2024-09-21T11:19:07.184 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T11:19:07.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T11:19:07.307 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913852 branch: wip-guits-main-2024-09-21-0813 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@ibm.com first_in_suite: false job_id: '7913852' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-21-0813 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-21-0813 sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3041 sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-21-0813 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 targets: smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4jDGVA2RRtiokHS8Olvdmg/qqyHioEucISbII2x+HNAdyUJaAG2HlqdeiLoKzX1tDOJNs3dWOGHeRnAWOrtME= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDS0YTgvgDpNydBRRb/VCxFrhe28El80WgUWpGqSgL9RCKrCgJULC6EVi9SapaWXz5w5kz3r7H/mhRj5eW79jbY= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_10:07:29 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-21T11:19:07.307 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa; will attempt to use it 2024-09-21T11:19:07.307 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks 2024-09-21T11:19:07.308 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T11:19:07.309 INFO:teuthology.task.internal:Checking packages... 2024-09-21T11:19:07.330 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5c1cdc3c470dae78e91a0ed2bcf13509a046d301' 2024-09-21T11:19:07.330 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T11:19:07.330 INFO:teuthology.packaging:ref: None 2024-09-21T11:19:07.330 INFO:teuthology.packaging:tag: None 2024-09-21T11:19:07.330 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-21-0813 2024-09-21T11:19:07.330 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:19:07.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-21-0813 2024-09-21T11:19:07.471 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5103.g5c1cdc3c 2024-09-21T11:19:07.473 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T11:19:07.478 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T11:19:07.478 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T11:19:07.529 INFO:teuthology.task.internal:Saving configuration 2024-09-21T11:19:07.549 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T11:19:07.564 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T11:19:07.588 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913852', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 11:13:21.695907', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4jDGVA2RRtiokHS8Olvdmg/qqyHioEucISbII2x+HNAdyUJaAG2HlqdeiLoKzX1tDOJNs3dWOGHeRnAWOrtME='} 2024-09-21T11:19:07.610 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913852', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 11:13:21.694413', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDS0YTgvgDpNydBRRb/VCxFrhe28El80WgUWpGqSgL9RCKrCgJULC6EVi9SapaWXz5w5kz3r7H/mhRj5eW79jbY='} 2024-09-21T11:19:07.610 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T11:19:07.630 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-21T11:19:07.630 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-21T11:19:07.631 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T11:19:07.706 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f238f848280>, signals=[15]) 2024-09-21T11:19:07.706 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T11:19:07.712 INFO:teuthology.task.internal:Opening connections... 2024-09-21T11:19:07.712 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:19:07.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:19:07.787 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T11:19:07.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:19:07.873 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T11:19:07.880 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-09-21T11:19:07.898 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-09-21T11:19:07.898 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-09-21T11:19:07.956 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-09-21T11:19:07.956 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-09-21T11:19:07.956 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-09-21T11:19:07.956 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-09-21T11:19:07.956 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-09-21T11:19:07.956 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-09-21T11:19:07.957 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T11:19:07.957 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-09-21T11:19:07.957 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-09-21T11:19:07.957 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T11:19:07.957 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-09-21T11:19:07.957 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T11:19:07.957 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T11:19:07.957 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T11:19:07.957 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-09-21T11:19:07.976 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-09-21T11:19:07.994 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-09-21T11:19:07.994 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-09-21T11:19:08.050 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T11:19:08.051 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T11:19:08.052 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T11:19:08.052 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-09-21T11:19:08.076 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T11:19:08.085 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T11:19:08.221 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T11:19:08.222 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2024-09-21T11:19:08.224 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-09-21T11:19:08.240 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T11:19:08.316 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T11:19:08.316 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2024-09-21T11:19:08.318 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-09-21T11:19:08.347 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T11:19:08.461 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T11:19:08.482 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T11:19:08.482 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T11:19:08.483 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T11:19:08.484 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T11:19:08.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T11:19:08.501 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-21T11:19:08.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T11:19:08.502 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-21T11:19:08.559 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-503.el9.x86_64 2024-09-21T11:19:08.559 INFO:teuthology.task.kernel:Running kernel on smithi118: 5.14.0-503.el9.x86_64 2024-09-21T11:19:08.560 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum install -y kernel 2024-09-21T11:19:08.560 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-503.el9.x86_64 2024-09-21T11:19:08.561 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.14.0-503.el9.x86_64 2024-09-21T11:19:08.561 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2024-09-21T11:19:11.040 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T11:19:11.184 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-21T11:19:12.666 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-21T11:19:14.444 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-21T11:19:18.593 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-21T11:19:19.266 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-21T11:19:20.219 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-21T11:19:21.132 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T11:19:21.725 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-21T11:19:22.805 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T11:19:26.521 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T11:19:28.293 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T11:19:28.410 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T11:19:28.410 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T11:19:28.509 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:19:28.520 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:19:28.520 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2024-09-21T11:19:28.520 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:19:28.520 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:19:28.520 INFO:teuthology.orchestra.run.smithi118.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout:Install 4 Packages 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 79 M 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 126 M 2024-09-21T11:19:28.521 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:19:28.880 INFO:teuthology.orchestra.run.smithi118.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 344 kB/s | 36 kB 00:00 2024-09-21T11:19:30.200 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T11:19:30.200 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T11:19:30.299 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:19:30.304 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:19:30.304 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-21T11:19:30.304 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:19:30.304 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-09-21T11:19:30.305 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:19:30.306 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 79 M 2024-09-21T11:19:30.306 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 126 M 2024-09-21T11:19:30.306 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:19:30.470 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 314 kB/s | 36 kB 00:00 2024-09-21T11:19:32.455 INFO:teuthology.orchestra.run.smithi118.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.3 MB/s | 16 MB 00:03 2024-09-21T11:19:33.170 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-09-21T11:19:35.469 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.7 MB/s | 29 MB 00:04 2024-09-21T11:19:36.580 INFO:teuthology.orchestra.run.smithi118.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.7 MB/s | 29 MB 00:07 2024-09-21T11:19:37.072 INFO:teuthology.orchestra.run.smithi118.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.2 MB/s | 35 MB 00:08 2024-09-21T11:19:37.072 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:19:37.072 INFO:teuthology.orchestra.run.smithi118.stdout:Total 9.2 MB/s | 79 MB 00:08 2024-09-21T11:19:37.545 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.8 MB/s | 35 MB 00:07 2024-09-21T11:19:37.545 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:19:37.545 INFO:teuthology.orchestra.run.smithi149.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-21T11:19:37.756 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:19:38.205 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:19:38.205 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:19:38.226 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:19:38.593 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:19:38.593 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:19:39.167 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:19:39.168 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:19:39.553 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:19:39.553 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:19:41.600 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:19:41.997 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:19:42.346 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T11:19:42.438 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T11:19:42.650 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T11:19:42.744 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T11:19:45.212 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T11:19:45.369 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T11:19:45.543 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T11:19:45.681 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T11:19:50.183 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T11:19:50.219 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:19:50.526 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T11:19:50.556 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:19:55.199 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:19:55.410 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:20:33.759 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:20:33.799 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:20:34.069 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:20:34.112 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:20:34.171 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:20:34.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T11:20:34.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T11:20:34.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T11:20:34.387 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:20:34.387 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T11:20:34.387 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T11:20:34.387 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T11:20:35.070 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:20:35.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:20:35.070 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:20:35.070 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.070 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.070 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.070 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:20:35.070 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:20:35.216 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T11:20:35.216 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:20:35.217 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:20:35.217 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.217 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.217 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.217 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.217 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:20:35.217 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:20:35.420 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T11:20:35.507 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.508 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T11:20:35.508 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T11:20:35.508 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T11:20:35.508 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T11:20:35.508 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-21T11:20:35.508 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T11:20:35.508 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T11:20:35.567 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.568 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T11:20:35.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-09-21T11:20:35.587 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T11:20:35.613 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-09-21T11:20:35.613 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-09-21T11:20:35.613 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-09-21T11:20:35.613 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 82.el9 2024-09-21T11:20:35.613 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-09-21T11:20:35.613 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8274670 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T11:20:35.614 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T11:20:35.615 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T11:20:35.615 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-09-21T11:20:35.615 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:20:35.615 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T11:20:35.615 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T11:20:35.616 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 5.14.0-508.el9.x86_64 2024-09-21T11:20:35.616 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T11:20:35.662 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.662 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T11:20:35.662 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T11:20:35.662 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T11:20:35.662 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T11:20:35.663 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-21T11:20:35.663 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T11:20:35.663 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T11:20:35.720 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T11:20:35.721 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T11:20:35.721 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2024-09-21T11:20:35.759 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.06 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 82.el9 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Group : Unspecified 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 8274670 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : builder@centos.org 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2024-09-21T11:20:35.760 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T11:20:35.761 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2024-09-21T11:20:35.761 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2024-09-21T11:20:35.761 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:20:35.761 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T11:20:35.761 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T11:20:35.761 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T11:20:35.761 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2024-09-21T11:20:35.761 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:20:35.761 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T11:20:35.762 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T11:20:35.762 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 5.14.0-508.el9.x86_64 2024-09-21T11:20:35.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T11:20:36.240 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-09-21T11:20:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2024-09-21T11:20:37.727 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[46223]) leaked on vgs invocation. Parent PID 22694: grub2-probe 2024-09-21T11:20:37.727 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[45385]) leaked on vgs invocation. Parent PID 22694: grub2-probe 2024-09-21T11:20:37.757 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[46223]) leaked on vgs invocation. Parent PID 22694: grub2-probe 2024-09-21T11:20:37.757 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[45385]) leaked on vgs invocation. Parent PID 22694: grub2-probe 2024-09-21T11:20:37.874 INFO:teuthology.orchestra.run.smithi118.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T11:20:37.892 INFO:teuthology.orchestra.run.smithi118.stderr:done 2024-09-21T11:20:37.894 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-09-21T11:20:37.932 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T11:20:37.949 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.YykhFpRjyE 2024-09-21T11:20:37.949 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YykhFpRjyE 2024-09-21T11:20:37.952 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-09-21T11:20:37.955 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-21T11:20:37.970 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.c8IyG728iX 2024-09-21T11:20:37.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.c8IyG728iX 2024-09-21T11:20:38.029 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.YykhFpRjyE 2024-09-21T11:20:38.037 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.c8IyG728iX 2024-09-21T11:20:38.165 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.YykhFpRjyE is 6KB 2024-09-21T11:20:38.166 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.c8IyG728iX is 6KB 2024-09-21T11:20:38.186 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.YykhFpRjyE 2024-09-21T11:20:38.200 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T11:20:38.214 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.c8IyG728iX 2024-09-21T11:20:38.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T11:20:38.272 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T11:20:38.272 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T11:20:38.272 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T11:20:38.272 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T11:20:38.273 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T11:20:38.297 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T11:20:38.297 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T11:20:38.297 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T11:20:38.297 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T11:20:38.298 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T11:20:38.440 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-09-21T11:20:38.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2024-09-21T11:21:08.469 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-21T11:21:08.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T11:21:08.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:21:08.471 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-21T11:21:08.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T11:21:08.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:21:27.023 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T11:21:27.023 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-21T11:21:36.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T11:21:36.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:21:36.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T11:21:36.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:21:39.091 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T11:21:39.091 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-21T11:21:51.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T11:21:51.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:21:51.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T11:21:51.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:21:54.159 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-21T11:22:09.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T11:22:09.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:22:09.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T11:22:24.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T11:22:24.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:22:24.875 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-21T11:22:25.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T11:22:25.283 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T11:22:25.283 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-21T11:22:25.298 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-508.el9.x86_64 2024-09-21T11:22:25.298 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T11:22:25.298 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T11:22:25.298 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T11:22:26.299 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-21T11:22:26.300 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T11:22:26.386 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2024-09-21T11:22:26.407 DEBUG:teuthology.parallel:result is None 2024-09-21T11:22:41.052 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-21T11:22:41.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T11:22:41.395 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T11:22:41.395 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-21T11:22:41.411 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-508.el9.x86_64 2024-09-21T11:22:41.411 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T11:22:41.412 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T11:22:41.412 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T11:22:42.412 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-21T11:22:42.412 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T11:22:42.485 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2024-09-21T11:22:42.506 DEBUG:teuthology.parallel:result is None 2024-09-21T11:22:42.506 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T11:22:42.512 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T11:22:42.513 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T11:22:42.515 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T11:22:42.536 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T11:22:42.696 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T11:22:42.755 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T11:22:42.755 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T11:22:42.758 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T11:22:42.862 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T11:22:42.868 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T11:22:42.869 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T11:22:42.871 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T11:22:42.904 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T11:22:42.907 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T11:22:42.916 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T11:22:42.919 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T11:22:42.920 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T11:22:43.005 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T11:22:43.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T11:22:43.008 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T11:22:43.036 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T11:22:43.123 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T11:22:43.123 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T11:22:43.126 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T11:22:43.143 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T11:22:43.225 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T11:22:43.283 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T11:22:43.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T11:22:43.408 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:22:43.409 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T11:22:43.474 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T11:22:43.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T11:22:43.584 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T11:22:43.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T11:22:43.672 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:22:43.672 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T11:22:43.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2024-09-21T11:22:43.743 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-09-21T11:22:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T11:22:43.836 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T11:22:44.295 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T11:22:44.303 INFO:teuthology.task.internal:Starting timer... 2024-09-21T11:22:44.303 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T11:22:44.377 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T11:22:44.446 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T11:22:44.446 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2024-09-21T11:22:44.502 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2024-09-21T11:22:44.504 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-09-21T11:22:44.561 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-09-21T11:22:44.563 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T11:22:44.563 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2024-09-21T11:22:44.606 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2024-09-21T11:22:44.606 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-09-21T11:22:44.646 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-09-21T11:22:44.646 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi118.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2024-09-21T11:22:44.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T11:22:44.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T11:22:44.673 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T11:22:44.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T11:22:44.712 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T11:22:44.712 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2024-09-21T11:22:44.742 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-09-21T11:22:44.781 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T11:22:44.791 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T11:22:44.793 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T11:22:44.912 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T11:22:44.922 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T11:22:44.923 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi118.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T11:26:32.380 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-09-21T11:26:32.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T11:26:32.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:26:32.456 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-21T11:26:32.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T11:26:32.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T11:26:32.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T11:26:32.575 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-21T11:26:32.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T11:26:32.658 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T11:26:32.673 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T11:26:32.674 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T11:26:32.674 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T11:26:32.676 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T11:26:32.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T11:26:32.703 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T11:26:32.718 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T11:26:32.729 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T11:26:32.742 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2024-09-21T11:26:32.743 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T11:26:32.753 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2024-09-21T11:26:32.767 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T11:26:32.769 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-09-21T11:26:32.780 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-09-21T11:26:32.781 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T11:26:32.795 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T11:26:32.808 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T11:26:32.843 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-21T11:26:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T11:26:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-21T11:26:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T11:26:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T11:26:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T11:26:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T11:26:32.866 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-21T11:26:32.869 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T11:26:32.869 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-21T11:26:32.869 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T11:26:32.869 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T11:26:32.869 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T11:26:32.869 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T11:26:32.870 INFO:teuthology.run_tasks:Running task install... 2024-09-21T11:26:32.878 DEBUG:teuthology.task.install:project ceph 2024-09-21T11:26:32.878 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'}} 2024-09-21T11:26:32.878 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'} 2024-09-21T11:26:32.878 INFO:teuthology.task.install:Using flavor: default 2024-09-21T11:26:32.884 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T11:26:32.884 INFO:teuthology.task.install:extra packages: [] 2024-09-21T11:26:32.884 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301', 'tag': None, 'wait_for_package': False} 2024-09-21T11:26:32.884 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T11:26:32.885 INFO:teuthology.packaging:ref: None 2024-09-21T11:26:32.885 INFO:teuthology.packaging:tag: None 2024-09-21T11:26:32.885 INFO:teuthology.packaging:branch: squid 2024-09-21T11:26:32.885 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:26:32.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T11:26:32.887 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301', 'tag': None, 'wait_for_package': False} 2024-09-21T11:26:32.887 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T11:26:32.887 INFO:teuthology.packaging:ref: None 2024-09-21T11:26:32.887 INFO:teuthology.packaging:tag: None 2024-09-21T11:26:32.887 INFO:teuthology.packaging:branch: squid 2024-09-21T11:26:32.887 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:26:32.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T11:26:33.109 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T11:26:33.109 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T11:26:33.129 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T11:26:33.129 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T11:26:33.221 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T11:26:33.221 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:26:33.221 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T11:26:33.235 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T11:26:33.235 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:26:33.235 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T11:26:33.247 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T11:26:33.247 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T11:26:33.247 INFO:teuthology.packaging:ref: None 2024-09-21T11:26:33.247 INFO:teuthology.packaging:tag: None 2024-09-21T11:26:33.247 INFO:teuthology.packaging:branch: squid 2024-09-21T11:26:33.247 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:26:33.247 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T11:26:33.262 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T11:26:33.262 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T11:26:33.262 INFO:teuthology.packaging:ref: None 2024-09-21T11:26:33.262 INFO:teuthology.packaging:tag: None 2024-09-21T11:26:33.262 INFO:teuthology.packaging:branch: squid 2024-09-21T11:26:33.262 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:26:33.262 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T11:26:33.313 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T11:26:33.328 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T11:26:33.387 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T11:26:33.403 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T11:26:33.452 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-09-21T11:26:33.454 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-09-21T11:26:33.467 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2024-09-21T11:26:33.469 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2024-09-21T11:26:33.689 INFO:teuthology.orchestra.run.smithi118.stdout:45 files removed 2024-09-21T11:26:33.690 INFO:teuthology.orchestra.run.smithi149.stdout:45 files removed 2024-09-21T11:26:33.716 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw 2024-09-21T11:26:33.717 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw 2024-09-21T11:26:34.280 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-21T11:26:34.284 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-21T11:26:34.568 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-21T11:26:34.589 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-09-21T11:26:34.843 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T11:26:34.881 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 7.4 kB/s | 1.9 kB 00:00 2024-09-21T11:26:35.600 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-21T11:26:37.493 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.3 MB 00:02 2024-09-21T11:26:39.586 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-21T11:26:44.087 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T11:26:45.671 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-21T11:26:46.459 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T11:26:47.802 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 1.8 MB/s | 20 MB 00:11 2024-09-21T11:26:52.040 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T11:26:53.616 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-21T11:26:54.283 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:26:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:26:54.302 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T11:26:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:26:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:26:54.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T11:26:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-09-21T11:26:54.302 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T11:26:54.302 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T11:26:54.303 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T11:26:54.304 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:Install 30 Packages 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 2 Packages 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:26:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 60 M 2024-09-21T11:26:54.306 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:26:54.949 INFO:teuthology.orchestra.run.smithi149.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 12 MB/s | 5.4 MB 00:00 2024-09-21T11:26:55.008 INFO:teuthology.orchestra.run.smithi149.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 432 kB/s | 25 kB 00:00 2024-09-21T11:26:55.100 INFO:teuthology.orchestra.run.smithi149.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 8.0 MB/s | 751 kB 00:00 2024-09-21T11:26:55.133 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-21T11:26:55.200 INFO:teuthology.orchestra.run.smithi149.stdout:(4/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 5.0 MB/s | 507 kB 00:00 2024-09-21T11:26:55.309 INFO:teuthology.orchestra.run.smithi149.stdout:(5/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 13 MB/s | 11 MB 00:00 2024-09-21T11:26:55.359 INFO:teuthology.orchestra.run.smithi149.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 910 kB/s | 45 kB 00:00 2024-09-21T11:26:55.451 INFO:teuthology.orchestra.run.smithi149.stdout:(7/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 21 MB/s | 5.3 MB 00:00 2024-09-21T11:26:55.476 INFO:teuthology.orchestra.run.smithi149.stdout:(8/32): python3-ceph-common-19.1.1-373.g4e45e6b 1.1 MB/s | 136 kB 00:00 2024-09-21T11:26:55.502 INFO:teuthology.orchestra.run.smithi149.stdout:(9/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 3.1 MB/s | 162 kB 00:00 2024-09-21T11:26:55.527 INFO:teuthology.orchestra.run.smithi149.stdout:(10/32): python3-rados-19.1.1-373.g4e45e6b4.el9 6.2 MB/s | 321 kB 00:00 2024-09-21T11:26:55.552 INFO:teuthology.orchestra.run.smithi149.stdout:(11/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 5.8 MB/s | 300 kB 00:00 2024-09-21T11:26:55.577 INFO:teuthology.orchestra.run.smithi149.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-21T11:26:55.794 INFO:teuthology.orchestra.run.smithi149.stdout:(13/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 16 MB/s | 21 MB 00:01 2024-09-21T11:26:55.836 INFO:teuthology.orchestra.run.smithi149.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 377 kB/s | 107 kB 00:00 2024-09-21T11:26:55.862 INFO:teuthology.orchestra.run.smithi149.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 564 kB/s | 160 kB 00:00 2024-09-21T11:26:55.887 INFO:teuthology.orchestra.run.smithi149.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-09-21T11:26:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 725 kB/s | 42 kB 00:00 2024-09-21T11:26:55.971 INFO:teuthology.orchestra.run.smithi149.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T11:26:56.005 INFO:teuthology.orchestra.run.smithi149.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.8 MB/s | 662 kB 00:00 2024-09-21T11:26:56.038 INFO:teuthology.orchestra.run.smithi149.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-21T11:26:56.063 INFO:teuthology.orchestra.run.smithi149.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 388 kB/s | 36 kB 00:00 2024-09-21T11:26:56.089 INFO:teuthology.orchestra.run.smithi149.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 564 kB/s | 47 kB 00:00 2024-09-21T11:26:56.121 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-21T11:26:56.147 INFO:teuthology.orchestra.run.smithi149.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T11:26:56.173 INFO:teuthology.orchestra.run.smithi149.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T11:26:56.198 INFO:teuthology.orchestra.run.smithi149.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 275 kB/s | 26 kB 00:00 2024-09-21T11:26:56.223 INFO:teuthology.orchestra.run.smithi149.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T11:26:56.248 INFO:teuthology.orchestra.run.smithi149.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T11:26:56.299 INFO:teuthology.orchestra.run.smithi149.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-21T11:26:56.341 INFO:teuthology.orchestra.run.smithi149.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T11:26:56.424 INFO:teuthology.orchestra.run.smithi149.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T11:26:56.525 INFO:teuthology.orchestra.run.smithi149.stdout:(31/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 15 MB/s | 3.4 MB 00:00 2024-09-21T11:26:56.583 INFO:teuthology.orchestra.run.smithi149.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 13 MB/s | 3.2 MB 00:00 2024-09-21T11:26:56.588 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:26:56.588 INFO:teuthology.orchestra.run.smithi149.stdout:Total 26 MB/s | 60 MB 00:02 2024-09-21T11:26:56.691 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:26:56.727 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:26:56.727 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:26:57.417 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:26:57.417 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:26:58.922 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:26:59.016 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T11:26:59.047 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T11:26:59.075 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T11:26:59.095 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T11:26:59.118 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T11:26:59.314 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T11:26:59.376 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T11:26:59.751 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T11:26:59.840 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T11:26:59.919 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T11:27:00.016 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T11:27:00.042 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T11:27:00.105 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T11:27:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T11:27:00.186 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T11:27:00.262 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T11:27:00.286 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T11:27:00.350 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T11:27:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T11:27:00.497 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T11:27:00.528 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T11:27:00.569 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T11:27:00.609 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T11:27:00.638 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T11:27:00.676 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T11:27:00.987 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T11:27:01.042 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T11:27:01.132 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T11:27:01.173 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T11:27:01.216 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T11:27:01.535 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T11:27:01.698 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T11:27:01.728 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T11:27:01.800 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T11:27:01.877 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T11:27:01.914 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T11:27:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:27:03.772 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:03.772 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T11:27:03.772 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:03.772 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T11:27:03.773 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T11:27:03.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout:Installing weak dependencies: 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout:Install 30 Packages 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 2 Packages 2024-09-21T11:27:03.775 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:03.776 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 60 M 2024-09-21T11:27:03.776 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:27:04.211 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T11:27:04.244 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T11:27:04.795 INFO:teuthology.orchestra.run.smithi118.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 9.2 MB/s | 5.4 MB 00:00 2024-09-21T11:27:04.815 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T11:27:04.828 INFO:teuthology.orchestra.run.smithi118.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 756 kB/s | 25 kB 00:00 2024-09-21T11:27:04.867 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T11:27:04.945 INFO:teuthology.orchestra.run.smithi118.stdout:(3/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 14 MB/s | 11 MB 00:00 2024-09-21T11:27:04.956 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T11:27:04.956 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T11:27:04.956 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T11:27:04.956 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:04.987 INFO:teuthology.orchestra.run.smithi118.stdout:(4/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 4.6 MB/s | 751 kB 00:00 2024-09-21T11:27:04.993 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T11:27:05.012 INFO:teuthology.orchestra.run.smithi118.stdout:(5/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 7.4 MB/s | 507 kB 00:00 2024-09-21T11:27:05.055 INFO:teuthology.orchestra.run.smithi118.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 1.1 MB/s | 45 kB 00:00 2024-09-21T11:27:05.138 INFO:teuthology.orchestra.run.smithi118.stdout:(7/32): python3-ceph-common-19.1.1-373.g4e45e6b 1.6 MB/s | 136 kB 00:00 2024-09-21T11:27:05.297 INFO:teuthology.orchestra.run.smithi118.stdout:(8/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 17 MB/s | 5.3 MB 00:00 2024-09-21T11:27:05.322 INFO:teuthology.orchestra.run.smithi118.stdout:(9/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 882 kB/s | 162 kB 00:00 2024-09-21T11:27:05.347 INFO:teuthology.orchestra.run.smithi118.stdout:(10/32): python3-rados-19.1.1-373.g4e45e6b4.el9 6.3 MB/s | 321 kB 00:00 2024-09-21T11:27:05.381 INFO:teuthology.orchestra.run.smithi118.stdout:(11/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 5.0 MB/s | 300 kB 00:00 2024-09-21T11:27:05.406 INFO:teuthology.orchestra.run.smithi118.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-21T11:27:05.615 INFO:teuthology.orchestra.run.smithi118.stdout:(13/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 15 MB/s | 21 MB 00:01 2024-09-21T11:27:05.699 INFO:teuthology.orchestra.run.smithi118.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 544 kB/s | 45 kB 00:00 2024-09-21T11:27:05.724 INFO:teuthology.orchestra.run.smithi118.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 312 kB/s | 107 kB 00:00 2024-09-21T11:27:05.749 INFO:teuthology.orchestra.run.smithi118.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 468 kB/s | 160 kB 00:00 2024-09-21T11:27:05.782 INFO:teuthology.orchestra.run.smithi118.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 42 kB 00:00 2024-09-21T11:27:05.808 INFO:teuthology.orchestra.run.smithi118.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-21T11:27:05.833 INFO:teuthology.orchestra.run.smithi118.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-21T11:27:05.858 INFO:teuthology.orchestra.run.smithi118.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 712 kB/s | 36 kB 00:00 2024-09-21T11:27:05.883 INFO:teuthology.orchestra.run.smithi118.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T11:27:05.917 INFO:teuthology.orchestra.run.smithi118.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-21T11:27:05.968 INFO:teuthology.orchestra.run.smithi118.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T11:27:05.993 INFO:teuthology.orchestra.run.smithi118.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-21T11:27:06.018 INFO:teuthology.orchestra.run.smithi118.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 300 kB/s | 26 kB 00:00 2024-09-21T11:27:06.044 INFO:teuthology.orchestra.run.smithi118.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T11:27:06.086 INFO:teuthology.orchestra.run.smithi118.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T11:27:06.144 INFO:teuthology.orchestra.run.smithi118.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-21T11:27:06.195 INFO:teuthology.orchestra.run.smithi118.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T11:27:06.270 INFO:teuthology.orchestra.run.smithi118.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-21T11:27:06.412 INFO:teuthology.orchestra.run.smithi118.stdout:(31/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 13 MB/s | 3.4 MB 00:00 2024-09-21T11:27:06.462 INFO:teuthology.orchestra.run.smithi118.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 12 MB/s | 3.2 MB 00:00 2024-09-21T11:27:06.467 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:06.467 INFO:teuthology.orchestra.run.smithi118.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-21T11:27:06.567 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:27:06.603 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:27:06.603 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:27:07.313 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:27:07.313 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:27:08.980 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:27:09.080 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T11:27:09.117 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T11:27:09.151 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T11:27:09.173 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T11:27:09.197 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T11:27:09.393 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T11:27:09.445 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T11:27:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T11:27:09.894 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T11:27:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T11:27:10.085 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T11:27:10.113 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T11:27:10.159 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T11:27:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T11:27:10.232 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T11:27:10.311 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T11:27:10.356 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T11:27:10.421 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T11:27:10.464 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T11:27:10.574 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T11:27:10.606 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T11:27:10.658 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T11:27:10.688 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T11:27:10.717 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T11:27:10.742 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T11:27:11.056 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T11:27:11.105 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T11:27:11.179 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T11:27:11.210 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T11:27:11.254 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T11:27:11.735 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T11:27:11.758 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T11:27:11.829 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T11:27:11.906 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T11:27:11.935 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T11:27:14.225 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T11:27:14.257 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T11:27:14.830 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T11:27:14.878 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T11:27:14.971 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T11:27:14.971 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T11:27:14.971 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T11:27:14.971 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:15.012 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T11:27:15.241 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T11:27:15.241 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-09-21T11:27:15.242 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-09-21T11:27:15.242 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-09-21T11:27:15.242 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-09-21T11:27:15.242 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-09-21T11:27:15.242 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-09-21T11:27:15.242 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-09-21T11:27:15.242 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:16.236 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T11:27:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T11:27:16.261 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:16.262 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T11:27:16.262 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T11:27:16.262 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T11:27:16.262 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:16.263 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T11:27:16.355 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T11:27:16.355 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T11:27:17.528 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T11:27:17.528 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T11:27:17.528 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T11:27:17.528 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T11:27:17.528 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T11:27:17.529 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T11:27:17.530 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T11:27:17.531 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T11:27:17.531 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T11:27:17.531 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T11:27:18.421 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T11:27:18.421 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:18.421 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-09-21T11:27:18.421 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.421 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.421 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T11:27:18.422 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T11:27:18.423 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T11:27:18.424 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T11:27:18.424 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T11:27:18.424 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T11:27:18.424 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:18.424 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:27:18.809 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-test 2024-09-21T11:27:19.401 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:27:19.538 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:27:19.539 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:19.539 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T11:27:19.539 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:19.539 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:27:19.539 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T11:27:19.539 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T11:27:19.540 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T11:27:19.540 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T11:27:19.540 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T11:27:19.540 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:19.540 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:27:19.540 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:19.540 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-09-21T11:27:19.540 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:19.540 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 49 M 2024-09-21T11:27:19.541 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 209 M 2024-09-21T11:27:19.541 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:27:19.795 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-21T11:27:19.837 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-21T11:27:19.878 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 700 kB/s | 163 kB 00:00 2024-09-21T11:27:21.145 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-21T11:27:21.147 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:21.147 INFO:teuthology.orchestra.run.smithi149.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-21T11:27:21.175 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:27:21.196 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:27:21.196 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:27:21.569 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:27:21.570 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:27:22.106 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:27:22.181 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T11:27:22.227 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T11:27:22.256 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T11:27:25.214 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T11:27:25.214 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2024-09-21T11:27:25.215 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2024-09-21T11:27:25.215 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2024-09-21T11:27:25.215 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2024-09-21T11:27:25.215 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2024-09-21T11:27:25.215 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /root 2024-09-21T11:27:25.215 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2024-09-21T11:27:25.215 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:26.175 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T11:27:26.202 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T11:27:26.202 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:26.202 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T11:27:26.202 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T11:27:26.202 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T11:27:26.202 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:26.203 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T11:27:26.303 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T11:27:26.303 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T11:27:26.884 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T11:27:26.962 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T11:27:27.744 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T11:27:27.745 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T11:27:27.746 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T11:27:28.729 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T11:27:28.729 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:28.729 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.730 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T11:27:28.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.732 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.732 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:28.732 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T11:27:28.732 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T11:27:28.732 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T11:27:28.732 INFO:teuthology.orchestra.run.smithi118.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T11:27:28.732 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T11:27:28.732 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:28.732 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:27:29.088 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-test 2024-09-21T11:27:29.339 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T11:27:29.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T11:27:29.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T11:27:29.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T11:27:29.672 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:27:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T11:27:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:29.702 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:27:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T11:27:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T11:27:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:29.703 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:27:29.809 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:27:29.810 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:29.811 INFO:teuthology.orchestra.run.smithi118.stdout:Install 4 Packages 2024-09-21T11:27:29.811 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:29.811 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 49 M 2024-09-21T11:27:29.811 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 209 M 2024-09-21T11:27:29.811 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:27:29.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph 2024-09-21T11:27:30.303 INFO:teuthology.orchestra.run.smithi118.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-21T11:27:30.337 INFO:teuthology.orchestra.run.smithi118.stdout:(2/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 667 kB/s | 163 kB 00:00 2024-09-21T11:27:30.362 INFO:teuthology.orchestra.run.smithi118.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T11:27:30.597 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:27:30.749 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:27:30.751 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T11:27:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T11:27:30.753 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T11:27:30.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T11:27:30.755 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T11:27:30.755 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:30.755 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:27:30.755 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:30.755 INFO:teuthology.orchestra.run.smithi149.stdout:Install 37 Packages 2024-09-21T11:27:30.755 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:30.755 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 30 M 2024-09-21T11:27:30.756 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 108 M 2024-09-21T11:27:30.756 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:27:31.450 INFO:teuthology.orchestra.run.smithi149.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 52 kB/s | 6.6 kB 00:00 2024-09-21T11:27:31.642 INFO:teuthology.orchestra.run.smithi149.stdout:(2/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 4.8 MB/s | 1.5 MB 00:00 2024-09-21T11:27:31.684 INFO:teuthology.orchestra.run.smithi149.stdout:(3/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 6.6 MB/s | 2.4 MB 00:00 2024-09-21T11:27:31.768 INFO:teuthology.orchestra.run.smithi149.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.9 MB/s | 249 kB 00:00 2024-09-21T11:27:31.993 INFO:teuthology.orchestra.run.smithi149.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-21T11:27:32.077 INFO:teuthology.orchestra.run.smithi149.stdout:(6/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 7.5 MB/s | 4.7 MB 00:00 2024-09-21T11:27:32.244 INFO:teuthology.orchestra.run.smithi149.stdout:(7/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 28 MB/s | 17 MB 00:00 2024-09-21T11:27:32.303 INFO:teuthology.orchestra.run.smithi118.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 22 MB/s | 49 MB 00:02 2024-09-21T11:27:32.306 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:32.306 INFO:teuthology.orchestra.run.smithi118.stdout:Total 20 MB/s | 49 MB 00:02 2024-09-21T11:27:32.334 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:27:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:27:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:27:32.378 INFO:teuthology.orchestra.run.smithi149.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 3.2 MB/s | 1.2 MB 00:00 2024-09-21T11:27:32.411 INFO:teuthology.orchestra.run.smithi149.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 319 kB/s | 106 kB 00:00 2024-09-21T11:27:32.436 INFO:teuthology.orchestra.run.smithi149.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.1 MB/s | 125 kB 00:00 2024-09-21T11:27:32.461 INFO:teuthology.orchestra.run.smithi149.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 622 kB/s | 135 kB 00:00 2024-09-21T11:27:32.504 INFO:teuthology.orchestra.run.smithi149.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-21T11:27:32.579 INFO:teuthology.orchestra.run.smithi149.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 464 kB/s | 35 kB 00:00 2024-09-21T11:27:32.613 INFO:teuthology.orchestra.run.smithi149.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-21T11:27:32.638 INFO:teuthology.orchestra.run.smithi149.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 936 kB/s | 188 kB 00:00 2024-09-21T11:27:32.671 INFO:teuthology.orchestra.run.smithi149.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 836 kB/s | 77 kB 00:00 2024-09-21T11:27:32.688 INFO:teuthology.orchestra.run.smithi149.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-21T11:27:32.705 INFO:teuthology.orchestra.run.smithi149.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 619 kB/s | 42 kB 00:00 2024-09-21T11:27:32.725 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:27:32.725 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:27:32.747 INFO:teuthology.orchestra.run.smithi149.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-21T11:27:32.772 INFO:teuthology.orchestra.run.smithi149.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 221 kB/s | 22 kB 00:00 2024-09-21T11:27:32.806 INFO:teuthology.orchestra.run.smithi149.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-21T11:27:32.831 INFO:teuthology.orchestra.run.smithi149.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 457 kB/s | 11 kB 00:00 2024-09-21T11:27:32.856 INFO:teuthology.orchestra.run.smithi149.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-21T11:27:32.882 INFO:teuthology.orchestra.run.smithi149.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-21T11:27:32.907 INFO:teuthology.orchestra.run.smithi149.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-21T11:27:32.932 INFO:teuthology.orchestra.run.smithi149.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-21T11:27:32.958 INFO:teuthology.orchestra.run.smithi149.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-21T11:27:32.983 INFO:teuthology.orchestra.run.smithi149.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-21T11:27:33.008 INFO:teuthology.orchestra.run.smithi149.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T11:27:33.034 INFO:teuthology.orchestra.run.smithi149.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-21T11:27:33.059 INFO:teuthology.orchestra.run.smithi149.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-21T11:27:33.093 INFO:teuthology.orchestra.run.smithi149.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-21T11:27:33.118 INFO:teuthology.orchestra.run.smithi149.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 611 kB/s | 36 kB 00:00 2024-09-21T11:27:33.143 INFO:teuthology.orchestra.run.smithi149.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-21T11:27:33.168 INFO:teuthology.orchestra.run.smithi149.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-21T11:27:33.193 INFO:teuthology.orchestra.run.smithi149.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T11:27:33.219 INFO:teuthology.orchestra.run.smithi149.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-21T11:27:33.222 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:33.222 INFO:teuthology.orchestra.run.smithi149.stdout:Total 12 MB/s | 30 MB 00:02 2024-09-21T11:27:33.257 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:27:33.331 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T11:27:33.368 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:27:33.369 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T11:27:33.397 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T11:27:33.408 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:27:33.408 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:27:33.906 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:27:33.906 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:27:35.256 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:27:35.335 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T11:27:35.363 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T11:27:35.400 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T11:27:35.470 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T11:27:35.516 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T11:27:35.557 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T11:27:35.649 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T11:27:35.729 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T11:27:35.770 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T11:27:35.805 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T11:27:35.835 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T11:27:35.870 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T11:27:35.903 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T11:27:35.944 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T11:27:35.987 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T11:27:36.021 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T11:27:36.070 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T11:27:36.102 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T11:27:36.178 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T11:27:36.329 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T11:27:36.419 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T11:27:36.471 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T11:27:36.519 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T11:27:36.568 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T11:27:36.622 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T11:27:36.808 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T11:27:36.864 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T11:27:36.951 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T11:27:37.048 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T11:27:37.088 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T11:27:37.205 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T11:27:37.360 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T11:27:37.391 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T11:27:37.417 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T11:27:37.418 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:37.418 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T11:27:37.418 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T11:27:37.418 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T11:27:37.418 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:38.000 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T11:27:38.089 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T11:27:38.875 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T11:27:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T11:27:38.903 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:38.903 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T11:27:38.903 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T11:27:38.903 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T11:27:38.903 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T11:27:39.366 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T11:27:39.366 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:39.366 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T11:27:39.366 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T11:27:39.366 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T11:27:39.367 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:39.593 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T11:27:39.616 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T11:27:39.616 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:39.616 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T11:27:39.617 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T11:27:39.617 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T11:27:39.617 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:39.682 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T11:27:40.582 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T11:27:40.582 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T11:27:40.582 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T11:27:40.582 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T11:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T11:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T11:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T11:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:27:41.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph 2024-09-21T11:27:41.609 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T11:27:41.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T11:27:41.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T11:27:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T11:27:41.748 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:00:40 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:27:41.894 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:27:41.896 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T11:27:41.897 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T11:27:41.898 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T11:27:41.899 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T11:27:41.900 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T11:27:41.900 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T11:27:41.900 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T11:27:41.900 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:41.900 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:27:41.900 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:41.900 INFO:teuthology.orchestra.run.smithi118.stdout:Install 37 Packages 2024-09-21T11:27:41.900 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:41.901 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 30 M 2024-09-21T11:27:41.901 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 108 M 2024-09-21T11:27:41.901 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:27:42.632 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T11:27:42.632 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:42.632 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:27:42.632 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:42.632 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:42.632 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:42.632 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:27:42.632 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:42.632 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T11:27:42.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T11:27:42.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:42.635 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:27:42.723 INFO:teuthology.orchestra.run.smithi118.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 47 kB/s | 6.6 kB 00:00 2024-09-21T11:27:42.881 INFO:teuthology.orchestra.run.smithi118.stdout:(2/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 5.1 MB/s | 1.5 MB 00:00 2024-09-21T11:27:42.956 INFO:teuthology.orchestra.run.smithi118.stdout:(3/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 6.4 MB/s | 2.4 MB 00:00 2024-09-21T11:27:43.035 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-base 2024-09-21T11:27:43.048 INFO:teuthology.orchestra.run.smithi118.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.7 MB/s | 249 kB 00:00 2024-09-21T11:27:43.124 INFO:teuthology.orchestra.run.smithi118.stdout:(5/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-21T11:27:43.274 INFO:teuthology.orchestra.run.smithi118.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-21T11:27:43.508 INFO:teuthology.orchestra.run.smithi118.stdout:(7/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 27 MB/s | 17 MB 00:00 2024-09-21T11:27:43.533 INFO:teuthology.orchestra.run.smithi118.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 412 kB/s | 106 kB 00:00 2024-09-21T11:27:43.591 INFO:teuthology.orchestra.run.smithi118.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 2.6 MB/s | 1.2 MB 00:00 2024-09-21T11:27:43.617 INFO:teuthology.orchestra.run.smithi118.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 125 kB 00:00 2024-09-21T11:27:43.637 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:27:43.642 INFO:teuthology.orchestra.run.smithi118.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-21T11:27:43.667 INFO:teuthology.orchestra.run.smithi118.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 847 kB/s | 135 kB 00:00 2024-09-21T11:27:43.727 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:27:43.734 INFO:teuthology.orchestra.run.smithi118.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 521 kB/s | 35 kB 00:00 2024-09-21T11:27:43.760 INFO:teuthology.orchestra.run.smithi118.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-21T11:27:43.769 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:27:43.770 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T11:27:43.770 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:27:43.785 INFO:teuthology.orchestra.run.smithi118.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-21T11:27:43.810 INFO:teuthology.orchestra.run.smithi118.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-21T11:27:43.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install cephadm 2024-09-21T11:27:43.836 INFO:teuthology.orchestra.run.smithi118.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-09-21T11:27:43.861 INFO:teuthology.orchestra.run.smithi118.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-09-21T11:27:43.903 INFO:teuthology.orchestra.run.smithi118.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-21T11:27:43.928 INFO:teuthology.orchestra.run.smithi118.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-21T11:27:43.962 INFO:teuthology.orchestra.run.smithi118.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-21T11:27:43.987 INFO:teuthology.orchestra.run.smithi118.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 460 kB/s | 11 kB 00:00 2024-09-21T11:27:44.029 INFO:teuthology.orchestra.run.smithi118.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T11:27:44.054 INFO:teuthology.orchestra.run.smithi118.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 264 kB/s | 18 kB 00:00 2024-09-21T11:27:44.079 INFO:teuthology.orchestra.run.smithi118.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 942 kB/s | 23 kB 00:00 2024-09-21T11:27:44.105 INFO:teuthology.orchestra.run.smithi118.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-21T11:27:44.130 INFO:teuthology.orchestra.run.smithi118.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-21T11:27:44.147 INFO:teuthology.orchestra.run.smithi118.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-09-21T11:27:44.172 INFO:teuthology.orchestra.run.smithi118.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-21T11:27:44.206 INFO:teuthology.orchestra.run.smithi118.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-21T11:27:44.223 INFO:teuthology.orchestra.run.smithi118.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-21T11:27:44.252 INFO:teuthology.orchestra.run.smithi118.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.2 MB/s | 36 kB 00:00 2024-09-21T11:27:44.277 INFO:teuthology.orchestra.run.smithi118.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-21T11:27:44.344 INFO:teuthology.orchestra.run.smithi118.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-21T11:27:44.370 INFO:teuthology.orchestra.run.smithi118.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-21T11:27:44.395 INFO:teuthology.orchestra.run.smithi118.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-21T11:27:44.420 INFO:teuthology.orchestra.run.smithi118.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.9 MB/s | 427 kB 00:00 2024-09-21T11:27:44.424 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:44.424 INFO:teuthology.orchestra.run.smithi118.stdout:Total 12 MB/s | 30 MB 00:02 2024-09-21T11:27:44.424 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:27:44.562 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:27:44.562 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 765 k 2024-09-21T11:27:44.563 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 772 k 2024-09-21T11:27:44.564 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:27:44.572 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:27:44.613 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:27:44.613 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:27:44.828 INFO:teuthology.orchestra.run.smithi149.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-21T11:27:44.828 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:44.829 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-21T11:27:44.829 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:27:44.834 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:27:44.834 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:27:44.840 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:27:44.841 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:27:44.911 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:27:45.075 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:27:45.076 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:27:45.331 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T11:27:45.415 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T11:27:45.765 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T11:27:46.034 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T11:27:46.034 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:46.034 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:27:46.034 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:27:46.034 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:46.034 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:27:46.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T11:27:46.438 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:27:46.531 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T11:27:46.585 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T11:27:46.617 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T11:27:46.687 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T11:27:46.749 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T11:27:46.782 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T11:27:46.847 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:27:46.872 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T11:27:46.944 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T11:27:46.985 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T11:27:46.985 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T11:27:46.986 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:46.987 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 145 k 2024-09-21T11:27:46.987 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 435 k 2024-09-21T11:27:46.987 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:27:47.020 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T11:27:47.050 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T11:27:47.084 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T11:27:47.110 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T11:27:47.150 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T11:27:47.185 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T11:27:47.201 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 677 kB/s | 145 kB 00:00 2024-09-21T11:27:47.202 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:47.202 INFO:teuthology.orchestra.run.smithi149.stdout:Total 672 kB/s | 145 kB 00:00 2024-09-21T11:27:47.202 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:27:47.210 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:27:47.210 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:27:47.220 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T11:27:47.267 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:27:47.267 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:27:47.268 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T11:27:47.300 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T11:27:47.372 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T11:27:47.412 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:27:47.477 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T11:27:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T11:27:47.502 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:47.502 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T11:27:47.502 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:47.512 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T11:27:47.591 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T11:27:47.653 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T11:27:47.692 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T11:27:47.763 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T11:27:47.817 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T11:27:48.005 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T11:27:48.052 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T11:27:48.163 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T11:27:48.251 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T11:27:48.292 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T11:27:48.409 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T11:27:48.432 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T11:27:48.432 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:48.432 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:27:48.432 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:48.432 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:48.432 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:27:48.568 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T11:27:48.622 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T11:27:48.648 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T11:27:48.648 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:48.648 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T11:27:48.648 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T11:27:48.649 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T11:27:48.649 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:48.672 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr 2024-09-21T11:27:49.282 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:27:49.373 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:27:49.415 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:27:49.417 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T11:27:49.417 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:27:49.481 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T11:27:50.065 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:27:50.098 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T11:27:50.125 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T11:27:50.125 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:50.125 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T11:27:50.125 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T11:27:50.125 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T11:27:50.126 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:50.199 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:27:50.200 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T11:27:50.200 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:50.200 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:27:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T11:27:50.200 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T11:27:50.200 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout:Install 12 Packages 2024-09-21T11:27:50.201 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:50.202 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 8.7 M 2024-09-21T11:27:50.202 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 105 M 2024-09-21T11:27:50.202 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:27:50.591 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T11:27:50.615 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T11:27:50.615 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:50.615 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T11:27:50.615 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T11:27:50.615 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T11:27:50.615 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:50.849 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T11:27:50.873 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T11:27:50.873 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:50.873 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T11:27:50.873 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T11:27:50.873 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T11:27:50.873 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:50.930 INFO:teuthology.orchestra.run.smithi149.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 204 kB/s | 32 kB 00:00 2024-09-21T11:27:50.937 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T11:27:50.955 INFO:teuthology.orchestra.run.smithi149.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 91 kB/s | 16 kB 00:00 2024-09-21T11:27:51.172 INFO:teuthology.orchestra.run.smithi149.stdout:(3/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 9.0 MB/s | 3.6 MB 00:00 2024-09-21T11:27:51.323 INFO:teuthology.orchestra.run.smithi149.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 6.2 MB/s | 863 kB 00:00 2024-09-21T11:27:51.381 INFO:teuthology.orchestra.run.smithi149.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-21T11:27:51.398 INFO:teuthology.orchestra.run.smithi149.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-21T11:27:51.457 INFO:teuthology.orchestra.run.smithi149.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 35 MB/s | 2.0 MB 00:00 2024-09-21T11:27:51.482 INFO:teuthology.orchestra.run.smithi149.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-21T11:27:51.507 INFO:teuthology.orchestra.run.smithi149.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T11:27:51.533 INFO:teuthology.orchestra.run.smithi149.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-21T11:27:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:(11/12): python3-protobuf-3.14.0-13.el9.noarch. 316 kB/s | 269 kB 00:00 2024-09-21T11:27:51.875 INFO:teuthology.orchestra.run.smithi149.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-21T11:27:51.880 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:51.880 INFO:teuthology.orchestra.run.smithi149.stdout:Total 5.2 MB/s | 8.7 MB 00:01 2024-09-21T11:27:51.930 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:27:51.949 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:27:51.949 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:27:52.157 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:27:52.158 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:27:52.696 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:27:52.775 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T11:27:52.819 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T11:27:52.873 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T11:27:52.913 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T11:27:53.028 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T11:27:53.155 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T11:27:53.165 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T11:27:53.166 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T11:27:53.167 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T11:27:53.167 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T11:27:53.167 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T11:27:53.167 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T11:27:53.167 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T11:27:53.168 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T11:27:53.168 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T11:27:53.168 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T11:27:53.168 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T11:27:53.168 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T11:27:53.168 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T11:27:53.168 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T11:27:53.168 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T11:27:53.169 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T11:27:53.240 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T11:27:53.284 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T11:27:53.321 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T11:27:53.352 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T11:27:54.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T11:27:54.338 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:54.338 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:27:54.338 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:54.338 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:54.338 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:54.338 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:27:54.338 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:54.338 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T11:27:54.339 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T11:27:54.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T11:27:54.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T11:27:54.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T11:27:54.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T11:27:54.341 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:54.341 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:27:54.416 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T11:27:54.462 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T11:27:54.723 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-base 2024-09-21T11:27:55.304 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:27:55.393 INFO:teuthology.orchestra.run.smithi118.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:27:55.436 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:27:55.437 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2024-09-21T11:27:55.437 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:27:55.521 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install cephadm 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T11:27:55.888 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T11:27:55.889 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T11:27:55.889 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T11:27:56.102 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:27:56.205 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T11:27:56.205 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:56.205 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:27:56.205 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T11:27:56.205 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:27:56.205 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:27:56.205 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:27:56.205 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T11:27:56.205 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T11:27:56.206 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T11:27:56.206 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T11:27:56.206 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T11:27:56.206 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T11:27:56.206 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T11:27:56.206 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T11:27:56.206 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:56.206 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:27:56.233 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout:Install 1 Package 2024-09-21T11:27:56.234 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:56.235 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 765 k 2024-09-21T11:27:56.235 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 772 k 2024-09-21T11:27:56.235 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:27:56.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T11:27:56.500 INFO:teuthology.orchestra.run.smithi118.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-21T11:27:56.500 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:56.501 INFO:teuthology.orchestra.run.smithi118.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-21T11:27:56.501 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:27:56.506 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:27:56.506 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:27:56.512 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:27:56.513 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:27:56.589 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:27:56.994 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T11:27:57.051 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:06 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:27:57.088 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T11:27:57.184 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:27:57.185 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-21T11:27:57.185 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T11:27:57.185 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-21T11:27:57.185 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:27:57.185 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T11:27:57.185 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T11:27:57.185 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:27:57.186 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-21T11:27:57.187 INFO:teuthology.orchestra.run.smithi149.stdout:Install 12 Packages 2024-09-21T11:27:57.187 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:27:57.187 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 38 M 2024-09-21T11:27:57.187 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 212 M 2024-09-21T11:27:57.187 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:27:57.454 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T11:27:57.484 INFO:teuthology.orchestra.run.smithi149.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 934 kB/s | 191 kB 00:00 2024-09-21T11:27:57.542 INFO:teuthology.orchestra.run.smithi149.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-09-21T11:27:57.659 INFO:teuthology.orchestra.run.smithi149.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.1 MB/s | 801 kB 00:00 2024-09-21T11:27:57.723 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T11:27:57.723 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:57.723 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:27:57.723 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:27:57.723 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:57.723 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:27:57.759 INFO:teuthology.orchestra.run.smithi149.stdout:(4/12): ceph-mgr-diskprediction-local-19.1.1-37 15 MB/s | 7.4 MB 00:00 2024-09-21T11:27:57.818 INFO:teuthology.orchestra.run.smithi149.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 115 kB/s | 18 kB 00:00 2024-09-21T11:27:57.843 INFO:teuthology.orchestra.run.smithi149.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-21T11:27:57.893 INFO:teuthology.orchestra.run.smithi149.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.5 MB/s | 3.0 MB 00:00 2024-09-21T11:27:57.913 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T11:27:57.977 INFO:teuthology.orchestra.run.smithi149.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-21T11:27:58.052 INFO:teuthology.orchestra.run.smithi149.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-21T11:27:58.086 INFO:teuthology.orchestra.run.smithi149.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.3 MB/s | 250 kB 00:00 2024-09-21T11:27:58.161 INFO:teuthology.orchestra.run.smithi149.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 14 MB/s | 4.9 MB 00:00 2024-09-21T11:27:58.428 INFO:teuthology.orchestra.run.smithi149.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-09-21T11:27:58.429 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:58.429 INFO:teuthology.orchestra.run.smithi149.stdout:Total 31 MB/s | 38 MB 00:01 2024-09-21T11:27:58.508 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:27:58.645 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:27:58.646 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:58.646 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repo Size 2024-09-21T11:27:58.646 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:58.646 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:27:58.646 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T11:27:58.646 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:58.646 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:27:58.646 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:27:58.647 INFO:teuthology.orchestra.run.smithi118.stdout:Install 1 Package 2024-09-21T11:27:58.647 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:58.647 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 145 k 2024-09-21T11:27:58.647 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 435 k 2024-09-21T11:27:58.647 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:27:58.777 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:27:58.803 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:27:58.803 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:27:58.865 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 665 kB/s | 145 kB 00:00 2024-09-21T11:27:58.866 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:27:58.866 INFO:teuthology.orchestra.run.smithi118.stdout:Total 660 kB/s | 145 kB 00:00 2024-09-21T11:27:58.866 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:27:58.873 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:27:58.873 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:27:58.931 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:27:58.931 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:27:59.074 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:27:59.149 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T11:27:59.174 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T11:27:59.174 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:27:59.174 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T11:27:59.174 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:27:59.233 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:27:59.233 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:27:59.998 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:28:00.075 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T11:28:00.118 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T11:28:00.183 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T11:28:00.183 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:00.183 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:00.183 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:00.184 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:00.184 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:00.220 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T11:28:00.262 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T11:28:00.418 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-mgr 2024-09-21T11:28:00.447 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T11:28:00.477 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T11:28:00.554 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T11:28:01.012 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:01.101 INFO:teuthology.orchestra.run.smithi118.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:01.143 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:01.144 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2024-09-21T11:28:01.144 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:01.207 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T11:28:01.215 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T11:28:01.341 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T11:28:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T11:28:01.933 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:Install 12 Packages 2024-09-21T11:28:01.934 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 8.7 M 2024-09-21T11:28:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 105 M 2024-09-21T11:28:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:02.186 INFO:teuthology.orchestra.run.smithi118.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 213 kB/s | 32 kB 00:00 2024-09-21T11:28:02.203 INFO:teuthology.orchestra.run.smithi118.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 99 kB/s | 16 kB 00:00 2024-09-21T11:28:02.329 INFO:teuthology.orchestra.run.smithi118.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-21T11:28:02.387 INFO:teuthology.orchestra.run.smithi118.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-21T11:28:02.463 INFO:teuthology.orchestra.run.smithi118.stdout:(5/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 8.4 MB/s | 3.6 MB 00:00 2024-09-21T11:28:02.505 INFO:teuthology.orchestra.run.smithi118.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.6 MB/s | 548 kB 00:00 2024-09-21T11:28:02.538 INFO:teuthology.orchestra.run.smithi118.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 264 kB/s | 19 kB 00:00 2024-09-21T11:28:02.572 INFO:teuthology.orchestra.run.smithi118.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-21T11:28:02.597 INFO:teuthology.orchestra.run.smithi118.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T11:28:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T11:28:02.648 INFO:teuthology.orchestra.run.smithi118.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 14 MB/s | 2.0 MB 00:00 2024-09-21T11:28:02.673 INFO:teuthology.orchestra.run.smithi118.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T11:28:03.115 INFO:teuthology.orchestra.run.smithi118.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.1 MB/s | 863 kB 00:00 2024-09-21T11:28:03.118 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:03.118 INFO:teuthology.orchestra.run.smithi118.stdout:Total 7.3 MB/s | 8.7 MB 00:01 2024-09-21T11:28:03.167 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:03.184 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:03.184 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:03.386 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:03.386 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:03.643 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T11:28:03.677 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T11:28:03.971 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:04.082 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T11:28:04.126 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T11:28:04.172 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T11:28:04.203 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T11:28:04.325 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T11:28:04.454 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T11:28:04.548 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T11:28:04.591 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T11:28:04.620 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T11:28:04.651 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T11:28:05.716 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T11:28:05.777 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T11:28:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T11:28:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T11:28:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T11:28:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T11:28:06.216 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T11:28:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T11:28:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T11:28:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T11:28:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T11:28:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T11:28:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T11:28:06.217 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T11:28:06.596 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T11:28:06.597 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T11:28:06.598 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T11:28:06.598 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T11:28:06.598 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:06.598 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:06.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-rook 2024-09-21T11:28:07.261 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T11:28:07.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T11:28:07.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T11:28:07.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T11:28:07.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T11:28:07.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T11:28:07.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T11:28:07.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T11:28:07.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T11:28:07.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T11:28:07.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T11:28:07.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T11:28:07.564 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T11:28:07.565 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T11:28:07.565 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T11:28:07.565 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T11:28:07.565 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T11:28:07.565 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:07.565 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:07.566 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:16 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:07.701 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:07.702 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T11:28:07.702 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:07.703 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:28:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T11:28:07.703 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T11:28:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T11:28:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T11:28:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T11:28:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T11:28:07.703 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T11:28:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T11:28:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T11:28:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T11:28:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T11:28:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T11:28:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T11:28:07.704 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T11:28:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:07.705 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:28:07.705 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:07.705 INFO:teuthology.orchestra.run.smithi149.stdout:Install 13 Packages 2024-09-21T11:28:07.705 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:07.706 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 2.2 M 2024-09-21T11:28:07.706 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 26 M 2024-09-21T11:28:07.706 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:28:07.819 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T11:28:08.262 INFO:teuthology.orchestra.run.smithi149.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 193 kB/s | 19 kB 00:00 2024-09-21T11:28:08.279 INFO:teuthology.orchestra.run.smithi149.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 220 kB/s | 26 kB 00:00 2024-09-21T11:28:08.312 INFO:teuthology.orchestra.run.smithi149.stdout:(3/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 328 kB/s | 49 kB 00:00 2024-09-21T11:28:08.396 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:07 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:08.397 INFO:teuthology.orchestra.run.smithi149.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T11:28:08.421 INFO:teuthology.orchestra.run.smithi149.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-21T11:28:08.447 INFO:teuthology.orchestra.run.smithi149.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T11:28:08.498 INFO:teuthology.orchestra.run.smithi149.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-21T11:28:08.523 INFO:teuthology.orchestra.run.smithi149.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 319 kB/s | 32 kB 00:00 2024-09-21T11:28:08.529 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:08.530 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================== 2024-09-21T11:28:08.530 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T11:28:08.530 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================== 2024-09-21T11:28:08.530 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:08.530 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T11:28:08.530 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T11:28:08.530 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T11:28:08.530 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T11:28:08.530 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================== 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout:Install 12 Packages 2024-09-21T11:28:08.531 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:08.532 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 38 M 2024-09-21T11:28:08.532 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 212 M 2024-09-21T11:28:08.532 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:08.556 INFO:teuthology.orchestra.run.smithi149.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 129 kB/s | 14 kB 00:00 2024-09-21T11:28:08.582 INFO:teuthology.orchestra.run.smithi149.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-21T11:28:08.607 INFO:teuthology.orchestra.run.smithi149.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-21T11:28:08.632 INFO:teuthology.orchestra.run.smithi149.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-21T11:28:08.674 INFO:teuthology.orchestra.run.smithi149.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.1 MB/s | 1.0 MB 00:00 2024-09-21T11:28:08.677 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:08.677 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-21T11:28:08.750 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:28:08.766 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:28:08.766 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:28:08.860 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:28:08.861 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:28:08.890 INFO:teuthology.orchestra.run.smithi118.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 948 kB/s | 191 kB 00:00 2024-09-21T11:28:08.982 INFO:teuthology.orchestra.run.smithi118.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-21T11:28:09.007 INFO:teuthology.orchestra.run.smithi118.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-21T11:28:09.058 INFO:teuthology.orchestra.run.smithi118.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-21T11:28:09.166 INFO:teuthology.orchestra.run.smithi118.stdout:(5/12): ceph-mgr-diskprediction-local-19.1.1-37 15 MB/s | 7.4 MB 00:00 2024-09-21T11:28:09.192 INFO:teuthology.orchestra.run.smithi118.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 288 kB/s | 38 kB 00:00 2024-09-21T11:28:09.309 INFO:teuthology.orchestra.run.smithi118.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T11:28:09.369 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:28:09.492 INFO:teuthology.orchestra.run.smithi118.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-21T11:28:09.539 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T11:28:09.568 INFO:teuthology.orchestra.run.smithi118.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2024-09-21T11:28:09.601 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T11:28:09.651 INFO:teuthology.orchestra.run.smithi118.stdout:(10/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 4.5 MB/s | 3.0 MB 00:00 2024-09-21T11:28:09.656 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T11:28:09.676 INFO:teuthology.orchestra.run.smithi118.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.3 MB/s | 250 kB 00:00 2024-09-21T11:28:09.695 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T11:28:09.735 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T11:28:09.837 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T11:28:09.939 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T11:28:09.977 INFO:teuthology.orchestra.run.smithi118.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-21T11:28:09.978 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:09.978 INFO:teuthology.orchestra.run.smithi118.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-21T11:28:09.995 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T11:28:10.333 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:10.725 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T11:28:10.767 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T11:28:10.801 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T11:28:10.808 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:10.808 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:10.849 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T11:28:10.887 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T11:28:11.595 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:11.673 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T11:28:11.674 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T11:28:11.674 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T11:28:11.674 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T11:28:11.674 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T11:28:11.674 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T11:28:11.674 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T11:28:11.674 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T11:28:11.674 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T11:28:11.675 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T11:28:11.675 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T11:28:11.675 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T11:28:11.675 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T11:28:11.743 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T11:28:11.791 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T11:28:11.892 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T11:28:11.943 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T11:28:12.004 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T11:28:12.004 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:12.004 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:28:12.004 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:28:12.004 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T11:28:12.004 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:12.005 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:12.121 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T11:28:12.159 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T11:28:12.236 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T11:28:12.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T11:28:12.869 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:21 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:12.911 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T11:28:13.004 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:13.005 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:13.005 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T11:28:13.005 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:13.005 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:28:13.005 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T11:28:13.005 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T11:28:13.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T11:28:13.005 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T11:28:13.006 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T11:28:13.006 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T11:28:13.006 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T11:28:13.006 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:13.006 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:28:13.006 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:13.006 INFO:teuthology.orchestra.run.smithi149.stdout:Install 6 Packages 2024-09-21T11:28:13.006 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:13.007 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 7.0 M 2024-09-21T11:28:13.007 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 33 M 2024-09-21T11:28:13.007 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:28:13.048 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T11:28:13.310 INFO:teuthology.orchestra.run.smithi149.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-21T11:28:13.360 INFO:teuthology.orchestra.run.smithi149.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-21T11:28:13.386 INFO:teuthology.orchestra.run.smithi149.stdout:(3/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 660 kB/s | 146 kB 00:00 2024-09-21T11:28:13.411 INFO:teuthology.orchestra.run.smithi149.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T11:28:13.461 INFO:teuthology.orchestra.run.smithi149.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 990 kB/s | 74 kB 00:00 2024-09-21T11:28:13.536 INFO:teuthology.orchestra.run.smithi149.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T11:28:13.539 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:13.539 INFO:teuthology.orchestra.run.smithi149.stdout:Total 13 MB/s | 7.0 MB 00:00 2024-09-21T11:28:13.610 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:28:13.621 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:28:13.621 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:28:13.723 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:28:13.723 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:28:14.053 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:28:14.229 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T11:28:14.287 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T11:28:14.297 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T11:28:14.833 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T11:28:14.915 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T11:28:14.988 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T11:28:15.026 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T11:28:15.358 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T11:28:15.410 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T11:28:15.817 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T11:28:15.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T11:28:15.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T11:28:15.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T11:28:15.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T11:28:15.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T11:28:16.093 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:16.094 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:16.352 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-fuse 2024-09-21T11:28:16.945 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:25 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:17.080 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:28:17.081 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:17.082 INFO:teuthology.orchestra.run.smithi149.stdout:Install 2 Packages 2024-09-21T11:28:17.082 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:17.082 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 976 k 2024-09-21T11:28:17.082 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 2.9 M 2024-09-21T11:28:17.082 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:28:17.297 INFO:teuthology.orchestra.run.smithi149.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 720 kB/s | 80 kB 00:00 2024-09-21T11:28:17.464 INFO:teuthology.orchestra.run.smithi149.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-21T11:28:17.465 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:17.465 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.5 MB/s | 976 kB 00:00 2024-09-21T11:28:17.477 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:28:17.500 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:28:17.500 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:28:17.583 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:28:17.583 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:28:17.770 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:28:17.909 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T11:28:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T11:28:18.429 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T11:28:18.648 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T11:28:18.649 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T11:28:18.907 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T11:28:18.908 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T11:28:18.908 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T11:28:18.908 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T11:28:18.908 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T11:28:18.908 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:18.908 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:18.927 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T11:28:18.927 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:18.927 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:28:18.927 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T11:28:18.928 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:18.928 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:19.204 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados-devel 2024-09-21T11:28:19.307 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-mgr-rook 2024-09-21T11:28:19.816 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:19.901 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:18 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:19.951 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:19.951 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:19.951 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-21T11:28:19.951 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 127 k 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 456 k 2024-09-21T11:28:19.952 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:28:20.033 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:20.034 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:20.034 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T11:28:20.034 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:20.034 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:20.034 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T11:28:20.035 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T11:28:20.035 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T11:28:20.035 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T11:28:20.035 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T11:28:20.035 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T11:28:20.035 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T11:28:20.035 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T11:28:20.035 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T11:28:20.036 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T11:28:20.036 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T11:28:20.036 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T11:28:20.036 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T11:28:20.036 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T11:28:20.036 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:20.036 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:20.036 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:20.036 INFO:teuthology.orchestra.run.smithi118.stdout:Install 13 Packages 2024-09-21T11:28:20.037 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:20.037 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 2.2 M 2024-09-21T11:28:20.037 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 26 M 2024-09-21T11:28:20.037 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:20.160 INFO:teuthology.orchestra.run.smithi149.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 608 kB/s | 127 kB 00:00 2024-09-21T11:28:20.161 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:20.161 INFO:teuthology.orchestra.run.smithi149.stdout:Total 604 kB/s | 127 kB 00:00 2024-09-21T11:28:20.161 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:28:20.167 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:28:20.167 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:28:20.231 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:28:20.232 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:28:20.287 INFO:teuthology.orchestra.run.smithi118.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 255 kB/s | 19 kB 00:00 2024-09-21T11:28:20.329 INFO:teuthology.orchestra.run.smithi118.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 218 kB/s | 26 kB 00:00 2024-09-21T11:28:20.371 INFO:teuthology.orchestra.run.smithi118.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-09-21T11:28:20.387 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:28:20.413 INFO:teuthology.orchestra.run.smithi118.stdout:(4/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 245 kB/s | 49 kB 00:00 2024-09-21T11:28:20.438 INFO:teuthology.orchestra.run.smithi118.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-21T11:28:20.464 INFO:teuthology.orchestra.run.smithi118.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.9 MB/s | 279 kB 00:00 2024-09-21T11:28:20.491 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:20.506 INFO:teuthology.orchestra.run.smithi118.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-21T11:28:20.539 INFO:teuthology.orchestra.run.smithi118.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 426 kB/s | 54 kB 00:00 2024-09-21T11:28:20.565 INFO:teuthology.orchestra.run.smithi118.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 150 kB/s | 14 kB 00:00 2024-09-21T11:28:20.598 INFO:teuthology.orchestra.run.smithi118.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-21T11:28:20.623 INFO:teuthology.orchestra.run.smithi118.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-21T11:28:20.649 INFO:teuthology.orchestra.run.smithi118.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-21T11:28:20.682 INFO:teuthology.orchestra.run.smithi118.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-21T11:28:20.685 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:20.685 INFO:teuthology.orchestra.run.smithi118.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-21T11:28:20.750 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:20.765 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:20.765 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:20.856 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:20.856 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:20.928 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:21.202 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:21.203 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:21.203 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:28:21.203 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:21.203 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:21.203 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:21.371 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:21.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs2 2024-09-21T11:28:21.664 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T11:28:21.733 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T11:28:21.789 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T11:28:21.827 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T11:28:21.868 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T11:28:21.978 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T11:28:22.080 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T11:28:22.081 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:22.145 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T11:28:22.173 INFO:teuthology.orchestra.run.smithi149.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:22.218 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:22.220 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T11:28:22.221 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:22.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs-devel 2024-09-21T11:28:22.851 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T11:28:22.886 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:22.901 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T11:28:22.935 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T11:28:22.983 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T11:28:23.006 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T11:28:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:23.021 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-21T11:28:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:28:23.021 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T11:28:23.022 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:28:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T11:28:23.022 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 32 k 2024-09-21T11:28:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 142 k 2024-09-21T11:28:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:28:23.165 INFO:teuthology.orchestra.run.smithi149.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 223 kB/s | 32 kB 00:00 2024-09-21T11:28:23.165 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:23.166 INFO:teuthology.orchestra.run.smithi149.stdout:Total 221 kB/s | 32 kB 00:00 2024-09-21T11:28:23.166 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:28:23.169 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:28:23.169 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:28:23.188 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:28:23.189 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:28:23.275 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:28:23.387 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:23.773 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:23.941 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T11:28:23.942 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T11:28:24.008 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:24.008 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:24.009 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:28:24.009 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:24.009 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:24.009 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:24.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados2 2024-09-21T11:28:24.285 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T11:28:24.286 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T11:28:24.287 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T11:28:24.287 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T11:28:24.287 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T11:28:24.287 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:24.287 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:24.531 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T11:28:24.779 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:24.870 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:24.913 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:24.914 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T11:28:24.914 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:24.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librbd1 2024-09-21T11:28:25.115 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:24 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:25.248 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T11:28:25.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T11:28:25.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T11:28:25.250 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:25.250 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:25.250 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:25.250 INFO:teuthology.orchestra.run.smithi118.stdout:Install 6 Packages 2024-09-21T11:28:25.250 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:25.250 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 7.0 M 2024-09-21T11:28:25.250 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 33 M 2024-09-21T11:28:25.251 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:25.562 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:25.653 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:25.697 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:25.698 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T11:28:25.698 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:25.760 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rados 2024-09-21T11:28:26.069 INFO:teuthology.orchestra.run.smithi118.stdout:(1/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 710 kB/s | 146 kB 00:00 2024-09-21T11:28:26.095 INFO:teuthology.orchestra.run.smithi118.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-21T11:28:26.145 INFO:teuthology.orchestra.run.smithi118.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-21T11:28:26.170 INFO:teuthology.orchestra.run.smithi118.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 768 kB/s | 58 kB 00:00 2024-09-21T11:28:26.195 INFO:teuthology.orchestra.run.smithi118.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-21T11:28:26.352 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:26.442 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:26.486 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:26.487 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T11:28:26.487 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:26.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rgw 2024-09-21T11:28:27.151 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:27.240 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:27.285 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:27.286 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T11:28:27.286 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:27.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-cephfs 2024-09-21T11:28:27.943 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:28.034 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:28.078 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:28.079 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T11:28:28.079 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:28.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rbd 2024-09-21T11:28:28.279 INFO:teuthology.orchestra.run.smithi118.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.5 MB/s | 6.0 MB 00:02 2024-09-21T11:28:28.281 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:28.282 INFO:teuthology.orchestra.run.smithi118.stdout:Total 2.3 MB/s | 7.0 MB 00:03 2024-09-21T11:28:28.356 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:28.368 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:28.368 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:28.469 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:28.470 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:28.744 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:28.833 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:28.877 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:28.878 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-21T11:28:28.878 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:28.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-fuse 2024-09-21T11:28:28.997 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T11:28:29.056 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T11:28:29.539 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:29.601 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T11:28:29.672 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:29.672 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:29.672 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-21T11:28:29.672 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:29.672 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:28:29.672 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T11:28:29.673 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:29.673 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:28:29.673 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:29.673 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T11:28:29.673 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:29.673 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 85 k 2024-09-21T11:28:29.673 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 231 k 2024-09-21T11:28:29.674 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:28:29.692 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T11:28:29.764 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T11:28:29.793 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T11:28:29.868 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 440 kB/s | 85 kB 00:00 2024-09-21T11:28:29.869 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:29.869 INFO:teuthology.orchestra.run.smithi149.stdout:Total 436 kB/s | 85 kB 00:00 2024-09-21T11:28:29.869 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:28:29.875 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:28:29.876 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:28:29.940 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:28:29.940 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:28:30.085 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:28:30.190 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:30.579 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:30.663 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T11:28:30.663 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T11:28:30.663 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T11:28:30.663 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T11:28:30.663 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T11:28:30.663 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T11:28:30.833 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:30.833 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:30.833 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:28:30.833 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:30.833 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:30.833 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:30.960 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:30.961 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:31.079 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-mirror 2024-09-21T11:28:31.202 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-fuse 2024-09-21T11:28:31.680 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:31.777 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:31.818 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:31.819 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:31.819 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-21T11:28:31.819 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:31.819 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:28:31.821 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T11:28:31.821 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:31.822 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:28:31.822 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:31.822 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T11:28:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:31.822 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 3.1 M 2024-09-21T11:28:31.822 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 13 M 2024-09-21T11:28:31.822 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:28:31.909 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:31.909 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:31.909 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T11:28:31.909 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:31.909 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:31.909 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T11:28:31.910 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T11:28:31.910 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T11:28:31.910 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:31.910 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:31.910 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:31.910 INFO:teuthology.orchestra.run.smithi118.stdout:Install 2 Packages 2024-09-21T11:28:31.910 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:31.910 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 976 k 2024-09-21T11:28:31.911 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 2.9 M 2024-09-21T11:28:31.911 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:32.082 INFO:teuthology.orchestra.run.smithi118.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-21T11:28:32.155 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.3 MB/s | 3.1 MB 00:00 2024-09-21T11:28:32.156 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:32.156 INFO:teuthology.orchestra.run.smithi149.stdout:Total 9.2 MB/s | 3.1 MB 00:00 2024-09-21T11:28:32.156 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:28:32.168 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:28:32.168 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:28:32.223 INFO:teuthology.orchestra.run.smithi118.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-21T11:28:32.224 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:32.224 INFO:teuthology.orchestra.run.smithi118.stdout:Total 3.0 MB/s | 976 kB 00:00 2024-09-21T11:28:32.236 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:32.250 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:28:32.250 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:28:32.257 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:32.257 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:32.339 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:32.339 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:32.530 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:32.678 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:28:32.683 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T11:28:32.739 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:32.746 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T11:28:32.765 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:32.765 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:28:32.765 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T11:28:32.765 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T11:28:32.765 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T11:28:32.766 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:33.483 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T11:28:33.483 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T11:28:33.775 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T11:28:33.775 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:33.775 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:33.775 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T11:28:33.776 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:33.776 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:33.900 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:33.900 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:33.900 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:28:33.900 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:33.900 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:33.900 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:34.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install librados-devel 2024-09-21T11:28:34.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-nbd 2024-09-21T11:28:34.668 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:34.763 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 11:26:51 AM UTC. 2024-09-21T11:28:34.803 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:34.803 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repo Size 2024-09-21T11:28:34.803 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:34.803 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T11:28:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:34.804 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:34.804 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:34.804 INFO:teuthology.orchestra.run.smithi118.stdout:Install 1 Package 2024-09-21T11:28:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:34.804 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 127 k 2024-09-21T11:28:34.804 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 456 k 2024-09-21T11:28:34.805 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:34.897 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T11:28:34.898 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-21T11:28:34.898 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:34.898 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T11:28:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T11:28:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:34.899 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T11:28:34.899 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T11:28:34.899 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-21T11:28:34.899 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:34.899 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 170 k 2024-09-21T11:28:34.899 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 494 k 2024-09-21T11:28:34.899 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T11:28:35.020 INFO:teuthology.orchestra.run.smithi118.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 588 kB/s | 127 kB 00:00 2024-09-21T11:28:35.020 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:35.021 INFO:teuthology.orchestra.run.smithi118.stdout:Total 584 kB/s | 127 kB 00:00 2024-09-21T11:28:35.021 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:35.026 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:35.026 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:35.090 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:35.091 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:35.117 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 781 kB/s | 170 kB 00:00 2024-09-21T11:28:35.118 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:35.118 INFO:teuthology.orchestra.run.smithi149.stdout:Total 776 kB/s | 170 kB 00:00 2024-09-21T11:28:35.118 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T11:28:35.126 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T11:28:35.126 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T11:28:35.190 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T11:28:35.190 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T11:28:35.237 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:35.347 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T11:28:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:35.448 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:35.804 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:35.965 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:36.059 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:36.060 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:36.060 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:36.060 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:36.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:36.309 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:36.310 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T11:28:36.310 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:36.310 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:28:36.310 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T11:28:36.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install libcephfs2 2024-09-21T11:28:36.591 DEBUG:teuthology.parallel:result is None 2024-09-21T11:28:36.901 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:36.990 INFO:teuthology.orchestra.run.smithi118.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:37.035 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:37.036 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2024-09-21T11:28:37.036 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:37.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install libcephfs-devel 2024-09-21T11:28:37.680 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:37.812 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:37.813 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:37.813 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repo Size 2024-09-21T11:28:37.813 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:37.813 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:37.813 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T11:28:37.813 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:37.813 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:37.813 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:37.814 INFO:teuthology.orchestra.run.smithi118.stdout:Install 1 Package 2024-09-21T11:28:37.814 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:37.814 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 32 k 2024-09-21T11:28:37.814 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 142 k 2024-09-21T11:28:37.815 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:37.983 INFO:teuthology.orchestra.run.smithi118.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 188 kB/s | 32 kB 00:00 2024-09-21T11:28:37.983 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:37.984 INFO:teuthology.orchestra.run.smithi118.stdout:Total 186 kB/s | 32 kB 00:00 2024-09-21T11:28:37.984 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:37.987 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:37.987 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:38.002 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:38.002 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:38.094 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:38.204 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:38.605 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:38.841 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:38.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:38.841 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:38.841 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:38.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:38.841 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:39.030 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install librados2 2024-09-21T11:28:39.606 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:39.739 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:39.740 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2024-09-21T11:28:39.740 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:39.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install librbd1 2024-09-21T11:28:40.384 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:40.471 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:40.515 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:40.516 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2024-09-21T11:28:40.516 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:40.583 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install python3-rados 2024-09-21T11:28:41.160 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:41.249 INFO:teuthology.orchestra.run.smithi118.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:41.292 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2024-09-21T11:28:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:41.369 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install python3-rgw 2024-09-21T11:28:41.939 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:42.027 INFO:teuthology.orchestra.run.smithi118.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:42.070 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:42.071 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2024-09-21T11:28:42.071 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:42.160 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install python3-cephfs 2024-09-21T11:28:42.739 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:42.828 INFO:teuthology.orchestra.run.smithi118.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:42.871 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:42.872 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2024-09-21T11:28:42.872 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:42.949 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install python3-rbd 2024-09-21T11:28:43.527 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:43.615 INFO:teuthology.orchestra.run.smithi118.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T11:28:43.658 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:43.659 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2024-09-21T11:28:43.659 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:43.753 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install rbd-fuse 2024-09-21T11:28:44.331 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:44.462 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:44.463 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:44.463 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2024-09-21T11:28:44.463 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:44.463 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:44.463 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T11:28:44.463 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:44.463 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:44.463 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:44.463 INFO:teuthology.orchestra.run.smithi118.stdout:Install 1 Package 2024-09-21T11:28:44.464 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:44.464 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 85 k 2024-09-21T11:28:44.464 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 231 k 2024-09-21T11:28:44.464 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:44.669 INFO:teuthology.orchestra.run.smithi118.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 416 kB/s | 85 kB 00:00 2024-09-21T11:28:44.670 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:44.670 INFO:teuthology.orchestra.run.smithi118.stdout:Total 413 kB/s | 85 kB 00:00 2024-09-21T11:28:44.670 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:44.677 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:44.677 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:44.740 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:44.740 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:44.881 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:45.008 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:45.378 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:45.694 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:45.695 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:45.695 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:45.695 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:45.695 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:45.695 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:45.992 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install rbd-mirror 2024-09-21T11:28:46.602 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:46.740 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repo Size 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout:Install 1 Package 2024-09-21T11:28:46.741 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:46.742 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 3.1 M 2024-09-21T11:28:46.742 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 13 M 2024-09-21T11:28:46.742 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:47.082 INFO:teuthology.orchestra.run.smithi118.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.1 MB/s | 3.1 MB 00:00 2024-09-21T11:28:47.083 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:47.083 INFO:teuthology.orchestra.run.smithi118.stdout:Total 9.1 MB/s | 3.1 MB 00:00 2024-09-21T11:28:47.084 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:47.092 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:47.093 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:47.175 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:47.176 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:47.612 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:47.675 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:47.700 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:47.700 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T11:28:47.700 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T11:28:47.700 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T11:28:47.701 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T11:28:47.701 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:48.848 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:48.848 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:48.849 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:48.849 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:48.849 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:48.849 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:49.095 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install rbd-nbd 2024-09-21T11:28:49.686 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Sep 2024 11:27:01 AM UTC. 2024-09-21T11:28:49.824 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout:Install 1 Package 2024-09-21T11:28:49.825 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:49.826 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 170 k 2024-09-21T11:28:49.826 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 494 k 2024-09-21T11:28:49.826 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T11:28:50.054 INFO:teuthology.orchestra.run.smithi118.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 748 kB/s | 170 kB 00:00 2024-09-21T11:28:50.055 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:28:50.055 INFO:teuthology.orchestra.run.smithi118.stdout:Total 744 kB/s | 170 kB 00:00 2024-09-21T11:28:50.055 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T11:28:50.062 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T11:28:50.063 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T11:28:50.127 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T11:28:50.128 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T11:28:50.290 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T11:28:50.385 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:50.799 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T11:28:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:51.040 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T11:28:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T11:28:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:28:51.040 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T11:28:51.301 DEBUG:teuthology.parallel:result is None 2024-09-21T11:28:51.302 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T11:28:51.302 INFO:teuthology.packaging:ref: None 2024-09-21T11:28:51.302 INFO:teuthology.packaging:tag: None 2024-09-21T11:28:51.302 INFO:teuthology.packaging:branch: squid 2024-09-21T11:28:51.302 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:28:51.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T11:28:51.545 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T11:28:51.567 INFO:teuthology.orchestra.run.smithi118.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T11:28:51.567 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T11:28:51.567 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T11:28:51.569 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T11:28:51.569 INFO:teuthology.packaging:ref: None 2024-09-21T11:28:51.569 INFO:teuthology.packaging:tag: None 2024-09-21T11:28:51.569 INFO:teuthology.packaging:branch: squid 2024-09-21T11:28:51.569 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:28:51.569 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T11:28:51.804 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T11:28:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T11:28:51.830 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T11:28:51.830 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T11:28:51.832 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T11:28:51.832 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:28:51.832 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T11:28:51.860 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:28:51.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T11:28:51.900 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T11:28:51.900 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:28:51.900 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T11:28:51.926 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T11:28:51.992 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:28:51.992 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T11:28:52.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T11:28:52.085 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T11:28:52.085 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:28:52.085 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T11:28:52.111 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T11:28:52.177 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:28:52.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T11:28:52.203 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T11:28:52.270 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T11:28:52.270 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:28:52.270 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T11:28:52.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T11:28:52.358 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:28:52.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T11:28:52.384 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T11:28:52.450 INFO:teuthology.run_tasks:Running task print... 2024-09-21T11:28:52.458 INFO:teuthology.task.print:**** done install task... 2024-09-21T11:28:52.459 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T11:28:52.617 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'} 2024-09-21T11:28:52.617 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T11:28:52.617 INFO:tasks.cephadm:Cluster fsid is ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:28:52.618 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T11:28:52.618 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-21T11:28:52.618 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi118': '172.21.15.118', 'mon.smithi149': '172.21.15.149'} 2024-09-21T11:28:52.618 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T11:28:52.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname $(hostname -s) 2024-09-21T11:28:52.643 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname $(hostname -s) 2024-09-21T11:28:52.669 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-21T11:28:52.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:28:52.806 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83200/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5103-g5c1cdc3c', 'node_name': '172.21.2.5+braggi05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5103.g5c1cdc3c'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0813/5c1cdc3c470dae78e91a0ed2bcf13509a046d301/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 10:00:04.055809', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-21-0813', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-21-0813/5c1cdc3c470dae78e91a0ed2bcf13509a046d301/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-21T11:28:53.042 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 4e45e6b490e6cbe082cdf155fea780438ec53fc7 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-21T11:28:53.043 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm 2024-09-21T11:28:53.043 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm 2024-09-21T11:28:53.044 DEBUG:teuthology.orchestra.run.smithi118:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T11:28:53.423 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Sep 21 11:28 /home/ubuntu/cephtest/cephadm 2024-09-21T11:28:53.424 DEBUG:teuthology.orchestra.run.smithi149:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T11:28:53.801 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Sep 21 11:28 /home/ubuntu/cephtest/cephadm 2024-09-21T11:28:53.801 DEBUG:teuthology.orchestra.run.smithi118:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T11:28:53.821 DEBUG:teuthology.orchestra.run.smithi149:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T11:28:53.852 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-21T11:28:53.852 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T11:28:53.863 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T11:28:55.432 INFO:teuthology.orchestra.run.smithi149.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T11:28:55.711 INFO:teuthology.orchestra.run.smithi118.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T11:29:23.472 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T11:29:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T11:29:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T11:29:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "repo_digests": [ 2024-09-21T11:29:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T11:29:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-21T11:29:23.473 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T11:29:24.611 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:29:24.611 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T11:29:24.611 INFO:teuthology.orchestra.run.smithi118.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T11:29:24.611 INFO:teuthology.orchestra.run.smithi118.stdout: "repo_digests": [ 2024-09-21T11:29:24.611 INFO:teuthology.orchestra.run.smithi118.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T11:29:24.611 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T11:29:24.611 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:29:24.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph 2024-09-21T11:29:24.684 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph 2024-09-21T11:29:24.717 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /etc/ceph 2024-09-21T11:29:24.741 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /etc/ceph 2024-09-21T11:29:24.784 INFO:tasks.cephadm:Writing seed config... 2024-09-21T11:29:24.785 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-21T11:29:24.785 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-21T11:29:24.785 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T11:29:24.785 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T11:29:24.785 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T11:29:24.786 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-21T11:29:24.787 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-21T11:29:24.787 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-21T11:29:24.787 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T11:29:24.787 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T11:29:24.787 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T11:29:24.787 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T11:29:24.787 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T11:29:24.787 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T11:29:24.788 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:29:24.788 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T11:29:24.803 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ae037950-780c-11ef-baf6-efdc52797490 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T11:29:24.803 DEBUG:teuthology.orchestra.run.smithi118:mon.smithi118> sudo journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118.service 2024-09-21T11:29:24.845 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T11:29:24.845 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid ae037950-780c-11ef-baf6-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.118 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T11:29:25.050 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T11:29:25.051 INFO:teuthology.orchestra.run.smithi118.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.118', '--skip-admin-label'] 2024-09-21T11:29:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T11:29:25.051 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying podman|docker is present... 2024-09-21T11:29:25.089 INFO:teuthology.orchestra.run.smithi118.stdout:/bin/podman: stdout 5.2.2 2024-09-21T11:29:25.090 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying lvm2 is present... 2024-09-21T11:29:25.090 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying time synchronization is in place... 2024-09-21T11:29:25.097 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T11:29:25.097 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T11:29:25.104 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T11:29:25.104 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout inactive 2024-09-21T11:29:25.110 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout enabled 2024-09-21T11:29:25.117 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout active 2024-09-21T11:29:25.117 INFO:teuthology.orchestra.run.smithi118.stdout:Unit chronyd.service is enabled and running 2024-09-21T11:29:25.117 INFO:teuthology.orchestra.run.smithi118.stdout:Repeating the final host check... 2024-09-21T11:29:25.139 INFO:teuthology.orchestra.run.smithi118.stdout:/bin/podman: stdout 5.2.2 2024-09-21T11:29:25.139 INFO:teuthology.orchestra.run.smithi118.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T11:29:25.139 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl is present 2024-09-21T11:29:25.139 INFO:teuthology.orchestra.run.smithi118.stdout:lvcreate is present 2024-09-21T11:29:25.145 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T11:29:25.145 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T11:29:25.152 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T11:29:25.152 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout inactive 2024-09-21T11:29:25.158 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout enabled 2024-09-21T11:29:25.165 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout active 2024-09-21T11:29:25.165 INFO:teuthology.orchestra.run.smithi118.stdout:Unit chronyd.service is enabled and running 2024-09-21T11:29:25.165 INFO:teuthology.orchestra.run.smithi118.stdout:Host looks OK 2024-09-21T11:29:25.165 INFO:teuthology.orchestra.run.smithi118.stdout:Cluster fsid: ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:25.165 INFO:teuthology.orchestra.run.smithi118.stdout:Acquiring lock 140234252445536 on /run/cephadm/ae037950-780c-11ef-baf6-efdc52797490.lock 2024-09-21T11:29:25.165 INFO:teuthology.orchestra.run.smithi118.stdout:Lock 140234252445536 acquired on /run/cephadm/ae037950-780c-11ef-baf6-efdc52797490.lock 2024-09-21T11:29:25.166 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying IP 172.21.15.118 port 3300 ... 2024-09-21T11:29:25.166 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying IP 172.21.15.118 port 6789 ... 2024-09-21T11:29:25.166 INFO:teuthology.orchestra.run.smithi118.stdout:Base mon IP(s) is [172.21.15.118:3300, 172.21.15.118:6789], mon addrv is [v2:172.21.15.118:3300,v1:172.21.15.118:6789] 2024-09-21T11:29:25.169 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.118 metric 100 2024-09-21T11:29:25.169 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.118 metric 100 2024-09-21T11:29:25.172 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T11:29:25.172 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T11:29:25.172 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T11:29:25.174 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T11:29:25.174 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T11:29:25.174 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T11:29:25.174 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T11:29:25.175 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T11:29:25.175 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T11:29:25.175 INFO:teuthology.orchestra.run.smithi118.stdout:Mon IP `172.21.15.118` is in CIDR network `172.21.0.0/20` 2024-09-21T11:29:25.175 INFO:teuthology.orchestra.run.smithi118.stdout:Mon IP `172.21.15.118` is in CIDR network `172.21.0.0/20` 2024-09-21T11:29:25.175 INFO:teuthology.orchestra.run.smithi118.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T11:29:25.176 INFO:teuthology.orchestra.run.smithi118.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T11:29:25.176 INFO:teuthology.orchestra.run.smithi118.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T11:29:25.679 INFO:teuthology.orchestra.run.smithi118.stdout:/bin/podman: stdout 164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c 2024-09-21T11:29:25.680 INFO:teuthology.orchestra.run.smithi118.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T11:29:25.680 INFO:teuthology.orchestra.run.smithi118.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T11:29:25.680 INFO:teuthology.orchestra.run.smithi118.stdout:/bin/podman: stderr Copying blob sha256:66069d7a5240ff24cb47e5b84cff1b0dd6013e59abb2a061101c2af76e3da9e1 2024-09-21T11:29:25.680 INFO:teuthology.orchestra.run.smithi118.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T11:29:25.680 INFO:teuthology.orchestra.run.smithi118.stdout:/bin/podman: stderr Copying config sha256:164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c 2024-09-21T11:29:25.680 INFO:teuthology.orchestra.run.smithi118.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T11:29:26.576 INFO:teuthology.orchestra.run.smithi118.stdout:ceph: stdout ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T11:29:26.577 INFO:teuthology.orchestra.run.smithi118.stdout:Ceph version: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T11:29:26.577 INFO:teuthology.orchestra.run.smithi118.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T11:29:27.591 INFO:teuthology.orchestra.run.smithi118.stdout:stat: stdout 167 167 2024-09-21T11:29:27.592 INFO:teuthology.orchestra.run.smithi118.stdout:Creating initial keys... 2024-09-21T11:29:28.540 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph-authtool: stdout AQAXru5mTfyONxAADIid2pQLBu6JtE0c1OSWyw== 2024-09-21T11:29:29.529 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph-authtool: stdout AQAYru5mGC8FMxAAcGeBmYM1eGa4gYDMvwcPZg== 2024-09-21T11:29:30.453 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph-authtool: stdout AQAZru5mOdpkMxAAsaBB1gq79yGqPB0HHD+NvQ== 2024-09-21T11:29:30.454 INFO:teuthology.orchestra.run.smithi118.stdout:Creating initial monmap... 2024-09-21T11:29:31.377 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T11:29:31.377 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T11:29:31.377 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:31.377 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T11:29:31.377 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool for smithi118 [v2:172.21.15.118:3300,v1:172.21.15.118:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T11:29:31.377 INFO:teuthology.orchestra.run.smithi118.stdout:setting min_mon_release = quincy 2024-09-21T11:29:31.378 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/monmaptool: set fsid to ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:31.378 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T11:29:31.378 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:29:31.378 INFO:teuthology.orchestra.run.smithi118.stdout:Creating mon... 2024-09-21T11:29:32.333 INFO:teuthology.orchestra.run.smithi118.stdout:create mon.smithi118 on 2024-09-21T11:29:32.543 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T11:29:32.690 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T11:29:32.864 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ae037950-780c-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-ae037950-780c-11ef-baf6-efdc52797490.target. 2024-09-21T11:29:32.864 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ae037950-780c-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-ae037950-780c-11ef-baf6-efdc52797490.target. 2024-09-21T11:29:33.087 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118 2024-09-21T11:29:33.087 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118.service: Unit ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118.service not loaded. 2024-09-21T11:29:33.247 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ae037950-780c-11ef-baf6-efdc52797490.target.wants/ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118.service → /etc/systemd/system/ceph-ae037950-780c-11ef-baf6-efdc52797490@.service. 2024-09-21T11:29:33.760 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:33 smithi118 podman[28366]: 2024-09-21 11:29:33.720761327 +0000 UTC m=+0.350119699 container start 62402f9f0420740061b5fb0e59b56e9d77dc919d7236b0e34b0e54a2b0296a6d (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, RELEASE=squid-4e45e6b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:29:33.816 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T11:29:33.816 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout disabled 2024-09-21T11:29:33.823 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T11:29:33.823 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout inactive 2024-09-21T11:29:33.823 INFO:teuthology.orchestra.run.smithi118.stdout:firewalld.service is not enabled 2024-09-21T11:29:33.823 INFO:teuthology.orchestra.run.smithi118.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T11:29:33.823 INFO:teuthology.orchestra.run.smithi118.stdout:Waiting for mon to start... 2024-09-21T11:29:33.824 INFO:teuthology.orchestra.run.smithi118.stdout:Waiting for mon... 2024-09-21T11:29:34.020 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:33 smithi118 ceph-mon[28384]: mkfs ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:34.020 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:33 smithi118 ceph-mon[28384]: mon.smithi118 is new leader, mons smithi118 in quorum (ranks 0) 2024-09-21T11:29:34.020 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:33 smithi118 bash[28366]: 62402f9f0420740061b5fb0e59b56e9d77dc919d7236b0e34b0e54a2b0296a6d 2024-09-21T11:29:34.020 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:33 smithi118 systemd[1]: Started Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:29:34.793 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: mon.smithi118 is new leader, mons smithi118 in quorum (ranks 0) 2024-09-21T11:29:34.793 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: monmap epoch 1 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: last_changed 2024-09-21T11:29:30.783062+0000 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: created 2024-09-21T11:29:30.783062+0000 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: min_mon_release 19 (squid) 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: election_strategy: 1 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: 0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.smithi118 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: fsmap 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: mgrmap e1: no daemons active 2024-09-21T11:29:34.794 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:34 smithi118 ceph-mon[28384]: from='client.? 172.21.15.118:0/1558856600' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T11:29:34.796 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T11:29:34.798 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout id: ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:34.798 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T11:29:34.798 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:29:34.798 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout services: 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi118 (age 0.491171s) 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout data: 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:mon is available 2024-09-21T11:29:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T11:29:35.805 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:29:35.805 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T11:29:35.805 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout fsid = ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:35.805 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.118:3300,v1:172.21.15.118:6789] 2024-09-21T11:29:35.805 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T11:29:35.805 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T11:29:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:Generating new minimal ceph.conf... 2024-09-21T11:29:35.917 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:35 smithi118 ceph-mon[28384]: from='client.? 172.21.15.118:0/3886834179' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T11:29:35.917 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:35 smithi118 ceph-mon[28384]: from='client.? 172.21.15.118:0/3886834179' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T11:29:36.743 INFO:teuthology.orchestra.run.smithi118.stdout:Restarting the monitor... 2024-09-21T11:29:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:36 smithi118 ceph-mon[28384]: from='client.? 172.21.15.118:0/2674011497' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:29:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:36 smithi118 systemd[1]: Stopping Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:29:37.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:37 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[28380]: 2024-09-21T11:29:37.016+0000 7f5a8513d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi118 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T11:29:37.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:37 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[28380]: 2024-09-21T11:29:37.016+0000 7f5a8513d640 -1 mon.smithi118@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T11:29:37.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:37 smithi118 podman[28629]: 2024-09-21 11:29:37.211472721 +0000 UTC m=+0.304296895 container died 62402f9f0420740061b5fb0e59b56e9d77dc919d7236b0e34b0e54a2b0296a6d (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T11:29:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:37 smithi118 podman[28629]: 2024-09-21 11:29:37.575319479 +0000 UTC m=+0.668143640 container cleanup 62402f9f0420740061b5fb0e59b56e9d77dc919d7236b0e34b0e54a2b0296a6d (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T11:29:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:37 smithi118 bash[28629]: ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118 2024-09-21T11:29:38.145 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:37 smithi118 podman[28641]: 2024-09-21 11:29:37.82642505 +0000 UTC m=+0.609317905 container remove 62402f9f0420740061b5fb0e59b56e9d77dc919d7236b0e34b0e54a2b0296a6d (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T11:29:38.145 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:37 smithi118 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118.service: Deactivated successfully. 2024-09-21T11:29:38.145 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:37 smithi118 systemd[1]: Stopped Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:29:38.145 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:37 smithi118 systemd[1]: Starting Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:29:38.398 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 podman[28737]: 2024-09-21 11:29:38.143902509 +0000 UTC m=+0.108956517 container create 7d891b2316871fb41581637fdbc9af8fcb45389a8d5a56a99a8a7e4f7cf66f2e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:29:38.398 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 podman[28737]: 2024-09-21 11:29:38.050788169 +0000 UTC m=+0.015842176 image pull 164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T11:29:38.398 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 podman[28737]: 2024-09-21 11:29:38.371657999 +0000 UTC m=+0.336712016 container init 7d891b2316871fb41581637fdbc9af8fcb45389a8d5a56a99a8a7e4f7cf66f2e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T11:29:38.398 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 podman[28737]: 2024-09-21 11:29:38.374814609 +0000 UTC m=+0.339868617 container start 7d891b2316871fb41581637fdbc9af8fcb45389a8d5a56a99a8a7e4f7cf66f2e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, maintainer=Guillaume Abrioux , RELEASE=squid-4e45e6b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T11:29:38.452 INFO:teuthology.orchestra.run.smithi118.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T11:29:38.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T11:29:38.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable), process ceph-mon, pid 2 2024-09-21T11:29:38.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: pidfile_write: ignore empty --pid-file 2024-09-21T11:29:38.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: load: jerasure load: lrc 2024-09-21T11:29:38.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: RocksDB version: 7.9.2 2024-09-21T11:29:38.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Git sha 0 2024-09-21T11:29:38.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: DB SUMMARY 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: DB Session ID: GCWGOBUDU2D3W2FZSSZ3 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: CURRENT file: CURRENT 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi118/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi118/store.db: 000009.log size: 95865 ; 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.error_if_exists: 0 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.create_if_missing: 0 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.paranoid_checks: 1 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T11:29:38.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.env: 0x55858de4e940 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.info_log: 0x55858ebd38c0 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.statistics: (nil) 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.use_fsync: 0 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_log_file_size: 0 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.allow_fallocate: 1 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T11:29:38.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.use_direct_reads: 0 2024-09-21T11:29:38.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T11:29:38.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T11:29:38.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.db_log_dir: 2024-09-21T11:29:38.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.wal_dir: 2024-09-21T11:29:38.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T11:29:38.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T11:29:38.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T11:29:38.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T11:29:38.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T11:29:38.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T11:29:38.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T11:29:38.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T11:29:38.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.write_buffer_manager: 0x55858ebe2dc0 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.unordered_write: 0 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T11:29:38.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.row_cache: None 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.wal_filter: None 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.two_write_queues: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.wal_compression: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.atomic_flush: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.log_readahead_size: 0 2024-09-21T11:29:38.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_background_jobs: 2 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_background_compactions: -1 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_subcompactions: 1 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T11:29:38.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_open_files: -1 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_background_flushes: -1 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Compression algorithms supported: 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: kZSTD supported: 0 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: kXpressCompression supported: 0 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: kBZip2Compression supported: 0 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T11:29:38.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: kLZ4Compression supported: 1 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: kZlibCompression supported: 1 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: kSnappyCompression supported: 1 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi118/store.db/MANIFEST-000010 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.merge_operator: 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_filter: None 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T11:29:38.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55858ebd3520) 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: cache_index_and_filter_blocks: 1 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: pin_top_level_index_and_filter: 1 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: index_type: 0 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: data_block_index_type: 0 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: index_shortening: 1 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: checksum: 4 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: no_block_cache: 0 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_cache: 0x55858ebc71f0 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_cache_name: BinnedLRUCache 2024-09-21T11:29:38.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_cache_options: 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: capacity : 536870912 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: num_shard_bits : 4 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: strict_capacity_limit : 0 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: high_pri_pool_ratio: 0.000 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_cache_compressed: (nil) 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: persistent_cache: (nil) 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_size: 4096 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_size_deviation: 10 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_restart_interval: 16 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: index_block_restart_interval: 1 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: metadata_block_size: 4096 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: partition_filters: 0 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: use_delta_encoding: 1 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: filter_policy: bloomfilter 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: whole_key_filtering: 1 2024-09-21T11:29:38.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: verify_compression: 0 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: read_amp_bytes_per_bit: 0 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: format_version: 5 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: enable_index_compression: 1 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_align: 0 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: max_auto_readahead_size: 262144 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: prepopulate_block_cache: 0 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: initial_auto_readahead_size: 8192 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression: NoCompression 2024-09-21T11:29:38.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.num_levels: 7 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T11:29:38.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T11:29:38.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T11:29:38.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.inplace_update_support: 0 2024-09-21T11:29:38.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.bloom_locality: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.max_successive_merges: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.ttl: 2592000 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.enable_blob_files: false 2024-09-21T11:29:38.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.min_blob_size: 0 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi118/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fe08b315-1507-4d8a-a0db-5337a1c4d2fd 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726918178401846, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726918178402737, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91866, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89907, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83275, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726918178, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fe08b315-1507-4d8a-a0db-5337a1c4d2fd", "db_session_id": "GCWGOBUDU2D3W2FZSSZ3", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T11:29:38.675 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726918178402834, "job": 1, "event": "recovery_finished"} 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi118/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55858ebf4e00 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: DB pointer 0x55858ecf0000 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ** DB Stats ** 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T11:29:38.676 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ** Compaction Stats [default] ** 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: L0 2/0 91.61 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Sum 2/0 91.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ** Compaction Stats [default] ** 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 151.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T11:29:38.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Cumulative compaction: 0.00 GB write, 29.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Interval compaction: 0.00 GB write, 29.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Block cache BinnedLRUCache@0x55858ebc71f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: starting mon.smithi118 rank 0 at public addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] at bind addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi118 fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:38.678 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mon.smithi118@-1(???) e1 preinit fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mon.smithi118@-1(???).mds e1 new map 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mon.smithi118@-1(???).mds e1 print_map 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: e1 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: btime 2024-09-21T11:29:33:756682+0000 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: legacy client fscid: -1 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: No filesystems configured 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mon.smithi118@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mon.smithi118@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mon.smithi118@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mon.smithi118@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mon.smithi118@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 bash[28737]: 7d891b2316871fb41581637fdbc9af8fcb45389a8d5a56a99a8a7e4f7cf66f2e 2024-09-21T11:29:38.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 systemd[1]: Started Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mon.smithi118 is new leader, mons smithi118 in quorum (ranks 0) 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: monmap epoch 1 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: last_changed 2024-09-21T11:29:30.783062+0000 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: created 2024-09-21T11:29:30.783062+0000 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: min_mon_release 19 (squid) 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: election_strategy: 1 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: 0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.smithi118 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: fsmap 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T11:29:38.680 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:38 smithi118 ceph-mon[28757]: mgrmap e1: no daemons active 2024-09-21T11:29:39.508 INFO:teuthology.orchestra.run.smithi118.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T11:29:39.530 INFO:teuthology.orchestra.run.smithi118.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T11:29:39.530 INFO:teuthology.orchestra.run.smithi118.stdout:Creating mgr... 2024-09-21T11:29:39.530 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T11:29:39.531 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T11:29:39.531 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-21T11:29:39.786 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ae037950-780c-11ef-baf6-efdc52797490@mgr.smithi118.djbwyn 2024-09-21T11:29:39.787 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ae037950-780c-11ef-baf6-efdc52797490@mgr.smithi118.djbwyn.service: Unit ceph-ae037950-780c-11ef-baf6-efdc52797490@mgr.smithi118.djbwyn.service not loaded. 2024-09-21T11:29:39.940 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ae037950-780c-11ef-baf6-efdc52797490.target.wants/ceph-ae037950-780c-11ef-baf6-efdc52797490@mgr.smithi118.djbwyn.service → /etc/systemd/system/ceph-ae037950-780c-11ef-baf6-efdc52797490@.service. 2024-09-21T11:29:40.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:39 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1991746473' entity='client.admin' 2024-09-21T11:29:40.482 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T11:29:40.483 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout disabled 2024-09-21T11:29:40.490 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T11:29:40.490 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout inactive 2024-09-21T11:29:40.490 INFO:teuthology.orchestra.run.smithi118.stdout:firewalld.service is not enabled 2024-09-21T11:29:40.490 INFO:teuthology.orchestra.run.smithi118.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T11:29:40.498 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T11:29:40.499 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout disabled 2024-09-21T11:29:40.506 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T11:29:40.506 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout inactive 2024-09-21T11:29:40.506 INFO:teuthology.orchestra.run.smithi118.stdout:firewalld.service is not enabled 2024-09-21T11:29:40.506 INFO:teuthology.orchestra.run.smithi118.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-21T11:29:40.506 INFO:teuthology.orchestra.run.smithi118.stdout:Waiting for mgr to start... 2024-09-21T11:29:40.506 INFO:teuthology.orchestra.run.smithi118.stdout:Waiting for mgr... 2024-09-21T11:29:41.317 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:41 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3546566698' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T11:29:41.589 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:29:41.589 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout { 2024-09-21T11:29:41.589 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "fsid": "ae037950-780c-11ef-baf6-efdc52797490", 2024-09-21T11:29:41.589 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T11:29:41.589 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T11:29:41.589 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 0 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ], 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "smithi118" 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ], 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T11:29:41.590 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T11:29:41.591 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:41.591 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T11:29:41.591 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:41.591 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T11:29:41.591 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T11:29:41.591 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T11:29:41.591 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T11:29:41.591 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T11:29:41.591 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T11:29:41.594 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:41.594 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T11:29:41.594 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T11:29:41.594 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T11:29:41.594 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T11:29:33:756682+0000", 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T11:29:41.595 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ], 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T11:29:33.757323+0000", 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout } 2024-09-21T11:29:41.596 INFO:teuthology.orchestra.run.smithi118.stdout:mgr not available, waiting (1/15)... 2024-09-21T11:29:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:44 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2606852494' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T11:29:44.742 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:29:44.742 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout { 2024-09-21T11:29:44.742 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "fsid": "ae037950-780c-11ef-baf6-efdc52797490", 2024-09-21T11:29:44.742 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T11:29:44.743 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T11:29:44.743 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T11:29:44.743 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T11:29:44.743 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:44.743 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T11:29:44.743 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T11:29:44.743 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 0 2024-09-21T11:29:44.743 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ], 2024-09-21T11:29:44.743 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "smithi118" 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ], 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T11:29:44.744 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:44.745 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T11:29:33:756682+0000", 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T11:29:44.746 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ], 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T11:29:33.757323+0000", 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout } 2024-09-21T11:29:44.747 INFO:teuthology.orchestra.run.smithi118.stdout:mgr not available, waiting (2/15)... 2024-09-21T11:29:45.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: Activating manager daemon smithi118.djbwyn 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: mgrmap e2: smithi118.djbwyn(active, starting, since 0.00323011s) 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi118.djbwyn", "id": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: Manager daemon smithi118.djbwyn is now available 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/mirror_snapshot_schedule"}]: dispatch 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/trash_purge_schedule"}]: dispatch 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' 2024-09-21T11:29:45.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:45 smithi118 ceph-mon[28757]: from='mgr.14100 172.21.15.118:0/1090654907' entity='mgr.smithi118.djbwyn' 2024-09-21T11:29:47.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:47 smithi118 ceph-mon[28757]: mgrmap e3: smithi118.djbwyn(active, since 1.00756s) 2024-09-21T11:29:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:48 smithi118 ceph-mon[28757]: mgrmap e4: smithi118.djbwyn(active, since 2s) 2024-09-21T11:29:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:48 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/89862787' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T11:29:49.255 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:29:49.255 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout { 2024-09-21T11:29:49.255 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "fsid": "ae037950-780c-11ef-baf6-efdc52797490", 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 0 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ], 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "smithi118" 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ], 2024-09-21T11:29:49.256 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T11:29:49.257 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T11:29:33:756682+0000", 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T11:29:49.258 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ], 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T11:29:33.757323+0000", 2024-09-21T11:29:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T11:29:49.260 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout }, 2024-09-21T11:29:49.260 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T11:29:49.260 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout } 2024-09-21T11:29:49.260 INFO:teuthology.orchestra.run.smithi118.stdout:mgr is available 2024-09-21T11:29:53.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:29:52 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2366617901' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T11:30:00.599 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout fsid = ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.118:3300,v1:172.21.15.118:6789] 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T11:30:00.601 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 2024-09-21T11:30:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T11:30:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T11:30:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T11:30:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T11:30:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T11:30:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T11:30:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:Enabling cephadm module... 2024-09-21T11:30:04.555 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:04 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3112437281' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-21T11:30:05.493 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:05 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3112437281' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T11:30:05.493 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:05 smithi118 ceph-mon[28757]: mgrmap e5: smithi118.djbwyn(active, since 19s) 2024-09-21T11:30:06.169 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout { 2024-09-21T11:30:06.169 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T11:30:06.169 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T11:30:06.169 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "active_name": "smithi118.djbwyn", 2024-09-21T11:30:06.169 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T11:30:06.169 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout } 2024-09-21T11:30:06.169 INFO:teuthology.orchestra.run.smithi118.stdout:Waiting for the mgr to restart... 2024-09-21T11:30:06.169 INFO:teuthology.orchestra.run.smithi118.stdout:Waiting for mgr epoch 5... 2024-09-21T11:30:06.475 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:06 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/248936396' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T11:30:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: Active manager daemon smithi118.djbwyn restarted 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: Activating manager daemon smithi118.djbwyn 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: mgrmap e6: smithi118.djbwyn(active, starting, since 0.00322694s) 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi118.djbwyn", "id": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: Manager daemon smithi118.djbwyn is now available 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:09.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:30:09.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:30:09.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/mirror_snapshot_schedule"}]: dispatch 2024-09-21T11:30:09.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:09 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/trash_purge_schedule"}]: dispatch 2024-09-21T11:30:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:10 smithi118 ceph-mon[28757]: Found migration_current of "None". Setting to last migration. 2024-09-21T11:30:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:10 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:10 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:10 smithi118 ceph-mon[28757]: mgrmap e7: smithi118.djbwyn(active, since 1.00498s) 2024-09-21T11:30:10.632 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout { 2024-09-21T11:30:10.632 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T11:30:10.633 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T11:30:10.633 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout } 2024-09-21T11:30:10.633 INFO:teuthology.orchestra.run.smithi118.stdout:mgr epoch 5 is available 2024-09-21T11:30:10.633 INFO:teuthology.orchestra.run.smithi118.stdout:Setting orchestrator backend to cephadm... 2024-09-21T11:30:11.228 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:11 smithi118 ceph-mon[28757]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T11:30:11.228 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:11 smithi118 ceph-mon[28757]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T11:30:11.228 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:11 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:12 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:10] ENGINE Bus STARTING 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:12 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:10] ENGINE Serving on http://172.21.15.118:8765 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:12 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:10] ENGINE Serving on https://172.21.15.118:7150 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:12 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:10] ENGINE Bus STARTED 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:12 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:10] ENGINE Error in HTTPServer.serve 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Traceback (most recent call last): 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._connections.run(self.expiration_interval) 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T11:30:12.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._run(expiration_interval) 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s = self.context.wrap_socket( 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: return self.sslsocket_class._create( 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self.do_handshake() 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._sslobj.do_handshake() 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:12 smithi118 ceph-mon[28757]: mgrmap e8: smithi118.djbwyn(active, since 2s) 2024-09-21T11:30:12.295 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:12 smithi118 ceph-mon[28757]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:12.296 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:12 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:12.296 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:12 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:30:12.819 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T11:30:12.819 INFO:teuthology.orchestra.run.smithi118.stdout:Generating ssh key... 2024-09-21T11:30:13.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:13 smithi118 ceph-mon[28757]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:14.771 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:14 smithi118 ceph-mon[28757]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:14.771 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:14 smithi118 ceph-mon[28757]: Generating ssh key... 2024-09-21T11:30:14.771 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:14 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:14.771 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:14 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:15.023 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPy5AD9t7xzxtqnRtPx2xD8jjUpFA5A7LbW9ONUza7fgsI5yRY3HWPSFvW3+QF/74eItux9zaj7+Aw7CKvWM+A3KihZ/5LsXzbv3/9l5lfqadKFtLcHF/8pisY1GQhXGUf6RhorP18s6z8auDN9oqrTT/9CkwsVoAd6nEG7jHeJPvYTVj6f/jgjMCqc+R4qeqi7LWNm4F8mdyvPXbRTErlN8aiXiMnJpeG5TPaEmnRry6c/MzFrCDvfHo3VL+3YcH9KEvHCWCF60ZaRqEce+0YGZPnbzUV0Gm1q7UMuxS99TBxCxf1BSUPgWlfQjve/zR/6zQN64Tr1Xrw0HcE0/IXVa2wONHNjp05KgMb4fGL66s4T09W56zO+Zh8wV0g8GUgGfzBoZNn8WGnSkqQS5ALDvOhWB79tkG6ZkanR9eNhbAoYG3t+SXn9o4xOpMRe4i9KBZEAgGANaxyoYN8D2hy9OaQj0gp+57fp2Jem9XBULQWdd3MN+fKvqUWbcIZuDU= ceph-ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:30:15.024 INFO:teuthology.orchestra.run.smithi118.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T11:30:15.024 INFO:teuthology.orchestra.run.smithi118.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T11:30:15.042 INFO:teuthology.orchestra.run.smithi118.stdout:Adding host smithi118... 2024-09-21T11:30:15.727 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:15 smithi118 ceph-mon[28757]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:16.636 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:16 smithi118 ceph-mon[28757]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi118", "addr": "172.21.15.118", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:17 smithi118 ceph-mon[28757]: Deploying cephadm binary to smithi118 2024-09-21T11:30:19.323 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Added host 'smithi118' with addr '172.21.15.118' 2024-09-21T11:30:19.323 INFO:teuthology.orchestra.run.smithi118.stdout:Deploying mon service with default placement... 2024-09-21T11:30:19.943 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:19 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:19.943 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:19 smithi118 ceph-mon[28757]: Added host smithi118 2024-09-21T11:30:19.943 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:19 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:30:20.717 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T11:30:20.718 INFO:teuthology.orchestra.run.smithi118.stdout:Deploying mgr service with default placement... 2024-09-21T11:30:21.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:20 smithi118 ceph-mon[28757]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:21.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:20 smithi118 ceph-mon[28757]: Saving service mon spec with placement count:5 2024-09-21T11:30:21.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:20 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:22.344 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T11:30:22.344 INFO:teuthology.orchestra.run.smithi118.stdout:Deploying crash service with default placement... 2024-09-21T11:30:22.450 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:22 smithi118 ceph-mon[28757]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:22.450 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:22 smithi118 ceph-mon[28757]: Saving service mgr spec with placement count:2 2024-09-21T11:30:22.450 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:22 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:22.451 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:22 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:23.560 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-21T11:30:23.560 INFO:teuthology.orchestra.run.smithi118.stdout:Deploying ceph-exporter service with default placement... 2024-09-21T11:30:24.150 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:23 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:24.150 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:23 smithi118 ceph-mon[28757]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:24.150 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:23 smithi118 ceph-mon[28757]: Saving service crash spec with placement * 2024-09-21T11:30:24.150 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:23 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:25.249 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:25 smithi118 ceph-mon[28757]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:25.249 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:25 smithi118 ceph-mon[28757]: Saving service ceph-exporter spec with placement * 2024-09-21T11:30:25.249 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:25 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:25.251 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-21T11:30:25.252 INFO:teuthology.orchestra.run.smithi118.stdout:Deploying prometheus service with default placement... 2024-09-21T11:30:26.534 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-21T11:30:26.534 INFO:teuthology.orchestra.run.smithi118.stdout:Deploying grafana service with default placement... 2024-09-21T11:30:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:26 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:26 smithi118 ceph-mon[28757]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:26 smithi118 ceph-mon[28757]: Saving service prometheus spec with placement count:1 2024-09-21T11:30:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:26 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:26 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:27.649 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-21T11:30:27.649 INFO:teuthology.orchestra.run.smithi118.stdout:Deploying node-exporter service with default placement... 2024-09-21T11:30:28.309 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:28 smithi118 ceph-mon[28757]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:28.310 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:28 smithi118 ceph-mon[28757]: Saving service grafana spec with placement count:1 2024-09-21T11:30:28.310 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:28 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:29.557 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:29 smithi118 ceph-mon[28757]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:29.558 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:29 smithi118 ceph-mon[28757]: Saving service node-exporter spec with placement * 2024-09-21T11:30:29.558 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:29 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:29.561 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-21T11:30:29.561 INFO:teuthology.orchestra.run.smithi118.stdout:Deploying alertmanager service with default placement... 2024-09-21T11:30:30.480 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:30 smithi118 ceph-mon[28757]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:30:30.481 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:30 smithi118 ceph-mon[28757]: from='mgr.14118 172.21.15.118:0/2102804334' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:30.733 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-21T11:30:31.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:31 smithi118 ceph-mon[28757]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:31.590 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:31 smithi118 ceph-mon[28757]: Saving service alertmanager spec with placement count:1 2024-09-21T11:30:32.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:32 smithi118 ceph-mon[28757]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:30:32.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:32 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1385067134' entity='client.admin' 2024-09-21T11:30:33.045 INFO:teuthology.orchestra.run.smithi118.stdout:Enabling the dashboard module... 2024-09-21T11:30:33.420 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:33 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2669274037' entity='client.admin' 2024-09-21T11:30:33.420 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:33 smithi118 ceph-mon[28757]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:30:34.766 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:34 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2537315868' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-21T11:30:35.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:35 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2537315868' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T11:30:35.720 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:35 smithi118 ceph-mon[28757]: mgrmap e9: smithi118.djbwyn(active, since 25s) 2024-09-21T11:30:36.384 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout { 2024-09-21T11:30:36.384 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T11:30:36.384 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T11:30:36.384 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "active_name": "smithi118.djbwyn", 2024-09-21T11:30:36.384 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T11:30:36.384 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout } 2024-09-21T11:30:36.384 INFO:teuthology.orchestra.run.smithi118.stdout:Waiting for the mgr to restart... 2024-09-21T11:30:36.385 INFO:teuthology.orchestra.run.smithi118.stdout:Waiting for mgr epoch 9... 2024-09-21T11:30:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:36 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2783645893' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T11:30:39.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: Active manager daemon smithi118.djbwyn restarted 2024-09-21T11:30:39.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: Activating manager daemon smithi118.djbwyn 2024-09-21T11:30:39.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T11:30:39.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: mgrmap e10: smithi118.djbwyn(active, starting, since 0.00331782s) 2024-09-21T11:30:39.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:30:39.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi118.djbwyn", "id": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:30:39.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T11:30:39.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T11:30:39.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T11:30:39.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: Manager daemon smithi118.djbwyn is now available 2024-09-21T11:30:39.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:30:39.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/mirror_snapshot_schedule"}]: dispatch 2024-09-21T11:30:39.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:39 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/trash_purge_schedule"}]: dispatch 2024-09-21T11:30:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout { 2024-09-21T11:30:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T11:30:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T11:30:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout } 2024-09-21T11:30:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:mgr epoch 9 is available 2024-09-21T11:30:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:Generating a dashboard self-signed certificate... 2024-09-21T11:30:41.443 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:41 smithi118 ceph-mon[28757]: mgrmap e11: smithi118.djbwyn(active, since 1.00633s) 2024-09-21T11:30:41.443 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:41 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:40] ENGINE Bus STARTING 2024-09-21T11:30:41.443 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:41 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:42.530 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:42 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:40] ENGINE Serving on http://172.21.15.118:8765 2024-09-21T11:30:42.530 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:42 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:40] ENGINE Serving on https://172.21.15.118:7150 2024-09-21T11:30:42.530 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:42 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:40] ENGINE Bus STARTED 2024-09-21T11:30:42.530 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:42 smithi118 ceph-mon[28757]: [21/Sep/2024:11:30:40] ENGINE Error in HTTPServer.serve 2024-09-21T11:30:42.530 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Traceback (most recent call last): 2024-09-21T11:30:42.530 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T11:30:42.530 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._connections.run(self.expiration_interval) 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._run(expiration_interval) 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s = self.context.wrap_socket( 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: return self.sslsocket_class._create( 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self.do_handshake() 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._sslobj.do_handshake() 2024-09-21T11:30:42.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T11:30:42.532 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:42 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:42.532 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:42 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:42.532 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:42 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:42.532 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:42 smithi118 ceph-mon[28757]: mgrmap e12: smithi118.djbwyn(active, since 2s) 2024-09-21T11:30:42.532 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-21T11:30:42.533 INFO:teuthology.orchestra.run.smithi118.stdout:Creating initial admin user... 2024-09-21T11:30:43.369 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:43 smithi118 ceph-mon[28757]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:44.092 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$x8gWNpme1HPh9XJwXiO3SO8pAXANOXGVTpycPvdZrJaLTLq/gkSUS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726918243, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T11:30:44.092 INFO:teuthology.orchestra.run.smithi118.stdout:Fetching dashboard port number... 2024-09-21T11:30:44.618 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:44 smithi118 ceph-mon[28757]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:44.618 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:44 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:45.606 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:45 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1606732257' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-21T11:30:45.609 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T11:30:45.618 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T11:30:45.618 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout disabled 2024-09-21T11:30:45.625 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T11:30:45.625 INFO:teuthology.orchestra.run.smithi118.stdout:systemctl: stdout inactive 2024-09-21T11:30:45.626 INFO:teuthology.orchestra.run.smithi118.stdout:firewalld.service is not enabled 2024-09-21T11:30:45.626 INFO:teuthology.orchestra.run.smithi118.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T11:30:45.627 INFO:teuthology.orchestra.run.smithi118.stdout:Ceph Dashboard is now available at: 2024-09-21T11:30:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: URL: https://smithi118.front.sepia.ceph.com:8443/ 2024-09-21T11:30:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: User: admin 2024-09-21T11:30:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Password: x8w4jloouf 2024-09-21T11:30:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:45.628 INFO:teuthology.orchestra.run.smithi118.stdout:Saving cluster configuration to /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config directory 2024-09-21T11:30:46.562 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:46 smithi118 ceph-mon[28757]: mgrmap e13: smithi118.djbwyn(active, since 6s) 2024-09-21T11:30:46.562 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:46 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/271728945' entity='client.admin' 2024-09-21T11:30:46.866 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T11:30:46.866 INFO:teuthology.orchestra.run.smithi118.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T11:30:46.866 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:46.866 INFO:teuthology.orchestra.run.smithi118.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T11:30:46.866 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:46.866 INFO:teuthology.orchestra.run.smithi118.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout: ceph telemetry on 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout:For more information see: 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:46.867 INFO:teuthology.orchestra.run.smithi118.stdout:Bootstrap complete. 2024-09-21T11:30:46.907 INFO:tasks.cephadm:Fetching config... 2024-09-21T11:30:46.908 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:30:46.908 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T11:30:46.925 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T11:30:46.925 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:30:46.925 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T11:30:46.979 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T11:30:46.980 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:30:46.980 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/keyring of=/dev/stdout 2024-09-21T11:30:47.044 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T11:30:47.044 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:30:47.045 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T11:30:47.099 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T11:30:47.100 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPy5AD9t7xzxtqnRtPx2xD8jjUpFA5A7LbW9ONUza7fgsI5yRY3HWPSFvW3+QF/74eItux9zaj7+Aw7CKvWM+A3KihZ/5LsXzbv3/9l5lfqadKFtLcHF/8pisY1GQhXGUf6RhorP18s6z8auDN9oqrTT/9CkwsVoAd6nEG7jHeJPvYTVj6f/jgjMCqc+R4qeqi7LWNm4F8mdyvPXbRTErlN8aiXiMnJpeG5TPaEmnRry6c/MzFrCDvfHo3VL+3YcH9KEvHCWCF60ZaRqEce+0YGZPnbzUV0Gm1q7UMuxS99TBxCxf1BSUPgWlfQjve/zR/6zQN64Tr1Xrw0HcE0/IXVa2wONHNjp05KgMb4fGL66s4T09W56zO+Zh8wV0g8GUgGfzBoZNn8WGnSkqQS5ALDvOhWB79tkG6ZkanR9eNhbAoYG3t+SXn9o4xOpMRe4i9KBZEAgGANaxyoYN8D2hy9OaQj0gp+57fp2Jem9XBULQWdd3MN+fKvqUWbcIZuDU= ceph-ae037950-780c-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T11:30:47.174 INFO:teuthology.orchestra.run.smithi118.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPy5AD9t7xzxtqnRtPx2xD8jjUpFA5A7LbW9ONUza7fgsI5yRY3HWPSFvW3+QF/74eItux9zaj7+Aw7CKvWM+A3KihZ/5LsXzbv3/9l5lfqadKFtLcHF/8pisY1GQhXGUf6RhorP18s6z8auDN9oqrTT/9CkwsVoAd6nEG7jHeJPvYTVj6f/jgjMCqc+R4qeqi7LWNm4F8mdyvPXbRTErlN8aiXiMnJpeG5TPaEmnRry6c/MzFrCDvfHo3VL+3YcH9KEvHCWCF60ZaRqEce+0YGZPnbzUV0Gm1q7UMuxS99TBxCxf1BSUPgWlfQjve/zR/6zQN64Tr1Xrw0HcE0/IXVa2wONHNjp05KgMb4fGL66s4T09W56zO+Zh8wV0g8GUgGfzBoZNn8WGnSkqQS5ALDvOhWB79tkG6ZkanR9eNhbAoYG3t+SXn9o4xOpMRe4i9KBZEAgGANaxyoYN8D2hy9OaQj0gp+57fp2Jem9XBULQWdd3MN+fKvqUWbcIZuDU= ceph-ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:30:47.185 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPy5AD9t7xzxtqnRtPx2xD8jjUpFA5A7LbW9ONUza7fgsI5yRY3HWPSFvW3+QF/74eItux9zaj7+Aw7CKvWM+A3KihZ/5LsXzbv3/9l5lfqadKFtLcHF/8pisY1GQhXGUf6RhorP18s6z8auDN9oqrTT/9CkwsVoAd6nEG7jHeJPvYTVj6f/jgjMCqc+R4qeqi7LWNm4F8mdyvPXbRTErlN8aiXiMnJpeG5TPaEmnRry6c/MzFrCDvfHo3VL+3YcH9KEvHCWCF60ZaRqEce+0YGZPnbzUV0Gm1q7UMuxS99TBxCxf1BSUPgWlfQjve/zR/6zQN64Tr1Xrw0HcE0/IXVa2wONHNjp05KgMb4fGL66s4T09W56zO+Zh8wV0g8GUgGfzBoZNn8WGnSkqQS5ALDvOhWB79tkG6ZkanR9eNhbAoYG3t+SXn9o4xOpMRe4i9KBZEAgGANaxyoYN8D2hy9OaQj0gp+57fp2Jem9XBULQWdd3MN+fKvqUWbcIZuDU= ceph-ae037950-780c-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T11:30:47.236 INFO:teuthology.orchestra.run.smithi149.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPy5AD9t7xzxtqnRtPx2xD8jjUpFA5A7LbW9ONUza7fgsI5yRY3HWPSFvW3+QF/74eItux9zaj7+Aw7CKvWM+A3KihZ/5LsXzbv3/9l5lfqadKFtLcHF/8pisY1GQhXGUf6RhorP18s6z8auDN9oqrTT/9CkwsVoAd6nEG7jHeJPvYTVj6f/jgjMCqc+R4qeqi7LWNm4F8mdyvPXbRTErlN8aiXiMnJpeG5TPaEmnRry6c/MzFrCDvfHo3VL+3YcH9KEvHCWCF60ZaRqEce+0YGZPnbzUV0Gm1q7UMuxS99TBxCxf1BSUPgWlfQjve/zR/6zQN64Tr1Xrw0HcE0/IXVa2wONHNjp05KgMb4fGL66s4T09W56zO+Zh8wV0g8GUgGfzBoZNn8WGnSkqQS5ALDvOhWB79tkG6ZkanR9eNhbAoYG3t+SXn9o4xOpMRe4i9KBZEAgGANaxyoYN8D2hy9OaQj0gp+57fp2Jem9XBULQWdd3MN+fKvqUWbcIZuDU= ceph-ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:30:47.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T11:30:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:30:49.348 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T11:30:49.348 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T11:30:49.430 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:49 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3693429828' entity='client.admin' 2024-09-21T11:30:49.686 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:30:50.959 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi149 2024-09-21T11:30:50.959 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:30:50.959 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.conf 2024-09-21T11:30:50.978 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:30:50.978 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:30:51.037 INFO:tasks.cephadm:Adding host smithi149 to orchestrator... 2024-09-21T11:30:51.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch host add smithi149 2024-09-21T11:30:51.369 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:30:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:51 smithi118 ceph-mon[28757]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:51 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:51 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:51 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:51 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:30:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:51 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:30:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:51 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:30:52.622 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:52 smithi118 ceph-mon[28757]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-21T11:30:52.622 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:52 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:52.622 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:52 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:52.622 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:52 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:52.622 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:52 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi118", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:30:52.622 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:52 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi118", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T11:30:52.623 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:52 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:30:53.728 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:53 smithi118 ceph-mon[28757]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:30:53.728 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:53 smithi118 ceph-mon[28757]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:30:53.728 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:53 smithi118 ceph-mon[28757]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:30:53.728 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:53 smithi118 ceph-mon[28757]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:30:53.728 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:53 smithi118 ceph-mon[28757]: Deploying daemon ceph-exporter.smithi118 on smithi118 2024-09-21T11:30:54.424 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:54 smithi118 ceph-mon[28757]: Deploying cephadm binary to smithi149 2024-09-21T11:30:55.260 INFO:teuthology.orchestra.run.smithi118.stdout:Added host 'smithi149' with addr '172.21.15.149' 2024-09-21T11:30:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi118", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T11:30:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi118", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T11:30:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:30:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: Deploying daemon crash.smithi118 on smithi118 2024-09-21T11:30:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:55 smithi118 ceph-mon[28757]: Added host smithi149 2024-09-21T11:30:56.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T11:30:56.457 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:30:57.221 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:30:57.221 INFO:teuthology.orchestra.run.smithi118.stdout:[{"addr": "172.21.15.118", "hostname": "smithi118", "labels": [], "status": ""}, {"addr": "172.21.15.149", "hostname": "smithi149", "labels": [], "status": ""}] 2024-09-21T11:30:57.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:57 smithi118 ceph-mon[28757]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T11:30:58.165 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T11:30:58.165 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd crush tunables default 2024-09-21T11:30:58.436 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:30:59.040 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:58 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:59.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:58 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:59.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:58 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:59.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:58 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:30:59.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:58 smithi118 ceph-mon[28757]: Deploying daemon node-exporter.smithi118 on smithi118 2024-09-21T11:30:59.721 INFO:teuthology.orchestra.run.smithi118.stderr:adjusted tunables profile to default 2024-09-21T11:31:00.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:59 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2574722194' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T11:31:00.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:59 smithi118 ceph-mon[28757]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:00.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:30:59 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:00.992 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:00 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2574722194' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T11:31:00.993 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:00 smithi118 ceph-mon[28757]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T11:31:00.994 INFO:tasks.cephadm:Adding mon.smithi118 on smithi118 2024-09-21T11:31:00.994 INFO:tasks.cephadm:Adding mon.smithi149 on smithi149 2024-09-21T11:31:00.995 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch apply mon '2;smithi118:172.21.15.118=smithi118;smithi149:172.21.15.149=smithi149' 2024-09-21T11:31:01.238 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:01.284 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:01.782 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:01 smithi118 ceph-mon[28757]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:01.849 INFO:teuthology.orchestra.run.smithi149.stdout:Scheduled mon update... 2024-09-21T11:31:02.434 DEBUG:teuthology.orchestra.run.smithi149:mon.smithi149> sudo journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi149.service 2024-09-21T11:31:02.436 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:02.437 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:02.709 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:02.754 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:02 smithi118 ceph-mon[28757]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi118:172.21.15.118=smithi118;smithi149:172.21.15.149=smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:31:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:02 smithi118 ceph-mon[28757]: Saving service mon spec with placement smithi118:172.21.15.118=smithi118;smithi149:172.21.15.149=smithi149;count:2 2024-09-21T11:31:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:02 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:02 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:02 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:02 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:02 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:02 smithi118 ceph-mon[28757]: Deploying daemon alertmanager.smithi118 on smithi118 2024-09-21T11:31:03.425 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:03.425 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:03.426 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:03 smithi118 ceph-mon[28757]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:03 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/176396197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:05.029 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:05.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:05.275 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:05.320 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:05 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:05.975 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:05.975 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:05.976 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:06 smithi118 ceph-mon[28757]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:06 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/3778755499' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:07.509 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:07.510 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:07.755 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:07.801 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:08.476 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:08.476 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:08.476 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:08.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:08 smithi118 ceph-mon[28757]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:09.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1348006727' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:09.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:09.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T11:31:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:09 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:10.082 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:10.082 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:10.329 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:10.376 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:10 smithi118 ceph-mon[28757]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T11:31:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:10 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T11:31:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:10 smithi118 ceph-mon[28757]: Deploying daemon grafana.smithi118 on smithi118 2024-09-21T11:31:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:10 smithi118 ceph-mon[28757]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:10 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:11.055 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:11.055 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:11.056 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:11 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1441157360' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:12.618 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:12.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:12 smithi118 ceph-mon[28757]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:12.866 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:12.911 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:13.554 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:13.555 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:13.555 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:14.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:14 smithi118 ceph-mon[28757]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:14.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:14 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/2174854166' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:15.095 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:15.095 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:15.343 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:15.389 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:16.031 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:16.031 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:16.031 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:16 smithi118 ceph-mon[28757]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:16 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/3738336545' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:17.642 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:17.642 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:17.888 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:17.933 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:18.551 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:18.551 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:18.551 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:18.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:18 smithi118 ceph-mon[28757]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:19.477 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:19 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1243578379' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:19.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:19 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:19.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:19 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:19.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:19 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:19.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:19 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:19.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:19 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:19.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:19 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:19.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:19 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:19.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:19 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:20.142 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:20.142 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:20.385 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:20.430 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:20.540 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:20 smithi118 ceph-mon[28757]: Deploying daemon prometheus.smithi118 on smithi118 2024-09-21T11:31:20.540 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:20 smithi118 ceph-mon[28757]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:20.540 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:20 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:21.077 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:21.077 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:21.077 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:21.638 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:21 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/2355486730' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:22.586 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:22.586 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:22.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:22 smithi118 ceph-mon[28757]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:22.827 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:22.872 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:23.511 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:23.512 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:23.512 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:24.626 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:24 smithi118 ceph-mon[28757]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:24.627 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:24 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/346001448' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:25.083 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:25.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:25.328 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:25.374 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:25.990 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:25.990 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:25.990 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:26 smithi118 ceph-mon[28757]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:26 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/147811444' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:27.564 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:27.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:27.809 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:27.867 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:28.530 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:28.530 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:28.531 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:28.757 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:28 smithi118 ceph-mon[28757]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:29 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1034199408' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:30.086 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:30.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:30.331 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:30.376 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:30.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:30 smithi118 ceph-mon[28757]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:31.053 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:31.053 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:31.053 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:31.441 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:31 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/3262941475' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:32.467 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:32 smithi118 ceph-mon[28757]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:32.609 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:32.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:32.854 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:32.900 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:33.523 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:33.523 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:33.523 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:34.055 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:33 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:34.055 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:33 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:34.055 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:33 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:34.055 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:33 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T11:31:34.055 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:33 smithi118 ceph-mon[28757]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:31:34.055 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:33 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1915591618' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:35.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:34 smithi118 ceph-mon[28757]: from='mgr.14162 172.21.15.118:0/3656123911' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T11:31:35.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:34 smithi118 ceph-mon[28757]: mgrmap e14: smithi118.djbwyn(active, since 54s) 2024-09-21T11:31:35.156 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:35.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:35.395 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:35.441 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:36.076 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:36.076 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:36.076 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:36 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/2684469111' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:37.653 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:37.653 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:37.897 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:37.943 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:38.594 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:38.594 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:38.594 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: Active manager daemon smithi118.djbwyn restarted 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: Activating manager daemon smithi118.djbwyn 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: mgrmap e15: smithi118.djbwyn(active, starting, since 0.00325789s) 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi118.djbwyn", "id": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T11:31:38.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: Manager daemon smithi118.djbwyn is now available 2024-09-21T11:31:38.720 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:31:38.720 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:38.720 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:31:38.720 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/mirror_snapshot_schedule"}]: dispatch 2024-09-21T11:31:38.720 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/trash_purge_schedule"}]: dispatch 2024-09-21T11:31:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:39 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/3330328294' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:39 smithi118 ceph-mon[28757]: mgrmap e16: smithi118.djbwyn(active, since 1.00598s) 2024-09-21T11:31:40.189 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:40.190 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:40.466 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:40.520 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:40.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:40.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:41.212 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:41.212 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:41.212 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:41 smithi118 ceph-mon[28757]: [21/Sep/2024:11:31:40] ENGINE Bus STARTING 2024-09-21T11:31:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:41 smithi118 ceph-mon[28757]: [21/Sep/2024:11:31:40] ENGINE Serving on http://172.21.15.118:8765 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:41 smithi118 ceph-mon[28757]: [21/Sep/2024:11:31:40] ENGINE Serving on https://172.21.15.118:7150 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:41 smithi118 ceph-mon[28757]: [21/Sep/2024:11:31:40] ENGINE Bus STARTED 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:41 smithi118 ceph-mon[28757]: [21/Sep/2024:11:31:40] ENGINE Error in HTTPServer.serve 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Traceback (most recent call last): 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._connections.run(self.expiration_interval) 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._run(expiration_interval) 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T11:31:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s = self.context.wrap_socket( 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: return self.sslsocket_class._create( 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self.do_handshake() 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._sslobj.do_handshake() 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:41 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/562252014' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:41.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:41 smithi118 ceph-mon[28757]: mgrmap e17: smithi118.djbwyn(active, since 2s) 2024-09-21T11:31:43.472 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:43.472 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:44.041 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:44.087 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T11:31:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:43 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:43 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:43 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:43 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:44.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:43 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:31:44.826 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:44.827 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:44.827 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:45.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:31:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:31:45.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/121075493' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:45.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:45.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:45.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:45.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:45.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:45.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:31:45.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T11:31:45.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:31:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:45 smithi118 ceph-mon[28757]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-09-21T11:31:46.456 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:46.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:46.730 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:31:47.540 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:47.540 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:47.540 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:47 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1378419895' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:49.090 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:49.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:49.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:49.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T11:31:49.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T11:31:49.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:31:49.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:49 smithi118 ceph-mon[28757]: Deploying daemon crash.smithi149 on smithi149 2024-09-21T11:31:49.875 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:31:50.590 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:50.590 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:50.590 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:50 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/4060895794' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:52.299 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:52.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:51 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:51 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:51 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:51 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:51 smithi118 ceph-mon[28757]: Deploying daemon node-exporter.smithi149 on smithi149 2024-09-21T11:31:52.552 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:31:53.505 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:53.505 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:53.505 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:53.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:53 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/541300173' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:53.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:53.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:31:55.467 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:55.467 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:55.787 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:31:55.993 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:55 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:55.993 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:55 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:55.994 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:55 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:55.994 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:55 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:55.994 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:55 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.xjglai", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:31:55.994 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:55 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.xjglai", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T11:31:55.994 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:55 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:31:55.994 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:55 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:31:55.994 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:55 smithi118 ceph-mon[28757]: Deploying daemon mgr.smithi149.xjglai on smithi149 2024-09-21T11:31:56.877 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:31:56.877 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:31:56.877 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:31:57.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:56 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1634111343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:31:58.974 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:31:58.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:31:59.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:58 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:59.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:58 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:59.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:58 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:59.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:58 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:59.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:58 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T11:31:59.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:58 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:31:59.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:58 smithi118 ceph-mon[28757]: Deploying daemon mon.smithi149 on smithi149 2024-09-21T11:31:59.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:58 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:31:59.749 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:31:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:31:59 smithi118 ceph-mon[28757]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:01.026 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:32:01.026 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:29:30.783062Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T11:32:01.027 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-21T11:32:01.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:01 smithi149 systemd[1]: Started Ceph mon.smithi149 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:32:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:01 smithi118 ceph-mon[28757]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:02.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:01 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1321069208' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:32:03.050 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T11:32:03.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T11:32:03.300 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T11:32:06.964 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:32:06.964 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":2,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","modified":"2024-09-21T11:32:01.669801Z","created":"2024-09-21T11:29:30.783062Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi118","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi149","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T11:32:06.965 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 2 2024-09-21T11:32:07.011 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: mon.smithi118 calling monitor election 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/3096626423' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/crt"}]: dispatch 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: mon.smithi149 calling monitor election 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.012 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: mon.smithi118 is new leader, mons smithi118,smithi149 in quorum (ranks 0,1) 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: monmap epoch 2 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: last_changed 2024-09-21T11:32:01.669801+0000 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: created 2024-09-21T11:29:30.783062+0000 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: min_mon_release 19 (squid) 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: election_strategy: 1 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: 0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.smithi118 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: fsmap 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: mgrmap e17: smithi118.djbwyn(active, since 28s) 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: overall HEALTH_OK 2024-09-21T11:32:07.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: Standby manager daemon smithi149.xjglai started 2024-09-21T11:32:07.014 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.014 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/3096626423' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:32:07.014 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/3096626423' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/key"}]: dispatch 2024-09-21T11:32:07.014 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/3096626423' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:32:07.014 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.014 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.014 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.014 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: mon.smithi118 calling monitor election 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/3096626423' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/crt"}]: dispatch 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: mon.smithi149 calling monitor election 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: mon.smithi118 is new leader, mons smithi118,smithi149 in quorum (ranks 0,1) 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: monmap epoch 2 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: last_changed 2024-09-21T11:32:01.669801+0000 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: created 2024-09-21T11:29:30.783062+0000 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: min_mon_release 19 (squid) 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: election_strategy: 1 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: 0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.smithi118 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: fsmap 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: mgrmap e17: smithi118.djbwyn(active, since 28s) 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: overall HEALTH_OK 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: Standby manager daemon smithi149.xjglai started 2024-09-21T11:32:07.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/3096626423' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:32:07.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/3096626423' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/key"}]: dispatch 2024-09-21T11:32:07.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/3096626423' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:32:07.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:07.572 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T11:32:07.572 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T11:32:07.829 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:07.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:07 smithi149 ceph-mon[36123]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:07.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:07 smithi149 ceph-mon[36123]: mgrmap e18: smithi118.djbwyn(active, since 28s), standbys: smithi149.xjglai 2024-09-21T11:32:07.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:07 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi149.xjglai", "id": "smithi149.xjglai"}]: dispatch 2024-09-21T11:32:07.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:07 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:32:07.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:07 smithi149 ceph-mon[36123]: from='client.? 172.21.15.149:0/1967111572' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:32:07.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:07 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:07.950 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:07 smithi118 ceph-mon[28757]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:07.950 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:07 smithi118 ceph-mon[28757]: mgrmap e18: smithi118.djbwyn(active, since 28s), standbys: smithi149.xjglai 2024-09-21T11:32:07.950 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:07 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi149.xjglai", "id": "smithi149.xjglai"}]: dispatch 2024-09-21T11:32:07.950 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:07 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:32:07.950 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:07 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1967111572' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T11:32:07.950 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:07 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:32:08.438 INFO:teuthology.orchestra.run.smithi118.stdout:# minimal ceph.conf for ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:32:08.438 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2024-09-21T11:32:08.438 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:32:08.438 INFO:teuthology.orchestra.run.smithi118.stdout: mon_host = [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-21T11:32:09.035 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:08 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/38918647' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:09.035 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:32:09.035 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:09.062 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T11:32:09.062 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:32:09.062 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T11:32:09.091 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:32:09.091 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:32:09.156 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:32:09.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T11:32:09.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:08 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/38918647' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:09.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:32:09.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:09.183 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:32:09.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:32:09.248 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T11:32:09.248 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T11:32:09.250 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T11:32:09.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T11:32:09.293 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T11:32:09.293 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T11:32:09.336 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T11:32:09.336 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T11:32:09.380 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T11:32:09.380 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T11:32:09.423 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T11:32:09.423 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T11:32:09.467 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T11:32:09.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T11:32:09.521 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T11:32:09.521 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T11:32:09.568 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T11:32:09.569 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T11:32:09.612 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T11:32:09.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T11:32:09.655 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T11:32:09.656 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T11:32:09.659 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:09.705 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T11:32:09.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T11:32:09.717 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:09.724 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T11:32:09.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T11:32:09.780 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T11:32:09.780 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T11:32:09.830 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T11:32:09.831 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T11:32:09.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:09 smithi118 ceph-mon[28757]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:09.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:09.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:09.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:09.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:32:09.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:09.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:09.862 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T11:32:09.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T11:32:09.923 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-21T11:32:09.923 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-21T11:32:09.976 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T11:32:09.977 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T11:32:10.033 DEBUG:tasks.cephadm:set 18 configs 2024-09-21T11:32:10.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi118') 2024-09-21T11:32:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:09 smithi149 ceph-mon[36123]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:32:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T11:32:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:10.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:10 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3082607674' entity='client.admin' 2024-09-21T11:32:11.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-21T11:32:11.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-21T11:32:11.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:32:11.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:32:11.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:11.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:11.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:11.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T11:32:11.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T11:32:11.049 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:11.049 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:10 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3082607674' entity='client.admin' 2024-09-21T11:32:11.367 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi118') 2024-09-21T11:32:11.650 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:11.752 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:11 smithi118 ceph-mon[28757]: Reconfiguring mon.smithi118 (unknown last config time)... 2024-09-21T11:32:11.752 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:11 smithi118 ceph-mon[28757]: Reconfiguring daemon mon.smithi118 on smithi118 2024-09-21T11:32:11.752 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:11 smithi118 ceph-mon[28757]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:11.821 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:11 smithi149 ceph-mon[36123]: Reconfiguring mon.smithi118 (unknown last config time)... 2024-09-21T11:32:12.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:11 smithi149 ceph-mon[36123]: Reconfiguring daemon mon.smithi118 on smithi118 2024-09-21T11:32:12.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:11 smithi149 ceph-mon[36123]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:12.357 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.795 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.797 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.798 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.806 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.813 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.813 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.813 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.814 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.814 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:12.817 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:13.143 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:12 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2464688359' entity='client.admin' 2024-09-21T11:32:13.143 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:12 smithi118 ceph-mon[28757]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:13.171 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi118') 2024-09-21T11:32:13.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:12 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2464688359' entity='client.admin' 2024-09-21T11:32:13.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:12 smithi149 ceph-mon[36123]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:13.343 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:15.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:15 smithi118 ceph-mon[28757]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:15.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:15 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/259372157' entity='client.admin' 2024-09-21T11:32:15.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:15 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3175309002' entity='client.admin' 2024-09-21T11:32:15.719 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:15 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3177377616' entity='client.admin' 2024-09-21T11:32:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:15 smithi149 ceph-mon[36123]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:15 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/259372157' entity='client.admin' 2024-09-21T11:32:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:15 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3175309002' entity='client.admin' 2024-09-21T11:32:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:15 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3177377616' entity='client.admin' 2024-09-21T11:32:16.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:16 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3381992256' entity='client.admin' 2024-09-21T11:32:16.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:16 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3381992256' entity='client.admin' 2024-09-21T11:32:17.804 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:17 smithi118 ceph-mon[28757]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:17.805 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:17 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/96022045' entity='client.admin' 2024-09-21T11:32:17.805 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:17 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:17.805 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:17 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:17.805 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:17 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi118.djbwyn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:32:17.805 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:17 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:32:17.805 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:17 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:17 smithi149 ceph-mon[36123]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:17 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/96022045' entity='client.admin' 2024-09-21T11:32:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:17 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:17 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:17 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi118.djbwyn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:32:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:17 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:32:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:17 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:18.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:18 smithi118 ceph-mon[28757]: Reconfiguring mgr.smithi118.djbwyn (unknown last config time)... 2024-09-21T11:32:18.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:18 smithi118 ceph-mon[28757]: Reconfiguring daemon mgr.smithi118.djbwyn on smithi118 2024-09-21T11:32:18.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:18 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2246553377' entity='client.admin' 2024-09-21T11:32:18.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:18 smithi149 ceph-mon[36123]: Reconfiguring mgr.smithi118.djbwyn (unknown last config time)... 2024-09-21T11:32:18.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:18 smithi149 ceph-mon[36123]: Reconfiguring daemon mgr.smithi118.djbwyn on smithi118 2024-09-21T11:32:18.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:18 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2246553377' entity='client.admin' 2024-09-21T11:32:19.901 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:19 smithi118 ceph-mon[28757]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:19.901 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:19 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1475754468' entity='client.admin' 2024-09-21T11:32:19.901 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:19 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1138483409' entity='client.admin' 2024-09-21T11:32:19.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:19 smithi149 ceph-mon[36123]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:19 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1475754468' entity='client.admin' 2024-09-21T11:32:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:19 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1138483409' entity='client.admin' 2024-09-21T11:32:20.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.298+0000 7fc2d95c8640 1 -- 172.21.15.118:0/2403229720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fc2b4005180 con 0x7fc2d4101a80 2024-09-21T11:32:20.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.301+0000 7fc2bbfff640 1 -- 172.21.15.118:0/2403229720 <== mon.0 v2:172.21.15.118:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7fc2c8084bc0 con 0x7fc2d4101a80 2024-09-21T11:32:20.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 -- 172.21.15.118:0/2403229720 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fc2bc06e240 msgr2=0x7fc2bc070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:20.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 --2- 172.21.15.118:0/2403229720 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fc2bc06e240 0x7fc2bc070700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc2d41018e0 tx=0x7fc2c4005c20 comp rx=0 tx=0).stop 2024-09-21T11:32:20.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 -- 172.21.15.118:0/2403229720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d4101a80 msgr2=0x7fc2d419c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:20.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 --2- 172.21.15.118:0/2403229720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d4101a80 0x7fc2d419c160 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8006010 tx=0x7fc2c8004040 comp rx=0 tx=0).stop 2024-09-21T11:32:20.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 -- 172.21.15.118:0/2403229720 shutdown_connections 2024-09-21T11:32:20.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 --2- 172.21.15.118:0/2403229720 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fc2bc06e240 0x7fc2bc070700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:20.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 --2- 172.21.15.118:0/2403229720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d4101a80 0x7fc2d419c160 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:20.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 --2- 172.21.15.118:0/2403229720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d4100880 0x7fc2d406adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:20.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 -- 172.21.15.118:0/2403229720 >> 172.21.15.118:0/2403229720 conn(0x7fc2d40fc010 msgr2=0x7fc2d4105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:20.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 -- 172.21.15.118:0/2403229720 shutdown_connections 2024-09-21T11:32:20.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.303+0000 7fc2d95c8640 1 -- 172.21.15.118:0/2403229720 wait complete. 2024-09-21T11:32:20.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 -- 172.21.15.118:0/1941952471 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1da406e230 msgr2=0x7f1da40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:20.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 --2- 172.21.15.118:0/1941952471 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1da406e230 0x7f1da40706f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1da8000c00 tx=0x7f1da8004dd0 comp rx=0 tx=0).stop 2024-09-21T11:32:20.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 -- 172.21.15.118:0/1941952471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db8101a40 msgr2=0x7f1db8197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:20.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 --2- 172.21.15.118:0/1941952471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db8101a40 0x7f1db8197850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1da000d8d0 tx=0x7f1da000dd90 comp rx=0 tx=0).stop 2024-09-21T11:32:20.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 -- 172.21.15.118:0/1941952471 shutdown_connections 2024-09-21T11:32:20.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 --2- 172.21.15.118:0/1941952471 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1da406e230 0x7f1da40706f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:20.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 --2- 172.21.15.118:0/1941952471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db8101a40 0x7f1db8197850 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:20.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 --2- 172.21.15.118:0/1941952471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1db8100840 0x7f1db8197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:20.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 -- 172.21.15.118:0/1941952471 >> 172.21.15.118:0/1941952471 conn(0x7f1db80fbff0 msgr2=0x7f1db80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:20.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 -- 172.21.15.118:0/1941952471 shutdown_connections 2024-09-21T11:32:20.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:20.205+0000 7f1dbe699640 1 -- 172.21.15.118:0/1941952471 wait complete. 2024-09-21T11:32:21.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:21 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1941952471' entity='client.admin' 2024-09-21T11:32:21.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:21 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2403229720' entity='client.admin' 2024-09-21T11:32:21.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:21 smithi118 ceph-mon[28757]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:21.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:21 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1941952471' entity='client.admin' 2024-09-21T11:32:21.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:21 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2403229720' entity='client.admin' 2024-09-21T11:32:21.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:21 smithi149 ceph-mon[36123]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:21.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.989+0000 7f0296b8f640 1 -- 172.21.15.118:0/2776102956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 msgr2=0x7f0290101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:21.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.989+0000 7f0296b8f640 1 --2- 172.21.15.118:0/2776102956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 0x7f0290101ec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f027c009880 tx=0x7f027c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:32:21.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 -- 172.21.15.118:0/2776102956 shutdown_connections 2024-09-21T11:32:21.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 --2- 172.21.15.118:0/2776102956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 0x7f0290101ec0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:21.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 --2- 172.21.15.118:0/2776102956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0290100840 0x7f0290100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:21.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 -- 172.21.15.118:0/2776102956 >> 172.21.15.118:0/2776102956 conn(0x7f02900fbff0 msgr2=0x7f02900fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 -- 172.21.15.118:0/2776102956 shutdown_connections 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 -- 172.21.15.118:0/2776102956 wait complete. 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 Processor -- start 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 -- start start 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0290100840 0x7f029006a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 0x7f029019c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f02901095c0 con 0x7f0290101a40 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f0296b8f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0290109440 con 0x7f0290100840 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.990+0000 7f028ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 0x7f029019c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f028ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 0x7f029019c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38072/0 (socket says 172.21.15.118:38072) 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f028ffff640 1 -- 172.21.15.118:0/1734325308 learned_addr learned my addr 172.21.15.118:0/1734325308 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f028ffff640 1 -- 172.21.15.118:0/1734325308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0290100840 msgr2=0x7f029006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f028ffff640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0290100840 0x7f029006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f028ffff640 1 -- 172.21.15.118:0/1734325308 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029019c7d0 con 0x7f0290101a40 2024-09-21T11:32:21.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f028ffff640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 0x7f029019c210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f027c009230 tx=0x7f027c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:21.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f028dffb640 1 -- 172.21.15.118:0/1734325308 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f027c03f070 con 0x7f0290101a40 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029019ca60 con 0x7f0290101a40 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f028dffb640 1 -- 172.21.15.118:0/1734325308 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f027c003a90 con 0x7f0290101a40 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f028dffb640 1 -- 172.21.15.118:0/1734325308 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f027c035030 con 0x7f0290101a40 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.991+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f029019d010 con 0x7f0290101a40 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.992+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0290100cc0 con 0x7f0290101a40 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.993+0000 7f028dffb640 1 -- 172.21.15.118:0/1734325308 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f027c042070 con 0x7f0290101a40 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.993+0000 7f028dffb640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f028006e230 0x7f02800706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.993+0000 7f028dffb640 1 -- 172.21.15.118:0/1734325308 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f027c0adcd0 con 0x7f0290101a40 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.993+0000 7f029492b640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f028006e230 0x7f02800706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.994+0000 7f029492b640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f028006e230 0x7f02800706f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02901018a0 tx=0x7f0284006c90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:21.998+0000 7f028dffb640 1 -- 172.21.15.118:0/1734325308 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f027c005490 con 0x7f0290101a40 2024-09-21T11:32:22.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.169+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f0290062df0 con 0x7f0290101a40 2024-09-21T11:32:22.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.173+0000 7f028dffb640 1 -- 172.21.15.118:0/1734325308 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f027c07c680 con 0x7f0290101a40 2024-09-21T11:32:22.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.175+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f028006e230 msgr2=0x7f02800706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:22.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.175+0000 7f0296b8f640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f028006e230 0x7f02800706f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02901018a0 tx=0x7f0284006c90 comp rx=0 tx=0).stop 2024-09-21T11:32:22.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.175+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 msgr2=0x7f029019c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:22.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.175+0000 7f0296b8f640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 0x7f029019c210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f027c009230 tx=0x7f027c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.175+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 shutdown_connections 2024-09-21T11:32:22.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.175+0000 7f0296b8f640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f028006e230 0x7f02800706f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.175+0000 7f0296b8f640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0290101a40 0x7f029019c210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.175+0000 7f0296b8f640 1 --2- 172.21.15.118:0/1734325308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0290100840 0x7f029006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.175+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 >> 172.21.15.118:0/1734325308 conn(0x7f02900fbff0 msgr2=0x7f0290105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:22.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.176+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 shutdown_connections 2024-09-21T11:32:22.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.176+0000 7f0296b8f640 1 -- 172.21.15.118:0/1734325308 wait complete. 2024-09-21T11:32:22.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.533+0000 7f9882ac0640 1 -- 172.21.15.118:0/289271003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 msgr2=0x7f987c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.533+0000 7f9882ac0640 1 --2- 172.21.15.118:0/289271003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 0x7f987c107130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f98680098b0 tx=0x7f986802a4d0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.533+0000 7f9882ac0640 1 -- 172.21.15.118:0/289271003 shutdown_connections 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.533+0000 7f9882ac0640 1 --2- 172.21.15.118:0/289271003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 0x7f987c107130 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.533+0000 7f9882ac0640 1 --2- 172.21.15.118:0/289271003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f987c102410 0x7f987c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.533+0000 7f9882ac0640 1 -- 172.21.15.118:0/289271003 >> 172.21.15.118:0/289271003 conn(0x7f987c0fc010 msgr2=0x7f987c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.533+0000 7f9882ac0640 1 -- 172.21.15.118:0/289271003 shutdown_connections 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.533+0000 7f9882ac0640 1 -- 172.21.15.118:0/289271003 wait complete. 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.533+0000 7f9882ac0640 1 Processor -- start 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f9882ac0640 1 -- start start 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f9882ac0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f987c102410 0x7f987c101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f9882ac0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 0x7f987c1003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f9882ac0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f987c10a6f0 con 0x7f987c104d40 2024-09-21T11:32:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f9882ac0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f987c10a570 con 0x7f987c102410 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f987bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 0x7f987c1003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f987bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 0x7f987c1003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38102/0 (socket says 172.21.15.118:38102) 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f987bfff640 1 -- 172.21.15.118:0/3962152241 learned_addr learned my addr 172.21.15.118:0/3962152241 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f988085c640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f987c102410 0x7f987c101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f987bfff640 1 -- 172.21.15.118:0/3962152241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f987c102410 msgr2=0x7f987c101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f987bfff640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f987c102410 0x7f987c101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f987bfff640 1 -- 172.21.15.118:0/3962152241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c100900 con 0x7f987c104d40 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f988085c640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f987c102410 0x7f987c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.534+0000 7f987bfff640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 0x7f987c1003c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9868009880 tx=0x7f98680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.535+0000 7f9879ffb640 1 -- 172.21.15.118:0/3962152241 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f986803f070 con 0x7f987c104d40 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.535+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987c100b90 con 0x7f987c104d40 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.535+0000 7f9879ffb640 1 -- 172.21.15.118:0/3962152241 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f9868003a90 con 0x7f987c104d40 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.535+0000 7f9879ffb640 1 -- 172.21.15.118:0/3962152241 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9868035030 con 0x7f987c104d40 2024-09-21T11:32:22.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.535+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987c101140 con 0x7f987c104d40 2024-09-21T11:32:22.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.536+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987c102870 con 0x7f987c104d40 2024-09-21T11:32:22.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.536+0000 7f9879ffb640 1 -- 172.21.15.118:0/3962152241 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f9868042070 con 0x7f987c104d40 2024-09-21T11:32:22.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.537+0000 7f9879ffb640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f986c06e280 0x7f986c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:22.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.537+0000 7f9879ffb640 1 -- 172.21.15.118:0/3962152241 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f98680adaf0 con 0x7f987c104d40 2024-09-21T11:32:22.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.537+0000 7f988085c640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f986c06e280 0x7f986c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:22.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.537+0000 7f988085c640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f986c06e280 0x7f986c070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9870006fd0 tx=0x7f9870008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:22.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.541+0000 7f9879ffb640 1 -- 172.21.15.118:0/3962152241 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f986807c5b0 con 0x7f987c104d40 2024-09-21T11:32:22.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.710+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f987c19f640 con 0x7f987c104d40 2024-09-21T11:32:22.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.713+0000 7f9879ffb640 1 -- 172.21.15.118:0/3962152241 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7f9868080260 con 0x7f987c104d40 2024-09-21T11:32:22.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.714+0000 7f9879ffb640 1 -- 172.21.15.118:0/3962152241 <== mon.0 v2:172.21.15.118:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f98680b3080 con 0x7f987c104d40 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f986c06e280 msgr2=0x7f986c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f986c06e280 0x7f986c070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9870006fd0 tx=0x7f9870008040 comp rx=0 tx=0).stop 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 msgr2=0x7f987c1003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 0x7f987c1003c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9868009880 tx=0x7f98680048f0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 shutdown_connections 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f986c06e280 0x7f986c070740 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f987c104d40 0x7f987c1003c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 --2- 172.21.15.118:0/3962152241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f987c102410 0x7f987c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 >> 172.21.15.118:0/3962152241 conn(0x7f987c0fc010 msgr2=0x7f987c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 shutdown_connections 2024-09-21T11:32:22.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:22.715+0000 7f9882ac0640 1 -- 172.21.15.118:0/3962152241 wait complete. 2024-09-21T11:32:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:23 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1734325308' entity='client.admin' 2024-09-21T11:32:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:23 smithi149 ceph-mon[36123]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:23 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3962152241' entity='client.admin' 2024-09-21T11:32:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:23 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1734325308' entity='client.admin' 2024-09-21T11:32:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:23 smithi118 ceph-mon[28757]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:23 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3962152241' entity='client.admin' 2024-09-21T11:32:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.231+0000 7f8e8ae40640 1 -- 172.21.15.118:0/3607784453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84101a40 msgr2=0x7f8e84101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.231+0000 7f8e8ae40640 1 --2- 172.21.15.118:0/3607784453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84101a40 0x7f8e84101ec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009c20 tx=0x7f8e7402a970 comp rx=0 tx=0).stop 2024-09-21T11:32:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.231+0000 7f8e8ae40640 1 -- 172.21.15.118:0/3607784453 shutdown_connections 2024-09-21T11:32:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.231+0000 7f8e8ae40640 1 --2- 172.21.15.118:0/3607784453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84101a40 0x7f8e84101ec0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.231+0000 7f8e8ae40640 1 --2- 172.21.15.118:0/3607784453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e84100840 0x7f8e84100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.231+0000 7f8e8ae40640 1 -- 172.21.15.118:0/3607784453 >> 172.21.15.118:0/3607784453 conn(0x7f8e840fbff0 msgr2=0x7f8e840fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.231+0000 7f8e8ae40640 1 -- 172.21.15.118:0/3607784453 shutdown_connections 2024-09-21T11:32:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.231+0000 7f8e8ae40640 1 -- 172.21.15.118:0/3607784453 wait complete. 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e8ae40640 1 Processor -- start 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e8ae40640 1 -- start start 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e8ae40640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84100840 0x7f8e84104760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e8ae40640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e84101a40 0x7f8e84102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e8ae40640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84109680 con 0x7f8e84100840 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e8ae40640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84109500 con 0x7f8e84101a40 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e88bdc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84100840 0x7f8e84104760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e88bdc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84100840 0x7f8e84104760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38118/0 (socket says 172.21.15.118:38118) 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e88bdc640 1 -- 172.21.15.118:0/2883951272 learned_addr learned my addr 172.21.15.118:0/2883951272 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:32:24.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e83fff640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e84101a40 0x7f8e84102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:24.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e88bdc640 1 -- 172.21.15.118:0/2883951272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e84101a40 msgr2=0x7f8e84102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:24.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e88bdc640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e84101a40 0x7f8e84102e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:24.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.232+0000 7f8e88bdc640 1 -- 172.21.15.118:0/2883951272 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e84103360 con 0x7f8e84100840 2024-09-21T11:32:24.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.233+0000 7f8e88bdc640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84100840 0x7f8e84104760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00d8d0 tx=0x7f8e7c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:24.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.233+0000 7f8e81ffb640 1 -- 172.21.15.118:0/2883951272 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e7c017070 con 0x7f8e84100840 2024-09-21T11:32:24.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.233+0000 7f8e81ffb640 1 -- 172.21.15.118:0/2883951272 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e7c00be10 con 0x7f8e84100840 2024-09-21T11:32:24.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.233+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e84103650 con 0x7f8e84100840 2024-09-21T11:32:24.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.233+0000 7f8e81ffb640 1 -- 172.21.15.118:0/2883951272 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e7c00f3c0 con 0x7f8e84100840 2024-09-21T11:32:24.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.233+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e84103c60 con 0x7f8e84100840 2024-09-21T11:32:24.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.234+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e84100c40 con 0x7f8e84100840 2024-09-21T11:32:24.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.234+0000 7f8e81ffb640 1 -- 172.21.15.118:0/2883951272 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f8e7c01a070 con 0x7f8e84100840 2024-09-21T11:32:24.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.235+0000 7f8e81ffb640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f8e7006e280 0x7f8e70070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:24.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.235+0000 7f8e81ffb640 1 -- 172.21.15.118:0/2883951272 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8e7c08cc10 con 0x7f8e84100840 2024-09-21T11:32:24.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.235+0000 7f8e83fff640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f8e7006e280 0x7f8e70070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:24.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.235+0000 7f8e83fff640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f8e7006e280 0x7f8e70070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8e841044e0 tx=0x7f8e7402f9f0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:24.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.239+0000 7f8e81ffb640 1 -- 172.21.15.118:0/2883951272 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e7c05b6d0 con 0x7f8e84100840 2024-09-21T11:32:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:32:24.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.416+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f8e8419f580 con 0x7f8e84100840 2024-09-21T11:32:24.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.419+0000 7f8e81ffb640 1 -- 172.21.15.118:0/2883951272 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f8e7c05f380 con 0x7f8e84100840 2024-09-21T11:32:24.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f8e7006e280 msgr2=0x7f8e70070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:24.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f8e7006e280 0x7f8e70070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8e841044e0 tx=0x7f8e7402f9f0 comp rx=0 tx=0).stop 2024-09-21T11:32:24.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84100840 msgr2=0x7f8e84104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:24.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84100840 0x7f8e84104760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00d8d0 tx=0x7f8e7c00dd90 comp rx=0 tx=0).stop 2024-09-21T11:32:24.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 shutdown_connections 2024-09-21T11:32:24.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f8e7006e280 0x7f8e70070740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:24.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e84101a40 0x7f8e84102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:24.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 --2- 172.21.15.118:0/2883951272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e84100840 0x7f8e84104760 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:24.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 >> 172.21.15.118:0/2883951272 conn(0x7f8e840fbff0 msgr2=0x7f8e840fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:24.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 shutdown_connections 2024-09-21T11:32:24.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:24.422+0000 7f8e8ae40640 1 -- 172.21.15.118:0/2883951272 wait complete. 2024-09-21T11:32:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:32:25.613 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:25 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2883951272' entity='client.admin' 2024-09-21T11:32:25.613 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:25 smithi118 ceph-mon[28757]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:25.613 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:25 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:25.614 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:25 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:25.614 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:25 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi118", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:32:25.614 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:25 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:25 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2883951272' entity='client.admin' 2024-09-21T11:32:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:25 smithi149 ceph-mon[36123]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:25 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:25 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:25 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi118", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:32:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:25 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:25.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.930+0000 7f6280df8640 1 -- 172.21.15.118:0/2623582698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c102b90 msgr2=0x7f627c103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:25.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.930+0000 7f6280df8640 1 --2- 172.21.15.118:0/2623582698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c102b90 0x7f627c103010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6270009880 tx=0x7f627002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:32:25.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.930+0000 7f6280df8640 1 -- 172.21.15.118:0/2623582698 shutdown_connections 2024-09-21T11:32:25.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.930+0000 7f6280df8640 1 --2- 172.21.15.118:0/2623582698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c102b90 0x7f627c103010 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.930+0000 7f6280df8640 1 --2- 172.21.15.118:0/2623582698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c101990 0x7f627c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.930+0000 7f6280df8640 1 -- 172.21.15.118:0/2623582698 >> 172.21.15.118:0/2623582698 conn(0x7f627c0fd140 msgr2=0x7f627c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.930+0000 7f6280df8640 1 -- 172.21.15.118:0/2623582698 shutdown_connections 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.930+0000 7f6280df8640 1 -- 172.21.15.118:0/2623582698 wait complete. 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f6280df8640 1 Processor -- start 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f6280df8640 1 -- start start 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f6280df8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c101990 0x7f627c1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f6280df8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c102b90 0x7f627c197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f6280df8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f627c10a7d0 con 0x7f627c101990 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f6280df8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f627c10a650 con 0x7f627c102b90 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f627a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c101990 0x7f627c1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f627a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c101990 0x7f627c1974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38578/0 (socket says 172.21.15.118:38578) 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f627a59c640 1 -- 172.21.15.118:0/1204284339 learned_addr learned my addr 172.21.15.118:0/1204284339 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f6279d9b640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c102b90 0x7f627c197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f627a59c640 1 -- 172.21.15.118:0/1204284339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c102b90 msgr2=0x7f627c197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f627a59c640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c102b90 0x7f627c197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.931+0000 7f627a59c640 1 -- 172.21.15.118:0/1204284339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c198080 con 0x7f627c101990 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.932+0000 7f627a59c640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c101990 0x7f627c1974c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f626c00d8d0 tx=0x7f626c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.932+0000 7f626b7fe640 1 -- 172.21.15.118:0/1204284339 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f626c017070 con 0x7f627c101990 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.932+0000 7f626b7fe640 1 -- 172.21.15.118:0/1204284339 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f626c00be10 con 0x7f627c101990 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.932+0000 7f626b7fe640 1 -- 172.21.15.118:0/1204284339 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f626c00f3c0 con 0x7f627c101990 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.932+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627c19cac0 con 0x7f627c101990 2024-09-21T11:32:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.932+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627c19d020 con 0x7f627c101990 2024-09-21T11:32:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.933+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627c101d90 con 0x7f627c101990 2024-09-21T11:32:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.933+0000 7f626b7fe640 1 -- 172.21.15.118:0/1204284339 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f626c01a070 con 0x7f627c101990 2024-09-21T11:32:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.934+0000 7f626b7fe640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f626406e280 0x7f6264070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.934+0000 7f626b7fe640 1 -- 172.21.15.118:0/1204284339 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f626c08caf0 con 0x7f627c101990 2024-09-21T11:32:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.934+0000 7f6279d9b640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f626406e280 0x7f6264070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.934+0000 7f6279d9b640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f626406e280 0x7f6264070740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6270000c00 tx=0x7f62700058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:25.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.938+0000 7f626b7fe640 1 -- 172.21.15.118:0/1204284339 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f626c05f260 con 0x7f627c101990 2024-09-21T11:32:26.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.119+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f627c19d250 con 0x7f627c101990 2024-09-21T11:32:26.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.123+0000 7f626b7fe640 1 -- 172.21.15.118:0/1204284339 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7f626c063a90 con 0x7f627c101990 2024-09-21T11:32:26.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f626406e280 msgr2=0x7f6264070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:26.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f626406e280 0x7f6264070740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6270000c00 tx=0x7f62700058d0 comp rx=0 tx=0).stop 2024-09-21T11:32:26.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c101990 msgr2=0x7f627c1974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:26.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c101990 0x7f627c1974c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f626c00d8d0 tx=0x7f626c00dd90 comp rx=0 tx=0).stop 2024-09-21T11:32:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 shutdown_connections 2024-09-21T11:32:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f626406e280 0x7f6264070740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c102b90 0x7f627c197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 --2- 172.21.15.118:0/1204284339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f627c101990 0x7f627c1974c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 >> 172.21.15.118:0/1204284339 conn(0x7f627c0fd140 msgr2=0x7f627c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 shutdown_connections 2024-09-21T11:32:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:26.125+0000 7f6280df8640 1 -- 172.21.15.118:0/1204284339 wait complete. 2024-09-21T11:32:26.868 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:26 smithi118 ceph-mon[28757]: Reconfiguring ceph-exporter.smithi118 (monmap changed)... 2024-09-21T11:32:26.868 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:26 smithi118 ceph-mon[28757]: Reconfiguring daemon ceph-exporter.smithi118 on smithi118 2024-09-21T11:32:26.868 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:26 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1141469826' entity='client.admin' 2024-09-21T11:32:26.868 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:26 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1204284339' entity='client.admin' 2024-09-21T11:32:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:26 smithi149 ceph-mon[36123]: Reconfiguring ceph-exporter.smithi118 (monmap changed)... 2024-09-21T11:32:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:26 smithi149 ceph-mon[36123]: Reconfiguring daemon ceph-exporter.smithi118 on smithi118 2024-09-21T11:32:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:26 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1141469826' entity='client.admin' 2024-09-21T11:32:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:26 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1204284339' entity='client.admin' 2024-09-21T11:32:27.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.434+0000 7f67d5043640 1 -- 172.21.15.118:0/1331771190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0101e10 msgr2=0x7f67d0102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.434+0000 7f67d5043640 1 --2- 172.21.15.118:0/1331771190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0101e10 0x7f67d0102210 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009c20 tx=0x7f67c002a970 comp rx=0 tx=0).stop 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.434+0000 7f67d5043640 1 -- 172.21.15.118:0/1331771190 shutdown_connections 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.434+0000 7f67d5043640 1 --2- 172.21.15.118:0/1331771190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d0100b50 0x7f67d0100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.434+0000 7f67d5043640 1 --2- 172.21.15.118:0/1331771190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0101e10 0x7f67d0102210 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.434+0000 7f67d5043640 1 -- 172.21.15.118:0/1331771190 >> 172.21.15.118:0/1331771190 conn(0x7f67d00fb790 msgr2=0x7f67d00fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.434+0000 7f67d5043640 1 -- 172.21.15.118:0/1331771190 shutdown_connections 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.434+0000 7f67d5043640 1 -- 172.21.15.118:0/1331771190 wait complete. 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.434+0000 7f67d5043640 1 Processor -- start 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67d5043640 1 -- start start 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67d5043640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0100b50 0x7f67d0100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67d5043640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d0101e10 0x7f67d019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67d5043640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0109720 con 0x7f67d0100b50 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67d5043640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f67d01095a0 con 0x7f67d0101e10 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67ced9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0100b50 0x7f67d0100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67ced9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0100b50 0x7f67d0100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38132/0 (socket says 172.21.15.118:38132) 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67ced9d640 1 -- 172.21.15.118:0/1141469826 learned_addr learned my addr 172.21.15.118:0/1141469826 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67ce59c640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d0101e10 0x7f67d019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67ced9d640 1 -- 172.21.15.118:0/1141469826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d0101e10 msgr2=0x7f67d019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67ced9d640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d0101e10 0x7f67d019c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67ced9d640 1 -- 172.21.15.118:0/1141469826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d019c8c0 con 0x7f67d0100b50 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67ce59c640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d0101e10 0x7f67d019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.435+0000 7f67ced9d640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0100b50 0x7f67d0100530 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f67c002fd60 tx=0x7f67c002fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.436+0000 7f67b7fff640 1 -- 172.21.15.118:0/1141469826 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67c0047070 con 0x7f67d0100b50 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.436+0000 7f67b7fff640 1 -- 172.21.15.118:0/1141469826 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67c0031e30 con 0x7f67d0100b50 2024-09-21T11:32:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.436+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d019cb50 con 0x7f67d0100b50 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.436+0000 7f67b7fff640 1 -- 172.21.15.118:0/1141469826 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67c0034070 con 0x7f67d0100b50 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.436+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d019d080 con 0x7f67d0100b50 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.437+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d0101050 con 0x7f67d0100b50 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.437+0000 7f67b7fff640 1 -- 172.21.15.118:0/1141469826 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f67c004a070 con 0x7f67d0100b50 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.438+0000 7f67b7fff640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f67b806e240 0x7f67b8070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.438+0000 7f67b7fff640 1 -- 172.21.15.118:0/1141469826 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f67c00adf00 con 0x7f67d0100b50 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.438+0000 7f67ce59c640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f67b806e240 0x7f67b8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.438+0000 7f67ce59c640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f67b806e240 0x7f67b8070700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f67d01002b0 tx=0x7f67c4008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.442+0000 7f67b7fff640 1 -- 172.21.15.118:0/1141469826 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67c003f070 con 0x7f67d0100b50 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.611+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f67d019da00 con 0x7f67d0100b50 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.614+0000 7f67b7fff640 1 -- 172.21.15.118:0/1141469826 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7f67c0080560 con 0x7f67d0100b50 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f67b806e240 msgr2=0x7f67b8070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f67b806e240 0x7f67b8070700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f67d01002b0 tx=0x7f67c4008040 comp rx=0 tx=0).stop 2024-09-21T11:32:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0100b50 msgr2=0x7f67d0100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0100b50 0x7f67d0100530 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f67c002fd60 tx=0x7f67c002fd90 comp rx=0 tx=0).stop 2024-09-21T11:32:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 shutdown_connections 2024-09-21T11:32:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f67b806e240 0x7f67b8070700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d0101e10 0x7f67d019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 --2- 172.21.15.118:0/1141469826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d0100b50 0x7f67d0100530 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 >> 172.21.15.118:0/1141469826 conn(0x7f67d00fb790 msgr2=0x7f67d00fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 shutdown_connections 2024-09-21T11:32:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:25.616+0000 7f67d5043640 1 -- 172.21.15.118:0/1141469826 wait complete. 2024-09-21T11:32:27.643 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:27.765 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:27 smithi118 ceph-mon[28757]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:27 smithi149 ceph-mon[36123]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:29.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:29 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3501719874' entity='client.admin' 2024-09-21T11:32:29.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:29 smithi118 ceph-mon[28757]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:29.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:29 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3501719874' entity='client.admin' 2024-09-21T11:32:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:29 smithi149 ceph-mon[36123]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:30.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3300205149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 msgr2=0x7ff4a81048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:30.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 --2- 172.21.15.118:0/3300205149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 0x7ff4a81048c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff498009880 tx=0x7ff49802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3300205149 shutdown_connections 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 --2- 172.21.15.118:0/3300205149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4a8104e00 0x7ff4a81071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 --2- 172.21.15.118:0/3300205149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 0x7ff4a81048c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3300205149 >> 172.21.15.118:0/3300205149 conn(0x7ff4a80fc010 msgr2=0x7ff4a80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3300205149 shutdown_connections 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3300205149 wait complete. 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 Processor -- start 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.070+0000 7ff4ad64c640 1 -- start start 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4ad64c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 0x7ff4a8101dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4ad64c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4a8104e00 0x7ff4a8100480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4ad64c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a810a840 con 0x7ff4a81024d0 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4ad64c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a810a6c0 con 0x7ff4a8104e00 2024-09-21T11:32:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 0x7ff4a8101dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 0x7ff4a8101dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38600/0 (socket says 172.21.15.118:38600) 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a6ffd640 1 -- 172.21.15.118:0/3501719874 learned_addr learned my addr 172.21.15.118:0/3501719874 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a6ffd640 1 -- 172.21.15.118:0/3501719874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4a8104e00 msgr2=0x7ff4a8100480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a6ffd640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4a8104e00 0x7ff4a8100480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a6ffd640 1 -- 172.21.15.118:0/3501719874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a81009c0 con 0x7ff4a81024d0 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a6ffd640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 0x7ff4a8101dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff498009230 tx=0x7ff4980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a4ff9640 1 -- 172.21.15.118:0/3501719874 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff49803f070 con 0x7ff4a81024d0 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a4ff9640 1 -- 172.21.15.118:0/3501719874 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4980044d0 con 0x7ff4a81024d0 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a8100c50 con 0x7ff4a81024d0 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4a4ff9640 1 -- 172.21.15.118:0/3501719874 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff498035030 con 0x7ff4a81024d0 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.071+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a8101200 con 0x7ff4a81024d0 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.072+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a81028b0 con 0x7ff4a81024d0 2024-09-21T11:32:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.073+0000 7ff4a4ff9640 1 -- 172.21.15.118:0/3501719874 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7ff498042070 con 0x7ff4a81024d0 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.073+0000 7ff4a4ff9640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff49406e240 0x7ff494070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.073+0000 7ff4a4ff9640 1 -- 172.21.15.118:0/3501719874 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff4980add90 con 0x7ff4a81024d0 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.073+0000 7ff49ffff640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff49406e240 0x7ff494070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.074+0000 7ff49ffff640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff49406e240 0x7ff494070700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8101b40 tx=0x7ff490006c90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.078+0000 7ff4a4ff9640 1 -- 172.21.15.118:0/3501719874 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff49807c7d0 con 0x7ff4a81024d0 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.244+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ff4a819f570 con 0x7ff4a81024d0 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.248+0000 7ff4a4ff9640 1 -- 172.21.15.118:0/3501719874 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7ff498080480 con 0x7ff4a81024d0 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff49406e240 msgr2=0x7ff494070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff49406e240 0x7ff494070700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8101b40 tx=0x7ff490006c90 comp rx=0 tx=0).stop 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 msgr2=0x7ff4a8101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 0x7ff4a8101dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff498009230 tx=0x7ff4980048f0 comp rx=0 tx=0).stop 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 shutdown_connections 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff49406e240 0x7ff494070700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4a8104e00 0x7ff4a8100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 --2- 172.21.15.118:0/3501719874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4a81024d0 0x7ff4a8101dc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:30.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 >> 172.21.15.118:0/3501719874 conn(0x7ff4a80fc010 msgr2=0x7ff4a80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:30.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 shutdown_connections 2024-09-21T11:32:30.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:28.250+0000 7ff4ad64c640 1 -- 172.21.15.118:0/3501719874 wait complete. 2024-09-21T11:32:31.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.035 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.035 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.035 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.035 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:31 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:31.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:31 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:31.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:31 smithi118 ceph-mon[28757]: Reconfiguring crash.smithi118 (monmap changed)... 2024-09-21T11:32:31.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:31 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi118", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T11:32:31.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:31 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:31.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:31 smithi118 ceph-mon[28757]: Reconfiguring daemon crash.smithi118 on smithi118 2024-09-21T11:32:31.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:31 smithi118 ceph-mon[28757]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:31 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:31 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:31 smithi149 ceph-mon[36123]: Reconfiguring crash.smithi118 (monmap changed)... 2024-09-21T11:32:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:31 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi118", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T11:32:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:31 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:31 smithi149 ceph-mon[36123]: Reconfiguring daemon crash.smithi118 on smithi118 2024-09-21T11:32:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:31 smithi149 ceph-mon[36123]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:31.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae037950-780c-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi118') 2024-09-21T11:32:31.617 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T11:32:31.618 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:32:31.618 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T11:32:31.635 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T11:32:31.635 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2024-09-21T11:32:31.692 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T11:32:31.692 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T11:32:31.692 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T11:32:31.692 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:32:31.692 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T11:32:31.692 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-21 11:31:31.927028518 +0000 2024-09-21T11:32:31.693 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-21 11:26:06.320461924 +0000 2024-09-21T11:32:31.693 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-21 11:26:06.320461924 +0000 2024-09-21T11:32:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-21 11:26:06.320461924 +0000 2024-09-21T11:32:31.693 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T11:32:31.758 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-21T11:32:31.759 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-21T11:32:31.759 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000114667 s, 4.5 MB/s 2024-09-21T11:32:31.760 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T11:32:31.818 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2024-09-21T11:32:31.874 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T11:32:31.874 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T11:32:31.874 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T11:32:31.875 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:32:31.875 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T11:32:31.875 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-21 11:31:31.928028497 +0000 2024-09-21T11:32:31.875 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-21 11:26:06.637454987 +0000 2024-09-21T11:32:31.875 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-21 11:26:06.637454987 +0000 2024-09-21T11:32:31.875 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-21 11:26:06.637454987 +0000 2024-09-21T11:32:31.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T11:32:31.939 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-21T11:32:31.939 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-21T11:32:31.940 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 9.3838e-05 s, 5.5 MB/s 2024-09-21T11:32:31.941 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T11:32:31.997 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2024-09-21T11:32:32.054 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T11:32:32.054 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T11:32:32.054 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T11:32:32.054 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:32:32.054 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T11:32:32.054 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-21 11:31:31.928028497 +0000 2024-09-21T11:32:32.054 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-21 11:26:06.966447787 +0000 2024-09-21T11:32:32.054 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-21 11:26:06.966447787 +0000 2024-09-21T11:32:32.054 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-21 11:26:06.966447787 +0000 2024-09-21T11:32:32.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T11:32:32.117 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-21T11:32:32.117 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-21T11:32:32.117 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 8.7471e-05 s, 5.9 MB/s 2024-09-21T11:32:32.118 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T11:32:32.176 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2024-09-21T11:32:32.231 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T11:32:32.232 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T11:32:32.232 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T11:32:32.232 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:32:32.232 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T11:32:32.232 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-21 11:31:31.928028497 +0000 2024-09-21T11:32:32.232 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-21 11:26:07.274441047 +0000 2024-09-21T11:32:32.232 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-21 11:26:07.274441047 +0000 2024-09-21T11:32:32.232 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-21 11:26:07.274441047 +0000 2024-09-21T11:32:32.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T11:32:32.296 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-21T11:32:32.296 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-21T11:32:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 8.6545e-05 s, 5.9 MB/s 2024-09-21T11:32:32.297 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T11:32:32.355 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:32:32.355 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T11:32:32.375 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T11:32:32.375 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-09-21T11:32:32.434 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T11:32:32.434 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T11:32:32.434 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 798 Links: 1 2024-09-21T11:32:32.434 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:32:32.434 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T11:32:32.434 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 11:32:00.485640744 +0000 2024-09-21T11:32:32.434 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 11:26:14.302181406 +0000 2024-09-21T11:32:32.434 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 11:26:14.302181406 +0000 2024-09-21T11:32:32.434 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 11:26:14.302181406 +0000 2024-09-21T11:32:32.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T11:32:32.502 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T11:32:32.502 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T11:32:32.502 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000278674 s, 1.8 MB/s 2024-09-21T11:32:32.503 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T11:32:32.562 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-09-21T11:32:32.618 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T11:32:32.619 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T11:32:32.619 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 819 Links: 1 2024-09-21T11:32:32.619 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:32:32.619 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T11:32:32.619 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 11:32:00.485640744 +0000 2024-09-21T11:32:32.619 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 11:26:14.686173429 +0000 2024-09-21T11:32:32.619 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 11:26:14.686173429 +0000 2024-09-21T11:32:32.619 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 11:26:14.686173429 +0000 2024-09-21T11:32:32.619 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T11:32:32.684 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T11:32:32.684 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T11:32:32.684 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.00026549 s, 1.9 MB/s 2024-09-21T11:32:32.685 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T11:32:32.743 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-09-21T11:32:32.800 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T11:32:32.800 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T11:32:32.800 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 838 Links: 1 2024-09-21T11:32:32.800 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:32:32.800 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T11:32:32.800 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 11:32:00.486640723 +0000 2024-09-21T11:32:32.800 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 11:26:15.007166762 +0000 2024-09-21T11:32:32.800 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 11:26:15.007166762 +0000 2024-09-21T11:32:32.800 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 11:26:15.007166762 +0000 2024-09-21T11:32:32.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T11:32:32.864 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T11:32:32.864 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T11:32:32.864 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000199989 s, 2.6 MB/s 2024-09-21T11:32:32.866 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T11:32:32.922 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-09-21T11:32:32.978 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T11:32:32.978 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T11:32:32.978 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 857 Links: 1 2024-09-21T11:32:32.978 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:32:32.978 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T11:32:32.979 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 11:32:00.486640723 +0000 2024-09-21T11:32:32.979 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 11:26:15.318160301 +0000 2024-09-21T11:32:32.979 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 11:26:15.318160301 +0000 2024-09-21T11:32:32.979 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 11:26:15.318160301 +0000 2024-09-21T11:32:32.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T11:32:33.042 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T11:32:33.042 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T11:32:33.042 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000219915 s, 2.3 MB/s 2024-09-21T11:32:33.043 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T11:32:33.100 INFO:tasks.cephadm:Deploying osd.0 on smithi118 with /dev/vg_nvme/lv_4... 2024-09-21T11:32:33.100 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T11:32:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:33 smithi149 ceph-mon[36123]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:33 smithi149 ceph-mon[36123]: Reconfiguring alertmanager.smithi118 (dependencies changed)... 2024-09-21T11:32:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:33 smithi149 ceph-mon[36123]: Reconfiguring daemon alertmanager.smithi118 on smithi118 2024-09-21T11:32:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:33 smithi118 ceph-mon[28757]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:33 smithi118 ceph-mon[28757]: Reconfiguring alertmanager.smithi118 (dependencies changed)... 2024-09-21T11:32:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:33 smithi118 ceph-mon[28757]: Reconfiguring daemon alertmanager.smithi118 on smithi118 2024-09-21T11:32:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:35 smithi149 ceph-mon[36123]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:35 smithi118 ceph-mon[28757]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:37 smithi118 ceph-mon[28757]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:37 smithi149 ceph-mon[36123]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:38.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:38 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:32:39.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:32:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:39 smithi118 ceph-mon[28757]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:39.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:39 smithi149 ceph-mon[36123]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:39.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:39.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:40.957 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:40 smithi118 ceph-mon[28757]: Reconfiguring grafana.smithi118 (dependencies changed)... 2024-09-21T11:32:40.957 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:40 smithi118 ceph-mon[28757]: Reconfiguring daemon grafana.smithi118 on smithi118 2024-09-21T11:32:40.960 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:32:40.985 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi118:vg_nvme/lv_4 2024-09-21T11:32:41.121 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:40 smithi149 ceph-mon[36123]: Reconfiguring grafana.smithi118 (dependencies changed)... 2024-09-21T11:32:41.121 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:40 smithi149 ceph-mon[36123]: Reconfiguring daemon grafana.smithi118 on smithi118 2024-09-21T11:32:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:41 smithi118 ceph-mon[28757]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:42.076 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:41 smithi149 ceph-mon[36123]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:42.891 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:32:43.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:43 smithi149 ceph-mon[36123]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:43.997 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:43 smithi118 ceph-mon[28757]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1682212227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec100840 msgr2=0x7f7aec100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 --2- 172.21.15.118:0/1682212227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec100840 0x7f7aec100c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009c20 tx=0x7f7adc02a970 comp rx=0 tx=0).stop 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1682212227 shutdown_connections 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 --2- 172.21.15.118:0/1682212227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aec101a40 0x7f7aec101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 --2- 172.21.15.118:0/1682212227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec100840 0x7f7aec100c40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1682212227 >> 172.21.15.118:0/1682212227 conn(0x7f7aec0fbff0 msgr2=0x7f7aec0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1682212227 shutdown_connections 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1682212227 wait complete. 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 Processor -- start 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.085+0000 7f7af1ffb640 1 -- start start 2024-09-21T11:32:44.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7af1ffb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aec100840 0x7f7aec1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7af1ffb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec101a40 0x7f7aec197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7af1ffb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec109680 con 0x7f7aec101a40 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7af1ffb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec109500 con 0x7f7aec100840 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7aeaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec101a40 0x7f7aec197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7aeaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec101a40 0x7f7aec197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43508/0 (socket says 172.21.15.118:43508) 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7aeaffd640 1 -- 172.21.15.118:0/1059830683 learned_addr learned my addr 172.21.15.118:0/1059830683 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7aeb7fe640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aec100840 0x7f7aec1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7aeaffd640 1 -- 172.21.15.118:0/1059830683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aec100840 msgr2=0x7f7aec1974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7aeaffd640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aec100840 0x7f7aec1974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7aeaffd640 1 -- 172.21.15.118:0/1059830683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec198080 con 0x7f7aec101a40 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7aeb7fe640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aec100840 0x7f7aec1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7aeaffd640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec101a40 0x7f7aec197a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c8f0 tx=0x7f7ae000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:44.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7ae8ff9640 1 -- 172.21.15.118:0/1059830683 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ae00079b0 con 0x7f7aec101a40 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7ae8ff9640 1 -- 172.21.15.118:0/1059830683 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ae00054e0 con 0x7f7aec101a40 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec19cac0 con 0x7f7aec101a40 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7ae8ff9640 1 -- 172.21.15.118:0/1059830683 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ae0004dd0 con 0x7f7aec101a40 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.086+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec19d0d0 con 0x7f7aec101a40 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.087+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec100c40 con 0x7f7aec101a40 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.088+0000 7f7ae8ff9640 1 -- 172.21.15.118:0/1059830683 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f7ae0005020 con 0x7f7aec101a40 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.088+0000 7f7ae8ff9640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7ad406e1c0 0x7f7ad4070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.088+0000 7f7aeb7fe640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7ad406e1c0 0x7f7ad4070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.088+0000 7f7ae8ff9640 1 -- 172.21.15.118:0/1059830683 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7ae008d060 con 0x7f7aec101a40 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.089+0000 7f7aeb7fe640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7ad406e1c0 0x7f7ad4070680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7adc006010 tx=0x7f7adc0093f0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:32:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.093+0000 7f7ae8ff9640 1 -- 172.21.15.118:0/1059830683 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ae0014030 con 0x7f7aec101a40 2024-09-21T11:32:44.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:32:44.270+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7aec19d3c0 con 0x7f7ad406e1c0 2024-09-21T11:32:44.816 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:32:44.816 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:32:44.816 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:45.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:44 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:32:45.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:44 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:32:45.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:44 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:32:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:45 smithi118 ceph-mon[28757]: from='client.14332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:32:45.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:45 smithi118 ceph-mon[28757]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:45 smithi149 ceph-mon[36123]: from='client.14332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:32:46.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:45 smithi149 ceph-mon[36123]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:48.010 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:47 smithi118 ceph-mon[28757]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:47 smithi149 ceph-mon[36123]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:49 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:49 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:49 smithi149 ceph-mon[36123]: Reconfiguring prometheus.smithi118 (dependencies changed)... 2024-09-21T11:32:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:49 smithi149 ceph-mon[36123]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:49 smithi149 ceph-mon[36123]: Reconfiguring daemon prometheus.smithi118 on smithi118 2024-09-21T11:32:49.757 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:49.757 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:32:49.757 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:49 smithi118 ceph-mon[28757]: Reconfiguring prometheus.smithi118 (dependencies changed)... 2024-09-21T11:32:49.757 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:49 smithi118 ceph-mon[28757]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:49.757 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:49 smithi118 ceph-mon[28757]: Reconfiguring daemon prometheus.smithi118 on smithi118 2024-09-21T11:32:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:50 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1967230956' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99a80214-8ca7-4b8f-a04e-c3b15aa49219"}]: dispatch 2024-09-21T11:32:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:50 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1967230956' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99a80214-8ca7-4b8f-a04e-c3b15aa49219"}]': finished 2024-09-21T11:32:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:50 smithi149 ceph-mon[36123]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T11:32:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:50 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:32:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:50 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/697531840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:32:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:50 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1967230956' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99a80214-8ca7-4b8f-a04e-c3b15aa49219"}]: dispatch 2024-09-21T11:32:50.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:50 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1967230956' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99a80214-8ca7-4b8f-a04e-c3b15aa49219"}]': finished 2024-09-21T11:32:50.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:50 smithi118 ceph-mon[28757]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T11:32:50.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:50 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:32:50.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:50 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/697531840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:32:51.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:51 smithi118 ceph-mon[28757]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:51.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:51 smithi149 ceph-mon[36123]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:53 smithi118 ceph-mon[28757]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:32:53.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:53 smithi149 ceph-mon[36123]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:53.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:32:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:55 smithi118 ceph-mon[28757]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:55.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:55 smithi149 ceph-mon[36123]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:57.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:57 smithi118 ceph-mon[28757]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:57.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:57 smithi149 ceph-mon[36123]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:59.814 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:32:59 smithi118 ceph-mon[28757]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:32:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:32:59 smithi149 ceph-mon[36123]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:01.758 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:01 smithi118 ceph-mon[28757]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:01.758 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:01 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:01.758 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:01 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:01.759 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:01 smithi118 ceph-mon[28757]: Reconfiguring ceph-exporter.smithi149 (monmap changed)... 2024-09-21T11:33:01.759 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:01 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:33:01.759 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:01 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:01.759 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:01 smithi118 ceph-mon[28757]: Reconfiguring daemon ceph-exporter.smithi149 on smithi149 2024-09-21T11:33:01.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:01 smithi149 ceph-mon[36123]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:01.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:01 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:01.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:01 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:01.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:01 smithi149 ceph-mon[36123]: Reconfiguring ceph-exporter.smithi149 (monmap changed)... 2024-09-21T11:33:01.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:01 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:33:01.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:01 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:01.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:01 smithi149 ceph-mon[36123]: Reconfiguring daemon ceph-exporter.smithi149 on smithi149 2024-09-21T11:33:03.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:03.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:03.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: Reconfiguring crash.smithi149 (monmap changed)... 2024-09-21T11:33:03.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T11:33:03.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:03.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: Reconfiguring daemon crash.smithi149 on smithi149 2024-09-21T11:33:03.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T11:33:03.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:03.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: Deploying daemon osd.0 on smithi118 2024-09-21T11:33:03.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:02 smithi118 ceph-mon[28757]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: Reconfiguring crash.smithi149 (monmap changed)... 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: Reconfiguring daemon crash.smithi149 on smithi149 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: Deploying daemon osd.0 on smithi118 2024-09-21T11:33:03.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:02 smithi149 ceph-mon[36123]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:03 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:04.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:03 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:04.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:03 smithi118 ceph-mon[28757]: Reconfiguring mgr.smithi149.xjglai (monmap changed)... 2024-09-21T11:33:04.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:03 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.xjglai", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:33:04.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:03 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:33:04.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:03 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:04.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:03 smithi118 ceph-mon[28757]: Reconfiguring daemon mgr.smithi149.xjglai on smithi149 2024-09-21T11:33:04.347 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:03 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:04.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:03 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:04.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:03 smithi149 ceph-mon[36123]: Reconfiguring mgr.smithi149.xjglai (monmap changed)... 2024-09-21T11:33:04.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:03 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.xjglai", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:33:04.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:03 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:33:04.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:03 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:04.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:03 smithi149 ceph-mon[36123]: Reconfiguring daemon mgr.smithi149.xjglai on smithi149 2024-09-21T11:33:05.603 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:05 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:05.603 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:05 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:05.603 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:05 smithi149 ceph-mon[36123]: Reconfiguring mon.smithi149 (monmap changed)... 2024-09-21T11:33:05.603 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:05 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T11:33:05.603 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:05 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T11:33:05.603 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:05 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:05.603 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:05 smithi149 ceph-mon[36123]: Reconfiguring daemon mon.smithi149 on smithi149 2024-09-21T11:33:05.604 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:05 smithi149 ceph-mon[36123]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:05.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:05 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:05.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:05 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:05.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:05 smithi118 ceph-mon[28757]: Reconfiguring mon.smithi149 (monmap changed)... 2024-09-21T11:33:05.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:05 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T11:33:05.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:05 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T11:33:05.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:05 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:05.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:05 smithi118 ceph-mon[28757]: Reconfiguring daemon mon.smithi149 on smithi149 2024-09-21T11:33:05.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:05 smithi118 ceph-mon[28757]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:06.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:06.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:06.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T11:33:06.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T11:33:06.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi118.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T11:33:06.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi118.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T11:33:06.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:06.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi118.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi118.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi118.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi118.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:06.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:07.002 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:07.002 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:07.002 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi118.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi118.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi118.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi118.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi118.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi118.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T11:33:07.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:07.004 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:07 smithi118 ceph-mon[28757]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:07 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:07 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:07.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:07 smithi149 ceph-mon[36123]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:07 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:07 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:08.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:33:09.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:33:09.776 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:09 smithi118 ceph-mon[28757]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:09.776 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:09.776 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:09 smithi149 ceph-mon[36123]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:11 smithi149 ceph-mon[36123]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:11 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:11 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:11 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:11 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:11 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:11 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:11.986 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:11 smithi118 ceph-mon[28757]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:11.987 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:11 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:11.987 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:11 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:11.987 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:11 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:11.987 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:11 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:11.987 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:11 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:11.987 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:11 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:13.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:13 smithi149 ceph-mon[36123]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:13.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:13 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:13.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:13 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:13 smithi118 ceph-mon[28757]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:13 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:13 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:14.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.576+0000 7f7ae8ff9640 1 -- 172.21.15.118:0/1059830683 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7aec19d3c0 con 0x7f7ad406e1c0 2024-09-21T11:33:14.579 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 0 on host 'smithi118' 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7ad406e1c0 msgr2=0x7f7ad4070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7ad406e1c0 0x7f7ad4070680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7adc006010 tx=0x7f7adc0093f0 comp rx=0 tx=0).stop 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec101a40 msgr2=0x7f7aec197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec101a40 0x7f7aec197a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c8f0 tx=0x7f7ae000cdb0 comp rx=0 tx=0).stop 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 shutdown_connections 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7ad406e1c0 0x7f7ad4070680 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec101a40 0x7f7aec197a00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 --2- 172.21.15.118:0/1059830683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aec100840 0x7f7aec1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 >> 172.21.15.118:0/1059830683 conn(0x7f7aec0fbff0 msgr2=0x7f7aec069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 shutdown_connections 2024-09-21T11:33:14.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:14.578+0000 7f7af1ffb640 1 -- 172.21.15.118:0/1059830683 wait complete. 2024-09-21T11:33:15.503 DEBUG:teuthology.orchestra.run.smithi118:osd.0> sudo journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.0.service 2024-09-21T11:33:15.505 INFO:tasks.cephadm:Deploying osd.1 on smithi118 with /dev/vg_nvme/lv_3... 2024-09-21T11:33:15.506 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T11:33:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:15 smithi118 ceph-mon[28757]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:15 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:15 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:15 smithi149 ceph-mon[36123]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:15 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:15 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:16.153 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:33:15 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[50380]: 2024-09-21T11:33:15.872+0000 7fe8a85df640 -1 osd.0 0 log_to_monitors true 2024-09-21T11:33:16.518 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:33:16.865 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:16 smithi118 ceph-mon[28757]: from='osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T11:33:16.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:16 smithi149 ceph-mon[36123]: from='osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T11:33:17.739 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:33:17 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[50380]: 2024-09-21T11:33:17.583+0000 7fe8a3d3f640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T11:33:17.739 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:33:17 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[50380]: 2024-09-21T11:33:17.585+0000 7fe8a0379640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:33:17.739 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:17 smithi118 ceph-mon[28757]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:17.739 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:17 smithi118 ceph-mon[28757]: from='osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T11:33:17.739 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:17 smithi118 ceph-mon[28757]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T11:33:17.740 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:17 smithi118 ceph-mon[28757]: from='osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-21T11:33:17.740 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:17 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:33:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:17 smithi149 ceph-mon[36123]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:17 smithi149 ceph-mon[36123]: from='osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T11:33:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:17 smithi149 ceph-mon[36123]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T11:33:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:17 smithi149 ceph-mon[36123]: from='osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-21T11:33:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:17 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:33:18.796 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:18 smithi118 ceph-mon[28757]: from='osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-21T11:33:18.796 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:18 smithi118 ceph-mon[28757]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T11:33:18.796 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:18 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:33:18.796 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:18 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:33:18.797 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:18 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:18.797 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:18 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:18.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:18 smithi149 ceph-mon[36123]: from='osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-21T11:33:18.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:18 smithi149 ceph-mon[36123]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T11:33:18.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:18 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:33:18.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:18 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:33:18.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:18 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:18.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:18 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:19 smithi149 ceph-mon[36123]: purged_snaps scrub starts 2024-09-21T11:33:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:19 smithi149 ceph-mon[36123]: purged_snaps scrub ok 2024-09-21T11:33:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:19 smithi149 ceph-mon[36123]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:19 smithi149 ceph-mon[36123]: osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] boot 2024-09-21T11:33:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:19 smithi149 ceph-mon[36123]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T11:33:19.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:33:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:19 smithi118 ceph-mon[28757]: purged_snaps scrub starts 2024-09-21T11:33:20.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:19 smithi118 ceph-mon[28757]: purged_snaps scrub ok 2024-09-21T11:33:20.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:19 smithi118 ceph-mon[28757]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T11:33:20.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:19 smithi118 ceph-mon[28757]: osd.0 [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] boot 2024-09-21T11:33:20.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:19 smithi118 ceph-mon[28757]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T11:33:20.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:33:20.608 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:33:20.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi118:vg_nvme/lv_3 2024-09-21T11:33:20.862 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:20 smithi118 ceph-mon[28757]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T11:33:20.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:20 smithi149 ceph-mon[36123]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T11:33:21.145 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:33:21.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.636+0000 7f9fba8e4640 1 -- 172.21.15.118:0/815951859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4101a40 msgr2=0x7f9fb4101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:33:21.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.636+0000 7f9fba8e4640 1 --2- 172.21.15.118:0/815951859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4101a40 0x7f9fb4101ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009880 tx=0x7f9fa802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:33:21.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.636+0000 7f9fba8e4640 1 -- 172.21.15.118:0/815951859 shutdown_connections 2024-09-21T11:33:21.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.636+0000 7f9fba8e4640 1 --2- 172.21.15.118:0/815951859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4101a40 0x7f9fb4101ec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.636+0000 7f9fba8e4640 1 --2- 172.21.15.118:0/815951859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb4100840 0x7f9fb4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.636+0000 7f9fba8e4640 1 -- 172.21.15.118:0/815951859 >> 172.21.15.118:0/815951859 conn(0x7f9fb40fbff0 msgr2=0x7f9fb40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.636+0000 7f9fba8e4640 1 -- 172.21.15.118:0/815951859 shutdown_connections 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.636+0000 7f9fba8e4640 1 -- 172.21.15.118:0/815951859 wait complete. 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fba8e4640 1 Processor -- start 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fba8e4640 1 -- start start 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fba8e4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4100840 0x7f9fb4199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fba8e4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb4101a40 0x7f9fb4199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fba8e4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb41085f0 con 0x7f9fb4100840 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fba8e4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb4108470 con 0x7f9fb4101a40 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fb3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4100840 0x7f9fb4199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:33:21.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fb3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4100840 0x7f9fb4199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51942/0 (socket says 172.21.15.118:51942) 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fb3fff640 1 -- 172.21.15.118:0/2251669595 learned_addr learned my addr 172.21.15.118:0/2251669595 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fb37fe640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb4101a40 0x7f9fb4199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fb3fff640 1 -- 172.21.15.118:0/2251669595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb4101a40 msgr2=0x7f9fb4199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.637+0000 7f9fb3fff640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb4101a40 0x7f9fb4199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.638+0000 7f9fb3fff640 1 -- 172.21.15.118:0/2251669595 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb419a2c0 con 0x7f9fb4100840 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.638+0000 7f9fb3fff640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4100840 0x7f9fb4199700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400b3d0 tx=0x7f9fa400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.638+0000 7f9fb17fa640 1 -- 172.21.15.118:0/2251669595 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fa4015020 con 0x7f9fb4100840 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.638+0000 7f9fb17fa640 1 -- 172.21.15.118:0/2251669595 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fa4011af0 con 0x7f9fb4100840 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.638+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb419ed00 con 0x7f9fb4100840 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.638+0000 7f9fb17fa640 1 -- 172.21.15.118:0/2251669595 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fa4010da0 con 0x7f9fb4100840 2024-09-21T11:33:21.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.638+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb419f230 con 0x7f9fb4100840 2024-09-21T11:33:21.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.639+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb4100c40 con 0x7f9fb4100840 2024-09-21T11:33:21.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.639+0000 7f9fb17fa640 1 -- 172.21.15.118:0/2251669595 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f9fa4018020 con 0x7f9fb4100840 2024-09-21T11:33:21.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.640+0000 7f9fb17fa640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9f9c06e220 0x7f9f9c0706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:33:21.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.640+0000 7f9fb17fa640 1 -- 172.21.15.118:0/2251669595 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7f9fa408ce00 con 0x7f9fb4100840 2024-09-21T11:33:21.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.640+0000 7f9fb37fe640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9f9c06e220 0x7f9f9c0706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:33:21.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.640+0000 7f9fb37fe640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9f9c06e220 0x7f9f9c0706e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8000c00 tx=0x7f9fa80058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:33:21.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.645+0000 7f9fb17fa640 1 -- 172.21.15.118:0/2251669595 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9fa401f020 con 0x7f9fb4100840 2024-09-21T11:33:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:21 smithi118 ceph-mon[28757]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:21.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:21.848+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9fb4062630 con 0x7f9f9c06e220 2024-09-21T11:33:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:21 smithi149 ceph-mon[36123]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:33:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:33:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:33:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:22.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:22.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:23.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:23.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:23.633 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:23 smithi118 ceph-mon[28757]: from='client.14350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:33:23.633 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:23 smithi118 ceph-mon[28757]: Detected new or changed devices on smithi118 2024-09-21T11:33:23.633 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:23 smithi118 ceph-mon[28757]: Adjusting osd_memory_target on smithi118 to 11840M 2024-09-21T11:33:23.633 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:23 smithi118 ceph-mon[28757]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:23.633 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:33:23.806 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:23 smithi149 ceph-mon[36123]: from='client.14350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:33:23.807 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:23 smithi149 ceph-mon[36123]: Detected new or changed devices on smithi118 2024-09-21T11:33:23.807 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:23 smithi149 ceph-mon[36123]: Adjusting osd_memory_target on smithi118 to 11840M 2024-09-21T11:33:23.807 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:23 smithi149 ceph-mon[36123]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:23.807 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:33:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:25 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:25 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:25 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/4186052856' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68e49e0e-fa7a-455c-8c4a-6446669e012d"}]: dispatch 2024-09-21T11:33:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:25 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/4186052856' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68e49e0e-fa7a-455c-8c4a-6446669e012d"}]': finished 2024-09-21T11:33:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:25 smithi149 ceph-mon[36123]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T11:33:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:25 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:25 smithi149 ceph-mon[36123]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:25.451 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:25 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:25.451 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:25 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:25.451 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:25 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/4186052856' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68e49e0e-fa7a-455c-8c4a-6446669e012d"}]: dispatch 2024-09-21T11:33:25.451 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:25 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/4186052856' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68e49e0e-fa7a-455c-8c4a-6446669e012d"}]': finished 2024-09-21T11:33:25.451 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:25 smithi118 ceph-mon[28757]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T11:33:25.452 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:25 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:25.452 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:25 smithi118 ceph-mon[28757]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:26.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:26 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2859711705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:33:26.479 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:26 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2859711705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:33:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:27 smithi118 ceph-mon[28757]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:27.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:27 smithi149 ceph-mon[36123]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:29.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:29 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:29.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:29 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:29.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:29 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:29.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:29 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:29.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:29 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:29.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:29 smithi118 ceph-mon[28757]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:29.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:29 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:29.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:29 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:29.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:29 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:29.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:29 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:29.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:29 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:29.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:29 smithi149 ceph-mon[36123]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:31.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:31 smithi118 ceph-mon[28757]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:31.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:31 smithi149 ceph-mon[36123]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:33.793 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:33 smithi118 ceph-mon[28757]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:33.793 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T11:33:33.793 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:33.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:33 smithi149 ceph-mon[36123]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T11:33:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:34.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:34 smithi118 ceph-mon[28757]: Deploying daemon osd.1 on smithi118 2024-09-21T11:33:34.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:34 smithi149 ceph-mon[36123]: Deploying daemon osd.1 on smithi118 2024-09-21T11:33:35.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:35 smithi118 ceph-mon[28757]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:35.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:35 smithi149 ceph-mon[36123]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:37.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:37 smithi118 ceph-mon[28757]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:37 smithi149 ceph-mon[36123]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:33:38.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:38 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:33:39.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:39 smithi149 ceph-mon[36123]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:39 smithi118 ceph-mon[28757]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:41.688 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:41 smithi118 ceph-mon[28757]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:41.688 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:41 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:41.688 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:41 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:41.851 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:41 smithi149 ceph-mon[36123]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:41.851 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:41 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:41.851 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:41 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:43 smithi118 ceph-mon[28757]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:43.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.897+0000 7f9fb17fa640 1 -- 172.21.15.118:0/2251669595 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9fb4062630 con 0x7f9f9c06e220 2024-09-21T11:33:43.899 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 1 on host 'smithi118' 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9f9c06e220 msgr2=0x7f9f9c0706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9f9c06e220 0x7f9f9c0706e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8000c00 tx=0x7f9fa80058d0 comp rx=0 tx=0).stop 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4100840 msgr2=0x7f9fb4199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4100840 0x7f9fb4199700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400b3d0 tx=0x7f9fa400b890 comp rx=0 tx=0).stop 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 shutdown_connections 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9f9c06e220 0x7f9f9c0706e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb4101a40 0x7f9fb4199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 --2- 172.21.15.118:0/2251669595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb4100840 0x7f9fb4199700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 >> 172.21.15.118:0/2251669595 conn(0x7f9fb40fbff0 msgr2=0x7f9fb4104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 shutdown_connections 2024-09-21T11:33:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:43.899+0000 7f9fba8e4640 1 -- 172.21.15.118:0/2251669595 wait complete. 2024-09-21T11:33:43.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:43 smithi149 ceph-mon[36123]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:44.772 DEBUG:teuthology.orchestra.run.smithi118:osd.1> sudo journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.1.service 2024-09-21T11:33:44.774 INFO:tasks.cephadm:Deploying osd.2 on smithi118 with /dev/vg_nvme/lv_2... 2024-09-21T11:33:44.778 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T11:33:45.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:45.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:45.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:44 smithi118 ceph-mon[28757]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:33:45.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:44 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:45.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:44 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:45.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:44 smithi149 ceph-mon[36123]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:46.000 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:45 smithi118 ceph-mon[28757]: from='osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T11:33:46.000 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:33:45 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[58379]: 2024-09-21T11:33:45.708+0000 7f8d6e2ce640 -1 osd.1 0 log_to_monitors true 2024-09-21T11:33:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:45 smithi149 ceph-mon[36123]: from='osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T11:33:47.142 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:33:46 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[58379]: 2024-09-21T11:33:46.909+0000 7f8d69a2e640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T11:33:47.142 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:33:46 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[58379]: 2024-09-21T11:33:46.912+0000 7f8d66068640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:33:47.143 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:46 smithi118 ceph-mon[28757]: from='osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T11:33:47.143 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:46 smithi118 ceph-mon[28757]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T11:33:47.143 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:46 smithi118 ceph-mon[28757]: from='osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-21T11:33:47.143 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:46 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:47.143 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:46 smithi118 ceph-mon[28757]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:46 smithi149 ceph-mon[36123]: from='osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T11:33:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:46 smithi149 ceph-mon[36123]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T11:33:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:46 smithi149 ceph-mon[36123]: from='osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-21T11:33:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:46 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:46 smithi149 ceph-mon[36123]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:47 smithi149 ceph-mon[36123]: from='osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-21T11:33:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:47 smithi149 ceph-mon[36123]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T11:33:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:47 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:47 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:47 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:47 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:47 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:48.221 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:47 smithi118 ceph-mon[28757]: from='osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-21T11:33:48.221 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:47 smithi118 ceph-mon[28757]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T11:33:48.221 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:47 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:48.221 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:47 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:48.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:47 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:48.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:47 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:48.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:47 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:48.224 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:33:48.249 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi118:vg_nvme/lv_2 2024-09-21T11:33:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:48 smithi149 ceph-mon[36123]: purged_snaps scrub starts 2024-09-21T11:33:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:48 smithi149 ceph-mon[36123]: purged_snaps scrub ok 2024-09-21T11:33:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:48 smithi149 ceph-mon[36123]: osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] boot 2024-09-21T11:33:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:48 smithi149 ceph-mon[36123]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T11:33:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:48 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:48 smithi149 ceph-mon[36123]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:49.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:48 smithi118 ceph-mon[28757]: purged_snaps scrub starts 2024-09-21T11:33:49.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:48 smithi118 ceph-mon[28757]: purged_snaps scrub ok 2024-09-21T11:33:49.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:48 smithi118 ceph-mon[28757]: osd.1 [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] boot 2024-09-21T11:33:49.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:48 smithi118 ceph-mon[28757]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T11:33:49.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:48 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:33:49.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:48 smithi118 ceph-mon[28757]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T11:33:49.373 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:33:50.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.008+0000 7f1d7520b640 1 -- 172.21.15.118:0/2514305879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 msgr2=0x7f1d70100f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:33:50.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.008+0000 7f1d7520b640 1 --2- 172.21.15.118:0/2514305879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 0x7f1d70100f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009880 tx=0x7f1d5802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:33:50.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.008+0000 7f1d7520b640 1 -- 172.21.15.118:0/2514305879 shutdown_connections 2024-09-21T11:33:50.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.008+0000 7f1d7520b640 1 --2- 172.21.15.118:0/2514305879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 0x7f1d70100f60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:50.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.008+0000 7f1d7520b640 1 --2- 172.21.15.118:0/2514305879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d701001c0 0x7f1d701005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:50.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.008+0000 7f1d7520b640 1 -- 172.21.15.118:0/2514305879 >> 172.21.15.118:0/2514305879 conn(0x7f1d700fbff0 msgr2=0x7f1d700fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:33:50.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.008+0000 7f1d7520b640 1 -- 172.21.15.118:0/2514305879 shutdown_connections 2024-09-21T11:33:50.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.008+0000 7f1d7520b640 1 -- 172.21.15.118:0/2514305879 wait complete. 2024-09-21T11:33:50.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d7520b640 1 Processor -- start 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d7520b640 1 -- start start 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d7520b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d701001c0 0x7f1d701996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d7520b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 0x7f1d70199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d7520b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7010c970 con 0x7f1d70100b00 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d7520b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7010c7f0 con 0x7f1d701001c0 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d67fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 0x7f1d70199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d67fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 0x7f1d70199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52224/0 (socket says 172.21.15.118:52224) 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d67fff640 1 -- 172.21.15.118:0/3145164597 learned_addr learned my addr 172.21.15.118:0/3145164597 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d6ed9d640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d701001c0 0x7f1d701996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d67fff640 1 -- 172.21.15.118:0/3145164597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d701001c0 msgr2=0x7f1d701996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d67fff640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d701001c0 0x7f1d701996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.009+0000 7f1d67fff640 1 -- 172.21.15.118:0/3145164597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7019a260 con 0x7f1d70100b00 2024-09-21T11:33:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.010+0000 7f1d67fff640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 0x7f1d70199be0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1d58006010 tx=0x7f1d580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:33:50.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.010+0000 7f1d6cd99640 1 -- 172.21.15.118:0/3145164597 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d5803f070 con 0x7f1d70100b00 2024-09-21T11:33:50.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.010+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7019ec40 con 0x7f1d70100b00 2024-09-21T11:33:50.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.010+0000 7f1d6cd99640 1 -- 172.21.15.118:0/3145164597 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d580044d0 con 0x7f1d70100b00 2024-09-21T11:33:50.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.010+0000 7f1d6cd99640 1 -- 172.21.15.118:0/3145164597 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d58035030 con 0x7f1d70100b00 2024-09-21T11:33:50.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.010+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7019f180 con 0x7f1d70100b00 2024-09-21T11:33:50.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.011+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d701005c0 con 0x7f1d70100b00 2024-09-21T11:33:50.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.011+0000 7f1d6cd99640 1 -- 172.21.15.118:0/3145164597 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f1d58042070 con 0x7f1d70100b00 2024-09-21T11:33:50.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.012+0000 7f1d6cd99640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d5c06e230 0x7f1d5c0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:33:50.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.012+0000 7f1d6cd99640 1 -- 172.21.15.118:0/3145164597 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2414+0+0 (secure 0 0 0) 0x7f1d580ae150 con 0x7f1d70100b00 2024-09-21T11:33:50.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.012+0000 7f1d6ed9d640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d5c06e230 0x7f1d5c0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:33:50.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.012+0000 7f1d6ed9d640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d5c06e230 0x7f1d5c0706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d600058c0 tx=0x7f1d6000a250 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:33:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.020+0000 7f1d6cd99640 1 -- 172.21.15.118:0/3145164597 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d58080430 con 0x7f1d70100b00 2024-09-21T11:33:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:49 smithi149 ceph-mon[36123]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T11:33:50.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:33:50.200+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1d70062630 con 0x7f1d5c06e230 2024-09-21T11:33:50.201 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:49 smithi118 ceph-mon[28757]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T11:33:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:50 smithi149 ceph-mon[36123]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:33:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:50 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:33:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:50 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:33:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:50 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:50 smithi149 ceph-mon[36123]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:33:51.271 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:50 smithi118 ceph-mon[28757]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:33:51.271 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:50 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:33:51.271 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:50 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:33:51.272 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:50 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:51.272 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:50 smithi118 ceph-mon[28757]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:33:52.887 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: Detected new or changed devices on smithi118 2024-09-21T11:33:52.887 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:52.887 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:52.887 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:33:52.887 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:33:52.887 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: Adjusting osd_memory_target on smithi118 to 5920M 2024-09-21T11:33:52.887 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:52.887 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:52.888 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:52.888 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:52.888 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:52.888 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:52 smithi118 ceph-mon[28757]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: Detected new or changed devices on smithi118 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: Adjusting osd_memory_target on smithi118 to 5920M 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:53.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:33:53.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:52 smithi149 ceph-mon[36123]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:33:53.957 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:53 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/4235585460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01488d66-e964-4ae3-b00c-98f99ce1d7c6"}]: dispatch 2024-09-21T11:33:53.957 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:53 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/4235585460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01488d66-e964-4ae3-b00c-98f99ce1d7c6"}]': finished 2024-09-21T11:33:53.957 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:53 smithi118 ceph-mon[28757]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T11:33:53.957 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:33:53.957 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:33:54.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:53 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/4235585460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01488d66-e964-4ae3-b00c-98f99ce1d7c6"}]: dispatch 2024-09-21T11:33:54.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:53 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/4235585460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01488d66-e964-4ae3-b00c-98f99ce1d7c6"}]': finished 2024-09-21T11:33:54.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:53 smithi149 ceph-mon[36123]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T11:33:54.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:33:54.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:33:55.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:54 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/266095198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:33:55.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:54 smithi118 ceph-mon[28757]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:33:55.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:54 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/266095198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:33:55.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:54 smithi149 ceph-mon[36123]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:33:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:57 smithi118 ceph-mon[28757]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:33:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:57 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:58.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:57 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:58.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:57 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:58.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:57 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:58.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:57 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:57 smithi149 ceph-mon[36123]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:33:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:57 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:57 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:57 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:33:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:57 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:33:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:57 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:33:59.872 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:33:59 smithi118 ceph-mon[28757]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:00.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:33:59 smithi149 ceph-mon[36123]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:01 smithi118 ceph-mon[28757]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:01 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T11:34:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:01 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:02.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:01 smithi149 ceph-mon[36123]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:01 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T11:34:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:01 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:02.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:02 smithi118 ceph-mon[28757]: Deploying daemon osd.2 on smithi118 2024-09-21T11:34:03.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:02 smithi149 ceph-mon[36123]: Deploying daemon osd.2 on smithi118 2024-09-21T11:34:03.784 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:03 smithi149 ceph-mon[36123]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:03 smithi118 ceph-mon[28757]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:05.018 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:04 smithi118 ceph-mon[28757]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:05.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:04 smithi149 ceph-mon[36123]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:07 smithi118 ceph-mon[28757]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:07 smithi149 ceph-mon[36123]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:08.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:08.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:08.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:08.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:34:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:34:09.896 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:09 smithi118 ceph-mon[28757]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:09.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:09 smithi149 ceph-mon[36123]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:10.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.681+0000 7f1d6cd99640 1 -- 172.21.15.118:0/3145164597 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1d70062630 con 0x7f1d5c06e230 2024-09-21T11:34:10.684 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 2 on host 'smithi118' 2024-09-21T11:34:10.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.683+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d5c06e230 msgr2=0x7f1d5c0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:34:10.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.683+0000 7f1d7520b640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d5c06e230 0x7f1d5c0706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d600058c0 tx=0x7f1d6000a250 comp rx=0 tx=0).stop 2024-09-21T11:34:10.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.683+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 msgr2=0x7f1d70199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:34:10.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.683+0000 7f1d7520b640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 0x7f1d70199be0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1d58006010 tx=0x7f1d580048f0 comp rx=0 tx=0).stop 2024-09-21T11:34:10.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.683+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 shutdown_connections 2024-09-21T11:34:10.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.683+0000 7f1d7520b640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d5c06e230 0x7f1d5c0706f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:10.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.683+0000 7f1d7520b640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d70100b00 0x7f1d70199be0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:10.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.683+0000 7f1d7520b640 1 --2- 172.21.15.118:0/3145164597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d701001c0 0x7f1d701996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:10.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.683+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 >> 172.21.15.118:0/3145164597 conn(0x7f1d700fbff0 msgr2=0x7f1d701089d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:34:10.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.684+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 shutdown_connections 2024-09-21T11:34:10.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:34:10.684+0000 7f1d7520b640 1 -- 172.21.15.118:0/3145164597 wait complete. 2024-09-21T11:34:11.302 DEBUG:teuthology.orchestra.run.smithi118:osd.2> sudo journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.2.service 2024-09-21T11:34:11.304 INFO:tasks.cephadm:Deploying osd.3 on smithi149 with /dev/vg_nvme/lv_4... 2024-09-21T11:34:11.304 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T11:34:11.564 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T11:34:11.889 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:11 smithi118 ceph-mon[28757]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:11.889 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:11 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:11.889 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:11 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:11.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:11 smithi149 ceph-mon[36123]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:11.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:11 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:11.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:11 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:13.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:13 smithi149 ceph-mon[36123]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:13.980 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:34:13.981 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:13 smithi118 ceph-mon[28757]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:13.981 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:13 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[66197]: 2024-09-21T11:34:13.902+0000 7f5ceca68640 -1 osd.2 0 log_to_monitors true 2024-09-21T11:34:14.006 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi149:vg_nvme/lv_4 2024-09-21T11:34:14.251 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T11:34:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.659+0000 7f270fa16640 1 -- 172.21.15.149:0/3615487643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708102b90 msgr2=0x7f2708103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:34:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.659+0000 7f270fa16640 1 --2- 172.21.15.149:0/3615487643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708102b90 0x7f2708103010 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009880 tx=0x7f26f802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:34:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.659+0000 7f270fa16640 1 -- 172.21.15.149:0/3615487643 shutdown_connections 2024-09-21T11:34:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.659+0000 7f270fa16640 1 --2- 172.21.15.149:0/3615487643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708102b90 0x7f2708103010 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.659+0000 7f270fa16640 1 --2- 172.21.15.149:0/3615487643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2708101990 0x7f2708101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.659+0000 7f270fa16640 1 -- 172.21.15.149:0/3615487643 >> 172.21.15.149:0/3615487643 conn(0x7f27080fd140 msgr2=0x7f27080ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.659+0000 7f270fa16640 1 -- 172.21.15.149:0/3615487643 shutdown_connections 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.659+0000 7f270fa16640 1 -- 172.21.15.149:0/3615487643 wait complete. 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270fa16640 1 Processor -- start 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270fa16640 1 -- start start 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270fa16640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708101990 0x7f27081974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270fa16640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2708102b90 0x7f27081979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270fa16640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f270810a7b0 con 0x7f2708102b90 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270fa16640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f270810a630 con 0x7f2708101990 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270d7b2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708101990 0x7f27081974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270d7b2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708101990 0x7f27081974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41806/0 (socket says 172.21.15.149:41806) 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270d7b2640 1 -- 172.21.15.149:0/2248622479 learned_addr learned my addr 172.21.15.149:0/2248622479 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.660+0000 7f270cfb1640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2708102b90 0x7f27081979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.661+0000 7f270d7b2640 1 -- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2708102b90 msgr2=0x7f27081979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:34:14.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.661+0000 7f270d7b2640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2708102b90 0x7f27081979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.661+0000 7f270d7b2640 1 -- 172.21.15.149:0/2248622479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2708198060 con 0x7f2708101990 2024-09-21T11:34:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.661+0000 7f270d7b2640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708101990 0x7f27081974a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f270400e940 tx=0x7f270400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:34:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.661+0000 7f26fe7fc640 1 -- 172.21.15.149:0/2248622479 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f270400cac0 con 0x7f2708101990 2024-09-21T11:34:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.661+0000 7f26fe7fc640 1 -- 172.21.15.149:0/2248622479 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f270400cc60 con 0x7f2708101990 2024-09-21T11:34:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.661+0000 7f26fe7fc640 1 -- 172.21.15.149:0/2248622479 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2704003de0 con 0x7f2708101990 2024-09-21T11:34:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.661+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270819caa0 con 0x7f2708101990 2024-09-21T11:34:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.661+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270819d000 con 0x7f2708101990 2024-09-21T11:34:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.662+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270810af90 con 0x7f2708101990 2024-09-21T11:34:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.663+0000 7f26fe7fc640 1 -- 172.21.15.149:0/2248622479 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f2704003fc0 con 0x7f2708101990 2024-09-21T11:34:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.663+0000 7f26fe7fc640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f26f406e230 0x7f26f40706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:34:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.663+0000 7f26fe7fc640 1 -- 172.21.15.149:0/2248622479 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2529+0+0 (secure 0 0 0) 0x7f270408db70 con 0x7f2708101990 2024-09-21T11:34:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.663+0000 7f270cfb1640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f26f406e230 0x7f26f40706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:34:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.664+0000 7f270cfb1640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f26f406e230 0x7f26f40706f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26f8000c00 tx=0x7f26f80058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:34:14.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.668+0000 7f26fe7fc640 1 -- 172.21.15.149:0/2248622479 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f270405c120 con 0x7f2708101990 2024-09-21T11:34:14.851 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:14.848+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2708107110 con 0x7f26f406e230 2024-09-21T11:34:14.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:14 smithi149 ceph-mon[36123]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T11:34:14.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:14 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:14.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:14 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:14 smithi118 ceph-mon[28757]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T11:34:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:14 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:14 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:15 smithi118 ceph-mon[28757]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:15 smithi118 ceph-mon[28757]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T11:34:15.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:15 smithi118 ceph-mon[28757]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T11:34:15.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:15 smithi118 ceph-mon[28757]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-21T11:34:15.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:15 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:15.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:15 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:34:15.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:15 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:34:15.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:15 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:15 smithi149 ceph-mon[36123]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:15 smithi149 ceph-mon[36123]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T11:34:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:15 smithi149 ceph-mon[36123]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T11:34:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:15 smithi149 ceph-mon[36123]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-21T11:34:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:15 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:15 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:34:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:15 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:34:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:15 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:16.423 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:16 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[66197]: 2024-09-21T11:34:16.370+0000 7f5ce81c8640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T11:34:16.423 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:16 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[66197]: 2024-09-21T11:34:16.375+0000 7f5ce07fa640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:34:16.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:16 smithi149 ceph-mon[36123]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:34:16.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:16 smithi149 ceph-mon[36123]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-21T11:34:16.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:16 smithi149 ceph-mon[36123]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T11:34:16.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:16 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:16.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:16 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:16.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:16 smithi149 ceph-mon[36123]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' 2024-09-21T11:34:17.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:16 smithi118 ceph-mon[28757]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:34:17.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:16 smithi118 ceph-mon[28757]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-21T11:34:17.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:16 smithi118 ceph-mon[28757]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T11:34:17.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:16 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:17.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:16 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:17.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:16 smithi118 ceph-mon[28757]: from='osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999]' entity='osd.2' 2024-09-21T11:34:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: purged_snaps scrub starts 2024-09-21T11:34:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: purged_snaps scrub ok 2024-09-21T11:34:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: from='client.? 172.21.15.149:0/327073999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f33f5adc-ef11-4165-a7e2-15917a76b0ab"}]: dispatch 2024-09-21T11:34:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f33f5adc-ef11-4165-a7e2-15917a76b0ab"}]: dispatch 2024-09-21T11:34:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f33f5adc-ef11-4165-a7e2-15917a76b0ab"}]': finished 2024-09-21T11:34:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] boot 2024-09-21T11:34:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T11:34:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:17 smithi149 ceph-mon[36123]: from='client.? 172.21.15.149:0/687081608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: purged_snaps scrub starts 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: purged_snaps scrub ok 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/327073999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f33f5adc-ef11-4165-a7e2-15917a76b0ab"}]: dispatch 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f33f5adc-ef11-4165-a7e2-15917a76b0ab"}]: dispatch 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f33f5adc-ef11-4165-a7e2-15917a76b0ab"}]': finished 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: osd.2 [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] boot 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:34:17.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:17.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:17 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/687081608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:34:19.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: Detected new or changed devices on smithi118 2024-09-21T11:34:19.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: Adjusting osd_memory_target on smithi118 to 3946M 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: pgmap v87: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:19.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T11:34:19.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T11:34:19.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:34:19.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:19.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T11:34:19.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:19 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:19.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: Detected new or changed devices on smithi118 2024-09-21T11:34:19.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:19.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:19.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:34:19.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:34:19.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: Adjusting osd_memory_target on smithi118 to 3946M 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: pgmap v87: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:19.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T11:34:19.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T11:34:19.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:34:19.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:19.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T11:34:19.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:19 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:20.522 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70965]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T11:34:20.522 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70965]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:20.522 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:20.522 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70965]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:20.784 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70968]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T11:34:20.784 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70968]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:20.784 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:20.784 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70968]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:20.790 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:20.788+0000 7f26fe7fc640 1 -- 172.21.15.149:0/2248622479 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f27040042b0 con 0x7f2708101990 2024-09-21T11:34:21.048 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70971]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T11:34:21.048 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70971]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:21.048 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:21.048 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:34:20 smithi118 sudo[70971]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:21.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:20 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T11:34:21.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:20 smithi118 ceph-mon[28757]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T11:34:21.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:20 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:21.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:20 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:20 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T11:34:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:20 smithi149 ceph-mon[36123]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T11:34:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:20 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:20 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:21.309 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70974]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T11:34:21.309 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70974]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:21.309 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:21.309 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70974]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:21.310 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70977]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T11:34:21.310 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70977]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:21.310 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:21.310 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70977]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:21.574 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70980]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T11:34:21.574 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70980]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:21.574 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:21.574 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70980]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:22.063 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70983]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T11:34:22.063 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70983]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:22.063 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:22.063 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:21 smithi118 sudo[70983]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:22 smithi118 sudo[70986]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T11:34:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:22 smithi118 sudo[70986]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:22 smithi118 sudo[70986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:22 smithi118 sudo[70986]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:22.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:22 smithi118 ceph-mon[28757]: pgmap v90: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:22.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:22 smithi118 ceph-mon[28757]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T11:34:22.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:22 smithi118 ceph-mon[28757]: mgrmap e19: smithi118.djbwyn(active, since 2m), standbys: smithi149.xjglai 2024-09-21T11:34:22.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:22.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:22 smithi118 ceph-mon[28757]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T11:34:22.330 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 ceph-mon[36123]: pgmap v90: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:22.330 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 ceph-mon[36123]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T11:34:22.330 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 ceph-mon[36123]: mgrmap e19: smithi118.djbwyn(active, since 2m), standbys: smithi149.xjglai 2024-09-21T11:34:22.330 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:22.330 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 ceph-mon[36123]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T11:34:22.330 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 sudo[41291]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T11:34:22.330 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 sudo[41291]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:22.331 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 sudo[41291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:22.331 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 sudo[41291]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:22.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 sudo[41310]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T11:34:22.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 sudo[41310]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T11:34:22.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 sudo[41310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T11:34:22.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:22 smithi149 sudo[41310]: pam_unix(sudo:session): session closed for user root 2024-09-21T11:34:23.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:23 smithi118 ceph-mon[28757]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T11:34:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:34:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:34:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:23 smithi118 ceph-mon[28757]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T11:34:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:34:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:34:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:23 smithi118 ceph-mon[28757]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:23 smithi118 ceph-mon[28757]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T11:34:23.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:23 smithi149 ceph-mon[36123]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T11:34:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:34:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:34:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:23 smithi149 ceph-mon[36123]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T11:34:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:34:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:34:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:23 smithi149 ceph-mon[36123]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:23.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:23 smithi149 ceph-mon[36123]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T11:34:23.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:34:24.491 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:34:25.170 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:25 smithi149 ceph-mon[36123]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:25.457 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:25 smithi118 ceph-mon[28757]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:26.416 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:26 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T11:34:26.416 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:26 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:26.417 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:26 smithi149 ceph-mon[36123]: Deploying daemon osd.3 on smithi149 2024-09-21T11:34:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:26 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T11:34:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:26 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:26 smithi118 ceph-mon[28757]: Deploying daemon osd.3 on smithi149 2024-09-21T11:34:27.382 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:27 smithi149 ceph-mon[36123]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:27.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:27 smithi118 ceph-mon[28757]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:29 smithi118 ceph-mon[28757]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:29.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:29 smithi149 ceph-mon[36123]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:31.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:31 smithi149 ceph-mon[36123]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:31 smithi118 ceph-mon[28757]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:32.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:32 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:32 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:32 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:32.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:32 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:32.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:32 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:32.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:32 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:33.731 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:33 smithi149 ceph-mon[36123]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:33 smithi118 ceph-mon[28757]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:35 smithi118 ceph-mon[28757]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:35.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:35.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:35.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:34:35.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:35 smithi149 ceph-mon[36123]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:34:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:36.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.322+0000 7f26fe7fc640 1 -- 172.21.15.149:0/2248622479 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2708107110 con 0x7f26f406e230 2024-09-21T11:34:36.325 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 3 on host 'smithi149' 2024-09-21T11:34:36.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f26f406e230 msgr2=0x7f26f40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:34:36.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f26f406e230 0x7f26f40706f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26f8000c00 tx=0x7f26f80058d0 comp rx=0 tx=0).stop 2024-09-21T11:34:36.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708101990 msgr2=0x7f27081974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:34:36.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708101990 0x7f27081974a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f270400e940 tx=0x7f270400ee00 comp rx=0 tx=0).stop 2024-09-21T11:34:36.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 shutdown_connections 2024-09-21T11:34:36.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f26f406e230 0x7f26f40706f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:36.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2708102b90 0x7f27081979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:36.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 --2- 172.21.15.149:0/2248622479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2708101990 0x7f27081974a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:36.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 >> 172.21.15.149:0/2248622479 conn(0x7f27080fd140 msgr2=0x7f27080ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:34:36.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 shutdown_connections 2024-09-21T11:34:36.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:36.325+0000 7f270fa16640 1 -- 172.21.15.149:0/2248622479 wait complete. 2024-09-21T11:34:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:36 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:36 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:36 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:36.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:36 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:36.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:36 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:36.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:36 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:36.929 DEBUG:teuthology.orchestra.run.smithi149:osd.3> sudo journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.3.service 2024-09-21T11:34:36.932 INFO:tasks.cephadm:Deploying osd.4 on smithi149 with /dev/vg_nvme/lv_3... 2024-09-21T11:34:36.932 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T11:34:37.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:37 smithi149 ceph-mon[36123]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:37 smithi118 ceph-mon[28757]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:38.506 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T11:34:38.563 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:34:38 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[42055]: 2024-09-21T11:34:38.285+0000 7f8ef6bda640 -1 osd.3 0 log_to_monitors true 2024-09-21T11:34:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:38 smithi118 ceph-mon[28757]: from='osd.3 [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T11:34:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:38 smithi118 ceph-mon[28757]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T11:34:38.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:34:38.896 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:38 smithi149 ceph-mon[36123]: from='osd.3 [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T11:34:38.896 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:38 smithi149 ceph-mon[36123]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T11:34:38.896 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:38 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:34:39.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:39 smithi149 ceph-mon[36123]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:39.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:39 smithi149 ceph-mon[36123]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T11:34:39.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:39 smithi149 ceph-mon[36123]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T11:34:39.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:39.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:39 smithi149 ceph-mon[36123]: from='osd.3 [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:34:39.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:39 smithi149 ceph-mon[36123]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:34:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:39 smithi118 ceph-mon[28757]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:39 smithi118 ceph-mon[28757]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T11:34:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:39 smithi118 ceph-mon[28757]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T11:34:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:39 smithi118 ceph-mon[28757]: from='osd.3 [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:34:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:39 smithi118 ceph-mon[28757]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:34:40.450 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[42055]: 2024-09-21T11:34:40.415+0000 7f8ef3371640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T11:34:40.450 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[42055]: 2024-09-21T11:34:40.425+0000 7f8eea96c640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:34:40.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-21T11:34:40.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T11:34:40.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:40.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:40.803 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: Detected new or changed devices on smithi149 2024-09-21T11:34:40.803 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:40.803 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:40.803 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:34:40.803 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:40.803 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:40.803 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:34:40.803 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:40.803 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:40 smithi149 ceph-mon[36123]: from='osd.3 ' entity='osd.3' 2024-09-21T11:34:41.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: Detected new or changed devices on smithi149 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:41.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:40 smithi118 ceph-mon[28757]: from='osd.3 ' entity='osd.3' 2024-09-21T11:34:41.571 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:34:41.600 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi149:vg_nvme/lv_3 2024-09-21T11:34:41.848 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T11:34:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:41 smithi149 ceph-mon[36123]: purged_snaps scrub starts 2024-09-21T11:34:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:41 smithi149 ceph-mon[36123]: purged_snaps scrub ok 2024-09-21T11:34:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:41 smithi149 ceph-mon[36123]: Adjusting osd_memory_target on smithi149 to 3639M 2024-09-21T11:34:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:41 smithi149 ceph-mon[36123]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:41 smithi149 ceph-mon[36123]: osd.3 [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] boot 2024-09-21T11:34:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:41 smithi149 ceph-mon[36123]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T11:34:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:41 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:41 smithi118 ceph-mon[28757]: purged_snaps scrub starts 2024-09-21T11:34:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:41 smithi118 ceph-mon[28757]: purged_snaps scrub ok 2024-09-21T11:34:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:41 smithi118 ceph-mon[28757]: Adjusting osd_memory_target on smithi149 to 3639M 2024-09-21T11:34:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:41 smithi118 ceph-mon[28757]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T11:34:42.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:41 smithi118 ceph-mon[28757]: osd.3 [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] boot 2024-09-21T11:34:42.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:41 smithi118 ceph-mon[28757]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T11:34:42.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:41 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:34:42.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.246+0000 7fed80092640 1 -- 172.21.15.149:0/2274715758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78102b60 msgr2=0x7fed78102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:34:42.250 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.246+0000 7fed80092640 1 --2- 172.21.15.149:0/2274715758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78102b60 0x7fed78102fe0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009880 tx=0x7fed6c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.246+0000 7fed80092640 1 -- 172.21.15.149:0/2274715758 shutdown_connections 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.246+0000 7fed80092640 1 --2- 172.21.15.149:0/2274715758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78102b60 0x7fed78102fe0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.246+0000 7fed80092640 1 --2- 172.21.15.149:0/2274715758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed78101960 0x7fed78101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.246+0000 7fed80092640 1 -- 172.21.15.149:0/2274715758 >> 172.21.15.149:0/2274715758 conn(0x7fed780fd0f0 msgr2=0x7fed780ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.246+0000 7fed80092640 1 -- 172.21.15.149:0/2274715758 shutdown_connections 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.246+0000 7fed80092640 1 -- 172.21.15.149:0/2274715758 wait complete. 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.247+0000 7fed80092640 1 Processor -- start 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.247+0000 7fed80092640 1 -- start start 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.247+0000 7fed80092640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78101960 0x7fed78197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.247+0000 7fed80092640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed78102b60 0x7fed781979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.247+0000 7fed80092640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fed7810a780 con 0x7fed78102b60 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.247+0000 7fed80092640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed7810a600 con 0x7fed78101960 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.247+0000 7fed7de2e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78101960 0x7fed78197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:34:42.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.247+0000 7fed7de2e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78101960 0x7fed78197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37926/0 (socket says 172.21.15.149:37926) 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.247+0000 7fed7de2e640 1 -- 172.21.15.149:0/4158541907 learned_addr learned my addr 172.21.15.149:0/4158541907 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.248+0000 7fed7de2e640 1 -- 172.21.15.149:0/4158541907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed78102b60 msgr2=0x7fed781979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.248+0000 7fed7de2e640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed78102b60 0x7fed781979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.248+0000 7fed7de2e640 1 -- 172.21.15.149:0/4158541907 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed78197fb0 con 0x7fed78101960 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.248+0000 7fed7de2e640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78101960 0x7fed78197480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c8f0 tx=0x7fed7400cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.248+0000 7fed6affd640 1 -- 172.21.15.149:0/4158541907 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed74004020 con 0x7fed78101960 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.248+0000 7fed6affd640 1 -- 172.21.15.149:0/4158541907 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed74007e10 con 0x7fed78101960 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.248+0000 7fed6affd640 1 -- 172.21.15.149:0/4158541907 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed74003e10 con 0x7fed78101960 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.248+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7819ca20 con 0x7fed78101960 2024-09-21T11:34:42.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.248+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7819cf80 con 0x7fed78101960 2024-09-21T11:34:42.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.249+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed78101d60 con 0x7fed78101960 2024-09-21T11:34:42.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.250+0000 7fed6affd640 1 -- 172.21.15.149:0/4158541907 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fed740041c0 con 0x7fed78101960 2024-09-21T11:34:42.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.250+0000 7fed6affd640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fed6406e2b0 0x7fed64070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:34:42.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.251+0000 7fed6affd640 1 -- 172.21.15.149:0/4158541907 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3803+0+0 (secure 0 0 0) 0x7fed7408dbb0 con 0x7fed78101960 2024-09-21T11:34:42.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.251+0000 7fed7d62d640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fed6406e2b0 0x7fed64070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:34:42.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.251+0000 7fed7d62d640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fed6406e2b0 0x7fed64070770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0096c0 tx=0x7fed6c000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:34:42.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.255+0000 7fed6affd640 1 -- 172.21.15.149:0/4158541907 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed74094080 con 0x7fed78101960 2024-09-21T11:34:42.442 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:34:42.439+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fed78062630 con 0x7fed6406e2b0 2024-09-21T11:34:42.874 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:42 smithi149 ceph-mon[36123]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T11:34:42.874 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:42 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:34:42.875 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:42 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:34:42.875 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:42 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:43.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:42 smithi118 ceph-mon[28757]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T11:34:43.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:42 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:34:43.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:42 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:34:43.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:42 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:43.869 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:43 smithi149 ceph-mon[36123]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:34:43.869 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:43 smithi149 ceph-mon[36123]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:43.869 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:43 smithi149 ceph-mon[36123]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T11:34:43.869 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:43 smithi149 ceph-mon[36123]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T11:34:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:43 smithi118 ceph-mon[28757]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:34:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:43 smithi118 ceph-mon[28757]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:43 smithi118 ceph-mon[28757]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T11:34:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:43 smithi118 ceph-mon[28757]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T11:34:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:45 smithi118 ceph-mon[28757]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T11:34:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:45 smithi118 ceph-mon[28757]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-21T11:34:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:45 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/614073400' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e791ff3-6070-41cc-b7ab-542698f77638"}]: dispatch 2024-09-21T11:34:45.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:45 smithi118 ceph-mon[28757]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e791ff3-6070-41cc-b7ab-542698f77638"}]: dispatch 2024-09-21T11:34:45.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:45 smithi118 ceph-mon[28757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e791ff3-6070-41cc-b7ab-542698f77638"}]': finished 2024-09-21T11:34:45.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:45 smithi118 ceph-mon[28757]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T11:34:45.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:45 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:34:45.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:45 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/3360030179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:34:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:45 smithi149 ceph-mon[36123]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T11:34:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:45 smithi149 ceph-mon[36123]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-21T11:34:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:45 smithi149 ceph-mon[36123]: from='client.? 172.21.15.149:0/614073400' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e791ff3-6070-41cc-b7ab-542698f77638"}]: dispatch 2024-09-21T11:34:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:45 smithi149 ceph-mon[36123]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e791ff3-6070-41cc-b7ab-542698f77638"}]: dispatch 2024-09-21T11:34:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:45 smithi149 ceph-mon[36123]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e791ff3-6070-41cc-b7ab-542698f77638"}]': finished 2024-09-21T11:34:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:45 smithi149 ceph-mon[36123]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T11:34:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:45 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:34:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:45 smithi149 ceph-mon[36123]: from='client.? 172.21.15.149:0/3360030179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:34:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:47 smithi118 ceph-mon[28757]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T11:34:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:47 smithi149 ceph-mon[36123]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T11:34:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:49 smithi118 ceph-mon[28757]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T11:34:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:49 smithi149 ceph-mon[36123]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T11:34:51.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:51 smithi149 ceph-mon[36123]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T11:34:51.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:51 smithi118 ceph-mon[28757]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T11:34:53.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:53 smithi149 ceph-mon[36123]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:53.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T11:34:53.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:53.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:34:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:53 smithi118 ceph-mon[28757]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T11:34:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:34:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:34:54.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:54 smithi118 ceph-mon[28757]: Deploying daemon osd.4 on smithi149 2024-09-21T11:34:54.871 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:54 smithi149 ceph-mon[36123]: Deploying daemon osd.4 on smithi149 2024-09-21T11:34:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:55 smithi118 ceph-mon[28757]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:55.881 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:55 smithi149 ceph-mon[36123]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:57 smithi118 ceph-mon[28757]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:57.830 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:57 smithi149 ceph-mon[36123]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:59 smithi118 ceph-mon[28757]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:59 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:59 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:34:59 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:59.846 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:59 smithi149 ceph-mon[36123]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:34:59.846 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:59 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:34:59.846 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:59 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:34:59.846 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:34:59 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:01.756 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:01 smithi149 ceph-mon[36123]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:35:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:01 smithi118 ceph-mon[28757]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:35:03.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.153+0000 7fed6affd640 1 -- 172.21.15.149:0/4158541907 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fed78062630 con 0x7fed6406e2b0 2024-09-21T11:35:03.156 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 4 on host 'smithi149' 2024-09-21T11:35:03.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.155+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fed6406e2b0 msgr2=0x7fed64070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.155+0000 7fed80092640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fed6406e2b0 0x7fed64070770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0096c0 tx=0x7fed6c000bc0 comp rx=0 tx=0).stop 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.155+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78101960 msgr2=0x7fed78197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.155+0000 7fed80092640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78101960 0x7fed78197480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c8f0 tx=0x7fed7400cdb0 comp rx=0 tx=0).stop 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.156+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 shutdown_connections 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.156+0000 7fed80092640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fed6406e2b0 0x7fed64070770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.156+0000 7fed80092640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed78102b60 0x7fed781979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.156+0000 7fed80092640 1 --2- 172.21.15.149:0/4158541907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed78101960 0x7fed78197480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.156+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 >> 172.21.15.149:0/4158541907 conn(0x7fed780fd0f0 msgr2=0x7fed78105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.156+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 shutdown_connections 2024-09-21T11:35:03.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:03.156+0000 7fed80092640 1 -- 172.21.15.149:0/4158541907 wait complete. 2024-09-21T11:35:03.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:03 smithi149 ceph-mon[36123]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:35:03.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:03 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:03.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:03 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:03.809 DEBUG:teuthology.orchestra.run.smithi149:osd.4> sudo journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.4.service 2024-09-21T11:35:03.811 INFO:tasks.cephadm:Deploying osd.5 on smithi149 with /dev/vg_nvme/lv_2... 2024-09-21T11:35:03.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T11:35:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:03 smithi118 ceph-mon[28757]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:35:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:03 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:03 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:04.132 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T11:35:05.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:04 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:05.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:04 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:05.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:04 smithi118 ceph-mon[28757]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:35:05.171 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:04 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:05.172 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:04 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:05.172 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:04 smithi149 ceph-mon[36123]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:35:05.449 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:35:05 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[48492]: 2024-09-21T11:35:05.321+0000 7fb1c13dc640 -1 osd.4 0 log_to_monitors true 2024-09-21T11:35:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:05 smithi149 ceph-mon[36123]: from='osd.4 [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T11:35:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:05 smithi149 ceph-mon[36123]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T11:35:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:05 smithi118 ceph-mon[28757]: from='osd.4 [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T11:35:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:05 smithi118 ceph-mon[28757]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T11:35:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:06 smithi149 ceph-mon[36123]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T11:35:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:06 smithi149 ceph-mon[36123]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T11:35:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:06 smithi149 ceph-mon[36123]: from='osd.4 [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:35:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:06 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:35:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:06 smithi149 ceph-mon[36123]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:35:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:06 smithi149 ceph-mon[36123]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:35:07.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:35:06 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[48492]: 2024-09-21T11:35:06.934+0000 7fb1bcb3c640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T11:35:07.201 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:35:06 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[48492]: 2024-09-21T11:35:06.940+0000 7fb1b9176640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:35:07.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:06 smithi118 ceph-mon[28757]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T11:35:07.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:06 smithi118 ceph-mon[28757]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T11:35:07.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:06 smithi118 ceph-mon[28757]: from='osd.4 [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:35:07.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:06 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:35:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:06 smithi118 ceph-mon[28757]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:35:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:06 smithi118 ceph-mon[28757]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T11:35:07.471 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T11:35:07.498 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi149:vg_nvme/lv_2 2024-09-21T11:35:08.073 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T11:35:08.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:07 smithi149 ceph-mon[36123]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-21T11:35:08.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:07 smithi149 ceph-mon[36123]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T11:35:08.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:07 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:35:08.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:07 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:35:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:07 smithi118 ceph-mon[28757]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-21T11:35:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:07 smithi118 ceph-mon[28757]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T11:35:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:07 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:35:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:07 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:35:08.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.575+0000 7f97d941f640 1 -- 172.21.15.149:0/842132720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4101980 msgr2=0x7f97d4101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:08.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 --2- 172.21.15.149:0/842132720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4101980 0x7f97d4101d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009880 tx=0x7f97c402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:08.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 -- 172.21.15.149:0/842132720 shutdown_connections 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 --2- 172.21.15.149:0/842132720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97d4102b80 0x7f97d4103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 --2- 172.21.15.149:0/842132720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4101980 0x7f97d4101d80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 -- 172.21.15.149:0/842132720 >> 172.21.15.149:0/842132720 conn(0x7f97d40fd110 msgr2=0x7f97d40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 -- 172.21.15.149:0/842132720 shutdown_connections 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 -- 172.21.15.149:0/842132720 wait complete. 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 Processor -- start 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 -- start start 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97d4101980 0x7f97d4199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4102b80 0x7f97d4199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f97d410a7a0 con 0x7f97d4101980 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.576+0000 7f97d941f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f97d410a620 con 0x7f97d4102b80 2024-09-21T11:35:08.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97cbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4102b80 0x7f97d4199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97cbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4102b80 0x7f97d4199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:41142/0 (socket says 172.21.15.149:41142) 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97cbfff640 1 -- 172.21.15.149:0/2091414345 learned_addr learned my addr 172.21.15.149:0/2091414345 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97d2ffd640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97d4101980 0x7f97d4199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97cbfff640 1 -- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97d4101980 msgr2=0x7f97d4199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97cbfff640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97d4101980 0x7f97d4199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97cbfff640 1 -- 172.21.15.149:0/2091414345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d419a250 con 0x7f97d4102b80 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97d2ffd640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97d4101980 0x7f97d4199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97cbfff640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4102b80 0x7f97d4199bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00e970 tx=0x7f97bc00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97d0ff9640 1 -- 172.21.15.149:0/2091414345 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97bc00cac0 con 0x7f97d4102b80 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d419ec90 con 0x7f97d4102b80 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d419f1c0 con 0x7f97d4102b80 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97d0ff9640 1 -- 172.21.15.149:0/2091414345 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97bc00cc60 con 0x7f97d4102b80 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.577+0000 7f97d0ff9640 1 -- 172.21.15.149:0/2091414345 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97bc018720 con 0x7f97d4102b80 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.578+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d4101d80 con 0x7f97d4102b80 2024-09-21T11:35:08.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.579+0000 7f97d0ff9640 1 -- 172.21.15.149:0/2091414345 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f97bc010430 con 0x7f97d4102b80 2024-09-21T11:35:08.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.580+0000 7f97d0ff9640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f97c006e2b0 0x7f97c0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:08.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.580+0000 7f97d0ff9640 1 -- 172.21.15.149:0/2091414345 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4206+0+0 (secure 0 0 0) 0x7f97bc08e2b0 con 0x7f97d4102b80 2024-09-21T11:35:08.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.580+0000 7f97d2ffd640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f97c006e2b0 0x7f97c0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:08.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.580+0000 7f97d2ffd640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f97c006e2b0 0x7f97c0070770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f97c4000c00 tx=0x7f97c4005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:08.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.588+0000 7f97d0ff9640 1 -- 172.21.15.149:0/2091414345 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f97bc05c100 con 0x7f97d4102b80 2024-09-21T11:35:08.767 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:08.765+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f97d40626f0 con 0x7f97c006e2b0 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: purged_snaps scrub starts 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: purged_snaps scrub ok 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: osd.4 [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] boot 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:35:09.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: purged_snaps scrub starts 2024-09-21T11:35:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: purged_snaps scrub ok 2024-09-21T11:35:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: osd.4 [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] boot 2024-09-21T11:35:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T11:35:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:35:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:35:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:35:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T11:35:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T11:35:09.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T11:35:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: Detected new or changed devices on smithi149 2024-09-21T11:35:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: Adjusting osd_memory_target on smithi149 to 1819M 2024-09-21T11:35:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:35:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:35:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:35:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:09 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T11:35:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: Detected new or changed devices on smithi149 2024-09-21T11:35:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: Adjusting osd_memory_target on smithi149 to 1819M 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:35:10.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:09 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:11.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:10 smithi149 ceph-mon[36123]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:11.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:10 smithi118 ceph-mon[28757]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:12.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:11 smithi149 ceph-mon[36123]: from='client.? 172.21.15.149:0/3978735264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7be3412-785f-467d-8fa5-9336d472bbdf"}]: dispatch 2024-09-21T11:35:12.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:11 smithi149 ceph-mon[36123]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7be3412-785f-467d-8fa5-9336d472bbdf"}]: dispatch 2024-09-21T11:35:12.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:11 smithi149 ceph-mon[36123]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7be3412-785f-467d-8fa5-9336d472bbdf"}]': finished 2024-09-21T11:35:12.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:11 smithi149 ceph-mon[36123]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T11:35:12.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:11 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:12.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:11 smithi149 ceph-mon[36123]: from='client.? 172.21.15.149:0/1545214405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:35:12.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:11 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/3978735264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7be3412-785f-467d-8fa5-9336d472bbdf"}]: dispatch 2024-09-21T11:35:12.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:11 smithi118 ceph-mon[28757]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7be3412-785f-467d-8fa5-9336d472bbdf"}]: dispatch 2024-09-21T11:35:12.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:11 smithi118 ceph-mon[28757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7be3412-785f-467d-8fa5-9336d472bbdf"}]': finished 2024-09-21T11:35:12.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:11 smithi118 ceph-mon[28757]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T11:35:12.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:11 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:12.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:11 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1545214405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T11:35:13.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:12 smithi118 ceph-mon[28757]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:13.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:12 smithi149 ceph-mon[36123]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:15 smithi118 ceph-mon[28757]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:15.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:15 smithi149 ceph-mon[36123]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:17.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:17 smithi149 ceph-mon[36123]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:17 smithi118 ceph-mon[28757]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:19 smithi118 ceph-mon[28757]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:19.890 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:19 smithi149 ceph-mon[36123]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:20 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T11:35:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:20 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:20.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:20 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T11:35:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:20 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:21.823 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:21 smithi149 ceph-mon[36123]: Deploying daemon osd.5 on smithi149 2024-09-21T11:35:21.823 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:21 smithi149 ceph-mon[36123]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:21 smithi118 ceph-mon[28757]: Deploying daemon osd.5 on smithi149 2024-09-21T11:35:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:21 smithi118 ceph-mon[28757]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:23.604 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:23 smithi149 ceph-mon[36123]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:23.604 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:35:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:23 smithi118 ceph-mon[28757]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:35:25.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:25 smithi149 ceph-mon[36123]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:26.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:25 smithi118 ceph-mon[28757]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:26.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:26 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:35:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:26 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:26 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:27.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:26 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:35:27.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:26 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:27.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:26 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:27.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:27 smithi149 ceph-mon[36123]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:27 smithi118 ceph-mon[28757]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:29.759 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:29 smithi149 ceph-mon[36123]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:29.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.793+0000 7f97d0ff9640 1 -- 172.21.15.149:0/2091414345 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f97d40626f0 con 0x7f97c006e2b0 2024-09-21T11:35:29.795 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 5 on host 'smithi149' 2024-09-21T11:35:29.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f97c006e2b0 msgr2=0x7f97c0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:29.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f97c006e2b0 0x7f97c0070770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f97c4000c00 tx=0x7f97c4005a20 comp rx=0 tx=0).stop 2024-09-21T11:35:29.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4102b80 msgr2=0x7f97d4199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:29.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4102b80 0x7f97d4199bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00e970 tx=0x7f97bc00ee30 comp rx=0 tx=0).stop 2024-09-21T11:35:29.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 shutdown_connections 2024-09-21T11:35:29.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f97c006e2b0 0x7f97c0070770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:29.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d4102b80 0x7f97d4199bd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:29.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 --2- 172.21.15.149:0/2091414345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97d4101980 0x7f97d4199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:29.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 >> 172.21.15.149:0/2091414345 conn(0x7f97d40fd110 msgr2=0x7f97d4104030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:29.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 shutdown_connections 2024-09-21T11:35:29.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:29.796+0000 7f97d941f640 1 -- 172.21.15.149:0/2091414345 wait complete. 2024-09-21T11:35:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:29 smithi118 ceph-mon[28757]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:30.480 DEBUG:teuthology.orchestra.run.smithi149:osd.5> sudo journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.5.service 2024-09-21T11:35:30.484 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-21T11:35:30.484 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T11:35:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:31.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:31.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:31.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.252+0000 7f25bd031640 1 -- 172.21.15.118:0/2437913333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8102b60 msgr2=0x7f25b8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:31.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.252+0000 7f25bd031640 1 --2- 172.21.15.118:0/2437913333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8102b60 0x7f25b8102fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009880 tx=0x7f25ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:31.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.252+0000 7f25bd031640 1 -- 172.21.15.118:0/2437913333 shutdown_connections 2024-09-21T11:35:31.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.252+0000 7f25bd031640 1 --2- 172.21.15.118:0/2437913333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8102b60 0x7f25b8102fe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.252+0000 7f25bd031640 1 --2- 172.21.15.118:0/2437913333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b8101960 0x7f25b8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.252+0000 7f25bd031640 1 -- 172.21.15.118:0/2437913333 >> 172.21.15.118:0/2437913333 conn(0x7f25b80fd0f0 msgr2=0x7f25b80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.252+0000 7f25bd031640 1 -- 172.21.15.118:0/2437913333 shutdown_connections 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.252+0000 7f25bd031640 1 -- 172.21.15.118:0/2437913333 wait complete. 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.253+0000 7f25bd031640 1 Processor -- start 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.253+0000 7f25bd031640 1 -- start start 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.253+0000 7f25bd031640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8101960 0x7f25b81996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25bd031640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b8102b60 0x7f25b8199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25bd031640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f25b810a7a0 con 0x7f25b8101960 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25bd031640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f25b810a620 con 0x7f25b8102b60 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25b6d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8101960 0x7f25b81996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:31.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25b6d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8101960 0x7f25b81996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44608/0 (socket says 172.21.15.118:44608) 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25b6d9d640 1 -- 172.21.15.118:0/2177467752 learned_addr learned my addr 172.21.15.118:0/2177467752 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25b659c640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b8102b60 0x7f25b8199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25b6d9d640 1 -- 172.21.15.118:0/2177467752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b8102b60 msgr2=0x7f25b8199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25b6d9d640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b8102b60 0x7f25b8199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25b6d9d640 1 -- 172.21.15.118:0/2177467752 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b819a2a0 con 0x7f25b8101960 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25b6d9d640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8101960 0x7f25b81996e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25b000d8d0 tx=0x7f25b000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f259ffff640 1 -- 172.21.15.118:0/2177467752 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25b0017070 con 0x7f25b8101960 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b819ece0 con 0x7f25b8101960 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f259ffff640 1 -- 172.21.15.118:0/2177467752 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25b000be10 con 0x7f25b8101960 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f259ffff640 1 -- 172.21.15.118:0/2177467752 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25b000f3c0 con 0x7f25b8101960 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.254+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b819f190 con 0x7f25b8101960 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.255+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b8101d60 con 0x7f25b8101960 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.256+0000 7f259ffff640 1 -- 172.21.15.118:0/2177467752 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f25b001a070 con 0x7f25b8101960 2024-09-21T11:35:31.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.257+0000 7f259ffff640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25a006e2b0 0x7f25a0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:31.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.257+0000 7f25b659c640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25a006e2b0 0x7f25a0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:31.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.257+0000 7f259ffff640 1 -- 172.21.15.118:0/2177467752 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4321+0+0 (secure 0 0 0) 0x7f25b008d850 con 0x7f25b8101960 2024-09-21T11:35:31.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.257+0000 7f25b659c640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25a006e2b0 0x7f25a0070770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000c00 tx=0x7f25ac0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:31.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.262+0000 7f259ffff640 1 -- 172.21.15.118:0/2177467752 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25b005f2d0 con 0x7f25b8101960 2024-09-21T11:35:31.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.432+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f25b819fc50 con 0x7f25b8101960 2024-09-21T11:35:31.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.432+0000 7f259ffff640 1 -- 172.21.15.118:0/2177467752 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) ==== 74+0+130 (secure 0 0 0) 0x7f25b0063b00 con 0x7f25b8101960 2024-09-21T11:35:31.435 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.434+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25a006e2b0 msgr2=0x7f25a0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.434+0000 7f25bd031640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25a006e2b0 0x7f25a0070770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000c00 tx=0x7f25ac0058d0 comp rx=0 tx=0).stop 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.434+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8101960 msgr2=0x7f25b81996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.434+0000 7f25bd031640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8101960 0x7f25b81996e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25b000d8d0 tx=0x7f25b000dd90 comp rx=0 tx=0).stop 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.434+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 shutdown_connections 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.434+0000 7f25bd031640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25a006e2b0 0x7f25a0070770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.434+0000 7f25bd031640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25b8102b60 0x7f25b8199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.434+0000 7f25bd031640 1 --2- 172.21.15.118:0/2177467752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25b8101960 0x7f25b81996e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.434+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 >> 172.21.15.118:0/2177467752 conn(0x7f25b80fd0f0 msgr2=0x7f25b8074680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.435+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 shutdown_connections 2024-09-21T11:35:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:31.435+0000 7f25bd031640 1 -- 172.21.15.118:0/2177467752 wait complete. 2024-09-21T11:35:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:31 smithi149 ceph-mon[36123]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:31 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2177467752' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T11:35:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:31 smithi118 ceph-mon[28757]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:31 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2177467752' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T11:35:32.172 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1726918507,"num_in_osds":6,"osd_in_since":1726918511,"num_remapped_pgs":0} 2024-09-21T11:35:32.450 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:35:32 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[54966]: 2024-09-21T11:35:32.132+0000 7f8a2dc45640 -1 osd.5 0 log_to_monitors true 2024-09-21T11:35:33.027 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:32 smithi149 ceph-mon[36123]: from='osd.5 [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T11:35:33.027 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:32 smithi149 ceph-mon[36123]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T11:35:33.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:32 smithi118 ceph-mon[28757]: from='osd.5 [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T11:35:33.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:32 smithi118 ceph-mon[28757]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T11:35:33.173 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T11:35:33.423 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:33.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.900+0000 7f5fa94da640 1 -- 172.21.15.118:0/2459263333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4074c50 msgr2=0x7f5fa40750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:33.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.900+0000 7f5fa94da640 1 --2- 172.21.15.118:0/2459263333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4074c50 0x7f5fa40750b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009880 tx=0x7f5f8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:33.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.900+0000 7f5fa94da640 1 -- 172.21.15.118:0/2459263333 shutdown_connections 2024-09-21T11:35:33.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.900+0000 7f5fa94da640 1 --2- 172.21.15.118:0/2459263333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4074c50 0x7f5fa40750b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:33.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.900+0000 7f5fa94da640 1 --2- 172.21.15.118:0/2459263333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa4076220 0x7f5fa4074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:33.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.900+0000 7f5fa94da640 1 -- 172.21.15.118:0/2459263333 >> 172.21.15.118:0/2459263333 conn(0x7f5fa40fd140 msgr2=0x7f5fa40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:33.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.900+0000 7f5fa94da640 1 -- 172.21.15.118:0/2459263333 shutdown_connections 2024-09-21T11:35:33.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.900+0000 7f5fa94da640 1 -- 172.21.15.118:0/2459263333 wait complete. 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5fa94da640 1 Processor -- start 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5fa94da640 1 -- start start 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5fa94da640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa4074c50 0x7f5fa419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5fa94da640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4076220 0x7f5fa419e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5fa94da640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4110df0 con 0x7f5fa4076220 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5fa94da640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4110c70 con 0x7f5fa4074c50 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4076220 0x7f5fa419e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4076220 0x7f5fa419e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44624/0 (socket says 172.21.15.118:44624) 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5f9bfff640 1 -- 172.21.15.118:0/1251307905 learned_addr learned my addr 172.21.15.118:0/1251307905 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5fa2ffd640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa4074c50 0x7f5fa419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5f9bfff640 1 -- 172.21.15.118:0/1251307905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa4074c50 msgr2=0x7f5fa419dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5f9bfff640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa4074c50 0x7f5fa419dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.901+0000 7f5f9bfff640 1 -- 172.21.15.118:0/1251307905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa419e6a0 con 0x7f5fa4076220 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.902+0000 7f5f9bfff640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4076220 0x7f5fa419e020 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c006010 tx=0x7f5f8c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:33.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.902+0000 7f5fa0ff9640 1 -- 172.21.15.118:0/1251307905 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f8c03f070 con 0x7f5fa4076220 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.902+0000 7f5fa0ff9640 1 -- 172.21.15.118:0/1251307905 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f8c0049d0 con 0x7f5fa4076220 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.902+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa41a3080 con 0x7f5fa4076220 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.902+0000 7f5fa0ff9640 1 -- 172.21.15.118:0/1251307905 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f8c035030 con 0x7f5fa4076220 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.902+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa41a3610 con 0x7f5fa4076220 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.903+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa40750b0 con 0x7f5fa4076220 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.903+0000 7f5fa0ff9640 1 -- 172.21.15.118:0/1251307905 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f5f8c042070 con 0x7f5fa4076220 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.904+0000 7f5fa0ff9640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f5f9006e310 0x7f5f900707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.904+0000 7f5fa2ffd640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f5f9006e310 0x7f5f900707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.904+0000 7f5fa0ff9640 1 -- 172.21.15.118:0/1251307905 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4358+0+0 (secure 0 0 0) 0x7f5f8c0ae800 con 0x7f5fa4076220 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.904+0000 7f5fa2ffd640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f5f9006e310 0x7f5f900707d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4076600 tx=0x7f5f94005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:33.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:33.908+0000 7f5fa0ff9640 1 -- 172.21.15.118:0/1251307905 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f8c0802e0 con 0x7f5fa4076220 2024-09-21T11:35:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:33 smithi118 ceph-mon[28757]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:33 smithi118 ceph-mon[28757]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T11:35:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:33 smithi118 ceph-mon[28757]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T11:35:34.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:34.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:33 smithi118 ceph-mon[28757]: from='osd.5 [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:35:34.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:33 smithi118 ceph-mon[28757]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:35:34.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.079+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5fa4062df0 con 0x7f5fa4076220 2024-09-21T11:35:34.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.079+0000 7f5fa0ff9640 1 -- 172.21.15.118:0/1251307905 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) ==== 74+0+130 (secure 0 0 0) 0x7f5f8c084b10 con 0x7f5fa4076220 2024-09-21T11:35:34.083 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:35:34.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.081+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f5f9006e310 msgr2=0x7f5f900707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:34.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.081+0000 7f5fa94da640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f5f9006e310 0x7f5f900707d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4076600 tx=0x7f5f94005f90 comp rx=0 tx=0).stop 2024-09-21T11:35:34.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.081+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4076220 msgr2=0x7f5fa419e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:34.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.081+0000 7f5fa94da640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4076220 0x7f5fa419e020 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c006010 tx=0x7f5f8c004570 comp rx=0 tx=0).stop 2024-09-21T11:35:34.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.082+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 shutdown_connections 2024-09-21T11:35:34.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.082+0000 7f5fa94da640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f5f9006e310 0x7f5f900707d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:34.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.082+0000 7f5fa94da640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fa4076220 0x7f5fa419e020 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:34.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.082+0000 7f5fa94da640 1 --2- 172.21.15.118:0/1251307905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa4074c50 0x7f5fa419dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:34.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.082+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 >> 172.21.15.118:0/1251307905 conn(0x7f5fa40fd140 msgr2=0x7f5fa41035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:34.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.082+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 shutdown_connections 2024-09-21T11:35:34.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:34.082+0000 7f5fa94da640 1 -- 172.21.15.118:0/1251307905 wait complete. 2024-09-21T11:35:34.123 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:33 smithi149 ceph-mon[36123]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:34.123 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:33 smithi149 ceph-mon[36123]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T11:35:34.123 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:33 smithi149 ceph-mon[36123]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T11:35:34.124 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:34.124 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:33 smithi149 ceph-mon[36123]: from='osd.5 [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:35:34.124 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:33 smithi149 ceph-mon[36123]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-21T11:35:34.788 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1726918507,"num_in_osds":6,"osd_in_since":1726918511,"num_remapped_pgs":0} 2024-09-21T11:35:34.950 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[54966]: 2024-09-21T11:35:34.589+0000 7f8a293a5640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T11:35:34.950 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[54966]: 2024-09-21T11:35:34.597+0000 7f8a219d7640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:35:34.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-21T11:35:34.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T11:35:34.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:34.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:34.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1251307905' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T11:35:34.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: Detected new or changed devices on smithi149 2024-09-21T11:35:34.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: Adjusting osd_memory_target on smithi149 to 1213M 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:34.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:34.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:34 smithi149 ceph-mon[36123]: from='osd.5 ' entity='osd.5' 2024-09-21T11:35:35.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1251307905' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: Detected new or changed devices on smithi149 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: Adjusting osd_memory_target on smithi149 to 1213M 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:35.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:35:35.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:35.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:35:35.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:35:35.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:35:35.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:35:35.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T11:35:35.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:34 smithi118 ceph-mon[28757]: from='osd.5 ' entity='osd.5' 2024-09-21T11:35:35.789 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T11:35:36.048 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:35 smithi118 ceph-mon[28757]: purged_snaps scrub starts 2024-09-21T11:35:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:35 smithi118 ceph-mon[28757]: purged_snaps scrub ok 2024-09-21T11:35:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:35 smithi118 ceph-mon[28757]: osd.5 [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] boot 2024-09-21T11:35:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:35 smithi118 ceph-mon[28757]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T11:35:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:35 smithi149 ceph-mon[36123]: purged_snaps scrub starts 2024-09-21T11:35:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:35 smithi149 ceph-mon[36123]: purged_snaps scrub ok 2024-09-21T11:35:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:35 smithi149 ceph-mon[36123]: osd.5 [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] boot 2024-09-21T11:35:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:35 smithi149 ceph-mon[36123]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T11:35:36.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:35:36.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 -- 172.21.15.118:0/2762827032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c101a40 msgr2=0x7f7c4c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:36.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 --2- 172.21.15.118:0/2762827032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c101a40 0x7f7c4c101ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009880 tx=0x7f7c3c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 -- 172.21.15.118:0/2762827032 shutdown_connections 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 --2- 172.21.15.118:0/2762827032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c101a40 0x7f7c4c101ec0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 --2- 172.21.15.118:0/2762827032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c4c100840 0x7f7c4c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 -- 172.21.15.118:0/2762827032 >> 172.21.15.118:0/2762827032 conn(0x7f7c4c0fbff0 msgr2=0x7f7c4c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 -- 172.21.15.118:0/2762827032 shutdown_connections 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 -- 172.21.15.118:0/2762827032 wait complete. 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 Processor -- start 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.467+0000 7f7c53d30640 1 -- start start 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c53d30640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c100840 0x7f7c4c196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c53d30640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c4c101a40 0x7f7c4c196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c53d30640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c109700 con 0x7f7c4c100840 2024-09-21T11:35:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c53d30640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c109580 con 0x7f7c4c101a40 2024-09-21T11:35:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c51acc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c100840 0x7f7c4c196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c51acc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c100840 0x7f7c4c196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48060/0 (socket says 172.21.15.118:48060) 2024-09-21T11:35:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c51acc640 1 -- 172.21.15.118:0/3422707160 learned_addr learned my addr 172.21.15.118:0/3422707160 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c512cb640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c4c101a40 0x7f7c4c196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c51acc640 1 -- 172.21.15.118:0/3422707160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c4c101a40 msgr2=0x7f7c4c196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c51acc640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c4c101a40 0x7f7c4c196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c51acc640 1 -- 172.21.15.118:0/3422707160 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c196fe0 con 0x7f7c4c100840 2024-09-21T11:35:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c51acc640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c100840 0x7f7c4c196420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800b3d0 tx=0x7f7c4800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c42ffd640 1 -- 172.21.15.118:0/3422707160 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c48015020 con 0x7f7c4c100840 2024-09-21T11:35:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c42ffd640 1 -- 172.21.15.118:0/3422707160 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c48011af0 con 0x7f7c4c100840 2024-09-21T11:35:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c19ba20 con 0x7f7c4c100840 2024-09-21T11:35:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.468+0000 7f7c42ffd640 1 -- 172.21.15.118:0/3422707160 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c48010da0 con 0x7f7c4c100840 2024-09-21T11:35:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.469+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c19c030 con 0x7f7c4c100840 2024-09-21T11:35:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.469+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c100c40 con 0x7f7c4c100840 2024-09-21T11:35:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.470+0000 7f7c42ffd640 1 -- 172.21.15.118:0/3422707160 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f7c48018020 con 0x7f7c4c100840 2024-09-21T11:35:36.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.470+0000 7f7c42ffd640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7c3806e310 0x7f7c380707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:36.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.470+0000 7f7c42ffd640 1 -- 172.21.15.118:0/3422707160 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f7c4808d980 con 0x7f7c4c100840 2024-09-21T11:35:36.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.470+0000 7f7c512cb640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7c3806e310 0x7f7c380707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:36.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.471+0000 7f7c512cb640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7c3806e310 0x7f7c380707d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c1978d0 tx=0x7f7c3c005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:36.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.475+0000 7f7c42ffd640 1 -- 172.21.15.118:0/3422707160 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c4801f020 con 0x7f7c4c100840 2024-09-21T11:35:36.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.641+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7c4c190510 con 0x7f7c4c100840 2024-09-21T11:35:36.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.641+0000 7f7c42ffd640 1 -- 172.21.15.118:0/3422707160 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) ==== 74+0+130 (secure 0 0 0) 0x7f7c4805b6a0 con 0x7f7c4c100840 2024-09-21T11:35:36.644 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:35:36.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7c3806e310 msgr2=0x7f7c380707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:36.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7c3806e310 0x7f7c380707d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c1978d0 tx=0x7f7c3c005a20 comp rx=0 tx=0).stop 2024-09-21T11:35:36.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c100840 msgr2=0x7f7c4c196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:36.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c100840 0x7f7c4c196420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800b3d0 tx=0x7f7c4800b890 comp rx=0 tx=0).stop 2024-09-21T11:35:36.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 shutdown_connections 2024-09-21T11:35:36.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f7c3806e310 0x7f7c380707d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:36.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c4c101a40 0x7f7c4c196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:36.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 --2- 172.21.15.118:0/3422707160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4c100840 0x7f7c4c196420 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:36.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 >> 172.21.15.118:0/3422707160 conn(0x7f7c4c0fbff0 msgr2=0x7f7c4c104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:36.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 shutdown_connections 2024-09-21T11:35:36.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:36.643+0000 7f7c53d30640 1 -- 172.21.15.118:0/3422707160 wait complete. 2024-09-21T11:35:37.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:36 smithi118 ceph-mon[28757]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:37.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:36 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3422707160' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T11:35:37.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:36 smithi149 ceph-mon[36123]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:37.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:36 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3422707160' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T11:35:37.296 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726918535,"num_in_osds":6,"osd_in_since":1726918511,"num_remapped_pgs":0} 2024-09-21T11:35:37.297 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T11:35:37.542 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:37 smithi118 ceph-mon[28757]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T11:35:38.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/1663523926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64106820 msgr2=0x7f6e64106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:38.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 --2- 172.21.15.118:0/1663523926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64106820 0x7f6e64106c00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009880 tx=0x7f6e5402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:38.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/1663523926 shutdown_connections 2024-09-21T11:35:38.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 --2- 172.21.15.118:0/1663523926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e64100820 0x7f6e64100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 --2- 172.21.15.118:0/1663523926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64106820 0x7f6e64106c00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/1663523926 >> 172.21.15.118:0/1663523926 conn(0x7f6e640fc520 msgr2=0x7f6e640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/1663523926 shutdown_connections 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/1663523926 wait complete. 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 Processor -- start 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.025+0000 7f6e6a7bd640 1 -- start start 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e6a7bd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64100820 0x7f6e6419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e6a7bd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e64106820 0x7f6e6419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e6a7bd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6410dcf0 con 0x7f6e64100820 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e6a7bd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6410db70 con 0x7f6e64106820 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e63fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64100820 0x7f6e6419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e63fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64100820 0x7f6e6419c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48080/0 (socket says 172.21.15.118:48080) 2024-09-21T11:35:38.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e63fff640 1 -- 172.21.15.118:0/3855032427 learned_addr learned my addr 172.21.15.118:0/3855032427 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e5bfff640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e64106820 0x7f6e6419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e63fff640 1 -- 172.21.15.118:0/3855032427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e64106820 msgr2=0x7f6e6419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e63fff640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e64106820 0x7f6e6419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e63fff640 1 -- 172.21.15.118:0/3855032427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e64196700 con 0x7f6e64100820 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e63fff640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64100820 0x7f6e6419c630 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6e54031460 tx=0x7f6e540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e61ffb640 1 -- 172.21.15.118:0/3855032427 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e5403f070 con 0x7f6e64100820 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e61ffb640 1 -- 172.21.15.118:0/3855032427 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e540035f0 con 0x7f6e64100820 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e61ffb640 1 -- 172.21.15.118:0/3855032427 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e54035030 con 0x7f6e64100820 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e64196990 con 0x7f6e64100820 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.026+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e64196e90 con 0x7f6e64100820 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.027+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e64101f60 con 0x7f6e64100820 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.028+0000 7f6e61ffb640 1 -- 172.21.15.118:0/3855032427 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f6e54042070 con 0x7f6e64100820 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.028+0000 7f6e61ffb640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6e5006e2b0 0x7f6e50070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:38.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.028+0000 7f6e61ffb640 1 -- 172.21.15.118:0/3855032427 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f6e540ae740 con 0x7f6e64100820 2024-09-21T11:35:38.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.028+0000 7f6e5bfff640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6e5006e2b0 0x7f6e50070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:38.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.029+0000 7f6e5bfff640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6e5006e2b0 0x7f6e50070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e64197f50 tx=0x7f6e4c00b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:38.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.033+0000 7f6e61ffb640 1 -- 172.21.15.118:0/3855032427 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e54080090 con 0x7f6e64100820 2024-09-21T11:35:38.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:37 smithi149 ceph-mon[36123]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T11:35:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.200+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e64108d90 con 0x7f6e64100820 2024-09-21T11:35:38.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.201+0000 7f6e61ffb640 1 -- 172.21.15.118:0/3855032427 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11444 (secure 0 0 0) 0x7f6e540848c0 con 0x7f6e64100820 2024-09-21T11:35:38.203 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:35:38.203 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":39,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","created":"2024-09-21T11:29:33.756830+0000","modified":"2024-09-21T11:35:36.805914+0000","last_up_change":"2024-09-21T11:35:35.592786+0000","last_in_change":"2024-09-21T11:35:11.292902+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T11:34:18.773747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"99a80214-8ca7-4b8f-a04e-c3b15aa49219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6803","nonce":2716746021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6805","nonce":2716746021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6809","nonce":2716746021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6807","nonce":2716746021}]},"public_addr":"172.21.15.118:6803/2716746021","cluster_addr":"172.21.15.118:6805/2716746021","heartbeat_back_addr":"172.21.15.118:6809/2716746021","heartbeat_front_addr":"172.21.15.118:6807/2716746021","state":["exists","up"]},{"osd":1,"uuid":"68e49e0e-fa7a-455c-8c4a-6446669e012d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6811","nonce":798289254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6813","nonce":798289254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6817","nonce":798289254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6815","nonce":798289254}]},"public_addr":"172.21.15.118:6811/798289254","cluster_addr":"172.21.15.118:6813/798289254","heartbeat_back_addr":"172.21.15.118:6817/798289254","heartbeat_front_addr":"172.21.15.118:6815/798289254","state":["exists","up"]},{"osd":2,"uuid":"01488d66-e964-4ae3-b00c-98f99ce1d7c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6819","nonce":4288623999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6821","nonce":4288623999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6825","nonce":4288623999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6823","nonce":4288623999}]},"public_addr":"172.21.15.118:6819/4288623999","cluster_addr":"172.21.15.118:6821/4288623999","heartbeat_back_addr":"172.21.15.118:6825/4288623999","heartbeat_front_addr":"172.21.15.118:6823/4288623999","state":["exists","up"]},{"osd":3,"uuid":"f33f5adc-ef11-4165-a7e2-15917a76b0ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6801","nonce":3817247056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6803","nonce":3817247056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6807","nonce":3817247056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6805","nonce":3817247056}]},"public_addr":"172.21.15.149:6801/3817247056","cluster_addr":"172.21.15.149:6803/3817247056","heartbeat_back_addr":"172.21.15.149:6807/3817247056","heartbeat_front_addr":"172.21.15.149:6805/3817247056","state":["exists","up"]},{"osd":4,"uuid":"9e791ff3-6070-41cc-b7ab-542698f77638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6809","nonce":1437394417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6811","nonce":1437394417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6815","nonce":1437394417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6813","nonce":1437394417}]},"public_addr":"172.21.15.149:6809/1437394417","cluster_addr":"172.21.15.149:6811/1437394417","heartbeat_back_addr":"172.21.15.149:6815/1437394417","heartbeat_front_addr":"172.21.15.149:6813/1437394417","state":["exists","up"]},{"osd":5,"uuid":"c7be3412-785f-467d-8fa5-9336d472bbdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6817","nonce":1365805680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6819","nonce":1365805680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6823","nonce":1365805680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6821","nonce":1365805680}]},"public_addr":"172.21.15.149:6817/1365805680","cluster_addr":"172.21.15.149:6819/1365805680","heartbeat_back_addr":"172.21.15.149:6823/1365805680","heartbeat_front_addr":"172.21.15.149:6821/1365805680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:33:16.871760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:33:46.660243+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:34:14.931968+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:34:39.337766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:35:06.342117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:35:33.087911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:0/1228637555":"2024-09-22T11:31:38.466642+0000","172.21.15.118:6801/1466313795":"2024-09-22T11:30:09.037549+0000","172.21.15.118:0/1054797697":"2024-09-22T11:30:39.263894+0000","172.21.15.118:0/569646691":"2024-09-22T11:30:09.037549+0000","172.21.15.118:0/3259731444":"2024-09-22T11:30:09.037549+0000","172.21.15.118:0/2459604279":"2024-09-22T11:31:38.466642+0000","172.21.15.118:0/870566679":"2024-09-22T11:30:39.263894+0000","172.21.15.118:0/2783214462":"2024-09-22T11:30:09.037549+0000","172.21.15.118:6800/2509956308":"2024-09-22T11:30:39.263894+0000","172.21.15.118:0/2091506307":"2024-09-22T11:31:38.466642+0000","172.21.15.118:0/2193247089":"2024-09-22T11:30:39.263894+0000","172.21.15.118:6800/1466313795":"2024-09-22T11:30:09.037549+0000","172.21.15.118:6801/2509956308":"2024-09-22T11:30:39.263894+0000","172.21.15.118:6800/821568869":"2024-09-22T11:31:38.466642+0000","172.21.15.118:6801/821568869":"2024-09-22T11:31:38.466642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T11:35:38.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6e5006e2b0 msgr2=0x7f6e50070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:38.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6e5006e2b0 0x7f6e50070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e64197f50 tx=0x7f6e4c00b390 comp rx=0 tx=0).stop 2024-09-21T11:35:38.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64100820 msgr2=0x7f6e6419c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:38.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64100820 0x7f6e6419c630 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6e54031460 tx=0x7f6e540045e0 comp rx=0 tx=0).stop 2024-09-21T11:35:38.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 shutdown_connections 2024-09-21T11:35:38.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6e5006e2b0 0x7f6e50070770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:38.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e64106820 0x7f6e6419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:38.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 --2- 172.21.15.118:0/3855032427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e64100820 0x7f6e6419c630 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:38.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 >> 172.21.15.118:0/3855032427 conn(0x7f6e640fc520 msgr2=0x7f6e640fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:38.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 shutdown_connections 2024-09-21T11:35:38.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:38.203+0000 7f6e6a7bd640 1 -- 172.21.15.118:0/3855032427 wait complete. 2024-09-21T11:35:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:38 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3855032427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T11:35:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:38 smithi118 ceph-mon[28757]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:35:38.897 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T11:34:18.773747+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T11:35:38.898 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T11:35:39.145 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:38 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3855032427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T11:35:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:38 smithi149 ceph-mon[36123]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:38 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.610+0000 7f774c4c5640 1 -- 172.21.15.118:0/2882464841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 msgr2=0x7f774410b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.610+0000 7f774c4c5640 1 --2- 172.21.15.118:0/2882464841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 0x7f774410b8e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7734009880 tx=0x7f773402a530 comp rx=0 tx=0).stop 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.610+0000 7f774c4c5640 1 -- 172.21.15.118:0/2882464841 shutdown_connections 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.610+0000 7f774c4c5640 1 --2- 172.21.15.118:0/2882464841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 0x7f774410b8e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.610+0000 7f774c4c5640 1 --2- 172.21.15.118:0/2882464841 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7744102ad0 0x7f7744102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.610+0000 7f774c4c5640 1 -- 172.21.15.118:0/2882464841 >> 172.21.15.118:0/2882464841 conn(0x7f77440fc510 msgr2=0x7f77440fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f774c4c5640 1 -- 172.21.15.118:0/2882464841 shutdown_connections 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f774c4c5640 1 -- 172.21.15.118:0/2882464841 wait complete. 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f774c4c5640 1 Processor -- start 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f774c4c5640 1 -- start start 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f774c4c5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7744102ad0 0x7f774419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f774c4c5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 0x7f774419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:39.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f774c4c5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f774410ee60 con 0x7f77441033f0 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f774c4c5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f774410ece0 con 0x7f7744102ad0 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f7749a60640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 0x7f774419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f7749a60640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 0x7f774419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48098/0 (socket says 172.21.15.118:48098) 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.611+0000 7f7749a60640 1 -- 172.21.15.118:0/3458357000 learned_addr learned my addr 172.21.15.118:0/3458357000 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f774a261640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7744102ad0 0x7f774419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f7749a60640 1 -- 172.21.15.118:0/3458357000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7744102ad0 msgr2=0x7f774419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f7749a60640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7744102ad0 0x7f774419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f7749a60640 1 -- 172.21.15.118:0/3458357000 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7744197870 con 0x7f77441033f0 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f774a261640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7744102ad0 0x7f774419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f7749a60640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 0x7f774419dbf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7734031460 tx=0x7f77340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f773b7fe640 1 -- 172.21.15.118:0/3458357000 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f773403f070 con 0x7f77441033f0 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f773b7fe640 1 -- 172.21.15.118:0/3458357000 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7734004ac0 con 0x7f77441033f0 2024-09-21T11:35:39.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7744197b00 con 0x7f77441033f0 2024-09-21T11:35:39.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f773b7fe640 1 -- 172.21.15.118:0/3458357000 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7734035030 con 0x7f77441033f0 2024-09-21T11:35:39.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.612+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7744198030 con 0x7f77441033f0 2024-09-21T11:35:39.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.613+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774406abe0 con 0x7f77441033f0 2024-09-21T11:35:39.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.614+0000 7f773b7fe640 1 -- 172.21.15.118:0/3458357000 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f7734042070 con 0x7f77441033f0 2024-09-21T11:35:39.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.614+0000 7f773b7fe640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f773006e2b0 0x7f7730070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:39.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.614+0000 7f773b7fe640 1 -- 172.21.15.118:0/3458357000 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f77340ae860 con 0x7f77441033f0 2024-09-21T11:35:39.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.614+0000 7f774a261640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f773006e2b0 0x7f7730070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:39.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.615+0000 7f774a261640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f773006e2b0 0x7f7730070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7740006fd0 tx=0x7f7740008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:39.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.619+0000 7f773b7fe640 1 -- 172.21.15.118:0/3458357000 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f773407c500 con 0x7f77441033f0 2024-09-21T11:35:39.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.784+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7744105fd0 con 0x7f77441033f0 2024-09-21T11:35:39.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.785+0000 7f773b7fe640 1 -- 172.21.15.118:0/3458357000 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f77340801b0 con 0x7f77441033f0 2024-09-21T11:35:39.787 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T11:35:39.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f773006e2b0 msgr2=0x7f7730070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:39.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f773006e2b0 0x7f7730070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7740006fd0 tx=0x7f7740008040 comp rx=0 tx=0).stop 2024-09-21T11:35:39.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 msgr2=0x7f774419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:39.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 0x7f774419dbf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7734031460 tx=0x7f77340046c0 comp rx=0 tx=0).stop 2024-09-21T11:35:39.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 shutdown_connections 2024-09-21T11:35:39.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f773006e2b0 0x7f7730070770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:39.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77441033f0 0x7f774419dbf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:39.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 --2- 172.21.15.118:0/3458357000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7744102ad0 0x7f774419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:39.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 >> 172.21.15.118:0/3458357000 conn(0x7f77440fc510 msgr2=0x7f7744108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:39.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 shutdown_connections 2024-09-21T11:35:39.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:39.787+0000 7f774c4c5640 1 -- 172.21.15.118:0/3458357000 wait complete. 2024-09-21T11:35:40.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:39 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3458357000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T11:35:40.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:39 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3458357000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T11:35:40.656 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T11:35:40.656 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T11:35:40.903 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:41.024 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:40 smithi118 ceph-mon[28757]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:41.101 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:40 smithi149 ceph-mon[36123]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.358+0000 7faf784ee640 1 -- 172.21.15.118:0/1914024882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 msgr2=0x7faf70100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.358+0000 7faf784ee640 1 --2- 172.21.15.118:0/1914024882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 0x7faf70100c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009880 tx=0x7faf6c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.358+0000 7faf784ee640 1 -- 172.21.15.118:0/1914024882 shutdown_connections 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.358+0000 7faf784ee640 1 --2- 172.21.15.118:0/1914024882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf70101a80 0x7faf70101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.358+0000 7faf784ee640 1 --2- 172.21.15.118:0/1914024882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 0x7faf70100c80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.358+0000 7faf784ee640 1 -- 172.21.15.118:0/1914024882 >> 172.21.15.118:0/1914024882 conn(0x7faf700fc010 msgr2=0x7faf700fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.358+0000 7faf784ee640 1 -- 172.21.15.118:0/1914024882 shutdown_connections 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.358+0000 7faf784ee640 1 -- 172.21.15.118:0/1914024882 wait complete. 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf784ee640 1 Processor -- start 2024-09-21T11:35:41.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf784ee640 1 -- start start 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf784ee640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 0x7faf701963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf784ee640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf70101a80 0x7faf701968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf784ee640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faf701096c0 con 0x7faf70100880 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf784ee640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf70109540 con 0x7faf70101a80 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf7628a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 0x7faf701963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf7628a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 0x7faf701963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48126/0 (socket says 172.21.15.118:48126) 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf7628a640 1 -- 172.21.15.118:0/304319512 learned_addr learned my addr 172.21.15.118:0/304319512 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf75a89640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf70101a80 0x7faf701968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf7628a640 1 -- 172.21.15.118:0/304319512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf70101a80 msgr2=0x7faf701968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf7628a640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf70101a80 0x7faf701968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf7628a640 1 -- 172.21.15.118:0/304319512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf70196f70 con 0x7faf70100880 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf7628a640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 0x7faf701963b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf6c006010 tx=0x7faf6c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf677fe640 1 -- 172.21.15.118:0/304319512 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf6c03f070 con 0x7faf70100880 2024-09-21T11:35:41.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf677fe640 1 -- 172.21.15.118:0/304319512 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf6c004a50 con 0x7faf70100880 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.359+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7019b950 con 0x7faf70100880 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.360+0000 7faf677fe640 1 -- 172.21.15.118:0/304319512 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf6c035030 con 0x7faf70100880 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.360+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7019bee0 con 0x7faf70100880 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.361+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf70100c80 con 0x7faf70100880 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.361+0000 7faf677fe640 1 -- 172.21.15.118:0/304319512 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7faf6c042070 con 0x7faf70100880 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.362+0000 7faf677fe640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faf5c06e2b0 0x7faf5c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.362+0000 7faf75a89640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faf5c06e2b0 0x7faf5c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.362+0000 7faf677fe640 1 -- 172.21.15.118:0/304319512 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7faf6c0ae930 con 0x7faf70100880 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.362+0000 7faf75a89640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faf5c06e2b0 0x7faf5c070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf70197860 tx=0x7faf6000b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.366+0000 7faf677fe640 1 -- 172.21.15.118:0/304319512 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf6c004c00 con 0x7faf70100880 2024-09-21T11:35:41.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.595+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7faf701904d0 con 0x7faf70100880 2024-09-21T11:35:41.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.597+0000 7faf677fe640 1 -- 172.21.15.118:0/304319512 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7faf6c080280 con 0x7faf70100880 2024-09-21T11:35:41.599 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T11:35:41.599 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCNr+5m3XKTIxAAPdMPwRoONSuZxeEJYS4TfQ== 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faf5c06e2b0 msgr2=0x7faf5c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faf5c06e2b0 0x7faf5c070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf70197860 tx=0x7faf6000b390 comp rx=0 tx=0).stop 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 msgr2=0x7faf701963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 0x7faf701963b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf6c006010 tx=0x7faf6c0045e0 comp rx=0 tx=0).stop 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 shutdown_connections 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faf5c06e2b0 0x7faf5c070770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf70101a80 0x7faf701968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 --2- 172.21.15.118:0/304319512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf70100880 0x7faf701963b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 >> 172.21.15.118:0/304319512 conn(0x7faf700fc010 msgr2=0x7faf70104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 shutdown_connections 2024-09-21T11:35:41.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:41.599+0000 7faf784ee640 1 -- 172.21.15.118:0/304319512 wait complete. 2024-09-21T11:35:42.039 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:41 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/304319512' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T11:35:42.039 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:41 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/304319512' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T11:35:42.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:41 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/304319512' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T11:35:42.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:41 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/304319512' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T11:35:42.314 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:35:42.314 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T11:35:42.314 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T11:35:42.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T11:35:42.605 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T11:35:42.985 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:42 smithi149 ceph-mon[36123]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:43.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:42 smithi118 ceph-mon[28757]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.073+0000 7fbb820f3640 1 -- 172.21.15.149:0/4165821558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 msgr2=0x7fbb7c103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.073+0000 7fbb820f3640 1 --2- 172.21.15.149:0/4165821558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 0x7fbb7c103000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009880 tx=0x7fbb7002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.073+0000 7fbb820f3640 1 -- 172.21.15.149:0/4165821558 shutdown_connections 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.073+0000 7fbb820f3640 1 --2- 172.21.15.149:0/4165821558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 0x7fbb7c103000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.073+0000 7fbb820f3640 1 --2- 172.21.15.149:0/4165821558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c101980 0x7fbb7c101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.073+0000 7fbb820f3640 1 -- 172.21.15.149:0/4165821558 >> 172.21.15.149:0/4165821558 conn(0x7fbb7c0fd110 msgr2=0x7fbb7c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.074+0000 7fbb820f3640 1 -- 172.21.15.149:0/4165821558 shutdown_connections 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.074+0000 7fbb820f3640 1 -- 172.21.15.149:0/4165821558 wait complete. 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.074+0000 7fbb820f3640 1 Processor -- start 2024-09-21T11:35:43.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.074+0000 7fbb820f3640 1 -- start start 2024-09-21T11:35:43.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.074+0000 7fbb820f3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c101980 0x7fbb7c197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:43.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.074+0000 7fbb820f3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 0x7fbb7c197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:43.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.074+0000 7fbb820f3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c10a840 con 0x7fbb7c101980 2024-09-21T11:35:43.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.074+0000 7fbb820f3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c10a6c0 con 0x7fbb7c102b80 2024-09-21T11:35:43.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb7affd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 0x7fbb7c197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:43.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb7affd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 0x7fbb7c197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45798/0 (socket says 172.21.15.149:45798) 2024-09-21T11:35:43.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb7affd640 1 -- 172.21.15.149:0/1014345507 learned_addr learned my addr 172.21.15.149:0/1014345507 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb7b7fe640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c101980 0x7fbb7c197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb7affd640 1 -- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c101980 msgr2=0x7fbb7c197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb7affd640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c101980 0x7fbb7c197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb7affd640 1 -- 172.21.15.149:0/1014345507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7c198120 con 0x7fbb7c102b80 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb7affd640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 0x7fbb7c197aa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbb70006010 tx=0x7fbb700048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb78ff9640 1 -- 172.21.15.149:0/1014345507 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb7003f070 con 0x7fbb7c102b80 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb78ff9640 1 -- 172.21.15.149:0/1014345507 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb700044d0 con 0x7fbb7c102b80 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7c19cb00 con 0x7fbb7c102b80 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb78ff9640 1 -- 172.21.15.149:0/1014345507 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb70035030 con 0x7fbb7c102b80 2024-09-21T11:35:43.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.075+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7c19d110 con 0x7fbb7c102b80 2024-09-21T11:35:43.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.077+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7c101d60 con 0x7fbb7c102b80 2024-09-21T11:35:43.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.077+0000 7fbb78ff9640 1 -- 172.21.15.149:0/1014345507 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fbb70042070 con 0x7fbb7c102b80 2024-09-21T11:35:43.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.077+0000 7fbb78ff9640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fbb6406e2b0 0x7fbb64070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:43.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.077+0000 7fbb78ff9640 1 -- 172.21.15.149:0/1014345507 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fbb700aeba0 con 0x7fbb7c102b80 2024-09-21T11:35:43.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.078+0000 7fbb7b7fe640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fbb6406e2b0 0x7fbb64070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:43.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.078+0000 7fbb7b7fe640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fbb6406e2b0 0x7fbb64070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c1029e0 tx=0x7fbb6c008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:43.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.082+0000 7fbb78ff9640 1 -- 172.21.15.149:0/1014345507 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb7007c840 con 0x7fbb7c102b80 2024-09-21T11:35:43.310 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.309+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fbb7c191650 con 0x7fbb7c102b80 2024-09-21T11:35:43.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.313+0000 7fbb78ff9640 1 -- 172.21.15.149:0/1014345507 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7fbb7009c170 con 0x7fbb7c102b80 2024-09-21T11:35:43.315 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-09-21T11:35:43.316 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCPr+5mujKIEhAAaz+Eg2tGO0F7Hf5AcdUUKw== 2024-09-21T11:35:43.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fbb6406e2b0 msgr2=0x7fbb64070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fbb6406e2b0 0x7fbb64070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c1029e0 tx=0x7fbb6c008040 comp rx=0 tx=0).stop 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 msgr2=0x7fbb7c197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 0x7fbb7c197aa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbb70006010 tx=0x7fbb700048f0 comp rx=0 tx=0).stop 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 shutdown_connections 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fbb6406e2b0 0x7fbb64070770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c102b80 0x7fbb7c197aa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 --2- 172.21.15.149:0/1014345507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c101980 0x7fbb7c197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 >> 172.21.15.149:0/1014345507 conn(0x7fbb7c0fd110 msgr2=0x7fbb7c106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 shutdown_connections 2024-09-21T11:35:43.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:35:43.316+0000 7fbb820f3640 1 -- 172.21.15.149:0/1014345507 wait complete. 2024-09-21T11:35:43.916 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:35:43.917 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-21T11:35:43.917 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T11:35:43.954 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T11:35:44.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:43 smithi149 ceph-mon[36123]: from='client.? 172.21.15.149:0/1014345507' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T11:35:44.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:43 smithi149 ceph-mon[36123]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T11:35:44.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:43 smithi149 ceph-mon[36123]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T11:35:44.220 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:43 smithi118 ceph-mon[28757]: from='client.? 172.21.15.149:0/1014345507' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T11:35:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:43 smithi118 ceph-mon[28757]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T11:35:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:43 smithi118 ceph-mon[28757]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T11:35:44.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 -- 172.21.15.118:0/2125341195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2fc106800 msgr2=0x7fd2fc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:44.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 --2- 172.21.15.118:0/2125341195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2fc106800 0x7fd2fc106be0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009880 tx=0x7fd2ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:44.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 -- 172.21.15.118:0/2125341195 shutdown_connections 2024-09-21T11:35:44.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 --2- 172.21.15.118:0/2125341195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc100800 0x7fd2fc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:44.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 --2- 172.21.15.118:0/2125341195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2fc106800 0x7fd2fc106be0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:44.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 -- 172.21.15.118:0/2125341195 >> 172.21.15.118:0/2125341195 conn(0x7fd2fc0fc4e0 msgr2=0x7fd2fc0fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 -- 172.21.15.118:0/2125341195 shutdown_connections 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 -- 172.21.15.118:0/2125341195 wait complete. 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 Processor -- start 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.668+0000 7fd301c24640 1 -- start start 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd301c24640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2fc100800 0x7fd2fc0fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd301c24640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc106800 0x7fd2fc0fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd301c24640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc10dcd0 con 0x7fd2fc100800 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd301c24640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc10db50 con 0x7fd2fc106800 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2f3fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc106800 0x7fd2fc0fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2f3fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc106800 0x7fd2fc0fd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:36754/0 (socket says 172.21.15.118:36754) 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2fb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2fc100800 0x7fd2fc0fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2f3fff640 1 -- 172.21.15.118:0/2433345267 learned_addr learned my addr 172.21.15.118:0/2433345267 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2fb7fe640 1 -- 172.21.15.118:0/2433345267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc106800 msgr2=0x7fd2fc0fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:44.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2fb7fe640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc106800 0x7fd2fc0fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2fb7fe640 1 -- 172.21.15.118:0/2433345267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2fc0fd670 con 0x7fd2fc100800 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2fb7fe640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2fc100800 0x7fd2fc0fcbf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec006010 tx=0x7fd2ec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2f97fa640 1 -- 172.21.15.118:0/2433345267 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2ec03f070 con 0x7fd2fc100800 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2f97fa640 1 -- 172.21.15.118:0/2433345267 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2ec0035f0 con 0x7fd2fc100800 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2fc0fd900 con 0x7fd2fc100800 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.669+0000 7fd2f97fa640 1 -- 172.21.15.118:0/2433345267 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2ec035030 con 0x7fd2fc100800 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.670+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2fc1a3d60 con 0x7fd2fc100800 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.670+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2fc101f40 con 0x7fd2fc100800 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.671+0000 7fd2f97fa640 1 -- 172.21.15.118:0/2433345267 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fd2ec042070 con 0x7fd2fc100800 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.671+0000 7fd2f97fa640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd2e806e2b0 0x7fd2e8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.671+0000 7fd2f97fa640 1 -- 172.21.15.118:0/2433345267 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd2ec0ae790 con 0x7fd2fc100800 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.671+0000 7fd2f3fff640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd2e806e2b0 0x7fd2e8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.672+0000 7fd2f3fff640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd2e806e2b0 0x7fd2e8070770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0fe680 tx=0x7fd2e400b410 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.676+0000 7fd2f97fa640 1 -- 172.21.15.118:0/2433345267 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2ec0800e0 con 0x7fd2fc100800 2024-09-21T11:35:44.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.845+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fd2fc0fe120 con 0x7fd2fc100800 2024-09-21T11:35:44.848 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:44 smithi118 ceph-mon[28757]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:44.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.845+0000 7fd2f97fa640 1 -- 172.21.15.118:0/2433345267 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v40) ==== 86+0+160 (secure 0 0 0) 0x7fd2ec084910 con 0x7fd2fc100800 2024-09-21T11:35:44.848 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:35:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.847+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd2e806e2b0 msgr2=0x7fd2e8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.847+0000 7fd301c24640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd2e806e2b0 0x7fd2e8070770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0fe680 tx=0x7fd2e400b410 comp rx=0 tx=0).stop 2024-09-21T11:35:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.847+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2fc100800 msgr2=0x7fd2fc0fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.847+0000 7fd301c24640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2fc100800 0x7fd2fc0fcbf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec006010 tx=0x7fd2ec0045e0 comp rx=0 tx=0).stop 2024-09-21T11:35:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.847+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 shutdown_connections 2024-09-21T11:35:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.847+0000 7fd301c24640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd2e806e2b0 0x7fd2e8070770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.848+0000 7fd301c24640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc106800 0x7fd2fc0fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:44.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.848+0000 7fd301c24640 1 --2- 172.21.15.118:0/2433345267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2fc100800 0x7fd2fc0fcbf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:44.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.848+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 >> 172.21.15.118:0/2433345267 conn(0x7fd2fc0fc4e0 msgr2=0x7fd2fc06a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:44.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.848+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 shutdown_connections 2024-09-21T11:35:44.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:44.848+0000 7fd301c24640 1 -- 172.21.15.118:0/2433345267 wait complete. 2024-09-21T11:35:45.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:44 smithi149 ceph-mon[36123]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:45.530 INFO:teuthology.orchestra.run.smithi118.stdout:[{"version":40,"timestamp":"2024-09-21T11:35:34.591504+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"8481.758979"}]}] 2024-09-21T11:35:45.530 INFO:tasks.ceph_manager:config epoch is 40 2024-09-21T11:35:45.531 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T11:35:45.531 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T11:35:45.531 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T11:35:45.777 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:46.164 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:45 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2433345267' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T11:35:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:45 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2433345267' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T11:35:46.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 -- 172.21.15.118:0/2430749172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 msgr2=0x7f34c0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:46.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 --2- 172.21.15.118:0/2430749172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 0x7f34c0106bc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009880 tx=0x7f34b002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:46.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 -- 172.21.15.118:0/2430749172 shutdown_connections 2024-09-21T11:35:46.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 --2- 172.21.15.118:0/2430749172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c01007e0 0x7f34c0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:46.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 --2- 172.21.15.118:0/2430749172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 0x7f34c0106bc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:46.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 -- 172.21.15.118:0/2430749172 >> 172.21.15.118:0/2430749172 conn(0x7f34c00fc4c0 msgr2=0x7f34c00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 -- 172.21.15.118:0/2430749172 shutdown_connections 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 -- 172.21.15.118:0/2430749172 wait complete. 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 Processor -- start 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 -- start start 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c01007e0 0x7f34c0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 0x7f34c0198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f34c010dd10 con 0x7f34c01067e0 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.241+0000 7f34c671c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34c010db90 con 0x7f34c01007e0 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34b7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 0x7f34c0198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34b7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 0x7f34c0198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47410/0 (socket says 172.21.15.118:47410) 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34b7fff640 1 -- 172.21.15.118:0/3711532540 learned_addr learned my addr 172.21.15.118:0/3711532540 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34bffff640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c01007e0 0x7f34c0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34b7fff640 1 -- 172.21.15.118:0/3711532540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c01007e0 msgr2=0x7f34c0198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34b7fff640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c01007e0 0x7f34c0198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34b7fff640 1 -- 172.21.15.118:0/3711532540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c01993d0 con 0x7f34c01067e0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34b7fff640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 0x7f34c0198d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34a800b420 tx=0x7f34a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34bdffb640 1 -- 172.21.15.118:0/3711532540 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34a8011630 con 0x7f34c01067e0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34bdffb640 1 -- 172.21.15.118:0/3711532540 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34a8016070 con 0x7f34c01067e0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c01a18b0 con 0x7f34c01067e0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34bdffb640 1 -- 172.21.15.118:0/3711532540 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34a8010d40 con 0x7f34c01067e0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.242+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c01a1cb0 con 0x7f34c01067e0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.243+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c0101f20 con 0x7f34c01067e0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.244+0000 7f34bdffb640 1 -- 172.21.15.118:0/3711532540 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f34a801b460 con 0x7f34c01067e0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.244+0000 7f34bdffb640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f34ac06e310 0x7f34ac0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.244+0000 7f34bffff640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f34ac06e310 0x7f34ac0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.244+0000 7f34bdffb640 1 -- 172.21.15.118:0/3711532540 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f34a808d550 con 0x7f34c01067e0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.245+0000 7f34bffff640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f34ac06e310 0x7f34ac0707d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34b00096c0 tx=0x7f34b0031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.248+0000 7f34bdffb640 1 -- 172.21.15.118:0/3711532540 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f34a805b270 con 0x7f34c01067e0 2024-09-21T11:35:46.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.458+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f34c0108d50 con 0x7f34c01067e0 2024-09-21T11:35:46.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.461+0000 7f34bdffb640 1 -- 172.21.15.118:0/3711532540 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176574 (secure 0 0 0) 0x7f34a808d370 con 0x7f34c01067e0 2024-09-21T11:35:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.463+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f34ac06e310 msgr2=0x7f34ac0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.463+0000 7f34c671c640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f34ac06e310 0x7f34ac0707d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34b00096c0 tx=0x7f34b0031400 comp rx=0 tx=0).stop 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.463+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 msgr2=0x7f34c0198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.463+0000 7f34c671c640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 0x7f34c0198d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34a800b420 tx=0x7f34a800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.463+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 shutdown_connections 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.464+0000 7f34c671c640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f34ac06e310 0x7f34ac0707d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.464+0000 7f34c671c640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34c01067e0 0x7f34c0198d80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.464+0000 7f34c671c640 1 --2- 172.21.15.118:0/3711532540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c01007e0 0x7f34c0198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.464+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 >> 172.21.15.118:0/3711532540 conn(0x7f34c00fc4c0 msgr2=0x7f34c00fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:46.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.464+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 shutdown_connections 2024-09-21T11:35:46.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:46.464+0000 7f34c671c640 1 -- 172.21.15.118:0/3711532540 wait complete. 2024-09-21T11:35:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:46 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3711532540' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T11:35:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:46 smithi118 ceph-mon[28757]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:47.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:46 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3711532540' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T11:35:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:46 smithi149 ceph-mon[36123]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:47.225 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":19,"flags":0,"active_gid":14221,"active_name":"smithi118.djbwyn","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1247137526},{"type":"v1","addr":"172.21.15.118:6801","nonce":1247137526}]},"active_addr":"172.21.15.118:6801/1247137526","active_change":"2024-09-21T11:31:38.466792+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14246,"name":"smithi149.xjglai","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.118:8443/","prometheus":"http://172.21.15.118:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":3869671741}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":591223858}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":1431244700}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":1896148961}]}]} 2024-09-21T11:35:47.230 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T11:35:47.230 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T11:35:47.230 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T11:35:47.478 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:47.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.882+0000 7f255c102640 1 -- 172.21.15.118:0/2415911675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 msgr2=0x7f2554100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:47.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.882+0000 7f255c102640 1 --2- 172.21.15.118:0/2415911675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 0x7f2554100c80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2550009880 tx=0x7f255002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:47.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.882+0000 7f255c102640 1 -- 172.21.15.118:0/2415911675 shutdown_connections 2024-09-21T11:35:47.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.882+0000 7f255c102640 1 --2- 172.21.15.118:0/2415911675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 0x7f2554100c80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.882+0000 7f255c102640 1 --2- 172.21.15.118:0/2415911675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2554106820 0x7f2554106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.882+0000 7f255c102640 1 -- 172.21.15.118:0/2415911675 >> 172.21.15.118:0/2415911675 conn(0x7f25540fc520 msgr2=0x7f25540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.882+0000 7f255c102640 1 -- 172.21.15.118:0/2415911675 shutdown_connections 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.882+0000 7f255c102640 1 -- 172.21.15.118:0/2415911675 wait complete. 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f255c102640 1 Processor -- start 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f255c102640 1 -- start start 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f255c102640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 0x7f2554198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f255c102640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2554106820 0x7f2554198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f255c102640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f255410dd50 con 0x7f2554100820 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f255c102640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f255410dbd0 con 0x7f2554106820 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f2559e9e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 0x7f2554198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f2559e9e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 0x7f2554198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47414/0 (socket says 172.21.15.118:47414) 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f2559e9e640 1 -- 172.21.15.118:0/2157454187 learned_addr learned my addr 172.21.15.118:0/2157454187 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:47.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f2559e9e640 1 -- 172.21.15.118:0/2157454187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2554106820 msgr2=0x7f2554198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f2559e9e640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2554106820 0x7f2554198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f2559e9e640 1 -- 172.21.15.118:0/2157454187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25541993c0 con 0x7f2554100820 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f2559e9e640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 0x7f2554198830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f254800b420 tx=0x7f254800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f2546ffd640 1 -- 172.21.15.118:0/2157454187 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2548011630 con 0x7f2554100820 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.883+0000 7f2546ffd640 1 -- 172.21.15.118:0/2157454187 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2548016070 con 0x7f2554100820 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.884+0000 7f2546ffd640 1 -- 172.21.15.118:0/2157454187 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2548010d40 con 0x7f2554100820 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.884+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25541a18a0 con 0x7f2554100820 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.884+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25541a1ca0 con 0x7f2554100820 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.884+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2554101f60 con 0x7f2554100820 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.885+0000 7f2546ffd640 1 -- 172.21.15.118:0/2157454187 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f254801b460 con 0x7f2554100820 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.885+0000 7f2546ffd640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f254006e2b0 0x7f2540070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.885+0000 7f2546ffd640 1 -- 172.21.15.118:0/2157454187 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f254808d680 con 0x7f2554100820 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.886+0000 7f255969d640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f254006e2b0 0x7f2540070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.886+0000 7f255969d640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f254006e2b0 0x7f2540070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25500096c0 tx=0x7f2550000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:47.890+0000 7f2546ffd640 1 -- 172.21.15.118:0/2157454187 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f254805b320 con 0x7f2554100820 2024-09-21T11:35:48.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.058+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2554100c80 con 0x7f2554100820 2024-09-21T11:35:48.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.059+0000 7f2546ffd640 1 -- 172.21.15.118:0/2157454187 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11444 (secure 0 0 0) 0x7f254805efd0 con 0x7f2554100820 2024-09-21T11:35:48.061 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:35:48.061 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":39,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","created":"2024-09-21T11:29:33.756830+0000","modified":"2024-09-21T11:35:36.805914+0000","last_up_change":"2024-09-21T11:35:35.592786+0000","last_in_change":"2024-09-21T11:35:11.292902+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T11:34:18.773747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"99a80214-8ca7-4b8f-a04e-c3b15aa49219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6803","nonce":2716746021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6805","nonce":2716746021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6809","nonce":2716746021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6807","nonce":2716746021}]},"public_addr":"172.21.15.118:6803/2716746021","cluster_addr":"172.21.15.118:6805/2716746021","heartbeat_back_addr":"172.21.15.118:6809/2716746021","heartbeat_front_addr":"172.21.15.118:6807/2716746021","state":["exists","up"]},{"osd":1,"uuid":"68e49e0e-fa7a-455c-8c4a-6446669e012d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6811","nonce":798289254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6813","nonce":798289254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6817","nonce":798289254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6815","nonce":798289254}]},"public_addr":"172.21.15.118:6811/798289254","cluster_addr":"172.21.15.118:6813/798289254","heartbeat_back_addr":"172.21.15.118:6817/798289254","heartbeat_front_addr":"172.21.15.118:6815/798289254","state":["exists","up"]},{"osd":2,"uuid":"01488d66-e964-4ae3-b00c-98f99ce1d7c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6819","nonce":4288623999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6821","nonce":4288623999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6825","nonce":4288623999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6823","nonce":4288623999}]},"public_addr":"172.21.15.118:6819/4288623999","cluster_addr":"172.21.15.118:6821/4288623999","heartbeat_back_addr":"172.21.15.118:6825/4288623999","heartbeat_front_addr":"172.21.15.118:6823/4288623999","state":["exists","up"]},{"osd":3,"uuid":"f33f5adc-ef11-4165-a7e2-15917a76b0ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6801","nonce":3817247056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6803","nonce":3817247056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6807","nonce":3817247056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6805","nonce":3817247056}]},"public_addr":"172.21.15.149:6801/3817247056","cluster_addr":"172.21.15.149:6803/3817247056","heartbeat_back_addr":"172.21.15.149:6807/3817247056","heartbeat_front_addr":"172.21.15.149:6805/3817247056","state":["exists","up"]},{"osd":4,"uuid":"9e791ff3-6070-41cc-b7ab-542698f77638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6809","nonce":1437394417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6811","nonce":1437394417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6815","nonce":1437394417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6813","nonce":1437394417}]},"public_addr":"172.21.15.149:6809/1437394417","cluster_addr":"172.21.15.149:6811/1437394417","heartbeat_back_addr":"172.21.15.149:6815/1437394417","heartbeat_front_addr":"172.21.15.149:6813/1437394417","state":["exists","up"]},{"osd":5,"uuid":"c7be3412-785f-467d-8fa5-9336d472bbdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6817","nonce":1365805680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6819","nonce":1365805680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6823","nonce":1365805680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6821","nonce":1365805680}]},"public_addr":"172.21.15.149:6817/1365805680","cluster_addr":"172.21.15.149:6819/1365805680","heartbeat_back_addr":"172.21.15.149:6823/1365805680","heartbeat_front_addr":"172.21.15.149:6821/1365805680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:33:16.871760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:33:46.660243+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:34:14.931968+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:34:39.337766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:35:06.342117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:35:33.087911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:0/1228637555":"2024-09-22T11:31:38.466642+0000","172.21.15.118:6801/1466313795":"2024-09-22T11:30:09.037549+0000","172.21.15.118:0/1054797697":"2024-09-22T11:30:39.263894+0000","172.21.15.118:0/569646691":"2024-09-22T11:30:09.037549+0000","172.21.15.118:0/3259731444":"2024-09-22T11:30:09.037549+0000","172.21.15.118:0/2459604279":"2024-09-22T11:31:38.466642+0000","172.21.15.118:0/870566679":"2024-09-22T11:30:39.263894+0000","172.21.15.118:0/2783214462":"2024-09-22T11:30:09.037549+0000","172.21.15.118:6800/2509956308":"2024-09-22T11:30:39.263894+0000","172.21.15.118:0/2091506307":"2024-09-22T11:31:38.466642+0000","172.21.15.118:0/2193247089":"2024-09-22T11:30:39.263894+0000","172.21.15.118:6800/1466313795":"2024-09-22T11:30:09.037549+0000","172.21.15.118:6801/2509956308":"2024-09-22T11:30:39.263894+0000","172.21.15.118:6800/821568869":"2024-09-22T11:31:38.466642+0000","172.21.15.118:6801/821568869":"2024-09-22T11:31:38.466642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T11:35:48.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f254006e2b0 msgr2=0x7f2540070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f254006e2b0 0x7f2540070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25500096c0 tx=0x7f2550000bc0 comp rx=0 tx=0).stop 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 msgr2=0x7f2554198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 0x7f2554198830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f254800b420 tx=0x7f254800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 shutdown_connections 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f254006e2b0 0x7f2540070770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2554106820 0x7f2554198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 --2- 172.21.15.118:0/2157454187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2554100820 0x7f2554198830 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 >> 172.21.15.118:0/2157454187 conn(0x7f25540fc520 msgr2=0x7f25540fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 shutdown_connections 2024-09-21T11:35:48.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:48.061+0000 7f255c102640 1 -- 172.21.15.118:0/2157454187 wait complete. 2024-09-21T11:35:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:48 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2157454187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T11:35:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:48 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2157454187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T11:35:48.730 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T11:35:48.731 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T11:35:48.975 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:49.372 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:49 smithi118 ceph-mon[28757]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.373+0000 7fdf0923c640 1 -- 172.21.15.118:0/3011387345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 msgr2=0x7fdf04100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.373+0000 7fdf0923c640 1 --2- 172.21.15.118:0/3011387345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 0x7fdf04100a90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009880 tx=0x7fdefc02a490 comp rx=0 tx=0).stop 2024-09-21T11:35:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.373+0000 7fdf0923c640 1 -- 172.21.15.118:0/3011387345 shutdown_connections 2024-09-21T11:35:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.373+0000 7fdf0923c640 1 --2- 172.21.15.118:0/3011387345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf04101060 0x7fdf0410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.373+0000 7fdf0923c640 1 --2- 172.21.15.118:0/3011387345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 0x7fdf04100a90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.373+0000 7fdf0923c640 1 -- 172.21.15.118:0/3011387345 >> 172.21.15.118:0/3011387345 conn(0x7fdf040fc4c0 msgr2=0x7fdf040fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.373+0000 7fdf0923c640 1 -- 172.21.15.118:0/3011387345 shutdown_connections 2024-09-21T11:35:49.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.373+0000 7fdf0923c640 1 -- 172.21.15.118:0/3011387345 wait complete. 2024-09-21T11:35:49.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.374+0000 7fdf0923c640 1 Processor -- start 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.374+0000 7fdf0923c640 1 -- start start 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf0923c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 0x7fdf0419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf0923c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf04101060 0x7fdf0419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf0923c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04110f90 con 0x7fdf041006b0 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf0923c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04110e10 con 0x7fdf04101060 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf02d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 0x7fdf0419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf02d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 0x7fdf0419f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47426/0 (socket says 172.21.15.118:47426) 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf02d9d640 1 -- 172.21.15.118:0/3878258227 learned_addr learned my addr 172.21.15.118:0/3878258227 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf0259c640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf04101060 0x7fdf0419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:49.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf02d9d640 1 -- 172.21.15.118:0/3878258227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf04101060 msgr2=0x7fdf0419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:49.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf02d9d640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf04101060 0x7fdf0419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:49.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf02d9d640 1 -- 172.21.15.118:0/3878258227 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf04199a20 con 0x7fdf041006b0 2024-09-21T11:35:49.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf02d9d640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 0x7fdf0419f860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdefc031460 tx=0x7fdefc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:49.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdefbfff640 1 -- 172.21.15.118:0/3878258227 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdefc03f070 con 0x7fdf041006b0 2024-09-21T11:35:49.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdefbfff640 1 -- 172.21.15.118:0/3878258227 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdefc0035f0 con 0x7fdf041006b0 2024-09-21T11:35:49.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf04199cb0 con 0x7fdf041006b0 2024-09-21T11:35:49.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdefbfff640 1 -- 172.21.15.118:0/3878258227 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdefc035030 con 0x7fdf041006b0 2024-09-21T11:35:49.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.375+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0419a240 con 0x7fdf041006b0 2024-09-21T11:35:49.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.376+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf0406a390 con 0x7fdf041006b0 2024-09-21T11:35:49.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.377+0000 7fdefbfff640 1 -- 172.21.15.118:0/3878258227 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fdefc042070 con 0x7fdf041006b0 2024-09-21T11:35:49.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.377+0000 7fdefbfff640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdef006e310 0x7fdef00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:49.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.377+0000 7fdefbfff640 1 -- 172.21.15.118:0/3878258227 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fdefc0ae6e0 con 0x7fdf041006b0 2024-09-21T11:35:49.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.378+0000 7fdf0259c640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdef006e310 0x7fdef00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:49.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.378+0000 7fdf0259c640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdef006e310 0x7fdef00707d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf040fef00 tx=0x7fdeec005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:49.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.382+0000 7fdefbfff640 1 -- 172.21.15.118:0/3878258227 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdefc07c400 con 0x7fdf041006b0 2024-09-21T11:35:49.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:49 smithi149 ceph-mon[36123]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:49.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.550+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf0410b400 con 0x7fdf041006b0 2024-09-21T11:35:49.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.550+0000 7fdefbfff640 1 -- 172.21.15.118:0/3878258227 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11444 (secure 0 0 0) 0x7fdefc0800b0 con 0x7fdf041006b0 2024-09-21T11:35:49.554 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:35:49.554 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":39,"fsid":"ae037950-780c-11ef-baf6-efdc52797490","created":"2024-09-21T11:29:33.756830+0000","modified":"2024-09-21T11:35:36.805914+0000","last_up_change":"2024-09-21T11:35:35.592786+0000","last_in_change":"2024-09-21T11:35:11.292902+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T11:34:18.773747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"99a80214-8ca7-4b8f-a04e-c3b15aa49219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6803","nonce":2716746021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6805","nonce":2716746021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6809","nonce":2716746021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2716746021},{"type":"v1","addr":"172.21.15.118:6807","nonce":2716746021}]},"public_addr":"172.21.15.118:6803/2716746021","cluster_addr":"172.21.15.118:6805/2716746021","heartbeat_back_addr":"172.21.15.118:6809/2716746021","heartbeat_front_addr":"172.21.15.118:6807/2716746021","state":["exists","up"]},{"osd":1,"uuid":"68e49e0e-fa7a-455c-8c4a-6446669e012d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6811","nonce":798289254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6813","nonce":798289254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6817","nonce":798289254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":798289254},{"type":"v1","addr":"172.21.15.118:6815","nonce":798289254}]},"public_addr":"172.21.15.118:6811/798289254","cluster_addr":"172.21.15.118:6813/798289254","heartbeat_back_addr":"172.21.15.118:6817/798289254","heartbeat_front_addr":"172.21.15.118:6815/798289254","state":["exists","up"]},{"osd":2,"uuid":"01488d66-e964-4ae3-b00c-98f99ce1d7c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6819","nonce":4288623999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6821","nonce":4288623999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6825","nonce":4288623999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4288623999},{"type":"v1","addr":"172.21.15.118:6823","nonce":4288623999}]},"public_addr":"172.21.15.118:6819/4288623999","cluster_addr":"172.21.15.118:6821/4288623999","heartbeat_back_addr":"172.21.15.118:6825/4288623999","heartbeat_front_addr":"172.21.15.118:6823/4288623999","state":["exists","up"]},{"osd":3,"uuid":"f33f5adc-ef11-4165-a7e2-15917a76b0ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6801","nonce":3817247056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6803","nonce":3817247056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6807","nonce":3817247056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3817247056},{"type":"v1","addr":"172.21.15.149:6805","nonce":3817247056}]},"public_addr":"172.21.15.149:6801/3817247056","cluster_addr":"172.21.15.149:6803/3817247056","heartbeat_back_addr":"172.21.15.149:6807/3817247056","heartbeat_front_addr":"172.21.15.149:6805/3817247056","state":["exists","up"]},{"osd":4,"uuid":"9e791ff3-6070-41cc-b7ab-542698f77638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6809","nonce":1437394417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6811","nonce":1437394417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6815","nonce":1437394417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1437394417},{"type":"v1","addr":"172.21.15.149:6813","nonce":1437394417}]},"public_addr":"172.21.15.149:6809/1437394417","cluster_addr":"172.21.15.149:6811/1437394417","heartbeat_back_addr":"172.21.15.149:6815/1437394417","heartbeat_front_addr":"172.21.15.149:6813/1437394417","state":["exists","up"]},{"osd":5,"uuid":"c7be3412-785f-467d-8fa5-9336d472bbdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6817","nonce":1365805680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6819","nonce":1365805680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6823","nonce":1365805680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1365805680},{"type":"v1","addr":"172.21.15.149:6821","nonce":1365805680}]},"public_addr":"172.21.15.149:6817/1365805680","cluster_addr":"172.21.15.149:6819/1365805680","heartbeat_back_addr":"172.21.15.149:6823/1365805680","heartbeat_front_addr":"172.21.15.149:6821/1365805680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:33:16.871760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:33:46.660243+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:34:14.931968+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:34:39.337766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:35:06.342117+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T11:35:33.087911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:0/1228637555":"2024-09-22T11:31:38.466642+0000","172.21.15.118:6801/1466313795":"2024-09-22T11:30:09.037549+0000","172.21.15.118:0/1054797697":"2024-09-22T11:30:39.263894+0000","172.21.15.118:0/569646691":"2024-09-22T11:30:09.037549+0000","172.21.15.118:0/3259731444":"2024-09-22T11:30:09.037549+0000","172.21.15.118:0/2459604279":"2024-09-22T11:31:38.466642+0000","172.21.15.118:0/870566679":"2024-09-22T11:30:39.263894+0000","172.21.15.118:0/2783214462":"2024-09-22T11:30:09.037549+0000","172.21.15.118:6800/2509956308":"2024-09-22T11:30:39.263894+0000","172.21.15.118:0/2091506307":"2024-09-22T11:31:38.466642+0000","172.21.15.118:0/2193247089":"2024-09-22T11:30:39.263894+0000","172.21.15.118:6800/1466313795":"2024-09-22T11:30:09.037549+0000","172.21.15.118:6801/2509956308":"2024-09-22T11:30:39.263894+0000","172.21.15.118:6800/821568869":"2024-09-22T11:31:38.466642+0000","172.21.15.118:6801/821568869":"2024-09-22T11:31:38.466642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T11:35:49.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.552+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdef006e310 msgr2=0x7fdef00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:49.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.552+0000 7fdf0923c640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdef006e310 0x7fdef00707d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf040fef00 tx=0x7fdeec005f90 comp rx=0 tx=0).stop 2024-09-21T11:35:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.552+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 msgr2=0x7fdf0419f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.552+0000 7fdf0923c640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 0x7fdf0419f860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdefc031460 tx=0x7fdefc004530 comp rx=0 tx=0).stop 2024-09-21T11:35:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.553+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 shutdown_connections 2024-09-21T11:35:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.553+0000 7fdf0923c640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdef006e310 0x7fdef00707d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.553+0000 7fdf0923c640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf04101060 0x7fdf0419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.553+0000 7fdf0923c640 1 --2- 172.21.15.118:0/3878258227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf041006b0 0x7fdf0419f860 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.553+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 >> 172.21.15.118:0/3878258227 conn(0x7fdf040fc4c0 msgr2=0x7fdf040fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.553+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 shutdown_connections 2024-09-21T11:35:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:49.553+0000 7fdf0923c640 1 -- 172.21.15.118:0/3878258227 wait complete. 2024-09-21T11:35:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:50 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3878258227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T11:35:50.560 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:50 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3878258227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T11:35:50.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T11:35:50.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T11:35:50.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T11:35:50.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T11:35:50.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T11:35:50.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T11:35:50.933 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:50.936 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:51 smithi118 ceph-mon[28757]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:51.327 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:51.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:51 smithi149 ceph-mon[36123]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.164+0000 7f0af058e640 1 -- 172.21.15.118:0/230777755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 msgr2=0x7f0ae8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.164+0000 7f0af058e640 1 --2- 172.21.15.118:0/230777755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 0x7f0ae8101d70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009880 tx=0x7f0ad802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.164+0000 7f0af058e640 1 -- 172.21.15.118:0/230777755 shutdown_connections 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.164+0000 7f0af058e640 1 --2- 172.21.15.118:0/230777755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 0x7f0ae8101d70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.164+0000 7f0af058e640 1 --2- 172.21.15.118:0/230777755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8107910 0x7f0ae8107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.164+0000 7f0af058e640 1 -- 172.21.15.118:0/230777755 >> 172.21.15.118:0/230777755 conn(0x7f0ae80fd630 msgr2=0x7f0ae80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.164+0000 7f0af058e640 1 -- 172.21.15.118:0/230777755 shutdown_connections 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.164+0000 7f0af058e640 1 -- 172.21.15.118:0/230777755 wait complete. 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0af058e640 1 Processor -- start 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0af058e640 1 -- start start 2024-09-21T11:35:52.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0af058e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 0x7f0ae819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0af058e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8107910 0x7f0ae819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0af058e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae810ee40 con 0x7f0ae8101910 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0af058e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae810ecc0 con 0x7f0ae8107910 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0aee32a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 0x7f0ae819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0aee32a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 0x7f0ae819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47444/0 (socket says 172.21.15.118:47444) 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0aee32a640 1 -- 172.21.15.118:0/261506693 learned_addr learned my addr 172.21.15.118:0/261506693 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0aedb29640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8107910 0x7f0ae819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0aee32a640 1 -- 172.21.15.118:0/261506693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8107910 msgr2=0x7f0ae819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0aee32a640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8107910 0x7f0ae819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0aee32a640 1 -- 172.21.15.118:0/261506693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae8197850 con 0x7f0ae8101910 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.165+0000 7f0aedb29640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8107910 0x7f0ae819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:35:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.166+0000 7f0aee32a640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 0x7f0ae819d6d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400b420 tx=0x7f0ae400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.166+0000 7f0adf7fe640 1 -- 172.21.15.118:0/261506693 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ae4011630 con 0x7f0ae8101910 2024-09-21T11:35:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.166+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae8197b40 con 0x7f0ae8101910 2024-09-21T11:35:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.166+0000 7f0adf7fe640 1 -- 172.21.15.118:0/261506693 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ae4016070 con 0x7f0ae8101910 2024-09-21T11:35:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.166+0000 7f0adf7fe640 1 -- 172.21.15.118:0/261506693 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ae4010d40 con 0x7f0ae8101910 2024-09-21T11:35:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.166+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae81980a0 con 0x7f0ae8101910 2024-09-21T11:35:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.167+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ae81986c0 con 0x7f0ae8101910 2024-09-21T11:35:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.167+0000 7f0adf7fe640 1 -- 172.21.15.118:0/261506693 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f0ae401b460 con 0x7f0ae8101910 2024-09-21T11:35:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.168+0000 7f0adf7fe640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0ad406e2b0 0x7f0ad4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.168+0000 7f0adf7fe640 1 -- 172.21.15.118:0/261506693 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f0ae408d690 con 0x7f0ae8101910 2024-09-21T11:35:52.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.168+0000 7f0aedb29640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0ad406e2b0 0x7f0ad4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:52.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.168+0000 7f0adf7fe640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] conn(0x7f0ad40740a0 0x7f0ad40764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:52.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.168+0000 7f0adf7fe640 1 -- 172.21.15.118:0/261506693 --> [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ad4076b70 con 0x7f0ad40740a0 2024-09-21T11:35:52.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.168+0000 7f0adf7fe640 1 -- 172.21.15.118:0/261506693 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0ae4094050 con 0x7f0ae8101910 2024-09-21T11:35:52.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.168+0000 7f0aeeb2b640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] conn(0x7f0ad40740a0 0x7f0ad40764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:52.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.168+0000 7f0aedb29640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0ad406e2b0 0x7f0ad4070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8198ba0 tx=0x7f0ad8031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:52.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.168+0000 7f0aeeb2b640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] conn(0x7f0ad40740a0 0x7f0ad40764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:52.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.169+0000 7f0adf7fe640 1 -- 172.21.15.118:0/261506693 <== osd.2 v2:172.21.15.118:6818/4288623999 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ad4076b70 con 0x7f0ad40740a0 2024-09-21T11:35:52.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.182+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 --> [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ae8062880 con 0x7f0ad40740a0 2024-09-21T11:35:52.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0adf7fe640 1 -- 172.21.15.118:0/261506693 <== osd.2 v2:172.21.15.118:6818/4288623999 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ae8062880 con 0x7f0ad40740a0 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] conn(0x7f0ad40740a0 msgr2=0x7f0ad40764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] conn(0x7f0ad40740a0 0x7f0ad40764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0ad406e2b0 msgr2=0x7f0ad4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0ad406e2b0 0x7f0ad4070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8198ba0 tx=0x7f0ad8031400 comp rx=0 tx=0).stop 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 msgr2=0x7f0ae819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 0x7f0ae819d6d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400b420 tx=0x7f0ae400b8e0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 shutdown_connections 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6818/4288623999,v1:172.21.15.118:6819/4288623999] conn(0x7f0ad40740a0 0x7f0ad40764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0ad406e2b0 0x7f0ad4070770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ae8107910 0x7f0ae819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 --2- 172.21.15.118:0/261506693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ae8101910 0x7f0ae819d6d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 >> 172.21.15.118:0/261506693 conn(0x7f0ae80fd630 msgr2=0x7f0ae80fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 shutdown_connections 2024-09-21T11:35:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.183+0000 7f0af058e640 1 -- 172.21.15.118:0/261506693 wait complete. 2024-09-21T11:35:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.776+0000 7fb728021640 1 -- 172.21.15.118:0/3005630995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720106820 msgr2=0x7fb720106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.776+0000 7fb728021640 1 --2- 172.21.15.118:0/3005630995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720106820 0x7fb720106c00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009880 tx=0x7fb71c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.776+0000 7fb728021640 1 -- 172.21.15.118:0/3005630995 shutdown_connections 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.776+0000 7fb728021640 1 --2- 172.21.15.118:0/3005630995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb720100820 0x7fb720100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.776+0000 7fb728021640 1 --2- 172.21.15.118:0/3005630995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720106820 0x7fb720106c00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.776+0000 7fb728021640 1 -- 172.21.15.118:0/3005630995 >> 172.21.15.118:0/3005630995 conn(0x7fb7200fc520 msgr2=0x7fb7200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.776+0000 7fb728021640 1 -- 172.21.15.118:0/3005630995 shutdown_connections 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.776+0000 7fb728021640 1 -- 172.21.15.118:0/3005630995 wait complete. 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb728021640 1 Processor -- start 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb728021640 1 -- start start 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb728021640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720100820 0x7fb720198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:52.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb728021640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb720106820 0x7fb720198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb728021640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb72010dcd0 con 0x7fb720100820 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb728021640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb72010db50 con 0x7fb720106820 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb725dbd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720100820 0x7fb720198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb725dbd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720100820 0x7fb720198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47460/0 (socket says 172.21.15.118:47460) 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb725dbd640 1 -- 172.21.15.118:0/267680169 learned_addr learned my addr 172.21.15.118:0/267680169 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb7255bc640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb720106820 0x7fb720198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb725dbd640 1 -- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb720106820 msgr2=0x7fb720198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb725dbd640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb720106820 0x7fb720198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.777+0000 7fb725dbd640 1 -- 172.21.15.118:0/267680169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb720199370 con 0x7fb720100820 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.778+0000 7fb725dbd640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720100820 0x7fb720198830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb71c031460 tx=0x7fb71c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.778+0000 7fb716ffd640 1 -- 172.21.15.118:0/267680169 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb71c03f070 con 0x7fb720100820 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.778+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb720199600 con 0x7fb720100820 2024-09-21T11:35:52.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.778+0000 7fb716ffd640 1 -- 172.21.15.118:0/267680169 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb71c0035f0 con 0x7fb720100820 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.778+0000 7fb716ffd640 1 -- 172.21.15.118:0/267680169 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb71c035030 con 0x7fb720100820 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.778+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7201a1bb0 con 0x7fb720100820 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.779+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7200628c0 con 0x7fb720100820 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.779+0000 7fb716ffd640 1 -- 172.21.15.118:0/267680169 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fb71c042070 con 0x7fb720100820 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.780+0000 7fb716ffd640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb70c06e2b0 0x7fb70c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.780+0000 7fb7255bc640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb70c06e2b0 0x7fb70c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.780+0000 7fb716ffd640 1 -- 172.21.15.118:0/267680169 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fb71c0ae740 con 0x7fb720100820 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.780+0000 7fb716ffd640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] conn(0x7fb70c0740a0 0x7fb70c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.780+0000 7fb716ffd640 1 -- 172.21.15.118:0/267680169 --> [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb71c0054e0 con 0x7fb70c0740a0 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.780+0000 7fb716ffd640 1 -- 172.21.15.118:0/267680169 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb71c0b32a0 con 0x7fb720100820 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.780+0000 7fb7265be640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] conn(0x7fb70c0740a0 0x7fb70c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.780+0000 7fb7255bc640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb70c06e2b0 0x7fb70c070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb72006ae50 tx=0x7fb71000b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.780+0000 7fb7265be640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] conn(0x7fb70c0740a0 0x7fb70c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.781+0000 7fb716ffd640 1 -- 172.21.15.118:0/267680169 <== osd.5 v2:172.21.15.149:6816/1365805680 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb71c0054e0 con 0x7fb70c0740a0 2024-09-21T11:35:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.799+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 --> [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb720062cc0 con 0x7fb70c0740a0 2024-09-21T11:35:52.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb716ffd640 1 -- 172.21.15.118:0/267680169 <== osd.5 v2:172.21.15.149:6816/1365805680 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb720062cc0 con 0x7fb70c0740a0 2024-09-21T11:35:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] conn(0x7fb70c0740a0 msgr2=0x7fb70c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] conn(0x7fb70c0740a0 0x7fb70c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb70c06e2b0 msgr2=0x7fb70c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb70c06e2b0 0x7fb70c070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb72006ae50 tx=0x7fb71000b390 comp rx=0 tx=0).stop 2024-09-21T11:35:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720100820 msgr2=0x7fb720198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720100820 0x7fb720198830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb71c031460 tx=0x7fb71c0045e0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 shutdown_connections 2024-09-21T11:35:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb70c06e2b0 0x7fb70c070770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb720106820 0x7fb720198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.149:6816/1365805680,v1:172.21.15.149:6817/1365805680] conn(0x7fb70c0740a0 0x7fb70c0764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 --2- 172.21.15.118:0/267680169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb720100820 0x7fb720198830 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 >> 172.21.15.118:0/267680169 conn(0x7fb7200fc520 msgr2=0x7fb7200fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.800+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 shutdown_connections 2024-09-21T11:35:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:52.801+0000 7fb728021640 1 -- 172.21.15.118:0/267680169 wait complete. 2024-09-21T11:35:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:53.538 INFO:teuthology.orchestra.run.smithi118.stdout:163208757255 2024-09-21T11:35:53.538 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T11:35:53.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.715+0000 7fc1a29f4640 1 -- 172.21.15.118:0/1819086943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 msgr2=0x7fc19c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:53.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.715+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/1819086943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 0x7fc19c107d10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009880 tx=0x7fc18c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.716+0000 7fc1a29f4640 1 -- 172.21.15.118:0/1819086943 shutdown_connections 2024-09-21T11:35:53.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.716+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/1819086943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc19c101930 0x7fc19c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.716+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/1819086943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 0x7fc19c107d10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.716+0000 7fc1a29f4640 1 -- 172.21.15.118:0/1819086943 >> 172.21.15.118:0/1819086943 conn(0x7fc19c0fd630 msgr2=0x7fc19c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:53.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.716+0000 7fc1a29f4640 1 -- 172.21.15.118:0/1819086943 shutdown_connections 2024-09-21T11:35:53.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.716+0000 7fc1a29f4640 1 -- 172.21.15.118:0/1819086943 wait complete. 2024-09-21T11:35:53.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.716+0000 7fc1a29f4640 1 Processor -- start 2024-09-21T11:35:53.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.716+0000 7fc1a29f4640 1 -- start start 2024-09-21T11:35:53.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc1a29f4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc19c101930 0x7fc19c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:53.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc1a29f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 0x7fc19c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:53.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc1a29f4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c10ede0 con 0x7fc19c107930 2024-09-21T11:35:53.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc1a29f4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c10ec60 con 0x7fc19c101930 2024-09-21T11:35:53.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc19b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 0x7fc19c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:53.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc19b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 0x7fc19c19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47472/0 (socket says 172.21.15.118:47472) 2024-09-21T11:35:53.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc19b7fe640 1 -- 172.21.15.118:0/236738215 learned_addr learned my addr 172.21.15.118:0/236738215 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:53.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc19bfff640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc19c101930 0x7fc19c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:53.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc19b7fe640 1 -- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc19c101930 msgr2=0x7fc19c19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:53.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc19b7fe640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc19c101930 0x7fc19c19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc19b7fe640 1 -- 172.21.15.118:0/236738215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c1977d0 con 0x7fc19c107930 2024-09-21T11:35:53.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.717+0000 7fc19b7fe640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 0x7fc19c19db90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c810 tx=0x7fc19000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:53.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.718+0000 7fc1997fa640 1 -- 172.21.15.118:0/236738215 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc190004020 con 0x7fc19c107930 2024-09-21T11:35:53.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.718+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c197ac0 con 0x7fc19c107930 2024-09-21T11:35:53.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.718+0000 7fc1997fa640 1 -- 172.21.15.118:0/236738215 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1900041c0 con 0x7fc19c107930 2024-09-21T11:35:53.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.718+0000 7fc1997fa640 1 -- 172.21.15.118:0/236738215 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1900047a0 con 0x7fc19c107930 2024-09-21T11:35:53.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.718+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c198050 con 0x7fc19c107930 2024-09-21T11:35:53.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.719+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc19c198670 con 0x7fc19c107930 2024-09-21T11:35:53.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.719+0000 7fc1997fa640 1 -- 172.21.15.118:0/236738215 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fc1900079b0 con 0x7fc19c107930 2024-09-21T11:35:53.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.720+0000 7fc1997fa640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fc18406e2b0 0x7fc184070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:53.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.720+0000 7fc1997fa640 1 -- 172.21.15.118:0/236738215 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc19008dd10 con 0x7fc19c107930 2024-09-21T11:35:53.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.720+0000 7fc19bfff640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fc18406e2b0 0x7fc184070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:53.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.720+0000 7fc1997fa640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] conn(0x7fc1840740a0 0x7fc1840764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:53.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.720+0000 7fc1997fa640 1 -- 172.21.15.118:0/236738215 --> [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc19000de50 con 0x7fc1840740a0 2024-09-21T11:35:53.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.720+0000 7fc1997fa640 1 -- 172.21.15.118:0/236738215 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc190093430 con 0x7fc19c107930 2024-09-21T11:35:53.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.720+0000 7fc1a0f91640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] conn(0x7fc1840740a0 0x7fc1840764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:53.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.721+0000 7fc19bfff640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fc18406e2b0 0x7fc184070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc18c031460 tx=0x7fc18c005bd0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:53.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.721+0000 7fc1a0f91640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] conn(0x7fc1840740a0 0x7fc1840764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:53.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.722+0000 7fc1997fa640 1 -- 172.21.15.118:0/236738215 <== osd.4 v2:172.21.15.149:6808/1437394417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc19000de50 con 0x7fc1840740a0 2024-09-21T11:35:53.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.737+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 --> [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc19c062900 con 0x7fc1840740a0 2024-09-21T11:35:53.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.737+0000 7fc1997fa640 1 -- 172.21.15.118:0/236738215 <== osd.4 v2:172.21.15.149:6808/1437394417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc19c062900 con 0x7fc1840740a0 2024-09-21T11:35:53.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] conn(0x7fc1840740a0 msgr2=0x7fc1840764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:53.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] conn(0x7fc1840740a0 0x7fc1840764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fc18406e2b0 msgr2=0x7fc184070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:53.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fc18406e2b0 0x7fc184070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc18c031460 tx=0x7fc18c005bd0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 msgr2=0x7fc19c19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 0x7fc19c19db90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c810 tx=0x7fc19000ccd0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 shutdown_connections 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fc18406e2b0 0x7fc184070770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:6808/1437394417,v1:172.21.15.149:6809/1437394417] conn(0x7fc1840740a0 0x7fc1840764c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c107930 0x7fc19c19db90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 --2- 172.21.15.118:0/236738215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc19c101930 0x7fc19c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 >> 172.21.15.118:0/236738215 conn(0x7fc19c0fd630 msgr2=0x7fc19c0fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 shutdown_connections 2024-09-21T11:35:53.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:53.738+0000 7fc1a29f4640 1 -- 172.21.15.118:0/236738215 wait complete. 2024-09-21T11:35:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:53 smithi118 ceph-mon[28757]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:35:53.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:53 smithi149 ceph-mon[36123]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:53.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:35:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.487+0000 7f200436a640 1 -- 172.21.15.118:0/229667580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 msgr2=0x7f1ffc10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.487+0000 7f200436a640 1 --2- 172.21.15.118:0/229667580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 0x7f1ffc10b8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009880 tx=0x7f1ff802a530 comp rx=0 tx=0).stop 2024-09-21T11:35:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.487+0000 7f200436a640 1 -- 172.21.15.118:0/229667580 shutdown_connections 2024-09-21T11:35:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.487+0000 7f200436a640 1 --2- 172.21.15.118:0/229667580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 0x7f1ffc10b8f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.487+0000 7f200436a640 1 --2- 172.21.15.118:0/229667580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ffc102ae0 0x7f1ffc102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.487+0000 7f200436a640 1 -- 172.21.15.118:0/229667580 >> 172.21.15.118:0/229667580 conn(0x7f1ffc0fc520 msgr2=0x7f1ffc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.487+0000 7f200436a640 1 -- 172.21.15.118:0/229667580 shutdown_connections 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.487+0000 7f200436a640 1 -- 172.21.15.118:0/229667580 wait complete. 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f200436a640 1 Processor -- start 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f200436a640 1 -- start start 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f200436a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ffc102ae0 0x7f1ffc19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f200436a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 0x7f1ffc19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f200436a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc10ee70 con 0x7f1ffc103400 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f200436a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc10ecf0 con 0x7f1ffc102ae0 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f2001905640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 0x7f1ffc19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f2001905640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 0x7f1ffc19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47498/0 (socket says 172.21.15.118:47498) 2024-09-21T11:35:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f2001905640 1 -- 172.21.15.118:0/488768033 learned_addr learned my addr 172.21.15.118:0/488768033 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f2002106640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ffc102ae0 0x7f1ffc19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f2001905640 1 -- 172.21.15.118:0/488768033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ffc102ae0 msgr2=0x7f1ffc19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f2001905640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ffc102ae0 0x7f1ffc19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f2001905640 1 -- 172.21.15.118:0/488768033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ffc197880 con 0x7f1ffc103400 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.488+0000 7f2002106640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ffc102ae0 0x7f1ffc19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.489+0000 7f2001905640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 0x7f1ffc19dc00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8031460 tx=0x7f1ff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.489+0000 7f1ff37fe640 1 -- 172.21.15.118:0/488768033 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ff803f070 con 0x7f1ffc103400 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.489+0000 7f1ff37fe640 1 -- 172.21.15.118:0/488768033 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ff8004ac0 con 0x7f1ffc103400 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.489+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ffc197b10 con 0x7f1ffc103400 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.489+0000 7f1ff37fe640 1 -- 172.21.15.118:0/488768033 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ff8035030 con 0x7f1ffc103400 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.489+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ffc198040 con 0x7f1ffc103400 2024-09-21T11:35:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.490+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ffc198600 con 0x7f1ffc103400 2024-09-21T11:35:54.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.490+0000 7f1ff37fe640 1 -- 172.21.15.118:0/488768033 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f1ff8042070 con 0x7f1ffc103400 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.491+0000 7f1ff37fe640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1fe806e310 0x7f1fe80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.491+0000 7f2002106640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1fe806e310 0x7f1fe80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.491+0000 7f1ff37fe640 1 -- 172.21.15.118:0/488768033 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1ff80aee40 con 0x7f1ffc103400 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.491+0000 7f1ff37fe640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] conn(0x7f1fe8074100 0x7f1fe8076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.491+0000 7f1ff37fe640 1 -- 172.21.15.118:0/488768033 --> [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ff804de50 con 0x7f1fe8074100 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.491+0000 7f1ff37fe640 1 -- 172.21.15.118:0/488768033 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1ff80af2e0 con 0x7f1ffc103400 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.491+0000 7f2002907640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] conn(0x7f1fe8074100 0x7f1fe8076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.491+0000 7f2002106640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1fe806e310 0x7f1fe80707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1fec006fd0 tx=0x7f1fec008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.491+0000 7f2002907640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] conn(0x7f1fe8074100 0x7f1fe8076520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.492+0000 7f1ff37fe640 1 -- 172.21.15.118:0/488768033 <== osd.1 v2:172.21.15.118:6810/798289254 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1ff804de50 con 0x7f1fe8074100 2024-09-21T11:35:54.500 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:54.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.507+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 --> [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ffc062880 con 0x7f1fe8074100 2024-09-21T11:35:54.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.507+0000 7f1ff37fe640 1 -- 172.21.15.118:0/488768033 <== osd.1 v2:172.21.15.118:6810/798289254 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1ffc062880 con 0x7f1fe8074100 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] conn(0x7f1fe8074100 msgr2=0x7f1fe8076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] conn(0x7f1fe8074100 0x7f1fe8076520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1fe806e310 msgr2=0x7f1fe80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1fe806e310 0x7f1fe80707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1fec006fd0 tx=0x7f1fec008040 comp rx=0 tx=0).stop 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 msgr2=0x7f1ffc19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 0x7f1ffc19dc00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8031460 tx=0x7f1ff80046c0 comp rx=0 tx=0).stop 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 shutdown_connections 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6810/798289254,v1:172.21.15.118:6811/798289254] conn(0x7f1fe8074100 0x7f1fe8076520 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1fe806e310 0x7f1fe80707d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ffc103400 0x7f1ffc19dc00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:54.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 --2- 172.21.15.118:0/488768033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ffc102ae0 0x7f1ffc19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:54.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 >> 172.21.15.118:0/488768033 conn(0x7f1ffc0fc520 msgr2=0x7f1ffc108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:54.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 shutdown_connections 2024-09-21T11:35:54.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:54.508+0000 7f200436a640 1 -- 172.21.15.118:0/488768033 wait complete. 2024-09-21T11:35:54.837 INFO:teuthology.orchestra.run.smithi118.stdout:81604378645 2024-09-21T11:35:54.837 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T11:35:55.760 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:55 smithi118 ceph-mon[28757]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:55.795 INFO:teuthology.orchestra.run.smithi118.stdout:141733920780 2024-09-21T11:35:55.795 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T11:35:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:55 smithi149 ceph-mon[36123]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:56.237 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:56.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.237+0000 7f640f88a640 1 -- 172.21.15.118:0/2544560740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 msgr2=0x7f6408100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.237+0000 7f640f88a640 1 --2- 172.21.15.118:0/2544560740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 0x7f6408100180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009880 tx=0x7f63f802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.237+0000 7f640f88a640 1 -- 172.21.15.118:0/2544560740 shutdown_connections 2024-09-21T11:35:56.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.237+0000 7f640f88a640 1 --2- 172.21.15.118:0/2544560740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 0x7f6408100180 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.237+0000 7f640f88a640 1 --2- 172.21.15.118:0/2544560740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6408106900 0x7f6408106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.237+0000 7f640f88a640 1 -- 172.21.15.118:0/2544560740 >> 172.21.15.118:0/2544560740 conn(0x7f64080fbc10 msgr2=0x7f64080fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:56.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.237+0000 7f640f88a640 1 -- 172.21.15.118:0/2544560740 shutdown_connections 2024-09-21T11:35:56.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.237+0000 7f640f88a640 1 -- 172.21.15.118:0/2544560740 wait complete. 2024-09-21T11:35:56.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.238+0000 7f640f88a640 1 Processor -- start 2024-09-21T11:35:56.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.238+0000 7f640f88a640 1 -- start start 2024-09-21T11:35:56.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.238+0000 7f640f88a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 0x7f640819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:56.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.238+0000 7f640f88a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6408106900 0x7f640819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:56.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640f88a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f640810ee80 con 0x7f64080ffd20 2024-09-21T11:35:56.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640f88a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f640810ed00 con 0x7f6408106900 2024-09-21T11:35:56.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640d626640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 0x7f640819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:56.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640d626640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 0x7f640819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60478/0 (socket says 172.21.15.118:60478) 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640d626640 1 -- 172.21.15.118:0/1032668255 learned_addr learned my addr 172.21.15.118:0/1032668255 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640ce25640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6408106900 0x7f640819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640d626640 1 -- 172.21.15.118:0/1032668255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6408106900 msgr2=0x7f640819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640d626640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6408106900 0x7f640819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640d626640 1 -- 172.21.15.118:0/1032668255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6408197890 con 0x7f64080ffd20 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.239+0000 7f640d626640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 0x7f640819d6d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f640400c810 tx=0x7f640400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.240+0000 7f63fe7fc640 1 -- 172.21.15.118:0/1032668255 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6404004020 con 0x7f64080ffd20 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.240+0000 7f63fe7fc640 1 -- 172.21.15.118:0/1032668255 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64040041c0 con 0x7f64080ffd20 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.240+0000 7f63fe7fc640 1 -- 172.21.15.118:0/1032668255 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64040047a0 con 0x7f64080ffd20 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.240+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6408197b80 con 0x7f64080ffd20 2024-09-21T11:35:56.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.240+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64081980e0 con 0x7f64080ffd20 2024-09-21T11:35:56.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.241+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6408198640 con 0x7f64080ffd20 2024-09-21T11:35:56.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.242+0000 7f63fe7fc640 1 -- 172.21.15.118:0/1032668255 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f64040079b0 con 0x7f64080ffd20 2024-09-21T11:35:56.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.242+0000 7f63fe7fc640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f63f406e310 0x7f63f40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:56.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.243+0000 7f63fe7fc640 1 -- 172.21.15.118:0/1032668255 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f640408dfa0 con 0x7f64080ffd20 2024-09-21T11:35:56.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.243+0000 7f640ce25640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f63f406e310 0x7f63f40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:56.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.243+0000 7f63fe7fc640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] conn(0x7f63f4074100 0x7f63f4076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:56.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.243+0000 7f63fe7fc640 1 -- 172.21.15.118:0/1032668255 --> [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6404012ec0 con 0x7f63f4074100 2024-09-21T11:35:56.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.243+0000 7f63fe7fc640 1 -- 172.21.15.118:0/1032668255 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f640408e460 con 0x7f64080ffd20 2024-09-21T11:35:56.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.243+0000 7f640de27640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] conn(0x7f63f4074100 0x7f63f4076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:56.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.243+0000 7f640ce25640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f63f406e310 0x7f63f40707d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6408199080 tx=0x7f63f8031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:56.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.244+0000 7f640de27640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] conn(0x7f63f4074100 0x7f63f4076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:56.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.245+0000 7f63fe7fc640 1 -- 172.21.15.118:0/1032668255 <== osd.0 v2:172.21.15.118:6802/2716746021 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6404012ec0 con 0x7f63f4074100 2024-09-21T11:35:56.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.271+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 --> [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64080628b0 con 0x7f63f4074100 2024-09-21T11:35:56.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.272+0000 7f63fe7fc640 1 -- 172.21.15.118:0/1032668255 <== osd.0 v2:172.21.15.118:6802/2716746021 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f64080628b0 con 0x7f63f4074100 2024-09-21T11:35:56.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.272+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] conn(0x7f63f4074100 msgr2=0x7f63f4076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.272+0000 7f640f88a640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] conn(0x7f63f4074100 0x7f63f4076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.272+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f63f406e310 msgr2=0x7f63f40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.272+0000 7f640f88a640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f63f406e310 0x7f63f40707d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6408199080 tx=0x7f63f8031400 comp rx=0 tx=0).stop 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.272+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 msgr2=0x7f640819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.272+0000 7f640f88a640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 0x7f640819d6d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f640400c810 tx=0x7f640400ccd0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.273+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 shutdown_connections 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.273+0000 7f640f88a640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6802/2716746021,v1:172.21.15.118:6803/2716746021] conn(0x7f63f4074100 0x7f63f4076520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.273+0000 7f640f88a640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f63f406e310 0x7f63f40707d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.273+0000 7f640f88a640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6408106900 0x7f640819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.273+0000 7f640f88a640 1 --2- 172.21.15.118:0/1032668255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64080ffd20 0x7f640819d6d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.273+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 >> 172.21.15.118:0/1032668255 conn(0x7f64080fbc10 msgr2=0x7f64080fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:56.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.273+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 shutdown_connections 2024-09-21T11:35:56.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.273+0000 7f640f88a640 1 -- 172.21.15.118:0/1032668255 wait complete. 2024-09-21T11:35:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.530+0000 7f993794b640 1 -- 172.21.15.118:0/1718771960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 msgr2=0x7f9930100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.530+0000 7f993794b640 1 --2- 172.21.15.118:0/1718771960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 0x7f9930100c40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9920009880 tx=0x7f992002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.531+0000 7f993794b640 1 -- 172.21.15.118:0/1718771960 shutdown_connections 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.531+0000 7f993794b640 1 --2- 172.21.15.118:0/1718771960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 0x7f9930100c40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.531+0000 7f993794b640 1 --2- 172.21.15.118:0/1718771960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99301067e0 0x7f9930106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.531+0000 7f993794b640 1 -- 172.21.15.118:0/1718771960 >> 172.21.15.118:0/1718771960 conn(0x7f99300fc4c0 msgr2=0x7f99300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.531+0000 7f993794b640 1 -- 172.21.15.118:0/1718771960 shutdown_connections 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.531+0000 7f993794b640 1 -- 172.21.15.118:0/1718771960 wait complete. 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.531+0000 7f993794b640 1 Processor -- start 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f993794b640 1 -- start start 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f993794b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 0x7f99301987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f993794b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99301067e0 0x7f9930198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f993794b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f993010dcb0 con 0x7f99301007e0 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f993794b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f993010db30 con 0x7f99301067e0 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f99356e7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 0x7f99301987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:56.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f99356e7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 0x7f99301987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60492/0 (socket says 172.21.15.118:60492) 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f99356e7640 1 -- 172.21.15.118:0/1166141709 learned_addr learned my addr 172.21.15.118:0/1166141709 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f9934ee6640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99301067e0 0x7f9930198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f99356e7640 1 -- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99301067e0 msgr2=0x7f9930198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f99356e7640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99301067e0 0x7f9930198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f99356e7640 1 -- 172.21.15.118:0/1166141709 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9930199330 con 0x7f99301007e0 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f99356e7640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 0x7f99301987a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f992c00d6f0 tx=0x7f992c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.532+0000 7f99267fc640 1 -- 172.21.15.118:0/1166141709 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f992c017070 con 0x7f99301007e0 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.533+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99301a1810 con 0x7f99301007e0 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.533+0000 7f99267fc640 1 -- 172.21.15.118:0/1166141709 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f992c00de00 con 0x7f99301007e0 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.533+0000 7f99267fc640 1 -- 172.21.15.118:0/1166141709 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f992c004bb0 con 0x7f99301007e0 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.533+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99301a1c10 con 0x7f99301007e0 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.533+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99300628c0 con 0x7f99301007e0 2024-09-21T11:35:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.534+0000 7f99267fc640 1 -- 172.21.15.118:0/1166141709 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f992c004e60 con 0x7f99301007e0 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.534+0000 7f99267fc640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f991c06e2b0 0x7f991c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.535+0000 7f99267fc640 1 -- 172.21.15.118:0/1166141709 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f992c08d970 con 0x7f99301007e0 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.535+0000 7f9934ee6640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f991c06e2b0 0x7f991c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.535+0000 7f99267fc640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] conn(0x7f991c0740a0 0x7f991c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.535+0000 7f99267fc640 1 -- 172.21.15.118:0/1166141709 --> [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f991c076b70 con 0x7f991c0740a0 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.535+0000 7f99267fc640 1 -- 172.21.15.118:0/1166141709 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f992c0922a0 con 0x7f99301007e0 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.535+0000 7f9934ee6640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f991c06e2b0 0x7f991c070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f993006a6c0 tx=0x7f9920031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.535+0000 7f9935ee8640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] conn(0x7f991c0740a0 0x7f991c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.535+0000 7f9935ee8640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] conn(0x7f991c0740a0 0x7f991c0764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.536+0000 7f99267fc640 1 -- 172.21.15.118:0/1166141709 <== osd.3 v2:172.21.15.149:6800/3817247056 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f991c076b70 con 0x7f991c0740a0 2024-09-21T11:35:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.550+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 --> [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9930062d10 con 0x7f991c0740a0 2024-09-21T11:35:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f99267fc640 1 -- 172.21.15.118:0/1166141709 <== osd.3 v2:172.21.15.149:6800/3817247056 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9930062d10 con 0x7f991c0740a0 2024-09-21T11:35:56.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] conn(0x7f991c0740a0 msgr2=0x7f991c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] conn(0x7f991c0740a0 0x7f991c0764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f991c06e2b0 msgr2=0x7f991c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f991c06e2b0 0x7f991c070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f993006a6c0 tx=0x7f9920031400 comp rx=0 tx=0).stop 2024-09-21T11:35:56.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 msgr2=0x7f99301987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:56.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 0x7f99301987a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f992c00d6f0 tx=0x7f992c00dbb0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 shutdown_connections 2024-09-21T11:35:56.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:6800/3817247056,v1:172.21.15.149:6801/3817247056] conn(0x7f991c0740a0 0x7f991c0764c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f991c06e2b0 0x7f991c070770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99301067e0 0x7f9930198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 --2- 172.21.15.118:0/1166141709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99301007e0 0x7f99301987a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:56.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 >> 172.21.15.118:0/1166141709 conn(0x7f99300fc4c0 msgr2=0x7f99300fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:56.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 shutdown_connections 2024-09-21T11:35:56.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:56.551+0000 7f993794b640 1 -- 172.21.15.118:0/1166141709 wait complete. 2024-09-21T11:35:57.223 INFO:teuthology.orchestra.run.smithi118.stdout:107374182418 2024-09-21T11:35:57.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T11:35:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:57 smithi118 ceph-mon[28757]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:57.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:57 smithi149 ceph-mon[36123]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:58.383 INFO:teuthology.orchestra.run.smithi118.stdout:60129542173 2024-09-21T11:35:58.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T11:35:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.554+0000 7fcb90a55640 1 -- 172.21.15.118:0/2155754933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 msgr2=0x7fcb8c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.554+0000 7fcb90a55640 1 --2- 172.21.15.118:0/2155754933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 0x7fcb8c100c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcb80009880 tx=0x7fcb8002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:35:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.555+0000 7fcb90a55640 1 -- 172.21.15.118:0/2155754933 shutdown_connections 2024-09-21T11:35:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.555+0000 7fcb90a55640 1 --2- 172.21.15.118:0/2155754933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 0x7fcb8c100c50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.555+0000 7fcb90a55640 1 --2- 172.21.15.118:0/2155754933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb8c1067f0 0x7fcb8c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.555+0000 7fcb90a55640 1 -- 172.21.15.118:0/2155754933 >> 172.21.15.118:0/2155754933 conn(0x7fcb8c0fc4f0 msgr2=0x7fcb8c0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.555+0000 7fcb90a55640 1 -- 172.21.15.118:0/2155754933 shutdown_connections 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.555+0000 7fcb90a55640 1 -- 172.21.15.118:0/2155754933 wait complete. 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb90a55640 1 Processor -- start 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb90a55640 1 -- start start 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb90a55640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 0x7fcb8c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb90a55640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb8c1067f0 0x7fcb8c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb90a55640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c10dd20 con 0x7fcb8c1007f0 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb90a55640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c10dba0 con 0x7fcb8c1067f0 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb8a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 0x7fcb8c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb8a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 0x7fcb8c198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60506/0 (socket says 172.21.15.118:60506) 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb8a59c640 1 -- 172.21.15.118:0/3030826844 learned_addr learned my addr 172.21.15.118:0/3030826844 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb89d9b640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb8c1067f0 0x7fcb8c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb8a59c640 1 -- 172.21.15.118:0/3030826844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb8c1067f0 msgr2=0x7fcb8c198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb8a59c640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb8c1067f0 0x7fcb8c198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.556+0000 7fcb8a59c640 1 -- 172.21.15.118:0/3030826844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c199390 con 0x7fcb8c1007f0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.557+0000 7fcb8a59c640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 0x7fcb8c198850 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00b420 tx=0x7fcb7c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.557+0000 7fcb7b7fe640 1 -- 172.21.15.118:0/3030826844 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb7c011630 con 0x7fcb8c1007f0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.557+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8c199680 con 0x7fcb8c1007f0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.557+0000 7fcb7b7fe640 1 -- 172.21.15.118:0/3030826844 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb7c016070 con 0x7fcb8c1007f0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.557+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8c1a1c80 con 0x7fcb8c1007f0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.557+0000 7fcb7b7fe640 1 -- 172.21.15.118:0/3030826844 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb7c010d40 con 0x7fcb8c1007f0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.558+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c005290 con 0x7fcb8c1007f0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.558+0000 7fcb7b7fe640 1 -- 172.21.15.118:0/3030826844 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fcb7c01b460 con 0x7fcb8c1007f0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.559+0000 7fcb7b7fe640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcb7406e310 0x7fcb740707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.559+0000 7fcb7b7fe640 1 -- 172.21.15.118:0/3030826844 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fcb7c08d480 con 0x7fcb8c1007f0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.559+0000 7fcb89d9b640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcb7406e310 0x7fcb740707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:35:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.560+0000 7fcb89d9b640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcb7406e310 0x7fcb740707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c06aea0 tx=0x7fcb80031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:35:58.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.564+0000 7fcb7b7fe640 1 -- 172.21.15.118:0/3030826844 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb8c199680 con 0x7fcb8c1007f0 2024-09-21T11:35:58.655 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:58.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.760+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcb6c005580 con 0x7fcb8c1007f0 2024-09-21T11:35:58.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.760+0000 7fcb7b7fe640 1 -- 172.21.15.118:0/3030826844 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcb7c05b1a0 con 0x7fcb8c1007f0 2024-09-21T11:35:58.763 INFO:teuthology.orchestra.run.smithi118.stdout:163208757256 2024-09-21T11:35:58.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.762+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcb7406e310 msgr2=0x7fcb740707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:58.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.762+0000 7fcb90a55640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcb7406e310 0x7fcb740707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c06aea0 tx=0x7fcb80031400 comp rx=0 tx=0).stop 2024-09-21T11:35:58.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.762+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 msgr2=0x7fcb8c198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:35:58.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.762+0000 7fcb90a55640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 0x7fcb8c198850 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00b420 tx=0x7fcb7c00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:35:58.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.762+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 shutdown_connections 2024-09-21T11:35:58.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.762+0000 7fcb90a55640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcb7406e310 0x7fcb740707d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:58.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.762+0000 7fcb90a55640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb8c1067f0 0x7fcb8c198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:58.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.762+0000 7fcb90a55640 1 --2- 172.21.15.118:0/3030826844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8c1007f0 0x7fcb8c198850 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:35:58.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.762+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 >> 172.21.15.118:0/3030826844 conn(0x7fcb8c0fc4f0 msgr2=0x7fcb8c0fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:35:58.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.763+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 shutdown_connections 2024-09-21T11:35:58.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:35:58.763+0000 7fcb90a55640 1 -- 172.21.15.118:0/3030826844 wait complete. 2024-09-21T11:35:59.150 INFO:teuthology.orchestra.run.smithi118.stdout:38654705699 2024-09-21T11:35:59.150 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T11:35:59.418 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:35:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:59 smithi118 ceph-mon[28757]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:35:59 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3030826844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T11:35:59.915 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757255 got 163208757256 for osd.5 2024-09-21T11:35:59.915 DEBUG:teuthology.parallel:result is None 2024-09-21T11:35:59.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:59 smithi149 ceph-mon[36123]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:35:59.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:35:59 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3030826844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T11:36:00.559 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:00.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.558+0000 7ffbbf179640 1 -- 172.21.15.118:0/3742614082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb81033f0 msgr2=0x7ffbb810b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:00.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.558+0000 7ffbbf179640 1 --2- 172.21.15.118:0/3742614082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb81033f0 0x7ffbb810b8e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009880 tx=0x7ffba402a530 comp rx=0 tx=0).stop 2024-09-21T11:36:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.558+0000 7ffbbf179640 1 -- 172.21.15.118:0/3742614082 shutdown_connections 2024-09-21T11:36:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.558+0000 7ffbbf179640 1 --2- 172.21.15.118:0/3742614082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb81033f0 0x7ffbb810b8e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.558+0000 7ffbbf179640 1 --2- 172.21.15.118:0/3742614082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb8102ad0 0x7ffbb8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.558+0000 7ffbbf179640 1 -- 172.21.15.118:0/3742614082 >> 172.21.15.118:0/3742614082 conn(0x7ffbb80fc510 msgr2=0x7ffbb80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.558+0000 7ffbbf179640 1 -- 172.21.15.118:0/3742614082 shutdown_connections 2024-09-21T11:36:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.558+0000 7ffbbf179640 1 -- 172.21.15.118:0/3742614082 wait complete. 2024-09-21T11:36:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbf179640 1 Processor -- start 2024-09-21T11:36:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbf179640 1 -- start start 2024-09-21T11:36:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbf179640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8102ad0 0x7ffbb819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbf179640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb81033f0 0x7ffbb819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbf179640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb810ee00 con 0x7ffbb8102ad0 2024-09-21T11:36:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbf179640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb810ec80 con 0x7ffbb81033f0 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbcf15640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8102ad0 0x7ffbb819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbcf15640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8102ad0 0x7ffbb819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60536/0 (socket says 172.21.15.118:60536) 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbcf15640 1 -- 172.21.15.118:0/2130392379 learned_addr learned my addr 172.21.15.118:0/2130392379 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbb7fff640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb81033f0 0x7ffbb819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbcf15640 1 -- 172.21.15.118:0/2130392379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb81033f0 msgr2=0x7ffbb819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbcf15640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb81033f0 0x7ffbb819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.559+0000 7ffbbcf15640 1 -- 172.21.15.118:0/2130392379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb8197870 con 0x7ffbb8102ad0 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.560+0000 7ffbbcf15640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8102ad0 0x7ffbb819d6b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00d6f0 tx=0x7ffbac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.560+0000 7ffbb5ffb640 1 -- 172.21.15.118:0/2130392379 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffbac017070 con 0x7ffbb8102ad0 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.560+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb8197b60 con 0x7ffbb8102ad0 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.560+0000 7ffbb5ffb640 1 -- 172.21.15.118:0/2130392379 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffbac00de00 con 0x7ffbb8102ad0 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.560+0000 7ffbb5ffb640 1 -- 172.21.15.118:0/2130392379 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffbac004bb0 con 0x7ffbb8102ad0 2024-09-21T11:36:00.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.560+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb81980f0 con 0x7ffbb8102ad0 2024-09-21T11:36:00.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.561+0000 7ffbb5ffb640 1 -- 172.21.15.118:0/2130392379 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ffbac009a30 con 0x7ffbb8102ad0 2024-09-21T11:36:00.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.561+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb806ac30 con 0x7ffbb8102ad0 2024-09-21T11:36:00.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.562+0000 7ffbb5ffb640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ffba806e2b0 0x7ffba8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:00.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.562+0000 7ffbb7fff640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ffba806e2b0 0x7ffba8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:00.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.562+0000 7ffbb5ffb640 1 -- 172.21.15.118:0/2130392379 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7ffbac08db10 con 0x7ffbb8102ad0 2024-09-21T11:36:00.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.562+0000 7ffbb7fff640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ffba806e2b0 0x7ffba8070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffba4031460 tx=0x7ffba4009560 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:00.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.566+0000 7ffbb5ffb640 1 -- 172.21.15.118:0/2130392379 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffbac05b710 con 0x7ffbb8102ad0 2024-09-21T11:36:00.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.739+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ffbb8198da0 con 0x7ffbb8102ad0 2024-09-21T11:36:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:81604378647 2024-09-21T11:36:00.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.739+0000 7ffbb5ffb640 1 -- 172.21.15.118:0/2130392379 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffbac05f3c0 con 0x7ffbb8102ad0 2024-09-21T11:36:00.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ffba806e2b0 msgr2=0x7ffba8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:00.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ffba806e2b0 0x7ffba8070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffba4031460 tx=0x7ffba4009560 comp rx=0 tx=0).stop 2024-09-21T11:36:00.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8102ad0 msgr2=0x7ffbb819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:00.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8102ad0 0x7ffbb819d6b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00d6f0 tx=0x7ffbac00dbb0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 shutdown_connections 2024-09-21T11:36:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ffba806e2b0 0x7ffba8070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbb81033f0 0x7ffbb819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 --2- 172.21.15.118:0/2130392379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8102ad0 0x7ffbb819d6b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 >> 172.21.15.118:0/2130392379 conn(0x7ffbb80fc510 msgr2=0x7ffbb8108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 shutdown_connections 2024-09-21T11:36:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.742+0000 7ffbbf179640 1 -- 172.21.15.118:0/2130392379 wait complete. 2024-09-21T11:36:00.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.778+0000 7fd0adf4d640 1 -- 172.21.15.118:0/1892480926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8100810 msgr2=0x7fd0a8100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:00.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.778+0000 7fd0adf4d640 1 --2- 172.21.15.118:0/1892480926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8100810 0x7fd0a8100c70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd090009880 tx=0x7fd09002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.778+0000 7fd0adf4d640 1 -- 172.21.15.118:0/1892480926 shutdown_connections 2024-09-21T11:36:00.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.778+0000 7fd0adf4d640 1 --2- 172.21.15.118:0/1892480926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8100810 0x7fd0a8100c70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.778+0000 7fd0adf4d640 1 --2- 172.21.15.118:0/1892480926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a8106810 0x7fd0a8106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.778+0000 7fd0adf4d640 1 -- 172.21.15.118:0/1892480926 >> 172.21.15.118:0/1892480926 conn(0x7fd0a80fc510 msgr2=0x7fd0a80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:00.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd0adf4d640 1 -- 172.21.15.118:0/1892480926 shutdown_connections 2024-09-21T11:36:00.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd0adf4d640 1 -- 172.21.15.118:0/1892480926 wait complete. 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd0adf4d640 1 Processor -- start 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd0adf4d640 1 -- start start 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd0adf4d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a8100810 0x7fd0a819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd0adf4d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8106810 0x7fd0a819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd0adf4d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a810dce0 con 0x7fd0a8106810 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd0adf4d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a810db60 con 0x7fd0a8100810 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd09ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8106810 0x7fd0a819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd09ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8106810 0x7fd0a819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60548/0 (socket says 172.21.15.118:60548) 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.779+0000 7fd09ffff640 1 -- 172.21.15.118:0/2705207327 learned_addr learned my addr 172.21.15.118:0/2705207327 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd0a77fe640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a8100810 0x7fd0a819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:00.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd09ffff640 1 -- 172.21.15.118:0/2705207327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a8100810 msgr2=0x7fd0a819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd09ffff640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a8100810 0x7fd0a819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd09ffff640 1 -- 172.21.15.118:0/2705207327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a81977d0 con 0x7fd0a8106810 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd09ffff640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8106810 0x7fd0a819db90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd090031460 tx=0x7fd0900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd0a57fa640 1 -- 172.21.15.118:0/2705207327 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd09003f070 con 0x7fd0a8106810 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd0a57fa640 1 -- 172.21.15.118:0/2705207327 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0900035f0 con 0x7fd0a8106810 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a8197a60 con 0x7fd0a8106810 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd0a57fa640 1 -- 172.21.15.118:0/2705207327 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd090035030 con 0x7fd0a8106810 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.780+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a8197f90 con 0x7fd0a8106810 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.781+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a8101f50 con 0x7fd0a8106810 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.782+0000 7fd0a57fa640 1 -- 172.21.15.118:0/2705207327 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fd090042070 con 0x7fd0a8106810 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.782+0000 7fd0a57fa640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd09406e2b0 0x7fd094070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.782+0000 7fd0a57fa640 1 -- 172.21.15.118:0/2705207327 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd0900ae7f0 con 0x7fd0a8106810 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.782+0000 7fd0a77fe640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd09406e2b0 0x7fd094070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.782+0000 7fd0a77fe640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd09406e2b0 0x7fd094070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd098005fd0 tx=0x7fd098005850 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.786+0000 7fd0a57fa640 1 -- 172.21.15.118:0/2705207327 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd09007c490 con 0x7fd0a8106810 2024-09-21T11:36:00.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.956+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd0a8109d90 con 0x7fd0a8106810 2024-09-21T11:36:00.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.956+0000 7fd0a57fa640 1 -- 172.21.15.118:0/2705207327 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd090080140 con 0x7fd0a8106810 2024-09-21T11:36:00.957 INFO:teuthology.orchestra.run.smithi118.stdout:60129542174 2024-09-21T11:36:00.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd09406e2b0 msgr2=0x7fd094070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:00.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd09406e2b0 0x7fd094070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd098005fd0 tx=0x7fd098005850 comp rx=0 tx=0).stop 2024-09-21T11:36:00.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8106810 msgr2=0x7fd0a819db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:00.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8106810 0x7fd0a819db90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd090031460 tx=0x7fd0900045e0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 shutdown_connections 2024-09-21T11:36:00.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd09406e2b0 0x7fd094070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a8106810 0x7fd0a819db90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 --2- 172.21.15.118:0/2705207327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a8100810 0x7fd0a819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:00.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 >> 172.21.15.118:0/2705207327 conn(0x7fd0a80fc510 msgr2=0x7fd0a806a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:00.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 shutdown_connections 2024-09-21T11:36:00.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:00.958+0000 7fd0adf4d640 1 -- 172.21.15.118:0/2705207327 wait complete. 2024-09-21T11:36:01.580 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542174 for osd.1 2024-09-21T11:36:01.581 DEBUG:teuthology.parallel:result is None 2024-09-21T11:36:01.822 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:01 smithi118 ceph-mon[28757]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:01.822 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:01 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2130392379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T11:36:01.822 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:01 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2705207327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T11:36:01.843 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:01.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:01 smithi149 ceph-mon[36123]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:01.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:01 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2130392379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T11:36:01.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:01 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2705207327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T11:36:02.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.025+0000 7f71d57a2640 1 -- 172.21.15.118:0/1692578825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 msgr2=0x7f71d0107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:02.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.025+0000 7f71d57a2640 1 --2- 172.21.15.118:0/1692578825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 0x7f71d0107cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009880 tx=0x7f71c002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:02.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.025+0000 7f71d57a2640 1 -- 172.21.15.118:0/1692578825 shutdown_connections 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.025+0000 7f71d57a2640 1 --2- 172.21.15.118:0/1692578825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71d0101910 0x7f71d0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.025+0000 7f71d57a2640 1 --2- 172.21.15.118:0/1692578825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 0x7f71d0107cf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.025+0000 7f71d57a2640 1 -- 172.21.15.118:0/1692578825 >> 172.21.15.118:0/1692578825 conn(0x7f71d00fd630 msgr2=0x7f71d00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.025+0000 7f71d57a2640 1 -- 172.21.15.118:0/1692578825 shutdown_connections 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.025+0000 7f71d57a2640 1 -- 172.21.15.118:0/1692578825 wait complete. 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71d57a2640 1 Processor -- start 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71d57a2640 1 -- start start 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71d57a2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71d0101910 0x7f71d00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71d57a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 0x7f71d0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71d57a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f71d010ee40 con 0x7f71d0107910 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71d57a2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71d010ecc0 con 0x7f71d0101910 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71c67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 0x7f71d0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:02.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71c67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 0x7f71d0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60564/0 (socket says 172.21.15.118:60564) 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71c67fc640 1 -- 172.21.15.118:0/199624112 learned_addr learned my addr 172.21.15.118:0/199624112 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71ceffd640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71d0101910 0x7f71d00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71c67fc640 1 -- 172.21.15.118:0/199624112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71d0101910 msgr2=0x7f71d00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71c67fc640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71d0101910 0x7f71d00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.026+0000 7f71c67fc640 1 -- 172.21.15.118:0/199624112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d0074f70 con 0x7f71d0107910 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.027+0000 7f71c67fc640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 0x7f71d0074a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f71b800b420 tx=0x7f71b800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.027+0000 7f71ccff9640 1 -- 172.21.15.118:0/199624112 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71b8011630 con 0x7f71d0107910 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.027+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d0075260 con 0x7f71d0107910 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.027+0000 7f71ccff9640 1 -- 172.21.15.118:0/199624112 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71b8016070 con 0x7f71d0107910 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.027+0000 7f71ccff9640 1 -- 172.21.15.118:0/199624112 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71b8010d40 con 0x7f71d0107910 2024-09-21T11:36:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.027+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d01a3eb0 con 0x7f71d0107910 2024-09-21T11:36:02.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.028+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d0103050 con 0x7f71d0107910 2024-09-21T11:36:02.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.028+0000 7f71ccff9640 1 -- 172.21.15.118:0/199624112 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f71b80117d0 con 0x7f71d0107910 2024-09-21T11:36:02.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.029+0000 7f71ccff9640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f71bc06e2b0 0x7f71bc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:02.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.029+0000 7f71ccff9640 1 -- 172.21.15.118:0/199624112 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f71b808d610 con 0x7f71d0107910 2024-09-21T11:36:02.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.029+0000 7f71ceffd640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f71bc06e2b0 0x7f71bc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:02.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.029+0000 7f71ceffd640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f71bc06e2b0 0x7f71bc070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f71c00096c0 tx=0x7f71c0031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:02.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.033+0000 7f71ccff9640 1 -- 172.21.15.118:0/199624112 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71b805b2b0 con 0x7f71d0107910 2024-09-21T11:36:02.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.200+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f71d0109e80 con 0x7f71d0107910 2024-09-21T11:36:02.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.201+0000 7f71ccff9640 1 -- 172.21.15.118:0/199624112 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f71b808d430 con 0x7f71d0107910 2024-09-21T11:36:02.202 INFO:teuthology.orchestra.run.smithi118.stdout:107374182418 2024-09-21T11:36:02.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.202+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f71bc06e2b0 msgr2=0x7f71bc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:02.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.202+0000 7f71d57a2640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f71bc06e2b0 0x7f71bc070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f71c00096c0 tx=0x7f71c0031400 comp rx=0 tx=0).stop 2024-09-21T11:36:02.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.203+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 msgr2=0x7f71d0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:02.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.203+0000 7f71d57a2640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 0x7f71d0074a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f71b800b420 tx=0x7f71b800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:36:02.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.203+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 shutdown_connections 2024-09-21T11:36:02.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.203+0000 7f71d57a2640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f71bc06e2b0 0x7f71bc070770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:02.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.203+0000 7f71d57a2640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71d0107910 0x7f71d0074a30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:02.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.203+0000 7f71d57a2640 1 --2- 172.21.15.118:0/199624112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71d0101910 0x7f71d00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:02.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.203+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 >> 172.21.15.118:0/199624112 conn(0x7f71d00fd630 msgr2=0x7f71d00fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:02.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.203+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 shutdown_connections 2024-09-21T11:36:02.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:02.203+0000 7f71d57a2640 1 -- 172.21.15.118:0/199624112 wait complete. 2024-09-21T11:36:02.721 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378645 got 81604378647 for osd.2 2024-09-21T11:36:02.722 DEBUG:teuthology.parallel:result is None 2024-09-21T11:36:02.834 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:02 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/199624112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T11:36:02.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:02 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/199624112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T11:36:03.126 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:03.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.291+0000 7f71507b9640 1 -- 172.21.15.118:0/1564018913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 msgr2=0x7f7148106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:03.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.291+0000 7f71507b9640 1 --2- 172.21.15.118:0/1564018913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 0x7f7148106c00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f713c009880 tx=0x7f713c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:03.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.291+0000 7f71507b9640 1 -- 172.21.15.118:0/1564018913 shutdown_connections 2024-09-21T11:36:03.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.291+0000 7f71507b9640 1 --2- 172.21.15.118:0/1564018913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7148100820 0x7f7148100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:03.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.291+0000 7f71507b9640 1 --2- 172.21.15.118:0/1564018913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 0x7f7148106c00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:03.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.291+0000 7f71507b9640 1 -- 172.21.15.118:0/1564018913 >> 172.21.15.118:0/1564018913 conn(0x7f71480fc520 msgr2=0x7f71480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:03.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.291+0000 7f71507b9640 1 -- 172.21.15.118:0/1564018913 shutdown_connections 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.291+0000 7f71507b9640 1 -- 172.21.15.118:0/1564018913 wait complete. 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.291+0000 7f71507b9640 1 Processor -- start 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f71507b9640 1 -- start start 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f71507b9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7148100820 0x7f71480fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f71507b9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 0x7f71480fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f71507b9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f714810dd50 con 0x7f7148106820 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f71507b9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f714810dbd0 con 0x7f7148100820 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f714dd54640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 0x7f71480fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f714dd54640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 0x7f71480fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60574/0 (socket says 172.21.15.118:60574) 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f714dd54640 1 -- 172.21.15.118:0/2502419742 learned_addr learned my addr 172.21.15.118:0/2502419742 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f714e555640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7148100820 0x7f71480fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f714dd54640 1 -- 172.21.15.118:0/2502419742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7148100820 msgr2=0x7f71480fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:03.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f714dd54640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7148100820 0x7f71480fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f714dd54640 1 -- 172.21.15.118:0/2502419742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71480fd6c0 con 0x7f7148106820 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f714e555640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7148100820 0x7f71480fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f714dd54640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 0x7f71480fd180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f714400b420 tx=0x7f714400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f713b7fe640 1 -- 172.21.15.118:0/2502419742 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7144011630 con 0x7f7148106820 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f713b7fe640 1 -- 172.21.15.118:0/2502419742 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7144016070 con 0x7f7148106820 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71480fd9b0 con 0x7f7148106820 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.292+0000 7f713b7fe640 1 -- 172.21.15.118:0/2502419742 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7144010d40 con 0x7f7148106820 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.293+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71481a3e90 con 0x7f7148106820 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.294+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7148101f60 con 0x7f7148106820 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.294+0000 7f713b7fe640 1 -- 172.21.15.118:0/2502419742 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f714401b460 con 0x7f7148106820 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.294+0000 7f713b7fe640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f713406e2b0 0x7f7134070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.295+0000 7f713b7fe640 1 -- 172.21.15.118:0/2502419742 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f714408d6e0 con 0x7f7148106820 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.295+0000 7f714e555640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f713406e2b0 0x7f7134070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.295+0000 7f714e555640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f713406e2b0 0x7f7134070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f713c006010 tx=0x7f713c0095f0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:03.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.299+0000 7f713b7fe640 1 -- 172.21.15.118:0/2502419742 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f714405b380 con 0x7f7148106820 2024-09-21T11:36:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.475+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7148109da0 con 0x7f7148106820 2024-09-21T11:36:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.475+0000 7f713b7fe640 1 -- 172.21.15.118:0/2502419742 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f714405f030 con 0x7f7148106820 2024-09-21T11:36:03.477 INFO:teuthology.orchestra.run.smithi118.stdout:141733920781 2024-09-21T11:36:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.477+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f713406e2b0 msgr2=0x7f7134070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.477+0000 7f71507b9640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f713406e2b0 0x7f7134070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f713c006010 tx=0x7f713c0095f0 comp rx=0 tx=0).stop 2024-09-21T11:36:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.477+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 msgr2=0x7f71480fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.477+0000 7f71507b9640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 0x7f71480fd180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f714400b420 tx=0x7f714400b8e0 comp rx=0 tx=0).stop 2024-09-21T11:36:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.478+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 shutdown_connections 2024-09-21T11:36:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.478+0000 7f71507b9640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f713406e2b0 0x7f7134070770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.478+0000 7f71507b9640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7148106820 0x7f71480fd180 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:03.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.478+0000 7f71507b9640 1 --2- 172.21.15.118:0/2502419742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7148100820 0x7f71480fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:03.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.478+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 >> 172.21.15.118:0/2502419742 conn(0x7f71480fc520 msgr2=0x7f714806a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:03.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.478+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 shutdown_connections 2024-09-21T11:36:03.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:03.478+0000 7f71507b9640 1 -- 172.21.15.118:0/2502419742 wait complete. 2024-09-21T11:36:03.731 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:03 smithi118 ceph-mon[28757]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:03.731 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:03 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2502419742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T11:36:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:03 smithi149 ceph-mon[36123]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:03 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2502419742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T11:36:04.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.191+0000 7f19ff8df640 1 -- 172.21.15.118:0/3065557828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 msgr2=0x7f19f8100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:04.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.191+0000 7f19ff8df640 1 --2- 172.21.15.118:0/3065557828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 0x7f19f8100190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009880 tx=0x7f19ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:04.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.191+0000 7f19ff8df640 1 -- 172.21.15.118:0/3065557828 shutdown_connections 2024-09-21T11:36:04.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.191+0000 7f19ff8df640 1 --2- 172.21.15.118:0/3065557828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 0x7f19f8100190 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:04.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.191+0000 7f19ff8df640 1 --2- 172.21.15.118:0/3065557828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f8106910 0x7f19f8106cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:04.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.191+0000 7f19ff8df640 1 -- 172.21.15.118:0/3065557828 >> 172.21.15.118:0/3065557828 conn(0x7f19f80fbc40 msgr2=0x7f19f80fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:04.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.191+0000 7f19ff8df640 1 -- 172.21.15.118:0/3065557828 shutdown_connections 2024-09-21T11:36:04.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.191+0000 7f19ff8df640 1 -- 172.21.15.118:0/3065557828 wait complete. 2024-09-21T11:36:04.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19ff8df640 1 Processor -- start 2024-09-21T11:36:04.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19ff8df640 1 -- start start 2024-09-21T11:36:04.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19ff8df640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 0x7f19f819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:04.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19ff8df640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f8106910 0x7f19f819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:04.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19ff8df640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f19f810eeb0 con 0x7f19f80ffd30 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19ff8df640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f19f810ed30 con 0x7f19f8106910 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19fd67b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 0x7f19f819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19fd67b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 0x7f19f819f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60588/0 (socket says 172.21.15.118:60588) 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19fd67b640 1 -- 172.21.15.118:0/523472976 learned_addr learned my addr 172.21.15.118:0/523472976 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19fce7a640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f8106910 0x7f19f819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19fd67b640 1 -- 172.21.15.118:0/523472976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f8106910 msgr2=0x7f19f819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19fd67b640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f8106910 0x7f19f819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.192+0000 7f19fd67b640 1 -- 172.21.15.118:0/523472976 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f8199a50 con 0x7f19f80ffd30 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.193+0000 7f19fd67b640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 0x7f19f819f890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c8f0 tx=0x7f19f400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.193+0000 7f19ea7fc640 1 -- 172.21.15.118:0/523472976 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19f40079b0 con 0x7f19f80ffd30 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.193+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f8199d40 con 0x7f19f80ffd30 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.193+0000 7f19ea7fc640 1 -- 172.21.15.118:0/523472976 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19f40054e0 con 0x7f19f80ffd30 2024-09-21T11:36:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.193+0000 7f19ea7fc640 1 -- 172.21.15.118:0/523472976 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19f4004dd0 con 0x7f19f80ffd30 2024-09-21T11:36:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.193+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f819a2d0 con 0x7f19f80ffd30 2024-09-21T11:36:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.194+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f8103050 con 0x7f19f80ffd30 2024-09-21T11:36:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.194+0000 7f19ea7fc640 1 -- 172.21.15.118:0/523472976 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f19f4005020 con 0x7f19f80ffd30 2024-09-21T11:36:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.195+0000 7f19ea7fc640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f19e406e2b0 0x7f19e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.195+0000 7f19ea7fc640 1 -- 172.21.15.118:0/523472976 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f19f408dcd0 con 0x7f19f80ffd30 2024-09-21T11:36:04.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.195+0000 7f19fce7a640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f19e406e2b0 0x7f19e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:04.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.195+0000 7f19fce7a640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f19e406e2b0 0x7f19e4070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f19ec031460 tx=0x7f19ec009560 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:04.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.199+0000 7f19ea7fc640 1 -- 172.21.15.118:0/523472976 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19f4014030 con 0x7f19f80ffd30 2024-09-21T11:36:04.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.371+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f19f819af80 con 0x7f19f80ffd30 2024-09-21T11:36:04.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.371+0000 7f19ea7fc640 1 -- 172.21.15.118:0/523472976 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19f405b9f0 con 0x7f19f80ffd30 2024-09-21T11:36:04.373 INFO:teuthology.orchestra.run.smithi118.stdout:38654705700 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f19e406e2b0 msgr2=0x7f19e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f19e406e2b0 0x7f19e4070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f19ec031460 tx=0x7f19ec009560 comp rx=0 tx=0).stop 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 msgr2=0x7f19f819f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 0x7f19f819f890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c8f0 tx=0x7f19f400cdb0 comp rx=0 tx=0).stop 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 shutdown_connections 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f19e406e2b0 0x7f19e4070770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f8106910 0x7f19f819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 --2- 172.21.15.118:0/523472976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19f80ffd30 0x7f19f819f890 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 >> 172.21.15.118:0/523472976 conn(0x7f19f80fbc40 msgr2=0x7f19f8100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.373+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 shutdown_connections 2024-09-21T11:36:04.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:04.374+0000 7f19ff8df640 1 -- 172.21.15.118:0/523472976 wait complete. 2024-09-21T11:36:04.733 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:04 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/523472976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T11:36:04.849 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920780 got 141733920781 for osd.4 2024-09-21T11:36:04.849 DEBUG:teuthology.parallel:result is None 2024-09-21T11:36:04.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:04 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/523472976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T11:36:05.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:05 smithi149 ceph-mon[36123]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:05 smithi118 ceph-mon[28757]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:06.167 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182418 got 107374182418 for osd.3 2024-09-21T11:36:06.167 DEBUG:teuthology.parallel:result is None 2024-09-21T11:36:06.930 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705700 for osd.0 2024-09-21T11:36:06.930 DEBUG:teuthology.parallel:result is None 2024-09-21T11:36:06.930 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T11:36:06.930 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T11:36:07.187 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.639+0000 7f25d2a54640 1 -- 172.21.15.118:0/1490568803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc103440 msgr2=0x7f25cc10b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.639+0000 7f25d2a54640 1 --2- 172.21.15.118:0/1490568803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc103440 0x7f25cc10b930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f25b40098b0 tx=0x7f25b402a560 comp rx=0 tx=0).stop 2024-09-21T11:36:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.639+0000 7f25d2a54640 1 -- 172.21.15.118:0/1490568803 shutdown_connections 2024-09-21T11:36:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.639+0000 7f25d2a54640 1 --2- 172.21.15.118:0/1490568803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc103440 0x7f25cc10b930 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.639+0000 7f25d2a54640 1 --2- 172.21.15.118:0/1490568803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25cc102b20 0x7f25cc102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.639+0000 7f25d2a54640 1 -- 172.21.15.118:0/1490568803 >> 172.21.15.118:0/1490568803 conn(0x7f25cc0fc520 msgr2=0x7f25cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.639+0000 7f25d2a54640 1 -- 172.21.15.118:0/1490568803 shutdown_connections 2024-09-21T11:36:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.639+0000 7f25d2a54640 1 -- 172.21.15.118:0/1490568803 wait complete. 2024-09-21T11:36:07.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25d2a54640 1 Processor -- start 2024-09-21T11:36:07.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25d2a54640 1 -- start start 2024-09-21T11:36:07.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25d2a54640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc102b20 0x7f25cc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:07.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25d2a54640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25cc103440 0x7f25cc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25d2a54640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc10ee70 con 0x7f25cc102b20 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25d2a54640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc10ecf0 con 0x7f25cc103440 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25cbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc102b20 0x7f25cc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25cbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc102b20 0x7f25cc19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39820/0 (socket says 172.21.15.118:39820) 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25cbfff640 1 -- 172.21.15.118:0/2814492458 learned_addr learned my addr 172.21.15.118:0/2814492458 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25c3fff640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25cc103440 0x7f25cc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25cbfff640 1 -- 172.21.15.118:0/2814492458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25cc103440 msgr2=0x7f25cc19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25cbfff640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25cc103440 0x7f25cc19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.640+0000 7f25cbfff640 1 -- 172.21.15.118:0/2814492458 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc197860 con 0x7f25cc102b20 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.641+0000 7f25cbfff640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc102b20 0x7f25cc19d6a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00b420 tx=0x7f25bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.641+0000 7f25c9ffb640 1 -- 172.21.15.118:0/2814492458 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25bc011630 con 0x7f25cc102b20 2024-09-21T11:36:07.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.641+0000 7f25c9ffb640 1 -- 172.21.15.118:0/2814492458 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25bc016070 con 0x7f25cc102b20 2024-09-21T11:36:07.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.641+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25cc197b50 con 0x7f25cc102b20 2024-09-21T11:36:07.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.641+0000 7f25c9ffb640 1 -- 172.21.15.118:0/2814492458 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25bc010d40 con 0x7f25cc102b20 2024-09-21T11:36:07.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.641+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25cc1980b0 con 0x7f25cc102b20 2024-09-21T11:36:07.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.642+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25cc06aba0 con 0x7f25cc102b20 2024-09-21T11:36:07.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.642+0000 7f25c9ffb640 1 -- 172.21.15.118:0/2814492458 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f25bc01b460 con 0x7f25cc102b20 2024-09-21T11:36:07.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.643+0000 7f25c9ffb640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25b806e310 0x7f25b80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:07.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.643+0000 7f25c3fff640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25b806e310 0x7f25b80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:07.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.643+0000 7f25c9ffb640 1 -- 172.21.15.118:0/2814492458 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f25bc08d550 con 0x7f25cc102b20 2024-09-21T11:36:07.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.643+0000 7f25c3fff640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25b806e310 0x7f25b80707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000c00 tx=0x7f25b4031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:07.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.647+0000 7f25c9ffb640 1 -- 172.21.15.118:0/2814492458 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25bc05b270 con 0x7f25cc102b20 2024-09-21T11:36:07.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.809+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25cc198d90 con 0x7f25b806e310 2024-09-21T11:36:07.811 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:07 smithi118 ceph-mon[28757]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:07.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.810+0000 7f25c9ffb640 1 -- 172.21.15.118:0/2814492458 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f25cc198d90 con 0x7f25b806e310 2024-09-21T11:36:07.812 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:07.812 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T11:36:07.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25b806e310 msgr2=0x7f25b80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25b806e310 0x7f25b80707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000c00 tx=0x7f25b4031400 comp rx=0 tx=0).stop 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc102b20 msgr2=0x7f25cc19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc102b20 0x7f25cc19d6a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00b420 tx=0x7f25bc00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 shutdown_connections 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f25b806e310 0x7f25b80707d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25cc103440 0x7f25cc19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 --2- 172.21.15.118:0/2814492458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25cc102b20 0x7f25cc19d6a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 >> 172.21.15.118:0/2814492458 conn(0x7f25cc0fc520 msgr2=0x7f25cc103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 shutdown_connections 2024-09-21T11:36:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:07.812+0000 7f25d2a54640 1 -- 172.21.15.118:0/2814492458 wait complete. 2024-09-21T11:36:07.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:07 smithi149 ceph-mon[36123]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:08.587 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-21T11:36:06.513090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":186820,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":562284092,"statfs":{"total":575970213888,"available":575778910208,"internally_reserved":0,"allocated":3919872,"data_stored":2591340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001784"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T11:35:36.812551+0000","last_change":"2024-09-21T11:35:07.936023+0000","last_active":"2024-09-21T11:35:36.812551+0000","last_peered":"2024-09-21T11:35:36.812551+0000","last_clean":"2024-09-21T11:35:36.812551+0000","last_became_active":"2024-09-21T11:35:07.935701+0000","last_became_peered":"2024-09-21T11:35:07.935701+0000","last_unstale":"2024-09-21T11:35:36.812551+0000","last_undegraded":"2024-09-21T11:35:36.812551+0000","last_fullsized":"2024-09-21T11:35:36.812551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T11:34:18.773892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T11:34:18.773892+0000","last_clean_scrub_stamp":"2024-09-21T11:34:18.773892+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:07.318326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":356352,"data_stored":136706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182420,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":727074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378648,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39860,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93705292,"statfs":{"total":95995035648,"available":95954219008,"internally_reserved":0,"allocated":356352,"data_stored":136706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":727074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":950272,"data_stored":727074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T11:36:08.587 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T11:36:08.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:36:08.836 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:08.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:36:09.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.272+0000 7ff81970d640 1 -- 172.21.15.118:0/1016692952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141067f0 msgr2=0x7ff814106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:09.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.272+0000 7ff81970d640 1 --2- 172.21.15.118:0/1016692952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141067f0 0x7ff814106bd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff804009880 tx=0x7ff80402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.272+0000 7ff81970d640 1 -- 172.21.15.118:0/1016692952 shutdown_connections 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.272+0000 7ff81970d640 1 --2- 172.21.15.118:0/1016692952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8141007f0 0x7ff814100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.272+0000 7ff81970d640 1 --2- 172.21.15.118:0/1016692952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141067f0 0x7ff814106bd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.272+0000 7ff81970d640 1 -- 172.21.15.118:0/1016692952 >> 172.21.15.118:0/1016692952 conn(0x7ff8140fc4f0 msgr2=0x7ff8140fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.272+0000 7ff81970d640 1 -- 172.21.15.118:0/1016692952 shutdown_connections 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.272+0000 7ff81970d640 1 -- 172.21.15.118:0/1016692952 wait complete. 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.273+0000 7ff81970d640 1 Processor -- start 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.273+0000 7ff81970d640 1 -- start start 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.273+0000 7ff81970d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141007f0 0x7ff8141988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.273+0000 7ff81970d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8141067f0 0x7ff814198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.273+0000 7ff81970d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff81410dd20 con 0x7ff8141007f0 2024-09-21T11:36:09.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.273+0000 7ff81970d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff81410dba0 con 0x7ff8141067f0 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.273+0000 7ff812ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141007f0 0x7ff8141988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.273+0000 7ff812ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141007f0 0x7ff8141988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39838/0 (socket says 172.21.15.118:39838) 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.273+0000 7ff812ffd640 1 -- 172.21.15.118:0/28617861 learned_addr learned my addr 172.21.15.118:0/28617861 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff8127fc640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8141067f0 0x7ff814198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff812ffd640 1 -- 172.21.15.118:0/28617861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8141067f0 msgr2=0x7ff814198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff812ffd640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8141067f0 0x7ff814198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff812ffd640 1 -- 172.21.15.118:0/28617861 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8141993e0 con 0x7ff8141007f0 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff812ffd640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141007f0 0x7ff8141988a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff804031460 tx=0x7ff8040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff7fbfff640 1 -- 172.21.15.118:0/28617861 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff80403f070 con 0x7ff8141007f0 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff814199670 con 0x7ff8141007f0 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff7fbfff640 1 -- 172.21.15.118:0/28617861 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff804004cf0 con 0x7ff8141007f0 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff7fbfff640 1 -- 172.21.15.118:0/28617861 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff804035030 con 0x7ff8141007f0 2024-09-21T11:36:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.274+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8141a1c20 con 0x7ff8141007f0 2024-09-21T11:36:09.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.275+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff814101f30 con 0x7ff8141007f0 2024-09-21T11:36:09.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.276+0000 7ff7fbfff640 1 -- 172.21.15.118:0/28617861 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff804042070 con 0x7ff8141007f0 2024-09-21T11:36:09.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.276+0000 7ff7fbfff640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff7fc06e2b0 0x7ff7fc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:09.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.276+0000 7ff7fbfff640 1 -- 172.21.15.118:0/28617861 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7ff8040ae910 con 0x7ff8141007f0 2024-09-21T11:36:09.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.276+0000 7ff8127fc640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff7fc06e2b0 0x7ff7fc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:09.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.277+0000 7ff8127fc640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff7fc06e2b0 0x7ff7fc070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff81406aea0 tx=0x7ff808008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:09.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.281+0000 7ff7fbfff640 1 -- 172.21.15.118:0/28617861 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff80407c5b0 con 0x7ff8141007f0 2024-09-21T11:36:09.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.443+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff814062630 con 0x7ff7fc06e2b0 2024-09-21T11:36:09.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.444+0000 7ff7fbfff640 1 -- 172.21.15.118:0/28617861 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7ff814062630 con 0x7ff7fc06e2b0 2024-09-21T11:36:09.445 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:09.446 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T11:36:09.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff7fc06e2b0 msgr2=0x7ff7fc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:09.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff7fc06e2b0 0x7ff7fc070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff81406aea0 tx=0x7ff808008040 comp rx=0 tx=0).stop 2024-09-21T11:36:09.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141007f0 msgr2=0x7ff8141988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:09.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141007f0 0x7ff8141988a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff804031460 tx=0x7ff8040048f0 comp rx=0 tx=0).stop 2024-09-21T11:36:09.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 shutdown_connections 2024-09-21T11:36:09.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff7fc06e2b0 0x7ff7fc070770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:09.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8141067f0 0x7ff814198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:09.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 --2- 172.21.15.118:0/28617861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8141007f0 0x7ff8141988a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:09.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 >> 172.21.15.118:0/28617861 conn(0x7ff8140fc4f0 msgr2=0x7ff8140fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:09.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 shutdown_connections 2024-09-21T11:36:09.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:09.446+0000 7ff81970d640 1 -- 172.21.15.118:0/28617861 wait complete. 2024-09-21T11:36:09.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:09 smithi149 ceph-mon[36123]: from='client.14512 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T11:36:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:09 smithi149 ceph-mon[36123]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:09.960 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:09 smithi118 ceph-mon[28757]: from='client.14512 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T11:36:09.961 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:09 smithi118 ceph-mon[28757]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:10.219 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-21T11:36:08.513420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":186820,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":562284092,"statfs":{"total":575970213888,"available":575778910208,"internally_reserved":0,"allocated":3919872,"data_stored":2591340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001789"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T11:35:36.812551+0000","last_change":"2024-09-21T11:35:07.936023+0000","last_active":"2024-09-21T11:35:36.812551+0000","last_peered":"2024-09-21T11:35:36.812551+0000","last_clean":"2024-09-21T11:35:36.812551+0000","last_became_active":"2024-09-21T11:35:07.935701+0000","last_became_peered":"2024-09-21T11:35:07.935701+0000","last_unstale":"2024-09-21T11:35:36.812551+0000","last_undegraded":"2024-09-21T11:35:36.812551+0000","last_fullsized":"2024-09-21T11:35:36.812551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T11:34:18.773892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T11:34:18.773892+0000","last_clean_scrub_stamp":"2024-09-21T11:34:18.773892+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:07.318326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":356352,"data_stored":136706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182420,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":727074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39860,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93705292,"statfs":{"total":95995035648,"available":95954219008,"internally_reserved":0,"allocated":356352,"data_stored":136706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":727074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":950272,"data_stored":727074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T11:36:10.220 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T11:36:10.220 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T11:36:10.220 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T11:36:10.220 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph health --format=json 2024-09-21T11:36:10.469 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:10.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:10 smithi149 ceph-mon[36123]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T11:36:11.017 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:10 smithi118 ceph-mon[28757]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T11:36:11.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.015+0000 7fe6366e6640 1 -- 172.21.15.118:0/2346198103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6301033c0 msgr2=0x7fe63010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.015+0000 7fe6366e6640 1 --2- 172.21.15.118:0/2346198103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6301033c0 0x7fe63010b8b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe624009880 tx=0x7fe62402a530 comp rx=0 tx=0).stop 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.015+0000 7fe6366e6640 1 -- 172.21.15.118:0/2346198103 shutdown_connections 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.015+0000 7fe6366e6640 1 --2- 172.21.15.118:0/2346198103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6301033c0 0x7fe63010b8b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.015+0000 7fe6366e6640 1 --2- 172.21.15.118:0/2346198103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe630102aa0 0x7fe630102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.015+0000 7fe6366e6640 1 -- 172.21.15.118:0/2346198103 >> 172.21.15.118:0/2346198103 conn(0x7fe6300fc4c0 msgr2=0x7fe6300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.015+0000 7fe6366e6640 1 -- 172.21.15.118:0/2346198103 shutdown_connections 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.016+0000 7fe6366e6640 1 -- 172.21.15.118:0/2346198103 wait complete. 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.016+0000 7fe6366e6640 1 Processor -- start 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.016+0000 7fe6366e6640 1 -- start start 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe6366e6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe630102aa0 0x7fe63019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe6366e6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6301033c0 0x7fe63019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:11.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe6366e6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe63010edd0 con 0x7fe630102aa0 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe6366e6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe63010ec50 con 0x7fe6301033c0 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe630102aa0 0x7fe63019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe630102aa0 0x7fe63019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39850/0 (socket says 172.21.15.118:39850) 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62ffff640 1 -- 172.21.15.118:0/2660801411 learned_addr learned my addr 172.21.15.118:0/2660801411 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62f7fe640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6301033c0 0x7fe63019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62ffff640 1 -- 172.21.15.118:0/2660801411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6301033c0 msgr2=0x7fe63019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62ffff640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6301033c0 0x7fe63019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62ffff640 1 -- 172.21.15.118:0/2660801411 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe630197800 con 0x7fe630102aa0 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62ffff640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe630102aa0 0x7fe63019d680 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe62000d6f0 tx=0x7fe62000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62d7fa640 1 -- 172.21.15.118:0/2660801411 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe620017070 con 0x7fe630102aa0 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62d7fa640 1 -- 172.21.15.118:0/2660801411 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe62000de00 con 0x7fe630102aa0 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe630197af0 con 0x7fe630102aa0 2024-09-21T11:36:11.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe62d7fa640 1 -- 172.21.15.118:0/2660801411 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe620004bb0 con 0x7fe630102aa0 2024-09-21T11:36:11.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.017+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe630198050 con 0x7fe630102aa0 2024-09-21T11:36:11.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.018+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63006a410 con 0x7fe630102aa0 2024-09-21T11:36:11.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.019+0000 7fe62d7fa640 1 -- 172.21.15.118:0/2660801411 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fe620010460 con 0x7fe630102aa0 2024-09-21T11:36:11.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.019+0000 7fe62d7fa640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe61806e2b0 0x7fe618070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:11.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.019+0000 7fe62d7fa640 1 -- 172.21.15.118:0/2660801411 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fe62008daa0 con 0x7fe630102aa0 2024-09-21T11:36:11.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.019+0000 7fe62f7fe640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe61806e2b0 0x7fe618070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:11.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.020+0000 7fe62f7fe640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe61806e2b0 0x7fe618070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe630198b50 tx=0x7fe624031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:11.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.024+0000 7fe62d7fa640 1 -- 172.21.15.118:0/2660801411 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe62005b740 con 0x7fe630102aa0 2024-09-21T11:36:11.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.227+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe630105f40 con 0x7fe630102aa0 2024-09-21T11:36:11.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.227+0000 7fe62d7fa640 1 -- 172.21.15.118:0/2660801411 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe62005f3f0 con 0x7fe630102aa0 2024-09-21T11:36:11.229 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:11.229 INFO:teuthology.orchestra.run.smithi118.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.229+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe61806e2b0 msgr2=0x7fe618070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.229+0000 7fe6366e6640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe61806e2b0 0x7fe618070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe630198b50 tx=0x7fe624031400 comp rx=0 tx=0).stop 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.229+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe630102aa0 msgr2=0x7fe63019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.229+0000 7fe6366e6640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe630102aa0 0x7fe63019d680 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe62000d6f0 tx=0x7fe62000dbb0 comp rx=0 tx=0).stop 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.229+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 shutdown_connections 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.229+0000 7fe6366e6640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe61806e2b0 0x7fe618070770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.229+0000 7fe6366e6640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6301033c0 0x7fe63019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.229+0000 7fe6366e6640 1 --2- 172.21.15.118:0/2660801411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe630102aa0 0x7fe63019d680 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.229+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 >> 172.21.15.118:0/2660801411 conn(0x7fe6300fc4c0 msgr2=0x7fe630108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.230+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 shutdown_connections 2024-09-21T11:36:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:11.230+0000 7fe6366e6640 1 -- 172.21.15.118:0/2660801411 wait complete. 2024-09-21T11:36:11.800 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:11 smithi118 ceph-mon[28757]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:11.800 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:11 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2660801411' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T11:36:11.830 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T11:36:11.830 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T11:36:11.830 INFO:teuthology.run_tasks:Running task print... 2024-09-21T11:36:11.841 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-21T11:36:11.841 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T11:36:11.892 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:36:11.892 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-21T11:36:11.893 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:11 smithi149 ceph-mon[36123]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:11.893 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:11 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2660801411' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T11:36:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:12.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.577+0000 7fd514b2a640 1 -- 172.21.15.118:0/3356955433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510100b50 msgr2=0x7fd510100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:12.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.577+0000 7fd514b2a640 1 --2- 172.21.15.118:0/3356955433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510100b50 0x7fd510100fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009880 tx=0x7fd4f802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:12.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.577+0000 7fd514b2a640 1 -- 172.21.15.118:0/3356955433 shutdown_connections 2024-09-21T11:36:12.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.577+0000 7fd514b2a640 1 --2- 172.21.15.118:0/3356955433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510100b50 0x7fd510100fd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:12.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.577+0000 7fd514b2a640 1 --2- 172.21.15.118:0/3356955433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd510101e10 0x7fd510102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:12.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.577+0000 7fd514b2a640 1 -- 172.21.15.118:0/3356955433 >> 172.21.15.118:0/3356955433 conn(0x7fd5100fb7b0 msgr2=0x7fd5100fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:12.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.577+0000 7fd514b2a640 1 -- 172.21.15.118:0/3356955433 shutdown_connections 2024-09-21T11:36:12.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.577+0000 7fd514b2a640 1 -- 172.21.15.118:0/3356955433 wait complete. 2024-09-21T11:36:12.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd514b2a640 1 Processor -- start 2024-09-21T11:36:12.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd514b2a640 1 -- start start 2024-09-21T11:36:12.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd514b2a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd510100b50 0x7fd5101974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:12.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd514b2a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510101e10 0x7fd510197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:12.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd514b2a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101096c0 con 0x7fd510101e10 2024-09-21T11:36:12.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd514b2a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd510109540 con 0x7fd510100b50 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd507fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510101e10 0x7fd510197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd507fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510101e10 0x7fd510197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39866/0 (socket says 172.21.15.118:39866) 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd50e59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd510100b50 0x7fd5101974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd507fff640 1 -- 172.21.15.118:0/2174757440 learned_addr learned my addr 172.21.15.118:0/2174757440 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.578+0000 7fd507fff640 1 -- 172.21.15.118:0/2174757440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd510100b50 msgr2=0x7fd5101974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.579+0000 7fd507fff640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd510100b50 0x7fd5101974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.579+0000 7fd507fff640 1 -- 172.21.15.118:0/2174757440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5101980a0 con 0x7fd510101e10 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.579+0000 7fd50e59c640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd510100b50 0x7fd5101974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.579+0000 7fd507fff640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510101e10 0x7fd510197a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8006010 tx=0x7fd4f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.579+0000 7fd5077fe640 1 -- 172.21.15.118:0/2174757440 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4f803f070 con 0x7fd510101e10 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.579+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51019ca80 con 0x7fd510101e10 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.579+0000 7fd5077fe640 1 -- 172.21.15.118:0/2174757440 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4f8004ac0 con 0x7fd510101e10 2024-09-21T11:36:12.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.579+0000 7fd5077fe640 1 -- 172.21.15.118:0/2174757440 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4f8035030 con 0x7fd510101e10 2024-09-21T11:36:12.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.579+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51019d010 con 0x7fd510101e10 2024-09-21T11:36:12.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.580+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd510100fd0 con 0x7fd510101e10 2024-09-21T11:36:12.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.580+0000 7fd5077fe640 1 -- 172.21.15.118:0/2174757440 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fd4f8042070 con 0x7fd510101e10 2024-09-21T11:36:12.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.581+0000 7fd5077fe640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd4fc06e2b0 0x7fd4fc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:12.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.581+0000 7fd50e59c640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd4fc06e2b0 0x7fd4fc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:12.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.581+0000 7fd5077fe640 1 -- 172.21.15.118:0/2174757440 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd4f80ae9e0 con 0x7fd510101e10 2024-09-21T11:36:12.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.581+0000 7fd50e59c640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd4fc06e2b0 0x7fd4fc070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd500005fd0 tx=0x7fd50000b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:12.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.585+0000 7fd5077fe640 1 -- 172.21.15.118:0/2174757440 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd4f8080330 con 0x7fd510101e10 2024-09-21T11:36:12.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.751+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7fd51019d820 con 0x7fd510101e10 2024-09-21T11:36:12.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.754+0000 7fd5077fe640 1 -- 172.21.15.118:0/2174757440 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v41)=0 v41) ==== 143+0+0 (secure 0 0 0) 0x7fd4f8084b60 con 0x7fd510101e10 2024-09-21T11:36:12.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd4fc06e2b0 msgr2=0x7fd4fc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:12.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd4fc06e2b0 0x7fd4fc070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd500005fd0 tx=0x7fd50000b390 comp rx=0 tx=0).stop 2024-09-21T11:36:12.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510101e10 msgr2=0x7fd510197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:12.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510101e10 0x7fd510197a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8006010 tx=0x7fd4f80046c0 comp rx=0 tx=0).stop 2024-09-21T11:36:12.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 shutdown_connections 2024-09-21T11:36:12.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fd4fc06e2b0 0x7fd4fc070770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:12.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd510101e10 0x7fd510197a20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:12.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 --2- 172.21.15.118:0/2174757440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd510100b50 0x7fd5101974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:12.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 >> 172.21.15.118:0/2174757440 conn(0x7fd5100fb7b0 msgr2=0x7fd5100ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:12.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 shutdown_connections 2024-09-21T11:36:12.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:12.756+0000 7fd514b2a640 1 -- 172.21.15.118:0/2174757440 wait complete. 2024-09-21T11:36:13.348 INFO:teuthology.run_tasks:Running task print... 2024-09-21T11:36:13.357 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-21T11:36:13.357 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T11:36:13.405 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:36:13.405 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T11:36:13.651 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:14.021 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:13 smithi118 ceph-mon[28757]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:14.021 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:13 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2174757440' entity='client.admin' 2024-09-21T11:36:14.021 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:13 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:36:14.021 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:13 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:14.021 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:13 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:36:14.021 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:13 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.194+0000 7fe7572b6640 1 -- 172.21.15.118:0/1098236958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750102b90 msgr2=0x7fe750103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.194+0000 7fe7572b6640 1 --2- 172.21.15.118:0/1098236958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750102b90 0x7fe750103010 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe740009880 tx=0x7fe74002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.194+0000 7fe7572b6640 1 -- 172.21.15.118:0/1098236958 shutdown_connections 2024-09-21T11:36:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.194+0000 7fe7572b6640 1 --2- 172.21.15.118:0/1098236958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750102b90 0x7fe750103010 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.194+0000 7fe7572b6640 1 --2- 172.21.15.118:0/1098236958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe750101990 0x7fe750101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.194+0000 7fe7572b6640 1 -- 172.21.15.118:0/1098236958 >> 172.21.15.118:0/1098236958 conn(0x7fe7500fd140 msgr2=0x7fe7500ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.194+0000 7fe7572b6640 1 -- 172.21.15.118:0/1098236958 shutdown_connections 2024-09-21T11:36:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.194+0000 7fe7572b6640 1 -- 172.21.15.118:0/1098236958 wait complete. 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe7572b6640 1 Processor -- start 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe7572b6640 1 -- start start 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe7572b6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750101990 0x7fe750075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe7572b6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe750102b90 0x7fe7500745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe7572b6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010a850 con 0x7fe750101990 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe7572b6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010a6d0 con 0x7fe750102b90 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe755052640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750101990 0x7fe750075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe755052640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750101990 0x7fe750075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39884/0 (socket says 172.21.15.118:39884) 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe755052640 1 -- 172.21.15.118:0/2114997654 learned_addr learned my addr 172.21.15.118:0/2114997654 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe755052640 1 -- 172.21.15.118:0/2114997654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe750102b90 msgr2=0x7fe7500745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe754851640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe750102b90 0x7fe7500745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe755052640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe750102b90 0x7fe7500745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe755052640 1 -- 172.21.15.118:0/2114997654 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe750074b20 con 0x7fe750101990 2024-09-21T11:36:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe754851640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe750102b90 0x7fe7500745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:36:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.195+0000 7fe755052640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750101990 0x7fe750075f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00b3d0 tx=0x7fe74c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.196+0000 7fe7467fc640 1 -- 172.21.15.118:0/2114997654 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe74c015020 con 0x7fe750101990 2024-09-21T11:36:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.196+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe750074e10 con 0x7fe750101990 2024-09-21T11:36:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.196+0000 7fe7467fc640 1 -- 172.21.15.118:0/2114997654 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe74c011af0 con 0x7fe750101990 2024-09-21T11:36:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.196+0000 7fe7467fc640 1 -- 172.21.15.118:0/2114997654 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe74c010da0 con 0x7fe750101990 2024-09-21T11:36:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.196+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe750075420 con 0x7fe750101990 2024-09-21T11:36:14.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:13 smithi149 ceph-mon[36123]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:14.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:13 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2174757440' entity='client.admin' 2024-09-21T11:36:14.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:13 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:36:14.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:13 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:14.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:13 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:36:14.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:13 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:14.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.197+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750101d90 con 0x7fe750101990 2024-09-21T11:36:14.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.197+0000 7fe7467fc640 1 -- 172.21.15.118:0/2114997654 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fe74c018020 con 0x7fe750101990 2024-09-21T11:36:14.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.198+0000 7fe7467fc640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe73c06e2b0 0x7fe73c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:14.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.198+0000 7fe7467fc640 1 -- 172.21.15.118:0/2114997654 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fe74c08d9e0 con 0x7fe750101990 2024-09-21T11:36:14.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.198+0000 7fe754851640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe73c06e2b0 0x7fe73c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:14.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.198+0000 7fe754851640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe73c06e2b0 0x7fe73c070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7400096c0 tx=0x7fe740009650 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:14.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.202+0000 7fe7467fc640 1 -- 172.21.15.118:0/2114997654 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe74c01f020 con 0x7fe750101990 2024-09-21T11:36:14.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.383+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fe750062630 con 0x7fe73c06e2b0 2024-09-21T11:36:14.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.384+0000 7fe7467fc640 1 -- 172.21.15.118:0/2114997654 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fe750062630 con 0x7fe73c06e2b0 2024-09-21T11:36:14.386 INFO:teuthology.orchestra.run.smithi118.stdout:Backend: cephadm 2024-09-21T11:36:14.386 INFO:teuthology.orchestra.run.smithi118.stdout:Available: Yes 2024-09-21T11:36:14.387 INFO:teuthology.orchestra.run.smithi118.stdout:Paused: No 2024-09-21T11:36:14.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe73c06e2b0 msgr2=0x7fe73c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe73c06e2b0 0x7fe73c070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7400096c0 tx=0x7fe740009650 comp rx=0 tx=0).stop 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750101990 msgr2=0x7fe750075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750101990 0x7fe750075f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00b3d0 tx=0x7fe74c00b890 comp rx=0 tx=0).stop 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 shutdown_connections 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe73c06e2b0 0x7fe73c070770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe750102b90 0x7fe7500745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 --2- 172.21.15.118:0/2114997654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe750101990 0x7fe750075f20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 >> 172.21.15.118:0/2114997654 conn(0x7fe7500fd140 msgr2=0x7fe750106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 shutdown_connections 2024-09-21T11:36:14.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:14.386+0000 7fe7572b6640 1 -- 172.21.15.118:0/2114997654 wait complete. 2024-09-21T11:36:15.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T11:36:15.342 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:15.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.770+0000 7f51b5542640 1 -- 172.21.15.118:0/3202880498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 msgr2=0x7f51b01070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:15.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.770+0000 7f51b5542640 1 --2- 172.21.15.118:0/3202880498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 0x7f51b01070f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f51a40098b0 tx=0x7f51a402a4d0 comp rx=0 tx=0).stop 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.770+0000 7f51b5542640 1 -- 172.21.15.118:0/3202880498 shutdown_connections 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.770+0000 7f51b5542640 1 --2- 172.21.15.118:0/3202880498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 0x7f51b01070f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.770+0000 7f51b5542640 1 --2- 172.21.15.118:0/3202880498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b01023d0 0x7f51b01047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.770+0000 7f51b5542640 1 -- 172.21.15.118:0/3202880498 >> 172.21.15.118:0/3202880498 conn(0x7f51b00fbff0 msgr2=0x7f51b00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.770+0000 7f51b5542640 1 -- 172.21.15.118:0/3202880498 shutdown_connections 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.770+0000 7f51b5542640 1 -- 172.21.15.118:0/3202880498 wait complete. 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51b5542640 1 Processor -- start 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51b5542640 1 -- start start 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51b5542640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b01023d0 0x7f51b0197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51b5542640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 0x7f51b0197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51b5542640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f51b010a770 con 0x7f51b0104d00 2024-09-21T11:36:15.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51b5542640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f51b010a5f0 con 0x7f51b01023d0 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51ae7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 0x7f51b0197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51ae7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 0x7f51b0197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35468/0 (socket says 172.21.15.118:35468) 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51ae7fc640 1 -- 172.21.15.118:0/2811912189 learned_addr learned my addr 172.21.15.118:0/2811912189 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51aeffd640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b01023d0 0x7f51b0197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51ae7fc640 1 -- 172.21.15.118:0/2811912189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b01023d0 msgr2=0x7f51b0197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51ae7fc640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b01023d0 0x7f51b0197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.771+0000 7f51ae7fc640 1 -- 172.21.15.118:0/2811912189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b01980d0 con 0x7f51b0104d00 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.772+0000 7f51ae7fc640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 0x7f51b0197a50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009230 tx=0x7f51a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.772+0000 7f5197fff640 1 -- 172.21.15.118:0/2811912189 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51a403f070 con 0x7f51b0104d00 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.772+0000 7f5197fff640 1 -- 172.21.15.118:0/2811912189 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51a4004a50 con 0x7f51b0104d00 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.772+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b019cab0 con 0x7f51b0104d00 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.772+0000 7f5197fff640 1 -- 172.21.15.118:0/2811912189 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51a4035030 con 0x7f51b0104d00 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.772+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b019d040 con 0x7f51b0104d00 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.773+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b01027b0 con 0x7f51b0104d00 2024-09-21T11:36:15.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.773+0000 7f5197fff640 1 -- 172.21.15.118:0/2811912189 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f51a4042070 con 0x7f51b0104d00 2024-09-21T11:36:15.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.774+0000 7f5197fff640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f519806e2b0 0x7f5198070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:15.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.774+0000 7f5197fff640 1 -- 172.21.15.118:0/2811912189 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f51a40ae900 con 0x7f51b0104d00 2024-09-21T11:36:15.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.775+0000 7f51aeffd640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f519806e2b0 0x7f5198070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:15.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.775+0000 7f51aeffd640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f519806e2b0 0x7f5198070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51a000bbe0 tx=0x7f51a000b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:15.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.779+0000 7f5197fff640 1 -- 172.21.15.118:0/2811912189 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51a4080250 con 0x7f51b0104d00 2024-09-21T11:36:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.952+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f51b01057c0 con 0x7f519806e2b0 2024-09-21T11:36:15.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.960+0000 7f5197fff640 1 -- 172.21.15.118:0/2811912189 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7f51b01057c0 con 0x7f519806e2b0 2024-09-21T11:36:15.963 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:36:15.963 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (3m) 2m ago 5m 24.7M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:36:15.963 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (5m) 2m ago 5m 7696k - 19.1.1-373-g4e45e6b4 164465d2334a f027b8fa4d1f 2024-09-21T11:36:15.963 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (4m) 45s ago 4m 5268k - 19.1.1-373-g4e45e6b4 164465d2334a b67cebd3ec35 2024-09-21T11:36:15.963 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (5m) 2m ago 5m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:36:15.963 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (4m) 45s ago 4m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:36:15.963 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (3m) 2m ago 4m 74.4M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:36:15.963 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:9283,8765,8443 running (6m) 2m ago 6m 489M - 19.1.1-373-g4e45e6b4 164465d2334a 74626178eaa8 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (4m) 45s ago 4m 442M - 19.1.1-373-g4e45e6b4 164465d2334a 13c5d2f4c157 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (6m) 2m ago 6m 45.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (4m) 45s ago 4m 39.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (5m) 2m ago 5m 15.7M - 1.5.0 0da6a335fe13 92cdb77bc8bc 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (4m) 45s ago 4m 15.4M - 1.5.0 0da6a335fe13 1a6e8f960a5b 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (3m) 2m ago 3m 37.5M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (2m) 2m ago 2m 38.9M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (2m) 2m ago 2m 11.6M 3946M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (104s) 45s ago 103s 47.6M 1213M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (77s) 45s ago 76s 37.3M 1213M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (50s) 45s ago 50s 11.7M 1213M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:36:15.964 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (3m) 2m ago 4m 42.5M - 2.43.0 a07b618ecd1d 44053d283e3b 2024-09-21T11:36:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.962+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f519806e2b0 msgr2=0x7f5198070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.962+0000 7f51b5542640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f519806e2b0 0x7f5198070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51a000bbe0 tx=0x7f51a000b390 comp rx=0 tx=0).stop 2024-09-21T11:36:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.962+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 msgr2=0x7f51b0197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.962+0000 7f51b5542640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 0x7f51b0197a50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009230 tx=0x7f51a40045e0 comp rx=0 tx=0).stop 2024-09-21T11:36:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.963+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 shutdown_connections 2024-09-21T11:36:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.963+0000 7f51b5542640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f519806e2b0 0x7f5198070770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:15.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.963+0000 7f51b5542640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51b0104d00 0x7f51b0197a50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:15.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.963+0000 7f51b5542640 1 --2- 172.21.15.118:0/2811912189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51b01023d0 0x7f51b0197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:15.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.963+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 >> 172.21.15.118:0/2811912189 conn(0x7f51b00fbff0 msgr2=0x7f51b00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:15.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.963+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 shutdown_connections 2024-09-21T11:36:15.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:15.963+0000 7f51b5542640 1 -- 172.21.15.118:0/2811912189 wait complete. 2024-09-21T11:36:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:15 smithi118 ceph-mon[28757]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:15 smithi118 ceph-mon[28757]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:16.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:15 smithi149 ceph-mon[36123]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:16.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:15 smithi149 ceph-mon[36123]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:16.678 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T11:36:16.923 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:17.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.352+0000 7f85fe066640 1 -- 172.21.15.118:0/438226746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 msgr2=0x7f85f81070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:17.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.352+0000 7f85fe066640 1 --2- 172.21.15.118:0/438226746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 0x7f85f81070f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f85e00098b0 tx=0x7f85e002a4d0 comp rx=0 tx=0).stop 2024-09-21T11:36:17.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 -- 172.21.15.118:0/438226746 shutdown_connections 2024-09-21T11:36:17.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 --2- 172.21.15.118:0/438226746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 0x7f85f81070f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 --2- 172.21.15.118:0/438226746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f81023d0 0x7f85f81047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 -- 172.21.15.118:0/438226746 >> 172.21.15.118:0/438226746 conn(0x7f85f80fbff0 msgr2=0x7f85f80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 -- 172.21.15.118:0/438226746 shutdown_connections 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 -- 172.21.15.118:0/438226746 wait complete. 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 Processor -- start 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 -- start start 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f81023d0 0x7f85f8197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 0x7f85f8197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f85f810a790 con 0x7f85f8104d00 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.353+0000 7f85fe066640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85f810a610 con 0x7f85f81023d0 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85eeffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 0x7f85f8197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85eeffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 0x7f85f8197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35482/0 (socket says 172.21.15.118:35482) 2024-09-21T11:36:17.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85eeffd640 1 -- 172.21.15.118:0/1777653417 learned_addr learned my addr 172.21.15.118:0/1777653417 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85eeffd640 1 -- 172.21.15.118:0/1777653417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f81023d0 msgr2=0x7f85f8197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85f77fe640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f81023d0 0x7f85f8197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85eeffd640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f81023d0 0x7f85f8197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85eeffd640 1 -- 172.21.15.118:0/1777653417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f81980e0 con 0x7f85f8104d00 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85f77fe640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f81023d0 0x7f85f8197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85eeffd640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 0x7f85f8197a60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009230 tx=0x7f85e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85f57fa640 1 -- 172.21.15.118:0/1777653417 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85e003f070 con 0x7f85f8104d00 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85f57fa640 1 -- 172.21.15.118:0/1777653417 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85e00044d0 con 0x7f85f8104d00 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f819cac0 con 0x7f85f8104d00 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85f57fa640 1 -- 172.21.15.118:0/1777653417 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85e0035030 con 0x7f85f8104d00 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.354+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f819d050 con 0x7f85f8104d00 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.355+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f81027b0 con 0x7f85f8104d00 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.356+0000 7f85f57fa640 1 -- 172.21.15.118:0/1777653417 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f85e0042070 con 0x7f85f8104d00 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.356+0000 7f85f57fa640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f85e406e2b0 0x7f85e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:17.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.356+0000 7f85f57fa640 1 -- 172.21.15.118:0/1777653417 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f85e00aea90 con 0x7f85f8104d00 2024-09-21T11:36:17.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.356+0000 7f85f77fe640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f85e406e2b0 0x7f85e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:17.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.357+0000 7f85f77fe640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f85e406e2b0 0x7f85e4070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85e80058c0 tx=0x7f85e8005d30 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:17.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.361+0000 7f85f57fa640 1 -- 172.21.15.118:0/1777653417 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f85e007c730 con 0x7f85f8104d00 2024-09-21T11:36:17.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.534+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f85f8105700 con 0x7f85e406e2b0 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.539+0000 7f85f57fa640 1 -- 172.21.15.118:0/1777653417 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1310 (secure 0 0 0) 0x7f85f8105700 con 0x7f85e406e2b0 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:crash 2/2 2m ago 5m * 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:mgr 2/2 2m ago 5m count:2 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:mon 2/2 2m ago 5m smithi118:172.21.15.118=smithi118;smithi149:172.21.15.149=smithi149;count:2 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:osd 6 2m ago - 2024-09-21T11:36:17.541 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-21T11:36:17.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f85e406e2b0 msgr2=0x7f85e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:17.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f85e406e2b0 0x7f85e4070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85e80058c0 tx=0x7f85e8005d30 comp rx=0 tx=0).stop 2024-09-21T11:36:17.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 msgr2=0x7f85f8197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:17.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 0x7f85f8197a60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009230 tx=0x7f85e00048f0 comp rx=0 tx=0).stop 2024-09-21T11:36:17.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 shutdown_connections 2024-09-21T11:36:17.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f85e406e2b0 0x7f85e4070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:17.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85f8104d00 0x7f85f8197a60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:17.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 --2- 172.21.15.118:0/1777653417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f81023d0 0x7f85f8197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:17.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 >> 172.21.15.118:0/1777653417 conn(0x7f85f80fbff0 msgr2=0x7f85f80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:17.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 shutdown_connections 2024-09-21T11:36:17.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:17.541+0000 7f85fe066640 1 -- 172.21.15.118:0/1777653417 wait complete. 2024-09-21T11:36:18.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:17 smithi118 ceph-mon[28757]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:18.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:17 smithi118 ceph-mon[28757]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:18.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:17 smithi149 ceph-mon[36123]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:18.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:17 smithi149 ceph-mon[36123]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:18.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T11:36:18.473 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:18.909 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:18 smithi118 ceph-mon[28757]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.988+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/344705187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8100880 msgr2=0x7f4fc8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.988+0000 7f4fcc8ab640 1 --2- 172.21.15.118:0/344705187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8100880 0x7f4fc8100c80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009880 tx=0x7f4fb802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.988+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/344705187 shutdown_connections 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.988+0000 7f4fcc8ab640 1 --2- 172.21.15.118:0/344705187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fc8101a80 0x7f4fc8101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.988+0000 7f4fcc8ab640 1 --2- 172.21.15.118:0/344705187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8100880 0x7f4fc8100c80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.988+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/344705187 >> 172.21.15.118:0/344705187 conn(0x7f4fc80fc010 msgr2=0x7f4fc80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.988+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/344705187 shutdown_connections 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.988+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/344705187 wait complete. 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fcc8ab640 1 Processor -- start 2024-09-21T11:36:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fcc8ab640 1 -- start start 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fcc8ab640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fc8100880 0x7f4fc806ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fcc8ab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8101a80 0x7f4fc819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fcc8ab640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8109720 con 0x7f4fc8101a80 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fcc8ab640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81095a0 con 0x7f4fc8100880 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fbffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8101a80 0x7f4fc819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fbffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8101a80 0x7f4fc819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35502/0 (socket says 172.21.15.118:35502) 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fbffff640 1 -- 172.21.15.118:0/182506650 learned_addr learned my addr 172.21.15.118:0/182506650 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fc659c640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fc8100880 0x7f4fc806ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fbffff640 1 -- 172.21.15.118:0/182506650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fc8100880 msgr2=0x7f4fc806ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fbffff640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fc8100880 0x7f4fc806ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.989+0000 7f4fbffff640 1 -- 172.21.15.118:0/182506650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc819c820 con 0x7f4fc8101a80 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.990+0000 7f4fbffff640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8101a80 0x7f4fc819c230 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000b420 tx=0x7f4fb000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:18.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.990+0000 7f4fbf7fe640 1 -- 172.21.15.118:0/182506650 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fb0011630 con 0x7f4fc8101a80 2024-09-21T11:36:18.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.990+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc819cb10 con 0x7f4fc8101a80 2024-09-21T11:36:18.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.990+0000 7f4fbf7fe640 1 -- 172.21.15.118:0/182506650 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fb0016070 con 0x7f4fc8101a80 2024-09-21T11:36:18.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.990+0000 7f4fbf7fe640 1 -- 172.21.15.118:0/182506650 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fb0010d40 con 0x7f4fc8101a80 2024-09-21T11:36:18.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.990+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc819d120 con 0x7f4fc8101a80 2024-09-21T11:36:18.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.991+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc8100c80 con 0x7f4fc8101a80 2024-09-21T11:36:18.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.991+0000 7f4fbf7fe640 1 -- 172.21.15.118:0/182506650 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f4fb001b460 con 0x7f4fc8101a80 2024-09-21T11:36:18.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.992+0000 7f4fbf7fe640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4fb406e2b0 0x7f4fb4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:18.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.992+0000 7f4fbf7fe640 1 -- 172.21.15.118:0/182506650 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f4fb008d690 con 0x7f4fc8101a80 2024-09-21T11:36:18.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.992+0000 7f4fc659c640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4fb406e2b0 0x7f4fb4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:18.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.992+0000 7f4fc659c640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4fb406e2b0 0x7f4fb4070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009230 tx=0x7f4fb80058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:18.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:18.996+0000 7f4fbf7fe640 1 -- 172.21.15.118:0/182506650 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4fb005b2a0 con 0x7f4fc8101a80 2024-09-21T11:36:19.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.170+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f4fc8062630 con 0x7f4fb406e2b0 2024-09-21T11:36:19.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.172+0000 7f4fbf7fe640 1 -- 172.21.15.118:0/182506650 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7f4fc8062630 con 0x7f4fb406e2b0 2024-09-21T11:36:19.174 INFO:teuthology.orchestra.run.smithi118.stdout:HOST ADDR LABELS STATUS 2024-09-21T11:36:19.175 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118 172.21.15.118 2024-09-21T11:36:19.175 INFO:teuthology.orchestra.run.smithi118.stdout:smithi149 172.21.15.149 2024-09-21T11:36:19.175 INFO:teuthology.orchestra.run.smithi118.stdout:2 hosts in cluster 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4fb406e2b0 msgr2=0x7f4fb4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4fb406e2b0 0x7f4fb4070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009230 tx=0x7f4fb80058d0 comp rx=0 tx=0).stop 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8101a80 msgr2=0x7f4fc819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8101a80 0x7f4fc819c230 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000b420 tx=0x7f4fb000b8e0 comp rx=0 tx=0).stop 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 shutdown_connections 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4fb406e2b0 0x7f4fb4070770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fc8101a80 0x7f4fc819c230 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 --2- 172.21.15.118:0/182506650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fc8100880 0x7f4fc806ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 >> 172.21.15.118:0/182506650 conn(0x7f4fc80fc010 msgr2=0x7f4fc8104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 shutdown_connections 2024-09-21T11:36:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:19.174+0000 7f4fcc8ab640 1 -- 172.21.15.118:0/182506650 wait complete. 2024-09-21T11:36:19.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:18 smithi149 ceph-mon[36123]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:19.791 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T11:36:20.036 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:19 smithi118 ceph-mon[28757]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:20.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:19 smithi149 ceph-mon[36123]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:20.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.436+0000 7f9e298c1640 1 -- 172.21.15.118:0/714150105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e241023f0 msgr2=0x7f9e241047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:20.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.436+0000 7f9e298c1640 1 --2- 172.21.15.118:0/714150105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e241023f0 0x7f9e241047e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009c50 tx=0x7f9e1402a9a0 comp rx=0 tx=0).stop 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.436+0000 7f9e298c1640 1 -- 172.21.15.118:0/714150105 shutdown_connections 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.436+0000 7f9e298c1640 1 --2- 172.21.15.118:0/714150105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e24104d20 0x7f9e24107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.436+0000 7f9e298c1640 1 --2- 172.21.15.118:0/714150105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e241023f0 0x7f9e241047e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.436+0000 7f9e298c1640 1 -- 172.21.15.118:0/714150105 >> 172.21.15.118:0/714150105 conn(0x7f9e240fbff0 msgr2=0x7f9e240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.437+0000 7f9e298c1640 1 -- 172.21.15.118:0/714150105 shutdown_connections 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.437+0000 7f9e298c1640 1 -- 172.21.15.118:0/714150105 wait complete. 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.437+0000 7f9e298c1640 1 Processor -- start 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.437+0000 7f9e298c1640 1 -- start start 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.437+0000 7f9e298c1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e241023f0 0x7f9e241975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e298c1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e24104d20 0x7f9e24197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e298c1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2410a830 con 0x7f9e24104d20 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e298c1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2410a6b0 con 0x7f9e241023f0 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e227fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e24104d20 0x7f9e24197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:20.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e227fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e24104d20 0x7f9e24197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35512/0 (socket says 172.21.15.118:35512) 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e227fc640 1 -- 172.21.15.118:0/1300660622 learned_addr learned my addr 172.21.15.118:0/1300660622 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e22ffd640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e241023f0 0x7f9e241975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e227fc640 1 -- 172.21.15.118:0/1300660622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e241023f0 msgr2=0x7f9e241975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e227fc640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e241023f0 0x7f9e241975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e227fc640 1 -- 172.21.15.118:0/1300660622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e24198180 con 0x7f9e24104d20 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e227fc640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e24104d20 0x7f9e24197b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00b3d0 tx=0x7f9e0c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e288bf640 1 -- 172.21.15.118:0/1300660622 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e0c015020 con 0x7f9e24104d20 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e288bf640 1 -- 172.21.15.118:0/1300660622 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e0c011af0 con 0x7f9e24104d20 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2419cbc0 con 0x7f9e24104d20 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e288bf640 1 -- 172.21.15.118:0/1300660622 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e0c010d30 con 0x7f9e24104d20 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.438+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e2419d1d0 con 0x7f9e24104d20 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.439+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e24102850 con 0x7f9e24104d20 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.440+0000 7f9e288bf640 1 -- 172.21.15.118:0/1300660622 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f9e0c018020 con 0x7f9e24104d20 2024-09-21T11:36:20.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.440+0000 7f9e288bf640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9e1006e310 0x7f9e100707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:20.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.441+0000 7f9e288bf640 1 -- 172.21.15.118:0/1300660622 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f9e0c08d780 con 0x7f9e24104d20 2024-09-21T11:36:20.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.441+0000 7f9e22ffd640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9e1006e310 0x7f9e100707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:20.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.441+0000 7f9e22ffd640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9e1006e310 0x7f9e100707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e14000f80 tx=0x7f9e14009360 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:20.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.445+0000 7f9e288bf640 1 -- 172.21.15.118:0/1300660622 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e0c01f020 con 0x7f9e24104d20 2024-09-21T11:36:20.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.618+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f9e24105760 con 0x7f9e1006e310 2024-09-21T11:36:20.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.619+0000 7f9e288bf640 1 -- 172.21.15.118:0/1300660622 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f9e24105760 con 0x7f9e1006e310 2024-09-21T11:36:20.622 INFO:teuthology.orchestra.run.smithi118.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T11:36:20.622 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747500JS480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-21T11:36:20.622 INFO:teuthology.orchestra.run.smithi118.stdout:smithi149 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CK400BGN 372G No 46s ago Has a FileSystem, LVM detected 2024-09-21T11:36:20.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.621+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9e1006e310 msgr2=0x7f9e100707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:20.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.621+0000 7f9e298c1640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9e1006e310 0x7f9e100707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e14000f80 tx=0x7f9e14009360 comp rx=0 tx=0).stop 2024-09-21T11:36:20.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.621+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e24104d20 msgr2=0x7f9e24197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:20.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.621+0000 7f9e298c1640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e24104d20 0x7f9e24197b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00b3d0 tx=0x7f9e0c00b890 comp rx=0 tx=0).stop 2024-09-21T11:36:20.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.621+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 shutdown_connections 2024-09-21T11:36:20.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.621+0000 7f9e298c1640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f9e1006e310 0x7f9e100707d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:20.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.622+0000 7f9e298c1640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e24104d20 0x7f9e24197b00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:20.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.622+0000 7f9e298c1640 1 --2- 172.21.15.118:0/1300660622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e241023f0 0x7f9e241975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:20.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.622+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 >> 172.21.15.118:0/1300660622 conn(0x7f9e240fbff0 msgr2=0x7f9e240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:20.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.622+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 shutdown_connections 2024-09-21T11:36:20.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:20.622+0000 7f9e298c1640 1 -- 172.21.15.118:0/1300660622 wait complete. 2024-09-21T11:36:21.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:20 smithi118 ceph-mon[28757]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:20 smithi149 ceph-mon[36123]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:21.238 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T11:36:21.247 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:36:21.247 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-21T11:36:21.489 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:21.896 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:21 smithi118 ceph-mon[28757]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:21.896 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:21 smithi118 ceph-mon[28757]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:21.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.894+0000 7f9908990640 1 -- 172.21.15.118:0/2702794948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 msgr2=0x7f9904100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:21.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.894+0000 7f9908990640 1 --2- 172.21.15.118:0/2702794948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 0x7f9904100c40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009880 tx=0x7f98f402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.894+0000 7f9908990640 1 -- 172.21.15.118:0/2702794948 shutdown_connections 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.894+0000 7f9908990640 1 --2- 172.21.15.118:0/2702794948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9904101a40 0x7f9904101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.894+0000 7f9908990640 1 --2- 172.21.15.118:0/2702794948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 0x7f9904100c40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.894+0000 7f9908990640 1 -- 172.21.15.118:0/2702794948 >> 172.21.15.118:0/2702794948 conn(0x7f99040fbff0 msgr2=0x7f99040fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.894+0000 7f9908990640 1 -- 172.21.15.118:0/2702794948 shutdown_connections 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.894+0000 7f9908990640 1 -- 172.21.15.118:0/2702794948 wait complete. 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f9908990640 1 Processor -- start 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f9908990640 1 -- start start 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f9908990640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 0x7f9904104760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f9908990640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9904101a40 0x7f9904102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f9908990640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f99041096e0 con 0x7f9904100840 2024-09-21T11:36:21.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f9908990640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9904109560 con 0x7f9904101a40 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f990259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 0x7f9904104760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f990259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 0x7f9904104760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35532/0 (socket says 172.21.15.118:35532) 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f990259c640 1 -- 172.21.15.118:0/2001827493 learned_addr learned my addr 172.21.15.118:0/2001827493 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f990259c640 1 -- 172.21.15.118:0/2001827493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9904101a40 msgr2=0x7f9904102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f9901d9b640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9904101a40 0x7f9904102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f990259c640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9904101a40 0x7f9904102e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.895+0000 7f990259c640 1 -- 172.21.15.118:0/2001827493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9904103360 con 0x7f9904100840 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.896+0000 7f990259c640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 0x7f9904104760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f98f4006010 tx=0x7f98f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.896+0000 7f98f37fe640 1 -- 172.21.15.118:0/2001827493 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f98f403f070 con 0x7f9904100840 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.896+0000 7f98f37fe640 1 -- 172.21.15.118:0/2001827493 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f98f40044d0 con 0x7f9904100840 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.896+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99041035f0 con 0x7f9904100840 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.896+0000 7f98f37fe640 1 -- 172.21.15.118:0/2001827493 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f98f4035030 con 0x7f9904100840 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.896+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9904103ba0 con 0x7f9904100840 2024-09-21T11:36:21.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.897+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9904100c40 con 0x7f9904100840 2024-09-21T11:36:21.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.897+0000 7f98f37fe640 1 -- 172.21.15.118:0/2001827493 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f98f4042070 con 0x7f9904100840 2024-09-21T11:36:21.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.898+0000 7f98f37fe640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f98ec06e2b0 0x7f98ec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:21.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.898+0000 7f98f37fe640 1 -- 172.21.15.118:0/2001827493 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f98f40aeae0 con 0x7f9904100840 2024-09-21T11:36:21.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.898+0000 7f9901d9b640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f98ec06e2b0 0x7f98ec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:21.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.898+0000 7f9901d9b640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f98ec06e2b0 0x7f98ec070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f99041044e0 tx=0x7f98f8008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:21.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:21.902+0000 7f98f37fe640 1 -- 172.21.15.118:0/2001827493 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98f407c780 con 0x7f9904100840 2024-09-21T11:36:22.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:22.092+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7f990406a2f0 con 0x7f98ec06e2b0 2024-09-21T11:36:22.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:21 smithi149 ceph-mon[36123]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:22.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:21 smithi149 ceph-mon[36123]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:22.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:22 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T11:36:23.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:22 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T11:36:23.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.804+0000 7f98f37fe640 1 -- 172.21.15.118:0/2001827493 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f990406a2f0 con 0x7f98ec06e2b0 2024-09-21T11:36:23.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.806+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f98ec06e2b0 msgr2=0x7f98ec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:23.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.806+0000 7f9908990640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f98ec06e2b0 0x7f98ec070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f99041044e0 tx=0x7f98f8008040 comp rx=0 tx=0).stop 2024-09-21T11:36:23.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.806+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 msgr2=0x7f9904104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:23.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.806+0000 7f9908990640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 0x7f9904104760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f98f4006010 tx=0x7f98f40048f0 comp rx=0 tx=0).stop 2024-09-21T11:36:23.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.807+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 shutdown_connections 2024-09-21T11:36:23.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.807+0000 7f9908990640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f98ec06e2b0 0x7f98ec070770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:23.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.807+0000 7f9908990640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9904101a40 0x7f9904102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:23.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.807+0000 7f9908990640 1 --2- 172.21.15.118:0/2001827493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9904100840 0x7f9904104760 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:23.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.807+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 >> 172.21.15.118:0/2001827493 conn(0x7f99040fbff0 msgr2=0x7f9904069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:23.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.807+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 shutdown_connections 2024-09-21T11:36:23.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:23.807+0000 7f9908990640 1 -- 172.21.15.118:0/2001827493 wait complete. 2024-09-21T11:36:24.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:23 smithi118 ceph-mon[28757]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:24.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:23 smithi118 ceph-mon[28757]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:24.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T11:36:24.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:23 smithi118 ceph-mon[28757]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T11:36:24.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T11:36:24.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:36:24.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:23 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[28753]: 2024-09-21T11:36:23.784+0000 7f8185e0a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T11:36:24.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:23 smithi149 ceph-mon[36123]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:36:24.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:23 smithi149 ceph-mon[36123]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:24.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T11:36:24.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:23 smithi149 ceph-mon[36123]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T11:36:24.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T11:36:24.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:36:24.465 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T11:36:24.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T11:36:24.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T11:36:24.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T11:36:24.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T11:36:24.998 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: fsmap cephfs:0 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: Saving service mds.cephfs spec with placement count:4 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.ciljqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.ciljqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T11:36:24.999 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T11:36:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T11:36:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T11:36:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T11:36:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T11:36:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: fsmap cephfs:0 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: Saving service mds.cephfs spec with placement count:4 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.ciljqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.ciljqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T11:36:25.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:25.722 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:25.941 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:25 smithi118 ceph-mon[28757]: Deploying daemon mds.cephfs.smithi118.ciljqr on smithi118 2024-09-21T11:36:25.941 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:25 smithi118 ceph-mon[28757]: pgmap v173: 65 pgs: 8 creating+peering, 49 unknown, 8 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:25.941 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:25 smithi118 ceph-mon[28757]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T11:36:26.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:25 smithi149 ceph-mon[36123]: Deploying daemon mds.cephfs.smithi118.ciljqr on smithi118 2024-09-21T11:36:26.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:25 smithi149 ceph-mon[36123]: pgmap v173: 65 pgs: 8 creating+peering, 49 unknown, 8 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:26.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:25 smithi149 ceph-mon[36123]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T11:36:26.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.311+0000 7fdb5dae1640 1 -- 172.21.15.118:0/2732662572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58101a40 msgr2=0x7fdb58101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:26.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.311+0000 7fdb5dae1640 1 --2- 172.21.15.118:0/2732662572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58101a40 0x7fdb58101ec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009880 tx=0x7fdb4c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:26.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.311+0000 7fdb5dae1640 1 -- 172.21.15.118:0/2732662572 shutdown_connections 2024-09-21T11:36:26.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.311+0000 7fdb5dae1640 1 --2- 172.21.15.118:0/2732662572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58101a40 0x7fdb58101ec0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.311+0000 7fdb5dae1640 1 --2- 172.21.15.118:0/2732662572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58100840 0x7fdb58100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.311+0000 7fdb5dae1640 1 -- 172.21.15.118:0/2732662572 >> 172.21.15.118:0/2732662572 conn(0x7fdb580fbff0 msgr2=0x7fdb580fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.311+0000 7fdb5dae1640 1 -- 172.21.15.118:0/2732662572 shutdown_connections 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.311+0000 7fdb5dae1640 1 -- 172.21.15.118:0/2732662572 wait complete. 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb5dae1640 1 Processor -- start 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb5dae1640 1 -- start start 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb5dae1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58100840 0x7fdb58197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb5dae1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101a40 0x7fdb58197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb5dae1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58109700 con 0x7fdb58100840 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb5dae1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58109580 con 0x7fdb58101a40 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb577fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58100840 0x7fdb58197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb577fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58100840 0x7fdb58197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38844/0 (socket says 172.21.15.118:38844) 2024-09-21T11:36:26.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb577fe640 1 -- 172.21.15.118:0/866796035 learned_addr learned my addr 172.21.15.118:0/866796035 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb56ffd640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101a40 0x7fdb58197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb577fe640 1 -- 172.21.15.118:0/866796035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101a40 msgr2=0x7fdb58197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb577fe640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101a40 0x7fdb58197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.312+0000 7fdb577fe640 1 -- 172.21.15.118:0/866796035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb581980e0 con 0x7fdb58100840 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.313+0000 7fdb577fe640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58100840 0x7fdb58197520 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800b3d0 tx=0x7fdb4800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.313+0000 7fdb54ff9640 1 -- 172.21.15.118:0/866796035 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb48015020 con 0x7fdb58100840 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.313+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5819cb20 con 0x7fdb58100840 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.313+0000 7fdb54ff9640 1 -- 172.21.15.118:0/866796035 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb48011af0 con 0x7fdb58100840 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.313+0000 7fdb54ff9640 1 -- 172.21.15.118:0/866796035 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb48010da0 con 0x7fdb58100840 2024-09-21T11:36:26.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.313+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5819d0b0 con 0x7fdb58100840 2024-09-21T11:36:26.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.314+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb58100c40 con 0x7fdb58100840 2024-09-21T11:36:26.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.314+0000 7fdb54ff9640 1 -- 172.21.15.118:0/866796035 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fdb48018020 con 0x7fdb58100840 2024-09-21T11:36:26.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.315+0000 7fdb54ff9640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdb4006e2b0 0x7fdb40070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:26.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.315+0000 7fdb54ff9640 1 -- 172.21.15.118:0/866796035 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fdb4808dcd0 con 0x7fdb58100840 2024-09-21T11:36:26.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.315+0000 7fdb56ffd640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdb4006e2b0 0x7fdb40070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:26.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.315+0000 7fdb56ffd640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdb4006e2b0 0x7fdb40070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdb581989d0 tx=0x7fdb4c005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:26.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.319+0000 7fdb54ff9640 1 -- 172.21.15.118:0/866796035 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb4801f020 con 0x7fdb58100840 2024-09-21T11:36:26.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.538+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fdb5819d9c0 con 0x7fdb58100840 2024-09-21T11:36:26.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.539+0000 7fdb54ff9640 1 -- 172.21.15.118:0/866796035 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7fdb4805b630 con 0x7fdb58100840 2024-09-21T11:36:26.542 INFO:teuthology.orchestra.run.smithi118.stdout:e2 2024-09-21T11:36:26.542 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:23:785689+0000 2024-09-21T11:36:26.542 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:36:26.542 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:36:26.542 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:36:26.542 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:26.542 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:36:26.542 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 2 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:23.785634+0000 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 0 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:36:26.543 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 1 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:in 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data disabled 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 0 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:26.544 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:26.545 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 2 2024-09-21T11:36:26.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.541+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdb4006e2b0 msgr2=0x7fdb40070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:26.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.541+0000 7fdb5dae1640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdb4006e2b0 0x7fdb40070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdb581989d0 tx=0x7fdb4c005a20 comp rx=0 tx=0).stop 2024-09-21T11:36:26.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.541+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58100840 msgr2=0x7fdb58197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:26.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.541+0000 7fdb5dae1640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58100840 0x7fdb58197520 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800b3d0 tx=0x7fdb4800b890 comp rx=0 tx=0).stop 2024-09-21T11:36:26.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.541+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 shutdown_connections 2024-09-21T11:36:26.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.541+0000 7fdb5dae1640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fdb4006e2b0 0x7fdb40070770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:26.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.541+0000 7fdb5dae1640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101a40 0x7fdb58197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:26.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.541+0000 7fdb5dae1640 1 --2- 172.21.15.118:0/866796035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb58100840 0x7fdb58197520 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:26.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.541+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 >> 172.21.15.118:0/866796035 conn(0x7fdb580fbff0 msgr2=0x7fdb580fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:26.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.542+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 shutdown_connections 2024-09-21T11:36:26.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:26.542+0000 7fdb5dae1640 1 -- 172.21.15.118:0/866796035 wait complete. 2024-09-21T11:36:27.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:26 smithi118 ceph-mon[28757]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T11:36:27.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:26 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/866796035' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T11:36:27.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:26 smithi149 ceph-mon[36123]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T11:36:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:26 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/866796035' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T11:36:27.507 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T11:36:27.523 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:36:27.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-21T11:36:27.788 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:27.910 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:27 smithi118 ceph-mon[28757]: pgmap v176: 65 pgs: 14 creating+peering, 12 unknown, 39 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:27.910 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:27 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:27.910 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:27 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:27.910 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:27 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:27.910 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:27 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zgoqsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T11:36:27.910 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:27 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zgoqsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T11:36:27.910 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:27 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:28.128 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:27 smithi149 ceph-mon[36123]: pgmap v176: 65 pgs: 14 creating+peering, 12 unknown, 39 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:36:28.128 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:27 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:28.128 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:27 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:28.129 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:27 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:28.129 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:27 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zgoqsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T11:36:28.129 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:27 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zgoqsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T11:36:28.129 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:27 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.266+0000 7f2c98a5b640 1 -- 172.21.15.118:0/233260050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 msgr2=0x7f2c94101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.266+0000 7f2c98a5b640 1 --2- 172.21.15.118:0/233260050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 0x7f2c94101ec0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009880 tx=0x7f2c7c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.266+0000 7f2c98a5b640 1 -- 172.21.15.118:0/233260050 shutdown_connections 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.266+0000 7f2c98a5b640 1 --2- 172.21.15.118:0/233260050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 0x7f2c94101ec0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.266+0000 7f2c98a5b640 1 --2- 172.21.15.118:0/233260050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c94100840 0x7f2c94100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.266+0000 7f2c98a5b640 1 -- 172.21.15.118:0/233260050 >> 172.21.15.118:0/233260050 conn(0x7f2c940fbff0 msgr2=0x7f2c940fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.266+0000 7f2c98a5b640 1 -- 172.21.15.118:0/233260050 shutdown_connections 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.266+0000 7f2c98a5b640 1 -- 172.21.15.118:0/233260050 wait complete. 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c98a5b640 1 Processor -- start 2024-09-21T11:36:28.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c98a5b640 1 -- start start 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c98a5b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c94100840 0x7f2c94197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c98a5b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 0x7f2c94197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c98a5b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2c94109700 con 0x7f2c94101a40 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c98a5b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2c94109580 con 0x7f2c94100840 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c8bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 0x7f2c94197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c8bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 0x7f2c94197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38872/0 (socket says 172.21.15.118:38872) 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c8bfff640 1 -- 172.21.15.118:0/3033557681 learned_addr learned my addr 172.21.15.118:0/3033557681 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c9259c640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c94100840 0x7f2c94197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c8bfff640 1 -- 172.21.15.118:0/3033557681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c94100840 msgr2=0x7f2c94197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c8bfff640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c94100840 0x7f2c94197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:28.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c8bfff640 1 -- 172.21.15.118:0/3033557681 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c94198130 con 0x7f2c94101a40 2024-09-21T11:36:28.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.267+0000 7f2c8bfff640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 0x7f2c94197ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009230 tx=0x7f2c7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:28.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.268+0000 7f2c8b7fe640 1 -- 172.21.15.118:0/3033557681 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c7c03f070 con 0x7f2c94101a40 2024-09-21T11:36:28.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.268+0000 7f2c8b7fe640 1 -- 172.21.15.118:0/3033557681 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c7c0044d0 con 0x7f2c94101a40 2024-09-21T11:36:28.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.268+0000 7f2c8b7fe640 1 -- 172.21.15.118:0/3033557681 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c7c035030 con 0x7f2c94101a40 2024-09-21T11:36:28.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.268+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9419cb10 con 0x7f2c94101a40 2024-09-21T11:36:28.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.268+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9419d120 con 0x7f2c94101a40 2024-09-21T11:36:28.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.269+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c94100c20 con 0x7f2c94101a40 2024-09-21T11:36:28.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.269+0000 7f2c8b7fe640 1 -- 172.21.15.118:0/3033557681 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f2c7c042070 con 0x7f2c94101a40 2024-09-21T11:36:28.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.270+0000 7f2c8b7fe640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f2c8006e2b0 0x7f2c80070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:28.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.270+0000 7f2c8b7fe640 1 -- 172.21.15.118:0/3033557681 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f2c7c0aed80 con 0x7f2c94101a40 2024-09-21T11:36:28.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.270+0000 7f2c9259c640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f2c8006e2b0 0x7f2c80070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:28.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.270+0000 7f2c9259c640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f2c8006e2b0 0x7f2c80070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c941018a0 tx=0x7f2c84009110 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:28.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.274+0000 7f2c8b7fe640 1 -- 172.21.15.118:0/3033557681 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c7c07c6e0 con 0x7f2c94101a40 2024-09-21T11:36:28.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.482+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7f2c9419d3f0 con 0x7f2c94101a40 2024-09-21T11:36:28.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.811+0000 7f2c8b7fe640 1 -- 172.21.15.118:0/3033557681 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7f2c7c080390 con 0x7f2c94101a40 2024-09-21T11:36:28.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.813+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f2c8006e2b0 msgr2=0x7f2c80070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:28.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.813+0000 7f2c98a5b640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f2c8006e2b0 0x7f2c80070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c941018a0 tx=0x7f2c84009110 comp rx=0 tx=0).stop 2024-09-21T11:36:28.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.813+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 msgr2=0x7f2c94197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:28.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.813+0000 7f2c98a5b640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 0x7f2c94197ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009230 tx=0x7f2c7c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:36:28.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.813+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 shutdown_connections 2024-09-21T11:36:28.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.813+0000 7f2c98a5b640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f2c8006e2b0 0x7f2c80070770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:28.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.813+0000 7f2c98a5b640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c94101a40 0x7f2c94197ab0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:28.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.813+0000 7f2c98a5b640 1 --2- 172.21.15.118:0/3033557681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c94100840 0x7f2c94197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:28.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.813+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 >> 172.21.15.118:0/3033557681 conn(0x7f2c940fbff0 msgr2=0x7f2c940fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:28.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.814+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 shutdown_connections 2024-09-21T11:36:28.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:28.814+0000 7f2c98a5b640 1 -- 172.21.15.118:0/3033557681 wait complete. 2024-09-21T11:36:29.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: Deploying daemon mds.cephfs.smithi149.zgoqsi on smithi149 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] up:boot 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: daemon mds.cephfs.smithi118.ciljqr assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: Cluster is now healthy 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: fsmap cephfs:0 1 up:standby 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"}]: dispatch 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: fsmap cephfs:1 {0=cephfs.smithi118.ciljqr=up:creating} 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: daemon mds.cephfs.smithi118.ciljqr is now active in filesystem cephfs as rank 0 2024-09-21T11:36:29.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:28 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3033557681' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: Deploying daemon mds.cephfs.smithi149.zgoqsi on smithi149 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] up:boot 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: daemon mds.cephfs.smithi118.ciljqr assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: Cluster is now healthy 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: fsmap cephfs:0 1 up:standby 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"}]: dispatch 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: fsmap cephfs:1 {0=cephfs.smithi118.ciljqr=up:creating} 2024-09-21T11:36:29.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: daemon mds.cephfs.smithi118.ciljqr is now active in filesystem cephfs as rank 0 2024-09-21T11:36:29.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:28 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3033557681' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-21T11:36:29.382 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T11:36:29.392 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:36:29.392 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-21T11:36:29.641 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:30.024 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:29 smithi118 ceph-mon[28757]: pgmap v177: 65 pgs: 11 creating+peering, 54 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 216 B/s wr, 0 op/s 2024-09-21T11:36:30.024 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:29 smithi118 ceph-mon[28757]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T11:36:30.024 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:29 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3033557681' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-21T11:36:30.024 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:29 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] up:active 2024-09-21T11:36:30.024 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:29 smithi118 ceph-mon[28757]: fsmap cephfs:1 {0=cephfs.smithi118.ciljqr=up:active} 2024-09-21T11:36:30.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.030+0000 7f22ea006640 1 -- 172.21.15.118:0/3744787099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 msgr2=0x7f22e4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:30.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.030+0000 7f22ea006640 1 --2- 172.21.15.118:0/3744787099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 0x7f22e4100c40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009880 tx=0x7f22d402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:30.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.030+0000 7f22ea006640 1 -- 172.21.15.118:0/3744787099 shutdown_connections 2024-09-21T11:36:30.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.030+0000 7f22ea006640 1 --2- 172.21.15.118:0/3744787099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22e4101a40 0x7f22e4101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:30.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.030+0000 7f22ea006640 1 --2- 172.21.15.118:0/3744787099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 0x7f22e4100c40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:30.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.030+0000 7f22ea006640 1 -- 172.21.15.118:0/3744787099 >> 172.21.15.118:0/3744787099 conn(0x7f22e40fbff0 msgr2=0x7f22e40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:30.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.030+0000 7f22ea006640 1 -- 172.21.15.118:0/3744787099 shutdown_connections 2024-09-21T11:36:30.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.030+0000 7f22ea006640 1 -- 172.21.15.118:0/3744787099 wait complete. 2024-09-21T11:36:30.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.031+0000 7f22ea006640 1 Processor -- start 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.031+0000 7f22ea006640 1 -- start start 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.031+0000 7f22ea006640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 0x7f22e41975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.031+0000 7f22ea006640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22e4101a40 0x7f22e4197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.031+0000 7f22ea006640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f22e41096e0 con 0x7f22e4100840 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.031+0000 7f22ea006640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f22e4109560 con 0x7f22e4101a40 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.031+0000 7f22e37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 0x7f22e41975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.031+0000 7f22e37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 0x7f22e41975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38896/0 (socket says 172.21.15.118:38896) 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.031+0000 7f22e37fe640 1 -- 172.21.15.118:0/2516302417 learned_addr learned my addr 172.21.15.118:0/2516302417 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22e2ffd640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22e4101a40 0x7f22e4197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22e37fe640 1 -- 172.21.15.118:0/2516302417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22e4101a40 msgr2=0x7f22e4197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22e37fe640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22e4101a40 0x7f22e4197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22e37fe640 1 -- 172.21.15.118:0/2516302417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e4198190 con 0x7f22e4100840 2024-09-21T11:36:30.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22e37fe640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 0x7f22e41975d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009230 tx=0x7f22d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:30.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22e0ff9640 1 -- 172.21.15.118:0/2516302417 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22d403f070 con 0x7f22e4100840 2024-09-21T11:36:30.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e419cb70 con 0x7f22e4100840 2024-09-21T11:36:30.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22e0ff9640 1 -- 172.21.15.118:0/2516302417 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22d4004c70 con 0x7f22e4100840 2024-09-21T11:36:30.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22e0ff9640 1 -- 172.21.15.118:0/2516302417 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22d4035030 con 0x7f22e4100840 2024-09-21T11:36:30.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.032+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e419d100 con 0x7f22e4100840 2024-09-21T11:36:30.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.033+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e4100c40 con 0x7f22e4100840 2024-09-21T11:36:30.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.034+0000 7f22e0ff9640 1 -- 172.21.15.118:0/2516302417 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f22d4042070 con 0x7f22e4100840 2024-09-21T11:36:30.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.034+0000 7f22e0ff9640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f22d006e2b0 0x7f22d0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:30.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.034+0000 7f22e0ff9640 1 -- 172.21.15.118:0/2516302417 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f22d40aed30 con 0x7f22e4100840 2024-09-21T11:36:30.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.034+0000 7f22e2ffd640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f22d006e2b0 0x7f22d0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:30.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.035+0000 7f22e2ffd640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f22d006e2b0 0x7f22d0070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22e4198a80 tx=0x7f22cc008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:30.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.039+0000 7f22e0ff9640 1 -- 172.21.15.118:0/2516302417 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22d407c690 con 0x7f22e4100840 2024-09-21T11:36:30.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:29 smithi149 ceph-mon[36123]: pgmap v177: 65 pgs: 11 creating+peering, 54 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 216 B/s wr, 0 op/s 2024-09-21T11:36:30.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:29 smithi149 ceph-mon[36123]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T11:36:30.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:29 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3033557681' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-21T11:36:30.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:29 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] up:active 2024-09-21T11:36:30.131 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:29 smithi149 ceph-mon[36123]: fsmap cephfs:1 {0=cephfs.smithi118.ciljqr=up:active} 2024-09-21T11:36:30.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.241+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f22e419d360 con 0x7f22e4100840 2024-09-21T11:36:30.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.805+0000 7f22e0ff9640 1 -- 172.21.15.118:0/2516302417 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f22d4080340 con 0x7f22e4100840 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.807+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f22d006e2b0 msgr2=0x7f22d0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.807+0000 7f22ea006640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f22d006e2b0 0x7f22d0070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22e4198a80 tx=0x7f22cc008040 comp rx=0 tx=0).stop 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.807+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 msgr2=0x7f22e41975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.807+0000 7f22ea006640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 0x7f22e41975d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009230 tx=0x7f22d40048f0 comp rx=0 tx=0).stop 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.807+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 shutdown_connections 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.807+0000 7f22ea006640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f22d006e2b0 0x7f22d0070770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.807+0000 7f22ea006640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22e4101a40 0x7f22e4197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.807+0000 7f22ea006640 1 --2- 172.21.15.118:0/2516302417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22e4100840 0x7f22e41975d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.807+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 >> 172.21.15.118:0/2516302417 conn(0x7f22e40fbff0 msgr2=0x7f22e4069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:30.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.808+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 shutdown_connections 2024-09-21T11:36:30.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:30.808+0000 7f22ea006640 1 -- 172.21.15.118:0/2516302417 wait complete. 2024-09-21T11:36:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:30 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2516302417' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T11:36:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.macjke", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T11:36:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.macjke", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T11:36:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:30 smithi118 ceph-mon[28757]: Deploying daemon mds.cephfs.smithi118.macjke on smithi118 2024-09-21T11:36:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:30 smithi118 ceph-mon[28757]: pgmap v178: 65 pgs: 65 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 2 op/s 2024-09-21T11:36:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:30 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2516302417' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T11:36:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.macjke", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T11:36:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.macjke", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T11:36:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:30 smithi149 ceph-mon[36123]: Deploying daemon mds.cephfs.smithi118.macjke on smithi118 2024-09-21T11:36:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:30 smithi149 ceph-mon[36123]: pgmap v178: 65 pgs: 65 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 2 op/s 2024-09-21T11:36:32.066 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:31 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2516302417' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T11:36:32.066 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:31 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.149:6824/888554295,v1:172.21.15.149:6825/888554295] up:boot 2024-09-21T11:36:32.066 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:31 smithi118 ceph-mon[28757]: daemon mds.cephfs.smithi149.zgoqsi assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T11:36:32.066 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:31 smithi118 ceph-mon[28757]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-21T11:36:32.066 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:31 smithi118 ceph-mon[28757]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T11:36:32.066 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:31 smithi118 ceph-mon[28757]: fsmap cephfs:1 {0=cephfs.smithi118.ciljqr=up:active} 1 up:standby 2024-09-21T11:36:32.066 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:31 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"}]: dispatch 2024-09-21T11:36:32.066 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:31 smithi118 ceph-mon[28757]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:creating} 2024-09-21T11:36:32.067 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:31 smithi118 ceph-mon[28757]: daemon mds.cephfs.smithi149.zgoqsi is now active in filesystem cephfs as rank 1 2024-09-21T11:36:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:31 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2516302417' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T11:36:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:31 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.149:6824/888554295,v1:172.21.15.149:6825/888554295] up:boot 2024-09-21T11:36:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:31 smithi149 ceph-mon[36123]: daemon mds.cephfs.smithi149.zgoqsi assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T11:36:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:31 smithi149 ceph-mon[36123]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-21T11:36:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:31 smithi149 ceph-mon[36123]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T11:36:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:31 smithi149 ceph-mon[36123]: fsmap cephfs:1 {0=cephfs.smithi118.ciljqr=up:active} 1 up:standby 2024-09-21T11:36:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:31 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"}]: dispatch 2024-09-21T11:36:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:31 smithi149 ceph-mon[36123]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:creating} 2024-09-21T11:36:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:31 smithi149 ceph-mon[36123]: daemon mds.cephfs.smithi149.zgoqsi is now active in filesystem cephfs as rank 1 2024-09-21T11:36:32.483 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T11:36:32.493 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:36:32.494 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-21T11:36:32.973 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:32 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.149:6824/888554295,v1:172.21.15.149:6825/888554295] up:active 2024-09-21T11:36:32.973 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:32 smithi118 ceph-mon[28757]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:active} 2024-09-21T11:36:32.973 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:32 smithi118 ceph-mon[28757]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 3 op/s 2024-09-21T11:36:33.117 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:33.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:32 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.149:6824/888554295,v1:172.21.15.149:6825/888554295] up:active 2024-09-21T11:36:33.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:32 smithi149 ceph-mon[36123]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:active} 2024-09-21T11:36:33.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:32 smithi149 ceph-mon[36123]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 3 op/s 2024-09-21T11:36:33.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.601+0000 7f0fdbc26640 1 -- 172.21.15.118:0/143187991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 msgr2=0x7f0fd4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:33.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.601+0000 7f0fdbc26640 1 --2- 172.21.15.118:0/143187991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 0x7f0fd4100c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009880 tx=0x7f0fd002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.601+0000 7f0fdbc26640 1 -- 172.21.15.118:0/143187991 shutdown_connections 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.601+0000 7f0fdbc26640 1 --2- 172.21.15.118:0/143187991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd4101a80 0x7f0fd4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.601+0000 7f0fdbc26640 1 --2- 172.21.15.118:0/143187991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 0x7f0fd4100c80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.601+0000 7f0fdbc26640 1 -- 172.21.15.118:0/143187991 >> 172.21.15.118:0/143187991 conn(0x7f0fd40fc010 msgr2=0x7f0fd40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.602+0000 7f0fdbc26640 1 -- 172.21.15.118:0/143187991 shutdown_connections 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.602+0000 7f0fdbc26640 1 -- 172.21.15.118:0/143187991 wait complete. 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.602+0000 7f0fdbc26640 1 Processor -- start 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.602+0000 7f0fdbc26640 1 -- start start 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.602+0000 7f0fdbc26640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 0x7f0fd41974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.602+0000 7f0fdbc26640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd4101a80 0x7f0fd4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fdbc26640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41096a0 con 0x7f0fd4100880 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fdbc26640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4109520 con 0x7f0fd4101a80 2024-09-21T11:36:33.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fd99c2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 0x7f0fd41974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fd99c2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 0x7f0fd41974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38942/0 (socket says 172.21.15.118:38942) 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fd99c2640 1 -- 172.21.15.118:0/1160462770 learned_addr learned my addr 172.21.15.118:0/1160462770 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fd91c1640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd4101a80 0x7f0fd4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fd99c2640 1 -- 172.21.15.118:0/1160462770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd4101a80 msgr2=0x7f0fd4197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fd99c2640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd4101a80 0x7f0fd4197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fd99c2640 1 -- 172.21.15.118:0/1160462770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd41980b0 con 0x7f0fd4100880 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fd99c2640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 0x7f0fd41974f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0006010 tx=0x7f0fd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fcaffd640 1 -- 172.21.15.118:0/1160462770 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0fd003f070 con 0x7f0fd4100880 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fcaffd640 1 -- 172.21.15.118:0/1160462770 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fd00044d0 con 0x7f0fd4100880 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fcaffd640 1 -- 172.21.15.118:0/1160462770 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0fd0035030 con 0x7f0fd4100880 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd419ca90 con 0x7f0fd4100880 2024-09-21T11:36:33.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.603+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd419d020 con 0x7f0fd4100880 2024-09-21T11:36:33.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.604+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd4100c80 con 0x7f0fd4100880 2024-09-21T11:36:33.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.605+0000 7f0fcaffd640 1 -- 172.21.15.118:0/1160462770 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f0fd0042070 con 0x7f0fd4100880 2024-09-21T11:36:33.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.605+0000 7f0fcaffd640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0fc006e2b0 0x7f0fc0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:33.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.605+0000 7f0fd91c1640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0fc006e2b0 0x7f0fc0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:33.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.606+0000 7f0fcaffd640 1 -- 172.21.15.118:0/1160462770 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f0fd00aed70 con 0x7f0fd4100880 2024-09-21T11:36:33.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.606+0000 7f0fd91c1640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0fc006e2b0 0x7f0fc0070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0fd41989a0 tx=0x7f0fc400a2d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:33.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.610+0000 7f0fcaffd640 1 -- 172.21.15.118:0/1160462770 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0fd0080380 con 0x7f0fd4100880 2024-09-21T11:36:33.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.811+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0fd419d250 con 0x7f0fd4100880 2024-09-21T11:36:33.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.821+0000 7f0fcaffd640 1 -- 172.21.15.118:0/1160462770 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) ==== 168+0+0 (secure 0 0 0) 0x7f0fd0084bb0 con 0x7f0fd4100880 2024-09-21T11:36:33.824 INFO:teuthology.orchestra.run.smithi118.stderr:inline data enabled 2024-09-21T11:36:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.823+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0fc006e2b0 msgr2=0x7f0fc0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.823+0000 7f0fdbc26640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0fc006e2b0 0x7f0fc0070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0fd41989a0 tx=0x7f0fc400a2d0 comp rx=0 tx=0).stop 2024-09-21T11:36:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.823+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 msgr2=0x7f0fd41974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.823+0000 7f0fdbc26640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 0x7f0fd41974f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0006010 tx=0x7f0fd00048f0 comp rx=0 tx=0).stop 2024-09-21T11:36:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.824+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 shutdown_connections 2024-09-21T11:36:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.824+0000 7f0fdbc26640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f0fc006e2b0 0x7f0fc0070770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.824+0000 7f0fdbc26640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fd4101a80 0x7f0fd4197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.824+0000 7f0fdbc26640 1 --2- 172.21.15.118:0/1160462770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fd4100880 0x7f0fd41974f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.824+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 >> 172.21.15.118:0/1160462770 conn(0x7f0fd40fc010 msgr2=0x7f0fd406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.824+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 shutdown_connections 2024-09-21T11:36:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:33.824+0000 7f0fdbc26640 1 -- 172.21.15.118:0/1160462770 wait complete. 2024-09-21T11:36:34.374 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.qzbfns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.qzbfns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: Deploying daemon mds.cephfs.smithi149.qzbfns on smithi149 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1160462770' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1160462770' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:boot 2024-09-21T11:36:34.375 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:active} 1 up:standby 2024-09-21T11:36:34.376 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:34 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"}]: dispatch 2024-09-21T11:36:34.400 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T11:36:34.410 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:36:34.410 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T11:36:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.qzbfns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T11:36:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.qzbfns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T11:36:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: Deploying daemon mds.cephfs.smithi149.qzbfns on smithi149 2024-09-21T11:36:34.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1160462770' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-21T11:36:34.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-21T11:36:34.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-21T11:36:34.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1160462770' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T11:36:34.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:boot 2024-09-21T11:36:34.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:active} 1 up:standby 2024-09-21T11:36:34.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:34 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"}]: dispatch 2024-09-21T11:36:34.660 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:35.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/3768523217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 msgr2=0x7ff3f8104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:35.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 --2- 172.21.15.118:0/3768523217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 0x7ff3f8104800 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40098b0 tx=0x7ff3f402a4d0 comp rx=0 tx=0).stop 2024-09-21T11:36:35.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/3768523217 shutdown_connections 2024-09-21T11:36:35.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 --2- 172.21.15.118:0/3768523217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3f8104d40 0x7ff3f8107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:35.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 --2- 172.21.15.118:0/3768523217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 0x7ff3f8104800 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:35.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/3768523217 >> 172.21.15.118:0/3768523217 conn(0x7ff3f80fc010 msgr2=0x7ff3f80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:35.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/3768523217 shutdown_connections 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/3768523217 wait complete. 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 Processor -- start 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 -- start start 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 0x7ff3f8199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.148+0000 7ff3ff5e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3f8104d40 0x7ff3f8199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3ff5e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f810a7e0 con 0x7ff3f8102410 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3ff5e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f810a660 con 0x7ff3f8104d40 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3fd381640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 0x7ff3f8199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3fd381640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 0x7ff3f8199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38960/0 (socket says 172.21.15.118:38960) 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3fd381640 1 -- 172.21.15.118:0/2248664896 learned_addr learned my addr 172.21.15.118:0/2248664896 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3fcb80640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3f8104d40 0x7ff3f8199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3fd381640 1 -- 172.21.15.118:0/2248664896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3f8104d40 msgr2=0x7ff3f8199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3fd381640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3f8104d40 0x7ff3f8199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3fd381640 1 -- 172.21.15.118:0/2248664896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f819a2f0 con 0x7ff3f8102410 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3fcb80640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3f8104d40 0x7ff3f8199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3fd381640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 0x7ff3f8199730 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40099d0 tx=0x7ff3f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3ee7fc640 1 -- 172.21.15.118:0/2248664896 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3f403f070 con 0x7ff3f8102410 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f819ecd0 con 0x7ff3f8102410 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3ee7fc640 1 -- 172.21.15.118:0/2248664896 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3f4004a40 con 0x7ff3f8102410 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3ee7fc640 1 -- 172.21.15.118:0/2248664896 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3f4035030 con 0x7ff3f8102410 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.149+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f819f1b0 con 0x7ff3f8102410 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.150+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f81027f0 con 0x7ff3f8102410 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.151+0000 7ff3ee7fc640 1 -- 172.21.15.118:0/2248664896 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff3f4042070 con 0x7ff3f8102410 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.151+0000 7ff3ee7fc640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff3e406e2b0 0x7ff3e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.151+0000 7ff3ee7fc640 1 -- 172.21.15.118:0/2248664896 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ff3f40aed20 con 0x7ff3f8102410 2024-09-21T11:36:35.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.151+0000 7ff3fcb80640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff3e406e2b0 0x7ff3e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.152+0000 7ff3fcb80640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff3e406e2b0 0x7ff3e4070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005d00 tx=0x7ff3e8005ed0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.156+0000 7ff3ee7fc640 1 -- 172.21.15.118:0/2248664896 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff3f407c680 con 0x7ff3f8102410 2024-09-21T11:36:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:35 smithi118 ceph-mon[28757]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-21T11:36:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.356+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff3f8062df0 con 0x7ff3f8102410 2024-09-21T11:36:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.357+0000 7ff3ee7fc640 1 -- 172.21.15.118:0/2248664896 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 9 v9) ==== 75+0+1809 (secure 0 0 0) 0x7ff3f4080330 con 0x7ff3f8102410 2024-09-21T11:36:35.359 INFO:teuthology.orchestra.run.smithi118.stdout:e9 2024-09-21T11:36:35.359 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:33:821680+0000 2024-09-21T11:36:35.359 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:36:35.359 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:36:35.359 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:36:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 9 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:33.813258+0000 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:36:35.360 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 0 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=14556,1=24289} 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:36:35.361 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 14556 members: 24289,14556 2024-09-21T11:36:35.362 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 2 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:36:35.362 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{1:24289} state up:active seq 2 addr [v2:172.21.15.149:6824/888554295,v1:172.21.15.149:6825/888554295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:36:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:35.362 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:36:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:35.362 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:14572} state up:standby seq 1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 9 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff3e406e2b0 msgr2=0x7ff3e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff3e406e2b0 0x7ff3e4070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005d00 tx=0x7ff3e8005ed0 comp rx=0 tx=0).stop 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 msgr2=0x7ff3f8199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 0x7ff3f8199730 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40099d0 tx=0x7ff3f40046c0 comp rx=0 tx=0).stop 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 shutdown_connections 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff3e406e2b0 0x7ff3e4070770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3f8104d40 0x7ff3f8199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 --2- 172.21.15.118:0/2248664896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3f8102410 0x7ff3f8199730 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 >> 172.21.15.118:0/2248664896 conn(0x7ff3f80fc010 msgr2=0x7ff3f8101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 shutdown_connections 2024-09-21T11:36:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:35.359+0000 7ff3ff5e5640 1 -- 172.21.15.118:0/2248664896 wait complete. 2024-09-21T11:36:35.403 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:35 smithi149 ceph-mon[36123]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-21T11:36:36.033 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-21T11:36:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:36 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2248664896' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T11:36:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:36 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:36 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:36 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:36 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:36 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:36 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:36:36.439 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:36 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2248664896' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T11:36:36.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:36 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:36 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:36 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:36 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:36 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:36.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:36 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:36:36.828 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:37.258 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:37 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] up:boot 2024-09-21T11:36:37.258 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:37 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] up:active 2024-09-21T11:36:37.258 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:37 smithi118 ceph-mon[28757]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:active} 2 up:standby 2024-09-21T11:36:37.258 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:37 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"}]: dispatch 2024-09-21T11:36:37.258 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:37 smithi118 ceph-mon[28757]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-21T11:36:37.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.255+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/1182152637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 msgr2=0x7f4aac103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.255+0000 7f4ab3e6d640 1 --2- 172.21.15.118:0/1182152637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 0x7f4aac103010 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009880 tx=0x7f4a9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.255+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/1182152637 shutdown_connections 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.255+0000 7f4ab3e6d640 1 --2- 172.21.15.118:0/1182152637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 0x7f4aac103010 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.255+0000 7f4ab3e6d640 1 --2- 172.21.15.118:0/1182152637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4aac101990 0x7f4aac101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.255+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/1182152637 >> 172.21.15.118:0/1182152637 conn(0x7f4aac0fd140 msgr2=0x7f4aac0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.255+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/1182152637 shutdown_connections 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.255+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/1182152637 wait complete. 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab3e6d640 1 Processor -- start 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab3e6d640 1 -- start start 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab3e6d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4aac101990 0x7f4aac1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab3e6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 0x7f4aac1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab3e6d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10a7b0 con 0x7f4aac102b90 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab3e6d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10a630 con 0x7f4aac101990 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab1408640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 0x7f4aac1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab1408640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 0x7f4aac1979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39444/0 (socket says 172.21.15.118:39444) 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab1408640 1 -- 172.21.15.118:0/3405090126 learned_addr learned my addr 172.21.15.118:0/3405090126 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.256+0000 7f4ab1c09640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4aac101990 0x7f4aac1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4ab1408640 1 -- 172.21.15.118:0/3405090126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4aac101990 msgr2=0x7f4aac1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4ab1408640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4aac101990 0x7f4aac1974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4ab1408640 1 -- 172.21.15.118:0/3405090126 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac198060 con 0x7f4aac102b90 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4ab1c09640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4aac101990 0x7f4aac1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4ab1408640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 0x7f4aac1979e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c006010 tx=0x7f4a9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4aa2ffd640 1 -- 172.21.15.118:0/3405090126 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a9c03f070 con 0x7f4aac102b90 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac19ca40 con 0x7f4aac102b90 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4aa2ffd640 1 -- 172.21.15.118:0/3405090126 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a9c004ac0 con 0x7f4aac102b90 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4aa2ffd640 1 -- 172.21.15.118:0/3405090126 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a9c035030 con 0x7f4aac102b90 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.257+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac19cfd0 con 0x7f4aac102b90 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.258+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac101d90 con 0x7f4aac102b90 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.258+0000 7f4aa2ffd640 1 -- 172.21.15.118:0/3405090126 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f4a9c042070 con 0x7f4aac102b90 2024-09-21T11:36:37.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.259+0000 7f4aa2ffd640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4a9806e2b0 0x7f4a98070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:37.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.259+0000 7f4aa2ffd640 1 -- 172.21.15.118:0/3405090126 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f4a9c0aee60 con 0x7f4aac102b90 2024-09-21T11:36:37.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.259+0000 7f4ab1c09640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4a9806e2b0 0x7f4a98070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:37.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.259+0000 7f4ab1c09640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4a9806e2b0 0x7f4a98070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80058c0 tx=0x7f4aa8005850 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:37.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.263+0000 7f4aa2ffd640 1 -- 172.21.15.118:0/3405090126 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a9c07c760 con 0x7f4aac102b90 2024-09-21T11:36:37.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:37 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] up:boot 2024-09-21T11:36:37.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:37 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] up:active 2024-09-21T11:36:37.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:37 smithi149 ceph-mon[36123]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:active} 2 up:standby 2024-09-21T11:36:37.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:37 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"}]: dispatch 2024-09-21T11:36:37.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:37 smithi149 ceph-mon[36123]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-21T11:36:37.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.470+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4aac19d3f0 con 0x7f4aac102b90 2024-09-21T11:36:37.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.470+0000 7f4aa2ffd640 1 -- 172.21.15.118:0/3405090126 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+4485 (secure 0 0 0) 0x7f4a9c080410 con 0x7f4aac102b90 2024-09-21T11:36:37.473 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 12 2024-09-21T11:36:37.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.472+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4a9806e2b0 msgr2=0x7f4a98070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:37.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.472+0000 7f4ab3e6d640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4a9806e2b0 0x7f4a98070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80058c0 tx=0x7f4aa8005850 comp rx=0 tx=0).stop 2024-09-21T11:36:37.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.472+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 msgr2=0x7f4aac1979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:37.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.472+0000 7f4ab3e6d640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 0x7f4aac1979e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c006010 tx=0x7f4a9c0046c0 comp rx=0 tx=0).stop 2024-09-21T11:36:37.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.472+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 shutdown_connections 2024-09-21T11:36:37.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.472+0000 7f4ab3e6d640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f4a9806e2b0 0x7f4a98070770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:37.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.472+0000 7f4ab3e6d640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4aac102b90 0x7f4aac1979e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:37.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.472+0000 7f4ab3e6d640 1 --2- 172.21.15.118:0/3405090126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4aac101990 0x7f4aac1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:37.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.472+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 >> 172.21.15.118:0/3405090126 conn(0x7f4aac0fd140 msgr2=0x7f4aac0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:37.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.473+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 shutdown_connections 2024-09-21T11:36:37.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:37.473+0000 7f4ab3e6d640 1 -- 172.21.15.118:0/3405090126 wait complete. 2024-09-21T11:36:37.484 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:36:38.242 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:standby 2024-09-21T11:36:38.243 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: Dropping low affinity active daemon mds.cephfs.smithi149.zgoqsi in favor of higher affinity standby. 2024-09-21T11:36:38.243 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: Replacing daemon mds.cephfs.smithi149.zgoqsi as rank 1 with standby daemon mds.cephfs.smithi118.macjke 2024-09-21T11:36:38.243 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T11:36:38.243 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:active} 2 up:standby 2024-09-21T11:36:38.243 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T11:36:38.243 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:replay} 1 up:standby 2024-09-21T11:36:38.243 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3405090126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T11:36:38.243 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:38.243 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:38 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:38.270 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:standby 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: Dropping low affinity active daemon mds.cephfs.smithi149.zgoqsi in favor of higher affinity standby. 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: Replacing daemon mds.cephfs.smithi149.zgoqsi as rank 1 with standby daemon mds.cephfs.smithi118.macjke 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi149.zgoqsi=up:active} 2 up:standby 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:replay} 1 up:standby 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3405090126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:38 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:38.656 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:39.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:39 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:resolve 2024-09-21T11:36:39.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:39 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] up:boot 2024-09-21T11:36:39.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:39 smithi149 ceph-mon[36123]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:resolve} 2 up:standby 2024-09-21T11:36:39.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"}]: dispatch 2024-09-21T11:36:39.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:39.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:36:39.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:39 smithi149 ceph-mon[36123]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-21T11:36:39.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:39.458 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:39 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:resolve 2024-09-21T11:36:39.458 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:39 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] up:boot 2024-09-21T11:36:39.458 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:39 smithi118 ceph-mon[28757]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:resolve} 2 up:standby 2024-09-21T11:36:39.458 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"}]: dispatch 2024-09-21T11:36:39.458 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:39.458 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:36:39.458 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:39 smithi118 ceph-mon[28757]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-21T11:36:39.458 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 -- 172.21.15.118:0/3432998951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c100880 msgr2=0x7faa8c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 --2- 172.21.15.118:0/3432998951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c100880 0x7faa8c100c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faa84009880 tx=0x7faa8402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 -- 172.21.15.118:0/3432998951 shutdown_connections 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 --2- 172.21.15.118:0/3432998951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa8c101a80 0x7faa8c101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 --2- 172.21.15.118:0/3432998951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c100880 0x7faa8c100c80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 -- 172.21.15.118:0/3432998951 >> 172.21.15.118:0/3432998951 conn(0x7faa8c0fc010 msgr2=0x7faa8c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 -- 172.21.15.118:0/3432998951 shutdown_connections 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 -- 172.21.15.118:0/3432998951 wait complete. 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 Processor -- start 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.780+0000 7faa9438b640 1 -- start start 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa9438b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa8c100880 0x7faa8c193600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa9438b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c101a80 0x7faa8c193b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa9438b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c109720 con 0x7faa8c101a80 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa9438b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c1095a0 con 0x7faa8c100880 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa91926640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c101a80 0x7faa8c193b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa91926640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c101a80 0x7faa8c193b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39462/0 (socket says 172.21.15.118:39462) 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa91926640 1 -- 172.21.15.118:0/2001313365 learned_addr learned my addr 172.21.15.118:0/2001313365 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa92127640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa8c100880 0x7faa8c193600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa91926640 1 -- 172.21.15.118:0/2001313365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa8c100880 msgr2=0x7faa8c193600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa91926640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa8c100880 0x7faa8c193600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa91926640 1 -- 172.21.15.118:0/2001313365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c1941c0 con 0x7faa8c101a80 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa91926640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c101a80 0x7faa8c193b40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faa8000b420 tx=0x7faa8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa8b7fe640 1 -- 172.21.15.118:0/2001313365 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa80011630 con 0x7faa8c101a80 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa8b7fe640 1 -- 172.21.15.118:0/2001313365 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa80016070 con 0x7faa8c101a80 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa8b7fe640 1 -- 172.21.15.118:0/2001313365 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa80010d40 con 0x7faa8c101a80 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8c198c00 con 0x7faa8c101a80 2024-09-21T11:36:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.781+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8c199210 con 0x7faa8c101a80 2024-09-21T11:36:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.782+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8c100c80 con 0x7faa8c101a80 2024-09-21T11:36:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.783+0000 7faa8b7fe640 1 -- 172.21.15.118:0/2001313365 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7faa8001b460 con 0x7faa8c101a80 2024-09-21T11:36:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.783+0000 7faa8b7fe640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faa7406e2b0 0x7faa74070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.783+0000 7faa8b7fe640 1 -- 172.21.15.118:0/2001313365 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7faa8008dad0 con 0x7faa8c101a80 2024-09-21T11:36:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.783+0000 7faa92127640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faa7406e2b0 0x7faa74070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.784+0000 7faa92127640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faa7406e2b0 0x7faa74070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa84000c00 tx=0x7faa84004140 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:39.788+0000 7faa8b7fe640 1 -- 172.21.15.118:0/2001313365 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa8005b3d0 con 0x7faa8c101a80 2024-09-21T11:36:40.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.031+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7faa8c199c20 con 0x7faa8c101a80 2024-09-21T11:36:40.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.032+0000 7faa8b7fe640 1 -- 172.21.15.118:0/2001313365 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) ==== 78+0+98 (secure 0 0 0) 0x7faa8005f080 con 0x7faa8c101a80 2024-09-21T11:36:40.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faa7406e2b0 msgr2=0x7faa74070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:40.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faa7406e2b0 0x7faa74070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa84000c00 tx=0x7faa84004140 comp rx=0 tx=0).stop 2024-09-21T11:36:40.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c101a80 msgr2=0x7faa8c193b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:40.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c101a80 0x7faa8c193b40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faa8000b420 tx=0x7faa8000b8e0 comp rx=0 tx=0).stop 2024-09-21T11:36:40.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 shutdown_connections 2024-09-21T11:36:40.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7faa7406e2b0 0x7faa74070770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:40.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8c101a80 0x7faa8c193b40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:40.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 --2- 172.21.15.118:0/2001313365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa8c100880 0x7faa8c193600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:40.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 >> 172.21.15.118:0/2001313365 conn(0x7faa8c0fc010 msgr2=0x7faa8c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:40.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 shutdown_connections 2024-09-21T11:36:40.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:40.034+0000 7faa9438b640 1 -- 172.21.15.118:0/2001313365 wait complete. 2024-09-21T11:36:40.045 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:36:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:40 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:reconnect 2024-09-21T11:36:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:40 smithi118 ceph-mon[28757]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:reconnect} 2 up:standby 2024-09-21T11:36:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:40 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2001313365' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T11:36:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:40 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:reconnect 2024-09-21T11:36:40.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:40 smithi149 ceph-mon[36123]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:reconnect} 2 up:standby 2024-09-21T11:36:40.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:40 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2001313365' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T11:36:40.693 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-21T11:36:40.717 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T11:36:41.018 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:41.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:41 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:rejoin 2024-09-21T11:36:41.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:41 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] up:standby 2024-09-21T11:36:41.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:41 smithi149 ceph-mon[36123]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:rejoin} 2 up:standby 2024-09-21T11:36:41.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:41 smithi149 ceph-mon[36123]: daemon mds.cephfs.smithi118.macjke is now active in filesystem cephfs as rank 1 2024-09-21T11:36:41.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:41 smithi149 ceph-mon[36123]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 614 B/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T11:36:41.461 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:41 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:rejoin 2024-09-21T11:36:41.461 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:41 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] up:standby 2024-09-21T11:36:41.461 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:41 smithi118 ceph-mon[28757]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:rejoin} 2 up:standby 2024-09-21T11:36:41.461 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:41 smithi118 ceph-mon[28757]: daemon mds.cephfs.smithi118.macjke is now active in filesystem cephfs as rank 1 2024-09-21T11:36:41.461 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:41 smithi118 ceph-mon[28757]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 614 B/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T11:36:42.395 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:42 smithi118 ceph-mon[28757]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T11:36:42.395 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:42 smithi118 ceph-mon[28757]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:active 2024-09-21T11:36:42.395 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:42 smithi118 ceph-mon[28757]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T11:36:42.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.392+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/1371971120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 msgr2=0x7ff4e8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:42.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.392+0000 7ff4ee1ba640 1 --2- 172.21.15.118:0/1371971120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 0x7ff4e8100c80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009880 tx=0x7ff4d002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:42.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.392+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/1371971120 shutdown_connections 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.392+0000 7ff4ee1ba640 1 --2- 172.21.15.118:0/1371971120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 0x7ff4e8100c80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.392+0000 7ff4ee1ba640 1 --2- 172.21.15.118:0/1371971120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4e8106820 0x7ff4e8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.392+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/1371971120 >> 172.21.15.118:0/1371971120 conn(0x7ff4e80fc520 msgr2=0x7ff4e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.392+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/1371971120 shutdown_connections 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.392+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/1371971120 wait complete. 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4ee1ba640 1 Processor -- start 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4ee1ba640 1 -- start start 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4ee1ba640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 0x7ff4e80fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4ee1ba640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4e8106820 0x7ff4e80fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4ee1ba640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e810dd50 con 0x7ff4e8100820 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4ee1ba640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e810dbd0 con 0x7ff4e8106820 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4e77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 0x7ff4e80fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4e77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 0x7ff4e80fcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39492/0 (socket says 172.21.15.118:39492) 2024-09-21T11:36:42.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4e77fe640 1 -- 172.21.15.118:0/4038650822 learned_addr learned my addr 172.21.15.118:0/4038650822 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4dffff640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4e8106820 0x7ff4e80fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4e77fe640 1 -- 172.21.15.118:0/4038650822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4e8106820 msgr2=0x7ff4e80fd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4e77fe640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4e8106820 0x7ff4e80fd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.393+0000 7ff4e77fe640 1 -- 172.21.15.118:0/4038650822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e80fd680 con 0x7ff4e8100820 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.394+0000 7ff4e77fe640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 0x7ff4e80fcc00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800b420 tx=0x7ff4d800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.394+0000 7ff4e57fa640 1 -- 172.21.15.118:0/4038650822 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4d8011630 con 0x7ff4e8100820 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.394+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e80fd970 con 0x7ff4e8100820 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.394+0000 7ff4e57fa640 1 -- 172.21.15.118:0/4038650822 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4d8016070 con 0x7ff4e8100820 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.394+0000 7ff4e57fa640 1 -- 172.21.15.118:0/4038650822 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4d8010d40 con 0x7ff4e8100820 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.394+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e81a3ec0 con 0x7ff4e8100820 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.395+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e8101f60 con 0x7ff4e8100820 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.395+0000 7ff4e57fa640 1 -- 172.21.15.118:0/4038650822 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff4d80117d0 con 0x7ff4e8100820 2024-09-21T11:36:42.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.396+0000 7ff4e57fa640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff4d406e2b0 0x7ff4d4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:42.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.396+0000 7ff4dffff640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff4d406e2b0 0x7ff4d4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:42.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.396+0000 7ff4e57fa640 1 -- 172.21.15.118:0/4038650822 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7ff4d808d9f0 con 0x7ff4e8100820 2024-09-21T11:36:42.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.396+0000 7ff4dffff640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff4d406e2b0 0x7ff4d4070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80fe690 tx=0x7ff4d0031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:42.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.400+0000 7ff4e57fa640 1 -- 172.21.15.118:0/4038650822 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff4d805b2f0 con 0x7ff4e8100820 2024-09-21T11:36:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:42 smithi149 ceph-mon[36123]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T11:36:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:42 smithi149 ceph-mon[36123]: mds.? [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] up:active 2024-09-21T11:36:42.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:42 smithi149 ceph-mon[36123]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T11:36:42.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.619+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4e8109dc0 con 0x7ff4e8100820 2024-09-21T11:36:42.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.619+0000 7ff4e57fa640 1 -- 172.21.15.118:0/4038650822 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5340 (secure 0 0 0) 0x7ff4d805efa0 con 0x7ff4e8100820 2024-09-21T11:36:42.625 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:36:42.625 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"btime":"2024-09-21T11:36:41:162720+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/1256053322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1256053322},{"type":"v1","addr":"172.21.15.149:6827","nonce":1256053322}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24305,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/2469878089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2469878089},{"type":"v1","addr":"172.21.15.149:6825","nonce":2469878089}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:36:41.162717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14556,"mds_1":14572},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"cephfs.smithi118.ciljqr","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6827/395212393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":395212393},{"type":"v1","addr":"172.21.15.118:6827","nonce":395212393}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14572":{"gid":14572,"name":"cephfs.smithi118.macjke","rank":1,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.118:6829/98130516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":98130516},{"type":"v1","addr":"172.21.15.118:6829","nonce":98130516}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14556,"qdb_cluster":[14556,14572]},"id":1}]} 2024-09-21T11:36:42.625 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T11:36:42.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff4d406e2b0 msgr2=0x7ff4d4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:42.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff4d406e2b0 0x7ff4d4070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80fe690 tx=0x7ff4d0031400 comp rx=0 tx=0).stop 2024-09-21T11:36:42.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 msgr2=0x7ff4e80fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:42.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 0x7ff4e80fcc00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800b420 tx=0x7ff4d800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:36:42.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 shutdown_connections 2024-09-21T11:36:42.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7ff4d406e2b0 0x7ff4d4070770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:42.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4e8106820 0x7ff4e80fd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:42.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 --2- 172.21.15.118:0/4038650822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e8100820 0x7ff4e80fcc00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:42.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 >> 172.21.15.118:0/4038650822 conn(0x7ff4e80fc520 msgr2=0x7ff4e806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:42.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.621+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 shutdown_connections 2024-09-21T11:36:42.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:42.622+0000 7ff4ee1ba640 1 -- 172.21.15.118:0/4038650822 wait complete. 2024-09-21T11:36:43.262 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 2, 'flags': 18} 2024-09-21T11:36:43.262 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T11:36:43.359 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T11:36:43.360 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-21T11:36:43.360 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-21T11:36:43.360 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T11:36:43.360 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:43.360 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-21T11:36:43.361 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T11:36:43.361 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:43.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:43.361 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T11:36:43.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:43.384 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-21T11:36:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:43 smithi149 ceph-mon[36123]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T11:36:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:43 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/4038650822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T11:36:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:43 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:43 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:43.464 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-09-21T11:36:43.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T11:36:43.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:43.466 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T11:36:43.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:43.483 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-09-21T11:36:43.542 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:43 smithi118 ceph-mon[28757]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T11:36:43.542 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:43 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/4038650822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T11:36:43.542 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:43 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:43.542 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:43 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:43.553 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2024-09-21T11:36:43.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T11:36:43.555 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T11:36:43.555 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T11:36:43.555 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T11:36:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:44.231 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:44.231 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:36:44.231 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:44.231 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:44 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 -- 172.21.15.118:0/228031518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0414102ab0 msgr2=0x7f0414102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 --2- 172.21.15.118:0/228031518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0414102ab0 0x7f0414102e90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0410009880 tx=0x7f041002a530 comp rx=0 tx=0).stop 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 -- 172.21.15.118:0/228031518 shutdown_connections 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 --2- 172.21.15.118:0/228031518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04141033d0 0x7f041410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 --2- 172.21.15.118:0/228031518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0414102ab0 0x7f0414102e90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 -- 172.21.15.118:0/228031518 >> 172.21.15.118:0/228031518 conn(0x7f04140fc4f0 msgr2=0x7f04140fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 -- 172.21.15.118:0/228031518 shutdown_connections 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 -- 172.21.15.118:0/228031518 wait complete. 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 Processor -- start 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.309+0000 7f041ae18640 1 -- start start 2024-09-21T11:36:44.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f041ae18640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414102ab0 0x7f041419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f041ae18640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04141033d0 0x7f041419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f041ae18640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f041410ee40 con 0x7f04141033d0 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f041ae18640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f041410ecc0 con 0x7f0414102ab0 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f040bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04141033d0 0x7f041419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f040bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04141033d0 0x7f041419dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39516/0 (socket says 172.21.15.118:39516) 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f040bfff640 1 -- 172.21.15.118:0/1779328980 learned_addr learned my addr 172.21.15.118:0/1779328980 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f0418bb4640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414102ab0 0x7f041419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f040bfff640 1 -- 172.21.15.118:0/1779328980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414102ab0 msgr2=0x7f041419d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f040bfff640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414102ab0 0x7f041419d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f040bfff640 1 -- 172.21.15.118:0/1779328980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0414197850 con 0x7f04141033d0 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f040bfff640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04141033d0 0x7f041419dc10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f040400b370 tx=0x7f040400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f0409ffb640 1 -- 172.21.15.118:0/1779328980 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0404015020 con 0x7f04141033d0 2024-09-21T11:36:44.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f0409ffb640 1 -- 172.21.15.118:0/1779328980 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0404011af0 con 0x7f04141033d0 2024-09-21T11:36:44.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f0409ffb640 1 -- 172.21.15.118:0/1779328980 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0404010d60 con 0x7f04141033d0 2024-09-21T11:36:44.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.310+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0414197b40 con 0x7f04141033d0 2024-09-21T11:36:44.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.311+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04141980d0 con 0x7f04141033d0 2024-09-21T11:36:44.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.312+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041406ac30 con 0x7f04141033d0 2024-09-21T11:36:44.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.312+0000 7f0409ffb640 1 -- 172.21.15.118:0/1779328980 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f0404018020 con 0x7f04141033d0 2024-09-21T11:36:44.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.313+0000 7f0409ffb640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f03fc06e310 0x7f03fc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:44.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.313+0000 7f0409ffb640 1 -- 172.21.15.118:0/1779328980 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f040408db20 con 0x7f04141033d0 2024-09-21T11:36:44.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.313+0000 7f0418bb4640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f03fc06e310 0x7f03fc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:44.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.313+0000 7f0418bb4640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f03fc06e310 0x7f03fc0707d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f04100096c0 tx=0x7f0410031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.317+0000 7f0409ffb640 1 -- 172.21.15.118:0/1779328980 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f040401f020 con 0x7f04141033d0 2024-09-21T11:36:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:44 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:44 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:36:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:44 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:44 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:36:44.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.549+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0414105f80 con 0x7f04141033d0 2024-09-21T11:36:44.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.550+0000 7f0409ffb640 1 -- 172.21.15.118:0/1779328980 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+83 (secure 0 0 0) 0x7f040405b4a0 con 0x7f04141033d0 2024-09-21T11:36:44.552 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T11:36:44.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f03fc06e310 msgr2=0x7f03fc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:44.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f03fc06e310 0x7f03fc0707d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f04100096c0 tx=0x7f0410031400 comp rx=0 tx=0).stop 2024-09-21T11:36:44.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04141033d0 msgr2=0x7f041419dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:44.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04141033d0 0x7f041419dc10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f040400b370 tx=0x7f040400b830 comp rx=0 tx=0).stop 2024-09-21T11:36:44.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 shutdown_connections 2024-09-21T11:36:44.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f03fc06e310 0x7f03fc0707d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:44.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04141033d0 0x7f041419dc10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:44.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 --2- 172.21.15.118:0/1779328980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414102ab0 0x7f041419d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:44.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 >> 172.21.15.118:0/1779328980 conn(0x7f04140fc4f0 msgr2=0x7f0414108e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:44.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 shutdown_connections 2024-09-21T11:36:44.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:44.553+0000 7f041ae18640 1 -- 172.21.15.118:0/1779328980 wait complete. 2024-09-21T11:36:45.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:45 smithi149 ceph-mon[36123]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 818 B/s wr, 5 op/s 2024-09-21T11:36:45.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:45 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1779328980' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T11:36:45.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:45 smithi118 ceph-mon[28757]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 818 B/s wr, 5 op/s 2024-09-21T11:36:45.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:45 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1779328980' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T11:36:45.613 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T11:36:45.613 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T11:36:45.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T11:36:45.613 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T11:36:45.614 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:45.614 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T11:36:45.614 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T11:36:45.614 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T11:36:45.614 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T11:36:45.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:45.614 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T11:36:45.631 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42345sec preferred_lft 42345sec 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T11:36:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T11:36:45.633 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T11:36:45.633 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:45.633 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T11:36:45.633 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2024-09-21T11:36:45.633 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2024-09-21T11:36:45.633 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2024-09-21T11:36:45.633 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T11:36:45.633 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T11:36:45.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:45.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:45.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:45.868 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T11:36:45.892 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T11:36:45.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:45.894 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T11:36:45.992 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T11:36:45.992 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T11:36:45.993 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T11:36:45.993 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T11:36:45.993 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T11:36:45.993 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:45.993 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T11:36:45.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T11:36:45.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T11:36:45.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T11:36:45.994 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T11:36:46.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:46.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:46.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:46.427 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T11:36:46.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:46.443 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2024-09-21T11:36:46.498 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:46.498 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T11:36:46.498 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T11:36:46.498 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T11:36:46.498 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T11:36:46.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:46.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:46.618 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T11:36:46.618 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:46.618 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T11:36:46.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T11:36:46.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T11:36:46.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T11:36:46.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T11:36:46.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T11:36:46.618 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T11:36:46.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:46.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:46 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:46.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:46 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:46.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:46.764 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:46.764 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T11:36:46.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T11:36:46.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T11:36:46.764 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T11:36:46.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:46.845 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-21T11:36:46.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T11:36:46.846 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:46.866 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T11:36:46.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T11:36:46.866 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:46.921 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-09-21T11:36:46.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:46 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:46.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:46 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:46.987 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T11:36:47.043 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-09-21T11:36:47.043 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-09-21T11:36:47.043 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-09-21T11:36:47.044 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/96114449ce44a8e62464e165788cae353919584f481a33336c8bfa8a641ebdc9/merged 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/8364438c322da930f81167f6c2abc3d568824b67d6b4acfddd58f4b6c7e64879/merged 2024-09-21T11:36:47.045 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/0 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/f7d3290bce6cd8a775c2ad92dd8b71089a5156b4e08cbfafb68efd39269841e1/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/07f40f6a6be99461fe399474cc3f12c3ce03c47d5740d9bf7b45bc7ca3ee94a5/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/7abb9d276c545a958d0bf4a62f0f237d7cfd9ca4eb1c536fd3ac322d08aeb15e/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/9f92a9a4c1371a0c6e6206efdd6c18f27df8175c33f1829745028523e5753d53/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/5c3544dd0a9a117a15cb44fab69a75a13f744319e687a28613306d009ec1383c/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/04f66238c6b9a2a5cd03e63e44acf17eda19a15fa1fa28d254e659ca0c6378c8/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/201674bd0b1c7ac55556a46ea181ca47d103a24d4cb76519085760ca581754f8/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/62b68c0d5f06dbe6d91c4c9826d6c548e8307acc7c7eef02ed1f70b58189eeae/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/1238f551cf90a8753d5815638ddbba594275cf68925fcd00a882381c3d728f58/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/96f358b1dc7f4b0eb480f733cbd2a4e89c99c4375689236632cd6b651b62494b/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/93b00f7455fa6caea4800315c26b3ed3dd3025d2f9b98e594ba28abb2361cb23/merged 2024-09-21T11:36:47.046 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-09-21T11:36:47.047 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T11:36:47.047 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T11:36:47.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:47.047 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-09-21T11:36:47.100 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T11:36:47.100 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-21T11:36:47.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-09-21T11:36:47.167 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T11:36:47.225 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-09-21T11:36:47.225 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-09-21T11:36:47.226 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/96114449ce44a8e62464e165788cae353919584f481a33336c8bfa8a641ebdc9/merged 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/8364438c322da930f81167f6c2abc3d568824b67d6b4acfddd58f4b6c7e64879/merged 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/0 2024-09-21T11:36:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/f7d3290bce6cd8a775c2ad92dd8b71089a5156b4e08cbfafb68efd39269841e1/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/07f40f6a6be99461fe399474cc3f12c3ce03c47d5740d9bf7b45bc7ca3ee94a5/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/7abb9d276c545a958d0bf4a62f0f237d7cfd9ca4eb1c536fd3ac322d08aeb15e/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/9f92a9a4c1371a0c6e6206efdd6c18f27df8175c33f1829745028523e5753d53/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/5c3544dd0a9a117a15cb44fab69a75a13f744319e687a28613306d009ec1383c/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/04f66238c6b9a2a5cd03e63e44acf17eda19a15fa1fa28d254e659ca0c6378c8/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/201674bd0b1c7ac55556a46ea181ca47d103a24d4cb76519085760ca581754f8/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/62b68c0d5f06dbe6d91c4c9826d6c548e8307acc7c7eef02ed1f70b58189eeae/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/1238f551cf90a8753d5815638ddbba594275cf68925fcd00a882381c3d728f58/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/96f358b1dc7f4b0eb480f733cbd2a4e89c99c4375689236632cd6b651b62494b/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/93b00f7455fa6caea4800315c26b3ed3dd3025d2f9b98e594ba28abb2361cb23/merged 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T11:36:47.228 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T11:36:47.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:47.229 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-09-21T11:36:47.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:2024-09-21T11:36:47.304+0000 7fbf69aab480 -1 init, newargv = 0x557f9b8501a0 newargc=15 2024-09-21T11:36:47.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[78238]: starting ceph client 2024-09-21T11:36:47.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[78238]: starting fuse 2024-09-21T11:36:47.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:47 smithi149 ceph-mon[36123]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T11:36:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:47 smithi118 ceph-mon[28757]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T11:36:48.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-09-21T11:36:48.408 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T11:36:48.465 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:48.466 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/96114449ce44a8e62464e165788cae353919584f481a33336c8bfa8a641ebdc9/merged 2024-09-21T11:36:48.467 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/8364438c322da930f81167f6c2abc3d568824b67d6b4acfddd58f4b6c7e64879/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/0 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/f7d3290bce6cd8a775c2ad92dd8b71089a5156b4e08cbfafb68efd39269841e1/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/07f40f6a6be99461fe399474cc3f12c3ce03c47d5740d9bf7b45bc7ca3ee94a5/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/7abb9d276c545a958d0bf4a62f0f237d7cfd9ca4eb1c536fd3ac322d08aeb15e/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/9f92a9a4c1371a0c6e6206efdd6c18f27df8175c33f1829745028523e5753d53/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/5c3544dd0a9a117a15cb44fab69a75a13f744319e687a28613306d009ec1383c/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/04f66238c6b9a2a5cd03e63e44acf17eda19a15fa1fa28d254e659ca0c6378c8/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/201674bd0b1c7ac55556a46ea181ca47d103a24d4cb76519085760ca581754f8/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/62b68c0d5f06dbe6d91c4c9826d6c548e8307acc7c7eef02ed1f70b58189eeae/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/1238f551cf90a8753d5815638ddbba594275cf68925fcd00a882381c3d728f58/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/96f358b1dc7f4b0eb480f733cbd2a4e89c99c4375689236632cd6b651b62494b/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/containers/storage/overlay/93b00f7455fa6caea4800315c26b3ed3dd3025d2f9b98e594ba28abb2361cb23/merged 2024-09-21T11:36:48.468 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-09-21T11:36:48.469 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T11:36:48.469 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T11:36:48.469 INFO:teuthology.orchestra.run.smithi118.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:48.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:48.469 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-09-21T11:36:48.521 INFO:teuthology.orchestra.run.smithi118.stdout:165 2024-09-21T11:36:48.521 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [165] 2024-09-21T11:36:48.521 DEBUG:teuthology.orchestra.run.smithi118:> sudo stdin-killer -- python3 -c ' 2024-09-21T11:36:48.521 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2024-09-21T11:36:48.521 DEBUG:teuthology.orchestra.run.smithi118:> import re 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2024-09-21T11:36:48.522 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T11:36:48.523 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T11:36:48.523 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T11:36:48.523 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2024-09-21T11:36:48.523 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2024-09-21T11:36:48.523 DEBUG:teuthology.orchestra.run.smithi118:> return f 2024-09-21T11:36:48.523 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T11:36:48.523 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T11:36:48.523 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.0")) 2024-09-21T11:36:48.523 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T11:36:48.640 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.0.78238.asok 2024-09-21T11:36:48.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:48.651 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.78238.asok 2024-09-21T11:36:48.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:48.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.78238.asok status 2024-09-21T11:36:48.788 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:36:48.788 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2024-09-21T11:36:48.788 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "4e45e6b490e6cbe082cdf155fea780438ec53fc7", 2024-09-21T11:36:48.788 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T11:36:48.788 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "0", 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "78238", 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 14606, 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 14606 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:36:48.789 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2284766377 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2284766377 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.14606 192.168.0.1:0/2284766377", 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.1:0/2284766377", 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2024-09-21T11:36:48.790 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 16, 2024-09-21T11:36:48.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 45, 2024-09-21T11:36:48.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2024-09-21T11:36:48.791 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2024-09-21T11:36:48.791 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2024-09-21T11:36:48.791 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:36:48.798 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T11:36:48.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T11:36:49.073 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:49.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.505+0000 7f86578c7640 1 -- 172.21.15.118:0/2132357096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 msgr2=0x7f865010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:49.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.505+0000 7f86578c7640 1 --2- 172.21.15.118:0/2132357096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 0x7f865010b8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8640009880 tx=0x7f864002a530 comp rx=0 tx=0).stop 2024-09-21T11:36:49.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.505+0000 7f86578c7640 1 -- 172.21.15.118:0/2132357096 shutdown_connections 2024-09-21T11:36:49.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.505+0000 7f86578c7640 1 --2- 172.21.15.118:0/2132357096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 0x7f865010b8f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:49.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.505+0000 7f86578c7640 1 --2- 172.21.15.118:0/2132357096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8650102ae0 0x7f8650102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:49.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.505+0000 7f86578c7640 1 -- 172.21.15.118:0/2132357096 >> 172.21.15.118:0/2132357096 conn(0x7f86500fc520 msgr2=0x7f86500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:49.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.505+0000 7f86578c7640 1 -- 172.21.15.118:0/2132357096 shutdown_connections 2024-09-21T11:36:49.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.505+0000 7f86578c7640 1 -- 172.21.15.118:0/2132357096 wait complete. 2024-09-21T11:36:49.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.506+0000 7f86578c7640 1 Processor -- start 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.506+0000 7f86578c7640 1 -- start start 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.506+0000 7f86578c7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8650102ae0 0x7f8650100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.506+0000 7f86578c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 0x7f8650100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.506+0000 7f86578c7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f865010ee10 con 0x7f8650103400 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.506+0000 7f86578c7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f865010ec90 con 0x7f8650102ae0 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.506+0000 7f8654e62640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 0x7f8650100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.506+0000 7f8654e62640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 0x7f8650100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40616/0 (socket says 172.21.15.118:40616) 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.506+0000 7f8654e62640 1 -- 172.21.15.118:0/2462350369 learned_addr learned my addr 172.21.15.118:0/2462350369 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f8655663640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8650102ae0 0x7f8650100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f8654e62640 1 -- 172.21.15.118:0/2462350369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8650102ae0 msgr2=0x7f8650100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f8654e62640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8650102ae0 0x7f8650100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f8654e62640 1 -- 172.21.15.118:0/2462350369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86501011c0 con 0x7f8650103400 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f8654e62640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 0x7f8650100c80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8640031460 tx=0x7f8640004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:49.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f86467fc640 1 -- 172.21.15.118:0/2462350369 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f864003f070 con 0x7f8650103400 2024-09-21T11:36:49.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f86467fc640 1 -- 172.21.15.118:0/2462350369 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86400035f0 con 0x7f8650103400 2024-09-21T11:36:49.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8650101450 con 0x7f8650103400 2024-09-21T11:36:49.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f86467fc640 1 -- 172.21.15.118:0/2462350369 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8640035030 con 0x7f8650103400 2024-09-21T11:36:49.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.507+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86501a3de0 con 0x7f8650103400 2024-09-21T11:36:49.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.508+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865006abe0 con 0x7f8650103400 2024-09-21T11:36:49.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.509+0000 7f86467fc640 1 -- 172.21.15.118:0/2462350369 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f8640042070 con 0x7f8650103400 2024-09-21T11:36:49.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.509+0000 7f86467fc640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f863c06e2b0 0x7f863c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:49.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.509+0000 7f86467fc640 1 -- 172.21.15.118:0/2462350369 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f86400aeb70 con 0x7f8650103400 2024-09-21T11:36:49.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.509+0000 7f8655663640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f863c06e2b0 0x7f863c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:49.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.510+0000 7f8655663640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f863c06e2b0 0x7f863c070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f864c005fd0 tx=0x7f864c005850 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:49.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.514+0000 7f86467fc640 1 -- 172.21.15.118:0/2462350369 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f864007c470 con 0x7f8650103400 2024-09-21T11:36:49.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.717+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8650105f80 con 0x7f8650103400 2024-09-21T11:36:49.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.717+0000 7f86467fc640 1 -- 172.21.15.118:0/2462350369 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+83 (secure 0 0 0) 0x7f8640080120 con 0x7f8650103400 2024-09-21T11:36:49.718 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T11:36:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f863c06e2b0 msgr2=0x7f863c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f863c06e2b0 0x7f863c070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f864c005fd0 tx=0x7f864c005850 comp rx=0 tx=0).stop 2024-09-21T11:36:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 msgr2=0x7f8650100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 0x7f8650100c80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8640031460 tx=0x7f8640004530 comp rx=0 tx=0).stop 2024-09-21T11:36:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 shutdown_connections 2024-09-21T11:36:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f863c06e2b0 0x7f863c070770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8650103400 0x7f8650100c80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 --2- 172.21.15.118:0/2462350369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8650102ae0 0x7f8650100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 >> 172.21.15.118:0/2462350369 conn(0x7f86500fc520 msgr2=0x7f8650108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 shutdown_connections 2024-09-21T11:36:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:49.719+0000 7f86578c7640 1 -- 172.21.15.118:0/2462350369 wait complete. 2024-09-21T11:36:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:49 smithi118 ceph-mon[28757]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T11:36:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:36:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:49 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:49 smithi149 ceph-mon[36123]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T11:36:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:49 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:49 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:49 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:36:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:49 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:36:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:49 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:50.391 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T11:36:50.391 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T11:36:50.391 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T11:36:50.391 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T11:36:50.392 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:50.392 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T11:36:50.392 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T11:36:50.392 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T11:36:50.392 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T11:36:50.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:50.393 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T11:36:50.413 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T11:36:50.413 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T11:36:50.413 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T11:36:50.413 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T11:36:50.413 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T11:36:50.413 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T11:36:50.414 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T11:36:50.414 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T11:36:50.414 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T11:36:50.414 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T11:36:50.414 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T11:36:50.414 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T11:36:50.415 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T11:36:50.415 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T11:36:50.415 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T11:36:50.415 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T11:36:50.415 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T11:36:50.415 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42334sec preferred_lft 42334sec 2024-09-21T11:36:50.415 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T11:36:50.415 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T11:36:50.416 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T11:36:50.416 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:50.416 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T11:36:50.416 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2024-09-21T11:36:50.416 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2024-09-21T11:36:50.416 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2024-09-21T11:36:50.416 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T11:36:50.416 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T11:36:50.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:50.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:50.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:50.642 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T11:36:50.668 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T11:36:50.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:50.670 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T11:36:50.746 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T11:36:50.746 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T11:36:50.747 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T11:36:50.747 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T11:36:50.747 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T11:36:50.747 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:50.747 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T11:36:50.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T11:36:50.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T11:36:50.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T11:36:50.747 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T11:36:50.835 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:50.844 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:50 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2462350369' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T11:36:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:50 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2462350369' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T11:36:51.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:51.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:51.095 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T11:36:51.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:51.110 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-09-21T11:36:51.166 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:51.166 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T11:36:51.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T11:36:51.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T11:36:51.166 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T11:36:51.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:51.277 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:51.283 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T11:36:51.284 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:51.284 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T11:36:51.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T11:36:51.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T11:36:51.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T11:36:51.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T11:36:51.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T11:36:51.284 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T11:36:51.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:51.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:51.414 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T11:36:51.414 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T11:36:51.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T11:36:51.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T11:36:51.414 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T11:36:51.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T11:36:51.486 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:51.493 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-21T11:36:51.493 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T11:36:51.493 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:51.508 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T11:36:51.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T11:36:51.508 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:51.562 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-09-21T11:36:51.628 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T11:36:51.685 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-09-21T11:36:51.685 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/selinux 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:51.686 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/0 2024-09-21T11:36:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/793a2f34269f5353b52c55875ab4e6acb3aac19336d337423b2f27092682fc93/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/e52345c3920b4cbfbb09a8df5e7b4f7aafc234b0cab80d5ac4732391650fb677/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/c9e245d582d5a074aa00391c39ab0834861049288006573e87f45c3c18fc3edf/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/5f691a4eeb933c3682c1f8fec3bede7a76d83b7c4ebdb8b0b8cf3c5d40fd2685/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/1c06d962379d3ab0f45e267805057e09770abb2c26a12a110bd14a49c3c2868a/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/2ed0df6c42e190f90e3071749fc1de37a4668f24a41015100e173f1571943ab4/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/274d14a9f1a614177f6c562528128911c93c133bd38c43bd2b9b4099ce80eabe/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/48f031573fc3aed3f50dce8a5c777041452363bdafd66b56b88d7222bec00153/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/b6b6cba45da037be97c624f57d941c6cc1d500dd60b5bbb1ccdf0fc7833539ae/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/aeffaad74cb33c8f005284694c3209c58a5aade90962a79d3ed7b7d9cc8a938f/merged 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T11:36:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T11:36:51.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:51.689 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-09-21T11:36:51.741 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T11:36:51.741 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-21T11:36:51.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-09-21T11:36:51.807 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T11:36:51.863 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-09-21T11:36:51.863 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-09-21T11:36:51.863 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/selinux 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-09-21T11:36:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/0 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/793a2f34269f5353b52c55875ab4e6acb3aac19336d337423b2f27092682fc93/merged 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/e52345c3920b4cbfbb09a8df5e7b4f7aafc234b0cab80d5ac4732391650fb677/merged 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/c9e245d582d5a074aa00391c39ab0834861049288006573e87f45c3c18fc3edf/merged 2024-09-21T11:36:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/5f691a4eeb933c3682c1f8fec3bede7a76d83b7c4ebdb8b0b8cf3c5d40fd2685/merged 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/1c06d962379d3ab0f45e267805057e09770abb2c26a12a110bd14a49c3c2868a/merged 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/2ed0df6c42e190f90e3071749fc1de37a4668f24a41015100e173f1571943ab4/merged 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/274d14a9f1a614177f6c562528128911c93c133bd38c43bd2b9b4099ce80eabe/merged 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/48f031573fc3aed3f50dce8a5c777041452363bdafd66b56b88d7222bec00153/merged 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/b6b6cba45da037be97c624f57d941c6cc1d500dd60b5bbb1ccdf0fc7833539ae/merged 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/aeffaad74cb33c8f005284694c3209c58a5aade90962a79d3ed7b7d9cc8a938f/merged 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T11:36:51.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:51.866 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-09-21T11:36:51.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi149.stderr:2024-09-21T11:36:51.911+0000 7f512168d480 -1 init, newargv = 0x55e0502f1000 newargc=15 2024-09-21T11:36:51.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi149.stderr:ceph-fuse[61350]: starting ceph client 2024-09-21T11:36:51.920 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi149.stderr:ceph-fuse[61350]: starting fuse 2024-09-21T11:36:51.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:51 smithi149 ceph-mon[36123]: pgmap v189: 65 pgs: 65 active+clean; 581 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T11:36:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:51 smithi118 ceph-mon[28757]: pgmap v189: 65 pgs: 65 active+clean; 581 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T11:36:53.020 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-09-21T11:36:53.054 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T11:36:53.114 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-09-21T11:36:53.115 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/selinux 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-09-21T11:36:53.116 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/0 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/793a2f34269f5353b52c55875ab4e6acb3aac19336d337423b2f27092682fc93/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/e52345c3920b4cbfbb09a8df5e7b4f7aafc234b0cab80d5ac4732391650fb677/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/c9e245d582d5a074aa00391c39ab0834861049288006573e87f45c3c18fc3edf/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/5f691a4eeb933c3682c1f8fec3bede7a76d83b7c4ebdb8b0b8cf3c5d40fd2685/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/1c06d962379d3ab0f45e267805057e09770abb2c26a12a110bd14a49c3c2868a/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/2ed0df6c42e190f90e3071749fc1de37a4668f24a41015100e173f1571943ab4/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/274d14a9f1a614177f6c562528128911c93c133bd38c43bd2b9b4099ce80eabe/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/48f031573fc3aed3f50dce8a5c777041452363bdafd66b56b88d7222bec00153/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/b6b6cba45da037be97c624f57d941c6cc1d500dd60b5bbb1ccdf0fc7833539ae/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/aeffaad74cb33c8f005284694c3209c58a5aade90962a79d3ed7b7d9cc8a938f/merged 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-09-21T11:36:53.117 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T11:36:53.118 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T11:36:53.118 INFO:teuthology.orchestra.run.smithi149.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:53.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:53.118 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-09-21T11:36:53.173 INFO:teuthology.orchestra.run.smithi149.stdout:129 2024-09-21T11:36:53.173 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-21T11:36:53.173 DEBUG:teuthology.orchestra.run.smithi149:> sudo stdin-killer -- python3 -c ' 2024-09-21T11:36:53.173 DEBUG:teuthology.orchestra.run.smithi149:> import glob 2024-09-21T11:36:53.173 DEBUG:teuthology.orchestra.run.smithi149:> import re 2024-09-21T11:36:53.173 DEBUG:teuthology.orchestra.run.smithi149:> import os 2024-09-21T11:36:53.173 DEBUG:teuthology.orchestra.run.smithi149:> import subprocess 2024-09-21T11:36:53.173 DEBUG:teuthology.orchestra.run.smithi149:> 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> def _find_admin_socket(client_name): 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> files = glob.glob(asok_path) 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> # Given a non-glob path, it better be there 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> if "*" not in asok_path: 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> assert(len(files) == 1) 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> return files[0] 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> for f in files: 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T11:36:53.174 DEBUG:teuthology.orchestra.run.smithi149:> contents = proc_f.read() 2024-09-21T11:36:53.175 DEBUG:teuthology.orchestra.run.smithi149:> if mountpoint in contents: 2024-09-21T11:36:53.175 DEBUG:teuthology.orchestra.run.smithi149:> return f 2024-09-21T11:36:53.175 DEBUG:teuthology.orchestra.run.smithi149:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T11:36:53.175 DEBUG:teuthology.orchestra.run.smithi149:> 2024-09-21T11:36:53.175 DEBUG:teuthology.orchestra.run.smithi149:> print(_find_admin_socket("client.1")) 2024-09-21T11:36:53.175 DEBUG:teuthology.orchestra.run.smithi149:> ' 2024-09-21T11:36:53.301 INFO:teuthology.orchestra.run.smithi149.stdout:/var/run/ceph/ceph-client.1.61350.asok 2024-09-21T11:36:53.304 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T11:36:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T11:36:53.312 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61350.asok 2024-09-21T11:36:53.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:53.312 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61350.asok status 2024-09-21T11:36:53.447 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-21T11:36:53.447 INFO:teuthology.orchestra.run.smithi149.stdout: "metadata": { 2024-09-21T11:36:53.447 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_sha1": "4e45e6b490e6cbe082cdf155fea780438ec53fc7", 2024-09-21T11:36:53.447 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T11:36:53.447 INFO:teuthology.orchestra.run.smithi149.stdout: "entity_id": "1", 2024-09-21T11:36:53.447 INFO:teuthology.orchestra.run.smithi149.stdout: "hostname": "smithi149", 2024-09-21T11:36:53.447 INFO:teuthology.orchestra.run.smithi149.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "pid": "61350", 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "root": "/" 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_count": 0, 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_pinned_count": 0, 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 24327, 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "inst": { 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "name": { 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "client", 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "num": 24327 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2024-09-21T11:36:53.448 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 3135304614 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 3135304614 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "inst_str": "client.24327 192.168.0.1:0/3135304614", 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "addr_str": "192.168.0.1:0/3135304614", 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "inode_count": 1, 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_epoch": 16, 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch": 45, 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch_barrier": 0, 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "blocklisted": false, 2024-09-21T11:36:53.449 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs" 2024-09-21T11:36:53.450 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-21T11:36:53.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:53.456 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2024-09-21T11:36:53.456 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:53.476 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2024-09-21T11:36:53.477 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:53.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:53.477 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:53.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:53.549 DEBUG:teuthology.orchestra.run.smithi149:> stat --file-system '--printf=%T 2024-09-21T11:36:53.549 DEBUG:teuthology.orchestra.run.smithi149:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:53.565 INFO:teuthology.orchestra.run.smithi149.stdout:fuseblk 2024-09-21T11:36:53.566 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:53.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T11:36:53.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:53 smithi118 ceph-mon[28757]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T11:36:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:36:53.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:53 smithi149 ceph-mon[36123]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T11:36:53.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:36:53.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:36:55.906 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:55 smithi118 ceph-mon[28757]: pgmap v191: 65 pgs: 65 active+clean; 582 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 5.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T11:36:55.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:55 smithi149 ceph-mon[36123]: pgmap v191: 65 pgs: 65 active+clean; 582 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 5.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T11:36:57.054 INFO:teuthology.run_tasks:Running task print... 2024-09-21T11:36:57.067 INFO:teuthology.task.print:**** done client 2024-09-21T11:36:57.067 INFO:teuthology.run_tasks:Running task parallel... 2024-09-21T11:36:57.114 INFO:teuthology.task.parallel:starting parallel... 2024-09-21T11:36:57.115 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T11:36:57.115 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T11:36:57.116 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:36:57.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T11:36:57.116 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T11:36:57.117 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-21T11:36:57.121 INFO:tasks.workunit:Pulling workunits from ref 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:36:57.121 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T11:36:57.121 INFO:tasks.workunit:timeout=3h 2024-09-21T11:36:57.121 INFO:tasks.workunit:cleanup=True 2024-09-21T11:36:57.121 DEBUG:teuthology.orchestra.run.smithi118:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:57.138 INFO:teuthology.orchestra.run.smithi118.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:57.138 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T11:36:57.138 INFO:teuthology.orchestra.run.smithi118.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-21T11:36:57.138 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:36:57.138 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T11:36:57.138 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T11:36:57.138 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-21 11:36:27.810739261 +0000 2024-09-21T11:36:57.139 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-21 11:36:53.545176142 +0000 2024-09-21T11:36:57.139 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2024-09-21T11:36:57.139 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T11:36:57.139 DEBUG:teuthology.orchestra.run.smithi118:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T11:36:57.209 DEBUG:teuthology.orchestra.run.smithi149:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:57.230 INFO:teuthology.orchestra.run.smithi149.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:57.230 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T11:36:57.231 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-21T11:36:57.231 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T11:36:57.231 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T11:36:57.231 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T11:36:57.231 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 11:36:57.201886721 +0000 2024-09-21T11:36:57.231 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 11:36:57.201886721 +0000 2024-09-21T11:36:57.231 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2024-09-21T11:36:57.231 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-21T11:36:57.231 DEBUG:teuthology.orchestra.run.smithi149:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-21T11:36:57.308 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:36:57.308 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:36:57.325 INFO:tasks.workunit.client.0.smithi118.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T11:36:57.366 INFO:tasks.workunit.client.1.smithi149.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-21T11:36:57.379 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:57.775 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:57 smithi118 ceph-mon[28757]: pgmap v192: 65 pgs: 65 active+clean; 582 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.6 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.859+0000 7f6bc4acd640 1 -- 172.21.15.118:0/3346312073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 msgr2=0x7f6bc0101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.859+0000 7f6bc4acd640 1 --2- 172.21.15.118:0/3346312073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 0x7f6bc0101ec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009880 tx=0x7f6bb402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.859+0000 7f6bc4acd640 1 -- 172.21.15.118:0/3346312073 shutdown_connections 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.859+0000 7f6bc4acd640 1 --2- 172.21.15.118:0/3346312073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 0x7f6bc0101ec0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.859+0000 7f6bc4acd640 1 --2- 172.21.15.118:0/3346312073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bc0100840 0x7f6bc0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.859+0000 7f6bc4acd640 1 -- 172.21.15.118:0/3346312073 >> 172.21.15.118:0/3346312073 conn(0x7f6bc00fbff0 msgr2=0x7f6bc00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.859+0000 7f6bc4acd640 1 -- 172.21.15.118:0/3346312073 shutdown_connections 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.859+0000 7f6bc4acd640 1 -- 172.21.15.118:0/3346312073 wait complete. 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bc4acd640 1 Processor -- start 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bc4acd640 1 -- start start 2024-09-21T11:36:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bc4acd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bc0100840 0x7f6bc0197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bc4acd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 0x7f6bc0197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bc4acd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc0109660 con 0x7f6bc0101a40 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bc4acd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01094e0 con 0x7f6bc0100840 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bbdd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 0x7f6bc0197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bbdd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 0x7f6bc0197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41158/0 (socket says 172.21.15.118:41158) 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bbdd9b640 1 -- 172.21.15.118:0/1134389613 learned_addr learned my addr 172.21.15.118:0/1134389613 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bbe59c640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bc0100840 0x7f6bc0197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bbdd9b640 1 -- 172.21.15.118:0/1134389613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bc0100840 msgr2=0x7f6bc0197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bbdd9b640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bc0100840 0x7f6bc0197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bbdd9b640 1 -- 172.21.15.118:0/1134389613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc01980f0 con 0x7f6bc0101a40 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.860+0000 7f6bbe59c640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bc0100840 0x7f6bc0197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.861+0000 7f6bbdd9b640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 0x7f6bc0197a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4006010 tx=0x7f6bb40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.861+0000 7f6baf7fe640 1 -- 172.21.15.118:0/1134389613 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bb403f070 con 0x7f6bc0101a40 2024-09-21T11:36:57.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.861+0000 7f6baf7fe640 1 -- 172.21.15.118:0/1134389613 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bb40049d0 con 0x7f6bc0101a40 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.861+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc019cad0 con 0x7f6bc0101a40 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.861+0000 7f6baf7fe640 1 -- 172.21.15.118:0/1134389613 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bb4035030 con 0x7f6bc0101a40 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.861+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc019d060 con 0x7f6bc0101a40 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.862+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc0100c40 con 0x7f6bc0101a40 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.862+0000 7f6baf7fe640 1 -- 172.21.15.118:0/1134389613 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f6bb4042070 con 0x7f6bc0101a40 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.863+0000 7f6baf7fe640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6ba806e2b0 0x7f6ba8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.863+0000 7f6baf7fe640 1 -- 172.21.15.118:0/1134389613 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f6bb40aed00 con 0x7f6bc0101a40 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.863+0000 7f6bbe59c640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6ba806e2b0 0x7f6ba8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.863+0000 7f6bbe59c640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6ba806e2b0 0x7f6ba8070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6bc01018a0 tx=0x7f6bb0005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:57.867+0000 7f6baf7fe640 1 -- 172.21.15.118:0/1134389613 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6bb40b2030 con 0x7f6bc0101a40 2024-09-21T11:36:57.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:57 smithi149 ceph-mon[36123]: pgmap v192: 65 pgs: 65 active+clean; 582 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.6 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T11:36:58.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.032+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f6bc019d890 con 0x7f6bc0101a40 2024-09-21T11:36:58.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.033+0000 7f6baf7fe640 1 -- 172.21.15.118:0/1134389613 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v42)=0 v42) ==== 155+0+0 (secure 0 0 0) 0x7f6bb407c600 con 0x7f6bc0101a40 2024-09-21T11:36:58.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6ba806e2b0 msgr2=0x7f6ba8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:58.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6ba806e2b0 0x7f6ba8070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6bc01018a0 tx=0x7f6bb0005f90 comp rx=0 tx=0).stop 2024-09-21T11:36:58.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 msgr2=0x7f6bc0197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:58.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 0x7f6bc0197a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4006010 tx=0x7f6bb40045e0 comp rx=0 tx=0).stop 2024-09-21T11:36:58.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 shutdown_connections 2024-09-21T11:36:58.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6ba806e2b0 0x7f6ba8070770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:58.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bc0101a40 0x7f6bc0197a70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:58.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 --2- 172.21.15.118:0/1134389613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bc0100840 0x7f6bc0197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:58.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 >> 172.21.15.118:0/1134389613 conn(0x7f6bc00fbff0 msgr2=0x7f6bc0069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:58.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 shutdown_connections 2024-09-21T11:36:58.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:58.035+0000 7f6bc4acd640 1 -- 172.21.15.118:0/1134389613 wait complete. 2024-09-21T11:36:58.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T11:36:59.051 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.473+0000 7fe503d10640 1 -- 172.21.15.118:0/3785774509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc101990 msgr2=0x7fe4fc101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.473+0000 7fe503d10640 1 --2- 172.21.15.118:0/3785774509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc101990 0x7fe4fc101d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009880 tx=0x7fe4ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.473+0000 7fe503d10640 1 -- 172.21.15.118:0/3785774509 shutdown_connections 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.473+0000 7fe503d10640 1 --2- 172.21.15.118:0/3785774509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4fc102b90 0x7fe4fc103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.473+0000 7fe503d10640 1 --2- 172.21.15.118:0/3785774509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc101990 0x7fe4fc101d90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.473+0000 7fe503d10640 1 -- 172.21.15.118:0/3785774509 >> 172.21.15.118:0/3785774509 conn(0x7fe4fc0fd140 msgr2=0x7fe4fc0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.473+0000 7fe503d10640 1 -- 172.21.15.118:0/3785774509 shutdown_connections 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.473+0000 7fe503d10640 1 -- 172.21.15.118:0/3785774509 wait complete. 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe503d10640 1 Processor -- start 2024-09-21T11:36:59.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe503d10640 1 -- start start 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe503d10640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4fc101990 0x7fe4fc197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe503d10640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc102b90 0x7fe4fc197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe503d10640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc10a830 con 0x7fe4fc102b90 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe503d10640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc10a6b0 con 0x7fe4fc101990 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe5012ab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc102b90 0x7fe4fc197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe5012ab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc102b90 0x7fe4fc197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41164/0 (socket says 172.21.15.118:41164) 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe5012ab640 1 -- 172.21.15.118:0/256577218 learned_addr learned my addr 172.21.15.118:0/256577218 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe501aac640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4fc101990 0x7fe4fc197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe5012ab640 1 -- 172.21.15.118:0/256577218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4fc101990 msgr2=0x7fe4fc197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe5012ab640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4fc101990 0x7fe4fc197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe5012ab640 1 -- 172.21.15.118:0/256577218 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4fc198130 con 0x7fe4fc102b90 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe5012ab640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc102b90 0x7fe4fc197ab0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800b420 tx=0x7fe4f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:59.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe4f2ffd640 1 -- 172.21.15.118:0/256577218 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4f8011630 con 0x7fe4fc102b90 2024-09-21T11:36:59.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4fc19cb70 con 0x7fe4fc102b90 2024-09-21T11:36:59.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.474+0000 7fe4f2ffd640 1 -- 172.21.15.118:0/256577218 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4f8016070 con 0x7fe4fc102b90 2024-09-21T11:36:59.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.475+0000 7fe4f2ffd640 1 -- 172.21.15.118:0/256577218 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4f8010d40 con 0x7fe4fc102b90 2024-09-21T11:36:59.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.475+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4fc074670 con 0x7fe4fc102b90 2024-09-21T11:36:59.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.476+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4fc101d90 con 0x7fe4fc102b90 2024-09-21T11:36:59.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.476+0000 7fe4f2ffd640 1 -- 172.21.15.118:0/256577218 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fe4f801b460 con 0x7fe4fc102b90 2024-09-21T11:36:59.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.476+0000 7fe4f2ffd640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe4e80726c0 0x7fe4e8074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:36:59.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.477+0000 7fe4f2ffd640 1 -- 172.21.15.118:0/256577218 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fe4f808daa0 con 0x7fe4fc102b90 2024-09-21T11:36:59.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.477+0000 7fe501aac640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe4e80726c0 0x7fe4e8074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:36:59.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.477+0000 7fe501aac640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe4e80726c0 0x7fe4e8074b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec000c00 tx=0x7fe4ec005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:36:59.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.481+0000 7fe4f2ffd640 1 -- 172.21.15.118:0/256577218 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4f805b3a0 con 0x7fe4fc102b90 2024-09-21T11:36:59.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.649+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fe4fc062df0 con 0x7fe4fc102b90 2024-09-21T11:36:59.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.649+0000 7fe4f2ffd640 1 -- 172.21.15.118:0/256577218 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v42)=0 v42) ==== 163+0+0 (secure 0 0 0) 0x7fe4f805f050 con 0x7fe4fc102b90 2024-09-21T11:36:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe4e80726c0 msgr2=0x7fe4e8074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe4e80726c0 0x7fe4e8074b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec000c00 tx=0x7fe4ec005a20 comp rx=0 tx=0).stop 2024-09-21T11:36:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc102b90 msgr2=0x7fe4fc197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:36:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc102b90 0x7fe4fc197ab0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800b420 tx=0x7fe4f800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:36:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 shutdown_connections 2024-09-21T11:36:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fe4e80726c0 0x7fe4e8074b80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4fc102b90 0x7fe4fc197ab0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 --2- 172.21.15.118:0/256577218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4fc101990 0x7fe4fc197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:36:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 >> 172.21.15.118:0/256577218 conn(0x7fe4fc0fd140 msgr2=0x7fe4fc106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:36:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 shutdown_connections 2024-09-21T11:36:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:36:59.651+0000 7fe503d10640 1 -- 172.21.15.118:0/256577218 wait complete. 2024-09-21T11:36:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:36:59 smithi118 ceph-mon[28757]: pgmap v193: 65 pgs: 65 active+clean; 582 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T11:36:59.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:36:59 smithi149 ceph-mon[36123]: pgmap v193: 65 pgs: 65 active+clean; 582 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T11:37:00.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T11:37:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:37:00.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.986+0000 7f39a06c4640 1 -- 172.21.15.118:0/3578005519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 msgr2=0x7f3998104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:00.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.986+0000 7f39a06c4640 1 --2- 172.21.15.118:0/3578005519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 0x7f3998104800 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f39940098b0 tx=0x7f399402a4d0 comp rx=0 tx=0).stop 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.986+0000 7f39a06c4640 1 -- 172.21.15.118:0/3578005519 shutdown_connections 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.986+0000 7f39a06c4640 1 --2- 172.21.15.118:0/3578005519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3998104d40 0x7f3998107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.986+0000 7f39a06c4640 1 --2- 172.21.15.118:0/3578005519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 0x7f3998104800 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.986+0000 7f39a06c4640 1 -- 172.21.15.118:0/3578005519 >> 172.21.15.118:0/3578005519 conn(0x7f39980fc010 msgr2=0x7f39980fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.986+0000 7f39a06c4640 1 -- 172.21.15.118:0/3578005519 shutdown_connections 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.986+0000 7f39a06c4640 1 -- 172.21.15.118:0/3578005519 wait complete. 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f39a06c4640 1 Processor -- start 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f39a06c4640 1 -- start start 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f39a06c4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 0x7f3998197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f39a06c4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3998104d40 0x7f3998197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:00.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f39a06c4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f399810a850 con 0x7f3998102410 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f39a06c4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f399810a6d0 con 0x7f3998104d40 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f399e460640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 0x7f3998197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f399e460640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 0x7f3998197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41174/0 (socket says 172.21.15.118:41174) 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f399e460640 1 -- 172.21.15.118:0/4101515370 learned_addr learned my addr 172.21.15.118:0/4101515370 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f399dc5f640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3998104d40 0x7f3998197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f399e460640 1 -- 172.21.15.118:0/4101515370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3998104d40 msgr2=0x7f3998197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f399e460640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3998104d40 0x7f3998197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.987+0000 7f399e460640 1 -- 172.21.15.118:0/4101515370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3998198110 con 0x7f3998102410 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.988+0000 7f399e460640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 0x7f3998197550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39940099d0 tx=0x7f39940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.988+0000 7f398f7fe640 1 -- 172.21.15.118:0/4101515370 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f399403f070 con 0x7f3998102410 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.988+0000 7f398f7fe640 1 -- 172.21.15.118:0/4101515370 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3994004c70 con 0x7f3998102410 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.988+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399819caf0 con 0x7f3998102410 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.988+0000 7f398f7fe640 1 -- 172.21.15.118:0/4101515370 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3994035030 con 0x7f3998102410 2024-09-21T11:37:00.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.988+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399819d080 con 0x7f3998102410 2024-09-21T11:37:00.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.989+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39981027f0 con 0x7f3998102410 2024-09-21T11:37:00.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.989+0000 7f398f7fe640 1 -- 172.21.15.118:0/4101515370 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f3994042070 con 0x7f3998102410 2024-09-21T11:37:00.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.990+0000 7f398f7fe640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f398406e2b0 0x7f3984070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:00.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.990+0000 7f398f7fe640 1 -- 172.21.15.118:0/4101515370 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f39940aee60 con 0x7f3998102410 2024-09-21T11:37:00.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.990+0000 7f399dc5f640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f398406e2b0 0x7f3984070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:00.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.990+0000 7f399dc5f640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f398406e2b0 0x7f3984070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3998198a00 tx=0x7f3988008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:00.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:00.994+0000 7f398f7fe640 1 -- 172.21.15.118:0/4101515370 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f399407c760 con 0x7f3998102410 2024-09-21T11:37:01.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.160+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f399819d350 con 0x7f3998102410 2024-09-21T11:37:01.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.161+0000 7f398f7fe640 1 -- 172.21.15.118:0/4101515370 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v42)=0 v42) ==== 135+0+0 (secure 0 0 0) 0x7f3994080410 con 0x7f3998102410 2024-09-21T11:37:01.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.162+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f398406e2b0 msgr2=0x7f3984070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:01.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.162+0000 7f39a06c4640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f398406e2b0 0x7f3984070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3998198a00 tx=0x7f3988008040 comp rx=0 tx=0).stop 2024-09-21T11:37:01.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.162+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 msgr2=0x7f3998197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:01.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.162+0000 7f39a06c4640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 0x7f3998197550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39940099d0 tx=0x7f39940048f0 comp rx=0 tx=0).stop 2024-09-21T11:37:01.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.163+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 shutdown_connections 2024-09-21T11:37:01.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.163+0000 7f39a06c4640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f398406e2b0 0x7f3984070770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.163+0000 7f39a06c4640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3998104d40 0x7f3998197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.163+0000 7f39a06c4640 1 --2- 172.21.15.118:0/4101515370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3998102410 0x7f3998197550 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.163+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 >> 172.21.15.118:0/4101515370 conn(0x7f39980fc010 msgr2=0x7f39980fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.163+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 shutdown_connections 2024-09-21T11:37:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:01.163+0000 7f39a06c4640 1 -- 172.21.15.118:0/4101515370 wait complete. 2024-09-21T11:37:01.750 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:01 smithi118 ceph-mon[28757]: pgmap v194: 65 pgs: 65 active+clean; 582 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-09-21T11:37:01.778 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-21T11:37:01.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:01 smithi149 ceph-mon[36123]: pgmap v194: 65 pgs: 65 active+clean; 582 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-09-21T11:37:02.024 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:37:02.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.485+0000 7f10a0fb0640 1 -- 172.21.15.118:0/3787288019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 msgr2=0x7f109c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:02.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.485+0000 7f10a0fb0640 1 --2- 172.21.15.118:0/3787288019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 0x7f109c101ec0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1084009880 tx=0x7f108402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:37:02.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 -- 172.21.15.118:0/3787288019 shutdown_connections 2024-09-21T11:37:02.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 --2- 172.21.15.118:0/3787288019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 0x7f109c101ec0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:02.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 --2- 172.21.15.118:0/3787288019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f109c100840 0x7f109c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:02.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 -- 172.21.15.118:0/3787288019 >> 172.21.15.118:0/3787288019 conn(0x7f109c0fbff0 msgr2=0x7f109c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:02.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 -- 172.21.15.118:0/3787288019 shutdown_connections 2024-09-21T11:37:02.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 -- 172.21.15.118:0/3787288019 wait complete. 2024-09-21T11:37:02.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 Processor -- start 2024-09-21T11:37:02.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 -- start start 2024-09-21T11:37:02.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f109c100840 0x7f109c1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:02.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 0x7f109c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:02.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f109c109660 con 0x7f109c101a40 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.486+0000 7f10a0fb0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f109c1094e0 con 0x7f109c100840 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f1093fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 0x7f109c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f1093fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 0x7f109c1979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41192/0 (socket says 172.21.15.118:41192) 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f1093fff640 1 -- 172.21.15.118:0/1090501422 learned_addr learned my addr 172.21.15.118:0/1090501422 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f109a59c640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f109c100840 0x7f109c1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f1093fff640 1 -- 172.21.15.118:0/1090501422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f109c100840 msgr2=0x7f109c1974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f1093fff640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f109c100840 0x7f109c1974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f1093fff640 1 -- 172.21.15.118:0/1090501422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109c198070 con 0x7f109c101a40 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f1093fff640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 0x7f109c1979f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1084006010 tx=0x7f10840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f10937fe640 1 -- 172.21.15.118:0/1090501422 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f108403f070 con 0x7f109c101a40 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109c19ca50 con 0x7f109c101a40 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f10937fe640 1 -- 172.21.15.118:0/1090501422 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1084004ac0 con 0x7f109c101a40 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f10937fe640 1 -- 172.21.15.118:0/1090501422 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1084035030 con 0x7f109c101a40 2024-09-21T11:37:02.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.487+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109c19cfe0 con 0x7f109c101a40 2024-09-21T11:37:02.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.488+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109c100c40 con 0x7f109c101a40 2024-09-21T11:37:02.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.489+0000 7f10937fe640 1 -- 172.21.15.118:0/1090501422 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f1084042070 con 0x7f109c101a40 2024-09-21T11:37:02.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.489+0000 7f10937fe640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f108806e2b0 0x7f1088070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:02.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.489+0000 7f10937fe640 1 -- 172.21.15.118:0/1090501422 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f10840aed80 con 0x7f109c101a40 2024-09-21T11:37:02.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.489+0000 7f109a59c640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f108806e2b0 0x7f1088070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:02.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.490+0000 7f109a59c640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f108806e2b0 0x7f1088070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f109c1018a0 tx=0x7f108c00b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:02.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.494+0000 7f10937fe640 1 -- 172.21.15.118:0/1090501422 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1084080330 con 0x7f109c101a40 2024-09-21T11:37:02.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:02.676+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7f109c06a2f0 con 0x7f108806e2b0 2024-09-21T11:37:03.931 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:03 smithi118 ceph-mon[28757]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-09-21T11:37:03.931 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:03 smithi118 ceph-mon[28757]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:03.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:03 smithi149 ceph-mon[36123]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-09-21T11:37:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:03 smithi149 ceph-mon[36123]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:05.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:05 smithi149 ceph-mon[36123]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 1 op/s 2024-09-21T11:37:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:05 smithi118 ceph-mon[28757]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 1 op/s 2024-09-21T11:37:07.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:07 smithi149 ceph-mon[36123]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2024-09-21T11:37:08.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:07 smithi118 ceph-mon[28757]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2024-09-21T11:37:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:37:09.035 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:37:09.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:09 smithi149 ceph-mon[36123]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-09-21T11:37:10.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:09 smithi118 ceph-mon[28757]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-09-21T11:37:11.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:11 smithi149 ceph-mon[36123]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-09-21T11:37:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:11 smithi118 ceph-mon[28757]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-09-21T11:37:13.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:13 smithi149 ceph-mon[36123]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-21T11:37:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:13 smithi118 ceph-mon[28757]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-21T11:37:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:15 smithi149 ceph-mon[36123]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T11:37:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:15 smithi118 ceph-mon[28757]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T11:37:17.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:17 smithi149 ceph-mon[36123]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T11:37:18.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:17 smithi118 ceph-mon[28757]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T11:37:19.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:19 smithi149 ceph-mon[36123]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T11:37:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:19 smithi118 ceph-mon[28757]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T11:37:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:21 smithi149 ceph-mon[36123]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T11:37:22.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:21 smithi118 ceph-mon[28757]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T11:37:23.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:23 smithi149 ceph-mon[36123]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T11:37:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:37:24.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:23 smithi118 ceph-mon[28757]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T11:37:24.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:37:25.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:25 smithi149 ceph-mon[36123]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:26.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:25 smithi118 ceph-mon[28757]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:27 smithi149 ceph-mon[36123]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:27.950 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:27 smithi118 ceph-mon[28757]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:29 smithi118 ceph-mon[28757]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:29.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:29 smithi149 ceph-mon[36123]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:31.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:31 smithi149 ceph-mon[36123]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:31 smithi118 ceph-mon[28757]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:33.526 INFO:teuthology.orchestra.run.smithi118.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:37:33.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.524+0000 7f10937fe640 1 -- 172.21.15.118:0/1090501422 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f109c06a2f0 con 0x7f108806e2b0 2024-09-21T11:37:33.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f108806e2b0 msgr2=0x7f1088070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:33.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f108806e2b0 0x7f1088070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f109c1018a0 tx=0x7f108c00b390 comp rx=0 tx=0).stop 2024-09-21T11:37:33.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 msgr2=0x7f109c1979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:33.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 0x7f109c1979f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1084006010 tx=0x7f10840046c0 comp rx=0 tx=0).stop 2024-09-21T11:37:33.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 shutdown_connections 2024-09-21T11:37:33.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f108806e2b0 0x7f1088070770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:33.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109c101a40 0x7f109c1979f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:33.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 --2- 172.21.15.118:0/1090501422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f109c100840 0x7f109c1974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:33.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 >> 172.21.15.118:0/1090501422 conn(0x7f109c0fbff0 msgr2=0x7f109c069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:33.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 shutdown_connections 2024-09-21T11:37:33.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:33.528+0000 7f10a0fb0640 1 -- 172.21.15.118:0/1090501422 wait complete. 2024-09-21T11:37:33.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:33 smithi149 ceph-mon[36123]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:37:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:37:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:37:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:37:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:33 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:37:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:33 smithi118 ceph-mon[28757]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:37:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:37:34.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:37:34.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:37:34.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:33 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:37:34.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:34 smithi149 ceph-mon[36123]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:37:34.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:34 smithi149 ceph-mon[36123]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:37:35.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:34 smithi118 ceph-mon[28757]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:37:35.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:34 smithi118 ceph-mon[28757]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:37:35.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:35 smithi149 ceph-mon[36123]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:35 smithi118 ceph-mon[28757]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:37 smithi149 ceph-mon[36123]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:37 smithi118 ceph-mon[28757]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:39.425 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T11:37:39.798 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:37:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:39 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:37:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:39 smithi118 ceph-mon[28757]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:39.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:39 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:37:39.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:39 smithi149 ceph-mon[36123]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:40.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.470+0000 7f610643d640 1 -- 172.21.15.118:0/791353234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6100104da0 msgr2=0x7f6100107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.470+0000 7f610643d640 1 --2- 172.21.15.118:0/791353234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6100104da0 0x7f6100107190 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009880 tx=0x7f60f402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.470+0000 7f610643d640 1 -- 172.21.15.118:0/791353234 shutdown_connections 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.470+0000 7f610643d640 1 --2- 172.21.15.118:0/791353234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6100104da0 0x7f6100107190 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.470+0000 7f610643d640 1 --2- 172.21.15.118:0/791353234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6100102470 0x7f6100104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.470+0000 7f610643d640 1 -- 172.21.15.118:0/791353234 >> 172.21.15.118:0/791353234 conn(0x7f61000fbff0 msgr2=0x7f61000fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.470+0000 7f610643d640 1 -- 172.21.15.118:0/791353234 shutdown_connections 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.470+0000 7f610643d640 1 -- 172.21.15.118:0/791353234 wait complete. 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.471+0000 7f610643d640 1 Processor -- start 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.471+0000 7f610643d640 1 -- start start 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.471+0000 7f610643d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6100102470 0x7f61001974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.471+0000 7f610643d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6100104da0 0x7f6100197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.471+0000 7f610643d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f610010a760 con 0x7f6100102470 2024-09-21T11:37:40.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.471+0000 7f610643d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f610010a5e0 con 0x7f6100104da0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.471+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6100104da0 0x7f6100197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.471+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6100104da0 0x7f6100197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:46014/0 (socket says 172.21.15.118:46014) 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.471+0000 7f60ff7fe640 1 -- 172.21.15.118:0/3797131227 learned_addr learned my addr 172.21.15.118:0/3797131227 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.472+0000 7f60ff7fe640 1 -- 172.21.15.118:0/3797131227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6100102470 msgr2=0x7f61001974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.472+0000 7f60ff7fe640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6100102470 0x7f61001974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.472+0000 7f60ff7fe640 1 -- 172.21.15.118:0/3797131227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61001980a0 con 0x7f6100104da0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.472+0000 7f60ff7fe640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6100104da0 0x7f6100197a20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006010 tx=0x7f60f40045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.472+0000 7f60fd7fa640 1 -- 172.21.15.118:0/3797131227 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60f403f070 con 0x7f6100104da0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.472+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610006bc70 con 0x7f6100104da0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.472+0000 7f60fd7fa640 1 -- 172.21.15.118:0/3797131227 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60f4004a50 con 0x7f6100104da0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.472+0000 7f60fd7fa640 1 -- 172.21.15.118:0/3797131227 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60f4035030 con 0x7f6100104da0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.472+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610006c200 con 0x7f6100104da0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.474+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6100102850 con 0x7f6100104da0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.474+0000 7f60fd7fa640 1 -- 172.21.15.118:0/3797131227 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f60f4042070 con 0x7f6100104da0 2024-09-21T11:37:40.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.475+0000 7f60fd7fa640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f60e806e360 0x7f60e8070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:40.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.475+0000 7f60fd7fa640 1 -- 172.21.15.118:0/3797131227 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f60f40aecc0 con 0x7f6100104da0 2024-09-21T11:37:40.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.475+0000 7f60fffff640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f60e806e360 0x7f60e8070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:40.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.475+0000 7f60fffff640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f60e806e360 0x7f60e8070820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f60f000ba80 tx=0x7f60f0005ed0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:40.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.484+0000 7f60fd7fa640 1 -- 172.21.15.118:0/3797131227 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60f407c5a0 con 0x7f6100104da0 2024-09-21T11:37:40.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.678+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f61001057a0 con 0x7f60e806e360 2024-09-21T11:37:40.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.680+0000 7f60fd7fa640 1 -- 172.21.15.118:0/3797131227 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f61001057a0 con 0x7f60e806e360 2024-09-21T11:37:40.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f60e806e360 msgr2=0x7f60e8070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:40.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f60e806e360 0x7f60e8070820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f60f000ba80 tx=0x7f60f0005ed0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6100104da0 msgr2=0x7f6100197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:40.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6100104da0 0x7f6100197a20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006010 tx=0x7f60f40045e0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 shutdown_connections 2024-09-21T11:37:40.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f60e806e360 0x7f60e8070820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6100104da0 0x7f6100197a20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 --2- 172.21.15.118:0/3797131227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6100102470 0x7f61001974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 >> 172.21.15.118:0/3797131227 conn(0x7f61000fbff0 msgr2=0x7f61000fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:40.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 shutdown_connections 2024-09-21T11:37:40.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.682+0000 7f610643d640 1 -- 172.21.15.118:0/3797131227 wait complete. 2024-09-21T11:37:40.696 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:37:40.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.817+0000 7f1d803b1640 1 -- 172.21.15.118:0/4205088070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 msgr2=0x7f1d78101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:40.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.817+0000 7f1d803b1640 1 --2- 172.21.15.118:0/4205088070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 0x7f1d78101d70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1d740098d0 tx=0x7f1d7402a4f0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.817+0000 7f1d803b1640 1 -- 172.21.15.118:0/4205088070 shutdown_connections 2024-09-21T11:37:40.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.817+0000 7f1d803b1640 1 --2- 172.21.15.118:0/4205088070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d78102b70 0x7f1d78102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.817+0000 7f1d803b1640 1 --2- 172.21.15.118:0/4205088070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 0x7f1d78101d70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.817+0000 7f1d803b1640 1 -- 172.21.15.118:0/4205088070 >> 172.21.15.118:0/4205088070 conn(0x7f1d780fd140 msgr2=0x7f1d780ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:40.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.818+0000 7f1d803b1640 1 -- 172.21.15.118:0/4205088070 shutdown_connections 2024-09-21T11:37:40.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.818+0000 7f1d803b1640 1 -- 172.21.15.118:0/4205088070 wait complete. 2024-09-21T11:37:40.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.819+0000 7f1d803b1640 1 Processor -- start 2024-09-21T11:37:40.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.819+0000 7f1d803b1640 1 -- start start 2024-09-21T11:37:40.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.819+0000 7f1d803b1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 0x7f1d78197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:40.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.819+0000 7f1d7e14d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 0x7f1d78197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:40.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.820+0000 7f1d7e14d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 0x7f1d78197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60732/0 (socket says 172.21.15.118:60732) 2024-09-21T11:37:40.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.820+0000 7f1d7e14d640 1 -- 172.21.15.118:0/53487892 learned_addr learned my addr 172.21.15.118:0/53487892 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:37:40.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.820+0000 7f1d803b1640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d78102b70 0x7f1d781977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:40.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.820+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7810a790 con 0x7f1d78101970 2024-09-21T11:37:40.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.820+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7810a610 con 0x7f1d78102b70 2024-09-21T11:37:40.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.820+0000 7f1d7d94c640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d78102b70 0x7f1d781977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:40.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.820+0000 7f1d7e14d640 1 -- 172.21.15.118:0/53487892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d78102b70 msgr2=0x7f1d781977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:40.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.820+0000 7f1d7e14d640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d78102b70 0x7f1d781977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:40.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.820+0000 7f1d7e14d640 1 -- 172.21.15.118:0/53487892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d78197e20 con 0x7f1d78101970 2024-09-21T11:37:40.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.821+0000 7f1d7e14d640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 0x7f1d78197260 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009230 tx=0x7f1d74004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:40.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.821+0000 7f1d6f7fe640 1 -- 172.21.15.118:0/53487892 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d7403f070 con 0x7f1d78101970 2024-09-21T11:37:40.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.821+0000 7f1d6f7fe640 1 -- 172.21.15.118:0/53487892 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d74003ab0 con 0x7f1d78101970 2024-09-21T11:37:40.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.821+0000 7f1d6f7fe640 1 -- 172.21.15.118:0/53487892 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d74035030 con 0x7f1d78101970 2024-09-21T11:37:40.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.822+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7819c800 con 0x7f1d78101970 2024-09-21T11:37:40.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.823+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7819cd60 con 0x7f1d78101970 2024-09-21T11:37:40.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.824+0000 7f1d6f7fe640 1 -- 172.21.15.118:0/53487892 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f1d74042070 con 0x7f1d78101970 2024-09-21T11:37:40.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.825+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7819cfb0 con 0x7f1d78101970 2024-09-21T11:37:40.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.825+0000 7f1d6f7fe640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d6406e350 0x7f1d64070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:40.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.826+0000 7f1d6f7fe640 1 -- 172.21.15.118:0/53487892 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f1d740ae950 con 0x7f1d78101970 2024-09-21T11:37:40.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.827+0000 7f1d7d94c640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d6406e350 0x7f1d64070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:40.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.828+0000 7f1d7d94c640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d6406e350 0x7f1d64070810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1d680095f0 tx=0x7f1d68005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:40.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:40.835+0000 7f1d6f7fe640 1 -- 172.21.15.118:0/53487892 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d7407c230 con 0x7f1d78101970 2024-09-21T11:37:41.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.219+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1d78107530 con 0x7f1d6406e350 2024-09-21T11:37:41.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.221+0000 7f1d6f7fe640 1 -- 172.21.15.118:0/53487892 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f1d78107530 con 0x7f1d6406e350 2024-09-21T11:37:41.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.224+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d6406e350 msgr2=0x7f1d64070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:41.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.224+0000 7f1d803b1640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d6406e350 0x7f1d64070810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1d680095f0 tx=0x7f1d68005f90 comp rx=0 tx=0).stop 2024-09-21T11:37:41.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.224+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 msgr2=0x7f1d78197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:41.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.224+0000 7f1d803b1640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 0x7f1d78197260 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009230 tx=0x7f1d74004cb0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.225+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 shutdown_connections 2024-09-21T11:37:41.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.225+0000 7f1d803b1640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f1d6406e350 0x7f1d64070810 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.225+0000 7f1d803b1640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d78102b70 0x7f1d781977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.225+0000 7f1d803b1640 1 --2- 172.21.15.118:0/53487892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d78101970 0x7f1d78197260 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.225+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 >> 172.21.15.118:0/53487892 conn(0x7f1d780fd140 msgr2=0x7f1d78105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:41.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.225+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 shutdown_connections 2024-09-21T11:37:41.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.225+0000 7f1d803b1640 1 -- 172.21.15.118:0/53487892 wait complete. 2024-09-21T11:37:41.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.341+0000 7fb66edea640 1 -- 172.21.15.118:0/290572551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6681011c0 msgr2=0x7fb668101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:41.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.341+0000 7fb66edea640 1 --2- 172.21.15.118:0/290572551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6681011c0 0x7fb668101640 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb654009880 tx=0x7fb65402a4d0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.341+0000 7fb66edea640 1 -- 172.21.15.118:0/290572551 shutdown_connections 2024-09-21T11:37:41.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.341+0000 7fb66edea640 1 --2- 172.21.15.118:0/290572551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6681011c0 0x7fb668101640 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.341+0000 7fb66edea640 1 --2- 172.21.15.118:0/290572551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6680fffc0 0x7fb6681003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.341+0000 7fb66edea640 1 -- 172.21.15.118:0/290572551 >> 172.21.15.118:0/290572551 conn(0x7fb6680fb750 msgr2=0x7fb6680fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:41.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.342+0000 7fb66edea640 1 -- 172.21.15.118:0/290572551 shutdown_connections 2024-09-21T11:37:41.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.342+0000 7fb66edea640 1 -- 172.21.15.118:0/290572551 wait complete. 2024-09-21T11:37:41.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.343+0000 7fb66edea640 1 Processor -- start 2024-09-21T11:37:41.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.343+0000 7fb66edea640 1 -- start start 2024-09-21T11:37:41.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.343+0000 7fb66edea640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6680fffc0 0x7fb668197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:41.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.344+0000 7fb66edea640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6681011c0 0x7fb668197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:41.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.344+0000 7fb66cb86640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6680fffc0 0x7fb668197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:41.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.344+0000 7fb66cb86640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6680fffc0 0x7fb668197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60742/0 (socket says 172.21.15.118:60742) 2024-09-21T11:37:41.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.344+0000 7fb66cb86640 1 -- 172.21.15.118:0/3155021808 learned_addr learned my addr 172.21.15.118:0/3155021808 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:37:41.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.344+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb66810a760 con 0x7fb6680fffc0 2024-09-21T11:37:41.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.344+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb66810a5e0 con 0x7fb6681011c0 2024-09-21T11:37:41.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.344+0000 7fb667fff640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6681011c0 0x7fb668197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:41.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.345+0000 7fb667fff640 1 -- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6680fffc0 msgr2=0x7fb668197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:41.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.345+0000 7fb667fff640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6680fffc0 0x7fb668197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.345+0000 7fb667fff640 1 -- 172.21.15.118:0/3155021808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb668198010 con 0x7fb6681011c0 2024-09-21T11:37:41.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.345+0000 7fb66cb86640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6680fffc0 0x7fb668197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T11:37:41.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.345+0000 7fb667fff640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6681011c0 0x7fb668197990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb654033040 tx=0x7fb654005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:41.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.345+0000 7fb665ffb640 1 -- 172.21.15.118:0/3155021808 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb654040030 con 0x7fb6681011c0 2024-09-21T11:37:41.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.345+0000 7fb665ffb640 1 -- 172.21.15.118:0/3155021808 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb65403c900 con 0x7fb6681011c0 2024-09-21T11:37:41.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.345+0000 7fb665ffb640 1 -- 172.21.15.118:0/3155021808 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb654031a10 con 0x7fb6681011c0 2024-09-21T11:37:41.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.346+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66819c9f0 con 0x7fb6681011c0 2024-09-21T11:37:41.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.346+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66819cf80 con 0x7fb6681011c0 2024-09-21T11:37:41.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.347+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6681003c0 con 0x7fb6681011c0 2024-09-21T11:37:41.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.348+0000 7fb665ffb640 1 -- 172.21.15.118:0/3155021808 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fb654043030 con 0x7fb6681011c0 2024-09-21T11:37:41.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.349+0000 7fb665ffb640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb65806e350 0x7fb658070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:41.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.349+0000 7fb665ffb640 1 -- 172.21.15.118:0/3155021808 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fb654041070 con 0x7fb6681011c0 2024-09-21T11:37:41.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.349+0000 7fb66cb86640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb65806e350 0x7fb658070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:41.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.350+0000 7fb66cb86640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb65806e350 0x7fb658070810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb65c011620 tx=0x7fb65c005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:41.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.358+0000 7fb665ffb640 1 -- 172.21.15.118:0/3155021808 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb6540b0e20 con 0x7fb6681011c0 2024-09-21T11:37:41.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.544+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb6680626f0 con 0x7fb65806e350 2024-09-21T11:37:41.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.554+0000 7fb665ffb640 1 -- 172.21.15.118:0/3155021808 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7fb6680626f0 con 0x7fb65806e350 2024-09-21T11:37:41.555 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (5m) 52s ago 6m 23.6M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (6m) 52s ago 6m 8342k - 19.1.1-373-g4e45e6b4 164465d2334a f027b8fa4d1f 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (5m) 55s ago 5m 5268k - 19.1.1-373-g4e45e6b4 164465d2334a b67cebd3ec35 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (6m) 52s ago 6m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (5m) 55s ago 5m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (4m) 52s ago 6m 78.5M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (75s) 52s ago 73s 17.1M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (68s) 52s ago 68s 17.1M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (66s) 55s ago 65s 17.4M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (71s) 55s ago 71s 11.3M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:9283,8765,8443 running (8m) 52s ago 8m 499M - 19.1.1-373-g4e45e6b4 164465d2334a 74626178eaa8 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (5m) 55s ago 5m 443M - 19.1.1-373-g4e45e6b4 164465d2334a 13c5d2f4c157 2024-09-21T11:37:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (8m) 52s ago 8m 46.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (5m) 55s ago 5m 35.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (6m) 52s ago 6m 15.9M - 1.5.0 0da6a335fe13 92cdb77bc8bc 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (5m) 55s ago 5m 15.5M - 1.5.0 0da6a335fe13 1a6e8f960a5b 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (4m) 52s ago 4m 49.5M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (4m) 52s ago 4m 50.7M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (3m) 52s ago 3m 54.8M 3946M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (3m) 55s ago 3m 53.2M 1213M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (2m) 55s ago 2m 42.4M 1213M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (2m) 55s ago 2m 48.5M 1213M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:37:41.557 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (4m) 52s ago 6m 55.3M - 2.43.0 a07b618ecd1d 44053d283e3b 2024-09-21T11:37:41.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb65806e350 msgr2=0x7fb658070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb65806e350 0x7fb658070810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb65c011620 tx=0x7fb65c005f90 comp rx=0 tx=0).stop 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6681011c0 msgr2=0x7fb668197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6681011c0 0x7fb668197990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb654033040 tx=0x7fb654005700 comp rx=0 tx=0).stop 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 shutdown_connections 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fb65806e350 0x7fb658070810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6681011c0 0x7fb668197990 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb654033040 tx=0x7fb654005700 comp rx=0 tx=0).stop 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 --2- 172.21.15.118:0/3155021808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6680fffc0 0x7fb668197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 >> 172.21.15.118:0/3155021808 conn(0x7fb6680fb750 msgr2=0x7fb668104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 shutdown_connections 2024-09-21T11:37:41.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.557+0000 7fb66edea640 1 -- 172.21.15.118:0/3155021808 wait complete. 2024-09-21T11:37:41.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.644+0000 7fcd5c12d640 1 -- 172.21.15.118:0/1437775604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100b60 msgr2=0x7fcd54100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:41.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.644+0000 7fcd5c12d640 1 --2- 172.21.15.118:0/1437775604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100b60 0x7fcd54100fc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009880 tx=0x7fcd4402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.646 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:41 smithi118 ceph-mon[28757]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:41.646 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:41 smithi118 ceph-mon[28757]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:41.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.644+0000 7fcd5c12d640 1 -- 172.21.15.118:0/1437775604 shutdown_connections 2024-09-21T11:37:41.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.645+0000 7fcd5c12d640 1 --2- 172.21.15.118:0/1437775604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100b60 0x7fcd54100fc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.645+0000 7fcd5c12d640 1 --2- 172.21.15.118:0/1437775604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd54100220 0x7fcd54100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.645+0000 7fcd5c12d640 1 -- 172.21.15.118:0/1437775604 >> 172.21.15.118:0/1437775604 conn(0x7fcd540fbff0 msgr2=0x7fcd540fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:41.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.645+0000 7fcd5c12d640 1 -- 172.21.15.118:0/1437775604 shutdown_connections 2024-09-21T11:37:41.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.645+0000 7fcd5c12d640 1 -- 172.21.15.118:0/1437775604 wait complete. 2024-09-21T11:37:41.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.646+0000 7fcd5c12d640 1 Processor -- start 2024-09-21T11:37:41.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.646+0000 7fcd5c12d640 1 -- start start 2024-09-21T11:37:41.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.646+0000 7fcd5c12d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100220 0x7fcd541996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:41.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.646+0000 7fcd5c12d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd54100b60 0x7fcd54199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:41.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.646+0000 7fcd5c12d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5410c950 con 0x7fcd54100220 2024-09-21T11:37:41.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.646+0000 7fcd5c12d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5410c7d0 con 0x7fcd54100b60 2024-09-21T11:37:41.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.647+0000 7fcd59ec9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100220 0x7fcd541996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:41.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.647+0000 7fcd59ec9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100220 0x7fcd541996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60758/0 (socket says 172.21.15.118:60758) 2024-09-21T11:37:41.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.647+0000 7fcd59ec9640 1 -- 172.21.15.118:0/2513626757 learned_addr learned my addr 172.21.15.118:0/2513626757 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:37:41.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.647+0000 7fcd596c8640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd54100b60 0x7fcd54199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:41.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.647+0000 7fcd59ec9640 1 -- 172.21.15.118:0/2513626757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd54100b60 msgr2=0x7fcd54199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:41.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.647+0000 7fcd59ec9640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd54100b60 0x7fcd54199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:41.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.647+0000 7fcd59ec9640 1 -- 172.21.15.118:0/2513626757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5419a2a0 con 0x7fcd54100220 2024-09-21T11:37:41.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.647+0000 7fcd59ec9640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100220 0x7fcd541996e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000e970 tx=0x7fcd5000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:41.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.648+0000 7fcd4affd640 1 -- 172.21.15.118:0/2513626757 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd5000cac0 con 0x7fcd54100220 2024-09-21T11:37:41.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.648+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5419ece0 con 0x7fcd54100220 2024-09-21T11:37:41.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.648+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5419f1c0 con 0x7fcd54100220 2024-09-21T11:37:41.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.648+0000 7fcd4affd640 1 -- 172.21.15.118:0/2513626757 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd5000cc60 con 0x7fcd54100220 2024-09-21T11:37:41.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.648+0000 7fcd4affd640 1 -- 172.21.15.118:0/2513626757 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd50018770 con 0x7fcd54100220 2024-09-21T11:37:41.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.649+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd38005290 con 0x7fcd54100220 2024-09-21T11:37:41.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.650+0000 7fcd4affd640 1 -- 172.21.15.118:0/2513626757 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fcd50010430 con 0x7fcd54100220 2024-09-21T11:37:41.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.650+0000 7fcd4affd640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcd4006e2b0 0x7fcd40070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:41.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.650+0000 7fcd4affd640 1 -- 172.21.15.118:0/2513626757 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fcd5008e980 con 0x7fcd54100220 2024-09-21T11:37:41.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.651+0000 7fcd596c8640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcd4006e2b0 0x7fcd40070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:41.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.651+0000 7fcd596c8640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcd4006e2b0 0x7fcd40070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcd44006010 tx=0x7fcd44000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:41.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:41.659+0000 7fcd4affd640 1 -- 172.21.15.118:0/2513626757 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd50054210 con 0x7fcd54100220 2024-09-21T11:37:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:41 smithi149 ceph-mon[36123]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:41 smithi149 ceph-mon[36123]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:42.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.137+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcd38005d90 con 0x7fcd54100220 2024-09-21T11:37:42.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.138+0000 7fcd4affd640 1 -- 172.21.15.118:0/2513626757 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fcd50016330 con 0x7fcd54100220 2024-09-21T11:37:42.139 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:37:42.139 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:37:42.139 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:37:42.139 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:37:42.139 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:37:42.139 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:37:42.139 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 14 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:37:42.140 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:37:42.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcd4006e2b0 msgr2=0x7fcd40070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:42.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcd4006e2b0 0x7fcd40070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcd44006010 tx=0x7fcd44000bc0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100220 msgr2=0x7fcd541996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:42.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100220 0x7fcd541996e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000e970 tx=0x7fcd5000ee30 comp rx=0 tx=0).stop 2024-09-21T11:37:42.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 shutdown_connections 2024-09-21T11:37:42.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7fcd4006e2b0 0x7fcd40070770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd54100b60 0x7fcd54199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 --2- 172.21.15.118:0/2513626757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd54100220 0x7fcd541996e0 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000e970 tx=0x7fcd5000ee30 comp rx=0 tx=0).stop 2024-09-21T11:37:42.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 >> 172.21.15.118:0/2513626757 conn(0x7fcd540fbff0 msgr2=0x7fcd54108ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:42.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 shutdown_connections 2024-09-21T11:37:42.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.141+0000 7fcd5c12d640 1 -- 172.21.15.118:0/2513626757 wait complete. 2024-09-21T11:37:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 -- 172.21.15.118:0/2510046664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3418101a40 msgr2=0x7f3418101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 --2- 172.21.15.118:0/2510046664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3418101a40 0x7f3418101ec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f340c009880 tx=0x7f340c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 -- 172.21.15.118:0/2510046664 shutdown_connections 2024-09-21T11:37:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 --2- 172.21.15.118:0/2510046664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3418101a40 0x7f3418101ec0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 --2- 172.21.15.118:0/2510046664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3418100840 0x7f3418100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 -- 172.21.15.118:0/2510046664 >> 172.21.15.118:0/2510046664 conn(0x7f34180fbff0 msgr2=0x7f34180fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 -- 172.21.15.118:0/2510046664 shutdown_connections 2024-09-21T11:37:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 -- 172.21.15.118:0/2510046664 wait complete. 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 Processor -- start 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.267+0000 7f341e96a640 1 -- start start 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.268+0000 7f341e96a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3418100840 0x7f34181974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.268+0000 7f341e96a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3418197a10 0x7f341819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.268+0000 7f341e96a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3418109680 con 0x7f3418197a10 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.268+0000 7f3417fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3418100840 0x7f34181974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.268+0000 7f34177fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3418197a10 0x7f341819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.268+0000 7f3417fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3418100840 0x7f34181974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:46120/0 (socket says 172.21.15.118:46120) 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.268+0000 7f3417fff640 1 -- 172.21.15.118:0/4219010305 learned_addr learned my addr 172.21.15.118:0/4219010305 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:37:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.268+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3418109500 con 0x7f3418100840 2024-09-21T11:37:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.269+0000 7f34177fe640 1 -- 172.21.15.118:0/4219010305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3418100840 msgr2=0x7f34181974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.269+0000 7f34177fe640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3418100840 0x7f34181974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.269+0000 7f34177fe640 1 -- 172.21.15.118:0/4219010305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3418197f40 con 0x7f3418197a10 2024-09-21T11:37:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.269+0000 7f34177fe640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3418197a10 0x7f341819ca10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f340c008000 tx=0x7f340c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.270+0000 7f34157fa640 1 -- 172.21.15.118:0/4219010305 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f340c03f030 con 0x7f3418197a10 2024-09-21T11:37:42.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.270+0000 7f34157fa640 1 -- 172.21.15.118:0/4219010305 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f340c004b80 con 0x7f3418197a10 2024-09-21T11:37:42.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.270+0000 7f34157fa640 1 -- 172.21.15.118:0/4219010305 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f340c035070 con 0x7f3418197a10 2024-09-21T11:37:42.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.270+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341819cf50 con 0x7f3418197a10 2024-09-21T11:37:42.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.270+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341819d2f0 con 0x7f3418197a10 2024-09-21T11:37:42.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.271+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341819d520 con 0x7f3418197a10 2024-09-21T11:37:42.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.272+0000 7f34157fa640 1 -- 172.21.15.118:0/4219010305 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f340c042030 con 0x7f3418197a10 2024-09-21T11:37:42.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.273+0000 7f34157fa640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f340006e420 0x7f34000708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:37:42.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.273+0000 7f34157fa640 1 -- 172.21.15.118:0/4219010305 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f340c040070 con 0x7f3418197a10 2024-09-21T11:37:42.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.273+0000 7f3417fff640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f340006e420 0x7f34000708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:37:42.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.274+0000 7f3417fff640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f340006e420 0x7f34000708e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f34080058c0 tx=0x7f3408005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:37:42.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.278+0000 7f34157fa640 1 -- 172.21.15.118:0/4219010305 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f340c07fe80 con 0x7f3418197a10 2024-09-21T11:37:42.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.657+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f34180fe210 con 0x7f340006e420 2024-09-21T11:37:42.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.659+0000 7f34157fa640 1 -- 172.21.15.118:0/4219010305 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f34180fe210 con 0x7f340006e420 2024-09-21T11:37:42.660 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:37:42.660 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:37:42.660 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:37:42.660 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:37:42.660 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [], 2024-09-21T11:37:42.660 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T11:37:42.660 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 image on host smithi149", 2024-09-21T11:37:42.660 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:37:42.662 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:37:42.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.661+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f340006e420 msgr2=0x7f34000708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:42.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.661+0000 7f341e96a640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f340006e420 0x7f34000708e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f34080058c0 tx=0x7f3408005f90 comp rx=0 tx=0).stop 2024-09-21T11:37:42.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.661+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3418197a10 msgr2=0x7f341819ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:37:42.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.661+0000 7f341e96a640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3418197a10 0x7f341819ca10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f340c008000 tx=0x7f340c005d50 comp rx=0 tx=0).stop 2024-09-21T11:37:42.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.662+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 shutdown_connections 2024-09-21T11:37:42.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.662+0000 7f341e96a640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f340006e420 0x7f34000708e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.662+0000 7f341e96a640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3418197a10 0x7f341819ca10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.662+0000 7f341e96a640 1 --2- 172.21.15.118:0/4219010305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3418100840 0x7f34181974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:37:42.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.662+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 >> 172.21.15.118:0/4219010305 conn(0x7f34180fbff0 msgr2=0x7f34180fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:37:42.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.662+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 shutdown_connections 2024-09-21T11:37:42.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:37:42.662+0000 7f341e96a640 1 -- 172.21.15.118:0/4219010305 wait complete. 2024-09-21T11:37:43.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:42 smithi118 ceph-mon[28757]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:43.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:42 smithi118 ceph-mon[28757]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:43.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:42 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:37:43.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:42 smithi118 ceph-mon[28757]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (squid) 2024-09-21T11:37:43.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:42 smithi118 ceph-mon[28757]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T11:37:43.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:42 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:37:43.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:42 smithi118 ceph-mon[28757]: Upgrade: Need to upgrade myself (mgr.smithi118.djbwyn) 2024-09-21T11:37:43.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:42 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2513626757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:37:43.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:42 smithi149 ceph-mon[36123]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:42 smithi149 ceph-mon[36123]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:42 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:37:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:42 smithi149 ceph-mon[36123]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (squid) 2024-09-21T11:37:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:42 smithi149 ceph-mon[36123]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T11:37:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:42 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:37:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:42 smithi149 ceph-mon[36123]: Upgrade: Need to upgrade myself (mgr.smithi118.djbwyn) 2024-09-21T11:37:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:42 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2513626757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:37:43.776 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:43 smithi149 ceph-mon[36123]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 on smithi149 2024-09-21T11:37:43.777 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:43 smithi149 ceph-mon[36123]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:43.777 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:43 smithi149 ceph-mon[36123]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:43 smithi118 ceph-mon[28757]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 on smithi149 2024-09-21T11:37:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:43 smithi118 ceph-mon[28757]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:43 smithi118 ceph-mon[28757]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:37:46.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:45 smithi118 ceph-mon[28757]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:45 smithi149 ceph-mon[36123]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:47 smithi118 ceph-mon[28757]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:47 smithi149 ceph-mon[36123]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:49 smithi118 ceph-mon[28757]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:49 smithi149 ceph-mon[36123]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:51 smithi118 ceph-mon[28757]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:52.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:51 smithi149 ceph-mon[36123]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:53 smithi118 ceph-mon[28757]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:53 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:37:54.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:53 smithi149 ceph-mon[36123]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:54.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:53 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:37:56.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:55 smithi118 ceph-mon[28757]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:56.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:55 smithi149 ceph-mon[36123]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:57 smithi118 ceph-mon[28757]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:37:58.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:57 smithi149 ceph-mon[36123]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:00.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:37:59 smithi118 ceph-mon[28757]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:00.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:37:59 smithi149 ceph-mon[36123]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:00.942 INFO:tasks.workunit.client.0.smithi118.stderr:Note: switching to '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'. 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr: git switch -c 2024-09-21T11:38:00.943 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-09-21T11:38:00.944 INFO:tasks.workunit.client.0.smithi118.stderr:Or undo this operation with: 2024-09-21T11:38:00.944 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-09-21T11:38:00.944 INFO:tasks.workunit.client.0.smithi118.stderr: git switch - 2024-09-21T11:38:00.944 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-09-21T11:38:00.944 INFO:tasks.workunit.client.0.smithi118.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T11:38:00.944 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-09-21T11:38:00.944 INFO:tasks.workunit.client.0.smithi118.stderr:HEAD is now at 5c1cdc3c470 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-21T11:38:00.947 DEBUG:teuthology.orchestra.run.smithi118:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T11:38:01.048 INFO:tasks.workunit.client.0.smithi118.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T11:38:01.050 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T11:38:01.051 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T11:38:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:01 smithi118 ceph-mon[28757]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:01 smithi149 ceph-mon[36123]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:03 smithi118 ceph-mon[28757]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:04.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:03 smithi149 ceph-mon[36123]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:04.294 INFO:tasks.workunit.client.1.smithi149.stderr:Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr:Note: switching to '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'. 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr: git switch -c 2024-09-21T11:38:04.951 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T11:38:04.952 INFO:tasks.workunit.client.1.smithi149.stderr:Or undo this operation with: 2024-09-21T11:38:04.952 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T11:38:04.952 INFO:tasks.workunit.client.1.smithi149.stderr: git switch - 2024-09-21T11:38:04.952 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T11:38:04.952 INFO:tasks.workunit.client.1.smithi149.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T11:38:04.952 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T11:38:04.952 INFO:tasks.workunit.client.1.smithi149.stderr:HEAD is now at 5c1cdc3c470 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-21T11:38:04.956 DEBUG:teuthology.orchestra.run.smithi149:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-21T11:38:05.227 INFO:tasks.workunit.client.1.smithi149.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T11:38:05.229 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T11:38:05.230 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T11:38:05.902 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T11:38:05.991 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T11:38:06.037 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T11:38:06.038 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T11:38:06.039 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T11:38:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:05 smithi118 ceph-mon[28757]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:06.082 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T11:38:06.086 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T11:38:06.086 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-21T11:38:06.103 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-21T11:38:06.104 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T11:38:06.105 DEBUG:teuthology.orchestra.run.smithi149:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-21T11:38:06.175 INFO:tasks.workunit.client.1.smithi149.stderr:+ mkdir -p fsstress 2024-09-21T11:38:06.178 INFO:tasks.workunit.client.1.smithi149.stderr:+ pushd fsstress 2024-09-21T11:38:06.179 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T11:38:06.179 INFO:tasks.workunit.client.1.smithi149.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T11:38:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:05 smithi149 ceph-mon[36123]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:06.764 INFO:tasks.workunit.client.1.smithi149.stderr:+ tar xzf ltp-full.tgz 2024-09-21T11:38:07.309 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T11:38:07.413 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T11:38:07.455 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T11:38:07.456 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T11:38:07.456 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T11:38:07.499 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T11:38:07.503 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T11:38:07.503 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T11:38:07.519 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-21T11:38:07.520 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T11:38:07.520 DEBUG:teuthology.orchestra.run.smithi118:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-21T11:38:07.586 INFO:tasks.workunit.client.0.smithi118.stderr:+ mkdir -p fsstress 2024-09-21T11:38:07.587 INFO:tasks.workunit.client.0.smithi118.stderr:+ pushd fsstress 2024-09-21T11:38:07.588 INFO:tasks.workunit.client.0.smithi118.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T11:38:07.588 INFO:tasks.workunit.client.0.smithi118.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T11:38:08.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:07 smithi118 ceph-mon[28757]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:08.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:07 smithi149 ceph-mon[36123]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:08.212 INFO:tasks.workunit.client.0.smithi118.stderr:+ tar xzf ltp-full.tgz 2024-09-21T11:38:09.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:08 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:38:09.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:08 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:38:10.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:09 smithi118 ceph-mon[28757]: pgmap v228: 65 pgs: 65 active+clean; 1019 KiB data, 192 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 36 KiB/s wr, 2 op/s 2024-09-21T11:38:10.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:09 smithi149 ceph-mon[36123]: pgmap v228: 65 pgs: 65 active+clean; 1019 KiB data, 192 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 36 KiB/s wr, 2 op/s 2024-09-21T11:38:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:11 smithi118 ceph-mon[28757]: pgmap v229: 65 pgs: 65 active+clean; 13 MiB data, 225 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.0 MiB/s wr, 19 op/s 2024-09-21T11:38:12.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:11 smithi149 ceph-mon[36123]: pgmap v229: 65 pgs: 65 active+clean; 13 MiB data, 225 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.0 MiB/s wr, 19 op/s 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.765+0000 7f657d8c7640 1 -- 172.21.15.118:0/3403679287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6578104d60 msgr2=0x7f65781051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.766+0000 7f657d8c7640 1 --2- 172.21.15.118:0/3403679287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6578104d60 0x7f65781051e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f656c009880 tx=0x7f656c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.766+0000 7f657d8c7640 1 -- 172.21.15.118:0/3403679287 shutdown_connections 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.766+0000 7f657d8c7640 1 --2- 172.21.15.118:0/3403679287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6578104d60 0x7f65781051e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.766+0000 7f657d8c7640 1 --2- 172.21.15.118:0/3403679287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6578103b60 0x7f6578103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.766+0000 7f657d8c7640 1 -- 172.21.15.118:0/3403679287 >> 172.21.15.118:0/3403679287 conn(0x7f65780ff2f0 msgr2=0x7f6578101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.766+0000 7f657d8c7640 1 -- 172.21.15.118:0/3403679287 shutdown_connections 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.766+0000 7f657d8c7640 1 -- 172.21.15.118:0/3403679287 wait complete. 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.766+0000 7f657d8c7640 1 Processor -- start 2024-09-21T11:38:12.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f657d8c7640 1 -- start start 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f657d8c7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6578103b60 0x7f6578199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f657d8c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6578104d60 0x7f6578199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f657d8c7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f657810c980 con 0x7f6578104d60 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f657d8c7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f657810c800 con 0x7f6578103b60 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f6576ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6578103b60 0x7f6578199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f6576ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6578103b60 0x7f6578199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:57918/0 (socket says 172.21.15.118:57918) 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f6576ffd640 1 -- 172.21.15.118:0/2698570900 learned_addr learned my addr 172.21.15.118:0/2698570900 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f65767fc640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6578104d60 0x7f6578199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f6576ffd640 1 -- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6578104d60 msgr2=0x7f6578199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f6576ffd640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6578104d60 0x7f6578199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:12.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.767+0000 7f6576ffd640 1 -- 172.21.15.118:0/2698570900 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657819a220 con 0x7f6578103b60 2024-09-21T11:38:12.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.768+0000 7f6576ffd640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6578103b60 0x7f6578199660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f656800e940 tx=0x7f656800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:12.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.768+0000 7f657c8c5640 1 -- 172.21.15.118:0/2698570900 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f656800cb80 con 0x7f6578103b60 2024-09-21T11:38:12.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.768+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657819ec60 con 0x7f6578103b60 2024-09-21T11:38:12.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.768+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657819f1c0 con 0x7f6578103b60 2024-09-21T11:38:12.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.768+0000 7f657c8c5640 1 -- 172.21.15.118:0/2698570900 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f656800cd20 con 0x7f6578103b60 2024-09-21T11:38:12.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.769+0000 7f657c8c5640 1 -- 172.21.15.118:0/2698570900 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6568018810 con 0x7f6578103b60 2024-09-21T11:38:12.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.770+0000 7f657c8c5640 1 -- 172.21.15.118:0/2698570900 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f6568018ab0 con 0x7f6578103b60 2024-09-21T11:38:12.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.770+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65640052c0 con 0x7f6578103b60 2024-09-21T11:38:12.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.770+0000 7f657c8c5640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f656006e300 0x7f65600707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:12.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.770+0000 7f657c8c5640 1 -- 172.21.15.118:0/2698570900 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f656808f720 con 0x7f6578103b60 2024-09-21T11:38:12.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.770+0000 7f65767fc640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f656006e300 0x7f65600707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:12.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.771+0000 7f65767fc640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f656006e300 0x7f65600707c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f656c000c00 tx=0x7f656c005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:12.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:12.775+0000 7f657c8c5640 1 -- 172.21.15.118:0/2698570900 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6568054210 con 0x7f6578103b60 2024-09-21T11:38:13.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.058+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6564000bf0 con 0x7f656006e300 2024-09-21T11:38:13.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.059+0000 7f657c8c5640 1 -- 172.21.15.118:0/2698570900 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f6564000bf0 con 0x7f656006e300 2024-09-21T11:38:13.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f656006e300 msgr2=0x7f65600707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f656006e300 0x7f65600707c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f656c000c00 tx=0x7f656c005a20 comp rx=0 tx=0).stop 2024-09-21T11:38:13.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6578103b60 msgr2=0x7f6578199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6578103b60 0x7f6578199660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f656800e940 tx=0x7f656800ee00 comp rx=0 tx=0).stop 2024-09-21T11:38:13.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 shutdown_connections 2024-09-21T11:38:13.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f656006e300 0x7f65600707c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6578104d60 0x7f6578199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 --2- 172.21.15.118:0/2698570900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6578103b60 0x7f6578199660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 >> 172.21.15.118:0/2698570900 conn(0x7f65780ff2f0 msgr2=0x7f6578108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:13.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 shutdown_connections 2024-09-21T11:38:13.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.062+0000 7f657d8c7640 1 -- 172.21.15.118:0/2698570900 wait complete. 2024-09-21T11:38:13.074 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:38:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 -- 172.21.15.118:0/3250208746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 msgr2=0x7f83dc104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 --2- 172.21.15.118:0/3250208746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 0x7f83dc104800 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009810 tx=0x7f83d002a410 comp rx=0 tx=0).stop 2024-09-21T11:38:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 -- 172.21.15.118:0/3250208746 shutdown_connections 2024-09-21T11:38:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 --2- 172.21.15.118:0/3250208746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83dc104d40 0x7f83dc107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 --2- 172.21.15.118:0/3250208746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 0x7f83dc104800 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 -- 172.21.15.118:0/3250208746 >> 172.21.15.118:0/3250208746 conn(0x7f83dc0fc010 msgr2=0x7f83dc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 -- 172.21.15.118:0/3250208746 shutdown_connections 2024-09-21T11:38:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 -- 172.21.15.118:0/3250208746 wait complete. 2024-09-21T11:38:13.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 Processor -- start 2024-09-21T11:38:13.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.163+0000 7f83e2a67640 1 -- start start 2024-09-21T11:38:13.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e2a67640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 0x7f83dc1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:13.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e2a67640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83dc104d40 0x7f83dc199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:13.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e2a67640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc10c9d0 con 0x7f83dc102410 2024-09-21T11:38:13.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e2a67640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc10c850 con 0x7f83dc104d40 2024-09-21T11:38:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e0803640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 0x7f83dc1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e0803640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 0x7f83dc1996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49534/0 (socket says 172.21.15.118:49534) 2024-09-21T11:38:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e0803640 1 -- 172.21.15.118:0/453622144 learned_addr learned my addr 172.21.15.118:0/453622144 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83dbfff640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83dc104d40 0x7f83dc199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e0803640 1 -- 172.21.15.118:0/453622144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83dc104d40 msgr2=0x7f83dc199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e0803640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83dc104d40 0x7f83dc199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e0803640 1 -- 172.21.15.118:0/453622144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc19a2b0 con 0x7f83dc102410 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.164+0000 7f83e0803640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 0x7f83dc1996f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f83d0000c00 tx=0x7f83d00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.165+0000 7f83d9ffb640 1 -- 172.21.15.118:0/453622144 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83d0040070 con 0x7f83dc102410 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.165+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc19ec90 con 0x7f83dc102410 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.165+0000 7f83d9ffb640 1 -- 172.21.15.118:0/453622144 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83d0030c00 con 0x7f83dc102410 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.165+0000 7f83d9ffb640 1 -- 172.21.15.118:0/453622144 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83d0003c40 con 0x7f83dc102410 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.165+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc19f170 con 0x7f83dc102410 2024-09-21T11:38:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.166+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc1027f0 con 0x7f83dc102410 2024-09-21T11:38:13.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.167+0000 7f83d9ffb640 1 -- 172.21.15.118:0/453622144 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f83d0039040 con 0x7f83dc102410 2024-09-21T11:38:13.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.168+0000 7f83d9ffb640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f83cc06e2b0 0x7f83cc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:13.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.168+0000 7f83d9ffb640 1 -- 172.21.15.118:0/453622144 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f83d00af470 con 0x7f83dc102410 2024-09-21T11:38:13.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.168+0000 7f83dbfff640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f83cc06e2b0 0x7f83cc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:13.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.168+0000 7f83dbfff640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f83cc06e2b0 0x7f83cc070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f83dc19aba0 tx=0x7f83c8009260 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:13.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.174+0000 7f83d9ffb640 1 -- 172.21.15.118:0/453622144 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83d007cd70 con 0x7f83dc102410 2024-09-21T11:38:13.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.455+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f83dc1056c0 con 0x7f83cc06e2b0 2024-09-21T11:38:13.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.456+0000 7f83d9ffb640 1 -- 172.21.15.118:0/453622144 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f83dc1056c0 con 0x7f83cc06e2b0 2024-09-21T11:38:13.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.458+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f83cc06e2b0 msgr2=0x7f83cc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.458+0000 7f83e2a67640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f83cc06e2b0 0x7f83cc070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f83dc19aba0 tx=0x7f83c8009260 comp rx=0 tx=0).stop 2024-09-21T11:38:13.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.459+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 msgr2=0x7f83dc1996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.459+0000 7f83e2a67640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 0x7f83dc1996f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f83d0000c00 tx=0x7f83d00043b0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.459+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 shutdown_connections 2024-09-21T11:38:13.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.459+0000 7f83e2a67640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f83cc06e2b0 0x7f83cc070770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.459+0000 7f83e2a67640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83dc104d40 0x7f83dc199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.459+0000 7f83e2a67640 1 --2- 172.21.15.118:0/453622144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83dc102410 0x7f83dc1996f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.459+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 >> 172.21.15.118:0/453622144 conn(0x7f83dc0fc010 msgr2=0x7f83dc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:13.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.459+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 shutdown_connections 2024-09-21T11:38:13.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.459+0000 7f83e2a67640 1 -- 172.21.15.118:0/453622144 wait complete. 2024-09-21T11:38:13.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.568+0000 7f6a32721640 1 -- 172.21.15.118:0/3479281279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c100840 msgr2=0x7f6a2c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.568+0000 7f6a32721640 1 --2- 172.21.15.118:0/3479281279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c100840 0x7f6a2c100c40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009880 tx=0x7f6a1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.568+0000 7f6a32721640 1 -- 172.21.15.118:0/3479281279 shutdown_connections 2024-09-21T11:38:13.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.568+0000 7f6a32721640 1 --2- 172.21.15.118:0/3479281279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a2c101a40 0x7f6a2c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.568+0000 7f6a32721640 1 --2- 172.21.15.118:0/3479281279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c100840 0x7f6a2c100c40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.568+0000 7f6a32721640 1 -- 172.21.15.118:0/3479281279 >> 172.21.15.118:0/3479281279 conn(0x7f6a2c0fbff0 msgr2=0x7f6a2c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:13.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.568+0000 7f6a32721640 1 -- 172.21.15.118:0/3479281279 shutdown_connections 2024-09-21T11:38:13.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.568+0000 7f6a32721640 1 -- 172.21.15.118:0/3479281279 wait complete. 2024-09-21T11:38:13.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a32721640 1 Processor -- start 2024-09-21T11:38:13.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a32721640 1 -- start start 2024-09-21T11:38:13.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a32721640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a2c100840 0x7f6a2c1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:13.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a32721640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c101a40 0x7f6a2c199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a32721640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c108570 con 0x7f6a2c101a40 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a32721640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c1083f0 con 0x7f6a2c100840 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a2b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c101a40 0x7f6a2c199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a2b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c101a40 0x7f6a2c199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49558/0 (socket says 172.21.15.118:49558) 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a2b7fe640 1 -- 172.21.15.118:0/813278251 learned_addr learned my addr 172.21.15.118:0/813278251 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.569+0000 7f6a2bfff640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a2c100840 0x7f6a2c1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a2b7fe640 1 -- 172.21.15.118:0/813278251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a2c100840 msgr2=0x7f6a2c1996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a2b7fe640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a2c100840 0x7f6a2c1996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a2b7fe640 1 -- 172.21.15.118:0/813278251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c19a270 con 0x7f6a2c101a40 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a2bfff640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a2c100840 0x7f6a2c1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a2b7fe640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c101a40 0x7f6a2c199bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e970 tx=0x7f6a2000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a297fa640 1 -- 172.21.15.118:0/813278251 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a2000cac0 con 0x7f6a2c101a40 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a297fa640 1 -- 172.21.15.118:0/813278251 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a200054e0 con 0x7f6a2c101a40 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2c19ecb0 con 0x7f6a2c101a40 2024-09-21T11:38:13.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a297fa640 1 -- 172.21.15.118:0/813278251 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a20010430 con 0x7f6a2c101a40 2024-09-21T11:38:13.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.570+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2c19f1e0 con 0x7f6a2c101a40 2024-09-21T11:38:13.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.571+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2c100c40 con 0x7f6a2c101a40 2024-09-21T11:38:13.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.572+0000 7f6a297fa640 1 -- 172.21.15.118:0/813278251 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f6a20004e80 con 0x7f6a2c101a40 2024-09-21T11:38:13.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.572+0000 7f6a297fa640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6a1406e2b0 0x7f6a14070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:13.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.572+0000 7f6a297fa640 1 -- 172.21.15.118:0/813278251 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f6a2000cc60 con 0x7f6a2c101a40 2024-09-21T11:38:13.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.572+0000 7f6a2bfff640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6a1406e2b0 0x7f6a14070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:13.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.573+0000 7f6a2bfff640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6a1406e2b0 0x7f6a14070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c000c00 tx=0x7f6a1c005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:13.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.580+0000 7f6a297fa640 1 -- 172.21.15.118:0/813278251 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a2005feb0 con 0x7f6a2c101a40 2024-09-21T11:38:13.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.859+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6a2c062630 con 0x7f6a1406e2b0 2024-09-21T11:38:13.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.873+0000 7f6a297fa640 1 -- 172.21.15.118:0/813278251 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f6a2c062630 con 0x7f6a1406e2b0 2024-09-21T11:38:13.875 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:38:13.875 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (5m) 84s ago 7m 23.6M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (7m) 84s ago 7m 8342k - 19.1.1-373-g4e45e6b4 164465d2334a f027b8fa4d1f 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (6m) 88s ago 6m 5268k - 19.1.1-373-g4e45e6b4 164465d2334a b67cebd3ec35 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (7m) 84s ago 7m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (6m) 88s ago 6m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (5m) 84s ago 6m 78.5M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (107s) 84s ago 106s 17.1M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (101s) 84s ago 100s 17.1M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (98s) 88s ago 98s 17.4M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (104s) 88s ago 103s 11.3M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:9283,8765,8443 running (8m) 84s ago 8m 499M - 19.1.1-373-g4e45e6b4 164465d2334a 74626178eaa8 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (6m) 88s ago 6m 443M - 19.1.1-373-g4e45e6b4 164465d2334a 13c5d2f4c157 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (8m) 84s ago 8m 46.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (6m) 88s ago 6m 35.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (7m) 84s ago 7m 15.9M - 1.5.0 0da6a335fe13 92cdb77bc8bc 2024-09-21T11:38:13.876 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (6m) 88s ago 6m 15.5M - 1.5.0 0da6a335fe13 1a6e8f960a5b 2024-09-21T11:38:13.877 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (5m) 84s ago 5m 49.5M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:38:13.877 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (4m) 84s ago 4m 50.7M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:38:13.877 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (4m) 84s ago 4m 54.8M 3946M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:38:13.877 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (3m) 88s ago 3m 53.2M 1213M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:38:13.877 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (3m) 88s ago 3m 42.4M 1213M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:38:13.877 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (2m) 88s ago 2m 48.5M 1213M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:38:13.877 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (5m) 84s ago 6m 55.3M - 2.43.0 a07b618ecd1d 44053d283e3b 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6a1406e2b0 msgr2=0x7f6a14070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6a1406e2b0 0x7f6a14070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c000c00 tx=0x7f6a1c005a20 comp rx=0 tx=0).stop 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c101a40 msgr2=0x7f6a2c199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c101a40 0x7f6a2c199bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e970 tx=0x7f6a2000ed70 comp rx=0 tx=0).stop 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 shutdown_connections 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f6a1406e2b0 0x7f6a14070770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a2c101a40 0x7f6a2c199bf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 --2- 172.21.15.118:0/813278251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a2c100840 0x7f6a2c1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 >> 172.21.15.118:0/813278251 conn(0x7f6a2c0fbff0 msgr2=0x7f6a2c104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 shutdown_connections 2024-09-21T11:38:13.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.876+0000 7f6a32721640 1 -- 172.21.15.118:0/813278251 wait complete. 2024-09-21T11:38:13.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.987+0000 7f3dc043d640 1 -- 172.21.15.118:0/620138752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db80ffc50 msgr2=0x7f3db8100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.987+0000 7f3dc043d640 1 --2- 172.21.15.118:0/620138752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db80ffc50 0x7f3db8100050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009880 tx=0x7f3db402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.987+0000 7f3dc043d640 1 -- 172.21.15.118:0/620138752 shutdown_connections 2024-09-21T11:38:13.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.987+0000 7f3dc043d640 1 --2- 172.21.15.118:0/620138752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db8102c30 0x7f3db81030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.988+0000 7f3dc043d640 1 --2- 172.21.15.118:0/620138752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db80ffc50 0x7f3db8100050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.988+0000 7f3dc043d640 1 -- 172.21.15.118:0/620138752 >> 172.21.15.118:0/620138752 conn(0x7f3db80fb7a0 msgr2=0x7f3db80fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:13.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.988+0000 7f3dc043d640 1 -- 172.21.15.118:0/620138752 shutdown_connections 2024-09-21T11:38:13.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.988+0000 7f3dc043d640 1 -- 172.21.15.118:0/620138752 wait complete. 2024-09-21T11:38:13.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.988+0000 7f3dc043d640 1 Processor -- start 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.988+0000 7f3dc043d640 1 -- start start 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dc043d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db80ffc50 0x7f3db8110560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dc043d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8102c30 0x7f3db8110aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dc043d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3db81085a0 con 0x7f3db8102c30 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dc043d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8108420 con 0x7f3db80ffc50 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dbe1d9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db80ffc50 0x7f3db8110560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dbd9d8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8102c30 0x7f3db8110aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dbe1d9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db80ffc50 0x7f3db8110560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:57960/0 (socket says 172.21.15.118:57960) 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dbe1d9640 1 -- 172.21.15.118:0/4245476116 learned_addr learned my addr 172.21.15.118:0/4245476116 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dbd9d8640 1 -- 172.21.15.118:0/4245476116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db80ffc50 msgr2=0x7f3db8110560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dbd9d8640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db80ffc50 0x7f3db8110560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.989+0000 7f3dbd9d8640 1 -- 172.21.15.118:0/4245476116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db8111120 con 0x7f3db8102c30 2024-09-21T11:38:13.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.990+0000 7f3dbd9d8640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8102c30 0x7f3db8110aa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3da800e970 tx=0x7f3da800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:13.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.990+0000 7f3daf7fe640 1 -- 172.21.15.118:0/4245476116 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3da800cac0 con 0x7f3db8102c30 2024-09-21T11:38:13.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.990+0000 7f3daf7fe640 1 -- 172.21.15.118:0/4245476116 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3da800cc60 con 0x7f3db8102c30 2024-09-21T11:38:13.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.990+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db8113b50 con 0x7f3db8102c30 2024-09-21T11:38:13.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.990+0000 7f3daf7fe640 1 -- 172.21.15.118:0/4245476116 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3da8018720 con 0x7f3db8102c30 2024-09-21T11:38:13.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.991+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db81140e0 con 0x7f3db8102c30 2024-09-21T11:38:13.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.992+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db810a490 con 0x7f3db8102c30 2024-09-21T11:38:13.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.992+0000 7f3daf7fe640 1 -- 172.21.15.118:0/4245476116 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f3da80188c0 con 0x7f3db8102c30 2024-09-21T11:38:13.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.992+0000 7f3daf7fe640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f3da406e310 0x7f3da40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:13.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.993+0000 7f3daf7fe640 1 -- 172.21.15.118:0/4245476116 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f3da808e610 con 0x7f3db8102c30 2024-09-21T11:38:13.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.993+0000 7f3dbe1d9640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f3da406e310 0x7f3da40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:13.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.993+0000 7f3dbe1d9640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f3da406e310 0x7f3da40707d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3db4000c00 tx=0x7f3db40058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:13.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:13.997+0000 7f3daf7fe640 1 -- 172.21.15.118:0/4245476116 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3da805fc40 con 0x7f3db8102c30 2024-09-21T11:38:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:13 smithi118 ceph-mon[28757]: pgmap v230: 65 pgs: 65 active+clean; 27 MiB data, 261 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 48 op/s 2024-09-21T11:38:14.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:13 smithi149 ceph-mon[36123]: pgmap v230: 65 pgs: 65 active+clean; 27 MiB data, 261 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 48 op/s 2024-09-21T11:38:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.337+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3db81143f0 con 0x7f3db8102c30 2024-09-21T11:38:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.338+0000 7f3daf7fe640 1 -- 172.21.15.118:0/4245476116 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f3da8064470 con 0x7f3db8102c30 2024-09-21T11:38:14.340 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:38:14.340 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:38:14.340 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:38:14.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:38:14.341 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:38:14.341 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:38:14.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:38:14.341 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:38:14.341 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:38:14.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:38:14.341 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:38:14.341 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:38:14.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:38:14.342 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:38:14.342 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 14 2024-09-21T11:38:14.342 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:38:14.342 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.341+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f3da406e310 msgr2=0x7f3da40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.341+0000 7f3dc043d640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f3da406e310 0x7f3da40707d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3db4000c00 tx=0x7f3db40058d0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.341+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8102c30 msgr2=0x7f3db8110aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.341+0000 7f3dc043d640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8102c30 0x7f3db8110aa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3da800e970 tx=0x7f3da800ee30 comp rx=0 tx=0).stop 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.341+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 shutdown_connections 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.341+0000 7f3dc043d640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7f3da406e310 0x7f3da40707d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.341+0000 7f3dc043d640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8102c30 0x7f3db8110aa0 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3da800e970 tx=0x7f3da800ee30 comp rx=0 tx=0).stop 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.341+0000 7f3dc043d640 1 --2- 172.21.15.118:0/4245476116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db80ffc50 0x7f3db8110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.341+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 >> 172.21.15.118:0/4245476116 conn(0x7f3db80fb7a0 msgr2=0x7f3db81060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.342+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 shutdown_connections 2024-09-21T11:38:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.342+0000 7f3dc043d640 1 -- 172.21.15.118:0/4245476116 wait complete. 2024-09-21T11:38:14.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.436+0000 7eff6d9e1640 1 -- 172.21.15.118:0/3143972125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 msgr2=0x7eff68100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:14.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.436+0000 7eff6d9e1640 1 --2- 172.21.15.118:0/3143972125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 0x7eff68100c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7eff58009880 tx=0x7eff5802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.437+0000 7eff6d9e1640 1 -- 172.21.15.118:0/3143972125 shutdown_connections 2024-09-21T11:38:14.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.437+0000 7eff6d9e1640 1 --2- 172.21.15.118:0/3143972125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff68101a40 0x7eff68101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.437+0000 7eff6d9e1640 1 --2- 172.21.15.118:0/3143972125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 0x7eff68100c40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.437+0000 7eff6d9e1640 1 -- 172.21.15.118:0/3143972125 >> 172.21.15.118:0/3143972125 conn(0x7eff680fbff0 msgr2=0x7eff680fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:14.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.437+0000 7eff6d9e1640 1 -- 172.21.15.118:0/3143972125 shutdown_connections 2024-09-21T11:38:14.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.437+0000 7eff6d9e1640 1 -- 172.21.15.118:0/3143972125 wait complete. 2024-09-21T11:38:14.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.437+0000 7eff6d9e1640 1 Processor -- start 2024-09-21T11:38:14.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff6d9e1640 1 -- start start 2024-09-21T11:38:14.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff6d9e1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 0x7eff6806a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:14.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff6d9e1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff68101a40 0x7eff6819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:14.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff6d9e1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7eff68109680 con 0x7eff68100840 2024-09-21T11:38:14.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff6d9e1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7eff68109500 con 0x7eff68101a40 2024-09-21T11:38:14.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff66ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 0x7eff6806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:14.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff66ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 0x7eff6806a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49604/0 (socket says 172.21.15.118:49604) 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff66ffd640 1 -- 172.21.15.118:0/2878731347 learned_addr learned my addr 172.21.15.118:0/2878731347 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff667fc640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff68101a40 0x7eff6819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff66ffd640 1 -- 172.21.15.118:0/2878731347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff68101a40 msgr2=0x7eff6819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff66ffd640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff68101a40 0x7eff6819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.438+0000 7eff66ffd640 1 -- 172.21.15.118:0/2878731347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6819c7e0 con 0x7eff68100840 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.439+0000 7eff66ffd640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 0x7eff6806a620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7eff58006010 tx=0x7eff580045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.439+0000 7eff6c9df640 1 -- 172.21.15.118:0/2878731347 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff5803f070 con 0x7eff68100840 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.439+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6819ca70 con 0x7eff68100840 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.439+0000 7eff6c9df640 1 -- 172.21.15.118:0/2878731347 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff580049d0 con 0x7eff68100840 2024-09-21T11:38:14.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.439+0000 7eff6c9df640 1 -- 172.21.15.118:0/2878731347 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff58035030 con 0x7eff68100840 2024-09-21T11:38:14.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.439+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6819cfa0 con 0x7eff68100840 2024-09-21T11:38:14.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.440+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff68100c40 con 0x7eff68100840 2024-09-21T11:38:14.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.441+0000 7eff6c9df640 1 -- 172.21.15.118:0/2878731347 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7eff58042070 con 0x7eff68100840 2024-09-21T11:38:14.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.441+0000 7eff6c9df640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7eff5006e310 0x7eff500707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:14.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.441+0000 7eff6c9df640 1 -- 172.21.15.118:0/2878731347 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7eff580aecd0 con 0x7eff68100840 2024-09-21T11:38:14.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.441+0000 7eff667fc640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7eff5006e310 0x7eff500707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:14.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.442+0000 7eff667fc640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7eff5006e310 0x7eff500707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff6806a3a0 tx=0x7eff5c005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:14.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.449+0000 7eff6c9df640 1 -- 172.21.15.118:0/2878731347 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7eff580801d0 con 0x7eff68100840 2024-09-21T11:38:14.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.707+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 --> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7eff68062630 con 0x7eff5006e310 2024-09-21T11:38:14.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.708+0000 7eff6c9df640 1 -- 172.21.15.118:0/2878731347 <== mgr.14221 v2:172.21.15.118:6800/1247137526 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7eff68062630 con 0x7eff5006e310 2024-09-21T11:38:14.710 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:38:14.711 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:38:14.711 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:38:14.711 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:38:14.711 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [], 2024-09-21T11:38:14.711 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T11:38:14.711 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 image on host smithi149", 2024-09-21T11:38:14.711 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:38:14.711 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:38:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.710+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7eff5006e310 msgr2=0x7eff500707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.710+0000 7eff6d9e1640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7eff5006e310 0x7eff500707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff6806a3a0 tx=0x7eff5c005f90 comp rx=0 tx=0).stop 2024-09-21T11:38:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.710+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 msgr2=0x7eff6806a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.710+0000 7eff6d9e1640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 0x7eff6806a620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7eff58006010 tx=0x7eff580045e0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.710+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 shutdown_connections 2024-09-21T11:38:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.711+0000 7eff6d9e1640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:6800/1247137526,v1:172.21.15.118:6801/1247137526] conn(0x7eff5006e310 0x7eff500707d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.711+0000 7eff6d9e1640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff68101a40 0x7eff6819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.711+0000 7eff6d9e1640 1 --2- 172.21.15.118:0/2878731347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff68100840 0x7eff6806a620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:14.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.711+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 >> 172.21.15.118:0/2878731347 conn(0x7eff680fbff0 msgr2=0x7eff68104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:14.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.711+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 shutdown_connections 2024-09-21T11:38:14.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:14.711+0000 7eff6d9e1640 1 -- 172.21.15.118:0/2878731347 wait complete. 2024-09-21T11:38:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:14 smithi118 ceph-mon[28757]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:14 smithi118 ceph-mon[28757]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:14 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/4245476116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:38:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:14 smithi149 ceph-mon[36123]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:14 smithi149 ceph-mon[36123]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:14 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/4245476116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:38:15.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:15 smithi149 ceph-mon[36123]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:15 smithi149 ceph-mon[36123]: pgmap v231: 65 pgs: 65 active+clean; 33 MiB data, 283 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 76 op/s 2024-09-21T11:38:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:15 smithi149 ceph-mon[36123]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:15 smithi118 ceph-mon[28757]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:15 smithi118 ceph-mon[28757]: pgmap v231: 65 pgs: 65 active+clean; 33 MiB data, 283 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 76 op/s 2024-09-21T11:38:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:15 smithi118 ceph-mon[28757]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:17.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:16 smithi118 ceph-mon[28757]: pgmap v232: 65 pgs: 65 active+clean; 40 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 121 op/s 2024-09-21T11:38:17.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:16 smithi149 ceph-mon[36123]: pgmap v232: 65 pgs: 65 active+clean; 40 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 121 op/s 2024-09-21T11:38:19.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:19 smithi149 ceph-mon[36123]: pgmap v233: 65 pgs: 65 active+clean; 41 MiB data, 337 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 131 op/s 2024-09-21T11:38:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:19 smithi118 ceph-mon[28757]: pgmap v233: 65 pgs: 65 active+clean; 41 MiB data, 337 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 131 op/s 2024-09-21T11:38:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:20 smithi149 ceph-mon[36123]: Upgrade: Updating mgr.smithi149.xjglai 2024-09-21T11:38:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:20 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:20 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.xjglai", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:38:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:20 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:38:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:20 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:38:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:20 smithi149 ceph-mon[36123]: Deploying daemon mgr.smithi149.xjglai on smithi149 2024-09-21T11:38:21.037 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:20 smithi118 ceph-mon[28757]: Upgrade: Updating mgr.smithi149.xjglai 2024-09-21T11:38:21.038 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:20 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:21.038 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:20 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.xjglai", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:38:21.038 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:20 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:38:21.038 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:20 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:38:21.038 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:20 smithi118 ceph-mon[28757]: Deploying daemon mgr.smithi149.xjglai on smithi149 2024-09-21T11:38:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:21 smithi149 ceph-mon[36123]: pgmap v234: 65 pgs: 65 active+clean; 46 MiB data, 350 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.9 MiB/s wr, 147 op/s 2024-09-21T11:38:22.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:21 smithi118 ceph-mon[28757]: pgmap v234: 65 pgs: 65 active+clean; 46 MiB data, 350 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.9 MiB/s wr, 147 op/s 2024-09-21T11:38:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:23 smithi118 ceph-mon[28757]: pgmap v235: 65 pgs: 65 active+clean; 60 MiB data, 385 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 164 op/s 2024-09-21T11:38:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:23 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:38:23.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:23 smithi149 ceph-mon[36123]: pgmap v235: 65 pgs: 65 active+clean; 60 MiB data, 385 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 164 op/s 2024-09-21T11:38:23.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:23 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:38:25.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:25.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:25.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:24 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:38:25.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:24 smithi118 ceph-mon[28757]: pgmap v236: 65 pgs: 65 active+clean; 69 MiB data, 416 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 168 op/s 2024-09-21T11:38:25.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:24 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:38:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:24 smithi149 ceph-mon[36123]: pgmap v236: 65 pgs: 65 active+clean; 69 MiB data, 416 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 168 op/s 2024-09-21T11:38:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:27 smithi149 ceph-mon[36123]: pgmap v237: 65 pgs: 65 active+clean; 88 MiB data, 467 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.7 MiB/s wr, 204 op/s 2024-09-21T11:38:28.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:27 smithi118 ceph-mon[28757]: pgmap v237: 65 pgs: 65 active+clean; 88 MiB data, 467 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.7 MiB/s wr, 204 op/s 2024-09-21T11:38:29.814 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:29 smithi149 ceph-mon[36123]: pgmap v238: 65 pgs: 65 active+clean; 89 MiB data, 477 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 173 op/s 2024-09-21T11:38:29.814 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:29 smithi149 ceph-mon[36123]: Standby manager daemon smithi149.xjglai restarted 2024-09-21T11:38:29.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:29 smithi149 ceph-mon[36123]: Standby manager daemon smithi149.xjglai started 2024-09-21T11:38:29.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:29 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/crt"}]: dispatch 2024-09-21T11:38:29.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:29 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:38:29.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:29 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/key"}]: dispatch 2024-09-21T11:38:29.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:29 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:38:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:29 smithi118 ceph-mon[28757]: pgmap v238: 65 pgs: 65 active+clean; 89 MiB data, 477 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 173 op/s 2024-09-21T11:38:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:29 smithi118 ceph-mon[28757]: Standby manager daemon smithi149.xjglai restarted 2024-09-21T11:38:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:29 smithi118 ceph-mon[28757]: Standby manager daemon smithi149.xjglai started 2024-09-21T11:38:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:29 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/crt"}]: dispatch 2024-09-21T11:38:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:29 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:38:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:29 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/key"}]: dispatch 2024-09-21T11:38:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:29 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:38:30.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:30 smithi149 ceph-mon[36123]: mgrmap e20: smithi118.djbwyn(active, since 6m), standbys: smithi149.xjglai 2024-09-21T11:38:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:30 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:30 smithi118 ceph-mon[28757]: mgrmap e20: smithi118.djbwyn(active, since 6m), standbys: smithi149.xjglai 2024-09-21T11:38:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:30 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:31.836 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:31 smithi149 ceph-mon[36123]: pgmap v239: 65 pgs: 65 active+clean; 94 MiB data, 512 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.5 MiB/s wr, 181 op/s 2024-09-21T11:38:31.836 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:31 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:31.836 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:31 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:31 smithi118 ceph-mon[28757]: pgmap v239: 65 pgs: 65 active+clean; 94 MiB data, 512 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.5 MiB/s wr, 181 op/s 2024-09-21T11:38:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:31 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:31 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:33.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:33 smithi149 ceph-mon[36123]: pgmap v240: 65 pgs: 65 active+clean; 103 MiB data, 527 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.8 MiB/s wr, 189 op/s 2024-09-21T11:38:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:33 smithi118 ceph-mon[28757]: pgmap v240: 65 pgs: 65 active+clean; 103 MiB data, 527 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.8 MiB/s wr, 189 op/s 2024-09-21T11:38:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:35.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:35.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr fail", "who": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: Activating manager daemon smithi149.xjglai 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "mgr fail", "who": "smithi118.djbwyn"}]': finished 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: mgrmap e21: smithi149.xjglai(active, starting, since 0.00791237s) 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:38:35.955 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mgr metadata", "who": "smithi149.xjglai", "id": "smithi149.xjglai"}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T11:38:35.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T11:38:35.957 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T11:38:35.957 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:35 smithi149 ceph-mon[36123]: Manager daemon smithi149.xjglai is now available 2024-09-21T11:38:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr fail", "who": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: Activating manager daemon smithi149.xjglai 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.14221 172.21.15.118:0/3470830173' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "mgr fail", "who": "smithi118.djbwyn"}]': finished 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: mgrmap e21: smithi149.xjglai(active, starting, since 0.00791237s) 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:38:36.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mgr metadata", "who": "smithi149.xjglai", "id": "smithi149.xjglai"}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T11:38:36.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T11:38:36.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T11:38:36.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:35 smithi118 ceph-mon[28757]: Manager daemon smithi149.xjglai is now available 2024-09-21T11:38:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: mgrmap e22: smithi149.xjglai(active, since 1.00895s) 2024-09-21T11:38:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: pgmap v3: 65 pgs: 65 active+clean; 117 MiB data, 563 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:38:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:38:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:38:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.xjglai/mirror_snapshot_schedule"}]: dispatch 2024-09-21T11:38:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:38:36.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:36 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.xjglai/trash_purge_schedule"}]: dispatch 2024-09-21T11:38:37.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: mgrmap e22: smithi149.xjglai(active, since 1.00895s) 2024-09-21T11:38:37.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: pgmap v3: 65 pgs: 65 active+clean; 117 MiB data, 563 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:37.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:37.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:37.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:38:37.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:38:37.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:38:37.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.xjglai/mirror_snapshot_schedule"}]: dispatch 2024-09-21T11:38:37.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:38:37.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:36 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.xjglai/trash_purge_schedule"}]: dispatch 2024-09-21T11:38:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:37 smithi118 ceph-mon[28757]: Deploying cephadm binary to smithi149 2024-09-21T11:38:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:37 smithi118 ceph-mon[28757]: Deploying cephadm binary to smithi118 2024-09-21T11:38:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:37 smithi118 ceph-mon[28757]: [21/Sep/2024:11:38:37] ENGINE Bus STARTING 2024-09-21T11:38:38.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:37 smithi149 ceph-mon[36123]: Deploying cephadm binary to smithi149 2024-09-21T11:38:38.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:37 smithi149 ceph-mon[36123]: Deploying cephadm binary to smithi118 2024-09-21T11:38:38.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:37 smithi149 ceph-mon[36123]: [21/Sep/2024:11:38:37] ENGINE Bus STARTING 2024-09-21T11:38:39.041 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:38 smithi118 ceph-mon[28757]: [21/Sep/2024:11:38:37] ENGINE Serving on https://172.21.15.149:7150 2024-09-21T11:38:39.041 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:38 smithi118 ceph-mon[28757]: [21/Sep/2024:11:38:37] ENGINE Error in HTTPServer.serve 2024-09-21T11:38:39.041 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Traceback (most recent call last): 2024-09-21T11:38:39.041 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T11:38:39.041 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._connections.run(self.expiration_interval) 2024-09-21T11:38:39.041 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._run(expiration_interval) 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s = self.context.wrap_socket( 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: return self.sslsocket_class._create( 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self.do_handshake() 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._sslobj.do_handshake() 2024-09-21T11:38:39.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T11:38:39.043 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:38 smithi118 ceph-mon[28757]: mgrmap e23: smithi149.xjglai(active, since 3s) 2024-09-21T11:38:39.043 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:38 smithi118 ceph-mon[28757]: [21/Sep/2024:11:38:37] ENGINE Serving on http://172.21.15.149:8765 2024-09-21T11:38:39.043 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:38 smithi118 ceph-mon[28757]: [21/Sep/2024:11:38:37] ENGINE Bus STARTED 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:38 smithi149 ceph-mon[36123]: [21/Sep/2024:11:38:37] ENGINE Serving on https://172.21.15.149:7150 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:38 smithi149 ceph-mon[36123]: [21/Sep/2024:11:38:37] ENGINE Error in HTTPServer.serve 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Traceback (most recent call last): 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._connections.run(self.expiration_interval) 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._run(expiration_interval) 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T11:38:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: s = self.context.wrap_socket( 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: return self.sslsocket_class._create( 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self.do_handshake() 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._sslobj.do_handshake() 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:38 smithi149 ceph-mon[36123]: mgrmap e23: smithi149.xjglai(active, since 3s) 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:38 smithi149 ceph-mon[36123]: [21/Sep/2024:11:38:37] ENGINE Serving on http://172.21.15.149:8765 2024-09-21T11:38:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:38 smithi149 ceph-mon[36123]: [21/Sep/2024:11:38:37] ENGINE Bus STARTED 2024-09-21T11:38:40.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:40 smithi118 ceph-mon[28757]: pgmap v5: 65 pgs: 65 active+clean; 117 MiB data, 563 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:40.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:40 smithi149 ceph-mon[36123]: pgmap v5: 65 pgs: 65 active+clean; 117 MiB data, 563 MiB used, 536 GiB / 536 GiB avail 2024-09-21T11:38:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:41 smithi118 ceph-mon[28757]: mgrmap e24: smithi149.xjglai(active, since 5s) 2024-09-21T11:38:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:41 smithi118 ceph-mon[28757]: Standby manager daemon smithi118.djbwyn started 2024-09-21T11:38:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:41 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.118:0/4266899185' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi118.djbwyn/crt"}]: dispatch 2024-09-21T11:38:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:41 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.118:0/4266899185' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:38:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:41 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.118:0/4266899185' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi118.djbwyn/key"}]: dispatch 2024-09-21T11:38:41.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:41 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.118:0/4266899185' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:38:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:41 smithi149 ceph-mon[36123]: mgrmap e24: smithi149.xjglai(active, since 5s) 2024-09-21T11:38:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:41 smithi149 ceph-mon[36123]: Standby manager daemon smithi118.djbwyn started 2024-09-21T11:38:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:41 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.118:0/4266899185' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi118.djbwyn/crt"}]: dispatch 2024-09-21T11:38:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:41 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.118:0/4266899185' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:38:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:41 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.118:0/4266899185' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi118.djbwyn/key"}]: dispatch 2024-09-21T11:38:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:41 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.118:0/4266899185' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:38:42.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:42 smithi118 ceph-mon[28757]: pgmap v6: 65 pgs: 65 active+clean; 138 MiB data, 637 MiB used, 536 GiB / 536 GiB avail; 35 KiB/s rd, 4.3 MiB/s wr, 255 op/s 2024-09-21T11:38:42.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:42 smithi118 ceph-mon[28757]: mgrmap e25: smithi149.xjglai(active, since 6s), standbys: smithi118.djbwyn 2024-09-21T11:38:42.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:42 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mgr metadata", "who": "smithi118.djbwyn", "id": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:38:42.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:42 smithi149 ceph-mon[36123]: pgmap v6: 65 pgs: 65 active+clean; 138 MiB data, 637 MiB used, 536 GiB / 536 GiB avail; 35 KiB/s rd, 4.3 MiB/s wr, 255 op/s 2024-09-21T11:38:42.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:42 smithi149 ceph-mon[36123]: mgrmap e25: smithi149.xjglai(active, since 6s), standbys: smithi118.djbwyn 2024-09-21T11:38:42.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:42 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mgr metadata", "who": "smithi118.djbwyn", "id": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:38:44.791 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:44 smithi118 ceph-mon[28757]: pgmap v7: 65 pgs: 65 active+clean; 138 MiB data, 637 MiB used, 536 GiB / 536 GiB avail; 25 KiB/s rd, 3.0 MiB/s wr, 182 op/s 2024-09-21T11:38:44.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.821+0000 7f132e329640 1 -- 172.21.15.118:0/209923415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 msgr2=0x7f1328101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.821+0000 7f132e329640 1 --2- 172.21.15.118:0/209923415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 0x7f1328101ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f131c0097e0 tx=0x7f131c02a3f0 comp rx=0 tx=0).stop 2024-09-21T11:38:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.821+0000 7f132e329640 1 -- 172.21.15.118:0/209923415 shutdown_connections 2024-09-21T11:38:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.821+0000 7f132e329640 1 --2- 172.21.15.118:0/209923415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 0x7f1328101ef0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.821+0000 7f132e329640 1 --2- 172.21.15.118:0/209923415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1328100870 0x7f1328100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.821+0000 7f132e329640 1 -- 172.21.15.118:0/209923415 >> 172.21.15.118:0/209923415 conn(0x7f13280fc020 msgr2=0x7f13280fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.821+0000 7f132e329640 1 -- 172.21.15.118:0/209923415 shutdown_connections 2024-09-21T11:38:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.821+0000 7f132e329640 1 -- 172.21.15.118:0/209923415 wait complete. 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f132e329640 1 Processor -- start 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f132e329640 1 -- start start 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f132e329640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1328100870 0x7f132806ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f132e329640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 0x7f132819c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f132e329640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1328109690 con 0x7f1328101a70 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f132e329640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1328109510 con 0x7f1328100870 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f13277fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 0x7f132819c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f13277fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 0x7f132819c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42816/0 (socket says 172.21.15.118:42816) 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f13277fe640 1 -- 172.21.15.118:0/104973642 learned_addr learned my addr 172.21.15.118:0/104973642 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f1327fff640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1328100870 0x7f132806ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:44.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f13277fe640 1 -- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1328100870 msgr2=0x7f132806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:44.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.822+0000 7f13277fe640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1328100870 0x7f132806ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:44.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.823+0000 7f13277fe640 1 -- 172.21.15.118:0/104973642 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132819c790 con 0x7f1328101a70 2024-09-21T11:38:44.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.823+0000 7f13277fe640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 0x7f132819c1d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f131c009900 tx=0x7f131c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:44.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.823+0000 7f13257fa640 1 -- 172.21.15.118:0/104973642 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f131c040070 con 0x7f1328101a70 2024-09-21T11:38:44.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.823+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132819ca20 con 0x7f1328101a70 2024-09-21T11:38:44.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.823+0000 7f13257fa640 1 -- 172.21.15.118:0/104973642 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f131c030c00 con 0x7f1328101a70 2024-09-21T11:38:44.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.823+0000 7f13257fa640 1 -- 172.21.15.118:0/104973642 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f131c040070 con 0x7f1328101a70 2024-09-21T11:38:44.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.823+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132819cf50 con 0x7f1328101a70 2024-09-21T11:38:44.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.824+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1328100c70 con 0x7f1328101a70 2024-09-21T11:38:44.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.824+0000 7f13257fa640 1 -- 172.21.15.118:0/104973642 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f131c039040 con 0x7f1328101a70 2024-09-21T11:38:44.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.825+0000 7f13257fa640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1310074c10 0x7f13100770d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:44.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.825+0000 7f13257fa640 1 -- 172.21.15.118:0/104973642 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f131c0b7390 con 0x7f1328101a70 2024-09-21T11:38:44.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.825+0000 7f1327fff640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1310074c10 0x7f13100770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:44.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.826+0000 7f1327fff640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1310074c10 0x7f13100770d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f13281018d0 tx=0x7f1318009260 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:44.833+0000 7f13257fa640 1 -- 172.21.15.118:0/104973642 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f131c082830 con 0x7f1328101a70 2024-09-21T11:38:44.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:44 smithi149 ceph-mon[36123]: pgmap v7: 65 pgs: 65 active+clean; 138 MiB data, 637 MiB used, 536 GiB / 536 GiB avail; 25 KiB/s rd, 3.0 MiB/s wr, 182 op/s 2024-09-21T11:38:45.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.092+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1328062630 con 0x7f1310074c10 2024-09-21T11:38:45.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.094+0000 7f13257fa640 1 -- 172.21.15.118:0/104973642 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f1328062630 con 0x7f1310074c10 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.096+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1310074c10 msgr2=0x7f13100770d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.096+0000 7f132e329640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1310074c10 0x7f13100770d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f13281018d0 tx=0x7f1318009260 comp rx=0 tx=0).stop 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.096+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 msgr2=0x7f132819c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.096+0000 7f132e329640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 0x7f132819c1d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f131c009900 tx=0x7f131c0043b0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.097+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 shutdown_connections 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.097+0000 7f132e329640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1310074c10 0x7f13100770d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.097+0000 7f132e329640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1328101a70 0x7f132819c1d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.097+0000 7f132e329640 1 --2- 172.21.15.118:0/104973642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1328100870 0x7f132806ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.097+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 >> 172.21.15.118:0/104973642 conn(0x7f13280fc020 msgr2=0x7f1328104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.097+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 shutdown_connections 2024-09-21T11:38:45.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.097+0000 7f132e329640 1 -- 172.21.15.118:0/104973642 wait complete. 2024-09-21T11:38:45.107 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:38:45.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.186+0000 7efce0539640 1 -- 172.21.15.118:0/476039116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8102400 msgr2=0x7efcd81047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.186+0000 7efce0539640 1 --2- 172.21.15.118:0/476039116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8102400 0x7efcd81047f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efcd40098b0 tx=0x7efcd402a4d0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.187+0000 7efce0539640 1 -- 172.21.15.118:0/476039116 shutdown_connections 2024-09-21T11:38:45.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.187+0000 7efce0539640 1 --2- 172.21.15.118:0/476039116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcd8104d30 0x7efcd8107120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.187+0000 7efce0539640 1 --2- 172.21.15.118:0/476039116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8102400 0x7efcd81047f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.187+0000 7efce0539640 1 -- 172.21.15.118:0/476039116 >> 172.21.15.118:0/476039116 conn(0x7efcd80fc020 msgr2=0x7efcd80fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.187+0000 7efce0539640 1 -- 172.21.15.118:0/476039116 shutdown_connections 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.187+0000 7efce0539640 1 -- 172.21.15.118:0/476039116 wait complete. 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.187+0000 7efce0539640 1 Processor -- start 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.187+0000 7efce0539640 1 -- start start 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efce0539640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcd8102400 0x7efcd81974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efce0539640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8104d30 0x7efcd8197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efce0539640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efcd810a7f0 con 0x7efcd8104d30 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efce0539640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efcd810a670 con 0x7efcd8102400 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efcddad4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8104d30 0x7efcd8197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efcddad4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8104d30 0x7efcd8197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42826/0 (socket says 172.21.15.118:42826) 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efcddad4640 1 -- 172.21.15.118:0/2338581485 learned_addr learned my addr 172.21.15.118:0/2338581485 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:45.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efcde2d5640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcd8102400 0x7efcd81974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:45.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efcddad4640 1 -- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcd8102400 msgr2=0x7efcd81974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efcddad4640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcd8102400 0x7efcd81974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efcddad4640 1 -- 172.21.15.118:0/2338581485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd81980b0 con 0x7efcd8104d30 2024-09-21T11:38:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efcde2d5640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcd8102400 0x7efcd81974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T11:38:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.188+0000 7efcddad4640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8104d30 0x7efcd8197a30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e970 tx=0x7efcc800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.189+0000 7efccf7fe640 1 -- 172.21.15.118:0/2338581485 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcc800cac0 con 0x7efcd8104d30 2024-09-21T11:38:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.189+0000 7efccf7fe640 1 -- 172.21.15.118:0/2338581485 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcc80054e0 con 0x7efcd8104d30 2024-09-21T11:38:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.189+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd819caf0 con 0x7efcd8104d30 2024-09-21T11:38:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.189+0000 7efccf7fe640 1 -- 172.21.15.118:0/2338581485 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcc8010430 con 0x7efcd8104d30 2024-09-21T11:38:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.189+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd819d080 con 0x7efcd8104d30 2024-09-21T11:38:45.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.190+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd81027e0 con 0x7efcd8104d30 2024-09-21T11:38:45.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.191+0000 7efccf7fe640 1 -- 172.21.15.118:0/2338581485 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7efcc8004ee0 con 0x7efcd8104d30 2024-09-21T11:38:45.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.191+0000 7efccf7fe640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7efcc4074a80 0x7efcc4076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:45.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.191+0000 7efccf7fe640 1 -- 172.21.15.118:0/2338581485 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7efcc80968f0 con 0x7efcd8104d30 2024-09-21T11:38:45.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.191+0000 7efcde2d5640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7efcc4074a80 0x7efcc4076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:45.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.192+0000 7efcde2d5640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7efcc4074a80 0x7efcc4076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efcd4006010 tx=0x7efcd40058d0 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:45.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.197+0000 7efccf7fe640 1 -- 172.21.15.118:0/2338581485 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7efcc8061ea0 con 0x7efcd8104d30 2024-09-21T11:38:45.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.482+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efcd81057b0 con 0x7efcc4074a80 2024-09-21T11:38:45.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.483+0000 7efccf7fe640 1 -- 172.21.15.118:0/2338581485 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7efcd81057b0 con 0x7efcc4074a80 2024-09-21T11:38:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.485+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7efcc4074a80 msgr2=0x7efcc4076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.485+0000 7efce0539640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7efcc4074a80 0x7efcc4076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efcd4006010 tx=0x7efcd40058d0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.485+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8104d30 msgr2=0x7efcd8197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.485+0000 7efce0539640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8104d30 0x7efcd8197a30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e970 tx=0x7efcc800ee30 comp rx=0 tx=0).stop 2024-09-21T11:38:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.485+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 shutdown_connections 2024-09-21T11:38:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.485+0000 7efce0539640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7efcc4074a80 0x7efcc4076f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.485+0000 7efce0539640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcd8104d30 0x7efcd8197a30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.485+0000 7efce0539640 1 --2- 172.21.15.118:0/2338581485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcd8102400 0x7efcd81974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.485+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 >> 172.21.15.118:0/2338581485 conn(0x7efcd80fc020 msgr2=0x7efcd80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:45.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.486+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 shutdown_connections 2024-09-21T11:38:45.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.486+0000 7efce0539640 1 -- 172.21.15.118:0/2338581485 wait complete. 2024-09-21T11:38:45.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.595+0000 7fe24a501640 1 -- 172.21.15.118:0/3403481457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244101a40 msgr2=0x7fe244101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.595+0000 7fe24a501640 1 --2- 172.21.15.118:0/3403481457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244101a40 0x7fe244101ec0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe238009880 tx=0x7fe23802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.595+0000 7fe24a501640 1 -- 172.21.15.118:0/3403481457 shutdown_connections 2024-09-21T11:38:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.595+0000 7fe24a501640 1 --2- 172.21.15.118:0/3403481457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244101a40 0x7fe244101ec0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.595+0000 7fe24a501640 1 --2- 172.21.15.118:0/3403481457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe244100840 0x7fe244100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.595+0000 7fe24a501640 1 -- 172.21.15.118:0/3403481457 >> 172.21.15.118:0/3403481457 conn(0x7fe2440fbff0 msgr2=0x7fe2440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.595+0000 7fe24a501640 1 -- 172.21.15.118:0/3403481457 shutdown_connections 2024-09-21T11:38:45.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.595+0000 7fe24a501640 1 -- 172.21.15.118:0/3403481457 wait complete. 2024-09-21T11:38:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.596+0000 7fe24a501640 1 Processor -- start 2024-09-21T11:38:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.596+0000 7fe24a501640 1 -- start start 2024-09-21T11:38:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe24a501640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244100840 0x7fe2441963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe24a501640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe244101a40 0x7fe2441968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:45.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe24a501640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe244109660 con 0x7fe244100840 2024-09-21T11:38:45.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe24a501640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe2441094e0 con 0x7fe244101a40 2024-09-21T11:38:45.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe243fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244100840 0x7fe2441963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:45.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe243fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244100840 0x7fe2441963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34708/0 (socket says 172.21.15.118:34708) 2024-09-21T11:38:45.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe243fff640 1 -- 172.21.15.118:0/3365592843 learned_addr learned my addr 172.21.15.118:0/3365592843 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:45.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe2437fe640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe244101a40 0x7fe2441968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:45.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe243fff640 1 -- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe244101a40 msgr2=0x7fe2441968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe243fff640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe244101a40 0x7fe2441968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe243fff640 1 -- 172.21.15.118:0/3365592843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe244196f60 con 0x7fe244100840 2024-09-21T11:38:45.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.597+0000 7fe243fff640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244100840 0x7fe2441963a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe23400e940 tx=0x7fe23400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:45.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.598+0000 7fe2417fa640 1 -- 172.21.15.118:0/3365592843 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe23400cac0 con 0x7fe244100840 2024-09-21T11:38:45.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.598+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe244069bf0 con 0x7fe244100840 2024-09-21T11:38:45.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.598+0000 7fe2417fa640 1 -- 172.21.15.118:0/3365592843 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe23400cc60 con 0x7fe244100840 2024-09-21T11:38:45.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.598+0000 7fe2417fa640 1 -- 172.21.15.118:0/3365592843 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe234003be0 con 0x7fe244100840 2024-09-21T11:38:45.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.598+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24406a150 con 0x7fe244100840 2024-09-21T11:38:45.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.599+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe244100c40 con 0x7fe244100840 2024-09-21T11:38:45.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.600+0000 7fe2417fa640 1 -- 172.21.15.118:0/3365592843 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fe2340035f0 con 0x7fe244100840 2024-09-21T11:38:45.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.601+0000 7fe2417fa640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7fe22c074a30 0x7fe22c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:45.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.601+0000 7fe2417fa640 1 -- 172.21.15.118:0/3365592843 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fe234096760 con 0x7fe244100840 2024-09-21T11:38:45.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.601+0000 7fe2437fe640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7fe22c074a30 0x7fe22c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:45.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.602+0000 7fe2437fe640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7fe22c074a30 0x7fe22c076ef0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe238000c00 tx=0x7fe2380058d0 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:45.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.608+0000 7fe2417fa640 1 -- 172.21.15.118:0/3365592843 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe234061c90 con 0x7fe244100840 2024-09-21T11:38:45.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.837+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe24406a400 con 0x7fe22c074a30 2024-09-21T11:38:45.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.848+0000 7fe2417fa640 1 -- 172.21.15.118:0/3365592843 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe24406a400 con 0x7fe22c074a30 2024-09-21T11:38:45.851 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:38:45.851 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (6m) 116s ago 7m 23.6M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:38:45.851 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (7m) 116s ago 7m 8342k - 19.1.1-373-g4e45e6b4 164465d2334a f027b8fa4d1f 2024-09-21T11:38:45.851 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (6m) 1s ago 6m 5268k - 19.1.1-373-g4e45e6b4 164465d2334a b67cebd3ec35 2024-09-21T11:38:45.851 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (7m) 116s ago 7m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:38:45.851 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (6m) 1s ago 6m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:38:45.851 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (5m) 116s ago 7m 78.5M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (2m) 116s ago 2m 17.1M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (2m) 116s ago 2m 17.1M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (2m) 1s ago 2m 18.4M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (2m) 1s ago 2m 12.3M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:9283,8765,8443 running (9m) 116s ago 9m 499M - 19.1.1-373-g4e45e6b4 164465d2334a 74626178eaa8 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (22s) 1s ago 6m 496M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f2f99ac4e912 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (9m) 116s ago 9m 46.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (6m) 1s ago 6m 43.8M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (7m) 116s ago 7m 15.9M - 1.5.0 0da6a335fe13 92cdb77bc8bc 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (6m) 1s ago 6m 15.5M - 1.5.0 0da6a335fe13 1a6e8f960a5b 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (5m) 116s ago 5m 49.5M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (5m) 116s ago 5m 50.7M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (4m) 116s ago 4m 54.8M 3946M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (4m) 1s ago 4m 87.9M 1213M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:38:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (3m) 1s ago 3m 73.9M 1213M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:38:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (3m) 1s ago 3m 80.1M 1213M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:38:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (5m) 116s ago 7m 55.3M - 2.43.0 a07b618ecd1d 44053d283e3b 2024-09-21T11:38:45.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7fe22c074a30 msgr2=0x7fe22c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7fe22c074a30 0x7fe22c076ef0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe238000c00 tx=0x7fe2380058d0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244100840 msgr2=0x7fe2441963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244100840 0x7fe2441963a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe23400e940 tx=0x7fe23400ee00 comp rx=0 tx=0).stop 2024-09-21T11:38:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 shutdown_connections 2024-09-21T11:38:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7fe22c074a30 0x7fe22c076ef0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe244101a40 0x7fe2441968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 --2- 172.21.15.118:0/3365592843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe244100840 0x7fe2441963a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 >> 172.21.15.118:0/3365592843 conn(0x7fe2440fbff0 msgr2=0x7fe244104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 shutdown_connections 2024-09-21T11:38:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.852+0000 7fe24a501640 1 -- 172.21.15.118:0/3365592843 wait complete. 2024-09-21T11:38:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.952+0000 7f258711a640 1 -- 172.21.15.118:0/1937509412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2580101970 msgr2=0x7f2580101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.952+0000 7f258711a640 1 --2- 172.21.15.118:0/1937509412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2580101970 0x7f2580101d70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2574009880 tx=0x7f257402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.952+0000 7f258711a640 1 -- 172.21.15.118:0/1937509412 shutdown_connections 2024-09-21T11:38:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.952+0000 7f258711a640 1 --2- 172.21.15.118:0/1937509412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2580102b70 0x7f2580102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.952+0000 7f258711a640 1 --2- 172.21.15.118:0/1937509412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2580101970 0x7f2580101d70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.952+0000 7f258711a640 1 -- 172.21.15.118:0/1937509412 >> 172.21.15.118:0/1937509412 conn(0x7f25800fd140 msgr2=0x7f25800ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.952+0000 7f258711a640 1 -- 172.21.15.118:0/1937509412 shutdown_connections 2024-09-21T11:38:45.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.952+0000 7f258711a640 1 -- 172.21.15.118:0/1937509412 wait complete. 2024-09-21T11:38:45.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.953+0000 7f258711a640 1 Processor -- start 2024-09-21T11:38:45.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.953+0000 7f258711a640 1 -- start start 2024-09-21T11:38:45.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.953+0000 7f258711a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2580101970 0x7f25801952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:45.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.953+0000 7f258711a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2580102b70 0x7f25801957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f258711a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f258010a790 con 0x7f2580101970 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f258711a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f258010a610 con 0x7f2580102b70 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f2584eb6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2580101970 0x7f25801952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f257ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2580102b70 0x7f25801957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f257ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2580102b70 0x7f25801957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:37070/0 (socket says 172.21.15.118:37070) 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f257ffff640 1 -- 172.21.15.118:0/3920836809 learned_addr learned my addr 172.21.15.118:0/3920836809 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f257ffff640 1 -- 172.21.15.118:0/3920836809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2580101970 msgr2=0x7f25801952a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f257ffff640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2580101970 0x7f25801952a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f257ffff640 1 -- 172.21.15.118:0/3920836809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2580195e60 con 0x7f2580102b70 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.954+0000 7f257ffff640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2580102b70 0x7f25801957e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f256c00e970 tx=0x7f256c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.955+0000 7f257dffb640 1 -- 172.21.15.118:0/3920836809 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f256c00cac0 con 0x7f2580102b70 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.955+0000 7f257dffb640 1 -- 172.21.15.118:0/3920836809 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f256c00cc60 con 0x7f2580102b70 2024-09-21T11:38:45.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.955+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258019a8a0 con 0x7f2580102b70 2024-09-21T11:38:45.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.955+0000 7f257dffb640 1 -- 172.21.15.118:0/3920836809 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f256c018720 con 0x7f2580102b70 2024-09-21T11:38:45.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.955+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258019ae30 con 0x7f2580102b70 2024-09-21T11:38:45.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.956+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2580101d70 con 0x7f2580102b70 2024-09-21T11:38:45.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.957+0000 7f257dffb640 1 -- 172.21.15.118:0/3920836809 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f256c010430 con 0x7f2580102b70 2024-09-21T11:38:45.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.957+0000 7f257dffb640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2570074ad0 0x7f2570076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:45.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.957+0000 7f257dffb640 1 -- 172.21.15.118:0/3920836809 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f256c096960 con 0x7f2580102b70 2024-09-21T11:38:45.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.957+0000 7f2584eb6640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2570074ad0 0x7f2570076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:45.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.958+0000 7f2584eb6640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2570074ad0 0x7f2570076f90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2574000c00 tx=0x7f2574005a20 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:45.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:45.963+0000 7f257dffb640 1 -- 172.21.15.118:0/3920836809 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f256c061e70 con 0x7f2580102b70 2024-09-21T11:38:46.015 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:45 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:46.015 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:45 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:46.015 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:45 smithi149 ceph-mon[36123]: pgmap v8: 65 pgs: 65 active+clean; 138 MiB data, 637 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 141 op/s 2024-09-21T11:38:46.015 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:45 smithi149 ceph-mon[36123]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:46.015 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:45 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:46.015 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:45 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:46.015 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:45 smithi149 ceph-mon[36123]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:46.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:45 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:46.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:45 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:46.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:45 smithi118 ceph-mon[28757]: pgmap v8: 65 pgs: 65 active+clean; 138 MiB data, 637 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 141 op/s 2024-09-21T11:38:46.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:45 smithi118 ceph-mon[28757]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:46.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:45 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:46.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:45 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:46.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:45 smithi118 ceph-mon[28757]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.333+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f258019b320 con 0x7f2580102b70 2024-09-21T11:38:46.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.334+0000 7f257dffb640 1 -- 172.21.15.118:0/3920836809 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f256c066d20 con 0x7f2580102b70 2024-09-21T11:38:46.337 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:38:46.337 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:38:46.337 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:38:46.337 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:38:46.338 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:38:46.338 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:38:46.338 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T11:38:46.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:38:46.338 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:38:46.338 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:38:46.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:38:46.339 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:38:46.339 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:38:46.339 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:38:46.339 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:38:46.339 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T11:38:46.339 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T11:38:46.339 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:38:46.339 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:38:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2570074ad0 msgr2=0x7f2570076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2570074ad0 0x7f2570076f90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2574000c00 tx=0x7f2574005a20 comp rx=0 tx=0).stop 2024-09-21T11:38:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2580102b70 msgr2=0x7f25801957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2580102b70 0x7f25801957e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f256c00e970 tx=0x7f256c00ee30 comp rx=0 tx=0).stop 2024-09-21T11:38:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 shutdown_connections 2024-09-21T11:38:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2570074ad0 0x7f2570076f90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2580102b70 0x7f25801957e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 --2- 172.21.15.118:0/3920836809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2580101970 0x7f25801952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 >> 172.21.15.118:0/3920836809 conn(0x7f25800fd140 msgr2=0x7f2580074660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 shutdown_connections 2024-09-21T11:38:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.337+0000 7f258711a640 1 -- 172.21.15.118:0/3920836809 wait complete. 2024-09-21T11:38:46.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.439+0000 7f35f8ba0640 1 -- 172.21.15.118:0/3898440552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35f4101a40 msgr2=0x7f35f4101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:46.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.439+0000 7f35f8ba0640 1 --2- 172.21.15.118:0/3898440552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35f4101a40 0x7f35f4101ec0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009880 tx=0x7f35e802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.439+0000 7f35f8ba0640 1 -- 172.21.15.118:0/3898440552 shutdown_connections 2024-09-21T11:38:46.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.439+0000 7f35f8ba0640 1 --2- 172.21.15.118:0/3898440552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35f4101a40 0x7f35f4101ec0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.439+0000 7f35f8ba0640 1 --2- 172.21.15.118:0/3898440552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4100840 0x7f35f4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.439+0000 7f35f8ba0640 1 -- 172.21.15.118:0/3898440552 >> 172.21.15.118:0/3898440552 conn(0x7f35f40fbff0 msgr2=0x7f35f40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:46.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.439+0000 7f35f8ba0640 1 -- 172.21.15.118:0/3898440552 shutdown_connections 2024-09-21T11:38:46.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.439+0000 7f35f8ba0640 1 -- 172.21.15.118:0/3898440552 wait complete. 2024-09-21T11:38:46.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.440+0000 7f35f8ba0640 1 Processor -- start 2024-09-21T11:38:46.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.440+0000 7f35f8ba0640 1 -- start start 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.440+0000 7f35f8ba0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35f4100840 0x7f35f41974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.440+0000 7f35f8ba0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4101a40 0x7f35f41979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.440+0000 7f35f8ba0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4109660 con 0x7f35f4100840 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.440+0000 7f35f8ba0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41094e0 con 0x7f35f4101a40 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.441+0000 7f35f259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35f4100840 0x7f35f41974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.441+0000 7f35f1d9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4101a40 0x7f35f41979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.441+0000 7f35f259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35f4100840 0x7f35f41974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34760/0 (socket says 172.21.15.118:34760) 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.441+0000 7f35f1d9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4101a40 0x7f35f41979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:37078/0 (socket says 172.21.15.118:37078) 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.441+0000 7f35f259c640 1 -- 172.21.15.118:0/2090667843 learned_addr learned my addr 172.21.15.118:0/2090667843 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.441+0000 7f35f1d9b640 1 -- 172.21.15.118:0/2090667843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35f4100840 msgr2=0x7f35f41974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.441+0000 7f35f1d9b640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35f4100840 0x7f35f41974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.441+0000 7f35f1d9b640 1 -- 172.21.15.118:0/2090667843 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f4198070 con 0x7f35f4101a40 2024-09-21T11:38:46.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.441+0000 7f35f1d9b640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4101a40 0x7f35f41979f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009850 tx=0x7f35e8032c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:46.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.442+0000 7f35e37fe640 1 -- 172.21.15.118:0/2090667843 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35e803f030 con 0x7f35f4101a40 2024-09-21T11:38:46.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.442+0000 7f35e37fe640 1 -- 172.21.15.118:0/2090667843 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35e8005320 con 0x7f35f4101a40 2024-09-21T11:38:46.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.442+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f419ca50 con 0x7f35f4101a40 2024-09-21T11:38:46.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.442+0000 7f35e37fe640 1 -- 172.21.15.118:0/2090667843 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35e8035070 con 0x7f35f4101a40 2024-09-21T11:38:46.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.442+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f419cfe0 con 0x7f35f4101a40 2024-09-21T11:38:46.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.443+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f4100c40 con 0x7f35f4101a40 2024-09-21T11:38:46.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.444+0000 7f35e37fe640 1 -- 172.21.15.118:0/2090667843 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f35e8042030 con 0x7f35f4101a40 2024-09-21T11:38:46.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.444+0000 7f35e37fe640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f35dc074a80 0x7f35dc076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:38:46.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.445+0000 7f35e37fe640 1 -- 172.21.15.118:0/2090667843 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f35e8040070 con 0x7f35f4101a40 2024-09-21T11:38:46.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.445+0000 7f35f259c640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f35dc074a80 0x7f35dc076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:38:46.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.445+0000 7f35f259c640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f35dc074a80 0x7f35dc076f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f35e4005fd0 tx=0x7f35e400b4a0 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:38:46.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.449+0000 7f35e37fe640 1 -- 172.21.15.118:0/2090667843 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f35e80820e0 con 0x7f35f4101a40 2024-09-21T11:38:46.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.715+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f35f406a2f0 con 0x7f35dc074a80 2024-09-21T11:38:46.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.716+0000 7f35e37fe640 1 -- 172.21.15.118:0/2090667843 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f35f406a2f0 con 0x7f35dc074a80 2024-09-21T11:38:46.718 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:38:46.718 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:38:46.718 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:38:46.718 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:38:46.719 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [], 2024-09-21T11:38:46.719 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T11:38:46.719 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "", 2024-09-21T11:38:46.719 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:38:46.719 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.718+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f35dc074a80 msgr2=0x7f35dc076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.718+0000 7f35f8ba0640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f35dc074a80 0x7f35dc076f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f35e4005fd0 tx=0x7f35e400b4a0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.718+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4101a40 msgr2=0x7f35f41979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.718+0000 7f35f8ba0640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4101a40 0x7f35f41979f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009850 tx=0x7f35e8032c80 comp rx=0 tx=0).stop 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.718+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 shutdown_connections 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.718+0000 7f35f8ba0640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f35dc074a80 0x7f35dc076f40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.718+0000 7f35f8ba0640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4101a40 0x7f35f41979f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.718+0000 7f35f8ba0640 1 --2- 172.21.15.118:0/2090667843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35f4100840 0x7f35f41974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.718+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 >> 172.21.15.118:0/2090667843 conn(0x7f35f40fbff0 msgr2=0x7f35f4069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.719+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 shutdown_connections 2024-09-21T11:38:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:38:46.719+0000 7f35f8ba0640 1 -- 172.21.15.118:0/2090667843 wait complete. 2024-09-21T11:38:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:46 smithi118 ceph-mon[28757]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:46 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3920836809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:38:47.098 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:46 smithi149 ceph-mon[36123]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:47.098 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:46 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3920836809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:38:48.098 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:47 smithi149 ceph-mon[36123]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:48.098 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:47 smithi149 ceph-mon[36123]: pgmap v9: 65 pgs: 65 active+clean; 160 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 247 op/s 2024-09-21T11:38:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:47 smithi118 ceph-mon[28757]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:38:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:47 smithi118 ceph-mon[28757]: pgmap v9: 65 pgs: 65 active+clean; 160 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 247 op/s 2024-09-21T11:38:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:49 smithi149 ceph-mon[36123]: pgmap v10: 65 pgs: 65 active+clean; 160 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 3.6 MiB/s wr, 226 op/s 2024-09-21T11:38:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:49 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:49 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:49 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:38:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:49 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-09-21T11:38:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:49 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:49 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:49 smithi118 ceph-mon[28757]: pgmap v10: 65 pgs: 65 active+clean; 160 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 3.6 MiB/s wr, 226 op/s 2024-09-21T11:38:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:49 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:49 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:49 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:38:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:49 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-09-21T11:38:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:49 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:50.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:49 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: Adjusting osd_memory_target on smithi118 to 1216M 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi118", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:38:51.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:51 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:38:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:38:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:38:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:38:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: Adjusting osd_memory_target on smithi118 to 1216M 2024-09-21T11:38:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:38:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi118", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:38:51.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:51 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:38:52.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:52 smithi118 ceph-mon[28757]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:38:52.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:52 smithi118 ceph-mon[28757]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:38:52.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:52 smithi118 ceph-mon[28757]: pgmap v11: 65 pgs: 65 active+clean; 173 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 369 op/s 2024-09-21T11:38:52.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:52 smithi118 ceph-mon[28757]: Reconfiguring ceph-exporter.smithi118 (dependencies changed)... 2024-09-21T11:38:52.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:52 smithi118 ceph-mon[28757]: Deploying daemon ceph-exporter.smithi118 on smithi118 2024-09-21T11:38:52.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:52 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:38:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:52 smithi149 ceph-mon[36123]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:38:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:52 smithi149 ceph-mon[36123]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:38:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:52 smithi149 ceph-mon[36123]: pgmap v11: 65 pgs: 65 active+clean; 173 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 369 op/s 2024-09-21T11:38:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:52 smithi149 ceph-mon[36123]: Reconfiguring ceph-exporter.smithi118 (dependencies changed)... 2024-09-21T11:38:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:52 smithi149 ceph-mon[36123]: Deploying daemon ceph-exporter.smithi118 on smithi118 2024-09-21T11:38:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:52 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:38:54.540 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:54 smithi118 ceph-mon[28757]: pgmap v12: 65 pgs: 65 active+clean; 173 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 263 op/s 2024-09-21T11:38:54.681 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:54 smithi149 ceph-mon[36123]: pgmap v12: 65 pgs: 65 active+clean; 173 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 263 op/s 2024-09-21T11:38:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:56 smithi118 ceph-mon[28757]: pgmap v13: 65 pgs: 65 active+clean; 173 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 263 op/s 2024-09-21T11:38:56.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:56 smithi149 ceph-mon[36123]: pgmap v13: 65 pgs: 65 active+clean; 173 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 263 op/s 2024-09-21T11:38:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:38:58 smithi118 ceph-mon[28757]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.8 MiB/s wr, 442 op/s 2024-09-21T11:38:58.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:38:58 smithi149 ceph-mon[36123]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.8 MiB/s wr, 442 op/s 2024-09-21T11:38:59.371 INFO:tasks.workunit.client.1.smithi149.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T11:38:59.377 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T11:38:59.377 INFO:tasks.workunit.client.1.smithi149.stderr:+ make 2024-09-21T11:38:59.547 INFO:tasks.workunit.client.1.smithi149.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T11:38:59.938 INFO:tasks.workunit.client.1.smithi149.stderr:++ readlink -f fsstress 2024-09-21T11:38:59.939 INFO:tasks.workunit.client.1.smithi149.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T11:38:59.939 INFO:tasks.workunit.client.1.smithi149.stderr:+ popd 2024-09-21T11:38:59.940 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T11:38:59.940 INFO:tasks.workunit.client.1.smithi149.stderr:+ popd 2024-09-21T11:38:59.941 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-21T11:38:59.941 INFO:tasks.workunit.client.1.smithi149.stderr:++ mktemp -d -p . 2024-09-21T11:38:59.943 INFO:tasks.workunit.client.1.smithi149.stderr:+ T=./tmp.rGM16ijZwg 2024-09-21T11:38:59.943 INFO:tasks.workunit.client.1.smithi149.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.rGM16ijZwg -l 1 -n 1000 -p 10 -v 2024-09-21T11:38:59.946 INFO:tasks.workunit.client.1.smithi149.stdout:seed = 1726013276 2024-09-21T11:38:59.954 INFO:tasks.workunit.client.1.smithi149.stdout:0/0: creat f0 x:0 0 0 2024-09-21T11:38:59.954 INFO:tasks.workunit.client.1.smithi149.stdout:0/1: dread - f0 zero size 2024-09-21T11:38:59.956 INFO:tasks.workunit.client.1.smithi149.stdout:2/0: chown . 35258 1 2024-09-21T11:38:59.956 INFO:tasks.workunit.client.1.smithi149.stdout:2/1: chown . 1178202844 1 2024-09-21T11:38:59.956 INFO:tasks.workunit.client.1.smithi149.stdout:2/2: dwrite - no filename 2024-09-21T11:38:59.956 INFO:tasks.workunit.client.1.smithi149.stdout:2/3: unlink - no file 2024-09-21T11:38:59.957 INFO:tasks.workunit.client.1.smithi149.stdout:0/2: mkdir d1 0 2024-09-21T11:38:59.957 INFO:tasks.workunit.client.1.smithi149.stdout:1/0: getdents . 0 2024-09-21T11:38:59.957 INFO:tasks.workunit.client.1.smithi149.stdout:0/3: write f0 [788540,127243] 0 2024-09-21T11:38:59.961 INFO:tasks.workunit.client.1.smithi149.stdout:2/4: getdents . 0 2024-09-21T11:38:59.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/5: fsync - no filename 2024-09-21T11:38:59.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/6: dread - no filename 2024-09-21T11:38:59.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/7: dread - no filename 2024-09-21T11:38:59.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/8: stat - no entries 2024-09-21T11:38:59.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/9: rename - no filename 2024-09-21T11:38:59.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/10: dread - no filename 2024-09-21T11:38:59.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/11: link - no file 2024-09-21T11:38:59.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/12: readlink - no filename 2024-09-21T11:38:59.963 INFO:tasks.workunit.client.1.smithi149.stdout:4/0: dread - no filename 2024-09-21T11:38:59.963 INFO:tasks.workunit.client.1.smithi149.stdout:4/1: write - no filename 2024-09-21T11:38:59.964 INFO:tasks.workunit.client.1.smithi149.stdout:1/1: creat f0 x:0 0 0 2024-09-21T11:38:59.965 INFO:tasks.workunit.client.1.smithi149.stdout:0/4: dwrite f0 [0,4194304] 0 2024-09-21T11:38:59.965 INFO:tasks.workunit.client.1.smithi149.stdout:0/5: chown f0 357667 1 2024-09-21T11:38:59.967 INFO:tasks.workunit.client.1.smithi149.stdout:5/0: truncate - no filename 2024-09-21T11:38:59.967 INFO:tasks.workunit.client.1.smithi149.stdout:5/1: write - no filename 2024-09-21T11:38:59.967 INFO:tasks.workunit.client.1.smithi149.stdout:5/2: dread - no filename 2024-09-21T11:38:59.970 INFO:tasks.workunit.client.1.smithi149.stdout:3/0: mknod c0 0 2024-09-21T11:38:59.971 INFO:tasks.workunit.client.1.smithi149.stdout:3/1: write - no filename 2024-09-21T11:38:59.971 INFO:tasks.workunit.client.1.smithi149.stdout:3/2: write - no filename 2024-09-21T11:38:59.971 INFO:tasks.workunit.client.1.smithi149.stdout:1/2: mknod c1 0 2024-09-21T11:38:59.971 INFO:tasks.workunit.client.1.smithi149.stdout:1/3: readlink - no filename 2024-09-21T11:38:59.973 INFO:tasks.workunit.client.1.smithi149.stdout:2/13: mknod c0 0 2024-09-21T11:38:59.974 INFO:tasks.workunit.client.1.smithi149.stdout:4/2: mknod c0 0 2024-09-21T11:38:59.976 INFO:tasks.workunit.client.1.smithi149.stdout:6/0: read - no filename 2024-09-21T11:38:59.978 INFO:tasks.workunit.client.1.smithi149.stdout:3/3: creat f1 x:0 0 0 2024-09-21T11:38:59.979 INFO:tasks.workunit.client.1.smithi149.stdout:1/4: dwrite f0 [0,4194304] 0 2024-09-21T11:38:59.980 INFO:tasks.workunit.client.1.smithi149.stdout:2/14: creat f1 x:0 0 0 2024-09-21T11:38:59.981 INFO:tasks.workunit.client.1.smithi149.stdout:2/15: chown f1 80 1 2024-09-21T11:38:59.982 INFO:tasks.workunit.client.1.smithi149.stdout:4/3: rename c0 to c1 0 2024-09-21T11:38:59.983 INFO:tasks.workunit.client.1.smithi149.stdout:5/3: mknod c0 0 2024-09-21T11:38:59.983 INFO:tasks.workunit.client.1.smithi149.stdout:5/4: readlink - no filename 2024-09-21T11:38:59.986 INFO:tasks.workunit.client.1.smithi149.stdout:7/0: dwrite - no filename 2024-09-21T11:38:59.986 INFO:tasks.workunit.client.1.smithi149.stdout:7/1: dwrite - no filename 2024-09-21T11:38:59.986 INFO:tasks.workunit.client.1.smithi149.stdout:7/2: rmdir - no directory 2024-09-21T11:38:59.986 INFO:tasks.workunit.client.1.smithi149.stdout:7/3: dwrite - no filename 2024-09-21T11:38:59.986 INFO:tasks.workunit.client.1.smithi149.stdout:7/4: write - no filename 2024-09-21T11:38:59.991 INFO:tasks.workunit.client.1.smithi149.stdout:3/4: rename f1 to f2 0 2024-09-21T11:38:59.992 INFO:tasks.workunit.client.1.smithi149.stdout:0/6: rmdir d1 0 2024-09-21T11:38:59.994 INFO:tasks.workunit.client.1.smithi149.stdout:1/5: unlink c1 0 2024-09-21T11:38:59.995 INFO:tasks.workunit.client.1.smithi149.stdout:2/16: rename c0 to c2 0 2024-09-21T11:38:59.995 INFO:tasks.workunit.client.1.smithi149.stdout:2/17: dread - f1 zero size 2024-09-21T11:38:59.997 INFO:tasks.workunit.client.1.smithi149.stdout:6/1: mkdir d0 0 2024-09-21T11:38:59.998 INFO:tasks.workunit.client.1.smithi149.stdout:6/2: truncate - no filename 2024-09-21T11:38:59.998 INFO:tasks.workunit.client.1.smithi149.stdout:6/3: dread - no filename 2024-09-21T11:38:59.998 INFO:tasks.workunit.client.1.smithi149.stdout:6/4: rename d0 to d0/d1 22 2024-09-21T11:38:59.998 INFO:tasks.workunit.client.1.smithi149.stdout:6/5: write - no filename 2024-09-21T11:39:00.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/0: chown . 75042581 1 2024-09-21T11:39:00.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/1: chown . 33349987 1 2024-09-21T11:39:00.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/2: dwrite - no filename 2024-09-21T11:39:00.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/3: chown . 14064 1 2024-09-21T11:39:00.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/4: write - no filename 2024-09-21T11:39:00.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/5: dwrite - no filename 2024-09-21T11:39:00.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/6: chown . 897106 1 2024-09-21T11:39:00.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/7: link - no file 2024-09-21T11:39:00.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/8: chown . 3 1 2024-09-21T11:39:00.003 INFO:tasks.workunit.client.1.smithi149.stdout:3/5: creat f3 x:0 0 0 2024-09-21T11:39:00.005 INFO:tasks.workunit.client.1.smithi149.stdout:0/7: rename f0 to f2 0 2024-09-21T11:39:00.006 INFO:tasks.workunit.client.1.smithi149.stdout:2/18: creat f3 x:0 0 0 2024-09-21T11:39:00.010 INFO:tasks.workunit.client.1.smithi149.stdout:0/8: dread f2 [0,4194304] 0 2024-09-21T11:39:00.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/0: write - no filename 2024-09-21T11:39:00.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/1: dread - no filename 2024-09-21T11:39:00.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/2: write - no filename 2024-09-21T11:39:00.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/3: unlink - no file 2024-09-21T11:39:00.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/4: rename - no filename 2024-09-21T11:39:00.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/5: truncate - no filename 2024-09-21T11:39:00.014 INFO:tasks.workunit.client.1.smithi149.stdout:2/19: dwrite f1 [0,4194304] 0 2024-09-21T11:39:00.015 INFO:tasks.workunit.client.1.smithi149.stdout:7/5: creat f0 x:0 0 0 2024-09-21T11:39:00.016 INFO:tasks.workunit.client.1.smithi149.stdout:3/6: fdatasync f2 0 2024-09-21T11:39:00.016 INFO:tasks.workunit.client.1.smithi149.stdout:7/6: stat f0 0 2024-09-21T11:39:00.016 INFO:tasks.workunit.client.1.smithi149.stdout:3/7: chown f3 3935 1 2024-09-21T11:39:00.016 INFO:tasks.workunit.client.1.smithi149.stdout:3/8: chown c0 80081 1 2024-09-21T11:39:00.019 INFO:tasks.workunit.client.1.smithi149.stdout:5/5: link c0 c1 0 2024-09-21T11:39:00.023 INFO:tasks.workunit.client.1.smithi149.stdout:0/9: creat f3 x:0 0 0 2024-09-21T11:39:00.027 INFO:tasks.workunit.client.1.smithi149.stdout:8/9: creat f0 x:0 0 0 2024-09-21T11:39:00.029 INFO:tasks.workunit.client.1.smithi149.stdout:7/7: unlink f0 0 2024-09-21T11:39:00.030 INFO:tasks.workunit.client.1.smithi149.stdout:7/8: chown . 1799493 1 2024-09-21T11:39:00.030 INFO:tasks.workunit.client.1.smithi149.stdout:7/9: link - no file 2024-09-21T11:39:00.030 INFO:tasks.workunit.client.1.smithi149.stdout:2/20: fdatasync f1 0 2024-09-21T11:39:00.033 INFO:tasks.workunit.client.1.smithi149.stdout:5/6: creat f2 x:0 0 0 2024-09-21T11:39:00.033 INFO:tasks.workunit.client.1.smithi149.stdout:5/7: fdatasync f2 0 2024-09-21T11:39:00.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/6: rmdir d0 0 2024-09-21T11:39:00.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/7: dread - no filename 2024-09-21T11:39:00.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/8: dread - no filename 2024-09-21T11:39:00.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/9: truncate - no filename 2024-09-21T11:39:00.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/10: rename - no filename 2024-09-21T11:39:00.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/11: readlink - no filename 2024-09-21T11:39:00.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/12: unlink - no file 2024-09-21T11:39:00.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/13: write - no filename 2024-09-21T11:39:00.036 INFO:tasks.workunit.client.1.smithi149.stdout:9/6: creat f0 x:0 0 0 2024-09-21T11:39:00.037 INFO:tasks.workunit.client.1.smithi149.stdout:8/10: mknod c1 0 2024-09-21T11:39:00.042 INFO:tasks.workunit.client.1.smithi149.stdout:2/21: rename f1 to f4 0 2024-09-21T11:39:00.043 INFO:tasks.workunit.client.1.smithi149.stdout:5/8: creat f3 x:0 0 0 2024-09-21T11:39:00.044 INFO:tasks.workunit.client.1.smithi149.stdout:5/9: dread - f2 zero size 2024-09-21T11:39:00.044 INFO:tasks.workunit.client.1.smithi149.stdout:5/10: truncate f3 890147 0 2024-09-21T11:39:00.044 INFO:tasks.workunit.client.1.smithi149.stdout:6/14: creat f2 x:0 0 0 2024-09-21T11:39:00.047 INFO:tasks.workunit.client.1.smithi149.stdout:9/7: mknod c1 0 2024-09-21T11:39:00.048 INFO:tasks.workunit.client.1.smithi149.stdout:8/11: symlink l2 0 2024-09-21T11:39:00.049 INFO:tasks.workunit.client.1.smithi149.stdout:3/9: link c0 c4 0 2024-09-21T11:39:00.050 INFO:tasks.workunit.client.1.smithi149.stdout:2/22: mknod c5 0 2024-09-21T11:39:00.052 INFO:tasks.workunit.client.1.smithi149.stdout:8/12: mkdir d3 0 2024-09-21T11:39:00.054 INFO:tasks.workunit.client.1.smithi149.stdout:8/13: chown c1 230929243 1 2024-09-21T11:39:00.056 INFO:tasks.workunit.client.1.smithi149.stdout:6/15: dwrite f2 [0,4194304] 0 2024-09-21T11:39:00.057 INFO:tasks.workunit.client.1.smithi149.stdout:3/10: mknod c5 0 2024-09-21T11:39:00.059 INFO:tasks.workunit.client.1.smithi149.stdout:3/11: dread - f2 zero size 2024-09-21T11:39:00.060 INFO:tasks.workunit.client.1.smithi149.stdout:6/16: symlink l3 0 2024-09-21T11:39:00.061 INFO:tasks.workunit.client.1.smithi149.stdout:8/14: mkdir d3/d4 0 2024-09-21T11:39:00.061 INFO:tasks.workunit.client.1.smithi149.stdout:9/8: dwrite f0 [0,4194304] 0 2024-09-21T11:39:00.062 INFO:tasks.workunit.client.1.smithi149.stdout:3/12: mkdir d6 0 2024-09-21T11:39:00.063 INFO:tasks.workunit.client.1.smithi149.stdout:9/9: read f0 [3396059,6258] 0 2024-09-21T11:39:00.063 INFO:tasks.workunit.client.1.smithi149.stdout:3/13: truncate f3 932450 0 2024-09-21T11:39:00.063 INFO:tasks.workunit.client.1.smithi149.stdout:6/17: creat f4 x:0 0 0 2024-09-21T11:39:00.064 INFO:tasks.workunit.client.1.smithi149.stdout:6/18: dread - f4 zero size 2024-09-21T11:39:00.068 INFO:tasks.workunit.client.1.smithi149.stdout:8/15: rename c1 to d3/d4/c5 0 2024-09-21T11:39:00.068 INFO:tasks.workunit.client.1.smithi149.stdout:8/16: readlink l2 0 2024-09-21T11:39:00.072 INFO:tasks.workunit.client.1.smithi149.stdout:6/19: symlink l5 0 2024-09-21T11:39:00.073 INFO:tasks.workunit.client.1.smithi149.stdout:6/20: write f2 [648816,113749] 0 2024-09-21T11:39:00.076 INFO:tasks.workunit.client.1.smithi149.stdout:3/14: mkdir d6/d7 0 2024-09-21T11:39:00.081 INFO:tasks.workunit.client.1.smithi149.stdout:6/21: dwrite f4 [0,4194304] 0 2024-09-21T11:39:00.098 INFO:tasks.workunit.client.1.smithi149.stdout:3/15: rmdir d6/d7 0 2024-09-21T11:39:00.101 INFO:tasks.workunit.client.1.smithi149.stdout:3/16: creat d6/f8 x:0 0 0 2024-09-21T11:39:00.101 INFO:tasks.workunit.client.1.smithi149.stdout:3/17: chown d6/f8 195 1 2024-09-21T11:39:00.105 INFO:tasks.workunit.client.1.smithi149.stdout:3/18: creat d6/f9 x:0 0 0 2024-09-21T11:39:00.108 INFO:tasks.workunit.client.1.smithi149.stdout:3/19: creat d6/fa x:0 0 0 2024-09-21T11:39:00.114 INFO:tasks.workunit.client.1.smithi149.stdout:3/20: chown c0 860 1 2024-09-21T11:39:00.114 INFO:tasks.workunit.client.1.smithi149.stdout:3/21: chown d6 0 1 2024-09-21T11:39:00.117 INFO:tasks.workunit.client.1.smithi149.stdout:3/22: symlink d6/lb 0 2024-09-21T11:39:00.123 INFO:tasks.workunit.client.1.smithi149.stdout:3/23: dwrite d6/f9 [0,4194304] 0 2024-09-21T11:39:00.123 INFO:tasks.workunit.client.1.smithi149.stdout:3/24: readlink d6/lb 0 2024-09-21T11:39:00.129 INFO:tasks.workunit.client.1.smithi149.stdout:3/25: link f2 d6/fc 0 2024-09-21T11:39:00.132 INFO:tasks.workunit.client.1.smithi149.stdout:3/26: mknod d6/cd 0 2024-09-21T11:39:00.139 INFO:tasks.workunit.client.1.smithi149.stdout:3/27: dwrite d6/fa [0,4194304] 0 2024-09-21T11:39:00.144 INFO:tasks.workunit.client.1.smithi149.stdout:3/28: creat d6/fe x:0 0 0 2024-09-21T11:39:00.147 INFO:tasks.workunit.client.1.smithi149.stdout:3/29: creat d6/ff x:0 0 0 2024-09-21T11:39:00.363 INFO:tasks.workunit.client.1.smithi149.stdout:4/4: getdents . 0 2024-09-21T11:39:00.365 INFO:tasks.workunit.client.1.smithi149.stdout:4/5: chown c1 23641 1 2024-09-21T11:39:00.365 INFO:tasks.workunit.client.1.smithi149.stdout:4/6: write - no filename 2024-09-21T11:39:00.365 INFO:tasks.workunit.client.1.smithi149.stdout:4/7: chown c1 2 1 2024-09-21T11:39:00.368 INFO:tasks.workunit.client.1.smithi149.stdout:4/8: creat f2 x:0 0 0 2024-09-21T11:39:00.368 INFO:tasks.workunit.client.1.smithi149.stdout:4/9: rmdir - no directory 2024-09-21T11:39:00.368 INFO:tasks.workunit.client.1.smithi149.stdout:4/10: write f2 [424843,30865] 0 2024-09-21T11:39:00.371 INFO:tasks.workunit.client.1.smithi149.stdout:4/11: dread f2 [0,4194304] 0 2024-09-21T11:39:00.372 INFO:tasks.workunit.client.1.smithi149.stdout:4/12: chown f2 2324285 1 2024-09-21T11:39:00.374 INFO:tasks.workunit.client.1.smithi149.stdout:4/13: symlink l3 0 2024-09-21T11:39:00.376 INFO:tasks.workunit.client.1.smithi149.stdout:4/14: mkdir d4 0 2024-09-21T11:39:00.379 INFO:tasks.workunit.client.1.smithi149.stdout:4/15: symlink d4/l5 0 2024-09-21T11:39:00.381 INFO:tasks.workunit.client.1.smithi149.stdout:4/16: write f2 [737826,82329] 0 2024-09-21T11:39:00.388 INFO:tasks.workunit.client.1.smithi149.stdout:4/17: dwrite f2 [0,4194304] 0 2024-09-21T11:39:00.388 INFO:tasks.workunit.client.1.smithi149.stdout:0/10: getdents . 0 2024-09-21T11:39:00.390 INFO:tasks.workunit.client.1.smithi149.stdout:8/17: fsync f0 0 2024-09-21T11:39:00.392 INFO:tasks.workunit.client.1.smithi149.stdout:0/11: creat f4 x:0 0 0 2024-09-21T11:39:00.392 INFO:tasks.workunit.client.1.smithi149.stdout:0/12: rmdir - no directory 2024-09-21T11:39:00.393 INFO:tasks.workunit.client.1.smithi149.stdout:7/10: getdents . 0 2024-09-21T11:39:00.393 INFO:tasks.workunit.client.1.smithi149.stdout:7/11: dwrite - no filename 2024-09-21T11:39:00.393 INFO:tasks.workunit.client.1.smithi149.stdout:7/12: truncate - no filename 2024-09-21T11:39:00.393 INFO:tasks.workunit.client.1.smithi149.stdout:7/13: dwrite - no filename 2024-09-21T11:39:00.396 INFO:tasks.workunit.client.1.smithi149.stdout:4/18: dread f2 [0,4194304] 0 2024-09-21T11:39:00.396 INFO:tasks.workunit.client.1.smithi149.stdout:8/18: mknod d3/c6 0 2024-09-21T11:39:00.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/14: getdents . 0 2024-09-21T11:39:00.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/15: truncate - no filename 2024-09-21T11:39:00.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/16: rmdir - no directory 2024-09-21T11:39:00.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/17: dwrite - no filename 2024-09-21T11:39:00.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/18: rename - no filename 2024-09-21T11:39:00.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/19: dread - no filename 2024-09-21T11:39:00.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/20: dread - no filename 2024-09-21T11:39:00.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/21: unlink - no file 2024-09-21T11:39:00.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/22: rmdir - no directory 2024-09-21T11:39:00.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/23: write - no filename 2024-09-21T11:39:00.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/24: chown . 4866 1 2024-09-21T11:39:00.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/25: dwrite - no filename 2024-09-21T11:39:00.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/26: dwrite - no filename 2024-09-21T11:39:00.400 INFO:tasks.workunit.client.1.smithi149.stdout:4/19: mkdir d4/d6 0 2024-09-21T11:39:00.401 INFO:tasks.workunit.client.1.smithi149.stdout:7/27: creat f1 x:0 0 0 2024-09-21T11:39:00.402 INFO:tasks.workunit.client.1.smithi149.stdout:4/20: creat d4/f7 x:0 0 0 2024-09-21T11:39:00.404 INFO:tasks.workunit.client.1.smithi149.stdout:8/19: dwrite f0 [0,4194304] 0 2024-09-21T11:39:00.407 INFO:tasks.workunit.client.1.smithi149.stdout:2/23: unlink f4 0 2024-09-21T11:39:00.408 INFO:tasks.workunit.client.1.smithi149.stdout:7/28: symlink l2 0 2024-09-21T11:39:00.410 INFO:tasks.workunit.client.1.smithi149.stdout:7/29: readlink l2 0 2024-09-21T11:39:00.411 INFO:tasks.workunit.client.1.smithi149.stdout:4/21: mknod d4/c8 0 2024-09-21T11:39:00.411 INFO:tasks.workunit.client.1.smithi149.stdout:7/30: dread - f1 zero size 2024-09-21T11:39:00.412 INFO:tasks.workunit.client.1.smithi149.stdout:2/24: symlink l6 0 2024-09-21T11:39:00.414 INFO:tasks.workunit.client.1.smithi149.stdout:7/31: dread - f1 zero size 2024-09-21T11:39:00.415 INFO:tasks.workunit.client.1.smithi149.stdout:4/22: unlink f2 0 2024-09-21T11:39:00.415 INFO:tasks.workunit.client.1.smithi149.stdout:7/32: dread - f1 zero size 2024-09-21T11:39:00.416 INFO:tasks.workunit.client.1.smithi149.stdout:4/23: write d4/f7 [693039,110886] 0 2024-09-21T11:39:00.417 INFO:tasks.workunit.client.1.smithi149.stdout:7/33: write f1 [1029030,94120] 0 2024-09-21T11:39:00.417 INFO:tasks.workunit.client.1.smithi149.stdout:8/20: dwrite f0 [0,4194304] 0 2024-09-21T11:39:00.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/24: write d4/f7 [1015401,12027] 0 2024-09-21T11:39:00.419 INFO:tasks.workunit.client.1.smithi149.stdout:7/34: write f1 [600480,121777] 0 2024-09-21T11:39:00.421 INFO:tasks.workunit.client.1.smithi149.stdout:4/25: stat d4/l5 0 2024-09-21T11:39:00.423 INFO:tasks.workunit.client.1.smithi149.stdout:2/25: creat f7 x:0 0 0 2024-09-21T11:39:00.423 INFO:tasks.workunit.client.1.smithi149.stdout:2/26: rmdir - no directory 2024-09-21T11:39:00.425 INFO:tasks.workunit.client.1.smithi149.stdout:6/22: fsync f4 0 2024-09-21T11:39:00.425 INFO:tasks.workunit.client.1.smithi149.stdout:7/35: write f1 [859430,49588] 0 2024-09-21T11:39:00.426 INFO:tasks.workunit.client.1.smithi149.stdout:9/10: truncate f0 2334095 0 2024-09-21T11:39:00.426 INFO:tasks.workunit.client.1.smithi149.stdout:2/27: write f7 [518006,54483] 0 2024-09-21T11:39:00.428 INFO:tasks.workunit.client.1.smithi149.stdout:7/36: readlink l2 0 2024-09-21T11:39:00.430 INFO:tasks.workunit.client.1.smithi149.stdout:6/23: write f2 [4271128,115245] 0 2024-09-21T11:39:00.431 INFO:tasks.workunit.client.1.smithi149.stdout:2/28: read f7 [133832,39764] 0 2024-09-21T11:39:00.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/24: readlink l3 0 2024-09-21T11:39:00.434 INFO:tasks.workunit.client.1.smithi149.stdout:6/25: write f4 [1786485,123446] 0 2024-09-21T11:39:00.436 INFO:tasks.workunit.client.1.smithi149.stdout:8/21: dwrite f0 [0,4194304] 0 2024-09-21T11:39:00.437 INFO:tasks.workunit.client.1.smithi149.stdout:2/29: mkdir d8 0 2024-09-21T11:39:00.437 INFO:tasks.workunit.client.1.smithi149.stdout:7/37: dread f1 [0,4194304] 0 2024-09-21T11:39:00.438 INFO:tasks.workunit.client.1.smithi149.stdout:2/30: dread - f3 zero size 2024-09-21T11:39:00.440 INFO:tasks.workunit.client.1.smithi149.stdout:7/38: truncate f1 1520966 0 2024-09-21T11:39:00.440 INFO:tasks.workunit.client.1.smithi149.stdout:2/31: rename d8 to d8/d9 22 2024-09-21T11:39:00.440 INFO:tasks.workunit.client.1.smithi149.stdout:8/22: write f0 [3917114,95695] 0 2024-09-21T11:39:00.440 INFO:tasks.workunit.client.1.smithi149.stdout:6/26: mknod c6 0 2024-09-21T11:39:00.440 INFO:tasks.workunit.client.1.smithi149.stdout:7/39: stat f1 0 2024-09-21T11:39:00.441 INFO:tasks.workunit.client.1.smithi149.stdout:4/26: dwrite d4/f7 [0,4194304] 0 2024-09-21T11:39:00.444 INFO:tasks.workunit.client.1.smithi149.stdout:8/23: chown l2 14140 1 2024-09-21T11:39:00.444 INFO:tasks.workunit.client.1.smithi149.stdout:2/32: chown f3 7458 1 2024-09-21T11:39:00.446 INFO:tasks.workunit.client.1.smithi149.stdout:7/40: symlink l3 0 2024-09-21T11:39:00.447 INFO:tasks.workunit.client.1.smithi149.stdout:6/27: symlink l7 0 2024-09-21T11:39:00.452 INFO:tasks.workunit.client.1.smithi149.stdout:4/27: dread d4/f7 [0,4194304] 0 2024-09-21T11:39:00.452 INFO:tasks.workunit.client.1.smithi149.stdout:7/41: fdatasync f1 0 2024-09-21T11:39:00.454 INFO:tasks.workunit.client.1.smithi149.stdout:8/24: dwrite f0 [0,4194304] 0 2024-09-21T11:39:00.457 INFO:tasks.workunit.client.1.smithi149.stdout:2/33: mkdir d8/da 0 2024-09-21T11:39:00.459 INFO:tasks.workunit.client.1.smithi149.stdout:4/28: unlink d4/l5 0 2024-09-21T11:39:00.459 INFO:tasks.workunit.client.1.smithi149.stdout:2/34: dread - f3 zero size 2024-09-21T11:39:00.460 INFO:tasks.workunit.client.1.smithi149.stdout:2/35: dread - f3 zero size 2024-09-21T11:39:00.460 INFO:tasks.workunit.client.1.smithi149.stdout:2/36: truncate f3 945584 0 2024-09-21T11:39:00.461 INFO:tasks.workunit.client.1.smithi149.stdout:7/42: link f1 f4 0 2024-09-21T11:39:00.462 INFO:tasks.workunit.client.1.smithi149.stdout:2/37: write f3 [1166854,10671] 0 2024-09-21T11:39:00.466 INFO:tasks.workunit.client.1.smithi149.stdout:7/43: creat f5 x:0 0 0 2024-09-21T11:39:00.469 INFO:tasks.workunit.client.1.smithi149.stdout:4/29: getdents d4/d6 0 2024-09-21T11:39:00.470 INFO:tasks.workunit.client.1.smithi149.stdout:7/44: creat f6 x:0 0 0 2024-09-21T11:39:00.470 INFO:tasks.workunit.client.1.smithi149.stdout:7/45: chown l2 15875386 1 2024-09-21T11:39:00.470 INFO:tasks.workunit.client.1.smithi149.stdout:7/46: rmdir - no directory 2024-09-21T11:39:00.470 INFO:tasks.workunit.client.1.smithi149.stdout:2/38: mknod d8/da/cb 0 2024-09-21T11:39:00.472 INFO:tasks.workunit.client.1.smithi149.stdout:7/47: symlink l7 0 2024-09-21T11:39:00.472 INFO:tasks.workunit.client.1.smithi149.stdout:7/48: dread - f5 zero size 2024-09-21T11:39:00.472 INFO:tasks.workunit.client.1.smithi149.stdout:7/49: fdatasync f5 0 2024-09-21T11:39:00.472 INFO:tasks.workunit.client.1.smithi149.stdout:4/30: creat d4/d6/f9 x:0 0 0 2024-09-21T11:39:00.473 INFO:tasks.workunit.client.1.smithi149.stdout:2/39: mknod d8/da/cc 0 2024-09-21T11:39:00.474 INFO:tasks.workunit.client.1.smithi149.stdout:2/40: read f3 [951189,91365] 0 2024-09-21T11:39:00.474 INFO:tasks.workunit.client.1.smithi149.stdout:8/25: fdatasync f0 0 2024-09-21T11:39:00.475 INFO:tasks.workunit.client.1.smithi149.stdout:4/31: write d4/f7 [1743212,54199] 0 2024-09-21T11:39:00.479 INFO:tasks.workunit.client.1.smithi149.stdout:4/32: creat d4/d6/fa x:0 0 0 2024-09-21T11:39:00.480 INFO:tasks.workunit.client.1.smithi149.stdout:4/33: dread - d4/d6/fa zero size 2024-09-21T11:39:00.482 INFO:tasks.workunit.client.1.smithi149.stdout:3/30: getdents d6 0 2024-09-21T11:39:00.483 INFO:tasks.workunit.client.1.smithi149.stdout:7/50: dwrite f4 [0,4194304] 0 2024-09-21T11:39:00.484 INFO:tasks.workunit.client.1.smithi149.stdout:7/51: read f1 [1928412,38967] 0 2024-09-21T11:39:00.485 INFO:tasks.workunit.client.1.smithi149.stdout:8/26: dwrite f0 [0,4194304] 0 2024-09-21T11:39:00.485 INFO:tasks.workunit.client.1.smithi149.stdout:3/31: write d6/ff [770864,31056] 0 2024-09-21T11:39:00.493 INFO:tasks.workunit.client.1.smithi149.stdout:8/27: rmdir d3/d4 39 2024-09-21T11:39:00.494 INFO:tasks.workunit.client.1.smithi149.stdout:7/52: creat f8 x:0 0 0 2024-09-21T11:39:00.495 INFO:tasks.workunit.client.1.smithi149.stdout:7/53: readlink l7 0 2024-09-21T11:39:00.496 INFO:tasks.workunit.client.1.smithi149.stdout:4/34: dwrite d4/f7 [0,4194304] 0 2024-09-21T11:39:00.501 INFO:tasks.workunit.client.1.smithi149.stdout:3/32: creat d6/f10 x:0 0 0 2024-09-21T11:39:00.502 INFO:tasks.workunit.client.1.smithi149.stdout:4/35: write d4/d6/f9 [64035,108235] 0 2024-09-21T11:39:00.504 INFO:tasks.workunit.client.1.smithi149.stdout:3/33: write d6/fa [558742,38358] 0 2024-09-21T11:39:00.505 INFO:tasks.workunit.client.1.smithi149.stdout:3/34: readlink d6/lb 0 2024-09-21T11:39:00.507 INFO:tasks.workunit.client.1.smithi149.stdout:8/28: dread f0 [0,4194304] 0 2024-09-21T11:39:00.507 INFO:tasks.workunit.client.1.smithi149.stdout:7/54: dread f1 [0,4194304] 0 2024-09-21T11:39:00.508 INFO:tasks.workunit.client.1.smithi149.stdout:3/35: write d6/fe [1031054,103006] 0 2024-09-21T11:39:00.509 INFO:tasks.workunit.client.1.smithi149.stdout:7/55: read f4 [1684088,124878] 0 2024-09-21T11:39:00.510 INFO:tasks.workunit.client.1.smithi149.stdout:3/36: truncate f2 323636 0 2024-09-21T11:39:00.512 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:00 smithi118 ceph-mon[28757]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 321 op/s 2024-09-21T11:39:00.520 INFO:tasks.workunit.client.1.smithi149.stdout:7/56: write f5 [1045352,73069] 0 2024-09-21T11:39:00.523 INFO:tasks.workunit.client.1.smithi149.stdout:4/36: dwrite d4/f7 [0,4194304] 0 2024-09-21T11:39:00.523 INFO:tasks.workunit.client.1.smithi149.stdout:4/37: stat d4/c8 0 2024-09-21T11:39:00.531 INFO:tasks.workunit.client.1.smithi149.stdout:4/38: dwrite d4/d6/fa [0,4194304] 0 2024-09-21T11:39:00.681 INFO:tasks.workunit.client.1.smithi149.stdout:8/29: symlink d3/d4/l7 0 2024-09-21T11:39:00.685 INFO:tasks.workunit.client.1.smithi149.stdout:4/39: creat d4/d6/fb x:0 0 0 2024-09-21T11:39:00.686 INFO:tasks.workunit.client.1.smithi149.stdout:8/30: fdatasync f0 0 2024-09-21T11:39:00.687 INFO:tasks.workunit.client.1.smithi149.stdout:8/31: write f0 [4354088,100287] 0 2024-09-21T11:39:00.688 INFO:tasks.workunit.client.1.smithi149.stdout:8/32: write f0 [5051412,54856] 0 2024-09-21T11:39:00.688 INFO:tasks.workunit.client.1.smithi149.stdout:4/40: mkdir d4/dc 0 2024-09-21T11:39:00.689 INFO:tasks.workunit.client.1.smithi149.stdout:7/57: link l7 l9 0 2024-09-21T11:39:00.689 INFO:tasks.workunit.client.1.smithi149.stdout:7/58: rmdir - no directory 2024-09-21T11:39:00.689 INFO:tasks.workunit.client.1.smithi149.stdout:4/41: write d4/f7 [1537570,43332] 0 2024-09-21T11:39:00.691 INFO:tasks.workunit.client.1.smithi149.stdout:4/42: dread d4/d6/f9 [0,4194304] 0 2024-09-21T11:39:00.693 INFO:tasks.workunit.client.1.smithi149.stdout:6/28: getdents . 0 2024-09-21T11:39:00.694 INFO:tasks.workunit.client.1.smithi149.stdout:4/43: rmdir d4/d6 39 2024-09-21T11:39:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:00 smithi149 ceph-mon[36123]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 321 op/s 2024-09-21T11:39:00.701 INFO:tasks.workunit.client.1.smithi149.stdout:6/29: mkdir d8 0 2024-09-21T11:39:00.701 INFO:tasks.workunit.client.1.smithi149.stdout:4/44: truncate d4/d6/fa 5105590 0 2024-09-21T11:39:00.705 INFO:tasks.workunit.client.1.smithi149.stdout:4/45: mknod d4/dc/cd 0 2024-09-21T11:39:00.726 INFO:tasks.workunit.client.1.smithi149.stdout:4/46: symlink d4/dc/le 0 2024-09-21T11:39:00.746 INFO:tasks.workunit.client.1.smithi149.stdout:4/47: mknod d4/d6/cf 0 2024-09-21T11:39:00.747 INFO:tasks.workunit.client.1.smithi149.stdout:4/48: dread - d4/d6/fb zero size 2024-09-21T11:39:00.748 INFO:tasks.workunit.client.1.smithi149.stdout:4/49: fdatasync d4/d6/f9 0 2024-09-21T11:39:00.749 INFO:tasks.workunit.client.1.smithi149.stdout:4/50: write d4/f7 [2303124,65196] 0 2024-09-21T11:39:00.751 INFO:tasks.workunit.client.1.smithi149.stdout:4/51: mkdir d4/dc/d10 0 2024-09-21T11:39:00.752 INFO:tasks.workunit.client.1.smithi149.stdout:4/52: chown d4/d6 9752 1 2024-09-21T11:39:00.754 INFO:tasks.workunit.client.1.smithi149.stdout:4/53: symlink d4/d6/l11 0 2024-09-21T11:39:00.757 INFO:tasks.workunit.client.1.smithi149.stdout:4/54: link d4/f7 d4/dc/f12 0 2024-09-21T11:39:00.766 INFO:tasks.workunit.client.1.smithi149.stdout:8/33: getdents d3/d4 0 2024-09-21T11:39:00.766 INFO:tasks.workunit.client.1.smithi149.stdout:3/37: fsync f2 0 2024-09-21T11:39:00.768 INFO:tasks.workunit.client.1.smithi149.stdout:7/59: getdents . 0 2024-09-21T11:39:00.768 INFO:tasks.workunit.client.1.smithi149.stdout:7/60: chown f8 52565404 1 2024-09-21T11:39:00.768 INFO:tasks.workunit.client.1.smithi149.stdout:3/38: mknod d6/c11 0 2024-09-21T11:39:00.771 INFO:tasks.workunit.client.1.smithi149.stdout:7/61: unlink f8 0 2024-09-21T11:39:00.772 INFO:tasks.workunit.client.1.smithi149.stdout:8/34: creat d3/f8 x:0 0 0 2024-09-21T11:39:00.775 INFO:tasks.workunit.client.1.smithi149.stdout:7/62: creat fa x:0 0 0 2024-09-21T11:39:00.775 INFO:tasks.workunit.client.1.smithi149.stdout:9/11: truncate f0 1651929 0 2024-09-21T11:39:00.776 INFO:tasks.workunit.client.1.smithi149.stdout:8/35: dread f0 [0,4194304] 0 2024-09-21T11:39:00.777 INFO:tasks.workunit.client.1.smithi149.stdout:8/36: chown f0 68188725 1 2024-09-21T11:39:00.780 INFO:tasks.workunit.client.1.smithi149.stdout:7/63: creat fb x:0 0 0 2024-09-21T11:39:00.782 INFO:tasks.workunit.client.1.smithi149.stdout:9/12: mknod c2 0 2024-09-21T11:39:00.786 INFO:tasks.workunit.client.1.smithi149.stdout:7/64: dwrite fb [0,4194304] 0 2024-09-21T11:39:00.789 INFO:tasks.workunit.client.1.smithi149.stdout:8/37: rename d3/d4/l7 to d3/l9 0 2024-09-21T11:39:00.790 INFO:tasks.workunit.client.1.smithi149.stdout:4/55: rename d4/dc to d4/d13 0 2024-09-21T11:39:00.791 INFO:tasks.workunit.client.1.smithi149.stdout:4/56: write d4/d6/f9 [804906,125516] 0 2024-09-21T11:39:00.799 INFO:tasks.workunit.client.1.smithi149.stdout:4/57: mknod d4/d13/d10/c14 0 2024-09-21T11:39:00.799 INFO:tasks.workunit.client.1.smithi149.stdout:4/58: stat l3 0 2024-09-21T11:39:00.800 INFO:tasks.workunit.client.1.smithi149.stdout:4/59: chown d4/d6/fa 1418224 1 2024-09-21T11:39:00.801 INFO:tasks.workunit.client.1.smithi149.stdout:8/38: creat d3/fa x:0 0 0 2024-09-21T11:39:00.802 INFO:tasks.workunit.client.1.smithi149.stdout:3/39: truncate d6/ff 734853 0 2024-09-21T11:39:00.804 INFO:tasks.workunit.client.1.smithi149.stdout:4/60: fsync d4/f7 0 2024-09-21T11:39:00.806 INFO:tasks.workunit.client.1.smithi149.stdout:4/61: write d4/d6/fb [424365,13648] 0 2024-09-21T11:39:00.807 INFO:tasks.workunit.client.1.smithi149.stdout:3/40: creat d6/f12 x:0 0 0 2024-09-21T11:39:00.809 INFO:tasks.workunit.client.1.smithi149.stdout:3/41: write d6/f9 [4869840,47240] 0 2024-09-21T11:39:00.814 INFO:tasks.workunit.client.1.smithi149.stdout:3/42: creat d6/f13 x:0 0 0 2024-09-21T11:39:00.818 INFO:tasks.workunit.client.1.smithi149.stdout:3/43: symlink d6/l14 0 2024-09-21T11:39:00.819 INFO:tasks.workunit.client.1.smithi149.stdout:7/65: truncate f4 3153351 0 2024-09-21T11:39:00.819 INFO:tasks.workunit.client.1.smithi149.stdout:7/66: write f5 [478192,77713] 0 2024-09-21T11:39:00.823 INFO:tasks.workunit.client.1.smithi149.stdout:7/67: creat fc x:0 0 0 2024-09-21T11:39:00.826 INFO:tasks.workunit.client.1.smithi149.stdout:3/44: fdatasync d6/ff 0 2024-09-21T11:39:00.826 INFO:tasks.workunit.client.1.smithi149.stdout:4/62: write d4/f7 [4626600,55412] 0 2024-09-21T11:39:00.829 INFO:tasks.workunit.client.1.smithi149.stdout:9/13: dwrite f0 [0,4194304] 0 2024-09-21T11:39:00.829 INFO:tasks.workunit.client.1.smithi149.stdout:9/14: readlink - no filename 2024-09-21T11:39:00.829 INFO:tasks.workunit.client.1.smithi149.stdout:3/45: write f3 [757602,11498] 0 2024-09-21T11:39:00.832 INFO:tasks.workunit.client.1.smithi149.stdout:4/63: read d4/d6/fb [345767,116011] 0 2024-09-21T11:39:00.832 INFO:tasks.workunit.client.1.smithi149.stdout:8/39: dwrite f0 [0,4194304] 0 2024-09-21T11:39:00.833 INFO:tasks.workunit.client.1.smithi149.stdout:4/64: read d4/f7 [3273846,129804] 0 2024-09-21T11:39:00.834 INFO:tasks.workunit.client.1.smithi149.stdout:7/68: rename l7 to ld 0 2024-09-21T11:39:00.837 INFO:tasks.workunit.client.1.smithi149.stdout:9/15: symlink l3 0 2024-09-21T11:39:00.842 INFO:tasks.workunit.client.1.smithi149.stdout:8/40: mknod d3/d4/cb 0 2024-09-21T11:39:00.843 INFO:tasks.workunit.client.1.smithi149.stdout:8/41: write d3/fa [664995,59437] 0 2024-09-21T11:39:00.843 INFO:tasks.workunit.client.1.smithi149.stdout:7/69: creat fe x:0 0 0 2024-09-21T11:39:00.850 INFO:tasks.workunit.client.1.smithi149.stdout:3/46: truncate d6/fc 131587 0 2024-09-21T11:39:00.850 INFO:tasks.workunit.client.1.smithi149.stdout:8/42: dwrite d3/f8 [0,4194304] 0 2024-09-21T11:39:00.862 INFO:tasks.workunit.client.1.smithi149.stdout:3/47: rmdir d6 39 2024-09-21T11:39:00.863 INFO:tasks.workunit.client.1.smithi149.stdout:8/43: mknod d3/d4/cc 0 2024-09-21T11:39:00.867 INFO:tasks.workunit.client.1.smithi149.stdout:8/44: fsync d3/f8 0 2024-09-21T11:39:00.871 INFO:tasks.workunit.client.1.smithi149.stdout:3/48: symlink d6/l15 0 2024-09-21T11:39:00.871 INFO:tasks.workunit.client.1.smithi149.stdout:3/49: write d6/fa [565632,49223] 0 2024-09-21T11:39:00.872 INFO:tasks.workunit.client.1.smithi149.stdout:3/50: dread - d6/f12 zero size 2024-09-21T11:39:00.874 INFO:tasks.workunit.client.1.smithi149.stdout:4/65: truncate d4/d6/fa 3165312 0 2024-09-21T11:39:00.879 INFO:tasks.workunit.client.1.smithi149.stdout:8/45: mkdir d3/dd 0 2024-09-21T11:39:00.880 INFO:tasks.workunit.client.1.smithi149.stdout:3/51: creat d6/f16 x:0 0 0 2024-09-21T11:39:00.883 INFO:tasks.workunit.client.1.smithi149.stdout:4/66: mkdir d4/d13/d15 0 2024-09-21T11:39:00.883 INFO:tasks.workunit.client.1.smithi149.stdout:8/46: rmdir d3 39 2024-09-21T11:39:00.886 INFO:tasks.workunit.client.1.smithi149.stdout:3/52: rename d6/lb to d6/l17 0 2024-09-21T11:39:00.889 INFO:tasks.workunit.client.1.smithi149.stdout:4/67: unlink l3 0 2024-09-21T11:39:00.892 INFO:tasks.workunit.client.1.smithi149.stdout:4/68: dread d4/d6/f9 [0,4194304] 0 2024-09-21T11:39:00.894 INFO:tasks.workunit.client.1.smithi149.stdout:7/70: write f4 [86472,104874] 0 2024-09-21T11:39:00.895 INFO:tasks.workunit.client.1.smithi149.stdout:7/71: write f5 [2040196,54367] 0 2024-09-21T11:39:00.895 INFO:tasks.workunit.client.1.smithi149.stdout:4/69: write d4/d6/f9 [15733,24603] 0 2024-09-21T11:39:00.902 INFO:tasks.workunit.client.1.smithi149.stdout:7/72: link f6 ff 0 2024-09-21T11:39:00.908 INFO:tasks.workunit.client.1.smithi149.stdout:7/73: dread f5 [0,4194304] 0 2024-09-21T11:39:00.908 INFO:tasks.workunit.client.1.smithi149.stdout:3/53: link d6/l17 d6/l18 0 2024-09-21T11:39:00.909 INFO:tasks.workunit.client.1.smithi149.stdout:4/70: getdents d4 0 2024-09-21T11:39:00.910 INFO:tasks.workunit.client.1.smithi149.stdout:7/74: creat f10 x:0 0 0 2024-09-21T11:39:00.911 INFO:tasks.workunit.client.1.smithi149.stdout:7/75: read - f10 zero size 2024-09-21T11:39:00.911 INFO:tasks.workunit.client.1.smithi149.stdout:3/54: mknod d6/c19 0 2024-09-21T11:39:00.911 INFO:tasks.workunit.client.1.smithi149.stdout:3/55: truncate d6/fe 1566944 0 2024-09-21T11:39:00.913 INFO:tasks.workunit.client.1.smithi149.stdout:7/76: symlink l11 0 2024-09-21T11:39:00.913 INFO:tasks.workunit.client.1.smithi149.stdout:4/71: mkdir d4/d13/d15/d16 0 2024-09-21T11:39:00.915 INFO:tasks.workunit.client.1.smithi149.stdout:7/77: write fa [15084,47328] 0 2024-09-21T11:39:00.916 INFO:tasks.workunit.client.1.smithi149.stdout:7/78: write fe [58168,53582] 0 2024-09-21T11:39:00.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/79: mkdir d12 0 2024-09-21T11:39:00.920 INFO:tasks.workunit.client.1.smithi149.stdout:3/56: dwrite d6/f10 [0,4194304] 0 2024-09-21T11:39:00.921 INFO:tasks.workunit.client.1.smithi149.stdout:7/80: write fc [645270,91640] 0 2024-09-21T11:39:00.922 INFO:tasks.workunit.client.1.smithi149.stdout:3/57: chown d6/c11 248 1 2024-09-21T11:39:00.923 INFO:tasks.workunit.client.1.smithi149.stdout:3/58: write d6/f12 [355007,127422] 0 2024-09-21T11:39:00.925 INFO:tasks.workunit.client.1.smithi149.stdout:4/72: truncate d4/d6/fa 2558001 0 2024-09-21T11:39:00.930 INFO:tasks.workunit.client.1.smithi149.stdout:3/59: creat d6/f1a x:0 0 0 2024-09-21T11:39:00.930 INFO:tasks.workunit.client.1.smithi149.stdout:3/60: chown d6/l14 307714708 1 2024-09-21T11:39:00.937 INFO:tasks.workunit.client.1.smithi149.stdout:7/81: mknod d12/c13 0 2024-09-21T11:39:00.937 INFO:tasks.workunit.client.1.smithi149.stdout:4/73: creat d4/d13/d15/f17 x:0 0 0 2024-09-21T11:39:00.937 INFO:tasks.workunit.client.1.smithi149.stdout:7/82: truncate ff 590024 0 2024-09-21T11:39:00.938 INFO:tasks.workunit.client.1.smithi149.stdout:7/83: fsync f4 0 2024-09-21T11:39:00.939 INFO:tasks.workunit.client.1.smithi149.stdout:3/61: creat d6/f1b x:0 0 0 2024-09-21T11:39:00.939 INFO:tasks.workunit.client.1.smithi149.stdout:7/84: dread ff [0,4194304] 0 2024-09-21T11:39:00.940 INFO:tasks.workunit.client.1.smithi149.stdout:4/74: mkdir d4/d6/d18 0 2024-09-21T11:39:00.940 INFO:tasks.workunit.client.1.smithi149.stdout:3/62: write d6/fa [4945903,120003] 0 2024-09-21T11:39:00.941 INFO:tasks.workunit.client.1.smithi149.stdout:4/75: stat d4/d6/cf 0 2024-09-21T11:39:00.941 INFO:tasks.workunit.client.1.smithi149.stdout:3/63: chown d6/l14 7335835 1 2024-09-21T11:39:00.941 INFO:tasks.workunit.client.1.smithi149.stdout:3/64: chown d6/cd 173657 1 2024-09-21T11:39:00.942 INFO:tasks.workunit.client.1.smithi149.stdout:3/65: dread - d6/f13 zero size 2024-09-21T11:39:00.944 INFO:tasks.workunit.client.1.smithi149.stdout:7/85: creat d12/f14 x:0 0 0 2024-09-21T11:39:00.945 INFO:tasks.workunit.client.1.smithi149.stdout:4/76: unlink d4/d13/d15/f17 0 2024-09-21T11:39:00.945 INFO:tasks.workunit.client.1.smithi149.stdout:7/86: dread ff [0,4194304] 0 2024-09-21T11:39:00.945 INFO:tasks.workunit.client.1.smithi149.stdout:4/77: readlink d4/d6/l11 0 2024-09-21T11:39:00.948 INFO:tasks.workunit.client.1.smithi149.stdout:3/66: rmdir d6 39 2024-09-21T11:39:00.968 INFO:tasks.workunit.client.1.smithi149.stdout:4/78: rename d4/d6/fa to d4/d13/d15/f19 0 2024-09-21T11:39:00.968 INFO:tasks.workunit.client.1.smithi149.stdout:7/87: dwrite f6 [0,4194304] 0 2024-09-21T11:39:00.969 INFO:tasks.workunit.client.1.smithi149.stdout:7/88: fsync d12/f14 0 2024-09-21T11:39:00.971 INFO:tasks.workunit.client.1.smithi149.stdout:4/79: mknod d4/d6/c1a 0 2024-09-21T11:39:00.972 INFO:tasks.workunit.client.1.smithi149.stdout:7/89: mkdir d12/d15 0 2024-09-21T11:39:00.972 INFO:tasks.workunit.client.1.smithi149.stdout:3/67: write d6/ff [219087,123551] 0 2024-09-21T11:39:00.973 INFO:tasks.workunit.client.1.smithi149.stdout:7/90: write f10 [589149,76779] 0 2024-09-21T11:39:00.974 INFO:tasks.workunit.client.1.smithi149.stdout:4/80: mknod d4/d13/c1b 0 2024-09-21T11:39:00.980 INFO:tasks.workunit.client.1.smithi149.stdout:4/81: unlink d4/d6/c1a 0 2024-09-21T11:39:00.980 INFO:tasks.workunit.client.1.smithi149.stdout:7/91: link l11 d12/l16 0 2024-09-21T11:39:00.982 INFO:tasks.workunit.client.1.smithi149.stdout:3/68: dwrite d6/f12 [0,4194304] 0 2024-09-21T11:39:00.982 INFO:tasks.workunit.client.1.smithi149.stdout:7/92: read f6 [1901329,35112] 0 2024-09-21T11:39:00.988 INFO:tasks.workunit.client.1.smithi149.stdout:3/69: mknod d6/c1c 0 2024-09-21T11:39:00.989 INFO:tasks.workunit.client.1.smithi149.stdout:3/70: write d6/f9 [121875,37296] 0 2024-09-21T11:39:00.990 INFO:tasks.workunit.client.1.smithi149.stdout:4/82: creat d4/d6/d18/f1c x:0 0 0 2024-09-21T11:39:00.992 INFO:tasks.workunit.client.1.smithi149.stdout:7/93: creat d12/d15/f17 x:0 0 0 2024-09-21T11:39:00.995 INFO:tasks.workunit.client.1.smithi149.stdout:3/71: readlink d6/l17 0 2024-09-21T11:39:00.996 INFO:tasks.workunit.client.1.smithi149.stdout:4/83: mkdir d4/d13/d1d 0 2024-09-21T11:39:00.998 INFO:tasks.workunit.client.1.smithi149.stdout:7/94: creat d12/f18 x:0 0 0 2024-09-21T11:39:00.999 INFO:tasks.workunit.client.1.smithi149.stdout:3/72: mkdir d6/d1d 0 2024-09-21T11:39:01.004 INFO:tasks.workunit.client.1.smithi149.stdout:7/95: truncate f1 1693481 0 2024-09-21T11:39:01.005 INFO:tasks.workunit.client.1.smithi149.stdout:3/73: creat d6/d1d/f1e x:0 0 0 2024-09-21T11:39:01.005 INFO:tasks.workunit.client.1.smithi149.stdout:7/96: symlink d12/d15/l19 0 2024-09-21T11:39:01.006 INFO:tasks.workunit.client.1.smithi149.stdout:7/97: read fe [69863,71131] 0 2024-09-21T11:39:01.008 INFO:tasks.workunit.client.1.smithi149.stdout:1/6: sync 2024-09-21T11:39:01.009 INFO:tasks.workunit.client.1.smithi149.stdout:1/7: chown f0 0 1 2024-09-21T11:39:01.009 INFO:tasks.workunit.client.1.smithi149.stdout:1/8: readlink - no filename 2024-09-21T11:39:01.010 INFO:tasks.workunit.client.1.smithi149.stdout:7/98: symlink d12/l1a 0 2024-09-21T11:39:01.012 INFO:tasks.workunit.client.1.smithi149.stdout:3/74: dwrite d6/f8 [0,4194304] 0 2024-09-21T11:39:01.013 INFO:tasks.workunit.client.1.smithi149.stdout:1/9: mkdir d2 0 2024-09-21T11:39:01.013 INFO:tasks.workunit.client.1.smithi149.stdout:1/10: readlink - no filename 2024-09-21T11:39:01.014 INFO:tasks.workunit.client.1.smithi149.stdout:7/99: readlink ld 0 2024-09-21T11:39:01.017 INFO:tasks.workunit.client.1.smithi149.stdout:3/75: mkdir d6/d1f 0 2024-09-21T11:39:01.018 INFO:tasks.workunit.client.1.smithi149.stdout:3/76: fdatasync d6/f1b 0 2024-09-21T11:39:01.019 INFO:tasks.workunit.client.1.smithi149.stdout:7/100: rename ld to d12/l1b 0 2024-09-21T11:39:01.020 INFO:tasks.workunit.client.1.smithi149.stdout:7/101: stat d12/f14 0 2024-09-21T11:39:01.026 INFO:tasks.workunit.client.1.smithi149.stdout:4/84: dwrite d4/d13/d15/f19 [0,4194304] 0 2024-09-21T11:39:01.029 INFO:tasks.workunit.client.1.smithi149.stdout:3/77: link d6/cd d6/d1d/c20 0 2024-09-21T11:39:01.030 INFO:tasks.workunit.client.1.smithi149.stdout:3/78: chown d6/f8 6918 1 2024-09-21T11:39:01.031 INFO:tasks.workunit.client.1.smithi149.stdout:7/102: dwrite f10 [0,4194304] 0 2024-09-21T11:39:01.031 INFO:tasks.workunit.client.1.smithi149.stdout:3/79: fdatasync f3 0 2024-09-21T11:39:01.035 INFO:tasks.workunit.client.1.smithi149.stdout:7/103: write ff [1457452,15643] 0 2024-09-21T11:39:01.037 INFO:tasks.workunit.client.1.smithi149.stdout:1/11: truncate f0 2499712 0 2024-09-21T11:39:01.039 INFO:tasks.workunit.client.1.smithi149.stdout:4/85: getdents d4/d6 0 2024-09-21T11:39:01.045 INFO:tasks.workunit.client.1.smithi149.stdout:1/12: fdatasync f0 0 2024-09-21T11:39:01.047 INFO:tasks.workunit.client.1.smithi149.stdout:4/86: write d4/d6/f9 [71693,95360] 0 2024-09-21T11:39:01.051 INFO:tasks.workunit.client.1.smithi149.stdout:3/80: dwrite d6/ff [0,4194304] 0 2024-09-21T11:39:01.052 INFO:tasks.workunit.client.1.smithi149.stdout:3/81: chown d6/d1d 2 1 2024-09-21T11:39:01.056 INFO:tasks.workunit.client.1.smithi149.stdout:3/82: creat d6/f21 x:0 0 0 2024-09-21T11:39:01.058 INFO:tasks.workunit.client.1.smithi149.stdout:0/13: sync 2024-09-21T11:39:01.058 INFO:tasks.workunit.client.1.smithi149.stdout:5/11: sync 2024-09-21T11:39:01.058 INFO:tasks.workunit.client.1.smithi149.stdout:6/30: sync 2024-09-21T11:39:01.058 INFO:tasks.workunit.client.1.smithi149.stdout:2/41: sync 2024-09-21T11:39:01.058 INFO:tasks.workunit.client.1.smithi149.stdout:7/104: dwrite f5 [0,4194304] 0 2024-09-21T11:39:01.062 INFO:tasks.workunit.client.1.smithi149.stdout:5/12: mkdir d4 0 2024-09-21T11:39:01.062 INFO:tasks.workunit.client.1.smithi149.stdout:0/14: read - f3 zero size 2024-09-21T11:39:01.063 INFO:tasks.workunit.client.1.smithi149.stdout:3/83: chown d6/f1b 31188 1 2024-09-21T11:39:01.064 INFO:tasks.workunit.client.1.smithi149.stdout:5/13: fsync f3 0 2024-09-21T11:39:01.065 INFO:tasks.workunit.client.1.smithi149.stdout:2/42: chown f3 40 1 2024-09-21T11:39:01.070 INFO:tasks.workunit.client.1.smithi149.stdout:5/14: fsync f2 0 2024-09-21T11:39:01.074 INFO:tasks.workunit.client.1.smithi149.stdout:3/84: mkdir d6/d1d/d22 0 2024-09-21T11:39:01.075 INFO:tasks.workunit.client.1.smithi149.stdout:4/87: dwrite d4/d13/d15/f19 [0,4194304] 0 2024-09-21T11:39:01.076 INFO:tasks.workunit.client.1.smithi149.stdout:5/15: write f3 [1087022,11638] 0 2024-09-21T11:39:01.080 INFO:tasks.workunit.client.1.smithi149.stdout:4/88: stat d4/d13/f12 0 2024-09-21T11:39:01.083 INFO:tasks.workunit.client.1.smithi149.stdout:1/13: dread f0 [0,4194304] 0 2024-09-21T11:39:01.084 INFO:tasks.workunit.client.1.smithi149.stdout:4/89: chown d4/c8 3 1 2024-09-21T11:39:01.106 INFO:tasks.workunit.client.1.smithi149.stdout:2/43: dread f3 [0,4194304] 0 2024-09-21T11:39:01.108 INFO:tasks.workunit.client.1.smithi149.stdout:7/105: dwrite fb [0,4194304] 0 2024-09-21T11:39:01.108 INFO:tasks.workunit.client.1.smithi149.stdout:5/16: truncate f3 834103 0 2024-09-21T11:39:01.108 INFO:tasks.workunit.client.1.smithi149.stdout:6/31: dwrite f4 [0,4194304] 0 2024-09-21T11:39:01.108 INFO:tasks.workunit.client.1.smithi149.stdout:2/44: chown d8 38797619 1 2024-09-21T11:39:01.111 INFO:tasks.workunit.client.1.smithi149.stdout:1/14: unlink f0 0 2024-09-21T11:39:01.111 INFO:tasks.workunit.client.1.smithi149.stdout:0/15: dwrite f3 [0,4194304] 0 2024-09-21T11:39:01.118 INFO:tasks.workunit.client.1.smithi149.stdout:0/16: mknod c5 0 2024-09-21T11:39:01.118 INFO:tasks.workunit.client.1.smithi149.stdout:5/17: creat d4/f5 x:0 0 0 2024-09-21T11:39:01.119 INFO:tasks.workunit.client.1.smithi149.stdout:2/45: read f7 [435478,58504] 0 2024-09-21T11:39:01.121 INFO:tasks.workunit.client.1.smithi149.stdout:0/17: chown f2 36987508 1 2024-09-21T11:39:01.122 INFO:tasks.workunit.client.1.smithi149.stdout:7/106: dread f5 [0,4194304] 0 2024-09-21T11:39:01.123 INFO:tasks.workunit.client.1.smithi149.stdout:1/15: mknod d2/c3 0 2024-09-21T11:39:01.123 INFO:tasks.workunit.client.1.smithi149.stdout:1/16: dwrite - no filename 2024-09-21T11:39:01.123 INFO:tasks.workunit.client.1.smithi149.stdout:1/17: readlink - no filename 2024-09-21T11:39:01.123 INFO:tasks.workunit.client.1.smithi149.stdout:1/18: fsync - no filename 2024-09-21T11:39:01.123 INFO:tasks.workunit.client.1.smithi149.stdout:1/19: dwrite - no filename 2024-09-21T11:39:01.123 INFO:tasks.workunit.client.1.smithi149.stdout:6/32: creat d8/f9 x:0 0 0 2024-09-21T11:39:01.124 INFO:tasks.workunit.client.1.smithi149.stdout:7/107: fdatasync ff 0 2024-09-21T11:39:01.125 INFO:tasks.workunit.client.1.smithi149.stdout:7/108: chown l3 3344202 1 2024-09-21T11:39:01.126 INFO:tasks.workunit.client.1.smithi149.stdout:6/33: write f4 [56678,66886] 0 2024-09-21T11:39:01.126 INFO:tasks.workunit.client.1.smithi149.stdout:0/18: mknod c6 0 2024-09-21T11:39:01.128 INFO:tasks.workunit.client.1.smithi149.stdout:0/19: write f3 [537957,118519] 0 2024-09-21T11:39:01.128 INFO:tasks.workunit.client.1.smithi149.stdout:0/20: chown c5 17601 1 2024-09-21T11:39:01.131 INFO:tasks.workunit.client.1.smithi149.stdout:1/20: creat d2/f4 x:0 0 0 2024-09-21T11:39:01.132 INFO:tasks.workunit.client.1.smithi149.stdout:1/21: chown d2 1 1 2024-09-21T11:39:01.135 INFO:tasks.workunit.client.1.smithi149.stdout:7/109: creat d12/d15/f1c x:0 0 0 2024-09-21T11:39:01.136 INFO:tasks.workunit.client.1.smithi149.stdout:6/34: mkdir d8/da 0 2024-09-21T11:39:01.139 INFO:tasks.workunit.client.1.smithi149.stdout:1/22: mkdir d2/d5 0 2024-09-21T11:39:01.141 INFO:tasks.workunit.client.1.smithi149.stdout:7/110: rmdir d12 39 2024-09-21T11:39:01.142 INFO:tasks.workunit.client.1.smithi149.stdout:6/35: symlink d8/lb 0 2024-09-21T11:39:01.145 INFO:tasks.workunit.client.1.smithi149.stdout:6/36: dread f2 [0,4194304] 0 2024-09-21T11:39:01.148 INFO:tasks.workunit.client.1.smithi149.stdout:9/16: sync 2024-09-21T11:39:01.148 INFO:tasks.workunit.client.1.smithi149.stdout:8/47: sync 2024-09-21T11:39:01.149 INFO:tasks.workunit.client.1.smithi149.stdout:1/23: getdents d2/d5 0 2024-09-21T11:39:01.150 INFO:tasks.workunit.client.1.smithi149.stdout:1/24: dread - d2/f4 zero size 2024-09-21T11:39:01.151 INFO:tasks.workunit.client.1.smithi149.stdout:7/111: creat d12/d15/f1d x:0 0 0 2024-09-21T11:39:01.152 INFO:tasks.workunit.client.1.smithi149.stdout:6/37: dwrite f2 [0,4194304] 0 2024-09-21T11:39:01.153 INFO:tasks.workunit.client.1.smithi149.stdout:9/17: dread f0 [0,4194304] 0 2024-09-21T11:39:01.154 INFO:tasks.workunit.client.1.smithi149.stdout:9/18: fsync f0 0 2024-09-21T11:39:01.155 INFO:tasks.workunit.client.1.smithi149.stdout:8/48: chown d3/fa 29 1 2024-09-21T11:39:01.158 INFO:tasks.workunit.client.1.smithi149.stdout:1/25: mknod d2/c6 0 2024-09-21T11:39:01.163 INFO:tasks.workunit.client.1.smithi149.stdout:6/38: unlink c6 0 2024-09-21T11:39:01.164 INFO:tasks.workunit.client.1.smithi149.stdout:9/19: mknod c4 0 2024-09-21T11:39:01.167 INFO:tasks.workunit.client.1.smithi149.stdout:6/39: write d8/f9 [796239,74526] 0 2024-09-21T11:39:01.167 INFO:tasks.workunit.client.1.smithi149.stdout:4/90: dwrite d4/f7 [0,4194304] 0 2024-09-21T11:39:01.171 INFO:tasks.workunit.client.1.smithi149.stdout:7/112: dwrite f5 [4194304,4194304] 0 2024-09-21T11:39:01.171 INFO:tasks.workunit.client.1.smithi149.stdout:8/49: mknod d3/ce 0 2024-09-21T11:39:01.180 INFO:tasks.workunit.client.1.smithi149.stdout:8/50: readlink d3/l9 0 2024-09-21T11:39:01.183 INFO:tasks.workunit.client.1.smithi149.stdout:7/113: creat d12/f1e x:0 0 0 2024-09-21T11:39:01.185 INFO:tasks.workunit.client.1.smithi149.stdout:6/40: dwrite d8/f9 [0,4194304] 0 2024-09-21T11:39:01.185 INFO:tasks.workunit.client.1.smithi149.stdout:9/20: dread f0 [0,4194304] 0 2024-09-21T11:39:01.186 INFO:tasks.workunit.client.1.smithi149.stdout:6/41: readlink d8/lb 0 2024-09-21T11:39:01.193 INFO:tasks.workunit.client.1.smithi149.stdout:7/114: creat d12/d15/f1f x:0 0 0 2024-09-21T11:39:01.195 INFO:tasks.workunit.client.1.smithi149.stdout:9/21: write f0 [4581102,47593] 0 2024-09-21T11:39:01.201 INFO:tasks.workunit.client.1.smithi149.stdout:7/115: creat d12/d15/f20 x:0 0 0 2024-09-21T11:39:01.201 INFO:tasks.workunit.client.1.smithi149.stdout:7/116: dread - d12/f1e zero size 2024-09-21T11:39:01.201 INFO:tasks.workunit.client.1.smithi149.stdout:7/117: dread - d12/d15/f1c zero size 2024-09-21T11:39:01.207 INFO:tasks.workunit.client.1.smithi149.stdout:7/118: creat d12/f21 x:0 0 0 2024-09-21T11:39:01.207 INFO:tasks.workunit.client.1.smithi149.stdout:7/119: chown d12/d15 612 1 2024-09-21T11:39:01.207 INFO:tasks.workunit.client.1.smithi149.stdout:7/120: truncate d12/f18 562752 0 2024-09-21T11:39:01.208 INFO:tasks.workunit.client.1.smithi149.stdout:1/26: getdents d2 0 2024-09-21T11:39:01.223 INFO:tasks.workunit.client.1.smithi149.stdout:3/85: sync 2024-09-21T11:39:01.226 INFO:tasks.workunit.client.1.smithi149.stdout:1/27: creat d2/d5/f7 x:0 0 0 2024-09-21T11:39:01.226 INFO:tasks.workunit.client.1.smithi149.stdout:8/51: getdents d3 0 2024-09-21T11:39:01.227 INFO:tasks.workunit.client.1.smithi149.stdout:5/18: truncate f3 842925 0 2024-09-21T11:39:01.227 INFO:tasks.workunit.client.1.smithi149.stdout:8/52: read f0 [189130,56552] 0 2024-09-21T11:39:01.227 INFO:tasks.workunit.client.1.smithi149.stdout:3/86: chown d6/l15 16490 1 2024-09-21T11:39:01.229 INFO:tasks.workunit.client.1.smithi149.stdout:5/19: stat d4 0 2024-09-21T11:39:01.230 INFO:tasks.workunit.client.1.smithi149.stdout:7/121: dwrite d12/f1e [0,4194304] 0 2024-09-21T11:39:01.231 INFO:tasks.workunit.client.1.smithi149.stdout:1/28: mkdir d2/d5/d8 0 2024-09-21T11:39:01.232 INFO:tasks.workunit.client.1.smithi149.stdout:1/29: write d2/d5/f7 [550828,36360] 0 2024-09-21T11:39:01.236 INFO:tasks.workunit.client.1.smithi149.stdout:6/42: truncate f2 2543439 0 2024-09-21T11:39:01.239 INFO:tasks.workunit.client.1.smithi149.stdout:3/87: creat d6/d1d/f23 x:0 0 0 2024-09-21T11:39:01.239 INFO:tasks.workunit.client.1.smithi149.stdout:1/30: dwrite d2/d5/f7 [0,4194304] 0 2024-09-21T11:39:01.241 INFO:tasks.workunit.client.1.smithi149.stdout:8/53: creat d3/d4/ff x:0 0 0 2024-09-21T11:39:01.242 INFO:tasks.workunit.client.1.smithi149.stdout:7/122: symlink d12/d15/l22 0 2024-09-21T11:39:01.243 INFO:tasks.workunit.client.1.smithi149.stdout:7/123: read - d12/d15/f1c zero size 2024-09-21T11:39:01.247 INFO:tasks.workunit.client.1.smithi149.stdout:6/43: rename d8/f9 to d8/da/fc 0 2024-09-21T11:39:01.248 INFO:tasks.workunit.client.1.smithi149.stdout:6/44: read f4 [4019806,126718] 0 2024-09-21T11:39:01.252 INFO:tasks.workunit.client.1.smithi149.stdout:8/54: creat d3/f10 x:0 0 0 2024-09-21T11:39:01.254 INFO:tasks.workunit.client.1.smithi149.stdout:7/124: rename d12/l1a to d12/l23 0 2024-09-21T11:39:01.262 INFO:tasks.workunit.client.1.smithi149.stdout:3/88: mknod d6/d1f/c24 0 2024-09-21T11:39:01.263 INFO:tasks.workunit.client.1.smithi149.stdout:6/45: creat d8/da/fd x:0 0 0 2024-09-21T11:39:01.268 INFO:tasks.workunit.client.1.smithi149.stdout:7/125: symlink d12/d15/l24 0 2024-09-21T11:39:01.268 INFO:tasks.workunit.client.1.smithi149.stdout:7/126: stat d12/f1e 0 2024-09-21T11:39:01.270 INFO:tasks.workunit.client.1.smithi149.stdout:8/55: dread d3/f8 [0,4194304] 0 2024-09-21T11:39:01.270 INFO:tasks.workunit.client.1.smithi149.stdout:7/127: write d12/d15/f1d [1022556,96254] 0 2024-09-21T11:39:01.270 INFO:tasks.workunit.client.1.smithi149.stdout:7/128: dread - d12/f14 zero size 2024-09-21T11:39:01.271 INFO:tasks.workunit.client.1.smithi149.stdout:7/129: fsync d12/d15/f1f 0 2024-09-21T11:39:01.274 INFO:tasks.workunit.client.1.smithi149.stdout:3/89: symlink d6/d1f/l25 0 2024-09-21T11:39:01.275 INFO:tasks.workunit.client.1.smithi149.stdout:5/20: truncate f3 1410303 0 2024-09-21T11:39:01.276 INFO:tasks.workunit.client.1.smithi149.stdout:5/21: dread - f2 zero size 2024-09-21T11:39:01.277 INFO:tasks.workunit.client.1.smithi149.stdout:6/46: symlink d8/da/le 0 2024-09-21T11:39:01.280 INFO:tasks.workunit.client.1.smithi149.stdout:8/56: chown d3/d4/cb 1069 1 2024-09-21T11:39:01.280 INFO:tasks.workunit.client.1.smithi149.stdout:2/46: sync 2024-09-21T11:39:01.280 INFO:tasks.workunit.client.1.smithi149.stdout:2/47: chown d8/da/cc 0 1 2024-09-21T11:39:01.281 INFO:tasks.workunit.client.1.smithi149.stdout:3/90: creat d6/d1d/f26 x:0 0 0 2024-09-21T11:39:01.281 INFO:tasks.workunit.client.1.smithi149.stdout:3/91: stat d6/f8 0 2024-09-21T11:39:01.284 INFO:tasks.workunit.client.1.smithi149.stdout:6/47: rename d8/da/le to d8/lf 0 2024-09-21T11:39:01.285 INFO:tasks.workunit.client.1.smithi149.stdout:1/31: getdents d2/d5 0 2024-09-21T11:39:01.288 INFO:tasks.workunit.client.1.smithi149.stdout:2/48: truncate f3 1919932 0 2024-09-21T11:39:01.289 INFO:tasks.workunit.client.1.smithi149.stdout:3/92: mkdir d6/d1f/d27 0 2024-09-21T11:39:01.291 INFO:tasks.workunit.client.1.smithi149.stdout:3/93: chown d6/f1a 27760 1 2024-09-21T11:39:01.292 INFO:tasks.workunit.client.1.smithi149.stdout:3/94: chown d6/l17 317215324 1 2024-09-21T11:39:01.292 INFO:tasks.workunit.client.1.smithi149.stdout:6/48: unlink l3 0 2024-09-21T11:39:01.292 INFO:tasks.workunit.client.1.smithi149.stdout:1/32: dwrite d2/f4 [0,4194304] 0 2024-09-21T11:39:01.298 INFO:tasks.workunit.client.1.smithi149.stdout:3/95: dread d6/f8 [0,4194304] 0 2024-09-21T11:39:01.302 INFO:tasks.workunit.client.1.smithi149.stdout:1/33: creat d2/f9 x:0 0 0 2024-09-21T11:39:01.305 INFO:tasks.workunit.client.1.smithi149.stdout:8/57: creat d3/dd/f11 x:0 0 0 2024-09-21T11:39:01.309 INFO:tasks.workunit.client.1.smithi149.stdout:3/96: creat d6/f28 x:0 0 0 2024-09-21T11:39:01.319 INFO:tasks.workunit.client.1.smithi149.stdout:1/34: getdents d2/d5/d8 0 2024-09-21T11:39:01.321 INFO:tasks.workunit.client.1.smithi149.stdout:2/49: getdents d8/da 0 2024-09-21T11:39:01.323 INFO:tasks.workunit.client.1.smithi149.stdout:5/22: write f3 [1877106,63980] 0 2024-09-21T11:39:01.324 INFO:tasks.workunit.client.1.smithi149.stdout:3/97: symlink d6/d1d/d22/l29 0 2024-09-21T11:39:01.324 INFO:tasks.workunit.client.1.smithi149.stdout:3/98: readlink d6/l15 0 2024-09-21T11:39:01.327 INFO:tasks.workunit.client.1.smithi149.stdout:2/50: mkdir d8/dd 0 2024-09-21T11:39:01.330 INFO:tasks.workunit.client.1.smithi149.stdout:3/99: chown c0 0 1 2024-09-21T11:39:01.331 INFO:tasks.workunit.client.1.smithi149.stdout:5/23: dwrite f2 [0,4194304] 0 2024-09-21T11:39:01.332 INFO:tasks.workunit.client.1.smithi149.stdout:5/24: write d4/f5 [44559,83757] 0 2024-09-21T11:39:01.334 INFO:tasks.workunit.client.1.smithi149.stdout:1/35: unlink d2/f9 0 2024-09-21T11:39:01.339 INFO:tasks.workunit.client.1.smithi149.stdout:5/25: chown c1 914725 1 2024-09-21T11:39:01.342 INFO:tasks.workunit.client.1.smithi149.stdout:1/36: creat d2/d5/d8/fa x:0 0 0 2024-09-21T11:39:01.344 INFO:tasks.workunit.client.1.smithi149.stdout:6/49: dread f2 [0,4194304] 0 2024-09-21T11:39:01.345 INFO:tasks.workunit.client.1.smithi149.stdout:2/51: dread f3 [0,4194304] 0 2024-09-21T11:39:01.347 INFO:tasks.workunit.client.1.smithi149.stdout:3/100: dwrite d6/f1a [0,4194304] 0 2024-09-21T11:39:01.347 INFO:tasks.workunit.client.1.smithi149.stdout:6/50: chown l5 447898858 1 2024-09-21T11:39:01.348 INFO:tasks.workunit.client.1.smithi149.stdout:1/37: creat d2/d5/fb x:0 0 0 2024-09-21T11:39:01.349 INFO:tasks.workunit.client.1.smithi149.stdout:2/52: symlink d8/le 0 2024-09-21T11:39:01.350 INFO:tasks.workunit.client.1.smithi149.stdout:3/101: dread - d6/f13 zero size 2024-09-21T11:39:01.350 INFO:tasks.workunit.client.1.smithi149.stdout:6/51: creat d8/da/f10 x:0 0 0 2024-09-21T11:39:01.353 INFO:tasks.workunit.client.1.smithi149.stdout:3/102: chown d6/f12 12548 1 2024-09-21T11:39:01.353 INFO:tasks.workunit.client.1.smithi149.stdout:5/26: dwrite f3 [0,4194304] 0 2024-09-21T11:39:01.354 INFO:tasks.workunit.client.1.smithi149.stdout:6/52: mkdir d8/da/d11 0 2024-09-21T11:39:01.355 INFO:tasks.workunit.client.1.smithi149.stdout:6/53: readlink l7 0 2024-09-21T11:39:01.356 INFO:tasks.workunit.client.1.smithi149.stdout:5/27: write d4/f5 [153286,123537] 0 2024-09-21T11:39:01.357 INFO:tasks.workunit.client.1.smithi149.stdout:3/103: creat d6/f2a x:0 0 0 2024-09-21T11:39:01.358 INFO:tasks.workunit.client.1.smithi149.stdout:3/104: dread - d6/f2a zero size 2024-09-21T11:39:01.360 INFO:tasks.workunit.client.1.smithi149.stdout:1/38: getdents d2 0 2024-09-21T11:39:01.363 INFO:tasks.workunit.client.1.smithi149.stdout:3/105: symlink d6/d1d/l2b 0 2024-09-21T11:39:01.367 INFO:tasks.workunit.client.1.smithi149.stdout:5/28: getdents d4 0 2024-09-21T11:39:01.371 INFO:tasks.workunit.client.1.smithi149.stdout:1/39: dwrite d2/d5/fb [0,4194304] 0 2024-09-21T11:39:01.371 INFO:tasks.workunit.client.1.smithi149.stdout:1/40: stat d2/c6 0 2024-09-21T11:39:01.372 INFO:tasks.workunit.client.1.smithi149.stdout:1/41: chown d2/d5 33 1 2024-09-21T11:39:01.375 INFO:tasks.workunit.client.1.smithi149.stdout:9/22: sync 2024-09-21T11:39:01.375 INFO:tasks.workunit.client.1.smithi149.stdout:4/91: sync 2024-09-21T11:39:01.375 INFO:tasks.workunit.client.1.smithi149.stdout:0/21: sync 2024-09-21T11:39:01.377 INFO:tasks.workunit.client.1.smithi149.stdout:4/92: stat d4/d13/d15/d16 0 2024-09-21T11:39:01.379 INFO:tasks.workunit.client.1.smithi149.stdout:0/22: unlink f4 0 2024-09-21T11:39:01.379 INFO:tasks.workunit.client.1.smithi149.stdout:5/29: dwrite f3 [0,4194304] 0 2024-09-21T11:39:01.381 INFO:tasks.workunit.client.1.smithi149.stdout:5/30: chown d4/f5 49618085 1 2024-09-21T11:39:01.385 INFO:tasks.workunit.client.1.smithi149.stdout:1/42: dread d2/d5/fb [0,4194304] 0 2024-09-21T11:39:01.389 INFO:tasks.workunit.client.1.smithi149.stdout:0/23: write f2 [3885567,83855] 0 2024-09-21T11:39:01.390 INFO:tasks.workunit.client.1.smithi149.stdout:3/106: write d6/f8 [80952,47675] 0 2024-09-21T11:39:01.392 INFO:tasks.workunit.client.1.smithi149.stdout:9/23: dwrite f0 [0,4194304] 0 2024-09-21T11:39:01.393 INFO:tasks.workunit.client.1.smithi149.stdout:4/93: dread d4/d13/d15/f19 [0,4194304] 0 2024-09-21T11:39:01.395 INFO:tasks.workunit.client.1.smithi149.stdout:3/107: dread - d6/f1b zero size 2024-09-21T11:39:01.395 INFO:tasks.workunit.client.1.smithi149.stdout:0/24: unlink c6 0 2024-09-21T11:39:01.396 INFO:tasks.workunit.client.1.smithi149.stdout:3/108: dread - d6/f2a zero size 2024-09-21T11:39:01.396 INFO:tasks.workunit.client.1.smithi149.stdout:5/31: getdents d4 0 2024-09-21T11:39:01.397 INFO:tasks.workunit.client.1.smithi149.stdout:5/32: read f2 [3081062,101840] 0 2024-09-21T11:39:01.397 INFO:tasks.workunit.client.1.smithi149.stdout:5/33: readlink - no filename 2024-09-21T11:39:01.398 INFO:tasks.workunit.client.1.smithi149.stdout:9/24: rename l3 to l5 0 2024-09-21T11:39:01.398 INFO:tasks.workunit.client.1.smithi149.stdout:4/94: mknod d4/c1e 0 2024-09-21T11:39:01.399 INFO:tasks.workunit.client.1.smithi149.stdout:1/43: dread d2/d5/fb [0,4194304] 0 2024-09-21T11:39:01.400 INFO:tasks.workunit.client.1.smithi149.stdout:0/25: mknod c7 0 2024-09-21T11:39:01.403 INFO:tasks.workunit.client.1.smithi149.stdout:9/25: dread f0 [4194304,4194304] 0 2024-09-21T11:39:01.403 INFO:tasks.workunit.client.1.smithi149.stdout:5/34: mknod d4/c6 0 2024-09-21T11:39:01.404 INFO:tasks.workunit.client.1.smithi149.stdout:5/35: write d4/f5 [201910,11835] 0 2024-09-21T11:39:01.406 INFO:tasks.workunit.client.1.smithi149.stdout:4/95: creat d4/f1f x:0 0 0 2024-09-21T11:39:01.407 INFO:tasks.workunit.client.1.smithi149.stdout:9/26: dread f0 [0,4194304] 0 2024-09-21T11:39:01.407 INFO:tasks.workunit.client.1.smithi149.stdout:1/44: mknod d2/d5/d8/cc 0 2024-09-21T11:39:01.408 INFO:tasks.workunit.client.1.smithi149.stdout:3/109: fsync f2 0 2024-09-21T11:39:01.411 INFO:tasks.workunit.client.1.smithi149.stdout:5/36: mkdir d4/d7 0 2024-09-21T11:39:01.414 INFO:tasks.workunit.client.1.smithi149.stdout:3/110: dread d6/f12 [0,4194304] 0 2024-09-21T11:39:01.416 INFO:tasks.workunit.client.1.smithi149.stdout:1/45: dwrite d2/f4 [0,4194304] 0 2024-09-21T11:39:01.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/27: dwrite f0 [0,4194304] 0 2024-09-21T11:39:01.427 INFO:tasks.workunit.client.1.smithi149.stdout:3/111: symlink d6/d1d/d22/l2c 0 2024-09-21T11:39:01.429 INFO:tasks.workunit.client.1.smithi149.stdout:9/28: dread f0 [0,4194304] 0 2024-09-21T11:39:01.430 INFO:tasks.workunit.client.1.smithi149.stdout:9/29: write f0 [3057397,4071] 0 2024-09-21T11:39:01.430 INFO:tasks.workunit.client.1.smithi149.stdout:0/26: getdents . 0 2024-09-21T11:39:01.435 INFO:tasks.workunit.client.1.smithi149.stdout:9/30: dread f0 [0,4194304] 0 2024-09-21T11:39:01.435 INFO:tasks.workunit.client.1.smithi149.stdout:0/27: dread f2 [0,4194304] 0 2024-09-21T11:39:01.438 INFO:tasks.workunit.client.1.smithi149.stdout:0/28: dread f3 [0,4194304] 0 2024-09-21T11:39:01.438 INFO:tasks.workunit.client.1.smithi149.stdout:3/112: mknod d6/d1d/c2d 0 2024-09-21T11:39:01.439 INFO:tasks.workunit.client.1.smithi149.stdout:3/113: fdatasync d6/f8 0 2024-09-21T11:39:01.442 INFO:tasks.workunit.client.1.smithi149.stdout:9/31: stat l5 0 2024-09-21T11:39:01.443 INFO:tasks.workunit.client.1.smithi149.stdout:0/29: dread f3 [0,4194304] 0 2024-09-21T11:39:01.446 INFO:tasks.workunit.client.1.smithi149.stdout:3/114: dwrite d6/d1d/f1e [0,4194304] 0 2024-09-21T11:39:01.446 INFO:tasks.workunit.client.1.smithi149.stdout:4/96: truncate d4/d6/f9 216301 0 2024-09-21T11:39:01.446 INFO:tasks.workunit.client.1.smithi149.stdout:7/130: sync 2024-09-21T11:39:01.446 INFO:tasks.workunit.client.1.smithi149.stdout:8/58: sync 2024-09-21T11:39:01.450 INFO:tasks.workunit.client.1.smithi149.stdout:5/37: truncate d4/f5 171661 0 2024-09-21T11:39:01.454 INFO:tasks.workunit.client.1.smithi149.stdout:1/46: getdents d2/d5/d8 0 2024-09-21T11:39:01.455 INFO:tasks.workunit.client.1.smithi149.stdout:0/30: write f3 [894479,51571] 0 2024-09-21T11:39:01.455 INFO:tasks.workunit.client.1.smithi149.stdout:4/97: symlink d4/l20 0 2024-09-21T11:39:01.455 INFO:tasks.workunit.client.1.smithi149.stdout:0/31: rmdir - no directory 2024-09-21T11:39:01.456 INFO:tasks.workunit.client.1.smithi149.stdout:3/115: creat d6/d1f/f2e x:0 0 0 2024-09-21T11:39:01.456 INFO:tasks.workunit.client.1.smithi149.stdout:7/131: symlink d12/l25 0 2024-09-21T11:39:01.458 INFO:tasks.workunit.client.1.smithi149.stdout:8/59: mkdir d3/d12 0 2024-09-21T11:39:01.464 INFO:tasks.workunit.client.1.smithi149.stdout:7/132: mkdir d12/d15/d26 0 2024-09-21T11:39:01.465 INFO:tasks.workunit.client.1.smithi149.stdout:9/32: dwrite f0 [0,4194304] 0 2024-09-21T11:39:01.466 INFO:tasks.workunit.client.1.smithi149.stdout:3/116: mknod d6/d1f/c2f 0 2024-09-21T11:39:01.468 INFO:tasks.workunit.client.1.smithi149.stdout:0/32: dread f3 [0,4194304] 0 2024-09-21T11:39:01.469 INFO:tasks.workunit.client.1.smithi149.stdout:8/60: fdatasync f0 0 2024-09-21T11:39:01.471 INFO:tasks.workunit.client.1.smithi149.stdout:3/117: read d6/f8 [2937018,5323] 0 2024-09-21T11:39:01.472 INFO:tasks.workunit.client.1.smithi149.stdout:4/98: dread d4/f7 [0,4194304] 0 2024-09-21T11:39:01.473 INFO:tasks.workunit.client.1.smithi149.stdout:5/38: dread d4/f5 [0,4194304] 0 2024-09-21T11:39:01.475 INFO:tasks.workunit.client.1.smithi149.stdout:1/47: dwrite d2/d5/d8/fa [0,4194304] 0 2024-09-21T11:39:01.478 INFO:tasks.workunit.client.1.smithi149.stdout:1/48: chown d2/f4 473364884 1 2024-09-21T11:39:01.481 INFO:tasks.workunit.client.1.smithi149.stdout:7/133: dread f6 [0,4194304] 0 2024-09-21T11:39:01.485 INFO:tasks.workunit.client.1.smithi149.stdout:4/99: rename d4/d6/l11 to d4/d13/d10/l21 0 2024-09-21T11:39:01.486 INFO:tasks.workunit.client.1.smithi149.stdout:3/118: dwrite d6/f13 [0,4194304] 0 2024-09-21T11:39:01.486 INFO:tasks.workunit.client.1.smithi149.stdout:8/61: mknod d3/c13 0 2024-09-21T11:39:01.487 INFO:tasks.workunit.client.1.smithi149.stdout:8/62: readlink l2 0 2024-09-21T11:39:01.488 INFO:tasks.workunit.client.1.smithi149.stdout:1/49: mkdir d2/dd 0 2024-09-21T11:39:01.543 INFO:tasks.workunit.client.1.smithi149.stdout:2/53: sync 2024-09-21T11:39:01.543 INFO:tasks.workunit.client.1.smithi149.stdout:6/54: sync 2024-09-21T11:39:01.543 INFO:tasks.workunit.client.1.smithi149.stdout:5/39: dread f2 [0,4194304] 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:4/100: dread d4/d6/fb [0,4194304] 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:6/55: dread - d8/da/f10 zero size 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:6/56: chown l5 16385589 1 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:6/57: truncate d8/da/fd 898166 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:8/63: unlink f0 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:3/119: symlink d6/d1d/d22/l30 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:0/33: write f2 [1210511,126945] 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:0/34: chown f2 249561884 1 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:1/50: symlink d2/le 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:1/51: chown d2/d5/d8 7654 1 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:9/33: truncate f0 606059 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:2/54: mknod d8/da/cf 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:5/40: rename f3 to d4/f8 0 2024-09-21T11:39:01.544 INFO:tasks.workunit.client.1.smithi149.stdout:5/41: chown d4/d7 830272307 1 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:3/120: dwrite d6/d1d/f1e [0,4194304] 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:6/58: write d8/da/fc [4188823,37539] 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:9/34: mknod c6 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:6/59: chown d8/da/f10 10977 1 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:6/60: readlink l5 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:0/35: dwrite f2 [4194304,4194304] 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:6/61: readlink l7 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:0/36: write f2 [7385660,88671] 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:5/42: creat d4/f9 x:0 0 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:3/121: mknod d6/d1f/c31 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:7/134: link l11 d12/d15/d26/l27 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:2/55: creat d8/dd/f10 x:0 0 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:8/64: creat d3/f14 x:0 0 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:7/135: write fc [1227221,41452] 0 2024-09-21T11:39:01.545 INFO:tasks.workunit.client.1.smithi149.stdout:0/37: rename f2 to f8 0 2024-09-21T11:39:01.546 INFO:tasks.workunit.client.1.smithi149.stdout:6/62: truncate f4 3618354 0 2024-09-21T11:39:01.546 INFO:tasks.workunit.client.1.smithi149.stdout:1/52: dwrite d2/d5/fb [0,4194304] 0 2024-09-21T11:39:01.546 INFO:tasks.workunit.client.1.smithi149.stdout:6/63: write d8/da/f10 [176117,71652] 0 2024-09-21T11:39:01.546 INFO:tasks.workunit.client.1.smithi149.stdout:1/53: write d2/d5/f7 [1350127,72458] 0 2024-09-21T11:39:01.546 INFO:tasks.workunit.client.1.smithi149.stdout:9/35: dwrite f0 [0,4194304] 0 2024-09-21T11:39:01.546 INFO:tasks.workunit.client.1.smithi149.stdout:9/36: chown c2 1457983 1 2024-09-21T11:39:01.563 INFO:tasks.workunit.client.1.smithi149.stdout:1/54: fdatasync d2/d5/fb 0 2024-09-21T11:39:01.564 INFO:tasks.workunit.client.1.smithi149.stdout:1/55: write d2/d5/fb [60591,36887] 0 2024-09-21T11:39:01.564 INFO:tasks.workunit.client.1.smithi149.stdout:1/56: readlink d2/le 0 2024-09-21T11:39:01.565 INFO:tasks.workunit.client.1.smithi149.stdout:1/57: chown d2/le 68519402 1 2024-09-21T11:39:01.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/58: fsync d2/d5/fb 0 2024-09-21T11:39:01.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/59: write d2/d5/fb [2931669,114534] 0 2024-09-21T11:39:01.571 INFO:tasks.workunit.client.1.smithi149.stdout:1/60: dread d2/d5/d8/fa [0,4194304] 0 2024-09-21T11:39:01.613 INFO:tasks.workunit.client.1.smithi149.stdout:4/101: sync 2024-09-21T11:39:01.614 INFO:tasks.workunit.client.1.smithi149.stdout:4/102: fsync d4/d6/d18/f1c 0 2024-09-21T11:39:01.694 INFO:tasks.workunit.client.1.smithi149.stdout:5/43: fdatasync d4/f8 0 2024-09-21T11:39:01.696 INFO:tasks.workunit.client.1.smithi149.stdout:2/56: mkdir d8/d11 0 2024-09-21T11:39:01.698 INFO:tasks.workunit.client.1.smithi149.stdout:0/38: unlink c5 0 2024-09-21T11:39:01.700 INFO:tasks.workunit.client.1.smithi149.stdout:7/136: rename l3 to d12/l28 0 2024-09-21T11:39:01.704 INFO:tasks.workunit.client.1.smithi149.stdout:9/37: symlink l7 0 2024-09-21T11:39:01.704 INFO:tasks.workunit.client.1.smithi149.stdout:9/38: rmdir - no directory 2024-09-21T11:39:01.704 INFO:tasks.workunit.client.1.smithi149.stdout:9/39: fsync f0 0 2024-09-21T11:39:01.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/137: dwrite f5 [4194304,4194304] 0 2024-09-21T11:39:01.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/138: chown fa 1359 1 2024-09-21T11:39:01.708 INFO:tasks.workunit.client.1.smithi149.stdout:1/61: symlink d2/d5/d8/lf 0 2024-09-21T11:39:01.708 INFO:tasks.workunit.client.1.smithi149.stdout:1/62: chown d2/le 8850 1 2024-09-21T11:39:01.710 INFO:tasks.workunit.client.1.smithi149.stdout:1/63: write d2/d5/fb [3391746,109311] 0 2024-09-21T11:39:01.712 INFO:tasks.workunit.client.1.smithi149.stdout:8/65: unlink d3/ce 0 2024-09-21T11:39:01.714 INFO:tasks.workunit.client.1.smithi149.stdout:0/39: symlink l9 0 2024-09-21T11:39:01.720 INFO:tasks.workunit.client.1.smithi149.stdout:7/139: chown d12/l1b 10988438 1 2024-09-21T11:39:01.722 INFO:tasks.workunit.client.1.smithi149.stdout:5/44: creat d4/d7/fa x:0 0 0 2024-09-21T11:39:01.722 INFO:tasks.workunit.client.1.smithi149.stdout:5/45: fdatasync d4/f8 0 2024-09-21T11:39:01.723 INFO:tasks.workunit.client.1.smithi149.stdout:1/64: symlink d2/d5/d8/l10 0 2024-09-21T11:39:01.723 INFO:tasks.workunit.client.1.smithi149.stdout:5/46: read d4/f5 [127022,124095] 0 2024-09-21T11:39:01.724 INFO:tasks.workunit.client.1.smithi149.stdout:8/66: truncate d3/fa 957162 0 2024-09-21T11:39:01.724 INFO:tasks.workunit.client.1.smithi149.stdout:0/40: creat fa x:0 0 0 2024-09-21T11:39:01.726 INFO:tasks.workunit.client.1.smithi149.stdout:7/140: rmdir d12/d15/d26 39 2024-09-21T11:39:01.727 INFO:tasks.workunit.client.1.smithi149.stdout:7/141: write fb [788074,14686] 0 2024-09-21T11:39:01.728 INFO:tasks.workunit.client.1.smithi149.stdout:5/47: fdatasync d4/f5 0 2024-09-21T11:39:01.731 INFO:tasks.workunit.client.1.smithi149.stdout:0/41: mknod cb 0 2024-09-21T11:39:01.733 INFO:tasks.workunit.client.1.smithi149.stdout:7/142: dwrite d12/d15/f17 [0,4194304] 0 2024-09-21T11:39:01.736 INFO:tasks.workunit.client.1.smithi149.stdout:1/65: mkdir d2/dd/d11 0 2024-09-21T11:39:01.737 INFO:tasks.workunit.client.1.smithi149.stdout:5/48: creat d4/fb x:0 0 0 2024-09-21T11:39:01.738 INFO:tasks.workunit.client.1.smithi149.stdout:5/49: dread - d4/fb zero size 2024-09-21T11:39:01.739 INFO:tasks.workunit.client.1.smithi149.stdout:8/67: creat d3/d12/f15 x:0 0 0 2024-09-21T11:39:01.743 INFO:tasks.workunit.client.1.smithi149.stdout:0/42: symlink lc 0 2024-09-21T11:39:01.745 INFO:tasks.workunit.client.1.smithi149.stdout:7/143: rename f10 to d12/d15/d26/f29 0 2024-09-21T11:39:01.745 INFO:tasks.workunit.client.1.smithi149.stdout:7/144: chown d12/f14 5812 1 2024-09-21T11:39:01.747 INFO:tasks.workunit.client.1.smithi149.stdout:5/50: mknod d4/d7/cc 0 2024-09-21T11:39:01.749 INFO:tasks.workunit.client.1.smithi149.stdout:8/68: mknod d3/d4/c16 0 2024-09-21T11:39:01.751 INFO:tasks.workunit.client.1.smithi149.stdout:0/43: mkdir dd 0 2024-09-21T11:39:01.753 INFO:tasks.workunit.client.1.smithi149.stdout:1/66: link d2/d5/d8/fa d2/dd/f12 0 2024-09-21T11:39:01.755 INFO:tasks.workunit.client.1.smithi149.stdout:5/51: dwrite d4/fb [0,4194304] 0 2024-09-21T11:39:01.759 INFO:tasks.workunit.client.1.smithi149.stdout:1/67: rmdir d2/dd 39 2024-09-21T11:39:01.761 INFO:tasks.workunit.client.1.smithi149.stdout:5/52: rename c0 to d4/d7/cd 0 2024-09-21T11:39:01.765 INFO:tasks.workunit.client.1.smithi149.stdout:0/44: link f8 dd/fe 0 2024-09-21T11:39:01.766 INFO:tasks.workunit.client.1.smithi149.stdout:8/69: creat d3/f17 x:0 0 0 2024-09-21T11:39:01.767 INFO:tasks.workunit.client.1.smithi149.stdout:8/70: write d3/f14 [881909,72938] 0 2024-09-21T11:39:01.769 INFO:tasks.workunit.client.1.smithi149.stdout:5/53: mknod d4/d7/ce 0 2024-09-21T11:39:01.769 INFO:tasks.workunit.client.1.smithi149.stdout:7/145: link l2 d12/d15/l2a 0 2024-09-21T11:39:01.773 INFO:tasks.workunit.client.1.smithi149.stdout:8/71: mkdir d3/dd/d18 0 2024-09-21T11:39:01.773 INFO:tasks.workunit.client.1.smithi149.stdout:8/72: readlink l2 0 2024-09-21T11:39:01.774 INFO:tasks.workunit.client.1.smithi149.stdout:2/57: sync 2024-09-21T11:39:01.780 INFO:tasks.workunit.client.1.smithi149.stdout:1/68: creat d2/f13 x:0 0 0 2024-09-21T11:39:01.780 INFO:tasks.workunit.client.1.smithi149.stdout:1/69: write d2/d5/fb [33742,74711] 0 2024-09-21T11:39:01.783 INFO:tasks.workunit.client.1.smithi149.stdout:2/58: creat d8/dd/f12 x:0 0 0 2024-09-21T11:39:01.784 INFO:tasks.workunit.client.1.smithi149.stdout:2/59: dread - d8/dd/f10 zero size 2024-09-21T11:39:01.790 INFO:tasks.workunit.client.1.smithi149.stdout:1/70: truncate d2/dd/f12 4423414 0 2024-09-21T11:39:01.791 INFO:tasks.workunit.client.1.smithi149.stdout:7/146: rename d12/l25 to d12/d15/l2b 0 2024-09-21T11:39:01.792 INFO:tasks.workunit.client.1.smithi149.stdout:2/60: mkdir d8/da/d13 0 2024-09-21T11:39:01.794 INFO:tasks.workunit.client.1.smithi149.stdout:1/71: rmdir d2/d5/d8 39 2024-09-21T11:39:01.795 INFO:tasks.workunit.client.1.smithi149.stdout:7/147: chown f4 470677235 1 2024-09-21T11:39:01.795 INFO:tasks.workunit.client.1.smithi149.stdout:7/148: stat ff 0 2024-09-21T11:39:01.798 INFO:tasks.workunit.client.1.smithi149.stdout:2/61: dwrite d8/dd/f10 [0,4194304] 0 2024-09-21T11:39:01.801 INFO:tasks.workunit.client.1.smithi149.stdout:1/72: rename d2/d5/d8/cc to d2/d5/d8/c14 0 2024-09-21T11:39:01.802 INFO:tasks.workunit.client.1.smithi149.stdout:2/62: rename d8/da/cb to d8/da/d13/c14 0 2024-09-21T11:39:01.808 INFO:tasks.workunit.client.1.smithi149.stdout:1/73: dwrite d2/f13 [0,4194304] 0 2024-09-21T11:39:01.813 INFO:tasks.workunit.client.1.smithi149.stdout:1/74: mknod d2/d5/d8/c15 0 2024-09-21T11:39:01.816 INFO:tasks.workunit.client.1.smithi149.stdout:1/75: rename d2/d5/d8/lf to d2/d5/d8/l16 0 2024-09-21T11:39:01.818 INFO:tasks.workunit.client.1.smithi149.stdout:1/76: creat d2/d5/d8/f17 x:0 0 0 2024-09-21T11:39:01.822 INFO:tasks.workunit.client.1.smithi149.stdout:1/77: link d2/d5/fb d2/f18 0 2024-09-21T11:39:01.829 INFO:tasks.workunit.client.1.smithi149.stdout:9/40: sync 2024-09-21T11:39:01.830 INFO:tasks.workunit.client.1.smithi149.stdout:1/78: dwrite d2/d5/d8/f17 [0,4194304] 0 2024-09-21T11:39:01.831 INFO:tasks.workunit.client.1.smithi149.stdout:9/41: mknod c8 0 2024-09-21T11:39:01.833 INFO:tasks.workunit.client.1.smithi149.stdout:1/79: write d2/d5/d8/fa [3825364,53418] 0 2024-09-21T11:39:01.834 INFO:tasks.workunit.client.1.smithi149.stdout:9/42: rename c8 to c9 0 2024-09-21T11:39:01.835 INFO:tasks.workunit.client.1.smithi149.stdout:9/43: write f0 [2997380,99365] 0 2024-09-21T11:39:01.841 INFO:tasks.workunit.client.1.smithi149.stdout:1/80: dwrite d2/d5/d8/f17 [0,4194304] 0 2024-09-21T11:39:01.842 INFO:tasks.workunit.client.1.smithi149.stdout:9/44: link c6 ca 0 2024-09-21T11:39:01.847 INFO:tasks.workunit.client.1.smithi149.stdout:1/81: rename d2/d5/d8/c15 to d2/d5/c19 0 2024-09-21T11:39:01.907 INFO:tasks.workunit.client.1.smithi149.stdout:2/63: getdents d8 0 2024-09-21T11:39:01.909 INFO:tasks.workunit.client.1.smithi149.stdout:2/64: truncate d8/dd/f10 5193289 0 2024-09-21T11:39:01.909 INFO:tasks.workunit.client.1.smithi149.stdout:2/65: readlink d8/le 0 2024-09-21T11:39:01.911 INFO:tasks.workunit.client.1.smithi149.stdout:3/122: dwrite d6/ff [4194304,4194304] 0 2024-09-21T11:39:01.914 INFO:tasks.workunit.client.1.smithi149.stdout:2/66: symlink d8/da/l15 0 2024-09-21T11:39:01.914 INFO:tasks.workunit.client.1.smithi149.stdout:4/103: write d4/d6/fb [740363,38769] 0 2024-09-21T11:39:01.915 INFO:tasks.workunit.client.1.smithi149.stdout:2/67: read f3 [355216,103824] 0 2024-09-21T11:39:01.917 INFO:tasks.workunit.client.1.smithi149.stdout:3/123: rename d6/c11 to d6/c32 0 2024-09-21T11:39:01.917 INFO:tasks.workunit.client.1.smithi149.stdout:3/124: fsync d6/d1d/f23 0 2024-09-21T11:39:01.919 INFO:tasks.workunit.client.1.smithi149.stdout:3/125: rmdir d6/d1d/d22 39 2024-09-21T11:39:01.922 INFO:tasks.workunit.client.1.smithi149.stdout:3/126: creat d6/d1f/d27/f33 x:0 0 0 2024-09-21T11:39:01.923 INFO:tasks.workunit.client.1.smithi149.stdout:5/54: truncate d4/f5 776390 0 2024-09-21T11:39:01.925 INFO:tasks.workunit.client.1.smithi149.stdout:5/55: unlink d4/fb 0 2024-09-21T11:39:01.928 INFO:tasks.workunit.client.1.smithi149.stdout:3/127: rename c5 to d6/d1d/d22/c34 0 2024-09-21T11:39:01.931 INFO:tasks.workunit.client.1.smithi149.stdout:5/56: symlink d4/lf 0 2024-09-21T11:39:01.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/57: dwrite d4/f8 [0,4194304] 0 2024-09-21T11:39:01.938 INFO:tasks.workunit.client.1.smithi149.stdout:3/128: link d6/ff d6/d1f/f35 0 2024-09-21T11:39:01.938 INFO:tasks.workunit.client.1.smithi149.stdout:3/129: chown c4 51288 1 2024-09-21T11:39:01.940 INFO:tasks.workunit.client.1.smithi149.stdout:5/58: mknod d4/c10 0 2024-09-21T11:39:01.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/59: write d4/f8 [2303969,61147] 0 2024-09-21T11:39:01.942 INFO:tasks.workunit.client.1.smithi149.stdout:3/130: creat d6/d1f/d27/f36 x:0 0 0 2024-09-21T11:39:01.943 INFO:tasks.workunit.client.1.smithi149.stdout:5/60: chown d4/c6 212441693 1 2024-09-21T11:39:01.943 INFO:tasks.workunit.client.1.smithi149.stdout:5/61: chown d4/c10 2263 1 2024-09-21T11:39:01.945 INFO:tasks.workunit.client.1.smithi149.stdout:1/82: getdents d2/dd 0 2024-09-21T11:39:01.948 INFO:tasks.workunit.client.1.smithi149.stdout:5/62: unlink d4/f8 0 2024-09-21T11:39:01.949 INFO:tasks.workunit.client.1.smithi149.stdout:9/45: sync 2024-09-21T11:39:01.949 INFO:tasks.workunit.client.1.smithi149.stdout:5/63: write d4/f9 [669075,57885] 0 2024-09-21T11:39:01.949 INFO:tasks.workunit.client.1.smithi149.stdout:9/46: chown c4 802 1 2024-09-21T11:39:01.950 INFO:tasks.workunit.client.1.smithi149.stdout:3/131: mkdir d6/d1d/d37 0 2024-09-21T11:39:01.951 INFO:tasks.workunit.client.1.smithi149.stdout:3/132: write d6/d1d/f1e [4536851,52764] 0 2024-09-21T11:39:01.956 INFO:tasks.workunit.client.1.smithi149.stdout:9/47: dwrite f0 [0,4194304] 0 2024-09-21T11:39:01.959 INFO:tasks.workunit.client.1.smithi149.stdout:3/133: creat d6/f38 x:0 0 0 2024-09-21T11:39:01.963 INFO:tasks.workunit.client.1.smithi149.stdout:0/45: truncate f3 3411831 0 2024-09-21T11:39:01.967 INFO:tasks.workunit.client.1.smithi149.stdout:1/83: creat d2/f1a x:0 0 0 2024-09-21T11:39:01.968 INFO:tasks.workunit.client.1.smithi149.stdout:1/84: write d2/f13 [3991302,53448] 0 2024-09-21T11:39:01.972 INFO:tasks.workunit.client.1.smithi149.stdout:8/73: truncate d3/f14 615596 0 2024-09-21T11:39:01.972 INFO:tasks.workunit.client.1.smithi149.stdout:3/134: symlink d6/d1d/d37/l39 0 2024-09-21T11:39:01.973 INFO:tasks.workunit.client.1.smithi149.stdout:3/135: fdatasync d6/d1f/d27/f36 0 2024-09-21T11:39:01.975 INFO:tasks.workunit.client.1.smithi149.stdout:7/149: readlink d12/d15/l2b 0 2024-09-21T11:39:01.979 INFO:tasks.workunit.client.1.smithi149.stdout:8/74: symlink d3/d12/l19 0 2024-09-21T11:39:01.982 INFO:tasks.workunit.client.1.smithi149.stdout:3/136: unlink d6/d1d/d22/l29 0 2024-09-21T11:39:01.985 INFO:tasks.workunit.client.1.smithi149.stdout:1/85: symlink d2/d5/l1b 0 2024-09-21T11:39:01.987 INFO:tasks.workunit.client.1.smithi149.stdout:8/75: rename d3/d4/ff to d3/dd/f1a 0 2024-09-21T11:39:01.988 INFO:tasks.workunit.client.1.smithi149.stdout:3/137: dwrite d6/d1d/f1e [0,4194304] 0 2024-09-21T11:39:01.988 INFO:tasks.workunit.client.1.smithi149.stdout:8/76: dread - d3/d12/f15 zero size 2024-09-21T11:39:01.989 INFO:tasks.workunit.client.1.smithi149.stdout:8/77: chown d3/d4/cb 0 1 2024-09-21T11:39:01.989 INFO:tasks.workunit.client.1.smithi149.stdout:3/138: write d6/f8 [2369205,98995] 0 2024-09-21T11:39:01.990 INFO:tasks.workunit.client.1.smithi149.stdout:8/78: chown d3/f17 56 1 2024-09-21T11:39:01.990 INFO:tasks.workunit.client.1.smithi149.stdout:8/79: dread - d3/f10 zero size 2024-09-21T11:39:01.996 INFO:tasks.workunit.client.1.smithi149.stdout:7/150: creat d12/d15/f2c x:0 0 0 2024-09-21T11:39:01.996 INFO:tasks.workunit.client.1.smithi149.stdout:1/86: fsync d2/f18 0 2024-09-21T11:39:01.997 INFO:tasks.workunit.client.1.smithi149.stdout:3/139: mkdir d6/d1d/d37/d3a 0 2024-09-21T11:39:01.998 INFO:tasks.workunit.client.1.smithi149.stdout:3/140: fsync d6/f2a 0 2024-09-21T11:39:02.001 INFO:tasks.workunit.client.1.smithi149.stdout:1/87: dread d2/f13 [0,4194304] 0 2024-09-21T11:39:02.005 INFO:tasks.workunit.client.1.smithi149.stdout:3/141: creat d6/d1d/d37/f3b x:0 0 0 2024-09-21T11:39:02.006 INFO:tasks.workunit.client.1.smithi149.stdout:8/80: dwrite d3/dd/f1a [0,4194304] 0 2024-09-21T11:39:02.006 INFO:tasks.workunit.client.1.smithi149.stdout:9/48: getdents . 0 2024-09-21T11:39:02.007 INFO:tasks.workunit.client.1.smithi149.stdout:4/104: sync 2024-09-21T11:39:02.007 INFO:tasks.workunit.client.1.smithi149.stdout:3/142: dread - d6/f21 zero size 2024-09-21T11:39:02.008 INFO:tasks.workunit.client.1.smithi149.stdout:8/81: write d3/d12/f15 [754798,67041] 0 2024-09-21T11:39:02.014 INFO:tasks.workunit.client.1.smithi149.stdout:9/49: dread f0 [0,4194304] 0 2024-09-21T11:39:02.015 INFO:tasks.workunit.client.1.smithi149.stdout:4/105: symlink d4/d13/l22 0 2024-09-21T11:39:02.018 INFO:tasks.workunit.client.1.smithi149.stdout:8/82: creat d3/dd/f1b x:0 0 0 2024-09-21T11:39:02.019 INFO:tasks.workunit.client.1.smithi149.stdout:8/83: chown d3/d4/cc 0 1 2024-09-21T11:39:02.020 INFO:tasks.workunit.client.1.smithi149.stdout:8/84: write d3/dd/f11 [40066,130225] 0 2024-09-21T11:39:02.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/85: rename d3/dd/d18 to d3/dd/d18/d1c 22 2024-09-21T11:39:02.024 INFO:tasks.workunit.client.1.smithi149.stdout:9/50: write f0 [2516429,110048] 0 2024-09-21T11:39:02.026 INFO:tasks.workunit.client.0.smithi118.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T11:39:02.028 INFO:tasks.workunit.client.1.smithi149.stdout:3/143: link d6/f28 d6/d1f/d27/f3c 0 2024-09-21T11:39:02.030 INFO:tasks.workunit.client.1.smithi149.stdout:9/51: dwrite f0 [0,4194304] 0 2024-09-21T11:39:02.031 INFO:tasks.workunit.client.1.smithi149.stdout:9/52: write f0 [1915825,85898] 0 2024-09-21T11:39:02.033 INFO:tasks.workunit.client.0.smithi118.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T11:39:02.033 INFO:tasks.workunit.client.0.smithi118.stderr:+ make 2024-09-21T11:39:02.036 INFO:tasks.workunit.client.1.smithi149.stdout:8/86: creat d3/f1d x:0 0 0 2024-09-21T11:39:02.038 INFO:tasks.workunit.client.1.smithi149.stdout:9/53: dwrite f0 [0,4194304] 0 2024-09-21T11:39:02.040 INFO:tasks.workunit.client.1.smithi149.stdout:6/64: dread f4 [0,4194304] 0 2024-09-21T11:39:02.041 INFO:tasks.workunit.client.1.smithi149.stdout:2/68: sync 2024-09-21T11:39:02.041 INFO:tasks.workunit.client.1.smithi149.stdout:8/87: rmdir d3/dd 39 2024-09-21T11:39:02.043 INFO:tasks.workunit.client.1.smithi149.stdout:6/65: dread d8/da/fd [0,4194304] 0 2024-09-21T11:39:02.048 INFO:tasks.workunit.client.1.smithi149.stdout:9/54: dwrite f0 [0,4194304] 0 2024-09-21T11:39:02.049 INFO:tasks.workunit.client.1.smithi149.stdout:6/66: dread d8/da/f10 [0,4194304] 0 2024-09-21T11:39:02.049 INFO:tasks.workunit.client.1.smithi149.stdout:8/88: mknod d3/d4/c1e 0 2024-09-21T11:39:02.052 INFO:tasks.workunit.client.1.smithi149.stdout:2/69: dwrite d8/dd/f12 [0,4194304] 0 2024-09-21T11:39:02.056 INFO:tasks.workunit.client.1.smithi149.stdout:9/55: dwrite f0 [0,4194304] 0 2024-09-21T11:39:02.079 INFO:tasks.workunit.client.1.smithi149.stdout:6/67: symlink d8/da/l12 0 2024-09-21T11:39:02.083 INFO:tasks.workunit.client.1.smithi149.stdout:2/70: symlink d8/dd/l16 0 2024-09-21T11:39:02.085 INFO:tasks.workunit.client.1.smithi149.stdout:9/56: symlink lb 0 2024-09-21T11:39:02.087 INFO:tasks.workunit.client.1.smithi149.stdout:6/68: dwrite d8/da/fc [0,4194304] 0 2024-09-21T11:39:02.088 INFO:tasks.workunit.client.1.smithi149.stdout:2/71: dread f3 [0,4194304] 0 2024-09-21T11:39:02.089 INFO:tasks.workunit.client.1.smithi149.stdout:9/57: creat fc x:0 0 0 2024-09-21T11:39:02.090 INFO:tasks.workunit.client.1.smithi149.stdout:9/58: chown l5 192819 1 2024-09-21T11:39:02.094 INFO:tasks.workunit.client.1.smithi149.stdout:6/69: unlink d8/da/f10 0 2024-09-21T11:39:02.095 INFO:tasks.workunit.client.1.smithi149.stdout:0/46: dread f3 [0,4194304] 0 2024-09-21T11:39:02.096 INFO:tasks.workunit.client.1.smithi149.stdout:0/47: chown lc 8 1 2024-09-21T11:39:02.098 INFO:tasks.workunit.client.1.smithi149.stdout:9/59: mknod cd 0 2024-09-21T11:39:02.100 INFO:tasks.workunit.client.1.smithi149.stdout:6/70: unlink d8/lb 0 2024-09-21T11:39:02.113 INFO:tasks.workunit.client.1.smithi149.stdout:7/151: getdents d12/d15 0 2024-09-21T11:39:02.115 INFO:tasks.workunit.client.1.smithi149.stdout:1/88: dwrite d2/d5/fb [0,4194304] 0 2024-09-21T11:39:02.119 INFO:tasks.workunit.client.1.smithi149.stdout:1/89: dread d2/d5/d8/f17 [0,4194304] 0 2024-09-21T11:39:02.120 INFO:tasks.workunit.client.1.smithi149.stdout:9/60: link c2 ce 0 2024-09-21T11:39:02.121 INFO:tasks.workunit.client.1.smithi149.stdout:9/61: write fc [488088,25227] 0 2024-09-21T11:39:02.123 INFO:tasks.workunit.client.1.smithi149.stdout:1/90: dread d2/f18 [0,4194304] 0 2024-09-21T11:39:02.124 INFO:tasks.workunit.client.1.smithi149.stdout:7/152: fsync f4 0 2024-09-21T11:39:02.128 INFO:tasks.workunit.client.1.smithi149.stdout:0/48: getdents dd 0 2024-09-21T11:39:02.139 INFO:tasks.workunit.client.1.smithi149.stdout:7/153: creat d12/d15/f2d x:0 0 0 2024-09-21T11:39:02.140 INFO:tasks.workunit.client.1.smithi149.stdout:3/144: getdents d6/d1f/d27 0 2024-09-21T11:39:02.140 INFO:tasks.workunit.client.1.smithi149.stdout:7/154: write d12/f14 [938175,33845] 0 2024-09-21T11:39:02.143 INFO:tasks.workunit.client.1.smithi149.stdout:4/106: truncate d4/d6/fb 91563 0 2024-09-21T11:39:02.147 INFO:tasks.workunit.client.1.smithi149.stdout:5/64: write d4/f5 [1754191,84450] 0 2024-09-21T11:39:02.147 INFO:tasks.workunit.client.1.smithi149.stdout:1/91: mkdir d2/dd/d11/d1c 0 2024-09-21T11:39:02.148 INFO:tasks.workunit.client.1.smithi149.stdout:1/92: write d2/d5/d8/fa [2344857,11024] 0 2024-09-21T11:39:02.149 INFO:tasks.workunit.client.1.smithi149.stdout:8/89: getdents d3/d4 0 2024-09-21T11:39:02.150 INFO:tasks.workunit.client.1.smithi149.stdout:3/145: symlink d6/l3d 0 2024-09-21T11:39:02.150 INFO:tasks.workunit.client.1.smithi149.stdout:3/146: chown d6/f1a 66859532 1 2024-09-21T11:39:02.151 INFO:tasks.workunit.client.1.smithi149.stdout:7/155: dread - d12/d15/f20 zero size 2024-09-21T11:39:02.152 INFO:tasks.workunit.client.1.smithi149.stdout:7/156: dread fa [0,4194304] 0 2024-09-21T11:39:02.154 INFO:tasks.workunit.client.1.smithi149.stdout:5/65: symlink d4/l11 0 2024-09-21T11:39:02.158 INFO:tasks.workunit.client.1.smithi149.stdout:8/90: truncate d3/dd/f1b 189350 0 2024-09-21T11:39:02.160 INFO:tasks.workunit.client.1.smithi149.stdout:3/147: truncate f2 1124750 0 2024-09-21T11:39:02.166 INFO:tasks.workunit.client.1.smithi149.stdout:5/66: creat d4/f12 x:0 0 0 2024-09-21T11:39:02.169 INFO:tasks.workunit.client.1.smithi149.stdout:8/91: symlink d3/dd/l1f 0 2024-09-21T11:39:02.170 INFO:tasks.workunit.client.1.smithi149.stdout:3/148: creat d6/d1f/f3e x:0 0 0 2024-09-21T11:39:02.176 INFO:tasks.workunit.client.1.smithi149.stdout:1/93: link d2/d5/d8/f17 d2/d5/f1d 0 2024-09-21T11:39:02.177 INFO:tasks.workunit.client.1.smithi149.stdout:3/149: rmdir d6/d1d/d37 39 2024-09-21T11:39:02.177 INFO:tasks.workunit.client.1.smithi149.stdout:3/150: dread - d6/f2a zero size 2024-09-21T11:39:02.179 INFO:tasks.workunit.client.1.smithi149.stdout:7/157: rename d12/d15/f1d to d12/d15/d26/f2e 0 2024-09-21T11:39:02.179 INFO:tasks.workunit.client.1.smithi149.stdout:7/158: fsync fb 0 2024-09-21T11:39:02.179 INFO:tasks.workunit.client.1.smithi149.stdout:1/94: dread d2/f18 [0,4194304] 0 2024-09-21T11:39:02.184 INFO:tasks.workunit.client.1.smithi149.stdout:7/159: dwrite d12/f1e [0,4194304] 0 2024-09-21T11:39:02.191 INFO:tasks.workunit.client.1.smithi149.stdout:3/151: mkdir d6/d1d/d37/d3f 0 2024-09-21T11:39:02.192 INFO:tasks.workunit.client.1.smithi149.stdout:3/152: fdatasync d6/d1f/d27/f36 0 2024-09-21T11:39:02.197 INFO:tasks.workunit.client.1.smithi149.stdout:2/72: truncate d8/dd/f10 2327602 0 2024-09-21T11:39:02.200 INFO:tasks.workunit.client.1.smithi149.stdout:6/71: truncate d8/da/fc 1473155 0 2024-09-21T11:39:02.202 INFO:tasks.workunit.client.0.smithi118.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T11:39:02.204 INFO:tasks.workunit.client.1.smithi149.stdout:8/92: rename d3/dd/f11 to d3/f20 0 2024-09-21T11:39:02.206 INFO:tasks.workunit.client.1.smithi149.stdout:7/160: unlink d12/l16 0 2024-09-21T11:39:02.208 INFO:tasks.workunit.client.1.smithi149.stdout:2/73: mknod d8/dd/c17 0 2024-09-21T11:39:02.208 INFO:tasks.workunit.client.1.smithi149.stdout:2/74: read f3 [596564,113034] 0 2024-09-21T11:39:02.208 INFO:tasks.workunit.client.1.smithi149.stdout:2/75: stat d8/dd/f12 0 2024-09-21T11:39:02.210 INFO:tasks.workunit.client.1.smithi149.stdout:1/95: creat d2/f1e x:0 0 0 2024-09-21T11:39:02.211 INFO:tasks.workunit.client.1.smithi149.stdout:1/96: write d2/f4 [3606047,88724] 0 2024-09-21T11:39:02.213 INFO:tasks.workunit.client.1.smithi149.stdout:3/153: creat d6/d1d/d37/d3f/f40 x:0 0 0 2024-09-21T11:39:02.213 INFO:tasks.workunit.client.1.smithi149.stdout:3/154: dread - d6/f1b zero size 2024-09-21T11:39:02.217 INFO:tasks.workunit.client.1.smithi149.stdout:8/93: mkdir d3/dd/d21 0 2024-09-21T11:39:02.219 INFO:tasks.workunit.client.1.smithi149.stdout:8/94: dread d3/dd/f1b [0,4194304] 0 2024-09-21T11:39:02.220 INFO:tasks.workunit.client.1.smithi149.stdout:0/49: write f8 [7244876,40763] 0 2024-09-21T11:39:02.220 INFO:tasks.workunit.client.1.smithi149.stdout:3/155: dwrite d6/f1a [0,4194304] 0 2024-09-21T11:39:02.221 INFO:tasks.workunit.client.1.smithi149.stdout:0/50: chown dd 17820 1 2024-09-21T11:39:02.223 INFO:tasks.workunit.client.1.smithi149.stdout:6/72: symlink d8/da/d11/l13 0 2024-09-21T11:39:02.236 INFO:tasks.workunit.client.1.smithi149.stdout:8/95: rename d3/dd/l1f to d3/dd/d18/l22 0 2024-09-21T11:39:02.236 INFO:tasks.workunit.client.1.smithi149.stdout:8/96: chown d3/d12/l19 1067808797 1 2024-09-21T11:39:02.238 INFO:tasks.workunit.client.1.smithi149.stdout:6/73: mkdir d8/da/d14 0 2024-09-21T11:39:02.241 INFO:tasks.workunit.client.1.smithi149.stdout:1/97: link d2/f4 d2/d5/d8/f1f 0 2024-09-21T11:39:02.246 INFO:tasks.workunit.client.1.smithi149.stdout:5/67: getdents d4 0 2024-09-21T11:39:02.247 INFO:tasks.workunit.client.1.smithi149.stdout:8/97: symlink d3/dd/l23 0 2024-09-21T11:39:02.247 INFO:tasks.workunit.client.1.smithi149.stdout:8/98: chown d3/dd/f1a 145 1 2024-09-21T11:39:02.252 INFO:tasks.workunit.client.1.smithi149.stdout:5/68: dwrite d4/f12 [0,4194304] 0 2024-09-21T11:39:02.254 INFO:tasks.workunit.client.1.smithi149.stdout:6/74: creat d8/da/d14/f15 x:0 0 0 2024-09-21T11:39:02.259 INFO:tasks.workunit.client.1.smithi149.stdout:5/69: dread d4/f9 [0,4194304] 0 2024-09-21T11:39:02.267 INFO:tasks.workunit.client.1.smithi149.stdout:8/99: truncate d3/f8 297502 0 2024-09-21T11:39:02.268 INFO:tasks.workunit.client.1.smithi149.stdout:1/98: creat d2/f20 x:0 0 0 2024-09-21T11:39:02.269 INFO:tasks.workunit.client.1.smithi149.stdout:1/99: write d2/f1a [874062,66392] 0 2024-09-21T11:39:02.269 INFO:tasks.workunit.client.1.smithi149.stdout:5/70: symlink d4/d7/l13 0 2024-09-21T11:39:02.275 INFO:tasks.workunit.client.1.smithi149.stdout:8/100: creat d3/d12/f24 x:0 0 0 2024-09-21T11:39:02.276 INFO:tasks.workunit.client.1.smithi149.stdout:8/101: read d3/fa [387064,104969] 0 2024-09-21T11:39:02.277 INFO:tasks.workunit.client.1.smithi149.stdout:8/102: chown d3/d4 1095432 1 2024-09-21T11:39:02.278 INFO:tasks.workunit.client.1.smithi149.stdout:5/71: symlink d4/d7/l14 0 2024-09-21T11:39:02.279 INFO:tasks.workunit.client.1.smithi149.stdout:5/72: chown d4/lf 79 1 2024-09-21T11:39:02.284 INFO:tasks.workunit.client.1.smithi149.stdout:5/73: mknod d4/d7/c15 0 2024-09-21T11:39:02.286 INFO:tasks.workunit.client.1.smithi149.stdout:1/100: creat d2/f21 x:0 0 0 2024-09-21T11:39:02.287 INFO:tasks.workunit.client.1.smithi149.stdout:3/156: getdents d6/d1d/d37/d3f 0 2024-09-21T11:39:02.289 INFO:tasks.workunit.client.1.smithi149.stdout:5/74: symlink d4/d7/l16 0 2024-09-21T11:39:02.289 INFO:tasks.workunit.client.1.smithi149.stdout:1/101: dread d2/f4 [0,4194304] 0 2024-09-21T11:39:02.291 INFO:tasks.workunit.client.1.smithi149.stdout:8/103: creat d3/f25 x:0 0 0 2024-09-21T11:39:02.292 INFO:tasks.workunit.client.1.smithi149.stdout:5/75: symlink d4/d7/l17 0 2024-09-21T11:39:02.292 INFO:tasks.workunit.client.1.smithi149.stdout:2/76: write f7 [693929,84124] 0 2024-09-21T11:39:02.293 INFO:tasks.workunit.client.1.smithi149.stdout:5/76: chown d4/c6 2559 1 2024-09-21T11:39:02.295 INFO:tasks.workunit.client.1.smithi149.stdout:9/62: sync 2024-09-21T11:39:02.295 INFO:tasks.workunit.client.1.smithi149.stdout:1/102: creat d2/dd/f22 x:0 0 0 2024-09-21T11:39:02.296 INFO:tasks.workunit.client.1.smithi149.stdout:9/63: fdatasync fc 0 2024-09-21T11:39:02.297 INFO:tasks.workunit.client.1.smithi149.stdout:2/77: write d8/dd/f12 [4490435,44464] 0 2024-09-21T11:39:02.298 INFO:tasks.workunit.client.1.smithi149.stdout:8/104: dread d3/dd/f1b [0,4194304] 0 2024-09-21T11:39:02.299 INFO:tasks.workunit.client.1.smithi149.stdout:5/77: creat d4/f18 x:0 0 0 2024-09-21T11:39:02.299 INFO:tasks.workunit.client.1.smithi149.stdout:2/78: stat d8/da/l15 0 2024-09-21T11:39:02.301 INFO:tasks.workunit.client.1.smithi149.stdout:4/107: dwrite d4/d6/fb [0,4194304] 0 2024-09-21T11:39:02.302 INFO:tasks.workunit.client.1.smithi149.stdout:8/105: chown d3/dd/f1b 24 1 2024-09-21T11:39:02.309 INFO:tasks.workunit.client.1.smithi149.stdout:5/78: creat d4/f19 x:0 0 0 2024-09-21T11:39:02.313 INFO:tasks.workunit.client.1.smithi149.stdout:9/64: dread f0 [0,4194304] 0 2024-09-21T11:39:02.313 INFO:tasks.workunit.client.1.smithi149.stdout:5/79: chown d4/c10 375 1 2024-09-21T11:39:02.313 INFO:tasks.workunit.client.1.smithi149.stdout:4/108: mkdir d4/d13/d15/d16/d23 0 2024-09-21T11:39:02.314 INFO:tasks.workunit.client.1.smithi149.stdout:1/103: dwrite d2/f20 [0,4194304] 0 2024-09-21T11:39:02.314 INFO:tasks.workunit.client.1.smithi149.stdout:5/80: readlink d4/d7/l17 0 2024-09-21T11:39:02.316 INFO:tasks.workunit.client.1.smithi149.stdout:1/104: chown d2/dd/f12 15485 1 2024-09-21T11:39:02.317 INFO:tasks.workunit.client.1.smithi149.stdout:5/81: write d4/d7/fa [1037396,25083] 0 2024-09-21T11:39:02.318 INFO:tasks.workunit.client.1.smithi149.stdout:8/106: dwrite d3/d12/f24 [0,4194304] 0 2024-09-21T11:39:02.318 INFO:tasks.workunit.client.1.smithi149.stdout:4/109: mkdir d4/d13/d24 0 2024-09-21T11:39:02.321 INFO:tasks.workunit.client.1.smithi149.stdout:5/82: truncate d4/f19 404764 0 2024-09-21T11:39:02.321 INFO:tasks.workunit.client.1.smithi149.stdout:9/65: chown ce 9 1 2024-09-21T11:39:02.323 INFO:tasks.workunit.client.1.smithi149.stdout:4/110: mknod d4/d13/c25 0 2024-09-21T11:39:02.323 INFO:tasks.workunit.client.1.smithi149.stdout:9/66: chown l7 1 1 2024-09-21T11:39:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:01 smithi118 ceph-mon[28757]: pgmap v16: 65 pgs: 65 active+clean; 273 MiB data, 982 MiB used, 535 GiB / 536 GiB avail; 183 KiB/s rd, 11 MiB/s wr, 431 op/s 2024-09-21T11:39:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:01 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:01 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:01 smithi118 ceph-mon[28757]: Reconfiguring prometheus.smithi118 (dependencies changed)... 2024-09-21T11:39:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:01 smithi118 ceph-mon[28757]: Reconfiguring daemon prometheus.smithi118 on smithi118 2024-09-21T11:39:02.328 INFO:tasks.workunit.client.1.smithi149.stdout:5/83: unlink d4/d7/l13 0 2024-09-21T11:39:02.331 INFO:tasks.workunit.client.1.smithi149.stdout:1/105: dread d2/f1a [0,4194304] 0 2024-09-21T11:39:02.332 INFO:tasks.workunit.client.1.smithi149.stdout:4/111: mknod d4/d6/d18/c26 0 2024-09-21T11:39:02.332 INFO:tasks.workunit.client.1.smithi149.stdout:5/84: write d4/f12 [522656,74469] 0 2024-09-21T11:39:02.333 INFO:tasks.workunit.client.1.smithi149.stdout:5/85: fdatasync d4/f19 0 2024-09-21T11:39:02.334 INFO:tasks.workunit.client.1.smithi149.stdout:6/75: dwrite d8/da/fd [0,4194304] 0 2024-09-21T11:39:02.335 INFO:tasks.workunit.client.1.smithi149.stdout:5/86: write d4/f12 [3729828,128120] 0 2024-09-21T11:39:02.337 INFO:tasks.workunit.client.1.smithi149.stdout:5/87: readlink d4/d7/l16 0 2024-09-21T11:39:02.338 INFO:tasks.workunit.client.1.smithi149.stdout:5/88: write d4/f5 [1044938,78418] 0 2024-09-21T11:39:02.344 INFO:tasks.workunit.client.1.smithi149.stdout:4/112: fdatasync d4/f7 0 2024-09-21T11:39:02.351 INFO:tasks.workunit.client.1.smithi149.stdout:6/76: fsync d8/da/fc 0 2024-09-21T11:39:02.355 INFO:tasks.workunit.client.1.smithi149.stdout:9/67: link l7 lf 0 2024-09-21T11:39:02.355 INFO:tasks.workunit.client.1.smithi149.stdout:9/68: chown cd 5 1 2024-09-21T11:39:02.357 INFO:tasks.workunit.client.1.smithi149.stdout:5/89: mkdir d4/d7/d1a 0 2024-09-21T11:39:02.358 INFO:tasks.workunit.client.1.smithi149.stdout:5/90: truncate d4/f19 768886 0 2024-09-21T11:39:02.359 INFO:tasks.workunit.client.1.smithi149.stdout:4/113: creat d4/f27 x:0 0 0 2024-09-21T11:39:02.359 INFO:tasks.workunit.client.1.smithi149.stdout:6/77: dwrite d8/da/fc [0,4194304] 0 2024-09-21T11:39:02.361 INFO:tasks.workunit.client.1.smithi149.stdout:9/69: write f0 [3753239,117304] 0 2024-09-21T11:39:02.362 INFO:tasks.workunit.client.1.smithi149.stdout:9/70: readlink lb 0 2024-09-21T11:39:02.365 INFO:tasks.workunit.client.1.smithi149.stdout:5/91: dread d4/f9 [0,4194304] 0 2024-09-21T11:39:02.367 INFO:tasks.workunit.client.1.smithi149.stdout:4/114: creat d4/d13/f28 x:0 0 0 2024-09-21T11:39:02.368 INFO:tasks.workunit.client.1.smithi149.stdout:4/115: dread - d4/f1f zero size 2024-09-21T11:39:02.369 INFO:tasks.workunit.client.1.smithi149.stdout:9/71: dwrite f0 [0,4194304] 0 2024-09-21T11:39:02.370 INFO:tasks.workunit.client.1.smithi149.stdout:4/116: write d4/d6/d18/f1c [101981,84532] 0 2024-09-21T11:39:02.374 INFO:tasks.workunit.client.1.smithi149.stdout:1/106: getdents d2/d5 0 2024-09-21T11:39:02.374 INFO:tasks.workunit.client.1.smithi149.stdout:7/161: sync 2024-09-21T11:39:02.374 INFO:tasks.workunit.client.1.smithi149.stdout:1/107: stat d2/d5/d8 0 2024-09-21T11:39:02.375 INFO:tasks.workunit.client.1.smithi149.stdout:1/108: fsync d2/dd/f12 0 2024-09-21T11:39:02.377 INFO:tasks.workunit.client.1.smithi149.stdout:1/109: write d2/f1e [532623,94790] 0 2024-09-21T11:39:02.378 INFO:tasks.workunit.client.1.smithi149.stdout:4/117: dwrite d4/d6/d18/f1c [0,4194304] 0 2024-09-21T11:39:02.379 INFO:tasks.workunit.client.1.smithi149.stdout:4/118: truncate d4/d13/f12 5388769 0 2024-09-21T11:39:02.383 INFO:tasks.workunit.client.1.smithi149.stdout:9/72: creat f10 x:0 0 0 2024-09-21T11:39:02.383 INFO:tasks.workunit.client.1.smithi149.stdout:9/73: write f0 [823624,88240] 0 2024-09-21T11:39:02.389 INFO:tasks.workunit.client.1.smithi149.stdout:7/162: dread d12/d15/f17 [0,4194304] 0 2024-09-21T11:39:02.390 INFO:tasks.workunit.client.1.smithi149.stdout:7/163: stat d12/f1e 0 2024-09-21T11:39:02.390 INFO:tasks.workunit.client.1.smithi149.stdout:7/164: chown ff 1800 1 2024-09-21T11:39:02.391 INFO:tasks.workunit.client.1.smithi149.stdout:6/78: link l7 d8/da/d14/l16 0 2024-09-21T11:39:02.394 INFO:tasks.workunit.client.1.smithi149.stdout:4/119: rename d4/c1e to d4/d13/d15/c29 0 2024-09-21T11:39:02.395 INFO:tasks.workunit.client.1.smithi149.stdout:6/79: dread d8/da/fc [0,4194304] 0 2024-09-21T11:39:02.396 INFO:tasks.workunit.client.1.smithi149.stdout:6/80: write d8/da/d14/f15 [226618,85264] 0 2024-09-21T11:39:02.400 INFO:tasks.workunit.client.1.smithi149.stdout:1/110: creat d2/dd/d11/d1c/f23 x:0 0 0 2024-09-21T11:39:02.401 INFO:tasks.workunit.client.1.smithi149.stdout:8/107: truncate d3/d12/f15 74121 0 2024-09-21T11:39:02.404 INFO:tasks.workunit.client.1.smithi149.stdout:1/111: dread d2/d5/d8/f17 [0,4194304] 0 2024-09-21T11:39:02.404 INFO:tasks.workunit.client.1.smithi149.stdout:1/112: chown d2 61584478 1 2024-09-21T11:39:02.404 INFO:tasks.workunit.client.1.smithi149.stdout:1/113: read d2/d5/fb [1996118,114385] 0 2024-09-21T11:39:02.405 INFO:tasks.workunit.client.1.smithi149.stdout:4/120: creat d4/d6/d18/f2a x:0 0 0 2024-09-21T11:39:02.405 INFO:tasks.workunit.client.1.smithi149.stdout:4/121: fsync d4/d6/fb 0 2024-09-21T11:39:02.407 INFO:tasks.workunit.client.1.smithi149.stdout:0/51: sync 2024-09-21T11:39:02.408 INFO:tasks.workunit.client.1.smithi149.stdout:3/157: sync 2024-09-21T11:39:02.408 INFO:tasks.workunit.client.1.smithi149.stdout:0/52: chown lc 82 1 2024-09-21T11:39:02.408 INFO:tasks.workunit.client.1.smithi149.stdout:6/81: truncate f4 2566608 0 2024-09-21T11:39:02.408 INFO:tasks.workunit.client.1.smithi149.stdout:6/82: chown d8/da 180756 1 2024-09-21T11:39:02.412 INFO:tasks.workunit.client.1.smithi149.stdout:5/92: getdents d4/d7 0 2024-09-21T11:39:02.412 INFO:tasks.workunit.client.1.smithi149.stdout:5/93: fsync d4/f19 0 2024-09-21T11:39:02.413 INFO:tasks.workunit.client.1.smithi149.stdout:6/83: dread d8/da/fd [0,4194304] 0 2024-09-21T11:39:02.414 INFO:tasks.workunit.client.1.smithi149.stdout:8/108: rename d3/dd/l23 to d3/dd/l26 0 2024-09-21T11:39:02.415 INFO:tasks.workunit.client.1.smithi149.stdout:6/84: dread d8/da/d14/f15 [0,4194304] 0 2024-09-21T11:39:02.415 INFO:tasks.workunit.client.1.smithi149.stdout:8/109: truncate d3/f10 513758 0 2024-09-21T11:39:02.422 INFO:tasks.workunit.client.1.smithi149.stdout:6/85: dwrite d8/da/fd [0,4194304] 0 2024-09-21T11:39:02.423 INFO:tasks.workunit.client.1.smithi149.stdout:4/122: creat d4/d13/d10/f2b x:0 0 0 2024-09-21T11:39:02.425 INFO:tasks.workunit.client.1.smithi149.stdout:3/158: mknod d6/d1d/d37/c41 0 2024-09-21T11:39:02.427 INFO:tasks.workunit.client.1.smithi149.stdout:0/53: rename f3 to dd/ff 0 2024-09-21T11:39:02.428 INFO:tasks.workunit.client.1.smithi149.stdout:1/114: dwrite d2/f18 [0,4194304] 0 2024-09-21T11:39:02.428 INFO:tasks.workunit.client.1.smithi149.stdout:0/54: chown lc 15 1 2024-09-21T11:39:02.428 INFO:tasks.workunit.client.1.smithi149.stdout:0/55: chown cb 12790686 1 2024-09-21T11:39:02.429 INFO:tasks.workunit.client.1.smithi149.stdout:0/56: chown cb 14462 1 2024-09-21T11:39:02.430 INFO:tasks.workunit.client.1.smithi149.stdout:0/57: read f8 [1166054,46338] 0 2024-09-21T11:39:02.431 INFO:tasks.workunit.client.1.smithi149.stdout:5/94: symlink d4/d7/l1b 0 2024-09-21T11:39:02.432 INFO:tasks.workunit.client.1.smithi149.stdout:5/95: write d4/f12 [3561890,108702] 0 2024-09-21T11:39:02.437 INFO:tasks.workunit.client.1.smithi149.stdout:9/74: getdents . 0 2024-09-21T11:39:02.440 INFO:tasks.workunit.client.1.smithi149.stdout:4/123: mknod d4/d13/c2c 0 2024-09-21T11:39:02.442 INFO:tasks.workunit.client.1.smithi149.stdout:3/159: mknod d6/d1d/d37/d3f/c42 0 2024-09-21T11:39:02.444 INFO:tasks.workunit.client.1.smithi149.stdout:3/160: fdatasync d6/f8 0 2024-09-21T11:39:02.445 INFO:tasks.workunit.client.1.smithi149.stdout:7/165: getdents d12/d15/d26 0 2024-09-21T11:39:02.447 INFO:tasks.workunit.client.1.smithi149.stdout:1/115: rename d2/d5/fb to d2/dd/d11/f24 0 2024-09-21T11:39:02.448 INFO:tasks.workunit.client.1.smithi149.stdout:2/79: sync 2024-09-21T11:39:02.448 INFO:tasks.workunit.client.1.smithi149.stdout:9/75: dwrite fc [0,4194304] 0 2024-09-21T11:39:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:01 smithi149 ceph-mon[36123]: pgmap v16: 65 pgs: 65 active+clean; 273 MiB data, 982 MiB used, 535 GiB / 536 GiB avail; 183 KiB/s rd, 11 MiB/s wr, 431 op/s 2024-09-21T11:39:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:01 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:01 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:02.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:01 smithi149 ceph-mon[36123]: Reconfiguring prometheus.smithi118 (dependencies changed)... 2024-09-21T11:39:02.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:01 smithi149 ceph-mon[36123]: Reconfiguring daemon prometheus.smithi118 on smithi118 2024-09-21T11:39:02.458 INFO:tasks.workunit.client.1.smithi149.stdout:7/166: dwrite ff [4194304,4194304] 0 2024-09-21T11:39:02.460 INFO:tasks.workunit.client.1.smithi149.stdout:9/76: dread fc [0,4194304] 0 2024-09-21T11:39:02.461 INFO:tasks.workunit.client.1.smithi149.stdout:4/124: dread d4/d6/f9 [0,4194304] 0 2024-09-21T11:39:02.462 INFO:tasks.workunit.client.1.smithi149.stdout:9/77: write f0 [45969,50349] 0 2024-09-21T11:39:02.463 INFO:tasks.workunit.client.1.smithi149.stdout:4/125: write d4/f7 [4182932,108458] 0 2024-09-21T11:39:02.466 INFO:tasks.workunit.client.1.smithi149.stdout:4/126: write d4/d13/f28 [601849,82220] 0 2024-09-21T11:39:02.474 INFO:tasks.workunit.client.1.smithi149.stdout:1/116: creat d2/dd/d11/d1c/f25 x:0 0 0 2024-09-21T11:39:02.475 INFO:tasks.workunit.client.1.smithi149.stdout:4/127: dwrite d4/d13/d10/f2b [0,4194304] 0 2024-09-21T11:39:02.475 INFO:tasks.workunit.client.1.smithi149.stdout:8/110: write d3/fa [1040541,25032] 0 2024-09-21T11:39:02.476 INFO:tasks.workunit.client.1.smithi149.stdout:4/128: readlink d4/d13/le 0 2024-09-21T11:39:02.486 INFO:tasks.workunit.client.1.smithi149.stdout:9/78: unlink l5 0 2024-09-21T11:39:02.488 INFO:tasks.workunit.client.1.smithi149.stdout:3/161: creat d6/d1d/d37/d3a/f43 x:0 0 0 2024-09-21T11:39:02.494 INFO:tasks.workunit.client.1.smithi149.stdout:1/117: mkdir d2/dd/d11/d26 0 2024-09-21T11:39:02.495 INFO:tasks.workunit.client.1.smithi149.stdout:8/111: mknod d3/dd/c27 0 2024-09-21T11:39:02.496 INFO:tasks.workunit.client.1.smithi149.stdout:6/86: link l7 d8/da/d14/l17 0 2024-09-21T11:39:02.497 INFO:tasks.workunit.client.1.smithi149.stdout:7/167: getdents d12/d15/d26 0 2024-09-21T11:39:02.498 INFO:tasks.workunit.client.1.smithi149.stdout:7/168: dread - d12/d15/f2d zero size 2024-09-21T11:39:02.499 INFO:tasks.workunit.client.1.smithi149.stdout:9/79: read fc [2523494,113137] 0 2024-09-21T11:39:02.499 INFO:tasks.workunit.client.1.smithi149.stdout:3/162: unlink d6/d1d/f23 0 2024-09-21T11:39:02.500 INFO:tasks.workunit.client.1.smithi149.stdout:2/80: link c5 d8/da/d13/c18 0 2024-09-21T11:39:02.502 INFO:tasks.workunit.client.1.smithi149.stdout:5/96: getdents d4 0 2024-09-21T11:39:02.502 INFO:tasks.workunit.client.1.smithi149.stdout:8/112: mknod d3/dd/d18/c28 0 2024-09-21T11:39:02.503 INFO:tasks.workunit.client.1.smithi149.stdout:0/58: truncate f8 386471 0 2024-09-21T11:39:02.505 INFO:tasks.workunit.client.1.smithi149.stdout:4/129: dwrite d4/d13/d15/f19 [0,4194304] 0 2024-09-21T11:39:02.506 INFO:tasks.workunit.client.1.smithi149.stdout:9/80: symlink l11 0 2024-09-21T11:39:02.508 INFO:tasks.workunit.client.1.smithi149.stdout:7/169: symlink d12/d15/d26/l2f 0 2024-09-21T11:39:02.510 INFO:tasks.workunit.client.1.smithi149.stdout:2/81: dwrite d8/dd/f12 [0,4194304] 0 2024-09-21T11:39:02.515 INFO:tasks.workunit.client.1.smithi149.stdout:0/59: dwrite fa [0,4194304] 0 2024-09-21T11:39:02.516 INFO:tasks.workunit.client.1.smithi149.stdout:8/113: truncate d3/dd/f1b 872469 0 2024-09-21T11:39:02.523 INFO:tasks.workunit.client.1.smithi149.stdout:4/130: mkdir d4/d13/d2d 0 2024-09-21T11:39:02.524 INFO:tasks.workunit.client.1.smithi149.stdout:3/163: unlink f2 0 2024-09-21T11:39:02.524 INFO:tasks.workunit.client.1.smithi149.stdout:1/118: mknod d2/d5/c27 0 2024-09-21T11:39:02.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/170: dread - d12/d15/f1f zero size 2024-09-21T11:39:02.529 INFO:tasks.workunit.client.1.smithi149.stdout:8/114: rmdir d3/dd/d18 39 2024-09-21T11:39:02.533 INFO:tasks.workunit.client.1.smithi149.stdout:9/81: rename c6 to c12 0 2024-09-21T11:39:02.546 INFO:tasks.workunit.client.1.smithi149.stdout:8/115: write d3/f17 [102592,59779] 0 2024-09-21T11:39:02.546 INFO:tasks.workunit.client.1.smithi149.stdout:6/87: getdents d8 0 2024-09-21T11:39:02.547 INFO:tasks.workunit.client.1.smithi149.stdout:2/82: dread d8/dd/f12 [0,4194304] 0 2024-09-21T11:39:02.548 INFO:tasks.workunit.client.1.smithi149.stdout:8/116: chown d3/d4/cc 7 1 2024-09-21T11:39:02.549 INFO:tasks.workunit.client.1.smithi149.stdout:8/117: stat d3 0 2024-09-21T11:39:02.550 INFO:tasks.workunit.client.1.smithi149.stdout:4/131: dread d4/d6/d18/f1c [0,4194304] 0 2024-09-21T11:39:02.551 INFO:tasks.workunit.client.1.smithi149.stdout:4/132: stat d4/d13/f12 0 2024-09-21T11:39:02.554 INFO:tasks.workunit.client.1.smithi149.stdout:5/97: dwrite f2 [0,4194304] 0 2024-09-21T11:39:02.623 INFO:tasks.workunit.client.1.smithi149.stdout:9/82: mknod c13 0 2024-09-21T11:39:02.623 INFO:tasks.workunit.client.1.smithi149.stdout:9/83: rmdir - no directory 2024-09-21T11:39:02.623 INFO:tasks.workunit.client.1.smithi149.stdout:1/119: symlink d2/l28 0 2024-09-21T11:39:02.623 INFO:tasks.workunit.client.1.smithi149.stdout:7/171: mkdir d12/d15/d26/d30 0 2024-09-21T11:39:02.625 INFO:tasks.workunit.client.1.smithi149.stdout:3/164: creat d6/d1d/d37/d3f/f44 x:0 0 0 2024-09-21T11:39:02.626 INFO:tasks.workunit.client.1.smithi149.stdout:0/60: write dd/fe [567020,10728] 0 2024-09-21T11:39:02.628 INFO:tasks.workunit.client.1.smithi149.stdout:5/98: mkdir d4/d7/d1c 0 2024-09-21T11:39:02.628 INFO:tasks.workunit.client.1.smithi149.stdout:4/133: chown d4/d13/d15/c29 97 1 2024-09-21T11:39:02.630 INFO:tasks.workunit.client.1.smithi149.stdout:9/84: symlink l14 0 2024-09-21T11:39:02.630 INFO:tasks.workunit.client.1.smithi149.stdout:5/99: write d4/f5 [2549500,85902] 0 2024-09-21T11:39:02.631 INFO:tasks.workunit.client.1.smithi149.stdout:6/88: fsync f4 0 2024-09-21T11:39:02.632 INFO:tasks.workunit.client.1.smithi149.stdout:1/120: rename d2/dd/d11/d1c/f25 to d2/dd/d11/d1c/f29 0 2024-09-21T11:39:02.633 INFO:tasks.workunit.client.1.smithi149.stdout:9/85: chown c1 6 1 2024-09-21T11:39:02.633 INFO:tasks.workunit.client.1.smithi149.stdout:8/118: dread d3/f14 [0,4194304] 0 2024-09-21T11:39:02.635 INFO:tasks.workunit.client.1.smithi149.stdout:4/134: creat d4/d6/d18/f2e x:0 0 0 2024-09-21T11:39:02.636 INFO:tasks.workunit.client.1.smithi149.stdout:9/86: read f0 [3807797,6310] 0 2024-09-21T11:39:02.637 INFO:tasks.workunit.client.1.smithi149.stdout:7/172: dwrite d12/d15/f20 [0,4194304] 0 2024-09-21T11:39:02.639 INFO:tasks.workunit.client.1.smithi149.stdout:5/100: rename d4/d7/d1c to d4/d1d 0 2024-09-21T11:39:02.643 INFO:tasks.workunit.client.1.smithi149.stdout:9/87: symlink l15 0 2024-09-21T11:39:02.644 INFO:tasks.workunit.client.1.smithi149.stdout:4/135: symlink d4/l2f 0 2024-09-21T11:39:02.645 INFO:tasks.workunit.client.1.smithi149.stdout:2/83: link d8/da/d13/c18 d8/d11/c19 0 2024-09-21T11:39:02.646 INFO:tasks.workunit.client.1.smithi149.stdout:8/119: dread d3/d12/f15 [0,4194304] 0 2024-09-21T11:39:02.647 INFO:tasks.workunit.client.1.smithi149.stdout:5/101: creat d4/f1e x:0 0 0 2024-09-21T11:39:02.648 INFO:tasks.workunit.client.1.smithi149.stdout:9/88: creat f16 x:0 0 0 2024-09-21T11:39:02.648 INFO:tasks.workunit.client.1.smithi149.stdout:1/121: dwrite d2/f18 [0,4194304] 0 2024-09-21T11:39:02.649 INFO:tasks.workunit.client.1.smithi149.stdout:7/173: mkdir d12/d15/d26/d30/d31 0 2024-09-21T11:39:02.649 INFO:tasks.workunit.client.1.smithi149.stdout:5/102: write d4/f18 [574994,33988] 0 2024-09-21T11:39:02.650 INFO:tasks.workunit.client.1.smithi149.stdout:6/89: getdents d8 0 2024-09-21T11:39:02.651 INFO:tasks.workunit.client.1.smithi149.stdout:4/136: mkdir d4/d13/d15/d30 0 2024-09-21T11:39:02.651 INFO:tasks.workunit.client.1.smithi149.stdout:4/137: stat d4/d13/d1d 0 2024-09-21T11:39:02.657 INFO:tasks.workunit.client.1.smithi149.stdout:7/174: chown d12/d15/f1c 1978 1 2024-09-21T11:39:02.657 INFO:tasks.workunit.client.1.smithi149.stdout:6/90: truncate d8/da/fc 320948 0 2024-09-21T11:39:02.659 INFO:tasks.workunit.client.1.smithi149.stdout:4/138: rename d4/d13/d1d to d4/d13/d10/d31 0 2024-09-21T11:39:02.659 INFO:tasks.workunit.client.1.smithi149.stdout:7/175: chown d12/d15/d26/l2f 3978948 1 2024-09-21T11:39:02.660 INFO:tasks.workunit.client.1.smithi149.stdout:4/139: fsync d4/d13/d10/f2b 0 2024-09-21T11:39:02.661 INFO:tasks.workunit.client.1.smithi149.stdout:9/89: rename l7 to l17 0 2024-09-21T11:39:02.661 INFO:tasks.workunit.client.1.smithi149.stdout:2/84: dwrite d8/dd/f12 [0,4194304] 0 2024-09-21T11:39:02.661 INFO:tasks.workunit.client.1.smithi149.stdout:4/140: chown c1 591352 1 2024-09-21T11:39:02.671 INFO:tasks.workunit.client.1.smithi149.stdout:5/103: symlink d4/d7/d1a/l1f 0 2024-09-21T11:39:02.672 INFO:tasks.workunit.client.1.smithi149.stdout:6/91: fsync d8/da/fd 0 2024-09-21T11:39:02.672 INFO:tasks.workunit.client.1.smithi149.stdout:4/141: dread d4/d6/d18/f1c [0,4194304] 0 2024-09-21T11:39:02.672 INFO:tasks.workunit.client.1.smithi149.stdout:1/122: dread d2/d5/d8/fa [0,4194304] 0 2024-09-21T11:39:02.675 INFO:tasks.workunit.client.1.smithi149.stdout:6/92: mkdir d8/da/d14/d18 0 2024-09-21T11:39:02.676 INFO:tasks.workunit.client.1.smithi149.stdout:7/176: creat d12/d15/f32 x:0 0 0 2024-09-21T11:39:02.678 INFO:tasks.workunit.client.1.smithi149.stdout:1/123: unlink d2/d5/l1b 0 2024-09-21T11:39:02.679 INFO:tasks.workunit.client.1.smithi149.stdout:1/124: fsync d2/d5/d8/fa 0 2024-09-21T11:39:02.680 INFO:tasks.workunit.client.1.smithi149.stdout:1/125: read d2/f18 [2505135,67648] 0 2024-09-21T11:39:02.680 INFO:tasks.workunit.client.1.smithi149.stdout:7/177: dread f6 [0,4194304] 0 2024-09-21T11:39:02.681 INFO:tasks.workunit.client.1.smithi149.stdout:6/93: rename f2 to d8/da/d14/d18/f19 0 2024-09-21T11:39:02.683 INFO:tasks.workunit.client.1.smithi149.stdout:1/126: dread d2/f1e [0,4194304] 0 2024-09-21T11:39:02.685 INFO:tasks.workunit.client.1.smithi149.stdout:7/178: symlink d12/l33 0 2024-09-21T11:39:02.686 INFO:tasks.workunit.client.1.smithi149.stdout:6/94: dread d8/da/fd [0,4194304] 0 2024-09-21T11:39:02.690 INFO:tasks.workunit.client.1.smithi149.stdout:1/127: unlink d2/d5/f7 0 2024-09-21T11:39:02.691 INFO:tasks.workunit.client.1.smithi149.stdout:6/95: creat d8/da/f1a x:0 0 0 2024-09-21T11:39:02.692 INFO:tasks.workunit.client.1.smithi149.stdout:7/179: dwrite d12/d15/d26/f29 [0,4194304] 0 2024-09-21T11:39:02.694 INFO:tasks.workunit.client.1.smithi149.stdout:6/96: chown l7 56487247 1 2024-09-21T11:39:02.695 INFO:tasks.workunit.client.1.smithi149.stdout:7/180: creat d12/d15/d26/d30/f34 x:0 0 0 2024-09-21T11:39:02.698 INFO:tasks.workunit.client.1.smithi149.stdout:7/181: fdatasync d12/d15/d26/f2e 0 2024-09-21T11:39:02.700 INFO:tasks.workunit.client.1.smithi149.stdout:6/97: rename d8/da/d14/l16 to d8/da/d14/l1b 0 2024-09-21T11:39:02.701 INFO:tasks.workunit.client.1.smithi149.stdout:7/182: rmdir d12/d15/d26 39 2024-09-21T11:39:02.702 INFO:tasks.workunit.client.1.smithi149.stdout:7/183: dread - d12/d15/f1c zero size 2024-09-21T11:39:02.704 INFO:tasks.workunit.client.1.smithi149.stdout:6/98: truncate d8/da/d14/f15 952068 0 2024-09-21T11:39:02.704 INFO:tasks.workunit.client.1.smithi149.stdout:6/99: readlink l5 0 2024-09-21T11:39:02.705 INFO:tasks.workunit.client.1.smithi149.stdout:7/184: fsync d12/d15/f17 0 2024-09-21T11:39:02.709 INFO:tasks.workunit.client.1.smithi149.stdout:6/100: dread d8/da/fd [0,4194304] 0 2024-09-21T11:39:02.711 INFO:tasks.workunit.client.1.smithi149.stdout:3/165: fdatasync d6/f1b 0 2024-09-21T11:39:02.712 INFO:tasks.workunit.client.1.smithi149.stdout:7/185: dwrite d12/d15/f20 [0,4194304] 0 2024-09-21T11:39:02.714 INFO:tasks.workunit.client.1.smithi149.stdout:6/101: getdents d8 0 2024-09-21T11:39:02.716 INFO:tasks.workunit.client.1.smithi149.stdout:7/186: unlink f5 0 2024-09-21T11:39:02.718 INFO:tasks.workunit.client.1.smithi149.stdout:6/102: unlink d8/lf 0 2024-09-21T11:39:02.720 INFO:tasks.workunit.client.1.smithi149.stdout:3/166: mknod d6/d1d/c45 0 2024-09-21T11:39:02.722 INFO:tasks.workunit.client.1.smithi149.stdout:7/187: unlink fc 0 2024-09-21T11:39:02.723 INFO:tasks.workunit.client.1.smithi149.stdout:6/103: rmdir d8/da/d14 39 2024-09-21T11:39:02.723 INFO:tasks.workunit.client.1.smithi149.stdout:7/188: write fb [3809109,121083] 0 2024-09-21T11:39:02.725 INFO:tasks.workunit.client.1.smithi149.stdout:7/189: write d12/d15/f1c [864307,60273] 0 2024-09-21T11:39:02.728 INFO:tasks.workunit.client.1.smithi149.stdout:3/167: rename d6/f21 to d6/d1d/d37/d3a/f46 0 2024-09-21T11:39:02.728 INFO:tasks.workunit.client.1.smithi149.stdout:0/61: dwrite dd/ff [0,4194304] 0 2024-09-21T11:39:02.729 INFO:tasks.workunit.client.1.smithi149.stdout:7/190: mkdir d12/d35 0 2024-09-21T11:39:02.730 INFO:tasks.workunit.client.1.smithi149.stdout:6/104: chown d8/da/fc 23229 1 2024-09-21T11:39:02.734 INFO:tasks.workunit.client.1.smithi149.stdout:0/62: symlink dd/l10 0 2024-09-21T11:39:02.736 INFO:tasks.workunit.client.1.smithi149.stdout:7/191: unlink d12/l33 0 2024-09-21T11:39:02.787 INFO:tasks.workunit.client.1.smithi149.stdout:9/90: truncate f0 1439380 0 2024-09-21T11:39:02.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/120: dwrite d3/f14 [0,4194304] 0 2024-09-21T11:39:02.788 INFO:tasks.workunit.client.1.smithi149.stdout:1/128: write d2/f4 [2476426,108322] 0 2024-09-21T11:39:02.788 INFO:tasks.workunit.client.1.smithi149.stdout:8/121: write d3/f1d [938210,79551] 0 2024-09-21T11:39:02.790 INFO:tasks.workunit.client.1.smithi149.stdout:8/122: stat d3/f17 0 2024-09-21T11:39:02.818 INFO:tasks.workunit.client.1.smithi149.stdout:2/85: sync 2024-09-21T11:39:02.820 INFO:tasks.workunit.client.1.smithi149.stdout:7/192: dread fb [0,4194304] 0 2024-09-21T11:39:02.821 INFO:tasks.workunit.client.1.smithi149.stdout:9/91: write f0 [147900,45194] 0 2024-09-21T11:39:02.821 INFO:tasks.workunit.client.1.smithi149.stdout:2/86: chown d8/da/cc 122926 1 2024-09-21T11:39:02.822 INFO:tasks.workunit.client.1.smithi149.stdout:9/92: fsync f10 0 2024-09-21T11:39:02.822 INFO:tasks.workunit.client.1.smithi149.stdout:6/105: write d8/da/fc [571147,20810] 0 2024-09-21T11:39:02.823 INFO:tasks.workunit.client.1.smithi149.stdout:7/193: unlink d12/d15/f2d 0 2024-09-21T11:39:02.823 INFO:tasks.workunit.client.1.smithi149.stdout:8/123: dread d3/f1d [0,4194304] 0 2024-09-21T11:39:02.824 INFO:tasks.workunit.client.1.smithi149.stdout:8/124: dread - d3/f25 zero size 2024-09-21T11:39:02.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/168: rename d6/d1d to d6/d1f/d47 0 2024-09-21T11:39:02.825 INFO:tasks.workunit.client.1.smithi149.stdout:9/93: write fc [2527489,13394] 0 2024-09-21T11:39:02.826 INFO:tasks.workunit.client.1.smithi149.stdout:2/87: mkdir d8/da/d13/d1a 0 2024-09-21T11:39:02.826 INFO:tasks.workunit.client.1.smithi149.stdout:9/94: read fc [685124,91859] 0 2024-09-21T11:39:02.826 INFO:tasks.workunit.client.1.smithi149.stdout:6/106: rmdir d8/da/d11 39 2024-09-21T11:39:02.827 INFO:tasks.workunit.client.1.smithi149.stdout:2/88: read d8/dd/f12 [3339671,123248] 0 2024-09-21T11:39:02.827 INFO:tasks.workunit.client.1.smithi149.stdout:7/194: unlink f6 0 2024-09-21T11:39:02.827 INFO:tasks.workunit.client.1.smithi149.stdout:9/95: fsync fc 0 2024-09-21T11:39:02.828 INFO:tasks.workunit.client.1.smithi149.stdout:9/96: readlink l15 0 2024-09-21T11:39:02.828 INFO:tasks.workunit.client.1.smithi149.stdout:8/125: symlink d3/d12/l29 0 2024-09-21T11:39:02.828 INFO:tasks.workunit.client.1.smithi149.stdout:2/89: rename d8 to d8/d11/d1b 22 2024-09-21T11:39:02.828 INFO:tasks.workunit.client.1.smithi149.stdout:8/126: chown d3/d4 1806050 1 2024-09-21T11:39:02.830 INFO:tasks.workunit.client.1.smithi149.stdout:6/107: chown d8/da/d11/l13 133238 1 2024-09-21T11:39:02.833 INFO:tasks.workunit.client.1.smithi149.stdout:9/97: mkdir d18 0 2024-09-21T11:39:02.833 INFO:tasks.workunit.client.1.smithi149.stdout:2/90: creat d8/f1c x:0 0 0 2024-09-21T11:39:02.834 INFO:tasks.workunit.client.1.smithi149.stdout:2/91: chown d8/da/cc 406901687 1 2024-09-21T11:39:02.834 INFO:tasks.workunit.client.1.smithi149.stdout:2/92: chown d8/f1c 4 1 2024-09-21T11:39:02.837 INFO:tasks.workunit.client.1.smithi149.stdout:7/195: mknod d12/d15/d26/d30/c36 0 2024-09-21T11:39:02.838 INFO:tasks.workunit.client.1.smithi149.stdout:2/93: creat d8/dd/f1d x:0 0 0 2024-09-21T11:39:02.842 INFO:tasks.workunit.client.1.smithi149.stdout:6/108: write f4 [2158847,23717] 0 2024-09-21T11:39:02.847 INFO:tasks.workunit.client.1.smithi149.stdout:7/196: creat d12/d15/d26/d30/d31/f37 x:0 0 0 2024-09-21T11:39:02.848 INFO:tasks.workunit.client.1.smithi149.stdout:3/169: dwrite d6/f16 [0,4194304] 0 2024-09-21T11:39:02.848 INFO:tasks.workunit.client.1.smithi149.stdout:6/109: mknod d8/da/d14/d18/c1c 0 2024-09-21T11:39:02.850 INFO:tasks.workunit.client.1.smithi149.stdout:2/94: dwrite f7 [0,4194304] 0 2024-09-21T11:39:02.851 INFO:tasks.workunit.client.1.smithi149.stdout:6/110: fsync d8/da/fd 0 2024-09-21T11:39:02.852 INFO:tasks.workunit.client.1.smithi149.stdout:2/95: truncate d8/f1c 699419 0 2024-09-21T11:39:02.853 INFO:tasks.workunit.client.1.smithi149.stdout:3/170: unlink d6/l18 0 2024-09-21T11:39:02.855 INFO:tasks.workunit.client.1.smithi149.stdout:3/171: write d6/d1f/d47/f26 [219597,100175] 0 2024-09-21T11:39:02.856 INFO:tasks.workunit.client.1.smithi149.stdout:2/96: rename c2 to d8/dd/c1e 0 2024-09-21T11:39:02.856 INFO:tasks.workunit.client.1.smithi149.stdout:6/111: rename d8/da/d14/d18 to d8/da/d14/d18/d1d 22 2024-09-21T11:39:02.857 INFO:tasks.workunit.client.1.smithi149.stdout:3/172: dread - d6/f28 zero size 2024-09-21T11:39:02.858 INFO:tasks.workunit.client.1.smithi149.stdout:3/173: chown d6/d1f/l25 4 1 2024-09-21T11:39:02.859 INFO:tasks.workunit.client.1.smithi149.stdout:2/97: truncate d8/dd/f12 3457774 0 2024-09-21T11:39:02.860 INFO:tasks.workunit.client.1.smithi149.stdout:2/98: truncate d8/f1c 1346009 0 2024-09-21T11:39:02.860 INFO:tasks.workunit.client.1.smithi149.stdout:2/99: stat f3 0 2024-09-21T11:39:02.860 INFO:tasks.workunit.client.1.smithi149.stdout:2/100: chown d8/dd/c17 25096819 1 2024-09-21T11:39:02.861 INFO:tasks.workunit.client.1.smithi149.stdout:6/112: mknod d8/da/d14/d18/c1e 0 2024-09-21T11:39:02.866 INFO:tasks.workunit.client.1.smithi149.stdout:2/101: creat d8/da/d13/d1a/f1f x:0 0 0 2024-09-21T11:39:02.866 INFO:tasks.workunit.client.1.smithi149.stdout:3/174: dread d6/fc [0,4194304] 0 2024-09-21T11:39:02.867 INFO:tasks.workunit.client.1.smithi149.stdout:7/197: dread d12/d15/d26/f2e [0,4194304] 0 2024-09-21T11:39:02.867 INFO:tasks.workunit.client.1.smithi149.stdout:2/102: dread - d8/da/d13/d1a/f1f zero size 2024-09-21T11:39:02.871 INFO:tasks.workunit.client.1.smithi149.stdout:2/103: mkdir d8/d20 0 2024-09-21T11:39:02.872 INFO:tasks.workunit.client.1.smithi149.stdout:7/198: symlink d12/d15/l38 0 2024-09-21T11:39:02.874 INFO:tasks.workunit.client.1.smithi149.stdout:2/104: creat d8/da/d13/f21 x:0 0 0 2024-09-21T11:39:02.877 INFO:tasks.workunit.client.1.smithi149.stdout:7/199: mknod d12/d15/c39 0 2024-09-21T11:39:02.877 INFO:tasks.workunit.client.1.smithi149.stdout:7/200: chown d12 31813040 1 2024-09-21T11:39:02.879 INFO:tasks.workunit.client.1.smithi149.stdout:7/201: chown d12/d15/d26/d30 75 1 2024-09-21T11:39:02.881 INFO:tasks.workunit.client.1.smithi149.stdout:3/175: dwrite d6/d1f/f35 [0,4194304] 0 2024-09-21T11:39:02.881 INFO:tasks.workunit.client.1.smithi149.stdout:7/202: symlink d12/d15/d26/d30/l3a 0 2024-09-21T11:39:02.883 INFO:tasks.workunit.client.1.smithi149.stdout:3/176: write d6/d1f/d27/f36 [577801,59127] 0 2024-09-21T11:39:02.883 INFO:tasks.workunit.client.1.smithi149.stdout:7/203: fsync d12/d15/d26/d30/d31/f37 0 2024-09-21T11:39:02.885 INFO:tasks.workunit.client.1.smithi149.stdout:7/204: dread - d12/d15/d26/d30/f34 zero size 2024-09-21T11:39:02.886 INFO:tasks.workunit.client.1.smithi149.stdout:2/105: dread d8/dd/f12 [0,4194304] 0 2024-09-21T11:39:02.888 INFO:tasks.workunit.client.1.smithi149.stdout:7/205: unlink fe 0 2024-09-21T11:39:02.889 INFO:tasks.workunit.client.1.smithi149.stdout:3/177: link d6/d1f/c24 d6/d1f/d47/c48 0 2024-09-21T11:39:02.892 INFO:tasks.workunit.client.1.smithi149.stdout:2/106: dread f7 [0,4194304] 0 2024-09-21T11:39:02.893 INFO:tasks.workunit.client.1.smithi149.stdout:3/178: creat d6/d1f/d47/d22/f49 x:0 0 0 2024-09-21T11:39:02.893 INFO:tasks.workunit.client.1.smithi149.stdout:3/179: fdatasync d6/d1f/d47/d22/f49 0 2024-09-21T11:39:02.894 INFO:tasks.workunit.client.1.smithi149.stdout:7/206: link d12/c13 d12/d35/c3b 0 2024-09-21T11:39:02.896 INFO:tasks.workunit.client.1.smithi149.stdout:2/107: mknod d8/dd/c22 0 2024-09-21T11:39:02.896 INFO:tasks.workunit.client.1.smithi149.stdout:2/108: dread - d8/dd/f1d zero size 2024-09-21T11:39:02.898 INFO:tasks.workunit.client.1.smithi149.stdout:3/180: write d6/fe [281129,42051] 0 2024-09-21T11:39:02.898 INFO:tasks.workunit.client.1.smithi149.stdout:2/109: truncate d8/f1c 2256024 0 2024-09-21T11:39:02.899 INFO:tasks.workunit.client.1.smithi149.stdout:7/207: rename d12/l1b to d12/d15/l3c 0 2024-09-21T11:39:02.899 INFO:tasks.workunit.client.1.smithi149.stdout:2/110: write d8/f1c [1150509,48454] 0 2024-09-21T11:39:02.900 INFO:tasks.workunit.client.1.smithi149.stdout:3/181: chown d6/f2a 7 1 2024-09-21T11:39:02.901 INFO:tasks.workunit.client.1.smithi149.stdout:7/208: chown d12/d15/l24 384 1 2024-09-21T11:39:02.903 INFO:tasks.workunit.client.1.smithi149.stdout:3/182: creat d6/d1f/d47/d37/f4a x:0 0 0 2024-09-21T11:39:02.903 INFO:tasks.workunit.client.1.smithi149.stdout:7/209: mknod d12/d15/d26/d30/c3d 0 2024-09-21T11:39:02.904 INFO:tasks.workunit.client.1.smithi149.stdout:2/111: getdents d8 0 2024-09-21T11:39:02.904 INFO:tasks.workunit.client.1.smithi149.stdout:3/183: fdatasync d6/f13 0 2024-09-21T11:39:02.905 INFO:tasks.workunit.client.1.smithi149.stdout:7/210: creat d12/d15/d26/f3e x:0 0 0 2024-09-21T11:39:02.906 INFO:tasks.workunit.client.1.smithi149.stdout:2/112: truncate d8/da/d13/f21 768344 0 2024-09-21T11:39:02.908 INFO:tasks.workunit.client.1.smithi149.stdout:3/184: unlink d6/d1f/d47/c48 0 2024-09-21T11:39:02.910 INFO:tasks.workunit.client.1.smithi149.stdout:7/211: creat d12/d15/d26/d30/d31/f3f x:0 0 0 2024-09-21T11:39:02.911 INFO:tasks.workunit.client.1.smithi149.stdout:5/104: sync 2024-09-21T11:39:02.911 INFO:tasks.workunit.client.1.smithi149.stdout:5/105: rename d4 to d4/d7/d1a/d20 22 2024-09-21T11:39:02.911 INFO:tasks.workunit.client.1.smithi149.stdout:2/113: mkdir d8/da/d13/d23 0 2024-09-21T11:39:02.913 INFO:tasks.workunit.client.1.smithi149.stdout:3/185: creat d6/d1f/d47/d37/f4b x:0 0 0 2024-09-21T11:39:02.916 INFO:tasks.workunit.client.1.smithi149.stdout:2/114: creat d8/dd/f24 x:0 0 0 2024-09-21T11:39:02.917 INFO:tasks.workunit.client.1.smithi149.stdout:2/115: dread - d8/da/d13/d1a/f1f zero size 2024-09-21T11:39:02.917 INFO:tasks.workunit.client.1.smithi149.stdout:3/186: mkdir d6/d1f/d4c 0 2024-09-21T11:39:02.920 INFO:tasks.workunit.client.1.smithi149.stdout:3/187: creat d6/d1f/d27/f4d x:0 0 0 2024-09-21T11:39:02.920 INFO:tasks.workunit.client.1.smithi149.stdout:2/116: dread d8/dd/f12 [0,4194304] 0 2024-09-21T11:39:02.921 INFO:tasks.workunit.client.1.smithi149.stdout:7/212: getdents d12 0 2024-09-21T11:39:02.921 INFO:tasks.workunit.client.1.smithi149.stdout:5/106: getdents d4/d7/d1a 0 2024-09-21T11:39:02.921 INFO:tasks.workunit.client.1.smithi149.stdout:3/188: readlink d6/l15 0 2024-09-21T11:39:02.923 INFO:tasks.workunit.client.1.smithi149.stdout:7/213: mknod d12/c40 0 2024-09-21T11:39:02.923 INFO:tasks.workunit.client.1.smithi149.stdout:7/214: dread - d12/f21 zero size 2024-09-21T11:39:02.923 INFO:tasks.workunit.client.1.smithi149.stdout:2/117: symlink d8/d11/l25 0 2024-09-21T11:39:02.924 INFO:tasks.workunit.client.1.smithi149.stdout:2/118: stat f7 0 2024-09-21T11:39:02.924 INFO:tasks.workunit.client.1.smithi149.stdout:2/119: chown d8/f1c 281 1 2024-09-21T11:39:02.924 INFO:tasks.workunit.client.1.smithi149.stdout:5/107: mknod d4/d7/d1a/c21 0 2024-09-21T11:39:02.926 INFO:tasks.workunit.client.1.smithi149.stdout:3/189: mknod d6/d1f/d47/c4e 0 2024-09-21T11:39:02.926 INFO:tasks.workunit.client.1.smithi149.stdout:3/190: fsync d6/f13 0 2024-09-21T11:39:02.927 INFO:tasks.workunit.client.0.smithi118.stderr:++ readlink -f fsstress 2024-09-21T11:39:02.927 INFO:tasks.workunit.client.1.smithi149.stdout:5/108: unlink d4/f1e 0 2024-09-21T11:39:02.928 INFO:tasks.workunit.client.1.smithi149.stdout:3/191: read - d6/d1f/d47/d37/f4b zero size 2024-09-21T11:39:02.928 INFO:tasks.workunit.client.1.smithi149.stdout:3/192: fsync d6/f2a 0 2024-09-21T11:39:02.928 INFO:tasks.workunit.client.1.smithi149.stdout:2/120: symlink d8/da/d13/d1a/l26 0 2024-09-21T11:39:02.928 INFO:tasks.workunit.client.1.smithi149.stdout:2/121: chown d8/dd/f12 3648312 1 2024-09-21T11:39:02.929 INFO:tasks.workunit.client.0.smithi118.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T11:39:02.929 INFO:tasks.workunit.client.0.smithi118.stderr:+ popd 2024-09-21T11:39:02.930 INFO:tasks.workunit.client.1.smithi149.stdout:7/215: rename fb to d12/f41 0 2024-09-21T11:39:02.930 INFO:tasks.workunit.client.0.smithi118.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T11:39:02.930 INFO:tasks.workunit.client.0.smithi118.stderr:+ popd 2024-09-21T11:39:02.931 INFO:tasks.workunit.client.1.smithi149.stdout:5/109: symlink d4/d1d/l22 0 2024-09-21T11:39:02.931 INFO:tasks.workunit.client.1.smithi149.stdout:7/216: truncate d12/d15/d26/d30/f34 478565 0 2024-09-21T11:39:02.931 INFO:tasks.workunit.client.0.smithi118.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-21T11:39:02.931 INFO:tasks.workunit.client.0.smithi118.stderr:++ mktemp -d -p . 2024-09-21T11:39:02.932 INFO:tasks.workunit.client.1.smithi149.stdout:5/110: truncate d4/f18 810287 0 2024-09-21T11:39:02.932 INFO:tasks.workunit.client.1.smithi149.stdout:2/122: creat d8/da/d13/d23/f27 x:0 0 0 2024-09-21T11:39:02.932 INFO:tasks.workunit.client.1.smithi149.stdout:7/217: write d12/d15/d26/d30/d31/f37 [42607,108079] 0 2024-09-21T11:39:02.932 INFO:tasks.workunit.client.1.smithi149.stdout:2/123: chown d8/da/l15 142 1 2024-09-21T11:39:02.932 INFO:tasks.workunit.client.1.smithi149.stdout:7/218: readlink d12/l28 0 2024-09-21T11:39:02.934 INFO:tasks.workunit.client.0.smithi118.stderr:+ T=./tmp.epEnj0Ip6N 2024-09-21T11:39:02.934 INFO:tasks.workunit.client.0.smithi118.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.epEnj0Ip6N -l 1 -n 1000 -p 10 -v 2024-09-21T11:39:02.935 INFO:tasks.workunit.client.1.smithi149.stdout:2/124: creat d8/da/f28 x:0 0 0 2024-09-21T11:39:02.938 INFO:tasks.workunit.client.1.smithi149.stdout:7/219: mknod d12/c42 0 2024-09-21T11:39:02.941 INFO:tasks.workunit.client.1.smithi149.stdout:2/125: fsync d8/dd/f12 0 2024-09-21T11:39:02.942 INFO:tasks.workunit.client.1.smithi149.stdout:7/220: dread d12/d15/f20 [0,4194304] 0 2024-09-21T11:39:02.942 INFO:tasks.workunit.client.1.smithi149.stdout:2/126: readlink d8/da/d13/d1a/l26 0 2024-09-21T11:39:02.944 INFO:tasks.workunit.client.0.smithi118.stdout:seed = 1726011600 2024-09-21T11:39:02.946 INFO:tasks.workunit.client.1.smithi149.stdout:7/221: stat l2 0 2024-09-21T11:39:02.949 INFO:tasks.workunit.client.1.smithi149.stdout:2/127: mkdir d8/da/d13/d1a/d29 0 2024-09-21T11:39:02.950 INFO:tasks.workunit.client.1.smithi149.stdout:2/128: chown l6 1 1 2024-09-21T11:39:02.952 INFO:tasks.workunit.client.1.smithi149.stdout:7/222: dwrite d12/d15/d26/d30/d31/f3f [0,4194304] 0 2024-09-21T11:39:02.952 INFO:tasks.workunit.client.1.smithi149.stdout:2/129: rmdir d8/da/d13 39 2024-09-21T11:39:02.954 INFO:tasks.workunit.client.0.smithi118.stdout:1/0: read - no filename 2024-09-21T11:39:02.957 INFO:tasks.workunit.client.0.smithi118.stdout:2/0: chown . 8997 1 2024-09-21T11:39:02.958 INFO:tasks.workunit.client.0.smithi118.stdout:2/1: dread - no filename 2024-09-21T11:39:02.958 INFO:tasks.workunit.client.0.smithi118.stdout:2/2: dread - no filename 2024-09-21T11:39:02.958 INFO:tasks.workunit.client.0.smithi118.stdout:2/3: rename - no filename 2024-09-21T11:39:02.958 INFO:tasks.workunit.client.0.smithi118.stdout:2/4: readlink - no filename 2024-09-21T11:39:02.958 INFO:tasks.workunit.client.0.smithi118.stdout:0/0: mknod c0 0 2024-09-21T11:39:02.958 INFO:tasks.workunit.client.0.smithi118.stdout:0/1: dread - no filename 2024-09-21T11:39:02.958 INFO:tasks.workunit.client.0.smithi118.stdout:0/2: write - no filename 2024-09-21T11:39:02.962 INFO:tasks.workunit.client.0.smithi118.stdout:3/0: chown . 605849281 1 2024-09-21T11:39:02.963 INFO:tasks.workunit.client.1.smithi149.stdout:5/111: dwrite d4/f9 [0,4194304] 0 2024-09-21T11:39:02.966 INFO:tasks.workunit.client.0.smithi118.stdout:0/3: rename c0 to c1 0 2024-09-21T11:39:02.966 INFO:tasks.workunit.client.0.smithi118.stdout:0/4: dread - no filename 2024-09-21T11:39:02.967 INFO:tasks.workunit.client.0.smithi118.stdout:0/5: dwrite - no filename 2024-09-21T11:39:02.967 INFO:tasks.workunit.client.0.smithi118.stdout:1/1: creat f0 x:0 0 0 2024-09-21T11:39:02.967 INFO:tasks.workunit.client.0.smithi118.stdout:1/2: dread - f0 zero size 2024-09-21T11:39:02.967 INFO:tasks.workunit.client.1.smithi149.stdout:7/223: dwrite d12/d15/d26/f2e [0,4194304] 0 2024-09-21T11:39:02.969 INFO:tasks.workunit.client.0.smithi118.stdout:4/0: dwrite - no filename 2024-09-21T11:39:02.969 INFO:tasks.workunit.client.0.smithi118.stdout:4/1: dwrite - no filename 2024-09-21T11:39:02.969 INFO:tasks.workunit.client.1.smithi149.stdout:7/224: chown l2 1486966531 1 2024-09-21T11:39:02.971 INFO:tasks.workunit.client.1.smithi149.stdout:2/130: dwrite d8/da/d13/d23/f27 [0,4194304] 0 2024-09-21T11:39:02.972 INFO:tasks.workunit.client.0.smithi118.stdout:2/5: creat f0 x:0 0 0 2024-09-21T11:39:02.972 INFO:tasks.workunit.client.0.smithi118.stdout:2/6: dread - f0 zero size 2024-09-21T11:39:02.973 INFO:tasks.workunit.client.1.smithi149.stdout:7/225: chown f4 212 1 2024-09-21T11:39:02.974 INFO:tasks.workunit.client.0.smithi118.stdout:0/6: mknod c2 0 2024-09-21T11:39:02.974 INFO:tasks.workunit.client.0.smithi118.stdout:0/7: read - no filename 2024-09-21T11:39:02.974 INFO:tasks.workunit.client.0.smithi118.stdout:0/8: read - no filename 2024-09-21T11:39:02.974 INFO:tasks.workunit.client.0.smithi118.stdout:0/9: dwrite - no filename 2024-09-21T11:39:02.974 INFO:tasks.workunit.client.0.smithi118.stdout:0/10: stat c2 0 2024-09-21T11:39:02.975 INFO:tasks.workunit.client.0.smithi118.stdout:0/11: chown c2 108273 1 2024-09-21T11:39:02.976 INFO:tasks.workunit.client.0.smithi118.stdout:3/1: creat f0 x:0 0 0 2024-09-21T11:39:02.976 INFO:tasks.workunit.client.0.smithi118.stdout:0/12: chown c2 42921 1 2024-09-21T11:39:02.977 INFO:tasks.workunit.client.0.smithi118.stdout:1/3: dwrite f0 [0,4194304] 0 2024-09-21T11:39:02.978 INFO:tasks.workunit.client.0.smithi118.stdout:1/4: chown f0 16117368 1 2024-09-21T11:39:02.980 INFO:tasks.workunit.client.0.smithi118.stdout:5/0: dwrite - no filename 2024-09-21T11:39:02.980 INFO:tasks.workunit.client.0.smithi118.stdout:5/1: dwrite - no filename 2024-09-21T11:39:02.981 INFO:tasks.workunit.client.1.smithi149.stdout:7/226: symlink d12/d15/d26/l43 0 2024-09-21T11:39:02.981 INFO:tasks.workunit.client.1.smithi149.stdout:5/112: dread d4/f18 [0,4194304] 0 2024-09-21T11:39:02.988 INFO:tasks.workunit.client.1.smithi149.stdout:2/131: unlink d8/dd/c1e 0 2024-09-21T11:39:02.989 INFO:tasks.workunit.client.1.smithi149.stdout:2/132: fdatasync d8/f1c 0 2024-09-21T11:39:02.990 INFO:tasks.workunit.client.0.smithi118.stdout:2/7: mknod c1 0 2024-09-21T11:39:02.993 INFO:tasks.workunit.client.0.smithi118.stdout:1/5: dread f0 [0,4194304] 0 2024-09-21T11:39:02.994 INFO:tasks.workunit.client.0.smithi118.stdout:1/6: read f0 [626140,22395] 0 2024-09-21T11:39:02.997 INFO:tasks.workunit.client.0.smithi118.stdout:3/2: creat f1 x:0 0 0 2024-09-21T11:39:02.998 INFO:tasks.workunit.client.1.smithi149.stdout:7/227: symlink d12/d15/l44 0 2024-09-21T11:39:03.000 INFO:tasks.workunit.client.0.smithi118.stdout:2/8: dwrite f0 [0,4194304] 0 2024-09-21T11:39:03.002 INFO:tasks.workunit.client.0.smithi118.stdout:2/9: write f0 [3421650,98891] 0 2024-09-21T11:39:03.004 INFO:tasks.workunit.client.0.smithi118.stdout:1/7: dread f0 [0,4194304] 0 2024-09-21T11:39:03.005 INFO:tasks.workunit.client.1.smithi149.stdout:5/113: link d4/f12 d4/d7/d1a/f23 0 2024-09-21T11:39:03.005 INFO:tasks.workunit.client.1.smithi149.stdout:5/114: chown d4/c6 357805 1 2024-09-21T11:39:03.006 INFO:tasks.workunit.client.1.smithi149.stdout:5/115: chown d4/d7/l17 5 1 2024-09-21T11:39:03.008 INFO:tasks.workunit.client.0.smithi118.stdout:2/10: dread f0 [0,4194304] 0 2024-09-21T11:39:03.008 INFO:tasks.workunit.client.0.smithi118.stdout:4/2: creat f0 x:0 0 0 2024-09-21T11:39:03.012 INFO:tasks.workunit.client.0.smithi118.stdout:3/3: creat f2 x:0 0 0 2024-09-21T11:39:03.013 INFO:tasks.workunit.client.0.smithi118.stdout:3/4: stat f0 0 2024-09-21T11:39:03.015 INFO:tasks.workunit.client.0.smithi118.stdout:3/5: write f0 [680046,72468] 0 2024-09-21T11:39:03.016 INFO:tasks.workunit.client.1.smithi149.stdout:2/133: creat d8/da/f2a x:0 0 0 2024-09-21T11:39:03.017 INFO:tasks.workunit.client.0.smithi118.stdout:3/6: truncate f2 809085 0 2024-09-21T11:39:03.017 INFO:tasks.workunit.client.1.smithi149.stdout:4/142: sync 2024-09-21T11:39:03.017 INFO:tasks.workunit.client.1.smithi149.stdout:0/63: sync 2024-09-21T11:39:03.017 INFO:tasks.workunit.client.1.smithi149.stdout:2/134: dread - d8/da/f28 zero size 2024-09-21T11:39:03.018 INFO:tasks.workunit.client.1.smithi149.stdout:4/143: read d4/d6/f9 [134091,1871] 0 2024-09-21T11:39:03.019 INFO:tasks.workunit.client.0.smithi118.stdout:4/3: dwrite f0 [0,4194304] 0 2024-09-21T11:39:03.019 INFO:tasks.workunit.client.1.smithi149.stdout:2/135: chown d8/dd/c17 136 1 2024-09-21T11:39:03.019 INFO:tasks.workunit.client.1.smithi149.stdout:4/144: chown d4/d13/d10 986168378 1 2024-09-21T11:39:03.020 INFO:tasks.workunit.client.1.smithi149.stdout:2/136: fdatasync d8/da/d13/d23/f27 0 2024-09-21T11:39:03.020 INFO:tasks.workunit.client.1.smithi149.stdout:2/137: readlink d8/dd/l16 0 2024-09-21T11:39:03.022 INFO:tasks.workunit.client.0.smithi118.stdout:5/2: mkdir d0 0 2024-09-21T11:39:03.023 INFO:tasks.workunit.client.1.smithi149.stdout:2/138: dread d8/dd/f12 [0,4194304] 0 2024-09-21T11:39:03.025 INFO:tasks.workunit.client.1.smithi149.stdout:0/64: rename c7 to dd/c11 0 2024-09-21T11:39:03.029 INFO:tasks.workunit.client.0.smithi118.stdout:1/8: creat f1 x:0 0 0 2024-09-21T11:39:03.029 INFO:tasks.workunit.client.0.smithi118.stdout:1/9: chown f0 11451924 1 2024-09-21T11:39:03.031 INFO:tasks.workunit.client.0.smithi118.stdout:2/11: creat f2 x:0 0 0 2024-09-21T11:39:03.032 INFO:tasks.workunit.client.1.smithi149.stdout:4/145: mkdir d4/d13/d10/d31/d32 0 2024-09-21T11:39:03.032 INFO:tasks.workunit.client.0.smithi118.stdout:0/13: chown c1 431590 1 2024-09-21T11:39:03.032 INFO:tasks.workunit.client.1.smithi149.stdout:4/146: chown d4/f27 77636 1 2024-09-21T11:39:03.034 INFO:tasks.workunit.client.1.smithi149.stdout:2/139: creat d8/dd/f2b x:0 0 0 2024-09-21T11:39:03.035 INFO:tasks.workunit.client.1.smithi149.stdout:2/140: dread - d8/dd/f24 zero size 2024-09-21T11:39:03.035 INFO:tasks.workunit.client.1.smithi149.stdout:7/228: write f4 [251228,19627] 0 2024-09-21T11:39:03.035 INFO:tasks.workunit.client.1.smithi149.stdout:4/147: dread d4/d13/f12 [4194304,4194304] 0 2024-09-21T11:39:03.036 INFO:tasks.workunit.client.1.smithi149.stdout:0/65: rename l9 to dd/l12 0 2024-09-21T11:39:03.037 INFO:tasks.workunit.client.0.smithi118.stdout:3/7: creat f3 x:0 0 0 2024-09-21T11:39:03.038 INFO:tasks.workunit.client.1.smithi149.stdout:5/116: link c1 d4/c24 0 2024-09-21T11:39:03.039 INFO:tasks.workunit.client.1.smithi149.stdout:5/117: write f2 [3246966,46875] 0 2024-09-21T11:39:03.041 INFO:tasks.workunit.client.0.smithi118.stdout:8/0: read - no filename 2024-09-21T11:39:03.041 INFO:tasks.workunit.client.0.smithi118.stdout:8/1: fsync - no filename 2024-09-21T11:39:03.042 INFO:tasks.workunit.client.0.smithi118.stdout:8/2: rename - no filename 2024-09-21T11:39:03.042 INFO:tasks.workunit.client.0.smithi118.stdout:8/3: write - no filename 2024-09-21T11:39:03.042 INFO:tasks.workunit.client.0.smithi118.stdout:8/4: fdatasync - no filename 2024-09-21T11:39:03.042 INFO:tasks.workunit.client.0.smithi118.stdout:8/5: chown . 2 1 2024-09-21T11:39:03.042 INFO:tasks.workunit.client.0.smithi118.stdout:8/6: dwrite - no filename 2024-09-21T11:39:03.042 INFO:tasks.workunit.client.0.smithi118.stdout:8/7: dread - no filename 2024-09-21T11:39:03.042 INFO:tasks.workunit.client.0.smithi118.stdout:8/8: dwrite - no filename 2024-09-21T11:39:03.042 INFO:tasks.workunit.client.0.smithi118.stdout:8/9: write - no filename 2024-09-21T11:39:03.042 INFO:tasks.workunit.client.1.smithi149.stdout:0/66: symlink dd/l13 0 2024-09-21T11:39:03.043 INFO:tasks.workunit.client.0.smithi118.stdout:6/0: mknod c0 0 2024-09-21T11:39:03.044 INFO:tasks.workunit.client.1.smithi149.stdout:0/67: truncate dd/fe 886583 0 2024-09-21T11:39:03.045 INFO:tasks.workunit.client.1.smithi149.stdout:5/118: dwrite f2 [4194304,4194304] 0 2024-09-21T11:39:03.045 INFO:tasks.workunit.client.0.smithi118.stdout:3/8: dwrite f0 [0,4194304] 0 2024-09-21T11:39:03.046 INFO:tasks.workunit.client.0.smithi118.stdout:3/9: read f0 [1659906,108285] 0 2024-09-21T11:39:03.046 INFO:tasks.workunit.client.0.smithi118.stdout:3/10: chown f1 8187 1 2024-09-21T11:39:03.047 INFO:tasks.workunit.client.1.smithi149.stdout:2/141: rename d8/da/d13/d23 to d8/da/d13/d1a/d2c 0 2024-09-21T11:39:03.047 INFO:tasks.workunit.client.0.smithi118.stdout:3/11: write f0 [1566958,108118] 0 2024-09-21T11:39:03.047 INFO:tasks.workunit.client.1.smithi149.stdout:2/142: readlink d8/dd/l16 0 2024-09-21T11:39:03.051 INFO:tasks.workunit.client.0.smithi118.stdout:1/10: mknod c2 0 2024-09-21T11:39:03.052 INFO:tasks.workunit.client.0.smithi118.stdout:1/11: chown f0 0 1 2024-09-21T11:39:03.053 INFO:tasks.workunit.client.1.smithi149.stdout:0/68: mknod dd/c14 0 2024-09-21T11:39:03.054 INFO:tasks.workunit.client.0.smithi118.stdout:2/12: creat f3 x:0 0 0 2024-09-21T11:39:03.054 INFO:tasks.workunit.client.0.smithi118.stdout:2/13: write f3 [590030,92576] 0 2024-09-21T11:39:03.056 INFO:tasks.workunit.client.1.smithi149.stdout:5/119: creat d4/d7/f25 x:0 0 0 2024-09-21T11:39:03.057 INFO:tasks.workunit.client.0.smithi118.stdout:0/14: rename c2 to c3 0 2024-09-21T11:39:03.059 INFO:tasks.workunit.client.1.smithi149.stdout:2/143: mkdir d8/da/d13/d2d 0 2024-09-21T11:39:03.061 INFO:tasks.workunit.client.1.smithi149.stdout:0/69: creat dd/f15 x:0 0 0 2024-09-21T11:39:03.062 INFO:tasks.workunit.client.0.smithi118.stdout:9/0: dread - no filename 2024-09-21T11:39:03.062 INFO:tasks.workunit.client.0.smithi118.stdout:9/1: chown . 38573 1 2024-09-21T11:39:03.063 INFO:tasks.workunit.client.1.smithi149.stdout:2/144: creat d8/da/d13/f2e x:0 0 0 2024-09-21T11:39:03.064 INFO:tasks.workunit.client.1.smithi149.stdout:5/120: dwrite d4/d7/f25 [0,4194304] 0 2024-09-21T11:39:03.064 INFO:tasks.workunit.client.0.smithi118.stdout:7/0: mkdir d0 0 2024-09-21T11:39:03.067 INFO:tasks.workunit.client.0.smithi118.stdout:6/1: rename c0 to c1 0 2024-09-21T11:39:03.075 INFO:tasks.workunit.client.1.smithi149.stdout:2/145: dwrite f7 [0,4194304] 0 2024-09-21T11:39:03.076 INFO:tasks.workunit.client.1.smithi149.stdout:2/146: fsync d8/da/f2a 0 2024-09-21T11:39:03.076 INFO:tasks.workunit.client.0.smithi118.stdout:4/4: rename f0 to f1 0 2024-09-21T11:39:03.079 INFO:tasks.workunit.client.0.smithi118.stdout:3/12: creat f4 x:0 0 0 2024-09-21T11:39:03.083 INFO:tasks.workunit.client.0.smithi118.stdout:5/3: mknod d0/c1 0 2024-09-21T11:39:03.083 INFO:tasks.workunit.client.0.smithi118.stdout:5/4: dwrite - no filename 2024-09-21T11:39:03.083 INFO:tasks.workunit.client.0.smithi118.stdout:5/5: chown d0/c1 15 1 2024-09-21T11:39:03.085 INFO:tasks.workunit.client.1.smithi149.stdout:0/70: link dd/c11 dd/c16 0 2024-09-21T11:39:03.086 INFO:tasks.workunit.client.1.smithi149.stdout:0/71: write dd/fe [1877802,8490] 0 2024-09-21T11:39:03.090 INFO:tasks.workunit.client.1.smithi149.stdout:2/147: truncate d8/f1c 1067861 0 2024-09-21T11:39:03.092 INFO:tasks.workunit.client.1.smithi149.stdout:2/148: write d8/da/d13/d1a/f1f [794888,48541] 0 2024-09-21T11:39:03.093 INFO:tasks.workunit.client.0.smithi118.stdout:8/10: creat f0 x:0 0 0 2024-09-21T11:39:03.093 INFO:tasks.workunit.client.0.smithi118.stdout:8/11: truncate f0 84777 0 2024-09-21T11:39:03.093 INFO:tasks.workunit.client.1.smithi149.stdout:0/72: dwrite dd/f15 [0,4194304] 0 2024-09-21T11:39:03.094 INFO:tasks.workunit.client.1.smithi149.stdout:0/73: fdatasync dd/fe 0 2024-09-21T11:39:03.095 INFO:tasks.workunit.client.1.smithi149.stdout:0/74: stat dd/c14 0 2024-09-21T11:39:03.096 INFO:tasks.workunit.client.1.smithi149.stdout:0/75: truncate fa 4235339 0 2024-09-21T11:39:03.096 INFO:tasks.workunit.client.0.smithi118.stdout:4/5: mkdir d2 0 2024-09-21T11:39:03.098 INFO:tasks.workunit.client.1.smithi149.stdout:5/121: write d4/f12 [1886076,6417] 0 2024-09-21T11:39:03.098 INFO:tasks.workunit.client.0.smithi118.stdout:3/13: mkdir d5 0 2024-09-21T11:39:03.102 INFO:tasks.workunit.client.1.smithi149.stdout:0/76: mknod dd/c17 0 2024-09-21T11:39:03.106 INFO:tasks.workunit.client.1.smithi149.stdout:2/149: link d8/da/f28 d8/da/d13/d1a/d2c/f2f 0 2024-09-21T11:39:03.106 INFO:tasks.workunit.client.1.smithi149.stdout:2/150: write d8/dd/f1d [484753,49225] 0 2024-09-21T11:39:03.107 INFO:tasks.workunit.client.0.smithi118.stdout:9/2: mkdir d0 0 2024-09-21T11:39:03.107 INFO:tasks.workunit.client.0.smithi118.stdout:9/3: write - no filename 2024-09-21T11:39:03.107 INFO:tasks.workunit.client.0.smithi118.stdout:9/4: fsync - no filename 2024-09-21T11:39:03.107 INFO:tasks.workunit.client.0.smithi118.stdout:9/5: read - no filename 2024-09-21T11:39:03.108 INFO:tasks.workunit.client.1.smithi149.stdout:0/77: creat dd/f18 x:0 0 0 2024-09-21T11:39:03.109 INFO:tasks.workunit.client.0.smithi118.stdout:7/1: creat d0/f1 x:0 0 0 2024-09-21T11:39:03.109 INFO:tasks.workunit.client.0.smithi118.stdout:7/2: read - d0/f1 zero size 2024-09-21T11:39:03.110 INFO:tasks.workunit.client.0.smithi118.stdout:8/12: mknod c1 0 2024-09-21T11:39:03.112 INFO:tasks.workunit.client.0.smithi118.stdout:6/2: rename c1 to c2 0 2024-09-21T11:39:03.113 INFO:tasks.workunit.client.1.smithi149.stdout:2/151: mkdir d8/d30 0 2024-09-21T11:39:03.113 INFO:tasks.workunit.client.1.smithi149.stdout:5/122: write d4/f18 [1268748,64821] 0 2024-09-21T11:39:03.115 INFO:tasks.workunit.client.1.smithi149.stdout:2/152: mknod d8/da/d13/d1a/c31 0 2024-09-21T11:39:03.116 INFO:tasks.workunit.client.1.smithi149.stdout:1/129: sync 2024-09-21T11:39:03.116 INFO:tasks.workunit.client.1.smithi149.stdout:8/127: sync 2024-09-21T11:39:03.116 INFO:tasks.workunit.client.0.smithi118.stdout:0/15: link c3 c4 0 2024-09-21T11:39:03.116 INFO:tasks.workunit.client.0.smithi118.stdout:0/16: dread - no filename 2024-09-21T11:39:03.117 INFO:tasks.workunit.client.0.smithi118.stdout:8/13: mkdir d2 0 2024-09-21T11:39:03.117 INFO:tasks.workunit.client.0.smithi118.stdout:8/14: chown c1 99204 1 2024-09-21T11:39:03.118 INFO:tasks.workunit.client.0.smithi118.stdout:6/3: creat f3 x:0 0 0 2024-09-21T11:39:03.118 INFO:tasks.workunit.client.0.smithi118.stdout:4/6: symlink d2/l3 0 2024-09-21T11:39:03.119 INFO:tasks.workunit.client.0.smithi118.stdout:6/4: truncate f3 911407 0 2024-09-21T11:39:03.122 INFO:tasks.workunit.client.1.smithi149.stdout:5/123: dwrite d4/f12 [0,4194304] 0 2024-09-21T11:39:03.123 INFO:tasks.workunit.client.1.smithi149.stdout:2/153: dread d8/dd/f12 [0,4194304] 0 2024-09-21T11:39:03.123 INFO:tasks.workunit.client.1.smithi149.stdout:1/130: fsync d2/dd/d11/d1c/f29 0 2024-09-21T11:39:03.128 INFO:tasks.workunit.client.1.smithi149.stdout:8/128: dwrite d3/dd/f1a [4194304,4194304] 0 2024-09-21T11:39:03.128 INFO:tasks.workunit.client.0.smithi118.stdout:3/14: symlink d5/l6 0 2024-09-21T11:39:03.129 INFO:tasks.workunit.client.0.smithi118.stdout:1/12: getdents . 0 2024-09-21T11:39:03.130 INFO:tasks.workunit.client.0.smithi118.stdout:5/6: link d0/c1 d0/c2 0 2024-09-21T11:39:03.130 INFO:tasks.workunit.client.0.smithi118.stdout:3/15: stat f3 0 2024-09-21T11:39:03.130 INFO:tasks.workunit.client.0.smithi118.stdout:7/3: fsync d0/f1 0 2024-09-21T11:39:03.131 INFO:tasks.workunit.client.0.smithi118.stdout:6/5: write f3 [203767,51069] 0 2024-09-21T11:39:03.132 INFO:tasks.workunit.client.0.smithi118.stdout:9/6: creat d0/f1 x:0 0 0 2024-09-21T11:39:03.133 INFO:tasks.workunit.client.0.smithi118.stdout:0/17: mkdir d5 0 2024-09-21T11:39:03.133 INFO:tasks.workunit.client.0.smithi118.stdout:0/18: dwrite - no filename 2024-09-21T11:39:03.133 INFO:tasks.workunit.client.0.smithi118.stdout:3/16: fdatasync f4 0 2024-09-21T11:39:03.134 INFO:tasks.workunit.client.1.smithi149.stdout:5/124: dwrite d4/d7/f25 [0,4194304] 0 2024-09-21T11:39:03.136 INFO:tasks.workunit.client.0.smithi118.stdout:4/7: creat d2/f4 x:0 0 0 2024-09-21T11:39:03.138 INFO:tasks.workunit.client.0.smithi118.stdout:9/7: write d0/f1 [518462,38115] 0 2024-09-21T11:39:03.139 INFO:tasks.workunit.client.0.smithi118.stdout:6/6: write f3 [1246486,129603] 0 2024-09-21T11:39:03.141 INFO:tasks.workunit.client.1.smithi149.stdout:8/129: write d3/f20 [276065,74382] 0 2024-09-21T11:39:03.144 INFO:tasks.workunit.client.1.smithi149.stdout:2/154: rename d8/dd/f10 to d8/da/d13/d1a/d29/f32 0 2024-09-21T11:39:03.146 INFO:tasks.workunit.client.0.smithi118.stdout:9/8: truncate d0/f1 1189450 0 2024-09-21T11:39:03.149 INFO:tasks.workunit.client.0.smithi118.stdout:3/17: write f2 [376688,70429] 0 2024-09-21T11:39:03.150 INFO:tasks.workunit.client.1.smithi149.stdout:1/131: truncate d2/f20 1849919 0 2024-09-21T11:39:03.150 INFO:tasks.workunit.client.0.smithi118.stdout:7/4: write d0/f1 [910782,127250] 0 2024-09-21T11:39:03.150 INFO:tasks.workunit.client.1.smithi149.stdout:1/132: fsync d2/f4 0 2024-09-21T11:39:03.152 INFO:tasks.workunit.client.0.smithi118.stdout:8/15: dwrite f0 [0,4194304] 0 2024-09-21T11:39:03.153 INFO:tasks.workunit.client.0.smithi118.stdout:6/7: read f3 [42796,8991] 0 2024-09-21T11:39:03.155 INFO:tasks.workunit.client.0.smithi118.stdout:1/13: dread f0 [0,4194304] 0 2024-09-21T11:39:03.158 INFO:tasks.workunit.client.0.smithi118.stdout:3/18: write f2 [1086856,69030] 0 2024-09-21T11:39:03.159 INFO:tasks.workunit.client.0.smithi118.stdout:3/19: read - f3 zero size 2024-09-21T11:39:03.159 INFO:tasks.workunit.client.1.smithi149.stdout:1/133: mkdir d2/d5/d8/d2a 0 2024-09-21T11:39:03.160 INFO:tasks.workunit.client.1.smithi149.stdout:1/134: write d2/dd/f12 [362312,43630] 0 2024-09-21T11:39:03.161 INFO:tasks.workunit.client.0.smithi118.stdout:4/8: dwrite d2/f4 [0,4194304] 0 2024-09-21T11:39:03.161 INFO:tasks.workunit.client.1.smithi149.stdout:2/155: truncate d8/f1c 1110725 0 2024-09-21T11:39:03.164 INFO:tasks.workunit.client.1.smithi149.stdout:5/125: link d4/lf d4/l26 0 2024-09-21T11:39:03.165 INFO:tasks.workunit.client.1.smithi149.stdout:5/126: read d4/f19 [645626,84236] 0 2024-09-21T11:39:03.166 INFO:tasks.workunit.client.0.smithi118.stdout:4/9: dread d2/f4 [0,4194304] 0 2024-09-21T11:39:03.171 INFO:tasks.workunit.client.0.smithi118.stdout:4/10: dread d2/f4 [0,4194304] 0 2024-09-21T11:39:03.173 INFO:tasks.workunit.client.1.smithi149.stdout:5/127: creat d4/d7/f27 x:0 0 0 2024-09-21T11:39:03.176 INFO:tasks.workunit.client.1.smithi149.stdout:2/156: mknod d8/d20/c33 0 2024-09-21T11:39:03.179 INFO:tasks.workunit.client.1.smithi149.stdout:1/135: rename d2/d5/d8/d2a to d2/d2b 0 2024-09-21T11:39:03.180 INFO:tasks.workunit.client.1.smithi149.stdout:8/130: dwrite d3/dd/f1b [0,4194304] 0 2024-09-21T11:39:03.180 INFO:tasks.workunit.client.1.smithi149.stdout:5/128: dread f2 [0,4194304] 0 2024-09-21T11:39:03.181 INFO:tasks.workunit.client.1.smithi149.stdout:5/129: chown f2 13997 1 2024-09-21T11:39:03.186 INFO:tasks.workunit.client.1.smithi149.stdout:5/130: dread d4/f5 [0,4194304] 0 2024-09-21T11:39:03.187 INFO:tasks.workunit.client.1.smithi149.stdout:5/131: write d4/f12 [799125,19587] 0 2024-09-21T11:39:03.188 INFO:tasks.workunit.client.1.smithi149.stdout:5/132: chown d4/d7/f25 77 1 2024-09-21T11:39:03.188 INFO:tasks.workunit.client.1.smithi149.stdout:5/133: fsync d4/f18 0 2024-09-21T11:39:03.193 INFO:tasks.workunit.client.1.smithi149.stdout:6/113: sync 2024-09-21T11:39:03.193 INFO:tasks.workunit.client.1.smithi149.stdout:3/193: sync 2024-09-21T11:39:03.193 INFO:tasks.workunit.client.1.smithi149.stdout:9/98: sync 2024-09-21T11:39:03.194 INFO:tasks.workunit.client.1.smithi149.stdout:3/194: dread - d6/d1f/d47/d22/f49 zero size 2024-09-21T11:39:03.200 INFO:tasks.workunit.client.1.smithi149.stdout:3/195: dwrite d6/d1f/f3e [0,4194304] 0 2024-09-21T11:39:03.235 INFO:tasks.workunit.client.1.smithi149.stdout:4/148: sync 2024-09-21T11:39:03.235 INFO:tasks.workunit.client.1.smithi149.stdout:0/78: sync 2024-09-21T11:39:03.235 INFO:tasks.workunit.client.1.smithi149.stdout:7/229: sync 2024-09-21T11:39:03.235 INFO:tasks.workunit.client.1.smithi149.stdout:4/149: chown d4/d13 148 1 2024-09-21T11:39:03.236 INFO:tasks.workunit.client.1.smithi149.stdout:4/150: write d4/d13/d15/f19 [3563927,3386] 0 2024-09-21T11:39:03.241 INFO:tasks.workunit.client.1.smithi149.stdout:0/79: dwrite dd/fe [0,4194304] 0 2024-09-21T11:39:03.279 INFO:tasks.workunit.client.1.smithi149.stdout:8/131: symlink d3/d12/l2a 0 2024-09-21T11:39:03.284 INFO:tasks.workunit.client.1.smithi149.stdout:2/157: creat d8/da/d13/d2d/f34 x:0 0 0 2024-09-21T11:39:03.289 INFO:tasks.workunit.client.1.smithi149.stdout:1/136: dwrite d2/d5/d8/f17 [0,4194304] 0 2024-09-21T11:39:03.290 INFO:tasks.workunit.client.1.smithi149.stdout:6/114: creat d8/da/d14/f1f x:0 0 0 2024-09-21T11:39:03.293 INFO:tasks.workunit.client.1.smithi149.stdout:3/196: creat d6/d1f/d47/d22/f4f x:0 0 0 2024-09-21T11:39:03.294 INFO:tasks.workunit.client.1.smithi149.stdout:3/197: chown c0 450801822 1 2024-09-21T11:39:03.299 INFO:tasks.workunit.client.1.smithi149.stdout:4/151: readlink d4/d13/d10/l21 0 2024-09-21T11:39:03.303 INFO:tasks.workunit.client.1.smithi149.stdout:0/80: chown dd/c16 56866388 1 2024-09-21T11:39:03.304 INFO:tasks.workunit.client.1.smithi149.stdout:0/81: write dd/f18 [90563,76530] 0 2024-09-21T11:39:03.308 INFO:tasks.workunit.client.1.smithi149.stdout:2/158: mknod d8/d11/c35 0 2024-09-21T11:39:03.311 INFO:tasks.workunit.client.1.smithi149.stdout:9/99: unlink lf 0 2024-09-21T11:39:03.313 INFO:tasks.workunit.client.1.smithi149.stdout:3/198: mkdir d6/d1f/d47/d37/d50 0 2024-09-21T11:39:03.314 INFO:tasks.workunit.client.1.smithi149.stdout:3/199: write d6/d1f/d27/f36 [1670556,99462] 0 2024-09-21T11:39:03.316 INFO:tasks.workunit.client.1.smithi149.stdout:0/82: creat dd/f19 x:0 0 0 2024-09-21T11:39:03.318 INFO:tasks.workunit.client.1.smithi149.stdout:2/159: unlink d8/dd/l16 0 2024-09-21T11:39:03.326 INFO:tasks.workunit.client.1.smithi149.stdout:4/152: dread d4/d13/f12 [0,4194304] 0 2024-09-21T11:39:03.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/200: symlink d6/d1f/l51 0 2024-09-21T11:39:03.328 INFO:tasks.workunit.client.1.smithi149.stdout:0/83: mkdir dd/d1a 0 2024-09-21T11:39:03.329 INFO:tasks.workunit.client.1.smithi149.stdout:0/84: write dd/f19 [380261,75677] 0 2024-09-21T11:39:03.330 INFO:tasks.workunit.client.1.smithi149.stdout:0/85: write dd/ff [5074558,100174] 0 2024-09-21T11:39:03.331 INFO:tasks.workunit.client.1.smithi149.stdout:2/160: creat d8/dd/f36 x:0 0 0 2024-09-21T11:39:03.332 INFO:tasks.workunit.client.1.smithi149.stdout:8/132: write d3/f8 [956060,73051] 0 2024-09-21T11:39:03.333 INFO:tasks.workunit.client.1.smithi149.stdout:5/134: getdents d4/d7 0 2024-09-21T11:39:03.334 INFO:tasks.workunit.client.1.smithi149.stdout:9/100: stat l17 0 2024-09-21T11:39:03.334 INFO:tasks.workunit.client.1.smithi149.stdout:9/101: dread - f10 zero size 2024-09-21T11:39:03.335 INFO:tasks.workunit.client.1.smithi149.stdout:8/133: dread d3/f20 [0,4194304] 0 2024-09-21T11:39:03.335 INFO:tasks.workunit.client.1.smithi149.stdout:9/102: chown cd 436 1 2024-09-21T11:39:03.336 INFO:tasks.workunit.client.1.smithi149.stdout:7/230: getdents d12/d15 0 2024-09-21T11:39:03.337 INFO:tasks.workunit.client.1.smithi149.stdout:4/153: creat d4/d13/d15/d16/f33 x:0 0 0 2024-09-21T11:39:03.341 INFO:tasks.workunit.client.1.smithi149.stdout:2/161: symlink d8/d11/l37 0 2024-09-21T11:39:03.344 INFO:tasks.workunit.client.1.smithi149.stdout:5/135: rmdir d4/d7/d1a 39 2024-09-21T11:39:03.345 INFO:tasks.workunit.client.1.smithi149.stdout:5/136: write d4/d7/f25 [3271215,130066] 0 2024-09-21T11:39:03.346 INFO:tasks.workunit.client.1.smithi149.stdout:6/115: getdents d8/da/d14 0 2024-09-21T11:39:03.346 INFO:tasks.workunit.client.1.smithi149.stdout:6/116: dread - d8/da/d14/f1f zero size 2024-09-21T11:39:03.348 INFO:tasks.workunit.client.1.smithi149.stdout:9/103: unlink f10 0 2024-09-21T11:39:03.350 INFO:tasks.workunit.client.1.smithi149.stdout:8/134: unlink d3/f25 0 2024-09-21T11:39:03.351 INFO:tasks.workunit.client.1.smithi149.stdout:9/104: dread f0 [0,4194304] 0 2024-09-21T11:39:03.352 INFO:tasks.workunit.client.1.smithi149.stdout:6/117: dwrite f4 [0,4194304] 0 2024-09-21T11:39:03.353 INFO:tasks.workunit.client.1.smithi149.stdout:6/118: write d8/da/d14/f1f [676399,22884] 0 2024-09-21T11:39:03.354 INFO:tasks.workunit.client.1.smithi149.stdout:4/154: creat d4/d13/d15/d16/f34 x:0 0 0 2024-09-21T11:39:03.357 INFO:tasks.workunit.client.1.smithi149.stdout:0/86: mkdir dd/d1a/d1b 0 2024-09-21T11:39:03.358 INFO:tasks.workunit.client.1.smithi149.stdout:2/162: creat d8/dd/f38 x:0 0 0 2024-09-21T11:39:03.359 INFO:tasks.workunit.client.1.smithi149.stdout:3/201: write d6/d1f/d27/f3c [611595,113675] 0 2024-09-21T11:39:03.361 INFO:tasks.workunit.client.1.smithi149.stdout:1/137: sync 2024-09-21T11:39:03.361 INFO:tasks.workunit.client.1.smithi149.stdout:4/155: dread d4/f7 [0,4194304] 0 2024-09-21T11:39:03.364 INFO:tasks.workunit.client.1.smithi149.stdout:4/156: dread d4/d13/f28 [0,4194304] 0 2024-09-21T11:39:03.369 INFO:tasks.workunit.client.1.smithi149.stdout:0/87: creat dd/f1c x:0 0 0 2024-09-21T11:39:03.375 INFO:tasks.workunit.client.1.smithi149.stdout:3/202: dwrite d6/f1b [0,4194304] 0 2024-09-21T11:39:03.375 INFO:tasks.workunit.client.1.smithi149.stdout:5/137: symlink d4/d7/l28 0 2024-09-21T11:39:03.383 INFO:tasks.workunit.client.1.smithi149.stdout:9/105: mkdir d18/d19 0 2024-09-21T11:39:03.383 INFO:tasks.workunit.client.1.smithi149.stdout:9/106: truncate f16 302837 0 2024-09-21T11:39:03.384 INFO:tasks.workunit.client.1.smithi149.stdout:9/107: chown f0 33938302 1 2024-09-21T11:39:03.386 INFO:tasks.workunit.client.1.smithi149.stdout:0/88: unlink dd/f18 0 2024-09-21T11:39:03.390 INFO:tasks.workunit.client.1.smithi149.stdout:8/135: truncate d3/f20 604030 0 2024-09-21T11:39:03.391 INFO:tasks.workunit.client.1.smithi149.stdout:0/89: dread dd/f15 [0,4194304] 0 2024-09-21T11:39:03.391 INFO:tasks.workunit.client.1.smithi149.stdout:0/90: write dd/f15 [3530832,79233] 0 2024-09-21T11:39:03.392 INFO:tasks.workunit.client.1.smithi149.stdout:0/91: fsync dd/ff 0 2024-09-21T11:39:03.395 INFO:tasks.workunit.client.1.smithi149.stdout:4/157: symlink d4/d13/d15/d16/d23/l35 0 2024-09-21T11:39:03.396 INFO:tasks.workunit.client.1.smithi149.stdout:3/203: dread d6/f13 [0,4194304] 0 2024-09-21T11:39:03.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/231: truncate d12/f18 226933 0 2024-09-21T11:39:03.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/232: dread - d12/d15/f1f zero size 2024-09-21T11:39:03.400 INFO:tasks.workunit.client.1.smithi149.stdout:2/163: creat d8/da/f39 x:0 0 0 2024-09-21T11:39:03.401 INFO:tasks.workunit.client.1.smithi149.stdout:7/233: write d12/d15/f2c [878861,89924] 0 2024-09-21T11:39:03.402 INFO:tasks.workunit.client.1.smithi149.stdout:2/164: write d8/dd/f24 [64849,81012] 0 2024-09-21T11:39:03.408 INFO:tasks.workunit.client.1.smithi149.stdout:7/234: dread d12/d15/f20 [0,4194304] 0 2024-09-21T11:39:03.408 INFO:tasks.workunit.client.1.smithi149.stdout:4/158: creat d4/f36 x:0 0 0 2024-09-21T11:39:03.409 INFO:tasks.workunit.client.1.smithi149.stdout:4/159: readlink d4/l20 0 2024-09-21T11:39:03.409 INFO:tasks.workunit.client.1.smithi149.stdout:2/165: dwrite d8/da/f39 [0,4194304] 0 2024-09-21T11:39:03.409 INFO:tasks.workunit.client.1.smithi149.stdout:9/108: mkdir d18/d19/d1a 0 2024-09-21T11:39:03.413 INFO:tasks.workunit.client.1.smithi149.stdout:8/136: mknod d3/dd/d18/c2b 0 2024-09-21T11:39:03.415 INFO:tasks.workunit.client.1.smithi149.stdout:0/92: mknod dd/d1a/d1b/c1d 0 2024-09-21T11:39:03.421 INFO:tasks.workunit.client.1.smithi149.stdout:2/166: truncate f3 1207157 0 2024-09-21T11:39:03.423 INFO:tasks.workunit.client.1.smithi149.stdout:8/137: rmdir d3/dd/d18 39 2024-09-21T11:39:03.423 INFO:tasks.workunit.client.1.smithi149.stdout:1/138: dwrite d2/f20 [0,4194304] 0 2024-09-21T11:39:03.425 INFO:tasks.workunit.client.1.smithi149.stdout:1/139: dread - d2/dd/f22 zero size 2024-09-21T11:39:03.427 INFO:tasks.workunit.client.1.smithi149.stdout:0/93: dwrite dd/fe [0,4194304] 0 2024-09-21T11:39:03.431 INFO:tasks.workunit.client.1.smithi149.stdout:0/94: fsync fa 0 2024-09-21T11:39:03.435 INFO:tasks.workunit.client.1.smithi149.stdout:6/119: sync 2024-09-21T11:39:03.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/95: write dd/f19 [146578,28131] 0 2024-09-21T11:39:03.436 INFO:tasks.workunit.client.1.smithi149.stdout:5/138: truncate d4/f5 782958 0 2024-09-21T11:39:03.437 INFO:tasks.workunit.client.1.smithi149.stdout:8/138: dread d3/fa [0,4194304] 0 2024-09-21T11:39:03.441 INFO:tasks.workunit.client.1.smithi149.stdout:3/204: creat d6/d1f/d47/f52 x:0 0 0 2024-09-21T11:39:03.442 INFO:tasks.workunit.client.1.smithi149.stdout:1/140: mkdir d2/dd/d11/d1c/d2c 0 2024-09-21T11:39:03.447 INFO:tasks.workunit.client.1.smithi149.stdout:4/160: write d4/d6/f9 [575201,50020] 0 2024-09-21T11:39:03.447 INFO:tasks.workunit.client.1.smithi149.stdout:3/205: dwrite d6/d1f/d47/d37/f4b [0,4194304] 0 2024-09-21T11:39:03.448 INFO:tasks.workunit.client.1.smithi149.stdout:0/96: rename cb to dd/d1a/c1e 0 2024-09-21T11:39:03.457 INFO:tasks.workunit.client.1.smithi149.stdout:7/235: write fa [924662,56422] 0 2024-09-21T11:39:03.458 INFO:tasks.workunit.client.1.smithi149.stdout:7/236: truncate d12/d15/f1f 567599 0 2024-09-21T11:39:03.461 INFO:tasks.workunit.client.1.smithi149.stdout:1/141: write d2/d5/f1d [5063377,39786] 0 2024-09-21T11:39:03.466 INFO:tasks.workunit.client.1.smithi149.stdout:0/97: mknod dd/d1a/c1f 0 2024-09-21T11:39:03.467 INFO:tasks.workunit.client.1.smithi149.stdout:9/109: link c12 d18/d19/d1a/c1b 0 2024-09-21T11:39:03.468 INFO:tasks.workunit.client.1.smithi149.stdout:3/206: dwrite d6/f9 [4194304,4194304] 0 2024-09-21T11:39:03.470 INFO:tasks.workunit.client.1.smithi149.stdout:6/120: unlink d8/da/d14/l1b 0 2024-09-21T11:39:03.473 INFO:tasks.workunit.client.1.smithi149.stdout:5/139: rename d4/f19 to d4/d7/d1a/f29 0 2024-09-21T11:39:03.475 INFO:tasks.workunit.client.1.smithi149.stdout:2/167: chown f3 218781 1 2024-09-21T11:39:03.477 INFO:tasks.workunit.client.1.smithi149.stdout:7/237: creat d12/d15/f45 x:0 0 0 2024-09-21T11:39:03.479 INFO:tasks.workunit.client.1.smithi149.stdout:1/142: stat d2/d5/d8/c14 0 2024-09-21T11:39:03.480 INFO:tasks.workunit.client.0.smithi118.stdout:5/7: mknod d0/c3 0 2024-09-21T11:39:03.481 INFO:tasks.workunit.client.0.smithi118.stdout:5/8: rename d0 to d0/d4 22 2024-09-21T11:39:03.483 INFO:tasks.workunit.client.1.smithi149.stdout:4/161: creat d4/d13/d15/d30/f37 x:0 0 0 2024-09-21T11:39:03.484 INFO:tasks.workunit.client.1.smithi149.stdout:1/143: dread d2/d5/f1d [0,4194304] 0 2024-09-21T11:39:03.484 INFO:tasks.workunit.client.1.smithi149.stdout:0/98: creat dd/d1a/d1b/f20 x:0 0 0 2024-09-21T11:39:03.486 INFO:tasks.workunit.client.1.smithi149.stdout:6/121: symlink d8/da/d14/l20 0 2024-09-21T11:39:03.487 INFO:tasks.workunit.client.1.smithi149.stdout:6/122: truncate d8/da/f1a 563536 0 2024-09-21T11:39:03.488 INFO:tasks.workunit.client.0.smithi118.stdout:9/9: mknod d0/c2 0 2024-09-21T11:39:03.488 INFO:tasks.workunit.client.1.smithi149.stdout:6/123: write f4 [4695533,46918] 0 2024-09-21T11:39:03.488 INFO:tasks.workunit.client.1.smithi149.stdout:1/144: dread d2/d5/d8/f1f [0,4194304] 0 2024-09-21T11:39:03.489 INFO:tasks.workunit.client.1.smithi149.stdout:5/140: mkdir d4/d7/d1a/d2a 0 2024-09-21T11:39:03.490 INFO:tasks.workunit.client.1.smithi149.stdout:5/141: chown d4/d7/l16 14121755 1 2024-09-21T11:39:03.490 INFO:tasks.workunit.client.1.smithi149.stdout:5/142: fsync d4/f9 0 2024-09-21T11:39:03.493 INFO:tasks.workunit.client.1.smithi149.stdout:2/168: rename d8/dd/f12 to d8/d11/f3a 0 2024-09-21T11:39:03.494 INFO:tasks.workunit.client.1.smithi149.stdout:2/169: fdatasync d8/da/d13/d1a/f1f 0 2024-09-21T11:39:03.494 INFO:tasks.workunit.client.0.smithi118.stdout:7/5: rename d0/f1 to d0/f2 0 2024-09-21T11:39:03.495 INFO:tasks.workunit.client.0.smithi118.stdout:7/6: chown d0 608267 1 2024-09-21T11:39:03.497 INFO:tasks.workunit.client.0.smithi118.stdout:1/14: symlink l3 0 2024-09-21T11:39:03.497 INFO:tasks.workunit.client.0.smithi118.stdout:1/15: chown l3 8489 1 2024-09-21T11:39:03.498 INFO:tasks.workunit.client.0.smithi118.stdout:1/16: truncate f1 1034688 0 2024-09-21T11:39:03.498 INFO:tasks.workunit.client.0.smithi118.stdout:6/8: mknod c4 0 2024-09-21T11:39:03.500 INFO:tasks.workunit.client.0.smithi118.stdout:3/20: mkdir d5/d7 0 2024-09-21T11:39:03.500 INFO:tasks.workunit.client.0.smithi118.stdout:3/21: write f3 [664560,57976] 0 2024-09-21T11:39:03.501 INFO:tasks.workunit.client.1.smithi149.stdout:4/162: mkdir d4/d13/d15/d38 0 2024-09-21T11:39:03.506 INFO:tasks.workunit.client.1.smithi149.stdout:0/99: rmdir dd/d1a 39 2024-09-21T11:39:03.507 INFO:tasks.workunit.client.0.smithi118.stdout:3/22: dread f0 [0,4194304] 0 2024-09-21T11:39:03.507 INFO:tasks.workunit.client.0.smithi118.stdout:4/11: mkdir d2/d5 0 2024-09-21T11:39:03.507 INFO:tasks.workunit.client.0.smithi118.stdout:5/9: creat d0/f5 x:0 0 0 2024-09-21T11:39:03.507 INFO:tasks.workunit.client.0.smithi118.stdout:5/10: chown d0 694560921 1 2024-09-21T11:39:03.508 INFO:tasks.workunit.client.0.smithi118.stdout:0/19: mknod d5/c6 0 2024-09-21T11:39:03.508 INFO:tasks.workunit.client.0.smithi118.stdout:0/20: dread - no filename 2024-09-21T11:39:03.510 INFO:tasks.workunit.client.1.smithi149.stdout:6/124: chown d8/da/d14/d18/f19 0 1 2024-09-21T11:39:03.511 INFO:tasks.workunit.client.0.smithi118.stdout:9/10: creat d0/f3 x:0 0 0 2024-09-21T11:39:03.512 INFO:tasks.workunit.client.0.smithi118.stdout:9/11: write d0/f1 [1745676,116423] 0 2024-09-21T11:39:03.513 INFO:tasks.workunit.client.0.smithi118.stdout:8/16: symlink d2/l3 0 2024-09-21T11:39:03.514 INFO:tasks.workunit.client.1.smithi149.stdout:8/139: getdents d3/dd 0 2024-09-21T11:39:03.516 INFO:tasks.workunit.client.1.smithi149.stdout:5/143: rename d4/d7/d1a/c21 to d4/d7/d1a/d2a/c2b 0 2024-09-21T11:39:03.519 INFO:tasks.workunit.client.0.smithi118.stdout:1/17: rename l3 to l4 0 2024-09-21T11:39:03.520 INFO:tasks.workunit.client.1.smithi149.stdout:2/170: mkdir d8/da/d13/d1a/d3b 0 2024-09-21T11:39:03.522 INFO:tasks.workunit.client.0.smithi118.stdout:6/9: symlink l5 0 2024-09-21T11:39:03.522 INFO:tasks.workunit.client.1.smithi149.stdout:7/238: stat d12/d15/l19 0 2024-09-21T11:39:03.523 INFO:tasks.workunit.client.0.smithi118.stdout:7/7: dwrite d0/f2 [0,4194304] 0 2024-09-21T11:39:03.524 INFO:tasks.workunit.client.0.smithi118.stdout:7/8: chown d0/f2 403690866 1 2024-09-21T11:39:03.526 INFO:tasks.workunit.client.0.smithi118.stdout:4/12: write f1 [2629226,22477] 0 2024-09-21T11:39:03.529 INFO:tasks.workunit.client.0.smithi118.stdout:7/9: dread d0/f2 [0,4194304] 0 2024-09-21T11:39:03.530 INFO:tasks.workunit.client.0.smithi118.stdout:5/11: mkdir d0/d6 0 2024-09-21T11:39:03.532 INFO:tasks.workunit.client.0.smithi118.stdout:0/21: creat d5/f7 x:0 0 0 2024-09-21T11:39:03.533 INFO:tasks.workunit.client.0.smithi118.stdout:0/22: truncate d5/f7 646764 0 2024-09-21T11:39:03.533 INFO:tasks.workunit.client.0.smithi118.stdout:0/23: readlink - no filename 2024-09-21T11:39:03.533 INFO:tasks.workunit.client.1.smithi149.stdout:6/125: mknod d8/da/d14/d18/c21 0 2024-09-21T11:39:03.534 INFO:tasks.workunit.client.0.smithi118.stdout:7/10: dread d0/f2 [0,4194304] 0 2024-09-21T11:39:03.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/126: truncate d8/da/fc 903441 0 2024-09-21T11:39:03.535 INFO:tasks.workunit.client.0.smithi118.stdout:8/17: mknod d2/c4 0 2024-09-21T11:39:03.536 INFO:tasks.workunit.client.0.smithi118.stdout:8/18: chown d2 1535 1 2024-09-21T11:39:03.536 INFO:tasks.workunit.client.1.smithi149.stdout:5/144: symlink d4/d1d/l2c 0 2024-09-21T11:39:03.537 INFO:tasks.workunit.client.0.smithi118.stdout:6/10: creat f6 x:0 0 0 2024-09-21T11:39:03.540 INFO:tasks.workunit.client.0.smithi118.stdout:4/13: rename d2/d5 to d2/d6 0 2024-09-21T11:39:03.540 INFO:tasks.workunit.client.1.smithi149.stdout:4/163: creat d4/d13/d10/d31/d32/f39 x:0 0 0 2024-09-21T11:39:03.541 INFO:tasks.workunit.client.1.smithi149.stdout:4/164: read - d4/d13/d15/d30/f37 zero size 2024-09-21T11:39:03.542 INFO:tasks.workunit.client.0.smithi118.stdout:3/23: link f3 d5/f8 0 2024-09-21T11:39:03.542 INFO:tasks.workunit.client.1.smithi149.stdout:3/207: getdents d6/d1f 0 2024-09-21T11:39:03.544 INFO:tasks.workunit.client.1.smithi149.stdout:9/110: sync 2024-09-21T11:39:03.544 INFO:tasks.workunit.client.1.smithi149.stdout:0/100: symlink dd/l21 0 2024-09-21T11:39:03.546 INFO:tasks.workunit.client.1.smithi149.stdout:9/111: fdatasync f16 0 2024-09-21T11:39:03.546 INFO:tasks.workunit.client.0.smithi118.stdout:3/24: dread f0 [0,4194304] 0 2024-09-21T11:39:03.546 INFO:tasks.workunit.client.0.smithi118.stdout:3/25: rename d5/d7 to d5/d7/d9 22 2024-09-21T11:39:03.546 INFO:tasks.workunit.client.0.smithi118.stdout:0/24: chown c4 1846448 1 2024-09-21T11:39:03.547 INFO:tasks.workunit.client.0.smithi118.stdout:0/25: read d5/f7 [635601,28986] 0 2024-09-21T11:39:03.547 INFO:tasks.workunit.client.0.smithi118.stdout:0/26: write d5/f7 [1285654,113817] 0 2024-09-21T11:39:03.550 INFO:tasks.workunit.client.0.smithi118.stdout:7/11: mkdir d0/d3 0 2024-09-21T11:39:03.553 INFO:tasks.workunit.client.0.smithi118.stdout:9/12: unlink d0/f3 0 2024-09-21T11:39:03.555 INFO:tasks.workunit.client.1.smithi149.stdout:1/145: creat d2/f2d x:0 0 0 2024-09-21T11:39:03.555 INFO:tasks.workunit.client.1.smithi149.stdout:8/140: truncate d3/f20 1042561 0 2024-09-21T11:39:03.556 INFO:tasks.workunit.client.1.smithi149.stdout:8/141: truncate d3/f17 1117016 0 2024-09-21T11:39:03.556 INFO:tasks.workunit.client.0.smithi118.stdout:8/19: symlink d2/l5 0 2024-09-21T11:39:03.557 INFO:tasks.workunit.client.1.smithi149.stdout:7/239: creat d12/d35/f46 x:0 0 0 2024-09-21T11:39:03.558 INFO:tasks.workunit.client.0.smithi118.stdout:8/20: read f0 [1529558,76619] 0 2024-09-21T11:39:03.559 INFO:tasks.workunit.client.1.smithi149.stdout:3/208: write d6/f8 [3923249,47031] 0 2024-09-21T11:39:03.561 INFO:tasks.workunit.client.1.smithi149.stdout:8/142: dwrite d3/d12/f24 [0,4194304] 0 2024-09-21T11:39:03.562 INFO:tasks.workunit.client.0.smithi118.stdout:5/12: creat d0/d6/f7 x:0 0 0 2024-09-21T11:39:03.563 INFO:tasks.workunit.client.0.smithi118.stdout:3/26: rmdir d5 39 2024-09-21T11:39:03.563 INFO:tasks.workunit.client.0.smithi118.stdout:9/13: dwrite d0/f1 [0,4194304] 0 2024-09-21T11:39:03.567 INFO:tasks.workunit.client.0.smithi118.stdout:0/27: creat d5/f8 x:0 0 0 2024-09-21T11:39:03.570 INFO:tasks.workunit.client.0.smithi118.stdout:6/11: dread f3 [0,4194304] 0 2024-09-21T11:39:03.571 INFO:tasks.workunit.client.0.smithi118.stdout:0/28: dread - d5/f8 zero size 2024-09-21T11:39:03.571 INFO:tasks.workunit.client.0.smithi118.stdout:6/12: readlink l5 0 2024-09-21T11:39:03.575 INFO:tasks.workunit.client.0.smithi118.stdout:3/27: write f0 [1723241,91962] 0 2024-09-21T11:39:03.575 INFO:tasks.workunit.client.0.smithi118.stdout:0/29: dread - d5/f8 zero size 2024-09-21T11:39:03.575 INFO:tasks.workunit.client.0.smithi118.stdout:5/13: creat d0/d6/f8 x:0 0 0 2024-09-21T11:39:03.577 INFO:tasks.workunit.client.0.smithi118.stdout:8/21: dwrite f0 [4194304,4194304] 0 2024-09-21T11:39:03.579 INFO:tasks.workunit.client.0.smithi118.stdout:4/14: dwrite d2/f4 [4194304,4194304] 0 2024-09-21T11:39:03.579 INFO:tasks.workunit.client.0.smithi118.stdout:1/18: getdents . 0 2024-09-21T11:39:03.581 INFO:tasks.workunit.client.0.smithi118.stdout:5/14: write d0/d6/f7 [736538,112940] 0 2024-09-21T11:39:03.581 INFO:tasks.workunit.client.0.smithi118.stdout:1/19: write f1 [879001,49695] 0 2024-09-21T11:39:03.589 INFO:tasks.workunit.client.0.smithi118.stdout:0/30: write d5/f7 [913193,32176] 0 2024-09-21T11:39:03.591 INFO:tasks.workunit.client.0.smithi118.stdout:0/31: write d5/f8 [295074,50856] 0 2024-09-21T11:39:03.591 INFO:tasks.workunit.client.0.smithi118.stdout:0/32: rename d5 to d5/d9 22 2024-09-21T11:39:03.592 INFO:tasks.workunit.client.0.smithi118.stdout:8/22: symlink d2/l6 0 2024-09-21T11:39:03.595 INFO:tasks.workunit.client.0.smithi118.stdout:4/15: creat d2/f7 x:0 0 0 2024-09-21T11:39:03.598 INFO:tasks.workunit.client.0.smithi118.stdout:1/20: write f0 [2388332,108059] 0 2024-09-21T11:39:03.600 INFO:tasks.workunit.client.0.smithi118.stdout:5/15: mkdir d0/d6/d9 0 2024-09-21T11:39:03.602 INFO:tasks.workunit.client.0.smithi118.stdout:5/16: write d0/d6/f7 [943481,30501] 0 2024-09-21T11:39:03.602 INFO:tasks.workunit.client.0.smithi118.stdout:5/17: readlink - no filename 2024-09-21T11:39:03.604 INFO:tasks.workunit.client.0.smithi118.stdout:7/12: getdents d0 0 2024-09-21T11:39:03.608 INFO:tasks.workunit.client.0.smithi118.stdout:0/33: symlink d5/la 0 2024-09-21T11:39:03.610 INFO:tasks.workunit.client.0.smithi118.stdout:5/18: dwrite d0/f5 [0,4194304] 0 2024-09-21T11:39:03.610 INFO:tasks.workunit.client.0.smithi118.stdout:8/23: creat d2/f7 x:0 0 0 2024-09-21T11:39:03.614 INFO:tasks.workunit.client.0.smithi118.stdout:1/21: creat f5 x:0 0 0 2024-09-21T11:39:03.619 INFO:tasks.workunit.client.0.smithi118.stdout:7/13: write d0/f2 [2749992,38011] 0 2024-09-21T11:39:03.619 INFO:tasks.workunit.client.0.smithi118.stdout:8/24: dwrite f0 [0,4194304] 0 2024-09-21T11:39:03.619 INFO:tasks.workunit.client.0.smithi118.stdout:3/28: creat d5/d7/fa x:0 0 0 2024-09-21T11:39:03.625 INFO:tasks.workunit.client.0.smithi118.stdout:8/25: dread - d2/f7 zero size 2024-09-21T11:39:03.626 INFO:tasks.workunit.client.0.smithi118.stdout:0/34: creat d5/fb x:0 0 0 2024-09-21T11:39:03.627 INFO:tasks.workunit.client.1.smithi149.stdout:9/112: sync 2024-09-21T11:39:03.629 INFO:tasks.workunit.client.0.smithi118.stdout:6/13: write f3 [2207141,61714] 0 2024-09-21T11:39:03.629 INFO:tasks.workunit.client.0.smithi118.stdout:1/22: dwrite f0 [0,4194304] 0 2024-09-21T11:39:03.630 INFO:tasks.workunit.client.0.smithi118.stdout:8/26: readlink d2/l5 0 2024-09-21T11:39:03.634 INFO:tasks.workunit.client.0.smithi118.stdout:9/14: dwrite d0/f1 [4194304,4194304] 0 2024-09-21T11:39:03.636 INFO:tasks.workunit.client.0.smithi118.stdout:1/23: write f1 [2059439,118983] 0 2024-09-21T11:39:03.639 INFO:tasks.workunit.client.0.smithi118.stdout:7/14: dread d0/f2 [0,4194304] 0 2024-09-21T11:39:03.641 INFO:tasks.workunit.client.0.smithi118.stdout:4/16: fsync d2/f7 0 2024-09-21T11:39:03.642 INFO:tasks.workunit.client.0.smithi118.stdout:3/29: dwrite f2 [0,4194304] 0 2024-09-21T11:39:03.642 INFO:tasks.workunit.client.0.smithi118.stdout:0/35: mknod d5/cc 0 2024-09-21T11:39:03.644 INFO:tasks.workunit.client.0.smithi118.stdout:4/17: dread - d2/f7 zero size 2024-09-21T11:39:03.644 INFO:tasks.workunit.client.0.smithi118.stdout:3/30: truncate f1 596891 0 2024-09-21T11:39:03.646 INFO:tasks.workunit.client.0.smithi118.stdout:0/36: fdatasync d5/f8 0 2024-09-21T11:39:03.646 INFO:tasks.workunit.client.0.smithi118.stdout:5/19: mkdir d0/d6/d9/da 0 2024-09-21T11:39:03.648 INFO:tasks.workunit.client.0.smithi118.stdout:9/15: dread d0/f1 [4194304,4194304] 0 2024-09-21T11:39:03.648 INFO:tasks.workunit.client.0.smithi118.stdout:5/20: chown d0/c3 1345490801 1 2024-09-21T11:39:03.648 INFO:tasks.workunit.client.0.smithi118.stdout:6/14: mknod c7 0 2024-09-21T11:39:03.650 INFO:tasks.workunit.client.0.smithi118.stdout:5/21: chown d0/d6/f7 92539 1 2024-09-21T11:39:03.651 INFO:tasks.workunit.client.0.smithi118.stdout:5/22: chown d0/d6 7788707 1 2024-09-21T11:39:03.651 INFO:tasks.workunit.client.0.smithi118.stdout:7/15: dread d0/f2 [0,4194304] 0 2024-09-21T11:39:03.651 INFO:tasks.workunit.client.0.smithi118.stdout:8/27: rmdir d2 39 2024-09-21T11:39:03.652 INFO:tasks.workunit.client.0.smithi118.stdout:5/23: truncate d0/d6/f7 1275950 0 2024-09-21T11:39:03.659 INFO:tasks.workunit.client.0.smithi118.stdout:1/24: mkdir d6 0 2024-09-21T11:39:03.660 INFO:tasks.workunit.client.0.smithi118.stdout:1/25: fsync f0 0 2024-09-21T11:39:03.662 INFO:tasks.workunit.client.0.smithi118.stdout:1/26: write f1 [1255730,121685] 0 2024-09-21T11:39:03.662 INFO:tasks.workunit.client.0.smithi118.stdout:4/18: mknod d2/c8 0 2024-09-21T11:39:03.664 INFO:tasks.workunit.client.0.smithi118.stdout:3/31: rename f4 to d5/d7/fb 0 2024-09-21T11:39:03.664 INFO:tasks.workunit.client.0.smithi118.stdout:3/32: chown d5/f8 21618569 1 2024-09-21T11:39:03.665 INFO:tasks.workunit.client.0.smithi118.stdout:3/33: chown f3 856 1 2024-09-21T11:39:03.666 INFO:tasks.workunit.client.0.smithi118.stdout:3/34: truncate d5/f8 1240700 0 2024-09-21T11:39:03.666 INFO:tasks.workunit.client.0.smithi118.stdout:0/37: symlink d5/ld 0 2024-09-21T11:39:03.668 INFO:tasks.workunit.client.0.smithi118.stdout:6/15: mkdir d8 0 2024-09-21T11:39:03.670 INFO:tasks.workunit.client.0.smithi118.stdout:9/16: mkdir d0/d4 0 2024-09-21T11:39:03.672 INFO:tasks.workunit.client.0.smithi118.stdout:6/16: dread f3 [0,4194304] 0 2024-09-21T11:39:03.673 INFO:tasks.workunit.client.0.smithi118.stdout:8/28: truncate d2/f7 8297 0 2024-09-21T11:39:03.674 INFO:tasks.workunit.client.0.smithi118.stdout:7/16: write d0/f2 [4466837,70154] 0 2024-09-21T11:39:03.675 INFO:tasks.workunit.client.0.smithi118.stdout:6/17: dread f3 [0,4194304] 0 2024-09-21T11:39:03.676 INFO:tasks.workunit.client.0.smithi118.stdout:5/24: mkdir d0/db 0 2024-09-21T11:39:03.678 INFO:tasks.workunit.client.0.smithi118.stdout:5/25: write d0/d6/f7 [778969,28320] 0 2024-09-21T11:39:03.679 INFO:tasks.workunit.client.0.smithi118.stdout:5/26: fsync d0/f5 0 2024-09-21T11:39:03.681 INFO:tasks.workunit.client.0.smithi118.stdout:8/29: dwrite f0 [0,4194304] 0 2024-09-21T11:39:03.684 INFO:tasks.workunit.client.0.smithi118.stdout:4/19: rmdir d2 39 2024-09-21T11:39:03.688 INFO:tasks.workunit.client.0.smithi118.stdout:5/27: dwrite d0/d6/f7 [0,4194304] 0 2024-09-21T11:39:03.691 INFO:tasks.workunit.client.0.smithi118.stdout:3/35: unlink f1 0 2024-09-21T11:39:03.694 INFO:tasks.workunit.client.0.smithi118.stdout:0/38: rename d5/la to d5/le 0 2024-09-21T11:39:03.696 INFO:tasks.workunit.client.0.smithi118.stdout:0/39: write d5/f8 [142901,85093] 0 2024-09-21T11:39:03.697 INFO:tasks.workunit.client.0.smithi118.stdout:3/36: dwrite f2 [0,4194304] 0 2024-09-21T11:39:03.699 INFO:tasks.workunit.client.0.smithi118.stdout:3/37: dread - d5/d7/fa zero size 2024-09-21T11:39:03.706 INFO:tasks.workunit.client.0.smithi118.stdout:0/40: dwrite d5/f8 [0,4194304] 0 2024-09-21T11:39:03.713 INFO:tasks.workunit.client.0.smithi118.stdout:8/30: mknod d2/c8 0 2024-09-21T11:39:03.715 INFO:tasks.workunit.client.0.smithi118.stdout:1/27: symlink d6/l7 0 2024-09-21T11:39:03.725 INFO:tasks.workunit.client.0.smithi118.stdout:9/17: link d0/f1 d0/f5 0 2024-09-21T11:39:03.726 INFO:tasks.workunit.client.0.smithi118.stdout:3/38: creat d5/d7/fc x:0 0 0 2024-09-21T11:39:03.727 INFO:tasks.workunit.client.0.smithi118.stdout:3/39: read - d5/d7/fc zero size 2024-09-21T11:39:03.728 INFO:tasks.workunit.client.0.smithi118.stdout:7/17: mknod d0/d3/c4 0 2024-09-21T11:39:03.730 INFO:tasks.workunit.client.0.smithi118.stdout:6/18: symlink d8/l9 0 2024-09-21T11:39:03.732 INFO:tasks.workunit.client.0.smithi118.stdout:0/41: mknod d5/cf 0 2024-09-21T11:39:03.733 INFO:tasks.workunit.client.0.smithi118.stdout:0/42: stat d5 0 2024-09-21T11:39:03.733 INFO:tasks.workunit.client.0.smithi118.stdout:3/40: dwrite f2 [0,4194304] 0 2024-09-21T11:39:03.733 INFO:tasks.workunit.client.0.smithi118.stdout:0/43: fdatasync d5/f8 0 2024-09-21T11:39:03.735 INFO:tasks.workunit.client.0.smithi118.stdout:8/31: creat d2/f9 x:0 0 0 2024-09-21T11:39:03.738 INFO:tasks.workunit.client.0.smithi118.stdout:4/20: rename d2/c8 to d2/d6/c9 0 2024-09-21T11:39:03.739 INFO:tasks.workunit.client.0.smithi118.stdout:4/21: write f1 [3518208,124486] 0 2024-09-21T11:39:03.739 INFO:tasks.workunit.client.0.smithi118.stdout:8/32: dread f0 [0,4194304] 0 2024-09-21T11:39:03.740 INFO:tasks.workunit.client.0.smithi118.stdout:8/33: readlink d2/l6 0 2024-09-21T11:39:03.741 INFO:tasks.workunit.client.0.smithi118.stdout:4/22: write f1 [584222,119721] 0 2024-09-21T11:39:03.741 INFO:tasks.workunit.client.0.smithi118.stdout:1/28: creat d6/f8 x:0 0 0 2024-09-21T11:39:03.750 INFO:tasks.workunit.client.0.smithi118.stdout:6/19: write f3 [450986,38721] 0 2024-09-21T11:39:03.752 INFO:tasks.workunit.client.0.smithi118.stdout:0/44: rmdir d5 39 2024-09-21T11:39:03.752 INFO:tasks.workunit.client.0.smithi118.stdout:4/23: dwrite f1 [0,4194304] 0 2024-09-21T11:39:03.753 INFO:tasks.workunit.client.0.smithi118.stdout:1/29: dwrite f5 [0,4194304] 0 2024-09-21T11:39:03.761 INFO:tasks.workunit.client.0.smithi118.stdout:8/34: creat d2/fa x:0 0 0 2024-09-21T11:39:03.764 INFO:tasks.workunit.client.0.smithi118.stdout:9/18: symlink d0/d4/l6 0 2024-09-21T11:39:03.771 INFO:tasks.workunit.client.0.smithi118.stdout:6/20: unlink l5 0 2024-09-21T11:39:03.776 INFO:tasks.workunit.client.0.smithi118.stdout:0/45: write d5/f7 [2430965,19531] 0 2024-09-21T11:39:03.776 INFO:tasks.workunit.client.0.smithi118.stdout:4/24: symlink d2/d6/la 0 2024-09-21T11:39:03.778 INFO:tasks.workunit.client.0.smithi118.stdout:3/41: write f3 [1623005,85164] 0 2024-09-21T11:39:03.778 INFO:tasks.workunit.client.0.smithi118.stdout:1/30: symlink d6/l9 0 2024-09-21T11:39:03.779 INFO:tasks.workunit.client.0.smithi118.stdout:6/21: dwrite f6 [0,4194304] 0 2024-09-21T11:39:03.780 INFO:tasks.workunit.client.0.smithi118.stdout:0/46: write d5/fb [631197,92784] 0 2024-09-21T11:39:03.781 INFO:tasks.workunit.client.0.smithi118.stdout:4/25: write d2/f4 [3644766,114797] 0 2024-09-21T11:39:03.782 INFO:tasks.workunit.client.0.smithi118.stdout:1/31: write d6/f8 [593483,45878] 0 2024-09-21T11:39:03.784 INFO:tasks.workunit.client.0.smithi118.stdout:8/35: write f0 [818685,28366] 0 2024-09-21T11:39:03.786 INFO:tasks.workunit.client.0.smithi118.stdout:9/19: rename d0/c2 to d0/d4/c7 0 2024-09-21T11:39:03.787 INFO:tasks.workunit.client.0.smithi118.stdout:1/32: dread f0 [0,4194304] 0 2024-09-21T11:39:03.794 INFO:tasks.workunit.client.0.smithi118.stdout:0/47: readlink d5/le 0 2024-09-21T11:39:03.794 INFO:tasks.workunit.client.0.smithi118.stdout:7/18: truncate d0/f2 3878907 0 2024-09-21T11:39:03.798 INFO:tasks.workunit.client.0.smithi118.stdout:8/36: mknod d2/cb 0 2024-09-21T11:39:03.800 INFO:tasks.workunit.client.0.smithi118.stdout:1/33: mknod d6/ca 0 2024-09-21T11:39:03.803 INFO:tasks.workunit.client.0.smithi118.stdout:0/48: mkdir d5/d10 0 2024-09-21T11:39:03.806 INFO:tasks.workunit.client.0.smithi118.stdout:7/19: creat d0/f5 x:0 0 0 2024-09-21T11:39:03.808 INFO:tasks.workunit.client.0.smithi118.stdout:7/20: write d0/f5 [139431,72168] 0 2024-09-21T11:39:03.809 INFO:tasks.workunit.client.0.smithi118.stdout:6/22: link f6 d8/fa 0 2024-09-21T11:39:03.810 INFO:tasks.workunit.client.0.smithi118.stdout:7/21: write d0/f5 [1021704,87299] 0 2024-09-21T11:39:03.811 INFO:tasks.workunit.client.0.smithi118.stdout:6/23: chown f6 3446724 1 2024-09-21T11:39:03.811 INFO:tasks.workunit.client.0.smithi118.stdout:0/49: dwrite d5/f8 [0,4194304] 0 2024-09-21T11:39:03.813 INFO:tasks.workunit.client.0.smithi118.stdout:1/34: creat d6/fb x:0 0 0 2024-09-21T11:39:03.815 INFO:tasks.workunit.client.0.smithi118.stdout:6/24: dread f3 [0,4194304] 0 2024-09-21T11:39:03.821 INFO:tasks.workunit.client.0.smithi118.stdout:1/35: dwrite f0 [4194304,4194304] 0 2024-09-21T11:39:03.828 INFO:tasks.workunit.client.0.smithi118.stdout:3/42: getdents d5 0 2024-09-21T11:39:03.831 INFO:tasks.workunit.client.0.smithi118.stdout:6/25: creat d8/fb x:0 0 0 2024-09-21T11:39:03.836 INFO:tasks.workunit.client.0.smithi118.stdout:1/36: symlink d6/lc 0 2024-09-21T11:39:03.837 INFO:tasks.workunit.client.0.smithi118.stdout:3/43: dwrite f2 [4194304,4194304] 0 2024-09-21T11:39:03.837 INFO:tasks.workunit.client.0.smithi118.stdout:3/44: readlink d5/l6 0 2024-09-21T11:39:03.838 INFO:tasks.workunit.client.0.smithi118.stdout:3/45: fdatasync f3 0 2024-09-21T11:39:03.843 INFO:tasks.workunit.client.0.smithi118.stdout:8/37: truncate f0 5462208 0 2024-09-21T11:39:03.845 INFO:tasks.workunit.client.0.smithi118.stdout:6/26: unlink c7 0 2024-09-21T11:39:03.848 INFO:tasks.workunit.client.0.smithi118.stdout:1/37: creat d6/fd x:0 0 0 2024-09-21T11:39:03.849 INFO:tasks.workunit.client.0.smithi118.stdout:1/38: dread - d6/fb zero size 2024-09-21T11:39:03.851 INFO:tasks.workunit.client.0.smithi118.stdout:1/39: write f5 [3867848,53618] 0 2024-09-21T11:39:03.851 INFO:tasks.workunit.client.0.smithi118.stdout:3/46: mknod d5/cd 0 2024-09-21T11:39:03.853 INFO:tasks.workunit.client.0.smithi118.stdout:6/27: dwrite d8/fb [0,4194304] 0 2024-09-21T11:39:03.861 INFO:tasks.workunit.client.0.smithi118.stdout:1/40: mkdir d6/de 0 2024-09-21T11:39:03.861 INFO:tasks.workunit.client.0.smithi118.stdout:1/41: chown l4 525100 1 2024-09-21T11:39:03.861 INFO:tasks.workunit.client.0.smithi118.stdout:3/47: unlink d5/d7/fb 0 2024-09-21T11:39:03.863 INFO:tasks.workunit.client.0.smithi118.stdout:0/50: getdents d5 0 2024-09-21T11:39:03.870 INFO:tasks.workunit.client.0.smithi118.stdout:1/42: unlink d6/lc 0 2024-09-21T11:39:03.873 INFO:tasks.workunit.client.0.smithi118.stdout:7/22: dwrite d0/f2 [0,4194304] 0 2024-09-21T11:39:03.873 INFO:tasks.workunit.client.0.smithi118.stdout:8/38: dread f0 [0,4194304] 0 2024-09-21T11:39:03.874 INFO:tasks.workunit.client.0.smithi118.stdout:3/48: rename d5/l6 to d5/le 0 2024-09-21T11:39:03.877 INFO:tasks.workunit.client.0.smithi118.stdout:0/51: creat d5/f11 x:0 0 0 2024-09-21T11:39:03.884 INFO:tasks.workunit.client.0.smithi118.stdout:3/49: symlink d5/lf 0 2024-09-21T11:39:03.886 INFO:tasks.workunit.client.0.smithi118.stdout:0/52: rename c4 to d5/c12 0 2024-09-21T11:39:03.892 INFO:tasks.workunit.client.0.smithi118.stdout:0/53: dwrite d5/f8 [0,4194304] 0 2024-09-21T11:39:03.894 INFO:tasks.workunit.client.0.smithi118.stdout:7/23: link d0/f5 d0/f6 0 2024-09-21T11:39:03.896 INFO:tasks.workunit.client.0.smithi118.stdout:3/50: creat d5/f10 x:0 0 0 2024-09-21T11:39:03.898 INFO:tasks.workunit.client.0.smithi118.stdout:3/51: write f0 [3751451,20213] 0 2024-09-21T11:39:03.898 INFO:tasks.workunit.client.0.smithi118.stdout:0/54: dread d5/f7 [0,4194304] 0 2024-09-21T11:39:03.903 INFO:tasks.workunit.client.0.smithi118.stdout:6/28: truncate d8/fa 3775934 0 2024-09-21T11:39:03.904 INFO:tasks.workunit.client.0.smithi118.stdout:7/24: creat d0/d3/f7 x:0 0 0 2024-09-21T11:39:04.044 INFO:tasks.workunit.client.0.smithi118.stdout:3/52: rename f3 to d5/d7/f11 0 2024-09-21T11:39:04.047 INFO:tasks.workunit.client.0.smithi118.stdout:0/55: creat d5/f13 x:0 0 0 2024-09-21T11:39:04.048 INFO:tasks.workunit.client.0.smithi118.stdout:8/39: getdents d2 0 2024-09-21T11:39:04.050 INFO:tasks.workunit.client.0.smithi118.stdout:1/43: truncate f0 434649 0 2024-09-21T11:39:04.051 INFO:tasks.workunit.client.0.smithi118.stdout:1/44: write f1 [2963289,120038] 0 2024-09-21T11:39:04.051 INFO:tasks.workunit.client.0.smithi118.stdout:1/45: dread - d6/fd zero size 2024-09-21T11:39:04.055 INFO:tasks.workunit.client.0.smithi118.stdout:7/25: creat d0/d3/f8 x:0 0 0 2024-09-21T11:39:04.055 INFO:tasks.workunit.client.0.smithi118.stdout:6/29: dread f3 [0,4194304] 0 2024-09-21T11:39:04.056 INFO:tasks.workunit.client.0.smithi118.stdout:7/26: truncate d0/d3/f7 540314 0 2024-09-21T11:39:04.056 INFO:tasks.workunit.client.0.smithi118.stdout:7/27: stat d0/f2 0 2024-09-21T11:39:04.058 INFO:tasks.workunit.client.0.smithi118.stdout:3/53: creat d5/d7/f12 x:0 0 0 2024-09-21T11:39:04.059 INFO:tasks.workunit.client.0.smithi118.stdout:3/54: truncate d5/d7/fa 938783 0 2024-09-21T11:39:04.060 INFO:tasks.workunit.client.0.smithi118.stdout:3/55: chown d5/cd 32729 1 2024-09-21T11:39:04.060 INFO:tasks.workunit.client.0.smithi118.stdout:0/56: rmdir d5 39 2024-09-21T11:39:04.062 INFO:tasks.workunit.client.0.smithi118.stdout:8/40: mkdir d2/dc 0 2024-09-21T11:39:04.062 INFO:tasks.workunit.client.0.smithi118.stdout:8/41: chown d2/fa 229 1 2024-09-21T11:39:04.065 INFO:tasks.workunit.client.0.smithi118.stdout:6/30: creat d8/fc x:0 0 0 2024-09-21T11:39:04.066 INFO:tasks.workunit.client.0.smithi118.stdout:7/28: rename d0/d3/f8 to d0/f9 0 2024-09-21T11:39:04.072 INFO:tasks.workunit.client.0.smithi118.stdout:6/31: symlink d8/ld 0 2024-09-21T11:39:04.078 INFO:tasks.workunit.client.0.smithi118.stdout:3/56: rename d5/le to d5/l13 0 2024-09-21T11:39:04.079 INFO:tasks.workunit.client.0.smithi118.stdout:3/57: dread - d5/d7/f12 zero size 2024-09-21T11:39:04.080 INFO:tasks.workunit.client.0.smithi118.stdout:7/29: dwrite d0/f9 [0,4194304] 0 2024-09-21T11:39:04.081 INFO:tasks.workunit.client.0.smithi118.stdout:7/30: write d0/f2 [3834659,91741] 0 2024-09-21T11:39:04.082 INFO:tasks.workunit.client.0.smithi118.stdout:8/42: mknod d2/dc/cd 0 2024-09-21T11:39:04.084 INFO:tasks.workunit.client.0.smithi118.stdout:3/58: dread f2 [4194304,4194304] 0 2024-09-21T11:39:04.085 INFO:tasks.workunit.client.0.smithi118.stdout:6/32: mknod d8/ce 0 2024-09-21T11:39:04.085 INFO:tasks.workunit.client.0.smithi118.stdout:3/59: write d5/f10 [1031888,100657] 0 2024-09-21T11:39:04.090 INFO:tasks.workunit.client.0.smithi118.stdout:0/57: creat d5/d10/f14 x:0 0 0 2024-09-21T11:39:04.093 INFO:tasks.workunit.client.0.smithi118.stdout:3/60: dwrite d5/d7/fa [0,4194304] 0 2024-09-21T11:39:04.098 INFO:tasks.workunit.client.0.smithi118.stdout:7/31: symlink d0/d3/la 0 2024-09-21T11:39:04.099 INFO:tasks.workunit.client.0.smithi118.stdout:7/32: chown d0/d3/la 1464657904 1 2024-09-21T11:39:04.100 INFO:tasks.workunit.client.0.smithi118.stdout:8/43: rmdir d2/dc 39 2024-09-21T11:39:04.100 INFO:tasks.workunit.client.0.smithi118.stdout:8/44: dread - d2/f9 zero size 2024-09-21T11:39:04.106 INFO:tasks.workunit.client.0.smithi118.stdout:0/58: rename d5/fb to d5/f15 0 2024-09-21T11:39:04.106 INFO:tasks.workunit.client.0.smithi118.stdout:0/59: stat d5/ld 0 2024-09-21T11:39:04.109 INFO:tasks.workunit.client.0.smithi118.stdout:1/46: truncate f5 3751844 0 2024-09-21T11:39:04.109 INFO:tasks.workunit.client.0.smithi118.stdout:3/61: symlink d5/l14 0 2024-09-21T11:39:04.111 INFO:tasks.workunit.client.0.smithi118.stdout:7/33: symlink d0/lb 0 2024-09-21T11:39:04.118 INFO:tasks.workunit.client.0.smithi118.stdout:0/60: symlink d5/l16 0 2024-09-21T11:39:04.122 INFO:tasks.workunit.client.0.smithi118.stdout:1/47: rename l4 to d6/de/lf 0 2024-09-21T11:39:04.122 INFO:tasks.workunit.client.0.smithi118.stdout:1/48: readlink d6/l7 0 2024-09-21T11:39:04.122 INFO:tasks.workunit.client.0.smithi118.stdout:1/49: dread - d6/fd zero size 2024-09-21T11:39:04.122 INFO:tasks.workunit.client.0.smithi118.stdout:1/50: stat f1 0 2024-09-21T11:39:04.122 INFO:tasks.workunit.client.0.smithi118.stdout:1/51: stat f1 0 2024-09-21T11:39:04.123 INFO:tasks.workunit.client.0.smithi118.stdout:3/62: readlink d5/l13 0 2024-09-21T11:39:04.125 INFO:tasks.workunit.client.0.smithi118.stdout:7/34: rename d0/d3/c4 to d0/d3/cc 0 2024-09-21T11:39:04.127 INFO:tasks.workunit.client.0.smithi118.stdout:6/33: fsync f6 0 2024-09-21T11:39:04.135 INFO:tasks.workunit.client.0.smithi118.stdout:6/34: write d8/fc [506652,69278] 0 2024-09-21T11:39:04.135 INFO:tasks.workunit.client.0.smithi118.stdout:1/52: rename d6/fb to d6/de/f10 0 2024-09-21T11:39:04.136 INFO:tasks.workunit.client.0.smithi118.stdout:3/63: fdatasync d5/d7/f11 0 2024-09-21T11:39:04.139 INFO:tasks.workunit.client.0.smithi118.stdout:7/35: creat d0/d3/fd x:0 0 0 2024-09-21T11:39:04.140 INFO:tasks.workunit.client.0.smithi118.stdout:7/36: write d0/f9 [5024770,33167] 0 2024-09-21T11:39:04.140 INFO:tasks.workunit.client.0.smithi118.stdout:8/45: creat d2/fe x:0 0 0 2024-09-21T11:39:04.154 INFO:tasks.workunit.client.0.smithi118.stdout:0/61: write d5/f7 [1649317,86844] 0 2024-09-21T11:39:04.155 INFO:tasks.workunit.client.1.smithi149.stdout:1/146: mkdir d2/dd/d2e 0 2024-09-21T11:39:04.159 INFO:tasks.workunit.client.1.smithi149.stdout:7/240: fdatasync d12/d15/f1c 0 2024-09-21T11:39:04.165 INFO:tasks.workunit.client.1.smithi149.stdout:9/113: mkdir d18/d1c 0 2024-09-21T11:39:04.166 INFO:tasks.workunit.client.1.smithi149.stdout:6/127: link d8/da/d14/d18/c1e d8/da/d11/c22 0 2024-09-21T11:39:04.169 INFO:tasks.workunit.client.1.smithi149.stdout:2/171: getdents d8/dd 0 2024-09-21T11:39:04.173 INFO:tasks.workunit.client.1.smithi149.stdout:7/241: readlink d12/d15/d26/l43 0 2024-09-21T11:39:04.178 INFO:tasks.workunit.client.1.smithi149.stdout:8/143: mknod d3/c2c 0 2024-09-21T11:39:04.180 INFO:tasks.workunit.client.1.smithi149.stdout:6/128: rmdir d8/da/d11 39 2024-09-21T11:39:04.182 INFO:tasks.workunit.client.1.smithi149.stdout:5/145: getdents d4 0 2024-09-21T11:39:04.182 INFO:tasks.workunit.client.1.smithi149.stdout:5/146: chown d4/d7/c15 1239 1 2024-09-21T11:39:04.184 INFO:tasks.workunit.client.1.smithi149.stdout:5/147: dread d4/f18 [0,4194304] 0 2024-09-21T11:39:04.185 INFO:tasks.workunit.client.1.smithi149.stdout:1/147: write d2/d5/f1d [968264,57230] 0 2024-09-21T11:39:04.185 INFO:tasks.workunit.client.1.smithi149.stdout:4/165: getdents d4/d6 0 2024-09-21T11:39:04.189 INFO:tasks.workunit.client.1.smithi149.stdout:3/209: creat d6/d1f/d47/f53 x:0 0 0 2024-09-21T11:39:04.189 INFO:tasks.workunit.client.1.smithi149.stdout:0/101: link dd/c17 dd/d1a/d1b/c22 0 2024-09-21T11:39:04.192 INFO:tasks.workunit.client.1.smithi149.stdout:7/242: dread ff [4194304,4194304] 0 2024-09-21T11:39:04.192 INFO:tasks.workunit.client.1.smithi149.stdout:4/166: dwrite d4/d6/f9 [0,4194304] 0 2024-09-21T11:39:04.192 INFO:tasks.workunit.client.1.smithi149.stdout:9/114: mknod d18/d19/d1a/c1d 0 2024-09-21T11:39:04.199 INFO:tasks.workunit.client.1.smithi149.stdout:5/148: rename d4/d7/d1a/f29 to d4/d1d/f2d 0 2024-09-21T11:39:04.199 INFO:tasks.workunit.client.1.smithi149.stdout:5/149: chown d4/f5 1881 1 2024-09-21T11:39:04.200 INFO:tasks.workunit.client.1.smithi149.stdout:1/148: mknod d2/d2b/c2f 0 2024-09-21T11:39:04.205 INFO:tasks.workunit.client.1.smithi149.stdout:3/210: creat d6/d1f/f54 x:0 0 0 2024-09-21T11:39:04.205 INFO:tasks.workunit.client.1.smithi149.stdout:3/211: stat c4 0 2024-09-21T11:39:04.209 INFO:tasks.workunit.client.1.smithi149.stdout:8/144: symlink d3/dd/d21/l2d 0 2024-09-21T11:39:04.210 INFO:tasks.workunit.client.1.smithi149.stdout:8/145: write d3/dd/f1a [6778018,10552] 0 2024-09-21T11:39:04.211 INFO:tasks.workunit.client.1.smithi149.stdout:7/243: mkdir d12/d15/d26/d30/d31/d47 0 2024-09-21T11:39:04.213 INFO:tasks.workunit.client.1.smithi149.stdout:9/115: symlink d18/l1e 0 2024-09-21T11:39:04.217 INFO:tasks.workunit.client.1.smithi149.stdout:5/150: rename d4/d7/cc to d4/d7/d1a/c2e 0 2024-09-21T11:39:04.217 INFO:tasks.workunit.client.1.smithi149.stdout:5/151: chown d4/d1d/l2c 1933 1 2024-09-21T11:39:04.220 INFO:tasks.workunit.client.1.smithi149.stdout:3/212: unlink d6/d1f/d27/f36 0 2024-09-21T11:39:04.221 INFO:tasks.workunit.client.1.smithi149.stdout:2/172: write d8/d11/f3a [1998955,93883] 0 2024-09-21T11:39:04.222 INFO:tasks.workunit.client.1.smithi149.stdout:0/102: unlink dd/c17 0 2024-09-21T11:39:04.225 INFO:tasks.workunit.client.1.smithi149.stdout:8/146: mkdir d3/dd/d18/d2e 0 2024-09-21T11:39:04.225 INFO:tasks.workunit.client.1.smithi149.stdout:8/147: write d3/d12/f24 [3112597,31005] 0 2024-09-21T11:39:04.229 INFO:tasks.workunit.client.1.smithi149.stdout:5/152: rename d4/d1d/f2d to d4/f2f 0 2024-09-21T11:39:04.230 INFO:tasks.workunit.client.1.smithi149.stdout:5/153: fdatasync d4/d7/fa 0 2024-09-21T11:39:04.231 INFO:tasks.workunit.client.1.smithi149.stdout:1/149: unlink d2/d5/d8/l16 0 2024-09-21T11:39:04.237 INFO:tasks.workunit.client.1.smithi149.stdout:8/148: dread d3/dd/f1a [0,4194304] 0 2024-09-21T11:39:04.240 INFO:tasks.workunit.client.1.smithi149.stdout:6/129: getdents d8/da/d14/d18 0 2024-09-21T11:39:04.240 INFO:tasks.workunit.client.1.smithi149.stdout:6/130: write d8/da/fd [3834717,13280] 0 2024-09-21T11:39:04.242 INFO:tasks.workunit.client.1.smithi149.stdout:2/173: rename d8/dd/f36 to d8/da/d13/f3c 0 2024-09-21T11:39:04.246 INFO:tasks.workunit.client.1.smithi149.stdout:5/154: mknod d4/d7/d1a/c30 0 2024-09-21T11:39:04.248 INFO:tasks.workunit.client.1.smithi149.stdout:1/150: rmdir d2/d5/d8 39 2024-09-21T11:39:04.250 INFO:tasks.workunit.client.1.smithi149.stdout:3/213: symlink d6/l55 0 2024-09-21T11:39:04.255 INFO:tasks.workunit.client.1.smithi149.stdout:8/149: symlink d3/dd/d18/l2f 0 2024-09-21T11:39:04.255 INFO:tasks.workunit.client.1.smithi149.stdout:0/103: write dd/f15 [5084678,80887] 0 2024-09-21T11:39:04.256 INFO:tasks.workunit.client.1.smithi149.stdout:0/104: fsync dd/fe 0 2024-09-21T11:39:04.256 INFO:tasks.workunit.client.1.smithi149.stdout:6/131: mknod d8/c23 0 2024-09-21T11:39:04.257 INFO:tasks.workunit.client.1.smithi149.stdout:6/132: stat d8/da/d14/l20 0 2024-09-21T11:39:04.261 INFO:tasks.workunit.client.1.smithi149.stdout:8/150: dread d3/f14 [0,4194304] 0 2024-09-21T11:39:04.261 INFO:tasks.workunit.client.1.smithi149.stdout:6/133: write d8/da/d14/f1f [920501,98837] 0 2024-09-21T11:39:04.261 INFO:tasks.workunit.client.1.smithi149.stdout:1/151: unlink d2/d5/f1d 0 2024-09-21T11:39:04.262 INFO:tasks.workunit.client.1.smithi149.stdout:0/105: dread dd/f19 [0,4194304] 0 2024-09-21T11:39:04.263 INFO:tasks.workunit.client.1.smithi149.stdout:8/151: write d3/f17 [2062986,83553] 0 2024-09-21T11:39:04.263 INFO:tasks.workunit.client.1.smithi149.stdout:9/116: getdents d18/d19 0 2024-09-21T11:39:04.263 INFO:tasks.workunit.client.1.smithi149.stdout:9/117: chown cd 144420961 1 2024-09-21T11:39:04.264 INFO:tasks.workunit.client.1.smithi149.stdout:9/118: dread f16 [0,4194304] 0 2024-09-21T11:39:04.282 INFO:tasks.workunit.client.1.smithi149.stdout:2/174: dwrite d8/da/f28 [0,4194304] 0 2024-09-21T11:39:04.284 INFO:tasks.workunit.client.1.smithi149.stdout:5/155: link d4/d7/d1a/f23 d4/d7/f31 0 2024-09-21T11:39:04.285 INFO:tasks.workunit.client.1.smithi149.stdout:6/134: symlink d8/da/d11/l24 0 2024-09-21T11:39:04.289 INFO:tasks.workunit.client.1.smithi149.stdout:2/175: dwrite d8/da/d13/d1a/f1f [0,4194304] 0 2024-09-21T11:39:04.296 INFO:tasks.workunit.client.1.smithi149.stdout:0/106: rename fa to dd/f23 0 2024-09-21T11:39:04.297 INFO:tasks.workunit.client.1.smithi149.stdout:0/107: fsync dd/fe 0 2024-09-21T11:39:04.299 INFO:tasks.workunit.client.0.smithi118.stdout:6/35: symlink d8/lf 0 2024-09-21T11:39:04.301 INFO:tasks.workunit.client.1.smithi149.stdout:9/119: link c9 d18/c1f 0 2024-09-21T11:39:04.303 INFO:tasks.workunit.client.1.smithi149.stdout:9/120: read f16 [278318,82077] 0 2024-09-21T11:39:04.303 INFO:tasks.workunit.client.0.smithi118.stdout:3/64: creat d5/d7/f15 x:0 0 0 2024-09-21T11:39:04.303 INFO:tasks.workunit.client.0.smithi118.stdout:3/65: truncate d5/d7/fc 872344 0 2024-09-21T11:39:04.304 INFO:tasks.workunit.client.1.smithi149.stdout:0/108: dwrite dd/fe [0,4194304] 0 2024-09-21T11:39:04.306 INFO:tasks.workunit.client.0.smithi118.stdout:8/46: chown d2/dc/cd 179 1 2024-09-21T11:39:04.309 INFO:tasks.workunit.client.1.smithi149.stdout:8/152: rename l2 to d3/dd/l30 0 2024-09-21T11:39:04.310 INFO:tasks.workunit.client.0.smithi118.stdout:0/62: creat d5/f17 x:0 0 0 2024-09-21T11:39:04.312 INFO:tasks.workunit.client.0.smithi118.stdout:0/63: chown d5/f8 278118 1 2024-09-21T11:39:04.314 INFO:tasks.workunit.client.0.smithi118.stdout:8/47: dwrite d2/f9 [0,4194304] 0 2024-09-21T11:39:04.314 INFO:tasks.workunit.client.0.smithi118.stdout:0/64: write d5/f13 [398983,110794] 0 2024-09-21T11:39:04.315 INFO:tasks.workunit.client.0.smithi118.stdout:6/36: symlink d8/l10 0 2024-09-21T11:39:04.316 INFO:tasks.workunit.client.0.smithi118.stdout:0/65: write d5/f13 [847886,51935] 0 2024-09-21T11:39:04.316 INFO:tasks.workunit.client.0.smithi118.stdout:0/66: dread - d5/f11 zero size 2024-09-21T11:39:04.319 INFO:tasks.workunit.client.1.smithi149.stdout:2/176: truncate d8/da/d13/d1a/d2c/f27 3729402 0 2024-09-21T11:39:04.321 INFO:tasks.workunit.client.1.smithi149.stdout:1/152: truncate d2/f20 3116910 0 2024-09-21T11:39:04.322 INFO:tasks.workunit.client.1.smithi149.stdout:2/177: truncate d8/da/d13/d1a/d2c/f2f 4936062 0 2024-09-21T11:39:04.322 INFO:tasks.workunit.client.0.smithi118.stdout:3/66: creat d5/d7/f16 x:0 0 0 2024-09-21T11:39:04.323 INFO:tasks.workunit.client.0.smithi118.stdout:3/67: chown d5/cd 106680571 1 2024-09-21T11:39:04.323 INFO:tasks.workunit.client.0.smithi118.stdout:3/68: readlink d5/l14 0 2024-09-21T11:39:04.323 INFO:tasks.workunit.client.0.smithi118.stdout:3/69: write d5/d7/f11 [1835841,91801] 0 2024-09-21T11:39:04.323 INFO:tasks.workunit.client.1.smithi149.stdout:2/178: fsync d8/da/d13/d1a/f1f 0 2024-09-21T11:39:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:03 smithi118 ceph-mon[28757]: pgmap v17: 65 pgs: 65 active+clean; 273 MiB data, 982 MiB used, 535 GiB / 536 GiB avail; 183 KiB/s rd, 10 MiB/s wr, 288 op/s 2024-09-21T11:39:04.324 INFO:tasks.workunit.client.0.smithi118.stdout:8/48: symlink d2/dc/lf 0 2024-09-21T11:39:04.326 INFO:tasks.workunit.client.1.smithi149.stdout:5/156: getdents d4/d1d 0 2024-09-21T11:39:04.327 INFO:tasks.workunit.client.1.smithi149.stdout:6/135: write d8/da/d14/f15 [1833963,94631] 0 2024-09-21T11:39:04.329 INFO:tasks.workunit.client.0.smithi118.stdout:6/37: rmdir d8 39 2024-09-21T11:39:04.331 INFO:tasks.workunit.client.0.smithi118.stdout:0/67: fdatasync d5/f15 0 2024-09-21T11:39:04.331 INFO:tasks.workunit.client.0.smithi118.stdout:7/37: write d0/f6 [1024399,32882] 0 2024-09-21T11:39:04.333 INFO:tasks.workunit.client.1.smithi149.stdout:2/179: creat d8/d11/f3d x:0 0 0 2024-09-21T11:39:04.334 INFO:tasks.workunit.client.1.smithi149.stdout:6/136: dwrite d8/da/d14/f15 [0,4194304] 0 2024-09-21T11:39:04.338 INFO:tasks.workunit.client.0.smithi118.stdout:7/38: dwrite d0/f9 [0,4194304] 0 2024-09-21T11:39:04.339 INFO:tasks.workunit.client.1.smithi149.stdout:9/121: write f0 [353297,53106] 0 2024-09-21T11:39:04.339 INFO:tasks.workunit.client.0.smithi118.stdout:8/49: unlink d2/f9 0 2024-09-21T11:39:04.340 INFO:tasks.workunit.client.0.smithi118.stdout:7/39: dread d0/d3/f7 [0,4194304] 0 2024-09-21T11:39:04.340 INFO:tasks.workunit.client.1.smithi149.stdout:9/122: dread f16 [0,4194304] 0 2024-09-21T11:39:04.342 INFO:tasks.workunit.client.1.smithi149.stdout:1/153: link d2/dd/d11/d1c/f29 d2/dd/f30 0 2024-09-21T11:39:04.343 INFO:tasks.workunit.client.0.smithi118.stdout:6/38: fsync d8/fb 0 2024-09-21T11:39:04.344 INFO:tasks.workunit.client.0.smithi118.stdout:6/39: write f6 [4748577,14811] 0 2024-09-21T11:39:04.347 INFO:tasks.workunit.client.1.smithi149.stdout:6/137: creat d8/da/d11/f25 x:0 0 0 2024-09-21T11:39:04.353 INFO:tasks.workunit.client.0.smithi118.stdout:1/53: dread f5 [0,4194304] 0 2024-09-21T11:39:04.353 INFO:tasks.workunit.client.0.smithi118.stdout:1/54: stat d6/ca 0 2024-09-21T11:39:04.353 INFO:tasks.workunit.client.0.smithi118.stdout:1/55: write d6/fd [225725,13538] 0 2024-09-21T11:39:04.354 INFO:tasks.workunit.client.1.smithi149.stdout:9/123: creat d18/d19/f20 x:0 0 0 2024-09-21T11:39:04.354 INFO:tasks.workunit.client.0.smithi118.stdout:8/50: write f0 [2024492,60507] 0 2024-09-21T11:39:04.355 INFO:tasks.workunit.client.0.smithi118.stdout:7/40: creat d0/fe x:0 0 0 2024-09-21T11:39:04.357 INFO:tasks.workunit.client.1.smithi149.stdout:9/124: chown c13 0 1 2024-09-21T11:39:04.357 INFO:tasks.workunit.client.1.smithi149.stdout:5/157: creat d4/d7/f32 x:0 0 0 2024-09-21T11:39:04.359 INFO:tasks.workunit.client.0.smithi118.stdout:6/40: unlink f3 0 2024-09-21T11:39:04.359 INFO:tasks.workunit.client.1.smithi149.stdout:8/153: dwrite d3/dd/f1b [0,4194304] 0 2024-09-21T11:39:04.361 INFO:tasks.workunit.client.1.smithi149.stdout:2/180: link d8/da/d13/d1a/d2c/f2f d8/da/d13/d1a/f3e 0 2024-09-21T11:39:04.363 INFO:tasks.workunit.client.1.smithi149.stdout:6/138: dwrite f4 [0,4194304] 0 2024-09-21T11:39:04.363 INFO:tasks.workunit.client.1.smithi149.stdout:1/154: link d2/f21 d2/d2b/f31 0 2024-09-21T11:39:04.364 INFO:tasks.workunit.client.0.smithi118.stdout:1/56: write d6/de/f10 [402428,4006] 0 2024-09-21T11:39:04.365 INFO:tasks.workunit.client.1.smithi149.stdout:2/181: dread d8/da/d13/f21 [0,4194304] 0 2024-09-21T11:39:04.366 INFO:tasks.workunit.client.0.smithi118.stdout:8/51: mkdir d2/dc/d10 0 2024-09-21T11:39:04.367 INFO:tasks.workunit.client.1.smithi149.stdout:9/125: mknod d18/d19/d1a/c21 0 2024-09-21T11:39:04.367 INFO:tasks.workunit.client.0.smithi118.stdout:8/52: dread - d2/fa zero size 2024-09-21T11:39:04.368 INFO:tasks.workunit.client.1.smithi149.stdout:5/158: dread d4/d7/f25 [0,4194304] 0 2024-09-21T11:39:04.368 INFO:tasks.workunit.client.1.smithi149.stdout:2/182: write d8/d11/f3a [1320249,71174] 0 2024-09-21T11:39:04.370 INFO:tasks.workunit.client.0.smithi118.stdout:7/41: creat d0/d3/ff x:0 0 0 2024-09-21T11:39:04.371 INFO:tasks.workunit.client.0.smithi118.stdout:7/42: chown d0/f6 10362399 1 2024-09-21T11:39:04.374 INFO:tasks.workunit.client.0.smithi118.stdout:6/41: creat d8/f11 x:0 0 0 2024-09-21T11:39:04.375 INFO:tasks.workunit.client.0.smithi118.stdout:6/42: stat d8/fa 0 2024-09-21T11:39:04.375 INFO:tasks.workunit.client.1.smithi149.stdout:6/139: creat d8/da/d11/f26 x:0 0 0 2024-09-21T11:39:04.376 INFO:tasks.workunit.client.1.smithi149.stdout:6/140: chown d8/da/d11/l13 83677949 1 2024-09-21T11:39:04.377 INFO:tasks.workunit.client.1.smithi149.stdout:1/155: creat d2/dd/d11/d1c/f32 x:0 0 0 2024-09-21T11:39:04.379 INFO:tasks.workunit.client.0.smithi118.stdout:3/70: getdents d5/d7 0 2024-09-21T11:39:04.380 INFO:tasks.workunit.client.0.smithi118.stdout:7/43: dwrite d0/f5 [0,4194304] 0 2024-09-21T11:39:04.380 INFO:tasks.workunit.client.0.smithi118.stdout:1/57: rmdir d6/de 39 2024-09-21T11:39:04.381 INFO:tasks.workunit.client.1.smithi149.stdout:4/167: sync 2024-09-21T11:39:04.381 INFO:tasks.workunit.client.0.smithi118.stdout:7/44: chown d0/f2 690007 1 2024-09-21T11:39:04.382 INFO:tasks.workunit.client.0.smithi118.stdout:7/45: chown d0/d3/la 16958 1 2024-09-21T11:39:04.385 INFO:tasks.workunit.client.0.smithi118.stdout:0/68: getdents d5/d10 0 2024-09-21T11:39:04.385 INFO:tasks.workunit.client.0.smithi118.stdout:7/46: dread d0/f5 [0,4194304] 0 2024-09-21T11:39:04.386 INFO:tasks.workunit.client.0.smithi118.stdout:0/69: write d5/f13 [1099816,2976] 0 2024-09-21T11:39:04.387 INFO:tasks.workunit.client.0.smithi118.stdout:7/47: dread - d0/d3/ff zero size 2024-09-21T11:39:04.387 INFO:tasks.workunit.client.1.smithi149.stdout:7/244: sync 2024-09-21T11:39:04.387 INFO:tasks.workunit.client.0.smithi118.stdout:1/58: rmdir d6 39 2024-09-21T11:39:04.389 INFO:tasks.workunit.client.0.smithi118.stdout:8/53: mkdir d2/d11 0 2024-09-21T11:39:04.389 INFO:tasks.workunit.client.1.smithi149.stdout:1/156: readlink d2/d5/d8/l10 0 2024-09-21T11:39:04.390 INFO:tasks.workunit.client.1.smithi149.stdout:9/126: rename c9 to d18/c22 0 2024-09-21T11:39:04.391 INFO:tasks.workunit.client.1.smithi149.stdout:9/127: readlink l17 0 2024-09-21T11:39:04.392 INFO:tasks.workunit.client.1.smithi149.stdout:4/168: mkdir d4/d13/d10/d31/d32/d3a 0 2024-09-21T11:39:04.392 INFO:tasks.workunit.client.1.smithi149.stdout:8/154: getdents d3/dd/d18/d2e 0 2024-09-21T11:39:04.393 INFO:tasks.workunit.client.1.smithi149.stdout:4/169: stat d4/d6/d18/f2e 0 2024-09-21T11:39:04.393 INFO:tasks.workunit.client.0.smithi118.stdout:6/43: link d8/fa d8/f12 0 2024-09-21T11:39:04.394 INFO:tasks.workunit.client.1.smithi149.stdout:1/157: dread d2/f18 [0,4194304] 0 2024-09-21T11:39:04.394 INFO:tasks.workunit.client.0.smithi118.stdout:6/44: readlink d8/l9 0 2024-09-21T11:39:04.395 INFO:tasks.workunit.client.1.smithi149.stdout:5/159: link d4/d7/fa d4/d7/d1a/d2a/f33 0 2024-09-21T11:39:04.395 INFO:tasks.workunit.client.0.smithi118.stdout:6/45: chown d8/ce 18471 1 2024-09-21T11:39:04.395 INFO:tasks.workunit.client.1.smithi149.stdout:5/160: chown d4/d7/f31 189 1 2024-09-21T11:39:04.395 INFO:tasks.workunit.client.0.smithi118.stdout:0/70: mknod d5/c18 0 2024-09-21T11:39:04.396 INFO:tasks.workunit.client.0.smithi118.stdout:0/71: chown d5/le 199972 1 2024-09-21T11:39:04.396 INFO:tasks.workunit.client.1.smithi149.stdout:7/245: creat d12/f48 x:0 0 0 2024-09-21T11:39:04.397 INFO:tasks.workunit.client.0.smithi118.stdout:3/71: link d5/d7/fa d5/f17 0 2024-09-21T11:39:04.399 INFO:tasks.workunit.client.0.smithi118.stdout:3/72: write d5/d7/fc [1721353,129674] 0 2024-09-21T11:39:04.399 INFO:tasks.workunit.client.0.smithi118.stdout:0/72: dread d5/f7 [0,4194304] 0 2024-09-21T11:39:04.400 INFO:tasks.workunit.client.0.smithi118.stdout:0/73: read d5/f7 [1918291,79127] 0 2024-09-21T11:39:04.401 INFO:tasks.workunit.client.0.smithi118.stdout:0/74: write d5/f13 [92477,118933] 0 2024-09-21T11:39:04.407 INFO:tasks.workunit.client.0.smithi118.stdout:8/54: symlink d2/d11/l12 0 2024-09-21T11:39:04.407 INFO:tasks.workunit.client.0.smithi118.stdout:8/55: chown d2/f7 623 1 2024-09-21T11:39:04.408 INFO:tasks.workunit.client.0.smithi118.stdout:3/73: symlink d5/d7/l18 0 2024-09-21T11:39:04.411 INFO:tasks.workunit.client.0.smithi118.stdout:0/75: symlink d5/l19 0 2024-09-21T11:39:04.412 INFO:tasks.workunit.client.0.smithi118.stdout:0/76: write d5/f15 [889470,24] 0 2024-09-21T11:39:04.415 INFO:tasks.workunit.client.0.smithi118.stdout:8/56: dwrite d2/fe [0,4194304] 0 2024-09-21T11:39:04.420 INFO:tasks.workunit.client.0.smithi118.stdout:6/46: truncate d8/fa 3499293 0 2024-09-21T11:39:04.421 INFO:tasks.workunit.client.0.smithi118.stdout:6/47: chown d8/fc 58290 1 2024-09-21T11:39:04.422 INFO:tasks.workunit.client.0.smithi118.stdout:6/48: fdatasync d8/fa 0 2024-09-21T11:39:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:03 smithi149 ceph-mon[36123]: pgmap v17: 65 pgs: 65 active+clean; 273 MiB data, 982 MiB used, 535 GiB / 536 GiB avail; 183 KiB/s rd, 10 MiB/s wr, 288 op/s 2024-09-21T11:39:04.469 INFO:tasks.workunit.client.1.smithi149.stdout:0/109: sync 2024-09-21T11:39:04.469 INFO:tasks.workunit.client.1.smithi149.stdout:3/214: sync 2024-09-21T11:39:04.471 INFO:tasks.workunit.client.1.smithi149.stdout:9/128: creat d18/d19/d1a/f23 x:0 0 0 2024-09-21T11:39:04.472 INFO:tasks.workunit.client.1.smithi149.stdout:9/129: chown l14 82 1 2024-09-21T11:39:04.473 INFO:tasks.workunit.client.1.smithi149.stdout:4/170: mknod d4/d13/c3b 0 2024-09-21T11:39:04.473 INFO:tasks.workunit.client.0.smithi118.stdout:8/57: rename d2/d11 to d2/dc/d13 0 2024-09-21T11:39:04.474 INFO:tasks.workunit.client.1.smithi149.stdout:5/161: chown d4/d7/d1a/d2a/c2b 25 1 2024-09-21T11:39:04.475 INFO:tasks.workunit.client.1.smithi149.stdout:8/155: symlink d3/dd/d21/l31 0 2024-09-21T11:39:04.477 INFO:tasks.workunit.client.1.smithi149.stdout:3/215: unlink d6/d1f/d47/d37/d3f/c42 0 2024-09-21T11:39:04.479 INFO:tasks.workunit.client.1.smithi149.stdout:9/130: chown d18/c1f 844 1 2024-09-21T11:39:04.479 INFO:tasks.workunit.client.0.smithi118.stdout:3/74: truncate d5/d7/fc 342050 0 2024-09-21T11:39:04.480 INFO:tasks.workunit.client.0.smithi118.stdout:8/58: getdents d2/dc/d10 0 2024-09-21T11:39:04.481 INFO:tasks.workunit.client.0.smithi118.stdout:0/77: truncate d5/f8 3154719 0 2024-09-21T11:39:04.482 INFO:tasks.workunit.client.1.smithi149.stdout:1/158: creat d2/dd/d2e/f33 x:0 0 0 2024-09-21T11:39:04.483 INFO:tasks.workunit.client.1.smithi149.stdout:4/171: fsync d4/d13/f28 0 2024-09-21T11:39:04.484 INFO:tasks.workunit.client.0.smithi118.stdout:3/75: creat d5/d7/f19 x:0 0 0 2024-09-21T11:39:04.485 INFO:tasks.workunit.client.1.smithi149.stdout:7/246: mkdir d12/d15/d26/d30/d31/d47/d49 0 2024-09-21T11:39:04.486 INFO:tasks.workunit.client.1.smithi149.stdout:8/156: symlink d3/dd/d18/l32 0 2024-09-21T11:39:04.487 INFO:tasks.workunit.client.0.smithi118.stdout:3/76: creat d5/f1a x:0 0 0 2024-09-21T11:39:04.489 INFO:tasks.workunit.client.0.smithi118.stdout:8/59: getdents d2/dc/d10 0 2024-09-21T11:39:04.491 INFO:tasks.workunit.client.0.smithi118.stdout:0/78: getdents d5/d10 0 2024-09-21T11:39:04.491 INFO:tasks.workunit.client.0.smithi118.stdout:0/79: fsync d5/f11 0 2024-09-21T11:39:04.496 INFO:tasks.workunit.client.1.smithi149.stdout:4/172: mknod d4/d13/d15/d16/d23/c3c 0 2024-09-21T11:39:04.497 INFO:tasks.workunit.client.1.smithi149.stdout:7/247: chown d12/d15/l2b 0 1 2024-09-21T11:39:04.500 INFO:tasks.workunit.client.0.smithi118.stdout:0/80: dwrite d5/f17 [0,4194304] 0 2024-09-21T11:39:04.500 INFO:tasks.workunit.client.1.smithi149.stdout:3/216: dread d6/f1a [0,4194304] 0 2024-09-21T11:39:04.501 INFO:tasks.workunit.client.1.smithi149.stdout:3/217: stat d6/f2a 0 2024-09-21T11:39:04.503 INFO:tasks.workunit.client.0.smithi118.stdout:8/60: symlink d2/l14 0 2024-09-21T11:39:04.503 INFO:tasks.workunit.client.1.smithi149.stdout:3/218: read d6/d1f/d27/f3c [480001,97342] 0 2024-09-21T11:39:04.503 INFO:tasks.workunit.client.0.smithi118.stdout:6/49: dwrite d8/fa [0,4194304] 0 2024-09-21T11:39:04.505 INFO:tasks.workunit.client.0.smithi118.stdout:0/81: symlink d5/l1a 0 2024-09-21T11:39:04.508 INFO:tasks.workunit.client.0.smithi118.stdout:6/50: chown c2 717614 1 2024-09-21T11:39:04.509 INFO:tasks.workunit.client.1.smithi149.stdout:7/248: rmdir d12/d15/d26 39 2024-09-21T11:39:04.511 INFO:tasks.workunit.client.1.smithi149.stdout:0/110: creat dd/d1a/d1b/f24 x:0 0 0 2024-09-21T11:39:04.511 INFO:tasks.workunit.client.0.smithi118.stdout:3/77: unlink d5/d7/fc 0 2024-09-21T11:39:04.513 INFO:tasks.workunit.client.0.smithi118.stdout:8/61: mknod d2/c15 0 2024-09-21T11:39:04.515 INFO:tasks.workunit.client.1.smithi149.stdout:9/131: link c4 d18/d19/d1a/c24 0 2024-09-21T11:39:04.516 INFO:tasks.workunit.client.0.smithi118.stdout:6/51: creat d8/f13 x:0 0 0 2024-09-21T11:39:04.517 INFO:tasks.workunit.client.1.smithi149.stdout:1/159: creat d2/d5/f34 x:0 0 0 2024-09-21T11:39:04.517 INFO:tasks.workunit.client.0.smithi118.stdout:6/52: write f6 [2121710,54096] 0 2024-09-21T11:39:04.518 INFO:tasks.workunit.client.0.smithi118.stdout:3/78: mkdir d5/d7/d1b 0 2024-09-21T11:39:04.519 INFO:tasks.workunit.client.0.smithi118.stdout:8/62: mkdir d2/dc/d16 0 2024-09-21T11:39:04.523 INFO:tasks.workunit.client.0.smithi118.stdout:6/53: mkdir d8/d14 0 2024-09-21T11:39:04.523 INFO:tasks.workunit.client.0.smithi118.stdout:6/54: dread - d8/f11 zero size 2024-09-21T11:39:04.524 INFO:tasks.workunit.client.0.smithi118.stdout:6/55: chown d8/lf 19725 1 2024-09-21T11:39:04.524 INFO:tasks.workunit.client.0.smithi118.stdout:0/82: link d5/ld d5/l1b 0 2024-09-21T11:39:04.526 INFO:tasks.workunit.client.1.smithi149.stdout:9/132: fdatasync fc 0 2024-09-21T11:39:04.526 INFO:tasks.workunit.client.1.smithi149.stdout:1/160: truncate d2/f13 4641220 0 2024-09-21T11:39:04.527 INFO:tasks.workunit.client.1.smithi149.stdout:9/133: dread f16 [0,4194304] 0 2024-09-21T11:39:04.528 INFO:tasks.workunit.client.1.smithi149.stdout:4/173: rmdir d4/d13/d24 0 2024-09-21T11:39:04.530 INFO:tasks.workunit.client.0.smithi118.stdout:0/83: dwrite d5/f17 [0,4194304] 0 2024-09-21T11:39:04.532 INFO:tasks.workunit.client.1.smithi149.stdout:0/111: symlink dd/l25 0 2024-09-21T11:39:04.533 INFO:tasks.workunit.client.1.smithi149.stdout:2/183: sync 2024-09-21T11:39:04.534 INFO:tasks.workunit.client.1.smithi149.stdout:3/219: creat d6/f56 x:0 0 0 2024-09-21T11:39:04.536 INFO:tasks.workunit.client.1.smithi149.stdout:2/184: dread - d8/da/f2a zero size 2024-09-21T11:39:04.538 INFO:tasks.workunit.client.1.smithi149.stdout:3/220: dread - d6/d1f/d47/d22/f49 zero size 2024-09-21T11:39:04.539 INFO:tasks.workunit.client.1.smithi149.stdout:9/134: dwrite d18/d19/f20 [0,4194304] 0 2024-09-21T11:39:04.539 INFO:tasks.workunit.client.1.smithi149.stdout:1/161: rename d2/dd/d11 to d2/dd/d35 0 2024-09-21T11:39:04.541 INFO:tasks.workunit.client.1.smithi149.stdout:1/162: read - d2/dd/d2e/f33 zero size 2024-09-21T11:39:04.541 INFO:tasks.workunit.client.1.smithi149.stdout:7/249: dread d12/d15/d26/f29 [0,4194304] 0 2024-09-21T11:39:04.544 INFO:tasks.workunit.client.0.smithi118.stdout:0/84: link d5/cc d5/d10/c1c 0 2024-09-21T11:39:04.546 INFO:tasks.workunit.client.1.smithi149.stdout:2/185: fsync d8/da/d13/f3c 0 2024-09-21T11:39:04.548 INFO:tasks.workunit.client.0.smithi118.stdout:0/85: symlink d5/l1d 0 2024-09-21T11:39:04.549 INFO:tasks.workunit.client.0.smithi118.stdout:0/86: chown d5/c6 0 1 2024-09-21T11:39:04.551 INFO:tasks.workunit.client.1.smithi149.stdout:9/135: rmdir d18/d19/d1a 39 2024-09-21T11:39:04.551 INFO:tasks.workunit.client.1.smithi149.stdout:9/136: chown fc 355 1 2024-09-21T11:39:04.553 INFO:tasks.workunit.client.0.smithi118.stdout:0/87: mkdir d5/d10/d1e 0 2024-09-21T11:39:04.553 INFO:tasks.workunit.client.0.smithi118.stdout:0/88: fdatasync d5/f11 0 2024-09-21T11:39:04.554 INFO:tasks.workunit.client.0.smithi118.stdout:0/89: read - d5/d10/f14 zero size 2024-09-21T11:39:04.556 INFO:tasks.workunit.client.0.smithi118.stdout:8/63: truncate f0 4157570 0 2024-09-21T11:39:04.556 INFO:tasks.workunit.client.0.smithi118.stdout:0/90: read d5/f13 [1048643,63176] 0 2024-09-21T11:39:04.556 INFO:tasks.workunit.client.0.smithi118.stdout:8/64: readlink d2/dc/d13/l12 0 2024-09-21T11:39:04.557 INFO:tasks.workunit.client.0.smithi118.stdout:0/91: truncate d5/f11 80523 0 2024-09-21T11:39:04.561 INFO:tasks.workunit.client.0.smithi118.stdout:6/56: truncate d8/f12 4130919 0 2024-09-21T11:39:04.562 INFO:tasks.workunit.client.1.smithi149.stdout:5/162: sync 2024-09-21T11:39:04.562 INFO:tasks.workunit.client.1.smithi149.stdout:6/141: sync 2024-09-21T11:39:04.564 INFO:tasks.workunit.client.0.smithi118.stdout:0/92: symlink d5/l1f 0 2024-09-21T11:39:04.565 INFO:tasks.workunit.client.1.smithi149.stdout:1/163: fdatasync d2/f1e 0 2024-09-21T11:39:04.565 INFO:tasks.workunit.client.0.smithi118.stdout:8/65: symlink d2/l17 0 2024-09-21T11:39:04.566 INFO:tasks.workunit.client.1.smithi149.stdout:2/186: fsync d8/da/d13/d1a/f3e 0 2024-09-21T11:39:04.567 INFO:tasks.workunit.client.1.smithi149.stdout:3/221: link d6/d1f/d47/d22/f4f d6/d1f/f57 0 2024-09-21T11:39:04.567 INFO:tasks.workunit.client.1.smithi149.stdout:2/187: chown d8/dd/f1d 87 1 2024-09-21T11:39:04.572 INFO:tasks.workunit.client.0.smithi118.stdout:0/93: mkdir d5/d10/d1e/d20 0 2024-09-21T11:39:04.573 INFO:tasks.workunit.client.0.smithi118.stdout:8/66: dwrite d2/fa [0,4194304] 0 2024-09-21T11:39:04.573 INFO:tasks.workunit.client.0.smithi118.stdout:0/94: chown d5/f11 1404 1 2024-09-21T11:39:04.574 INFO:tasks.workunit.client.0.smithi118.stdout:0/95: fsync d5/f15 0 2024-09-21T11:39:04.577 INFO:tasks.workunit.client.0.smithi118.stdout:6/57: dread f6 [0,4194304] 0 2024-09-21T11:39:04.579 INFO:tasks.workunit.client.0.smithi118.stdout:0/96: chown d5/l1b 98619 1 2024-09-21T11:39:04.582 INFO:tasks.workunit.client.0.smithi118.stdout:6/58: write f6 [1085997,36196] 0 2024-09-21T11:39:04.584 INFO:tasks.workunit.client.0.smithi118.stdout:6/59: write d8/fa [2243415,26542] 0 2024-09-21T11:39:04.589 INFO:tasks.workunit.client.0.smithi118.stdout:6/60: creat d8/f15 x:0 0 0 2024-09-21T11:39:04.593 INFO:tasks.workunit.client.0.smithi118.stdout:6/61: link d8/ce d8/c16 0 2024-09-21T11:39:04.595 INFO:tasks.workunit.client.0.smithi118.stdout:6/62: symlink d8/l17 0 2024-09-21T11:39:04.597 INFO:tasks.workunit.client.0.smithi118.stdout:6/63: mknod d8/c18 0 2024-09-21T11:39:04.601 INFO:tasks.workunit.client.0.smithi118.stdout:6/64: mknod d8/d14/c19 0 2024-09-21T11:39:04.602 INFO:tasks.workunit.client.0.smithi118.stdout:8/67: dread f0 [0,4194304] 0 2024-09-21T11:39:04.603 INFO:tasks.workunit.client.1.smithi149.stdout:8/157: sync 2024-09-21T11:39:04.604 INFO:tasks.workunit.client.0.smithi118.stdout:6/65: rename d8/f12 to d8/f1a 0 2024-09-21T11:39:04.630 INFO:tasks.workunit.client.0.smithi118.stdout:8/68: dwrite f0 [4194304,4194304] 0 2024-09-21T11:39:04.630 INFO:tasks.workunit.client.0.smithi118.stdout:8/69: readlink d2/dc/lf 0 2024-09-21T11:39:04.633 INFO:tasks.workunit.client.0.smithi118.stdout:8/70: rmdir d2/dc 39 2024-09-21T11:39:04.638 INFO:tasks.workunit.client.0.smithi118.stdout:8/71: mkdir d2/dc/d13/d18 0 2024-09-21T11:39:04.641 INFO:tasks.workunit.client.0.smithi118.stdout:8/72: rename d2/l17 to d2/dc/d13/l19 0 2024-09-21T11:39:04.645 INFO:tasks.workunit.client.0.smithi118.stdout:8/73: mkdir d2/dc/d13/d18/d1a 0 2024-09-21T11:39:04.649 INFO:tasks.workunit.client.0.smithi118.stdout:8/74: dread d2/fe [0,4194304] 0 2024-09-21T11:39:04.653 INFO:tasks.workunit.client.0.smithi118.stdout:8/75: creat d2/dc/d13/d18/d1a/f1b x:0 0 0 2024-09-21T11:39:04.656 INFO:tasks.workunit.client.0.smithi118.stdout:8/76: mknod d2/dc/d13/d18/d1a/c1c 0 2024-09-21T11:39:04.658 INFO:tasks.workunit.client.0.smithi118.stdout:8/77: symlink d2/dc/d13/l1d 0 2024-09-21T11:39:04.672 INFO:tasks.workunit.client.0.smithi118.stdout:8/78: getdents d2/dc/d13/d18 0 2024-09-21T11:39:04.675 INFO:tasks.workunit.client.0.smithi118.stdout:8/79: creat d2/dc/d13/d18/d1a/f1e x:0 0 0 2024-09-21T11:39:04.677 INFO:tasks.workunit.client.0.smithi118.stdout:8/80: rmdir d2/dc/d13/d18 39 2024-09-21T11:39:04.678 INFO:tasks.workunit.client.0.smithi118.stdout:8/81: chown d2/f7 357766 1 2024-09-21T11:39:04.685 INFO:tasks.workunit.client.0.smithi118.stdout:8/82: getdents d2 0 2024-09-21T11:39:04.689 INFO:tasks.workunit.client.0.smithi118.stdout:8/83: creat d2/dc/d13/d18/d1a/f1f x:0 0 0 2024-09-21T11:39:04.691 INFO:tasks.workunit.client.0.smithi118.stdout:8/84: mknod d2/c20 0 2024-09-21T11:39:04.717 INFO:tasks.workunit.client.0.smithi118.stdout:8/85: write d2/f7 [646036,81397] 0 2024-09-21T11:39:04.787 INFO:tasks.workunit.client.0.smithi118.stdout:8/86: chown d2/dc/d13 408 1 2024-09-21T11:39:04.794 INFO:tasks.workunit.client.0.smithi118.stdout:8/87: rename f0 to d2/dc/d13/f21 0 2024-09-21T11:39:04.803 INFO:tasks.workunit.client.0.smithi118.stdout:8/88: getdents d2/dc/d13/d18/d1a 0 2024-09-21T11:39:04.805 INFO:tasks.workunit.client.0.smithi118.stdout:8/89: fdatasync d2/dc/d13/f21 0 2024-09-21T11:39:04.812 INFO:tasks.workunit.client.0.smithi118.stdout:8/90: rename d2/fe to d2/dc/d13/d18/f22 0 2024-09-21T11:39:04.829 INFO:tasks.workunit.client.1.smithi149.stdout:7/250: mkdir d12/d15/d4a 0 2024-09-21T11:39:04.831 INFO:tasks.workunit.client.1.smithi149.stdout:4/174: link d4/d13/d15/d16/d23/c3c d4/d13/d10/d31/c3d 0 2024-09-21T11:39:04.832 INFO:tasks.workunit.client.1.smithi149.stdout:0/112: rename dd/ff to dd/f26 0 2024-09-21T11:39:04.833 INFO:tasks.workunit.client.1.smithi149.stdout:6/142: chown d8/da/d14/d18/c1e 1 1 2024-09-21T11:39:04.836 INFO:tasks.workunit.client.1.smithi149.stdout:3/222: unlink d6/f28 0 2024-09-21T11:39:04.837 INFO:tasks.workunit.client.1.smithi149.stdout:7/251: dwrite d12/f21 [0,4194304] 0 2024-09-21T11:39:04.839 INFO:tasks.workunit.client.1.smithi149.stdout:7/252: chown d12/d15/d26 516 1 2024-09-21T11:39:04.840 INFO:tasks.workunit.client.1.smithi149.stdout:0/113: write dd/f26 [4015996,82644] 0 2024-09-21T11:39:04.841 INFO:tasks.workunit.client.1.smithi149.stdout:4/175: dwrite d4/d13/d15/d30/f37 [0,4194304] 0 2024-09-21T11:39:04.842 INFO:tasks.workunit.client.1.smithi149.stdout:1/164: symlink d2/dd/d35/d26/l36 0 2024-09-21T11:39:04.844 INFO:tasks.workunit.client.1.smithi149.stdout:9/137: creat d18/d19/f25 x:0 0 0 2024-09-21T11:39:04.846 INFO:tasks.workunit.client.1.smithi149.stdout:6/143: creat d8/da/d14/f27 x:0 0 0 2024-09-21T11:39:04.854 INFO:tasks.workunit.client.1.smithi149.stdout:4/176: symlink d4/d13/d15/l3e 0 2024-09-21T11:39:04.857 INFO:tasks.workunit.client.1.smithi149.stdout:6/144: mkdir d8/da/d14/d18/d28 0 2024-09-21T11:39:04.857 INFO:tasks.workunit.client.1.smithi149.stdout:8/158: dwrite d3/dd/f1a [0,4194304] 0 2024-09-21T11:39:04.858 INFO:tasks.workunit.client.1.smithi149.stdout:3/223: mknod d6/d1f/d47/c58 0 2024-09-21T11:39:04.859 INFO:tasks.workunit.client.1.smithi149.stdout:6/145: read f4 [1233523,56600] 0 2024-09-21T11:39:04.860 INFO:tasks.workunit.client.1.smithi149.stdout:3/224: write d6/f13 [580606,61086] 0 2024-09-21T11:39:04.861 INFO:tasks.workunit.client.1.smithi149.stdout:7/253: getdents d12/d15/d4a 0 2024-09-21T11:39:04.861 INFO:tasks.workunit.client.1.smithi149.stdout:4/177: mknod d4/d13/d10/d31/d32/c3f 0 2024-09-21T11:39:04.864 INFO:tasks.workunit.client.1.smithi149.stdout:9/138: creat d18/d19/d1a/f26 x:0 0 0 2024-09-21T11:39:04.866 INFO:tasks.workunit.client.1.smithi149.stdout:0/114: dwrite dd/f23 [0,4194304] 0 2024-09-21T11:39:04.867 INFO:tasks.workunit.client.1.smithi149.stdout:6/146: mknod d8/da/d14/c29 0 2024-09-21T11:39:04.868 INFO:tasks.workunit.client.1.smithi149.stdout:3/225: symlink d6/d1f/d47/d22/l59 0 2024-09-21T11:39:04.869 INFO:tasks.workunit.client.0.smithi118.stdout:8/91: dwrite d2/dc/d13/d18/d1a/f1b [0,4194304] 0 2024-09-21T11:39:04.870 INFO:tasks.workunit.client.1.smithi149.stdout:6/147: fsync d8/da/d14/f15 0 2024-09-21T11:39:04.872 INFO:tasks.workunit.client.1.smithi149.stdout:8/159: dread d3/f20 [0,4194304] 0 2024-09-21T11:39:04.872 INFO:tasks.workunit.client.0.smithi118.stdout:8/92: symlink d2/dc/l23 0 2024-09-21T11:39:04.873 INFO:tasks.workunit.client.1.smithi149.stdout:3/226: write d6/d1f/d47/d37/d3a/f43 [203596,37094] 0 2024-09-21T11:39:04.873 INFO:tasks.workunit.client.1.smithi149.stdout:4/178: creat d4/d13/d10/d31/f40 x:0 0 0 2024-09-21T11:39:04.874 INFO:tasks.workunit.client.0.smithi118.stdout:8/93: write d2/dc/d13/d18/d1a/f1f [594283,20742] 0 2024-09-21T11:39:04.876 INFO:tasks.workunit.client.1.smithi149.stdout:8/160: write d3/d12/f24 [981158,114654] 0 2024-09-21T11:39:04.877 INFO:tasks.workunit.client.1.smithi149.stdout:8/161: stat d3/dd/d18/l32 0 2024-09-21T11:39:04.882 INFO:tasks.workunit.client.1.smithi149.stdout:9/139: mkdir d18/d19/d27 0 2024-09-21T11:39:04.884 INFO:tasks.workunit.client.1.smithi149.stdout:5/163: write d4/f5 [1262273,80369] 0 2024-09-21T11:39:04.885 INFO:tasks.workunit.client.1.smithi149.stdout:5/164: chown d4/d7/f27 4743154 1 2024-09-21T11:39:04.885 INFO:tasks.workunit.client.1.smithi149.stdout:3/227: symlink d6/d1f/d47/d37/l5a 0 2024-09-21T11:39:04.886 INFO:tasks.workunit.client.0.smithi118.stdout:8/94: dwrite d2/dc/d13/d18/f22 [4194304,4194304] 0 2024-09-21T11:39:04.887 INFO:tasks.workunit.client.1.smithi149.stdout:4/179: symlink d4/d13/d10/l41 0 2024-09-21T11:39:04.889 INFO:tasks.workunit.client.1.smithi149.stdout:7/254: link d12/d15/f32 d12/d15/d26/f4b 0 2024-09-21T11:39:04.891 INFO:tasks.workunit.client.0.smithi118.stdout:8/95: rename d2/dc/l23 to d2/dc/d10/l24 0 2024-09-21T11:39:04.894 INFO:tasks.workunit.client.1.smithi149.stdout:2/188: write d8/f1c [1487433,49779] 0 2024-09-21T11:39:04.898 INFO:tasks.workunit.client.1.smithi149.stdout:3/228: dwrite d6/f56 [0,4194304] 0 2024-09-21T11:39:04.899 INFO:tasks.workunit.client.1.smithi149.stdout:2/189: rename d8 to d8/da/d13/d1a/d3b/d3f 22 2024-09-21T11:39:04.900 INFO:tasks.workunit.client.0.smithi118.stdout:8/96: dwrite d2/fa [0,4194304] 0 2024-09-21T11:39:04.900 INFO:tasks.workunit.client.1.smithi149.stdout:4/180: fsync d4/f7 0 2024-09-21T11:39:04.901 INFO:tasks.workunit.client.1.smithi149.stdout:1/165: write d2/d2b/f31 [637196,4209] 0 2024-09-21T11:39:04.901 INFO:tasks.workunit.client.1.smithi149.stdout:8/162: mkdir d3/d33 0 2024-09-21T11:39:04.903 INFO:tasks.workunit.client.1.smithi149.stdout:2/190: stat d8/da/d13/c14 0 2024-09-21T11:39:04.907 INFO:tasks.workunit.client.1.smithi149.stdout:0/115: creat dd/d1a/d1b/f27 x:0 0 0 2024-09-21T11:39:04.907 INFO:tasks.workunit.client.1.smithi149.stdout:5/165: link f2 d4/d7/d1a/d2a/f34 0 2024-09-21T11:39:04.908 INFO:tasks.workunit.client.1.smithi149.stdout:4/181: read d4/d6/d18/f1c [2277620,5727] 0 2024-09-21T11:39:04.908 INFO:tasks.workunit.client.1.smithi149.stdout:7/255: dread d12/d15/d26/f2e [0,4194304] 0 2024-09-21T11:39:04.909 INFO:tasks.workunit.client.1.smithi149.stdout:0/116: chown dd/c11 0 1 2024-09-21T11:39:04.909 INFO:tasks.workunit.client.0.smithi118.stdout:8/97: dwrite d2/dc/d13/d18/f22 [8388608,4194304] 0 2024-09-21T11:39:04.910 INFO:tasks.workunit.client.1.smithi149.stdout:6/148: getdents d8 0 2024-09-21T11:39:04.911 INFO:tasks.workunit.client.1.smithi149.stdout:7/256: write d12/d15/f45 [475827,112709] 0 2024-09-21T11:39:04.911 INFO:tasks.workunit.client.1.smithi149.stdout:1/166: mkdir d2/dd/d35/d1c/d37 0 2024-09-21T11:39:04.913 INFO:tasks.workunit.client.1.smithi149.stdout:1/167: dread - d2/f2d zero size 2024-09-21T11:39:04.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/191: creat d8/d20/f40 x:0 0 0 2024-09-21T11:39:04.913 INFO:tasks.workunit.client.1.smithi149.stdout:5/166: creat d4/d7/d1a/f35 x:0 0 0 2024-09-21T11:39:04.914 INFO:tasks.workunit.client.0.smithi118.stdout:8/98: symlink d2/dc/d10/l25 0 2024-09-21T11:39:04.915 INFO:tasks.workunit.client.0.smithi118.stdout:8/99: readlink d2/dc/lf 0 2024-09-21T11:39:04.915 INFO:tasks.workunit.client.0.smithi118.stdout:8/100: chown d2/dc/d16 505042856 1 2024-09-21T11:39:04.917 INFO:tasks.workunit.client.0.smithi118.stdout:8/101: write d2/fa [3200270,88279] 0 2024-09-21T11:39:04.917 INFO:tasks.workunit.client.1.smithi149.stdout:8/163: mkdir d3/d33/d34 0 2024-09-21T11:39:04.917 INFO:tasks.workunit.client.0.smithi118.stdout:8/102: stat d2/dc/d13/f21 0 2024-09-21T11:39:04.918 INFO:tasks.workunit.client.1.smithi149.stdout:2/192: chown d8/da/d13/f21 13 1 2024-09-21T11:39:04.921 INFO:tasks.workunit.client.0.smithi118.stdout:8/103: fsync d2/f7 0 2024-09-21T11:39:04.926 INFO:tasks.workunit.client.1.smithi149.stdout:0/117: dread dd/f15 [0,4194304] 0 2024-09-21T11:39:04.926 INFO:tasks.workunit.client.1.smithi149.stdout:6/149: creat d8/da/d14/f2a x:0 0 0 2024-09-21T11:39:04.926 INFO:tasks.workunit.client.1.smithi149.stdout:5/167: rename d4/d1d/l2c to d4/d1d/l36 0 2024-09-21T11:39:04.926 INFO:tasks.workunit.client.0.smithi118.stdout:8/104: creat d2/dc/f26 x:0 0 0 2024-09-21T11:39:04.928 INFO:tasks.workunit.client.0.smithi118.stdout:8/105: rmdir d2/dc/d10 39 2024-09-21T11:39:04.929 INFO:tasks.workunit.client.0.smithi118.stdout:8/106: fdatasync d2/dc/d13/d18/d1a/f1b 0 2024-09-21T11:39:04.929 INFO:tasks.workunit.client.1.smithi149.stdout:7/257: symlink d12/d15/d26/d30/l4c 0 2024-09-21T11:39:04.930 INFO:tasks.workunit.client.1.smithi149.stdout:4/182: mkdir d4/d13/d2d/d42 0 2024-09-21T11:39:04.930 INFO:tasks.workunit.client.0.smithi118.stdout:8/107: write d2/dc/f26 [53605,26218] 0 2024-09-21T11:39:04.932 INFO:tasks.workunit.client.1.smithi149.stdout:5/168: chown d4/d7/d1a/f23 210278862 1 2024-09-21T11:39:04.932 INFO:tasks.workunit.client.0.smithi118.stdout:8/108: symlink d2/dc/d13/d18/d1a/l27 0 2024-09-21T11:39:04.935 INFO:tasks.workunit.client.1.smithi149.stdout:2/193: dwrite d8/dd/f24 [0,4194304] 0 2024-09-21T11:39:04.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/168: creat d2/dd/d35/d1c/f38 x:0 0 0 2024-09-21T11:39:04.936 INFO:tasks.workunit.client.1.smithi149.stdout:6/150: rmdir d8/da/d14/d18 39 2024-09-21T11:39:04.938 INFO:tasks.workunit.client.0.smithi118.stdout:8/109: dwrite d2/dc/d13/d18/d1a/f1b [0,4194304] 0 2024-09-21T11:39:04.940 INFO:tasks.workunit.client.1.smithi149.stdout:1/169: truncate d2/f1a 973034 0 2024-09-21T11:39:04.940 INFO:tasks.workunit.client.1.smithi149.stdout:6/151: chown d8/c23 12 1 2024-09-21T11:39:04.944 INFO:tasks.workunit.client.1.smithi149.stdout:0/118: dread f8 [0,4194304] 0 2024-09-21T11:39:04.944 INFO:tasks.workunit.client.1.smithi149.stdout:2/194: read - d8/da/d13/d2d/f34 zero size 2024-09-21T11:39:04.945 INFO:tasks.workunit.client.1.smithi149.stdout:1/170: fsync d2/f2d 0 2024-09-21T11:39:04.945 INFO:tasks.workunit.client.1.smithi149.stdout:9/140: dwrite fc [0,4194304] 0 2024-09-21T11:39:04.946 INFO:tasks.workunit.client.0.smithi118.stdout:8/110: dwrite d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:04.947 INFO:tasks.workunit.client.1.smithi149.stdout:4/183: rename d4/l20 to d4/d13/d15/d16/d23/l43 0 2024-09-21T11:39:04.951 INFO:tasks.workunit.client.1.smithi149.stdout:2/195: write d8/da/f2a [753297,61536] 0 2024-09-21T11:39:04.952 INFO:tasks.workunit.client.0.smithi118.stdout:8/111: rename d2/dc/cd to d2/dc/c28 0 2024-09-21T11:39:04.956 INFO:tasks.workunit.client.1.smithi149.stdout:1/171: rmdir d2/d2b 39 2024-09-21T11:39:04.960 INFO:tasks.workunit.client.1.smithi149.stdout:7/258: getdents d12 0 2024-09-21T11:39:04.962 INFO:tasks.workunit.client.1.smithi149.stdout:8/164: getdents d3/d33 0 2024-09-21T11:39:04.962 INFO:tasks.workunit.client.0.smithi118.stdout:8/112: creat d2/f29 x:0 0 0 2024-09-21T11:39:04.962 INFO:tasks.workunit.client.1.smithi149.stdout:4/184: creat d4/d6/f44 x:0 0 0 2024-09-21T11:39:04.966 INFO:tasks.workunit.client.0.smithi118.stdout:8/113: readlink d2/dc/d10/l25 0 2024-09-21T11:39:04.967 INFO:tasks.workunit.client.0.smithi118.stdout:8/114: fdatasync d2/dc/d13/d18/d1a/f1e 0 2024-09-21T11:39:04.967 INFO:tasks.workunit.client.1.smithi149.stdout:6/152: mkdir d8/da/d14/d18/d2b 0 2024-09-21T11:39:04.967 INFO:tasks.workunit.client.1.smithi149.stdout:8/165: truncate d3/f8 1939590 0 2024-09-21T11:39:04.968 INFO:tasks.workunit.client.0.smithi118.stdout:8/115: write d2/dc/f26 [1758155,23290] 0 2024-09-21T11:39:04.970 INFO:tasks.workunit.client.1.smithi149.stdout:6/153: chown d8/c23 19747944 1 2024-09-21T11:39:04.970 INFO:tasks.workunit.client.1.smithi149.stdout:3/229: rename d6/d1f/d27/f4d to d6/d1f/d27/f5b 0 2024-09-21T11:39:04.970 INFO:tasks.workunit.client.1.smithi149.stdout:0/119: dwrite dd/d1a/d1b/f24 [0,4194304] 0 2024-09-21T11:39:04.971 INFO:tasks.workunit.client.1.smithi149.stdout:5/169: rename d4/d1d/l36 to d4/d7/d1a/l37 0 2024-09-21T11:39:04.972 INFO:tasks.workunit.client.0.smithi118.stdout:8/116: dread d2/dc/d13/d18/f22 [0,4194304] 0 2024-09-21T11:39:04.973 INFO:tasks.workunit.client.1.smithi149.stdout:7/259: symlink d12/d35/l4d 0 2024-09-21T11:39:04.974 INFO:tasks.workunit.client.1.smithi149.stdout:4/185: unlink d4/d13/l22 0 2024-09-21T11:39:04.975 INFO:tasks.workunit.client.0.smithi118.stdout:8/117: mknod d2/dc/d10/c2a 0 2024-09-21T11:39:04.975 INFO:tasks.workunit.client.1.smithi149.stdout:6/154: write d8/da/d11/f26 [461027,44335] 0 2024-09-21T11:39:04.979 INFO:tasks.workunit.client.1.smithi149.stdout:7/260: fsync d12/d15/d26/f2e 0 2024-09-21T11:39:04.983 INFO:tasks.workunit.client.1.smithi149.stdout:3/230: creat d6/d1f/d47/f5c x:0 0 0 2024-09-21T11:39:04.984 INFO:tasks.workunit.client.1.smithi149.stdout:4/186: creat d4/d13/d2d/d42/f45 x:0 0 0 2024-09-21T11:39:04.984 INFO:tasks.workunit.client.1.smithi149.stdout:5/170: creat d4/d7/f38 x:0 0 0 2024-09-21T11:39:04.986 INFO:tasks.workunit.client.1.smithi149.stdout:9/141: truncate fc 2314533 0 2024-09-21T11:39:04.986 INFO:tasks.workunit.client.1.smithi149.stdout:0/120: dread dd/fe [0,4194304] 0 2024-09-21T11:39:04.988 INFO:tasks.workunit.client.1.smithi149.stdout:0/121: stat dd/l25 0 2024-09-21T11:39:04.990 INFO:tasks.workunit.client.1.smithi149.stdout:4/187: unlink d4/d13/d15/d16/f34 0 2024-09-21T11:39:04.990 INFO:tasks.workunit.client.0.smithi118.stdout:8/118: fsync d2/f29 0 2024-09-21T11:39:04.993 INFO:tasks.workunit.client.1.smithi149.stdout:7/261: dwrite d12/d15/d26/f3e [0,4194304] 0 2024-09-21T11:39:04.993 INFO:tasks.workunit.client.1.smithi149.stdout:9/142: mknod d18/d1c/c28 0 2024-09-21T11:39:04.993 INFO:tasks.workunit.client.1.smithi149.stdout:4/188: fsync d4/d6/d18/f2e 0 2024-09-21T11:39:04.995 INFO:tasks.workunit.client.1.smithi149.stdout:6/155: dread d8/da/d14/d18/f19 [0,4194304] 0 2024-09-21T11:39:04.997 INFO:tasks.workunit.client.1.smithi149.stdout:1/172: fsync d2/f1a 0 2024-09-21T11:39:04.997 INFO:tasks.workunit.client.1.smithi149.stdout:3/231: chown d6/d1f/d27/f3c 35 1 2024-09-21T11:39:04.998 INFO:tasks.workunit.client.1.smithi149.stdout:9/143: chown ca 114 1 2024-09-21T11:39:04.999 INFO:tasks.workunit.client.1.smithi149.stdout:8/166: truncate d3/f1d 98022 0 2024-09-21T11:39:05.000 INFO:tasks.workunit.client.1.smithi149.stdout:7/262: fdatasync d12/f18 0 2024-09-21T11:39:05.003 INFO:tasks.workunit.client.1.smithi149.stdout:0/122: rename dd/c16 to dd/d1a/d1b/c28 0 2024-09-21T11:39:05.003 INFO:tasks.workunit.client.1.smithi149.stdout:7/263: chown d12/f21 2938 1 2024-09-21T11:39:05.011 INFO:tasks.workunit.client.1.smithi149.stdout:7/264: creat d12/d15/d26/d30/f4e x:0 0 0 2024-09-21T11:39:05.011 INFO:tasks.workunit.client.1.smithi149.stdout:8/167: mknod d3/dd/d18/d2e/c35 0 2024-09-21T11:39:05.014 INFO:tasks.workunit.client.1.smithi149.stdout:6/156: dwrite d8/da/d11/f26 [0,4194304] 0 2024-09-21T11:39:05.015 INFO:tasks.workunit.client.1.smithi149.stdout:4/189: getdents d4/d13/d2d/d42 0 2024-09-21T11:39:05.016 INFO:tasks.workunit.client.1.smithi149.stdout:7/265: stat d12/d15/d26/d30/d31/f37 0 2024-09-21T11:39:05.019 INFO:tasks.workunit.client.1.smithi149.stdout:5/171: dwrite d4/d7/f31 [0,4194304] 0 2024-09-21T11:39:05.025 INFO:tasks.workunit.client.1.smithi149.stdout:9/144: dwrite d18/d19/d1a/f23 [0,4194304] 0 2024-09-21T11:39:05.030 INFO:tasks.workunit.client.1.smithi149.stdout:4/190: unlink d4/d13/d15/f19 0 2024-09-21T11:39:05.032 INFO:tasks.workunit.client.1.smithi149.stdout:8/168: mknod d3/c36 0 2024-09-21T11:39:05.032 INFO:tasks.workunit.client.1.smithi149.stdout:7/266: write d12/d15/f2c [256862,675] 0 2024-09-21T11:39:05.032 INFO:tasks.workunit.client.1.smithi149.stdout:0/123: link dd/c11 dd/d1a/d1b/c29 0 2024-09-21T11:39:05.034 INFO:tasks.workunit.client.1.smithi149.stdout:5/172: mknod d4/d7/d1a/d2a/c39 0 2024-09-21T11:39:05.037 INFO:tasks.workunit.client.1.smithi149.stdout:7/267: dread - d12/d35/f46 zero size 2024-09-21T11:39:05.041 INFO:tasks.workunit.client.1.smithi149.stdout:4/191: dwrite d4/d6/fb [0,4194304] 0 2024-09-21T11:39:05.044 INFO:tasks.workunit.client.1.smithi149.stdout:9/145: mkdir d18/d19/d29 0 2024-09-21T11:39:05.046 INFO:tasks.workunit.client.1.smithi149.stdout:7/268: dread d12/d15/d26/d30/d31/f37 [0,4194304] 0 2024-09-21T11:39:05.046 INFO:tasks.workunit.client.1.smithi149.stdout:9/146: readlink lb 0 2024-09-21T11:39:05.050 INFO:tasks.workunit.client.1.smithi149.stdout:4/192: symlink d4/d13/d15/d16/l46 0 2024-09-21T11:39:05.051 INFO:tasks.workunit.client.1.smithi149.stdout:3/232: dread d6/f12 [0,4194304] 0 2024-09-21T11:39:05.055 INFO:tasks.workunit.client.1.smithi149.stdout:7/269: chown d12/d15/d26/f3e 0 1 2024-09-21T11:39:05.055 INFO:tasks.workunit.client.1.smithi149.stdout:8/169: rename d3/dd/f1a to d3/f37 0 2024-09-21T11:39:05.058 INFO:tasks.workunit.client.1.smithi149.stdout:5/173: dwrite d4/f18 [0,4194304] 0 2024-09-21T11:39:05.060 INFO:tasks.workunit.client.1.smithi149.stdout:4/193: readlink d4/d13/d15/d16/d23/l43 0 2024-09-21T11:39:05.061 INFO:tasks.workunit.client.1.smithi149.stdout:3/233: creat d6/d1f/d47/d22/f5d x:0 0 0 2024-09-21T11:39:05.062 INFO:tasks.workunit.client.1.smithi149.stdout:0/124: rename dd/d1a to dd/d1a/d1b/d2a 22 2024-09-21T11:39:05.063 INFO:tasks.workunit.client.1.smithi149.stdout:0/125: readlink dd/l25 0 2024-09-21T11:39:05.064 INFO:tasks.workunit.client.1.smithi149.stdout:6/157: truncate d8/da/d11/f26 482602 0 2024-09-21T11:39:05.065 INFO:tasks.workunit.client.1.smithi149.stdout:5/174: creat d4/f3a x:0 0 0 2024-09-21T11:39:05.069 INFO:tasks.workunit.client.1.smithi149.stdout:7/270: mkdir d12/d15/d4a/d4f 0 2024-09-21T11:39:05.070 INFO:tasks.workunit.client.1.smithi149.stdout:9/147: dwrite fc [0,4194304] 0 2024-09-21T11:39:05.071 INFO:tasks.workunit.client.1.smithi149.stdout:5/175: truncate d4/f3a 999217 0 2024-09-21T11:39:05.073 INFO:tasks.workunit.client.1.smithi149.stdout:0/126: unlink dd/d1a/d1b/f20 0 2024-09-21T11:39:05.075 INFO:tasks.workunit.client.1.smithi149.stdout:0/127: dread - dd/f1c zero size 2024-09-21T11:39:05.077 INFO:tasks.workunit.client.1.smithi149.stdout:5/176: mknod d4/d1d/c3b 0 2024-09-21T11:39:05.080 INFO:tasks.workunit.client.1.smithi149.stdout:4/194: write d4/d13/f28 [718463,81431] 0 2024-09-21T11:39:05.081 INFO:tasks.workunit.client.1.smithi149.stdout:3/234: dwrite d6/d1f/d47/d37/f4b [4194304,4194304] 0 2024-09-21T11:39:05.082 INFO:tasks.workunit.client.1.smithi149.stdout:9/148: link fc d18/f2a 0 2024-09-21T11:39:05.083 INFO:tasks.workunit.client.1.smithi149.stdout:4/195: chown d4/d13/d10/d31/c3d 79842017 1 2024-09-21T11:39:05.084 INFO:tasks.workunit.client.1.smithi149.stdout:3/235: write d6/d1f/d47/f1e [5305625,112505] 0 2024-09-21T11:39:05.084 INFO:tasks.workunit.client.1.smithi149.stdout:8/170: mknod d3/dd/c38 0 2024-09-21T11:39:05.084 INFO:tasks.workunit.client.1.smithi149.stdout:7/271: creat d12/d15/f50 x:0 0 0 2024-09-21T11:39:05.085 INFO:tasks.workunit.client.1.smithi149.stdout:0/128: mknod dd/c2b 0 2024-09-21T11:39:05.086 INFO:tasks.workunit.client.1.smithi149.stdout:5/177: fdatasync d4/d7/d1a/d2a/f34 0 2024-09-21T11:39:05.088 INFO:tasks.workunit.client.1.smithi149.stdout:6/158: truncate d8/da/f1a 113356 0 2024-09-21T11:39:05.090 INFO:tasks.workunit.client.1.smithi149.stdout:4/196: creat d4/d6/f47 x:0 0 0 2024-09-21T11:39:05.091 INFO:tasks.workunit.client.1.smithi149.stdout:0/129: creat dd/d1a/f2c x:0 0 0 2024-09-21T11:39:05.091 INFO:tasks.workunit.client.1.smithi149.stdout:5/178: symlink d4/l3c 0 2024-09-21T11:39:05.093 INFO:tasks.workunit.client.1.smithi149.stdout:3/236: creat d6/d1f/d47/d37/d3a/f5e x:0 0 0 2024-09-21T11:39:05.094 INFO:tasks.workunit.client.1.smithi149.stdout:7/272: creat d12/d15/d4a/d4f/f51 x:0 0 0 2024-09-21T11:39:05.094 INFO:tasks.workunit.client.1.smithi149.stdout:8/171: mknod d3/dd/d18/c39 0 2024-09-21T11:39:05.096 INFO:tasks.workunit.client.1.smithi149.stdout:4/197: rename d4/d6/f44 to d4/d13/d15/d30/f48 0 2024-09-21T11:39:05.098 INFO:tasks.workunit.client.1.smithi149.stdout:9/149: getdents d18/d19/d1a 0 2024-09-21T11:39:05.098 INFO:tasks.workunit.client.1.smithi149.stdout:6/159: dwrite d8/da/d14/f15 [0,4194304] 0 2024-09-21T11:39:05.099 INFO:tasks.workunit.client.1.smithi149.stdout:5/179: rename d4/l11 to d4/d1d/l3d 0 2024-09-21T11:39:05.099 INFO:tasks.workunit.client.1.smithi149.stdout:4/198: rmdir d4/d13/d2d 39 2024-09-21T11:39:05.100 INFO:tasks.workunit.client.1.smithi149.stdout:7/273: symlink d12/d15/d26/d30/d31/d47/d49/l52 0 2024-09-21T11:39:05.101 INFO:tasks.workunit.client.1.smithi149.stdout:3/237: mkdir d6/d5f 0 2024-09-21T11:39:05.102 INFO:tasks.workunit.client.1.smithi149.stdout:7/274: chown d12/d15/d26/d30/d31/d47 11675670 1 2024-09-21T11:39:05.103 INFO:tasks.workunit.client.1.smithi149.stdout:0/130: getdents dd 0 2024-09-21T11:39:05.106 INFO:tasks.workunit.client.1.smithi149.stdout:9/150: getdents d18 0 2024-09-21T11:39:05.106 INFO:tasks.workunit.client.1.smithi149.stdout:2/196: sync 2024-09-21T11:39:05.106 INFO:tasks.workunit.client.1.smithi149.stdout:1/173: sync 2024-09-21T11:39:05.110 INFO:tasks.workunit.client.1.smithi149.stdout:8/172: rename d3/d4 to d3/dd/d3a 0 2024-09-21T11:39:05.110 INFO:tasks.workunit.client.1.smithi149.stdout:9/151: chown f0 255357 1 2024-09-21T11:39:05.110 INFO:tasks.workunit.client.1.smithi149.stdout:1/174: dread - d2/dd/f22 zero size 2024-09-21T11:39:05.111 INFO:tasks.workunit.client.1.smithi149.stdout:0/131: mkdir dd/d2d 0 2024-09-21T11:39:05.111 INFO:tasks.workunit.client.1.smithi149.stdout:6/160: getdents d8/da/d14 0 2024-09-21T11:39:05.112 INFO:tasks.workunit.client.1.smithi149.stdout:8/173: fsync d3/f10 0 2024-09-21T11:39:05.113 INFO:tasks.workunit.client.1.smithi149.stdout:6/161: stat d8 0 2024-09-21T11:39:05.113 INFO:tasks.workunit.client.1.smithi149.stdout:7/275: write d12/d15/d26/f29 [5114597,111458] 0 2024-09-21T11:39:05.116 INFO:tasks.workunit.client.1.smithi149.stdout:4/199: dwrite d4/d6/f47 [0,4194304] 0 2024-09-21T11:39:05.119 INFO:tasks.workunit.client.1.smithi149.stdout:3/238: dread d6/f13 [0,4194304] 0 2024-09-21T11:39:05.119 INFO:tasks.workunit.client.1.smithi149.stdout:8/174: fdatasync d3/f14 0 2024-09-21T11:39:05.123 INFO:tasks.workunit.client.1.smithi149.stdout:8/175: chown d3/dd/d3a 3163 1 2024-09-21T11:39:05.123 INFO:tasks.workunit.client.1.smithi149.stdout:6/162: mkdir d8/da/d2c 0 2024-09-21T11:39:05.123 INFO:tasks.workunit.client.1.smithi149.stdout:1/175: creat d2/dd/d35/d1c/f39 x:0 0 0 2024-09-21T11:39:05.124 INFO:tasks.workunit.client.1.smithi149.stdout:3/239: rmdir d6/d1f 39 2024-09-21T11:39:05.124 INFO:tasks.workunit.client.1.smithi149.stdout:2/197: dread d8/da/f39 [0,4194304] 0 2024-09-21T11:39:05.127 INFO:tasks.workunit.client.1.smithi149.stdout:2/198: dread - d8/d11/f3d zero size 2024-09-21T11:39:05.127 INFO:tasks.workunit.client.1.smithi149.stdout:1/176: chown d2/d5/d8/fa 51213786 1 2024-09-21T11:39:05.144 INFO:tasks.workunit.client.1.smithi149.stdout:5/180: dread d4/f9 [0,4194304] 0 2024-09-21T11:39:05.145 INFO:tasks.workunit.client.1.smithi149.stdout:9/152: dwrite d18/f2a [0,4194304] 0 2024-09-21T11:39:05.146 INFO:tasks.workunit.client.1.smithi149.stdout:4/200: link d4/d13/f28 d4/d13/d15/f49 0 2024-09-21T11:39:05.147 INFO:tasks.workunit.client.1.smithi149.stdout:7/276: dwrite d12/f48 [0,4194304] 0 2024-09-21T11:39:05.149 INFO:tasks.workunit.client.1.smithi149.stdout:6/163: mkdir d8/da/d2c/d2d 0 2024-09-21T11:39:05.149 INFO:tasks.workunit.client.1.smithi149.stdout:3/240: mkdir d6/d5f/d60 0 2024-09-21T11:39:05.153 INFO:tasks.workunit.client.1.smithi149.stdout:1/177: mkdir d2/d5/d8/d3a 0 2024-09-21T11:39:05.153 INFO:tasks.workunit.client.1.smithi149.stdout:7/277: dread - d12/d15/d26/f4b zero size 2024-09-21T11:39:05.154 INFO:tasks.workunit.client.1.smithi149.stdout:2/199: creat d8/da/d13/d1a/d2c/f41 x:0 0 0 2024-09-21T11:39:05.158 INFO:tasks.workunit.client.1.smithi149.stdout:0/132: creat dd/d1a/f2e x:0 0 0 2024-09-21T11:39:05.164 INFO:tasks.workunit.client.1.smithi149.stdout:1/178: mkdir d2/d5/d8/d3b 0 2024-09-21T11:39:05.165 INFO:tasks.workunit.client.1.smithi149.stdout:7/278: symlink d12/d15/d26/d30/l53 0 2024-09-21T11:39:05.167 INFO:tasks.workunit.client.1.smithi149.stdout:0/133: write f8 [4544835,113073] 0 2024-09-21T11:39:05.167 INFO:tasks.workunit.client.1.smithi149.stdout:6/164: mkdir d8/da/d14/d18/d28/d2e 0 2024-09-21T11:39:05.167 INFO:tasks.workunit.client.1.smithi149.stdout:5/181: dwrite d4/d7/f38 [0,4194304] 0 2024-09-21T11:39:05.169 INFO:tasks.workunit.client.1.smithi149.stdout:3/241: symlink d6/d1f/d47/d37/l61 0 2024-09-21T11:39:05.170 INFO:tasks.workunit.client.1.smithi149.stdout:9/153: dwrite d18/d19/f25 [0,4194304] 0 2024-09-21T11:39:05.172 INFO:tasks.workunit.client.1.smithi149.stdout:3/242: chown d6/f12 1 1 2024-09-21T11:39:05.172 INFO:tasks.workunit.client.1.smithi149.stdout:7/279: write d12/d15/d4a/d4f/f51 [63076,5453] 0 2024-09-21T11:39:05.175 INFO:tasks.workunit.client.1.smithi149.stdout:0/134: creat dd/d1a/f2f x:0 0 0 2024-09-21T11:39:05.178 INFO:tasks.workunit.client.1.smithi149.stdout:9/154: truncate d18/d19/f25 4390175 0 2024-09-21T11:39:05.178 INFO:tasks.workunit.client.1.smithi149.stdout:0/135: dread - dd/d1a/f2c zero size 2024-09-21T11:39:05.181 INFO:tasks.workunit.client.1.smithi149.stdout:7/280: fsync d12/d15/d4a/d4f/f51 0 2024-09-21T11:39:05.182 INFO:tasks.workunit.client.1.smithi149.stdout:9/155: write d18/d19/d1a/f23 [2272679,41389] 0 2024-09-21T11:39:05.187 INFO:tasks.workunit.client.1.smithi149.stdout:3/243: symlink d6/d1f/d47/l62 0 2024-09-21T11:39:05.190 INFO:tasks.workunit.client.1.smithi149.stdout:5/182: dwrite d4/d7/f38 [0,4194304] 0 2024-09-21T11:39:05.190 INFO:tasks.workunit.client.1.smithi149.stdout:0/136: mkdir dd/d30 0 2024-09-21T11:39:05.191 INFO:tasks.workunit.client.1.smithi149.stdout:6/165: dwrite d8/da/d14/f15 [4194304,4194304] 0 2024-09-21T11:39:05.192 INFO:tasks.workunit.client.1.smithi149.stdout:7/281: creat d12/d15/d4a/d4f/f54 x:0 0 0 2024-09-21T11:39:05.195 INFO:tasks.workunit.client.1.smithi149.stdout:5/183: read d4/d7/f38 [151644,84701] 0 2024-09-21T11:39:05.196 INFO:tasks.workunit.client.1.smithi149.stdout:7/282: chown d12/d15/d26/d30/d31/f3f 29 1 2024-09-21T11:39:05.196 INFO:tasks.workunit.client.1.smithi149.stdout:9/156: symlink d18/d19/d1a/l2b 0 2024-09-21T11:39:05.203 INFO:tasks.workunit.client.1.smithi149.stdout:6/166: mkdir d8/da/d14/d18/d28/d2f 0 2024-09-21T11:39:05.207 INFO:tasks.workunit.client.1.smithi149.stdout:6/167: chown d8/da/d11/f26 235753618 1 2024-09-21T11:39:05.208 INFO:tasks.workunit.client.1.smithi149.stdout:0/137: dwrite f8 [0,4194304] 0 2024-09-21T11:39:05.209 INFO:tasks.workunit.client.1.smithi149.stdout:7/283: dread d12/d15/f1f [0,4194304] 0 2024-09-21T11:39:05.211 INFO:tasks.workunit.client.1.smithi149.stdout:9/157: dread d18/d19/d1a/f23 [0,4194304] 0 2024-09-21T11:39:05.212 INFO:tasks.workunit.client.1.smithi149.stdout:3/244: creat d6/d1f/d27/f63 x:0 0 0 2024-09-21T11:39:05.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/158: chown d18/d19/d1a/c1b 31536 1 2024-09-21T11:39:05.213 INFO:tasks.workunit.client.1.smithi149.stdout:9/159: fsync f0 0 2024-09-21T11:39:05.216 INFO:tasks.workunit.client.1.smithi149.stdout:3/245: write d6/d1f/d47/d37/d3a/f5e [876133,130802] 0 2024-09-21T11:39:05.220 INFO:tasks.workunit.client.1.smithi149.stdout:6/168: creat d8/da/d14/d18/d28/f30 x:0 0 0 2024-09-21T11:39:05.222 INFO:tasks.workunit.client.1.smithi149.stdout:7/284: creat d12/d35/f55 x:0 0 0 2024-09-21T11:39:05.225 INFO:tasks.workunit.client.1.smithi149.stdout:7/285: truncate d12/d15/f2c 1514060 0 2024-09-21T11:39:05.229 INFO:tasks.workunit.client.1.smithi149.stdout:3/246: write d6/f10 [5172220,111163] 0 2024-09-21T11:39:05.229 INFO:tasks.workunit.client.1.smithi149.stdout:8/176: sync 2024-09-21T11:39:05.230 INFO:tasks.workunit.client.1.smithi149.stdout:6/169: dwrite d8/da/d14/f2a [0,4194304] 0 2024-09-21T11:39:05.232 INFO:tasks.workunit.client.1.smithi149.stdout:3/247: readlink d6/d1f/l25 0 2024-09-21T11:39:05.233 INFO:tasks.workunit.client.1.smithi149.stdout:4/201: dwrite d4/d13/d15/f49 [0,4194304] 0 2024-09-21T11:39:05.238 INFO:tasks.workunit.client.1.smithi149.stdout:9/160: mknod d18/d19/c2c 0 2024-09-21T11:39:05.242 INFO:tasks.workunit.client.1.smithi149.stdout:7/286: symlink d12/d15/d26/d30/d31/l56 0 2024-09-21T11:39:05.243 INFO:tasks.workunit.client.1.smithi149.stdout:0/138: rmdir dd/d30 0 2024-09-21T11:39:05.243 INFO:tasks.workunit.client.1.smithi149.stdout:2/200: dwrite d8/da/d13/f21 [0,4194304] 0 2024-09-21T11:39:05.247 INFO:tasks.workunit.client.1.smithi149.stdout:4/202: rename d4/d13/d15/d38 to d4/d13/d10/d31/d32/d4a 0 2024-09-21T11:39:05.249 INFO:tasks.workunit.client.1.smithi149.stdout:9/161: creat d18/d19/d1a/f2d x:0 0 0 2024-09-21T11:39:05.250 INFO:tasks.workunit.client.1.smithi149.stdout:2/201: rmdir d8/da/d13/d2d 39 2024-09-21T11:39:05.256 INFO:tasks.workunit.client.1.smithi149.stdout:1/179: dwrite d2/f20 [0,4194304] 0 2024-09-21T11:39:05.258 INFO:tasks.workunit.client.1.smithi149.stdout:6/170: link d8/da/d14/f2a d8/da/d14/f31 0 2024-09-21T11:39:05.262 INFO:tasks.workunit.client.1.smithi149.stdout:2/202: dread d8/dd/f1d [0,4194304] 0 2024-09-21T11:39:05.263 INFO:tasks.workunit.client.1.smithi149.stdout:4/203: fdatasync d4/d13/d15/f49 0 2024-09-21T11:39:05.263 INFO:tasks.workunit.client.1.smithi149.stdout:2/203: readlink l6 0 2024-09-21T11:39:05.264 INFO:tasks.workunit.client.1.smithi149.stdout:4/204: write d4/f36 [110963,15924] 0 2024-09-21T11:39:05.266 INFO:tasks.workunit.client.1.smithi149.stdout:4/205: write d4/d6/d18/f2e [777184,57175] 0 2024-09-21T11:39:05.267 INFO:tasks.workunit.client.1.smithi149.stdout:4/206: write d4/d13/d10/d31/d32/f39 [941546,35539] 0 2024-09-21T11:39:05.271 INFO:tasks.workunit.client.1.smithi149.stdout:1/180: fsync d2/dd/f30 0 2024-09-21T11:39:05.272 INFO:tasks.workunit.client.1.smithi149.stdout:1/181: chown d2/dd/d35/f24 0 1 2024-09-21T11:39:05.273 INFO:tasks.workunit.client.1.smithi149.stdout:1/182: read - d2/dd/d35/d1c/f38 zero size 2024-09-21T11:39:05.276 INFO:tasks.workunit.client.1.smithi149.stdout:9/162: creat d18/d19/d29/f2e x:0 0 0 2024-09-21T11:39:05.277 INFO:tasks.workunit.client.1.smithi149.stdout:9/163: fdatasync d18/d19/d1a/f2d 0 2024-09-21T11:39:05.279 INFO:tasks.workunit.client.1.smithi149.stdout:5/184: truncate d4/f18 2224470 0 2024-09-21T11:39:05.284 INFO:tasks.workunit.client.1.smithi149.stdout:5/185: dwrite d4/d7/d1a/f23 [0,4194304] 0 2024-09-21T11:39:05.355 INFO:tasks.workunit.client.1.smithi149.stdout:7/287: sync 2024-09-21T11:39:05.360 INFO:tasks.workunit.client.1.smithi149.stdout:7/288: dwrite f4 [0,4194304] 0 2024-09-21T11:39:05.404 INFO:tasks.workunit.client.1.smithi149.stdout:4/207: creat d4/d13/d10/d31/f4b x:0 0 0 2024-09-21T11:39:05.411 INFO:tasks.workunit.client.1.smithi149.stdout:9/164: mkdir d18/d19/d1a/d2f 0 2024-09-21T11:39:05.416 INFO:tasks.workunit.client.1.smithi149.stdout:7/289: fsync d12/d15/d26/d30/d31/f37 0 2024-09-21T11:39:05.417 INFO:tasks.workunit.client.1.smithi149.stdout:7/290: read - d12/d15/d26/f4b zero size 2024-09-21T11:39:05.418 INFO:tasks.workunit.client.1.smithi149.stdout:4/208: creat d4/d13/d15/d16/d23/f4c x:0 0 0 2024-09-21T11:39:05.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/209: chown d4/d6/d18/f1c 997834874 1 2024-09-21T11:39:05.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/210: readlink d4/d13/d15/d16/d23/l35 0 2024-09-21T11:39:05.419 INFO:tasks.workunit.client.1.smithi149.stdout:8/177: link d3/f1d d3/dd/d21/f3b 0 2024-09-21T11:39:05.421 INFO:tasks.workunit.client.1.smithi149.stdout:1/183: mknod d2/d5/c3c 0 2024-09-21T11:39:05.423 INFO:tasks.workunit.client.1.smithi149.stdout:0/139: rename dd/f26 to dd/d1a/d1b/f31 0 2024-09-21T11:39:05.425 INFO:tasks.workunit.client.1.smithi149.stdout:1/184: truncate d2/d5/f34 223048 0 2024-09-21T11:39:05.426 INFO:tasks.workunit.client.1.smithi149.stdout:0/140: dread - dd/d1a/f2f zero size 2024-09-21T11:39:05.428 INFO:tasks.workunit.client.1.smithi149.stdout:8/178: dwrite d3/f8 [0,4194304] 0 2024-09-21T11:39:05.428 INFO:tasks.workunit.client.1.smithi149.stdout:4/211: dwrite d4/d6/f47 [4194304,4194304] 0 2024-09-21T11:39:05.431 INFO:tasks.workunit.client.1.smithi149.stdout:4/212: fsync d4/f1f 0 2024-09-21T11:39:05.433 INFO:tasks.workunit.client.1.smithi149.stdout:3/248: write d6/d1f/d27/f3c [468595,54410] 0 2024-09-21T11:39:05.436 INFO:tasks.workunit.client.1.smithi149.stdout:9/165: mkdir d18/d19/d1a/d2f/d30 0 2024-09-21T11:39:05.437 INFO:tasks.workunit.client.1.smithi149.stdout:4/213: read d4/d6/fb [798525,40164] 0 2024-09-21T11:39:05.440 INFO:tasks.workunit.client.1.smithi149.stdout:0/141: dwrite f8 [0,4194304] 0 2024-09-21T11:39:05.447 INFO:tasks.workunit.client.1.smithi149.stdout:6/171: write d8/da/d14/f1f [1792953,90781] 0 2024-09-21T11:39:05.448 INFO:tasks.workunit.client.1.smithi149.stdout:7/291: rename d12/d15/f1c to d12/d15/d26/d30/f57 0 2024-09-21T11:39:05.449 INFO:tasks.workunit.client.1.smithi149.stdout:3/249: rmdir d6/d5f 39 2024-09-21T11:39:05.450 INFO:tasks.workunit.client.1.smithi149.stdout:6/172: dread d8/da/d11/f26 [0,4194304] 0 2024-09-21T11:39:05.452 INFO:tasks.workunit.client.1.smithi149.stdout:5/186: getdents d4/d7 0 2024-09-21T11:39:05.456 INFO:tasks.workunit.client.1.smithi149.stdout:1/185: getdents d2/d5/d8/d3b 0 2024-09-21T11:39:05.460 INFO:tasks.workunit.client.1.smithi149.stdout:8/179: mkdir d3/d3c 0 2024-09-21T11:39:05.461 INFO:tasks.workunit.client.1.smithi149.stdout:3/250: dwrite d6/f8 [0,4194304] 0 2024-09-21T11:39:05.461 INFO:tasks.workunit.client.1.smithi149.stdout:2/204: dwrite d8/da/d13/d1a/f3e [4194304,4194304] 0 2024-09-21T11:39:05.466 INFO:tasks.workunit.client.1.smithi149.stdout:3/251: read d6/d1f/d47/f1e [4737292,41893] 0 2024-09-21T11:39:05.468 INFO:tasks.workunit.client.1.smithi149.stdout:9/166: dwrite d18/d19/d1a/f23 [0,4194304] 0 2024-09-21T11:39:05.475 INFO:tasks.workunit.client.1.smithi149.stdout:5/187: write d4/d7/f25 [2440235,32610] 0 2024-09-21T11:39:05.476 INFO:tasks.workunit.client.1.smithi149.stdout:4/214: rename d4/d13/d2d/d42 to d4/d4d 0 2024-09-21T11:39:05.478 INFO:tasks.workunit.client.1.smithi149.stdout:0/142: mkdir dd/d32 0 2024-09-21T11:39:05.479 INFO:tasks.workunit.client.1.smithi149.stdout:0/143: chown dd/d1a/c1f 0 1 2024-09-21T11:39:05.481 INFO:tasks.workunit.client.1.smithi149.stdout:8/180: creat d3/dd/d3a/f3d x:0 0 0 2024-09-21T11:39:05.482 INFO:tasks.workunit.client.1.smithi149.stdout:8/181: chown d3/d12/l29 3984 1 2024-09-21T11:39:05.488 INFO:tasks.workunit.client.1.smithi149.stdout:9/167: unlink d18/c1f 0 2024-09-21T11:39:05.489 INFO:tasks.workunit.client.1.smithi149.stdout:6/173: write d8/da/d14/f2a [2522009,79703] 0 2024-09-21T11:39:05.492 INFO:tasks.workunit.client.1.smithi149.stdout:6/174: read d8/da/fc [310318,37064] 0 2024-09-21T11:39:05.493 INFO:tasks.workunit.client.1.smithi149.stdout:4/215: mknod d4/d6/c4e 0 2024-09-21T11:39:05.501 INFO:tasks.workunit.client.1.smithi149.stdout:3/252: dread d6/d1f/d47/d37/f4b [0,4194304] 0 2024-09-21T11:39:05.507 INFO:tasks.workunit.client.1.smithi149.stdout:6/175: mkdir d8/d32 0 2024-09-21T11:39:05.509 INFO:tasks.workunit.client.1.smithi149.stdout:4/216: creat d4/d6/d18/f4f x:0 0 0 2024-09-21T11:39:05.511 INFO:tasks.workunit.client.1.smithi149.stdout:0/144: unlink dd/f1c 0 2024-09-21T11:39:05.513 INFO:tasks.workunit.client.1.smithi149.stdout:2/205: link l6 d8/da/d13/d1a/d3b/l42 0 2024-09-21T11:39:05.515 INFO:tasks.workunit.client.1.smithi149.stdout:7/292: getdents d12/d15/d4a 0 2024-09-21T11:39:05.518 INFO:tasks.workunit.client.1.smithi149.stdout:3/253: read d6/f1a [2322509,106409] 0 2024-09-21T11:39:05.518 INFO:tasks.workunit.client.1.smithi149.stdout:2/206: dwrite d8/dd/f2b [0,4194304] 0 2024-09-21T11:39:05.525 INFO:tasks.workunit.client.1.smithi149.stdout:1/186: rename d2/dd/d35/d26 to d2/d5/d3d 0 2024-09-21T11:39:05.530 INFO:tasks.workunit.client.1.smithi149.stdout:7/293: rmdir d12/d15/d26/d30 39 2024-09-21T11:39:05.531 INFO:tasks.workunit.client.1.smithi149.stdout:1/187: dwrite d2/dd/f22 [0,4194304] 0 2024-09-21T11:39:05.532 INFO:tasks.workunit.client.1.smithi149.stdout:1/188: fsync d2/f4 0 2024-09-21T11:39:05.533 INFO:tasks.workunit.client.1.smithi149.stdout:7/294: truncate d12/d15/d4a/d4f/f51 184058 0 2024-09-21T11:39:05.533 INFO:tasks.workunit.client.1.smithi149.stdout:1/189: chown d2/dd/d35 2231 1 2024-09-21T11:39:05.534 INFO:tasks.workunit.client.1.smithi149.stdout:9/168: link l11 d18/l31 0 2024-09-21T11:39:05.536 INFO:tasks.workunit.client.1.smithi149.stdout:3/254: read - d6/d1f/d27/f33 zero size 2024-09-21T11:39:05.536 INFO:tasks.workunit.client.1.smithi149.stdout:3/255: read f3 [142198,103957] 0 2024-09-21T11:39:05.541 INFO:tasks.workunit.client.1.smithi149.stdout:4/217: rename d4/d13/d15/d16/d23/f4c to d4/d13/d10/d31/d32/d4a/f50 0 2024-09-21T11:39:05.543 INFO:tasks.workunit.client.1.smithi149.stdout:4/218: write d4/d13/d10/d31/f4b [949214,103118] 0 2024-09-21T11:39:05.543 INFO:tasks.workunit.client.1.smithi149.stdout:6/176: creat d8/da/d14/d18/d28/f33 x:0 0 0 2024-09-21T11:39:05.546 INFO:tasks.workunit.client.1.smithi149.stdout:0/145: creat dd/d32/f33 x:0 0 0 2024-09-21T11:39:05.546 INFO:tasks.workunit.client.1.smithi149.stdout:0/146: write dd/d1a/d1b/f24 [585718,100031] 0 2024-09-21T11:39:05.547 INFO:tasks.workunit.client.1.smithi149.stdout:8/182: sync 2024-09-21T11:39:05.548 INFO:tasks.workunit.client.1.smithi149.stdout:8/183: write d3/f10 [272705,90622] 0 2024-09-21T11:39:05.550 INFO:tasks.workunit.client.1.smithi149.stdout:9/169: mkdir d18/d19/d1a/d2f/d32 0 2024-09-21T11:39:05.551 INFO:tasks.workunit.client.1.smithi149.stdout:9/170: write f0 [453179,69283] 0 2024-09-21T11:39:05.552 INFO:tasks.workunit.client.1.smithi149.stdout:3/256: creat d6/d1f/d47/d37/d3f/f64 x:0 0 0 2024-09-21T11:39:05.557 INFO:tasks.workunit.client.1.smithi149.stdout:5/188: dread d4/f18 [0,4194304] 0 2024-09-21T11:39:05.557 INFO:tasks.workunit.client.1.smithi149.stdout:2/207: rename d8/da/d13/f3c to d8/d11/f43 0 2024-09-21T11:39:05.558 INFO:tasks.workunit.client.1.smithi149.stdout:3/257: dwrite d6/d1f/f3e [4194304,4194304] 0 2024-09-21T11:39:05.559 INFO:tasks.workunit.client.1.smithi149.stdout:2/208: fsync d8/d11/f3a 0 2024-09-21T11:39:05.559 INFO:tasks.workunit.client.1.smithi149.stdout:4/219: unlink d4/d13/d10/d31/d32/f39 0 2024-09-21T11:39:05.562 INFO:tasks.workunit.client.1.smithi149.stdout:0/147: rmdir dd 39 2024-09-21T11:39:05.564 INFO:tasks.workunit.client.1.smithi149.stdout:7/295: creat d12/d15/d26/d30/d31/d47/d49/f58 x:0 0 0 2024-09-21T11:39:05.564 INFO:tasks.workunit.client.1.smithi149.stdout:5/189: dwrite d4/f3a [0,4194304] 0 2024-09-21T11:39:05.570 INFO:tasks.workunit.client.1.smithi149.stdout:9/171: readlink l11 0 2024-09-21T11:39:05.576 INFO:tasks.workunit.client.1.smithi149.stdout:1/190: rename d2/f18 to d2/d5/d8/d3b/f3e 0 2024-09-21T11:39:05.579 INFO:tasks.workunit.client.1.smithi149.stdout:6/177: mknod d8/da/d14/d18/d28/d2e/c34 0 2024-09-21T11:39:05.579 INFO:tasks.workunit.client.1.smithi149.stdout:6/178: dread - d8/da/d14/d18/d28/f33 zero size 2024-09-21T11:39:05.582 INFO:tasks.workunit.client.1.smithi149.stdout:4/220: symlink d4/d6/l51 0 2024-09-21T11:39:05.585 INFO:tasks.workunit.client.1.smithi149.stdout:2/209: dwrite d8/d11/f43 [0,4194304] 0 2024-09-21T11:39:05.586 INFO:tasks.workunit.client.1.smithi149.stdout:2/210: read - d8/da/d13/f2e zero size 2024-09-21T11:39:05.587 INFO:tasks.workunit.client.1.smithi149.stdout:5/190: mkdir d4/d1d/d3e 0 2024-09-21T11:39:05.590 INFO:tasks.workunit.client.1.smithi149.stdout:7/296: creat d12/d15/d26/d30/d31/d47/f59 x:0 0 0 2024-09-21T11:39:05.591 INFO:tasks.workunit.client.1.smithi149.stdout:9/172: unlink c12 0 2024-09-21T11:39:05.592 INFO:tasks.workunit.client.1.smithi149.stdout:9/173: fsync d18/d19/d1a/f2d 0 2024-09-21T11:39:05.592 INFO:tasks.workunit.client.1.smithi149.stdout:9/174: read fc [308108,129536] 0 2024-09-21T11:39:05.593 INFO:tasks.workunit.client.1.smithi149.stdout:9/175: dread - d18/d19/d1a/f26 zero size 2024-09-21T11:39:05.594 INFO:tasks.workunit.client.1.smithi149.stdout:9/176: chown c13 1065701 1 2024-09-21T11:39:05.595 INFO:tasks.workunit.client.1.smithi149.stdout:3/258: mknod d6/c65 0 2024-09-21T11:39:05.597 INFO:tasks.workunit.client.1.smithi149.stdout:4/221: symlink d4/d13/d10/d31/l52 0 2024-09-21T11:39:05.599 INFO:tasks.workunit.client.1.smithi149.stdout:2/211: mkdir d8/d44 0 2024-09-21T11:39:05.600 INFO:tasks.workunit.client.1.smithi149.stdout:8/184: link d3/dd/d3a/cc d3/dd/d18/c3e 0 2024-09-21T11:39:05.602 INFO:tasks.workunit.client.1.smithi149.stdout:5/191: creat d4/d7/d1a/d2a/f3f x:0 0 0 2024-09-21T11:39:05.603 INFO:tasks.workunit.client.1.smithi149.stdout:5/192: write d4/d7/d1a/f23 [1099302,80764] 0 2024-09-21T11:39:05.607 INFO:tasks.workunit.client.1.smithi149.stdout:9/177: mkdir d18/d19/d1a/d2f/d33 0 2024-09-21T11:39:05.608 INFO:tasks.workunit.client.1.smithi149.stdout:9/178: chown d18/d19/d27 1950556 1 2024-09-21T11:39:05.608 INFO:tasks.workunit.client.1.smithi149.stdout:9/179: readlink l15 0 2024-09-21T11:39:05.611 INFO:tasks.workunit.client.1.smithi149.stdout:3/259: rmdir d6/d1f 39 2024-09-21T11:39:05.613 INFO:tasks.workunit.client.1.smithi149.stdout:4/222: creat d4/d13/d15/d30/f53 x:0 0 0 2024-09-21T11:39:05.616 INFO:tasks.workunit.client.1.smithi149.stdout:3/260: dread d6/f56 [0,4194304] 0 2024-09-21T11:39:05.617 INFO:tasks.workunit.client.1.smithi149.stdout:7/297: dread d12/d15/f20 [0,4194304] 0 2024-09-21T11:39:05.620 INFO:tasks.workunit.client.1.smithi149.stdout:5/193: mkdir d4/d7/d40 0 2024-09-21T11:39:05.620 INFO:tasks.workunit.client.1.smithi149.stdout:1/191: dwrite d2/dd/d35/d1c/f29 [0,4194304] 0 2024-09-21T11:39:05.623 INFO:tasks.workunit.client.1.smithi149.stdout:9/180: write fc [4659792,83915] 0 2024-09-21T11:39:05.624 INFO:tasks.workunit.client.1.smithi149.stdout:4/223: creat d4/d13/d15/f54 x:0 0 0 2024-09-21T11:39:05.625 INFO:tasks.workunit.client.1.smithi149.stdout:2/212: rename d8/da/d13/c18 to d8/c45 0 2024-09-21T11:39:05.627 INFO:tasks.workunit.client.1.smithi149.stdout:2/213: truncate d8/d20/f40 166315 0 2024-09-21T11:39:05.638 INFO:tasks.workunit.client.1.smithi149.stdout:7/298: dwrite d12/f41 [0,4194304] 0 2024-09-21T11:39:05.638 INFO:tasks.workunit.client.1.smithi149.stdout:7/299: stat d12/f21 0 2024-09-21T11:39:05.664 INFO:tasks.workunit.client.1.smithi149.stdout:6/179: sync 2024-09-21T11:39:05.664 INFO:tasks.workunit.client.1.smithi149.stdout:0/148: sync 2024-09-21T11:39:05.767 INFO:tasks.workunit.client.1.smithi149.stdout:1/192: rename d2/l28 to d2/d5/d8/d3b/l3f 0 2024-09-21T11:39:05.769 INFO:tasks.workunit.client.1.smithi149.stdout:2/214: creat d8/f46 x:0 0 0 2024-09-21T11:39:05.771 INFO:tasks.workunit.client.1.smithi149.stdout:8/185: creat d3/dd/f3f x:0 0 0 2024-09-21T11:39:05.774 INFO:tasks.workunit.client.1.smithi149.stdout:0/149: truncate dd/d1a/d1b/f31 6130006 0 2024-09-21T11:39:05.779 INFO:tasks.workunit.client.1.smithi149.stdout:4/224: rename d4/d13/d10/f2b to d4/f55 0 2024-09-21T11:39:05.781 INFO:tasks.workunit.client.1.smithi149.stdout:6/180: dwrite d8/da/d14/f27 [0,4194304] 0 2024-09-21T11:39:05.781 INFO:tasks.workunit.client.1.smithi149.stdout:4/225: write d4/d13/d15/f54 [763000,70195] 0 2024-09-21T11:39:05.782 INFO:tasks.workunit.client.1.smithi149.stdout:4/226: write d4/d6/f47 [2527650,10483] 0 2024-09-21T11:39:05.785 INFO:tasks.workunit.client.1.smithi149.stdout:3/261: mknod d6/d1f/d47/c66 0 2024-09-21T11:39:05.785 INFO:tasks.workunit.client.1.smithi149.stdout:4/227: dread - d4/d13/d10/d31/d32/d4a/f50 zero size 2024-09-21T11:39:05.788 INFO:tasks.workunit.client.1.smithi149.stdout:9/181: symlink d18/d19/d1a/d2f/d32/l34 0 2024-09-21T11:39:05.788 INFO:tasks.workunit.client.1.smithi149.stdout:4/228: dread - d4/d6/d18/f4f zero size 2024-09-21T11:39:05.791 INFO:tasks.workunit.client.1.smithi149.stdout:7/300: rename d12/d15/d26/f4b to d12/d15/d26/d30/f5a 0 2024-09-21T11:39:05.793 INFO:tasks.workunit.client.1.smithi149.stdout:1/193: link d2/dd/d35/d1c/f38 d2/d5/d8/f40 0 2024-09-21T11:39:05.794 INFO:tasks.workunit.client.1.smithi149.stdout:1/194: stat d2/f2d 0 2024-09-21T11:39:05.795 INFO:tasks.workunit.client.1.smithi149.stdout:5/194: creat d4/d7/d1a/d2a/f41 x:0 0 0 2024-09-21T11:39:05.796 INFO:tasks.workunit.client.1.smithi149.stdout:6/181: dwrite d8/da/d11/f25 [0,4194304] 0 2024-09-21T11:39:05.796 INFO:tasks.workunit.client.1.smithi149.stdout:8/186: unlink d3/dd/f1b 0 2024-09-21T11:39:05.797 INFO:tasks.workunit.client.1.smithi149.stdout:8/187: stat d3/c36 0 2024-09-21T11:39:05.801 INFO:tasks.workunit.client.1.smithi149.stdout:0/150: dwrite dd/f23 [0,4194304] 0 2024-09-21T11:39:05.801 INFO:tasks.workunit.client.1.smithi149.stdout:3/262: write d6/d1f/d47/d37/f4b [641431,30547] 0 2024-09-21T11:39:05.802 INFO:tasks.workunit.client.1.smithi149.stdout:2/215: rename d8/d11/f43 to d8/d30/f47 0 2024-09-21T11:39:05.806 INFO:tasks.workunit.client.1.smithi149.stdout:1/195: rmdir d2/dd 39 2024-09-21T11:39:05.810 INFO:tasks.workunit.client.1.smithi149.stdout:5/195: truncate d4/d7/f25 4757566 0 2024-09-21T11:39:05.810 INFO:tasks.workunit.client.1.smithi149.stdout:8/188: dread d3/f8 [0,4194304] 0 2024-09-21T11:39:05.811 INFO:tasks.workunit.client.1.smithi149.stdout:4/229: write d4/f55 [2062187,90166] 0 2024-09-21T11:39:05.814 INFO:tasks.workunit.client.1.smithi149.stdout:6/182: dread d8/da/d11/f25 [0,4194304] 0 2024-09-21T11:39:05.815 INFO:tasks.workunit.client.1.smithi149.stdout:0/151: chown dd/d1a/d1b/c29 2521 1 2024-09-21T11:39:05.816 INFO:tasks.workunit.client.1.smithi149.stdout:2/216: stat d8/c45 0 2024-09-21T11:39:05.816 INFO:tasks.workunit.client.1.smithi149.stdout:3/263: creat d6/d1f/d47/d37/d3a/f67 x:0 0 0 2024-09-21T11:39:05.817 INFO:tasks.workunit.client.1.smithi149.stdout:2/217: fsync d8/da/d13/d1a/f3e 0 2024-09-21T11:39:05.821 INFO:tasks.workunit.client.1.smithi149.stdout:4/230: creat d4/d6/f56 x:0 0 0 2024-09-21T11:39:05.822 INFO:tasks.workunit.client.1.smithi149.stdout:1/196: dwrite d2/dd/f12 [0,4194304] 0 2024-09-21T11:39:05.825 INFO:tasks.workunit.client.1.smithi149.stdout:9/182: rename c2 to d18/d19/d1a/d2f/d33/c35 0 2024-09-21T11:39:05.827 INFO:tasks.workunit.client.1.smithi149.stdout:9/183: truncate d18/d19/d1a/f26 297252 0 2024-09-21T11:39:05.828 INFO:tasks.workunit.client.1.smithi149.stdout:2/218: creat d8/da/d13/d1a/f48 x:0 0 0 2024-09-21T11:39:05.828 INFO:tasks.workunit.client.1.smithi149.stdout:8/189: mknod d3/dd/c40 0 2024-09-21T11:39:05.829 INFO:tasks.workunit.client.1.smithi149.stdout:8/190: readlink d3/dd/d18/l2f 0 2024-09-21T11:39:05.830 INFO:tasks.workunit.client.1.smithi149.stdout:1/197: mkdir d2/dd/d35/d1c/d41 0 2024-09-21T11:39:05.833 INFO:tasks.workunit.client.1.smithi149.stdout:4/231: rename d4/d13/c25 to d4/d6/c57 0 2024-09-21T11:39:05.835 INFO:tasks.workunit.client.1.smithi149.stdout:5/196: write f2 [5384088,16318] 0 2024-09-21T11:39:05.835 INFO:tasks.workunit.client.1.smithi149.stdout:8/191: unlink d3/dd/d21/l2d 0 2024-09-21T11:39:05.836 INFO:tasks.workunit.client.1.smithi149.stdout:0/152: link lc dd/d32/l34 0 2024-09-21T11:39:05.838 INFO:tasks.workunit.client.1.smithi149.stdout:9/184: dwrite d18/d19/f20 [0,4194304] 0 2024-09-21T11:39:05.838 INFO:tasks.workunit.client.1.smithi149.stdout:1/198: creat d2/d5/d8/d3b/f42 x:0 0 0 2024-09-21T11:39:05.841 INFO:tasks.workunit.client.1.smithi149.stdout:2/219: symlink d8/da/d13/d1a/d3b/l49 0 2024-09-21T11:39:05.841 INFO:tasks.workunit.client.1.smithi149.stdout:4/232: mkdir d4/d4d/d58 0 2024-09-21T11:39:05.842 INFO:tasks.workunit.client.1.smithi149.stdout:5/197: stat d4/d7/cd 0 2024-09-21T11:39:05.843 INFO:tasks.workunit.client.1.smithi149.stdout:7/301: dwrite d12/d15/f32 [0,4194304] 0 2024-09-21T11:39:05.843 INFO:tasks.workunit.client.1.smithi149.stdout:8/192: symlink d3/d12/l41 0 2024-09-21T11:39:05.843 INFO:tasks.workunit.client.1.smithi149.stdout:3/264: getdents d6 0 2024-09-21T11:39:05.844 INFO:tasks.workunit.client.1.smithi149.stdout:4/233: write d4/f1f [597703,114268] 0 2024-09-21T11:39:05.844 INFO:tasks.workunit.client.1.smithi149.stdout:9/185: stat d18/d19/d1a/c1b 0 2024-09-21T11:39:05.846 INFO:tasks.workunit.client.1.smithi149.stdout:8/193: chown d3/dd/d18/c2b 1 1 2024-09-21T11:39:05.847 INFO:tasks.workunit.client.1.smithi149.stdout:8/194: chown d3/d12/f24 48 1 2024-09-21T11:39:05.847 INFO:tasks.workunit.client.1.smithi149.stdout:1/199: mknod d2/dd/d2e/c43 0 2024-09-21T11:39:05.848 INFO:tasks.workunit.client.1.smithi149.stdout:9/186: write d18/d19/d29/f2e [862257,39668] 0 2024-09-21T11:39:05.848 INFO:tasks.workunit.client.1.smithi149.stdout:0/153: mkdir dd/d35 0 2024-09-21T11:39:05.853 INFO:tasks.workunit.client.1.smithi149.stdout:7/302: unlink d12/d35/f46 0 2024-09-21T11:39:05.855 INFO:tasks.workunit.client.1.smithi149.stdout:1/200: dwrite d2/dd/d2e/f33 [0,4194304] 0 2024-09-21T11:39:05.857 INFO:tasks.workunit.client.1.smithi149.stdout:4/234: creat d4/d6/f59 x:0 0 0 2024-09-21T11:39:05.858 INFO:tasks.workunit.client.1.smithi149.stdout:1/201: chown d2/dd/d35/d1c/d2c 76433463 1 2024-09-21T11:39:05.858 INFO:tasks.workunit.client.1.smithi149.stdout:8/195: unlink d3/f8 0 2024-09-21T11:39:05.860 INFO:tasks.workunit.client.1.smithi149.stdout:1/202: write d2/dd/d35/d1c/f32 [1018696,119727] 0 2024-09-21T11:39:05.860 INFO:tasks.workunit.client.1.smithi149.stdout:9/187: mkdir d18/d36 0 2024-09-21T11:39:05.863 INFO:tasks.workunit.client.1.smithi149.stdout:2/220: symlink d8/d44/l4a 0 2024-09-21T11:39:05.865 INFO:tasks.workunit.client.1.smithi149.stdout:4/235: symlink d4/d4d/l5a 0 2024-09-21T11:39:05.866 INFO:tasks.workunit.client.1.smithi149.stdout:7/303: dread d12/d15/f45 [0,4194304] 0 2024-09-21T11:39:05.867 INFO:tasks.workunit.client.1.smithi149.stdout:8/196: mknod d3/dd/d21/c42 0 2024-09-21T11:39:05.869 INFO:tasks.workunit.client.1.smithi149.stdout:2/221: creat d8/da/d13/d1a/d2c/f4b x:0 0 0 2024-09-21T11:39:05.870 INFO:tasks.workunit.client.1.smithi149.stdout:0/154: creat dd/f36 x:0 0 0 2024-09-21T11:39:05.870 INFO:tasks.workunit.client.1.smithi149.stdout:7/304: mkdir d12/d5b 0 2024-09-21T11:39:05.871 INFO:tasks.workunit.client.1.smithi149.stdout:4/236: rename d4/f36 to d4/d13/d10/f5b 0 2024-09-21T11:39:05.872 INFO:tasks.workunit.client.1.smithi149.stdout:8/197: mknod d3/dd/d3a/c43 0 2024-09-21T11:39:05.873 INFO:tasks.workunit.client.1.smithi149.stdout:2/222: rmdir d8/dd 39 2024-09-21T11:39:05.874 INFO:tasks.workunit.client.1.smithi149.stdout:7/305: symlink d12/l5c 0 2024-09-21T11:39:05.875 INFO:tasks.workunit.client.1.smithi149.stdout:3/265: dwrite d6/d1f/f57 [0,4194304] 0 2024-09-21T11:39:05.876 INFO:tasks.workunit.client.1.smithi149.stdout:0/155: creat dd/d32/f37 x:0 0 0 2024-09-21T11:39:05.877 INFO:tasks.workunit.client.1.smithi149.stdout:2/223: rmdir d8/d30 39 2024-09-21T11:39:05.878 INFO:tasks.workunit.client.1.smithi149.stdout:8/198: mknod d3/dd/d3a/c44 0 2024-09-21T11:39:05.879 INFO:tasks.workunit.client.1.smithi149.stdout:4/237: rename d4/d13/d10/l21 to d4/d13/d2d/l5c 0 2024-09-21T11:39:05.879 INFO:tasks.workunit.client.1.smithi149.stdout:5/198: truncate d4/d7/d1a/f23 4127786 0 2024-09-21T11:39:05.880 INFO:tasks.workunit.client.1.smithi149.stdout:9/188: dwrite d18/d19/d1a/f23 [0,4194304] 0 2024-09-21T11:39:05.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/156: chown dd/d1a/d1b/c22 574191 1 2024-09-21T11:39:05.884 INFO:tasks.workunit.client.1.smithi149.stdout:2/224: creat d8/dd/f4c x:0 0 0 2024-09-21T11:39:05.889 INFO:tasks.workunit.client.1.smithi149.stdout:3/266: dread d6/d1f/d27/f3c [0,4194304] 0 2024-09-21T11:39:05.889 INFO:tasks.workunit.client.1.smithi149.stdout:0/157: chown dd/l25 211307599 1 2024-09-21T11:39:05.891 INFO:tasks.workunit.client.1.smithi149.stdout:9/189: dread d18/d19/f25 [0,4194304] 0 2024-09-21T11:39:05.891 INFO:tasks.workunit.client.1.smithi149.stdout:3/267: dread - d6/d1f/d27/f33 zero size 2024-09-21T11:39:05.892 INFO:tasks.workunit.client.1.smithi149.stdout:4/238: rename d4/d13/d10/d31/d32/d3a to d4/d13/d15/d16/d23/d5d 0 2024-09-21T11:39:05.892 INFO:tasks.workunit.client.1.smithi149.stdout:1/203: truncate d2/dd/d35/d1c/f32 374925 0 2024-09-21T11:39:05.894 INFO:tasks.workunit.client.1.smithi149.stdout:5/199: creat d4/d7/d40/f42 x:0 0 0 2024-09-21T11:39:05.895 INFO:tasks.workunit.client.1.smithi149.stdout:2/225: symlink d8/da/d13/l4d 0 2024-09-21T11:39:05.898 INFO:tasks.workunit.client.1.smithi149.stdout:0/158: unlink dd/d32/f33 0 2024-09-21T11:39:05.901 INFO:tasks.workunit.client.1.smithi149.stdout:8/199: link d3/dd/d3a/c44 d3/d33/c45 0 2024-09-21T11:39:05.902 INFO:tasks.workunit.client.1.smithi149.stdout:4/239: dwrite d4/d6/f59 [0,4194304] 0 2024-09-21T11:39:05.902 INFO:tasks.workunit.client.1.smithi149.stdout:2/226: rename d8/dd/c17 to d8/d11/c4e 0 2024-09-21T11:39:05.902 INFO:tasks.workunit.client.1.smithi149.stdout:1/204: write d2/d5/d8/d3b/f3e [1223455,13975] 0 2024-09-21T11:39:05.903 INFO:tasks.workunit.client.1.smithi149.stdout:3/268: mknod d6/d1f/d4c/c68 0 2024-09-21T11:39:05.906 INFO:tasks.workunit.client.1.smithi149.stdout:0/159: stat dd/d1a/c1e 0 2024-09-21T11:39:05.906 INFO:tasks.workunit.client.1.smithi149.stdout:5/200: dread d4/d7/d1a/d2a/f33 [0,4194304] 0 2024-09-21T11:39:05.909 INFO:tasks.workunit.client.1.smithi149.stdout:4/240: fdatasync d4/d6/fb 0 2024-09-21T11:39:05.909 INFO:tasks.workunit.client.1.smithi149.stdout:8/200: mknod d3/dd/d3a/c46 0 2024-09-21T11:39:05.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/227: symlink d8/da/d13/d1a/d29/l4f 0 2024-09-21T11:39:05.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/228: chown d8/da/d13 11570 1 2024-09-21T11:39:05.914 INFO:tasks.workunit.client.1.smithi149.stdout:5/201: write d4/f2f [906420,127974] 0 2024-09-21T11:39:05.914 INFO:tasks.workunit.client.1.smithi149.stdout:3/269: rmdir d6/d1f/d47/d37/d3f 39 2024-09-21T11:39:05.916 INFO:tasks.workunit.client.1.smithi149.stdout:3/270: chown d6/d1f/d27/f3c 2183 1 2024-09-21T11:39:05.917 INFO:tasks.workunit.client.1.smithi149.stdout:3/271: dread - d6/d1f/f2e zero size 2024-09-21T11:39:05.917 INFO:tasks.workunit.client.1.smithi149.stdout:4/241: rmdir d4/d13/d10 39 2024-09-21T11:39:05.918 INFO:tasks.workunit.client.1.smithi149.stdout:9/190: link d18/d19/d1a/d2f/d33/c35 d18/d36/c37 0 2024-09-21T11:39:05.919 INFO:tasks.workunit.client.1.smithi149.stdout:4/242: readlink d4/d6/l51 0 2024-09-21T11:39:05.919 INFO:tasks.workunit.client.1.smithi149.stdout:2/229: dread d8/da/f28 [4194304,4194304] 0 2024-09-21T11:39:05.920 INFO:tasks.workunit.client.1.smithi149.stdout:9/191: chown d18/d19/f20 38265 1 2024-09-21T11:39:05.921 INFO:tasks.workunit.client.1.smithi149.stdout:3/272: unlink d6/d1f/d47/f53 0 2024-09-21T11:39:05.921 INFO:tasks.workunit.client.1.smithi149.stdout:5/202: getdents d4/d1d/d3e 0 2024-09-21T11:39:05.923 INFO:tasks.workunit.client.1.smithi149.stdout:2/230: stat d8/d11/c4e 0 2024-09-21T11:39:05.925 INFO:tasks.workunit.client.1.smithi149.stdout:9/192: creat d18/d19/d1a/d2f/f38 x:0 0 0 2024-09-21T11:39:05.925 INFO:tasks.workunit.client.1.smithi149.stdout:8/201: getdents d3/dd/d18/d2e 0 2024-09-21T11:39:05.925 INFO:tasks.workunit.client.1.smithi149.stdout:0/160: dwrite dd/f15 [4194304,4194304] 0 2024-09-21T11:39:05.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/205: truncate d2/dd/f12 1625175 0 2024-09-21T11:39:05.928 INFO:tasks.workunit.client.1.smithi149.stdout:2/231: mkdir d8/dd/d50 0 2024-09-21T11:39:05.929 INFO:tasks.workunit.client.1.smithi149.stdout:9/193: write fc [4624305,96691] 0 2024-09-21T11:39:05.930 INFO:tasks.workunit.client.1.smithi149.stdout:8/202: creat d3/d33/f47 x:0 0 0 2024-09-21T11:39:05.933 INFO:tasks.workunit.client.1.smithi149.stdout:3/273: rename d6/c65 to d6/d1f/d47/d37/d3f/c69 0 2024-09-21T11:39:05.933 INFO:tasks.workunit.client.1.smithi149.stdout:8/203: truncate d3/dd/d3a/f3d 648863 0 2024-09-21T11:39:05.935 INFO:tasks.workunit.client.1.smithi149.stdout:9/194: fdatasync f16 0 2024-09-21T11:39:05.935 INFO:tasks.workunit.client.1.smithi149.stdout:2/232: write d8/da/d13/d2d/f34 [592307,80828] 0 2024-09-21T11:39:05.940 INFO:tasks.workunit.client.1.smithi149.stdout:5/203: dwrite d4/d7/fa [0,4194304] 0 2024-09-21T11:39:05.940 INFO:tasks.workunit.client.1.smithi149.stdout:2/233: chown d8/da/f39 128121 1 2024-09-21T11:39:05.946 INFO:tasks.workunit.client.1.smithi149.stdout:1/206: write d2/d5/d8/f40 [990822,98704] 0 2024-09-21T11:39:05.946 INFO:tasks.workunit.client.1.smithi149.stdout:9/195: rename d18/d19/d27 to d18/d19/d29/d39 0 2024-09-21T11:39:05.947 INFO:tasks.workunit.client.1.smithi149.stdout:5/204: mkdir d4/d7/d40/d43 0 2024-09-21T11:39:05.949 INFO:tasks.workunit.client.1.smithi149.stdout:9/196: unlink d18/d19/d29/f2e 0 2024-09-21T11:39:05.954 INFO:tasks.workunit.client.1.smithi149.stdout:9/197: readlink lb 0 2024-09-21T11:39:05.955 INFO:tasks.workunit.client.1.smithi149.stdout:2/234: link d8/dd/f2b d8/da/d13/d1a/d3b/f51 0 2024-09-21T11:39:05.958 INFO:tasks.workunit.client.1.smithi149.stdout:1/207: dwrite d2/dd/f30 [0,4194304] 0 2024-09-21T11:39:05.958 INFO:tasks.workunit.client.1.smithi149.stdout:9/198: symlink d18/l3a 0 2024-09-21T11:39:05.958 INFO:tasks.workunit.client.1.smithi149.stdout:0/161: dwrite dd/f19 [0,4194304] 0 2024-09-21T11:39:05.961 INFO:tasks.workunit.client.1.smithi149.stdout:0/162: chown dd/d1a/d1b 2012 1 2024-09-21T11:39:05.962 INFO:tasks.workunit.client.1.smithi149.stdout:9/199: chown d18/d19/d1a/d2f/d30 50091 1 2024-09-21T11:39:05.962 INFO:tasks.workunit.client.1.smithi149.stdout:9/200: chown d18/d19/d1a 0 1 2024-09-21T11:39:05.963 INFO:tasks.workunit.client.1.smithi149.stdout:2/235: creat d8/da/d13/d1a/f52 x:0 0 0 2024-09-21T11:39:05.964 INFO:tasks.workunit.client.1.smithi149.stdout:5/205: getdents d4/d1d 0 2024-09-21T11:39:05.965 INFO:tasks.workunit.client.1.smithi149.stdout:0/163: mkdir dd/d32/d38 0 2024-09-21T11:39:05.967 INFO:tasks.workunit.client.1.smithi149.stdout:8/204: truncate d3/f37 2542147 0 2024-09-21T11:39:05.967 INFO:tasks.workunit.client.1.smithi149.stdout:9/201: fdatasync f0 0 2024-09-21T11:39:05.967 INFO:tasks.workunit.client.1.smithi149.stdout:0/164: rename dd/d1a to dd/d1a/d39 22 2024-09-21T11:39:05.969 INFO:tasks.workunit.client.1.smithi149.stdout:3/274: link d6/d1f/d47/d37/f4b d6/d1f/d27/f6a 0 2024-09-21T11:39:05.969 INFO:tasks.workunit.client.1.smithi149.stdout:0/165: fsync dd/f36 0 2024-09-21T11:39:05.972 INFO:tasks.workunit.client.1.smithi149.stdout:9/202: write d18/d19/d1a/d2f/f38 [576224,79382] 0 2024-09-21T11:39:05.972 INFO:tasks.workunit.client.1.smithi149.stdout:6/183: sync 2024-09-21T11:39:05.973 INFO:tasks.workunit.client.1.smithi149.stdout:5/206: mknod d4/d7/d40/d43/c44 0 2024-09-21T11:39:05.974 INFO:tasks.workunit.client.1.smithi149.stdout:1/208: dwrite d2/f4 [4194304,4194304] 0 2024-09-21T11:39:05.974 INFO:tasks.workunit.client.1.smithi149.stdout:8/205: mknod d3/d12/c48 0 2024-09-21T11:39:05.976 INFO:tasks.workunit.client.1.smithi149.stdout:9/203: chown d18/d1c/c28 11442 1 2024-09-21T11:39:05.977 INFO:tasks.workunit.client.1.smithi149.stdout:9/204: readlink d18/l1e 0 2024-09-21T11:39:05.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/236: mkdir d8/da/d13/d53 0 2024-09-21T11:39:05.980 INFO:tasks.workunit.client.1.smithi149.stdout:2/237: dread - d8/dd/f38 zero size 2024-09-21T11:39:05.984 INFO:tasks.workunit.client.1.smithi149.stdout:3/275: unlink d6/f2a 0 2024-09-21T11:39:05.984 INFO:tasks.workunit.client.1.smithi149.stdout:0/166: mkdir dd/d32/d38/d3a 0 2024-09-21T11:39:05.986 INFO:tasks.workunit.client.1.smithi149.stdout:9/205: symlink d18/d19/d29/d39/l3b 0 2024-09-21T11:39:05.986 INFO:tasks.workunit.client.1.smithi149.stdout:6/184: dread d8/da/d11/f25 [0,4194304] 0 2024-09-21T11:39:05.986 INFO:tasks.workunit.client.1.smithi149.stdout:1/209: creat d2/dd/d35/d1c/d37/f44 x:0 0 0 2024-09-21T11:39:05.987 INFO:tasks.workunit.client.1.smithi149.stdout:8/206: getdents d3/dd/d18/d2e 0 2024-09-21T11:39:05.987 INFO:tasks.workunit.client.1.smithi149.stdout:2/238: rename d8/d11/c19 to d8/da/d13/d1a/c54 0 2024-09-21T11:39:05.989 INFO:tasks.workunit.client.1.smithi149.stdout:1/210: write d2/f20 [1417462,122012] 0 2024-09-21T11:39:05.991 INFO:tasks.workunit.client.1.smithi149.stdout:2/239: write d8/da/d13/d1a/d2c/f41 [544285,115932] 0 2024-09-21T11:39:05.992 INFO:tasks.workunit.client.1.smithi149.stdout:6/185: symlink d8/da/d2c/l35 0 2024-09-21T11:39:05.994 INFO:tasks.workunit.client.1.smithi149.stdout:0/167: symlink dd/d2d/l3b 0 2024-09-21T11:39:05.995 INFO:tasks.workunit.client.1.smithi149.stdout:6/186: chown d8/da/d14/d18/d28/d2f 946 1 2024-09-21T11:39:05.996 INFO:tasks.workunit.client.1.smithi149.stdout:3/276: truncate d6/d1f/d47/d22/f4f 4564529 0 2024-09-21T11:39:05.998 INFO:tasks.workunit.client.1.smithi149.stdout:5/207: link d4/d7/f27 d4/d7/f45 0 2024-09-21T11:39:06.002 INFO:tasks.workunit.client.1.smithi149.stdout:9/206: dwrite d18/d19/d1a/f26 [0,4194304] 0 2024-09-21T11:39:06.002 INFO:tasks.workunit.client.1.smithi149.stdout:2/240: dread d8/dd/f2b [0,4194304] 0 2024-09-21T11:39:06.005 INFO:tasks.workunit.client.1.smithi149.stdout:5/208: rename c1 to d4/d1d/c46 0 2024-09-21T11:39:06.008 INFO:tasks.workunit.client.1.smithi149.stdout:1/211: rmdir d2/d5/d8/d3a 0 2024-09-21T11:39:06.009 INFO:tasks.workunit.client.1.smithi149.stdout:0/168: dwrite dd/fe [0,4194304] 0 2024-09-21T11:39:06.009 INFO:tasks.workunit.client.1.smithi149.stdout:3/277: dread d6/d1f/d47/f1e [4194304,4194304] 0 2024-09-21T11:39:06.010 INFO:tasks.workunit.client.1.smithi149.stdout:0/169: write dd/d1a/f2c [905426,129344] 0 2024-09-21T11:39:06.011 INFO:tasks.workunit.client.1.smithi149.stdout:8/207: getdents d3/dd/d21 0 2024-09-21T11:39:06.015 INFO:tasks.workunit.client.1.smithi149.stdout:9/207: rename d18/d19/d1a/d2f/d32 to d18/d36/d3c 0 2024-09-21T11:39:06.015 INFO:tasks.workunit.client.1.smithi149.stdout:8/208: truncate d3/dd/f3f 693787 0 2024-09-21T11:39:06.017 INFO:tasks.workunit.client.1.smithi149.stdout:3/278: creat d6/d1f/d47/d37/d3a/f6b x:0 0 0 2024-09-21T11:39:06.018 INFO:tasks.workunit.client.1.smithi149.stdout:0/170: creat dd/d32/f3c x:0 0 0 2024-09-21T11:39:06.018 INFO:tasks.workunit.client.1.smithi149.stdout:6/187: link d8/da/d14/d18/f19 d8/da/d14/d18/f36 0 2024-09-21T11:39:06.019 INFO:tasks.workunit.client.1.smithi149.stdout:8/209: creat d3/dd/d18/f49 x:0 0 0 2024-09-21T11:39:06.020 INFO:tasks.workunit.client.1.smithi149.stdout:5/209: symlink d4/d1d/d3e/l47 0 2024-09-21T11:39:06.021 INFO:tasks.workunit.client.1.smithi149.stdout:9/208: creat d18/d19/d1a/d2f/f3d x:0 0 0 2024-09-21T11:39:06.021 INFO:tasks.workunit.client.1.smithi149.stdout:1/212: mknod d2/d2b/c45 0 2024-09-21T11:39:06.022 INFO:tasks.workunit.client.1.smithi149.stdout:3/279: readlink d6/l3d 0 2024-09-21T11:39:06.022 INFO:tasks.workunit.client.1.smithi149.stdout:2/241: creat d8/da/f55 x:0 0 0 2024-09-21T11:39:06.024 INFO:tasks.workunit.client.1.smithi149.stdout:6/188: write d8/da/d11/f26 [508059,3495] 0 2024-09-21T11:39:06.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/210: symlink d4/d7/d40/d43/l48 0 2024-09-21T11:39:06.025 INFO:tasks.workunit.client.1.smithi149.stdout:1/213: rmdir d2/dd 39 2024-09-21T11:39:06.026 INFO:tasks.workunit.client.1.smithi149.stdout:2/242: creat d8/dd/f56 x:0 0 0 2024-09-21T11:39:06.027 INFO:tasks.workunit.client.1.smithi149.stdout:8/210: symlink d3/l4a 0 2024-09-21T11:39:06.027 INFO:tasks.workunit.client.1.smithi149.stdout:9/209: symlink d18/d19/d1a/d2f/d30/l3e 0 2024-09-21T11:39:06.028 INFO:tasks.workunit.client.1.smithi149.stdout:5/211: mkdir d4/d7/d40/d43/d49 0 2024-09-21T11:39:06.030 INFO:tasks.workunit.client.1.smithi149.stdout:1/214: chown d2/dd/d35/d1c/d2c 4156196 1 2024-09-21T11:39:06.030 INFO:tasks.workunit.client.1.smithi149.stdout:8/211: mknod d3/d33/c4b 0 2024-09-21T11:39:06.031 INFO:tasks.workunit.client.1.smithi149.stdout:9/210: dread f16 [0,4194304] 0 2024-09-21T11:39:06.036 INFO:tasks.workunit.client.1.smithi149.stdout:6/189: dwrite d8/da/d11/f26 [0,4194304] 0 2024-09-21T11:39:06.039 INFO:tasks.workunit.client.1.smithi149.stdout:2/243: dwrite d8/d11/f3a [0,4194304] 0 2024-09-21T11:39:06.041 INFO:tasks.workunit.client.1.smithi149.stdout:5/212: dread d4/d7/f38 [0,4194304] 0 2024-09-21T11:39:06.053 INFO:tasks.workunit.client.1.smithi149.stdout:0/171: dread dd/d1a/d1b/f31 [0,4194304] 0 2024-09-21T11:39:06.056 INFO:tasks.workunit.client.1.smithi149.stdout:5/213: dread d4/f9 [0,4194304] 0 2024-09-21T11:39:06.057 INFO:tasks.workunit.client.1.smithi149.stdout:2/244: dwrite d8/dd/f56 [0,4194304] 0 2024-09-21T11:39:06.059 INFO:tasks.workunit.client.1.smithi149.stdout:2/245: write d8/da/d13/d1a/d2c/f2f [7998748,95195] 0 2024-09-21T11:39:06.095 INFO:tasks.workunit.client.1.smithi149.stdout:9/211: creat d18/d36/d3c/f3f x:0 0 0 2024-09-21T11:39:06.095 INFO:tasks.workunit.client.1.smithi149.stdout:9/212: stat d18/d19/d1a/d2f/d30 0 2024-09-21T11:39:06.101 INFO:tasks.workunit.client.1.smithi149.stdout:9/213: dwrite fc [4194304,4194304] 0 2024-09-21T11:39:06.103 INFO:tasks.workunit.client.1.smithi149.stdout:8/212: mkdir d3/d3c/d4c 0 2024-09-21T11:39:06.105 INFO:tasks.workunit.client.1.smithi149.stdout:8/213: read - d3/dd/d18/f49 zero size 2024-09-21T11:39:06.106 INFO:tasks.workunit.client.1.smithi149.stdout:0/172: symlink dd/d35/l3d 0 2024-09-21T11:39:06.107 INFO:tasks.workunit.client.1.smithi149.stdout:5/214: symlink d4/d7/d1a/l4a 0 2024-09-21T11:39:06.111 INFO:tasks.workunit.client.1.smithi149.stdout:5/215: write d4/d7/d1a/d2a/f33 [3551216,102075] 0 2024-09-21T11:39:06.111 INFO:tasks.workunit.client.1.smithi149.stdout:2/246: rename d8/d30 to d8/d20/d57 0 2024-09-21T11:39:06.114 INFO:tasks.workunit.client.1.smithi149.stdout:0/173: dread f8 [0,4194304] 0 2024-09-21T11:39:06.114 INFO:tasks.workunit.client.1.smithi149.stdout:7/306: sync 2024-09-21T11:39:06.118 INFO:tasks.workunit.client.1.smithi149.stdout:6/190: getdents d8/da 0 2024-09-21T11:39:06.120 INFO:tasks.workunit.client.1.smithi149.stdout:1/215: write d2/d5/d8/fa [835664,66910] 0 2024-09-21T11:39:06.120 INFO:tasks.workunit.client.1.smithi149.stdout:8/214: truncate d3/f1d 464114 0 2024-09-21T11:39:06.121 INFO:tasks.workunit.client.1.smithi149.stdout:8/215: fsync d3/f17 0 2024-09-21T11:39:06.122 INFO:tasks.workunit.client.1.smithi149.stdout:7/307: mknod d12/c5d 0 2024-09-21T11:39:06.123 INFO:tasks.workunit.client.1.smithi149.stdout:9/214: creat d18/d19/f40 x:0 0 0 2024-09-21T11:39:06.123 INFO:tasks.workunit.client.1.smithi149.stdout:6/191: dread d8/da/d14/f2a [0,4194304] 0 2024-09-21T11:39:06.125 INFO:tasks.workunit.client.1.smithi149.stdout:7/308: write d12/d15/d26/d30/f4e [34632,105671] 0 2024-09-21T11:39:06.127 INFO:tasks.workunit.client.1.smithi149.stdout:7/309: write d12/d15/d26/d30/d31/f3f [5146661,77786] 0 2024-09-21T11:39:06.129 INFO:tasks.workunit.client.1.smithi149.stdout:1/216: dwrite d2/dd/d35/d1c/f29 [0,4194304] 0 2024-09-21T11:39:06.129 INFO:tasks.workunit.client.1.smithi149.stdout:9/215: symlink d18/d1c/l41 0 2024-09-21T11:39:06.130 INFO:tasks.workunit.client.1.smithi149.stdout:6/192: fsync d8/da/f1a 0 2024-09-21T11:39:06.131 INFO:tasks.workunit.client.1.smithi149.stdout:2/247: link d8/dd/f1d d8/da/d13/d1a/d29/f58 0 2024-09-21T11:39:06.133 INFO:tasks.workunit.client.1.smithi149.stdout:4/243: sync 2024-09-21T11:39:06.133 INFO:tasks.workunit.client.1.smithi149.stdout:3/280: sync 2024-09-21T11:39:06.137 INFO:tasks.workunit.client.1.smithi149.stdout:1/217: symlink d2/dd/d2e/l46 0 2024-09-21T11:39:06.137 INFO:tasks.workunit.client.1.smithi149.stdout:1/218: read - d2/f2d zero size 2024-09-21T11:39:06.138 INFO:tasks.workunit.client.1.smithi149.stdout:2/248: dwrite d8/d11/f3d [0,4194304] 0 2024-09-21T11:39:06.138 INFO:tasks.workunit.client.1.smithi149.stdout:9/216: mknod d18/d19/d1a/d2f/c42 0 2024-09-21T11:39:06.139 INFO:tasks.workunit.client.1.smithi149.stdout:5/216: write d4/d7/f45 [292012,80942] 0 2024-09-21T11:39:06.142 INFO:tasks.workunit.client.1.smithi149.stdout:0/174: rename dd/d32/l34 to dd/l3e 0 2024-09-21T11:39:06.142 INFO:tasks.workunit.client.1.smithi149.stdout:1/219: write d2/d5/d8/d3b/f3e [2885685,84089] 0 2024-09-21T11:39:06.142 INFO:tasks.workunit.client.1.smithi149.stdout:2/249: write d8/d20/f40 [198036,130033] 0 2024-09-21T11:39:06.143 INFO:tasks.workunit.client.1.smithi149.stdout:4/244: creat d4/d6/f5e x:0 0 0 2024-09-21T11:39:06.144 INFO:tasks.workunit.client.1.smithi149.stdout:8/216: link d3/d12/f15 d3/dd/d21/f4d 0 2024-09-21T11:39:06.147 INFO:tasks.workunit.client.1.smithi149.stdout:0/175: fsync dd/f23 0 2024-09-21T11:39:06.148 INFO:tasks.workunit.client.1.smithi149.stdout:1/220: fdatasync d2/d5/d8/fa 0 2024-09-21T11:39:06.148 INFO:tasks.workunit.client.1.smithi149.stdout:8/217: write d3/dd/f3f [1358364,100988] 0 2024-09-21T11:39:06.149 INFO:tasks.workunit.client.1.smithi149.stdout:9/217: mkdir d18/d19/d1a/d2f/d43 0 2024-09-21T11:39:06.150 INFO:tasks.workunit.client.1.smithi149.stdout:0/176: truncate dd/fe 5326127 0 2024-09-21T11:39:06.150 INFO:tasks.workunit.client.1.smithi149.stdout:1/221: stat d2/d5/d8/d3b 0 2024-09-21T11:39:06.151 INFO:tasks.workunit.client.1.smithi149.stdout:7/310: rename d12/d15/d26/d30/d31/d47/d49/f58 to d12/d15/d4a/d4f/f5e 0 2024-09-21T11:39:06.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/218: read d18/d19/d1a/f23 [2168578,3308] 0 2024-09-21T11:39:06.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/219: fdatasync fc 0 2024-09-21T11:39:06.152 INFO:tasks.workunit.client.1.smithi149.stdout:9/220: readlink d18/d1c/l41 0 2024-09-21T11:39:06.153 INFO:tasks.workunit.client.1.smithi149.stdout:9/221: write d18/f2a [8494353,35103] 0 2024-09-21T11:39:06.153 INFO:tasks.workunit.client.1.smithi149.stdout:4/245: mkdir d4/d4d/d5f 0 2024-09-21T11:39:06.154 INFO:tasks.workunit.client.1.smithi149.stdout:4/246: write d4/d4d/f45 [546517,129565] 0 2024-09-21T11:39:06.155 INFO:tasks.workunit.client.1.smithi149.stdout:0/177: read dd/f15 [3304771,114341] 0 2024-09-21T11:39:06.156 INFO:tasks.workunit.client.1.smithi149.stdout:0/178: chown dd/d1a/d1b/c22 3787096 1 2024-09-21T11:39:06.165 INFO:tasks.workunit.client.1.smithi149.stdout:7/311: readlink d12/d15/l2b 0 2024-09-21T11:39:06.166 INFO:tasks.workunit.client.1.smithi149.stdout:6/193: rename d8/da/d14/d18 to d8/d32/d37 0 2024-09-21T11:39:06.167 INFO:tasks.workunit.client.1.smithi149.stdout:6/194: chown d8/da/d11/c22 7 1 2024-09-21T11:39:06.169 INFO:tasks.workunit.client.1.smithi149.stdout:9/222: symlink d18/l44 0 2024-09-21T11:39:06.172 INFO:tasks.workunit.client.1.smithi149.stdout:0/179: unlink dd/d35/l3d 0 2024-09-21T11:39:06.176 INFO:tasks.workunit.client.1.smithi149.stdout:8/218: symlink d3/l4e 0 2024-09-21T11:39:06.178 INFO:tasks.workunit.client.1.smithi149.stdout:7/312: dread d12/f48 [0,4194304] 0 2024-09-21T11:39:06.179 INFO:tasks.workunit.client.1.smithi149.stdout:0/180: dwrite dd/f36 [0,4194304] 0 2024-09-21T11:39:06.187 INFO:tasks.workunit.client.1.smithi149.stdout:7/313: dwrite d12/d15/d26/d30/d31/f37 [0,4194304] 0 2024-09-21T11:39:06.188 INFO:tasks.workunit.client.1.smithi149.stdout:7/314: fsync d12/d15/d4a/d4f/f54 0 2024-09-21T11:39:06.189 INFO:tasks.workunit.client.1.smithi149.stdout:6/195: mknod d8/d32/d37/d28/c38 0 2024-09-21T11:39:06.189 INFO:tasks.workunit.client.1.smithi149.stdout:7/315: fdatasync d12/d15/d4a/d4f/f54 0 2024-09-21T11:39:06.190 INFO:tasks.workunit.client.1.smithi149.stdout:2/250: write d8/da/d13/d1a/d29/f32 [1287253,80098] 0 2024-09-21T11:39:06.192 INFO:tasks.workunit.client.1.smithi149.stdout:4/247: link d4/d13/d15/d16/f33 d4/d13/d15/d16/d23/f60 0 2024-09-21T11:39:06.194 INFO:tasks.workunit.client.1.smithi149.stdout:7/316: write d12/d15/d26/f2e [4512240,57337] 0 2024-09-21T11:39:06.198 INFO:tasks.workunit.client.1.smithi149.stdout:5/217: rename d4/d7/f25 to d4/d7/d40/d43/d49/f4b 0 2024-09-21T11:39:06.198 INFO:tasks.workunit.client.1.smithi149.stdout:1/222: write d2/dd/d35/d1c/f32 [469983,6427] 0 2024-09-21T11:39:06.199 INFO:tasks.workunit.client.1.smithi149.stdout:0/181: rename dd/d1a to dd/d1a/d3f 22 2024-09-21T11:39:06.200 INFO:tasks.workunit.client.1.smithi149.stdout:0/182: read dd/d1a/f2c [718173,82716] 0 2024-09-21T11:39:06.201 INFO:tasks.workunit.client.1.smithi149.stdout:6/196: creat d8/f39 x:0 0 0 2024-09-21T11:39:06.202 INFO:tasks.workunit.client.1.smithi149.stdout:6/197: write d8/da/fd [3759062,62948] 0 2024-09-21T11:39:06.205 INFO:tasks.workunit.client.1.smithi149.stdout:5/218: fsync d4/d7/f27 0 2024-09-21T11:39:06.209 INFO:tasks.workunit.client.1.smithi149.stdout:0/183: mknod dd/d35/c40 0 2024-09-21T11:39:06.212 INFO:tasks.workunit.client.1.smithi149.stdout:0/184: dread f8 [0,4194304] 0 2024-09-21T11:39:06.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/248: creat d4/d13/d10/d31/d32/d4a/f61 x:0 0 0 2024-09-21T11:39:06.216 INFO:tasks.workunit.client.1.smithi149.stdout:8/219: dwrite d3/f20 [0,4194304] 0 2024-09-21T11:39:06.220 INFO:tasks.workunit.client.1.smithi149.stdout:1/223: mknod d2/dd/d35/d1c/d41/c47 0 2024-09-21T11:39:06.222 INFO:tasks.workunit.client.1.smithi149.stdout:5/219: symlink d4/d7/d1a/d2a/l4c 0 2024-09-21T11:39:06.224 INFO:tasks.workunit.client.1.smithi149.stdout:8/220: dread d3/dd/f3f [0,4194304] 0 2024-09-21T11:39:06.224 INFO:tasks.workunit.client.1.smithi149.stdout:2/251: creat d8/f59 x:0 0 0 2024-09-21T11:39:06.229 INFO:tasks.workunit.client.1.smithi149.stdout:7/317: rename d12/d15/d26/d30/f4e to d12/d15/f5f 0 2024-09-21T11:39:06.232 INFO:tasks.workunit.client.1.smithi149.stdout:5/220: rename d4/d7/d1a/d2a/f33 to d4/d7/d1a/d2a/f4d 0 2024-09-21T11:39:06.233 INFO:tasks.workunit.client.1.smithi149.stdout:0/185: symlink dd/d32/d38/d3a/l41 0 2024-09-21T11:39:06.233 INFO:tasks.workunit.client.1.smithi149.stdout:8/221: rmdir d3/d12 39 2024-09-21T11:39:06.233 INFO:tasks.workunit.client.1.smithi149.stdout:7/318: chown d12/d15/f5f 2512 1 2024-09-21T11:39:06.234 INFO:tasks.workunit.client.1.smithi149.stdout:1/224: dwrite d2/d5/d8/d3b/f42 [0,4194304] 0 2024-09-21T11:39:06.237 INFO:tasks.workunit.client.1.smithi149.stdout:7/319: chown d12/l23 283446973 1 2024-09-21T11:39:06.237 INFO:tasks.workunit.client.1.smithi149.stdout:1/225: readlink d2/d5/d3d/l36 0 2024-09-21T11:39:06.237 INFO:tasks.workunit.client.1.smithi149.stdout:2/252: dread d8/d11/f3d [0,4194304] 0 2024-09-21T11:39:06.237 INFO:tasks.workunit.client.1.smithi149.stdout:6/198: dwrite d8/da/d14/f27 [0,4194304] 0 2024-09-21T11:39:06.240 INFO:tasks.workunit.client.1.smithi149.stdout:1/226: write d2/dd/d35/d1c/f29 [146319,117571] 0 2024-09-21T11:39:06.241 INFO:tasks.workunit.client.1.smithi149.stdout:2/253: truncate d8/f1c 2249038 0 2024-09-21T11:39:06.243 INFO:tasks.workunit.client.1.smithi149.stdout:2/254: stat d8/da/d13/d1a/d29/l4f 0 2024-09-21T11:39:06.245 INFO:tasks.workunit.client.1.smithi149.stdout:2/255: stat d8/da/d13/d2d/f34 0 2024-09-21T11:39:06.245 INFO:tasks.workunit.client.1.smithi149.stdout:0/186: write f8 [6210613,19733] 0 2024-09-21T11:39:06.254 INFO:tasks.workunit.client.1.smithi149.stdout:7/320: creat d12/d15/d26/d30/d31/f60 x:0 0 0 2024-09-21T11:39:06.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/227: creat d2/d5/d8/f48 x:0 0 0 2024-09-21T11:39:06.260 INFO:tasks.workunit.client.1.smithi149.stdout:0/187: creat dd/d32/d38/f42 x:0 0 0 2024-09-21T11:39:06.261 INFO:tasks.workunit.client.1.smithi149.stdout:0/188: dread - dd/d1a/f2e zero size 2024-09-21T11:39:06.261 INFO:tasks.workunit.client.1.smithi149.stdout:0/189: chown dd/d35/c40 31514 1 2024-09-21T11:39:06.261 INFO:tasks.workunit.client.1.smithi149.stdout:5/221: truncate d4/d7/d1a/f23 2851464 0 2024-09-21T11:39:06.262 INFO:tasks.workunit.client.1.smithi149.stdout:5/222: truncate d4/f5 2010388 0 2024-09-21T11:39:06.264 INFO:tasks.workunit.client.1.smithi149.stdout:4/249: getdents d4/d13/d2d 0 2024-09-21T11:39:06.266 INFO:tasks.workunit.client.1.smithi149.stdout:7/321: rename d12/f18 to d12/d5b/f61 0 2024-09-21T11:39:06.271 INFO:tasks.workunit.client.1.smithi149.stdout:0/190: creat dd/d2d/f43 x:0 0 0 2024-09-21T11:39:06.272 INFO:tasks.workunit.client.1.smithi149.stdout:0/191: write dd/d1a/f2e [871477,1116] 0 2024-09-21T11:39:06.274 INFO:tasks.workunit.client.1.smithi149.stdout:8/222: rename d3/f14 to d3/f4f 0 2024-09-21T11:39:06.275 INFO:tasks.workunit.client.1.smithi149.stdout:4/250: mkdir d4/d13/d15/d16/d23/d62 0 2024-09-21T11:39:06.277 INFO:tasks.workunit.client.1.smithi149.stdout:3/281: sync 2024-09-21T11:39:06.281 INFO:tasks.workunit.client.1.smithi149.stdout:1/228: link d2/dd/f12 d2/dd/d35/d1c/d41/f49 0 2024-09-21T11:39:06.283 INFO:tasks.workunit.client.1.smithi149.stdout:7/322: dwrite d12/f48 [0,4194304] 0 2024-09-21T11:39:06.288 INFO:tasks.workunit.client.1.smithi149.stdout:2/256: write d8/da/d13/d1a/d3b/f51 [872559,102635] 0 2024-09-21T11:39:06.288 INFO:tasks.workunit.client.1.smithi149.stdout:0/192: creat dd/d1a/f44 x:0 0 0 2024-09-21T11:39:06.288 INFO:tasks.workunit.client.1.smithi149.stdout:8/223: symlink d3/dd/d3a/l50 0 2024-09-21T11:39:06.288 INFO:tasks.workunit.client.1.smithi149.stdout:6/199: link d8/da/d14/c29 d8/d32/d37/d28/c3a 0 2024-09-21T11:39:06.289 INFO:tasks.workunit.client.1.smithi149.stdout:5/223: creat d4/d7/f4e x:0 0 0 2024-09-21T11:39:06.290 INFO:tasks.workunit.client.1.smithi149.stdout:1/229: symlink d2/d5/d8/l4a 0 2024-09-21T11:39:06.290 INFO:tasks.workunit.client.1.smithi149.stdout:7/323: rename d12/d15/l2b to d12/d35/l62 0 2024-09-21T11:39:06.291 INFO:tasks.workunit.client.1.smithi149.stdout:7/324: chown d12/d15/d4a 0 1 2024-09-21T11:39:06.293 INFO:tasks.workunit.client.1.smithi149.stdout:3/282: link d6/d1f/f2e d6/d1f/d47/d37/d3a/f6c 0 2024-09-21T11:39:06.294 INFO:tasks.workunit.client.1.smithi149.stdout:5/224: dread d4/d7/f45 [0,4194304] 0 2024-09-21T11:39:06.295 INFO:tasks.workunit.client.1.smithi149.stdout:8/224: creat d3/dd/d18/f51 x:0 0 0 2024-09-21T11:39:06.296 INFO:tasks.workunit.client.1.smithi149.stdout:2/257: chown d8/da/d13/d1a/d3b/l42 200255 1 2024-09-21T11:39:06.296 INFO:tasks.workunit.client.1.smithi149.stdout:4/251: dread d4/d6/f47 [4194304,4194304] 0 2024-09-21T11:39:06.297 INFO:tasks.workunit.client.1.smithi149.stdout:2/258: readlink d8/da/d13/d1a/d3b/l49 0 2024-09-21T11:39:06.297 INFO:tasks.workunit.client.1.smithi149.stdout:7/325: mknod d12/d15/d26/d30/c63 0 2024-09-21T11:39:06.298 INFO:tasks.workunit.client.1.smithi149.stdout:3/283: chown d6/f10 1 1 2024-09-21T11:39:06.299 INFO:tasks.workunit.client.1.smithi149.stdout:5/225: mkdir d4/d4f 0 2024-09-21T11:39:06.301 INFO:tasks.workunit.client.1.smithi149.stdout:8/225: unlink d3/f10 0 2024-09-21T11:39:06.305 INFO:tasks.workunit.client.1.smithi149.stdout:2/259: mkdir d8/da/d13/d1a/d2c/d5a 0 2024-09-21T11:39:06.305 INFO:tasks.workunit.client.1.smithi149.stdout:5/226: dwrite d4/f3a [0,4194304] 0 2024-09-21T11:39:06.307 INFO:tasks.workunit.client.1.smithi149.stdout:2/260: dread - d8/f46 zero size 2024-09-21T11:39:06.313 INFO:tasks.workunit.client.1.smithi149.stdout:5/227: truncate d4/f18 2814520 0 2024-09-21T11:39:06.316 INFO:tasks.workunit.client.1.smithi149.stdout:7/326: dwrite d12/d15/f45 [0,4194304] 0 2024-09-21T11:39:06.316 INFO:tasks.workunit.client.1.smithi149.stdout:6/200: getdents d8/da 0 2024-09-21T11:39:06.317 INFO:tasks.workunit.client.1.smithi149.stdout:6/201: chown d8/d32/d37/c1e 1443891 1 2024-09-21T11:39:06.318 INFO:tasks.workunit.client.1.smithi149.stdout:3/284: mkdir d6/d5f/d6d 0 2024-09-21T11:39:06.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/285: write d6/d1f/d47/d37/d3a/f67 [1015134,62479] 0 2024-09-21T11:39:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:05 smithi118 ceph-mon[28757]: pgmap v18: 65 pgs: 65 active+clean; 273 MiB data, 982 MiB used, 535 GiB / 536 GiB avail; 183 KiB/s rd, 10 MiB/s wr, 288 op/s 2024-09-21T11:39:06.324 INFO:tasks.workunit.client.1.smithi149.stdout:4/252: rename d4/d13 to d4/d6/d63 0 2024-09-21T11:39:06.325 INFO:tasks.workunit.client.1.smithi149.stdout:5/228: mkdir d4/d1d/d50 0 2024-09-21T11:39:06.325 INFO:tasks.workunit.client.1.smithi149.stdout:2/261: creat d8/dd/d50/f5b x:0 0 0 2024-09-21T11:39:06.328 INFO:tasks.workunit.client.1.smithi149.stdout:6/202: creat d8/d32/d37/d28/d2e/f3b x:0 0 0 2024-09-21T11:39:06.329 INFO:tasks.workunit.client.1.smithi149.stdout:2/262: fsync d8/da/d13/f21 0 2024-09-21T11:39:06.330 INFO:tasks.workunit.client.1.smithi149.stdout:5/229: chown d4/d1d/d3e/l47 58 1 2024-09-21T11:39:06.331 INFO:tasks.workunit.client.1.smithi149.stdout:7/327: dwrite d12/d15/f45 [0,4194304] 0 2024-09-21T11:39:06.335 INFO:tasks.workunit.client.1.smithi149.stdout:4/253: mknod d4/d4d/d58/c64 0 2024-09-21T11:39:06.336 INFO:tasks.workunit.client.1.smithi149.stdout:3/286: dwrite d6/d1f/d47/d22/f5d [0,4194304] 0 2024-09-21T11:39:06.380 INFO:tasks.workunit.client.1.smithi149.stdout:9/223: sync 2024-09-21T11:39:06.394 INFO:tasks.workunit.client.1.smithi149.stdout:7/328: unlink d12/f14 0 2024-09-21T11:39:06.394 INFO:tasks.workunit.client.1.smithi149.stdout:5/230: chown d4/d7/f32 26 1 2024-09-21T11:39:06.396 INFO:tasks.workunit.client.1.smithi149.stdout:3/287: fdatasync d6/d1f/d47/d22/f4f 0 2024-09-21T11:39:06.396 INFO:tasks.workunit.client.1.smithi149.stdout:1/230: truncate d2/f4 4473037 0 2024-09-21T11:39:06.398 INFO:tasks.workunit.client.1.smithi149.stdout:6/203: dread f4 [4194304,4194304] 0 2024-09-21T11:39:06.399 INFO:tasks.workunit.client.1.smithi149.stdout:1/231: fdatasync d2/d5/d8/f40 0 2024-09-21T11:39:06.401 INFO:tasks.workunit.client.1.smithi149.stdout:2/263: dwrite d8/da/f55 [0,4194304] 0 2024-09-21T11:39:06.402 INFO:tasks.workunit.client.1.smithi149.stdout:4/254: mknod d4/d6/d63/d10/d31/d32/c65 0 2024-09-21T11:39:06.404 INFO:tasks.workunit.client.1.smithi149.stdout:4/255: readlink d4/l2f 0 2024-09-21T11:39:06.405 INFO:tasks.workunit.client.1.smithi149.stdout:7/329: chown d12/d15/d26/l27 2 1 2024-09-21T11:39:06.406 INFO:tasks.workunit.client.1.smithi149.stdout:6/204: rename d8/da/f1a to d8/d32/d37/f3c 0 2024-09-21T11:39:06.408 INFO:tasks.workunit.client.1.smithi149.stdout:5/231: write d4/d7/f38 [2060918,78825] 0 2024-09-21T11:39:06.408 INFO:tasks.workunit.client.1.smithi149.stdout:2/264: mkdir d8/dd/d5c 0 2024-09-21T11:39:06.411 INFO:tasks.workunit.client.1.smithi149.stdout:6/205: mkdir d8/da/d3d 0 2024-09-21T11:39:06.413 INFO:tasks.workunit.client.1.smithi149.stdout:3/288: write d6/d1f/d47/d37/d3a/f6c [244581,3639] 0 2024-09-21T11:39:06.413 INFO:tasks.workunit.client.1.smithi149.stdout:9/224: dwrite d18/d19/d1a/d2f/f3d [0,4194304] 0 2024-09-21T11:39:06.416 INFO:tasks.workunit.client.1.smithi149.stdout:4/256: creat d4/d4d/d5f/f66 x:0 0 0 2024-09-21T11:39:06.416 INFO:tasks.workunit.client.1.smithi149.stdout:9/225: chown f0 97 1 2024-09-21T11:39:06.417 INFO:tasks.workunit.client.1.smithi149.stdout:5/232: dread d4/d7/f45 [0,4194304] 0 2024-09-21T11:39:06.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/226: write d18/d19/f40 [760463,24455] 0 2024-09-21T11:39:06.424 INFO:tasks.workunit.client.1.smithi149.stdout:2/265: mkdir d8/da/d13/d5d 0 2024-09-21T11:39:06.425 INFO:tasks.workunit.client.1.smithi149.stdout:4/257: symlink d4/l67 0 2024-09-21T11:39:06.425 INFO:tasks.workunit.client.1.smithi149.stdout:1/232: dwrite d2/d5/f34 [0,4194304] 0 2024-09-21T11:39:06.426 INFO:tasks.workunit.client.1.smithi149.stdout:9/227: truncate f16 779280 0 2024-09-21T11:39:06.426 INFO:tasks.workunit.client.1.smithi149.stdout:3/289: mknod d6/d1f/d47/c6e 0 2024-09-21T11:39:06.430 INFO:tasks.workunit.client.1.smithi149.stdout:7/330: rename d12/d5b/f61 to d12/d15/d26/d30/d31/f64 0 2024-09-21T11:39:06.430 INFO:tasks.workunit.client.1.smithi149.stdout:3/290: mknod d6/d1f/d47/d22/c6f 0 2024-09-21T11:39:06.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/206: dwrite d8/da/d14/f15 [4194304,4194304] 0 2024-09-21T11:39:06.431 INFO:tasks.workunit.client.1.smithi149.stdout:0/193: sync 2024-09-21T11:39:06.435 INFO:tasks.workunit.client.1.smithi149.stdout:1/233: read - d2/f2d zero size 2024-09-21T11:39:06.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/194: fsync dd/d1a/f44 0 2024-09-21T11:39:06.440 INFO:tasks.workunit.client.1.smithi149.stdout:1/234: write d2/f1a [1906504,34951] 0 2024-09-21T11:39:06.441 INFO:tasks.workunit.client.1.smithi149.stdout:2/266: truncate d8/da/d13/d1a/d2c/f4b 75863 0 2024-09-21T11:39:06.443 INFO:tasks.workunit.client.1.smithi149.stdout:5/233: dwrite d4/d7/fa [4194304,4194304] 0 2024-09-21T11:39:06.444 INFO:tasks.workunit.client.1.smithi149.stdout:9/228: link l11 d18/d19/l45 0 2024-09-21T11:39:06.446 INFO:tasks.workunit.client.1.smithi149.stdout:0/195: mknod dd/c45 0 2024-09-21T11:39:06.446 INFO:tasks.workunit.client.1.smithi149.stdout:7/331: link d12/d15/f50 d12/d15/d26/f65 0 2024-09-21T11:39:06.449 INFO:tasks.workunit.client.1.smithi149.stdout:9/229: fdatasync d18/d19/d1a/f26 0 2024-09-21T11:39:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:05 smithi149 ceph-mon[36123]: pgmap v18: 65 pgs: 65 active+clean; 273 MiB data, 982 MiB used, 535 GiB / 536 GiB avail; 183 KiB/s rd, 10 MiB/s wr, 288 op/s 2024-09-21T11:39:06.453 INFO:tasks.workunit.client.1.smithi149.stdout:5/234: mkdir d4/d7/d40/d51 0 2024-09-21T11:39:06.456 INFO:tasks.workunit.client.1.smithi149.stdout:6/207: dread d8/da/d11/f25 [0,4194304] 0 2024-09-21T11:39:06.456 INFO:tasks.workunit.client.1.smithi149.stdout:2/267: rename d8/da/cf to d8/d20/d57/c5e 0 2024-09-21T11:39:06.459 INFO:tasks.workunit.client.1.smithi149.stdout:9/230: creat d18/d1c/f46 x:0 0 0 2024-09-21T11:39:06.459 INFO:tasks.workunit.client.1.smithi149.stdout:5/235: symlink d4/d1d/l52 0 2024-09-21T11:39:06.461 INFO:tasks.workunit.client.1.smithi149.stdout:7/332: truncate d12/d15/d26/d30/d31/f60 405078 0 2024-09-21T11:39:06.462 INFO:tasks.workunit.client.1.smithi149.stdout:3/291: dwrite d6/d1f/d27/f3c [0,4194304] 0 2024-09-21T11:39:06.462 INFO:tasks.workunit.client.1.smithi149.stdout:0/196: getdents dd/d32/d38/d3a 0 2024-09-21T11:39:06.464 INFO:tasks.workunit.client.1.smithi149.stdout:4/258: truncate d4/d6/f9 1591818 0 2024-09-21T11:39:06.465 INFO:tasks.workunit.client.1.smithi149.stdout:1/235: dwrite d2/dd/d35/d1c/f29 [0,4194304] 0 2024-09-21T11:39:06.466 INFO:tasks.workunit.client.1.smithi149.stdout:7/333: write d12/f48 [5018674,6669] 0 2024-09-21T11:39:06.466 INFO:tasks.workunit.client.1.smithi149.stdout:9/231: mkdir d18/d36/d3c/d47 0 2024-09-21T11:39:06.466 INFO:tasks.workunit.client.1.smithi149.stdout:8/226: sync 2024-09-21T11:39:06.468 INFO:tasks.workunit.client.1.smithi149.stdout:5/236: creat d4/d7/d40/f53 x:0 0 0 2024-09-21T11:39:06.471 INFO:tasks.workunit.client.1.smithi149.stdout:0/197: symlink dd/d32/d38/l46 0 2024-09-21T11:39:06.472 INFO:tasks.workunit.client.1.smithi149.stdout:2/268: dread d8/d11/f3d [0,4194304] 0 2024-09-21T11:39:06.472 INFO:tasks.workunit.client.1.smithi149.stdout:7/334: creat d12/f66 x:0 0 0 2024-09-21T11:39:06.473 INFO:tasks.workunit.client.1.smithi149.stdout:0/198: rename dd/d32/d38 to dd/d32/d38/d3a/d47 22 2024-09-21T11:39:06.474 INFO:tasks.workunit.client.1.smithi149.stdout:2/269: fdatasync d8/da/d13/d1a/d29/f32 0 2024-09-21T11:39:06.475 INFO:tasks.workunit.client.1.smithi149.stdout:5/237: unlink d4/d7/d1a/d2a/f41 0 2024-09-21T11:39:06.478 INFO:tasks.workunit.client.1.smithi149.stdout:6/208: link d8/d32/d37/f36 d8/d32/d37/d28/d2e/f3e 0 2024-09-21T11:39:06.479 INFO:tasks.workunit.client.1.smithi149.stdout:0/199: symlink dd/d2d/l48 0 2024-09-21T11:39:06.480 INFO:tasks.workunit.client.1.smithi149.stdout:6/209: readlink d8/da/l12 0 2024-09-21T11:39:06.481 INFO:tasks.workunit.client.1.smithi149.stdout:6/210: chown f4 0 1 2024-09-21T11:39:06.481 INFO:tasks.workunit.client.1.smithi149.stdout:8/227: dread d3/fa [0,4194304] 0 2024-09-21T11:39:06.482 INFO:tasks.workunit.client.1.smithi149.stdout:8/228: fsync d3/d33/f47 0 2024-09-21T11:39:06.484 INFO:tasks.workunit.client.1.smithi149.stdout:8/229: write d3/dd/d18/f51 [325641,65381] 0 2024-09-21T11:39:06.484 INFO:tasks.workunit.client.1.smithi149.stdout:9/232: link ca d18/d1c/c48 0 2024-09-21T11:39:06.485 INFO:tasks.workunit.client.1.smithi149.stdout:3/292: link d6/d1f/d47/l2b d6/l70 0 2024-09-21T11:39:06.485 INFO:tasks.workunit.client.1.smithi149.stdout:9/233: fsync d18/d19/d1a/f26 0 2024-09-21T11:39:06.485 INFO:tasks.workunit.client.1.smithi149.stdout:6/211: truncate d8/da/fc 1882415 0 2024-09-21T11:39:06.486 INFO:tasks.workunit.client.1.smithi149.stdout:9/234: chown d18/d19/f25 189901 1 2024-09-21T11:39:06.487 INFO:tasks.workunit.client.1.smithi149.stdout:1/236: link d2/dd/d35/d1c/d41/c47 d2/c4b 0 2024-09-21T11:39:06.489 INFO:tasks.workunit.client.1.smithi149.stdout:3/293: write d6/d1f/d47/d37/d3a/f43 [359641,78184] 0 2024-09-21T11:39:06.490 INFO:tasks.workunit.client.1.smithi149.stdout:3/294: chown c4 7 1 2024-09-21T11:39:06.492 INFO:tasks.workunit.client.1.smithi149.stdout:4/259: dread d4/d6/d63/f28 [0,4194304] 0 2024-09-21T11:39:06.493 INFO:tasks.workunit.client.1.smithi149.stdout:8/230: mknod d3/d3c/d4c/c52 0 2024-09-21T11:39:06.494 INFO:tasks.workunit.client.1.smithi149.stdout:9/235: rmdir d18/d36/d3c 39 2024-09-21T11:39:06.494 INFO:tasks.workunit.client.1.smithi149.stdout:1/237: dread d2/d5/d8/d3b/f42 [0,4194304] 0 2024-09-21T11:39:06.503 INFO:tasks.workunit.client.1.smithi149.stdout:3/295: mknod d6/d1f/d4c/c71 0 2024-09-21T11:39:06.504 INFO:tasks.workunit.client.1.smithi149.stdout:5/238: rename d4/d7/d1a to d4/d1d/d50/d54 0 2024-09-21T11:39:06.504 INFO:tasks.workunit.client.1.smithi149.stdout:9/236: rename d18/d19 to d18/d19/d1a/d2f/d43/d49 22 2024-09-21T11:39:06.505 INFO:tasks.workunit.client.1.smithi149.stdout:4/260: write d4/d6/f47 [7885514,79998] 0 2024-09-21T11:39:06.505 INFO:tasks.workunit.client.1.smithi149.stdout:7/335: truncate d12/d15/d26/d30/d31/f60 116255 0 2024-09-21T11:39:06.505 INFO:tasks.workunit.client.1.smithi149.stdout:3/296: chown d6/d1f/d47/d37/f3b 23174350 1 2024-09-21T11:39:06.506 INFO:tasks.workunit.client.1.smithi149.stdout:0/200: truncate dd/d1a/f2e 263655 0 2024-09-21T11:39:06.507 INFO:tasks.workunit.client.1.smithi149.stdout:1/238: rmdir d2/dd 39 2024-09-21T11:39:06.507 INFO:tasks.workunit.client.1.smithi149.stdout:5/239: rmdir d4/d7 39 2024-09-21T11:39:06.510 INFO:tasks.workunit.client.1.smithi149.stdout:8/231: fdatasync d3/d12/f15 0 2024-09-21T11:39:06.512 INFO:tasks.workunit.client.1.smithi149.stdout:0/201: write dd/d1a/d1b/f24 [228151,106851] 0 2024-09-21T11:39:06.516 INFO:tasks.workunit.client.1.smithi149.stdout:7/336: creat d12/d15/d26/d30/d31/d47/d49/f67 x:0 0 0 2024-09-21T11:39:06.521 INFO:tasks.workunit.client.1.smithi149.stdout:1/239: write d2/f13 [2310474,85842] 0 2024-09-21T11:39:06.521 INFO:tasks.workunit.client.1.smithi149.stdout:2/270: dwrite d8/da/d13/d1a/d29/f58 [0,4194304] 0 2024-09-21T11:39:06.521 INFO:tasks.workunit.client.1.smithi149.stdout:5/240: chown d4/d7/cd 39373669 1 2024-09-21T11:39:06.523 INFO:tasks.workunit.client.1.smithi149.stdout:9/237: dwrite d18/d1c/f46 [0,4194304] 0 2024-09-21T11:39:06.526 INFO:tasks.workunit.client.1.smithi149.stdout:7/337: mkdir d12/d15/d68 0 2024-09-21T11:39:06.534 INFO:tasks.workunit.client.1.smithi149.stdout:5/241: mknod d4/d7/d40/d43/c55 0 2024-09-21T11:39:06.535 INFO:tasks.workunit.client.1.smithi149.stdout:9/238: chown d18/d19/d1a/c1d 4067421 1 2024-09-21T11:39:06.535 INFO:tasks.workunit.client.1.smithi149.stdout:2/271: creat d8/dd/f5f x:0 0 0 2024-09-21T11:39:06.536 INFO:tasks.workunit.client.1.smithi149.stdout:5/242: fdatasync f2 0 2024-09-21T11:39:06.537 INFO:tasks.workunit.client.1.smithi149.stdout:0/202: link dd/d32/d38/d3a/l41 dd/d35/l49 0 2024-09-21T11:39:06.538 INFO:tasks.workunit.client.1.smithi149.stdout:1/240: mkdir d2/dd/d2e/d4c 0 2024-09-21T11:39:06.540 INFO:tasks.workunit.client.1.smithi149.stdout:1/241: readlink d2/le 0 2024-09-21T11:39:06.543 INFO:tasks.workunit.client.1.smithi149.stdout:8/232: dwrite d3/f37 [0,4194304] 0 2024-09-21T11:39:06.544 INFO:tasks.workunit.client.1.smithi149.stdout:9/239: mknod d18/d19/d1a/d2f/d43/c4a 0 2024-09-21T11:39:06.545 INFO:tasks.workunit.client.1.smithi149.stdout:7/338: dread fa [0,4194304] 0 2024-09-21T11:39:06.549 INFO:tasks.workunit.client.1.smithi149.stdout:1/242: fsync d2/d2b/f31 0 2024-09-21T11:39:06.558 INFO:tasks.workunit.client.1.smithi149.stdout:8/233: creat d3/d3c/d4c/f53 x:0 0 0 2024-09-21T11:39:06.564 INFO:tasks.workunit.client.1.smithi149.stdout:1/243: symlink d2/d5/l4d 0 2024-09-21T11:39:06.566 INFO:tasks.workunit.client.1.smithi149.stdout:4/261: dread d4/d6/d18/f1c [0,4194304] 0 2024-09-21T11:39:06.568 INFO:tasks.workunit.client.1.smithi149.stdout:2/272: dwrite d8/da/f55 [4194304,4194304] 0 2024-09-21T11:39:06.574 INFO:tasks.workunit.client.1.smithi149.stdout:6/212: sync 2024-09-21T11:39:06.574 INFO:tasks.workunit.client.1.smithi149.stdout:3/297: sync 2024-09-21T11:39:06.578 INFO:tasks.workunit.client.1.smithi149.stdout:5/243: dwrite d4/d1d/d50/d54/d2a/f3f [0,4194304] 0 2024-09-21T11:39:06.578 INFO:tasks.workunit.client.1.smithi149.stdout:9/240: dwrite f16 [0,4194304] 0 2024-09-21T11:39:06.578 INFO:tasks.workunit.client.1.smithi149.stdout:7/339: truncate d12/d15/d4a/d4f/f51 628006 0 2024-09-21T11:39:06.578 INFO:tasks.workunit.client.1.smithi149.stdout:8/234: mkdir d3/dd/d21/d54 0 2024-09-21T11:39:06.580 INFO:tasks.workunit.client.1.smithi149.stdout:4/262: unlink d4/d6/d63/f12 0 2024-09-21T11:39:06.580 INFO:tasks.workunit.client.1.smithi149.stdout:6/213: dread - d8/f39 zero size 2024-09-21T11:39:06.580 INFO:tasks.workunit.client.1.smithi149.stdout:0/203: dwrite dd/d2d/f43 [0,4194304] 0 2024-09-21T11:39:06.581 INFO:tasks.workunit.client.1.smithi149.stdout:1/244: chown d2/dd/d35/d1c/d37/f44 436706 1 2024-09-21T11:39:06.584 INFO:tasks.workunit.client.1.smithi149.stdout:0/204: write f8 [615055,113332] 0 2024-09-21T11:39:06.584 INFO:tasks.workunit.client.1.smithi149.stdout:9/241: write d18/d19/f20 [3669395,5483] 0 2024-09-21T11:39:06.584 INFO:tasks.workunit.client.1.smithi149.stdout:7/340: write d12/d35/f55 [653956,128460] 0 2024-09-21T11:39:06.584 INFO:tasks.workunit.client.1.smithi149.stdout:3/298: rmdir d6/d1f/d4c 39 2024-09-21T11:39:06.588 INFO:tasks.workunit.client.1.smithi149.stdout:5/244: chown d4/d7/d40/d43/l48 135 1 2024-09-21T11:39:06.588 INFO:tasks.workunit.client.1.smithi149.stdout:7/341: stat d12/d15/f32 0 2024-09-21T11:39:06.588 INFO:tasks.workunit.client.1.smithi149.stdout:4/263: unlink d4/d6/cf 0 2024-09-21T11:39:06.588 INFO:tasks.workunit.client.1.smithi149.stdout:8/235: readlink d3/dd/d18/l22 0 2024-09-21T11:39:06.591 INFO:tasks.workunit.client.1.smithi149.stdout:2/273: mkdir d8/dd/d5c/d60 0 2024-09-21T11:39:06.591 INFO:tasks.workunit.client.1.smithi149.stdout:5/245: fdatasync d4/f2f 0 2024-09-21T11:39:06.591 INFO:tasks.workunit.client.1.smithi149.stdout:0/205: unlink dd/d1a/d1b/c29 0 2024-09-21T11:39:06.592 INFO:tasks.workunit.client.1.smithi149.stdout:9/242: creat d18/d19/d1a/f4b x:0 0 0 2024-09-21T11:39:06.594 INFO:tasks.workunit.client.1.smithi149.stdout:8/236: fdatasync d3/d12/f24 0 2024-09-21T11:39:06.594 INFO:tasks.workunit.client.1.smithi149.stdout:3/299: write d6/d1f/d47/f52 [1027647,102438] 0 2024-09-21T11:39:06.596 INFO:tasks.workunit.client.1.smithi149.stdout:1/245: unlink d2/f4 0 2024-09-21T11:39:06.598 INFO:tasks.workunit.client.1.smithi149.stdout:7/342: fdatasync d12/d15/f5f 0 2024-09-21T11:39:06.598 INFO:tasks.workunit.client.1.smithi149.stdout:9/243: mkdir d18/d4c 0 2024-09-21T11:39:06.600 INFO:tasks.workunit.client.1.smithi149.stdout:5/246: rmdir d4/d7/d40/d43 39 2024-09-21T11:39:06.601 INFO:tasks.workunit.client.1.smithi149.stdout:2/274: creat d8/da/d13/d1a/d3b/f61 x:0 0 0 2024-09-21T11:39:06.601 INFO:tasks.workunit.client.1.smithi149.stdout:8/237: mkdir d3/d33/d34/d55 0 2024-09-21T11:39:06.604 INFO:tasks.workunit.client.1.smithi149.stdout:9/244: write d18/d19/d1a/d2f/f38 [1249580,48490] 0 2024-09-21T11:39:06.604 INFO:tasks.workunit.client.1.smithi149.stdout:7/343: write d12/d15/d26/f3e [4014051,27227] 0 2024-09-21T11:39:06.604 INFO:tasks.workunit.client.1.smithi149.stdout:5/247: stat d4/f18 0 2024-09-21T11:39:06.607 INFO:tasks.workunit.client.1.smithi149.stdout:1/246: dread d2/d5/d8/f1f [4194304,4194304] 0 2024-09-21T11:39:06.610 INFO:tasks.workunit.client.1.smithi149.stdout:0/206: dwrite dd/d1a/d1b/f24 [0,4194304] 0 2024-09-21T11:39:06.610 INFO:tasks.workunit.client.1.smithi149.stdout:9/245: chown l11 835 1 2024-09-21T11:39:06.611 INFO:tasks.workunit.client.1.smithi149.stdout:2/275: read d8/da/d13/d1a/f1f [2036492,95078] 0 2024-09-21T11:39:06.614 INFO:tasks.workunit.client.1.smithi149.stdout:8/238: creat d3/dd/d21/d54/f56 x:0 0 0 2024-09-21T11:39:06.616 INFO:tasks.workunit.client.1.smithi149.stdout:4/264: write d4/d6/fb [3108375,49117] 0 2024-09-21T11:39:06.617 INFO:tasks.workunit.client.1.smithi149.stdout:5/248: mkdir d4/d7/d40/d51/d56 0 2024-09-21T11:39:06.618 INFO:tasks.workunit.client.1.smithi149.stdout:3/300: dwrite d6/f38 [0,4194304] 0 2024-09-21T11:39:06.620 INFO:tasks.workunit.client.1.smithi149.stdout:1/247: unlink d2/dd/d35/d1c/f32 0 2024-09-21T11:39:06.621 INFO:tasks.workunit.client.1.smithi149.stdout:7/344: truncate d12/d15/f1f 201711 0 2024-09-21T11:39:06.621 INFO:tasks.workunit.client.1.smithi149.stdout:4/265: readlink d4/d6/d63/d10/l41 0 2024-09-21T11:39:06.625 INFO:tasks.workunit.client.1.smithi149.stdout:4/266: fsync d4/d6/d63/d15/f49 0 2024-09-21T11:39:06.625 INFO:tasks.workunit.client.1.smithi149.stdout:0/207: creat dd/d32/f4a x:0 0 0 2024-09-21T11:39:06.626 INFO:tasks.workunit.client.1.smithi149.stdout:2/276: creat d8/d20/f62 x:0 0 0 2024-09-21T11:39:06.626 INFO:tasks.workunit.client.1.smithi149.stdout:6/214: dwrite d8/d32/d37/f3c [0,4194304] 0 2024-09-21T11:39:06.627 INFO:tasks.workunit.client.1.smithi149.stdout:5/249: read - d4/d1d/d50/d54/f35 zero size 2024-09-21T11:39:06.629 INFO:tasks.workunit.client.1.smithi149.stdout:2/277: fdatasync d8/d20/f40 0 2024-09-21T11:39:06.634 INFO:tasks.workunit.client.1.smithi149.stdout:9/246: rename cd to d18/d19/d1a/d2f/c4d 0 2024-09-21T11:39:06.634 INFO:tasks.workunit.client.1.smithi149.stdout:7/345: mknod d12/d15/d26/d30/d31/d47/c69 0 2024-09-21T11:39:06.635 INFO:tasks.workunit.client.1.smithi149.stdout:0/208: unlink dd/f23 0 2024-09-21T11:39:06.638 INFO:tasks.workunit.client.1.smithi149.stdout:4/267: dread d4/d6/d63/d15/f54 [0,4194304] 0 2024-09-21T11:39:06.640 INFO:tasks.workunit.client.1.smithi149.stdout:2/278: mkdir d8/d44/d63 0 2024-09-21T11:39:06.642 INFO:tasks.workunit.client.1.smithi149.stdout:0/209: rmdir dd/d32/d38 39 2024-09-21T11:39:06.643 INFO:tasks.workunit.client.1.smithi149.stdout:9/247: dread d18/d1c/f46 [0,4194304] 0 2024-09-21T11:39:06.647 INFO:tasks.workunit.client.1.smithi149.stdout:8/239: link d3/dd/c38 d3/d3c/c57 0 2024-09-21T11:39:06.647 INFO:tasks.workunit.client.1.smithi149.stdout:7/346: dread d12/d15/d4a/d4f/f51 [0,4194304] 0 2024-09-21T11:39:06.647 INFO:tasks.workunit.client.1.smithi149.stdout:4/268: fsync d4/d6/d63/d10/f5b 0 2024-09-21T11:39:06.648 INFO:tasks.workunit.client.1.smithi149.stdout:2/279: symlink d8/l64 0 2024-09-21T11:39:06.650 INFO:tasks.workunit.client.1.smithi149.stdout:6/215: getdents d8/d32 0 2024-09-21T11:39:06.652 INFO:tasks.workunit.client.1.smithi149.stdout:8/240: unlink d3/d12/f24 0 2024-09-21T11:39:06.654 INFO:tasks.workunit.client.1.smithi149.stdout:9/248: getdents d18/d19/d1a/d2f/d33 0 2024-09-21T11:39:06.654 INFO:tasks.workunit.client.1.smithi149.stdout:1/248: write d2/dd/d35/d1c/d41/f49 [1530219,31778] 0 2024-09-21T11:39:06.654 INFO:tasks.workunit.client.1.smithi149.stdout:0/210: dwrite dd/d1a/d1b/f27 [0,4194304] 0 2024-09-21T11:39:06.656 INFO:tasks.workunit.client.1.smithi149.stdout:2/280: write d8/dd/f1d [4415080,87668] 0 2024-09-21T11:39:06.660 INFO:tasks.workunit.client.1.smithi149.stdout:3/301: write d6/f1a [1661528,96152] 0 2024-09-21T11:39:06.663 INFO:tasks.workunit.client.1.smithi149.stdout:6/216: truncate d8/d32/d37/d28/f30 64776 0 2024-09-21T11:39:06.663 INFO:tasks.workunit.client.1.smithi149.stdout:5/250: write d4/d1d/d50/d54/f23 [3557122,119713] 0 2024-09-21T11:39:06.666 INFO:tasks.workunit.client.1.smithi149.stdout:1/249: fdatasync d2/dd/d35/d1c/f38 0 2024-09-21T11:39:06.667 INFO:tasks.workunit.client.1.smithi149.stdout:9/249: unlink d18/l31 0 2024-09-21T11:39:06.667 INFO:tasks.workunit.client.1.smithi149.stdout:8/241: dread d3/dd/d3a/f3d [0,4194304] 0 2024-09-21T11:39:06.667 INFO:tasks.workunit.client.1.smithi149.stdout:7/347: dread d12/d35/f55 [0,4194304] 0 2024-09-21T11:39:06.668 INFO:tasks.workunit.client.1.smithi149.stdout:5/251: dread - d4/d7/d40/f42 zero size 2024-09-21T11:39:06.668 INFO:tasks.workunit.client.1.smithi149.stdout:4/269: dwrite d4/f1f [0,4194304] 0 2024-09-21T11:39:06.669 INFO:tasks.workunit.client.1.smithi149.stdout:2/281: symlink d8/d20/d57/l65 0 2024-09-21T11:39:06.671 INFO:tasks.workunit.client.1.smithi149.stdout:6/217: write d8/da/d11/f25 [1239622,73488] 0 2024-09-21T11:39:06.673 INFO:tasks.workunit.client.1.smithi149.stdout:8/242: mknod d3/dd/d21/d54/c58 0 2024-09-21T11:39:06.678 INFO:tasks.workunit.client.1.smithi149.stdout:5/252: mknod d4/d7/d40/d51/c57 0 2024-09-21T11:39:06.680 INFO:tasks.workunit.client.1.smithi149.stdout:9/250: unlink d18/d19/l45 0 2024-09-21T11:39:06.680 INFO:tasks.workunit.client.1.smithi149.stdout:9/251: chown d18/d1c 2315932 1 2024-09-21T11:39:06.681 INFO:tasks.workunit.client.1.smithi149.stdout:3/302: link d6/d1f/d47/d37/d3a/f67 d6/d5f/f72 0 2024-09-21T11:39:06.681 INFO:tasks.workunit.client.1.smithi149.stdout:7/348: truncate d12/d15/f1f 1215957 0 2024-09-21T11:39:06.682 INFO:tasks.workunit.client.1.smithi149.stdout:2/282: symlink d8/da/d13/d1a/d2c/d5a/l66 0 2024-09-21T11:39:06.684 INFO:tasks.workunit.client.1.smithi149.stdout:2/283: write d8/da/f28 [4234651,21287] 0 2024-09-21T11:39:06.684 INFO:tasks.workunit.client.1.smithi149.stdout:9/252: stat c1 0 2024-09-21T11:39:06.687 INFO:tasks.workunit.client.1.smithi149.stdout:2/284: fdatasync d8/d20/f40 0 2024-09-21T11:39:06.687 INFO:tasks.workunit.client.1.smithi149.stdout:9/253: creat d18/d1c/f4e x:0 0 0 2024-09-21T11:39:06.689 INFO:tasks.workunit.client.1.smithi149.stdout:8/243: getdents d3 0 2024-09-21T11:39:06.689 INFO:tasks.workunit.client.1.smithi149.stdout:9/254: fdatasync f0 0 2024-09-21T11:39:06.692 INFO:tasks.workunit.client.1.smithi149.stdout:9/255: creat d18/d1c/f4f x:0 0 0 2024-09-21T11:39:06.693 INFO:tasks.workunit.client.1.smithi149.stdout:1/250: truncate d2/d5/d8/fa 40607 0 2024-09-21T11:39:06.694 INFO:tasks.workunit.client.1.smithi149.stdout:2/285: unlink d8/da/d13/d1a/f52 0 2024-09-21T11:39:06.697 INFO:tasks.workunit.client.1.smithi149.stdout:1/251: chown d2/dd/f22 1848777 1 2024-09-21T11:39:06.702 INFO:tasks.workunit.client.1.smithi149.stdout:2/286: mkdir d8/dd/d5c/d60/d67 0 2024-09-21T11:39:06.705 INFO:tasks.workunit.client.1.smithi149.stdout:6/218: dwrite d8/da/d14/f2a [0,4194304] 0 2024-09-21T11:39:06.706 INFO:tasks.workunit.client.1.smithi149.stdout:3/303: dread d6/f16 [0,4194304] 0 2024-09-21T11:39:06.707 INFO:tasks.workunit.client.1.smithi149.stdout:6/219: chown d8/d32 0 1 2024-09-21T11:39:06.707 INFO:tasks.workunit.client.1.smithi149.stdout:2/287: rename d8/d44/d63 to d8/d44/d63/d68 22 2024-09-21T11:39:06.708 INFO:tasks.workunit.client.1.smithi149.stdout:9/256: link ca d18/d19/d1a/d2f/d43/c50 0 2024-09-21T11:39:06.709 INFO:tasks.workunit.client.1.smithi149.stdout:7/349: dread ff [4194304,4194304] 0 2024-09-21T11:39:06.711 INFO:tasks.workunit.client.1.smithi149.stdout:2/288: rmdir d8/d20 39 2024-09-21T11:39:06.712 INFO:tasks.workunit.client.1.smithi149.stdout:5/253: dread f2 [4194304,4194304] 0 2024-09-21T11:39:06.713 INFO:tasks.workunit.client.1.smithi149.stdout:3/304: read d6/f1b [652080,12449] 0 2024-09-21T11:39:06.714 INFO:tasks.workunit.client.1.smithi149.stdout:6/220: symlink d8/da/d11/l3f 0 2024-09-21T11:39:06.715 INFO:tasks.workunit.client.1.smithi149.stdout:8/244: dwrite d3/f1d [0,4194304] 0 2024-09-21T11:39:06.715 INFO:tasks.workunit.client.1.smithi149.stdout:7/350: chown d12/d15/d26/l27 427554737 1 2024-09-21T11:39:06.716 INFO:tasks.workunit.client.1.smithi149.stdout:6/221: stat f4 0 2024-09-21T11:39:06.745 INFO:tasks.workunit.client.1.smithi149.stdout:5/254: unlink d4/f12 0 2024-09-21T11:39:06.745 INFO:tasks.workunit.client.1.smithi149.stdout:2/289: write d8/da/d13/f21 [688876,78275] 0 2024-09-21T11:39:06.745 INFO:tasks.workunit.client.1.smithi149.stdout:1/252: getdents d2/d5/d8/d3b 0 2024-09-21T11:39:06.747 INFO:tasks.workunit.client.1.smithi149.stdout:7/351: unlink d12/c5d 0 2024-09-21T11:39:06.747 INFO:tasks.workunit.client.1.smithi149.stdout:3/305: mknod d6/c73 0 2024-09-21T11:39:06.749 INFO:tasks.workunit.client.1.smithi149.stdout:2/290: read d8/dd/f24 [3392668,93537] 0 2024-09-21T11:39:06.749 INFO:tasks.workunit.client.1.smithi149.stdout:1/253: mknod d2/dd/d35/d1c/d37/c4e 0 2024-09-21T11:39:06.750 INFO:tasks.workunit.client.1.smithi149.stdout:7/352: unlink l9 0 2024-09-21T11:39:06.750 INFO:tasks.workunit.client.1.smithi149.stdout:2/291: chown l6 6 1 2024-09-21T11:39:06.752 INFO:tasks.workunit.client.1.smithi149.stdout:7/353: rename d12/d15 to d12/d15/d26/d30/d31/d6a 22 2024-09-21T11:39:06.754 INFO:tasks.workunit.client.1.smithi149.stdout:5/255: dread f2 [4194304,4194304] 0 2024-09-21T11:39:06.754 INFO:tasks.workunit.client.1.smithi149.stdout:6/222: dread d8/da/d11/f26 [0,4194304] 0 2024-09-21T11:39:06.755 INFO:tasks.workunit.client.1.smithi149.stdout:2/292: creat d8/da/d13/d1a/d29/f69 x:0 0 0 2024-09-21T11:39:06.755 INFO:tasks.workunit.client.1.smithi149.stdout:3/306: creat d6/d1f/d47/f74 x:0 0 0 2024-09-21T11:39:06.756 INFO:tasks.workunit.client.1.smithi149.stdout:7/354: mkdir d12/d6b 0 2024-09-21T11:39:06.757 INFO:tasks.workunit.client.1.smithi149.stdout:5/256: dread - d4/d7/d40/f42 zero size 2024-09-21T11:39:06.757 INFO:tasks.workunit.client.1.smithi149.stdout:6/223: fsync d8/d32/d37/d28/f30 0 2024-09-21T11:39:06.759 INFO:tasks.workunit.client.1.smithi149.stdout:6/224: stat d8/d32/d37/c1e 0 2024-09-21T11:39:06.760 INFO:tasks.workunit.client.1.smithi149.stdout:3/307: write d6/d1f/d47/d37/d3f/f44 [1005534,31090] 0 2024-09-21T11:39:06.761 INFO:tasks.workunit.client.1.smithi149.stdout:1/254: dwrite d2/f20 [4194304,4194304] 0 2024-09-21T11:39:06.761 INFO:tasks.workunit.client.1.smithi149.stdout:7/355: rename d12/d6b to d12/d15/d4a/d6c 0 2024-09-21T11:39:06.764 INFO:tasks.workunit.client.1.smithi149.stdout:5/257: write d4/d1d/d50/d54/f35 [507101,40417] 0 2024-09-21T11:39:06.765 INFO:tasks.workunit.client.1.smithi149.stdout:7/356: write d12/d15/d26/f29 [2074034,68942] 0 2024-09-21T11:39:06.766 INFO:tasks.workunit.client.1.smithi149.stdout:3/308: unlink d6/d1f/d47/d22/f4f 0 2024-09-21T11:39:06.770 INFO:tasks.workunit.client.1.smithi149.stdout:6/225: rename l7 to d8/d32/d37/d28/d2e/l40 0 2024-09-21T11:39:06.773 INFO:tasks.workunit.client.1.smithi149.stdout:5/258: creat d4/d7/d40/d51/f58 x:0 0 0 2024-09-21T11:39:06.773 INFO:tasks.workunit.client.1.smithi149.stdout:7/357: dwrite d12/f21 [0,4194304] 0 2024-09-21T11:39:06.773 INFO:tasks.workunit.client.1.smithi149.stdout:7/358: chown d12 440202 1 2024-09-21T11:39:06.775 INFO:tasks.workunit.client.1.smithi149.stdout:3/309: rename d6/d1f/l25 to d6/d1f/d47/d37/d50/l75 0 2024-09-21T11:39:06.776 INFO:tasks.workunit.client.1.smithi149.stdout:3/310: read - d6/d1f/d47/d37/f3b zero size 2024-09-21T11:39:06.777 INFO:tasks.workunit.client.1.smithi149.stdout:2/293: dread d8/dd/f2b [0,4194304] 0 2024-09-21T11:39:06.778 INFO:tasks.workunit.client.1.smithi149.stdout:6/226: mknod d8/da/d14/c41 0 2024-09-21T11:39:06.778 INFO:tasks.workunit.client.1.smithi149.stdout:6/227: stat d8/da/d14 0 2024-09-21T11:39:06.784 INFO:tasks.workunit.client.1.smithi149.stdout:5/259: creat d4/d7/d40/f59 x:0 0 0 2024-09-21T11:39:06.785 INFO:tasks.workunit.client.1.smithi149.stdout:4/270: sync 2024-09-21T11:39:06.785 INFO:tasks.workunit.client.1.smithi149.stdout:0/211: sync 2024-09-21T11:39:06.785 INFO:tasks.workunit.client.1.smithi149.stdout:6/228: unlink d8/da/d14/c41 0 2024-09-21T11:39:06.786 INFO:tasks.workunit.client.1.smithi149.stdout:2/294: mkdir d8/da/d13/d5d/d6a 0 2024-09-21T11:39:06.787 INFO:tasks.workunit.client.1.smithi149.stdout:2/295: readlink d8/d11/l25 0 2024-09-21T11:39:06.788 INFO:tasks.workunit.client.1.smithi149.stdout:5/260: chown d4/d7/d40/d43/c55 200446 1 2024-09-21T11:39:06.788 INFO:tasks.workunit.client.1.smithi149.stdout:4/271: creat d4/d6/d63/d2d/f68 x:0 0 0 2024-09-21T11:39:06.789 INFO:tasks.workunit.client.1.smithi149.stdout:6/229: symlink d8/d32/d37/l42 0 2024-09-21T11:39:06.790 INFO:tasks.workunit.client.1.smithi149.stdout:2/296: creat d8/da/d13/d2d/f6b x:0 0 0 2024-09-21T11:39:06.790 INFO:tasks.workunit.client.1.smithi149.stdout:7/359: fsync d12/f21 0 2024-09-21T11:39:06.792 INFO:tasks.workunit.client.1.smithi149.stdout:6/230: unlink d8/da/d11/l24 0 2024-09-21T11:39:06.792 INFO:tasks.workunit.client.1.smithi149.stdout:2/297: write d8/da/f2a [981190,76013] 0 2024-09-21T11:39:06.793 INFO:tasks.workunit.client.1.smithi149.stdout:5/261: unlink d4/d7/l14 0 2024-09-21T11:39:06.794 INFO:tasks.workunit.client.1.smithi149.stdout:2/298: dread d8/da/d13/d1a/d2c/f4b [0,4194304] 0 2024-09-21T11:39:06.796 INFO:tasks.workunit.client.1.smithi149.stdout:0/212: getdents dd/d2d 0 2024-09-21T11:39:06.796 INFO:tasks.workunit.client.1.smithi149.stdout:6/231: rmdir d8/da/d2c 39 2024-09-21T11:39:06.799 INFO:tasks.workunit.client.1.smithi149.stdout:6/232: truncate d8/f39 844656 0 2024-09-21T11:39:06.801 INFO:tasks.workunit.client.1.smithi149.stdout:2/299: write d8/da/d13/d1a/d3b/f51 [4332017,17033] 0 2024-09-21T11:39:06.803 INFO:tasks.workunit.client.1.smithi149.stdout:5/262: dwrite d4/d7/f38 [0,4194304] 0 2024-09-21T11:39:06.805 INFO:tasks.workunit.client.1.smithi149.stdout:6/233: unlink d8/da/d14/l17 0 2024-09-21T11:39:06.805 INFO:tasks.workunit.client.1.smithi149.stdout:0/213: dread f8 [0,4194304] 0 2024-09-21T11:39:06.807 INFO:tasks.workunit.client.1.smithi149.stdout:2/300: creat d8/d20/d57/f6c x:0 0 0 2024-09-21T11:39:06.808 INFO:tasks.workunit.client.1.smithi149.stdout:4/272: dread d4/f7 [0,4194304] 0 2024-09-21T11:39:06.808 INFO:tasks.workunit.client.1.smithi149.stdout:5/263: fsync d4/d1d/d50/d54/f35 0 2024-09-21T11:39:06.810 INFO:tasks.workunit.client.1.smithi149.stdout:2/301: dread - d8/da/d13/d2d/f6b zero size 2024-09-21T11:39:06.811 INFO:tasks.workunit.client.1.smithi149.stdout:6/234: creat d8/da/d3d/f43 x:0 0 0 2024-09-21T11:39:06.814 INFO:tasks.workunit.client.1.smithi149.stdout:4/273: symlink d4/d6/d63/d2d/l69 0 2024-09-21T11:39:06.815 INFO:tasks.workunit.client.1.smithi149.stdout:5/264: creat d4/d7/d40/d51/f5a x:0 0 0 2024-09-21T11:39:06.816 INFO:tasks.workunit.client.1.smithi149.stdout:7/360: dwrite d12/d15/d26/f65 [0,4194304] 0 2024-09-21T11:39:06.818 INFO:tasks.workunit.client.1.smithi149.stdout:6/235: stat d8/da/fc 0 2024-09-21T11:39:06.819 INFO:tasks.workunit.client.1.smithi149.stdout:4/274: readlink d4/d6/d63/d2d/l5c 0 2024-09-21T11:39:06.820 INFO:tasks.workunit.client.1.smithi149.stdout:0/214: dread dd/fe [0,4194304] 0 2024-09-21T11:39:06.823 INFO:tasks.workunit.client.1.smithi149.stdout:7/361: mknod d12/d15/d4a/d4f/c6d 0 2024-09-21T11:39:06.824 INFO:tasks.workunit.client.1.smithi149.stdout:4/275: fdatasync d4/d6/d63/d2d/f68 0 2024-09-21T11:39:06.824 INFO:tasks.workunit.client.1.smithi149.stdout:0/215: readlink dd/l21 0 2024-09-21T11:39:06.827 INFO:tasks.workunit.client.1.smithi149.stdout:6/236: rename d8/da/d14/f2a to d8/d32/d37/d28/d2e/f44 0 2024-09-21T11:39:06.828 INFO:tasks.workunit.client.1.smithi149.stdout:5/265: getdents d4/d7 0 2024-09-21T11:39:06.828 INFO:tasks.workunit.client.1.smithi149.stdout:2/302: dwrite d8/dd/f38 [0,4194304] 0 2024-09-21T11:39:06.829 INFO:tasks.workunit.client.1.smithi149.stdout:6/237: fdatasync d8/d32/d37/d28/d2e/f3b 0 2024-09-21T11:39:06.832 INFO:tasks.workunit.client.1.smithi149.stdout:0/216: unlink dd/l25 0 2024-09-21T11:39:06.832 INFO:tasks.workunit.client.1.smithi149.stdout:4/276: unlink d4/d6/d63/d2d/f68 0 2024-09-21T11:39:06.837 INFO:tasks.workunit.client.1.smithi149.stdout:5/266: mkdir d4/d4f/d5b 0 2024-09-21T11:39:06.847 INFO:tasks.workunit.client.1.smithi149.stdout:4/277: dread d4/d6/f47 [0,4194304] 0 2024-09-21T11:39:06.851 INFO:tasks.workunit.client.1.smithi149.stdout:4/278: dread d4/d6/d18/f2e [0,4194304] 0 2024-09-21T11:39:06.853 INFO:tasks.workunit.client.1.smithi149.stdout:4/279: write d4/d6/d63/d15/f49 [2139397,23397] 0 2024-09-21T11:39:06.866 INFO:tasks.workunit.client.1.smithi149.stdout:0/217: rename dd/d32/f4a to dd/d2d/f4b 0 2024-09-21T11:39:06.869 INFO:tasks.workunit.client.1.smithi149.stdout:6/238: write d8/da/fc [2795798,130768] 0 2024-09-21T11:39:06.871 INFO:tasks.workunit.client.1.smithi149.stdout:4/280: creat d4/d6/d63/d10/d31/d32/d4a/f6a x:0 0 0 2024-09-21T11:39:06.871 INFO:tasks.workunit.client.1.smithi149.stdout:4/281: chown d4/d6/f5e 99819236 1 2024-09-21T11:39:06.872 INFO:tasks.workunit.client.1.smithi149.stdout:0/218: creat dd/d1a/f4c x:0 0 0 2024-09-21T11:39:06.872 INFO:tasks.workunit.client.1.smithi149.stdout:2/303: getdents d8/da/d13/d1a/d2c 0 2024-09-21T11:39:06.872 INFO:tasks.workunit.client.1.smithi149.stdout:7/362: link d12/d35/c3b d12/d15/d26/d30/d31/d47/d49/c6e 0 2024-09-21T11:39:06.874 INFO:tasks.workunit.client.1.smithi149.stdout:7/363: stat d12/d35/l4d 0 2024-09-21T11:39:06.874 INFO:tasks.workunit.client.1.smithi149.stdout:0/219: creat dd/d35/f4d x:0 0 0 2024-09-21T11:39:06.875 INFO:tasks.workunit.client.1.smithi149.stdout:6/239: dread d8/da/d14/f31 [0,4194304] 0 2024-09-21T11:39:06.875 INFO:tasks.workunit.client.1.smithi149.stdout:2/304: chown f3 7267586 1 2024-09-21T11:39:06.878 INFO:tasks.workunit.client.1.smithi149.stdout:2/305: creat d8/da/d13/d5d/f6d x:0 0 0 2024-09-21T11:39:06.879 INFO:tasks.workunit.client.1.smithi149.stdout:2/306: stat d8/da/d13/l4d 0 2024-09-21T11:39:06.879 INFO:tasks.workunit.client.1.smithi149.stdout:0/220: creat dd/d32/d38/d3a/f4e x:0 0 0 2024-09-21T11:39:06.881 INFO:tasks.workunit.client.1.smithi149.stdout:5/267: write d4/d1d/d50/d54/f23 [3207898,3539] 0 2024-09-21T11:39:06.881 INFO:tasks.workunit.client.1.smithi149.stdout:2/307: symlink d8/d11/l6e 0 2024-09-21T11:39:06.882 INFO:tasks.workunit.client.1.smithi149.stdout:5/268: readlink d4/d1d/d3e/l47 0 2024-09-21T11:39:06.882 INFO:tasks.workunit.client.1.smithi149.stdout:2/308: chown d8/da/f28 825046799 1 2024-09-21T11:39:06.883 INFO:tasks.workunit.client.1.smithi149.stdout:5/269: readlink d4/d1d/l3d 0 2024-09-21T11:39:06.883 INFO:tasks.workunit.client.1.smithi149.stdout:2/309: fsync d8/da/d13/d1a/d29/f32 0 2024-09-21T11:39:06.884 INFO:tasks.workunit.client.1.smithi149.stdout:2/310: chown d8/da/f55 59623079 1 2024-09-21T11:39:06.884 INFO:tasks.workunit.client.1.smithi149.stdout:0/221: rename dd/d1a/f4c to dd/d2d/f4f 0 2024-09-21T11:39:06.885 INFO:tasks.workunit.client.1.smithi149.stdout:4/282: truncate d4/d6/d18/f1c 3277662 0 2024-09-21T11:39:06.885 INFO:tasks.workunit.client.1.smithi149.stdout:2/311: write d8/da/d13/d1a/f3e [7472974,48056] 0 2024-09-21T11:39:06.885 INFO:tasks.workunit.client.1.smithi149.stdout:0/222: fsync dd/f36 0 2024-09-21T11:39:06.886 INFO:tasks.workunit.client.1.smithi149.stdout:4/283: write d4/f55 [3943039,29936] 0 2024-09-21T11:39:06.886 INFO:tasks.workunit.client.1.smithi149.stdout:5/270: mkdir d4/d7/d40/d43/d5c 0 2024-09-21T11:39:06.889 INFO:tasks.workunit.client.1.smithi149.stdout:7/364: truncate d12/d15/d26/f29 1670701 0 2024-09-21T11:39:06.890 INFO:tasks.workunit.client.1.smithi149.stdout:2/312: mkdir d8/da/d13/d2d/d6f 0 2024-09-21T11:39:06.891 INFO:tasks.workunit.client.1.smithi149.stdout:4/284: mkdir d4/d6/d63/d15/d30/d6b 0 2024-09-21T11:39:06.892 INFO:tasks.workunit.client.1.smithi149.stdout:0/223: mkdir dd/d1a/d1b/d50 0 2024-09-21T11:39:06.892 INFO:tasks.workunit.client.1.smithi149.stdout:7/365: write d12/d15/d26/d30/d31/f37 [5031619,75870] 0 2024-09-21T11:39:06.894 INFO:tasks.workunit.client.1.smithi149.stdout:5/271: dwrite f2 [0,4194304] 0 2024-09-21T11:39:06.895 INFO:tasks.workunit.client.1.smithi149.stdout:4/285: dread - d4/d6/d18/f4f zero size 2024-09-21T11:39:06.897 INFO:tasks.workunit.client.1.smithi149.stdout:9/257: sync 2024-09-21T11:39:06.900 INFO:tasks.workunit.client.1.smithi149.stdout:5/272: stat d4/l26 0 2024-09-21T11:39:06.901 INFO:tasks.workunit.client.1.smithi149.stdout:4/286: write d4/d6/d63/d10/d31/f4b [717420,43946] 0 2024-09-21T11:39:06.903 INFO:tasks.workunit.client.1.smithi149.stdout:5/273: write d4/f5 [334278,99371] 0 2024-09-21T11:39:06.907 INFO:tasks.workunit.client.1.smithi149.stdout:9/258: truncate d18/d19/d1a/f23 3967949 0 2024-09-21T11:39:06.909 INFO:tasks.workunit.client.1.smithi149.stdout:0/224: dwrite dd/d32/f3c [0,4194304] 0 2024-09-21T11:39:06.910 INFO:tasks.workunit.client.1.smithi149.stdout:5/274: getdents d4/d7/d40/d43/d5c 0 2024-09-21T11:39:06.912 INFO:tasks.workunit.client.1.smithi149.stdout:5/275: chown d4/d1d/l3d 1092092 1 2024-09-21T11:39:06.913 INFO:tasks.workunit.client.1.smithi149.stdout:0/225: dread - dd/d1a/f2f zero size 2024-09-21T11:39:06.916 INFO:tasks.workunit.client.1.smithi149.stdout:0/226: mknod dd/d1a/d1b/d50/c51 0 2024-09-21T11:39:06.917 INFO:tasks.workunit.client.1.smithi149.stdout:2/313: truncate d8/da/d13/d1a/f3e 829507 0 2024-09-21T11:39:06.918 INFO:tasks.workunit.client.1.smithi149.stdout:5/276: creat d4/d7/d40/d43/d5c/f5d x:0 0 0 2024-09-21T11:39:06.918 INFO:tasks.workunit.client.1.smithi149.stdout:7/366: write d12/d15/d26/d30/d31/f60 [125887,96102] 0 2024-09-21T11:39:06.920 INFO:tasks.workunit.client.1.smithi149.stdout:2/314: symlink d8/dd/d50/l70 0 2024-09-21T11:39:06.921 INFO:tasks.workunit.client.1.smithi149.stdout:0/227: symlink dd/d32/l52 0 2024-09-21T11:39:06.922 INFO:tasks.workunit.client.1.smithi149.stdout:0/228: chown dd/d1a/f2f 47 1 2024-09-21T11:39:06.923 INFO:tasks.workunit.client.1.smithi149.stdout:5/277: creat d4/d1d/d50/f5e x:0 0 0 2024-09-21T11:39:06.924 INFO:tasks.workunit.client.1.smithi149.stdout:2/315: mknod d8/d44/c71 0 2024-09-21T11:39:06.925 INFO:tasks.workunit.client.1.smithi149.stdout:5/278: chown d4/d7/l28 5190 1 2024-09-21T11:39:06.925 INFO:tasks.workunit.client.1.smithi149.stdout:9/259: truncate fc 862808 0 2024-09-21T11:39:06.927 INFO:tasks.workunit.client.1.smithi149.stdout:0/229: rename dd/d32/d38 to dd/d1a/d1b/d50/d53 0 2024-09-21T11:39:06.929 INFO:tasks.workunit.client.1.smithi149.stdout:9/260: chown d18/d19/d1a/l2b 53312 1 2024-09-21T11:39:06.929 INFO:tasks.workunit.client.1.smithi149.stdout:5/279: dread - d4/d7/d40/f42 zero size 2024-09-21T11:39:06.931 INFO:tasks.workunit.client.1.smithi149.stdout:2/316: creat d8/da/d13/d1a/d29/f72 x:0 0 0 2024-09-21T11:39:06.933 INFO:tasks.workunit.client.1.smithi149.stdout:4/287: dwrite d4/d6/f9 [0,4194304] 0 2024-09-21T11:39:06.933 INFO:tasks.workunit.client.1.smithi149.stdout:5/280: write d4/d7/d40/f42 [94545,103994] 0 2024-09-21T11:39:06.934 INFO:tasks.workunit.client.1.smithi149.stdout:0/230: creat dd/d1a/d1b/d50/d53/f54 x:0 0 0 2024-09-21T11:39:06.936 INFO:tasks.workunit.client.1.smithi149.stdout:9/261: symlink d18/d19/d1a/d2f/d33/l51 0 2024-09-21T11:39:06.937 INFO:tasks.workunit.client.1.smithi149.stdout:9/262: fdatasync d18/d19/f40 0 2024-09-21T11:39:06.941 INFO:tasks.workunit.client.1.smithi149.stdout:2/317: creat d8/da/d13/d1a/d2c/d5a/f73 x:0 0 0 2024-09-21T11:39:06.943 INFO:tasks.workunit.client.1.smithi149.stdout:5/281: creat d4/d7/d40/d43/f5f x:0 0 0 2024-09-21T11:39:06.943 INFO:tasks.workunit.client.1.smithi149.stdout:4/288: mknod d4/d6/d63/d15/d30/c6c 0 2024-09-21T11:39:06.943 INFO:tasks.workunit.client.1.smithi149.stdout:7/367: dread f1 [0,4194304] 0 2024-09-21T11:39:06.944 INFO:tasks.workunit.client.1.smithi149.stdout:2/318: creat d8/dd/f74 x:0 0 0 2024-09-21T11:39:06.946 INFO:tasks.workunit.client.1.smithi149.stdout:0/231: link dd/f36 dd/d1a/d1b/d50/f55 0 2024-09-21T11:39:06.948 INFO:tasks.workunit.client.1.smithi149.stdout:2/319: rmdir d8/da 39 2024-09-21T11:39:06.950 INFO:tasks.workunit.client.1.smithi149.stdout:7/368: creat d12/d15/d26/d30/d31/f6f x:0 0 0 2024-09-21T11:39:06.950 INFO:tasks.workunit.client.1.smithi149.stdout:4/289: dwrite d4/d6/f56 [0,4194304] 0 2024-09-21T11:39:06.951 INFO:tasks.workunit.client.1.smithi149.stdout:4/290: stat d4/d4d/d58 0 2024-09-21T11:39:06.953 INFO:tasks.workunit.client.1.smithi149.stdout:4/291: write d4/d6/d18/f2a [986253,592] 0 2024-09-21T11:39:06.955 INFO:tasks.workunit.client.1.smithi149.stdout:2/320: stat d8/da/d13 0 2024-09-21T11:39:06.955 INFO:tasks.workunit.client.1.smithi149.stdout:5/282: getdents d4/d1d/d50 0 2024-09-21T11:39:06.955 INFO:tasks.workunit.client.1.smithi149.stdout:7/369: truncate d12/d15/d26/d30/d31/f60 1116593 0 2024-09-21T11:39:06.956 INFO:tasks.workunit.client.1.smithi149.stdout:0/232: truncate dd/d1a/f2e 677570 0 2024-09-21T11:39:06.957 INFO:tasks.workunit.client.1.smithi149.stdout:4/292: chown d4/d6/d63/d10/l41 6059838 1 2024-09-21T11:39:06.958 INFO:tasks.workunit.client.1.smithi149.stdout:0/233: read dd/d2d/f43 [511671,1605] 0 2024-09-21T11:39:06.959 INFO:tasks.workunit.client.1.smithi149.stdout:5/283: mkdir d4/d1d/d50/d60 0 2024-09-21T11:39:06.959 INFO:tasks.workunit.client.1.smithi149.stdout:0/234: chown dd/l21 7639740 1 2024-09-21T11:39:06.959 INFO:tasks.workunit.client.1.smithi149.stdout:7/370: write d12/d15/d26/d30/d31/f3f [3605544,35666] 0 2024-09-21T11:39:06.959 INFO:tasks.workunit.client.1.smithi149.stdout:5/284: readlink d4/d7/l1b 0 2024-09-21T11:39:06.960 INFO:tasks.workunit.client.1.smithi149.stdout:2/321: creat d8/d44/d63/f75 x:0 0 0 2024-09-21T11:39:06.961 INFO:tasks.workunit.client.1.smithi149.stdout:2/322: chown d8/da/d13/d1a/d3b/f61 4415 1 2024-09-21T11:39:06.962 INFO:tasks.workunit.client.1.smithi149.stdout:4/293: rmdir d4/d6/d63/d15 39 2024-09-21T11:39:06.963 INFO:tasks.workunit.client.1.smithi149.stdout:7/371: mkdir d12/d70 0 2024-09-21T11:39:06.964 INFO:tasks.workunit.client.1.smithi149.stdout:7/372: write d12/d15/f5f [83220,5194] 0 2024-09-21T11:39:06.965 INFO:tasks.workunit.client.1.smithi149.stdout:5/285: symlink d4/d1d/d3e/l61 0 2024-09-21T11:39:06.966 INFO:tasks.workunit.client.1.smithi149.stdout:2/323: creat d8/dd/d5c/f76 x:0 0 0 2024-09-21T11:39:06.968 INFO:tasks.workunit.client.1.smithi149.stdout:7/373: mknod d12/d15/d26/d30/d31/c71 0 2024-09-21T11:39:06.970 INFO:tasks.workunit.client.1.smithi149.stdout:7/374: readlink d12/d15/l2a 0 2024-09-21T11:39:06.970 INFO:tasks.workunit.client.1.smithi149.stdout:2/324: symlink d8/da/d13/l77 0 2024-09-21T11:39:06.975 INFO:tasks.workunit.client.1.smithi149.stdout:7/375: creat d12/d15/d4a/f72 x:0 0 0 2024-09-21T11:39:06.975 INFO:tasks.workunit.client.1.smithi149.stdout:0/235: truncate dd/f19 1758127 0 2024-09-21T11:39:06.975 INFO:tasks.workunit.client.1.smithi149.stdout:2/325: stat d8/da/d13/d1a/d2c 0 2024-09-21T11:39:06.976 INFO:tasks.workunit.client.1.smithi149.stdout:5/286: dwrite d4/d7/fa [0,4194304] 0 2024-09-21T11:39:06.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/326: rmdir d8 39 2024-09-21T11:39:06.978 INFO:tasks.workunit.client.1.smithi149.stdout:0/236: creat dd/d2d/f56 x:0 0 0 2024-09-21T11:39:06.980 INFO:tasks.workunit.client.1.smithi149.stdout:4/294: dwrite d4/d6/d63/d15/f49 [0,4194304] 0 2024-09-21T11:39:06.980 INFO:tasks.workunit.client.1.smithi149.stdout:5/287: read - d4/d7/d40/d51/f58 zero size 2024-09-21T11:39:06.983 INFO:tasks.workunit.client.1.smithi149.stdout:5/288: write d4/d1d/d50/f5e [144007,58917] 0 2024-09-21T11:39:06.990 INFO:tasks.workunit.client.1.smithi149.stdout:2/327: mkdir d8/d20/d78 0 2024-09-21T11:39:06.990 INFO:tasks.workunit.client.1.smithi149.stdout:7/376: rename d12/d15/d26/d30/d31/d47/d49/f67 to d12/d35/f73 0 2024-09-21T11:39:06.993 INFO:tasks.workunit.client.1.smithi149.stdout:4/295: link d4/d6/d63/d10/d31/f40 d4/d6/d63/d15/d30/f6d 0 2024-09-21T11:39:06.995 INFO:tasks.workunit.client.1.smithi149.stdout:7/377: write d12/f21 [4778909,41234] 0 2024-09-21T11:39:06.997 INFO:tasks.workunit.client.1.smithi149.stdout:2/328: mknod d8/c79 0 2024-09-21T11:39:06.998 INFO:tasks.workunit.client.1.smithi149.stdout:0/237: dwrite dd/d2d/f56 [0,4194304] 0 2024-09-21T11:39:07.005 INFO:tasks.workunit.client.1.smithi149.stdout:2/329: rmdir d8/da/d13/d1a/d2c 39 2024-09-21T11:39:07.007 INFO:tasks.workunit.client.1.smithi149.stdout:5/289: dwrite d4/d7/f32 [0,4194304] 0 2024-09-21T11:39:07.013 INFO:tasks.workunit.client.1.smithi149.stdout:8/245: sync 2024-09-21T11:39:07.014 INFO:tasks.workunit.client.1.smithi149.stdout:1/255: sync 2024-09-21T11:39:07.015 INFO:tasks.workunit.client.1.smithi149.stdout:8/246: chown d3 4 1 2024-09-21T11:39:07.017 INFO:tasks.workunit.client.1.smithi149.stdout:7/378: dread d12/f21 [0,4194304] 0 2024-09-21T11:39:07.024 INFO:tasks.workunit.client.1.smithi149.stdout:1/256: mknod d2/d2b/c4f 0 2024-09-21T11:39:07.024 INFO:tasks.workunit.client.1.smithi149.stdout:8/247: rmdir d3/d33/d34 39 2024-09-21T11:39:07.025 INFO:tasks.workunit.client.1.smithi149.stdout:4/296: dwrite d4/d6/d63/d15/d30/f53 [0,4194304] 0 2024-09-21T11:39:07.026 INFO:tasks.workunit.client.1.smithi149.stdout:0/238: dwrite dd/d32/f3c [0,4194304] 0 2024-09-21T11:39:07.029 INFO:tasks.workunit.client.1.smithi149.stdout:8/248: write d3/d3c/d4c/f53 [465606,36493] 0 2024-09-21T11:39:07.029 INFO:tasks.workunit.client.1.smithi149.stdout:7/379: rename d12/d15/f5f to d12/f74 0 2024-09-21T11:39:07.029 INFO:tasks.workunit.client.1.smithi149.stdout:1/257: mknod d2/c50 0 2024-09-21T11:39:07.030 INFO:tasks.workunit.client.1.smithi149.stdout:0/239: fsync dd/d2d/f4b 0 2024-09-21T11:39:07.033 INFO:tasks.workunit.client.1.smithi149.stdout:1/258: dread - d2/dd/d35/d1c/f39 zero size 2024-09-21T11:39:07.033 INFO:tasks.workunit.client.1.smithi149.stdout:7/380: mkdir d12/d15/d4a/d4f/d75 0 2024-09-21T11:39:07.034 INFO:tasks.workunit.client.1.smithi149.stdout:4/297: read d4/d6/fb [301579,129295] 0 2024-09-21T11:39:07.036 INFO:tasks.workunit.client.1.smithi149.stdout:7/381: chown d12/d15/d68 1850122138 1 2024-09-21T11:39:07.037 INFO:tasks.workunit.client.1.smithi149.stdout:7/382: chown d12/d15/d26 104 1 2024-09-21T11:39:07.038 INFO:tasks.workunit.client.1.smithi149.stdout:5/290: dwrite d4/d7/d40/d43/d5c/f5d [0,4194304] 0 2024-09-21T11:39:07.040 INFO:tasks.workunit.client.1.smithi149.stdout:7/383: dread - d12/d15/d26/d30/d31/f6f zero size 2024-09-21T11:39:07.041 INFO:tasks.workunit.client.1.smithi149.stdout:8/249: rename d3/dd/d18/f49 to d3/d33/d34/d55/f59 0 2024-09-21T11:39:07.046 INFO:tasks.workunit.client.1.smithi149.stdout:1/259: mkdir d2/dd/d35/d1c/d41/d51 0 2024-09-21T11:39:07.046 INFO:tasks.workunit.client.1.smithi149.stdout:7/384: read d12/d15/d26/d30/d31/f3f [3335835,108893] 0 2024-09-21T11:39:07.049 INFO:tasks.workunit.client.1.smithi149.stdout:4/298: rename d4/d6/d63/d10/f5b to d4/d6/d63/d2d/f6e 0 2024-09-21T11:39:07.052 INFO:tasks.workunit.client.1.smithi149.stdout:8/250: dwrite d3/dd/d21/d54/f56 [0,4194304] 0 2024-09-21T11:39:07.057 INFO:tasks.workunit.client.1.smithi149.stdout:7/385: creat d12/d15/d4a/f76 x:0 0 0 2024-09-21T11:39:07.062 INFO:tasks.workunit.client.1.smithi149.stdout:8/251: unlink d3/dd/d21/l31 0 2024-09-21T11:39:07.063 INFO:tasks.workunit.client.1.smithi149.stdout:0/240: dwrite dd/d2d/f4f [0,4194304] 0 2024-09-21T11:39:07.074 INFO:tasks.workunit.client.1.smithi149.stdout:4/299: dwrite d4/d6/d63/d10/d31/f4b [0,4194304] 0 2024-09-21T11:39:07.074 INFO:tasks.workunit.client.1.smithi149.stdout:0/241: dread dd/d2d/f56 [0,4194304] 0 2024-09-21T11:39:07.087 INFO:tasks.workunit.client.1.smithi149.stdout:4/300: stat d4/d6/d18/f1c 0 2024-09-21T11:39:07.088 INFO:tasks.workunit.client.1.smithi149.stdout:5/291: truncate f2 4447377 0 2024-09-21T11:39:07.089 INFO:tasks.workunit.client.1.smithi149.stdout:5/292: chown d4/d1d/d3e/l47 0 1 2024-09-21T11:39:07.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/242: creat dd/d1a/d1b/d50/f57 x:0 0 0 2024-09-21T11:39:07.092 INFO:tasks.workunit.client.1.smithi149.stdout:7/386: creat d12/d15/d4a/d4f/d75/f77 x:0 0 0 2024-09-21T11:39:07.093 INFO:tasks.workunit.client.1.smithi149.stdout:7/387: chown d12/d15/f32 249220372 1 2024-09-21T11:39:07.098 INFO:tasks.workunit.client.1.smithi149.stdout:0/243: symlink dd/d35/l58 0 2024-09-21T11:39:07.098 INFO:tasks.workunit.client.1.smithi149.stdout:1/260: write d2/d5/d8/f17 [984383,68861] 0 2024-09-21T11:39:07.103 INFO:tasks.workunit.client.1.smithi149.stdout:4/301: dread d4/d6/f59 [0,4194304] 0 2024-09-21T11:39:07.104 INFO:tasks.workunit.client.1.smithi149.stdout:0/244: unlink dd/c11 0 2024-09-21T11:39:07.104 INFO:tasks.workunit.client.1.smithi149.stdout:4/302: write d4/f55 [247545,87690] 0 2024-09-21T11:39:07.105 INFO:tasks.workunit.client.1.smithi149.stdout:6/240: sync 2024-09-21T11:39:07.105 INFO:tasks.workunit.client.1.smithi149.stdout:3/311: sync 2024-09-21T11:39:07.105 INFO:tasks.workunit.client.1.smithi149.stdout:9/263: sync 2024-09-21T11:39:07.110 INFO:tasks.workunit.client.1.smithi149.stdout:4/303: mkdir d4/d6/d63/d10/d6f 0 2024-09-21T11:39:07.112 INFO:tasks.workunit.client.1.smithi149.stdout:6/241: write d8/d32/d37/d28/f30 [489894,12698] 0 2024-09-21T11:39:07.113 INFO:tasks.workunit.client.1.smithi149.stdout:1/261: dread d2/f1e [0,4194304] 0 2024-09-21T11:39:07.116 INFO:tasks.workunit.client.1.smithi149.stdout:4/304: chown d4/d6/d63/d15/f54 554793 1 2024-09-21T11:39:07.118 INFO:tasks.workunit.client.1.smithi149.stdout:0/245: dwrite f8 [4194304,4194304] 0 2024-09-21T11:39:07.119 INFO:tasks.workunit.client.1.smithi149.stdout:1/262: truncate d2/dd/d2e/f33 4506984 0 2024-09-21T11:39:07.124 INFO:tasks.workunit.client.1.smithi149.stdout:4/305: creat d4/d6/d63/d15/d16/d23/d5d/f70 x:0 0 0 2024-09-21T11:39:07.125 INFO:tasks.workunit.client.1.smithi149.stdout:1/263: creat d2/dd/d2e/d4c/f52 x:0 0 0 2024-09-21T11:39:07.126 INFO:tasks.workunit.client.1.smithi149.stdout:0/246: rename dd/d1a/d1b/c1d to dd/d1a/d1b/d50/d53/d3a/c59 0 2024-09-21T11:39:07.127 INFO:tasks.workunit.client.1.smithi149.stdout:4/306: mkdir d4/d4d/d5f/d71 0 2024-09-21T11:39:07.128 INFO:tasks.workunit.client.1.smithi149.stdout:0/247: stat dd/d1a/d1b/f27 0 2024-09-21T11:39:07.130 INFO:tasks.workunit.client.1.smithi149.stdout:1/264: rename d2/d5/d8/c14 to d2/dd/d35/d1c/d2c/c53 0 2024-09-21T11:39:07.132 INFO:tasks.workunit.client.1.smithi149.stdout:0/248: mkdir dd/d1a/d5a 0 2024-09-21T11:39:07.134 INFO:tasks.workunit.client.1.smithi149.stdout:1/265: mknod d2/d5/d3d/c54 0 2024-09-21T11:39:07.134 INFO:tasks.workunit.client.1.smithi149.stdout:0/249: readlink dd/l3e 0 2024-09-21T11:39:07.135 INFO:tasks.workunit.client.1.smithi149.stdout:1/266: write d2/f1a [561694,23966] 0 2024-09-21T11:39:07.135 INFO:tasks.workunit.client.1.smithi149.stdout:4/307: creat d4/d6/d63/d15/d30/d6b/f72 x:0 0 0 2024-09-21T11:39:07.136 INFO:tasks.workunit.client.1.smithi149.stdout:0/250: chown dd/l21 135 1 2024-09-21T11:39:07.138 INFO:tasks.workunit.client.1.smithi149.stdout:0/251: dread - dd/d1a/d1b/d50/d53/f54 zero size 2024-09-21T11:39:07.142 INFO:tasks.workunit.client.1.smithi149.stdout:0/252: creat dd/d1a/d1b/d50/d53/d3a/f5b x:0 0 0 2024-09-21T11:39:07.146 INFO:tasks.workunit.client.1.smithi149.stdout:0/253: dread - dd/d1a/d1b/d50/d53/d3a/f5b zero size 2024-09-21T11:39:07.146 INFO:tasks.workunit.client.1.smithi149.stdout:4/308: dwrite d4/d6/d63/d15/d30/f53 [0,4194304] 0 2024-09-21T11:39:07.154 INFO:tasks.workunit.client.1.smithi149.stdout:8/252: dwrite d3/dd/f3f [0,4194304] 0 2024-09-21T11:39:07.156 INFO:tasks.workunit.client.1.smithi149.stdout:0/254: creat dd/d1a/d1b/d50/d53/f5c x:0 0 0 2024-09-21T11:39:07.159 INFO:tasks.workunit.client.1.smithi149.stdout:6/242: write f4 [3234694,112118] 0 2024-09-21T11:39:07.162 INFO:tasks.workunit.client.1.smithi149.stdout:8/253: dwrite d3/f20 [4194304,4194304] 0 2024-09-21T11:39:07.163 INFO:tasks.workunit.client.1.smithi149.stdout:8/254: readlink d3/dd/d18/l22 0 2024-09-21T11:39:07.164 INFO:tasks.workunit.client.1.smithi149.stdout:9/264: truncate d18/d19/d1a/d2f/f3d 2426362 0 2024-09-21T11:39:07.164 INFO:tasks.workunit.client.1.smithi149.stdout:8/255: chown d3/dd/d3a/l50 123719 1 2024-09-21T11:39:07.166 INFO:tasks.workunit.client.1.smithi149.stdout:8/256: chown d3/d12/l29 5745649 1 2024-09-21T11:39:07.173 INFO:tasks.workunit.client.1.smithi149.stdout:8/257: unlink d3/d3c/d4c/f53 0 2024-09-21T11:39:07.176 INFO:tasks.workunit.client.1.smithi149.stdout:6/243: creat d8/da/d2c/d2d/f45 x:0 0 0 2024-09-21T11:39:07.179 INFO:tasks.workunit.client.1.smithi149.stdout:8/258: rename d3/d12/l29 to d3/d12/l5a 0 2024-09-21T11:39:07.181 INFO:tasks.workunit.client.1.smithi149.stdout:9/265: getdents d18/d36/d3c/d47 0 2024-09-21T11:39:07.183 INFO:tasks.workunit.client.1.smithi149.stdout:8/259: truncate d3/f4f 3897142 0 2024-09-21T11:39:07.184 INFO:tasks.workunit.client.1.smithi149.stdout:3/312: unlink d6/f56 0 2024-09-21T11:39:07.186 INFO:tasks.workunit.client.1.smithi149.stdout:6/244: dwrite d8/d32/d37/d28/f33 [0,4194304] 0 2024-09-21T11:39:07.190 INFO:tasks.workunit.client.1.smithi149.stdout:9/266: rename d18/l1e to d18/d4c/l52 0 2024-09-21T11:39:07.194 INFO:tasks.workunit.client.1.smithi149.stdout:6/245: write d8/d32/d37/d28/d2e/f44 [636561,43717] 0 2024-09-21T11:39:07.197 INFO:tasks.workunit.client.1.smithi149.stdout:9/267: unlink d18/d19/d29/d39/l3b 0 2024-09-21T11:39:07.198 INFO:tasks.workunit.client.1.smithi149.stdout:6/246: read d8/da/d11/f26 [1915807,66364] 0 2024-09-21T11:39:07.202 INFO:tasks.workunit.client.1.smithi149.stdout:1/267: creat d2/d5/f55 x:0 0 0 2024-09-21T11:39:07.203 INFO:tasks.workunit.client.1.smithi149.stdout:9/268: rmdir d18/d19/d1a/d2f/d33 39 2024-09-21T11:39:07.208 INFO:tasks.workunit.client.1.smithi149.stdout:9/269: chown l14 317393 1 2024-09-21T11:39:07.210 INFO:tasks.workunit.client.1.smithi149.stdout:5/293: dwrite f2 [4194304,4194304] 0 2024-09-21T11:39:07.211 INFO:tasks.workunit.client.1.smithi149.stdout:3/313: getdents d6/d1f/d27 0 2024-09-21T11:39:07.221 INFO:tasks.workunit.client.1.smithi149.stdout:6/247: dwrite d8/da/fd [0,4194304] 0 2024-09-21T11:39:07.222 INFO:tasks.workunit.client.1.smithi149.stdout:3/314: write d6/f9 [203211,44527] 0 2024-09-21T11:39:07.224 INFO:tasks.workunit.client.1.smithi149.stdout:1/268: dwrite d2/f21 [0,4194304] 0 2024-09-21T11:39:07.225 INFO:tasks.workunit.client.1.smithi149.stdout:2/330: sync 2024-09-21T11:39:07.225 INFO:tasks.workunit.client.1.smithi149.stdout:5/294: rename d4/d1d/d3e/l47 to d4/d7/d40/d51/l62 0 2024-09-21T11:39:07.230 INFO:tasks.workunit.client.1.smithi149.stdout:2/331: fdatasync d8/dd/f5f 0 2024-09-21T11:39:07.239 INFO:tasks.workunit.client.1.smithi149.stdout:9/270: dwrite d18/d1c/f4f [0,4194304] 0 2024-09-21T11:39:07.242 INFO:tasks.workunit.client.1.smithi149.stdout:3/315: chown d6/fa 41246 1 2024-09-21T11:39:07.249 INFO:tasks.workunit.client.1.smithi149.stdout:8/260: write d3/fa [1015197,73299] 0 2024-09-21T11:39:07.250 INFO:tasks.workunit.client.1.smithi149.stdout:1/269: dread d2/dd/f12 [0,4194304] 0 2024-09-21T11:39:07.251 INFO:tasks.workunit.client.1.smithi149.stdout:8/261: stat d3/dd/d3a 0 2024-09-21T11:39:07.251 INFO:tasks.workunit.client.1.smithi149.stdout:5/295: dwrite d4/d7/f4e [0,4194304] 0 2024-09-21T11:39:07.251 INFO:tasks.workunit.client.1.smithi149.stdout:7/388: sync 2024-09-21T11:39:07.252 INFO:tasks.workunit.client.1.smithi149.stdout:4/309: sync 2024-09-21T11:39:07.255 INFO:tasks.workunit.client.1.smithi149.stdout:9/271: mkdir d18/d19/d1a/d2f/d53 0 2024-09-21T11:39:07.257 INFO:tasks.workunit.client.1.smithi149.stdout:6/248: dwrite d8/d32/d37/d28/f30 [0,4194304] 0 2024-09-21T11:39:07.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/270: chown d2/d5/c27 69808 1 2024-09-21T11:39:07.259 INFO:tasks.workunit.client.1.smithi149.stdout:0/255: mkdir dd/d1a/d1b/d50/d5d 0 2024-09-21T11:39:07.264 INFO:tasks.workunit.client.1.smithi149.stdout:2/332: rename d8/da/d13/d1a/d29/l4f to d8/da/d13/l7a 0 2024-09-21T11:39:07.264 INFO:tasks.workunit.client.1.smithi149.stdout:1/271: read d2/d5/d8/d3b/f3e [24282,73730] 0 2024-09-21T11:39:07.267 INFO:tasks.workunit.client.1.smithi149.stdout:8/262: symlink d3/dd/d21/l5b 0 2024-09-21T11:39:07.268 INFO:tasks.workunit.client.1.smithi149.stdout:3/316: dread f3 [0,4194304] 0 2024-09-21T11:39:07.269 INFO:tasks.workunit.client.1.smithi149.stdout:4/310: creat d4/d6/d18/f73 x:0 0 0 2024-09-21T11:39:07.270 INFO:tasks.workunit.client.1.smithi149.stdout:2/333: readlink d8/d20/d57/l65 0 2024-09-21T11:39:07.271 INFO:tasks.workunit.client.1.smithi149.stdout:6/249: creat d8/d32/f46 x:0 0 0 2024-09-21T11:39:07.276 INFO:tasks.workunit.client.1.smithi149.stdout:8/263: read d3/dd/d21/f4d [64133,46603] 0 2024-09-21T11:39:07.277 INFO:tasks.workunit.client.1.smithi149.stdout:1/272: read - d2/d5/d8/f48 zero size 2024-09-21T11:39:07.278 INFO:tasks.workunit.client.1.smithi149.stdout:0/256: mkdir dd/d1a/d5a/d5e 0 2024-09-21T11:39:07.278 INFO:tasks.workunit.client.1.smithi149.stdout:5/296: dwrite d4/d7/f31 [4194304,4194304] 0 2024-09-21T11:39:07.278 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:06 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:39:07.280 INFO:tasks.workunit.client.1.smithi149.stdout:6/250: symlink d8/da/d3d/l47 0 2024-09-21T11:39:07.281 INFO:tasks.workunit.client.1.smithi149.stdout:2/334: mknod d8/dd/d5c/d60/c7b 0 2024-09-21T11:39:07.286 INFO:tasks.workunit.client.1.smithi149.stdout:7/389: dwrite ff [4194304,4194304] 0 2024-09-21T11:39:07.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/273: creat d2/dd/d2e/d4c/f56 x:0 0 0 2024-09-21T11:39:07.294 INFO:tasks.workunit.client.1.smithi149.stdout:7/390: fdatasync fa 0 2024-09-21T11:39:07.296 INFO:tasks.workunit.client.1.smithi149.stdout:6/251: chown d8/d32/d37/d28/f30 12388744 1 2024-09-21T11:39:07.300 INFO:tasks.workunit.client.1.smithi149.stdout:4/311: dwrite d4/d6/d18/f4f [0,4194304] 0 2024-09-21T11:39:07.302 INFO:tasks.workunit.client.1.smithi149.stdout:6/252: creat d8/f48 x:0 0 0 2024-09-21T11:39:07.305 INFO:tasks.workunit.client.1.smithi149.stdout:1/274: chown d2/dd/d35/d1c/d2c/c53 31906 1 2024-09-21T11:39:07.306 INFO:tasks.workunit.client.1.smithi149.stdout:3/317: dwrite d6/d1f/d47/f26 [0,4194304] 0 2024-09-21T11:39:07.307 INFO:tasks.workunit.client.1.smithi149.stdout:0/257: rename dd/d1a/d1b/d50/f55 to dd/d1a/d1b/d50/d53/f5f 0 2024-09-21T11:39:07.310 INFO:tasks.workunit.client.1.smithi149.stdout:4/312: fdatasync d4/d6/d63/d15/d30/d6b/f72 0 2024-09-21T11:39:07.311 INFO:tasks.workunit.client.1.smithi149.stdout:8/264: dwrite d3/f20 [4194304,4194304] 0 2024-09-21T11:39:07.316 INFO:tasks.workunit.client.1.smithi149.stdout:1/275: write d2/d5/d8/f40 [2108350,112692] 0 2024-09-21T11:39:07.317 INFO:tasks.workunit.client.1.smithi149.stdout:3/318: chown d6/d1f/f3e 1028418 1 2024-09-21T11:39:07.317 INFO:tasks.workunit.client.1.smithi149.stdout:2/335: dread d8/da/d13/d1a/f3e [0,4194304] 0 2024-09-21T11:39:07.318 INFO:tasks.workunit.client.1.smithi149.stdout:0/258: mknod dd/d35/c60 0 2024-09-21T11:39:07.323 INFO:tasks.workunit.client.1.smithi149.stdout:8/265: unlink d3/d12/l2a 0 2024-09-21T11:39:07.326 INFO:tasks.workunit.client.1.smithi149.stdout:6/253: dwrite d8/da/d14/f27 [0,4194304] 0 2024-09-21T11:39:07.329 INFO:tasks.workunit.client.1.smithi149.stdout:3/319: chown d6/d1f/d47/c20 24 1 2024-09-21T11:39:07.331 INFO:tasks.workunit.client.1.smithi149.stdout:0/259: symlink dd/d1a/d1b/d50/d53/d3a/l61 0 2024-09-21T11:39:07.334 INFO:tasks.workunit.client.1.smithi149.stdout:3/320: chown d6/d1f/d47/c6e 0 1 2024-09-21T11:39:07.337 INFO:tasks.workunit.client.1.smithi149.stdout:4/313: creat d4/d6/d63/d10/d6f/f74 x:0 0 0 2024-09-21T11:39:07.338 INFO:tasks.workunit.client.1.smithi149.stdout:8/266: mkdir d3/dd/d21/d54/d5c 0 2024-09-21T11:39:07.339 INFO:tasks.workunit.client.1.smithi149.stdout:9/272: dread d18/d19/d1a/f23 [0,4194304] 0 2024-09-21T11:39:07.339 INFO:tasks.workunit.client.1.smithi149.stdout:1/276: creat d2/dd/d35/d1c/d41/d51/f57 x:0 0 0 2024-09-21T11:39:07.339 INFO:tasks.workunit.client.1.smithi149.stdout:2/336: dwrite d8/dd/f38 [4194304,4194304] 0 2024-09-21T11:39:07.340 INFO:tasks.workunit.client.1.smithi149.stdout:6/254: creat d8/d32/d37/f49 x:0 0 0 2024-09-21T11:39:07.348 INFO:tasks.workunit.client.1.smithi149.stdout:0/260: dread f8 [0,4194304] 0 2024-09-21T11:39:07.349 INFO:tasks.workunit.client.1.smithi149.stdout:1/277: creat d2/dd/d35/f58 x:0 0 0 2024-09-21T11:39:07.350 INFO:tasks.workunit.client.1.smithi149.stdout:9/273: mkdir d18/d19/d1a/d2f/d30/d54 0 2024-09-21T11:39:07.351 INFO:tasks.workunit.client.1.smithi149.stdout:4/314: mknod d4/d6/d63/d15/d16/d23/d62/c75 0 2024-09-21T11:39:07.353 INFO:tasks.workunit.client.1.smithi149.stdout:2/337: mkdir d8/d20/d78/d7c 0 2024-09-21T11:39:07.354 INFO:tasks.workunit.client.1.smithi149.stdout:1/278: rmdir d2/dd/d35/d1c/d2c 39 2024-09-21T11:39:07.360 INFO:tasks.workunit.client.1.smithi149.stdout:1/279: rmdir d2/d2b 39 2024-09-21T11:39:07.362 INFO:tasks.workunit.client.1.smithi149.stdout:7/391: truncate ff 1688413 0 2024-09-21T11:39:07.366 INFO:tasks.workunit.client.1.smithi149.stdout:1/280: stat d2/d5/f34 0 2024-09-21T11:39:07.366 INFO:tasks.workunit.client.1.smithi149.stdout:3/321: dwrite d6/ff [0,4194304] 0 2024-09-21T11:39:07.369 INFO:tasks.workunit.client.1.smithi149.stdout:2/338: mknod d8/da/d13/d1a/c7d 0 2024-09-21T11:39:07.369 INFO:tasks.workunit.client.1.smithi149.stdout:6/255: dwrite d8/da/d2c/d2d/f45 [0,4194304] 0 2024-09-21T11:39:07.379 INFO:tasks.workunit.client.1.smithi149.stdout:9/274: dwrite d18/d19/f20 [0,4194304] 0 2024-09-21T11:39:07.379 INFO:tasks.workunit.client.1.smithi149.stdout:4/315: dwrite d4/d6/f9 [0,4194304] 0 2024-09-21T11:39:07.383 INFO:tasks.workunit.client.1.smithi149.stdout:1/281: readlink d2/d5/d8/l10 0 2024-09-21T11:39:07.389 INFO:tasks.workunit.client.1.smithi149.stdout:5/297: sync 2024-09-21T11:39:07.389 INFO:tasks.workunit.client.1.smithi149.stdout:8/267: truncate d3/dd/f3f 2018564 0 2024-09-21T11:39:07.389 INFO:tasks.workunit.client.1.smithi149.stdout:0/261: dwrite dd/d1a/d1b/d50/d53/d3a/f5b [0,4194304] 0 2024-09-21T11:39:07.389 INFO:tasks.workunit.client.1.smithi149.stdout:1/282: fdatasync d2/f2d 0 2024-09-21T11:39:07.393 INFO:tasks.workunit.client.1.smithi149.stdout:3/322: mknod d6/d1f/d47/d37/d3a/c76 0 2024-09-21T11:39:07.402 INFO:tasks.workunit.client.1.smithi149.stdout:4/316: dread d4/d6/d63/d15/f49 [0,4194304] 0 2024-09-21T11:39:07.402 INFO:tasks.workunit.client.1.smithi149.stdout:4/317: chown d4/d4d/l5a 4867 1 2024-09-21T11:39:07.402 INFO:tasks.workunit.client.1.smithi149.stdout:7/392: mknod d12/d15/d68/c78 0 2024-09-21T11:39:07.402 INFO:tasks.workunit.client.1.smithi149.stdout:6/256: mkdir d8/d32/d37/d2b/d4a 0 2024-09-21T11:39:07.402 INFO:tasks.workunit.client.1.smithi149.stdout:3/323: unlink d6/d1f/d47/c45 0 2024-09-21T11:39:07.404 INFO:tasks.workunit.client.1.smithi149.stdout:0/262: symlink dd/d1a/l62 0 2024-09-21T11:39:07.405 INFO:tasks.workunit.client.1.smithi149.stdout:6/257: dread - d8/da/d3d/f43 zero size 2024-09-21T11:39:07.406 INFO:tasks.workunit.client.1.smithi149.stdout:9/275: truncate d18/f2a 444221 0 2024-09-21T11:39:07.407 INFO:tasks.workunit.client.1.smithi149.stdout:5/298: dwrite f2 [0,4194304] 0 2024-09-21T11:39:07.408 INFO:tasks.workunit.client.1.smithi149.stdout:6/258: chown d8/f48 0 1 2024-09-21T11:39:07.408 INFO:tasks.workunit.client.1.smithi149.stdout:4/318: mkdir d4/d6/d63/d15/d30/d6b/d76 0 2024-09-21T11:39:07.409 INFO:tasks.workunit.client.1.smithi149.stdout:0/263: write dd/d1a/f2f [989881,99086] 0 2024-09-21T11:39:07.409 INFO:tasks.workunit.client.1.smithi149.stdout:3/324: chown d6/d1f/d47/d37/d3f/f44 264221625 1 2024-09-21T11:39:07.411 INFO:tasks.workunit.client.1.smithi149.stdout:2/339: link d8/dd/f24 d8/da/d13/f7e 0 2024-09-21T11:39:07.416 INFO:tasks.workunit.client.1.smithi149.stdout:6/259: write d8/d32/d37/f3c [720370,127502] 0 2024-09-21T11:39:07.416 INFO:tasks.workunit.client.1.smithi149.stdout:9/276: truncate d18/d36/d3c/f3f 354192 0 2024-09-21T11:39:07.420 INFO:tasks.workunit.client.1.smithi149.stdout:9/277: readlink d18/l3a 0 2024-09-21T11:39:07.420 INFO:tasks.workunit.client.1.smithi149.stdout:7/393: dread d12/d15/d26/d30/d31/f60 [0,4194304] 0 2024-09-21T11:39:07.420 INFO:tasks.workunit.client.1.smithi149.stdout:6/260: symlink d8/d32/l4b 0 2024-09-21T11:39:07.420 INFO:tasks.workunit.client.1.smithi149.stdout:0/264: dread - dd/d1a/d1b/d50/d53/f54 zero size 2024-09-21T11:39:07.421 INFO:tasks.workunit.client.1.smithi149.stdout:2/340: creat d8/da/d13/d5d/f7f x:0 0 0 2024-09-21T11:39:07.422 INFO:tasks.workunit.client.1.smithi149.stdout:4/319: symlink d4/d6/d63/d2d/l77 0 2024-09-21T11:39:07.423 INFO:tasks.workunit.client.1.smithi149.stdout:1/283: dread d2/dd/f22 [0,4194304] 0 2024-09-21T11:39:07.424 INFO:tasks.workunit.client.1.smithi149.stdout:6/261: chown d8/da/d11/l3f 51047346 1 2024-09-21T11:39:07.425 INFO:tasks.workunit.client.1.smithi149.stdout:0/265: fsync dd/d1a/d1b/d50/d53/d3a/f4e 0 2024-09-21T11:39:07.426 INFO:tasks.workunit.client.1.smithi149.stdout:2/341: write d8/da/d13/d1a/d29/f72 [142876,58656] 0 2024-09-21T11:39:07.426 INFO:tasks.workunit.client.1.smithi149.stdout:9/278: mkdir d18/d19/d1a/d2f/d33/d55 0 2024-09-21T11:39:07.428 INFO:tasks.workunit.client.1.smithi149.stdout:5/299: dread d4/f2f [0,4194304] 0 2024-09-21T11:39:07.430 INFO:tasks.workunit.client.1.smithi149.stdout:2/342: dread - d8/d20/f62 zero size 2024-09-21T11:39:07.431 INFO:tasks.workunit.client.1.smithi149.stdout:9/279: readlink l11 0 2024-09-21T11:39:07.431 INFO:tasks.workunit.client.1.smithi149.stdout:1/284: rename d2/c50 to d2/d2b/c59 0 2024-09-21T11:39:07.432 INFO:tasks.workunit.client.1.smithi149.stdout:0/266: dread - dd/d1a/d1b/d50/d53/d3a/f4e zero size 2024-09-21T11:39:07.432 INFO:tasks.workunit.client.1.smithi149.stdout:5/300: chown d4/d7/d40/d43/d5c 12 1 2024-09-21T11:39:07.433 INFO:tasks.workunit.client.1.smithi149.stdout:2/343: fdatasync d8/dd/f5f 0 2024-09-21T11:39:07.433 INFO:tasks.workunit.client.1.smithi149.stdout:7/394: dwrite d12/d15/d4a/f72 [0,4194304] 0 2024-09-21T11:39:07.434 INFO:tasks.workunit.client.1.smithi149.stdout:6/262: creat d8/da/d14/f4c x:0 0 0 2024-09-21T11:39:07.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/320: write d4/d6/d63/d10/d31/f40 [651994,65464] 0 2024-09-21T11:39:07.435 INFO:tasks.workunit.client.1.smithi149.stdout:0/267: chown dd/d35/f4d 21718000 1 2024-09-21T11:39:07.435 INFO:tasks.workunit.client.1.smithi149.stdout:5/301: mknod d4/d7/d40/d51/c63 0 2024-09-21T11:39:07.438 INFO:tasks.workunit.client.1.smithi149.stdout:9/280: symlink d18/d19/d1a/d2f/l56 0 2024-09-21T11:39:07.438 INFO:tasks.workunit.client.1.smithi149.stdout:2/344: mknod d8/da/d13/d1a/d29/c80 0 2024-09-21T11:39:07.440 INFO:tasks.workunit.client.1.smithi149.stdout:7/395: rename d12/l28 to d12/d15/d4a/d4f/d75/l79 0 2024-09-21T11:39:07.441 INFO:tasks.workunit.client.1.smithi149.stdout:0/268: creat dd/d2d/f63 x:0 0 0 2024-09-21T11:39:07.445 INFO:tasks.workunit.client.1.smithi149.stdout:1/285: rename d2/dd/d2e/d4c/f56 to d2/dd/d35/d1c/d2c/f5a 0 2024-09-21T11:39:07.447 INFO:tasks.workunit.client.1.smithi149.stdout:0/269: symlink dd/d1a/d5a/l64 0 2024-09-21T11:39:07.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:06 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:39:07.450 INFO:tasks.workunit.client.1.smithi149.stdout:4/321: dwrite d4/d4d/f45 [0,4194304] 0 2024-09-21T11:39:07.450 INFO:tasks.workunit.client.1.smithi149.stdout:2/345: creat d8/da/d13/f81 x:0 0 0 2024-09-21T11:39:07.457 INFO:tasks.workunit.client.1.smithi149.stdout:0/270: mkdir dd/d1a/d5a/d65 0 2024-09-21T11:39:07.459 INFO:tasks.workunit.client.1.smithi149.stdout:7/396: getdents d12/d35 0 2024-09-21T11:39:07.464 INFO:tasks.workunit.client.1.smithi149.stdout:6/263: dread d8/d32/d37/d28/d2e/f3e [0,4194304] 0 2024-09-21T11:39:07.465 INFO:tasks.workunit.client.1.smithi149.stdout:5/302: dwrite d4/d1d/d50/d54/d2a/f3f [4194304,4194304] 0 2024-09-21T11:39:07.468 INFO:tasks.workunit.client.1.smithi149.stdout:7/397: write f1 [4320966,98967] 0 2024-09-21T11:39:07.468 INFO:tasks.workunit.client.1.smithi149.stdout:4/322: rename d4/d6/d63/d15/d30/d6b/d76 to d4/d6/d63/d78 0 2024-09-21T11:39:07.471 INFO:tasks.workunit.client.1.smithi149.stdout:0/271: rmdir dd/d1a/d5a/d5e 0 2024-09-21T11:39:07.473 INFO:tasks.workunit.client.1.smithi149.stdout:6/264: creat d8/da/d2c/d2d/f4d x:0 0 0 2024-09-21T11:39:07.473 INFO:tasks.workunit.client.1.smithi149.stdout:2/346: dwrite d8/da/d13/d2d/f34 [0,4194304] 0 2024-09-21T11:39:07.473 INFO:tasks.workunit.client.1.smithi149.stdout:5/303: rmdir d4/d7/d40/d51 39 2024-09-21T11:39:07.473 INFO:tasks.workunit.client.1.smithi149.stdout:7/398: write f4 [3758029,54618] 0 2024-09-21T11:39:07.477 INFO:tasks.workunit.client.1.smithi149.stdout:6/265: readlink d8/da/d11/l13 0 2024-09-21T11:39:07.479 INFO:tasks.workunit.client.1.smithi149.stdout:8/268: sync 2024-09-21T11:39:07.482 INFO:tasks.workunit.client.1.smithi149.stdout:4/323: write d4/d6/d63/d15/f54 [1288364,62152] 0 2024-09-21T11:39:07.482 INFO:tasks.workunit.client.1.smithi149.stdout:1/286: dwrite d2/dd/d35/d1c/d2c/f5a [0,4194304] 0 2024-09-21T11:39:07.484 INFO:tasks.workunit.client.1.smithi149.stdout:9/281: dread d18/d1c/f46 [0,4194304] 0 2024-09-21T11:39:07.488 INFO:tasks.workunit.client.1.smithi149.stdout:0/272: mkdir dd/d1a/d1b/d50/d53/d3a/d66 0 2024-09-21T11:39:07.490 INFO:tasks.workunit.client.1.smithi149.stdout:7/399: dread d12/d15/d26/d30/f34 [0,4194304] 0 2024-09-21T11:39:07.494 INFO:tasks.workunit.client.1.smithi149.stdout:4/324: readlink d4/d6/d63/d10/d31/l52 0 2024-09-21T11:39:07.494 INFO:tasks.workunit.client.1.smithi149.stdout:3/325: sync 2024-09-21T11:39:07.494 INFO:tasks.workunit.client.1.smithi149.stdout:9/282: rmdir d18/d19/d1a/d2f 39 2024-09-21T11:39:07.496 INFO:tasks.workunit.client.1.smithi149.stdout:9/283: chown f0 6050700 1 2024-09-21T11:39:07.498 INFO:tasks.workunit.client.1.smithi149.stdout:8/269: rename d3/d33/c4b to d3/dd/d3a/c5d 0 2024-09-21T11:39:07.500 INFO:tasks.workunit.client.1.smithi149.stdout:6/266: creat d8/da/f4e x:0 0 0 2024-09-21T11:39:07.501 INFO:tasks.workunit.client.1.smithi149.stdout:5/304: dwrite d4/f5 [0,4194304] 0 2024-09-21T11:39:07.502 INFO:tasks.workunit.client.1.smithi149.stdout:8/270: chown d3/dd 20 1 2024-09-21T11:39:07.502 INFO:tasks.workunit.client.1.smithi149.stdout:2/347: dwrite d8/d20/d57/f47 [0,4194304] 0 2024-09-21T11:39:07.502 INFO:tasks.workunit.client.1.smithi149.stdout:0/273: truncate dd/f19 1187038 0 2024-09-21T11:39:07.505 INFO:tasks.workunit.client.1.smithi149.stdout:5/305: chown d4/d7/f4e 4 1 2024-09-21T11:39:07.505 INFO:tasks.workunit.client.1.smithi149.stdout:7/400: rmdir d12/d70 0 2024-09-21T11:39:07.510 INFO:tasks.workunit.client.1.smithi149.stdout:1/287: getdents d2/dd/d35 0 2024-09-21T11:39:07.513 INFO:tasks.workunit.client.1.smithi149.stdout:6/267: symlink d8/d32/d37/l4f 0 2024-09-21T11:39:07.515 INFO:tasks.workunit.client.1.smithi149.stdout:2/348: fsync d8/d20/d57/f6c 0 2024-09-21T11:39:07.517 INFO:tasks.workunit.client.1.smithi149.stdout:7/401: stat d12/d15/d26/d30/d31/d47/d49 0 2024-09-21T11:39:07.520 INFO:tasks.workunit.client.1.smithi149.stdout:5/306: mknod d4/d1d/d3e/c64 0 2024-09-21T11:39:07.525 INFO:tasks.workunit.client.1.smithi149.stdout:9/284: write d18/d19/f25 [627735,88719] 0 2024-09-21T11:39:07.526 INFO:tasks.workunit.client.1.smithi149.stdout:8/271: dread d3/dd/d18/f51 [0,4194304] 0 2024-09-21T11:39:07.528 INFO:tasks.workunit.client.1.smithi149.stdout:6/268: mknod d8/d32/d37/d28/d2f/c50 0 2024-09-21T11:39:07.529 INFO:tasks.workunit.client.1.smithi149.stdout:3/326: dread d6/d1f/d27/f3c [0,4194304] 0 2024-09-21T11:39:07.532 INFO:tasks.workunit.client.1.smithi149.stdout:0/274: dwrite dd/d1a/d1b/f24 [4194304,4194304] 0 2024-09-21T11:39:07.534 INFO:tasks.workunit.client.1.smithi149.stdout:1/288: dwrite d2/d2b/f31 [0,4194304] 0 2024-09-21T11:39:07.535 INFO:tasks.workunit.client.1.smithi149.stdout:6/269: write d8/d32/f46 [244502,2567] 0 2024-09-21T11:39:07.538 INFO:tasks.workunit.client.1.smithi149.stdout:2/349: link d8/c79 d8/da/d13/d2d/d6f/c82 0 2024-09-21T11:39:07.539 INFO:tasks.workunit.client.1.smithi149.stdout:4/325: dwrite d4/d6/d18/f1c [0,4194304] 0 2024-09-21T11:39:07.539 INFO:tasks.workunit.client.1.smithi149.stdout:2/350: truncate d8/f46 671254 0 2024-09-21T11:39:07.543 INFO:tasks.workunit.client.1.smithi149.stdout:7/402: getdents d12 0 2024-09-21T11:39:07.543 INFO:tasks.workunit.client.1.smithi149.stdout:2/351: chown d8/da/d13/d1a/d3b/l42 1114401842 1 2024-09-21T11:39:07.544 INFO:tasks.workunit.client.1.smithi149.stdout:4/326: stat d4/d6/d18/f2e 0 2024-09-21T11:39:07.547 INFO:tasks.workunit.client.1.smithi149.stdout:6/270: mkdir d8/d32/d37/d2b/d51 0 2024-09-21T11:39:07.548 INFO:tasks.workunit.client.1.smithi149.stdout:4/327: fsync d4/d6/d18/f4f 0 2024-09-21T11:39:07.553 INFO:tasks.workunit.client.1.smithi149.stdout:0/275: mknod dd/c67 0 2024-09-21T11:39:07.554 INFO:tasks.workunit.client.1.smithi149.stdout:2/352: truncate d8/d20/f62 834249 0 2024-09-21T11:39:07.555 INFO:tasks.workunit.client.1.smithi149.stdout:9/285: rmdir d18/d19/d1a/d2f/d33/d55 0 2024-09-21T11:39:07.557 INFO:tasks.workunit.client.1.smithi149.stdout:6/271: write d8/d32/d37/d28/d2e/f44 [1205452,32228] 0 2024-09-21T11:39:07.559 INFO:tasks.workunit.client.1.smithi149.stdout:4/328: write d4/d6/d63/d15/f49 [5137568,2828] 0 2024-09-21T11:39:07.559 INFO:tasks.workunit.client.1.smithi149.stdout:2/353: chown d8/d20/d78/d7c 279 1 2024-09-21T11:39:07.560 INFO:tasks.workunit.client.1.smithi149.stdout:3/327: write d6/f1b [1317576,112686] 0 2024-09-21T11:39:07.563 INFO:tasks.workunit.client.1.smithi149.stdout:6/272: write d8/da/fd [855600,15737] 0 2024-09-21T11:39:07.564 INFO:tasks.workunit.client.1.smithi149.stdout:9/286: symlink d18/d19/d1a/d2f/d53/l57 0 2024-09-21T11:39:07.566 INFO:tasks.workunit.client.1.smithi149.stdout:3/328: fsync d6/f12 0 2024-09-21T11:39:07.566 INFO:tasks.workunit.client.1.smithi149.stdout:0/276: rename dd/d1a/d1b/d50/d53/d3a/c59 to dd/d1a/d1b/d50/d53/d3a/c68 0 2024-09-21T11:39:07.567 INFO:tasks.workunit.client.1.smithi149.stdout:8/272: dwrite d3/dd/d21/f4d [0,4194304] 0 2024-09-21T11:39:07.567 INFO:tasks.workunit.client.1.smithi149.stdout:2/354: mkdir d8/da/d13/d83 0 2024-09-21T11:39:07.569 INFO:tasks.workunit.client.1.smithi149.stdout:6/273: stat d8/da/d14/f1f 0 2024-09-21T11:39:07.570 INFO:tasks.workunit.client.1.smithi149.stdout:2/355: chown d8/da/d13/d1a 12856826 1 2024-09-21T11:39:07.570 INFO:tasks.workunit.client.1.smithi149.stdout:0/277: readlink dd/l10 0 2024-09-21T11:39:07.571 INFO:tasks.workunit.client.1.smithi149.stdout:9/287: symlink d18/d36/l58 0 2024-09-21T11:39:07.580 INFO:tasks.workunit.client.1.smithi149.stdout:4/329: read d4/d6/d63/f28 [4673243,110739] 0 2024-09-21T11:39:07.581 INFO:tasks.workunit.client.1.smithi149.stdout:8/273: mkdir d3/d33/d34/d55/d5e 0 2024-09-21T11:39:07.583 INFO:tasks.workunit.client.1.smithi149.stdout:9/288: chown d18/d19/d1a/d2f/f3d 264628810 1 2024-09-21T11:39:07.583 INFO:tasks.workunit.client.1.smithi149.stdout:5/307: dread d4/f3a [0,4194304] 0 2024-09-21T11:39:07.583 INFO:tasks.workunit.client.1.smithi149.stdout:6/274: mkdir d8/da/d2c/d52 0 2024-09-21T11:39:07.585 INFO:tasks.workunit.client.1.smithi149.stdout:4/330: dread - d4/d6/d63/d10/d6f/f74 zero size 2024-09-21T11:39:07.585 INFO:tasks.workunit.client.1.smithi149.stdout:3/329: truncate d6/f9 6365000 0 2024-09-21T11:39:07.585 INFO:tasks.workunit.client.1.smithi149.stdout:0/278: truncate dd/d1a/d1b/d50/d53/f54 147942 0 2024-09-21T11:39:07.587 INFO:tasks.workunit.client.1.smithi149.stdout:8/274: chown d3/dd/d18/l32 15496 1 2024-09-21T11:39:07.587 INFO:tasks.workunit.client.1.smithi149.stdout:4/331: chown d4/f7 259653652 1 2024-09-21T11:39:07.587 INFO:tasks.workunit.client.1.smithi149.stdout:9/289: mknod d18/d19/d1a/d2f/c59 0 2024-09-21T11:39:07.587 INFO:tasks.workunit.client.1.smithi149.stdout:2/356: dwrite d8/da/f55 [4194304,4194304] 0 2024-09-21T11:39:07.588 INFO:tasks.workunit.client.1.smithi149.stdout:8/275: fsync d3/f37 0 2024-09-21T11:39:07.590 INFO:tasks.workunit.client.1.smithi149.stdout:8/276: stat d3/f37 0 2024-09-21T11:39:07.591 INFO:tasks.workunit.client.1.smithi149.stdout:4/332: write d4/d6/d63/d15/d30/f53 [2284301,66496] 0 2024-09-21T11:39:07.591 INFO:tasks.workunit.client.1.smithi149.stdout:5/308: creat d4/d7/d40/f65 x:0 0 0 2024-09-21T11:39:07.600 INFO:tasks.workunit.client.1.smithi149.stdout:0/279: dwrite dd/d1a/d1b/f27 [0,4194304] 0 2024-09-21T11:39:07.601 INFO:tasks.workunit.client.1.smithi149.stdout:9/290: dwrite d18/d19/f20 [0,4194304] 0 2024-09-21T11:39:07.602 INFO:tasks.workunit.client.1.smithi149.stdout:9/291: dread - d18/d19/d1a/f4b zero size 2024-09-21T11:39:07.653 INFO:tasks.workunit.client.1.smithi149.stdout:7/403: sync 2024-09-21T11:39:07.654 INFO:tasks.workunit.client.1.smithi149.stdout:1/289: sync 2024-09-21T11:39:07.654 INFO:tasks.workunit.client.1.smithi149.stdout:1/290: chown d2/d2b/f31 986 1 2024-09-21T11:39:07.773 INFO:tasks.workunit.client.1.smithi149.stdout:7/404: dread d12/d15/f50 [0,4194304] 0 2024-09-21T11:39:07.774 INFO:tasks.workunit.client.1.smithi149.stdout:2/357: write d8/da/f39 [5016175,82272] 0 2024-09-21T11:39:07.776 INFO:tasks.workunit.client.1.smithi149.stdout:8/277: symlink d3/dd/d21/d54/l5f 0 2024-09-21T11:39:07.778 INFO:tasks.workunit.client.1.smithi149.stdout:4/333: chown d4/d6/c57 1 1 2024-09-21T11:39:07.780 INFO:tasks.workunit.client.1.smithi149.stdout:6/275: rename d8/d32/d37/d28/c3a to d8/da/d2c/d52/c53 0 2024-09-21T11:39:07.781 INFO:tasks.workunit.client.1.smithi149.stdout:2/358: dwrite d8/da/f55 [8388608,4194304] 0 2024-09-21T11:39:07.782 INFO:tasks.workunit.client.1.smithi149.stdout:5/309: creat d4/d7/d40/d43/d5c/f66 x:0 0 0 2024-09-21T11:39:07.784 INFO:tasks.workunit.client.1.smithi149.stdout:9/292: truncate d18/d19/d1a/f23 2678866 0 2024-09-21T11:39:07.786 INFO:tasks.workunit.client.1.smithi149.stdout:1/291: rmdir d2/d5 39 2024-09-21T11:39:07.787 INFO:tasks.workunit.client.1.smithi149.stdout:5/310: fdatasync d4/d7/d40/d43/d5c/f66 0 2024-09-21T11:39:07.789 INFO:tasks.workunit.client.1.smithi149.stdout:2/359: dread d8/da/f28 [0,4194304] 0 2024-09-21T11:39:07.789 INFO:tasks.workunit.client.1.smithi149.stdout:8/278: rename d3/dd/d21/c42 to d3/dd/d18/d2e/c60 0 2024-09-21T11:39:07.790 INFO:tasks.workunit.client.1.smithi149.stdout:3/330: creat d6/d1f/d47/f77 x:0 0 0 2024-09-21T11:39:07.794 INFO:tasks.workunit.client.1.smithi149.stdout:0/280: creat dd/d1a/d1b/d50/d53/d3a/d66/f69 x:0 0 0 2024-09-21T11:39:07.794 INFO:tasks.workunit.client.1.smithi149.stdout:7/405: link ff d12/d15/d68/f7a 0 2024-09-21T11:39:07.795 INFO:tasks.workunit.client.1.smithi149.stdout:8/279: fdatasync d3/f20 0 2024-09-21T11:39:07.795 INFO:tasks.workunit.client.1.smithi149.stdout:4/334: dwrite d4/d6/d63/d10/d6f/f74 [0,4194304] 0 2024-09-21T11:39:07.795 INFO:tasks.workunit.client.1.smithi149.stdout:6/276: symlink d8/d32/d37/d2b/d51/l54 0 2024-09-21T11:39:07.795 INFO:tasks.workunit.client.1.smithi149.stdout:1/292: chown d2/d5/d3d/c54 145203 1 2024-09-21T11:39:07.797 INFO:tasks.workunit.client.1.smithi149.stdout:2/360: fdatasync d8/da/d13/d1a/d2c/f41 0 2024-09-21T11:39:07.797 INFO:tasks.workunit.client.1.smithi149.stdout:8/280: readlink d3/d12/l19 0 2024-09-21T11:39:07.799 INFO:tasks.workunit.client.1.smithi149.stdout:5/311: creat d4/d1d/d50/d54/d2a/f67 x:0 0 0 2024-09-21T11:39:07.801 INFO:tasks.workunit.client.1.smithi149.stdout:3/331: creat d6/d1f/d47/d37/d50/f78 x:0 0 0 2024-09-21T11:39:07.802 INFO:tasks.workunit.client.1.smithi149.stdout:7/406: creat d12/d15/d68/f7b x:0 0 0 2024-09-21T11:39:07.803 INFO:tasks.workunit.client.1.smithi149.stdout:6/277: dread d8/da/d14/f27 [0,4194304] 0 2024-09-21T11:39:07.804 INFO:tasks.workunit.client.1.smithi149.stdout:1/293: unlink d2/c6 0 2024-09-21T11:39:07.808 INFO:tasks.workunit.client.1.smithi149.stdout:2/361: mkdir d8/dd/d5c/d84 0 2024-09-21T11:39:07.808 INFO:tasks.workunit.client.1.smithi149.stdout:8/281: chown d3/dd/f3f 214 1 2024-09-21T11:39:07.813 INFO:tasks.workunit.client.1.smithi149.stdout:8/282: dread - d3/d33/d34/d55/f59 zero size 2024-09-21T11:39:07.814 INFO:tasks.workunit.client.1.smithi149.stdout:7/407: fsync d12/d15/d26/d30/d31/f3f 0 2024-09-21T11:39:07.815 INFO:tasks.workunit.client.1.smithi149.stdout:8/283: chown d3/d3c/d4c 1697454372 1 2024-09-21T11:39:07.816 INFO:tasks.workunit.client.1.smithi149.stdout:9/293: write d18/f2a [369271,40057] 0 2024-09-21T11:39:07.817 INFO:tasks.workunit.client.1.smithi149.stdout:4/335: getdents d4/d4d/d5f/d71 0 2024-09-21T11:39:07.818 INFO:tasks.workunit.client.1.smithi149.stdout:5/312: symlink d4/d1d/d50/d60/l68 0 2024-09-21T11:39:07.818 INFO:tasks.workunit.client.1.smithi149.stdout:1/294: dwrite d2/f20 [4194304,4194304] 0 2024-09-21T11:39:07.820 INFO:tasks.workunit.client.1.smithi149.stdout:3/332: mkdir d6/d79 0 2024-09-21T11:39:07.821 INFO:tasks.workunit.client.1.smithi149.stdout:6/278: dread d8/d32/d37/d28/f33 [0,4194304] 0 2024-09-21T11:39:07.822 INFO:tasks.workunit.client.1.smithi149.stdout:8/284: unlink d3/dd/d3a/c46 0 2024-09-21T11:39:07.824 INFO:tasks.workunit.client.1.smithi149.stdout:7/408: rmdir d12/d15/d26/d30/d31/d47 39 2024-09-21T11:39:07.825 INFO:tasks.workunit.client.1.smithi149.stdout:4/336: dread - d4/d6/d63/d10/d31/d32/d4a/f6a zero size 2024-09-21T11:39:07.830 INFO:tasks.workunit.client.1.smithi149.stdout:0/281: dread dd/d2d/f43 [0,4194304] 0 2024-09-21T11:39:07.831 INFO:tasks.workunit.client.1.smithi149.stdout:5/313: creat d4/d7/d40/d43/f69 x:0 0 0 2024-09-21T11:39:07.831 INFO:tasks.workunit.client.1.smithi149.stdout:2/362: dwrite d8/f46 [0,4194304] 0 2024-09-21T11:39:07.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/409: creat d12/d15/d68/f7c x:0 0 0 2024-09-21T11:39:07.836 INFO:tasks.workunit.client.1.smithi149.stdout:9/294: dwrite fc [0,4194304] 0 2024-09-21T11:39:07.837 INFO:tasks.workunit.client.1.smithi149.stdout:3/333: creat d6/d1f/f7a x:0 0 0 2024-09-21T11:39:07.841 INFO:tasks.workunit.client.1.smithi149.stdout:0/282: read dd/d2d/f56 [2980659,95645] 0 2024-09-21T11:39:07.842 INFO:tasks.workunit.client.1.smithi149.stdout:3/334: read d6/d1f/d27/f3c [458823,57782] 0 2024-09-21T11:39:07.842 INFO:tasks.workunit.client.1.smithi149.stdout:5/314: fdatasync d4/d7/d40/d51/f58 0 2024-09-21T11:39:07.843 INFO:tasks.workunit.client.1.smithi149.stdout:6/279: dwrite d8/da/d14/f15 [0,4194304] 0 2024-09-21T11:39:07.847 INFO:tasks.workunit.client.1.smithi149.stdout:8/285: dwrite d3/d33/f47 [0,4194304] 0 2024-09-21T11:39:07.847 INFO:tasks.workunit.client.1.smithi149.stdout:6/280: truncate d8/d32/f46 896907 0 2024-09-21T11:39:07.851 INFO:tasks.workunit.client.1.smithi149.stdout:4/337: write d4/f7 [2726929,96657] 0 2024-09-21T11:39:07.856 INFO:tasks.workunit.client.1.smithi149.stdout:5/315: mkdir d4/d1d/d50/d60/d6a 0 2024-09-21T11:39:07.856 INFO:tasks.workunit.client.1.smithi149.stdout:9/295: mknod d18/d19/c5a 0 2024-09-21T11:39:07.857 INFO:tasks.workunit.client.1.smithi149.stdout:6/281: creat d8/d32/f55 x:0 0 0 2024-09-21T11:39:07.858 INFO:tasks.workunit.client.1.smithi149.stdout:4/338: creat d4/d4d/d58/f79 x:0 0 0 2024-09-21T11:39:07.860 INFO:tasks.workunit.client.1.smithi149.stdout:2/363: getdents d8/d11 0 2024-09-21T11:39:07.860 INFO:tasks.workunit.client.1.smithi149.stdout:5/316: creat d4/d1d/f6b x:0 0 0 2024-09-21T11:39:07.861 INFO:tasks.workunit.client.1.smithi149.stdout:9/296: mkdir d18/d4c/d5b 0 2024-09-21T11:39:07.862 INFO:tasks.workunit.client.1.smithi149.stdout:0/283: dread dd/d1a/d1b/d50/d53/d3a/f5b [0,4194304] 0 2024-09-21T11:39:07.862 INFO:tasks.workunit.client.1.smithi149.stdout:7/410: getdents d12/d15 0 2024-09-21T11:39:07.863 INFO:tasks.workunit.client.1.smithi149.stdout:2/364: chown d8/dd/d5c/d60/d67 7632599 1 2024-09-21T11:39:07.863 INFO:tasks.workunit.client.1.smithi149.stdout:6/282: creat d8/da/d2c/f56 x:0 0 0 2024-09-21T11:39:07.863 INFO:tasks.workunit.client.1.smithi149.stdout:1/295: dwrite d2/d5/d8/d3b/f3e [0,4194304] 0 2024-09-21T11:39:07.864 INFO:tasks.workunit.client.1.smithi149.stdout:4/339: dread - d4/d6/d63/d15/d30/d6b/f72 zero size 2024-09-21T11:39:07.864 INFO:tasks.workunit.client.1.smithi149.stdout:8/286: rename d3/d12/l19 to d3/dd/l61 0 2024-09-21T11:39:07.868 INFO:tasks.workunit.client.1.smithi149.stdout:6/283: mknod d8/d32/d37/c57 0 2024-09-21T11:39:07.868 INFO:tasks.workunit.client.1.smithi149.stdout:2/365: read d8/d11/f3a [747676,110704] 0 2024-09-21T11:39:07.869 INFO:tasks.workunit.client.1.smithi149.stdout:0/284: readlink dd/d1a/d1b/d50/d53/d3a/l41 0 2024-09-21T11:39:07.869 INFO:tasks.workunit.client.1.smithi149.stdout:1/296: readlink d2/d5/d8/d3b/l3f 0 2024-09-21T11:39:07.870 INFO:tasks.workunit.client.1.smithi149.stdout:7/411: write d12/d15/d26/f2e [3011714,84124] 0 2024-09-21T11:39:07.871 INFO:tasks.workunit.client.1.smithi149.stdout:4/340: stat d4/d6/d63/d15/d16/d23/l35 0 2024-09-21T11:39:07.873 INFO:tasks.workunit.client.1.smithi149.stdout:8/287: mknod d3/d3c/c62 0 2024-09-21T11:39:07.873 INFO:tasks.workunit.client.1.smithi149.stdout:2/366: chown d8/d20/d57 35693 1 2024-09-21T11:39:07.873 INFO:tasks.workunit.client.1.smithi149.stdout:6/284: mknod d8/da/d11/c58 0 2024-09-21T11:39:07.876 INFO:tasks.workunit.client.1.smithi149.stdout:4/341: read - d4/d6/d18/f73 zero size 2024-09-21T11:39:07.878 INFO:tasks.workunit.client.1.smithi149.stdout:7/412: read d12/d15/d26/d30/d31/f37 [1527450,41908] 0 2024-09-21T11:39:07.879 INFO:tasks.workunit.client.1.smithi149.stdout:6/285: rmdir d8/da/d2c/d52 39 2024-09-21T11:39:07.880 INFO:tasks.workunit.client.1.smithi149.stdout:9/297: dwrite fc [0,4194304] 0 2024-09-21T11:39:07.880 INFO:tasks.workunit.client.1.smithi149.stdout:2/367: mknod d8/da/d13/d1a/d2c/c85 0 2024-09-21T11:39:07.881 INFO:tasks.workunit.client.1.smithi149.stdout:4/342: write d4/d6/f9 [3911742,9845] 0 2024-09-21T11:39:07.883 INFO:tasks.workunit.client.1.smithi149.stdout:8/288: rename d3/d33/f47 to d3/dd/d3a/f63 0 2024-09-21T11:39:07.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/297: truncate d2/d5/d8/f1f 3380792 0 2024-09-21T11:39:07.884 INFO:tasks.workunit.client.1.smithi149.stdout:7/413: chown d12/d15/d4a/d4f/f54 128333 1 2024-09-21T11:39:07.889 INFO:tasks.workunit.client.1.smithi149.stdout:9/298: rename d18/d19/f25 to d18/d19/d29/f5c 0 2024-09-21T11:39:07.889 INFO:tasks.workunit.client.1.smithi149.stdout:7/414: readlink d12/d15/l22 0 2024-09-21T11:39:07.893 INFO:tasks.workunit.client.1.smithi149.stdout:1/298: mkdir d2/dd/d35/d5b 0 2024-09-21T11:39:07.894 INFO:tasks.workunit.client.1.smithi149.stdout:4/343: mknod d4/d6/d63/d10/c7a 0 2024-09-21T11:39:07.897 INFO:tasks.workunit.client.1.smithi149.stdout:8/289: creat d3/d33/f64 x:0 0 0 2024-09-21T11:39:07.897 INFO:tasks.workunit.client.1.smithi149.stdout:7/415: mknod d12/d15/d4a/d4f/d75/c7d 0 2024-09-21T11:39:07.900 INFO:tasks.workunit.client.1.smithi149.stdout:0/285: dwrite dd/d1a/f2c [0,4194304] 0 2024-09-21T11:39:07.901 INFO:tasks.workunit.client.1.smithi149.stdout:6/286: dwrite d8/d32/d37/d28/d2e/f44 [0,4194304] 0 2024-09-21T11:39:07.902 INFO:tasks.workunit.client.1.smithi149.stdout:7/416: stat d12/l23 0 2024-09-21T11:39:07.911 INFO:tasks.workunit.client.1.smithi149.stdout:4/344: mknod d4/d6/d63/d10/d31/d32/d4a/c7b 0 2024-09-21T11:39:07.916 INFO:tasks.workunit.client.1.smithi149.stdout:6/287: write d8/d32/d37/d28/f30 [777702,71250] 0 2024-09-21T11:39:07.920 INFO:tasks.workunit.client.1.smithi149.stdout:2/368: dwrite d8/da/d13/f7e [0,4194304] 0 2024-09-21T11:39:07.925 INFO:tasks.workunit.client.1.smithi149.stdout:9/299: dwrite d18/d19/f40 [0,4194304] 0 2024-09-21T11:39:07.925 INFO:tasks.workunit.client.1.smithi149.stdout:1/299: dwrite d2/dd/f30 [0,4194304] 0 2024-09-21T11:39:07.929 INFO:tasks.workunit.client.1.smithi149.stdout:8/290: dread d3/f17 [0,4194304] 0 2024-09-21T11:39:07.930 INFO:tasks.workunit.client.1.smithi149.stdout:7/417: rename d12/d15/d26/d30/d31/d47/c69 to d12/d15/d4a/d6c/c7e 0 2024-09-21T11:39:07.932 INFO:tasks.workunit.client.1.smithi149.stdout:9/300: fdatasync d18/d19/d1a/d2f/f38 0 2024-09-21T11:39:07.933 INFO:tasks.workunit.client.1.smithi149.stdout:2/369: write d8/da/d13/d1a/d29/f58 [2209180,71643] 0 2024-09-21T11:39:07.934 INFO:tasks.workunit.client.1.smithi149.stdout:9/301: chown f0 2101 1 2024-09-21T11:39:07.936 INFO:tasks.workunit.client.1.smithi149.stdout:7/418: symlink d12/d15/d4a/l7f 0 2024-09-21T11:39:07.938 INFO:tasks.workunit.client.1.smithi149.stdout:2/370: symlink d8/d20/d78/l86 0 2024-09-21T11:39:07.938 INFO:tasks.workunit.client.1.smithi149.stdout:6/288: dwrite d8/d32/f46 [0,4194304] 0 2024-09-21T11:39:07.944 INFO:tasks.workunit.client.1.smithi149.stdout:9/302: symlink d18/d19/d1a/d2f/d30/d54/l5d 0 2024-09-21T11:39:07.944 INFO:tasks.workunit.client.1.smithi149.stdout:7/419: truncate d12/d15/d68/f7b 903018 0 2024-09-21T11:39:07.945 INFO:tasks.workunit.client.1.smithi149.stdout:2/371: stat d8/da/d13/d1a/d2c/f2f 0 2024-09-21T11:39:07.950 INFO:tasks.workunit.client.1.smithi149.stdout:8/291: dread d3/fa [0,4194304] 0 2024-09-21T11:39:07.950 INFO:tasks.workunit.client.1.smithi149.stdout:9/303: chown d18/d19/d1a/f4b 113000 1 2024-09-21T11:39:07.952 INFO:tasks.workunit.client.1.smithi149.stdout:7/420: symlink d12/d35/l80 0 2024-09-21T11:39:07.953 INFO:tasks.workunit.client.1.smithi149.stdout:6/289: creat d8/d32/d37/d2b/d51/f59 x:0 0 0 2024-09-21T11:39:07.953 INFO:tasks.workunit.client.1.smithi149.stdout:2/372: creat d8/da/d13/d53/f87 x:0 0 0 2024-09-21T11:39:07.955 INFO:tasks.workunit.client.1.smithi149.stdout:6/290: chown d8/d32/d37/c57 4890298 1 2024-09-21T11:39:07.955 INFO:tasks.workunit.client.1.smithi149.stdout:2/373: read d8/da/f28 [717576,100803] 0 2024-09-21T11:39:07.955 INFO:tasks.workunit.client.1.smithi149.stdout:7/421: rename d12/d15/l44 to d12/d5b/l81 0 2024-09-21T11:39:07.958 INFO:tasks.workunit.client.1.smithi149.stdout:2/374: mkdir d8/d11/d88 0 2024-09-21T11:39:07.958 INFO:tasks.workunit.client.1.smithi149.stdout:9/304: dread fc [0,4194304] 0 2024-09-21T11:39:07.960 INFO:tasks.workunit.client.1.smithi149.stdout:6/291: creat d8/d32/d37/d2b/d51/f5a x:0 0 0 2024-09-21T11:39:07.960 INFO:tasks.workunit.client.1.smithi149.stdout:8/292: dread d3/dd/d21/f4d [0,4194304] 0 2024-09-21T11:39:07.960 INFO:tasks.workunit.client.1.smithi149.stdout:4/345: dread d4/d6/f56 [0,4194304] 0 2024-09-21T11:39:07.961 INFO:tasks.workunit.client.1.smithi149.stdout:9/305: creat d18/f5e x:0 0 0 2024-09-21T11:39:07.962 INFO:tasks.workunit.client.1.smithi149.stdout:4/346: fsync d4/d4d/f45 0 2024-09-21T11:39:07.963 INFO:tasks.workunit.client.1.smithi149.stdout:8/293: write d3/dd/d18/f51 [524143,55552] 0 2024-09-21T11:39:07.966 INFO:tasks.workunit.client.1.smithi149.stdout:4/347: creat d4/d6/d63/d15/f7c x:0 0 0 2024-09-21T11:39:07.967 INFO:tasks.workunit.client.1.smithi149.stdout:9/306: mkdir d18/d19/d1a/d2f/d5f 0 2024-09-21T11:39:07.967 INFO:tasks.workunit.client.1.smithi149.stdout:2/375: dread d8/da/d13/d1a/d2c/f41 [0,4194304] 0 2024-09-21T11:39:07.968 INFO:tasks.workunit.client.1.smithi149.stdout:9/307: chown d18/f5e 18 1 2024-09-21T11:39:07.968 INFO:tasks.workunit.client.1.smithi149.stdout:7/422: chown d12/d15/d26/f2e 290227 1 2024-09-21T11:39:07.969 INFO:tasks.workunit.client.1.smithi149.stdout:4/348: symlink d4/d6/d63/d10/l7d 0 2024-09-21T11:39:07.970 INFO:tasks.workunit.client.1.smithi149.stdout:8/294: dread d3/dd/d21/f4d [0,4194304] 0 2024-09-21T11:39:07.970 INFO:tasks.workunit.client.1.smithi149.stdout:2/376: dread - d8/da/d13/d1a/d29/f69 zero size 2024-09-21T11:39:07.971 INFO:tasks.workunit.client.1.smithi149.stdout:4/349: chown d4/d6/f47 14073 1 2024-09-21T11:39:07.973 INFO:tasks.workunit.client.1.smithi149.stdout:8/295: fsync d3/dd/d3a/f63 0 2024-09-21T11:39:07.973 INFO:tasks.workunit.client.1.smithi149.stdout:2/377: mknod d8/d11/d88/c89 0 2024-09-21T11:39:07.974 INFO:tasks.workunit.client.1.smithi149.stdout:4/350: symlink d4/d6/d63/d15/d16/l7e 0 2024-09-21T11:39:07.974 INFO:tasks.workunit.client.1.smithi149.stdout:7/423: truncate d12/d15/d26/d30/d31/f64 304041 0 2024-09-21T11:39:07.975 INFO:tasks.workunit.client.1.smithi149.stdout:4/351: chown d4/d6/f47 380 1 2024-09-21T11:39:07.976 INFO:tasks.workunit.client.1.smithi149.stdout:9/308: dread d18/d19/d1a/f23 [0,4194304] 0 2024-09-21T11:39:07.976 INFO:tasks.workunit.client.1.smithi149.stdout:7/424: chown d12/d15/d26/d30/l4c 31457 1 2024-09-21T11:39:07.976 INFO:tasks.workunit.client.1.smithi149.stdout:2/378: mkdir d8/dd/d5c/d60/d67/d8a 0 2024-09-21T11:39:07.979 INFO:tasks.workunit.client.1.smithi149.stdout:9/309: creat d18/d1c/f60 x:0 0 0 2024-09-21T11:39:07.980 INFO:tasks.workunit.client.1.smithi149.stdout:4/352: rename d4/d6/d63/d15/f7c to d4/d6/f7f 0 2024-09-21T11:39:07.982 INFO:tasks.workunit.client.1.smithi149.stdout:6/292: dread f4 [0,4194304] 0 2024-09-21T11:39:07.983 INFO:tasks.workunit.client.1.smithi149.stdout:9/310: fdatasync d18/d19/d1a/f2d 0 2024-09-21T11:39:07.985 INFO:tasks.workunit.client.1.smithi149.stdout:8/296: dwrite d3/d33/d34/d55/f59 [0,4194304] 0 2024-09-21T11:39:07.986 INFO:tasks.workunit.client.1.smithi149.stdout:9/311: fsync d18/d19/d1a/f2d 0 2024-09-21T11:39:07.988 INFO:tasks.workunit.client.1.smithi149.stdout:8/297: fdatasync d3/dd/d21/d54/f56 0 2024-09-21T11:39:07.992 INFO:tasks.workunit.client.1.smithi149.stdout:2/379: dwrite d8/dd/d5c/f76 [0,4194304] 0 2024-09-21T11:39:07.998 INFO:tasks.workunit.client.1.smithi149.stdout:4/353: getdents d4/d6/d63/d15/d30 0 2024-09-21T11:39:07.999 INFO:tasks.workunit.client.1.smithi149.stdout:8/298: rmdir d3/d3c/d4c 39 2024-09-21T11:39:08.000 INFO:tasks.workunit.client.1.smithi149.stdout:6/293: dread d8/da/d14/f1f [0,4194304] 0 2024-09-21T11:39:08.001 INFO:tasks.workunit.client.1.smithi149.stdout:7/425: dread d12/d15/f17 [0,4194304] 0 2024-09-21T11:39:08.002 INFO:tasks.workunit.client.1.smithi149.stdout:4/354: fsync d4/d6/f59 0 2024-09-21T11:39:08.004 INFO:tasks.workunit.client.1.smithi149.stdout:9/312: dwrite d18/d19/d1a/f4b [0,4194304] 0 2024-09-21T11:39:08.004 INFO:tasks.workunit.client.1.smithi149.stdout:4/355: dread - d4/d4d/d58/f79 zero size 2024-09-21T11:39:08.006 INFO:tasks.workunit.client.1.smithi149.stdout:2/380: rename d8/da/d13/d5d/f6d to d8/da/d13/d5d/d6a/f8b 0 2024-09-21T11:39:08.008 INFO:tasks.workunit.client.1.smithi149.stdout:7/426: write d12/d35/f73 [123358,62449] 0 2024-09-21T11:39:08.008 INFO:tasks.workunit.client.1.smithi149.stdout:6/294: readlink d8/d32/d37/d28/d2e/l40 0 2024-09-21T11:39:08.009 INFO:tasks.workunit.client.1.smithi149.stdout:9/313: read d18/d1c/f4f [3180555,107574] 0 2024-09-21T11:39:08.010 INFO:tasks.workunit.client.1.smithi149.stdout:9/314: chown d18/d19/f20 9 1 2024-09-21T11:39:08.010 INFO:tasks.workunit.client.1.smithi149.stdout:9/315: read d18/f2a [4065729,38507] 0 2024-09-21T11:39:08.011 INFO:tasks.workunit.client.1.smithi149.stdout:4/356: creat d4/f80 x:0 0 0 2024-09-21T11:39:08.011 INFO:tasks.workunit.client.1.smithi149.stdout:9/316: chown d18/d19/f40 135160 1 2024-09-21T11:39:08.012 INFO:tasks.workunit.client.1.smithi149.stdout:4/357: readlink d4/d4d/l5a 0 2024-09-21T11:39:08.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/317: write d18/d36/d3c/f3f [874621,12230] 0 2024-09-21T11:39:08.013 INFO:tasks.workunit.client.1.smithi149.stdout:8/299: link d3/l4e d3/dd/d3a/l65 0 2024-09-21T11:39:08.013 INFO:tasks.workunit.client.1.smithi149.stdout:4/358: read d4/d6/f56 [2141262,84729] 0 2024-09-21T11:39:08.015 INFO:tasks.workunit.client.1.smithi149.stdout:7/427: write d12/d15/d68/f7c [423241,60140] 0 2024-09-21T11:39:08.018 INFO:tasks.workunit.client.1.smithi149.stdout:7/428: write f4 [4184091,68871] 0 2024-09-21T11:39:08.018 INFO:tasks.workunit.client.1.smithi149.stdout:6/295: mknod d8/da/c5b 0 2024-09-21T11:39:08.018 INFO:tasks.workunit.client.1.smithi149.stdout:7/429: stat d12/d35 0 2024-09-21T11:39:08.019 INFO:tasks.workunit.client.1.smithi149.stdout:8/300: rmdir d3/dd/d21/d54 39 2024-09-21T11:39:08.020 INFO:tasks.workunit.client.1.smithi149.stdout:4/359: dread d4/d6/d63/f28 [0,4194304] 0 2024-09-21T11:39:08.020 INFO:tasks.workunit.client.1.smithi149.stdout:6/296: rmdir d8/d32/d37/d28/d2f 39 2024-09-21T11:39:08.021 INFO:tasks.workunit.client.1.smithi149.stdout:2/381: getdents d8/dd/d50 0 2024-09-21T11:39:08.022 INFO:tasks.workunit.client.1.smithi149.stdout:8/301: fdatasync d3/f4f 0 2024-09-21T11:39:08.022 INFO:tasks.workunit.client.1.smithi149.stdout:7/430: write d12/d15/d26/d30/d31/f37 [2953794,37224] 0 2024-09-21T11:39:08.023 INFO:tasks.workunit.client.1.smithi149.stdout:2/382: write f7 [3158912,120165] 0 2024-09-21T11:39:08.023 INFO:tasks.workunit.client.1.smithi149.stdout:9/318: getdents d18/d19/d1a 0 2024-09-21T11:39:08.024 INFO:tasks.workunit.client.1.smithi149.stdout:6/297: write d8/da/d14/f15 [9430731,123093] 0 2024-09-21T11:39:08.025 INFO:tasks.workunit.client.1.smithi149.stdout:9/319: read d18/f2a [2322137,84812] 0 2024-09-21T11:39:08.027 INFO:tasks.workunit.client.1.smithi149.stdout:9/320: dread - d18/d1c/f60 zero size 2024-09-21T11:39:08.027 INFO:tasks.workunit.client.1.smithi149.stdout:8/302: fsync d3/dd/d21/f4d 0 2024-09-21T11:39:08.027 INFO:tasks.workunit.client.1.smithi149.stdout:7/431: rmdir d12/d15/d26/d30/d31 39 2024-09-21T11:39:08.028 INFO:tasks.workunit.client.1.smithi149.stdout:8/303: fdatasync d3/d33/f64 0 2024-09-21T11:39:08.028 INFO:tasks.workunit.client.1.smithi149.stdout:6/298: creat d8/da/d2c/d52/f5c x:0 0 0 2024-09-21T11:39:08.028 INFO:tasks.workunit.client.1.smithi149.stdout:8/304: chown d3/d12/l41 10295561 1 2024-09-21T11:39:08.029 INFO:tasks.workunit.client.1.smithi149.stdout:9/321: symlink d18/d19/l61 0 2024-09-21T11:39:08.030 INFO:tasks.workunit.client.1.smithi149.stdout:6/299: creat d8/da/d3d/f5d x:0 0 0 2024-09-21T11:39:08.030 INFO:tasks.workunit.client.1.smithi149.stdout:8/305: rmdir d3/dd/d18 39 2024-09-21T11:39:08.031 INFO:tasks.workunit.client.1.smithi149.stdout:7/432: symlink d12/d15/d4a/d6c/l82 0 2024-09-21T11:39:08.032 INFO:tasks.workunit.client.1.smithi149.stdout:7/433: truncate d12/d15/d4a/d4f/f54 105774 0 2024-09-21T11:39:08.034 INFO:tasks.workunit.client.1.smithi149.stdout:8/306: mknod d3/d33/d34/d55/d5e/c66 0 2024-09-21T11:39:08.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/300: getdents d8/da/d3d 0 2024-09-21T11:39:08.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/301: chown d8/da/d14/f27 697834 1 2024-09-21T11:39:08.041 INFO:tasks.workunit.client.1.smithi149.stdout:9/322: truncate d18/d19/f20 3911721 0 2024-09-21T11:39:08.041 INFO:tasks.workunit.client.1.smithi149.stdout:9/323: chown d18/d19/d1a/f2d 949273473 1 2024-09-21T11:39:08.042 INFO:tasks.workunit.client.1.smithi149.stdout:6/302: mkdir d8/da/d2c/d52/d5e 0 2024-09-21T11:39:08.043 INFO:tasks.workunit.client.1.smithi149.stdout:9/324: write d18/d19/d1a/d2f/f38 [33482,92645] 0 2024-09-21T11:39:08.043 INFO:tasks.workunit.client.1.smithi149.stdout:8/307: rename d3/dd/d18/d2e/c60 to d3/d3c/c67 0 2024-09-21T11:39:08.044 INFO:tasks.workunit.client.1.smithi149.stdout:6/303: mknod d8/d32/d37/d2b/d51/c5f 0 2024-09-21T11:39:08.045 INFO:tasks.workunit.client.1.smithi149.stdout:8/308: chown d3/dd/d18/l32 3440 1 2024-09-21T11:39:08.046 INFO:tasks.workunit.client.1.smithi149.stdout:9/325: creat d18/d19/d1a/d2f/d53/f62 x:0 0 0 2024-09-21T11:39:08.048 INFO:tasks.workunit.client.1.smithi149.stdout:8/309: creat d3/dd/d18/f68 x:0 0 0 2024-09-21T11:39:08.049 INFO:tasks.workunit.client.1.smithi149.stdout:9/326: write d18/d36/d3c/f3f [127089,53048] 0 2024-09-21T11:39:08.050 INFO:tasks.workunit.client.1.smithi149.stdout:8/310: fdatasync d3/d33/f64 0 2024-09-21T11:39:08.050 INFO:tasks.workunit.client.1.smithi149.stdout:7/434: dwrite d12/d15/d68/f7a [0,4194304] 0 2024-09-21T11:39:08.053 INFO:tasks.workunit.client.1.smithi149.stdout:7/435: fsync d12/f21 0 2024-09-21T11:39:08.054 INFO:tasks.workunit.client.1.smithi149.stdout:9/327: mkdir d18/d19/d29/d39/d63 0 2024-09-21T11:39:08.054 INFO:tasks.workunit.client.1.smithi149.stdout:6/304: dwrite d8/d32/f46 [0,4194304] 0 2024-09-21T11:39:08.065 INFO:tasks.workunit.client.1.smithi149.stdout:8/311: dwrite d3/d33/d34/d55/f59 [0,4194304] 0 2024-09-21T11:39:08.070 INFO:tasks.workunit.client.1.smithi149.stdout:9/328: dwrite f0 [0,4194304] 0 2024-09-21T11:39:08.082 INFO:tasks.workunit.client.1.smithi149.stdout:9/329: dwrite d18/d19/f20 [4194304,4194304] 0 2024-09-21T11:39:08.083 INFO:tasks.workunit.client.1.smithi149.stdout:9/330: chown d18/d19/d1a/d2f/d33 0 1 2024-09-21T11:39:08.085 INFO:tasks.workunit.client.1.smithi149.stdout:9/331: rmdir d18/d19/d1a/d2f 39 2024-09-21T11:39:08.087 INFO:tasks.workunit.client.1.smithi149.stdout:7/436: dread d12/d15/f32 [0,4194304] 0 2024-09-21T11:39:08.092 INFO:tasks.workunit.client.1.smithi149.stdout:9/332: getdents d18/d19/d1a/d2f/d30/d54 0 2024-09-21T11:39:08.095 INFO:tasks.workunit.client.1.smithi149.stdout:7/437: dwrite d12/d15/d4a/d4f/d75/f77 [0,4194304] 0 2024-09-21T11:39:08.098 INFO:tasks.workunit.client.1.smithi149.stdout:9/333: getdents d18/d19 0 2024-09-21T11:39:08.098 INFO:tasks.workunit.client.1.smithi149.stdout:7/438: chown d12/d15/d26/d30/d31/c71 435167702 1 2024-09-21T11:39:08.099 INFO:tasks.workunit.client.1.smithi149.stdout:9/334: stat ce 0 2024-09-21T11:39:08.099 INFO:tasks.workunit.client.1.smithi149.stdout:7/439: stat d12/d15/d4a/d4f/f5e 0 2024-09-21T11:39:08.102 INFO:tasks.workunit.client.1.smithi149.stdout:7/440: stat d12/d15/d4a/d6c 0 2024-09-21T11:39:08.104 INFO:tasks.workunit.client.1.smithi149.stdout:7/441: chown d12/d15/d26/l2f 213086 1 2024-09-21T11:39:08.104 INFO:tasks.workunit.client.1.smithi149.stdout:7/442: readlink d12/d15/d4a/l7f 0 2024-09-21T11:39:08.105 INFO:tasks.workunit.client.1.smithi149.stdout:9/335: dwrite f16 [4194304,4194304] 0 2024-09-21T11:39:08.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/443: stat d12/d15/d4a/f72 0 2024-09-21T11:39:08.106 INFO:tasks.workunit.client.1.smithi149.stdout:9/336: write d18/d19/f20 [5507320,87525] 0 2024-09-21T11:39:08.107 INFO:tasks.workunit.client.1.smithi149.stdout:7/444: rmdir d12/d15/d26/d30/d31/d47 39 2024-09-21T11:39:08.108 INFO:tasks.workunit.client.1.smithi149.stdout:9/337: fsync d18/d1c/f4f 0 2024-09-21T11:39:08.112 INFO:tasks.workunit.client.1.smithi149.stdout:3/335: sync 2024-09-21T11:39:08.113 INFO:tasks.workunit.client.1.smithi149.stdout:5/317: sync 2024-09-21T11:39:08.194 INFO:tasks.workunit.client.1.smithi149.stdout:7/445: chown d12/d15/d26/f29 646844 1 2024-09-21T11:39:08.196 INFO:tasks.workunit.client.1.smithi149.stdout:9/338: mkdir d18/d19/d1a/d2f/d53/d64 0 2024-09-21T11:39:08.198 INFO:tasks.workunit.client.1.smithi149.stdout:7/446: dread fa [0,4194304] 0 2024-09-21T11:39:08.201 INFO:tasks.workunit.client.1.smithi149.stdout:7/447: unlink d12/f41 0 2024-09-21T11:39:08.202 INFO:tasks.workunit.client.1.smithi149.stdout:9/339: symlink d18/d36/d3c/d47/l65 0 2024-09-21T11:39:08.204 INFO:tasks.workunit.client.1.smithi149.stdout:3/336: rename d6/d1f/d47/f5c to d6/d1f/d47/d37/f7b 0 2024-09-21T11:39:08.204 INFO:tasks.workunit.client.1.smithi149.stdout:5/318: getdents d4/d4f 0 2024-09-21T11:39:08.206 INFO:tasks.workunit.client.1.smithi149.stdout:9/340: creat d18/d36/d3c/d47/f66 x:0 0 0 2024-09-21T11:39:08.208 INFO:tasks.workunit.client.1.smithi149.stdout:7/448: truncate d12/d15/f1f 1695188 0 2024-09-21T11:39:08.210 INFO:tasks.workunit.client.1.smithi149.stdout:9/341: rmdir d18/d19/d1a/d2f/d53 39 2024-09-21T11:39:08.210 INFO:tasks.workunit.client.1.smithi149.stdout:5/319: dwrite d4/d7/f4e [0,4194304] 0 2024-09-21T11:39:08.211 INFO:tasks.workunit.client.1.smithi149.stdout:1/300: sync 2024-09-21T11:39:08.211 INFO:tasks.workunit.client.1.smithi149.stdout:0/286: sync 2024-09-21T11:39:08.216 INFO:tasks.workunit.client.1.smithi149.stdout:9/342: rename d18/f2a to d18/d4c/f67 0 2024-09-21T11:39:08.217 INFO:tasks.workunit.client.1.smithi149.stdout:1/301: creat d2/dd/d2e/d4c/f5c x:0 0 0 2024-09-21T11:39:08.219 INFO:tasks.workunit.client.1.smithi149.stdout:0/287: mkdir dd/d6a 0 2024-09-21T11:39:08.220 INFO:tasks.workunit.client.1.smithi149.stdout:3/337: dread d6/d1f/d47/f26 [0,4194304] 0 2024-09-21T11:39:08.220 INFO:tasks.workunit.client.1.smithi149.stdout:7/449: rename d12/d15/d26/d30/c63 to d12/d15/d26/d30/c83 0 2024-09-21T11:39:08.221 INFO:tasks.workunit.client.1.smithi149.stdout:9/343: creat d18/d19/d29/f68 x:0 0 0 2024-09-21T11:39:08.222 INFO:tasks.workunit.client.1.smithi149.stdout:1/302: creat d2/d2b/f5d x:0 0 0 2024-09-21T11:39:08.224 INFO:tasks.workunit.client.1.smithi149.stdout:7/450: rename d12/d35 to d12/d15/d4a/d6c/d84 0 2024-09-21T11:39:08.224 INFO:tasks.workunit.client.1.smithi149.stdout:7/451: stat d12/f1e 0 2024-09-21T11:39:08.225 INFO:tasks.workunit.client.1.smithi149.stdout:9/344: creat d18/d19/d29/d39/f69 x:0 0 0 2024-09-21T11:39:08.225 INFO:tasks.workunit.client.1.smithi149.stdout:3/338: symlink d6/d5f/d6d/l7c 0 2024-09-21T11:39:08.226 INFO:tasks.workunit.client.1.smithi149.stdout:3/339: read - d6/d1f/d47/f77 zero size 2024-09-21T11:39:08.227 INFO:tasks.workunit.client.1.smithi149.stdout:3/340: chown d6/d5f 13671 1 2024-09-21T11:39:08.227 INFO:tasks.workunit.client.1.smithi149.stdout:5/320: getdents d4/d1d/d50/d54/d2a 0 2024-09-21T11:39:08.228 INFO:tasks.workunit.client.1.smithi149.stdout:3/341: chown d6/d1f/d47/d37/d3a/f67 7 1 2024-09-21T11:39:08.228 INFO:tasks.workunit.client.1.smithi149.stdout:5/321: chown d4/d7/l17 12319893 1 2024-09-21T11:39:08.229 INFO:tasks.workunit.client.1.smithi149.stdout:9/345: mkdir d18/d19/d29/d6a 0 2024-09-21T11:39:08.231 INFO:tasks.workunit.client.1.smithi149.stdout:7/452: unlink d12/d5b/l81 0 2024-09-21T11:39:08.233 INFO:tasks.workunit.client.1.smithi149.stdout:5/322: creat d4/d1d/d50/d54/d2a/f6c x:0 0 0 2024-09-21T11:39:08.234 INFO:tasks.workunit.client.1.smithi149.stdout:9/346: creat d18/d4c/f6b x:0 0 0 2024-09-21T11:39:08.234 INFO:tasks.workunit.client.1.smithi149.stdout:5/323: read d4/d7/fa [5276461,52722] 0 2024-09-21T11:39:08.235 INFO:tasks.workunit.client.1.smithi149.stdout:1/303: creat d2/f5e x:0 0 0 2024-09-21T11:39:08.240 INFO:tasks.workunit.client.1.smithi149.stdout:9/347: fdatasync d18/d19/d1a/f23 0 2024-09-21T11:39:08.242 INFO:tasks.workunit.client.1.smithi149.stdout:1/304: creat d2/f5f x:0 0 0 2024-09-21T11:39:08.245 INFO:tasks.workunit.client.1.smithi149.stdout:5/324: dwrite d4/d1d/d50/f5e [0,4194304] 0 2024-09-21T11:39:08.249 INFO:tasks.workunit.client.1.smithi149.stdout:0/288: dwrite dd/d1a/f2e [0,4194304] 0 2024-09-21T11:39:08.250 INFO:tasks.workunit.client.1.smithi149.stdout:7/453: dwrite d12/f74 [0,4194304] 0 2024-09-21T11:39:08.251 INFO:tasks.workunit.client.1.smithi149.stdout:7/454: readlink d12/d15/d26/d30/l3a 0 2024-09-21T11:39:08.252 INFO:tasks.workunit.client.1.smithi149.stdout:9/348: rename d18/f5e to d18/d19/d29/d39/d63/f6c 0 2024-09-21T11:39:08.253 INFO:tasks.workunit.client.1.smithi149.stdout:5/325: unlink d4/f9 0 2024-09-21T11:39:08.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/305: getdents d2/d5/d8/d3b 0 2024-09-21T11:39:08.258 INFO:tasks.workunit.client.1.smithi149.stdout:5/326: truncate d4/d7/d40/d43/f69 120062 0 2024-09-21T11:39:08.262 INFO:tasks.workunit.client.1.smithi149.stdout:0/289: creat dd/d32/f6b x:0 0 0 2024-09-21T11:39:08.265 INFO:tasks.workunit.client.1.smithi149.stdout:1/306: read d2/d5/f34 [1211323,120717] 0 2024-09-21T11:39:08.265 INFO:tasks.workunit.client.1.smithi149.stdout:9/349: dwrite f0 [0,4194304] 0 2024-09-21T11:39:08.265 INFO:tasks.workunit.client.1.smithi149.stdout:0/290: mknod dd/d1a/c6c 0 2024-09-21T11:39:08.267 INFO:tasks.workunit.client.1.smithi149.stdout:7/455: rename d12/d15/d4a/d4f/f5e to d12/d15/d26/d30/f85 0 2024-09-21T11:39:08.267 INFO:tasks.workunit.client.1.smithi149.stdout:1/307: write d2/d5/d8/f17 [3881822,125845] 0 2024-09-21T11:39:08.267 INFO:tasks.workunit.client.1.smithi149.stdout:9/350: readlink d18/d36/l58 0 2024-09-21T11:39:08.267 INFO:tasks.workunit.client.1.smithi149.stdout:5/327: rmdir d4/d4f/d5b 0 2024-09-21T11:39:08.268 INFO:tasks.workunit.client.1.smithi149.stdout:0/291: read dd/d1a/f2e [2543506,110510] 0 2024-09-21T11:39:08.268 INFO:tasks.workunit.client.1.smithi149.stdout:5/328: stat d4/d1d/l22 0 2024-09-21T11:39:08.274 INFO:tasks.workunit.client.1.smithi149.stdout:5/329: dwrite d4/f5 [0,4194304] 0 2024-09-21T11:39:08.277 INFO:tasks.workunit.client.1.smithi149.stdout:1/308: creat d2/f60 x:0 0 0 2024-09-21T11:39:08.278 INFO:tasks.workunit.client.1.smithi149.stdout:9/351: creat d18/d36/f6d x:0 0 0 2024-09-21T11:39:08.282 INFO:tasks.workunit.client.1.smithi149.stdout:7/456: write d12/d15/d26/f29 [1887071,11856] 0 2024-09-21T11:39:08.284 INFO:tasks.workunit.client.1.smithi149.stdout:0/292: write dd/d2d/f43 [1963945,114046] 0 2024-09-21T11:39:08.285 INFO:tasks.workunit.client.1.smithi149.stdout:9/352: creat d18/d4c/d5b/f6e x:0 0 0 2024-09-21T11:39:08.285 INFO:tasks.workunit.client.1.smithi149.stdout:0/293: truncate dd/d2d/f43 4205049 0 2024-09-21T11:39:08.286 INFO:tasks.workunit.client.1.smithi149.stdout:2/383: sync 2024-09-21T11:39:08.286 INFO:tasks.workunit.client.1.smithi149.stdout:6/305: sync 2024-09-21T11:39:08.286 INFO:tasks.workunit.client.1.smithi149.stdout:8/312: sync 2024-09-21T11:39:08.286 INFO:tasks.workunit.client.1.smithi149.stdout:4/360: sync 2024-09-21T11:39:08.286 INFO:tasks.workunit.client.1.smithi149.stdout:5/330: creat d4/d7/d40/f6d x:0 0 0 2024-09-21T11:39:08.288 INFO:tasks.workunit.client.1.smithi149.stdout:7/457: rename d12/f48 to d12/d15/d4a/d6c/d84/f86 0 2024-09-21T11:39:08.288 INFO:tasks.workunit.client.1.smithi149.stdout:6/306: chown d8/da/fd 49794 1 2024-09-21T11:39:08.290 INFO:tasks.workunit.client.1.smithi149.stdout:8/313: read d3/d33/d34/d55/f59 [1295733,118296] 0 2024-09-21T11:39:08.290 INFO:tasks.workunit.client.1.smithi149.stdout:5/331: dread - d4/d7/d40/d51/f58 zero size 2024-09-21T11:39:08.290 INFO:tasks.workunit.client.1.smithi149.stdout:0/294: mkdir dd/d1a/d1b/d50/d6d 0 2024-09-21T11:39:08.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/309: truncate d2/f1a 1221053 0 2024-09-21T11:39:08.291 INFO:tasks.workunit.client.1.smithi149.stdout:2/384: mkdir d8/dd/d8c 0 2024-09-21T11:39:08.292 INFO:tasks.workunit.client.1.smithi149.stdout:4/361: mkdir d4/d6/d63/d15/d30/d81 0 2024-09-21T11:39:08.293 INFO:tasks.workunit.client.1.smithi149.stdout:5/332: write d4/d7/f27 [259907,46699] 0 2024-09-21T11:39:08.293 INFO:tasks.workunit.client.1.smithi149.stdout:1/310: chown d2/dd/f30 4654 1 2024-09-21T11:39:08.293 INFO:tasks.workunit.client.1.smithi149.stdout:8/314: creat d3/f69 x:0 0 0 2024-09-21T11:39:08.295 INFO:tasks.workunit.client.1.smithi149.stdout:5/333: chown d4/d7/d40/d43 1791 1 2024-09-21T11:39:08.295 INFO:tasks.workunit.client.1.smithi149.stdout:1/311: chown d2/d5/c3c 66462572 1 2024-09-21T11:39:08.295 INFO:tasks.workunit.client.1.smithi149.stdout:6/307: mkdir d8/da/d2c/d2d/d60 0 2024-09-21T11:39:08.296 INFO:tasks.workunit.client.1.smithi149.stdout:7/458: link d12/f21 d12/d15/d4a/f87 0 2024-09-21T11:39:08.296 INFO:tasks.workunit.client.1.smithi149.stdout:9/353: dwrite d18/d36/d3c/d47/f66 [0,4194304] 0 2024-09-21T11:39:08.297 INFO:tasks.workunit.client.1.smithi149.stdout:5/334: fdatasync d4/d7/d40/d43/f5f 0 2024-09-21T11:39:08.297 INFO:tasks.workunit.client.1.smithi149.stdout:4/362: dread - d4/f27 zero size 2024-09-21T11:39:08.298 INFO:tasks.workunit.client.1.smithi149.stdout:6/308: chown d8/da/d2c/f56 20 1 2024-09-21T11:39:08.299 INFO:tasks.workunit.client.1.smithi149.stdout:2/385: mknod d8/dd/d5c/d84/c8d 0 2024-09-21T11:39:08.301 INFO:tasks.workunit.client.1.smithi149.stdout:7/459: creat d12/d15/d4a/d4f/f88 x:0 0 0 2024-09-21T11:39:08.305 INFO:tasks.workunit.client.1.smithi149.stdout:4/363: symlink d4/d4d/d58/l82 0 2024-09-21T11:39:08.306 INFO:tasks.workunit.client.1.smithi149.stdout:6/309: creat d8/d32/d37/f61 x:0 0 0 2024-09-21T11:39:08.307 INFO:tasks.workunit.client.1.smithi149.stdout:9/354: symlink d18/d36/l6f 0 2024-09-21T11:39:08.308 INFO:tasks.workunit.client.1.smithi149.stdout:2/386: mkdir d8/da/d13/d5d/d6a/d8e 0 2024-09-21T11:39:08.309 INFO:tasks.workunit.client.1.smithi149.stdout:2/387: fsync d8/dd/f74 0 2024-09-21T11:39:08.311 INFO:tasks.workunit.client.1.smithi149.stdout:5/335: rename d4/d1d/d3e/c64 to d4/d7/d40/d43/d5c/c6e 0 2024-09-21T11:39:08.312 INFO:tasks.workunit.client.1.smithi149.stdout:4/364: dwrite d4/d6/d63/d15/d30/f53 [0,4194304] 0 2024-09-21T11:39:08.316 INFO:tasks.workunit.client.1.smithi149.stdout:7/460: symlink d12/d15/l89 0 2024-09-21T11:39:08.317 INFO:tasks.workunit.client.1.smithi149.stdout:1/312: getdents d2/dd/d35/d1c 0 2024-09-21T11:39:08.319 INFO:tasks.workunit.client.1.smithi149.stdout:4/365: dwrite d4/d6/d63/d10/d6f/f74 [0,4194304] 0 2024-09-21T11:39:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:07 smithi118 ceph-mon[28757]: pgmap v19: 65 pgs: 65 active+clean; 753 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s rd, 82 MiB/s wr, 409 op/s 2024-09-21T11:39:08.326 INFO:tasks.workunit.client.1.smithi149.stdout:4/366: mknod d4/d4d/c83 0 2024-09-21T11:39:08.328 INFO:tasks.workunit.client.1.smithi149.stdout:7/461: mknod d12/d15/d4a/d6c/c8a 0 2024-09-21T11:39:08.330 INFO:tasks.workunit.client.1.smithi149.stdout:9/355: link d18/d19/d1a/d2f/l56 d18/d19/d1a/l70 0 2024-09-21T11:39:08.332 INFO:tasks.workunit.client.1.smithi149.stdout:4/367: mknod d4/d6/d63/d78/c84 0 2024-09-21T11:39:08.337 INFO:tasks.workunit.client.1.smithi149.stdout:9/356: write d18/d19/d29/d39/d63/f6c [704193,40408] 0 2024-09-21T11:39:08.337 INFO:tasks.workunit.client.1.smithi149.stdout:7/462: chown d12/d15/d26/d30/c83 31 1 2024-09-21T11:39:08.338 INFO:tasks.workunit.client.1.smithi149.stdout:1/313: dwrite d2/d5/d8/d3b/f42 [0,4194304] 0 2024-09-21T11:39:08.341 INFO:tasks.workunit.client.1.smithi149.stdout:2/388: dwrite d8/da/d13/d1a/f3e [0,4194304] 0 2024-09-21T11:39:08.342 INFO:tasks.workunit.client.1.smithi149.stdout:7/463: chown d12/d15/d26/d30/d31/l56 517 1 2024-09-21T11:39:08.342 INFO:tasks.workunit.client.1.smithi149.stdout:4/368: creat d4/d6/d63/d10/d31/d32/d4a/f85 x:0 0 0 2024-09-21T11:39:08.342 INFO:tasks.workunit.client.1.smithi149.stdout:5/336: dread d4/d7/fa [0,4194304] 0 2024-09-21T11:39:08.345 INFO:tasks.workunit.client.1.smithi149.stdout:7/464: chown d12/d15/d26/d30/f5a 2414 1 2024-09-21T11:39:08.345 INFO:tasks.workunit.client.1.smithi149.stdout:4/369: chown d4/d6/d63/d10/c7a 861184281 1 2024-09-21T11:39:08.347 INFO:tasks.workunit.client.1.smithi149.stdout:3/342: sync 2024-09-21T11:39:08.348 INFO:tasks.workunit.client.1.smithi149.stdout:9/357: mknod d18/d19/d1a/d2f/d53/d64/c71 0 2024-09-21T11:39:08.360 INFO:tasks.workunit.client.1.smithi149.stdout:1/314: dwrite d2/dd/d35/d1c/d37/f44 [0,4194304] 0 2024-09-21T11:39:08.363 INFO:tasks.workunit.client.1.smithi149.stdout:7/465: mknod d12/d15/d26/d30/d31/d47/d49/c8b 0 2024-09-21T11:39:08.365 INFO:tasks.workunit.client.1.smithi149.stdout:2/389: dwrite d8/da/d13/d1a/f1f [4194304,4194304] 0 2024-09-21T11:39:08.365 INFO:tasks.workunit.client.1.smithi149.stdout:5/337: dwrite d4/d7/d40/d43/f69 [0,4194304] 0 2024-09-21T11:39:08.365 INFO:tasks.workunit.client.1.smithi149.stdout:4/370: rmdir d4/d6/d63/d15/d30/d81 0 2024-09-21T11:39:08.369 INFO:tasks.workunit.client.1.smithi149.stdout:1/315: unlink d2/d5/l4d 0 2024-09-21T11:39:08.372 INFO:tasks.workunit.client.1.smithi149.stdout:7/466: unlink d12/d15/d26/d30/d31/f37 0 2024-09-21T11:39:08.372 INFO:tasks.workunit.client.1.smithi149.stdout:2/390: write d8/da/d13/f7e [1640635,113354] 0 2024-09-21T11:39:08.373 INFO:tasks.workunit.client.1.smithi149.stdout:1/316: chown d2/f1e 3 1 2024-09-21T11:39:08.376 INFO:tasks.workunit.client.1.smithi149.stdout:3/343: dwrite d6/d1f/d27/f5b [0,4194304] 0 2024-09-21T11:39:08.380 INFO:tasks.workunit.client.1.smithi149.stdout:5/338: rename d4/d7/d40/d43/f5f to d4/d1d/f6f 0 2024-09-21T11:39:08.381 INFO:tasks.workunit.client.1.smithi149.stdout:2/391: readlink d8/da/d13/d1a/d3b/l42 0 2024-09-21T11:39:08.382 INFO:tasks.workunit.client.1.smithi149.stdout:9/358: dwrite d18/d19/d1a/d2f/f3d [0,4194304] 0 2024-09-21T11:39:08.382 INFO:tasks.workunit.client.1.smithi149.stdout:4/371: write d4/f27 [87626,27616] 0 2024-09-21T11:39:08.385 INFO:tasks.workunit.client.1.smithi149.stdout:7/467: mkdir d12/d15/d4a/d6c/d8c 0 2024-09-21T11:39:08.390 INFO:tasks.workunit.client.1.smithi149.stdout:1/317: rename d2/d2b/f5d to d2/dd/d35/d1c/d37/f61 0 2024-09-21T11:39:08.391 INFO:tasks.workunit.client.1.smithi149.stdout:3/344: creat d6/d79/f7d x:0 0 0 2024-09-21T11:39:08.395 INFO:tasks.workunit.client.1.smithi149.stdout:3/345: stat d6/d5f 0 2024-09-21T11:39:08.395 INFO:tasks.workunit.client.1.smithi149.stdout:4/372: rename d4/f1f to d4/d6/d63/d10/f86 0 2024-09-21T11:39:08.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/392: link d8/d11/l25 d8/dd/d5c/l8f 0 2024-09-21T11:39:08.400 INFO:tasks.workunit.client.1.smithi149.stdout:9/359: dwrite d18/d4c/d5b/f6e [0,4194304] 0 2024-09-21T11:39:08.400 INFO:tasks.workunit.client.1.smithi149.stdout:3/346: write d6/d1f/f2e [672774,28509] 0 2024-09-21T11:39:08.401 INFO:tasks.workunit.client.1.smithi149.stdout:5/339: getdents d4/d7/d40/d43/d49 0 2024-09-21T11:39:08.403 INFO:tasks.workunit.client.1.smithi149.stdout:4/373: creat d4/d4d/d5f/f87 x:0 0 0 2024-09-21T11:39:08.404 INFO:tasks.workunit.client.1.smithi149.stdout:1/318: dread d2/dd/d35/f24 [0,4194304] 0 2024-09-21T11:39:08.405 INFO:tasks.workunit.client.1.smithi149.stdout:0/295: sync 2024-09-21T11:39:08.406 INFO:tasks.workunit.client.1.smithi149.stdout:7/468: write d12/d15/f1f [2451059,22139] 0 2024-09-21T11:39:08.406 INFO:tasks.workunit.client.1.smithi149.stdout:1/319: write d2/dd/d35/d1c/d2c/f5a [2636764,118182] 0 2024-09-21T11:39:08.410 INFO:tasks.workunit.client.1.smithi149.stdout:3/347: fdatasync d6/d1f/d47/d37/d3a/f67 0 2024-09-21T11:39:08.411 INFO:tasks.workunit.client.1.smithi149.stdout:4/374: creat d4/d6/f88 x:0 0 0 2024-09-21T11:39:08.412 INFO:tasks.workunit.client.1.smithi149.stdout:3/348: chown d6/d1f/d47/d22/l2c 1106 1 2024-09-21T11:39:08.413 INFO:tasks.workunit.client.1.smithi149.stdout:9/360: dread d18/d1c/f46 [0,4194304] 0 2024-09-21T11:39:08.413 INFO:tasks.workunit.client.1.smithi149.stdout:3/349: stat d6/d1f/d47/d37/d50 0 2024-09-21T11:39:08.414 INFO:tasks.workunit.client.1.smithi149.stdout:9/361: chown fc 1162 1 2024-09-21T11:39:08.414 INFO:tasks.workunit.client.1.smithi149.stdout:2/393: unlink d8/d20/d57/c5e 0 2024-09-21T11:39:08.414 INFO:tasks.workunit.client.1.smithi149.stdout:0/296: symlink dd/d1a/d1b/d50/d53/l6e 0 2024-09-21T11:39:08.417 INFO:tasks.workunit.client.1.smithi149.stdout:4/375: mknod d4/d6/d63/d15/d30/d6b/c89 0 2024-09-21T11:39:08.419 INFO:tasks.workunit.client.1.smithi149.stdout:9/362: symlink d18/d19/d1a/d2f/d30/d54/l72 0 2024-09-21T11:39:08.420 INFO:tasks.workunit.client.1.smithi149.stdout:0/297: creat dd/d1a/d1b/d50/d53/f6f x:0 0 0 2024-09-21T11:39:08.422 INFO:tasks.workunit.client.1.smithi149.stdout:5/340: dwrite d4/f18 [0,4194304] 0 2024-09-21T11:39:08.423 INFO:tasks.workunit.client.1.smithi149.stdout:1/320: creat d2/d5/f62 x:0 0 0 2024-09-21T11:39:08.423 INFO:tasks.workunit.client.1.smithi149.stdout:4/376: mkdir d4/d6/d63/d15/d30/d8a 0 2024-09-21T11:39:08.426 INFO:tasks.workunit.client.1.smithi149.stdout:7/469: dwrite d12/d15/d4a/d6c/d84/f86 [4194304,4194304] 0 2024-09-21T11:39:08.426 INFO:tasks.workunit.client.1.smithi149.stdout:5/341: write d4/f5 [1883364,49184] 0 2024-09-21T11:39:08.426 INFO:tasks.workunit.client.1.smithi149.stdout:0/298: dread dd/d1a/d1b/d50/d53/f54 [0,4194304] 0 2024-09-21T11:39:08.427 INFO:tasks.workunit.client.1.smithi149.stdout:5/342: chown d4/d1d/d50/d54/d2a 10215998 1 2024-09-21T11:39:08.431 INFO:tasks.workunit.client.1.smithi149.stdout:2/394: getdents d8/d20/d78 0 2024-09-21T11:39:08.431 INFO:tasks.workunit.client.1.smithi149.stdout:9/363: creat d18/d19/d1a/d2f/d5f/f73 x:0 0 0 2024-09-21T11:39:08.434 INFO:tasks.workunit.client.1.smithi149.stdout:9/364: write d18/d19/f20 [4395687,114191] 0 2024-09-21T11:39:08.435 INFO:tasks.workunit.client.1.smithi149.stdout:1/321: rename d2/f5f to d2/d5/d8/d3b/f63 0 2024-09-21T11:39:08.436 INFO:tasks.workunit.client.1.smithi149.stdout:3/350: truncate d6/d1f/f2e 242543 0 2024-09-21T11:39:08.436 INFO:tasks.workunit.client.1.smithi149.stdout:1/322: dread - d2/f60 zero size 2024-09-21T11:39:08.437 INFO:tasks.workunit.client.1.smithi149.stdout:5/343: creat d4/d7/d40/d51/d56/f70 x:0 0 0 2024-09-21T11:39:08.438 INFO:tasks.workunit.client.1.smithi149.stdout:1/323: truncate d2/f5e 702426 0 2024-09-21T11:39:08.441 INFO:tasks.workunit.client.1.smithi149.stdout:4/377: rename d4/d6/d63/d10/d31/d32/d4a/f6a to d4/d6/f8b 0 2024-09-21T11:39:08.442 INFO:tasks.workunit.client.1.smithi149.stdout:9/365: creat d18/d19/d1a/d2f/d53/d64/f74 x:0 0 0 2024-09-21T11:39:08.446 INFO:tasks.workunit.client.1.smithi149.stdout:4/378: dread d4/d6/d63/d2d/f6e [0,4194304] 0 2024-09-21T11:39:08.447 INFO:tasks.workunit.client.1.smithi149.stdout:5/344: rename d4/d1d/d50/d60/d6a to d4/d1d/d50/d54/d2a/d71 0 2024-09-21T11:39:08.448 INFO:tasks.workunit.client.1.smithi149.stdout:1/324: dwrite d2/d5/d8/d3b/f42 [0,4194304] 0 2024-09-21T11:39:08.448 INFO:tasks.workunit.client.1.smithi149.stdout:7/470: link d12/d15/d4a/d6c/c8a d12/d15/d26/d30/c8d 0 2024-09-21T11:39:08.449 INFO:tasks.workunit.client.1.smithi149.stdout:8/315: sync 2024-09-21T11:39:08.449 INFO:tasks.workunit.client.1.smithi149.stdout:6/310: sync 2024-09-21T11:39:08.449 INFO:tasks.workunit.client.1.smithi149.stdout:5/345: chown d4/d7/f32 1 1 2024-09-21T11:39:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:07 smithi149 ceph-mon[36123]: pgmap v19: 65 pgs: 65 active+clean; 753 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s rd, 82 MiB/s wr, 409 op/s 2024-09-21T11:39:08.451 INFO:tasks.workunit.client.1.smithi149.stdout:4/379: chown d4/d6/d63/d10/d31/f40 57 1 2024-09-21T11:39:08.453 INFO:tasks.workunit.client.1.smithi149.stdout:6/311: readlink d8/da/d2c/l35 0 2024-09-21T11:39:08.453 INFO:tasks.workunit.client.1.smithi149.stdout:3/351: getdents d6/d1f/d47/d22 0 2024-09-21T11:39:08.454 INFO:tasks.workunit.client.1.smithi149.stdout:9/366: creat d18/d19/d1a/d2f/f75 x:0 0 0 2024-09-21T11:39:08.455 INFO:tasks.workunit.client.1.smithi149.stdout:5/346: truncate d4/d7/d40/f59 764254 0 2024-09-21T11:39:08.455 INFO:tasks.workunit.client.1.smithi149.stdout:3/352: chown d6/d1f/d47/d37/d50 760783859 1 2024-09-21T11:39:08.456 INFO:tasks.workunit.client.1.smithi149.stdout:8/316: unlink d3/dd/d3a/cb 0 2024-09-21T11:39:08.458 INFO:tasks.workunit.client.1.smithi149.stdout:1/325: unlink d2/d5/c19 0 2024-09-21T11:39:08.460 INFO:tasks.workunit.client.1.smithi149.stdout:6/312: creat d8/d32/d37/d2b/d51/f62 x:0 0 0 2024-09-21T11:39:08.461 INFO:tasks.workunit.client.1.smithi149.stdout:6/313: chown d8/da/fc 0 1 2024-09-21T11:39:08.462 INFO:tasks.workunit.client.1.smithi149.stdout:5/347: mkdir d4/d7/d40/d43/d72 0 2024-09-21T11:39:08.463 INFO:tasks.workunit.client.1.smithi149.stdout:9/367: mkdir d18/d36/d3c/d47/d76 0 2024-09-21T11:39:08.463 INFO:tasks.workunit.client.1.smithi149.stdout:2/395: dread d8/d11/f3d [0,4194304] 0 2024-09-21T11:39:08.465 INFO:tasks.workunit.client.1.smithi149.stdout:0/299: dread dd/d1a/d1b/f24 [4194304,4194304] 0 2024-09-21T11:39:08.466 INFO:tasks.workunit.client.1.smithi149.stdout:8/317: write d3/dd/d21/d54/f56 [3390260,54215] 0 2024-09-21T11:39:08.467 INFO:tasks.workunit.client.1.smithi149.stdout:1/326: link d2/dd/f22 d2/dd/d35/d1c/f64 0 2024-09-21T11:39:08.468 INFO:tasks.workunit.client.1.smithi149.stdout:9/368: write d18/d36/d3c/f3f [976759,42790] 0 2024-09-21T11:39:08.468 INFO:tasks.workunit.client.1.smithi149.stdout:2/396: write d8/dd/d5c/f76 [3035333,45229] 0 2024-09-21T11:39:08.468 INFO:tasks.workunit.client.1.smithi149.stdout:5/348: write d4/d1d/d50/d54/f35 [1483394,89519] 0 2024-09-21T11:39:08.470 INFO:tasks.workunit.client.1.smithi149.stdout:3/353: dwrite d6/d1f/d27/f63 [0,4194304] 0 2024-09-21T11:39:08.473 INFO:tasks.workunit.client.1.smithi149.stdout:7/471: dread f4 [0,4194304] 0 2024-09-21T11:39:08.473 INFO:tasks.workunit.client.1.smithi149.stdout:3/354: write d6/f16 [3939279,82064] 0 2024-09-21T11:39:08.474 INFO:tasks.workunit.client.1.smithi149.stdout:0/300: write dd/d1a/d1b/d50/d53/f6f [531988,84705] 0 2024-09-21T11:39:08.476 INFO:tasks.workunit.client.1.smithi149.stdout:2/397: truncate d8/da/d13/d5d/d6a/f8b 780916 0 2024-09-21T11:39:08.480 INFO:tasks.workunit.client.1.smithi149.stdout:0/301: mkdir dd/d35/d70 0 2024-09-21T11:39:08.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/349: dwrite d4/d1d/d50/d54/d2a/f34 [4194304,4194304] 0 2024-09-21T11:39:08.484 INFO:tasks.workunit.client.1.smithi149.stdout:0/302: chown dd/d2d/f4f 364883 1 2024-09-21T11:39:08.487 INFO:tasks.workunit.client.1.smithi149.stdout:8/318: link d3/d33/d34/d55/f59 d3/dd/f6a 0 2024-09-21T11:39:08.491 INFO:tasks.workunit.client.1.smithi149.stdout:2/398: creat d8/dd/d5c/d60/d67/d8a/f90 x:0 0 0 2024-09-21T11:39:08.491 INFO:tasks.workunit.client.1.smithi149.stdout:1/327: fsync d2/dd/d35/d1c/f23 0 2024-09-21T11:39:08.492 INFO:tasks.workunit.client.1.smithi149.stdout:9/369: dwrite d18/d1c/f46 [4194304,4194304] 0 2024-09-21T11:39:08.493 INFO:tasks.workunit.client.1.smithi149.stdout:0/303: write dd/d1a/d1b/d50/d53/f5c [44912,117831] 0 2024-09-21T11:39:08.496 INFO:tasks.workunit.client.1.smithi149.stdout:2/399: chown d8/da/d13/d5d/d6a 2173032 1 2024-09-21T11:39:08.499 INFO:tasks.workunit.client.1.smithi149.stdout:3/355: dwrite d6/d1f/d47/d37/f7b [0,4194304] 0 2024-09-21T11:39:08.500 INFO:tasks.workunit.client.1.smithi149.stdout:9/370: write d18/d19/d29/d39/f69 [655793,71574] 0 2024-09-21T11:39:08.503 INFO:tasks.workunit.client.1.smithi149.stdout:8/319: rename d3/f69 to d3/dd/d21/d54/d5c/f6b 0 2024-09-21T11:39:08.503 INFO:tasks.workunit.client.1.smithi149.stdout:0/304: write dd/d1a/d1b/d50/d53/d3a/d66/f69 [367656,5215] 0 2024-09-21T11:39:08.504 INFO:tasks.workunit.client.1.smithi149.stdout:5/350: rmdir d4/d7/d40/d43/d72 0 2024-09-21T11:39:08.505 INFO:tasks.workunit.client.1.smithi149.stdout:1/328: mkdir d2/d5/d65 0 2024-09-21T11:39:08.506 INFO:tasks.workunit.client.1.smithi149.stdout:2/400: creat d8/da/d13/d53/f91 x:0 0 0 2024-09-21T11:39:08.506 INFO:tasks.workunit.client.1.smithi149.stdout:3/356: mkdir d6/d79/d7e 0 2024-09-21T11:39:08.507 INFO:tasks.workunit.client.1.smithi149.stdout:7/472: dwrite d12/d15/f17 [0,4194304] 0 2024-09-21T11:39:08.507 INFO:tasks.workunit.client.1.smithi149.stdout:1/329: readlink d2/d5/d8/l10 0 2024-09-21T11:39:08.507 INFO:tasks.workunit.client.1.smithi149.stdout:8/320: chown d3/dd/d3a/c5 73293 1 2024-09-21T11:39:08.508 INFO:tasks.workunit.client.1.smithi149.stdout:5/351: dread - d4/d7/d40/f53 zero size 2024-09-21T11:39:08.508 INFO:tasks.workunit.client.1.smithi149.stdout:9/371: truncate d18/d19/d1a/d2f/f75 237520 0 2024-09-21T11:39:08.510 INFO:tasks.workunit.client.1.smithi149.stdout:8/321: write d3/f1d [638291,59771] 0 2024-09-21T11:39:08.512 INFO:tasks.workunit.client.1.smithi149.stdout:5/352: chown d4/d1d/d50/d54/d2a/l4c 28548 1 2024-09-21T11:39:08.513 INFO:tasks.workunit.client.1.smithi149.stdout:7/473: read d12/d15/f20 [3232466,99064] 0 2024-09-21T11:39:08.515 INFO:tasks.workunit.client.1.smithi149.stdout:0/305: getdents dd/d1a/d1b/d50/d6d 0 2024-09-21T11:39:08.516 INFO:tasks.workunit.client.1.smithi149.stdout:0/306: write dd/d1a/f44 [529101,13779] 0 2024-09-21T11:39:08.517 INFO:tasks.workunit.client.1.smithi149.stdout:9/372: unlink l11 0 2024-09-21T11:39:08.517 INFO:tasks.workunit.client.1.smithi149.stdout:3/357: symlink d6/d5f/d60/l7f 0 2024-09-21T11:39:08.518 INFO:tasks.workunit.client.1.smithi149.stdout:2/401: dwrite d8/d11/f3a [0,4194304] 0 2024-09-21T11:39:08.519 INFO:tasks.workunit.client.1.smithi149.stdout:8/322: readlink d3/dd/d3a/l65 0 2024-09-21T11:39:08.522 INFO:tasks.workunit.client.1.smithi149.stdout:1/330: mknod d2/dd/d35/d1c/d41/c66 0 2024-09-21T11:39:08.522 INFO:tasks.workunit.client.1.smithi149.stdout:2/402: truncate d8/da/d13/d53/f87 356963 0 2024-09-21T11:39:08.522 INFO:tasks.workunit.client.1.smithi149.stdout:7/474: symlink d12/d15/d4a/l8e 0 2024-09-21T11:39:08.523 INFO:tasks.workunit.client.1.smithi149.stdout:5/353: chown d4/d1d/d50/d54/l37 1892 1 2024-09-21T11:39:08.525 INFO:tasks.workunit.client.1.smithi149.stdout:8/323: fsync d3/f1d 0 2024-09-21T11:39:08.526 INFO:tasks.workunit.client.1.smithi149.stdout:0/307: rename dd/d2d/f63 to dd/d1a/d1b/d50/d5d/f71 0 2024-09-21T11:39:08.528 INFO:tasks.workunit.client.1.smithi149.stdout:0/308: readlink dd/d1a/d5a/l64 0 2024-09-21T11:39:08.528 INFO:tasks.workunit.client.1.smithi149.stdout:7/475: fsync d12/d15/d4a/d4f/d75/f77 0 2024-09-21T11:39:08.529 INFO:tasks.workunit.client.1.smithi149.stdout:9/373: getdents d18/d19/d29/d6a 0 2024-09-21T11:39:08.530 INFO:tasks.workunit.client.1.smithi149.stdout:2/403: symlink d8/dd/d50/l92 0 2024-09-21T11:39:08.531 INFO:tasks.workunit.client.1.smithi149.stdout:2/404: dread - d8/dd/d50/f5b zero size 2024-09-21T11:39:08.533 INFO:tasks.workunit.client.1.smithi149.stdout:3/358: creat d6/d1f/d47/f80 x:0 0 0 2024-09-21T11:39:08.537 INFO:tasks.workunit.client.1.smithi149.stdout:9/374: creat d18/d36/d3c/f77 x:0 0 0 2024-09-21T11:39:08.539 INFO:tasks.workunit.client.1.smithi149.stdout:7/476: creat d12/d15/d26/d30/d31/d47/f8f x:0 0 0 2024-09-21T11:39:08.540 INFO:tasks.workunit.client.1.smithi149.stdout:2/405: creat d8/d20/d78/f93 x:0 0 0 2024-09-21T11:39:08.541 INFO:tasks.workunit.client.1.smithi149.stdout:0/309: mkdir dd/d1a/d1b/d72 0 2024-09-21T11:39:08.543 INFO:tasks.workunit.client.1.smithi149.stdout:7/477: write f4 [5340880,21741] 0 2024-09-21T11:39:08.545 INFO:tasks.workunit.client.1.smithi149.stdout:3/359: rename d6/d1f/f7a to d6/d1f/d47/f81 0 2024-09-21T11:39:08.546 INFO:tasks.workunit.client.1.smithi149.stdout:4/380: sync 2024-09-21T11:39:08.547 INFO:tasks.workunit.client.1.smithi149.stdout:1/331: dwrite d2/dd/d35/d1c/f64 [4194304,4194304] 0 2024-09-21T11:39:08.551 INFO:tasks.workunit.client.1.smithi149.stdout:5/354: dread d4/d7/d40/d43/d5c/f5d [0,4194304] 0 2024-09-21T11:39:08.551 INFO:tasks.workunit.client.1.smithi149.stdout:0/310: chown dd/d1a/d1b/d50/d53/d3a/f5b 48 1 2024-09-21T11:39:08.553 INFO:tasks.workunit.client.1.smithi149.stdout:7/478: rename d12/d15 to d12/d90 0 2024-09-21T11:39:08.554 INFO:tasks.workunit.client.1.smithi149.stdout:4/381: write d4/d6/d63/d10/d31/f4b [1238129,24659] 0 2024-09-21T11:39:08.554 INFO:tasks.workunit.client.1.smithi149.stdout:5/355: fdatasync d4/f18 0 2024-09-21T11:39:08.555 INFO:tasks.workunit.client.1.smithi149.stdout:3/360: creat d6/d5f/d60/f82 x:0 0 0 2024-09-21T11:39:08.557 INFO:tasks.workunit.client.1.smithi149.stdout:9/375: dwrite d18/d19/f40 [0,4194304] 0 2024-09-21T11:39:08.557 INFO:tasks.workunit.client.1.smithi149.stdout:2/406: link d8/da/d13/f21 d8/da/d13/d2d/f94 0 2024-09-21T11:39:08.557 INFO:tasks.workunit.client.1.smithi149.stdout:1/332: truncate d2/dd/d2e/d4c/f52 225391 0 2024-09-21T11:39:08.559 INFO:tasks.workunit.client.1.smithi149.stdout:8/324: dread d3/dd/d3a/f63 [0,4194304] 0 2024-09-21T11:39:08.561 INFO:tasks.workunit.client.1.smithi149.stdout:3/361: write d6/d1f/d47/f52 [1894564,95878] 0 2024-09-21T11:39:08.561 INFO:tasks.workunit.client.1.smithi149.stdout:8/325: fdatasync d3/f20 0 2024-09-21T11:39:08.561 INFO:tasks.workunit.client.1.smithi149.stdout:2/407: chown d8/dd/d5c/d84/c8d 0 1 2024-09-21T11:39:08.563 INFO:tasks.workunit.client.1.smithi149.stdout:8/326: readlink d3/dd/d18/l32 0 2024-09-21T11:39:08.565 INFO:tasks.workunit.client.1.smithi149.stdout:9/376: symlink d18/d19/d1a/d2f/d33/l78 0 2024-09-21T11:39:08.569 INFO:tasks.workunit.client.1.smithi149.stdout:0/311: truncate dd/d32/f3c 998686 0 2024-09-21T11:39:08.570 INFO:tasks.workunit.client.1.smithi149.stdout:3/362: mkdir d6/d1f/d27/d83 0 2024-09-21T11:39:08.571 INFO:tasks.workunit.client.1.smithi149.stdout:9/377: mknod d18/d19/d29/c79 0 2024-09-21T11:39:08.571 INFO:tasks.workunit.client.1.smithi149.stdout:5/356: link d4/d7/ce d4/d7/d40/d43/d49/c73 0 2024-09-21T11:39:08.574 INFO:tasks.workunit.client.1.smithi149.stdout:8/327: mknod d3/d33/c6c 0 2024-09-21T11:39:08.574 INFO:tasks.workunit.client.1.smithi149.stdout:7/479: link d12/d90/d26/d30/d31/f3f d12/d90/d4a/d4f/d75/f91 0 2024-09-21T11:39:08.574 INFO:tasks.workunit.client.1.smithi149.stdout:5/357: fdatasync d4/d7/f27 0 2024-09-21T11:39:08.576 INFO:tasks.workunit.client.1.smithi149.stdout:2/408: creat d8/da/d13/f95 x:0 0 0 2024-09-21T11:39:08.578 INFO:tasks.workunit.client.1.smithi149.stdout:1/333: dwrite d2/f1e [0,4194304] 0 2024-09-21T11:39:08.587 INFO:tasks.workunit.client.1.smithi149.stdout:8/328: mkdir d3/dd/d21/d54/d5c/d6d 0 2024-09-21T11:39:08.589 INFO:tasks.workunit.client.1.smithi149.stdout:0/312: truncate dd/d2d/f4f 1333623 0 2024-09-21T11:39:08.590 INFO:tasks.workunit.client.1.smithi149.stdout:5/358: rename d4/d7/cd to d4/d1d/d50/d60/c74 0 2024-09-21T11:39:08.591 INFO:tasks.workunit.client.1.smithi149.stdout:4/382: dread d4/f7 [0,4194304] 0 2024-09-21T11:39:08.591 INFO:tasks.workunit.client.1.smithi149.stdout:8/329: mkdir d3/d12/d6e 0 2024-09-21T11:39:08.593 INFO:tasks.workunit.client.1.smithi149.stdout:3/363: write d6/d1f/d27/f63 [1087634,68266] 0 2024-09-21T11:39:08.593 INFO:tasks.workunit.client.1.smithi149.stdout:0/313: stat dd/d1a/d1b/d50/d53/d3a 0 2024-09-21T11:39:08.594 INFO:tasks.workunit.client.1.smithi149.stdout:5/359: symlink d4/d4f/l75 0 2024-09-21T11:39:08.595 INFO:tasks.workunit.client.1.smithi149.stdout:8/330: fsync d3/dd/d18/f51 0 2024-09-21T11:39:08.596 INFO:tasks.workunit.client.1.smithi149.stdout:4/383: chown d4/d6/d63/d10/d31/f4b 687 1 2024-09-21T11:39:08.596 INFO:tasks.workunit.client.1.smithi149.stdout:2/409: dwrite d8/f59 [0,4194304] 0 2024-09-21T11:39:08.597 INFO:tasks.workunit.client.1.smithi149.stdout:3/364: fdatasync d6/d1f/d47/d22/f49 0 2024-09-21T11:39:08.599 INFO:tasks.workunit.client.1.smithi149.stdout:7/480: dwrite d12/d90/d4a/d4f/d75/f77 [0,4194304] 0 2024-09-21T11:39:08.599 INFO:tasks.workunit.client.1.smithi149.stdout:0/314: mknod dd/d35/c73 0 2024-09-21T11:39:08.600 INFO:tasks.workunit.client.1.smithi149.stdout:2/410: write d8/dd/f56 [1065488,2108] 0 2024-09-21T11:39:08.604 INFO:tasks.workunit.client.1.smithi149.stdout:5/360: readlink d4/d7/l17 0 2024-09-21T11:39:08.604 INFO:tasks.workunit.client.1.smithi149.stdout:9/378: truncate d18/d19/d1a/f4b 4183485 0 2024-09-21T11:39:08.605 INFO:tasks.workunit.client.1.smithi149.stdout:9/379: chown d18 32275172 1 2024-09-21T11:39:08.606 INFO:tasks.workunit.client.1.smithi149.stdout:2/411: read d8/da/f39 [4267359,50657] 0 2024-09-21T11:39:08.607 INFO:tasks.workunit.client.1.smithi149.stdout:8/331: mknod d3/dd/d21/d54/d5c/d6d/c6f 0 2024-09-21T11:39:08.608 INFO:tasks.workunit.client.1.smithi149.stdout:3/365: creat d6/d1f/d47/f84 x:0 0 0 2024-09-21T11:39:08.610 INFO:tasks.workunit.client.1.smithi149.stdout:5/361: creat d4/d7/d40/d43/d49/f76 x:0 0 0 2024-09-21T11:39:08.613 INFO:tasks.workunit.client.1.smithi149.stdout:8/332: dread d3/fa [0,4194304] 0 2024-09-21T11:39:08.614 INFO:tasks.workunit.client.1.smithi149.stdout:0/315: dwrite dd/d1a/d1b/d50/d53/d3a/d66/f69 [0,4194304] 0 2024-09-21T11:39:08.614 INFO:tasks.workunit.client.1.smithi149.stdout:7/481: rename d12/d90/l89 to d12/d90/d26/d30/l92 0 2024-09-21T11:39:08.614 INFO:tasks.workunit.client.1.smithi149.stdout:3/366: read - d6/d1f/d47/d37/d3f/f40 zero size 2024-09-21T11:39:08.617 INFO:tasks.workunit.client.1.smithi149.stdout:7/482: write d12/d90/d4a/d4f/f88 [922383,10483] 0 2024-09-21T11:39:08.618 INFO:tasks.workunit.client.1.smithi149.stdout:7/483: chown d12/d90/f45 486506 1 2024-09-21T11:39:08.618 INFO:tasks.workunit.client.1.smithi149.stdout:3/367: chown d6/d1f/d27/f3c 779 1 2024-09-21T11:39:08.619 INFO:tasks.workunit.client.1.smithi149.stdout:3/368: write d6/d1f/d47/f80 [742868,110098] 0 2024-09-21T11:39:08.619 INFO:tasks.workunit.client.1.smithi149.stdout:0/316: truncate dd/d32/f3c 1236957 0 2024-09-21T11:39:08.621 INFO:tasks.workunit.client.1.smithi149.stdout:5/362: creat d4/d1d/d50/d54/f77 x:0 0 0 2024-09-21T11:39:08.622 INFO:tasks.workunit.client.1.smithi149.stdout:5/363: write d4/d7/d40/d43/d49/f76 [441623,78024] 0 2024-09-21T11:39:08.622 INFO:tasks.workunit.client.1.smithi149.stdout:9/380: getdents d18/d19/d29/d39 0 2024-09-21T11:39:08.624 INFO:tasks.workunit.client.1.smithi149.stdout:9/381: chown d18/d19/d1a/d2f/d30/d54 115 1 2024-09-21T11:39:08.625 INFO:tasks.workunit.client.1.smithi149.stdout:0/317: unlink dd/d2d/f43 0 2024-09-21T11:39:08.627 INFO:tasks.workunit.client.1.smithi149.stdout:4/384: truncate d4/d6/d63/d10/f86 113275 0 2024-09-21T11:39:08.630 INFO:tasks.workunit.client.1.smithi149.stdout:5/364: unlink d4/d1d/c3b 0 2024-09-21T11:39:08.630 INFO:tasks.workunit.client.1.smithi149.stdout:5/365: dread - d4/d7/d40/f6d zero size 2024-09-21T11:39:08.630 INFO:tasks.workunit.client.1.smithi149.stdout:9/382: rmdir d18/d19/d1a/d2f/d43 39 2024-09-21T11:39:08.630 INFO:tasks.workunit.client.1.smithi149.stdout:3/369: dread d6/d1f/d27/f5b [0,4194304] 0 2024-09-21T11:39:08.633 INFO:tasks.workunit.client.1.smithi149.stdout:4/385: mknod d4/d6/d63/d15/d16/d23/d62/c8c 0 2024-09-21T11:39:08.633 INFO:tasks.workunit.client.1.smithi149.stdout:7/484: write d12/d90/f20 [4109928,12121] 0 2024-09-21T11:39:08.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/386: fsync d4/f55 0 2024-09-21T11:39:08.636 INFO:tasks.workunit.client.1.smithi149.stdout:6/314: sync 2024-09-21T11:39:08.637 INFO:tasks.workunit.client.1.smithi149.stdout:5/366: rename d4/d7/d40/d43/d5c/f5d to d4/d7/d40/d43/d49/f78 0 2024-09-21T11:39:08.638 INFO:tasks.workunit.client.1.smithi149.stdout:9/383: mkdir d18/d19/d1a/d2f/d5f/d7a 0 2024-09-21T11:39:08.639 INFO:tasks.workunit.client.1.smithi149.stdout:4/387: dread d4/d6/d63/f28 [4194304,4194304] 0 2024-09-21T11:39:08.645 INFO:tasks.workunit.client.1.smithi149.stdout:9/384: dwrite d18/d36/d3c/f3f [0,4194304] 0 2024-09-21T11:39:08.646 INFO:tasks.workunit.client.1.smithi149.stdout:0/318: truncate dd/d1a/f2e 2620305 0 2024-09-21T11:39:08.647 INFO:tasks.workunit.client.1.smithi149.stdout:9/385: write d18/d1c/f60 [274215,7462] 0 2024-09-21T11:39:08.647 INFO:tasks.workunit.client.1.smithi149.stdout:5/367: symlink d4/d7/d40/l79 0 2024-09-21T11:39:08.649 INFO:tasks.workunit.client.1.smithi149.stdout:6/315: link d8/da/fc d8/d32/d37/d2b/d51/f63 0 2024-09-21T11:39:08.650 INFO:tasks.workunit.client.1.smithi149.stdout:4/388: creat d4/d4d/d5f/d71/f8d x:0 0 0 2024-09-21T11:39:08.650 INFO:tasks.workunit.client.1.smithi149.stdout:6/316: dread - d8/d32/d37/d2b/d51/f62 zero size 2024-09-21T11:39:08.650 INFO:tasks.workunit.client.1.smithi149.stdout:7/485: truncate ff 3894831 0 2024-09-21T11:39:08.650 INFO:tasks.workunit.client.1.smithi149.stdout:4/389: readlink d4/l67 0 2024-09-21T11:39:08.653 INFO:tasks.workunit.client.1.smithi149.stdout:0/319: dread dd/d1a/d1b/d50/d53/f54 [0,4194304] 0 2024-09-21T11:39:08.653 INFO:tasks.workunit.client.1.smithi149.stdout:3/370: dread d6/f9 [0,4194304] 0 2024-09-21T11:39:08.653 INFO:tasks.workunit.client.1.smithi149.stdout:9/386: unlink ce 0 2024-09-21T11:39:08.654 INFO:tasks.workunit.client.1.smithi149.stdout:5/368: mkdir d4/d7/d40/d43/d5c/d7a 0 2024-09-21T11:39:08.655 INFO:tasks.workunit.client.1.smithi149.stdout:7/486: creat d12/d90/d4a/f93 x:0 0 0 2024-09-21T11:39:08.657 INFO:tasks.workunit.client.1.smithi149.stdout:4/390: symlink d4/d4d/d5f/l8e 0 2024-09-21T11:39:08.659 INFO:tasks.workunit.client.1.smithi149.stdout:0/320: creat dd/d1a/d5a/f74 x:0 0 0 2024-09-21T11:39:08.659 INFO:tasks.workunit.client.1.smithi149.stdout:4/391: dread - d4/d6/f5e zero size 2024-09-21T11:39:08.661 INFO:tasks.workunit.client.1.smithi149.stdout:3/371: write d6/f8 [2749105,19483] 0 2024-09-21T11:39:08.661 INFO:tasks.workunit.client.1.smithi149.stdout:0/321: rmdir dd 39 2024-09-21T11:39:08.666 INFO:tasks.workunit.client.1.smithi149.stdout:5/369: truncate d4/d1d/d50/d54/d2a/f6c 155247 0 2024-09-21T11:39:08.667 INFO:tasks.workunit.client.1.smithi149.stdout:6/317: dwrite d8/d32/d37/d28/d2e/f3b [0,4194304] 0 2024-09-21T11:39:08.668 INFO:tasks.workunit.client.1.smithi149.stdout:7/487: rename d12/d90/d26/d30/d31 to d12/d90/d4a/d4f/d75/d94 0 2024-09-21T11:39:08.669 INFO:tasks.workunit.client.1.smithi149.stdout:9/387: dwrite d18/d19/d1a/d2f/f3d [0,4194304] 0 2024-09-21T11:39:08.670 INFO:tasks.workunit.client.1.smithi149.stdout:7/488: chown d12/d90/d26/f65 147 1 2024-09-21T11:39:08.672 INFO:tasks.workunit.client.1.smithi149.stdout:0/322: mknod dd/d32/c75 0 2024-09-21T11:39:08.673 INFO:tasks.workunit.client.1.smithi149.stdout:9/388: truncate d18/d36/f6d 1047846 0 2024-09-21T11:39:08.675 INFO:tasks.workunit.client.1.smithi149.stdout:5/370: symlink d4/d1d/d50/d54/l7b 0 2024-09-21T11:39:08.675 INFO:tasks.workunit.client.1.smithi149.stdout:7/489: read d12/d90/d26/f3e [1681650,42629] 0 2024-09-21T11:39:08.676 INFO:tasks.workunit.client.1.smithi149.stdout:4/392: link d4/d6/d63/d15/d16/f33 d4/d6/f8f 0 2024-09-21T11:39:08.681 INFO:tasks.workunit.client.1.smithi149.stdout:7/490: chown d12/d90/d26/d30 403 1 2024-09-21T11:39:08.681 INFO:tasks.workunit.client.1.smithi149.stdout:0/323: symlink dd/d1a/d1b/d50/d53/l76 0 2024-09-21T11:39:08.682 INFO:tasks.workunit.client.1.smithi149.stdout:5/371: creat d4/d1d/d3e/f7c x:0 0 0 2024-09-21T11:39:08.683 INFO:tasks.workunit.client.1.smithi149.stdout:4/393: fsync d4/d6/d63/d10/d31/d32/d4a/f85 0 2024-09-21T11:39:08.684 INFO:tasks.workunit.client.1.smithi149.stdout:3/372: dread d6/f38 [0,4194304] 0 2024-09-21T11:39:08.684 INFO:tasks.workunit.client.1.smithi149.stdout:9/389: creat d18/d36/d3c/d47/d76/f7b x:0 0 0 2024-09-21T11:39:08.685 INFO:tasks.workunit.client.1.smithi149.stdout:7/491: dread - d12/d90/d4a/d4f/d75/d94/f6f zero size 2024-09-21T11:39:08.688 INFO:tasks.workunit.client.1.smithi149.stdout:4/394: truncate d4/d6/f88 953475 0 2024-09-21T11:39:08.690 INFO:tasks.workunit.client.1.smithi149.stdout:9/390: mkdir d18/d36/d3c/d47/d76/d7c 0 2024-09-21T11:39:08.693 INFO:tasks.workunit.client.1.smithi149.stdout:0/324: dwrite dd/d35/f4d [0,4194304] 0 2024-09-21T11:39:08.693 INFO:tasks.workunit.client.1.smithi149.stdout:4/395: creat d4/d6/d63/d10/d31/f90 x:0 0 0 2024-09-21T11:39:08.693 INFO:tasks.workunit.client.1.smithi149.stdout:9/391: dread - d18/d19/d1a/d2f/d5f/f73 zero size 2024-09-21T11:39:08.693 INFO:tasks.workunit.client.1.smithi149.stdout:5/372: getdents d4/d7/d40/d43/d5c 0 2024-09-21T11:39:08.696 INFO:tasks.workunit.client.1.smithi149.stdout:3/373: dwrite d6/d1f/d47/d37/f7b [4194304,4194304] 0 2024-09-21T11:39:08.696 INFO:tasks.workunit.client.1.smithi149.stdout:5/373: readlink d4/d7/l28 0 2024-09-21T11:39:08.697 INFO:tasks.workunit.client.1.smithi149.stdout:4/396: creat d4/d4d/d58/f91 x:0 0 0 2024-09-21T11:39:08.703 INFO:tasks.workunit.client.1.smithi149.stdout:9/392: mkdir d18/d19/d1a/d2f/d7d 0 2024-09-21T11:39:08.705 INFO:tasks.workunit.client.1.smithi149.stdout:0/325: rename dd/d1a/f2e to dd/d1a/d5a/f77 0 2024-09-21T11:39:08.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/492: fsync d12/d90/d68/f7a 0 2024-09-21T11:39:08.709 INFO:tasks.workunit.client.1.smithi149.stdout:9/393: rename d18/l44 to d18/d4c/d5b/l7e 0 2024-09-21T11:39:08.709 INFO:tasks.workunit.client.1.smithi149.stdout:5/374: dwrite d4/d7/f32 [0,4194304] 0 2024-09-21T11:39:08.711 INFO:tasks.workunit.client.1.smithi149.stdout:9/394: write d18/d19/d29/f68 [202122,113087] 0 2024-09-21T11:39:08.712 INFO:tasks.workunit.client.1.smithi149.stdout:3/374: link d6/d1f/d4c/c68 d6/d1f/d47/d22/c85 0 2024-09-21T11:39:08.713 INFO:tasks.workunit.client.1.smithi149.stdout:0/326: mkdir dd/d1a/d1b/d72/d78 0 2024-09-21T11:39:08.718 INFO:tasks.workunit.client.1.smithi149.stdout:7/493: rename d12/d90/d4a/d6c/l82 to d12/d90/d26/l95 0 2024-09-21T11:39:08.718 INFO:tasks.workunit.client.1.smithi149.stdout:9/395: write fc [661874,31485] 0 2024-09-21T11:39:08.718 INFO:tasks.workunit.client.1.smithi149.stdout:3/375: creat d6/d79/f86 x:0 0 0 2024-09-21T11:39:08.721 INFO:tasks.workunit.client.1.smithi149.stdout:3/376: fsync d6/d1f/d47/d22/f5d 0 2024-09-21T11:39:08.721 INFO:tasks.workunit.client.1.smithi149.stdout:9/396: unlink f0 0 2024-09-21T11:39:08.722 INFO:tasks.workunit.client.1.smithi149.stdout:0/327: getdents dd/d1a/d1b/d50/d5d 0 2024-09-21T11:39:08.724 INFO:tasks.workunit.client.1.smithi149.stdout:5/375: dwrite d4/d7/d40/f65 [0,4194304] 0 2024-09-21T11:39:08.725 INFO:tasks.workunit.client.1.smithi149.stdout:3/377: creat d6/d1f/d4c/f87 x:0 0 0 2024-09-21T11:39:08.729 INFO:tasks.workunit.client.1.smithi149.stdout:5/376: fdatasync d4/d7/f31 0 2024-09-21T11:39:08.730 INFO:tasks.workunit.client.1.smithi149.stdout:7/494: dwrite d12/d90/f1f [0,4194304] 0 2024-09-21T11:39:08.731 INFO:tasks.workunit.client.1.smithi149.stdout:9/397: creat d18/d36/f7f x:0 0 0 2024-09-21T11:39:08.732 INFO:tasks.workunit.client.1.smithi149.stdout:1/334: sync 2024-09-21T11:39:08.742 INFO:tasks.workunit.client.1.smithi149.stdout:1/335: mkdir d2/d5/d65/d67 0 2024-09-21T11:39:08.743 INFO:tasks.workunit.client.1.smithi149.stdout:3/378: dwrite d6/d1f/d27/f33 [0,4194304] 0 2024-09-21T11:39:08.744 INFO:tasks.workunit.client.1.smithi149.stdout:7/495: creat d12/d90/f96 x:0 0 0 2024-09-21T11:39:08.744 INFO:tasks.workunit.client.1.smithi149.stdout:5/377: getdents d4/d1d/d50/d54 0 2024-09-21T11:39:08.745 INFO:tasks.workunit.client.1.smithi149.stdout:1/336: fsync d2/dd/d35/d1c/f38 0 2024-09-21T11:39:08.746 INFO:tasks.workunit.client.1.smithi149.stdout:9/398: dwrite d18/d4c/f67 [0,4194304] 0 2024-09-21T11:39:08.747 INFO:tasks.workunit.client.1.smithi149.stdout:9/399: stat d18/d19/f40 0 2024-09-21T11:39:08.749 INFO:tasks.workunit.client.1.smithi149.stdout:7/496: rename d12/d90/d4a/d6c/d84/l80 to d12/d90/d4a/d4f/l97 0 2024-09-21T11:39:08.752 INFO:tasks.workunit.client.1.smithi149.stdout:9/400: creat d18/d19/d1a/d2f/d5f/f80 x:0 0 0 2024-09-21T11:39:08.754 INFO:tasks.workunit.client.1.smithi149.stdout:7/497: readlink d12/d90/d26/d30/l92 0 2024-09-21T11:39:08.755 INFO:tasks.workunit.client.1.smithi149.stdout:9/401: write d18/d4c/d5b/f6e [5030663,17224] 0 2024-09-21T11:39:08.756 INFO:tasks.workunit.client.1.smithi149.stdout:5/378: dwrite d4/d7/d40/f53 [0,4194304] 0 2024-09-21T11:39:08.756 INFO:tasks.workunit.client.1.smithi149.stdout:9/402: stat d18/d19/d29 0 2024-09-21T11:39:08.758 INFO:tasks.workunit.client.1.smithi149.stdout:7/498: dread d12/d90/d68/f7b [0,4194304] 0 2024-09-21T11:39:08.758 INFO:tasks.workunit.client.1.smithi149.stdout:9/403: write d18/d19/d29/d39/d63/f6c [264415,5699] 0 2024-09-21T11:39:08.765 INFO:tasks.workunit.client.1.smithi149.stdout:5/379: getdents d4/d1d/d3e 0 2024-09-21T11:39:08.767 INFO:tasks.workunit.client.1.smithi149.stdout:5/380: rmdir d4/d1d/d50/d54 39 2024-09-21T11:39:08.769 INFO:tasks.workunit.client.1.smithi149.stdout:5/381: creat d4/d1d/d50/f7d x:0 0 0 2024-09-21T11:39:08.770 INFO:tasks.workunit.client.1.smithi149.stdout:5/382: chown d4/d7/l16 73605 1 2024-09-21T11:39:08.773 INFO:tasks.workunit.client.1.smithi149.stdout:5/383: link d4/d1d/l52 d4/d7/l7e 0 2024-09-21T11:39:08.773 INFO:tasks.workunit.client.1.smithi149.stdout:5/384: chown d4/d7/d40/f6d 15706 1 2024-09-21T11:39:08.774 INFO:tasks.workunit.client.1.smithi149.stdout:5/385: truncate d4/d7/d40/d51/f58 1012279 0 2024-09-21T11:39:08.774 INFO:tasks.workunit.client.1.smithi149.stdout:5/386: read d4/f18 [1540894,5716] 0 2024-09-21T11:39:08.780 INFO:tasks.workunit.client.1.smithi149.stdout:5/387: dwrite d4/d7/f27 [0,4194304] 0 2024-09-21T11:39:08.782 INFO:tasks.workunit.client.1.smithi149.stdout:5/388: creat d4/d4f/f7f x:0 0 0 2024-09-21T11:39:08.786 INFO:tasks.workunit.client.1.smithi149.stdout:5/389: creat d4/d1d/d50/f80 x:0 0 0 2024-09-21T11:39:08.792 INFO:tasks.workunit.client.1.smithi149.stdout:5/390: dwrite d4/d7/d40/f65 [4194304,4194304] 0 2024-09-21T11:39:08.801 INFO:tasks.workunit.client.1.smithi149.stdout:5/391: dwrite d4/d1d/d3e/f7c [0,4194304] 0 2024-09-21T11:39:08.806 INFO:tasks.workunit.client.1.smithi149.stdout:5/392: fsync d4/d7/f27 0 2024-09-21T11:39:08.808 INFO:tasks.workunit.client.1.smithi149.stdout:5/393: write d4/d1d/d50/d54/f77 [365059,53153] 0 2024-09-21T11:39:08.809 INFO:tasks.workunit.client.1.smithi149.stdout:5/394: write d4/d7/d40/f53 [3653522,104182] 0 2024-09-21T11:39:08.813 INFO:tasks.workunit.client.1.smithi149.stdout:5/395: getdents d4 0 2024-09-21T11:39:08.814 INFO:tasks.workunit.client.1.smithi149.stdout:5/396: write d4/d7/d40/d43/d5c/f66 [164026,95071] 0 2024-09-21T11:39:08.816 INFO:tasks.workunit.client.1.smithi149.stdout:5/397: mkdir d4/d7/d40/d43/d5c/d7a/d81 0 2024-09-21T11:39:08.817 INFO:tasks.workunit.client.1.smithi149.stdout:5/398: symlink d4/d1d/l82 0 2024-09-21T11:39:08.820 INFO:tasks.workunit.client.1.smithi149.stdout:5/399: rename d4/d1d/d50/f5e to d4/d7/d40/d43/d5c/d7a/d81/f83 0 2024-09-21T11:39:08.825 INFO:tasks.workunit.client.1.smithi149.stdout:5/400: dwrite d4/d7/d40/f53 [0,4194304] 0 2024-09-21T11:39:08.829 INFO:tasks.workunit.client.1.smithi149.stdout:5/401: creat d4/d1d/d3e/f84 x:0 0 0 2024-09-21T11:39:08.830 INFO:tasks.workunit.client.1.smithi149.stdout:5/402: mkdir d4/d7/d40/d43/d85 0 2024-09-21T11:39:08.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/412: sync 2024-09-21T11:39:08.843 INFO:tasks.workunit.client.1.smithi149.stdout:0/328: dread dd/d32/f3c [0,4194304] 0 2024-09-21T11:39:08.845 INFO:tasks.workunit.client.1.smithi149.stdout:2/413: dwrite d8/da/d13/d1a/d29/f58 [4194304,4194304] 0 2024-09-21T11:39:08.846 INFO:tasks.workunit.client.1.smithi149.stdout:2/414: write d8/dd/f5f [41406,52001] 0 2024-09-21T11:39:08.850 INFO:tasks.workunit.client.1.smithi149.stdout:5/403: dread d4/d7/f31 [4194304,4194304] 0 2024-09-21T11:39:08.855 INFO:tasks.workunit.client.1.smithi149.stdout:5/404: getdents d4/d7/d40/d43/d85 0 2024-09-21T11:39:08.856 INFO:tasks.workunit.client.1.smithi149.stdout:5/405: stat d4/d7/f31 0 2024-09-21T11:39:08.857 INFO:tasks.workunit.client.1.smithi149.stdout:3/379: write d6/fa [617576,2803] 0 2024-09-21T11:39:08.858 INFO:tasks.workunit.client.1.smithi149.stdout:5/406: write d4/d1d/d50/d54/f23 [4740327,110680] 0 2024-09-21T11:39:08.861 INFO:tasks.workunit.client.1.smithi149.stdout:3/380: rmdir d6/d1f/d27 39 2024-09-21T11:39:08.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/407: truncate d4/d1d/d50/d54/d2a/f4d 3920640 0 2024-09-21T11:39:08.863 INFO:tasks.workunit.client.1.smithi149.stdout:9/404: dread d18/d19/d29/f68 [0,4194304] 0 2024-09-21T11:39:08.864 INFO:tasks.workunit.client.1.smithi149.stdout:3/381: mkdir d6/d5f/d60/d88 0 2024-09-21T11:39:08.866 INFO:tasks.workunit.client.1.smithi149.stdout:9/405: symlink d18/d19/d1a/d2f/d53/l81 0 2024-09-21T11:39:08.867 INFO:tasks.workunit.client.1.smithi149.stdout:6/318: sync 2024-09-21T11:39:08.867 INFO:tasks.workunit.client.1.smithi149.stdout:8/333: sync 2024-09-21T11:39:08.867 INFO:tasks.workunit.client.1.smithi149.stdout:4/397: sync 2024-09-21T11:39:08.868 INFO:tasks.workunit.client.1.smithi149.stdout:3/382: rename d6/d1f/d47/d37/d3a/f5e to d6/d79/d7e/f89 0 2024-09-21T11:39:08.871 INFO:tasks.workunit.client.1.smithi149.stdout:6/319: write d8/da/d3d/f43 [455380,73581] 0 2024-09-21T11:39:08.874 INFO:tasks.workunit.client.1.smithi149.stdout:7/499: dwrite ff [0,4194304] 0 2024-09-21T11:39:08.875 INFO:tasks.workunit.client.1.smithi149.stdout:3/383: write d6/d1f/d47/d22/f5d [3420407,130028] 0 2024-09-21T11:39:08.875 INFO:tasks.workunit.client.1.smithi149.stdout:6/320: chown d8/d32/d37 947591 1 2024-09-21T11:39:08.877 INFO:tasks.workunit.client.1.smithi149.stdout:0/329: dread dd/f15 [0,4194304] 0 2024-09-21T11:39:08.880 INFO:tasks.workunit.client.1.smithi149.stdout:8/334: creat d3/dd/d18/d2e/f70 x:0 0 0 2024-09-21T11:39:08.881 INFO:tasks.workunit.client.1.smithi149.stdout:4/398: fsync d4/d6/f8f 0 2024-09-21T11:39:08.881 INFO:tasks.workunit.client.1.smithi149.stdout:9/406: mknod d18/d19/d29/d6a/c82 0 2024-09-21T11:39:08.881 INFO:tasks.workunit.client.1.smithi149.stdout:0/330: chown dd/d1a/d1b/d50/d53/l6e 3698 1 2024-09-21T11:39:08.882 INFO:tasks.workunit.client.1.smithi149.stdout:2/415: dread d8/da/f55 [4194304,4194304] 0 2024-09-21T11:39:08.882 INFO:tasks.workunit.client.1.smithi149.stdout:3/384: readlink d6/l55 0 2024-09-21T11:39:08.885 INFO:tasks.workunit.client.1.smithi149.stdout:4/399: dread - d4/d6/d63/d15/d30/f48 zero size 2024-09-21T11:39:08.890 INFO:tasks.workunit.client.1.smithi149.stdout:4/400: fsync d4/d4d/f45 0 2024-09-21T11:39:08.890 INFO:tasks.workunit.client.1.smithi149.stdout:8/335: truncate d3/f20 4491009 0 2024-09-21T11:39:08.892 INFO:tasks.workunit.client.1.smithi149.stdout:2/416: creat d8/dd/d5c/d60/d67/d8a/f96 x:0 0 0 2024-09-21T11:39:08.895 INFO:tasks.workunit.client.1.smithi149.stdout:4/401: write d4/d6/d18/f2a [585754,100913] 0 2024-09-21T11:39:08.895 INFO:tasks.workunit.client.1.smithi149.stdout:5/408: dread f2 [0,4194304] 0 2024-09-21T11:39:08.896 INFO:tasks.workunit.client.1.smithi149.stdout:9/407: dread d18/d36/d3c/f3f [0,4194304] 0 2024-09-21T11:39:08.897 INFO:tasks.workunit.client.1.smithi149.stdout:3/385: write d6/fe [561315,97138] 0 2024-09-21T11:39:08.899 INFO:tasks.workunit.client.1.smithi149.stdout:2/417: creat d8/d20/f97 x:0 0 0 2024-09-21T11:39:08.901 INFO:tasks.workunit.client.1.smithi149.stdout:6/321: getdents d8/da/d14 0 2024-09-21T11:39:08.901 INFO:tasks.workunit.client.1.smithi149.stdout:4/402: stat d4/d6/d63/d10/d31/f90 0 2024-09-21T11:39:08.901 INFO:tasks.workunit.client.1.smithi149.stdout:5/409: symlink d4/d7/d40/d51/l86 0 2024-09-21T11:39:08.901 INFO:tasks.workunit.client.1.smithi149.stdout:2/418: fdatasync f7 0 2024-09-21T11:39:08.904 INFO:tasks.workunit.client.1.smithi149.stdout:8/336: truncate d3/d33/d34/d55/f59 4492968 0 2024-09-21T11:39:08.904 INFO:tasks.workunit.client.1.smithi149.stdout:3/386: chown d6/d1f/d47/d22/c6f 26214035 1 2024-09-21T11:39:08.905 INFO:tasks.workunit.client.1.smithi149.stdout:5/410: chown d4/d7/d40/d43/d5c/d7a 8187 1 2024-09-21T11:39:08.906 INFO:tasks.workunit.client.1.smithi149.stdout:4/403: mkdir d4/d6/d63/d92 0 2024-09-21T11:39:08.907 INFO:tasks.workunit.client.1.smithi149.stdout:2/419: creat d8/da/d13/d1a/d29/f98 x:0 0 0 2024-09-21T11:39:08.907 INFO:tasks.workunit.client.1.smithi149.stdout:6/322: write d8/da/d2c/d52/f5c [977326,121439] 0 2024-09-21T11:39:08.908 INFO:tasks.workunit.client.1.smithi149.stdout:0/331: dwrite dd/d1a/d1b/f31 [4194304,4194304] 0 2024-09-21T11:39:08.909 INFO:tasks.workunit.client.1.smithi149.stdout:4/404: chown d4/l67 19855902 1 2024-09-21T11:39:08.909 INFO:tasks.workunit.client.1.smithi149.stdout:3/387: symlink d6/d1f/d4c/l8a 0 2024-09-21T11:39:08.909 INFO:tasks.workunit.client.1.smithi149.stdout:5/411: fsync d4/d1d/d3e/f84 0 2024-09-21T11:39:08.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/420: read d8/dd/d5c/f76 [3934174,36318] 0 2024-09-21T11:39:08.913 INFO:tasks.workunit.client.1.smithi149.stdout:1/337: sync 2024-09-21T11:39:08.913 INFO:tasks.workunit.client.1.smithi149.stdout:7/500: dread d12/d90/d4a/d4f/d75/d94/f3f [0,4194304] 0 2024-09-21T11:39:08.913 INFO:tasks.workunit.client.1.smithi149.stdout:6/323: mkdir d8/d32/d64 0 2024-09-21T11:39:08.915 INFO:tasks.workunit.client.1.smithi149.stdout:4/405: creat d4/d6/d63/d10/d6f/f93 x:0 0 0 2024-09-21T11:39:08.916 INFO:tasks.workunit.client.1.smithi149.stdout:0/332: mkdir dd/d1a/d1b/d50/d5d/d79 0 2024-09-21T11:39:08.918 INFO:tasks.workunit.client.1.smithi149.stdout:9/408: dwrite d18/d36/d3c/f3f [0,4194304] 0 2024-09-21T11:39:08.919 INFO:tasks.workunit.client.1.smithi149.stdout:4/406: creat d4/d4d/d5f/f94 x:0 0 0 2024-09-21T11:39:08.919 INFO:tasks.workunit.client.1.smithi149.stdout:3/388: getdents d6/d1f/d27/d83 0 2024-09-21T11:39:08.920 INFO:tasks.workunit.client.1.smithi149.stdout:7/501: unlink d12/d90/d68/f7c 0 2024-09-21T11:39:08.922 INFO:tasks.workunit.client.1.smithi149.stdout:0/333: dread - dd/d2d/f4b zero size 2024-09-21T11:39:08.924 INFO:tasks.workunit.client.1.smithi149.stdout:1/338: creat d2/dd/d35/d1c/d41/d51/f68 x:0 0 0 2024-09-21T11:39:08.924 INFO:tasks.workunit.client.1.smithi149.stdout:2/421: readlink d8/da/d13/d1a/d2c/d5a/l66 0 2024-09-21T11:39:08.926 INFO:tasks.workunit.client.1.smithi149.stdout:6/324: creat d8/d32/d37/d28/d2f/f65 x:0 0 0 2024-09-21T11:39:08.931 INFO:tasks.workunit.client.1.smithi149.stdout:8/337: dwrite d3/dd/d21/f3b [0,4194304] 0 2024-09-21T11:39:08.931 INFO:tasks.workunit.client.1.smithi149.stdout:2/422: mknod d8/d11/c99 0 2024-09-21T11:39:08.934 INFO:tasks.workunit.client.1.smithi149.stdout:0/334: creat dd/d1a/d1b/d50/f7a x:0 0 0 2024-09-21T11:39:08.939 INFO:tasks.workunit.client.1.smithi149.stdout:0/335: stat dd/d32/f37 0 2024-09-21T11:39:08.944 INFO:tasks.workunit.client.1.smithi149.stdout:5/412: dwrite d4/d7/d40/d43/d49/f78 [0,4194304] 0 2024-09-21T11:39:08.950 INFO:tasks.workunit.client.1.smithi149.stdout:4/407: dwrite d4/d4d/d5f/f87 [0,4194304] 0 2024-09-21T11:39:08.953 INFO:tasks.workunit.client.1.smithi149.stdout:4/408: fsync d4/f80 0 2024-09-21T11:39:08.954 INFO:tasks.workunit.client.1.smithi149.stdout:9/409: dwrite d18/d19/d1a/d2f/d53/d64/f74 [0,4194304] 0 2024-09-21T11:39:08.955 INFO:tasks.workunit.client.1.smithi149.stdout:3/389: truncate d6/f1b 2197492 0 2024-09-21T11:39:08.956 INFO:tasks.workunit.client.1.smithi149.stdout:7/502: write d12/d90/d4a/d4f/d75/d94/f60 [28147,72541] 0 2024-09-21T11:39:08.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/413: dread d4/d7/d40/f59 [0,4194304] 0 2024-09-21T11:39:08.966 INFO:tasks.workunit.client.1.smithi149.stdout:0/336: creat dd/d1a/d5a/d65/f7b x:0 0 0 2024-09-21T11:39:08.966 INFO:tasks.workunit.client.1.smithi149.stdout:6/325: dread d8/d32/d37/f36 [0,4194304] 0 2024-09-21T11:39:08.967 INFO:tasks.workunit.client.1.smithi149.stdout:2/423: dwrite d8/d11/f3a [0,4194304] 0 2024-09-21T11:39:08.967 INFO:tasks.workunit.client.1.smithi149.stdout:1/339: rename d2/dd/d35/d1c/d41/d51/f68 to d2/dd/d35/d1c/d2c/f69 0 2024-09-21T11:39:08.971 INFO:tasks.workunit.client.1.smithi149.stdout:1/340: chown d2/d5/d65 0 1 2024-09-21T11:39:08.972 INFO:tasks.workunit.client.1.smithi149.stdout:2/424: rmdir d8/da/d13/d5d 39 2024-09-21T11:39:08.975 INFO:tasks.workunit.client.1.smithi149.stdout:5/414: dread - d4/d1d/d50/f80 zero size 2024-09-21T11:39:08.978 INFO:tasks.workunit.client.1.smithi149.stdout:2/425: fdatasync d8/da/d13/f95 0 2024-09-21T11:39:08.984 INFO:tasks.workunit.client.1.smithi149.stdout:1/341: creat d2/dd/d35/d5b/f6a x:0 0 0 2024-09-21T11:39:08.985 INFO:tasks.workunit.client.1.smithi149.stdout:2/426: dread - d8/da/d13/d1a/f48 zero size 2024-09-21T11:39:08.986 INFO:tasks.workunit.client.1.smithi149.stdout:7/503: dwrite d12/d90/f45 [0,4194304] 0 2024-09-21T11:39:08.987 INFO:tasks.workunit.client.1.smithi149.stdout:3/390: dwrite d6/d1f/d47/f84 [0,4194304] 0 2024-09-21T11:39:08.994 INFO:tasks.workunit.client.1.smithi149.stdout:4/409: dread d4/d6/f56 [0,4194304] 0 2024-09-21T11:39:08.995 INFO:tasks.workunit.client.1.smithi149.stdout:2/427: stat d8/dd/d5c/d60 0 2024-09-21T11:39:08.997 INFO:tasks.workunit.client.1.smithi149.stdout:6/326: dwrite d8/d32/d37/d2b/d51/f59 [0,4194304] 0 2024-09-21T11:39:08.999 INFO:tasks.workunit.client.1.smithi149.stdout:5/415: getdents d4/d7/d40/d43/d5c 0 2024-09-21T11:39:09.000 INFO:tasks.workunit.client.1.smithi149.stdout:1/342: chown d2/c4b 102 1 2024-09-21T11:39:09.004 INFO:tasks.workunit.client.1.smithi149.stdout:7/504: truncate f1 3539471 0 2024-09-21T11:39:09.004 INFO:tasks.workunit.client.1.smithi149.stdout:2/428: fsync d8/da/d13/d1a/d3b/f61 0 2024-09-21T11:39:09.004 INFO:tasks.workunit.client.1.smithi149.stdout:4/410: chown d4/d6/d63/d15/d16/d23/d62 2 1 2024-09-21T11:39:09.004 INFO:tasks.workunit.client.1.smithi149.stdout:5/416: chown d4/d1d/d3e/l61 167 1 2024-09-21T11:39:09.006 INFO:tasks.workunit.client.1.smithi149.stdout:7/505: truncate d12/d90/f96 911011 0 2024-09-21T11:39:09.010 INFO:tasks.workunit.client.1.smithi149.stdout:4/411: mknod d4/d6/d63/d10/d31/d32/d4a/c95 0 2024-09-21T11:39:09.012 INFO:tasks.workunit.client.1.smithi149.stdout:1/343: getdents d2/d5/d3d 0 2024-09-21T11:39:09.013 INFO:tasks.workunit.client.1.smithi149.stdout:4/412: mknod d4/d6/d63/d15/d30/d6b/c96 0 2024-09-21T11:39:09.016 INFO:tasks.workunit.client.1.smithi149.stdout:1/344: read d2/dd/d35/d1c/d2c/f5a [890958,16581] 0 2024-09-21T11:39:09.017 INFO:tasks.workunit.client.1.smithi149.stdout:7/506: creat d12/d90/d4a/d4f/d75/d94/f98 x:0 0 0 2024-09-21T11:39:09.019 INFO:tasks.workunit.client.1.smithi149.stdout:4/413: unlink d4/d4d/d5f/f66 0 2024-09-21T11:39:09.020 INFO:tasks.workunit.client.1.smithi149.stdout:5/417: link d4/d7/d40/d51/l62 d4/d7/l87 0 2024-09-21T11:39:09.020 INFO:tasks.workunit.client.1.smithi149.stdout:7/507: fsync d12/d90/f20 0 2024-09-21T11:39:09.021 INFO:tasks.workunit.client.1.smithi149.stdout:3/391: dread d6/d1f/f3e [4194304,4194304] 0 2024-09-21T11:39:09.021 INFO:tasks.workunit.client.1.smithi149.stdout:6/327: dread d8/da/d14/f1f [0,4194304] 0 2024-09-21T11:39:09.022 INFO:tasks.workunit.client.1.smithi149.stdout:5/418: dread - d4/d1d/d50/f80 zero size 2024-09-21T11:39:09.024 INFO:tasks.workunit.client.1.smithi149.stdout:1/345: creat d2/d5/f6b x:0 0 0 2024-09-21T11:39:09.024 INFO:tasks.workunit.client.1.smithi149.stdout:7/508: dread d12/d90/d4a/d4f/f54 [0,4194304] 0 2024-09-21T11:39:09.024 INFO:tasks.workunit.client.1.smithi149.stdout:6/328: write d8/da/d14/f15 [6249649,123759] 0 2024-09-21T11:39:09.025 INFO:tasks.workunit.client.1.smithi149.stdout:5/419: chown d4/d7/d40/f42 7951 1 2024-09-21T11:39:09.026 INFO:tasks.workunit.client.1.smithi149.stdout:4/414: rename d4/d6/d63/d15/d30/c6c to d4/d6/d63/d10/c97 0 2024-09-21T11:39:09.027 INFO:tasks.workunit.client.1.smithi149.stdout:4/415: fdatasync d4/d6/d63/d10/d6f/f74 0 2024-09-21T11:39:09.028 INFO:tasks.workunit.client.1.smithi149.stdout:5/420: mkdir d4/d7/d40/d43/d49/d88 0 2024-09-21T11:39:09.030 INFO:tasks.workunit.client.1.smithi149.stdout:6/329: rename d8/da/d2c/f56 to d8/d32/d37/d28/d2e/f66 0 2024-09-21T11:39:09.032 INFO:tasks.workunit.client.1.smithi149.stdout:6/330: write d8/d32/f46 [1057825,100610] 0 2024-09-21T11:39:09.033 INFO:tasks.workunit.client.1.smithi149.stdout:1/346: creat d2/d5/f6c x:0 0 0 2024-09-21T11:39:09.034 INFO:tasks.workunit.client.1.smithi149.stdout:2/429: dread d8/da/f39 [0,4194304] 0 2024-09-21T11:39:09.035 INFO:tasks.workunit.client.1.smithi149.stdout:7/509: creat d12/d90/d26/d30/f99 x:0 0 0 2024-09-21T11:39:09.037 INFO:tasks.workunit.client.1.smithi149.stdout:7/510: chown d12/d90/d4a/d6c/d84/f55 33406306 1 2024-09-21T11:39:09.037 INFO:tasks.workunit.client.1.smithi149.stdout:1/347: read - d2/dd/d35/d1c/f39 zero size 2024-09-21T11:39:09.038 INFO:tasks.workunit.client.1.smithi149.stdout:2/430: mknod d8/dd/d5c/d60/c9a 0 2024-09-21T11:39:09.043 INFO:tasks.workunit.client.1.smithi149.stdout:4/416: dread d4/d6/d63/d15/d30/f53 [0,4194304] 0 2024-09-21T11:39:09.046 INFO:tasks.workunit.client.1.smithi149.stdout:5/421: dread d4/d7/f31 [0,4194304] 0 2024-09-21T11:39:09.047 INFO:tasks.workunit.client.1.smithi149.stdout:4/417: mkdir d4/d6/d63/d78/d98 0 2024-09-21T11:39:09.048 INFO:tasks.workunit.client.1.smithi149.stdout:2/431: creat d8/da/d13/f9b x:0 0 0 2024-09-21T11:39:09.051 INFO:tasks.workunit.client.1.smithi149.stdout:5/422: rename d4/d1d/d50/d54/f77 to d4/d1d/d3e/f89 0 2024-09-21T11:39:09.052 INFO:tasks.workunit.client.1.smithi149.stdout:4/418: mknod d4/d6/d63/d10/d6f/c99 0 2024-09-21T11:39:09.054 INFO:tasks.workunit.client.1.smithi149.stdout:2/432: creat d8/dd/f9c x:0 0 0 2024-09-21T11:39:09.054 INFO:tasks.workunit.client.1.smithi149.stdout:4/419: truncate d4/d6/d63/d10/d6f/f93 42972 0 2024-09-21T11:39:09.055 INFO:tasks.workunit.client.1.smithi149.stdout:1/348: getdents d2/dd/d35/d1c/d37 0 2024-09-21T11:39:09.056 INFO:tasks.workunit.client.1.smithi149.stdout:8/338: sync 2024-09-21T11:39:09.059 INFO:tasks.workunit.client.1.smithi149.stdout:5/423: symlink d4/d7/d40/d43/d5c/l8a 0 2024-09-21T11:39:09.061 INFO:tasks.workunit.client.1.smithi149.stdout:2/433: dwrite d8/da/d13/f2e [0,4194304] 0 2024-09-21T11:39:09.062 INFO:tasks.workunit.client.1.smithi149.stdout:8/339: chown d3/dd/d18/c3e 9366400 1 2024-09-21T11:39:09.066 INFO:tasks.workunit.client.1.smithi149.stdout:5/424: write d4/d7/d40/d43/d5c/d7a/d81/f83 [2507050,7916] 0 2024-09-21T11:39:09.070 INFO:tasks.workunit.client.1.smithi149.stdout:6/331: dwrite d8/da/fc [0,4194304] 0 2024-09-21T11:39:09.071 INFO:tasks.workunit.client.1.smithi149.stdout:8/340: write d3/fa [905229,117161] 0 2024-09-21T11:39:09.080 INFO:tasks.workunit.client.1.smithi149.stdout:1/349: truncate d2/dd/f22 6013826 0 2024-09-21T11:39:09.084 INFO:tasks.workunit.client.1.smithi149.stdout:4/420: dread d4/d6/d63/d10/d31/f4b [0,4194304] 0 2024-09-21T11:39:09.086 INFO:tasks.workunit.client.1.smithi149.stdout:8/341: creat d3/dd/d21/d54/d5c/f71 x:0 0 0 2024-09-21T11:39:09.086 INFO:tasks.workunit.client.1.smithi149.stdout:5/425: dwrite d4/f2f [0,4194304] 0 2024-09-21T11:39:09.087 INFO:tasks.workunit.client.1.smithi149.stdout:7/511: dwrite d12/d90/d68/f7b [0,4194304] 0 2024-09-21T11:39:09.089 INFO:tasks.workunit.client.1.smithi149.stdout:2/434: dread d8/da/d13/d2d/f34 [0,4194304] 0 2024-09-21T11:39:09.089 INFO:tasks.workunit.client.1.smithi149.stdout:5/426: chown d4/f5 2702 1 2024-09-21T11:39:09.091 INFO:tasks.workunit.client.1.smithi149.stdout:1/350: rename d2/dd/d35/d1c/f29 to d2/d5/d8/d3b/f6d 0 2024-09-21T11:39:09.091 INFO:tasks.workunit.client.1.smithi149.stdout:8/342: truncate d3/dd/d3a/f63 4595194 0 2024-09-21T11:39:09.093 INFO:tasks.workunit.client.1.smithi149.stdout:8/343: stat d3/d12/l41 0 2024-09-21T11:39:09.094 INFO:tasks.workunit.client.1.smithi149.stdout:5/427: read d4/d7/d40/d51/f58 [201478,114410] 0 2024-09-21T11:39:09.099 INFO:tasks.workunit.client.1.smithi149.stdout:4/421: dread d4/d6/d63/d10/d31/f4b [0,4194304] 0 2024-09-21T11:39:09.100 INFO:tasks.workunit.client.1.smithi149.stdout:1/351: mkdir d2/d2b/d6e 0 2024-09-21T11:39:09.102 INFO:tasks.workunit.client.1.smithi149.stdout:5/428: rmdir d4 39 2024-09-21T11:39:09.103 INFO:tasks.workunit.client.1.smithi149.stdout:1/352: truncate d2/d5/f6c 883543 0 2024-09-21T11:39:09.104 INFO:tasks.workunit.client.1.smithi149.stdout:2/435: creat d8/d20/d78/d7c/f9d x:0 0 0 2024-09-21T11:39:09.105 INFO:tasks.workunit.client.1.smithi149.stdout:6/332: truncate d8/da/d14/f15 2587574 0 2024-09-21T11:39:09.106 INFO:tasks.workunit.client.1.smithi149.stdout:8/344: dwrite d3/d33/f64 [0,4194304] 0 2024-09-21T11:39:09.108 INFO:tasks.workunit.client.1.smithi149.stdout:6/333: chown d8/d32/d37/d28/f33 105736 1 2024-09-21T11:39:09.109 INFO:tasks.workunit.client.1.smithi149.stdout:1/353: dread d2/dd/f12 [0,4194304] 0 2024-09-21T11:39:09.110 INFO:tasks.workunit.client.1.smithi149.stdout:4/422: read d4/d6/f9 [3796007,87907] 0 2024-09-21T11:39:09.111 INFO:tasks.workunit.client.1.smithi149.stdout:2/436: rename d8/d20/c33 to d8/da/d13/d1a/d29/c9e 0 2024-09-21T11:39:09.112 INFO:tasks.workunit.client.1.smithi149.stdout:1/354: chown d2/dd/d2e 10 1 2024-09-21T11:39:09.113 INFO:tasks.workunit.client.1.smithi149.stdout:1/355: dread - d2/f2d zero size 2024-09-21T11:39:09.115 INFO:tasks.workunit.client.1.smithi149.stdout:1/356: fsync d2/dd/d2e/d4c/f52 0 2024-09-21T11:39:09.115 INFO:tasks.workunit.client.1.smithi149.stdout:4/423: rmdir d4/d6/d63/d15/d16/d23/d5d 39 2024-09-21T11:39:09.118 INFO:tasks.workunit.client.1.smithi149.stdout:5/429: creat d4/d1d/d50/f8b x:0 0 0 2024-09-21T11:39:09.119 INFO:tasks.workunit.client.1.smithi149.stdout:8/345: dwrite d3/f1d [4194304,4194304] 0 2024-09-21T11:39:09.120 INFO:tasks.workunit.client.1.smithi149.stdout:2/437: symlink d8/d20/d78/d7c/l9f 0 2024-09-21T11:39:09.123 INFO:tasks.workunit.client.1.smithi149.stdout:5/430: write d4/f18 [1316824,31065] 0 2024-09-21T11:39:09.124 INFO:tasks.workunit.client.1.smithi149.stdout:8/346: truncate d3/dd/d21/d54/d5c/f71 776852 0 2024-09-21T11:39:09.124 INFO:tasks.workunit.client.1.smithi149.stdout:7/512: dread d12/d90/d4a/f72 [0,4194304] 0 2024-09-21T11:39:09.125 INFO:tasks.workunit.client.1.smithi149.stdout:2/438: dread - d8/da/d13/f81 zero size 2024-09-21T11:39:09.125 INFO:tasks.workunit.client.1.smithi149.stdout:4/424: read d4/d6/d63/d15/d30/f6d [435229,102486] 0 2024-09-21T11:39:09.126 INFO:tasks.workunit.client.1.smithi149.stdout:8/347: chown d3/dd/d21/f3b 706068 1 2024-09-21T11:39:09.127 INFO:tasks.workunit.client.1.smithi149.stdout:1/357: creat d2/d2b/d6e/f6f x:0 0 0 2024-09-21T11:39:09.127 INFO:tasks.workunit.client.1.smithi149.stdout:2/439: chown d8/da/d13/d53 302247460 1 2024-09-21T11:39:09.127 INFO:tasks.workunit.client.1.smithi149.stdout:4/425: dread - d4/d4d/d58/f91 zero size 2024-09-21T11:39:09.129 INFO:tasks.workunit.client.1.smithi149.stdout:5/431: chown d4/d7/d40/d43/d5c/d7a/d81/f83 14211633 1 2024-09-21T11:39:09.131 INFO:tasks.workunit.client.1.smithi149.stdout:1/358: symlink d2/d5/d8/d3b/l70 0 2024-09-21T11:39:09.133 INFO:tasks.workunit.client.1.smithi149.stdout:4/426: write d4/d6/d63/d10/d6f/f74 [4967965,42797] 0 2024-09-21T11:39:09.134 INFO:tasks.workunit.client.1.smithi149.stdout:5/432: creat d4/d7/d40/d51/f8c x:0 0 0 2024-09-21T11:39:09.138 INFO:tasks.workunit.client.1.smithi149.stdout:1/359: readlink d2/d5/d8/l4a 0 2024-09-21T11:39:09.138 INFO:tasks.workunit.client.1.smithi149.stdout:4/427: creat d4/d6/f9a x:0 0 0 2024-09-21T11:39:09.138 INFO:tasks.workunit.client.1.smithi149.stdout:2/440: dwrite d8/dd/f2b [0,4194304] 0 2024-09-21T11:39:09.138 INFO:tasks.workunit.client.1.smithi149.stdout:8/348: getdents d3/dd/d3a 0 2024-09-21T11:39:09.139 INFO:tasks.workunit.client.1.smithi149.stdout:4/428: stat d4/d6/d63/le 0 2024-09-21T11:39:09.139 INFO:tasks.workunit.client.1.smithi149.stdout:6/334: truncate d8/da/d11/f25 738716 0 2024-09-21T11:39:09.140 INFO:tasks.workunit.client.1.smithi149.stdout:5/433: mknod d4/d7/d40/d43/d5c/d7a/d81/c8d 0 2024-09-21T11:39:09.140 INFO:tasks.workunit.client.1.smithi149.stdout:2/441: chown d8/d20/d57/l65 11 1 2024-09-21T11:39:09.141 INFO:tasks.workunit.client.1.smithi149.stdout:8/349: mkdir d3/d33/d34/d72 0 2024-09-21T11:39:09.142 INFO:tasks.workunit.client.1.smithi149.stdout:6/335: stat d8/d32/d37/d28/d2e/f3e 0 2024-09-21T11:39:09.144 INFO:tasks.workunit.client.1.smithi149.stdout:6/336: truncate d8/f48 469859 0 2024-09-21T11:39:09.146 INFO:tasks.workunit.client.1.smithi149.stdout:5/434: write d4/d1d/d50/d54/f35 [1308152,46426] 0 2024-09-21T11:39:09.146 INFO:tasks.workunit.client.1.smithi149.stdout:8/350: creat d3/dd/d3a/f73 x:0 0 0 2024-09-21T11:39:09.148 INFO:tasks.workunit.client.1.smithi149.stdout:4/429: rename d4/d6/c57 to d4/d6/d63/d15/d16/d23/c9b 0 2024-09-21T11:39:09.152 INFO:tasks.workunit.client.1.smithi149.stdout:4/430: mknod d4/c9c 0 2024-09-21T11:39:09.153 INFO:tasks.workunit.client.1.smithi149.stdout:8/351: symlink d3/d3c/l74 0 2024-09-21T11:39:09.154 INFO:tasks.workunit.client.1.smithi149.stdout:2/442: dwrite d8/da/d13/d5d/f7f [0,4194304] 0 2024-09-21T11:39:09.159 INFO:tasks.workunit.client.1.smithi149.stdout:1/360: write d2/dd/d35/d1c/f23 [830594,129566] 0 2024-09-21T11:39:09.163 INFO:tasks.workunit.client.1.smithi149.stdout:6/337: dwrite d8/da/d14/f1f [0,4194304] 0 2024-09-21T11:39:09.164 INFO:tasks.workunit.client.1.smithi149.stdout:2/443: mkdir d8/da/d13/d5d/da0 0 2024-09-21T11:39:09.165 INFO:tasks.workunit.client.1.smithi149.stdout:8/352: rename d3/l9 to d3/dd/d21/d54/d5c/l75 0 2024-09-21T11:39:09.165 INFO:tasks.workunit.client.1.smithi149.stdout:5/435: dwrite d4/d1d/d3e/f84 [0,4194304] 0 2024-09-21T11:39:09.167 INFO:tasks.workunit.client.1.smithi149.stdout:5/436: fdatasync d4/d1d/d50/d54/f35 0 2024-09-21T11:39:09.170 INFO:tasks.workunit.client.1.smithi149.stdout:1/361: fsync d2/dd/f22 0 2024-09-21T11:39:09.172 INFO:tasks.workunit.client.1.smithi149.stdout:4/431: link d4/d6/d63/cd d4/d4d/c9d 0 2024-09-21T11:39:09.175 INFO:tasks.workunit.client.1.smithi149.stdout:8/353: dwrite d3/dd/d21/d54/d5c/f71 [0,4194304] 0 2024-09-21T11:39:09.175 INFO:tasks.workunit.client.1.smithi149.stdout:2/444: creat d8/dd/d8c/fa1 x:0 0 0 2024-09-21T11:39:09.177 INFO:tasks.workunit.client.1.smithi149.stdout:6/338: getdents d8/d32/d37/d2b/d4a 0 2024-09-21T11:39:09.178 INFO:tasks.workunit.client.1.smithi149.stdout:8/354: dread - d3/dd/d18/f68 zero size 2024-09-21T11:39:09.179 INFO:tasks.workunit.client.1.smithi149.stdout:2/445: write d8/dd/f38 [7187795,66522] 0 2024-09-21T11:39:09.182 INFO:tasks.workunit.client.1.smithi149.stdout:4/432: symlink d4/d6/d63/d15/d16/d23/d62/l9e 0 2024-09-21T11:39:09.183 INFO:tasks.workunit.client.1.smithi149.stdout:8/355: fsync d3/dd/d21/f3b 0 2024-09-21T11:39:09.184 INFO:tasks.workunit.client.1.smithi149.stdout:1/362: dwrite d2/d5/f62 [0,4194304] 0 2024-09-21T11:39:09.186 INFO:tasks.workunit.client.1.smithi149.stdout:2/446: truncate d8/d20/f62 1153310 0 2024-09-21T11:39:09.189 INFO:tasks.workunit.client.1.smithi149.stdout:2/447: write d8/dd/f74 [457235,126927] 0 2024-09-21T11:39:09.190 INFO:tasks.workunit.client.1.smithi149.stdout:6/339: creat d8/da/d2c/d52/d5e/f67 x:0 0 0 2024-09-21T11:39:09.194 INFO:tasks.workunit.client.1.smithi149.stdout:4/433: symlink d4/d6/d63/d10/l9f 0 2024-09-21T11:39:09.198 INFO:tasks.workunit.client.1.smithi149.stdout:1/363: rename d2/dd/d35/f58 to d2/dd/f71 0 2024-09-21T11:39:09.199 INFO:tasks.workunit.client.1.smithi149.stdout:8/356: mkdir d3/d3c/d4c/d76 0 2024-09-21T11:39:09.199 INFO:tasks.workunit.client.1.smithi149.stdout:4/434: mknod d4/d6/d63/d2d/ca0 0 2024-09-21T11:39:09.202 INFO:tasks.workunit.client.1.smithi149.stdout:2/448: dwrite d8/d11/f3a [4194304,4194304] 0 2024-09-21T11:39:09.203 INFO:tasks.workunit.client.1.smithi149.stdout:4/435: symlink d4/d4d/d5f/la1 0 2024-09-21T11:39:09.204 INFO:tasks.workunit.client.1.smithi149.stdout:1/364: fdatasync d2/dd/d35/d1c/d37/f61 0 2024-09-21T11:39:09.207 INFO:tasks.workunit.client.1.smithi149.stdout:4/436: write d4/d6/d63/d2d/f6e [58804,73333] 0 2024-09-21T11:39:09.213 INFO:tasks.workunit.client.1.smithi149.stdout:4/437: creat d4/d6/d63/d15/d16/d23/d62/fa2 x:0 0 0 2024-09-21T11:39:09.215 INFO:tasks.workunit.client.1.smithi149.stdout:1/365: dwrite d2/f21 [0,4194304] 0 2024-09-21T11:39:09.215 INFO:tasks.workunit.client.1.smithi149.stdout:2/449: dwrite d8/dd/d5c/d60/d67/d8a/f90 [0,4194304] 0 2024-09-21T11:39:09.216 INFO:tasks.workunit.client.1.smithi149.stdout:4/438: read - d4/d6/f5e zero size 2024-09-21T11:39:09.217 INFO:tasks.workunit.client.1.smithi149.stdout:1/366: readlink d2/d5/d8/d3b/l70 0 2024-09-21T11:39:09.219 INFO:tasks.workunit.client.1.smithi149.stdout:4/439: symlink d4/d6/d63/d78/la3 0 2024-09-21T11:39:09.221 INFO:tasks.workunit.client.1.smithi149.stdout:2/450: symlink d8/da/d13/d1a/la2 0 2024-09-21T11:39:09.223 INFO:tasks.workunit.client.1.smithi149.stdout:2/451: dread - d8/dd/d8c/fa1 zero size 2024-09-21T11:39:09.225 INFO:tasks.workunit.client.1.smithi149.stdout:4/440: creat d4/d6/d63/d10/d31/d32/fa4 x:0 0 0 2024-09-21T11:39:09.225 INFO:tasks.workunit.client.1.smithi149.stdout:6/340: dread d8/da/d2c/d2d/f45 [0,4194304] 0 2024-09-21T11:39:09.226 INFO:tasks.workunit.client.1.smithi149.stdout:9/410: sync 2024-09-21T11:39:09.229 INFO:tasks.workunit.client.1.smithi149.stdout:9/411: dread - d18/d1c/f4e zero size 2024-09-21T11:39:09.230 INFO:tasks.workunit.client.1.smithi149.stdout:2/452: mknod d8/ca3 0 2024-09-21T11:39:09.235 INFO:tasks.workunit.client.1.smithi149.stdout:4/441: link d4/d6/d63/d15/d30/d6b/c89 d4/d6/d63/d10/d31/d32/d4a/ca5 0 2024-09-21T11:39:09.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/412: link d18/d36/l58 d18/d4c/d5b/l83 0 2024-09-21T11:39:09.239 INFO:tasks.workunit.client.1.smithi149.stdout:4/442: write d4/d6/d18/f2a [343975,108225] 0 2024-09-21T11:39:09.241 INFO:tasks.workunit.client.1.smithi149.stdout:1/367: dwrite d2/dd/d35/d1c/d2c/f69 [0,4194304] 0 2024-09-21T11:39:09.243 INFO:tasks.workunit.client.1.smithi149.stdout:2/453: dwrite d8/d20/f62 [0,4194304] 0 2024-09-21T11:39:09.248 INFO:tasks.workunit.client.1.smithi149.stdout:4/443: mkdir d4/d6/d63/d15/d30/da6 0 2024-09-21T11:39:09.249 INFO:tasks.workunit.client.1.smithi149.stdout:9/413: symlink d18/d36/d3c/d47/d76/d7c/l84 0 2024-09-21T11:39:09.250 INFO:tasks.workunit.client.1.smithi149.stdout:1/368: rmdir d2/d5/d65/d67 0 2024-09-21T11:39:09.260 INFO:tasks.workunit.client.1.smithi149.stdout:8/357: dread d3/d12/f15 [0,4194304] 0 2024-09-21T11:39:09.261 INFO:tasks.workunit.client.1.smithi149.stdout:8/358: write d3/dd/d3a/f63 [1886287,68632] 0 2024-09-21T11:39:09.261 INFO:tasks.workunit.client.1.smithi149.stdout:8/359: chown d3/dd/d3a/l50 137717570 1 2024-09-21T11:39:09.262 INFO:tasks.workunit.client.1.smithi149.stdout:8/360: readlink d3/d3c/l74 0 2024-09-21T11:39:09.372 INFO:tasks.workunit.client.1.smithi149.stdout:0/337: sync 2024-09-21T11:39:09.418 INFO:tasks.workunit.client.1.smithi149.stdout:4/444: mkdir d4/d6/d63/d15/d30/d8a/da7 0 2024-09-21T11:39:09.418 INFO:tasks.workunit.client.1.smithi149.stdout:1/369: creat d2/d5/d3d/f72 x:0 0 0 2024-09-21T11:39:09.420 INFO:tasks.workunit.client.1.smithi149.stdout:0/338: creat dd/d1a/d1b/d50/d53/d3a/f7c x:0 0 0 2024-09-21T11:39:09.421 INFO:tasks.workunit.client.1.smithi149.stdout:4/445: symlink d4/d6/d63/d78/d98/la8 0 2024-09-21T11:39:09.422 INFO:tasks.workunit.client.1.smithi149.stdout:1/370: mkdir d2/dd/d35/d1c/d41/d51/d73 0 2024-09-21T11:39:09.423 INFO:tasks.workunit.client.1.smithi149.stdout:1/371: truncate d2/f60 44838 0 2024-09-21T11:39:09.424 INFO:tasks.workunit.client.1.smithi149.stdout:4/446: creat d4/d6/d63/d15/d16/d23/d62/fa9 x:0 0 0 2024-09-21T11:39:09.425 INFO:tasks.workunit.client.1.smithi149.stdout:7/513: sync 2024-09-21T11:39:09.425 INFO:tasks.workunit.client.1.smithi149.stdout:5/437: sync 2024-09-21T11:39:09.425 INFO:tasks.workunit.client.1.smithi149.stdout:3/392: sync 2024-09-21T11:39:09.425 INFO:tasks.workunit.client.1.smithi149.stdout:4/447: chown d4/d6/d63/d15/d16/d23/c3c 3 1 2024-09-21T11:39:09.426 INFO:tasks.workunit.client.1.smithi149.stdout:1/372: getdents d2/dd/d35/d1c/d41 0 2024-09-21T11:39:09.429 INFO:tasks.workunit.client.1.smithi149.stdout:7/514: fsync d12/d90/d4a/d6c/d84/f55 0 2024-09-21T11:39:09.431 INFO:tasks.workunit.client.1.smithi149.stdout:7/515: fdatasync d12/d90/d68/f7a 0 2024-09-21T11:39:09.431 INFO:tasks.workunit.client.1.smithi149.stdout:5/438: dread d4/d7/d40/d43/d5c/f66 [0,4194304] 0 2024-09-21T11:39:09.432 INFO:tasks.workunit.client.1.smithi149.stdout:3/393: rename d6/d1f/d47/d37/d3a/f43 to d6/d5f/d60/d88/f8b 0 2024-09-21T11:39:09.432 INFO:tasks.workunit.client.1.smithi149.stdout:7/516: chown d12/d90/f45 311762985 1 2024-09-21T11:39:09.433 INFO:tasks.workunit.client.1.smithi149.stdout:5/439: readlink d4/d7/d40/d43/d5c/l8a 0 2024-09-21T11:39:09.434 INFO:tasks.workunit.client.1.smithi149.stdout:5/440: read - d4/d1d/f6b zero size 2024-09-21T11:39:09.434 INFO:tasks.workunit.client.1.smithi149.stdout:7/517: truncate d12/d90/d68/f7a 5054931 0 2024-09-21T11:39:09.435 INFO:tasks.workunit.client.1.smithi149.stdout:5/441: stat d4/d1d/f6b 0 2024-09-21T11:39:09.435 INFO:tasks.workunit.client.1.smithi149.stdout:8/361: dread d3/f20 [0,4194304] 0 2024-09-21T11:39:09.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/339: dread dd/d2d/f56 [0,4194304] 0 2024-09-21T11:39:09.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/340: stat dd/d1a/d1b/f27 0 2024-09-21T11:39:09.440 INFO:tasks.workunit.client.1.smithi149.stdout:3/394: mknod d6/d1f/d47/d37/d3a/c8c 0 2024-09-21T11:39:09.440 INFO:tasks.workunit.client.1.smithi149.stdout:8/362: dwrite d3/dd/d18/f68 [0,4194304] 0 2024-09-21T11:39:09.472 INFO:tasks.workunit.client.1.smithi149.stdout:0/341: symlink dd/d1a/d1b/d50/l7d 0 2024-09-21T11:39:09.474 INFO:tasks.workunit.client.1.smithi149.stdout:1/373: truncate d2/d2b/f31 2853684 0 2024-09-21T11:39:09.474 INFO:tasks.workunit.client.1.smithi149.stdout:8/363: write d3/f1d [6739658,45421] 0 2024-09-21T11:39:09.475 INFO:tasks.workunit.client.1.smithi149.stdout:3/395: mkdir d6/d1f/d47/d22/d8d 0 2024-09-21T11:39:09.476 INFO:tasks.workunit.client.1.smithi149.stdout:0/342: stat dd/l12 0 2024-09-21T11:39:09.481 INFO:tasks.workunit.client.1.smithi149.stdout:3/396: chown d6/d1f/l51 58 1 2024-09-21T11:39:09.486 INFO:tasks.workunit.client.1.smithi149.stdout:4/448: dwrite d4/d6/d63/d15/d16/d23/f60 [0,4194304] 0 2024-09-21T11:39:09.488 INFO:tasks.workunit.client.1.smithi149.stdout:0/343: getdents dd/d1a/d1b/d50/d53 0 2024-09-21T11:39:09.488 INFO:tasks.workunit.client.1.smithi149.stdout:5/442: dwrite d4/d7/f38 [4194304,4194304] 0 2024-09-21T11:39:09.489 INFO:tasks.workunit.client.1.smithi149.stdout:8/364: dread d3/dd/d18/f51 [0,4194304] 0 2024-09-21T11:39:09.494 INFO:tasks.workunit.client.1.smithi149.stdout:1/374: dwrite d2/d5/d8/f48 [0,4194304] 0 2024-09-21T11:39:09.507 INFO:tasks.workunit.client.1.smithi149.stdout:2/454: sync 2024-09-21T11:39:09.507 INFO:tasks.workunit.client.1.smithi149.stdout:6/341: sync 2024-09-21T11:39:09.508 INFO:tasks.workunit.client.1.smithi149.stdout:9/414: sync 2024-09-21T11:39:09.508 INFO:tasks.workunit.client.1.smithi149.stdout:5/443: symlink d4/d7/d40/d43/d5c/d7a/d81/l8e 0 2024-09-21T11:39:09.515 INFO:tasks.workunit.client.1.smithi149.stdout:4/449: dwrite d4/f7 [0,4194304] 0 2024-09-21T11:39:09.515 INFO:tasks.workunit.client.1.smithi149.stdout:3/397: dwrite d6/d5f/d60/d88/f8b [0,4194304] 0 2024-09-21T11:39:09.516 INFO:tasks.workunit.client.1.smithi149.stdout:0/344: dwrite dd/d35/f4d [0,4194304] 0 2024-09-21T11:39:09.517 INFO:tasks.workunit.client.1.smithi149.stdout:3/398: fdatasync d6/d1f/d47/f74 0 2024-09-21T11:39:09.517 INFO:tasks.workunit.client.1.smithi149.stdout:9/415: truncate d18/d19/d1a/d2f/d5f/f80 812225 0 2024-09-21T11:39:09.519 INFO:tasks.workunit.client.1.smithi149.stdout:4/450: write d4/d4d/d5f/d71/f8d [842790,48662] 0 2024-09-21T11:39:09.541 INFO:tasks.workunit.client.1.smithi149.stdout:7/518: sync 2024-09-21T11:39:09.541 INFO:tasks.workunit.client.1.smithi149.stdout:8/365: mknod d3/dd/c77 0 2024-09-21T11:39:09.543 INFO:tasks.workunit.client.1.smithi149.stdout:8/366: truncate d3/dd/d21/d54/f56 5094565 0 2024-09-21T11:39:09.543 INFO:tasks.workunit.client.1.smithi149.stdout:1/375: truncate d2/dd/f12 139015 0 2024-09-21T11:39:09.544 INFO:tasks.workunit.client.1.smithi149.stdout:5/444: stat d4/d1d/d50/d54/l4a 0 2024-09-21T11:39:09.545 INFO:tasks.workunit.client.1.smithi149.stdout:2/455: dread d8/d20/d57/f47 [0,4194304] 0 2024-09-21T11:39:09.545 INFO:tasks.workunit.client.1.smithi149.stdout:8/367: dread - d3/dd/d18/d2e/f70 zero size 2024-09-21T11:39:09.546 INFO:tasks.workunit.client.1.smithi149.stdout:4/451: mkdir d4/d6/d63/d15/d30/d6b/daa 0 2024-09-21T11:39:09.547 INFO:tasks.workunit.client.1.smithi149.stdout:7/519: mknod d12/d90/d4a/d6c/c9a 0 2024-09-21T11:39:09.548 INFO:tasks.workunit.client.1.smithi149.stdout:8/368: truncate d3/dd/d21/d54/d5c/f6b 931262 0 2024-09-21T11:39:09.549 INFO:tasks.workunit.client.1.smithi149.stdout:0/345: rename dd/d1a/d1b/c28 to dd/d35/c7e 0 2024-09-21T11:39:09.549 INFO:tasks.workunit.client.1.smithi149.stdout:5/445: fdatasync d4/d7/f31 0 2024-09-21T11:39:09.549 INFO:tasks.workunit.client.1.smithi149.stdout:7/520: write d12/d90/d4a/d6c/d84/f86 [2768271,109180] 0 2024-09-21T11:39:09.550 INFO:tasks.workunit.client.1.smithi149.stdout:9/416: unlink d18/d4c/l52 0 2024-09-21T11:39:09.551 INFO:tasks.workunit.client.1.smithi149.stdout:3/399: symlink d6/d1f/d47/d22/d8d/l8e 0 2024-09-21T11:39:09.552 INFO:tasks.workunit.client.1.smithi149.stdout:6/342: creat d8/da/d2c/f68 x:0 0 0 2024-09-21T11:39:09.554 INFO:tasks.workunit.client.1.smithi149.stdout:4/452: chown d4/d6/d63/d15/d16/d23/c9b 53322 1 2024-09-21T11:39:09.555 INFO:tasks.workunit.client.1.smithi149.stdout:2/456: link d8/da/d13/d1a/f48 d8/da/d13/d1a/d29/fa4 0 2024-09-21T11:39:09.555 INFO:tasks.workunit.client.1.smithi149.stdout:0/346: dread dd/d1a/f44 [0,4194304] 0 2024-09-21T11:39:09.555 INFO:tasks.workunit.client.1.smithi149.stdout:6/343: chown d8/d32/d37/d2b/d51/f59 5845 1 2024-09-21T11:39:09.557 INFO:tasks.workunit.client.1.smithi149.stdout:9/417: creat d18/d36/d3c/d47/f85 x:0 0 0 2024-09-21T11:39:09.558 INFO:tasks.workunit.client.1.smithi149.stdout:2/457: write d8/da/d13/d1a/d2c/f2f [159881,116636] 0 2024-09-21T11:39:09.562 INFO:tasks.workunit.client.1.smithi149.stdout:6/344: mkdir d8/da/d2c/d52/d5e/d69 0 2024-09-21T11:39:09.563 INFO:tasks.workunit.client.1.smithi149.stdout:1/376: dread d2/f13 [0,4194304] 0 2024-09-21T11:39:09.564 INFO:tasks.workunit.client.1.smithi149.stdout:2/458: write d8/dd/d5c/d60/d67/d8a/f96 [381961,117420] 0 2024-09-21T11:39:09.565 INFO:tasks.workunit.client.1.smithi149.stdout:7/521: rename d12/d90/d4a/d6c/d84/c3b to d12/d90/d4a/c9b 0 2024-09-21T11:39:09.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/377: chown d2/dd/d35/d1c/f23 81 1 2024-09-21T11:39:09.568 INFO:tasks.workunit.client.1.smithi149.stdout:4/453: dwrite d4/d6/f5e [0,4194304] 0 2024-09-21T11:39:09.569 INFO:tasks.workunit.client.1.smithi149.stdout:5/446: link d4/f2f d4/d7/d40/d43/d5c/d7a/d81/f8f 0 2024-09-21T11:39:09.570 INFO:tasks.workunit.client.1.smithi149.stdout:7/522: truncate d12/f66 955120 0 2024-09-21T11:39:09.570 INFO:tasks.workunit.client.1.smithi149.stdout:0/347: fsync dd/d1a/d5a/f77 0 2024-09-21T11:39:09.572 INFO:tasks.workunit.client.1.smithi149.stdout:6/345: mkdir d8/d32/d37/d28/d2f/d6a 0 2024-09-21T11:39:09.572 INFO:tasks.workunit.client.1.smithi149.stdout:5/447: readlink d4/d1d/d3e/l61 0 2024-09-21T11:39:09.572 INFO:tasks.workunit.client.1.smithi149.stdout:9/418: dwrite d18/d1c/f60 [0,4194304] 0 2024-09-21T11:39:09.573 INFO:tasks.workunit.client.1.smithi149.stdout:5/448: chown d4/d1d/f6f 1127055 1 2024-09-21T11:39:09.574 INFO:tasks.workunit.client.1.smithi149.stdout:0/348: write dd/d1a/d1b/d50/d53/f6f [892510,14296] 0 2024-09-21T11:39:09.574 INFO:tasks.workunit.client.1.smithi149.stdout:9/419: write d18/d19/d29/d39/f69 [1028477,76721] 0 2024-09-21T11:39:09.575 INFO:tasks.workunit.client.1.smithi149.stdout:0/349: stat dd/d1a/d1b 0 2024-09-21T11:39:09.627 INFO:tasks.workunit.client.1.smithi149.stdout:2/459: mknod d8/d20/d78/d7c/ca5 0 2024-09-21T11:39:09.631 INFO:tasks.workunit.client.1.smithi149.stdout:1/378: mkdir d2/dd/d35/d1c/d41/d74 0 2024-09-21T11:39:09.632 INFO:tasks.workunit.client.1.smithi149.stdout:3/400: dread d6/d1f/d27/f5b [0,4194304] 0 2024-09-21T11:39:09.632 INFO:tasks.workunit.client.1.smithi149.stdout:6/346: mknod d8/da/d2c/d52/d5e/c6b 0 2024-09-21T11:39:09.632 INFO:tasks.workunit.client.1.smithi149.stdout:5/449: mkdir d4/d90 0 2024-09-21T11:39:09.633 INFO:tasks.workunit.client.1.smithi149.stdout:9/420: creat d18/d36/d3c/d47/d76/f86 x:0 0 0 2024-09-21T11:39:09.633 INFO:tasks.workunit.client.1.smithi149.stdout:1/379: write d2/d5/d3d/f72 [437449,84090] 0 2024-09-21T11:39:09.634 INFO:tasks.workunit.client.1.smithi149.stdout:3/401: write d6/d1f/d27/f63 [172561,130303] 0 2024-09-21T11:39:09.635 INFO:tasks.workunit.client.1.smithi149.stdout:9/421: fdatasync d18/d19/d29/d39/f69 0 2024-09-21T11:39:09.635 INFO:tasks.workunit.client.1.smithi149.stdout:4/454: mknod d4/d6/d63/d15/d16/d23/cab 0 2024-09-21T11:39:09.636 INFO:tasks.workunit.client.1.smithi149.stdout:3/402: readlink d6/d1f/d47/d22/l30 0 2024-09-21T11:39:09.639 INFO:tasks.workunit.client.1.smithi149.stdout:6/347: mknod d8/d32/d64/c6c 0 2024-09-21T11:39:09.641 INFO:tasks.workunit.client.1.smithi149.stdout:3/403: unlink d6/d1f/d47/d22/d8d/l8e 0 2024-09-21T11:39:09.644 INFO:tasks.workunit.client.1.smithi149.stdout:2/460: write d8/da/d13/f21 [3401166,15219] 0 2024-09-21T11:39:09.645 INFO:tasks.workunit.client.1.smithi149.stdout:0/350: write dd/d1a/d1b/d50/d53/f54 [722427,49504] 0 2024-09-21T11:39:09.646 INFO:tasks.workunit.client.1.smithi149.stdout:1/380: dwrite d2/d5/d3d/f72 [0,4194304] 0 2024-09-21T11:39:09.647 INFO:tasks.workunit.client.1.smithi149.stdout:6/348: mkdir d8/da/d2c/d6d 0 2024-09-21T11:39:09.649 INFO:tasks.workunit.client.1.smithi149.stdout:3/404: unlink d6/c19 0 2024-09-21T11:39:09.650 INFO:tasks.workunit.client.1.smithi149.stdout:5/450: mknod d4/d7/d40/d43/c91 0 2024-09-21T11:39:09.650 INFO:tasks.workunit.client.1.smithi149.stdout:4/455: dwrite d4/d6/d63/d10/d31/f90 [0,4194304] 0 2024-09-21T11:39:09.653 INFO:tasks.workunit.client.1.smithi149.stdout:2/461: write d8/da/d13/d1a/d29/f98 [1022731,94468] 0 2024-09-21T11:39:09.655 INFO:tasks.workunit.client.1.smithi149.stdout:0/351: rename dd/f36 to dd/d2d/f7f 0 2024-09-21T11:39:09.656 INFO:tasks.workunit.client.1.smithi149.stdout:5/451: write d4/f5 [263428,111926] 0 2024-09-21T11:39:09.658 INFO:tasks.workunit.client.1.smithi149.stdout:1/381: creat d2/dd/d2e/d4c/f75 x:0 0 0 2024-09-21T11:39:09.660 INFO:tasks.workunit.client.1.smithi149.stdout:9/422: dread d18/d1c/f4f [0,4194304] 0 2024-09-21T11:39:09.667 INFO:tasks.workunit.client.1.smithi149.stdout:5/452: stat d4/d7/l16 0 2024-09-21T11:39:09.668 INFO:tasks.workunit.client.1.smithi149.stdout:6/349: dread d8/da/d3d/f43 [0,4194304] 0 2024-09-21T11:39:09.673 INFO:tasks.workunit.client.1.smithi149.stdout:6/350: stat d8/d32/f55 0 2024-09-21T11:39:09.674 INFO:tasks.workunit.client.1.smithi149.stdout:5/453: mknod d4/d7/d40/d43/d5c/c92 0 2024-09-21T11:39:09.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/456: dwrite d4/d6/d63/d10/d31/d32/d4a/f61 [0,4194304] 0 2024-09-21T11:39:09.683 INFO:tasks.workunit.client.1.smithi149.stdout:0/352: dwrite dd/d1a/d1b/d50/d53/d3a/d66/f69 [0,4194304] 0 2024-09-21T11:39:09.685 INFO:tasks.workunit.client.1.smithi149.stdout:6/351: write d8/da/d11/f26 [3753911,111067] 0 2024-09-21T11:39:09.686 INFO:tasks.workunit.client.1.smithi149.stdout:9/423: dwrite d18/d19/d1a/d2f/d5f/f80 [0,4194304] 0 2024-09-21T11:39:09.692 INFO:tasks.workunit.client.1.smithi149.stdout:2/462: dwrite f3 [0,4194304] 0 2024-09-21T11:39:09.692 INFO:tasks.workunit.client.1.smithi149.stdout:5/454: mkdir d4/d1d/d50/d54/d2a/d93 0 2024-09-21T11:39:09.694 INFO:tasks.workunit.client.1.smithi149.stdout:6/352: rmdir d8/da/d14 39 2024-09-21T11:39:09.694 INFO:tasks.workunit.client.1.smithi149.stdout:3/405: dread d6/f8 [0,4194304] 0 2024-09-21T11:39:09.696 INFO:tasks.workunit.client.1.smithi149.stdout:4/457: creat d4/d6/d63/d15/d30/d6b/daa/fac x:0 0 0 2024-09-21T11:39:09.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/406: chown d6/l15 6922 1 2024-09-21T11:39:09.702 INFO:tasks.workunit.client.1.smithi149.stdout:5/455: dread - d4/d7/d40/d51/f8c zero size 2024-09-21T11:39:09.702 INFO:tasks.workunit.client.1.smithi149.stdout:6/353: write d8/da/d3d/f5d [484157,118413] 0 2024-09-21T11:39:09.702 INFO:tasks.workunit.client.1.smithi149.stdout:2/463: creat d8/dd/d5c/d60/d67/d8a/fa6 x:0 0 0 2024-09-21T11:39:09.705 INFO:tasks.workunit.client.1.smithi149.stdout:4/458: dread - d4/d6/d63/d10/d31/d32/d4a/f50 zero size 2024-09-21T11:39:09.708 INFO:tasks.workunit.client.1.smithi149.stdout:5/456: symlink d4/d7/d40/d51/d56/l94 0 2024-09-21T11:39:09.708 INFO:tasks.workunit.client.1.smithi149.stdout:6/354: chown d8/d32/d37/d28/d2f 1457472 1 2024-09-21T11:39:09.710 INFO:tasks.workunit.client.1.smithi149.stdout:0/353: dwrite dd/d32/f6b [0,4194304] 0 2024-09-21T11:39:09.712 INFO:tasks.workunit.client.1.smithi149.stdout:0/354: stat dd/d1a/d1b 0 2024-09-21T11:39:09.715 INFO:tasks.workunit.client.1.smithi149.stdout:6/355: symlink d8/d32/d37/d2b/l6e 0 2024-09-21T11:39:09.718 INFO:tasks.workunit.client.1.smithi149.stdout:5/457: creat d4/d7/d40/d43/f95 x:0 0 0 2024-09-21T11:39:09.721 INFO:tasks.workunit.client.1.smithi149.stdout:4/459: dread d4/d6/d18/f2e [0,4194304] 0 2024-09-21T11:39:09.721 INFO:tasks.workunit.client.1.smithi149.stdout:6/356: creat d8/da/d2c/d2d/d60/f6f x:0 0 0 2024-09-21T11:39:09.722 INFO:tasks.workunit.client.1.smithi149.stdout:3/407: dwrite d6/d5f/d60/f82 [0,4194304] 0 2024-09-21T11:39:09.723 INFO:tasks.workunit.client.1.smithi149.stdout:5/458: write d4/d1d/d50/d54/d2a/f67 [314243,74005] 0 2024-09-21T11:39:09.760 INFO:tasks.workunit.client.1.smithi149.stdout:8/369: sync 2024-09-21T11:39:09.772 INFO:tasks.workunit.client.1.smithi149.stdout:8/370: chown d3/dd/d21/d54/l5f 85437 1 2024-09-21T11:39:09.772 INFO:tasks.workunit.client.1.smithi149.stdout:4/460: rmdir d4/d6/d63/d10/d6f 39 2024-09-21T11:39:09.773 INFO:tasks.workunit.client.1.smithi149.stdout:4/461: truncate d4/d6/d18/f73 749212 0 2024-09-21T11:39:09.773 INFO:tasks.workunit.client.1.smithi149.stdout:3/408: creat d6/d1f/d4c/f8f x:0 0 0 2024-09-21T11:39:09.774 INFO:tasks.workunit.client.1.smithi149.stdout:4/462: read - d4/d4d/d58/f79 zero size 2024-09-21T11:39:09.819 INFO:tasks.workunit.client.0.smithi118.stdout:5/28: sync 2024-09-21T11:39:09.819 INFO:tasks.workunit.client.0.smithi118.stdout:2/14: sync 2024-09-21T11:39:09.821 INFO:tasks.workunit.client.0.smithi118.stdout:5/29: mknod d0/db/cc 0 2024-09-21T11:39:09.821 INFO:tasks.workunit.client.1.smithi149.stdout:8/371: mknod d3/dd/d21/d54/d5c/d6d/c78 0 2024-09-21T11:39:09.822 INFO:tasks.workunit.client.1.smithi149.stdout:5/459: rename d4/d7/fa to d4/d1d/d3e/f96 0 2024-09-21T11:39:09.823 INFO:tasks.workunit.client.0.smithi118.stdout:5/30: creat d0/fd x:0 0 0 2024-09-21T11:39:09.823 INFO:tasks.workunit.client.0.smithi118.stdout:2/15: dread f3 [0,4194304] 0 2024-09-21T11:39:09.823 INFO:tasks.workunit.client.1.smithi149.stdout:5/460: read - d4/d7/d40/d51/f8c zero size 2024-09-21T11:39:09.824 INFO:tasks.workunit.client.0.smithi118.stdout:5/31: truncate d0/fd 607755 0 2024-09-21T11:39:09.826 INFO:tasks.workunit.client.0.smithi118.stdout:5/32: creat d0/fe x:0 0 0 2024-09-21T11:39:09.826 INFO:tasks.workunit.client.0.smithi118.stdout:2/16: truncate f3 1284414 0 2024-09-21T11:39:09.828 INFO:tasks.workunit.client.1.smithi149.stdout:3/409: truncate d6/d1f/d27/f6a 2089177 0 2024-09-21T11:39:09.829 INFO:tasks.workunit.client.1.smithi149.stdout:4/463: dread d4/d6/d63/d15/d16/f33 [0,4194304] 0 2024-09-21T11:39:09.830 INFO:tasks.workunit.client.1.smithi149.stdout:3/410: chown d6/f38 1917 1 2024-09-21T11:39:09.833 INFO:tasks.workunit.client.1.smithi149.stdout:8/372: dwrite d3/d12/f15 [0,4194304] 0 2024-09-21T11:39:09.834 INFO:tasks.workunit.client.1.smithi149.stdout:6/357: dread d8/d32/d37/d28/f33 [0,4194304] 0 2024-09-21T11:39:09.834 INFO:tasks.workunit.client.0.smithi118.stdout:5/33: write d0/d6/f7 [389799,66249] 0 2024-09-21T11:39:09.837 INFO:tasks.workunit.client.1.smithi149.stdout:5/461: dwrite d4/d1d/f6b [0,4194304] 0 2024-09-21T11:39:09.840 INFO:tasks.workunit.client.0.smithi118.stdout:5/34: rename d0/c2 to d0/db/cf 0 2024-09-21T11:39:09.840 INFO:tasks.workunit.client.1.smithi149.stdout:3/411: creat d6/d1f/d47/d37/d3a/f90 x:0 0 0 2024-09-21T11:39:09.842 INFO:tasks.workunit.client.0.smithi118.stdout:2/17: dwrite f3 [0,4194304] 0 2024-09-21T11:39:09.847 INFO:tasks.workunit.client.1.smithi149.stdout:8/373: mkdir d3/d12/d6e/d79 0 2024-09-21T11:39:09.847 INFO:tasks.workunit.client.1.smithi149.stdout:5/462: dread d4/d7/d40/d43/d5c/f66 [0,4194304] 0 2024-09-21T11:39:09.848 INFO:tasks.workunit.client.1.smithi149.stdout:5/463: stat d4/d7/f31 0 2024-09-21T11:39:09.848 INFO:tasks.workunit.client.1.smithi149.stdout:4/464: dwrite d4/d4d/d58/f91 [0,4194304] 0 2024-09-21T11:39:09.857 INFO:tasks.workunit.client.1.smithi149.stdout:3/412: symlink d6/d1f/d27/d83/l91 0 2024-09-21T11:39:09.861 INFO:tasks.workunit.client.0.smithi118.stdout:5/35: dwrite d0/d6/f8 [0,4194304] 0 2024-09-21T11:39:09.862 INFO:tasks.workunit.client.1.smithi149.stdout:5/464: creat d4/d7/d40/f97 x:0 0 0 2024-09-21T11:39:09.863 INFO:tasks.workunit.client.1.smithi149.stdout:4/465: dwrite d4/d4d/d5f/f87 [0,4194304] 0 2024-09-21T11:39:09.865 INFO:tasks.workunit.client.1.smithi149.stdout:3/413: rename d6/d5f/d60/d88/f8b to d6/d1f/d47/d37/d3a/f92 0 2024-09-21T11:39:09.866 INFO:tasks.workunit.client.0.smithi118.stdout:5/36: mkdir d0/d6/d9/d10 0 2024-09-21T11:39:09.866 INFO:tasks.workunit.client.0.smithi118.stdout:5/37: truncate d0/fe 743922 0 2024-09-21T11:39:09.868 INFO:tasks.workunit.client.1.smithi149.stdout:4/466: chown d4/d6/d63/d10/c14 6504134 1 2024-09-21T11:39:09.869 INFO:tasks.workunit.client.1.smithi149.stdout:1/382: sync 2024-09-21T11:39:09.869 INFO:tasks.workunit.client.1.smithi149.stdout:7/523: sync 2024-09-21T11:39:09.870 INFO:tasks.workunit.client.0.smithi118.stdout:5/38: creat d0/d6/d9/f11 x:0 0 0 2024-09-21T11:39:09.872 INFO:tasks.workunit.client.0.smithi118.stdout:5/39: truncate d0/fd 1432563 0 2024-09-21T11:39:09.878 INFO:tasks.workunit.client.1.smithi149.stdout:4/467: write d4/d6/d63/d15/f49 [3417740,21391] 0 2024-09-21T11:39:09.879 INFO:tasks.workunit.client.0.smithi118.stdout:3/79: sync 2024-09-21T11:39:09.879 INFO:tasks.workunit.client.0.smithi118.stdout:7/48: sync 2024-09-21T11:39:09.879 INFO:tasks.workunit.client.0.smithi118.stdout:1/59: sync 2024-09-21T11:39:09.879 INFO:tasks.workunit.client.0.smithi118.stdout:4/26: sync 2024-09-21T11:39:09.880 INFO:tasks.workunit.client.0.smithi118.stdout:9/20: sync 2024-09-21T11:39:09.880 INFO:tasks.workunit.client.0.smithi118.stdout:0/97: sync 2024-09-21T11:39:09.880 INFO:tasks.workunit.client.1.smithi149.stdout:1/383: rename d2/d5/f55 to d2/d2b/d6e/f76 0 2024-09-21T11:39:09.880 INFO:tasks.workunit.client.1.smithi149.stdout:7/524: symlink d12/d90/d26/d30/l9c 0 2024-09-21T11:39:09.881 INFO:tasks.workunit.client.0.smithi118.stdout:3/80: readlink d5/lf 0 2024-09-21T11:39:09.881 INFO:tasks.workunit.client.0.smithi118.stdout:5/40: rename d0/d6/d9/f11 to d0/d6/d9/da/f12 0 2024-09-21T11:39:09.881 INFO:tasks.workunit.client.0.smithi118.stdout:0/98: fdatasync d5/f15 0 2024-09-21T11:39:09.882 INFO:tasks.workunit.client.0.smithi118.stdout:4/27: rename d2 to d2/db 22 2024-09-21T11:39:09.882 INFO:tasks.workunit.client.1.smithi149.stdout:5/465: dwrite d4/d1d/d3e/f84 [0,4194304] 0 2024-09-21T11:39:09.882 INFO:tasks.workunit.client.0.smithi118.stdout:5/41: write d0/d6/f7 [2491523,109405] 0 2024-09-21T11:39:09.883 INFO:tasks.workunit.client.1.smithi149.stdout:4/468: chown d4/d4d/c83 1 1 2024-09-21T11:39:09.884 INFO:tasks.workunit.client.1.smithi149.stdout:6/358: dread d8/d32/d37/f3c [0,4194304] 0 2024-09-21T11:39:09.884 INFO:tasks.workunit.client.0.smithi118.stdout:5/42: chown d0/fe 2797092 1 2024-09-21T11:39:09.884 INFO:tasks.workunit.client.0.smithi118.stdout:4/28: chown d2/f4 0 1 2024-09-21T11:39:09.884 INFO:tasks.workunit.client.0.smithi118.stdout:4/29: chown f1 14208 1 2024-09-21T11:39:09.886 INFO:tasks.workunit.client.0.smithi118.stdout:3/81: rename d5/lf to d5/l1c 0 2024-09-21T11:39:09.886 INFO:tasks.workunit.client.1.smithi149.stdout:5/466: chown d4/d7/f27 1 1 2024-09-21T11:39:09.887 INFO:tasks.workunit.client.1.smithi149.stdout:7/525: unlink d12/d90/d68/c78 0 2024-09-21T11:39:09.888 INFO:tasks.workunit.client.1.smithi149.stdout:3/414: dwrite d6/d79/d7e/f89 [0,4194304] 0 2024-09-21T11:39:09.888 INFO:tasks.workunit.client.0.smithi118.stdout:7/49: truncate d0/d3/fd 515933 0 2024-09-21T11:39:09.893 INFO:tasks.workunit.client.0.smithi118.stdout:0/99: mkdir d5/d10/d1e/d21 0 2024-09-21T11:39:09.893 INFO:tasks.workunit.client.1.smithi149.stdout:1/384: dwrite d2/f20 [8388608,4194304] 0 2024-09-21T11:39:09.898 INFO:tasks.workunit.client.1.smithi149.stdout:5/467: chown d4/d1d/d3e/f96 53 1 2024-09-21T11:39:09.899 INFO:tasks.workunit.client.1.smithi149.stdout:7/526: dread d12/d90/d26/f2e [4194304,4194304] 0 2024-09-21T11:39:09.900 INFO:tasks.workunit.client.1.smithi149.stdout:7/527: dread - d12/d90/d4a/d4f/d75/d94/f98 zero size 2024-09-21T11:39:09.901 INFO:tasks.workunit.client.1.smithi149.stdout:7/528: read - d12/d90/d4a/d4f/d75/d94/d47/f59 zero size 2024-09-21T11:39:09.903 INFO:tasks.workunit.client.0.smithi118.stdout:1/60: creat d6/de/f11 x:0 0 0 2024-09-21T11:39:09.903 INFO:tasks.workunit.client.0.smithi118.stdout:1/61: chown d6 1 1 2024-09-21T11:39:09.904 INFO:tasks.workunit.client.0.smithi118.stdout:9/21: dwrite d0/f5 [0,4194304] 0 2024-09-21T11:39:09.905 INFO:tasks.workunit.client.0.smithi118.stdout:3/82: rename d5/d7 to d5/d1d 0 2024-09-21T11:39:09.905 INFO:tasks.workunit.client.0.smithi118.stdout:9/22: chown d0 107473 1 2024-09-21T11:39:09.906 INFO:tasks.workunit.client.0.smithi118.stdout:5/43: fdatasync d0/d6/d9/da/f12 0 2024-09-21T11:39:09.908 INFO:tasks.workunit.client.0.smithi118.stdout:7/50: creat d0/f10 x:0 0 0 2024-09-21T11:39:09.908 INFO:tasks.workunit.client.1.smithi149.stdout:5/468: rmdir d4/d7/d40/d43/d49 39 2024-09-21T11:39:09.909 INFO:tasks.workunit.client.1.smithi149.stdout:5/469: stat d4/d7/d40/d51/f58 0 2024-09-21T11:39:09.909 INFO:tasks.workunit.client.0.smithi118.stdout:0/100: read d5/f8 [1078145,80628] 0 2024-09-21T11:39:09.911 INFO:tasks.workunit.client.1.smithi149.stdout:3/415: symlink d6/l93 0 2024-09-21T11:39:09.914 INFO:tasks.workunit.client.0.smithi118.stdout:4/30: write d2/f4 [6509236,1797] 0 2024-09-21T11:39:09.915 INFO:tasks.workunit.client.1.smithi149.stdout:6/359: write d8/d32/d37/f36 [2667185,44367] 0 2024-09-21T11:39:09.915 INFO:tasks.workunit.client.0.smithi118.stdout:3/83: mknod d5/d1d/c1e 0 2024-09-21T11:39:09.916 INFO:tasks.workunit.client.0.smithi118.stdout:9/23: creat d0/d4/f8 x:0 0 0 2024-09-21T11:39:09.918 INFO:tasks.workunit.client.1.smithi149.stdout:5/470: chown d4/d7/l17 365 1 2024-09-21T11:39:09.918 INFO:tasks.workunit.client.1.smithi149.stdout:3/416: truncate d6/f12 3034333 0 2024-09-21T11:39:09.918 INFO:tasks.workunit.client.1.smithi149.stdout:4/469: dread d4/d6/f59 [0,4194304] 0 2024-09-21T11:39:09.920 INFO:tasks.workunit.client.1.smithi149.stdout:7/529: symlink d12/d90/d26/l9d 0 2024-09-21T11:39:09.920 INFO:tasks.workunit.client.1.smithi149.stdout:4/470: dread - d4/d4d/d5f/f94 zero size 2024-09-21T11:39:09.920 INFO:tasks.workunit.client.0.smithi118.stdout:0/101: symlink d5/d10/d1e/l22 0 2024-09-21T11:39:09.921 INFO:tasks.workunit.client.1.smithi149.stdout:6/360: fdatasync d8/da/d14/f31 0 2024-09-21T11:39:09.922 INFO:tasks.workunit.client.1.smithi149.stdout:1/385: dread d2/d5/d8/d3b/f42 [0,4194304] 0 2024-09-21T11:39:09.923 INFO:tasks.workunit.client.1.smithi149.stdout:3/417: rename d6/d1f/d47/d37/l5a to d6/d1f/d47/d22/l94 0 2024-09-21T11:39:09.924 INFO:tasks.workunit.client.0.smithi118.stdout:3/84: dwrite d5/f8 [0,4194304] 0 2024-09-21T11:39:09.926 INFO:tasks.workunit.client.1.smithi149.stdout:4/471: chown d4/d6/d63/d15/d16/d23/d5d 11 1 2024-09-21T11:39:09.927 INFO:tasks.workunit.client.1.smithi149.stdout:2/464: sync 2024-09-21T11:39:09.927 INFO:tasks.workunit.client.1.smithi149.stdout:9/424: sync 2024-09-21T11:39:09.927 INFO:tasks.workunit.client.0.smithi118.stdout:5/44: symlink d0/d6/d9/d10/l13 0 2024-09-21T11:39:09.927 INFO:tasks.workunit.client.0.smithi118.stdout:0/102: dread d5/f17 [0,4194304] 0 2024-09-21T11:39:09.928 INFO:tasks.workunit.client.0.smithi118.stdout:9/24: symlink d0/l9 0 2024-09-21T11:39:09.931 INFO:tasks.workunit.client.1.smithi149.stdout:7/530: rename d12/d90/d4a/d6c/d84 to d12/d90/d4a/d9e 0 2024-09-21T11:39:09.932 INFO:tasks.workunit.client.0.smithi118.stdout:3/85: dwrite d5/d1d/f19 [0,4194304] 0 2024-09-21T11:39:09.933 INFO:tasks.workunit.client.1.smithi149.stdout:3/418: mkdir d6/d1f/d47/d37/d3a/d95 0 2024-09-21T11:39:09.934 INFO:tasks.workunit.client.1.smithi149.stdout:5/471: creat d4/d7/d40/d43/d49/d88/f98 x:0 0 0 2024-09-21T11:39:09.935 INFO:tasks.workunit.client.0.smithi118.stdout:4/31: link d2/f4 d2/fc 0 2024-09-21T11:39:09.940 INFO:tasks.workunit.client.1.smithi149.stdout:1/386: rename d2/dd/f22 to d2/dd/d2e/f77 0 2024-09-21T11:39:09.941 INFO:tasks.workunit.client.0.smithi118.stdout:0/103: read d5/f13 [76302,91868] 0 2024-09-21T11:39:09.941 INFO:tasks.workunit.client.0.smithi118.stdout:7/51: link d0/f2 d0/d3/f11 0 2024-09-21T11:39:09.942 INFO:tasks.workunit.client.1.smithi149.stdout:7/531: mknod d12/d90/d4a/d6c/c9f 0 2024-09-21T11:39:09.942 INFO:tasks.workunit.client.0.smithi118.stdout:0/104: truncate d5/f11 1050373 0 2024-09-21T11:39:09.942 INFO:tasks.workunit.client.0.smithi118.stdout:9/25: symlink d0/d4/la 0 2024-09-21T11:39:09.943 INFO:tasks.workunit.client.0.smithi118.stdout:9/26: stat d0/d4 0 2024-09-21T11:39:09.945 INFO:tasks.workunit.client.1.smithi149.stdout:5/472: chown d4/d7/l28 164106266 1 2024-09-21T11:39:09.946 INFO:tasks.workunit.client.0.smithi118.stdout:1/62: getdents d6 0 2024-09-21T11:39:09.948 INFO:tasks.workunit.client.0.smithi118.stdout:3/86: read d5/f10 [288308,32775] 0 2024-09-21T11:39:09.948 INFO:tasks.workunit.client.0.smithi118.stdout:3/87: write d5/f8 [4056966,14044] 0 2024-09-21T11:39:09.953 INFO:tasks.workunit.client.1.smithi149.stdout:1/387: read d2/d2b/f31 [175387,90836] 0 2024-09-21T11:39:09.955 INFO:tasks.workunit.client.1.smithi149.stdout:2/465: rename d8/da/d13/d1a/f1f to d8/da/d13/d5d/da0/fa7 0 2024-09-21T11:39:09.955 INFO:tasks.workunit.client.0.smithi118.stdout:7/52: symlink d0/d3/l12 0 2024-09-21T11:39:09.956 INFO:tasks.workunit.client.1.smithi149.stdout:7/532: mkdir d12/d90/d4a/d6c/da0 0 2024-09-21T11:39:09.958 INFO:tasks.workunit.client.0.smithi118.stdout:0/105: unlink d5/c18 0 2024-09-21T11:39:09.958 INFO:tasks.workunit.client.1.smithi149.stdout:7/533: write d12/d90/d4a/f93 [778131,117488] 0 2024-09-21T11:39:09.959 INFO:tasks.workunit.client.1.smithi149.stdout:1/388: dwrite d2/dd/d2e/d4c/f52 [0,4194304] 0 2024-09-21T11:39:09.959 INFO:tasks.workunit.client.1.smithi149.stdout:3/419: fdatasync d6/fc 0 2024-09-21T11:39:09.960 INFO:tasks.workunit.client.0.smithi118.stdout:9/27: creat d0/fb x:0 0 0 2024-09-21T11:39:09.962 INFO:tasks.workunit.client.1.smithi149.stdout:5/473: symlink d4/d7/d40/d51/d56/l99 0 2024-09-21T11:39:09.963 INFO:tasks.workunit.client.0.smithi118.stdout:1/63: rename d6/ca to d6/de/c12 0 2024-09-21T11:39:09.964 INFO:tasks.workunit.client.1.smithi149.stdout:5/474: write d4/d7/f38 [5795781,105335] 0 2024-09-21T11:39:09.965 INFO:tasks.workunit.client.1.smithi149.stdout:6/361: getdents d8/d32/d37 0 2024-09-21T11:39:09.974 INFO:tasks.workunit.client.1.smithi149.stdout:2/466: mknod d8/da/d13/d5d/d6a/ca8 0 2024-09-21T11:39:09.976 INFO:tasks.workunit.client.0.smithi118.stdout:7/53: mkdir d0/d3/d13 0 2024-09-21T11:39:09.980 INFO:tasks.workunit.client.1.smithi149.stdout:2/467: dwrite d8/da/d13/d1a/d29/f69 [0,4194304] 0 2024-09-21T11:39:09.981 INFO:tasks.workunit.client.0.smithi118.stdout:9/28: creat d0/fc x:0 0 0 2024-09-21T11:39:09.983 INFO:tasks.workunit.client.0.smithi118.stdout:9/29: rename d0/d4 to d0/d4/dd 22 2024-09-21T11:39:09.985 INFO:tasks.workunit.client.0.smithi118.stdout:7/54: dwrite d0/d3/ff [0,4194304] 0 2024-09-21T11:39:09.985 INFO:tasks.workunit.client.1.smithi149.stdout:8/374: sync 2024-09-21T11:39:09.985 INFO:tasks.workunit.client.1.smithi149.stdout:0/355: sync 2024-09-21T11:39:09.986 INFO:tasks.workunit.client.0.smithi118.stdout:9/30: chown d0/d4/f8 80005 1 2024-09-21T11:39:09.986 INFO:tasks.workunit.client.1.smithi149.stdout:3/420: mkdir d6/d5f/d6d/d96 0 2024-09-21T11:39:09.987 INFO:tasks.workunit.client.0.smithi118.stdout:9/31: read d0/f1 [4328054,119905] 0 2024-09-21T11:39:09.987 INFO:tasks.workunit.client.1.smithi149.stdout:3/421: chown d6/d1f/d47/d37/c41 28860 1 2024-09-21T11:39:09.987 INFO:tasks.workunit.client.0.smithi118.stdout:3/88: rename d5/l1c to d5/l1f 0 2024-09-21T11:39:09.988 INFO:tasks.workunit.client.0.smithi118.stdout:3/89: chown d5/d1d/d1b 20784 1 2024-09-21T11:39:09.991 INFO:tasks.workunit.client.1.smithi149.stdout:1/389: rename d2/d5/c3c to d2/dd/d35/d1c/d2c/c78 0 2024-09-21T11:39:09.992 INFO:tasks.workunit.client.0.smithi118.stdout:5/45: link d0/c1 d0/d6/d9/c14 0 2024-09-21T11:39:09.992 INFO:tasks.workunit.client.0.smithi118.stdout:4/32: truncate d2/fc 2091037 0 2024-09-21T11:39:09.995 INFO:tasks.workunit.client.1.smithi149.stdout:4/472: getdents d4/d6/d63/d15/d30/d6b 0 2024-09-21T11:39:09.997 INFO:tasks.workunit.client.1.smithi149.stdout:5/475: mkdir d4/d1d/d3e/d9a 0 2024-09-21T11:39:09.998 INFO:tasks.workunit.client.0.smithi118.stdout:0/106: write d5/f8 [85440,78192] 0 2024-09-21T11:39:09.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/362: mkdir d8/d32/d70 0 2024-09-21T11:39:09.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/363: readlink d8/d32/d37/l42 0 2024-09-21T11:39:10.000 INFO:tasks.workunit.client.1.smithi149.stdout:9/425: link d18/d19/d1a/d2f/l56 d18/d19/d29/d39/l87 0 2024-09-21T11:39:10.003 INFO:tasks.workunit.client.0.smithi118.stdout:8/119: sync 2024-09-21T11:39:10.004 INFO:tasks.workunit.client.0.smithi118.stdout:6/66: sync 2024-09-21T11:39:10.004 INFO:tasks.workunit.client.0.smithi118.stdout:0/107: dwrite d5/f11 [0,4194304] 0 2024-09-21T11:39:10.005 INFO:tasks.workunit.client.1.smithi149.stdout:6/364: dwrite d8/da/d3d/f5d [0,4194304] 0 2024-09-21T11:39:10.005 INFO:tasks.workunit.client.1.smithi149.stdout:6/365: dread - d8/d32/d37/f49 zero size 2024-09-21T11:39:10.006 INFO:tasks.workunit.client.0.smithi118.stdout:9/32: rmdir d0/d4 39 2024-09-21T11:39:10.010 INFO:tasks.workunit.client.1.smithi149.stdout:7/534: mkdir d12/d90/da1 0 2024-09-21T11:39:10.012 INFO:tasks.workunit.client.1.smithi149.stdout:7/535: write d12/d90/d4a/f76 [923875,71195] 0 2024-09-21T11:39:10.012 INFO:tasks.workunit.client.1.smithi149.stdout:7/536: chown d12 29433736 1 2024-09-21T11:39:10.013 INFO:tasks.workunit.client.0.smithi118.stdout:1/64: fsync d6/f8 0 2024-09-21T11:39:10.016 INFO:tasks.workunit.client.0.smithi118.stdout:9/33: dwrite d0/fc [0,4194304] 0 2024-09-21T11:39:10.016 INFO:tasks.workunit.client.1.smithi149.stdout:8/375: creat d3/d3c/d4c/f7a x:0 0 0 2024-09-21T11:39:10.018 INFO:tasks.workunit.client.0.smithi118.stdout:4/33: dread f1 [0,4194304] 0 2024-09-21T11:39:10.019 INFO:tasks.workunit.client.1.smithi149.stdout:0/356: creat dd/d1a/d5a/f80 x:0 0 0 2024-09-21T11:39:10.022 INFO:tasks.workunit.client.1.smithi149.stdout:3/422: mkdir d6/d1f/d47/d22/d8d/d97 0 2024-09-21T11:39:10.024 INFO:tasks.workunit.client.0.smithi118.stdout:8/120: rmdir d2 39 2024-09-21T11:39:10.026 INFO:tasks.workunit.client.1.smithi149.stdout:4/473: rename d4/f7 to d4/d6/d63/d15/d30/d6b/daa/fad 0 2024-09-21T11:39:10.027 INFO:tasks.workunit.client.0.smithi118.stdout:6/67: mkdir d8/d1b 0 2024-09-21T11:39:10.028 INFO:tasks.workunit.client.0.smithi118.stdout:0/108: unlink d5/ld 0 2024-09-21T11:39:10.029 INFO:tasks.workunit.client.1.smithi149.stdout:9/426: mknod d18/d19/d29/d39/d63/c88 0 2024-09-21T11:39:10.033 INFO:tasks.workunit.client.0.smithi118.stdout:3/90: creat d5/d1d/d1b/f20 x:0 0 0 2024-09-21T11:39:10.035 INFO:tasks.workunit.client.1.smithi149.stdout:9/427: dwrite d18/d36/d3c/d47/d76/f7b [0,4194304] 0 2024-09-21T11:39:10.035 INFO:tasks.workunit.client.1.smithi149.stdout:2/468: truncate f7 2864425 0 2024-09-21T11:39:10.036 INFO:tasks.workunit.client.1.smithi149.stdout:2/469: fdatasync d8/dd/f74 0 2024-09-21T11:39:10.036 INFO:tasks.workunit.client.1.smithi149.stdout:9/428: stat d18/d19/d1a/d2f/f38 0 2024-09-21T11:39:10.036 INFO:tasks.workunit.client.1.smithi149.stdout:2/470: dread - d8/d44/d63/f75 zero size 2024-09-21T11:39:10.037 INFO:tasks.workunit.client.0.smithi118.stdout:7/55: dwrite d0/f2 [0,4194304] 0 2024-09-21T11:39:10.040 INFO:tasks.workunit.client.0.smithi118.stdout:4/34: mkdir d2/d6/dd 0 2024-09-21T11:39:10.042 INFO:tasks.workunit.client.1.smithi149.stdout:3/423: symlink d6/d79/l98 0 2024-09-21T11:39:10.042 INFO:tasks.workunit.client.1.smithi149.stdout:1/390: getdents d2/dd/d35/d1c/d41/d74 0 2024-09-21T11:39:10.049 INFO:tasks.workunit.client.0.smithi118.stdout:6/68: write d8/f1a [177325,24612] 0 2024-09-21T11:39:10.049 INFO:tasks.workunit.client.0.smithi118.stdout:0/109: chown c3 54 1 2024-09-21T11:39:10.050 INFO:tasks.workunit.client.1.smithi149.stdout:3/424: dwrite d6/d1f/d47/f74 [0,4194304] 0 2024-09-21T11:39:10.051 INFO:tasks.workunit.client.0.smithi118.stdout:7/56: dread d0/f9 [4194304,4194304] 0 2024-09-21T11:39:10.053 INFO:tasks.workunit.client.1.smithi149.stdout:3/425: dread - d6/d1f/d47/d37/d3f/f40 zero size 2024-09-21T11:39:10.054 INFO:tasks.workunit.client.1.smithi149.stdout:3/426: write d6/d1f/d47/f52 [1404067,130032] 0 2024-09-21T11:39:10.062 INFO:tasks.workunit.client.0.smithi118.stdout:1/65: dread f1 [0,4194304] 0 2024-09-21T11:39:10.063 INFO:tasks.workunit.client.0.smithi118.stdout:3/91: dread f0 [0,4194304] 0 2024-09-21T11:39:10.063 INFO:tasks.workunit.client.0.smithi118.stdout:8/121: dwrite d2/dc/d13/d18/d1a/f1f [0,4194304] 0 2024-09-21T11:39:10.068 INFO:tasks.workunit.client.1.smithi149.stdout:2/471: creat d8/d44/d63/fa9 x:0 0 0 2024-09-21T11:39:10.071 INFO:tasks.workunit.client.0.smithi118.stdout:7/57: mkdir d0/d3/d14 0 2024-09-21T11:39:10.071 INFO:tasks.workunit.client.0.smithi118.stdout:9/34: dwrite d0/f5 [8388608,4194304] 0 2024-09-21T11:39:10.072 INFO:tasks.workunit.client.0.smithi118.stdout:7/58: fdatasync d0/d3/ff 0 2024-09-21T11:39:10.072 INFO:tasks.workunit.client.0.smithi118.stdout:9/35: chown d0/l9 70512 1 2024-09-21T11:39:10.072 INFO:tasks.workunit.client.1.smithi149.stdout:0/357: mkdir dd/d1a/d1b/d81 0 2024-09-21T11:39:10.073 INFO:tasks.workunit.client.1.smithi149.stdout:0/358: chown dd/d35/c60 3269429 1 2024-09-21T11:39:10.076 INFO:tasks.workunit.client.1.smithi149.stdout:5/476: rename d4/c10 to d4/d1d/d3e/c9b 0 2024-09-21T11:39:10.077 INFO:tasks.workunit.client.0.smithi118.stdout:0/110: mkdir d5/d10/d1e/d23 0 2024-09-21T11:39:10.077 INFO:tasks.workunit.client.0.smithi118.stdout:7/59: dread d0/d3/ff [0,4194304] 0 2024-09-21T11:39:10.078 INFO:tasks.workunit.client.0.smithi118.stdout:7/60: fdatasync d0/fe 0 2024-09-21T11:39:10.084 INFO:tasks.workunit.client.0.smithi118.stdout:4/35: dwrite f1 [0,4194304] 0 2024-09-21T11:39:10.085 INFO:tasks.workunit.client.1.smithi149.stdout:3/427: mknod d6/d79/d7e/c99 0 2024-09-21T11:39:10.086 INFO:tasks.workunit.client.0.smithi118.stdout:3/92: symlink d5/l21 0 2024-09-21T11:39:10.091 INFO:tasks.workunit.client.1.smithi149.stdout:9/429: mknod d18/d19/d1a/d2f/c89 0 2024-09-21T11:39:10.093 INFO:tasks.workunit.client.0.smithi118.stdout:1/66: write f5 [3428945,54062] 0 2024-09-21T11:39:10.094 INFO:tasks.workunit.client.1.smithi149.stdout:2/472: mknod d8/dd/d50/caa 0 2024-09-21T11:39:10.094 INFO:tasks.workunit.client.1.smithi149.stdout:2/473: readlink d8/da/l15 0 2024-09-21T11:39:10.100 INFO:tasks.workunit.client.1.smithi149.stdout:6/366: getdents d8/d32/d64 0 2024-09-21T11:39:10.101 INFO:tasks.workunit.client.1.smithi149.stdout:6/367: write d8/d32/d37/f61 [611341,31875] 0 2024-09-21T11:39:10.102 INFO:tasks.workunit.client.1.smithi149.stdout:6/368: stat d8/d32/d37/f49 0 2024-09-21T11:39:10.102 INFO:tasks.workunit.client.1.smithi149.stdout:3/428: readlink d6/d1f/d47/d22/l94 0 2024-09-21T11:39:10.103 INFO:tasks.workunit.client.0.smithi118.stdout:4/36: mkdir d2/d6/de 0 2024-09-21T11:39:10.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/537: getdents d12/d90/d26/d30 0 2024-09-21T11:39:10.105 INFO:tasks.workunit.client.0.smithi118.stdout:3/93: mknod d5/d1d/d1b/c22 0 2024-09-21T11:39:10.106 INFO:tasks.workunit.client.1.smithi149.stdout:7/538: read d12/d90/d26/d30/f5a [1773587,45495] 0 2024-09-21T11:39:10.107 INFO:tasks.workunit.client.0.smithi118.stdout:8/122: mknod d2/dc/d13/c2b 0 2024-09-21T11:39:10.108 INFO:tasks.workunit.client.1.smithi149.stdout:7/539: truncate d12/d90/d26/d30/f57 1860039 0 2024-09-21T11:39:10.108 INFO:tasks.workunit.client.0.smithi118.stdout:1/67: fsync d6/fd 0 2024-09-21T11:39:10.108 INFO:tasks.workunit.client.1.smithi149.stdout:8/376: link d3/d12/l5a d3/d3c/d4c/l7b 0 2024-09-21T11:39:10.110 INFO:tasks.workunit.client.0.smithi118.stdout:3/94: dread d5/d1d/fa [0,4194304] 0 2024-09-21T11:39:10.110 INFO:tasks.workunit.client.1.smithi149.stdout:1/391: rename d2/dd/d35/d1c/f64 to d2/d5/d65/f79 0 2024-09-21T11:39:10.111 INFO:tasks.workunit.client.0.smithi118.stdout:6/69: rmdir d8/d1b 0 2024-09-21T11:39:10.112 INFO:tasks.workunit.client.1.smithi149.stdout:1/392: write d2/dd/d35/d1c/d2c/f69 [2065084,124245] 0 2024-09-21T11:39:10.113 INFO:tasks.workunit.client.1.smithi149.stdout:5/477: fsync d4/d7/d40/d43/d49/f78 0 2024-09-21T11:39:10.113 INFO:tasks.workunit.client.1.smithi149.stdout:5/478: fsync d4/d7/f31 0 2024-09-21T11:39:10.114 INFO:tasks.workunit.client.1.smithi149.stdout:6/369: creat d8/d32/d37/f71 x:0 0 0 2024-09-21T11:39:10.118 INFO:tasks.workunit.client.1.smithi149.stdout:3/429: dread d6/f1a [0,4194304] 0 2024-09-21T11:39:10.118 INFO:tasks.workunit.client.1.smithi149.stdout:2/474: symlink d8/lab 0 2024-09-21T11:39:10.120 INFO:tasks.workunit.client.1.smithi149.stdout:2/475: write d8/d20/f62 [4141804,3963] 0 2024-09-21T11:39:10.121 INFO:tasks.workunit.client.1.smithi149.stdout:2/476: dread - d8/d44/d63/f75 zero size 2024-09-21T11:39:10.121 INFO:tasks.workunit.client.1.smithi149.stdout:8/377: mknod d3/d33/d34/d55/c7c 0 2024-09-21T11:39:10.121 INFO:tasks.workunit.client.1.smithi149.stdout:2/477: stat d8/d44/d63 0 2024-09-21T11:39:10.122 INFO:tasks.workunit.client.0.smithi118.stdout:8/123: symlink d2/dc/d10/l2c 0 2024-09-21T11:39:10.127 INFO:tasks.workunit.client.1.smithi149.stdout:2/478: dwrite f3 [0,4194304] 0 2024-09-21T11:39:10.129 INFO:tasks.workunit.client.1.smithi149.stdout:5/479: readlink d4/d7/l7e 0 2024-09-21T11:39:10.135 INFO:tasks.workunit.client.0.smithi118.stdout:4/37: rename d2/d6/c9 to d2/d6/cf 0 2024-09-21T11:39:10.138 INFO:tasks.workunit.client.1.smithi149.stdout:1/393: dread d2/f1a [0,4194304] 0 2024-09-21T11:39:10.139 INFO:tasks.workunit.client.1.smithi149.stdout:8/378: dread d3/f1d [4194304,4194304] 0 2024-09-21T11:39:10.142 INFO:tasks.workunit.client.0.smithi118.stdout:9/36: link d0/l9 d0/d4/le 0 2024-09-21T11:39:10.144 INFO:tasks.workunit.client.1.smithi149.stdout:2/479: mkdir d8/d11/dac 0 2024-09-21T11:39:10.145 INFO:tasks.workunit.client.0.smithi118.stdout:9/37: truncate d0/d4/f8 638526 0 2024-09-21T11:39:10.145 INFO:tasks.workunit.client.1.smithi149.stdout:4/474: sync 2024-09-21T11:39:10.145 INFO:tasks.workunit.client.0.smithi118.stdout:7/61: dwrite d0/d3/fd [0,4194304] 0 2024-09-21T11:39:10.147 INFO:tasks.workunit.client.0.smithi118.stdout:0/111: write d5/f13 [91359,24540] 0 2024-09-21T11:39:10.149 INFO:tasks.workunit.client.0.smithi118.stdout:0/112: write d5/f13 [1500741,48774] 0 2024-09-21T11:39:10.150 INFO:tasks.workunit.client.1.smithi149.stdout:3/430: mknod d6/d1f/d47/d37/c9a 0 2024-09-21T11:39:10.151 INFO:tasks.workunit.client.0.smithi118.stdout:9/38: dread d0/f1 [4194304,4194304] 0 2024-09-21T11:39:10.151 INFO:tasks.workunit.client.0.smithi118.stdout:7/62: write d0/f10 [4073,120888] 0 2024-09-21T11:39:10.152 INFO:tasks.workunit.client.0.smithi118.stdout:8/124: write d2/dc/d13/d18/d1a/f1f [4806477,128407] 0 2024-09-21T11:39:10.153 INFO:tasks.workunit.client.1.smithi149.stdout:2/480: dwrite d8/d20/d78/f93 [0,4194304] 0 2024-09-21T11:39:10.155 INFO:tasks.workunit.client.0.smithi118.stdout:6/70: truncate d8/f1a 3399971 0 2024-09-21T11:39:10.155 INFO:tasks.workunit.client.0.smithi118.stdout:6/71: fdatasync d8/f15 0 2024-09-21T11:39:10.157 INFO:tasks.workunit.client.1.smithi149.stdout:2/481: write d8/da/d13/d1a/d2c/f41 [1393279,76705] 0 2024-09-21T11:39:10.162 INFO:tasks.workunit.client.1.smithi149.stdout:8/379: creat d3/f7d x:0 0 0 2024-09-21T11:39:10.164 INFO:tasks.workunit.client.1.smithi149.stdout:4/475: creat d4/d6/d63/d2d/fae x:0 0 0 2024-09-21T11:39:10.166 INFO:tasks.workunit.client.1.smithi149.stdout:4/476: readlink d4/d6/d63/d2d/l77 0 2024-09-21T11:39:10.167 INFO:tasks.workunit.client.0.smithi118.stdout:9/39: creat d0/d4/ff x:0 0 0 2024-09-21T11:39:10.167 INFO:tasks.workunit.client.1.smithi149.stdout:3/431: dwrite d6/d1f/d47/d37/f3b [0,4194304] 0 2024-09-21T11:39:10.167 INFO:tasks.workunit.client.1.smithi149.stdout:5/480: mknod d4/d7/d40/c9c 0 2024-09-21T11:39:10.169 INFO:tasks.workunit.client.0.smithi118.stdout:8/125: creat d2/dc/d13/d18/f2d x:0 0 0 2024-09-21T11:39:10.170 INFO:tasks.workunit.client.0.smithi118.stdout:8/126: chown d2/dc/d16 5277 1 2024-09-21T11:39:10.170 INFO:tasks.workunit.client.1.smithi149.stdout:1/394: mkdir d2/dd/d35/d1c/d7a 0 2024-09-21T11:39:10.176 INFO:tasks.workunit.client.1.smithi149.stdout:9/430: rename d18/d4c/d5b/l83 to d18/d36/l8a 0 2024-09-21T11:39:10.180 INFO:tasks.workunit.client.1.smithi149.stdout:8/380: creat d3/dd/d18/f7e x:0 0 0 2024-09-21T11:39:10.181 INFO:tasks.workunit.client.1.smithi149.stdout:8/381: write d3/f7d [921262,22892] 0 2024-09-21T11:39:10.181 INFO:tasks.workunit.client.0.smithi118.stdout:1/68: getdents d6/de 0 2024-09-21T11:39:10.182 INFO:tasks.workunit.client.1.smithi149.stdout:2/482: write d8/da/f39 [4837999,120536] 0 2024-09-21T11:39:10.182 INFO:tasks.workunit.client.0.smithi118.stdout:1/69: write d6/fd [417940,17452] 0 2024-09-21T11:39:10.183 INFO:tasks.workunit.client.1.smithi149.stdout:6/370: getdents d8/da/d2c/d52/d5e 0 2024-09-21T11:39:10.184 INFO:tasks.workunit.client.1.smithi149.stdout:6/371: chown d8/da/d2c/d52 13507 1 2024-09-21T11:39:10.186 INFO:tasks.workunit.client.1.smithi149.stdout:4/477: symlink d4/d6/d63/d15/laf 0 2024-09-21T11:39:10.188 INFO:tasks.workunit.client.1.smithi149.stdout:8/382: dwrite d3/f37 [0,4194304] 0 2024-09-21T11:39:10.189 INFO:tasks.workunit.client.0.smithi118.stdout:7/63: creat d0/d3/d14/f15 x:0 0 0 2024-09-21T11:39:10.189 INFO:tasks.workunit.client.0.smithi118.stdout:6/72: dwrite d8/fc [0,4194304] 0 2024-09-21T11:39:10.189 INFO:tasks.workunit.client.1.smithi149.stdout:3/432: symlink d6/d1f/d47/d37/d3a/l9b 0 2024-09-21T11:39:10.192 INFO:tasks.workunit.client.1.smithi149.stdout:4/478: dread d4/d6/f8f [0,4194304] 0 2024-09-21T11:39:10.192 INFO:tasks.workunit.client.1.smithi149.stdout:1/395: creat d2/d5/d65/f7b x:0 0 0 2024-09-21T11:39:10.194 INFO:tasks.workunit.client.0.smithi118.stdout:9/40: dwrite d0/f1 [0,4194304] 0 2024-09-21T11:39:10.195 INFO:tasks.workunit.client.1.smithi149.stdout:7/540: rename d12/d90/d4a/d4f/d75/d94/f6f to d12/d90/d4a/d6c/d8c/fa2 0 2024-09-21T11:39:10.197 INFO:tasks.workunit.client.1.smithi149.stdout:2/483: creat d8/dd/d50/fad x:0 0 0 2024-09-21T11:39:10.197 INFO:tasks.workunit.client.1.smithi149.stdout:1/396: chown d2/dd/d2e/d4c 3 1 2024-09-21T11:39:10.198 INFO:tasks.workunit.client.1.smithi149.stdout:5/481: unlink d4/c24 0 2024-09-21T11:39:10.203 INFO:tasks.workunit.client.1.smithi149.stdout:6/372: mkdir d8/d32/d37/d28/d2f/d6a/d72 0 2024-09-21T11:39:10.203 INFO:tasks.workunit.client.1.smithi149.stdout:8/383: dwrite d3/d33/f64 [0,4194304] 0 2024-09-21T11:39:10.205 INFO:tasks.workunit.client.1.smithi149.stdout:2/484: write d8/da/d13/d1a/d2c/f41 [953944,98286] 0 2024-09-21T11:39:10.207 INFO:tasks.workunit.client.1.smithi149.stdout:5/482: write d4/d7/d40/d43/d49/d88/f98 [385546,112162] 0 2024-09-21T11:39:10.210 INFO:tasks.workunit.client.1.smithi149.stdout:4/479: unlink d4/d6/d63/d15/d30/d6b/f72 0 2024-09-21T11:39:10.211 INFO:tasks.workunit.client.1.smithi149.stdout:1/397: mkdir d2/dd/d35/d7c 0 2024-09-21T11:39:10.212 INFO:tasks.workunit.client.1.smithi149.stdout:8/384: write d3/dd/d18/f7e [955042,130812] 0 2024-09-21T11:39:10.213 INFO:tasks.workunit.client.1.smithi149.stdout:4/480: dread - d4/d6/d63/d15/d16/d23/d62/fa9 zero size 2024-09-21T11:39:10.215 INFO:tasks.workunit.client.1.smithi149.stdout:4/481: write d4/d6/d63/d10/d31/d32/d4a/f61 [2370133,47349] 0 2024-09-21T11:39:10.220 INFO:tasks.workunit.client.0.smithi118.stdout:4/38: link d2/f4 d2/d6/de/f10 0 2024-09-21T11:39:10.221 INFO:tasks.workunit.client.1.smithi149.stdout:6/373: symlink d8/d32/d37/d2b/d51/l73 0 2024-09-21T11:39:10.224 INFO:tasks.workunit.client.0.smithi118.stdout:1/70: mkdir d6/de/d13 0 2024-09-21T11:39:10.227 INFO:tasks.workunit.client.1.smithi149.stdout:5/483: rmdir d4/d1d/d50 39 2024-09-21T11:39:10.227 INFO:tasks.workunit.client.1.smithi149.stdout:6/374: dwrite d8/da/d3d/f5d [0,4194304] 0 2024-09-21T11:39:10.227 INFO:tasks.workunit.client.0.smithi118.stdout:1/71: dread d6/fd [0,4194304] 0 2024-09-21T11:39:10.228 INFO:tasks.workunit.client.0.smithi118.stdout:8/127: unlink d2/dc/c28 0 2024-09-21T11:39:10.235 INFO:tasks.workunit.client.0.smithi118.stdout:9/41: mknod d0/d4/c10 0 2024-09-21T11:39:10.236 INFO:tasks.workunit.client.0.smithi118.stdout:9/42: dread - d0/fb zero size 2024-09-21T11:39:10.236 INFO:tasks.workunit.client.0.smithi118.stdout:9/43: chown d0/fc 75731 1 2024-09-21T11:39:10.239 INFO:tasks.workunit.client.0.smithi118.stdout:0/113: truncate d5/f8 241450 0 2024-09-21T11:39:10.240 INFO:tasks.workunit.client.1.smithi149.stdout:0/359: sync 2024-09-21T11:39:10.240 INFO:tasks.workunit.client.1.smithi149.stdout:7/541: link d12/d90/d4a/c9b d12/d90/d4a/d6c/d8c/ca3 0 2024-09-21T11:39:10.242 INFO:tasks.workunit.client.0.smithi118.stdout:8/128: rename d2/dc/d13 to d2/dc/d10/d2e 0 2024-09-21T11:39:10.242 INFO:tasks.workunit.client.1.smithi149.stdout:2/485: link d8/da/d13/d1a/c7d d8/d11/cae 0 2024-09-21T11:39:10.242 INFO:tasks.workunit.client.1.smithi149.stdout:5/484: dwrite d4/f18 [0,4194304] 0 2024-09-21T11:39:10.244 INFO:tasks.workunit.client.1.smithi149.stdout:1/398: rename d2/f20 to d2/d5/f7d 0 2024-09-21T11:39:10.246 INFO:tasks.workunit.client.1.smithi149.stdout:1/399: chown d2/dd/d2e 3543 1 2024-09-21T11:39:10.248 INFO:tasks.workunit.client.0.smithi118.stdout:4/39: symlink d2/d6/dd/l11 0 2024-09-21T11:39:10.250 INFO:tasks.workunit.client.0.smithi118.stdout:6/73: dwrite d8/fb [0,4194304] 0 2024-09-21T11:39:10.251 INFO:tasks.workunit.client.0.smithi118.stdout:6/74: dread - d8/f15 zero size 2024-09-21T11:39:10.256 INFO:tasks.workunit.client.1.smithi149.stdout:2/486: symlink d8/d20/d78/d7c/laf 0 2024-09-21T11:39:10.256 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:09 smithi118 ceph-mon[28757]: pgmap v20: 65 pgs: 65 active+clean; 753 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s rd, 80 MiB/s wr, 230 op/s 2024-09-21T11:39:10.257 INFO:tasks.workunit.client.1.smithi149.stdout:2/487: write d8/da/f39 [6115547,25035] 0 2024-09-21T11:39:10.259 INFO:tasks.workunit.client.1.smithi149.stdout:2/488: dread - d8/da/d13/d1a/d2c/d5a/f73 zero size 2024-09-21T11:39:10.260 INFO:tasks.workunit.client.0.smithi118.stdout:7/64: truncate d0/f2 1787162 0 2024-09-21T11:39:10.260 INFO:tasks.workunit.client.0.smithi118.stdout:7/65: dread - d0/d3/d14/f15 zero size 2024-09-21T11:39:10.264 INFO:tasks.workunit.client.1.smithi149.stdout:5/485: mknod d4/d7/d40/d43/d5c/c9d 0 2024-09-21T11:39:10.264 INFO:tasks.workunit.client.0.smithi118.stdout:2/18: sync 2024-09-21T11:39:10.265 INFO:tasks.workunit.client.0.smithi118.stdout:8/129: creat d2/dc/d10/d2e/d18/f2f x:0 0 0 2024-09-21T11:39:10.268 INFO:tasks.workunit.client.1.smithi149.stdout:4/482: rename d4/d6/d63/d10/d31/f4b to d4/d4d/d5f/d71/fb0 0 2024-09-21T11:39:10.269 INFO:tasks.workunit.client.1.smithi149.stdout:7/542: dread d12/f1e [0,4194304] 0 2024-09-21T11:39:10.270 INFO:tasks.workunit.client.1.smithi149.stdout:0/360: dwrite dd/d2d/f56 [0,4194304] 0 2024-09-21T11:39:10.271 INFO:tasks.workunit.client.1.smithi149.stdout:1/400: write d2/d2b/d6e/f76 [859938,91125] 0 2024-09-21T11:39:10.271 INFO:tasks.workunit.client.0.smithi118.stdout:9/44: mknod d0/c11 0 2024-09-21T11:39:10.271 INFO:tasks.workunit.client.0.smithi118.stdout:9/45: truncate d0/fb 522205 0 2024-09-21T11:39:10.272 INFO:tasks.workunit.client.1.smithi149.stdout:1/401: write d2/f5e [722244,107669] 0 2024-09-21T11:39:10.273 INFO:tasks.workunit.client.1.smithi149.stdout:7/543: write d12/d90/d4a/d4f/d75/d94/d47/f8f [821576,65906] 0 2024-09-21T11:39:10.274 INFO:tasks.workunit.client.1.smithi149.stdout:6/375: creat d8/d32/d37/d28/f74 x:0 0 0 2024-09-21T11:39:10.275 INFO:tasks.workunit.client.0.smithi118.stdout:6/75: rename d8/l10 to d8/d14/l1c 0 2024-09-21T11:39:10.279 INFO:tasks.workunit.client.0.smithi118.stdout:7/66: creat d0/f16 x:0 0 0 2024-09-21T11:39:10.281 INFO:tasks.workunit.client.1.smithi149.stdout:2/489: creat d8/d20/fb0 x:0 0 0 2024-09-21T11:39:10.281 INFO:tasks.workunit.client.0.smithi118.stdout:1/72: link d6/de/lf d6/de/d13/l14 0 2024-09-21T11:39:10.281 INFO:tasks.workunit.client.0.smithi118.stdout:6/76: dwrite d8/fc [0,4194304] 0 2024-09-21T11:39:10.283 INFO:tasks.workunit.client.1.smithi149.stdout:5/486: dread - d4/d4f/f7f zero size 2024-09-21T11:39:10.284 INFO:tasks.workunit.client.0.smithi118.stdout:2/19: mknod c4 0 2024-09-21T11:39:10.285 INFO:tasks.workunit.client.1.smithi149.stdout:4/483: creat d4/d6/d63/d15/d30/d6b/fb1 x:0 0 0 2024-09-21T11:39:10.285 INFO:tasks.workunit.client.0.smithi118.stdout:8/130: rmdir d2 39 2024-09-21T11:39:10.289 INFO:tasks.workunit.client.1.smithi149.stdout:6/376: mknod d8/d32/c75 0 2024-09-21T11:39:10.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/402: creat d2/d5/d3d/f7e x:0 0 0 2024-09-21T11:39:10.291 INFO:tasks.workunit.client.0.smithi118.stdout:0/114: creat d5/d10/d1e/d21/f24 x:0 0 0 2024-09-21T11:39:10.292 INFO:tasks.workunit.client.1.smithi149.stdout:2/490: rmdir d8/d11 39 2024-09-21T11:39:10.292 INFO:tasks.workunit.client.1.smithi149.stdout:1/403: stat d2/d2b/d6e/f76 0 2024-09-21T11:39:10.293 INFO:tasks.workunit.client.0.smithi118.stdout:7/67: mknod d0/d3/c17 0 2024-09-21T11:39:10.298 INFO:tasks.workunit.client.1.smithi149.stdout:6/377: dwrite d8/d32/d37/d28/f30 [4194304,4194304] 0 2024-09-21T11:39:10.298 INFO:tasks.workunit.client.0.smithi118.stdout:6/77: dread f6 [0,4194304] 0 2024-09-21T11:39:10.299 INFO:tasks.workunit.client.0.smithi118.stdout:1/73: unlink d6/de/c12 0 2024-09-21T11:39:10.300 INFO:tasks.workunit.client.1.smithi149.stdout:0/361: mknod dd/d1a/d1b/d50/d6d/c82 0 2024-09-21T11:39:10.304 INFO:tasks.workunit.client.1.smithi149.stdout:2/491: creat d8/d44/fb1 x:0 0 0 2024-09-21T11:39:10.306 INFO:tasks.workunit.client.0.smithi118.stdout:4/40: link d2/d6/de/f10 d2/f12 0 2024-09-21T11:39:10.307 INFO:tasks.workunit.client.1.smithi149.stdout:5/487: creat d4/d90/f9e x:0 0 0 2024-09-21T11:39:10.308 INFO:tasks.workunit.client.0.smithi118.stdout:9/46: symlink d0/l12 0 2024-09-21T11:39:10.309 INFO:tasks.workunit.client.1.smithi149.stdout:7/544: dread d12/d90/f50 [0,4194304] 0 2024-09-21T11:39:10.309 INFO:tasks.workunit.client.1.smithi149.stdout:1/404: rmdir d2/dd/d35/d1c/d41/d51 39 2024-09-21T11:39:10.309 INFO:tasks.workunit.client.1.smithi149.stdout:4/484: dread d4/d6/d18/f1c [0,4194304] 0 2024-09-21T11:39:10.309 INFO:tasks.workunit.client.1.smithi149.stdout:9/431: sync 2024-09-21T11:39:10.309 INFO:tasks.workunit.client.0.smithi118.stdout:4/41: dread d2/fc [0,4194304] 0 2024-09-21T11:39:10.310 INFO:tasks.workunit.client.1.smithi149.stdout:9/432: fdatasync d18/d19/d1a/d2f/d53/f62 0 2024-09-21T11:39:10.311 INFO:tasks.workunit.client.0.smithi118.stdout:7/68: creat d0/d3/f18 x:0 0 0 2024-09-21T11:39:10.313 INFO:tasks.workunit.client.1.smithi149.stdout:0/362: symlink dd/d1a/d5a/l83 0 2024-09-21T11:39:10.315 INFO:tasks.workunit.client.1.smithi149.stdout:2/492: chown d8/d11/c4e 5157 1 2024-09-21T11:39:10.315 INFO:tasks.workunit.client.0.smithi118.stdout:8/131: rename d2/dc/d10/d2e/d18/d1a/l27 to d2/dc/d10/l30 0 2024-09-21T11:39:10.318 INFO:tasks.workunit.client.1.smithi149.stdout:2/493: write d8/dd/f1d [7015908,5181] 0 2024-09-21T11:39:10.319 INFO:tasks.workunit.client.0.smithi118.stdout:4/42: creat d2/f13 x:0 0 0 2024-09-21T11:39:10.320 INFO:tasks.workunit.client.1.smithi149.stdout:4/485: dwrite d4/d6/d63/f28 [4194304,4194304] 0 2024-09-21T11:39:10.320 INFO:tasks.workunit.client.1.smithi149.stdout:7/545: mknod d12/d90/d4a/d4f/ca4 0 2024-09-21T11:39:10.321 INFO:tasks.workunit.client.0.smithi118.stdout:0/115: creat d5/d10/d1e/d23/f25 x:0 0 0 2024-09-21T11:39:10.322 INFO:tasks.workunit.client.1.smithi149.stdout:9/433: dwrite d18/d36/d3c/d47/f85 [0,4194304] 0 2024-09-21T11:39:10.323 INFO:tasks.workunit.client.1.smithi149.stdout:7/546: chown d12/d90/d4a/d4f/d75/c7d 489 1 2024-09-21T11:39:10.324 INFO:tasks.workunit.client.1.smithi149.stdout:1/405: write d2/d5/d8/d3b/f6d [2205655,129410] 0 2024-09-21T11:39:10.325 INFO:tasks.workunit.client.1.smithi149.stdout:6/378: symlink d8/da/d2c/d52/d5e/d69/l76 0 2024-09-21T11:39:10.328 INFO:tasks.workunit.client.1.smithi149.stdout:8/385: sync 2024-09-21T11:39:10.328 INFO:tasks.workunit.client.1.smithi149.stdout:3/433: sync 2024-09-21T11:39:10.328 INFO:tasks.workunit.client.1.smithi149.stdout:9/434: truncate d18/d36/d3c/f77 440998 0 2024-09-21T11:39:10.328 INFO:tasks.workunit.client.0.smithi118.stdout:4/43: rmdir d2/d6/dd 39 2024-09-21T11:39:10.329 INFO:tasks.workunit.client.0.smithi118.stdout:6/78: dwrite f6 [4194304,4194304] 0 2024-09-21T11:39:10.330 INFO:tasks.workunit.client.0.smithi118.stdout:4/44: write d2/f13 [1010478,15220] 0 2024-09-21T11:39:10.332 INFO:tasks.workunit.client.0.smithi118.stdout:7/69: fdatasync d0/d3/f11 0 2024-09-21T11:39:10.333 INFO:tasks.workunit.client.0.smithi118.stdout:7/70: fdatasync d0/f16 0 2024-09-21T11:39:10.335 INFO:tasks.workunit.client.1.smithi149.stdout:2/494: mknod d8/da/d13/d1a/d29/cb2 0 2024-09-21T11:39:10.335 INFO:tasks.workunit.client.1.smithi149.stdout:3/434: dread - d6/d1f/d47/d37/d3a/f90 zero size 2024-09-21T11:39:10.337 INFO:tasks.workunit.client.1.smithi149.stdout:7/547: unlink d12/d90/d4a/d4f/c6d 0 2024-09-21T11:39:10.337 INFO:tasks.workunit.client.0.smithi118.stdout:8/132: getdents d2/dc/d16 0 2024-09-21T11:39:10.339 INFO:tasks.workunit.client.0.smithi118.stdout:1/74: truncate f5 1481874 0 2024-09-21T11:39:10.341 INFO:tasks.workunit.client.0.smithi118.stdout:9/47: creat d0/f13 x:0 0 0 2024-09-21T11:39:10.341 INFO:tasks.workunit.client.0.smithi118.stdout:9/48: read - d0/f13 zero size 2024-09-21T11:39:10.343 INFO:tasks.workunit.client.0.smithi118.stdout:0/116: creat d5/d10/d1e/d20/f26 x:0 0 0 2024-09-21T11:39:10.345 INFO:tasks.workunit.client.1.smithi149.stdout:5/488: getdents d4/d4f 0 2024-09-21T11:39:10.347 INFO:tasks.workunit.client.1.smithi149.stdout:9/435: unlink d18/d19/d1a/d2f/d30/l3e 0 2024-09-21T11:39:10.348 INFO:tasks.workunit.client.1.smithi149.stdout:8/386: mknod d3/d33/d34/d55/d5e/c7f 0 2024-09-21T11:39:10.349 INFO:tasks.workunit.client.0.smithi118.stdout:7/71: symlink d0/d3/l19 0 2024-09-21T11:39:10.352 INFO:tasks.workunit.client.1.smithi149.stdout:3/435: symlink d6/d1f/d47/d37/d3a/l9c 0 2024-09-21T11:39:10.356 INFO:tasks.workunit.client.1.smithi149.stdout:6/379: dwrite d8/d32/d37/d2b/d51/f59 [0,4194304] 0 2024-09-21T11:39:10.358 INFO:tasks.workunit.client.1.smithi149.stdout:1/406: truncate d2/dd/d2e/f77 4470789 0 2024-09-21T11:39:10.358 INFO:tasks.workunit.client.0.smithi118.stdout:7/72: symlink d0/d3/d14/l1a 0 2024-09-21T11:39:10.358 INFO:tasks.workunit.client.1.smithi149.stdout:0/363: dwrite dd/d1a/d1b/d50/d53/d3a/f5b [0,4194304] 0 2024-09-21T11:39:10.359 INFO:tasks.workunit.client.0.smithi118.stdout:9/49: mknod d0/c14 0 2024-09-21T11:39:10.360 INFO:tasks.workunit.client.1.smithi149.stdout:4/486: dwrite d4/d6/d63/d15/d30/f53 [0,4194304] 0 2024-09-21T11:39:10.362 INFO:tasks.workunit.client.1.smithi149.stdout:5/489: stat d4/d7/d40/d43/d49 0 2024-09-21T11:39:10.362 INFO:tasks.workunit.client.0.smithi118.stdout:9/50: dread d0/d4/f8 [0,4194304] 0 2024-09-21T11:39:10.365 INFO:tasks.workunit.client.1.smithi149.stdout:1/407: fdatasync d2/f5e 0 2024-09-21T11:39:10.366 INFO:tasks.workunit.client.0.smithi118.stdout:9/51: write d0/fc [1885079,47778] 0 2024-09-21T11:39:10.369 INFO:tasks.workunit.client.1.smithi149.stdout:0/364: write dd/d35/f4d [2208618,43540] 0 2024-09-21T11:39:10.372 INFO:tasks.workunit.client.0.smithi118.stdout:7/73: dwrite d0/d3/f18 [0,4194304] 0 2024-09-21T11:39:10.374 INFO:tasks.workunit.client.0.smithi118.stdout:4/45: truncate f1 719900 0 2024-09-21T11:39:10.375 INFO:tasks.workunit.client.0.smithi118.stdout:7/74: chown d0/f5 24 1 2024-09-21T11:39:10.379 INFO:tasks.workunit.client.0.smithi118.stdout:6/79: getdents d8 0 2024-09-21T11:39:10.379 INFO:tasks.workunit.client.0.smithi118.stdout:4/46: write d2/f13 [1201451,48660] 0 2024-09-21T11:39:10.381 INFO:tasks.workunit.client.1.smithi149.stdout:7/548: dwrite d12/d90/d4a/d4f/d75/d94/d47/f59 [0,4194304] 0 2024-09-21T11:39:10.381 INFO:tasks.workunit.client.1.smithi149.stdout:8/387: dwrite d3/fa [0,4194304] 0 2024-09-21T11:39:10.382 INFO:tasks.workunit.client.0.smithi118.stdout:1/75: dwrite d6/f8 [0,4194304] 0 2024-09-21T11:39:10.382 INFO:tasks.workunit.client.1.smithi149.stdout:4/487: symlink d4/lb2 0 2024-09-21T11:39:10.387 INFO:tasks.workunit.client.0.smithi118.stdout:1/76: dread - d6/de/f11 zero size 2024-09-21T11:39:10.389 INFO:tasks.workunit.client.0.smithi118.stdout:9/52: dwrite d0/fc [4194304,4194304] 0 2024-09-21T11:39:10.392 INFO:tasks.workunit.client.1.smithi149.stdout:5/490: dwrite d4/d1d/d3e/f84 [0,4194304] 0 2024-09-21T11:39:10.393 INFO:tasks.workunit.client.0.smithi118.stdout:7/75: fsync d0/f2 0 2024-09-21T11:39:10.395 INFO:tasks.workunit.client.0.smithi118.stdout:1/77: truncate d6/de/f11 77862 0 2024-09-21T11:39:10.395 INFO:tasks.workunit.client.0.smithi118.stdout:0/117: dwrite d5/f7 [0,4194304] 0 2024-09-21T11:39:10.398 INFO:tasks.workunit.client.0.smithi118.stdout:4/47: rmdir d2 39 2024-09-21T11:39:10.398 INFO:tasks.workunit.client.1.smithi149.stdout:4/488: dread - d4/d6/d63/d15/d16/d23/d62/fa2 zero size 2024-09-21T11:39:10.401 INFO:tasks.workunit.client.0.smithi118.stdout:6/80: creat d8/d14/f1d x:0 0 0 2024-09-21T11:39:10.402 INFO:tasks.workunit.client.1.smithi149.stdout:2/495: dread d8/d11/f3d [0,4194304] 0 2024-09-21T11:39:10.402 INFO:tasks.workunit.client.0.smithi118.stdout:3/95: sync 2024-09-21T11:39:10.402 INFO:tasks.workunit.client.0.smithi118.stdout:5/46: sync 2024-09-21T11:39:10.402 INFO:tasks.workunit.client.0.smithi118.stdout:6/81: chown f6 1 1 2024-09-21T11:39:10.402 INFO:tasks.workunit.client.1.smithi149.stdout:0/365: read dd/d2d/f4f [1890,23113] 0 2024-09-21T11:39:10.403 INFO:tasks.workunit.client.0.smithi118.stdout:6/82: chown d8/f15 15503400 1 2024-09-21T11:39:10.404 INFO:tasks.workunit.client.0.smithi118.stdout:6/83: dread - d8/f13 zero size 2024-09-21T11:39:10.405 INFO:tasks.workunit.client.0.smithi118.stdout:6/84: write d8/f1a [2716097,28136] 0 2024-09-21T11:39:10.407 INFO:tasks.workunit.client.1.smithi149.stdout:9/436: dwrite d18/d19/d1a/f4b [0,4194304] 0 2024-09-21T11:39:10.407 INFO:tasks.workunit.client.1.smithi149.stdout:3/436: symlink d6/d1f/d47/d22/d8d/d97/l9d 0 2024-09-21T11:39:10.408 INFO:tasks.workunit.client.0.smithi118.stdout:9/53: creat d0/d4/f15 x:0 0 0 2024-09-21T11:39:10.408 INFO:tasks.workunit.client.1.smithi149.stdout:2/496: chown d8/dd/d5c/d60 1976 1 2024-09-21T11:39:10.413 INFO:tasks.workunit.client.1.smithi149.stdout:0/366: chown dd/d1a/d1b/d50/d53/d3a/d66/f69 15741 1 2024-09-21T11:39:10.417 INFO:tasks.workunit.client.1.smithi149.stdout:2/497: chown d8/d11/c4e 30870 1 2024-09-21T11:39:10.417 INFO:tasks.workunit.client.1.smithi149.stdout:2/498: stat d8/da/d13/d2d/d6f 0 2024-09-21T11:39:10.417 INFO:tasks.workunit.client.0.smithi118.stdout:3/96: fsync d5/d1d/f16 0 2024-09-21T11:39:10.419 INFO:tasks.workunit.client.0.smithi118.stdout:3/97: chown d5/d1d/d1b/c22 6501560 1 2024-09-21T11:39:10.419 INFO:tasks.workunit.client.0.smithi118.stdout:5/47: creat d0/d6/d9/d10/f15 x:0 0 0 2024-09-21T11:39:10.420 INFO:tasks.workunit.client.1.smithi149.stdout:0/367: chown dd/d1a/d1b/d50/d53/f42 1176 1 2024-09-21T11:39:10.421 INFO:tasks.workunit.client.0.smithi118.stdout:5/48: chown d0/d6/d9 149 1 2024-09-21T11:39:10.421 INFO:tasks.workunit.client.0.smithi118.stdout:5/49: chown d0/d6/d9/d10/l13 17944 1 2024-09-21T11:39:10.423 INFO:tasks.workunit.client.1.smithi149.stdout:8/388: mkdir d3/dd/d18/d2e/d80 0 2024-09-21T11:39:10.424 INFO:tasks.workunit.client.1.smithi149.stdout:0/368: dread - dd/d2d/f4b zero size 2024-09-21T11:39:10.425 INFO:tasks.workunit.client.1.smithi149.stdout:3/437: truncate d6/d1f/d47/d22/f5d 4913414 0 2024-09-21T11:39:10.425 INFO:tasks.workunit.client.0.smithi118.stdout:6/85: creat d8/d14/f1e x:0 0 0 2024-09-21T11:39:10.428 INFO:tasks.workunit.client.1.smithi149.stdout:2/499: symlink d8/d20/d57/lb3 0 2024-09-21T11:39:10.428 INFO:tasks.workunit.client.1.smithi149.stdout:7/549: unlink d12/d90/l2a 0 2024-09-21T11:39:10.429 INFO:tasks.workunit.client.0.smithi118.stdout:7/76: symlink d0/d3/d13/l1b 0 2024-09-21T11:39:10.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/380: dread d8/d32/f46 [0,4194304] 0 2024-09-21T11:39:10.432 INFO:tasks.workunit.client.1.smithi149.stdout:4/489: dread d4/d6/d63/d15/d30/f53 [0,4194304] 0 2024-09-21T11:39:10.433 INFO:tasks.workunit.client.1.smithi149.stdout:1/408: dread d2/d5/d8/d3b/f3e [0,4194304] 0 2024-09-21T11:39:10.433 INFO:tasks.workunit.client.1.smithi149.stdout:6/381: write d8/da/d3d/f5d [4475800,29598] 0 2024-09-21T11:39:10.434 INFO:tasks.workunit.client.1.smithi149.stdout:4/490: truncate d4/d6/f88 1461598 0 2024-09-21T11:39:10.437 INFO:tasks.workunit.client.1.smithi149.stdout:0/369: creat dd/d1a/d1b/d50/d5d/f84 x:0 0 0 2024-09-21T11:39:10.437 INFO:tasks.workunit.client.1.smithi149.stdout:5/491: write d4/d7/d40/d51/f58 [1872690,69233] 0 2024-09-21T11:39:10.438 INFO:tasks.workunit.client.1.smithi149.stdout:0/370: chown dd/d1a/d1b/f27 467303 1 2024-09-21T11:39:10.438 INFO:tasks.workunit.client.0.smithi118.stdout:3/98: creat d5/d1d/f23 x:0 0 0 2024-09-21T11:39:10.438 INFO:tasks.workunit.client.1.smithi149.stdout:5/492: dread - d4/d7/d40/f97 zero size 2024-09-21T11:39:10.441 INFO:tasks.workunit.client.0.smithi118.stdout:5/50: rename d0/d6/d9/da/f12 to d0/db/f16 0 2024-09-21T11:39:10.441 INFO:tasks.workunit.client.0.smithi118.stdout:5/51: fdatasync d0/d6/f8 0 2024-09-21T11:39:10.442 INFO:tasks.workunit.client.1.smithi149.stdout:7/550: symlink d12/d90/d4a/d6c/la5 0 2024-09-21T11:39:10.444 INFO:tasks.workunit.client.1.smithi149.stdout:4/491: dread d4/d6/d18/f2a [0,4194304] 0 2024-09-21T11:39:10.444 INFO:tasks.workunit.client.1.smithi149.stdout:9/437: mknod d18/d19/d1a/d2f/d43/c8b 0 2024-09-21T11:39:10.444 INFO:tasks.workunit.client.0.smithi118.stdout:6/86: truncate d8/f11 838900 0 2024-09-21T11:39:10.445 INFO:tasks.workunit.client.1.smithi149.stdout:4/492: fsync d4/d6/d63/d10/d31/d32/d4a/f85 0 2024-09-21T11:39:10.445 INFO:tasks.workunit.client.1.smithi149.stdout:2/500: mknod d8/d20/d78/d7c/cb4 0 2024-09-21T11:39:10.446 INFO:tasks.workunit.client.1.smithi149.stdout:2/501: readlink d8/d20/d78/l86 0 2024-09-21T11:39:10.446 INFO:tasks.workunit.client.0.smithi118.stdout:6/87: write f6 [2137881,63879] 0 2024-09-21T11:39:10.446 INFO:tasks.workunit.client.1.smithi149.stdout:2/502: chown d8/da/d13/d53/f87 8139 1 2024-09-21T11:39:10.447 INFO:tasks.workunit.client.0.smithi118.stdout:0/118: write d5/f8 [147791,40227] 0 2024-09-21T11:39:10.448 INFO:tasks.workunit.client.1.smithi149.stdout:2/503: write d8/d20/d78/f93 [4712840,93133] 0 2024-09-21T11:39:10.449 INFO:tasks.workunit.client.1.smithi149.stdout:1/409: unlink d2/d5/d3d/f7e 0 2024-09-21T11:39:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:10 smithi149 ceph-mon[36123]: pgmap v20: 65 pgs: 65 active+clean; 753 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s rd, 80 MiB/s wr, 230 op/s 2024-09-21T11:39:10.450 INFO:tasks.workunit.client.0.smithi118.stdout:0/119: read - d5/d10/d1e/d20/f26 zero size 2024-09-21T11:39:10.450 INFO:tasks.workunit.client.0.smithi118.stdout:3/99: mkdir d5/d1d/d1b/d24 0 2024-09-21T11:39:10.451 INFO:tasks.workunit.client.1.smithi149.stdout:1/410: read d2/dd/d35/d1c/d2c/f69 [942134,97565] 0 2024-09-21T11:39:10.452 INFO:tasks.workunit.client.1.smithi149.stdout:8/389: creat d3/dd/d18/d2e/d80/f81 x:0 0 0 2024-09-21T11:39:10.453 INFO:tasks.workunit.client.1.smithi149.stdout:8/390: write d3/dd/d3a/f73 [194074,121675] 0 2024-09-21T11:39:10.455 INFO:tasks.workunit.client.0.smithi118.stdout:9/54: link d0/d4/c10 d0/d4/c16 0 2024-09-21T11:39:10.455 INFO:tasks.workunit.client.0.smithi118.stdout:6/88: dwrite d8/f15 [0,4194304] 0 2024-09-21T11:39:10.455 INFO:tasks.workunit.client.0.smithi118.stdout:5/52: write d0/db/f16 [764317,106727] 0 2024-09-21T11:39:10.455 INFO:tasks.workunit.client.1.smithi149.stdout:8/391: write d3/dd/d21/d54/f56 [1091230,24490] 0 2024-09-21T11:39:10.457 INFO:tasks.workunit.client.1.smithi149.stdout:0/371: unlink dd/d1a/d1b/d50/d53/d3a/f4e 0 2024-09-21T11:39:10.462 INFO:tasks.workunit.client.0.smithi118.stdout:4/48: creat d2/d6/f14 x:0 0 0 2024-09-21T11:39:10.463 INFO:tasks.workunit.client.1.smithi149.stdout:4/493: dread d4/d4d/f45 [0,4194304] 0 2024-09-21T11:39:10.463 INFO:tasks.workunit.client.1.smithi149.stdout:6/382: dread d8/da/d14/f15 [0,4194304] 0 2024-09-21T11:39:10.464 INFO:tasks.workunit.client.0.smithi118.stdout:9/55: dwrite d0/f1 [8388608,4194304] 0 2024-09-21T11:39:10.464 INFO:tasks.workunit.client.1.smithi149.stdout:9/438: mkdir d18/d19/d1a/d2f/d30/d54/d8c 0 2024-09-21T11:39:10.467 INFO:tasks.workunit.client.0.smithi118.stdout:0/120: chown d5/cf 414 1 2024-09-21T11:39:10.467 INFO:tasks.workunit.client.1.smithi149.stdout:4/494: dread d4/d6/d18/f2e [0,4194304] 0 2024-09-21T11:39:10.473 INFO:tasks.workunit.client.0.smithi118.stdout:4/49: dwrite d2/d6/f14 [0,4194304] 0 2024-09-21T11:39:10.474 INFO:tasks.workunit.client.0.smithi118.stdout:3/100: creat d5/d1d/f25 x:0 0 0 2024-09-21T11:39:10.475 INFO:tasks.workunit.client.1.smithi149.stdout:2/504: mknod d8/da/d13/d5d/cb5 0 2024-09-21T11:39:10.476 INFO:tasks.workunit.client.1.smithi149.stdout:2/505: write d8/d44/d63/f75 [86185,15402] 0 2024-09-21T11:39:10.484 INFO:tasks.workunit.client.1.smithi149.stdout:3/438: write d6/d1f/d47/d37/f4b [2875549,80333] 0 2024-09-21T11:39:10.484 INFO:tasks.workunit.client.0.smithi118.stdout:9/56: creat d0/d4/f17 x:0 0 0 2024-09-21T11:39:10.485 INFO:tasks.workunit.client.0.smithi118.stdout:4/50: dwrite d2/f13 [0,4194304] 0 2024-09-21T11:39:10.485 INFO:tasks.workunit.client.1.smithi149.stdout:5/493: mknod d4/c9f 0 2024-09-21T11:39:10.485 INFO:tasks.workunit.client.0.smithi118.stdout:9/57: chown d0/c14 30048 1 2024-09-21T11:39:10.486 INFO:tasks.workunit.client.1.smithi149.stdout:5/494: write d4/d7/d40/d43/f69 [776715,109512] 0 2024-09-21T11:39:10.487 INFO:tasks.workunit.client.1.smithi149.stdout:5/495: chown d4/d7/l16 70 1 2024-09-21T11:39:10.488 INFO:tasks.workunit.client.0.smithi118.stdout:9/58: write d0/f13 [866412,18091] 0 2024-09-21T11:39:10.488 INFO:tasks.workunit.client.0.smithi118.stdout:0/121: creat d5/d10/d1e/f27 x:0 0 0 2024-09-21T11:39:10.489 INFO:tasks.workunit.client.0.smithi118.stdout:0/122: chown d5/d10/d1e/f27 356022197 1 2024-09-21T11:39:10.493 INFO:tasks.workunit.client.1.smithi149.stdout:8/392: mknod d3/dd/d18/d2e/c82 0 2024-09-21T11:39:10.494 INFO:tasks.workunit.client.1.smithi149.stdout:0/372: rename dd/d1a/d1b/d50/d6d to dd/d1a/d1b/d72/d85 0 2024-09-21T11:39:10.497 INFO:tasks.workunit.client.0.smithi118.stdout:5/53: rename d0/db/cf to d0/d6/c17 0 2024-09-21T11:39:10.498 INFO:tasks.workunit.client.1.smithi149.stdout:9/439: symlink d18/d36/d3c/d47/l8d 0 2024-09-21T11:39:10.500 INFO:tasks.workunit.client.1.smithi149.stdout:0/373: dwrite dd/d1a/f2f [0,4194304] 0 2024-09-21T11:39:10.501 INFO:tasks.workunit.client.1.smithi149.stdout:0/374: chown dd/d1a/f2c 0 1 2024-09-21T11:39:10.501 INFO:tasks.workunit.client.0.smithi118.stdout:9/59: creat d0/d4/f18 x:0 0 0 2024-09-21T11:39:10.502 INFO:tasks.workunit.client.1.smithi149.stdout:2/506: creat d8/d11/fb6 x:0 0 0 2024-09-21T11:39:10.503 INFO:tasks.workunit.client.0.smithi118.stdout:0/123: creat d5/d10/f28 x:0 0 0 2024-09-21T11:39:10.505 INFO:tasks.workunit.client.1.smithi149.stdout:1/411: fsync d2/d5/d8/fa 0 2024-09-21T11:39:10.507 INFO:tasks.workunit.client.1.smithi149.stdout:3/439: creat d6/d1f/d47/d37/d3a/f9e x:0 0 0 2024-09-21T11:39:10.508 INFO:tasks.workunit.client.1.smithi149.stdout:3/440: readlink d6/l15 0 2024-09-21T11:39:10.508 INFO:tasks.workunit.client.0.smithi118.stdout:5/54: creat d0/d6/d9/da/f18 x:0 0 0 2024-09-21T11:39:10.512 INFO:tasks.workunit.client.0.smithi118.stdout:9/60: readlink d0/l9 0 2024-09-21T11:39:10.515 INFO:tasks.workunit.client.0.smithi118.stdout:3/101: link d5/d1d/l18 d5/l26 0 2024-09-21T11:39:10.516 INFO:tasks.workunit.client.0.smithi118.stdout:6/89: link d8/ce d8/d14/c1f 0 2024-09-21T11:39:10.518 INFO:tasks.workunit.client.0.smithi118.stdout:5/55: rmdir d0/db 39 2024-09-21T11:39:10.519 INFO:tasks.workunit.client.0.smithi118.stdout:5/56: write d0/fe [785575,33702] 0 2024-09-21T11:39:10.520 INFO:tasks.workunit.client.1.smithi149.stdout:0/375: unlink dd/d1a/d1b/d50/d53/f5f 0 2024-09-21T11:39:10.520 INFO:tasks.workunit.client.0.smithi118.stdout:5/57: chown d0/d6/f7 156618 1 2024-09-21T11:39:10.521 INFO:tasks.workunit.client.1.smithi149.stdout:0/376: chown dd/d1a/d1b/d50/c51 14248 1 2024-09-21T11:39:10.522 INFO:tasks.workunit.client.0.smithi118.stdout:4/51: link d2/d6/f14 d2/d6/dd/f15 0 2024-09-21T11:39:10.523 INFO:tasks.workunit.client.1.smithi149.stdout:2/507: write d8/dd/d5c/f76 [357457,25209] 0 2024-09-21T11:39:10.523 INFO:tasks.workunit.client.0.smithi118.stdout:9/61: chown d0/d4/c7 167 1 2024-09-21T11:39:10.523 INFO:tasks.workunit.client.1.smithi149.stdout:2/508: fdatasync d8/da/d13/f7e 0 2024-09-21T11:39:10.529 INFO:tasks.workunit.client.1.smithi149.stdout:5/496: link d4/d4f/f7f d4/d7/d40/d51/fa0 0 2024-09-21T11:39:10.531 INFO:tasks.workunit.client.1.smithi149.stdout:8/393: mkdir d3/d33/d34/d72/d83 0 2024-09-21T11:39:10.533 INFO:tasks.workunit.client.0.smithi118.stdout:6/90: write d8/f13 [7624,27096] 0 2024-09-21T11:39:10.534 INFO:tasks.workunit.client.1.smithi149.stdout:3/441: write d6/d1f/d47/f1e [4668102,23360] 0 2024-09-21T11:39:10.534 INFO:tasks.workunit.client.1.smithi149.stdout:0/377: mknod dd/d1a/d1b/d50/d53/c86 0 2024-09-21T11:39:10.536 INFO:tasks.workunit.client.1.smithi149.stdout:4/495: sync 2024-09-21T11:39:10.536 INFO:tasks.workunit.client.1.smithi149.stdout:7/551: sync 2024-09-21T11:39:10.537 INFO:tasks.workunit.client.1.smithi149.stdout:7/552: read d12/d90/d4a/d4f/f88 [577654,34649] 0 2024-09-21T11:39:10.538 INFO:tasks.workunit.client.0.smithi118.stdout:0/124: dwrite d5/f17 [0,4194304] 0 2024-09-21T11:39:10.538 INFO:tasks.workunit.client.0.smithi118.stdout:6/91: mknod d8/c20 0 2024-09-21T11:39:10.540 INFO:tasks.workunit.client.1.smithi149.stdout:2/509: creat d8/da/d13/d1a/d3b/fb7 x:0 0 0 2024-09-21T11:39:10.541 INFO:tasks.workunit.client.0.smithi118.stdout:6/92: chown d8/fa 63773 1 2024-09-21T11:39:10.541 INFO:tasks.workunit.client.0.smithi118.stdout:9/62: rename d0/c11 to d0/c19 0 2024-09-21T11:39:10.542 INFO:tasks.workunit.client.1.smithi149.stdout:2/510: stat d8/da/d13/d1a/c31 0 2024-09-21T11:39:10.543 INFO:tasks.workunit.client.1.smithi149.stdout:1/412: creat d2/dd/d35/d1c/d41/d51/f7f x:0 0 0 2024-09-21T11:39:10.544 INFO:tasks.workunit.client.1.smithi149.stdout:4/496: dwrite d4/d4d/d5f/d71/f8d [0,4194304] 0 2024-09-21T11:39:10.544 INFO:tasks.workunit.client.0.smithi118.stdout:6/93: dread d8/f13 [0,4194304] 0 2024-09-21T11:39:10.544 INFO:tasks.workunit.client.0.smithi118.stdout:4/52: dwrite d2/f12 [0,4194304] 0 2024-09-21T11:39:10.545 INFO:tasks.workunit.client.1.smithi149.stdout:2/511: readlink d8/da/d13/d1a/d3b/l42 0 2024-09-21T11:39:10.547 INFO:tasks.workunit.client.1.smithi149.stdout:7/553: dwrite d12/f74 [0,4194304] 0 2024-09-21T11:39:10.547 INFO:tasks.workunit.client.1.smithi149.stdout:6/383: rename d8/da/d2c/l35 to d8/d32/d37/d28/l77 0 2024-09-21T11:39:10.548 INFO:tasks.workunit.client.0.smithi118.stdout:9/63: rmdir d0/d4 39 2024-09-21T11:39:10.551 INFO:tasks.workunit.client.0.smithi118.stdout:0/125: dwrite d5/d10/d1e/d20/f26 [0,4194304] 0 2024-09-21T11:39:10.556 INFO:tasks.workunit.client.1.smithi149.stdout:6/384: stat d8/da 0 2024-09-21T11:39:10.556 INFO:tasks.workunit.client.1.smithi149.stdout:3/442: symlink d6/d79/l9f 0 2024-09-21T11:39:10.556 INFO:tasks.workunit.client.1.smithi149.stdout:6/385: stat d8/d32/d37/d28/d2f/d6a 0 2024-09-21T11:39:10.558 INFO:tasks.workunit.client.1.smithi149.stdout:0/378: mkdir dd/d1a/d1b/d72/d87 0 2024-09-21T11:39:10.558 INFO:tasks.workunit.client.1.smithi149.stdout:6/386: write d8/d32/d37/d2b/d51/f5a [246362,17583] 0 2024-09-21T11:39:10.560 INFO:tasks.workunit.client.1.smithi149.stdout:0/379: fsync dd/d2d/f4b 0 2024-09-21T11:39:10.564 INFO:tasks.workunit.client.0.smithi118.stdout:9/64: stat d0/d4/la 0 2024-09-21T11:39:10.568 INFO:tasks.workunit.client.0.smithi118.stdout:4/53: creat d2/d6/de/f16 x:0 0 0 2024-09-21T11:39:10.568 INFO:tasks.workunit.client.1.smithi149.stdout:1/413: symlink d2/d2b/d6e/l80 0 2024-09-21T11:39:10.570 INFO:tasks.workunit.client.1.smithi149.stdout:2/512: mkdir d8/da/d13/d5d/da0/db8 0 2024-09-21T11:39:10.572 INFO:tasks.workunit.client.1.smithi149.stdout:2/513: dread d8/d44/d63/f75 [0,4194304] 0 2024-09-21T11:39:10.572 INFO:tasks.workunit.client.0.smithi118.stdout:0/126: mkdir d5/d29 0 2024-09-21T11:39:10.573 INFO:tasks.workunit.client.1.smithi149.stdout:7/554: creat d12/d90/d26/d30/fa6 x:0 0 0 2024-09-21T11:39:10.573 INFO:tasks.workunit.client.1.smithi149.stdout:7/555: fdatasync d12/f66 0 2024-09-21T11:39:10.574 INFO:tasks.workunit.client.1.smithi149.stdout:9/440: getdents d18/d4c 0 2024-09-21T11:39:10.575 INFO:tasks.workunit.client.1.smithi149.stdout:3/443: mknod d6/d1f/d47/d37/d3f/ca0 0 2024-09-21T11:39:10.578 INFO:tasks.workunit.client.1.smithi149.stdout:6/387: symlink d8/d32/d64/l78 0 2024-09-21T11:39:10.579 INFO:tasks.workunit.client.0.smithi118.stdout:0/127: write d5/f15 [1052892,121429] 0 2024-09-21T11:39:10.583 INFO:tasks.workunit.client.0.smithi118.stdout:4/54: write d2/d6/dd/f15 [2937803,51864] 0 2024-09-21T11:39:10.583 INFO:tasks.workunit.client.1.smithi149.stdout:8/394: link d3/dd/d3a/c5d d3/d12/c84 0 2024-09-21T11:39:10.584 INFO:tasks.workunit.client.0.smithi118.stdout:6/94: getdents d8 0 2024-09-21T11:39:10.585 INFO:tasks.workunit.client.0.smithi118.stdout:9/65: rename d0/d4/c7 to d0/c1a 0 2024-09-21T11:39:10.588 INFO:tasks.workunit.client.1.smithi149.stdout:5/497: rename d4/d7/d40/d43/d49/c73 to d4/d1d/d3e/ca1 0 2024-09-21T11:39:10.589 INFO:tasks.workunit.client.0.smithi118.stdout:6/95: symlink d8/d14/l21 0 2024-09-21T11:39:10.589 INFO:tasks.workunit.client.0.smithi118.stdout:0/128: dwrite d5/d10/d1e/d23/f25 [0,4194304] 0 2024-09-21T11:39:10.589 INFO:tasks.workunit.client.1.smithi149.stdout:2/514: chown c5 74404727 1 2024-09-21T11:39:10.590 INFO:tasks.workunit.client.1.smithi149.stdout:2/515: write d8/d20/d57/f6c [133800,81426] 0 2024-09-21T11:39:10.595 INFO:tasks.workunit.client.1.smithi149.stdout:3/444: creat d6/d1f/d47/d37/d3f/fa1 x:0 0 0 2024-09-21T11:39:10.595 INFO:tasks.workunit.client.0.smithi118.stdout:6/96: write d8/f13 [700030,68052] 0 2024-09-21T11:39:10.595 INFO:tasks.workunit.client.0.smithi118.stdout:0/129: dread d5/d10/d1e/d23/f25 [0,4194304] 0 2024-09-21T11:39:10.597 INFO:tasks.workunit.client.1.smithi149.stdout:6/388: mkdir d8/d32/d37/d79 0 2024-09-21T11:39:10.598 INFO:tasks.workunit.client.1.smithi149.stdout:0/380: creat dd/d6a/f88 x:0 0 0 2024-09-21T11:39:10.600 INFO:tasks.workunit.client.1.smithi149.stdout:0/381: write dd/d1a/d1b/f27 [4172551,107674] 0 2024-09-21T11:39:10.604 INFO:tasks.workunit.client.1.smithi149.stdout:8/395: mknod d3/d12/c85 0 2024-09-21T11:39:10.605 INFO:tasks.workunit.client.0.smithi118.stdout:6/97: creat d8/f22 x:0 0 0 2024-09-21T11:39:10.606 INFO:tasks.workunit.client.1.smithi149.stdout:1/414: creat d2/dd/d35/d1c/d7a/f81 x:0 0 0 2024-09-21T11:39:10.607 INFO:tasks.workunit.client.0.smithi118.stdout:0/130: write d5/f11 [4295085,44713] 0 2024-09-21T11:39:10.611 INFO:tasks.workunit.client.1.smithi149.stdout:4/497: rename d4/d6/d63/d15/d16/d23/d5d to d4/d6/d63/d15/d30/d6b/db3 0 2024-09-21T11:39:10.612 INFO:tasks.workunit.client.1.smithi149.stdout:1/415: dwrite d2/d2b/d6e/f76 [0,4194304] 0 2024-09-21T11:39:10.612 INFO:tasks.workunit.client.0.smithi118.stdout:6/98: creat d8/d14/f23 x:0 0 0 2024-09-21T11:39:10.615 INFO:tasks.workunit.client.0.smithi118.stdout:0/131: mkdir d5/d10/d1e/d21/d2a 0 2024-09-21T11:39:10.616 INFO:tasks.workunit.client.1.smithi149.stdout:3/445: dread - d6/d1f/f54 zero size 2024-09-21T11:39:10.616 INFO:tasks.workunit.client.0.smithi118.stdout:4/55: getdents d2/d6/dd 0 2024-09-21T11:39:10.617 INFO:tasks.workunit.client.0.smithi118.stdout:9/66: link d0/d4/la d0/l1b 0 2024-09-21T11:39:10.619 INFO:tasks.workunit.client.0.smithi118.stdout:4/56: write d2/d6/de/f10 [3419543,39760] 0 2024-09-21T11:39:10.622 INFO:tasks.workunit.client.0.smithi118.stdout:6/99: dwrite d8/fa [8388608,4194304] 0 2024-09-21T11:39:10.623 INFO:tasks.workunit.client.0.smithi118.stdout:6/100: chown d8/d14/f23 3197 1 2024-09-21T11:39:10.623 INFO:tasks.workunit.client.0.smithi118.stdout:0/132: creat d5/d10/d1e/d20/f2b x:0 0 0 2024-09-21T11:39:10.629 INFO:tasks.workunit.client.1.smithi149.stdout:5/498: creat d4/d1d/d50/d54/d2a/fa2 x:0 0 0 2024-09-21T11:39:10.631 INFO:tasks.workunit.client.0.smithi118.stdout:4/57: unlink d2/f12 0 2024-09-21T11:39:10.634 INFO:tasks.workunit.client.1.smithi149.stdout:2/516: rename d8/da/d13/d1a/d2c to d8/d44/d63/db9 0 2024-09-21T11:39:10.636 INFO:tasks.workunit.client.1.smithi149.stdout:4/498: mkdir d4/d4d/d58/db4 0 2024-09-21T11:39:10.638 INFO:tasks.workunit.client.1.smithi149.stdout:1/416: creat d2/dd/d35/d5b/f82 x:0 0 0 2024-09-21T11:39:10.638 INFO:tasks.workunit.client.1.smithi149.stdout:1/417: fdatasync d2/f60 0 2024-09-21T11:39:10.640 INFO:tasks.workunit.client.1.smithi149.stdout:9/441: rmdir d18/d19/d1a/d2f/d5f/d7a 0 2024-09-21T11:39:10.640 INFO:tasks.workunit.client.1.smithi149.stdout:6/389: mknod d8/da/c7a 0 2024-09-21T11:39:10.641 INFO:tasks.workunit.client.0.smithi118.stdout:0/133: symlink d5/d29/l2c 0 2024-09-21T11:39:10.642 INFO:tasks.workunit.client.1.smithi149.stdout:6/390: truncate d8/da/d2c/d52/d5e/f67 438987 0 2024-09-21T11:39:10.642 INFO:tasks.workunit.client.0.smithi118.stdout:0/134: chown d5/d10/d1e/d20/f2b 158360181 1 2024-09-21T11:39:10.642 INFO:tasks.workunit.client.1.smithi149.stdout:6/391: fsync d8/da/fd 0 2024-09-21T11:39:10.643 INFO:tasks.workunit.client.1.smithi149.stdout:6/392: dread d8/da/d2c/d52/d5e/f67 [0,4194304] 0 2024-09-21T11:39:10.644 INFO:tasks.workunit.client.0.smithi118.stdout:9/67: rename d0/d4/ff to d0/f1c 0 2024-09-21T11:39:10.645 INFO:tasks.workunit.client.1.smithi149.stdout:0/382: creat dd/d35/d70/f89 x:0 0 0 2024-09-21T11:39:10.646 INFO:tasks.workunit.client.0.smithi118.stdout:0/135: stat d5/d10/c1c 0 2024-09-21T11:39:10.647 INFO:tasks.workunit.client.1.smithi149.stdout:8/396: fdatasync d3/dd/f6a 0 2024-09-21T11:39:10.649 INFO:tasks.workunit.client.1.smithi149.stdout:8/397: dread d3/dd/d21/d54/d5c/f6b [0,4194304] 0 2024-09-21T11:39:10.649 INFO:tasks.workunit.client.0.smithi118.stdout:4/58: write d2/f13 [4825524,126100] 0 2024-09-21T11:39:10.652 INFO:tasks.workunit.client.0.smithi118.stdout:0/136: write d5/d10/d1e/d23/f25 [4226839,110370] 0 2024-09-21T11:39:10.653 INFO:tasks.workunit.client.0.smithi118.stdout:9/68: dwrite d0/d4/f18 [0,4194304] 0 2024-09-21T11:39:10.654 INFO:tasks.workunit.client.0.smithi118.stdout:0/137: fsync d5/d10/d1e/d20/f26 0 2024-09-21T11:39:10.661 INFO:tasks.workunit.client.0.smithi118.stdout:0/138: creat d5/d10/d1e/d21/f2d x:0 0 0 2024-09-21T11:39:10.662 INFO:tasks.workunit.client.0.smithi118.stdout:0/139: chown d5/d10/c1c 1113 1 2024-09-21T11:39:10.662 INFO:tasks.workunit.client.0.smithi118.stdout:9/69: truncate d0/d4/f8 498912 0 2024-09-21T11:39:10.664 INFO:tasks.workunit.client.1.smithi149.stdout:7/556: getdents d12/d90/d26 0 2024-09-21T11:39:10.665 INFO:tasks.workunit.client.1.smithi149.stdout:2/517: unlink d8/da/f2a 0 2024-09-21T11:39:10.668 INFO:tasks.workunit.client.1.smithi149.stdout:4/499: dread d4/d6/d18/f2a [0,4194304] 0 2024-09-21T11:39:10.671 INFO:tasks.workunit.client.1.smithi149.stdout:1/418: symlink d2/d5/d8/d3b/l83 0 2024-09-21T11:39:10.674 INFO:tasks.workunit.client.0.smithi118.stdout:9/70: rename d0/c1a to d0/d4/c1d 0 2024-09-21T11:39:10.675 INFO:tasks.workunit.client.1.smithi149.stdout:3/446: mknod d6/d1f/d47/ca2 0 2024-09-21T11:39:10.676 INFO:tasks.workunit.client.0.smithi118.stdout:4/59: truncate d2/d6/de/f10 3608815 0 2024-09-21T11:39:10.676 INFO:tasks.workunit.client.1.smithi149.stdout:3/447: stat d6/d1f/d47/f84 0 2024-09-21T11:39:10.676 INFO:tasks.workunit.client.1.smithi149.stdout:1/419: dwrite d2/dd/d35/d1c/f23 [0,4194304] 0 2024-09-21T11:39:10.677 INFO:tasks.workunit.client.1.smithi149.stdout:1/420: dread - d2/d5/d8/d3b/f63 zero size 2024-09-21T11:39:10.679 INFO:tasks.workunit.client.1.smithi149.stdout:6/393: symlink d8/da/d2c/d52/d5e/d69/l7b 0 2024-09-21T11:39:10.681 INFO:tasks.workunit.client.1.smithi149.stdout:0/383: mkdir dd/d1a/d5a/d8a 0 2024-09-21T11:39:10.681 INFO:tasks.workunit.client.0.smithi118.stdout:0/140: dwrite d5/d10/f14 [0,4194304] 0 2024-09-21T11:39:10.682 INFO:tasks.workunit.client.0.smithi118.stdout:4/60: dread - d2/f7 zero size 2024-09-21T11:39:10.684 INFO:tasks.workunit.client.1.smithi149.stdout:8/398: symlink d3/d3c/d4c/l86 0 2024-09-21T11:39:10.687 INFO:tasks.workunit.client.0.smithi118.stdout:9/71: dwrite d0/fb [0,4194304] 0 2024-09-21T11:39:10.693 INFO:tasks.workunit.client.1.smithi149.stdout:7/557: mknod d12/ca7 0 2024-09-21T11:39:10.694 INFO:tasks.workunit.client.1.smithi149.stdout:2/518: rmdir d8/dd/d50 39 2024-09-21T11:39:10.699 INFO:tasks.workunit.client.1.smithi149.stdout:4/500: unlink d4/l67 0 2024-09-21T11:39:10.704 INFO:tasks.workunit.client.1.smithi149.stdout:3/448: unlink d6/d1f/d47/f80 0 2024-09-21T11:39:10.707 INFO:tasks.workunit.client.0.smithi118.stdout:0/141: truncate d5/f17 3583895 0 2024-09-21T11:39:10.708 INFO:tasks.workunit.client.0.smithi118.stdout:0/142: dread - d5/d10/d1e/d20/f2b zero size 2024-09-21T11:39:10.708 INFO:tasks.workunit.client.1.smithi149.stdout:6/394: write f4 [5117877,47927] 0 2024-09-21T11:39:10.709 INFO:tasks.workunit.client.0.smithi118.stdout:9/72: truncate d0/f5 10294216 0 2024-09-21T11:39:10.711 INFO:tasks.workunit.client.1.smithi149.stdout:1/421: dwrite d2/f13 [4194304,4194304] 0 2024-09-21T11:39:10.711 INFO:tasks.workunit.client.0.smithi118.stdout:9/73: chown d0/c19 244281229 1 2024-09-21T11:39:10.712 INFO:tasks.workunit.client.1.smithi149.stdout:1/422: readlink d2/d5/d8/l4a 0 2024-09-21T11:39:10.715 INFO:tasks.workunit.client.1.smithi149.stdout:9/442: sync 2024-09-21T11:39:10.717 INFO:tasks.workunit.client.0.smithi118.stdout:4/61: dread d2/f4 [0,4194304] 0 2024-09-21T11:39:10.718 INFO:tasks.workunit.client.0.smithi118.stdout:9/74: mknod d0/d4/c1e 0 2024-09-21T11:39:10.722 INFO:tasks.workunit.client.0.smithi118.stdout:9/75: creat d0/d4/f1f x:0 0 0 2024-09-21T11:39:10.722 INFO:tasks.workunit.client.1.smithi149.stdout:4/501: fsync d4/d6/f8f 0 2024-09-21T11:39:10.723 INFO:tasks.workunit.client.0.smithi118.stdout:4/62: symlink d2/d6/dd/l17 0 2024-09-21T11:39:10.724 INFO:tasks.workunit.client.0.smithi118.stdout:0/143: getdents d5/d29 0 2024-09-21T11:39:10.726 INFO:tasks.workunit.client.1.smithi149.stdout:0/384: mkdir dd/d1a/d1b/d72/d78/d8b 0 2024-09-21T11:39:10.726 INFO:tasks.workunit.client.0.smithi118.stdout:9/76: rmdir d0/d4 39 2024-09-21T11:39:10.727 INFO:tasks.workunit.client.1.smithi149.stdout:5/499: getdents d4/d1d/d3e 0 2024-09-21T11:39:10.728 INFO:tasks.workunit.client.1.smithi149.stdout:1/423: mknod d2/dd/d2e/d4c/c84 0 2024-09-21T11:39:10.730 INFO:tasks.workunit.client.1.smithi149.stdout:9/443: write d18/d19/d1a/f2d [648726,55132] 0 2024-09-21T11:39:10.730 INFO:tasks.workunit.client.1.smithi149.stdout:1/424: read d2/dd/d2e/f33 [3747641,4660] 0 2024-09-21T11:39:10.732 INFO:tasks.workunit.client.1.smithi149.stdout:2/519: mknod d8/cba 0 2024-09-21T11:39:10.732 INFO:tasks.workunit.client.0.smithi118.stdout:0/144: dwrite d5/f13 [0,4194304] 0 2024-09-21T11:39:10.735 INFO:tasks.workunit.client.0.smithi118.stdout:4/63: creat d2/d6/f18 x:0 0 0 2024-09-21T11:39:10.736 INFO:tasks.workunit.client.1.smithi149.stdout:8/399: rename d3/d33/d34/d55/c7c to d3/d3c/c87 0 2024-09-21T11:39:10.738 INFO:tasks.workunit.client.1.smithi149.stdout:5/500: symlink d4/d4f/la3 0 2024-09-21T11:39:10.739 INFO:tasks.workunit.client.0.smithi118.stdout:9/77: dwrite d0/d4/f18 [0,4194304] 0 2024-09-21T11:39:10.745 INFO:tasks.workunit.client.1.smithi149.stdout:9/444: symlink d18/d36/d3c/d47/d76/l8e 0 2024-09-21T11:39:10.746 INFO:tasks.workunit.client.0.smithi118.stdout:9/78: chown d0/f5 18 1 2024-09-21T11:39:10.746 INFO:tasks.workunit.client.0.smithi118.stdout:4/64: truncate f1 1577717 0 2024-09-21T11:39:10.751 INFO:tasks.workunit.client.1.smithi149.stdout:3/449: creat d6/d1f/d47/fa3 x:0 0 0 2024-09-21T11:39:10.754 INFO:tasks.workunit.client.0.smithi118.stdout:4/65: dwrite d2/d6/dd/f15 [4194304,4194304] 0 2024-09-21T11:39:10.755 INFO:tasks.workunit.client.1.smithi149.stdout:6/395: rename d8/da/d11/c22 to d8/d32/d37/d28/d2e/c7c 0 2024-09-21T11:39:10.755 INFO:tasks.workunit.client.0.smithi118.stdout:4/66: write d2/d6/dd/f15 [1771540,96520] 0 2024-09-21T11:39:10.757 INFO:tasks.workunit.client.0.smithi118.stdout:0/145: link d5/l16 d5/d10/d1e/d23/l2e 0 2024-09-21T11:39:10.760 INFO:tasks.workunit.client.0.smithi118.stdout:9/79: mkdir d0/d20 0 2024-09-21T11:39:10.760 INFO:tasks.workunit.client.0.smithi118.stdout:9/80: stat d0/c19 0 2024-09-21T11:39:10.760 INFO:tasks.workunit.client.1.smithi149.stdout:4/502: truncate d4/d6/fb 1069096 0 2024-09-21T11:39:10.761 INFO:tasks.workunit.client.0.smithi118.stdout:9/81: fsync d0/f13 0 2024-09-21T11:39:10.762 INFO:tasks.workunit.client.1.smithi149.stdout:7/558: getdents d12/d90/d4a/d4f/d75/d94 0 2024-09-21T11:39:10.764 INFO:tasks.workunit.client.0.smithi118.stdout:4/67: rename d2/l3 to d2/d6/de/l19 0 2024-09-21T11:39:10.765 INFO:tasks.workunit.client.0.smithi118.stdout:9/82: dread d0/fc [0,4194304] 0 2024-09-21T11:39:10.767 INFO:tasks.workunit.client.1.smithi149.stdout:3/450: write d6/f38 [2315698,95439] 0 2024-09-21T11:39:10.768 INFO:tasks.workunit.client.1.smithi149.stdout:0/385: rename dd/d35/d70 to dd/d1a/d1b/d72/d85/d8c 0 2024-09-21T11:39:10.769 INFO:tasks.workunit.client.1.smithi149.stdout:0/386: write dd/d1a/f2f [2615093,11556] 0 2024-09-21T11:39:10.772 INFO:tasks.workunit.client.0.smithi118.stdout:2/20: sync 2024-09-21T11:39:10.774 INFO:tasks.workunit.client.1.smithi149.stdout:6/396: mkdir d8/d32/d37/d2b/d7d 0 2024-09-21T11:39:10.775 INFO:tasks.workunit.client.1.smithi149.stdout:0/387: dread dd/d1a/d1b/d50/d53/f54 [0,4194304] 0 2024-09-21T11:39:10.776 INFO:tasks.workunit.client.1.smithi149.stdout:8/400: mknod d3/dd/c88 0 2024-09-21T11:39:10.776 INFO:tasks.workunit.client.1.smithi149.stdout:8/401: stat d3/dd/c77 0 2024-09-21T11:39:10.779 INFO:tasks.workunit.client.0.smithi118.stdout:9/83: rename d0 to d0/d21 22 2024-09-21T11:39:10.781 INFO:tasks.workunit.client.1.smithi149.stdout:0/388: dwrite dd/d1a/f2f [0,4194304] 0 2024-09-21T11:39:10.782 INFO:tasks.workunit.client.0.smithi118.stdout:0/146: link d5/f13 d5/d10/d1e/d20/f2f 0 2024-09-21T11:39:10.783 INFO:tasks.workunit.client.0.smithi118.stdout:2/21: dread f0 [0,4194304] 0 2024-09-21T11:39:10.784 INFO:tasks.workunit.client.1.smithi149.stdout:0/389: chown dd/d1a/d1b/d50/f57 0 1 2024-09-21T11:39:10.784 INFO:tasks.workunit.client.0.smithi118.stdout:2/22: stat f2 0 2024-09-21T11:39:10.785 INFO:tasks.workunit.client.1.smithi149.stdout:8/402: dwrite d3/dd/d18/f7e [0,4194304] 0 2024-09-21T11:39:10.786 INFO:tasks.workunit.client.0.smithi118.stdout:0/147: chown d5/c6 110827991 1 2024-09-21T11:39:10.787 INFO:tasks.workunit.client.0.smithi118.stdout:0/148: fsync d5/d10/f14 0 2024-09-21T11:39:10.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/403: chown d3/dd/d21/d54 48391197 1 2024-09-21T11:39:10.788 INFO:tasks.workunit.client.0.smithi118.stdout:2/23: mknod c5 0 2024-09-21T11:39:10.789 INFO:tasks.workunit.client.1.smithi149.stdout:3/451: creat d6/d79/fa4 x:0 0 0 2024-09-21T11:39:10.790 INFO:tasks.workunit.client.1.smithi149.stdout:3/452: stat d6/d1f/d47/d37/d50/f78 0 2024-09-21T11:39:10.790 INFO:tasks.workunit.client.1.smithi149.stdout:2/520: rename d8/da/d13/d5d/d6a/ca8 to d8/da/d13/d5d/da0/cbb 0 2024-09-21T11:39:10.791 INFO:tasks.workunit.client.0.smithi118.stdout:4/68: link d2/d6/la d2/d6/dd/l1a 0 2024-09-21T11:39:10.791 INFO:tasks.workunit.client.1.smithi149.stdout:3/453: chown d6/d1f/d4c 20467 1 2024-09-21T11:39:10.793 INFO:tasks.workunit.client.1.smithi149.stdout:2/521: truncate d8/dd/f5f 1025107 0 2024-09-21T11:39:10.794 INFO:tasks.workunit.client.1.smithi149.stdout:2/522: chown d8/dd/f2b 3 1 2024-09-21T11:39:10.794 INFO:tasks.workunit.client.1.smithi149.stdout:0/390: dwrite dd/d1a/d1b/f27 [0,4194304] 0 2024-09-21T11:39:10.795 INFO:tasks.workunit.client.0.smithi118.stdout:9/84: rename d0/d4/la to d0/d20/l22 0 2024-09-21T11:39:10.795 INFO:tasks.workunit.client.1.smithi149.stdout:2/523: write d8/da/d13/d53/f87 [697560,51664] 0 2024-09-21T11:39:10.795 INFO:tasks.workunit.client.0.smithi118.stdout:0/149: dwrite d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:10.797 INFO:tasks.workunit.client.0.smithi118.stdout:2/24: dread f3 [0,4194304] 0 2024-09-21T11:39:10.798 INFO:tasks.workunit.client.0.smithi118.stdout:2/25: read f3 [3941396,22381] 0 2024-09-21T11:39:10.802 INFO:tasks.workunit.client.1.smithi149.stdout:9/445: truncate d18/d19/d1a/d2f/f3d 3703156 0 2024-09-21T11:39:10.803 INFO:tasks.workunit.client.1.smithi149.stdout:6/397: mkdir d8/d32/d37/d2b/d7e 0 2024-09-21T11:39:10.808 INFO:tasks.workunit.client.0.smithi118.stdout:4/69: creat d2/f1b x:0 0 0 2024-09-21T11:39:10.810 INFO:tasks.workunit.client.0.smithi118.stdout:4/70: write d2/d6/de/f16 [816463,114189] 0 2024-09-21T11:39:10.814 INFO:tasks.workunit.client.0.smithi118.stdout:9/85: dread d0/d4/f8 [0,4194304] 0 2024-09-21T11:39:10.816 INFO:tasks.workunit.client.0.smithi118.stdout:9/86: write d0/d4/f15 [986347,112331] 0 2024-09-21T11:39:10.816 INFO:tasks.workunit.client.0.smithi118.stdout:0/150: symlink d5/d10/d1e/d21/l30 0 2024-09-21T11:39:10.821 INFO:tasks.workunit.client.1.smithi149.stdout:8/404: rmdir d3/dd/d18/d2e 39 2024-09-21T11:39:10.821 INFO:tasks.workunit.client.1.smithi149.stdout:2/524: dread d8/d44/d63/db9/f27 [0,4194304] 0 2024-09-21T11:39:10.822 INFO:tasks.workunit.client.0.smithi118.stdout:4/71: mkdir d2/d6/de/d1c 0 2024-09-21T11:39:10.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/454: mknod d6/d79/d7e/ca5 0 2024-09-21T11:39:10.826 INFO:tasks.workunit.client.0.smithi118.stdout:2/26: write f2 [941394,90354] 0 2024-09-21T11:39:10.830 INFO:tasks.workunit.client.1.smithi149.stdout:7/559: dwrite f1 [0,4194304] 0 2024-09-21T11:39:10.832 INFO:tasks.workunit.client.0.smithi118.stdout:9/87: dwrite d0/fc [4194304,4194304] 0 2024-09-21T11:39:10.832 INFO:tasks.workunit.client.1.smithi149.stdout:5/501: link d4/d1d/l3d d4/la4 0 2024-09-21T11:39:10.834 INFO:tasks.workunit.client.0.smithi118.stdout:2/27: rename f2 to f6 0 2024-09-21T11:39:10.835 INFO:tasks.workunit.client.1.smithi149.stdout:4/503: link d4/d6/d63/le d4/d6/d18/lb5 0 2024-09-21T11:39:10.836 INFO:tasks.workunit.client.1.smithi149.stdout:9/446: dread d18/d19/d1a/d2f/d5f/f80 [0,4194304] 0 2024-09-21T11:39:10.838 INFO:tasks.workunit.client.0.smithi118.stdout:4/72: rename d2/d6/la to d2/d6/dd/l1d 0 2024-09-21T11:39:10.839 INFO:tasks.workunit.client.0.smithi118.stdout:9/88: dread d0/d4/f15 [0,4194304] 0 2024-09-21T11:39:10.839 INFO:tasks.workunit.client.0.smithi118.stdout:4/73: chown d2 136863 1 2024-09-21T11:39:10.844 INFO:tasks.workunit.client.1.smithi149.stdout:2/525: dread d8/da/d13/f7e [0,4194304] 0 2024-09-21T11:39:10.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/455: rename d6/d1f/d47/d37/c41 to d6/d5f/d6d/ca6 0 2024-09-21T11:39:10.846 INFO:tasks.workunit.client.0.smithi118.stdout:2/28: write f6 [1341556,13977] 0 2024-09-21T11:39:10.847 INFO:tasks.workunit.client.0.smithi118.stdout:9/89: mkdir d0/d4/d23 0 2024-09-21T11:39:10.848 INFO:tasks.workunit.client.1.smithi149.stdout:6/398: creat d8/d32/d37/d28/d2f/d6a/d72/f7f x:0 0 0 2024-09-21T11:39:10.848 INFO:tasks.workunit.client.0.smithi118.stdout:0/151: dwrite d5/f17 [0,4194304] 0 2024-09-21T11:39:10.849 INFO:tasks.workunit.client.0.smithi118.stdout:4/74: creat d2/d6/de/f1e x:0 0 0 2024-09-21T11:39:10.850 INFO:tasks.workunit.client.0.smithi118.stdout:0/152: write d5/d10/f28 [61613,70924] 0 2024-09-21T11:39:10.851 INFO:tasks.workunit.client.1.smithi149.stdout:5/502: chown d4/d1d/d50/d54/l37 656285 1 2024-09-21T11:39:10.853 INFO:tasks.workunit.client.0.smithi118.stdout:2/29: creat f7 x:0 0 0 2024-09-21T11:39:10.853 INFO:tasks.workunit.client.1.smithi149.stdout:4/504: symlink d4/d6/d63/d78/d98/lb6 0 2024-09-21T11:39:10.854 INFO:tasks.workunit.client.0.smithi118.stdout:4/75: symlink d2/d6/dd/l1f 0 2024-09-21T11:39:10.857 INFO:tasks.workunit.client.1.smithi149.stdout:1/425: sync 2024-09-21T11:39:10.857 INFO:tasks.workunit.client.1.smithi149.stdout:3/456: creat d6/d1f/d47/d37/d3f/fa7 x:0 0 0 2024-09-21T11:39:10.858 INFO:tasks.workunit.client.0.smithi118.stdout:0/153: dwrite d5/d10/d1e/f27 [0,4194304] 0 2024-09-21T11:39:10.861 INFO:tasks.workunit.client.0.smithi118.stdout:9/90: link d0/d4/f1f d0/f24 0 2024-09-21T11:39:10.861 INFO:tasks.workunit.client.0.smithi118.stdout:2/30: dread f3 [0,4194304] 0 2024-09-21T11:39:10.862 INFO:tasks.workunit.client.1.smithi149.stdout:7/560: fsync d12/d90/d26/d30/f34 0 2024-09-21T11:39:10.862 INFO:tasks.workunit.client.0.smithi118.stdout:9/91: truncate d0/f24 783556 0 2024-09-21T11:39:10.863 INFO:tasks.workunit.client.1.smithi149.stdout:6/399: rename d8/d32/c75 to d8/da/d2c/d6d/c80 0 2024-09-21T11:39:10.865 INFO:tasks.workunit.client.0.smithi118.stdout:0/154: symlink d5/d10/d1e/d20/l31 0 2024-09-21T11:39:10.867 INFO:tasks.workunit.client.0.smithi118.stdout:2/31: unlink f7 0 2024-09-21T11:39:10.871 INFO:tasks.workunit.client.1.smithi149.stdout:8/405: creat d3/d3c/f89 x:0 0 0 2024-09-21T11:39:10.872 INFO:tasks.workunit.client.0.smithi118.stdout:9/92: dwrite d0/d4/f18 [0,4194304] 0 2024-09-21T11:39:10.872 INFO:tasks.workunit.client.1.smithi149.stdout:2/526: symlink d8/d11/dac/lbc 0 2024-09-21T11:39:10.873 INFO:tasks.workunit.client.1.smithi149.stdout:2/527: chown d8/d44/d63/db9/f41 1695 1 2024-09-21T11:39:10.874 INFO:tasks.workunit.client.0.smithi118.stdout:9/93: chown d0/f1 15531 1 2024-09-21T11:39:10.876 INFO:tasks.workunit.client.0.smithi118.stdout:2/32: dwrite f6 [0,4194304] 0 2024-09-21T11:39:10.877 INFO:tasks.workunit.client.0.smithi118.stdout:9/94: dread d0/d4/f8 [0,4194304] 0 2024-09-21T11:39:10.877 INFO:tasks.workunit.client.0.smithi118.stdout:2/33: read f3 [3832362,103611] 0 2024-09-21T11:39:10.885 INFO:tasks.workunit.client.1.smithi149.stdout:6/400: dread d8/da/fc [0,4194304] 0 2024-09-21T11:39:10.885 INFO:tasks.workunit.client.0.smithi118.stdout:4/76: creat d2/d6/f20 x:0 0 0 2024-09-21T11:39:10.886 INFO:tasks.workunit.client.0.smithi118.stdout:4/77: dread - d2/f1b zero size 2024-09-21T11:39:10.887 INFO:tasks.workunit.client.1.smithi149.stdout:7/561: dread d12/d90/d4a/d4f/d75/f77 [0,4194304] 0 2024-09-21T11:39:10.887 INFO:tasks.workunit.client.0.smithi118.stdout:2/34: creat f8 x:0 0 0 2024-09-21T11:39:10.888 INFO:tasks.workunit.client.1.smithi149.stdout:7/562: read - d12/d90/d4a/d6c/d8c/fa2 zero size 2024-09-21T11:39:10.888 INFO:tasks.workunit.client.1.smithi149.stdout:5/503: creat d4/d1d/d3e/d9a/fa5 x:0 0 0 2024-09-21T11:39:10.893 INFO:tasks.workunit.client.0.smithi118.stdout:0/155: link d5/f11 d5/d10/d1e/d20/f32 0 2024-09-21T11:39:10.893 INFO:tasks.workunit.client.0.smithi118.stdout:0/156: read d5/f11 [1577929,125561] 0 2024-09-21T11:39:10.895 INFO:tasks.workunit.client.0.smithi118.stdout:0/157: truncate d5/d10/d1e/d21/f24 519400 0 2024-09-21T11:39:10.895 INFO:tasks.workunit.client.0.smithi118.stdout:4/78: truncate d2/f7 923364 0 2024-09-21T11:39:10.897 INFO:tasks.workunit.client.1.smithi149.stdout:4/505: mknod d4/d6/d63/d15/d16/d23/cb7 0 2024-09-21T11:39:10.898 INFO:tasks.workunit.client.0.smithi118.stdout:2/35: symlink l9 0 2024-09-21T11:39:10.900 INFO:tasks.workunit.client.1.smithi149.stdout:8/406: write d3/dd/d18/d2e/d80/f81 [102141,87552] 0 2024-09-21T11:39:10.902 INFO:tasks.workunit.client.1.smithi149.stdout:2/528: creat d8/d20/d57/fbd x:0 0 0 2024-09-21T11:39:10.902 INFO:tasks.workunit.client.1.smithi149.stdout:2/529: truncate d8/d20/fb0 561305 0 2024-09-21T11:39:10.904 INFO:tasks.workunit.client.0.smithi118.stdout:0/158: dwrite d5/d10/f28 [0,4194304] 0 2024-09-21T11:39:10.904 INFO:tasks.workunit.client.0.smithi118.stdout:4/79: dwrite d2/d6/dd/f15 [8388608,4194304] 0 2024-09-21T11:39:10.906 INFO:tasks.workunit.client.0.smithi118.stdout:2/36: mknod ca 0 2024-09-21T11:39:10.908 INFO:tasks.workunit.client.0.smithi118.stdout:4/80: readlink d2/d6/dd/l1a 0 2024-09-21T11:39:10.911 INFO:tasks.workunit.client.0.smithi118.stdout:0/159: mkdir d5/d10/d1e/d33 0 2024-09-21T11:39:10.914 INFO:tasks.workunit.client.0.smithi118.stdout:4/81: creat d2/f21 x:0 0 0 2024-09-21T11:39:10.914 INFO:tasks.workunit.client.1.smithi149.stdout:9/447: link d18/d19/d1a/d2f/d33/l78 d18/d19/d1a/l8f 0 2024-09-21T11:39:10.915 INFO:tasks.workunit.client.1.smithi149.stdout:9/448: write fc [292923,9351] 0 2024-09-21T11:39:10.917 INFO:tasks.workunit.client.1.smithi149.stdout:8/407: mknod d3/c8a 0 2024-09-21T11:39:10.917 INFO:tasks.workunit.client.0.smithi118.stdout:9/95: dwrite d0/f1 [8388608,4194304] 0 2024-09-21T11:39:10.917 INFO:tasks.workunit.client.1.smithi149.stdout:4/506: dread d4/d4d/d5f/f87 [0,4194304] 0 2024-09-21T11:39:10.919 INFO:tasks.workunit.client.1.smithi149.stdout:1/426: creat d2/d5/f85 x:0 0 0 2024-09-21T11:39:10.919 INFO:tasks.workunit.client.0.smithi118.stdout:0/160: mkdir d5/d34 0 2024-09-21T11:39:10.922 INFO:tasks.workunit.client.1.smithi149.stdout:2/530: dread d8/dd/f2b [0,4194304] 0 2024-09-21T11:39:10.923 INFO:tasks.workunit.client.0.smithi118.stdout:2/37: dwrite f0 [4194304,4194304] 0 2024-09-21T11:39:10.923 INFO:tasks.workunit.client.0.smithi118.stdout:0/161: chown d5/d10/d1e/d20/f2f 104 1 2024-09-21T11:39:10.924 INFO:tasks.workunit.client.1.smithi149.stdout:0/391: sync 2024-09-21T11:39:10.924 INFO:tasks.workunit.client.0.smithi118.stdout:2/38: chown f0 1 1 2024-09-21T11:39:10.924 INFO:tasks.workunit.client.1.smithi149.stdout:6/401: link d8/d32/d37/d28/f30 d8/da/d2c/d2d/d60/f81 0 2024-09-21T11:39:10.926 INFO:tasks.workunit.client.1.smithi149.stdout:7/563: mkdir d12/d90/d4a/d6c/da0/da8 0 2024-09-21T11:39:10.927 INFO:tasks.workunit.client.1.smithi149.stdout:0/392: fdatasync dd/d1a/d5a/f80 0 2024-09-21T11:39:10.928 INFO:tasks.workunit.client.1.smithi149.stdout:5/504: creat d4/d1d/d50/d54/d2a/d93/fa6 x:0 0 0 2024-09-21T11:39:10.929 INFO:tasks.workunit.client.0.smithi118.stdout:2/39: mknod cb 0 2024-09-21T11:39:10.931 INFO:tasks.workunit.client.0.smithi118.stdout:2/40: write f0 [99001,83827] 0 2024-09-21T11:39:10.932 INFO:tasks.workunit.client.1.smithi149.stdout:9/449: unlink d18/d36/f6d 0 2024-09-21T11:39:10.934 INFO:tasks.workunit.client.1.smithi149.stdout:4/507: dwrite d4/d6/d63/d15/d30/d6b/fb1 [0,4194304] 0 2024-09-21T11:39:10.934 INFO:tasks.workunit.client.1.smithi149.stdout:8/408: unlink d3/d3c/f89 0 2024-09-21T11:39:10.936 INFO:tasks.workunit.client.0.smithi118.stdout:4/82: rename d2/f1b to d2/d6/f22 0 2024-09-21T11:39:10.937 INFO:tasks.workunit.client.0.smithi118.stdout:4/83: read - d2/d6/f22 zero size 2024-09-21T11:39:10.939 INFO:tasks.workunit.client.0.smithi118.stdout:9/96: creat d0/f25 x:0 0 0 2024-09-21T11:39:10.940 INFO:tasks.workunit.client.1.smithi149.stdout:1/427: creat d2/d5/d65/f86 x:0 0 0 2024-09-21T11:39:10.944 INFO:tasks.workunit.client.1.smithi149.stdout:8/409: dwrite d3/dd/d18/f51 [0,4194304] 0 2024-09-21T11:39:10.946 INFO:tasks.workunit.client.0.smithi118.stdout:0/162: getdents d5/d10/d1e/d33 0 2024-09-21T11:39:10.948 INFO:tasks.workunit.client.1.smithi149.stdout:6/402: creat d8/d32/d37/d28/d2e/f82 x:0 0 0 2024-09-21T11:39:10.950 INFO:tasks.workunit.client.1.smithi149.stdout:0/393: mknod dd/d1a/d1b/d50/c8d 0 2024-09-21T11:39:10.953 INFO:tasks.workunit.client.1.smithi149.stdout:7/564: creat d12/d90/d4a/d4f/d75/d94/d47/d49/fa9 x:0 0 0 2024-09-21T11:39:10.955 INFO:tasks.workunit.client.1.smithi149.stdout:6/403: dread - d8/da/d14/f4c zero size 2024-09-21T11:39:10.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/505: rename d4/d1d/d50/d54/l37 to d4/d7/d40/d51/la7 0 2024-09-21T11:39:10.960 INFO:tasks.workunit.client.1.smithi149.stdout:5/506: stat d4/d7/d40/d43/d49 0 2024-09-21T11:39:10.960 INFO:tasks.workunit.client.1.smithi149.stdout:2/531: dwrite d8/da/d13/d5d/d6a/f8b [0,4194304] 0 2024-09-21T11:39:10.961 INFO:tasks.workunit.client.0.smithi118.stdout:4/84: mkdir d2/d6/de/d1c/d23 0 2024-09-21T11:39:10.962 INFO:tasks.workunit.client.1.smithi149.stdout:9/450: dread d18/d36/d3c/f3f [0,4194304] 0 2024-09-21T11:39:10.964 INFO:tasks.workunit.client.0.smithi118.stdout:2/41: link cb cc 0 2024-09-21T11:39:10.965 INFO:tasks.workunit.client.0.smithi118.stdout:2/42: chown c5 99746 1 2024-09-21T11:39:10.967 INFO:tasks.workunit.client.0.smithi118.stdout:0/163: unlink d5/c12 0 2024-09-21T11:39:10.968 INFO:tasks.workunit.client.1.smithi149.stdout:5/507: dread d4/d7/d40/d43/d5c/f66 [0,4194304] 0 2024-09-21T11:39:10.969 INFO:tasks.workunit.client.1.smithi149.stdout:9/451: fdatasync d18/d36/d3c/f77 0 2024-09-21T11:39:10.969 INFO:tasks.workunit.client.0.smithi118.stdout:4/85: creat d2/d6/de/f24 x:0 0 0 2024-09-21T11:39:10.972 INFO:tasks.workunit.client.0.smithi118.stdout:9/97: creat d0/f26 x:0 0 0 2024-09-21T11:39:10.972 INFO:tasks.workunit.client.0.smithi118.stdout:9/98: truncate d0/f26 81515 0 2024-09-21T11:39:10.974 INFO:tasks.workunit.client.1.smithi149.stdout:6/404: symlink d8/da/d14/l83 0 2024-09-21T11:39:10.974 INFO:tasks.workunit.client.1.smithi149.stdout:7/565: dwrite d12/d90/f17 [0,4194304] 0 2024-09-21T11:39:10.974 INFO:tasks.workunit.client.0.smithi118.stdout:2/43: symlink ld 0 2024-09-21T11:39:10.976 INFO:tasks.workunit.client.1.smithi149.stdout:1/428: dread d2/d5/f34 [0,4194304] 0 2024-09-21T11:39:10.976 INFO:tasks.workunit.client.1.smithi149.stdout:9/452: readlink d18/d19/d1a/d2f/d33/l51 0 2024-09-21T11:39:10.977 INFO:tasks.workunit.client.0.smithi118.stdout:0/164: chown d5/l1f 114 1 2024-09-21T11:39:10.978 INFO:tasks.workunit.client.1.smithi149.stdout:7/566: chown d12/d90/d4a/d4f/d75 719 1 2024-09-21T11:39:10.979 INFO:tasks.workunit.client.1.smithi149.stdout:2/532: dwrite d8/d20/f97 [0,4194304] 0 2024-09-21T11:39:10.980 INFO:tasks.workunit.client.1.smithi149.stdout:3/457: sync 2024-09-21T11:39:10.980 INFO:tasks.workunit.client.0.smithi118.stdout:2/44: dread f0 [0,4194304] 0 2024-09-21T11:39:10.980 INFO:tasks.workunit.client.0.smithi118.stdout:4/86: fsync d2/d6/de/f10 0 2024-09-21T11:39:10.985 INFO:tasks.workunit.client.1.smithi149.stdout:8/410: dread d3/f4f [0,4194304] 0 2024-09-21T11:39:10.986 INFO:tasks.workunit.client.1.smithi149.stdout:8/411: chown d3/d33/d34 17800058 1 2024-09-21T11:39:10.986 INFO:tasks.workunit.client.1.smithi149.stdout:5/508: dwrite d4/d90/f9e [0,4194304] 0 2024-09-21T11:39:10.988 INFO:tasks.workunit.client.0.smithi118.stdout:2/45: mkdir de 0 2024-09-21T11:39:10.990 INFO:tasks.workunit.client.1.smithi149.stdout:9/453: mkdir d18/d19/d1a/d2f/d30/d90 0 2024-09-21T11:39:10.991 INFO:tasks.workunit.client.1.smithi149.stdout:4/508: write d4/d6/fb [628872,120085] 0 2024-09-21T11:39:10.993 INFO:tasks.workunit.client.1.smithi149.stdout:9/454: fsync d18/d19/d1a/d2f/f75 0 2024-09-21T11:39:10.995 INFO:tasks.workunit.client.1.smithi149.stdout:2/533: creat d8/d44/fbe x:0 0 0 2024-09-21T11:39:10.997 INFO:tasks.workunit.client.1.smithi149.stdout:2/534: chown d8/da/d13/d1a/d29 0 1 2024-09-21T11:39:10.997 INFO:tasks.workunit.client.0.smithi118.stdout:4/87: rename d2/d6/dd/l17 to d2/d6/de/d1c/d23/l25 0 2024-09-21T11:39:10.998 INFO:tasks.workunit.client.1.smithi149.stdout:7/567: mkdir d12/d90/d4a/d6c/d8c/daa 0 2024-09-21T11:39:10.999 INFO:tasks.workunit.client.1.smithi149.stdout:8/412: dwrite d3/dd/d18/d2e/d80/f81 [0,4194304] 0 2024-09-21T11:39:11.000 INFO:tasks.workunit.client.1.smithi149.stdout:8/413: stat d3/dd/d18/c3e 0 2024-09-21T11:39:11.001 INFO:tasks.workunit.client.0.smithi118.stdout:0/165: link d5/d10/d1e/d21/f2d d5/d10/d1e/d33/f35 0 2024-09-21T11:39:11.003 INFO:tasks.workunit.client.1.smithi149.stdout:8/414: write d3/dd/d3a/f63 [4891942,36081] 0 2024-09-21T11:39:11.003 INFO:tasks.workunit.client.0.smithi118.stdout:9/99: truncate d0/fc 4585006 0 2024-09-21T11:39:11.004 INFO:tasks.workunit.client.1.smithi149.stdout:0/394: creat dd/f8e x:0 0 0 2024-09-21T11:39:11.004 INFO:tasks.workunit.client.1.smithi149.stdout:7/568: dread d12/d90/d26/d30/f34 [0,4194304] 0 2024-09-21T11:39:11.005 INFO:tasks.workunit.client.0.smithi118.stdout:2/46: creat de/ff x:0 0 0 2024-09-21T11:39:11.006 INFO:tasks.workunit.client.1.smithi149.stdout:6/405: creat d8/d32/d37/d79/f84 x:0 0 0 2024-09-21T11:39:11.008 INFO:tasks.workunit.client.0.smithi118.stdout:0/166: unlink d5/cf 0 2024-09-21T11:39:11.010 INFO:tasks.workunit.client.0.smithi118.stdout:0/167: write d5/d10/d1e/d23/f25 [4758446,117836] 0 2024-09-21T11:39:11.011 INFO:tasks.workunit.client.0.smithi118.stdout:0/168: dread - d5/d10/d1e/d20/f2b zero size 2024-09-21T11:39:11.011 INFO:tasks.workunit.client.0.smithi118.stdout:9/100: creat d0/d4/f27 x:0 0 0 2024-09-21T11:39:11.013 INFO:tasks.workunit.client.1.smithi149.stdout:4/509: mknod d4/d6/d63/d15/d30/d6b/db3/cb8 0 2024-09-21T11:39:11.014 INFO:tasks.workunit.client.1.smithi149.stdout:9/455: mkdir d18/d19/d1a/d2f/d33/d91 0 2024-09-21T11:39:11.015 INFO:tasks.workunit.client.1.smithi149.stdout:4/510: truncate d4/d6/f9 4750729 0 2024-09-21T11:39:11.016 INFO:tasks.workunit.client.0.smithi118.stdout:0/169: unlink c1 0 2024-09-21T11:39:11.017 INFO:tasks.workunit.client.1.smithi149.stdout:3/458: dwrite d6/d1f/f54 [0,4194304] 0 2024-09-21T11:39:11.017 INFO:tasks.workunit.client.1.smithi149.stdout:2/535: mknod d8/dd/d5c/cbf 0 2024-09-21T11:39:11.018 INFO:tasks.workunit.client.0.smithi118.stdout:9/101: symlink d0/d20/l28 0 2024-09-21T11:39:11.024 INFO:tasks.workunit.client.1.smithi149.stdout:9/456: dread d18/d19/d29/d39/f69 [0,4194304] 0 2024-09-21T11:39:11.024 INFO:tasks.workunit.client.0.smithi118.stdout:2/47: fsync de/ff 0 2024-09-21T11:39:11.029 INFO:tasks.workunit.client.0.smithi118.stdout:2/48: creat de/f10 x:0 0 0 2024-09-21T11:39:11.032 INFO:tasks.workunit.client.1.smithi149.stdout:0/395: fdatasync dd/d1a/f44 0 2024-09-21T11:39:11.033 INFO:tasks.workunit.client.1.smithi149.stdout:0/396: write dd/d1a/d5a/f80 [217548,18349] 0 2024-09-21T11:39:11.034 INFO:tasks.workunit.client.1.smithi149.stdout:0/397: write dd/d1a/d1b/d50/f7a [689380,58745] 0 2024-09-21T11:39:11.036 INFO:tasks.workunit.client.0.smithi118.stdout:2/49: creat de/f11 x:0 0 0 2024-09-21T11:39:11.037 INFO:tasks.workunit.client.1.smithi149.stdout:6/406: rmdir d8/d32/d37/d2b/d51 39 2024-09-21T11:39:11.038 INFO:tasks.workunit.client.1.smithi149.stdout:1/429: truncate d2/d5/d3d/f72 3933359 0 2024-09-21T11:39:11.038 INFO:tasks.workunit.client.0.smithi118.stdout:9/102: link d0/d4/f8 d0/d4/f29 0 2024-09-21T11:39:11.039 INFO:tasks.workunit.client.0.smithi118.stdout:9/103: write d0/fb [1708736,121671] 0 2024-09-21T11:39:11.040 INFO:tasks.workunit.client.0.smithi118.stdout:0/170: getdents d5/d10/d1e/d20 0 2024-09-21T11:39:11.040 INFO:tasks.workunit.client.1.smithi149.stdout:0/398: dwrite dd/d2d/f4b [0,4194304] 0 2024-09-21T11:39:11.042 INFO:tasks.workunit.client.0.smithi118.stdout:2/50: fsync f0 0 2024-09-21T11:39:11.043 INFO:tasks.workunit.client.0.smithi118.stdout:2/51: read - de/f10 zero size 2024-09-21T11:39:11.044 INFO:tasks.workunit.client.1.smithi149.stdout:3/459: symlink d6/d1f/d27/d83/la8 0 2024-09-21T11:39:11.045 INFO:tasks.workunit.client.1.smithi149.stdout:2/536: symlink d8/da/d13/d1a/d29/lc0 0 2024-09-21T11:39:11.047 INFO:tasks.workunit.client.1.smithi149.stdout:9/457: symlink d18/d1c/l92 0 2024-09-21T11:39:11.049 INFO:tasks.workunit.client.0.smithi118.stdout:9/104: truncate d0/d4/f15 298682 0 2024-09-21T11:39:11.050 INFO:tasks.workunit.client.1.smithi149.stdout:8/415: mknod d3/d3c/c8b 0 2024-09-21T11:39:11.053 INFO:tasks.workunit.client.0.smithi118.stdout:2/52: creat de/f12 x:0 0 0 2024-09-21T11:39:11.054 INFO:tasks.workunit.client.0.smithi118.stdout:2/53: fdatasync de/f12 0 2024-09-21T11:39:11.056 INFO:tasks.workunit.client.0.smithi118.stdout:0/171: symlink d5/d34/l36 0 2024-09-21T11:39:11.060 INFO:tasks.workunit.client.1.smithi149.stdout:6/407: rename d8/da/d2c/d6d to d8/da/d3d/d85 0 2024-09-21T11:39:11.060 INFO:tasks.workunit.client.0.smithi118.stdout:2/54: dwrite f6 [0,4194304] 0 2024-09-21T11:39:11.061 INFO:tasks.workunit.client.0.smithi118.stdout:2/55: dread - de/ff zero size 2024-09-21T11:39:11.063 INFO:tasks.workunit.client.1.smithi149.stdout:1/430: creat d2/d2b/d6e/f87 x:0 0 0 2024-09-21T11:39:11.064 INFO:tasks.workunit.client.1.smithi149.stdout:1/431: write d2/d2b/d6e/f87 [563835,21365] 0 2024-09-21T11:39:11.064 INFO:tasks.workunit.client.0.smithi118.stdout:9/105: mknod d0/d4/d23/c2a 0 2024-09-21T11:39:11.065 INFO:tasks.workunit.client.1.smithi149.stdout:5/509: link d4/d7/l17 d4/d7/d40/d43/d49/d88/la8 0 2024-09-21T11:39:11.068 INFO:tasks.workunit.client.0.smithi118.stdout:0/172: symlink d5/d10/d1e/d23/l37 0 2024-09-21T11:39:11.069 INFO:tasks.workunit.client.1.smithi149.stdout:4/511: symlink d4/d6/d63/d92/lb9 0 2024-09-21T11:39:11.070 INFO:tasks.workunit.client.0.smithi118.stdout:2/56: symlink de/l13 0 2024-09-21T11:39:11.071 INFO:tasks.workunit.client.0.smithi118.stdout:2/57: write f6 [2088245,61912] 0 2024-09-21T11:39:11.072 INFO:tasks.workunit.client.0.smithi118.stdout:9/106: symlink d0/d4/l2b 0 2024-09-21T11:39:11.074 INFO:tasks.workunit.client.1.smithi149.stdout:3/460: write d6/d1f/f3e [196162,103353] 0 2024-09-21T11:39:11.074 INFO:tasks.workunit.client.0.smithi118.stdout:0/173: mknod d5/d10/d1e/d20/c38 0 2024-09-21T11:39:11.076 INFO:tasks.workunit.client.1.smithi149.stdout:2/537: unlink d8/da/d13/f7e 0 2024-09-21T11:39:11.077 INFO:tasks.workunit.client.1.smithi149.stdout:2/538: write d8/da/d13/d53/f91 [728167,97829] 0 2024-09-21T11:39:11.078 INFO:tasks.workunit.client.1.smithi149.stdout:9/458: rmdir d18/d19/d29/d39/d63 39 2024-09-21T11:39:11.080 INFO:tasks.workunit.client.1.smithi149.stdout:7/569: rmdir d12/d90/d4a/d6c/da0/da8 0 2024-09-21T11:39:11.082 INFO:tasks.workunit.client.1.smithi149.stdout:1/432: rmdir d2/dd/d35/d1c/d41 39 2024-09-21T11:39:11.089 INFO:tasks.workunit.client.1.smithi149.stdout:5/510: mknod d4/d7/d40/d51/d56/ca9 0 2024-09-21T11:39:11.090 INFO:tasks.workunit.client.1.smithi149.stdout:5/511: read d4/d7/d40/f42 [3757,25514] 0 2024-09-21T11:39:11.090 INFO:tasks.workunit.client.0.smithi118.stdout:9/107: creat d0/f2c x:0 0 0 2024-09-21T11:39:11.090 INFO:tasks.workunit.client.0.smithi118.stdout:9/108: chown d0/c14 49967247 1 2024-09-21T11:39:11.093 INFO:tasks.workunit.client.0.smithi118.stdout:9/109: symlink d0/d20/l2d 0 2024-09-21T11:39:11.098 INFO:tasks.workunit.client.0.smithi118.stdout:0/174: dwrite d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:11.098 INFO:tasks.workunit.client.0.smithi118.stdout:9/110: rename d0/c14 to d0/d20/c2e 0 2024-09-21T11:39:11.100 INFO:tasks.workunit.client.1.smithi149.stdout:6/408: creat d8/d32/d37/d2b/d7e/f86 x:0 0 0 2024-09-21T11:39:11.102 INFO:tasks.workunit.client.0.smithi118.stdout:9/111: mknod d0/d20/c2f 0 2024-09-21T11:39:11.111 INFO:tasks.workunit.client.1.smithi149.stdout:0/399: link dd/d1a/d5a/l83 dd/d1a/d1b/d50/d53/d3a/d66/l8f 0 2024-09-21T11:39:11.112 INFO:tasks.workunit.client.1.smithi149.stdout:9/459: unlink d18/d19/d1a/c1b 0 2024-09-21T11:39:11.116 INFO:tasks.workunit.client.1.smithi149.stdout:1/433: dwrite d2/f21 [0,4194304] 0 2024-09-21T11:39:11.119 INFO:tasks.workunit.client.1.smithi149.stdout:5/512: creat d4/d7/d40/d43/d85/faa x:0 0 0 2024-09-21T11:39:11.121 INFO:tasks.workunit.client.1.smithi149.stdout:3/461: rename d6/d1f/d47/d37/f3b to d6/d1f/d47/fa9 0 2024-09-21T11:39:11.122 INFO:tasks.workunit.client.1.smithi149.stdout:0/400: symlink dd/d1a/l90 0 2024-09-21T11:39:11.123 INFO:tasks.workunit.client.1.smithi149.stdout:8/416: sync 2024-09-21T11:39:11.123 INFO:tasks.workunit.client.1.smithi149.stdout:3/462: fdatasync d6/d1f/d47/d37/d50/f78 0 2024-09-21T11:39:11.125 INFO:tasks.workunit.client.1.smithi149.stdout:0/401: read dd/d32/f3c [332469,69810] 0 2024-09-21T11:39:11.125 INFO:tasks.workunit.client.1.smithi149.stdout:4/512: getdents d4 0 2024-09-21T11:39:11.127 INFO:tasks.workunit.client.1.smithi149.stdout:4/513: write d4/d4d/d58/f79 [499548,5831] 0 2024-09-21T11:39:11.128 INFO:tasks.workunit.client.1.smithi149.stdout:5/513: creat d4/d1d/d50/d54/d2a/d93/fab x:0 0 0 2024-09-21T11:39:11.129 INFO:tasks.workunit.client.1.smithi149.stdout:1/434: rename d2/d5/d8/d3b to d2/d5/d3d/d88 0 2024-09-21T11:39:11.130 INFO:tasks.workunit.client.1.smithi149.stdout:3/463: mknod d6/d5f/d60/caa 0 2024-09-21T11:39:11.131 INFO:tasks.workunit.client.1.smithi149.stdout:5/514: stat d4/d7/d40/d43/d5c/l8a 0 2024-09-21T11:39:11.132 INFO:tasks.workunit.client.1.smithi149.stdout:9/460: dwrite d18/d36/d3c/f3f [4194304,4194304] 0 2024-09-21T11:39:11.135 INFO:tasks.workunit.client.1.smithi149.stdout:0/402: chown dd/f19 132131317 1 2024-09-21T11:39:11.137 INFO:tasks.workunit.client.1.smithi149.stdout:6/409: truncate d8/d32/d37/f61 221663 0 2024-09-21T11:39:11.141 INFO:tasks.workunit.client.1.smithi149.stdout:5/515: dread - d4/d7/d40/d51/d56/f70 zero size 2024-09-21T11:39:11.142 INFO:tasks.workunit.client.1.smithi149.stdout:1/435: fsync d2/d5/d8/f1f 0 2024-09-21T11:39:11.143 INFO:tasks.workunit.client.1.smithi149.stdout:3/464: mknod d6/d1f/d47/d22/d8d/d97/cab 0 2024-09-21T11:39:11.144 INFO:tasks.workunit.client.1.smithi149.stdout:7/570: dwrite d12/d90/f2c [0,4194304] 0 2024-09-21T11:39:11.146 INFO:tasks.workunit.client.1.smithi149.stdout:0/403: creat dd/d2d/f91 x:0 0 0 2024-09-21T11:39:11.147 INFO:tasks.workunit.client.1.smithi149.stdout:8/417: rename d3/dd/d18/d2e/f70 to d3/dd/d18/f8c 0 2024-09-21T11:39:11.149 INFO:tasks.workunit.client.1.smithi149.stdout:2/539: dwrite d8/dd/f24 [0,4194304] 0 2024-09-21T11:39:11.153 INFO:tasks.workunit.client.1.smithi149.stdout:1/436: symlink d2/d5/d65/l89 0 2024-09-21T11:39:11.156 INFO:tasks.workunit.client.1.smithi149.stdout:8/418: chown d3/dd/d18/f7e 7052012 1 2024-09-21T11:39:11.156 INFO:tasks.workunit.client.1.smithi149.stdout:5/516: creat d4/d7/d40/d43/d49/fac x:0 0 0 2024-09-21T11:39:11.159 INFO:tasks.workunit.client.1.smithi149.stdout:3/465: mknod d6/d1f/d47/d37/d3a/cac 0 2024-09-21T11:39:11.160 INFO:tasks.workunit.client.1.smithi149.stdout:7/571: mkdir d12/d90/d4a/d4f/d75/d94/d47/dab 0 2024-09-21T11:39:11.161 INFO:tasks.workunit.client.1.smithi149.stdout:9/461: link d18/d1c/l92 d18/d19/d29/d6a/l93 0 2024-09-21T11:39:11.165 INFO:tasks.workunit.client.1.smithi149.stdout:4/514: dread d4/f55 [0,4194304] 0 2024-09-21T11:39:11.165 INFO:tasks.workunit.client.1.smithi149.stdout:3/466: dread - d6/d1f/d4c/f8f zero size 2024-09-21T11:39:11.165 INFO:tasks.workunit.client.1.smithi149.stdout:1/437: write d2/d5/d8/f1f [2637003,21998] 0 2024-09-21T11:39:11.166 INFO:tasks.workunit.client.1.smithi149.stdout:7/572: stat d12/d90/f17 0 2024-09-21T11:39:11.166 INFO:tasks.workunit.client.1.smithi149.stdout:5/517: dread - d4/d7/d40/d43/d49/fac zero size 2024-09-21T11:39:11.168 INFO:tasks.workunit.client.1.smithi149.stdout:6/410: dwrite d8/f39 [0,4194304] 0 2024-09-21T11:39:11.174 INFO:tasks.workunit.client.1.smithi149.stdout:9/462: read d18/d1c/f60 [2894593,54661] 0 2024-09-21T11:39:11.174 INFO:tasks.workunit.client.1.smithi149.stdout:5/518: chown d4/d7/d40/d43/d49/f78 394 1 2024-09-21T11:39:11.175 INFO:tasks.workunit.client.1.smithi149.stdout:8/419: creat d3/dd/d21/d54/d5c/d6d/f8d x:0 0 0 2024-09-21T11:39:11.176 INFO:tasks.workunit.client.1.smithi149.stdout:6/411: write d8/d32/d37/f49 [790606,101092] 0 2024-09-21T11:39:11.178 INFO:tasks.workunit.client.1.smithi149.stdout:1/438: symlink d2/d2b/d6e/l8a 0 2024-09-21T11:39:11.179 INFO:tasks.workunit.client.1.smithi149.stdout:4/515: symlink d4/d6/d63/d15/d30/lba 0 2024-09-21T11:39:11.179 INFO:tasks.workunit.client.1.smithi149.stdout:0/404: dwrite dd/d1a/d1b/d72/d85/d8c/f89 [0,4194304] 0 2024-09-21T11:39:11.181 INFO:tasks.workunit.client.1.smithi149.stdout:8/420: write d3/dd/d18/f7e [1160289,3921] 0 2024-09-21T11:39:11.181 INFO:tasks.workunit.client.1.smithi149.stdout:2/540: dwrite d8/d20/d78/f93 [4194304,4194304] 0 2024-09-21T11:39:11.186 INFO:tasks.workunit.client.1.smithi149.stdout:5/519: truncate d4/d1d/d50/f8b 1043294 0 2024-09-21T11:39:11.186 INFO:tasks.workunit.client.1.smithi149.stdout:9/463: mknod d18/d19/d1a/d2f/d5f/c94 0 2024-09-21T11:39:11.190 INFO:tasks.workunit.client.1.smithi149.stdout:7/573: rename d12/d90/d4a/d9e/l4d to d12/d90/lac 0 2024-09-21T11:39:11.191 INFO:tasks.workunit.client.1.smithi149.stdout:3/467: truncate d6/d1f/d47/d37/f7b 1894799 0 2024-09-21T11:39:11.193 INFO:tasks.workunit.client.1.smithi149.stdout:6/412: mkdir d8/d32/d37/d28/d87 0 2024-09-21T11:39:11.193 INFO:tasks.workunit.client.1.smithi149.stdout:0/405: dread dd/d1a/d1b/d50/d53/f54 [0,4194304] 0 2024-09-21T11:39:11.195 INFO:tasks.workunit.client.1.smithi149.stdout:8/421: mkdir d3/d12/d6e/d79/d8e 0 2024-09-21T11:39:11.195 INFO:tasks.workunit.client.1.smithi149.stdout:9/464: symlink d18/d19/d29/d39/d63/l95 0 2024-09-21T11:39:11.196 INFO:tasks.workunit.client.1.smithi149.stdout:4/516: mknod d4/d6/d63/d10/cbb 0 2024-09-21T11:39:11.201 INFO:tasks.workunit.client.1.smithi149.stdout:9/465: rmdir d18/d36/d3c 39 2024-09-21T11:39:11.202 INFO:tasks.workunit.client.1.smithi149.stdout:1/439: dwrite d2/d5/d3d/d88/f42 [4194304,4194304] 0 2024-09-21T11:39:11.203 INFO:tasks.workunit.client.1.smithi149.stdout:9/466: stat d18/d1c/l41 0 2024-09-21T11:39:11.203 INFO:tasks.workunit.client.1.smithi149.stdout:5/520: dwrite d4/d1d/d50/d54/d2a/d93/fab [0,4194304] 0 2024-09-21T11:39:11.206 INFO:tasks.workunit.client.1.smithi149.stdout:9/467: chown d18/d1c/l41 27955 1 2024-09-21T11:39:11.214 INFO:tasks.workunit.client.1.smithi149.stdout:0/406: symlink dd/d1a/d1b/d72/d87/l92 0 2024-09-21T11:39:11.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/517: chown d4/d6/d63/d10/d6f 82 1 2024-09-21T11:39:11.215 INFO:tasks.workunit.client.1.smithi149.stdout:2/541: link d8/dd/d50/l70 d8/dd/d8c/lc1 0 2024-09-21T11:39:11.221 INFO:tasks.workunit.client.1.smithi149.stdout:8/422: rename d3/d3c/d4c to d3/d3c/d8f 0 2024-09-21T11:39:11.221 INFO:tasks.workunit.client.1.smithi149.stdout:6/413: getdents d8/da/d2c/d2d 0 2024-09-21T11:39:11.221 INFO:tasks.workunit.client.1.smithi149.stdout:2/542: mknod d8/dd/d8c/cc2 0 2024-09-21T11:39:11.224 INFO:tasks.workunit.client.1.smithi149.stdout:8/423: fdatasync d3/dd/d3a/f63 0 2024-09-21T11:39:11.225 INFO:tasks.workunit.client.1.smithi149.stdout:4/518: creat d4/d6/d63/d10/d31/fbc x:0 0 0 2024-09-21T11:39:11.226 INFO:tasks.workunit.client.1.smithi149.stdout:0/407: truncate dd/d1a/f2c 3659290 0 2024-09-21T11:39:11.229 INFO:tasks.workunit.client.1.smithi149.stdout:2/543: chown d8/d44/d63/db9/d5a/l66 329638441 1 2024-09-21T11:39:11.231 INFO:tasks.workunit.client.1.smithi149.stdout:5/521: dwrite d4/d1d/d3e/f89 [0,4194304] 0 2024-09-21T11:39:11.233 INFO:tasks.workunit.client.1.smithi149.stdout:1/440: dwrite d2/d5/d3d/d88/f3e [0,4194304] 0 2024-09-21T11:39:11.233 INFO:tasks.workunit.client.1.smithi149.stdout:9/468: dwrite d18/d1c/f4e [0,4194304] 0 2024-09-21T11:39:11.233 INFO:tasks.workunit.client.1.smithi149.stdout:4/519: write d4/d6/d63/d15/d30/d6b/db3/f70 [102603,7328] 0 2024-09-21T11:39:11.262 INFO:tasks.workunit.client.1.smithi149.stdout:8/424: mkdir d3/dd/d90 0 2024-09-21T11:39:11.263 INFO:tasks.workunit.client.1.smithi149.stdout:2/544: fsync d8/dd/f24 0 2024-09-21T11:39:11.265 INFO:tasks.workunit.client.1.smithi149.stdout:9/469: fdatasync d18/d1c/f46 0 2024-09-21T11:39:11.267 INFO:tasks.workunit.client.1.smithi149.stdout:1/441: creat d2/dd/d35/d1c/d2c/f8b x:0 0 0 2024-09-21T11:39:11.267 INFO:tasks.workunit.client.1.smithi149.stdout:5/522: mkdir d4/d1d/d50/d54/d2a/d93/dad 0 2024-09-21T11:39:11.268 INFO:tasks.workunit.client.1.smithi149.stdout:4/520: truncate d4/d6/d63/d15/f49 9425231 0 2024-09-21T11:39:11.269 INFO:tasks.workunit.client.1.smithi149.stdout:9/470: fdatasync d18/d19/d1a/d2f/f75 0 2024-09-21T11:39:11.273 INFO:tasks.workunit.client.1.smithi149.stdout:4/521: fsync d4/d4d/d5f/f87 0 2024-09-21T11:39:11.274 INFO:tasks.workunit.client.1.smithi149.stdout:5/523: write d4/d1d/d50/d54/d2a/fa2 [606724,57603] 0 2024-09-21T11:39:11.275 INFO:tasks.workunit.client.1.smithi149.stdout:3/468: dread d6/f10 [0,4194304] 0 2024-09-21T11:39:11.276 INFO:tasks.workunit.client.1.smithi149.stdout:6/414: dwrite d8/d32/d37/f61 [0,4194304] 0 2024-09-21T11:39:11.279 INFO:tasks.workunit.client.0.smithi118.stdout:9/112: creat d0/d20/f30 x:0 0 0 2024-09-21T11:39:11.279 INFO:tasks.workunit.client.0.smithi118.stdout:0/175: write d5/d10/d1e/d20/f2f [828756,84163] 0 2024-09-21T11:39:11.281 INFO:tasks.workunit.client.0.smithi118.stdout:0/176: write d5/d10/d1e/d21/f24 [895932,9793] 0 2024-09-21T11:39:11.282 INFO:tasks.workunit.client.1.smithi149.stdout:4/522: mknod d4/d6/d63/d10/d31/cbd 0 2024-09-21T11:39:11.283 INFO:tasks.workunit.client.1.smithi149.stdout:2/545: dwrite d8/dd/d50/f5b [0,4194304] 0 2024-09-21T11:39:11.283 INFO:tasks.workunit.client.0.smithi118.stdout:9/113: mkdir d0/d4/d31 0 2024-09-21T11:39:11.285 INFO:tasks.workunit.client.1.smithi149.stdout:6/415: chown d8/d32/d37/d28/d2f/d6a 146 1 2024-09-21T11:39:11.286 INFO:tasks.workunit.client.1.smithi149.stdout:4/523: readlink d4/d4d/d5f/l8e 0 2024-09-21T11:39:11.286 INFO:tasks.workunit.client.1.smithi149.stdout:3/469: truncate d6/d1f/d4c/f8f 947210 0 2024-09-21T11:39:11.287 INFO:tasks.workunit.client.1.smithi149.stdout:8/425: dwrite d3/dd/d21/d54/d5c/f6b [0,4194304] 0 2024-09-21T11:39:11.290 INFO:tasks.workunit.client.1.smithi149.stdout:5/524: creat d4/d7/d40/d43/d49/d88/fae x:0 0 0 2024-09-21T11:39:11.292 INFO:tasks.workunit.client.1.smithi149.stdout:2/546: rmdir d8/d11/d88 39 2024-09-21T11:39:11.292 INFO:tasks.workunit.client.1.smithi149.stdout:5/525: chown d4/d7/d40/d43/d49/f78 171 1 2024-09-21T11:39:11.293 INFO:tasks.workunit.client.1.smithi149.stdout:6/416: creat d8/d32/d37/d79/f88 x:0 0 0 2024-09-21T11:39:11.294 INFO:tasks.workunit.client.1.smithi149.stdout:5/526: write d4/d1d/d3e/f7c [2529985,93620] 0 2024-09-21T11:39:11.295 INFO:tasks.workunit.client.1.smithi149.stdout:3/470: unlink d6/d1f/d47/f26 0 2024-09-21T11:39:11.295 INFO:tasks.workunit.client.1.smithi149.stdout:5/527: chown d4/d7/f38 612625 1 2024-09-21T11:39:11.296 INFO:tasks.workunit.client.1.smithi149.stdout:4/524: mknod d4/d6/d63/d10/d31/d32/cbe 0 2024-09-21T11:39:11.296 INFO:tasks.workunit.client.1.smithi149.stdout:7/574: sync 2024-09-21T11:39:11.297 INFO:tasks.workunit.client.1.smithi149.stdout:9/471: truncate d18/d4c/d5b/f6e 1842474 0 2024-09-21T11:39:11.298 INFO:tasks.workunit.client.1.smithi149.stdout:4/525: write d4/d6/d63/d15/d16/d23/f60 [4233587,77837] 0 2024-09-21T11:39:11.299 INFO:tasks.workunit.client.1.smithi149.stdout:4/526: fdatasync d4/f27 0 2024-09-21T11:39:11.300 INFO:tasks.workunit.client.0.smithi118.stdout:0/177: truncate d5/d10/f28 1303783 0 2024-09-21T11:39:11.300 INFO:tasks.workunit.client.1.smithi149.stdout:4/527: write d4/d6/d63/d15/d30/d6b/db3/f70 [875844,47906] 0 2024-09-21T11:39:11.301 INFO:tasks.workunit.client.1.smithi149.stdout:4/528: dread - d4/d6/d63/d10/d31/fbc zero size 2024-09-21T11:39:11.302 INFO:tasks.workunit.client.0.smithi118.stdout:0/178: fsync d5/d10/d1e/d33/f35 0 2024-09-21T11:39:11.304 INFO:tasks.workunit.client.1.smithi149.stdout:1/442: dread d2/d5/d3d/f72 [0,4194304] 0 2024-09-21T11:39:11.305 INFO:tasks.workunit.client.1.smithi149.stdout:3/471: creat d6/d1f/d47/d22/fad x:0 0 0 2024-09-21T11:39:11.305 INFO:tasks.workunit.client.1.smithi149.stdout:3/472: readlink d6/l3d 0 2024-09-21T11:39:11.305 INFO:tasks.workunit.client.1.smithi149.stdout:5/528: creat d4/d7/d40/d43/d5c/faf x:0 0 0 2024-09-21T11:39:11.307 INFO:tasks.workunit.client.0.smithi118.stdout:9/114: dwrite d0/d4/f29 [0,4194304] 0 2024-09-21T11:39:11.307 INFO:tasks.workunit.client.1.smithi149.stdout:3/473: read - d6/d1f/d47/d37/d3a/f90 zero size 2024-09-21T11:39:11.309 INFO:tasks.workunit.client.1.smithi149.stdout:6/417: dwrite d8/d32/d37/d28/f33 [0,4194304] 0 2024-09-21T11:39:11.310 INFO:tasks.workunit.client.1.smithi149.stdout:7/575: creat d12/d90/d4a/d4f/d75/d94/d47/d49/fad x:0 0 0 2024-09-21T11:39:11.312 INFO:tasks.workunit.client.0.smithi118.stdout:9/115: creat d0/d4/d23/f32 x:0 0 0 2024-09-21T11:39:11.312 INFO:tasks.workunit.client.0.smithi118.stdout:9/116: chown d0/d4 3579326 1 2024-09-21T11:39:11.313 INFO:tasks.workunit.client.1.smithi149.stdout:7/576: chown d12/d90/d4a/d4f/d75/d94/d47/d49/c8b 9048 1 2024-09-21T11:39:11.314 INFO:tasks.workunit.client.1.smithi149.stdout:2/547: mkdir d8/da/d13/dc3 0 2024-09-21T11:39:11.314 INFO:tasks.workunit.client.0.smithi118.stdout:0/179: symlink d5/d10/d1e/d33/l39 0 2024-09-21T11:39:11.315 INFO:tasks.workunit.client.1.smithi149.stdout:7/577: write d12/d90/f1f [1048486,19518] 0 2024-09-21T11:39:11.317 INFO:tasks.workunit.client.0.smithi118.stdout:9/117: mknod d0/d4/d23/c33 0 2024-09-21T11:39:11.321 INFO:tasks.workunit.client.1.smithi149.stdout:0/408: sync 2024-09-21T11:39:11.322 INFO:tasks.workunit.client.0.smithi118.stdout:9/118: mknod d0/d4/d23/c34 0 2024-09-21T11:39:11.324 INFO:tasks.workunit.client.1.smithi149.stdout:1/443: mknod d2/dd/d2e/d4c/c8c 0 2024-09-21T11:39:11.325 INFO:tasks.workunit.client.1.smithi149.stdout:1/444: chown d2/dd/d35/f24 0 1 2024-09-21T11:39:11.325 INFO:tasks.workunit.client.1.smithi149.stdout:4/529: dwrite d4/d6/f7f [0,4194304] 0 2024-09-21T11:39:11.326 INFO:tasks.workunit.client.1.smithi149.stdout:8/426: link d3/dd/d3a/l50 d3/d33/d34/d55/l91 0 2024-09-21T11:39:11.327 INFO:tasks.workunit.client.1.smithi149.stdout:8/427: truncate d3/dd/d21/d54/d5c/f6b 4804715 0 2024-09-21T11:39:11.328 INFO:tasks.workunit.client.1.smithi149.stdout:9/472: creat d18/d19/d1a/d2f/d33/d91/f96 x:0 0 0 2024-09-21T11:39:11.329 INFO:tasks.workunit.client.0.smithi118.stdout:9/119: dwrite d0/fb [4194304,4194304] 0 2024-09-21T11:39:11.330 INFO:tasks.workunit.client.0.smithi118.stdout:9/120: stat d0/d4/l2b 0 2024-09-21T11:39:11.334 INFO:tasks.workunit.client.0.smithi118.stdout:0/180: getdents d5/d10 0 2024-09-21T11:39:11.336 INFO:tasks.workunit.client.0.smithi118.stdout:9/121: stat d0/l1b 0 2024-09-21T11:39:11.338 INFO:tasks.workunit.client.0.smithi118.stdout:0/181: mkdir d5/d10/d1e/d23/d3a 0 2024-09-21T11:39:11.339 INFO:tasks.workunit.client.0.smithi118.stdout:0/182: chown d5/f13 47750 1 2024-09-21T11:39:11.341 INFO:tasks.workunit.client.1.smithi149.stdout:7/578: chown d12/c13 0 1 2024-09-21T11:39:11.343 INFO:tasks.workunit.client.0.smithi118.stdout:0/183: dread d5/d10/d1e/d23/f25 [0,4194304] 0 2024-09-21T11:39:11.346 INFO:tasks.workunit.client.1.smithi149.stdout:5/529: write d4/d7/d40/d51/fa0 [960606,15407] 0 2024-09-21T11:39:11.348 INFO:tasks.workunit.client.1.smithi149.stdout:1/445: chown d2/dd/d35/d1c/f39 159488 1 2024-09-21T11:39:11.350 INFO:tasks.workunit.client.0.smithi118.stdout:0/184: dwrite d5/d10/d1e/f27 [0,4194304] 0 2024-09-21T11:39:11.351 INFO:tasks.workunit.client.0.smithi118.stdout:0/185: write d5/f7 [4014419,103807] 0 2024-09-21T11:39:11.355 INFO:tasks.workunit.client.1.smithi149.stdout:4/530: dwrite d4/d6/d63/d15/d30/f48 [0,4194304] 0 2024-09-21T11:39:11.355 INFO:tasks.workunit.client.0.smithi118.stdout:9/122: rmdir d0/d4/d31 0 2024-09-21T11:39:11.360 INFO:tasks.workunit.client.0.smithi118.stdout:0/186: creat d5/d34/f3b x:0 0 0 2024-09-21T11:39:11.360 INFO:tasks.workunit.client.1.smithi149.stdout:3/474: unlink d6/d1f/f35 0 2024-09-21T11:39:11.361 INFO:tasks.workunit.client.1.smithi149.stdout:6/418: symlink d8/da/d2c/l89 0 2024-09-21T11:39:11.361 INFO:tasks.workunit.client.1.smithi149.stdout:5/530: dread d4/d7/d40/d51/f58 [0,4194304] 0 2024-09-21T11:39:11.361 INFO:tasks.workunit.client.1.smithi149.stdout:0/409: dwrite dd/d32/f3c [0,4194304] 0 2024-09-21T11:39:11.362 INFO:tasks.workunit.client.1.smithi149.stdout:2/548: mknod d8/cc4 0 2024-09-21T11:39:11.364 INFO:tasks.workunit.client.1.smithi149.stdout:7/579: mknod d12/d90/d4a/d4f/cae 0 2024-09-21T11:39:11.364 INFO:tasks.workunit.client.1.smithi149.stdout:0/410: chown dd/d35/f4d 13083040 1 2024-09-21T11:39:11.364 INFO:tasks.workunit.client.0.smithi118.stdout:9/123: dwrite d0/d4/f27 [0,4194304] 0 2024-09-21T11:39:11.368 INFO:tasks.workunit.client.1.smithi149.stdout:5/531: dread d4/d7/d40/d51/fa0 [0,4194304] 0 2024-09-21T11:39:11.371 INFO:tasks.workunit.client.1.smithi149.stdout:8/428: creat d3/dd/d90/f92 x:0 0 0 2024-09-21T11:39:11.373 INFO:tasks.workunit.client.1.smithi149.stdout:9/473: mkdir d18/d36/d3c/d47/d76/d97 0 2024-09-21T11:39:11.374 INFO:tasks.workunit.client.1.smithi149.stdout:4/531: mknod d4/d6/d63/d15/d30/d8a/cbf 0 2024-09-21T11:39:11.376 INFO:tasks.workunit.client.0.smithi118.stdout:9/124: mknod d0/c35 0 2024-09-21T11:39:11.380 INFO:tasks.workunit.client.1.smithi149.stdout:6/419: unlink d8/da/d2c/d2d/f4d 0 2024-09-21T11:39:11.381 INFO:tasks.workunit.client.1.smithi149.stdout:6/420: write d8/d32/d37/f49 [1013797,87064] 0 2024-09-21T11:39:11.381 INFO:tasks.workunit.client.0.smithi118.stdout:9/125: creat d0/d4/d23/f36 x:0 0 0 2024-09-21T11:39:11.382 INFO:tasks.workunit.client.0.smithi118.stdout:9/126: chown d0/f5 14 1 2024-09-21T11:39:11.382 INFO:tasks.workunit.client.0.smithi118.stdout:9/127: stat d0/d4/l6 0 2024-09-21T11:39:11.385 INFO:tasks.workunit.client.1.smithi149.stdout:0/411: rename dd/d1a/d1b/d50/f7a to dd/d1a/d5a/f93 0 2024-09-21T11:39:11.386 INFO:tasks.workunit.client.1.smithi149.stdout:1/446: link d2/dd/f71 d2/dd/d35/f8d 0 2024-09-21T11:39:11.387 INFO:tasks.workunit.client.1.smithi149.stdout:5/532: creat d4/d7/d40/d43/d5c/fb0 x:0 0 0 2024-09-21T11:39:11.388 INFO:tasks.workunit.client.1.smithi149.stdout:9/474: chown d18/d19/d1a/d2f/d33/c35 18 1 2024-09-21T11:39:11.388 INFO:tasks.workunit.client.1.smithi149.stdout:9/475: fdatasync f16 0 2024-09-21T11:39:11.390 INFO:tasks.workunit.client.1.smithi149.stdout:2/549: mkdir d8/da/d13/d1a/dc5 0 2024-09-21T11:39:11.392 INFO:tasks.workunit.client.1.smithi149.stdout:7/580: link d12/d90/d4a/f76 d12/d90/d4a/d4f/d75/d94/faf 0 2024-09-21T11:39:11.393 INFO:tasks.workunit.client.1.smithi149.stdout:7/581: write d12/f74 [2299113,112948] 0 2024-09-21T11:39:11.394 INFO:tasks.workunit.client.1.smithi149.stdout:8/429: rename d3/dd/d21/f3b to d3/dd/d18/d2e/d80/f93 0 2024-09-21T11:39:11.395 INFO:tasks.workunit.client.1.smithi149.stdout:1/447: unlink d2/f1e 0 2024-09-21T11:39:11.396 INFO:tasks.workunit.client.1.smithi149.stdout:5/533: mkdir d4/d1d/d50/d60/db1 0 2024-09-21T11:39:11.397 INFO:tasks.workunit.client.1.smithi149.stdout:3/475: link d6/d1f/d47/d37/d3a/f67 d6/d1f/d47/d22/d8d/fae 0 2024-09-21T11:39:11.399 INFO:tasks.workunit.client.1.smithi149.stdout:6/421: dread d8/d32/d37/d28/f30 [0,4194304] 0 2024-09-21T11:39:11.399 INFO:tasks.workunit.client.1.smithi149.stdout:3/476: chown c4 56642 1 2024-09-21T11:39:11.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/550: chown d8/da/d13/d1a/d29/c9e 317565 1 2024-09-21T11:39:11.400 INFO:tasks.workunit.client.1.smithi149.stdout:5/534: chown d4/d1d/d50/d60/l68 61105 1 2024-09-21T11:39:11.400 INFO:tasks.workunit.client.1.smithi149.stdout:0/412: symlink dd/d1a/d1b/l94 0 2024-09-21T11:39:11.401 INFO:tasks.workunit.client.1.smithi149.stdout:1/448: symlink d2/dd/d2e/l8e 0 2024-09-21T11:39:11.405 INFO:tasks.workunit.client.1.smithi149.stdout:2/551: creat d8/d20/d57/fc6 x:0 0 0 2024-09-21T11:39:11.405 INFO:tasks.workunit.client.1.smithi149.stdout:5/535: write d4/d1d/d50/d54/d2a/f3f [4016347,111991] 0 2024-09-21T11:39:11.406 INFO:tasks.workunit.client.1.smithi149.stdout:8/430: dwrite d3/d3c/d8f/f7a [0,4194304] 0 2024-09-21T11:39:11.406 INFO:tasks.workunit.client.1.smithi149.stdout:3/477: mknod d6/d1f/d47/d37/d3a/d95/caf 0 2024-09-21T11:39:11.406 INFO:tasks.workunit.client.1.smithi149.stdout:1/449: symlink d2/dd/d2e/d4c/l8f 0 2024-09-21T11:39:11.410 INFO:tasks.workunit.client.1.smithi149.stdout:5/536: chown d4/d7/d40/d43/d5c/c92 554468 1 2024-09-21T11:39:11.410 INFO:tasks.workunit.client.1.smithi149.stdout:9/476: dread d18/d4c/f67 [0,4194304] 0 2024-09-21T11:39:11.410 INFO:tasks.workunit.client.1.smithi149.stdout:3/478: chown d6/d1f/d27/f3c 718 1 2024-09-21T11:39:11.411 INFO:tasks.workunit.client.1.smithi149.stdout:2/552: creat d8/d44/d63/db9/d5a/fc7 x:0 0 0 2024-09-21T11:39:11.412 INFO:tasks.workunit.client.1.smithi149.stdout:8/431: unlink d3/dd/d18/f7e 0 2024-09-21T11:39:11.414 INFO:tasks.workunit.client.1.smithi149.stdout:1/450: mkdir d2/dd/d35/d1c/d41/d51/d90 0 2024-09-21T11:39:11.415 INFO:tasks.workunit.client.1.smithi149.stdout:3/479: creat d6/d1f/d47/d37/d50/fb0 x:0 0 0 2024-09-21T11:39:11.415 INFO:tasks.workunit.client.1.smithi149.stdout:6/422: dwrite d8/da/d2c/d52/f5c [0,4194304] 0 2024-09-21T11:39:11.417 INFO:tasks.workunit.client.1.smithi149.stdout:2/553: creat d8/da/d13/d1a/d29/fc8 x:0 0 0 2024-09-21T11:39:11.418 INFO:tasks.workunit.client.1.smithi149.stdout:6/423: chown d8/da/d2c/d52/d5e/d69/l76 1927 1 2024-09-21T11:39:11.418 INFO:tasks.workunit.client.1.smithi149.stdout:9/477: link d18/d19/d1a/d2f/d33/d91/f96 d18/d1c/f98 0 2024-09-21T11:39:11.420 INFO:tasks.workunit.client.1.smithi149.stdout:1/451: rename d2/f5e to d2/dd/d35/d1c/d41/d51/d90/f91 0 2024-09-21T11:39:11.421 INFO:tasks.workunit.client.1.smithi149.stdout:2/554: write d8/d20/d78/f93 [7922368,9061] 0 2024-09-21T11:39:11.424 INFO:tasks.workunit.client.1.smithi149.stdout:9/478: mkdir d18/d36/d3c/d47/d99 0 2024-09-21T11:39:11.424 INFO:tasks.workunit.client.1.smithi149.stdout:6/424: unlink d8/da/d3d/d85/c80 0 2024-09-21T11:39:11.424 INFO:tasks.workunit.client.1.smithi149.stdout:3/480: rename d6/d5f/f72 to d6/d5f/d60/d88/fb1 0 2024-09-21T11:39:11.424 INFO:tasks.workunit.client.1.smithi149.stdout:2/555: rmdir d8/dd/d5c/d60/d67/d8a 39 2024-09-21T11:39:11.425 INFO:tasks.workunit.client.1.smithi149.stdout:9/479: unlink d18/d19/d1a/d2f/f75 0 2024-09-21T11:39:11.426 INFO:tasks.workunit.client.1.smithi149.stdout:6/425: symlink d8/da/d3d/l8a 0 2024-09-21T11:39:11.427 INFO:tasks.workunit.client.1.smithi149.stdout:1/452: rename d2/d2b/d6e/l80 to d2/dd/l92 0 2024-09-21T11:39:11.429 INFO:tasks.workunit.client.1.smithi149.stdout:3/481: mknod d6/cb2 0 2024-09-21T11:39:11.430 INFO:tasks.workunit.client.1.smithi149.stdout:6/426: symlink d8/d32/d37/d28/d2f/d6a/d72/l8b 0 2024-09-21T11:39:11.431 INFO:tasks.workunit.client.1.smithi149.stdout:9/480: read d18/d19/d1a/f23 [1029019,105066] 0 2024-09-21T11:39:11.434 INFO:tasks.workunit.client.1.smithi149.stdout:2/556: dwrite d8/dd/d5c/f76 [0,4194304] 0 2024-09-21T11:39:11.462 INFO:tasks.workunit.client.1.smithi149.stdout:4/532: sync 2024-09-21T11:39:11.467 INFO:tasks.workunit.client.1.smithi149.stdout:2/557: creat d8/da/d13/d83/fc9 x:0 0 0 2024-09-21T11:39:11.467 INFO:tasks.workunit.client.1.smithi149.stdout:1/453: dwrite d2/dd/d2e/d4c/f52 [4194304,4194304] 0 2024-09-21T11:39:11.469 INFO:tasks.workunit.client.1.smithi149.stdout:2/558: fsync d8/dd/f38 0 2024-09-21T11:39:11.470 INFO:tasks.workunit.client.1.smithi149.stdout:5/537: dread d4/f2f [0,4194304] 0 2024-09-21T11:39:11.470 INFO:tasks.workunit.client.1.smithi149.stdout:1/454: chown d2/d5/d3d/d88/l70 143204 1 2024-09-21T11:39:11.471 INFO:tasks.workunit.client.1.smithi149.stdout:3/482: dread d6/f8 [0,4194304] 0 2024-09-21T11:39:11.472 INFO:tasks.workunit.client.1.smithi149.stdout:3/483: chown d6/d1f/d27/f5b 5 1 2024-09-21T11:39:11.472 INFO:tasks.workunit.client.1.smithi149.stdout:4/533: rename d4/d6/d63/d10/c7a to d4/d6/d63/d10/d31/d32/d4a/cc0 0 2024-09-21T11:39:11.475 INFO:tasks.workunit.client.1.smithi149.stdout:2/559: rename d8/da/d13/d1a/d3b/l49 to d8/d20/d78/lca 0 2024-09-21T11:39:11.480 INFO:tasks.workunit.client.1.smithi149.stdout:3/484: getdents d6/d1f/d27/d83 0 2024-09-21T11:39:11.481 INFO:tasks.workunit.client.1.smithi149.stdout:2/560: unlink d8/da/d13/f95 0 2024-09-21T11:39:11.483 INFO:tasks.workunit.client.1.smithi149.stdout:1/455: dwrite d2/d5/d8/f48 [0,4194304] 0 2024-09-21T11:39:11.489 INFO:tasks.workunit.client.1.smithi149.stdout:4/534: dwrite d4/d4d/d58/f79 [0,4194304] 0 2024-09-21T11:39:11.490 INFO:tasks.workunit.client.1.smithi149.stdout:3/485: creat d6/d1f/d47/fb3 x:0 0 0 2024-09-21T11:39:11.493 INFO:tasks.workunit.client.1.smithi149.stdout:2/561: rename d8/da/d13/d5d/da0 to d8/dcb 0 2024-09-21T11:39:11.497 INFO:tasks.workunit.client.1.smithi149.stdout:2/562: write d8/da/d13/f2e [590610,61525] 0 2024-09-21T11:39:11.497 INFO:tasks.workunit.client.1.smithi149.stdout:3/486: creat d6/d1f/d4c/fb4 x:0 0 0 2024-09-21T11:39:11.499 INFO:tasks.workunit.client.1.smithi149.stdout:2/563: chown d8/da/d13/d1a/d29/f69 171813184 1 2024-09-21T11:39:11.504 INFO:tasks.workunit.client.1.smithi149.stdout:2/564: write d8/dd/f24 [2255029,119933] 0 2024-09-21T11:39:11.505 INFO:tasks.workunit.client.1.smithi149.stdout:4/535: dread d4/d6/d63/d10/f86 [0,4194304] 0 2024-09-21T11:39:11.505 INFO:tasks.workunit.client.1.smithi149.stdout:5/538: dread d4/d7/f31 [4194304,4194304] 0 2024-09-21T11:39:11.505 INFO:tasks.workunit.client.1.smithi149.stdout:1/456: link d2/dd/d2e/f33 d2/dd/d35/d1c/d41/d51/d73/f93 0 2024-09-21T11:39:11.505 INFO:tasks.workunit.client.1.smithi149.stdout:5/539: stat d4/d1d/d3e/f84 0 2024-09-21T11:39:11.506 INFO:tasks.workunit.client.1.smithi149.stdout:1/457: write d2/dd/d35/d1c/d37/f61 [303056,107929] 0 2024-09-21T11:39:11.506 INFO:tasks.workunit.client.1.smithi149.stdout:2/565: creat d8/dd/d5c/d60/fcc x:0 0 0 2024-09-21T11:39:11.507 INFO:tasks.workunit.client.1.smithi149.stdout:2/566: chown d8/da/d13/d1a 50902 1 2024-09-21T11:39:11.508 INFO:tasks.workunit.client.0.smithi118.stdout:0/187: truncate d5/f7 3744513 0 2024-09-21T11:39:11.509 INFO:tasks.workunit.client.1.smithi149.stdout:5/540: write f2 [3898165,118323] 0 2024-09-21T11:39:11.510 INFO:tasks.workunit.client.1.smithi149.stdout:5/541: chown d4/d7 12 1 2024-09-21T11:39:11.513 INFO:tasks.workunit.client.1.smithi149.stdout:0/413: sync 2024-09-21T11:39:11.514 INFO:tasks.workunit.client.0.smithi118.stdout:0/188: creat d5/d34/f3c x:0 0 0 2024-09-21T11:39:11.515 INFO:tasks.workunit.client.1.smithi149.stdout:2/567: creat d8/dcb/fcd x:0 0 0 2024-09-21T11:39:11.515 INFO:tasks.workunit.client.1.smithi149.stdout:1/458: dwrite d2/d2b/d6e/f6f [0,4194304] 0 2024-09-21T11:39:11.517 INFO:tasks.workunit.client.0.smithi118.stdout:0/189: mkdir d5/d10/d1e/d3d 0 2024-09-21T11:39:11.518 INFO:tasks.workunit.client.1.smithi149.stdout:0/414: read dd/d1a/d1b/f27 [2816780,22945] 0 2024-09-21T11:39:11.518 INFO:tasks.workunit.client.0.smithi118.stdout:0/190: write d5/d10/f14 [3238448,92141] 0 2024-09-21T11:39:11.519 INFO:tasks.workunit.client.0.smithi118.stdout:0/191: write d5/f8 [764331,51143] 0 2024-09-21T11:39:11.520 INFO:tasks.workunit.client.1.smithi149.stdout:3/487: truncate d6/d1f/d47/d22/d8d/fae 290433 0 2024-09-21T11:39:11.521 INFO:tasks.workunit.client.0.smithi118.stdout:0/192: write d5/f13 [415070,71554] 0 2024-09-21T11:39:11.521 INFO:tasks.workunit.client.1.smithi149.stdout:1/459: chown d2/dd/d35/d1c/d7a/f81 321 1 2024-09-21T11:39:11.522 INFO:tasks.workunit.client.1.smithi149.stdout:4/536: getdents d4/d6/d63/d15/d30/d6b/db3 0 2024-09-21T11:39:11.523 INFO:tasks.workunit.client.1.smithi149.stdout:1/460: rename d2/dd/d2e to d2/dd/d2e/d94 22 2024-09-21T11:39:11.524 INFO:tasks.workunit.client.1.smithi149.stdout:4/537: chown d4/d6/d63/d15/laf 4094 1 2024-09-21T11:39:11.525 INFO:tasks.workunit.client.1.smithi149.stdout:5/542: dwrite d4/d7/d40/f97 [0,4194304] 0 2024-09-21T11:39:11.526 INFO:tasks.workunit.client.1.smithi149.stdout:4/538: write d4/d4d/d5f/f87 [4263010,79326] 0 2024-09-21T11:39:11.530 INFO:tasks.workunit.client.1.smithi149.stdout:4/539: dread - d4/d6/d63/d10/d31/fbc zero size 2024-09-21T11:39:11.531 INFO:tasks.workunit.client.1.smithi149.stdout:3/488: rmdir d6/d1f/d27/d83 39 2024-09-21T11:39:11.531 INFO:tasks.workunit.client.0.smithi118.stdout:0/193: truncate d5/d10/f28 705528 0 2024-09-21T11:39:11.538 INFO:tasks.workunit.client.0.smithi118.stdout:0/194: creat d5/d10/d1e/d23/d3a/f3e x:0 0 0 2024-09-21T11:39:11.540 INFO:tasks.workunit.client.0.smithi118.stdout:0/195: write d5/d10/d1e/d20/f2b [490237,21103] 0 2024-09-21T11:39:11.542 INFO:tasks.workunit.client.1.smithi149.stdout:2/568: creat d8/d11/fce x:0 0 0 2024-09-21T11:39:11.543 INFO:tasks.workunit.client.0.smithi118.stdout:0/196: chown d5/l1b 2076752 1 2024-09-21T11:39:11.545 INFO:tasks.workunit.client.1.smithi149.stdout:5/543: mkdir d4/d1d/d50/d54/db2 0 2024-09-21T11:39:11.548 INFO:tasks.workunit.client.1.smithi149.stdout:2/569: rename d8/dd/f2b to d8/d11/dac/fcf 0 2024-09-21T11:39:11.548 INFO:tasks.workunit.client.0.smithi118.stdout:0/197: dwrite d5/d10/d1e/d33/f35 [0,4194304] 0 2024-09-21T11:39:11.550 INFO:tasks.workunit.client.1.smithi149.stdout:5/544: truncate d4/d1d/d3e/f96 780930 0 2024-09-21T11:39:11.552 INFO:tasks.workunit.client.1.smithi149.stdout:7/582: symlink d12/d90/d4a/d4f/d75/d94/d47/dab/lb0 0 2024-09-21T11:39:11.553 INFO:tasks.workunit.client.0.smithi118.stdout:0/198: mknod d5/d10/d1e/d21/d2a/c3f 0 2024-09-21T11:39:11.556 INFO:tasks.workunit.client.1.smithi149.stdout:8/432: sync 2024-09-21T11:39:11.556 INFO:tasks.workunit.client.1.smithi149.stdout:6/427: sync 2024-09-21T11:39:11.557 INFO:tasks.workunit.client.0.smithi118.stdout:0/199: mkdir d5/d34/d40 0 2024-09-21T11:39:11.557 INFO:tasks.workunit.client.1.smithi149.stdout:2/570: mkdir d8/d11/d88/dd0 0 2024-09-21T11:39:11.558 INFO:tasks.workunit.client.1.smithi149.stdout:7/583: unlink d12/ca7 0 2024-09-21T11:39:11.559 INFO:tasks.workunit.client.1.smithi149.stdout:2/571: dread - d8/da/d13/d1a/d3b/f61 zero size 2024-09-21T11:39:11.559 INFO:tasks.workunit.client.1.smithi149.stdout:1/461: dread d2/dd/d35/d1c/d2c/f69 [0,4194304] 0 2024-09-21T11:39:11.560 INFO:tasks.workunit.client.1.smithi149.stdout:2/572: fdatasync d8/dd/f24 0 2024-09-21T11:39:11.561 INFO:tasks.workunit.client.1.smithi149.stdout:1/462: dread - d2/dd/d35/f8d zero size 2024-09-21T11:39:11.563 INFO:tasks.workunit.client.0.smithi118.stdout:0/200: dwrite d5/d10/d1e/d20/f2b [0,4194304] 0 2024-09-21T11:39:11.566 INFO:tasks.workunit.client.1.smithi149.stdout:7/584: dwrite d12/d90/d68/f7b [4194304,4194304] 0 2024-09-21T11:39:11.571 INFO:tasks.workunit.client.1.smithi149.stdout:1/463: unlink d2/d2b/c2f 0 2024-09-21T11:39:11.573 INFO:tasks.workunit.client.1.smithi149.stdout:1/464: write d2/d5/f85 [336906,127810] 0 2024-09-21T11:39:11.578 INFO:tasks.workunit.client.1.smithi149.stdout:5/545: link d4/lf d4/lb3 0 2024-09-21T11:39:11.580 INFO:tasks.workunit.client.1.smithi149.stdout:9/481: truncate d18/d36/d3c/d47/f66 2641375 0 2024-09-21T11:39:11.582 INFO:tasks.workunit.client.1.smithi149.stdout:8/433: getdents d3/dd/d18/d2e 0 2024-09-21T11:39:11.583 INFO:tasks.workunit.client.1.smithi149.stdout:2/573: truncate d8/dd/f38 4288348 0 2024-09-21T11:39:11.583 INFO:tasks.workunit.client.1.smithi149.stdout:7/585: dwrite d12/d90/d4a/d4f/d75/d94/f98 [0,4194304] 0 2024-09-21T11:39:11.586 INFO:tasks.workunit.client.1.smithi149.stdout:1/465: symlink d2/l95 0 2024-09-21T11:39:11.586 INFO:tasks.workunit.client.1.smithi149.stdout:9/482: creat d18/d4c/d5b/f9a x:0 0 0 2024-09-21T11:39:11.587 INFO:tasks.workunit.client.1.smithi149.stdout:8/434: creat d3/d12/d6e/f94 x:0 0 0 2024-09-21T11:39:11.588 INFO:tasks.workunit.client.1.smithi149.stdout:8/435: chown d3/dd/d21/d54/c58 1041882 1 2024-09-21T11:39:11.590 INFO:tasks.workunit.client.1.smithi149.stdout:7/586: readlink d12/d90/d4a/d4f/d75/l79 0 2024-09-21T11:39:11.592 INFO:tasks.workunit.client.1.smithi149.stdout:1/466: mkdir d2/d5/d65/d96 0 2024-09-21T11:39:11.593 INFO:tasks.workunit.client.1.smithi149.stdout:1/467: write d2/dd/f30 [77735,119642] 0 2024-09-21T11:39:11.596 INFO:tasks.workunit.client.1.smithi149.stdout:8/436: mkdir d3/d33/d34/d55/d95 0 2024-09-21T11:39:11.599 INFO:tasks.workunit.client.1.smithi149.stdout:1/468: dwrite d2/d5/d8/f1f [0,4194304] 0 2024-09-21T11:39:11.600 INFO:tasks.workunit.client.1.smithi149.stdout:5/546: truncate d4/d7/f45 4101586 0 2024-09-21T11:39:11.601 INFO:tasks.workunit.client.1.smithi149.stdout:5/547: chown d4/d7/d40/d51/d56/f70 9987 1 2024-09-21T11:39:11.602 INFO:tasks.workunit.client.1.smithi149.stdout:9/483: mkdir d18/d19/d1a/d9b 0 2024-09-21T11:39:11.605 INFO:tasks.workunit.client.1.smithi149.stdout:2/574: rmdir d8/da/d13/d5d/d6a/d8e 0 2024-09-21T11:39:11.607 INFO:tasks.workunit.client.1.smithi149.stdout:5/548: readlink d4/d1d/d50/d54/l1f 0 2024-09-21T11:39:11.609 INFO:tasks.workunit.client.1.smithi149.stdout:0/415: write dd/d1a/f2c [4122882,31122] 0 2024-09-21T11:39:11.611 INFO:tasks.workunit.client.1.smithi149.stdout:0/416: write dd/d1a/d5a/d65/f7b [1003131,21325] 0 2024-09-21T11:39:11.614 INFO:tasks.workunit.client.1.smithi149.stdout:0/417: write dd/d1a/d1b/d50/d53/d3a/f5b [4694537,26390] 0 2024-09-21T11:39:11.616 INFO:tasks.workunit.client.1.smithi149.stdout:4/540: dwrite d4/d6/d63/d15/d30/f37 [0,4194304] 0 2024-09-21T11:39:11.616 INFO:tasks.workunit.client.1.smithi149.stdout:7/587: getdents d12/d90/d4a/d9e 0 2024-09-21T11:39:11.617 INFO:tasks.workunit.client.1.smithi149.stdout:4/541: dread - d4/f80 zero size 2024-09-21T11:39:11.618 INFO:tasks.workunit.client.1.smithi149.stdout:0/418: rmdir dd/d1a/d1b/d50/d5d 39 2024-09-21T11:39:11.619 INFO:tasks.workunit.client.1.smithi149.stdout:2/575: creat d8/d11/fd1 x:0 0 0 2024-09-21T11:39:11.619 INFO:tasks.workunit.client.1.smithi149.stdout:7/588: mkdir d12/d90/d4a/d6c/db1 0 2024-09-21T11:39:11.621 INFO:tasks.workunit.client.1.smithi149.stdout:0/419: rmdir dd 39 2024-09-21T11:39:11.622 INFO:tasks.workunit.client.1.smithi149.stdout:2/576: unlink d8/d20/d57/l65 0 2024-09-21T11:39:11.623 INFO:tasks.workunit.client.1.smithi149.stdout:4/542: creat d4/d4d/d58/db4/fc1 x:0 0 0 2024-09-21T11:39:11.624 INFO:tasks.workunit.client.1.smithi149.stdout:4/543: chown d4/d6/d63/d15/d30/d6b/daa/fac 227 1 2024-09-21T11:39:11.625 INFO:tasks.workunit.client.1.smithi149.stdout:2/577: creat d8/dd/d50/fd2 x:0 0 0 2024-09-21T11:39:11.629 INFO:tasks.workunit.client.1.smithi149.stdout:2/578: dwrite d8/f46 [0,4194304] 0 2024-09-21T11:39:11.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/579: rmdir d8/da/d13/d2d/d6f 39 2024-09-21T11:39:11.637 INFO:tasks.workunit.client.1.smithi149.stdout:2/580: dread d8/dd/f24 [0,4194304] 0 2024-09-21T11:39:11.638 INFO:tasks.workunit.client.1.smithi149.stdout:2/581: chown l6 995648 1 2024-09-21T11:39:11.638 INFO:tasks.workunit.client.1.smithi149.stdout:2/582: chown d8/d11 990379 1 2024-09-21T11:39:11.640 INFO:tasks.workunit.client.1.smithi149.stdout:2/583: mkdir d8/dcb/db8/dd3 0 2024-09-21T11:39:11.643 INFO:tasks.workunit.client.1.smithi149.stdout:2/584: mkdir d8/d11/d88/dd4 0 2024-09-21T11:39:11.644 INFO:tasks.workunit.client.1.smithi149.stdout:2/585: chown d8/d11/c35 27 1 2024-09-21T11:39:11.649 INFO:tasks.workunit.client.1.smithi149.stdout:6/428: sync 2024-09-21T11:39:11.649 INFO:tasks.workunit.client.1.smithi149.stdout:4/544: dread d4/d6/d63/f28 [8388608,4194304] 0 2024-09-21T11:39:11.656 INFO:tasks.workunit.client.1.smithi149.stdout:2/586: dwrite d8/da/d13/d2d/f34 [4194304,4194304] 0 2024-09-21T11:39:11.656 INFO:tasks.workunit.client.1.smithi149.stdout:4/545: symlink d4/d6/d63/d15/d16/lc2 0 2024-09-21T11:39:11.660 INFO:tasks.workunit.client.1.smithi149.stdout:6/429: dread d8/d32/d37/d28/f33 [0,4194304] 0 2024-09-21T11:39:11.667 INFO:tasks.workunit.client.1.smithi149.stdout:3/489: link d6/d5f/d60/d88/fb1 d6/d79/d7e/fb5 0 2024-09-21T11:39:11.668 INFO:tasks.workunit.client.1.smithi149.stdout:1/469: write d2/dd/d2e/f77 [2857694,5187] 0 2024-09-21T11:39:11.670 INFO:tasks.workunit.client.1.smithi149.stdout:3/490: readlink d6/d1f/l51 0 2024-09-21T11:39:11.670 INFO:tasks.workunit.client.1.smithi149.stdout:9/484: truncate d18/d36/d3c/f3f 8073844 0 2024-09-21T11:39:11.671 INFO:tasks.workunit.client.1.smithi149.stdout:6/430: truncate d8/d32/d37/d28/d2e/f66 883592 0 2024-09-21T11:39:11.671 INFO:tasks.workunit.client.1.smithi149.stdout:4/546: dwrite d4/d6/d63/d2d/f6e [0,4194304] 0 2024-09-21T11:39:11.675 INFO:tasks.workunit.client.1.smithi149.stdout:1/470: rmdir d2/dd/d35/d5b 39 2024-09-21T11:39:11.676 INFO:tasks.workunit.client.1.smithi149.stdout:2/587: dwrite d8/dd/d8c/fa1 [0,4194304] 0 2024-09-21T11:39:11.677 INFO:tasks.workunit.client.1.smithi149.stdout:8/437: dwrite d3/d33/d34/d55/f59 [0,4194304] 0 2024-09-21T11:39:11.680 INFO:tasks.workunit.client.1.smithi149.stdout:0/420: truncate dd/d2d/f4b 222300 0 2024-09-21T11:39:11.683 INFO:tasks.workunit.client.1.smithi149.stdout:5/549: truncate d4/d7/f27 1106365 0 2024-09-21T11:39:11.686 INFO:tasks.workunit.client.1.smithi149.stdout:4/547: mknod d4/d4d/d58/db4/cc3 0 2024-09-21T11:39:11.693 INFO:tasks.workunit.client.1.smithi149.stdout:9/485: rename d18/d19/d1a/l70 to d18/d19/d1a/d2f/d33/d91/l9c 0 2024-09-21T11:39:11.694 INFO:tasks.workunit.client.1.smithi149.stdout:6/431: mknod d8/d32/d37/d28/d87/c8c 0 2024-09-21T11:39:11.695 INFO:tasks.workunit.client.1.smithi149.stdout:7/589: dwrite d12/d90/d4a/d4f/d75/d94/faf [0,4194304] 0 2024-09-21T11:39:11.695 INFO:tasks.workunit.client.1.smithi149.stdout:5/550: fsync d4/d1d/d50/d54/d2a/f67 0 2024-09-21T11:39:11.698 INFO:tasks.workunit.client.1.smithi149.stdout:4/548: symlink d4/d6/d63/d15/d30/d6b/lc4 0 2024-09-21T11:39:11.698 INFO:tasks.workunit.client.1.smithi149.stdout:6/432: dread - d8/da/f4e zero size 2024-09-21T11:39:11.700 INFO:tasks.workunit.client.1.smithi149.stdout:1/471: rename d2/d2b/d6e/f87 to d2/dd/d35/d1c/d2c/f97 0 2024-09-21T11:39:11.700 INFO:tasks.workunit.client.1.smithi149.stdout:9/486: chown d18/d19/d29/d39 36448017 1 2024-09-21T11:39:11.700 INFO:tasks.workunit.client.1.smithi149.stdout:2/588: truncate d8/dd/f38 2631479 0 2024-09-21T11:39:11.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/590: rmdir d12/d90/d4a/d4f/d75/d94/d47/dab 39 2024-09-21T11:39:11.707 INFO:tasks.workunit.client.1.smithi149.stdout:2/589: fsync d8/d11/f3a 0 2024-09-21T11:39:11.707 INFO:tasks.workunit.client.1.smithi149.stdout:8/438: dwrite d3/f17 [0,4194304] 0 2024-09-21T11:39:11.709 INFO:tasks.workunit.client.1.smithi149.stdout:6/433: rename d8/da/d11/c58 to d8/da/d2c/d52/c8d 0 2024-09-21T11:39:11.711 INFO:tasks.workunit.client.1.smithi149.stdout:4/549: creat d4/d6/d63/fc5 x:0 0 0 2024-09-21T11:39:11.712 INFO:tasks.workunit.client.1.smithi149.stdout:8/439: mknod d3/d12/c96 0 2024-09-21T11:39:11.715 INFO:tasks.workunit.client.1.smithi149.stdout:6/434: creat d8/d32/d37/d28/d2f/f8e x:0 0 0 2024-09-21T11:39:11.715 INFO:tasks.workunit.client.1.smithi149.stdout:8/440: stat d3/d12/d6e/d79/d8e 0 2024-09-21T11:39:11.715 INFO:tasks.workunit.client.1.smithi149.stdout:5/551: dwrite d4/d1d/f6b [0,4194304] 0 2024-09-21T11:39:11.715 INFO:tasks.workunit.client.1.smithi149.stdout:7/591: creat d12/d90/d4a/d6c/db1/fb2 x:0 0 0 2024-09-21T11:39:11.719 INFO:tasks.workunit.client.1.smithi149.stdout:9/487: getdents d18/d19/d1a/d2f 0 2024-09-21T11:39:11.723 INFO:tasks.workunit.client.1.smithi149.stdout:8/441: dread - d3/dd/d21/d54/d5c/d6d/f8d zero size 2024-09-21T11:39:11.727 INFO:tasks.workunit.client.1.smithi149.stdout:7/592: fdatasync d12/d90/d4a/f87 0 2024-09-21T11:39:11.728 INFO:tasks.workunit.client.1.smithi149.stdout:6/435: rename d8/d32/d37/c57 to d8/d32/d37/d2b/d4a/c8f 0 2024-09-21T11:39:11.729 INFO:tasks.workunit.client.1.smithi149.stdout:2/590: dwrite d8/da/d13/d5d/d6a/f8b [0,4194304] 0 2024-09-21T11:39:11.730 INFO:tasks.workunit.client.1.smithi149.stdout:5/552: write d4/d1d/d50/d54/f23 [1103488,103138] 0 2024-09-21T11:39:11.733 INFO:tasks.workunit.client.1.smithi149.stdout:4/550: link d4/d6/d63/d78/d98/lb6 d4/d6/d63/d15/d30/da6/lc6 0 2024-09-21T11:39:11.733 INFO:tasks.workunit.client.1.smithi149.stdout:3/491: truncate d6/d1f/d47/f74 3223564 0 2024-09-21T11:39:11.735 INFO:tasks.workunit.client.1.smithi149.stdout:9/488: creat d18/d19/d1a/d2f/d30/d90/f9d x:0 0 0 2024-09-21T11:39:11.737 INFO:tasks.workunit.client.1.smithi149.stdout:7/593: mknod d12/d90/d4a/d4f/cb3 0 2024-09-21T11:39:11.740 INFO:tasks.workunit.client.1.smithi149.stdout:6/436: creat d8/d32/d37/f90 x:0 0 0 2024-09-21T11:39:11.741 INFO:tasks.workunit.client.1.smithi149.stdout:2/591: creat d8/d44/d63/fd5 x:0 0 0 2024-09-21T11:39:11.742 INFO:tasks.workunit.client.1.smithi149.stdout:6/437: chown d8/d32/f55 6 1 2024-09-21T11:39:11.743 INFO:tasks.workunit.client.1.smithi149.stdout:8/442: dread d3/f20 [0,4194304] 0 2024-09-21T11:39:11.744 INFO:tasks.workunit.client.1.smithi149.stdout:3/492: creat d6/d1f/d47/d37/d50/fb6 x:0 0 0 2024-09-21T11:39:11.745 INFO:tasks.workunit.client.1.smithi149.stdout:4/551: rename d4/d6/f8b to d4/d4d/d58/fc7 0 2024-09-21T11:39:11.745 INFO:tasks.workunit.client.1.smithi149.stdout:1/472: write d2/dd/f71 [616319,2637] 0 2024-09-21T11:39:11.746 INFO:tasks.workunit.client.1.smithi149.stdout:7/594: symlink d12/d90/d4a/d4f/d75/lb4 0 2024-09-21T11:39:11.748 INFO:tasks.workunit.client.1.smithi149.stdout:9/489: dwrite d18/d1c/f46 [0,4194304] 0 2024-09-21T11:39:11.748 INFO:tasks.workunit.client.1.smithi149.stdout:1/473: chown d2/dd/d35/d1c/d41/d51 0 1 2024-09-21T11:39:11.750 INFO:tasks.workunit.client.1.smithi149.stdout:2/592: unlink d8/dd/f5f 0 2024-09-21T11:39:11.751 INFO:tasks.workunit.client.1.smithi149.stdout:8/443: mknod d3/dd/d21/d54/d5c/d6d/c97 0 2024-09-21T11:39:11.756 INFO:tasks.workunit.client.1.smithi149.stdout:6/438: rename d8/d32/d37/d28/d2e/f3e to d8/d32/d70/f91 0 2024-09-21T11:39:11.757 INFO:tasks.workunit.client.1.smithi149.stdout:4/552: creat d4/d6/d63/d10/d6f/fc8 x:0 0 0 2024-09-21T11:39:11.781 INFO:tasks.workunit.client.1.smithi149.stdout:2/593: unlink d8/da/d13/d1a/d29/cb2 0 2024-09-21T11:39:11.782 INFO:tasks.workunit.client.1.smithi149.stdout:3/493: mknod d6/d5f/d6d/d96/cb7 0 2024-09-21T11:39:11.782 INFO:tasks.workunit.client.1.smithi149.stdout:8/444: chown d3/d3c/c57 27176598 1 2024-09-21T11:39:11.783 INFO:tasks.workunit.client.1.smithi149.stdout:0/421: dwrite dd/d2d/f4b [0,4194304] 0 2024-09-21T11:39:11.783 INFO:tasks.workunit.client.1.smithi149.stdout:6/439: mkdir d8/da/d3d/d92 0 2024-09-21T11:39:11.784 INFO:tasks.workunit.client.1.smithi149.stdout:4/553: symlink d4/d6/d63/d78/lc9 0 2024-09-21T11:39:11.786 INFO:tasks.workunit.client.1.smithi149.stdout:5/553: truncate d4/d7/f4e 653500 0 2024-09-21T11:39:11.787 INFO:tasks.workunit.client.1.smithi149.stdout:2/594: fdatasync d8/d44/d63/f75 0 2024-09-21T11:39:11.787 INFO:tasks.workunit.client.1.smithi149.stdout:9/490: rename d18/d4c/d5b/l7e to d18/d19/d1a/d2f/d30/d54/d8c/l9e 0 2024-09-21T11:39:11.788 INFO:tasks.workunit.client.1.smithi149.stdout:5/554: chown d4/d7/d40/c9c 311370 1 2024-09-21T11:39:11.789 INFO:tasks.workunit.client.1.smithi149.stdout:8/445: mkdir d3/d12/d98 0 2024-09-21T11:39:11.789 INFO:tasks.workunit.client.1.smithi149.stdout:9/491: dread - d18/d36/d3c/d47/d76/f86 zero size 2024-09-21T11:39:11.792 INFO:tasks.workunit.client.1.smithi149.stdout:0/422: truncate dd/d1a/d1b/f27 1302210 0 2024-09-21T11:39:11.793 INFO:tasks.workunit.client.1.smithi149.stdout:4/554: rmdir d4/d6/d63/d15/d30/d6b/daa 39 2024-09-21T11:39:11.794 INFO:tasks.workunit.client.1.smithi149.stdout:7/595: getdents d12/d90/d4a/d6c/da0 0 2024-09-21T11:39:11.796 INFO:tasks.workunit.client.1.smithi149.stdout:7/596: write d12/d90/d68/f7b [6037179,115628] 0 2024-09-21T11:39:11.796 INFO:tasks.workunit.client.1.smithi149.stdout:2/595: stat d8/dcb/cbb 0 2024-09-21T11:39:11.797 INFO:tasks.workunit.client.1.smithi149.stdout:5/555: read d4/d7/d40/f42 [116577,41044] 0 2024-09-21T11:39:11.799 INFO:tasks.workunit.client.1.smithi149.stdout:5/556: chown d4/d7/d40/d43/f95 136047 1 2024-09-21T11:39:11.800 INFO:tasks.workunit.client.1.smithi149.stdout:0/423: creat dd/d1a/d5a/f95 x:0 0 0 2024-09-21T11:39:11.802 INFO:tasks.workunit.client.1.smithi149.stdout:0/424: chown dd/d1a 11612632 1 2024-09-21T11:39:11.802 INFO:tasks.workunit.client.1.smithi149.stdout:3/494: link d6/fc d6/d1f/d4c/fb8 0 2024-09-21T11:39:11.803 INFO:tasks.workunit.client.1.smithi149.stdout:6/440: dread d8/d32/d37/f36 [0,4194304] 0 2024-09-21T11:39:11.804 INFO:tasks.workunit.client.1.smithi149.stdout:2/596: dread d8/dd/f24 [0,4194304] 0 2024-09-21T11:39:11.809 INFO:tasks.workunit.client.1.smithi149.stdout:0/425: creat dd/d1a/d1b/d72/d87/f96 x:0 0 0 2024-09-21T11:39:11.809 INFO:tasks.workunit.client.1.smithi149.stdout:3/495: chown d6/d1f/d47/d22/d8d/d97/l9d 1725968 1 2024-09-21T11:39:11.810 INFO:tasks.workunit.client.1.smithi149.stdout:8/446: link d3/d12/c48 d3/d3c/d8f/d76/c99 0 2024-09-21T11:39:11.812 INFO:tasks.workunit.client.1.smithi149.stdout:6/441: chown d8/da/d2c/d52/c53 26766 1 2024-09-21T11:39:11.813 INFO:tasks.workunit.client.1.smithi149.stdout:0/426: dread - dd/d2d/f91 zero size 2024-09-21T11:39:11.814 INFO:tasks.workunit.client.1.smithi149.stdout:3/496: truncate d6/f38 4623046 0 2024-09-21T11:39:11.817 INFO:tasks.workunit.client.1.smithi149.stdout:2/597: link d8/lab d8/dcb/db8/ld6 0 2024-09-21T11:39:11.818 INFO:tasks.workunit.client.1.smithi149.stdout:8/447: mknod d3/dd/d18/c9a 0 2024-09-21T11:39:11.818 INFO:tasks.workunit.client.1.smithi149.stdout:0/427: write dd/d1a/f44 [833688,4443] 0 2024-09-21T11:39:11.819 INFO:tasks.workunit.client.1.smithi149.stdout:9/492: dread d18/d19/d29/f5c [0,4194304] 0 2024-09-21T11:39:11.820 INFO:tasks.workunit.client.1.smithi149.stdout:3/497: fsync d6/d79/d7e/f89 0 2024-09-21T11:39:11.821 INFO:tasks.workunit.client.1.smithi149.stdout:5/557: dwrite d4/d7/d40/d43/d5c/f66 [0,4194304] 0 2024-09-21T11:39:11.821 INFO:tasks.workunit.client.1.smithi149.stdout:4/555: dread d4/d6/f5e [0,4194304] 0 2024-09-21T11:39:11.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/498: dread - d6/d1f/d4c/fb4 zero size 2024-09-21T11:39:11.828 INFO:tasks.workunit.client.1.smithi149.stdout:7/597: dread d12/d90/f32 [0,4194304] 0 2024-09-21T11:39:11.829 INFO:tasks.workunit.client.1.smithi149.stdout:0/428: write dd/d1a/d1b/d50/d53/f42 [611219,126530] 0 2024-09-21T11:39:11.830 INFO:tasks.workunit.client.1.smithi149.stdout:5/558: mkdir d4/d1d/d50/d60/db1/db4 0 2024-09-21T11:39:11.832 INFO:tasks.workunit.client.1.smithi149.stdout:3/499: creat d6/d1f/fb9 x:0 0 0 2024-09-21T11:39:11.836 INFO:tasks.workunit.client.1.smithi149.stdout:8/448: dwrite d3/fa [0,4194304] 0 2024-09-21T11:39:11.836 INFO:tasks.workunit.client.1.smithi149.stdout:3/500: creat d6/d5f/d6d/fba x:0 0 0 2024-09-21T11:39:11.838 INFO:tasks.workunit.client.1.smithi149.stdout:0/429: mkdir dd/d1a/d1b/d81/d97 0 2024-09-21T11:39:11.839 INFO:tasks.workunit.client.1.smithi149.stdout:5/559: mknod d4/d7/d40/d43/d5c/cb5 0 2024-09-21T11:39:11.839 INFO:tasks.workunit.client.1.smithi149.stdout:4/556: truncate d4/d6/d63/d15/d16/d23/f60 1759592 0 2024-09-21T11:39:11.840 INFO:tasks.workunit.client.1.smithi149.stdout:6/442: dread d8/d32/d37/f3c [0,4194304] 0 2024-09-21T11:39:11.840 INFO:tasks.workunit.client.1.smithi149.stdout:7/598: getdents d12/d5b 0 2024-09-21T11:39:11.840 INFO:tasks.workunit.client.1.smithi149.stdout:5/560: readlink d4/d7/l28 0 2024-09-21T11:39:11.841 INFO:tasks.workunit.client.1.smithi149.stdout:0/430: rmdir dd/d1a/d5a/d65 39 2024-09-21T11:39:11.841 INFO:tasks.workunit.client.1.smithi149.stdout:4/557: fsync d4/d6/f88 0 2024-09-21T11:39:11.842 INFO:tasks.workunit.client.1.smithi149.stdout:3/501: mkdir d6/d1f/d47/dbb 0 2024-09-21T11:39:11.844 INFO:tasks.workunit.client.1.smithi149.stdout:3/502: write d6/d1f/d47/fb3 [846947,35764] 0 2024-09-21T11:39:11.847 INFO:tasks.workunit.client.1.smithi149.stdout:7/599: fdatasync d12/d90/d26/d30/f57 0 2024-09-21T11:39:11.847 INFO:tasks.workunit.client.1.smithi149.stdout:8/449: link d3/dd/f3f d3/d33/f9b 0 2024-09-21T11:39:11.849 INFO:tasks.workunit.client.1.smithi149.stdout:3/503: dread - d6/d1f/d47/d37/d3a/f90 zero size 2024-09-21T11:39:11.850 INFO:tasks.workunit.client.1.smithi149.stdout:4/558: rename d4/d6/d63/d10/d31/l52 to d4/d6/d63/d15/lca 0 2024-09-21T11:39:11.852 INFO:tasks.workunit.client.1.smithi149.stdout:3/504: fsync d6/fa 0 2024-09-21T11:39:11.852 INFO:tasks.workunit.client.1.smithi149.stdout:2/598: dread d8/da/d13/d1a/d3b/f51 [0,4194304] 0 2024-09-21T11:39:11.855 INFO:tasks.workunit.client.1.smithi149.stdout:4/559: fsync d4/d4d/d58/db4/fc1 0 2024-09-21T11:39:11.857 INFO:tasks.workunit.client.1.smithi149.stdout:5/561: write d4/d7/d40/f59 [1617714,7063] 0 2024-09-21T11:39:11.857 INFO:tasks.workunit.client.1.smithi149.stdout:7/600: write d12/d90/d4a/d4f/d75/d94/d47/d49/fa9 [385066,110931] 0 2024-09-21T11:39:11.858 INFO:tasks.workunit.client.1.smithi149.stdout:0/431: dwrite dd/d32/f3c [0,4194304] 0 2024-09-21T11:39:11.860 INFO:tasks.workunit.client.1.smithi149.stdout:2/599: mkdir d8/da/d13/d5d/dd7 0 2024-09-21T11:39:11.861 INFO:tasks.workunit.client.1.smithi149.stdout:6/443: dwrite d8/d32/d37/d28/d2f/d6a/d72/f7f [0,4194304] 0 2024-09-21T11:39:11.861 INFO:tasks.workunit.client.1.smithi149.stdout:3/505: chown d6/d1f/d47/d37/d3a/f6b 1626917364 1 2024-09-21T11:39:11.861 INFO:tasks.workunit.client.1.smithi149.stdout:8/450: write d3/d33/f9b [2594947,28535] 0 2024-09-21T11:39:11.862 INFO:tasks.workunit.client.1.smithi149.stdout:3/506: readlink d6/l93 0 2024-09-21T11:39:11.863 INFO:tasks.workunit.client.1.smithi149.stdout:0/432: chown dd/d1a/d1b/d50/d53/f54 2 1 2024-09-21T11:39:11.864 INFO:tasks.workunit.client.1.smithi149.stdout:6/444: dread - d8/da/d14/f4c zero size 2024-09-21T11:39:11.865 INFO:tasks.workunit.client.0.smithi118.stdout:8/133: sync 2024-09-21T11:39:11.866 INFO:tasks.workunit.client.1.smithi149.stdout:5/562: rmdir d4/d1d/d50/d54/d2a/d71 0 2024-09-21T11:39:11.867 INFO:tasks.workunit.client.1.smithi149.stdout:4/560: link d4/d6/d63/d10/c14 d4/d4d/d58/ccb 0 2024-09-21T11:39:11.869 INFO:tasks.workunit.client.1.smithi149.stdout:8/451: stat d3/d3c/d8f/d76/c99 0 2024-09-21T11:39:11.871 INFO:tasks.workunit.client.0.smithi118.stdout:8/134: dread d2/dc/d10/d2e/d18/d1a/f1f [0,4194304] 0 2024-09-21T11:39:11.873 INFO:tasks.workunit.client.0.smithi118.stdout:8/135: fdatasync d2/f29 0 2024-09-21T11:39:11.874 INFO:tasks.workunit.client.1.smithi149.stdout:5/563: write d4/d7/d40/d43/d5c/d7a/d81/f83 [2957176,125980] 0 2024-09-21T11:39:11.876 INFO:tasks.workunit.client.1.smithi149.stdout:4/561: mkdir d4/d6/d63/d78/d98/dcc 0 2024-09-21T11:39:11.876 INFO:tasks.workunit.client.1.smithi149.stdout:8/452: creat d3/d33/d34/d72/f9c x:0 0 0 2024-09-21T11:39:11.877 INFO:tasks.workunit.client.0.smithi118.stdout:8/136: symlink d2/dc/d16/l31 0 2024-09-21T11:39:11.878 INFO:tasks.workunit.client.1.smithi149.stdout:3/507: getdents d6/d5f/d6d/d96 0 2024-09-21T11:39:11.878 INFO:tasks.workunit.client.1.smithi149.stdout:7/601: dwrite d12/d90/d4a/f93 [0,4194304] 0 2024-09-21T11:39:11.880 INFO:tasks.workunit.client.1.smithi149.stdout:8/453: unlink d3/c6 0 2024-09-21T11:39:11.882 INFO:tasks.workunit.client.1.smithi149.stdout:6/445: rename d8/d32/d37/d28/d2f/f65 to d8/d32/d37/d2b/d51/f93 0 2024-09-21T11:39:11.886 INFO:tasks.workunit.client.1.smithi149.stdout:8/454: chown d3/dd/d18/l32 2846 1 2024-09-21T11:39:11.887 INFO:tasks.workunit.client.1.smithi149.stdout:3/508: creat d6/d1f/d47/d37/d3a/fbc x:0 0 0 2024-09-21T11:39:11.890 INFO:tasks.workunit.client.1.smithi149.stdout:0/433: dwrite dd/f15 [4194304,4194304] 0 2024-09-21T11:39:11.890 INFO:tasks.workunit.client.1.smithi149.stdout:4/562: rename d4/d6/c4e to d4/d6/d63/d92/ccd 0 2024-09-21T11:39:11.891 INFO:tasks.workunit.client.1.smithi149.stdout:2/600: dread d8/d20/d57/f47 [0,4194304] 0 2024-09-21T11:39:11.891 INFO:tasks.workunit.client.1.smithi149.stdout:6/446: creat d8/d32/d37/d2b/d51/f94 x:0 0 0 2024-09-21T11:39:11.891 INFO:tasks.workunit.client.1.smithi149.stdout:2/601: fdatasync d8/dcb/fcd 0 2024-09-21T11:39:11.893 INFO:tasks.workunit.client.1.smithi149.stdout:2/602: write d8/dd/d50/f5b [5140642,130219] 0 2024-09-21T11:39:11.895 INFO:tasks.workunit.client.1.smithi149.stdout:2/603: fdatasync d8/da/d13/d1a/f3e 0 2024-09-21T11:39:11.896 INFO:tasks.workunit.client.1.smithi149.stdout:6/447: dread d8/d32/d37/f19 [0,4194304] 0 2024-09-21T11:39:11.897 INFO:tasks.workunit.client.1.smithi149.stdout:4/563: symlink d4/d4d/lce 0 2024-09-21T11:39:11.897 INFO:tasks.workunit.client.1.smithi149.stdout:5/564: write d4/d7/d40/d51/f58 [2074866,98638] 0 2024-09-21T11:39:11.898 INFO:tasks.workunit.client.1.smithi149.stdout:1/474: sync 2024-09-21T11:39:11.898 INFO:tasks.workunit.client.0.smithi118.stdout:8/137: dwrite d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:11.899 INFO:tasks.workunit.client.1.smithi149.stdout:8/455: mknod d3/d33/c9d 0 2024-09-21T11:39:11.902 INFO:tasks.workunit.client.1.smithi149.stdout:7/602: write d12/d90/d4a/d4f/d75/f91 [1430127,128970] 0 2024-09-21T11:39:11.903 INFO:tasks.workunit.client.0.smithi118.stdout:8/138: chown d2/l3 0 1 2024-09-21T11:39:11.903 INFO:tasks.workunit.client.0.smithi118.stdout:8/139: readlink d2/dc/lf 0 2024-09-21T11:39:11.903 INFO:tasks.workunit.client.1.smithi149.stdout:6/448: rmdir d8/d32/d37/d28/d87 39 2024-09-21T11:39:11.904 INFO:tasks.workunit.client.1.smithi149.stdout:7/603: write d12/d90/d4a/f76 [3396440,60552] 0 2024-09-21T11:39:11.904 INFO:tasks.workunit.client.0.smithi118.stdout:8/140: read - d2/dc/d10/d2e/d18/f2f zero size 2024-09-21T11:39:11.905 INFO:tasks.workunit.client.1.smithi149.stdout:0/434: mkdir dd/d1a/d1b/d72/d78/d8b/d98 0 2024-09-21T11:39:11.906 INFO:tasks.workunit.client.1.smithi149.stdout:7/604: chown d12/d90/d4a/d4f/f51 1197573 1 2024-09-21T11:39:11.907 INFO:tasks.workunit.client.1.smithi149.stdout:8/456: mkdir d3/d33/d34/d55/d5e/d9e 0 2024-09-21T11:39:11.910 INFO:tasks.workunit.client.1.smithi149.stdout:3/509: creat d6/d1f/fbd x:0 0 0 2024-09-21T11:39:11.910 INFO:tasks.workunit.client.1.smithi149.stdout:2/604: symlink d8/da/d13/ld8 0 2024-09-21T11:39:11.911 INFO:tasks.workunit.client.1.smithi149.stdout:8/457: truncate d3/dd/d21/f4d 4229955 0 2024-09-21T11:39:11.912 INFO:tasks.workunit.client.1.smithi149.stdout:0/435: write dd/d1a/f2f [4602137,13673] 0 2024-09-21T11:39:11.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/605: write d8/da/d13/f21 [5140074,102037] 0 2024-09-21T11:39:11.914 INFO:tasks.workunit.client.1.smithi149.stdout:6/449: creat d8/d32/d37/d28/d2f/d6a/f95 x:0 0 0 2024-09-21T11:39:11.915 INFO:tasks.workunit.client.1.smithi149.stdout:8/458: fsync d3/dd/d21/d54/d5c/f6b 0 2024-09-21T11:39:11.916 INFO:tasks.workunit.client.1.smithi149.stdout:7/605: mkdir d12/d5b/db5 0 2024-09-21T11:39:11.916 INFO:tasks.workunit.client.1.smithi149.stdout:6/450: dread - d8/da/f4e zero size 2024-09-21T11:39:11.917 INFO:tasks.workunit.client.1.smithi149.stdout:3/510: unlink d6/d79/f86 0 2024-09-21T11:39:11.918 INFO:tasks.workunit.client.1.smithi149.stdout:3/511: chown d6/d5f/d6d/d96 1342 1 2024-09-21T11:39:11.918 INFO:tasks.workunit.client.1.smithi149.stdout:4/564: link d4/d6/d63/d15/d30/lba d4/d6/d63/d10/d31/d32/lcf 0 2024-09-21T11:39:11.919 INFO:tasks.workunit.client.0.smithi118.stdout:8/141: dwrite d2/dc/d10/d2e/f21 [0,4194304] 0 2024-09-21T11:39:11.919 INFO:tasks.workunit.client.1.smithi149.stdout:3/512: write d6/d1f/d47/d37/d50/f78 [1010888,12983] 0 2024-09-21T11:39:11.923 INFO:tasks.workunit.client.1.smithi149.stdout:8/459: creat d3/dd/d21/d54/d5c/f9f x:0 0 0 2024-09-21T11:39:11.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/475: rename d2/dd/d35/d1c/d2c/c78 to d2/c98 0 2024-09-21T11:39:11.928 INFO:tasks.workunit.client.0.smithi118.stdout:8/142: mkdir d2/d32 0 2024-09-21T11:39:11.930 INFO:tasks.workunit.client.1.smithi149.stdout:3/513: truncate d6/d1f/d27/f5b 4743355 0 2024-09-21T11:39:11.930 INFO:tasks.workunit.client.1.smithi149.stdout:1/476: fdatasync d2/dd/d35/d1c/d41/d51/f7f 0 2024-09-21T11:39:11.932 INFO:tasks.workunit.client.1.smithi149.stdout:7/606: dread d12/d90/d26/d30/f5a [0,4194304] 0 2024-09-21T11:39:11.932 INFO:tasks.workunit.client.1.smithi149.stdout:5/565: truncate d4/d7/d40/d43/d49/f4b 4572885 0 2024-09-21T11:39:11.932 INFO:tasks.workunit.client.1.smithi149.stdout:2/606: dwrite d8/dd/d5c/d60/d67/d8a/f90 [0,4194304] 0 2024-09-21T11:39:11.933 INFO:tasks.workunit.client.1.smithi149.stdout:6/451: getdents d8/d32/d37/d2b/d7d 0 2024-09-21T11:39:11.933 INFO:tasks.workunit.client.1.smithi149.stdout:3/514: dread - d6/d1f/d47/d22/f49 zero size 2024-09-21T11:39:11.934 INFO:tasks.workunit.client.0.smithi118.stdout:8/143: fdatasync d2/f7 0 2024-09-21T11:39:11.935 INFO:tasks.workunit.client.0.smithi118.stdout:8/144: dread - d2/dc/d10/d2e/d18/f2f zero size 2024-09-21T11:39:11.937 INFO:tasks.workunit.client.1.smithi149.stdout:0/436: rename dd/d1a/d1b/d72/d85/c82 to dd/d1a/d5a/d8a/c99 0 2024-09-21T11:39:11.937 INFO:tasks.workunit.client.1.smithi149.stdout:8/460: dwrite d3/f37 [0,4194304] 0 2024-09-21T11:39:11.937 INFO:tasks.workunit.client.1.smithi149.stdout:5/566: dread - d4/d7/d40/d43/d49/d88/fae zero size 2024-09-21T11:39:11.938 INFO:tasks.workunit.client.1.smithi149.stdout:4/565: write d4/d6/d63/d15/d30/d6b/daa/fad [2888920,126712] 0 2024-09-21T11:39:11.941 INFO:tasks.workunit.client.1.smithi149.stdout:8/461: write d3/dd/d21/d54/f56 [1250507,86665] 0 2024-09-21T11:39:11.945 INFO:tasks.workunit.client.0.smithi118.stdout:8/145: mknod d2/dc/c33 0 2024-09-21T11:39:11.948 INFO:tasks.workunit.client.0.smithi118.stdout:8/146: stat d2/c15 0 2024-09-21T11:39:11.951 INFO:tasks.workunit.client.1.smithi149.stdout:1/477: symlink d2/dd/d35/d7c/l99 0 2024-09-21T11:39:11.951 INFO:tasks.workunit.client.1.smithi149.stdout:5/567: readlink d4/d7/l1b 0 2024-09-21T11:39:11.952 INFO:tasks.workunit.client.1.smithi149.stdout:0/437: dwrite dd/d1a/d1b/d50/d53/f5c [0,4194304] 0 2024-09-21T11:39:11.953 INFO:tasks.workunit.client.1.smithi149.stdout:0/438: chown dd/d1a/f2c 1 1 2024-09-21T11:39:11.953 INFO:tasks.workunit.client.1.smithi149.stdout:4/566: creat d4/d6/d63/d92/fd0 x:0 0 0 2024-09-21T11:39:11.954 INFO:tasks.workunit.client.1.smithi149.stdout:0/439: chown dd/f8e 9016 1 2024-09-21T11:39:11.954 INFO:tasks.workunit.client.1.smithi149.stdout:8/462: unlink d3/dd/f6a 0 2024-09-21T11:39:11.955 INFO:tasks.workunit.client.1.smithi149.stdout:7/607: getdents d12/d90/d4a/d9e 0 2024-09-21T11:39:11.956 INFO:tasks.workunit.client.0.smithi118.stdout:8/147: read d2/fa [3239336,120480] 0 2024-09-21T11:39:11.960 INFO:tasks.workunit.client.1.smithi149.stdout:2/607: truncate d8/da/d13/d1a/f3e 1656828 0 2024-09-21T11:39:11.960 INFO:tasks.workunit.client.1.smithi149.stdout:1/478: mknod d2/d5/d3d/d88/c9a 0 2024-09-21T11:39:11.962 INFO:tasks.workunit.client.1.smithi149.stdout:4/567: mkdir d4/d4d/d5f/d71/dd1 0 2024-09-21T11:39:11.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/608: write d8/dd/d50/fd2 [546563,107] 0 2024-09-21T11:39:11.963 INFO:tasks.workunit.client.1.smithi149.stdout:0/440: creat dd/d1a/d1b/d72/d85/f9a x:0 0 0 2024-09-21T11:39:11.964 INFO:tasks.workunit.client.1.smithi149.stdout:3/515: dwrite d6/f10 [0,4194304] 0 2024-09-21T11:39:11.965 INFO:tasks.workunit.client.1.smithi149.stdout:9/493: sync 2024-09-21T11:39:11.966 INFO:tasks.workunit.client.1.smithi149.stdout:2/609: read - d8/dd/d50/fad zero size 2024-09-21T11:39:11.966 INFO:tasks.workunit.client.1.smithi149.stdout:0/441: write dd/d35/f4d [353290,125779] 0 2024-09-21T11:39:11.966 INFO:tasks.workunit.client.1.smithi149.stdout:6/452: creat d8/d32/d37/d2b/f96 x:0 0 0 2024-09-21T11:39:11.968 INFO:tasks.workunit.client.1.smithi149.stdout:8/463: symlink d3/d33/d34/d55/d5e/la0 0 2024-09-21T11:39:11.968 INFO:tasks.workunit.client.1.smithi149.stdout:2/610: dread - d8/d11/fd1 zero size 2024-09-21T11:39:11.970 INFO:tasks.workunit.client.1.smithi149.stdout:7/608: creat d12/d90/d4a/d4f/fb6 x:0 0 0 2024-09-21T11:39:11.974 INFO:tasks.workunit.client.1.smithi149.stdout:9/494: creat d18/f9f x:0 0 0 2024-09-21T11:39:11.975 INFO:tasks.workunit.client.0.smithi118.stdout:8/148: dwrite d2/fa [0,4194304] 0 2024-09-21T11:39:11.977 INFO:tasks.workunit.client.1.smithi149.stdout:4/568: dwrite d4/d6/d63/d15/d30/d6b/fb1 [0,4194304] 0 2024-09-21T11:39:11.978 INFO:tasks.workunit.client.1.smithi149.stdout:0/442: creat dd/d1a/d1b/d50/d53/d3a/d66/f9b x:0 0 0 2024-09-21T11:39:11.979 INFO:tasks.workunit.client.1.smithi149.stdout:4/569: stat d4/d4d/d5f/la1 0 2024-09-21T11:39:11.979 INFO:tasks.workunit.client.1.smithi149.stdout:2/611: symlink d8/da/d13/d5d/ld9 0 2024-09-21T11:39:11.982 INFO:tasks.workunit.client.0.smithi118.stdout:8/149: dwrite d2/fa [0,4194304] 0 2024-09-21T11:39:11.985 INFO:tasks.workunit.client.1.smithi149.stdout:1/479: rename d2/dd/d35/d1c/f38 to d2/dd/d35/d1c/d41/d51/d90/f9b 0 2024-09-21T11:39:11.986 INFO:tasks.workunit.client.1.smithi149.stdout:7/609: dread d12/d90/d4a/f93 [0,4194304] 0 2024-09-21T11:39:11.988 INFO:tasks.workunit.client.1.smithi149.stdout:4/570: truncate d4/d6/d63/d92/fd0 148785 0 2024-09-21T11:39:11.990 INFO:tasks.workunit.client.0.smithi118.stdout:2/58: sync 2024-09-21T11:39:11.990 INFO:tasks.workunit.client.0.smithi118.stdout:6/101: sync 2024-09-21T11:39:11.990 INFO:tasks.workunit.client.0.smithi118.stdout:9/128: sync 2024-09-21T11:39:11.991 INFO:tasks.workunit.client.0.smithi118.stdout:0/201: sync 2024-09-21T11:39:11.991 INFO:tasks.workunit.client.0.smithi118.stdout:1/78: sync 2024-09-21T11:39:11.991 INFO:tasks.workunit.client.0.smithi118.stdout:5/58: sync 2024-09-21T11:39:11.991 INFO:tasks.workunit.client.0.smithi118.stdout:7/77: sync 2024-09-21T11:39:11.991 INFO:tasks.workunit.client.0.smithi118.stdout:3/102: sync 2024-09-21T11:39:11.991 INFO:tasks.workunit.client.0.smithi118.stdout:4/88: sync 2024-09-21T11:39:11.992 INFO:tasks.workunit.client.0.smithi118.stdout:2/59: fsync de/ff 0 2024-09-21T11:39:11.992 INFO:tasks.workunit.client.1.smithi149.stdout:9/495: mknod d18/d19/d1a/d2f/d5f/ca0 0 2024-09-21T11:39:11.992 INFO:tasks.workunit.client.1.smithi149.stdout:3/516: write d6/f9 [2599197,16879] 0 2024-09-21T11:39:11.992 INFO:tasks.workunit.client.1.smithi149.stdout:5/568: getdents d4/d1d/d50 0 2024-09-21T11:39:11.993 INFO:tasks.workunit.client.0.smithi118.stdout:3/103: chown d5/d1d/f16 209 1 2024-09-21T11:39:11.993 INFO:tasks.workunit.client.0.smithi118.stdout:0/202: write d5/f17 [2688002,123580] 0 2024-09-21T11:39:11.994 INFO:tasks.workunit.client.0.smithi118.stdout:9/129: chown d0/d20/l28 907623 1 2024-09-21T11:39:11.994 INFO:tasks.workunit.client.0.smithi118.stdout:2/60: chown f3 57 1 2024-09-21T11:39:11.999 INFO:tasks.workunit.client.0.smithi118.stdout:1/79: fdatasync f1 0 2024-09-21T11:39:12.000 INFO:tasks.workunit.client.1.smithi149.stdout:0/443: dwrite dd/d1a/d1b/d72/d85/d8c/f89 [0,4194304] 0 2024-09-21T11:39:12.000 INFO:tasks.workunit.client.1.smithi149.stdout:2/612: unlink d8/da/d13/f81 0 2024-09-21T11:39:12.002 INFO:tasks.workunit.client.0.smithi118.stdout:6/102: creat d8/d14/f24 x:0 0 0 2024-09-21T11:39:12.002 INFO:tasks.workunit.client.0.smithi118.stdout:7/78: rmdir d0 39 2024-09-21T11:39:12.002 INFO:tasks.workunit.client.0.smithi118.stdout:6/103: read - d8/d14/f1e zero size 2024-09-21T11:39:12.004 INFO:tasks.workunit.client.0.smithi118.stdout:4/89: mkdir d2/d6/de/d1c/d23/d26 0 2024-09-21T11:39:12.007 INFO:tasks.workunit.client.0.smithi118.stdout:3/104: dread - d5/f1a zero size 2024-09-21T11:39:12.008 INFO:tasks.workunit.client.1.smithi149.stdout:7/610: dwrite f1 [0,4194304] 0 2024-09-21T11:39:12.008 INFO:tasks.workunit.client.1.smithi149.stdout:6/453: rename d8/d32/d37/d2b/d4a to d8/d32/d64/d97 0 2024-09-21T11:39:12.010 INFO:tasks.workunit.client.1.smithi149.stdout:4/571: fsync d4/d6/f47 0 2024-09-21T11:39:12.010 INFO:tasks.workunit.client.1.smithi149.stdout:6/454: fsync d8/d32/d37/f61 0 2024-09-21T11:39:12.012 INFO:tasks.workunit.client.0.smithi118.stdout:9/130: rename d0/l9 to d0/d4/l37 0 2024-09-21T11:39:12.013 INFO:tasks.workunit.client.0.smithi118.stdout:0/203: creat d5/d10/d1e/d20/f41 x:0 0 0 2024-09-21T11:39:12.016 INFO:tasks.workunit.client.1.smithi149.stdout:3/517: mkdir d6/d1f/d47/d37/d3a/d95/dbe 0 2024-09-21T11:39:12.018 INFO:tasks.workunit.client.1.smithi149.stdout:3/518: read - d6/d1f/d47/d37/d3f/fa1 zero size 2024-09-21T11:39:12.020 INFO:tasks.workunit.client.1.smithi149.stdout:1/480: symlink d2/dd/d35/d1c/l9c 0 2024-09-21T11:39:12.021 INFO:tasks.workunit.client.0.smithi118.stdout:6/104: chown d8/ce 73 1 2024-09-21T11:39:12.022 INFO:tasks.workunit.client.1.smithi149.stdout:9/496: dwrite d18/d19/d1a/d2f/d5f/f80 [4194304,4194304] 0 2024-09-21T11:39:12.023 INFO:tasks.workunit.client.1.smithi149.stdout:2/613: fsync d8/da/d13/d1a/d3b/f51 0 2024-09-21T11:39:12.024 INFO:tasks.workunit.client.0.smithi118.stdout:3/105: creat d5/d1d/f27 x:0 0 0 2024-09-21T11:39:12.027 INFO:tasks.workunit.client.1.smithi149.stdout:4/572: mkdir d4/d6/d63/d15/dd2 0 2024-09-21T11:39:12.028 INFO:tasks.workunit.client.1.smithi149.stdout:5/569: symlink d4/d1d/d50/d60/db1/db4/lb6 0 2024-09-21T11:39:12.031 INFO:tasks.workunit.client.0.smithi118.stdout:8/150: dread d2/dc/d10/d2e/d18/f22 [8388608,4194304] 0 2024-09-21T11:39:12.032 INFO:tasks.workunit.client.1.smithi149.stdout:7/611: rmdir d12/d90/d4a/d6c/d8c 39 2024-09-21T11:39:12.032 INFO:tasks.workunit.client.0.smithi118.stdout:2/61: write f0 [5563473,104864] 0 2024-09-21T11:39:12.033 INFO:tasks.workunit.client.1.smithi149.stdout:2/614: dwrite d8/da/d13/d5d/d6a/f8b [0,4194304] 0 2024-09-21T11:39:12.033 INFO:tasks.workunit.client.0.smithi118.stdout:7/79: mkdir d0/d3/d1c 0 2024-09-21T11:39:12.034 INFO:tasks.workunit.client.1.smithi149.stdout:7/612: write d12/d90/d68/f7a [366402,109131] 0 2024-09-21T11:39:12.034 INFO:tasks.workunit.client.1.smithi149.stdout:2/615: stat d8/da/d13/d1a/la2 0 2024-09-21T11:39:12.036 INFO:tasks.workunit.client.1.smithi149.stdout:3/519: fdatasync d6/d1f/d47/d37/d3a/f92 0 2024-09-21T11:39:12.036 INFO:tasks.workunit.client.0.smithi118.stdout:6/105: creat d8/f25 x:0 0 0 2024-09-21T11:39:12.038 INFO:tasks.workunit.client.0.smithi118.stdout:4/90: mknod d2/d6/de/d1c/d23/d26/c27 0 2024-09-21T11:39:12.041 INFO:tasks.workunit.client.0.smithi118.stdout:6/106: dread f6 [0,4194304] 0 2024-09-21T11:39:12.041 INFO:tasks.workunit.client.1.smithi149.stdout:0/444: mkdir dd/d1a/d1b/d50/d5d/d9c 0 2024-09-21T11:39:12.041 INFO:tasks.workunit.client.0.smithi118.stdout:3/106: rmdir d5/d1d 39 2024-09-21T11:39:12.044 INFO:tasks.workunit.client.1.smithi149.stdout:7/613: dwrite d12/f74 [4194304,4194304] 0 2024-09-21T11:39:12.044 INFO:tasks.workunit.client.1.smithi149.stdout:9/497: creat d18/d36/d3c/d47/fa1 x:0 0 0 2024-09-21T11:39:12.045 INFO:tasks.workunit.client.0.smithi118.stdout:1/80: creat d6/f15 x:0 0 0 2024-09-21T11:39:12.046 INFO:tasks.workunit.client.1.smithi149.stdout:7/614: write d12/d90/d4a/d4f/d75/d94/faf [3179184,28422] 0 2024-09-21T11:39:12.050 INFO:tasks.workunit.client.0.smithi118.stdout:2/62: creat de/f14 x:0 0 0 2024-09-21T11:39:12.053 INFO:tasks.workunit.client.1.smithi149.stdout:4/573: mkdir d4/d6/d63/d15/d30/dd3 0 2024-09-21T11:39:12.055 INFO:tasks.workunit.client.0.smithi118.stdout:7/80: mkdir d0/d3/d1d 0 2024-09-21T11:39:12.056 INFO:tasks.workunit.client.0.smithi118.stdout:7/81: truncate d0/f10 199282 0 2024-09-21T11:39:12.056 INFO:tasks.workunit.client.1.smithi149.stdout:5/570: creat d4/d1d/d50/d60/fb7 x:0 0 0 2024-09-21T11:39:12.056 INFO:tasks.workunit.client.0.smithi118.stdout:7/82: fdatasync d0/d3/f18 0 2024-09-21T11:39:12.059 INFO:tasks.workunit.client.0.smithi118.stdout:6/107: creat d8/d14/f26 x:0 0 0 2024-09-21T11:39:12.060 INFO:tasks.workunit.client.0.smithi118.stdout:6/108: stat d8/d14 0 2024-09-21T11:39:12.060 INFO:tasks.workunit.client.1.smithi149.stdout:2/616: mkdir d8/d20/d57/dda 0 2024-09-21T11:39:12.098 INFO:tasks.workunit.client.1.smithi149.stdout:1/481: mkdir d2/dd/d35/d1c/d41/d74/d9d 0 2024-09-21T11:39:12.101 INFO:tasks.workunit.client.0.smithi118.stdout:1/81: fsync d6/de/f11 0 2024-09-21T11:39:12.103 INFO:tasks.workunit.client.1.smithi149.stdout:9/498: unlink d18/d36/d3c/f77 0 2024-09-21T11:39:12.120 INFO:tasks.workunit.client.0.smithi118.stdout:4/91: mknod d2/d6/c28 0 2024-09-21T11:39:12.121 INFO:tasks.workunit.client.0.smithi118.stdout:4/92: write d2/d6/de/f16 [49792,65303] 0 2024-09-21T11:39:12.122 INFO:tasks.workunit.client.1.smithi149.stdout:3/520: creat d6/d1f/d47/dbb/fbf x:0 0 0 2024-09-21T11:39:12.125 INFO:tasks.workunit.client.0.smithi118.stdout:6/109: mknod d8/d14/c27 0 2024-09-21T11:39:12.131 INFO:tasks.workunit.client.0.smithi118.stdout:9/131: getdents d0/d4 0 2024-09-21T11:39:12.131 INFO:tasks.workunit.client.0.smithi118.stdout:9/132: dread - d0/f2c zero size 2024-09-21T11:39:12.133 INFO:tasks.workunit.client.1.smithi149.stdout:9/499: rename d18/d19/d1a/d2f/d30/d54/l72 to d18/d4c/la2 0 2024-09-21T11:39:12.135 INFO:tasks.workunit.client.1.smithi149.stdout:6/455: getdents d8 0 2024-09-21T11:39:12.140 INFO:tasks.workunit.client.0.smithi118.stdout:2/63: link de/f11 de/f15 0 2024-09-21T11:39:12.145 INFO:tasks.workunit.client.0.smithi118.stdout:4/93: mknod d2/d6/de/d1c/d23/d26/c29 0 2024-09-21T11:39:12.149 INFO:tasks.workunit.client.0.smithi118.stdout:9/133: mkdir d0/d4/d38 0 2024-09-21T11:39:12.150 INFO:tasks.workunit.client.0.smithi118.stdout:9/134: dread d0/d4/f1f [0,4194304] 0 2024-09-21T11:39:12.151 INFO:tasks.workunit.client.0.smithi118.stdout:9/135: dread - d0/f1c zero size 2024-09-21T11:39:12.152 INFO:tasks.workunit.client.0.smithi118.stdout:9/136: write d0/d4/f17 [84674,13882] 0 2024-09-21T11:39:12.154 INFO:tasks.workunit.client.1.smithi149.stdout:3/521: symlink d6/lc0 0 2024-09-21T11:39:12.154 INFO:tasks.workunit.client.1.smithi149.stdout:3/522: fsync d6/d1f/d47/d37/d3a/f90 0 2024-09-21T11:39:12.156 INFO:tasks.workunit.client.0.smithi118.stdout:2/64: write de/f11 [487286,31245] 0 2024-09-21T11:39:12.158 INFO:tasks.workunit.client.1.smithi149.stdout:1/482: creat d2/d5/f9e x:0 0 0 2024-09-21T11:39:12.160 INFO:tasks.workunit.client.0.smithi118.stdout:4/94: truncate d2/fc 2280956 0 2024-09-21T11:39:12.165 INFO:tasks.workunit.client.1.smithi149.stdout:4/574: getdents d4/d6/d63/d10/d31/d32 0 2024-09-21T11:39:12.169 INFO:tasks.workunit.client.1.smithi149.stdout:2/617: getdents d8/dd 0 2024-09-21T11:39:12.171 INFO:tasks.workunit.client.1.smithi149.stdout:3/523: creat d6/d79/d7e/fc1 x:0 0 0 2024-09-21T11:39:12.174 INFO:tasks.workunit.client.1.smithi149.stdout:1/483: rename d2/d2b/c45 to d2/d2b/d6e/c9f 0 2024-09-21T11:39:12.176 INFO:tasks.workunit.client.0.smithi118.stdout:2/65: mkdir de/d16 0 2024-09-21T11:39:12.179 INFO:tasks.workunit.client.0.smithi118.stdout:4/95: write d2/d6/f22 [220223,81820] 0 2024-09-21T11:39:12.179 INFO:tasks.workunit.client.0.smithi118.stdout:3/107: mkdir d5/d28 0 2024-09-21T11:39:12.183 INFO:tasks.workunit.client.1.smithi149.stdout:2/618: dread d8/d20/f62 [0,4194304] 0 2024-09-21T11:39:12.184 INFO:tasks.workunit.client.0.smithi118.stdout:2/66: unlink de/f11 0 2024-09-21T11:39:12.189 INFO:tasks.workunit.client.0.smithi118.stdout:3/108: chown d5/d1d/fa 3871960 1 2024-09-21T11:39:12.189 INFO:tasks.workunit.client.0.smithi118.stdout:3/109: fdatasync d5/d1d/f27 0 2024-09-21T11:39:12.191 INFO:tasks.workunit.client.0.smithi118.stdout:4/96: dread d2/f7 [0,4194304] 0 2024-09-21T11:39:12.194 INFO:tasks.workunit.client.0.smithi118.stdout:6/110: getdents d8 0 2024-09-21T11:39:12.194 INFO:tasks.workunit.client.0.smithi118.stdout:6/111: readlink d8/lf 0 2024-09-21T11:39:12.195 INFO:tasks.workunit.client.0.smithi118.stdout:6/112: truncate d8/f25 132499 0 2024-09-21T11:39:12.198 INFO:tasks.workunit.client.0.smithi118.stdout:2/67: rename f3 to de/f17 0 2024-09-21T11:39:12.202 INFO:tasks.workunit.client.0.smithi118.stdout:6/113: dwrite d8/d14/f1e [0,4194304] 0 2024-09-21T11:39:12.203 INFO:tasks.workunit.client.0.smithi118.stdout:6/114: chown d8/d14 5350694 1 2024-09-21T11:39:12.204 INFO:tasks.workunit.client.0.smithi118.stdout:6/115: write d8/d14/f1d [166632,84597] 0 2024-09-21T11:39:12.205 INFO:tasks.workunit.client.0.smithi118.stdout:6/116: stat d8/d14/f26 0 2024-09-21T11:39:12.208 INFO:tasks.workunit.client.0.smithi118.stdout:2/68: rename f6 to de/f18 0 2024-09-21T11:39:12.212 INFO:tasks.workunit.client.1.smithi149.stdout:3/524: creat d6/d1f/fc2 x:0 0 0 2024-09-21T11:39:12.212 INFO:tasks.workunit.client.1.smithi149.stdout:3/525: chown d6/d5f/d60/d88 980730717 1 2024-09-21T11:39:12.213 INFO:tasks.workunit.client.1.smithi149.stdout:3/526: chown d6 15515069 1 2024-09-21T11:39:12.216 INFO:tasks.workunit.client.1.smithi149.stdout:4/575: getdents d4/d4d 0 2024-09-21T11:39:12.218 INFO:tasks.workunit.client.1.smithi149.stdout:3/527: dwrite d6/d79/d7e/fc1 [0,4194304] 0 2024-09-21T11:39:12.220 INFO:tasks.workunit.client.0.smithi118.stdout:6/117: fsync d8/f1a 0 2024-09-21T11:39:12.221 INFO:tasks.workunit.client.1.smithi149.stdout:1/484: getdents d2/d5/d3d/d88 0 2024-09-21T11:39:12.222 INFO:tasks.workunit.client.1.smithi149.stdout:1/485: chown d2/dd/d35/d1c/d37/f61 2180161 1 2024-09-21T11:39:12.223 INFO:tasks.workunit.client.0.smithi118.stdout:2/69: creat de/f19 x:0 0 0 2024-09-21T11:39:12.224 INFO:tasks.workunit.client.1.smithi149.stdout:1/486: dread - d2/dd/d35/d1c/d41/d51/f7f zero size 2024-09-21T11:39:12.224 INFO:tasks.workunit.client.1.smithi149.stdout:1/487: chown d2/d2b/d6e/f6f 766 1 2024-09-21T11:39:12.225 INFO:tasks.workunit.client.0.smithi118.stdout:3/110: link d5/l13 d5/d1d/l29 0 2024-09-21T11:39:12.229 INFO:tasks.workunit.client.1.smithi149.stdout:8/464: sync 2024-09-21T11:39:12.230 INFO:tasks.workunit.client.0.smithi118.stdout:3/111: readlink d5/l13 0 2024-09-21T11:39:12.232 INFO:tasks.workunit.client.1.smithi149.stdout:1/488: mknod d2/d5/ca0 0 2024-09-21T11:39:12.234 INFO:tasks.workunit.client.1.smithi149.stdout:1/489: write d2/dd/d35/d1c/f39 [690990,8003] 0 2024-09-21T11:39:12.234 INFO:tasks.workunit.client.1.smithi149.stdout:8/465: dwrite d3/d12/f15 [0,4194304] 0 2024-09-21T11:39:12.239 INFO:tasks.workunit.client.1.smithi149.stdout:3/528: getdents d6/d1f/d47/d37/d3a/d95 0 2024-09-21T11:39:12.240 INFO:tasks.workunit.client.1.smithi149.stdout:3/529: stat d6/d1f/d47/f77 0 2024-09-21T11:39:12.241 INFO:tasks.workunit.client.1.smithi149.stdout:8/466: rmdir d3/d12/d6e/d79 39 2024-09-21T11:39:12.244 INFO:tasks.workunit.client.1.smithi149.stdout:3/530: dread d6/f10 [0,4194304] 0 2024-09-21T11:39:12.246 INFO:tasks.workunit.client.1.smithi149.stdout:1/490: creat d2/dd/fa1 x:0 0 0 2024-09-21T11:39:12.249 INFO:tasks.workunit.client.1.smithi149.stdout:1/491: creat d2/d5/d65/fa2 x:0 0 0 2024-09-21T11:39:12.250 INFO:tasks.workunit.client.0.smithi118.stdout:7/83: dwrite d0/f2 [0,4194304] 0 2024-09-21T11:39:12.250 INFO:tasks.workunit.client.1.smithi149.stdout:3/531: dwrite d6/d1f/d47/d37/f4b [0,4194304] 0 2024-09-21T11:39:12.251 INFO:tasks.workunit.client.0.smithi118.stdout:7/84: chown d0/d3/l12 26 1 2024-09-21T11:39:12.251 INFO:tasks.workunit.client.1.smithi149.stdout:1/492: chown d2/dd/d35/d7c/l99 303614 1 2024-09-21T11:39:12.256 INFO:tasks.workunit.client.1.smithi149.stdout:3/532: symlink d6/d1f/d47/d22/lc3 0 2024-09-21T11:39:12.258 INFO:tasks.workunit.client.1.smithi149.stdout:3/533: read - d6/d1f/d47/d37/d3a/fbc zero size 2024-09-21T11:39:12.260 INFO:tasks.workunit.client.0.smithi118.stdout:7/85: link d0/d3/l12 d0/d3/d14/l1e 0 2024-09-21T11:39:12.261 INFO:tasks.workunit.client.1.smithi149.stdout:1/493: dwrite d2/d5/d8/f17 [4194304,4194304] 0 2024-09-21T11:39:12.261 INFO:tasks.workunit.client.0.smithi118.stdout:7/86: read d0/d3/fd [3516444,67930] 0 2024-09-21T11:39:12.262 INFO:tasks.workunit.client.1.smithi149.stdout:3/534: mknod d6/d1f/d47/d37/d3a/d95/cc4 0 2024-09-21T11:39:12.267 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:12 smithi149 ceph-mon[36123]: pgmap v21: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 183 MiB/s wr, 404 op/s 2024-09-21T11:39:12.267 INFO:tasks.workunit.client.1.smithi149.stdout:7/615: unlink d12/d90/d26/l2f 0 2024-09-21T11:39:12.270 INFO:tasks.workunit.client.1.smithi149.stdout:1/494: chown d2/dd/d35/d5b/f6a 87327 1 2024-09-21T11:39:12.271 INFO:tasks.workunit.client.1.smithi149.stdout:1/495: chown d2/f2d 1 1 2024-09-21T11:39:12.272 INFO:tasks.workunit.client.1.smithi149.stdout:1/496: chown d2/d5/d3d/d88/f63 459 1 2024-09-21T11:39:12.273 INFO:tasks.workunit.client.1.smithi149.stdout:3/535: truncate d6/ff 7191699 0 2024-09-21T11:39:12.273 INFO:tasks.workunit.client.1.smithi149.stdout:3/536: dread - d6/d1f/d4c/fb4 zero size 2024-09-21T11:39:12.273 INFO:tasks.workunit.client.1.smithi149.stdout:7/616: mkdir d12/d90/db7 0 2024-09-21T11:39:12.275 INFO:tasks.workunit.client.1.smithi149.stdout:1/497: dread d2/dd/f71 [0,4194304] 0 2024-09-21T11:39:12.279 INFO:tasks.workunit.client.1.smithi149.stdout:3/537: rename d6/d1f/d47/d37/d3a/d95/dbe to d6/d1f/d47/d37/d3f/dc5 0 2024-09-21T11:39:12.280 INFO:tasks.workunit.client.1.smithi149.stdout:3/538: read - d6/d1f/d47/d37/d3a/f9e zero size 2024-09-21T11:39:12.280 INFO:tasks.workunit.client.1.smithi149.stdout:3/539: readlink d6/d1f/l51 0 2024-09-21T11:39:12.280 INFO:tasks.workunit.client.1.smithi149.stdout:7/617: unlink d12/d90/d4a/d4f/l97 0 2024-09-21T11:39:12.281 INFO:tasks.workunit.client.1.smithi149.stdout:3/540: truncate d6/d1f/d4c/fb4 62832 0 2024-09-21T11:39:12.283 INFO:tasks.workunit.client.0.smithi118.stdout:1/82: dwrite f0 [0,4194304] 0 2024-09-21T11:39:12.287 INFO:tasks.workunit.client.1.smithi149.stdout:7/618: readlink d12/d90/d4a/d4f/d75/d94/l56 0 2024-09-21T11:39:12.287 INFO:tasks.workunit.client.0.smithi118.stdout:4/97: dread d2/f4 [0,4194304] 0 2024-09-21T11:39:12.294 INFO:tasks.workunit.client.1.smithi149.stdout:9/500: dwrite d18/d36/d3c/d47/f66 [0,4194304] 0 2024-09-21T11:39:12.310 INFO:tasks.workunit.client.0.smithi118.stdout:1/83: rmdir d6/de/d13 39 2024-09-21T11:39:12.313 INFO:tasks.workunit.client.1.smithi149.stdout:3/541: read - d6/d1f/d47/d37/d3f/f64 zero size 2024-09-21T11:39:12.313 INFO:tasks.workunit.client.0.smithi118.stdout:4/98: dwrite d2/d6/f18 [0,4194304] 0 2024-09-21T11:39:12.314 INFO:tasks.workunit.client.0.smithi118.stdout:7/87: dread d0/f9 [0,4194304] 0 2024-09-21T11:39:12.318 INFO:tasks.workunit.client.1.smithi149.stdout:9/501: mknod d18/d19/d1a/d2f/d53/d64/ca3 0 2024-09-21T11:39:12.319 INFO:tasks.workunit.client.1.smithi149.stdout:9/502: fsync d18/d19/d29/d39/f69 0 2024-09-21T11:39:12.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/542: dwrite d6/d1f/d47/d37/d50/f78 [0,4194304] 0 2024-09-21T11:39:12.322 INFO:tasks.workunit.client.0.smithi118.stdout:1/84: dwrite d6/de/f10 [0,4194304] 0 2024-09-21T11:39:12.322 INFO:tasks.workunit.client.0.smithi118.stdout:4/99: mknod d2/d6/dd/c2a 0 2024-09-21T11:39:12.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/543: chown d6/d1f/d47/c6e 497854229 1 2024-09-21T11:39:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:12 smithi118 ceph-mon[28757]: pgmap v21: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 183 MiB/s wr, 404 op/s 2024-09-21T11:39:12.325 INFO:tasks.workunit.client.1.smithi149.stdout:7/619: mkdir d12/d90/db8 0 2024-09-21T11:39:12.326 INFO:tasks.workunit.client.1.smithi149.stdout:5/571: sync 2024-09-21T11:39:12.326 INFO:tasks.workunit.client.1.smithi149.stdout:6/456: sync 2024-09-21T11:39:12.326 INFO:tasks.workunit.client.1.smithi149.stdout:0/445: sync 2024-09-21T11:39:12.328 INFO:tasks.workunit.client.1.smithi149.stdout:6/457: write d8/da/d2c/d52/f5c [1921964,98833] 0 2024-09-21T11:39:12.334 INFO:tasks.workunit.client.0.smithi118.stdout:1/85: chown d6/f8 0 1 2024-09-21T11:39:12.334 INFO:tasks.workunit.client.0.smithi118.stdout:1/86: chown d6/de/d13 310 1 2024-09-21T11:39:12.335 INFO:tasks.workunit.client.1.smithi149.stdout:9/503: write d18/d1c/f60 [3947948,65969] 0 2024-09-21T11:39:12.336 INFO:tasks.workunit.client.0.smithi118.stdout:4/100: fsync d2/f7 0 2024-09-21T11:39:12.338 INFO:tasks.workunit.client.0.smithi118.stdout:1/87: dread d6/f8 [0,4194304] 0 2024-09-21T11:39:12.338 INFO:tasks.workunit.client.1.smithi149.stdout:3/544: write d6/d1f/d47/d37/d3a/f46 [270206,23250] 0 2024-09-21T11:39:12.338 INFO:tasks.workunit.client.0.smithi118.stdout:4/101: truncate d2/d6/f22 306407 0 2024-09-21T11:39:12.340 INFO:tasks.workunit.client.1.smithi149.stdout:7/620: dwrite d12/d90/d4a/d4f/d75/d94/d47/d49/fad [0,4194304] 0 2024-09-21T11:39:12.340 INFO:tasks.workunit.client.1.smithi149.stdout:5/572: creat d4/d1d/d50/d60/fb8 x:0 0 0 2024-09-21T11:39:12.343 INFO:tasks.workunit.client.1.smithi149.stdout:5/573: dread - d4/d7/d40/d43/f95 zero size 2024-09-21T11:39:12.343 INFO:tasks.workunit.client.1.smithi149.stdout:7/621: chown d12/d90/f20 1989 1 2024-09-21T11:39:12.347 INFO:tasks.workunit.client.0.smithi118.stdout:4/102: dwrite d2/d6/f20 [0,4194304] 0 2024-09-21T11:39:12.350 INFO:tasks.workunit.client.0.smithi118.stdout:8/151: mkdir d2/d34 0 2024-09-21T11:39:12.355 INFO:tasks.workunit.client.0.smithi118.stdout:1/88: mkdir d6/de/d16 0 2024-09-21T11:39:12.356 INFO:tasks.workunit.client.1.smithi149.stdout:5/574: dwrite d4/d7/d40/d51/f58 [0,4194304] 0 2024-09-21T11:39:12.356 INFO:tasks.workunit.client.0.smithi118.stdout:1/89: write d6/f15 [985909,55863] 0 2024-09-21T11:39:12.366 INFO:tasks.workunit.client.1.smithi149.stdout:3/545: mkdir d6/d1f/dc6 0 2024-09-21T11:39:12.366 INFO:tasks.workunit.client.1.smithi149.stdout:3/546: chown d6/d1f/d27/f3c 0 1 2024-09-21T11:39:12.370 INFO:tasks.workunit.client.1.smithi149.stdout:6/458: link d8/d32/d37/c21 d8/d32/d37/d2b/d51/c98 0 2024-09-21T11:39:12.372 INFO:tasks.workunit.client.0.smithi118.stdout:2/70: fdatasync de/f15 0 2024-09-21T11:39:12.375 INFO:tasks.workunit.client.0.smithi118.stdout:8/152: unlink d2/l14 0 2024-09-21T11:39:12.375 INFO:tasks.workunit.client.1.smithi149.stdout:2/619: dwrite f7 [0,4194304] 0 2024-09-21T11:39:12.377 INFO:tasks.workunit.client.1.smithi149.stdout:9/504: link d18/d19/d1a/d2f/d53/l57 d18/d19/d1a/d2f/d33/la4 0 2024-09-21T11:39:12.377 INFO:tasks.workunit.client.1.smithi149.stdout:2/620: truncate d8/dd/d5c/d60/fcc 780235 0 2024-09-21T11:39:12.379 INFO:tasks.workunit.client.1.smithi149.stdout:2/621: write d8/da/d13/d2d/f6b [771215,67122] 0 2024-09-21T11:39:12.380 INFO:tasks.workunit.client.1.smithi149.stdout:9/505: chown d18/d19/d1a/f2d 6412 1 2024-09-21T11:39:12.381 INFO:tasks.workunit.client.0.smithi118.stdout:4/103: creat d2/d6/f2b x:0 0 0 2024-09-21T11:39:12.389 INFO:tasks.workunit.client.1.smithi149.stdout:2/622: readlink d8/d20/d78/lca 0 2024-09-21T11:39:12.391 INFO:tasks.workunit.client.0.smithi118.stdout:1/90: creat d6/de/f17 x:0 0 0 2024-09-21T11:39:12.392 INFO:tasks.workunit.client.1.smithi149.stdout:9/506: symlink d18/d36/d3c/la5 0 2024-09-21T11:39:12.392 INFO:tasks.workunit.client.1.smithi149.stdout:9/507: readlink d18/d36/d3c/d47/l65 0 2024-09-21T11:39:12.394 INFO:tasks.workunit.client.0.smithi118.stdout:4/104: creat d2/d6/de/d1c/d23/f2c x:0 0 0 2024-09-21T11:39:12.395 INFO:tasks.workunit.client.1.smithi149.stdout:3/547: rmdir d6/d1f/dc6 0 2024-09-21T11:39:12.398 INFO:tasks.workunit.client.1.smithi149.stdout:6/459: creat d8/d32/d37/d2b/f99 x:0 0 0 2024-09-21T11:39:12.399 INFO:tasks.workunit.client.0.smithi118.stdout:4/105: dwrite d2/f13 [0,4194304] 0 2024-09-21T11:39:12.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/623: chown d8/da/d13/d2d/d6f/c82 88852517 1 2024-09-21T11:39:12.400 INFO:tasks.workunit.client.0.smithi118.stdout:4/106: readlink d2/d6/dd/l1f 0 2024-09-21T11:39:12.402 INFO:tasks.workunit.client.1.smithi149.stdout:3/548: dwrite d6/d1f/d47/d37/d3f/fa1 [0,4194304] 0 2024-09-21T11:39:12.405 INFO:tasks.workunit.client.1.smithi149.stdout:4/576: sync 2024-09-21T11:39:12.405 INFO:tasks.workunit.client.1.smithi149.stdout:8/467: sync 2024-09-21T11:39:12.406 INFO:tasks.workunit.client.0.smithi118.stdout:1/91: symlink d6/l18 0 2024-09-21T11:39:12.407 INFO:tasks.workunit.client.1.smithi149.stdout:8/468: chown d3/d12/c84 1 1 2024-09-21T11:39:12.407 INFO:tasks.workunit.client.0.smithi118.stdout:1/92: truncate d6/de/f17 269612 0 2024-09-21T11:39:12.407 INFO:tasks.workunit.client.1.smithi149.stdout:4/577: write d4/d6/d63/fc5 [139203,131015] 0 2024-09-21T11:39:12.408 INFO:tasks.workunit.client.1.smithi149.stdout:6/460: mkdir d8/da/d2c/d2d/d9a 0 2024-09-21T11:39:12.411 INFO:tasks.workunit.client.1.smithi149.stdout:2/624: chown d8/d44/d63/db9/f2f 1 1 2024-09-21T11:39:12.415 INFO:tasks.workunit.client.1.smithi149.stdout:3/549: fdatasync d6/f1a 0 2024-09-21T11:39:12.418 INFO:tasks.workunit.client.0.smithi118.stdout:1/93: getdents d6/de/d16 0 2024-09-21T11:39:12.420 INFO:tasks.workunit.client.1.smithi149.stdout:6/461: mkdir d8/da/d2c/d52/d5e/d9b 0 2024-09-21T11:39:12.422 INFO:tasks.workunit.client.1.smithi149.stdout:2/625: mkdir d8/d20/d78/ddb 0 2024-09-21T11:39:12.424 INFO:tasks.workunit.client.1.smithi149.stdout:1/498: write d2/d2b/d6e/f76 [4522236,110115] 0 2024-09-21T11:39:12.427 INFO:tasks.workunit.client.1.smithi149.stdout:6/462: rmdir d8/da/d2c/d52/d5e/d69 39 2024-09-21T11:39:12.429 INFO:tasks.workunit.client.1.smithi149.stdout:2/626: creat d8/dd/d5c/d60/fdc x:0 0 0 2024-09-21T11:39:12.430 INFO:tasks.workunit.client.1.smithi149.stdout:8/469: dread d3/dd/d21/d54/d5c/f6b [0,4194304] 0 2024-09-21T11:39:12.431 INFO:tasks.workunit.client.1.smithi149.stdout:4/578: creat d4/d6/d63/d10/fd4 x:0 0 0 2024-09-21T11:39:12.433 INFO:tasks.workunit.client.1.smithi149.stdout:3/550: creat d6/d1f/d47/d37/fc7 x:0 0 0 2024-09-21T11:39:12.433 INFO:tasks.workunit.client.1.smithi149.stdout:7/622: unlink d12/d90/d26/d30/l9c 0 2024-09-21T11:39:12.434 INFO:tasks.workunit.client.1.smithi149.stdout:4/579: chown d4/d4d/lce 1632 1 2024-09-21T11:39:12.435 INFO:tasks.workunit.client.1.smithi149.stdout:8/470: read d3/dd/d3a/f63 [411644,72307] 0 2024-09-21T11:39:12.436 INFO:tasks.workunit.client.1.smithi149.stdout:1/499: dwrite d2/f2d [0,4194304] 0 2024-09-21T11:39:12.436 INFO:tasks.workunit.client.1.smithi149.stdout:3/551: chown d6/fa 487793956 1 2024-09-21T11:39:12.444 INFO:tasks.workunit.client.1.smithi149.stdout:9/508: getdents d18/d19/d1a/d2f/d33 0 2024-09-21T11:39:12.445 INFO:tasks.workunit.client.1.smithi149.stdout:7/623: write d12/d90/d26/f29 [2241836,12368] 0 2024-09-21T11:39:12.448 INFO:tasks.workunit.client.0.smithi118.stdout:8/153: dwrite d2/f7 [0,4194304] 0 2024-09-21T11:39:12.449 INFO:tasks.workunit.client.1.smithi149.stdout:2/627: dwrite d8/dd/f1d [0,4194304] 0 2024-09-21T11:39:12.450 INFO:tasks.workunit.client.1.smithi149.stdout:4/580: dread d4/d6/d18/f2e [0,4194304] 0 2024-09-21T11:39:12.451 INFO:tasks.workunit.client.1.smithi149.stdout:6/463: dwrite d8/d32/d37/d2b/d51/f94 [0,4194304] 0 2024-09-21T11:39:12.456 INFO:tasks.workunit.client.0.smithi118.stdout:8/154: rmdir d2/dc/d10/d2e/d18 39 2024-09-21T11:39:12.458 INFO:tasks.workunit.client.1.smithi149.stdout:6/464: write d8/da/d11/f26 [4211657,105157] 0 2024-09-21T11:39:12.460 INFO:tasks.workunit.client.1.smithi149.stdout:7/624: mkdir d12/d90/d4a/d6c/da0/db9 0 2024-09-21T11:39:12.460 INFO:tasks.workunit.client.0.smithi118.stdout:4/107: truncate d2/d6/f18 2902432 0 2024-09-21T11:39:12.461 INFO:tasks.workunit.client.1.smithi149.stdout:3/552: dwrite d6/d1f/d47/d37/d50/fb6 [0,4194304] 0 2024-09-21T11:39:12.463 INFO:tasks.workunit.client.1.smithi149.stdout:3/553: write d6/f38 [2376919,78131] 0 2024-09-21T11:39:12.464 INFO:tasks.workunit.client.1.smithi149.stdout:3/554: dread - d6/d1f/d47/fa3 zero size 2024-09-21T11:39:12.468 INFO:tasks.workunit.client.0.smithi118.stdout:2/71: symlink de/l1a 0 2024-09-21T11:39:12.470 INFO:tasks.workunit.client.0.smithi118.stdout:4/108: dwrite d2/f21 [0,4194304] 0 2024-09-21T11:39:12.472 INFO:tasks.workunit.client.0.smithi118.stdout:4/109: write d2/f13 [733636,76031] 0 2024-09-21T11:39:12.473 INFO:tasks.workunit.client.0.smithi118.stdout:8/155: mkdir d2/dc/d35 0 2024-09-21T11:39:12.476 INFO:tasks.workunit.client.0.smithi118.stdout:1/94: dwrite f1 [0,4194304] 0 2024-09-21T11:39:12.484 INFO:tasks.workunit.client.1.smithi149.stdout:1/500: truncate d2/f2d 492548 0 2024-09-21T11:39:12.484 INFO:tasks.workunit.client.0.smithi118.stdout:4/110: truncate d2/f7 481404 0 2024-09-21T11:39:12.486 INFO:tasks.workunit.client.1.smithi149.stdout:6/465: creat d8/d32/d64/f9c x:0 0 0 2024-09-21T11:39:12.486 INFO:tasks.workunit.client.1.smithi149.stdout:8/471: write d3/d33/d34/d55/f59 [4640074,19333] 0 2024-09-21T11:39:12.487 INFO:tasks.workunit.client.1.smithi149.stdout:6/466: stat d8/d32/d37/d28/d2f/c50 0 2024-09-21T11:39:12.490 INFO:tasks.workunit.client.0.smithi118.stdout:4/111: creat d2/f2d x:0 0 0 2024-09-21T11:39:12.492 INFO:tasks.workunit.client.0.smithi118.stdout:4/112: write d2/d6/dd/f15 [7167899,37766] 0 2024-09-21T11:39:12.493 INFO:tasks.workunit.client.0.smithi118.stdout:8/156: mkdir d2/dc/d10/d2e/d18/d36 0 2024-09-21T11:39:12.496 INFO:tasks.workunit.client.1.smithi149.stdout:1/501: mkdir d2/dd/d35/d1c/d37/da3 0 2024-09-21T11:39:12.497 INFO:tasks.workunit.client.1.smithi149.stdout:8/472: creat d3/dd/d18/d2e/d80/fa1 x:0 0 0 2024-09-21T11:39:12.499 INFO:tasks.workunit.client.1.smithi149.stdout:6/467: symlink d8/d32/d37/d28/d2f/d6a/l9d 0 2024-09-21T11:39:12.501 INFO:tasks.workunit.client.0.smithi118.stdout:4/113: rename d2/f4 to d2/d6/de/d1c/f2e 0 2024-09-21T11:39:12.501 INFO:tasks.workunit.client.1.smithi149.stdout:8/473: dread d3/fa [0,4194304] 0 2024-09-21T11:39:12.502 INFO:tasks.workunit.client.0.smithi118.stdout:4/114: truncate d2/d6/de/f16 1464671 0 2024-09-21T11:39:12.502 INFO:tasks.workunit.client.1.smithi149.stdout:8/474: read d3/dd/d3a/f73 [210453,102704] 0 2024-09-21T11:39:12.502 INFO:tasks.workunit.client.1.smithi149.stdout:3/555: mknod d6/d1f/cc8 0 2024-09-21T11:39:12.506 INFO:tasks.workunit.client.0.smithi118.stdout:1/95: creat d6/f19 x:0 0 0 2024-09-21T11:39:12.507 INFO:tasks.workunit.client.0.smithi118.stdout:1/96: chown d6 583 1 2024-09-21T11:39:12.508 INFO:tasks.workunit.client.1.smithi149.stdout:2/628: rename d8/da/d13/d1a/c31 to d8/d11/cdd 0 2024-09-21T11:39:12.510 INFO:tasks.workunit.client.0.smithi118.stdout:2/72: write de/f15 [882009,57333] 0 2024-09-21T11:39:12.510 INFO:tasks.workunit.client.1.smithi149.stdout:9/509: getdents d18/d36/d3c/d47 0 2024-09-21T11:39:12.511 INFO:tasks.workunit.client.1.smithi149.stdout:9/510: fdatasync d18/d36/d3c/d47/f85 0 2024-09-21T11:39:12.512 INFO:tasks.workunit.client.0.smithi118.stdout:8/157: symlink d2/d32/l37 0 2024-09-21T11:39:12.512 INFO:tasks.workunit.client.0.smithi118.stdout:8/158: dread - d2/f29 zero size 2024-09-21T11:39:12.513 INFO:tasks.workunit.client.0.smithi118.stdout:8/159: dread - d2/dc/d10/d2e/d18/f2d zero size 2024-09-21T11:39:12.517 INFO:tasks.workunit.client.1.smithi149.stdout:6/468: creat d8/d32/d37/d28/d2e/f9e x:0 0 0 2024-09-21T11:39:12.522 INFO:tasks.workunit.client.0.smithi118.stdout:2/73: dread de/f18 [0,4194304] 0 2024-09-21T11:39:12.525 INFO:tasks.workunit.client.0.smithi118.stdout:8/160: dread d2/dc/d10/d2e/f21 [4194304,4194304] 0 2024-09-21T11:39:12.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/625: link d12/d90/d4a/d4f/d75/d94/d47/d49/c8b d12/d90/d4a/d4f/d75/cba 0 2024-09-21T11:39:12.526 INFO:tasks.workunit.client.0.smithi118.stdout:8/161: write d2/fa [3150805,67601] 0 2024-09-21T11:39:12.527 INFO:tasks.workunit.client.0.smithi118.stdout:8/162: chown d2/f29 6397860 1 2024-09-21T11:39:12.527 INFO:tasks.workunit.client.1.smithi149.stdout:0/446: sync 2024-09-21T11:39:12.528 INFO:tasks.workunit.client.1.smithi149.stdout:2/629: mkdir d8/d44/dde 0 2024-09-21T11:39:12.530 INFO:tasks.workunit.client.0.smithi118.stdout:1/97: creat d6/de/f1a x:0 0 0 2024-09-21T11:39:12.533 INFO:tasks.workunit.client.1.smithi149.stdout:7/626: dwrite d12/d90/d4a/d4f/d75/d94/d47/d49/fa9 [0,4194304] 0 2024-09-21T11:39:12.535 INFO:tasks.workunit.client.1.smithi149.stdout:7/627: chown d12/c42 127183193 1 2024-09-21T11:39:12.536 INFO:tasks.workunit.client.0.smithi118.stdout:4/115: dwrite d2/fc [0,4194304] 0 2024-09-21T11:39:12.536 INFO:tasks.workunit.client.1.smithi149.stdout:2/630: dwrite f3 [0,4194304] 0 2024-09-21T11:39:12.537 INFO:tasks.workunit.client.0.smithi118.stdout:8/163: read - d2/dc/d10/d2e/d18/d1a/f1e zero size 2024-09-21T11:39:12.537 INFO:tasks.workunit.client.1.smithi149.stdout:2/631: fsync d8/dd/f9c 0 2024-09-21T11:39:12.539 INFO:tasks.workunit.client.0.smithi118.stdout:8/164: dread - d2/dc/d10/d2e/d18/f2d zero size 2024-09-21T11:39:12.539 INFO:tasks.workunit.client.1.smithi149.stdout:1/502: write d2/dd/d2e/f33 [4230702,47748] 0 2024-09-21T11:39:12.540 INFO:tasks.workunit.client.0.smithi118.stdout:2/74: symlink de/l1b 0 2024-09-21T11:39:12.541 INFO:tasks.workunit.client.0.smithi118.stdout:2/75: truncate f8 11558 0 2024-09-21T11:39:12.543 INFO:tasks.workunit.client.1.smithi149.stdout:3/556: symlink d6/d1f/lc9 0 2024-09-21T11:39:12.543 INFO:tasks.workunit.client.0.smithi118.stdout:1/98: readlink d6/l7 0 2024-09-21T11:39:12.544 INFO:tasks.workunit.client.0.smithi118.stdout:1/99: write f0 [1134857,39542] 0 2024-09-21T11:39:12.545 INFO:tasks.workunit.client.1.smithi149.stdout:8/475: mkdir d3/dd/d21/da2 0 2024-09-21T11:39:12.545 INFO:tasks.workunit.client.0.smithi118.stdout:1/100: dread - d6/de/f1a zero size 2024-09-21T11:39:12.546 INFO:tasks.workunit.client.0.smithi118.stdout:4/116: unlink d2/d6/de/f24 0 2024-09-21T11:39:12.550 INFO:tasks.workunit.client.1.smithi149.stdout:0/447: creat dd/d1a/d1b/d81/f9d x:0 0 0 2024-09-21T11:39:12.553 INFO:tasks.workunit.client.1.smithi149.stdout:6/469: dwrite d8/d32/d37/d2b/d51/f63 [0,4194304] 0 2024-09-21T11:39:12.553 INFO:tasks.workunit.client.0.smithi118.stdout:1/101: dwrite d6/f15 [0,4194304] 0 2024-09-21T11:39:12.554 INFO:tasks.workunit.client.1.smithi149.stdout:0/448: write dd/d1a/d1b/d50/d5d/f84 [633695,31975] 0 2024-09-21T11:39:12.557 INFO:tasks.workunit.client.0.smithi118.stdout:4/117: mknod d2/d6/de/d1c/c2f 0 2024-09-21T11:39:12.557 INFO:tasks.workunit.client.0.smithi118.stdout:8/165: mknod d2/dc/d10/d2e/d18/d36/c38 0 2024-09-21T11:39:12.558 INFO:tasks.workunit.client.0.smithi118.stdout:8/166: fdatasync d2/f7 0 2024-09-21T11:39:12.560 INFO:tasks.workunit.client.1.smithi149.stdout:2/632: dwrite d8/da/d13/f21 [4194304,4194304] 0 2024-09-21T11:39:12.562 INFO:tasks.workunit.client.0.smithi118.stdout:2/76: mkdir de/d16/d1c 0 2024-09-21T11:39:12.562 INFO:tasks.workunit.client.0.smithi118.stdout:1/102: dwrite d6/f19 [0,4194304] 0 2024-09-21T11:39:12.565 INFO:tasks.workunit.client.1.smithi149.stdout:8/476: unlink d3/f4f 0 2024-09-21T11:39:12.565 INFO:tasks.workunit.client.1.smithi149.stdout:3/557: mknod d6/d1f/d47/d37/d50/cca 0 2024-09-21T11:39:12.566 INFO:tasks.workunit.client.1.smithi149.stdout:0/449: chown dd/d1a/d5a/d65/f7b 30 1 2024-09-21T11:39:12.567 INFO:tasks.workunit.client.1.smithi149.stdout:3/558: write d6/f38 [1994593,20109] 0 2024-09-21T11:39:12.570 INFO:tasks.workunit.client.0.smithi118.stdout:8/167: symlink d2/dc/d10/d2e/d18/d1a/l39 0 2024-09-21T11:39:12.571 INFO:tasks.workunit.client.1.smithi149.stdout:7/628: unlink d12/d90/d26/d30/f85 0 2024-09-21T11:39:12.573 INFO:tasks.workunit.client.0.smithi118.stdout:2/77: read - de/f10 zero size 2024-09-21T11:39:12.575 INFO:tasks.workunit.client.1.smithi149.stdout:2/633: mknod d8/da/d13/d1a/d29/cdf 0 2024-09-21T11:39:12.577 INFO:tasks.workunit.client.1.smithi149.stdout:3/559: truncate d6/d1f/d4c/fb4 940603 0 2024-09-21T11:39:12.577 INFO:tasks.workunit.client.1.smithi149.stdout:0/450: dread - dd/d32/f37 zero size 2024-09-21T11:39:12.577 INFO:tasks.workunit.client.1.smithi149.stdout:1/503: link d2/d5/d65/f79 d2/d5/d8/fa4 0 2024-09-21T11:39:12.579 INFO:tasks.workunit.client.0.smithi118.stdout:2/78: chown de/f17 217 1 2024-09-21T11:39:12.579 INFO:tasks.workunit.client.1.smithi149.stdout:7/629: mkdir d12/d90/d4a/d6c/da0/dbb 0 2024-09-21T11:39:12.582 INFO:tasks.workunit.client.1.smithi149.stdout:2/634: mkdir d8/dd/d8c/de0 0 2024-09-21T11:39:12.582 INFO:tasks.workunit.client.1.smithi149.stdout:7/630: write d12/d90/d26/d30/fa6 [189902,92497] 0 2024-09-21T11:39:12.583 INFO:tasks.workunit.client.1.smithi149.stdout:0/451: truncate dd/d1a/d1b/d50/d53/d3a/d66/f9b 1038887 0 2024-09-21T11:39:12.584 INFO:tasks.workunit.client.1.smithi149.stdout:3/560: mkdir d6/d79/d7e/dcb 0 2024-09-21T11:39:12.585 INFO:tasks.workunit.client.1.smithi149.stdout:3/561: write d6/f9 [5176552,95923] 0 2024-09-21T11:39:12.586 INFO:tasks.workunit.client.0.smithi118.stdout:2/79: rename f0 to de/d16/d1c/f1d 0 2024-09-21T11:39:12.586 INFO:tasks.workunit.client.1.smithi149.stdout:0/452: write dd/d1a/d1b/d50/d53/d3a/f7c [478706,7756] 0 2024-09-21T11:39:12.587 INFO:tasks.workunit.client.0.smithi118.stdout:5/59: sync 2024-09-21T11:39:12.588 INFO:tasks.workunit.client.1.smithi149.stdout:1/504: symlink d2/d5/la5 0 2024-09-21T11:39:12.588 INFO:tasks.workunit.client.0.smithi118.stdout:1/103: getdents d6/de 0 2024-09-21T11:39:12.593 INFO:tasks.workunit.client.1.smithi149.stdout:2/635: dwrite d8/d44/fb1 [0,4194304] 0 2024-09-21T11:39:12.595 INFO:tasks.workunit.client.0.smithi118.stdout:5/60: symlink d0/d6/l19 0 2024-09-21T11:39:12.596 INFO:tasks.workunit.client.1.smithi149.stdout:1/505: rmdir d2/dd/d2e/d4c 39 2024-09-21T11:39:12.598 INFO:tasks.workunit.client.1.smithi149.stdout:0/453: symlink dd/d1a/d1b/d72/d78/d8b/l9e 0 2024-09-21T11:39:12.600 INFO:tasks.workunit.client.0.smithi118.stdout:1/104: getdents d6/de/d16 0 2024-09-21T11:39:12.600 INFO:tasks.workunit.client.1.smithi149.stdout:9/511: dwrite d18/d19/d1a/f26 [0,4194304] 0 2024-09-21T11:39:12.601 INFO:tasks.workunit.client.1.smithi149.stdout:8/477: dread d3/dd/d21/d54/d5c/f71 [0,4194304] 0 2024-09-21T11:39:12.601 INFO:tasks.workunit.client.0.smithi118.stdout:1/105: chown d6/de/f1a 76842932 1 2024-09-21T11:39:12.602 INFO:tasks.workunit.client.1.smithi149.stdout:2/636: symlink d8/dd/d5c/d60/d67/d8a/le1 0 2024-09-21T11:39:12.604 INFO:tasks.workunit.client.0.smithi118.stdout:2/80: creat de/f1e x:0 0 0 2024-09-21T11:39:12.605 INFO:tasks.workunit.client.0.smithi118.stdout:2/81: fdatasync de/f1e 0 2024-09-21T11:39:12.606 INFO:tasks.workunit.client.1.smithi149.stdout:9/512: mknod d18/d1c/ca6 0 2024-09-21T11:39:12.607 INFO:tasks.workunit.client.1.smithi149.stdout:8/478: chown d3/dd/l30 3212 1 2024-09-21T11:39:12.607 INFO:tasks.workunit.client.1.smithi149.stdout:9/513: read d18/d19/d29/d39/f69 [806745,10496] 0 2024-09-21T11:39:12.612 INFO:tasks.workunit.client.1.smithi149.stdout:4/581: sync 2024-09-21T11:39:12.612 INFO:tasks.workunit.client.1.smithi149.stdout:5/575: sync 2024-09-21T11:39:12.614 INFO:tasks.workunit.client.1.smithi149.stdout:5/576: dread d4/d1d/d50/d54/d2a/f6c [0,4194304] 0 2024-09-21T11:39:12.615 INFO:tasks.workunit.client.1.smithi149.stdout:5/577: rename d4/d1d/d50 to d4/d1d/d50/d54/d2a/d93/db9 22 2024-09-21T11:39:12.615 INFO:tasks.workunit.client.1.smithi149.stdout:8/479: creat d3/d33/d34/d72/fa3 x:0 0 0 2024-09-21T11:39:12.617 INFO:tasks.workunit.client.1.smithi149.stdout:1/506: link d2/dd/d35/f8d d2/d5/d8/fa6 0 2024-09-21T11:39:12.620 INFO:tasks.workunit.client.1.smithi149.stdout:2/637: creat d8/dd/d5c/d60/d67/fe2 x:0 0 0 2024-09-21T11:39:12.623 INFO:tasks.workunit.client.1.smithi149.stdout:3/562: dwrite d6/d1f/d47/d37/d3f/f40 [0,4194304] 0 2024-09-21T11:39:12.623 INFO:tasks.workunit.client.1.smithi149.stdout:0/454: write dd/d2d/f7f [2785274,123874] 0 2024-09-21T11:39:12.624 INFO:tasks.workunit.client.1.smithi149.stdout:1/507: unlink d2/dd/d35/d1c/d37/f61 0 2024-09-21T11:39:12.625 INFO:tasks.workunit.client.1.smithi149.stdout:4/582: link d4/d6/d63/d10/d31/d32/d4a/f85 d4/d6/d63/d15/d30/d8a/fd5 0 2024-09-21T11:39:12.628 INFO:tasks.workunit.client.1.smithi149.stdout:4/583: write d4/d6/f9a [589505,57391] 0 2024-09-21T11:39:12.630 INFO:tasks.workunit.client.1.smithi149.stdout:3/563: creat d6/d79/fcc x:0 0 0 2024-09-21T11:39:12.631 INFO:tasks.workunit.client.1.smithi149.stdout:0/455: rmdir dd/d1a/d1b/d50 39 2024-09-21T11:39:12.632 INFO:tasks.workunit.client.1.smithi149.stdout:3/564: write d6/d1f/d47/d22/f49 [853032,10021] 0 2024-09-21T11:39:12.634 INFO:tasks.workunit.client.1.smithi149.stdout:9/514: getdents d18/d19/d1a/d2f/d33/d91 0 2024-09-21T11:39:12.635 INFO:tasks.workunit.client.1.smithi149.stdout:2/638: getdents d8/d20/d78/ddb 0 2024-09-21T11:39:12.636 INFO:tasks.workunit.client.1.smithi149.stdout:4/584: chown d4/d6/d63/d10/c97 15037 1 2024-09-21T11:39:12.636 INFO:tasks.workunit.client.1.smithi149.stdout:2/639: write d8/da/d13/d1a/d29/f69 [1769857,35671] 0 2024-09-21T11:39:12.642 INFO:tasks.workunit.client.1.smithi149.stdout:0/456: creat dd/d1a/f9f x:0 0 0 2024-09-21T11:39:12.652 INFO:tasks.workunit.client.1.smithi149.stdout:9/515: mkdir d18/d19/d1a/d2f/d30/d54/da7 0 2024-09-21T11:39:12.653 INFO:tasks.workunit.client.1.smithi149.stdout:8/480: write d3/f1d [3467532,128539] 0 2024-09-21T11:39:12.653 INFO:tasks.workunit.client.1.smithi149.stdout:2/640: truncate d8/da/d13/d1a/d29/fa4 640546 0 2024-09-21T11:39:12.654 INFO:tasks.workunit.client.1.smithi149.stdout:1/508: write d2/d5/d3d/f72 [4056842,56532] 0 2024-09-21T11:39:12.654 INFO:tasks.workunit.client.1.smithi149.stdout:3/565: read d6/d1f/d47/d22/d8d/fae [48773,59433] 0 2024-09-21T11:39:12.654 INFO:tasks.workunit.client.1.smithi149.stdout:8/481: stat d3/l4e 0 2024-09-21T11:39:12.656 INFO:tasks.workunit.client.1.smithi149.stdout:9/516: chown d18/d19/f20 599226 1 2024-09-21T11:39:12.657 INFO:tasks.workunit.client.1.smithi149.stdout:0/457: write dd/d1a/d1b/d72/d85/d8c/f89 [3247673,11280] 0 2024-09-21T11:39:12.659 INFO:tasks.workunit.client.1.smithi149.stdout:3/566: fsync d6/d1f/d47/d37/d3a/f90 0 2024-09-21T11:39:12.660 INFO:tasks.workunit.client.1.smithi149.stdout:1/509: creat d2/d5/fa7 x:0 0 0 2024-09-21T11:39:12.660 INFO:tasks.workunit.client.1.smithi149.stdout:2/641: creat d8/dcb/db8/dd3/fe3 x:0 0 0 2024-09-21T11:39:12.661 INFO:tasks.workunit.client.1.smithi149.stdout:8/482: mknod d3/d12/d6e/ca4 0 2024-09-21T11:39:12.663 INFO:tasks.workunit.client.1.smithi149.stdout:1/510: fdatasync d2/d2b/d6e/f76 0 2024-09-21T11:39:12.663 INFO:tasks.workunit.client.1.smithi149.stdout:0/458: mknod dd/d1a/d1b/d81/d97/ca0 0 2024-09-21T11:39:12.663 INFO:tasks.workunit.client.1.smithi149.stdout:5/578: dwrite d4/d7/f45 [0,4194304] 0 2024-09-21T11:39:12.664 INFO:tasks.workunit.client.1.smithi149.stdout:3/567: write d6/d1f/fbd [753861,76433] 0 2024-09-21T11:39:12.667 INFO:tasks.workunit.client.1.smithi149.stdout:1/511: dread - d2/dd/d35/d5b/f82 zero size 2024-09-21T11:39:12.668 INFO:tasks.workunit.client.1.smithi149.stdout:0/459: unlink dd/fe 0 2024-09-21T11:39:12.669 INFO:tasks.workunit.client.1.smithi149.stdout:5/579: mknod d4/d1d/d50/d54/d2a/d93/cba 0 2024-09-21T11:39:12.671 INFO:tasks.workunit.client.1.smithi149.stdout:3/568: creat d6/d1f/d47/d22/d8d/fcd x:0 0 0 2024-09-21T11:39:12.673 INFO:tasks.workunit.client.1.smithi149.stdout:2/642: dwrite d8/d20/f97 [4194304,4194304] 0 2024-09-21T11:39:12.673 INFO:tasks.workunit.client.1.smithi149.stdout:0/460: creat dd/d1a/fa1 x:0 0 0 2024-09-21T11:39:12.674 INFO:tasks.workunit.client.1.smithi149.stdout:3/569: read d6/d1f/d4c/fb4 [870203,43522] 0 2024-09-21T11:39:12.675 INFO:tasks.workunit.client.1.smithi149.stdout:2/643: stat d8/da/d13/d1a/d3b/l42 0 2024-09-21T11:39:12.676 INFO:tasks.workunit.client.1.smithi149.stdout:3/570: readlink d6/d79/l98 0 2024-09-21T11:39:12.678 INFO:tasks.workunit.client.1.smithi149.stdout:8/483: link d3/d33/c6c d3/dd/d21/d54/d5c/d6d/ca5 0 2024-09-21T11:39:12.686 INFO:tasks.workunit.client.1.smithi149.stdout:0/461: unlink dd/d1a/d1b/d50/d53/l46 0 2024-09-21T11:39:12.686 INFO:tasks.workunit.client.1.smithi149.stdout:9/517: dread d18/d36/d3c/d47/d76/f7b [0,4194304] 0 2024-09-21T11:39:12.686 INFO:tasks.workunit.client.1.smithi149.stdout:6/470: sync 2024-09-21T11:39:12.687 INFO:tasks.workunit.client.1.smithi149.stdout:8/484: mkdir d3/dd/d3a/da6 0 2024-09-21T11:39:12.687 INFO:tasks.workunit.client.1.smithi149.stdout:0/462: fdatasync dd/d1a/d1b/d72/d85/d8c/f89 0 2024-09-21T11:39:12.689 INFO:tasks.workunit.client.1.smithi149.stdout:2/644: rmdir d8/d44/dde 0 2024-09-21T11:39:12.689 INFO:tasks.workunit.client.1.smithi149.stdout:8/485: read d3/d33/f64 [2818965,52783] 0 2024-09-21T11:39:12.689 INFO:tasks.workunit.client.1.smithi149.stdout:5/580: truncate d4/d7/f27 1868909 0 2024-09-21T11:39:12.691 INFO:tasks.workunit.client.1.smithi149.stdout:9/518: readlink d18/d1c/l92 0 2024-09-21T11:39:12.692 INFO:tasks.workunit.client.1.smithi149.stdout:6/471: rmdir d8/da/d2c/d2d 39 2024-09-21T11:39:12.696 INFO:tasks.workunit.client.1.smithi149.stdout:9/519: rename d18/d19/d29/d39 to d18/d19/d29/d39/da8 22 2024-09-21T11:39:12.696 INFO:tasks.workunit.client.1.smithi149.stdout:5/581: creat d4/d7/d40/d51/fbb x:0 0 0 2024-09-21T11:39:12.697 INFO:tasks.workunit.client.1.smithi149.stdout:5/582: chown d4/d7/d40/c9c 109349 1 2024-09-21T11:39:12.697 INFO:tasks.workunit.client.1.smithi149.stdout:5/583: stat f2 0 2024-09-21T11:39:12.701 INFO:tasks.workunit.client.1.smithi149.stdout:3/571: truncate d6/d1f/d47/f52 290274 0 2024-09-21T11:39:12.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/572: write d6/d1f/d47/fa3 [105239,5586] 0 2024-09-21T11:39:12.703 INFO:tasks.workunit.client.1.smithi149.stdout:6/472: rename d8/d32/d37/f36 to d8/d32/d37/d2b/d7d/f9f 0 2024-09-21T11:39:12.704 INFO:tasks.workunit.client.1.smithi149.stdout:9/520: unlink d18/d1c/l92 0 2024-09-21T11:39:12.705 INFO:tasks.workunit.client.1.smithi149.stdout:5/584: creat d4/d1d/d50/fbc x:0 0 0 2024-09-21T11:39:12.705 INFO:tasks.workunit.client.1.smithi149.stdout:2/645: write d8/d44/d63/db9/f2f [976093,47961] 0 2024-09-21T11:39:12.707 INFO:tasks.workunit.client.1.smithi149.stdout:6/473: rename d8/d32/d37/d79/f88 to d8/d32/d37/d2b/d7d/fa0 0 2024-09-21T11:39:12.708 INFO:tasks.workunit.client.1.smithi149.stdout:2/646: write d8/da/d13/f9b [485505,116697] 0 2024-09-21T11:39:12.709 INFO:tasks.workunit.client.1.smithi149.stdout:0/463: truncate dd/d2d/f56 2961832 0 2024-09-21T11:39:12.711 INFO:tasks.workunit.client.1.smithi149.stdout:9/521: symlink d18/d19/d1a/d2f/d7d/la9 0 2024-09-21T11:39:12.712 INFO:tasks.workunit.client.1.smithi149.stdout:6/474: mkdir d8/d32/d70/da1 0 2024-09-21T11:39:12.713 INFO:tasks.workunit.client.1.smithi149.stdout:5/585: mkdir d4/d7/dbd 0 2024-09-21T11:39:12.714 INFO:tasks.workunit.client.1.smithi149.stdout:8/486: dwrite d3/dd/d3a/f73 [0,4194304] 0 2024-09-21T11:39:12.714 INFO:tasks.workunit.client.1.smithi149.stdout:6/475: stat d8/da/d14/f15 0 2024-09-21T11:39:12.715 INFO:tasks.workunit.client.1.smithi149.stdout:0/464: rmdir dd/d1a/d1b/d81/d97 39 2024-09-21T11:39:12.717 INFO:tasks.workunit.client.1.smithi149.stdout:2/647: unlink d8/da/d13/d1a/d29/c9e 0 2024-09-21T11:39:12.721 INFO:tasks.workunit.client.1.smithi149.stdout:9/522: unlink d18/d19/d1a/d2f/d33/l51 0 2024-09-21T11:39:12.723 INFO:tasks.workunit.client.1.smithi149.stdout:0/465: symlink dd/d6a/la2 0 2024-09-21T11:39:12.723 INFO:tasks.workunit.client.1.smithi149.stdout:3/573: dread d6/d1f/d47/d37/d3a/f92 [0,4194304] 0 2024-09-21T11:39:12.724 INFO:tasks.workunit.client.1.smithi149.stdout:2/648: chown d8/da/d13/ld8 10112526 1 2024-09-21T11:39:12.725 INFO:tasks.workunit.client.1.smithi149.stdout:2/649: chown d8/d20/d78/f93 4618939 1 2024-09-21T11:39:12.729 INFO:tasks.workunit.client.1.smithi149.stdout:5/586: link d4/d7/f32 d4/d7/d40/d43/d5c/d7a/fbe 0 2024-09-21T11:39:12.730 INFO:tasks.workunit.client.1.smithi149.stdout:2/650: rmdir d8 39 2024-09-21T11:39:12.730 INFO:tasks.workunit.client.1.smithi149.stdout:9/523: dwrite d18/d19/d1a/f4b [4194304,4194304] 0 2024-09-21T11:39:12.732 INFO:tasks.workunit.client.1.smithi149.stdout:5/587: mkdir d4/d4f/dbf 0 2024-09-21T11:39:12.732 INFO:tasks.workunit.client.1.smithi149.stdout:3/574: mkdir d6/d1f/d47/dce 0 2024-09-21T11:39:12.737 INFO:tasks.workunit.client.1.smithi149.stdout:2/651: chown d8/da/d13/d1a/c54 10233303 1 2024-09-21T11:39:12.738 INFO:tasks.workunit.client.1.smithi149.stdout:5/588: unlink d4/d1d/d3e/f7c 0 2024-09-21T11:39:12.744 INFO:tasks.workunit.client.1.smithi149.stdout:0/466: fdatasync dd/d2d/f56 0 2024-09-21T11:39:12.746 INFO:tasks.workunit.client.1.smithi149.stdout:3/575: rename d6/fe to d6/fcf 0 2024-09-21T11:39:12.747 INFO:tasks.workunit.client.0.smithi118.stdout:1/106: dwrite d6/de/f11 [0,4194304] 0 2024-09-21T11:39:12.747 INFO:tasks.workunit.client.1.smithi149.stdout:3/576: read - d6/d1f/d47/f81 zero size 2024-09-21T11:39:12.750 INFO:tasks.workunit.client.0.smithi118.stdout:8/168: dwrite d2/f29 [0,4194304] 0 2024-09-21T11:39:12.750 INFO:tasks.workunit.client.1.smithi149.stdout:5/589: write d4/d1d/d50/f7d [252165,126472] 0 2024-09-21T11:39:12.751 INFO:tasks.workunit.client.1.smithi149.stdout:5/590: write d4/d90/f9e [4297165,52520] 0 2024-09-21T11:39:12.752 INFO:tasks.workunit.client.0.smithi118.stdout:2/82: dwrite f8 [0,4194304] 0 2024-09-21T11:39:12.757 INFO:tasks.workunit.client.1.smithi149.stdout:0/467: mknod dd/d1a/d1b/d72/ca3 0 2024-09-21T11:39:12.758 INFO:tasks.workunit.client.0.smithi118.stdout:8/169: mkdir d2/dc/d10/d3a 0 2024-09-21T11:39:12.760 INFO:tasks.workunit.client.0.smithi118.stdout:8/170: write d2/fa [3474280,3698] 0 2024-09-21T11:39:12.760 INFO:tasks.workunit.client.1.smithi149.stdout:9/524: dwrite d18/d1c/f98 [0,4194304] 0 2024-09-21T11:39:12.762 INFO:tasks.workunit.client.0.smithi118.stdout:1/107: mknod d6/de/d16/c1b 0 2024-09-21T11:39:12.764 INFO:tasks.workunit.client.0.smithi118.stdout:8/171: readlink d2/dc/d10/l24 0 2024-09-21T11:39:12.767 INFO:tasks.workunit.client.0.smithi118.stdout:1/108: creat d6/de/d13/f1c x:0 0 0 2024-09-21T11:39:12.769 INFO:tasks.workunit.client.1.smithi149.stdout:2/652: getdents d8/dcb/db8 0 2024-09-21T11:39:12.769 INFO:tasks.workunit.client.0.smithi118.stdout:8/172: mkdir d2/dc/d10/d3b 0 2024-09-21T11:39:12.769 INFO:tasks.workunit.client.0.smithi118.stdout:1/109: truncate d6/de/d13/f1c 290032 0 2024-09-21T11:39:12.769 INFO:tasks.workunit.client.0.smithi118.stdout:8/173: stat d2/dc/d10/d3a 0 2024-09-21T11:39:12.770 INFO:tasks.workunit.client.1.smithi149.stdout:3/577: truncate d6/d1f/d47/d37/d3a/f6c 552140 0 2024-09-21T11:39:12.770 INFO:tasks.workunit.client.0.smithi118.stdout:8/174: chown d2/dc/d10/d3a 2859163 1 2024-09-21T11:39:12.771 INFO:tasks.workunit.client.0.smithi118.stdout:2/83: getdents de 0 2024-09-21T11:39:12.772 INFO:tasks.workunit.client.1.smithi149.stdout:7/631: sync 2024-09-21T11:39:12.773 INFO:tasks.workunit.client.0.smithi118.stdout:8/175: creat d2/d32/f3c x:0 0 0 2024-09-21T11:39:12.777 INFO:tasks.workunit.client.0.smithi118.stdout:8/176: fdatasync d2/dc/d10/d2e/d18/f22 0 2024-09-21T11:39:12.777 INFO:tasks.workunit.client.1.smithi149.stdout:2/653: rename d8/d44/l4a to d8/dcb/le4 0 2024-09-21T11:39:12.778 INFO:tasks.workunit.client.1.smithi149.stdout:3/578: unlink d6/d1f/d47/d37/d3a/d95/cc4 0 2024-09-21T11:39:12.787 INFO:tasks.workunit.client.1.smithi149.stdout:3/579: symlink d6/d1f/d4c/ld0 0 2024-09-21T11:39:12.792 INFO:tasks.workunit.client.1.smithi149.stdout:9/525: dwrite d18/d19/d29/f68 [0,4194304] 0 2024-09-21T11:39:12.793 INFO:tasks.workunit.client.1.smithi149.stdout:7/632: dwrite d12/d90/f1f [0,4194304] 0 2024-09-21T11:39:12.794 INFO:tasks.workunit.client.1.smithi149.stdout:3/580: symlink d6/d1f/d47/ld1 0 2024-09-21T11:39:12.796 INFO:tasks.workunit.client.1.smithi149.stdout:3/581: stat d6/f10 0 2024-09-21T11:39:12.797 INFO:tasks.workunit.client.1.smithi149.stdout:0/468: write dd/d1a/d1b/d50/d53/f54 [297209,64994] 0 2024-09-21T11:39:12.800 INFO:tasks.workunit.client.0.smithi118.stdout:1/110: truncate d6/de/f11 1071571 0 2024-09-21T11:39:12.801 INFO:tasks.workunit.client.1.smithi149.stdout:5/591: truncate d4/d1d/d3e/f84 4076453 0 2024-09-21T11:39:12.803 INFO:tasks.workunit.client.0.smithi118.stdout:8/177: write d2/dc/d10/d2e/d18/f22 [10570287,45086] 0 2024-09-21T11:39:12.803 INFO:tasks.workunit.client.1.smithi149.stdout:2/654: dwrite d8/da/d13/f9b [0,4194304] 0 2024-09-21T11:39:12.803 INFO:tasks.workunit.client.0.smithi118.stdout:1/111: mknod d6/de/d16/c1d 0 2024-09-21T11:39:12.804 INFO:tasks.workunit.client.0.smithi118.stdout:8/178: dread - d2/dc/d10/d2e/d18/f2f zero size 2024-09-21T11:39:12.806 INFO:tasks.workunit.client.0.smithi118.stdout:8/179: fdatasync d2/dc/d10/d2e/f21 0 2024-09-21T11:39:12.807 INFO:tasks.workunit.client.1.smithi149.stdout:0/469: fdatasync dd/d1a/d5a/f77 0 2024-09-21T11:39:12.808 INFO:tasks.workunit.client.1.smithi149.stdout:3/582: mkdir d6/d1f/d47/d22/d8d/d97/dd2 0 2024-09-21T11:39:12.809 INFO:tasks.workunit.client.1.smithi149.stdout:0/470: chown dd/d35/c60 7757 1 2024-09-21T11:39:12.811 INFO:tasks.workunit.client.1.smithi149.stdout:5/592: unlink d4/d1d/l82 0 2024-09-21T11:39:12.813 INFO:tasks.workunit.client.0.smithi118.stdout:1/112: rename f5 to d6/f1e 0 2024-09-21T11:39:12.815 INFO:tasks.workunit.client.1.smithi149.stdout:3/583: write d6/d1f/fc2 [115944,80371] 0 2024-09-21T11:39:12.819 INFO:tasks.workunit.client.0.smithi118.stdout:1/113: dread d6/f8 [0,4194304] 0 2024-09-21T11:39:12.820 INFO:tasks.workunit.client.1.smithi149.stdout:5/593: symlink d4/d7/lc0 0 2024-09-21T11:39:12.821 INFO:tasks.workunit.client.1.smithi149.stdout:2/655: dwrite f7 [4194304,4194304] 0 2024-09-21T11:39:12.822 INFO:tasks.workunit.client.1.smithi149.stdout:7/633: link d12/d90/d26/d30/f34 d12/d90/d4a/d4f/d75/d94/fbc 0 2024-09-21T11:39:12.822 INFO:tasks.workunit.client.1.smithi149.stdout:0/471: creat dd/d1a/d1b/d72/d85/d8c/fa4 x:0 0 0 2024-09-21T11:39:12.823 INFO:tasks.workunit.client.0.smithi118.stdout:1/114: fdatasync d6/f8 0 2024-09-21T11:39:12.825 INFO:tasks.workunit.client.1.smithi149.stdout:3/584: creat d6/d1f/d47/d37/d3f/fd3 x:0 0 0 2024-09-21T11:39:12.827 INFO:tasks.workunit.client.1.smithi149.stdout:3/585: dread - d6/d1f/d4c/f87 zero size 2024-09-21T11:39:12.830 INFO:tasks.workunit.client.1.smithi149.stdout:4/585: sync 2024-09-21T11:39:12.830 INFO:tasks.workunit.client.1.smithi149.stdout:7/634: write d12/d90/d4a/d4f/d75/d94/d47/d49/fad [1470563,120084] 0 2024-09-21T11:39:12.831 INFO:tasks.workunit.client.0.smithi118.stdout:1/115: mkdir d6/d1f 0 2024-09-21T11:39:12.832 INFO:tasks.workunit.client.0.smithi118.stdout:1/116: chown d6/de/d13 90761 1 2024-09-21T11:39:12.832 INFO:tasks.workunit.client.1.smithi149.stdout:0/472: dwrite dd/d2d/f7f [0,4194304] 0 2024-09-21T11:39:12.834 INFO:tasks.workunit.client.1.smithi149.stdout:3/586: mknod d6/d1f/d4c/cd4 0 2024-09-21T11:39:12.837 INFO:tasks.workunit.client.1.smithi149.stdout:9/526: dread d18/d19/d1a/f23 [0,4194304] 0 2024-09-21T11:39:12.839 INFO:tasks.workunit.client.1.smithi149.stdout:9/527: chown d18/d1c/f98 6560 1 2024-09-21T11:39:12.844 INFO:tasks.workunit.client.0.smithi118.stdout:8/180: dwrite d2/dc/d10/d2e/d18/d1a/f1b [0,4194304] 0 2024-09-21T11:39:12.846 INFO:tasks.workunit.client.1.smithi149.stdout:7/635: dread d12/d90/d4a/d4f/d75/d94/fbc [0,4194304] 0 2024-09-21T11:39:12.847 INFO:tasks.workunit.client.1.smithi149.stdout:9/528: rmdir d18/d19/d1a/d2f/d5f 39 2024-09-21T11:39:12.849 INFO:tasks.workunit.client.0.smithi118.stdout:8/181: dread d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:12.850 INFO:tasks.workunit.client.0.smithi118.stdout:8/182: chown d2/dc/d10/d2e/d18/d36 25 1 2024-09-21T11:39:12.852 INFO:tasks.workunit.client.1.smithi149.stdout:3/587: symlink d6/d1f/d27/ld5 0 2024-09-21T11:39:12.854 INFO:tasks.workunit.client.0.smithi118.stdout:8/183: rmdir d2/dc/d10/d2e/d18 39 2024-09-21T11:39:12.857 INFO:tasks.workunit.client.1.smithi149.stdout:5/594: link d4/d1d/d3e/f96 d4/d1d/d50/fc1 0 2024-09-21T11:39:12.859 INFO:tasks.workunit.client.1.smithi149.stdout:0/473: creat dd/d1a/d1b/d81/fa5 x:0 0 0 2024-09-21T11:39:12.859 INFO:tasks.workunit.client.0.smithi118.stdout:1/117: truncate d6/de/f11 909805 0 2024-09-21T11:39:12.859 INFO:tasks.workunit.client.0.smithi118.stdout:8/184: dwrite d2/fa [0,4194304] 0 2024-09-21T11:39:12.860 INFO:tasks.workunit.client.0.smithi118.stdout:1/118: write d6/f19 [4890559,57210] 0 2024-09-21T11:39:12.861 INFO:tasks.workunit.client.0.smithi118.stdout:1/119: chown d6 843 1 2024-09-21T11:39:12.863 INFO:tasks.workunit.client.0.smithi118.stdout:8/185: rmdir d2/d32 39 2024-09-21T11:39:12.863 INFO:tasks.workunit.client.1.smithi149.stdout:9/529: creat d18/d19/d1a/d2f/faa x:0 0 0 2024-09-21T11:39:12.863 INFO:tasks.workunit.client.1.smithi149.stdout:7/636: dwrite d12/d90/d4a/f72 [0,4194304] 0 2024-09-21T11:39:12.866 INFO:tasks.workunit.client.1.smithi149.stdout:4/586: dwrite d4/d6/d63/f28 [0,4194304] 0 2024-09-21T11:39:12.866 INFO:tasks.workunit.client.0.smithi118.stdout:1/120: rename d6/de/lf to d6/de/d13/l20 0 2024-09-21T11:39:12.869 INFO:tasks.workunit.client.0.smithi118.stdout:1/121: mkdir d6/de/d21 0 2024-09-21T11:39:12.869 INFO:tasks.workunit.client.0.smithi118.stdout:8/186: dwrite d2/f29 [0,4194304] 0 2024-09-21T11:39:12.874 INFO:tasks.workunit.client.0.smithi118.stdout:1/122: fdatasync d6/fd 0 2024-09-21T11:39:12.875 INFO:tasks.workunit.client.1.smithi149.stdout:0/474: getdents dd/d1a/d1b/d50/d5d/d9c 0 2024-09-21T11:39:12.876 INFO:tasks.workunit.client.0.smithi118.stdout:8/187: dread d2/f29 [0,4194304] 0 2024-09-21T11:39:12.880 INFO:tasks.workunit.client.1.smithi149.stdout:4/587: rename d4/d6/d63/d10/d31 to d4/d6/d63/d2d/dd6 0 2024-09-21T11:39:12.881 INFO:tasks.workunit.client.1.smithi149.stdout:7/637: getdents d12/d90/d4a/d6c/da0/dbb 0 2024-09-21T11:39:12.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/475: chown dd/d1a/d5a/d8a/c99 6658 1 2024-09-21T11:39:12.883 INFO:tasks.workunit.client.1.smithi149.stdout:4/588: write d4/d6/d63/d2d/fae [817275,2147] 0 2024-09-21T11:39:12.883 INFO:tasks.workunit.client.0.smithi118.stdout:1/123: getdents d6/d1f 0 2024-09-21T11:39:12.889 INFO:tasks.workunit.client.1.smithi149.stdout:9/530: link d18/d19/d1a/d2f/c4d d18/d19/d1a/d2f/cab 0 2024-09-21T11:39:12.890 INFO:tasks.workunit.client.0.smithi118.stdout:1/124: unlink d6/de/d13/l14 0 2024-09-21T11:39:12.890 INFO:tasks.workunit.client.1.smithi149.stdout:7/638: dread d12/d90/d4a/f87 [4194304,4194304] 0 2024-09-21T11:39:12.894 INFO:tasks.workunit.client.1.smithi149.stdout:5/595: write d4/f3a [841016,102876] 0 2024-09-21T11:39:12.896 INFO:tasks.workunit.client.1.smithi149.stdout:9/531: mkdir d18/d19/d29/d39/d63/dac 0 2024-09-21T11:39:12.896 INFO:tasks.workunit.client.1.smithi149.stdout:5/596: write d4/d7/d40/d43/d49/f76 [1215294,30740] 0 2024-09-21T11:39:12.897 INFO:tasks.workunit.client.1.smithi149.stdout:7/639: symlink d12/d90/da1/lbd 0 2024-09-21T11:39:12.898 INFO:tasks.workunit.client.1.smithi149.stdout:0/476: dwrite dd/d1a/d1b/d81/fa5 [0,4194304] 0 2024-09-21T11:39:12.905 INFO:tasks.workunit.client.1.smithi149.stdout:5/597: chown d4/d1d/d3e/ca1 8 1 2024-09-21T11:39:12.905 INFO:tasks.workunit.client.1.smithi149.stdout:0/477: mkdir dd/d1a/d1b/d72/d87/da6 0 2024-09-21T11:39:12.910 INFO:tasks.workunit.client.1.smithi149.stdout:7/640: link d12/d90/d4a/d4f/d75/d94/d47/d49/fad d12/d90/da1/fbe 0 2024-09-21T11:39:12.910 INFO:tasks.workunit.client.1.smithi149.stdout:9/532: dwrite d18/d4c/f67 [4194304,4194304] 0 2024-09-21T11:39:12.912 INFO:tasks.workunit.client.1.smithi149.stdout:7/641: write d12/d90/d4a/d9e/f86 [48094,113019] 0 2024-09-21T11:39:12.912 INFO:tasks.workunit.client.1.smithi149.stdout:5/598: mknod d4/d1d/d50/d60/cc2 0 2024-09-21T11:39:12.913 INFO:tasks.workunit.client.1.smithi149.stdout:0/478: creat dd/d32/fa7 x:0 0 0 2024-09-21T11:39:12.915 INFO:tasks.workunit.client.1.smithi149.stdout:5/599: readlink d4/d7/d40/d51/d56/l94 0 2024-09-21T11:39:12.916 INFO:tasks.workunit.client.0.smithi118.stdout:8/188: write d2/dc/d10/d2e/d18/d1a/f1e [394020,3525] 0 2024-09-21T11:39:12.918 INFO:tasks.workunit.client.1.smithi149.stdout:9/533: symlink d18/d19/d29/d39/d63/dac/lad 0 2024-09-21T11:39:12.918 INFO:tasks.workunit.client.0.smithi118.stdout:8/189: write d2/f29 [850051,34564] 0 2024-09-21T11:39:12.919 INFO:tasks.workunit.client.0.smithi118.stdout:8/190: read d2/f29 [2464396,64041] 0 2024-09-21T11:39:12.920 INFO:tasks.workunit.client.1.smithi149.stdout:4/589: truncate d4/d6/f5e 1912737 0 2024-09-21T11:39:12.922 INFO:tasks.workunit.client.1.smithi149.stdout:5/600: mkdir d4/d7/d40/d43/d49/dc3 0 2024-09-21T11:39:12.923 INFO:tasks.workunit.client.1.smithi149.stdout:5/601: write d4/d7/d40/d43/f69 [279719,86504] 0 2024-09-21T11:39:12.924 INFO:tasks.workunit.client.0.smithi118.stdout:8/191: chown d2/c8 266 1 2024-09-21T11:39:12.924 INFO:tasks.workunit.client.1.smithi149.stdout:0/479: dread dd/d1a/d1b/d50/d53/f42 [0,4194304] 0 2024-09-21T11:39:12.928 INFO:tasks.workunit.client.1.smithi149.stdout:7/642: creat d12/d90/d4a/d6c/fbf x:0 0 0 2024-09-21T11:39:12.929 INFO:tasks.workunit.client.0.smithi118.stdout:8/192: symlink d2/dc/d35/l3d 0 2024-09-21T11:39:12.930 INFO:tasks.workunit.client.1.smithi149.stdout:0/480: rmdir dd/d32 39 2024-09-21T11:39:12.934 INFO:tasks.workunit.client.0.smithi118.stdout:8/193: symlink d2/dc/d35/l3e 0 2024-09-21T11:39:12.934 INFO:tasks.workunit.client.0.smithi118.stdout:8/194: write d2/dc/d10/d2e/d18/d1a/f1e [165070,75732] 0 2024-09-21T11:39:12.934 INFO:tasks.workunit.client.1.smithi149.stdout:5/602: unlink d4/d1d/d50/d54/c2e 0 2024-09-21T11:39:12.939 INFO:tasks.workunit.client.1.smithi149.stdout:0/481: getdents dd/d1a/d1b/d50/d53/d3a 0 2024-09-21T11:39:12.943 INFO:tasks.workunit.client.1.smithi149.stdout:0/482: write dd/d1a/d1b/f24 [773590,117244] 0 2024-09-21T11:39:12.943 INFO:tasks.workunit.client.0.smithi118.stdout:8/195: link d2/dc/d10/d2e/l1d d2/dc/l3f 0 2024-09-21T11:39:12.943 INFO:tasks.workunit.client.1.smithi149.stdout:7/643: write d12/d90/d26/f2e [1804639,67314] 0 2024-09-21T11:39:12.944 INFO:tasks.workunit.client.1.smithi149.stdout:5/603: getdents d4/d7/d40/d43/d5c/d7a 0 2024-09-21T11:39:12.946 INFO:tasks.workunit.client.1.smithi149.stdout:0/483: dread - dd/d1a/d1b/d50/f57 zero size 2024-09-21T11:39:12.947 INFO:tasks.workunit.client.1.smithi149.stdout:0/484: readlink dd/l10 0 2024-09-21T11:39:12.947 INFO:tasks.workunit.client.1.smithi149.stdout:5/604: mknod d4/d1d/d50/d60/db1/cc4 0 2024-09-21T11:39:12.950 INFO:tasks.workunit.client.1.smithi149.stdout:5/605: symlink d4/d1d/d50/lc5 0 2024-09-21T11:39:12.951 INFO:tasks.workunit.client.1.smithi149.stdout:7/644: dwrite ff [0,4194304] 0 2024-09-21T11:39:12.952 INFO:tasks.workunit.client.0.smithi118.stdout:8/196: truncate d2/dc/d10/d2e/d18/d1a/f1b 631738 0 2024-09-21T11:39:12.956 INFO:tasks.workunit.client.0.smithi118.stdout:8/197: symlink d2/d32/l40 0 2024-09-21T11:39:12.956 INFO:tasks.workunit.client.1.smithi149.stdout:7/645: dread d12/f74 [4194304,4194304] 0 2024-09-21T11:39:12.956 INFO:tasks.workunit.client.1.smithi149.stdout:0/485: link dd/d1a/d1b/d72/d78/d8b/l9e dd/d1a/d1b/d50/d5d/la8 0 2024-09-21T11:39:12.960 INFO:tasks.workunit.client.1.smithi149.stdout:1/512: sync 2024-09-21T11:39:12.961 INFO:tasks.workunit.client.1.smithi149.stdout:6/476: sync 2024-09-21T11:39:12.961 INFO:tasks.workunit.client.1.smithi149.stdout:8/487: sync 2024-09-21T11:39:12.964 INFO:tasks.workunit.client.1.smithi149.stdout:7/646: getdents d12/d90/d26 0 2024-09-21T11:39:12.967 INFO:tasks.workunit.client.1.smithi149.stdout:7/647: mknod d12/d90/d4a/d9e/cc0 0 2024-09-21T11:39:12.968 INFO:tasks.workunit.client.1.smithi149.stdout:5/606: dread d4/d7/f4e [0,4194304] 0 2024-09-21T11:39:12.969 INFO:tasks.workunit.client.1.smithi149.stdout:7/648: fsync d12/d90/d68/f7b 0 2024-09-21T11:39:12.970 INFO:tasks.workunit.client.1.smithi149.stdout:8/488: creat d3/d12/d98/fa7 x:0 0 0 2024-09-21T11:39:12.970 INFO:tasks.workunit.client.0.smithi118.stdout:8/198: truncate d2/dc/d10/d2e/d18/d1a/f1e 158113 0 2024-09-21T11:39:12.971 INFO:tasks.workunit.client.0.smithi118.stdout:8/199: read d2/f7 [3842645,54393] 0 2024-09-21T11:39:12.973 INFO:tasks.workunit.client.1.smithi149.stdout:6/477: link d8/d32/d37/d28/d2f/d6a/d72/l8b d8/da/d3d/la2 0 2024-09-21T11:39:12.974 INFO:tasks.workunit.client.0.smithi118.stdout:8/200: symlink d2/dc/d10/d2e/d18/l41 0 2024-09-21T11:39:12.975 INFO:tasks.workunit.client.1.smithi149.stdout:5/607: dread d4/d7/d40/d43/d49/d88/f98 [0,4194304] 0 2024-09-21T11:39:12.975 INFO:tasks.workunit.client.1.smithi149.stdout:0/486: dread dd/d1a/d1b/f27 [0,4194304] 0 2024-09-21T11:39:12.975 INFO:tasks.workunit.client.1.smithi149.stdout:7/649: rename d12/d90/d4a/d4f/d75/l79 to d12/d90/d4a/d9e/lc1 0 2024-09-21T11:39:12.976 INFO:tasks.workunit.client.0.smithi118.stdout:8/201: mkdir d2/dc/d35/d42 0 2024-09-21T11:39:12.978 INFO:tasks.workunit.client.1.smithi149.stdout:0/487: write dd/d2d/f56 [3059793,30828] 0 2024-09-21T11:39:12.980 INFO:tasks.workunit.client.0.smithi118.stdout:8/202: getdents d2/dc/d35/d42 0 2024-09-21T11:39:12.980 INFO:tasks.workunit.client.1.smithi149.stdout:0/488: stat lc 0 2024-09-21T11:39:12.982 INFO:tasks.workunit.client.0.smithi118.stdout:8/203: readlink d2/l6 0 2024-09-21T11:39:12.983 INFO:tasks.workunit.client.1.smithi149.stdout:5/608: rename d4/d1d/d3e/ca1 to d4/d1d/d3e/cc6 0 2024-09-21T11:39:12.983 INFO:tasks.workunit.client.1.smithi149.stdout:8/489: dwrite d3/dd/f3f [0,4194304] 0 2024-09-21T11:39:12.983 INFO:tasks.workunit.client.0.smithi118.stdout:8/204: stat d2/dc/d35/l3d 0 2024-09-21T11:39:12.983 INFO:tasks.workunit.client.0.smithi118.stdout:8/205: chown d2/c20 28 1 2024-09-21T11:39:12.985 INFO:tasks.workunit.client.0.smithi118.stdout:8/206: symlink d2/dc/d16/l43 0 2024-09-21T11:39:12.986 INFO:tasks.workunit.client.1.smithi149.stdout:8/490: readlink d3/d33/d34/d55/d5e/la0 0 2024-09-21T11:39:12.986 INFO:tasks.workunit.client.1.smithi149.stdout:0/489: fsync dd/f19 0 2024-09-21T11:39:13.001 INFO:tasks.workunit.client.0.smithi118.stdout:8/207: dread d2/dc/d10/d2e/d18/d1a/f1e [0,4194304] 0 2024-09-21T11:39:13.004 INFO:tasks.workunit.client.1.smithi149.stdout:1/513: dread d2/dd/d35/d1c/d2c/f5a [0,4194304] 0 2024-09-21T11:39:13.005 INFO:tasks.workunit.client.0.smithi118.stdout:8/208: rmdir d2/dc/d10/d3a 0 2024-09-21T11:39:13.006 INFO:tasks.workunit.client.1.smithi149.stdout:7/650: dwrite d12/d90/d26/d30/f99 [0,4194304] 0 2024-09-21T11:39:13.006 INFO:tasks.workunit.client.0.smithi118.stdout:8/209: mknod d2/dc/d35/d42/c44 0 2024-09-21T11:39:13.008 INFO:tasks.workunit.client.1.smithi149.stdout:8/491: dwrite d3/d12/f15 [0,4194304] 0 2024-09-21T11:39:13.012 INFO:tasks.workunit.client.1.smithi149.stdout:6/478: dread d8/d32/d37/d28/f30 [0,4194304] 0 2024-09-21T11:39:13.014 INFO:tasks.workunit.client.1.smithi149.stdout:5/609: dread d4/d7/d40/d43/d49/f78 [0,4194304] 0 2024-09-21T11:39:13.014 INFO:tasks.workunit.client.0.smithi118.stdout:8/210: dwrite d2/dc/d10/d2e/d18/f2d [0,4194304] 0 2024-09-21T11:39:13.019 INFO:tasks.workunit.client.1.smithi149.stdout:1/514: write d2/dd/f12 [620255,10568] 0 2024-09-21T11:39:13.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/492: symlink d3/la8 0 2024-09-21T11:39:13.023 INFO:tasks.workunit.client.1.smithi149.stdout:6/479: creat d8/fa3 x:0 0 0 2024-09-21T11:39:13.024 INFO:tasks.workunit.client.0.smithi118.stdout:8/211: truncate d2/f29 2142688 0 2024-09-21T11:39:13.026 INFO:tasks.workunit.client.0.smithi118.stdout:8/212: fdatasync d2/f29 0 2024-09-21T11:39:13.027 INFO:tasks.workunit.client.1.smithi149.stdout:5/610: mknod d4/d1d/d3e/cc7 0 2024-09-21T11:39:13.028 INFO:tasks.workunit.client.0.smithi118.stdout:8/213: chown d2/cb 1270 1 2024-09-21T11:39:13.028 INFO:tasks.workunit.client.1.smithi149.stdout:0/490: dread dd/d1a/d1b/d50/d53/d3a/d66/f69 [0,4194304] 0 2024-09-21T11:39:13.029 INFO:tasks.workunit.client.1.smithi149.stdout:7/651: symlink d12/d90/d4a/d6c/lc2 0 2024-09-21T11:39:13.029 INFO:tasks.workunit.client.0.smithi118.stdout:8/214: symlink d2/dc/l45 0 2024-09-21T11:39:13.032 INFO:tasks.workunit.client.1.smithi149.stdout:3/588: sync 2024-09-21T11:39:13.033 INFO:tasks.workunit.client.1.smithi149.stdout:2/656: sync 2024-09-21T11:39:13.037 INFO:tasks.workunit.client.1.smithi149.stdout:5/611: mkdir d4/d1d/d50/dc8 0 2024-09-21T11:39:13.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/480: rename d8/d32/d70/da1 to d8/d32/d37/d28/d87/da4 0 2024-09-21T11:39:13.039 INFO:tasks.workunit.client.1.smithi149.stdout:7/652: symlink d12/d90/d4a/d4f/d75/lc3 0 2024-09-21T11:39:13.042 INFO:tasks.workunit.client.1.smithi149.stdout:2/657: mkdir d8/d11/d88/dd4/de5 0 2024-09-21T11:39:13.044 INFO:tasks.workunit.client.1.smithi149.stdout:6/481: chown d8/d32/d37/d2b/d51 0 1 2024-09-21T11:39:13.044 INFO:tasks.workunit.client.1.smithi149.stdout:8/493: dread d3/dd/d21/f4d [0,4194304] 0 2024-09-21T11:39:13.045 INFO:tasks.workunit.client.1.smithi149.stdout:5/612: creat d4/d1d/d50/dc8/fc9 x:0 0 0 2024-09-21T11:39:13.045 INFO:tasks.workunit.client.1.smithi149.stdout:1/515: dwrite d2/d5/f6b [0,4194304] 0 2024-09-21T11:39:13.047 INFO:tasks.workunit.client.1.smithi149.stdout:3/589: rename d6/d5f/d6d to d6/d1f/d47/d37/dd6 0 2024-09-21T11:39:13.049 INFO:tasks.workunit.client.1.smithi149.stdout:2/658: creat d8/da/d13/d83/fe6 x:0 0 0 2024-09-21T11:39:13.049 INFO:tasks.workunit.client.1.smithi149.stdout:6/482: write d8/d32/d37/d2b/d51/f5a [1002777,120126] 0 2024-09-21T11:39:13.050 INFO:tasks.workunit.client.1.smithi149.stdout:0/491: link dd/l13 dd/d1a/d1b/d50/la9 0 2024-09-21T11:39:13.051 INFO:tasks.workunit.client.1.smithi149.stdout:8/494: truncate d3/dd/d21/d54/d5c/f9f 769912 0 2024-09-21T11:39:13.051 INFO:tasks.workunit.client.1.smithi149.stdout:1/516: mknod d2/d2b/d6e/ca8 0 2024-09-21T11:39:13.052 INFO:tasks.workunit.client.1.smithi149.stdout:5/613: write d4/d1d/d50/f8b [1525083,68664] 0 2024-09-21T11:39:13.053 INFO:tasks.workunit.client.1.smithi149.stdout:3/590: mknod d6/d5f/d60/cd7 0 2024-09-21T11:39:13.054 INFO:tasks.workunit.client.1.smithi149.stdout:7/653: rename d12/d90/d26 to d12/d90/d68/dc4 0 2024-09-21T11:39:13.057 INFO:tasks.workunit.client.1.smithi149.stdout:5/614: write d4/d7/d40/d43/d85/faa [847001,106577] 0 2024-09-21T11:39:13.057 INFO:tasks.workunit.client.1.smithi149.stdout:3/591: read d6/d1f/fc2 [117262,90957] 0 2024-09-21T11:39:13.060 INFO:tasks.workunit.client.1.smithi149.stdout:5/615: write d4/d7/d40/f6d [144703,81657] 0 2024-09-21T11:39:13.062 INFO:tasks.workunit.client.1.smithi149.stdout:1/517: mknod d2/dd/d35/d1c/d7a/ca9 0 2024-09-21T11:39:13.062 INFO:tasks.workunit.client.1.smithi149.stdout:5/616: fsync d4/d7/d40/d43/d49/f76 0 2024-09-21T11:39:13.064 INFO:tasks.workunit.client.1.smithi149.stdout:9/534: sync 2024-09-21T11:39:13.064 INFO:tasks.workunit.client.1.smithi149.stdout:4/590: sync 2024-09-21T11:39:13.065 INFO:tasks.workunit.client.1.smithi149.stdout:2/659: link d8/da/f39 d8/d44/d63/db9/fe7 0 2024-09-21T11:39:13.067 INFO:tasks.workunit.client.0.smithi118.stdout:8/215: dread d2/dc/d10/d2e/d18/f22 [0,4194304] 0 2024-09-21T11:39:13.067 INFO:tasks.workunit.client.1.smithi149.stdout:0/492: mkdir dd/d1a/d1b/d72/d78/d8b/d98/daa 0 2024-09-21T11:39:13.068 INFO:tasks.workunit.client.0.smithi118.stdout:8/216: stat d2/dc/d10/d2e/d18/d1a/l39 0 2024-09-21T11:39:13.068 INFO:tasks.workunit.client.1.smithi149.stdout:6/483: dwrite d8/d32/d70/f91 [0,4194304] 0 2024-09-21T11:39:13.069 INFO:tasks.workunit.client.1.smithi149.stdout:3/592: symlink d6/d5f/d60/d88/ld8 0 2024-09-21T11:39:13.072 INFO:tasks.workunit.client.1.smithi149.stdout:3/593: chown d6/d1f/d47/d37/d3f/fa1 24119 1 2024-09-21T11:39:13.074 INFO:tasks.workunit.client.1.smithi149.stdout:8/495: link d3/dd/d21/f4d d3/d3c/d8f/d76/fa9 0 2024-09-21T11:39:13.075 INFO:tasks.workunit.client.1.smithi149.stdout:0/493: dwrite dd/d1a/d5a/f80 [0,4194304] 0 2024-09-21T11:39:13.078 INFO:tasks.workunit.client.1.smithi149.stdout:8/496: write d3/dd/d18/d2e/d80/f93 [2774911,13051] 0 2024-09-21T11:39:13.078 INFO:tasks.workunit.client.1.smithi149.stdout:7/654: mkdir d12/d5b/db5/dc5 0 2024-09-21T11:39:13.079 INFO:tasks.workunit.client.1.smithi149.stdout:7/655: chown d12 69 1 2024-09-21T11:39:13.079 INFO:tasks.workunit.client.1.smithi149.stdout:1/518: mknod d2/dd/d35/d7c/caa 0 2024-09-21T11:39:13.080 INFO:tasks.workunit.client.1.smithi149.stdout:0/494: dread - dd/d1a/d1b/d50/f57 zero size 2024-09-21T11:39:13.081 INFO:tasks.workunit.client.0.smithi118.stdout:8/217: getdents d2/dc/d10 0 2024-09-21T11:39:13.082 INFO:tasks.workunit.client.1.smithi149.stdout:9/535: rmdir d18/d19/d1a/d2f/d33/d91 39 2024-09-21T11:39:13.082 INFO:tasks.workunit.client.0.smithi118.stdout:8/218: fsync d2/dc/d10/d2e/d18/f2d 0 2024-09-21T11:39:13.085 INFO:tasks.workunit.client.1.smithi149.stdout:1/519: chown d2/d5/d3d/l36 972763 1 2024-09-21T11:39:13.085 INFO:tasks.workunit.client.1.smithi149.stdout:2/660: mkdir d8/da/d13/d2d/d6f/de8 0 2024-09-21T11:39:13.087 INFO:tasks.workunit.client.1.smithi149.stdout:4/591: fsync d4/d6/d63/d2d/dd6/d32/d4a/f85 0 2024-09-21T11:39:13.087 INFO:tasks.workunit.client.1.smithi149.stdout:5/617: rename d4/d1d/d50/d54/d2a/d93/dad to d4/d7/d40/d43/d5c/d7a/dca 0 2024-09-21T11:39:13.088 INFO:tasks.workunit.client.1.smithi149.stdout:6/484: rmdir d8/d32/d37/d28/d2e 39 2024-09-21T11:39:13.088 INFO:tasks.workunit.client.1.smithi149.stdout:3/594: mknod d6/d5f/d60/cd9 0 2024-09-21T11:39:13.090 INFO:tasks.workunit.client.1.smithi149.stdout:8/497: chown d3/d12/d6e/d79/d8e 118251982 1 2024-09-21T11:39:13.091 INFO:tasks.workunit.client.1.smithi149.stdout:3/595: readlink d6/d1f/lc9 0 2024-09-21T11:39:13.091 INFO:tasks.workunit.client.1.smithi149.stdout:6/485: read - d8/d32/d64/f9c zero size 2024-09-21T11:39:13.092 INFO:tasks.workunit.client.0.smithi118.stdout:8/219: dwrite d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:13.093 INFO:tasks.workunit.client.1.smithi149.stdout:9/536: symlink d18/d19/d1a/d2f/d33/lae 0 2024-09-21T11:39:13.093 INFO:tasks.workunit.client.0.smithi118.stdout:8/220: chown d2/dc/d10/d2e/d18/d36 820980793 1 2024-09-21T11:39:13.094 INFO:tasks.workunit.client.1.smithi149.stdout:2/661: mknod d8/dd/d5c/d60/d67/ce9 0 2024-09-21T11:39:13.094 INFO:tasks.workunit.client.1.smithi149.stdout:3/596: chown d6/d1f/d4c/fb4 4 1 2024-09-21T11:39:13.095 INFO:tasks.workunit.client.1.smithi149.stdout:7/656: rename f4 to d12/d90/d4a/d6c/d8c/daa/fc6 0 2024-09-21T11:39:13.095 INFO:tasks.workunit.client.1.smithi149.stdout:8/498: rmdir d3/dd/d18/d2e 39 2024-09-21T11:39:13.097 INFO:tasks.workunit.client.1.smithi149.stdout:1/520: link d2/d5/f34 d2/d5/fab 0 2024-09-21T11:39:13.101 INFO:tasks.workunit.client.0.smithi118.stdout:8/221: truncate d2/f7 104929 0 2024-09-21T11:39:13.105 INFO:tasks.workunit.client.1.smithi149.stdout:2/662: write d8/dcb/fcd [900113,110375] 0 2024-09-21T11:39:13.106 INFO:tasks.workunit.client.1.smithi149.stdout:4/592: dread d4/d6/d18/f2a [0,4194304] 0 2024-09-21T11:39:13.107 INFO:tasks.workunit.client.1.smithi149.stdout:0/495: dwrite dd/d1a/d1b/d50/d53/d3a/d66/f9b [0,4194304] 0 2024-09-21T11:39:13.107 INFO:tasks.workunit.client.1.smithi149.stdout:5/618: rename d4/d1d/d50/d54/l1f to d4/d7/d40/d43/d49/d88/lcb 0 2024-09-21T11:39:13.107 INFO:tasks.workunit.client.1.smithi149.stdout:3/597: rmdir d6/d1f/d47/d37/d50 39 2024-09-21T11:39:13.110 INFO:tasks.workunit.client.1.smithi149.stdout:6/486: truncate d8/d32/d37/d2b/f96 82533 0 2024-09-21T11:39:13.114 INFO:tasks.workunit.client.1.smithi149.stdout:1/521: symlink d2/dd/d35/d1c/d41/d74/lac 0 2024-09-21T11:39:13.115 INFO:tasks.workunit.client.0.smithi118.stdout:8/222: getdents d2/dc/d10 0 2024-09-21T11:39:13.115 INFO:tasks.workunit.client.1.smithi149.stdout:4/593: truncate d4/f80 274740 0 2024-09-21T11:39:13.115 INFO:tasks.workunit.client.1.smithi149.stdout:7/657: symlink d12/d90/d4a/d6c/da0/dbb/lc7 0 2024-09-21T11:39:13.118 INFO:tasks.workunit.client.1.smithi149.stdout:2/663: rename d8/da/d13/d5d/cb5 to d8/d44/d63/cea 0 2024-09-21T11:39:13.118 INFO:tasks.workunit.client.1.smithi149.stdout:9/537: dwrite d18/d19/d29/d39/f69 [0,4194304] 0 2024-09-21T11:39:13.120 INFO:tasks.workunit.client.1.smithi149.stdout:2/664: chown d8/d11/c35 1007 1 2024-09-21T11:39:13.120 INFO:tasks.workunit.client.1.smithi149.stdout:9/538: read d18/d19/d1a/f26 [3050529,2161] 0 2024-09-21T11:39:13.121 INFO:tasks.workunit.client.1.smithi149.stdout:3/598: symlink d6/d1f/d47/dce/lda 0 2024-09-21T11:39:13.122 INFO:tasks.workunit.client.0.smithi118.stdout:8/223: fsync d2/dc/d10/d2e/d18/d1a/f1b 0 2024-09-21T11:39:13.127 INFO:tasks.workunit.client.1.smithi149.stdout:6/487: truncate d8/d32/d37/d28/d2e/f9e 71233 0 2024-09-21T11:39:13.127 INFO:tasks.workunit.client.1.smithi149.stdout:1/522: rmdir d2/dd/d35/d1c/d41/d51/d73 39 2024-09-21T11:39:13.130 INFO:tasks.workunit.client.0.smithi118.stdout:8/224: mkdir d2/dc/d16/d46 0 2024-09-21T11:39:13.131 INFO:tasks.workunit.client.0.smithi118.stdout:8/225: write d2/f29 [2782700,53576] 0 2024-09-21T11:39:13.131 INFO:tasks.workunit.client.1.smithi149.stdout:5/619: creat d4/fcc x:0 0 0 2024-09-21T11:39:13.133 INFO:tasks.workunit.client.1.smithi149.stdout:4/594: mknod d4/d4d/d5f/d71/cd7 0 2024-09-21T11:39:13.134 INFO:tasks.workunit.client.1.smithi149.stdout:8/499: dread d3/dd/d3a/f63 [0,4194304] 0 2024-09-21T11:39:13.135 INFO:tasks.workunit.client.1.smithi149.stdout:6/488: dread d8/d32/d70/f91 [0,4194304] 0 2024-09-21T11:39:13.138 INFO:tasks.workunit.client.0.smithi118.stdout:8/226: fdatasync d2/dc/d10/d2e/d18/d1a/f1e 0 2024-09-21T11:39:13.138 INFO:tasks.workunit.client.0.smithi118.stdout:8/227: chown d2/dc/d35/d42/c44 0 1 2024-09-21T11:39:13.138 INFO:tasks.workunit.client.1.smithi149.stdout:7/658: dread d12/d90/f17 [0,4194304] 0 2024-09-21T11:39:13.143 INFO:tasks.workunit.client.1.smithi149.stdout:9/539: mkdir d18/d36/d3c/d47/daf 0 2024-09-21T11:39:13.145 INFO:tasks.workunit.client.1.smithi149.stdout:9/540: write d18/d19/d1a/d2f/faa [10164,71916] 0 2024-09-21T11:39:13.146 INFO:tasks.workunit.client.1.smithi149.stdout:3/599: symlink d6/d5f/d60/ldb 0 2024-09-21T11:39:13.148 INFO:tasks.workunit.client.1.smithi149.stdout:0/496: rename dd/d1a/c1e to dd/d1a/d1b/d81/d97/cab 0 2024-09-21T11:39:13.150 INFO:tasks.workunit.client.0.smithi118.stdout:0/204: sync 2024-09-21T11:39:13.152 INFO:tasks.workunit.client.0.smithi118.stdout:0/205: write d5/d10/d1e/d23/d3a/f3e [709039,37274] 0 2024-09-21T11:39:13.152 INFO:tasks.workunit.client.1.smithi149.stdout:5/620: mkdir d4/d7/d40/d43/d49/d88/dcd 0 2024-09-21T11:39:13.154 INFO:tasks.workunit.client.0.smithi118.stdout:8/228: link d2/dc/d10/d2e/l1d d2/dc/d35/l47 0 2024-09-21T11:39:13.154 INFO:tasks.workunit.client.1.smithi149.stdout:4/595: write d4/d6/f56 [1021485,66065] 0 2024-09-21T11:39:13.154 INFO:tasks.workunit.client.1.smithi149.stdout:0/497: dwrite dd/d1a/d1b/d72/d87/f96 [0,4194304] 0 2024-09-21T11:39:13.156 INFO:tasks.workunit.client.0.smithi118.stdout:0/206: rename d5/f17 to d5/d10/d1e/d21/f42 0 2024-09-21T11:39:13.161 INFO:tasks.workunit.client.0.smithi118.stdout:0/207: creat d5/d10/d1e/d20/f43 x:0 0 0 2024-09-21T11:39:13.161 INFO:tasks.workunit.client.1.smithi149.stdout:8/500: read d3/dd/d18/d2e/d80/f93 [2946330,32393] 0 2024-09-21T11:39:13.165 INFO:tasks.workunit.client.1.smithi149.stdout:9/541: symlink d18/d19/d29/d39/d63/dac/lb0 0 2024-09-21T11:39:13.166 INFO:tasks.workunit.client.0.smithi118.stdout:8/229: link d2/dc/l45 d2/d34/l48 0 2024-09-21T11:39:13.167 INFO:tasks.workunit.client.1.smithi149.stdout:3/600: read - d6/d1f/d47/d37/d3a/f6b zero size 2024-09-21T11:39:13.168 INFO:tasks.workunit.client.0.smithi118.stdout:0/208: dwrite d5/d10/d1e/d23/d3a/f3e [0,4194304] 0 2024-09-21T11:39:13.168 INFO:tasks.workunit.client.1.smithi149.stdout:1/523: rename d2/d5/d3d/d88/l83 to d2/d5/d65/lad 0 2024-09-21T11:39:13.172 INFO:tasks.workunit.client.0.smithi118.stdout:0/209: mkdir d5/d34/d44 0 2024-09-21T11:39:13.174 INFO:tasks.workunit.client.0.smithi118.stdout:8/230: mkdir d2/dc/d49 0 2024-09-21T11:39:13.175 INFO:tasks.workunit.client.1.smithi149.stdout:4/596: mknod d4/d4d/cd8 0 2024-09-21T11:39:13.175 INFO:tasks.workunit.client.1.smithi149.stdout:1/524: dwrite d2/dd/d35/d1c/d2c/f8b [0,4194304] 0 2024-09-21T11:39:13.176 INFO:tasks.workunit.client.0.smithi118.stdout:0/210: creat d5/d10/d1e/d21/d2a/f45 x:0 0 0 2024-09-21T11:39:13.180 INFO:tasks.workunit.client.0.smithi118.stdout:8/231: write d2/dc/d10/d2e/d18/f22 [6597569,12752] 0 2024-09-21T11:39:13.180 INFO:tasks.workunit.client.0.smithi118.stdout:0/211: dread d5/f13 [0,4194304] 0 2024-09-21T11:39:13.181 INFO:tasks.workunit.client.1.smithi149.stdout:0/498: unlink dd/d1a/d1b/d50/d53/d3a/d66/f9b 0 2024-09-21T11:39:13.182 INFO:tasks.workunit.client.0.smithi118.stdout:8/232: fsync d2/dc/d10/d2e/d18/f2f 0 2024-09-21T11:39:13.183 INFO:tasks.workunit.client.1.smithi149.stdout:7/659: symlink d12/d90/d4a/d6c/lc8 0 2024-09-21T11:39:13.186 INFO:tasks.workunit.client.1.smithi149.stdout:2/665: creat d8/d11/feb x:0 0 0 2024-09-21T11:39:13.187 INFO:tasks.workunit.client.1.smithi149.stdout:9/542: symlink d18/d19/d29/d39/d63/dac/lb1 0 2024-09-21T11:39:13.189 INFO:tasks.workunit.client.1.smithi149.stdout:3/601: truncate d6/d1f/d4c/fb4 1619297 0 2024-09-21T11:39:13.194 INFO:tasks.workunit.client.1.smithi149.stdout:1/525: creat d2/dd/d35/d1c/d7a/fae x:0 0 0 2024-09-21T11:39:13.195 INFO:tasks.workunit.client.0.smithi118.stdout:0/212: rmdir d5/d34/d40 0 2024-09-21T11:39:13.195 INFO:tasks.workunit.client.0.smithi118.stdout:0/213: chown d5/d34/d44 1339706 1 2024-09-21T11:39:13.200 INFO:tasks.workunit.client.1.smithi149.stdout:9/543: rmdir d18/d36 39 2024-09-21T11:39:13.202 INFO:tasks.workunit.client.1.smithi149.stdout:0/499: dread dd/d1a/d1b/f31 [0,4194304] 0 2024-09-21T11:39:13.202 INFO:tasks.workunit.client.0.smithi118.stdout:0/214: link d5/d10/d1e/d20/f2b d5/d10/d1e/d23/d3a/f46 0 2024-09-21T11:39:13.203 INFO:tasks.workunit.client.1.smithi149.stdout:0/500: chown dd/d1a/l62 43742417 1 2024-09-21T11:39:13.203 INFO:tasks.workunit.client.1.smithi149.stdout:3/602: mknod d6/d1f/d47/d37/dd6/cdc 0 2024-09-21T11:39:13.206 INFO:tasks.workunit.client.0.smithi118.stdout:8/233: truncate d2/f29 891648 0 2024-09-21T11:39:13.206 INFO:tasks.workunit.client.1.smithi149.stdout:4/597: mknod d4/d4d/d5f/d71/dd1/cd9 0 2024-09-21T11:39:13.208 INFO:tasks.workunit.client.1.smithi149.stdout:4/598: write d4/d6/fb [1952684,64768] 0 2024-09-21T11:39:13.208 INFO:tasks.workunit.client.0.smithi118.stdout:0/215: unlink d5/l19 0 2024-09-21T11:39:13.208 INFO:tasks.workunit.client.0.smithi118.stdout:0/216: dread - d5/d10/d1e/d20/f41 zero size 2024-09-21T11:39:13.209 INFO:tasks.workunit.client.1.smithi149.stdout:4/599: stat d4/d6/d18/c26 0 2024-09-21T11:39:13.209 INFO:tasks.workunit.client.0.smithi118.stdout:0/217: fdatasync d5/d34/f3c 0 2024-09-21T11:39:13.210 INFO:tasks.workunit.client.1.smithi149.stdout:4/600: fsync d4/d6/d63/d2d/dd6/fbc 0 2024-09-21T11:39:13.211 INFO:tasks.workunit.client.0.smithi118.stdout:8/234: rename d2/dc/d10/d2e/d18/f2d to d2/d34/f4a 0 2024-09-21T11:39:13.211 INFO:tasks.workunit.client.0.smithi118.stdout:8/235: readlink d2/dc/d35/l3d 0 2024-09-21T11:39:13.212 INFO:tasks.workunit.client.1.smithi149.stdout:7/660: creat d12/d5b/db5/dc5/fc9 x:0 0 0 2024-09-21T11:39:13.213 INFO:tasks.workunit.client.1.smithi149.stdout:9/544: chown d18/d19/d1a/d2f/d5f/f73 0 1 2024-09-21T11:39:13.216 INFO:tasks.workunit.client.1.smithi149.stdout:6/489: rename d8/da/d2c/d52/d5e/d69/l7b to d8/da/d2c/la5 0 2024-09-21T11:39:13.217 INFO:tasks.workunit.client.1.smithi149.stdout:3/603: mkdir d6/d79/d7e/ddd 0 2024-09-21T11:39:13.218 INFO:tasks.workunit.client.1.smithi149.stdout:0/501: dread dd/d1a/f2f [0,4194304] 0 2024-09-21T11:39:13.219 INFO:tasks.workunit.client.1.smithi149.stdout:6/490: chown d8/d32/d37/d2b/d51/f5a 62702098 1 2024-09-21T11:39:13.219 INFO:tasks.workunit.client.1.smithi149.stdout:3/604: chown d6/d1f/d47/d37/dd6/l7c 1067 1 2024-09-21T11:39:13.220 INFO:tasks.workunit.client.1.smithi149.stdout:5/621: getdents d4/d7/d40/d51/d56 0 2024-09-21T11:39:13.221 INFO:tasks.workunit.client.1.smithi149.stdout:6/491: dread - d8/d32/d37/d28/f74 zero size 2024-09-21T11:39:13.222 INFO:tasks.workunit.client.1.smithi149.stdout:9/545: dwrite d18/d19/d1a/f2d [0,4194304] 0 2024-09-21T11:39:13.222 INFO:tasks.workunit.client.1.smithi149.stdout:5/622: dread - d4/d7/d40/d51/f8c zero size 2024-09-21T11:39:13.222 INFO:tasks.workunit.client.0.smithi118.stdout:8/236: link d2/l6 d2/dc/d35/d42/l4b 0 2024-09-21T11:39:13.223 INFO:tasks.workunit.client.1.smithi149.stdout:6/492: fsync d8/d32/d37/d2b/f99 0 2024-09-21T11:39:13.224 INFO:tasks.workunit.client.1.smithi149.stdout:4/601: creat d4/d6/d63/d15/fda x:0 0 0 2024-09-21T11:39:13.227 INFO:tasks.workunit.client.0.smithi118.stdout:8/237: mkdir d2/dc/d16/d46/d4c 0 2024-09-21T11:39:13.229 INFO:tasks.workunit.client.1.smithi149.stdout:9/546: dread d18/d19/d1a/d2f/f38 [0,4194304] 0 2024-09-21T11:39:13.231 INFO:tasks.workunit.client.1.smithi149.stdout:8/501: rename d3/dd/d18/c2b to d3/d33/d34/d72/caa 0 2024-09-21T11:39:13.232 INFO:tasks.workunit.client.0.smithi118.stdout:0/218: dwrite d5/f11 [0,4194304] 0 2024-09-21T11:39:13.234 INFO:tasks.workunit.client.0.smithi118.stdout:8/238: symlink d2/dc/d10/d2e/d18/l4d 0 2024-09-21T11:39:13.237 INFO:tasks.workunit.client.0.smithi118.stdout:8/239: write d2/dc/d10/d2e/f21 [4729344,76602] 0 2024-09-21T11:39:13.240 INFO:tasks.workunit.client.1.smithi149.stdout:7/661: creat d12/d90/db8/fca x:0 0 0 2024-09-21T11:39:13.241 INFO:tasks.workunit.client.0.smithi118.stdout:0/219: dwrite d5/d10/d1e/d20/f26 [0,4194304] 0 2024-09-21T11:39:13.241 INFO:tasks.workunit.client.0.smithi118.stdout:8/240: rmdir d2/dc/d35/d42 39 2024-09-21T11:39:13.243 INFO:tasks.workunit.client.0.smithi118.stdout:8/241: readlink d2/dc/d10/d2e/d18/l41 0 2024-09-21T11:39:13.244 INFO:tasks.workunit.client.0.smithi118.stdout:8/242: chown d2/dc/d10/c2a 3801 1 2024-09-21T11:39:13.244 INFO:tasks.workunit.client.1.smithi149.stdout:2/666: rename d8/d44/d63/db9/fe7 to d8/dd/d8c/de0/fec 0 2024-09-21T11:39:13.248 INFO:tasks.workunit.client.1.smithi149.stdout:3/605: symlink d6/d1f/lde 0 2024-09-21T11:39:13.248 INFO:tasks.workunit.client.1.smithi149.stdout:6/493: dwrite d8/d32/d37/f3c [0,4194304] 0 2024-09-21T11:39:13.249 INFO:tasks.workunit.client.1.smithi149.stdout:0/502: mknod dd/d1a/d1b/d72/d87/da6/cac 0 2024-09-21T11:39:13.251 INFO:tasks.workunit.client.0.smithi118.stdout:0/220: rename c3 to d5/d10/d1e/d3d/c47 0 2024-09-21T11:39:13.253 INFO:tasks.workunit.client.0.smithi118.stdout:0/221: fdatasync d5/d10/d1e/d21/f24 0 2024-09-21T11:39:13.255 INFO:tasks.workunit.client.0.smithi118.stdout:8/243: dwrite d2/dc/d10/d2e/d18/d1a/f1f [0,4194304] 0 2024-09-21T11:39:13.256 INFO:tasks.workunit.client.1.smithi149.stdout:9/547: mknod d18/d19/d1a/cb2 0 2024-09-21T11:39:13.260 INFO:tasks.workunit.client.0.smithi118.stdout:0/222: fsync d5/d10/d1e/d20/f2b 0 2024-09-21T11:39:13.264 INFO:tasks.workunit.client.1.smithi149.stdout:5/623: rename d4/d7/d40/d43/d5c/d7a/dca to d4/d7/d40/d43/d85/dce 0 2024-09-21T11:39:13.265 INFO:tasks.workunit.client.0.smithi118.stdout:0/223: mkdir d5/d10/d1e/d21/d2a/d48 0 2024-09-21T11:39:13.266 INFO:tasks.workunit.client.1.smithi149.stdout:4/602: dwrite d4/d6/d63/d2d/dd6/d32/d4a/f85 [0,4194304] 0 2024-09-21T11:39:13.269 INFO:tasks.workunit.client.1.smithi149.stdout:2/667: creat d8/dd/d5c/d84/fed x:0 0 0 2024-09-21T11:39:13.271 INFO:tasks.workunit.client.1.smithi149.stdout:0/503: unlink dd/d35/f4d 0 2024-09-21T11:39:13.271 INFO:tasks.workunit.client.1.smithi149.stdout:7/662: write d12/d90/d4a/d4f/d75/d94/d47/d49/fad [2248334,101028] 0 2024-09-21T11:39:13.272 INFO:tasks.workunit.client.0.smithi118.stdout:0/224: rename d5/cc to d5/d29/c49 0 2024-09-21T11:39:13.273 INFO:tasks.workunit.client.0.smithi118.stdout:8/244: write d2/dc/d10/d2e/d18/d1a/f1b [1671176,66048] 0 2024-09-21T11:39:13.275 INFO:tasks.workunit.client.0.smithi118.stdout:0/225: truncate d5/f13 2964229 0 2024-09-21T11:39:13.276 INFO:tasks.workunit.client.1.smithi149.stdout:6/494: rename d8/d32/d37/f71 to d8/da/d2c/d52/d5e/d9b/fa6 0 2024-09-21T11:39:13.278 INFO:tasks.workunit.client.0.smithi118.stdout:8/245: dread d2/f29 [0,4194304] 0 2024-09-21T11:39:13.279 INFO:tasks.workunit.client.0.smithi118.stdout:0/226: dread d5/d10/d1e/d21/f24 [0,4194304] 0 2024-09-21T11:39:13.281 INFO:tasks.workunit.client.1.smithi149.stdout:6/495: write d8/d32/d37/d2b/f96 [407867,41490] 0 2024-09-21T11:39:13.283 INFO:tasks.workunit.client.0.smithi118.stdout:0/227: creat d5/d10/d1e/d21/d2a/f4a x:0 0 0 2024-09-21T11:39:13.284 INFO:tasks.workunit.client.1.smithi149.stdout:7/663: creat d12/d90/d4a/d6c/d8c/fcb x:0 0 0 2024-09-21T11:39:13.285 INFO:tasks.workunit.client.1.smithi149.stdout:9/548: dwrite d18/d36/d3c/d47/f66 [0,4194304] 0 2024-09-21T11:39:13.287 INFO:tasks.workunit.client.0.smithi118.stdout:8/246: dwrite d2/dc/d10/d2e/d18/f2f [0,4194304] 0 2024-09-21T11:39:13.290 INFO:tasks.workunit.client.0.smithi118.stdout:8/247: dread d2/dc/d10/d2e/d18/d1a/f1e [0,4194304] 0 2024-09-21T11:39:13.296 INFO:tasks.workunit.client.1.smithi149.stdout:9/549: dwrite d18/d19/d29/f68 [4194304,4194304] 0 2024-09-21T11:39:13.296 INFO:tasks.workunit.client.0.smithi118.stdout:0/228: dwrite d5/d10/d1e/d23/d3a/f46 [0,4194304] 0 2024-09-21T11:39:13.298 INFO:tasks.workunit.client.0.smithi118.stdout:0/229: chown d5/d10/d1e/d20/f26 1009446 1 2024-09-21T11:39:13.298 INFO:tasks.workunit.client.1.smithi149.stdout:6/496: mkdir d8/d32/d37/d2b/d51/da7 0 2024-09-21T11:39:13.299 INFO:tasks.workunit.client.0.smithi118.stdout:8/248: dread d2/dc/d10/d2e/d18/d1a/f1f [0,4194304] 0 2024-09-21T11:39:13.299 INFO:tasks.workunit.client.1.smithi149.stdout:7/664: symlink d12/d90/d4a/d9e/lcc 0 2024-09-21T11:39:13.299 INFO:tasks.workunit.client.1.smithi149.stdout:8/502: link d3/d3c/c67 d3/d12/d6e/cab 0 2024-09-21T11:39:13.300 INFO:tasks.workunit.client.0.smithi118.stdout:0/230: truncate d5/d10/d1e/d20/f41 579475 0 2024-09-21T11:39:13.301 INFO:tasks.workunit.client.0.smithi118.stdout:8/249: write d2/d34/f4a [992735,125194] 0 2024-09-21T11:39:13.302 INFO:tasks.workunit.client.1.smithi149.stdout:7/665: write d12/d90/d4a/d6c/fbf [14815,13316] 0 2024-09-21T11:39:13.308 INFO:tasks.workunit.client.0.smithi118.stdout:0/231: dwrite d5/f11 [0,4194304] 0 2024-09-21T11:39:13.311 INFO:tasks.workunit.client.0.smithi118.stdout:8/250: rename d2/dc/lf to d2/dc/d10/d2e/d18/l4e 0 2024-09-21T11:39:13.316 INFO:tasks.workunit.client.1.smithi149.stdout:8/503: rename d3/c36 to d3/d12/d6e/d79/cac 0 2024-09-21T11:39:13.317 INFO:tasks.workunit.client.1.smithi149.stdout:2/668: write d8/da/d13/d1a/d29/fa4 [74861,22729] 0 2024-09-21T11:39:13.319 INFO:tasks.workunit.client.0.smithi118.stdout:8/251: fsync d2/f7 0 2024-09-21T11:39:13.320 INFO:tasks.workunit.client.0.smithi118.stdout:8/252: stat d2/dc 0 2024-09-21T11:39:13.321 INFO:tasks.workunit.client.0.smithi118.stdout:8/253: chown d2/f29 15115 1 2024-09-21T11:39:13.321 INFO:tasks.workunit.client.1.smithi149.stdout:6/497: symlink d8/d32/d37/d2b/la8 0 2024-09-21T11:39:13.324 INFO:tasks.workunit.client.1.smithi149.stdout:2/669: dread - d8/dd/f4c zero size 2024-09-21T11:39:13.324 INFO:tasks.workunit.client.1.smithi149.stdout:8/504: mknod d3/d33/d34/d72/cad 0 2024-09-21T11:39:13.326 INFO:tasks.workunit.client.1.smithi149.stdout:3/606: dwrite d6/fc [0,4194304] 0 2024-09-21T11:39:13.326 INFO:tasks.workunit.client.1.smithi149.stdout:6/498: unlink d8/da/c5b 0 2024-09-21T11:39:13.328 INFO:tasks.workunit.client.1.smithi149.stdout:4/603: fsync d4/d6/f9 0 2024-09-21T11:39:13.328 INFO:tasks.workunit.client.1.smithi149.stdout:5/624: write d4/d1d/d3e/f84 [3360166,108269] 0 2024-09-21T11:39:13.330 INFO:tasks.workunit.client.0.smithi118.stdout:8/254: dwrite d2/d32/f3c [0,4194304] 0 2024-09-21T11:39:13.331 INFO:tasks.workunit.client.0.smithi118.stdout:0/232: dwrite d5/d10/d1e/d20/f2b [0,4194304] 0 2024-09-21T11:39:13.334 INFO:tasks.workunit.client.0.smithi118.stdout:8/255: creat d2/dc/d10/d2e/d18/f4f x:0 0 0 2024-09-21T11:39:13.334 INFO:tasks.workunit.client.0.smithi118.stdout:0/233: mknod d5/d10/d1e/d21/c4b 0 2024-09-21T11:39:13.336 INFO:tasks.workunit.client.0.smithi118.stdout:0/234: creat d5/d10/d1e/f4c x:0 0 0 2024-09-21T11:39:13.340 INFO:tasks.workunit.client.0.smithi118.stdout:8/256: dread d2/dc/d10/d2e/f21 [4194304,4194304] 0 2024-09-21T11:39:13.340 INFO:tasks.workunit.client.1.smithi149.stdout:9/550: truncate fc 874151 0 2024-09-21T11:39:13.341 INFO:tasks.workunit.client.1.smithi149.stdout:1/526: sync 2024-09-21T11:39:13.342 INFO:tasks.workunit.client.1.smithi149.stdout:5/625: write d4/d1d/d50/d54/f35 [2050161,38053] 0 2024-09-21T11:39:13.342 INFO:tasks.workunit.client.0.smithi118.stdout:9/137: sync 2024-09-21T11:39:13.343 INFO:tasks.workunit.client.0.smithi118.stdout:8/257: mkdir d2/dc/d35/d50 0 2024-09-21T11:39:13.344 INFO:tasks.workunit.client.0.smithi118.stdout:0/235: dwrite d5/f11 [4194304,4194304] 0 2024-09-21T11:39:13.348 INFO:tasks.workunit.client.1.smithi149.stdout:9/551: dread - d18/d36/d3c/d47/fa1 zero size 2024-09-21T11:39:13.348 INFO:tasks.workunit.client.1.smithi149.stdout:3/607: unlink d6/d1f/d47/d37/d50/f78 0 2024-09-21T11:39:13.350 INFO:tasks.workunit.client.0.smithi118.stdout:0/236: dread d5/d10/d1e/d20/f26 [0,4194304] 0 2024-09-21T11:39:13.350 INFO:tasks.workunit.client.0.smithi118.stdout:8/258: rename d2/dc/d10/l30 to d2/dc/d10/d3b/l51 0 2024-09-21T11:39:13.353 INFO:tasks.workunit.client.1.smithi149.stdout:7/666: dwrite d12/d90/d4a/d4f/d75/d94/f98 [0,4194304] 0 2024-09-21T11:39:13.355 INFO:tasks.workunit.client.1.smithi149.stdout:4/604: mkdir d4/d6/d63/d78/d98/dcc/ddb 0 2024-09-21T11:39:13.363 INFO:tasks.workunit.client.1.smithi149.stdout:2/670: dwrite d8/da/d13/d1a/d3b/fb7 [0,4194304] 0 2024-09-21T11:39:13.363 INFO:tasks.workunit.client.1.smithi149.stdout:5/626: unlink d4/d7/d40/d51/d56/ca9 0 2024-09-21T11:39:13.365 INFO:tasks.workunit.client.1.smithi149.stdout:2/671: write d8/d20/fb0 [645484,80164] 0 2024-09-21T11:39:13.367 INFO:tasks.workunit.client.1.smithi149.stdout:8/505: dwrite d3/dd/d21/d54/f56 [0,4194304] 0 2024-09-21T11:39:13.368 INFO:tasks.workunit.client.1.smithi149.stdout:3/608: chown d6/d1f/d47/d22/d8d/fcd 10 1 2024-09-21T11:39:13.369 INFO:tasks.workunit.client.1.smithi149.stdout:1/527: read d2/dd/d2e/d4c/f52 [4988142,19853] 0 2024-09-21T11:39:13.374 INFO:tasks.workunit.client.1.smithi149.stdout:2/672: chown d8/da/d13/d1a/l26 2 1 2024-09-21T11:39:13.374 INFO:tasks.workunit.client.1.smithi149.stdout:1/528: chown d2/dd/d2e/f33 14 1 2024-09-21T11:39:13.376 INFO:tasks.workunit.client.1.smithi149.stdout:6/499: dread d8/d32/d37/d28/f30 [4194304,4194304] 0 2024-09-21T11:39:13.378 INFO:tasks.workunit.client.1.smithi149.stdout:9/552: readlink d18/d19/d1a/d2f/d33/d91/l9c 0 2024-09-21T11:39:13.380 INFO:tasks.workunit.client.1.smithi149.stdout:8/506: read d3/f37 [1674021,62435] 0 2024-09-21T11:39:13.381 INFO:tasks.workunit.client.1.smithi149.stdout:3/609: creat d6/d79/d7e/fdf x:0 0 0 2024-09-21T11:39:13.381 INFO:tasks.workunit.client.1.smithi149.stdout:5/627: rename d4/d1d/d50/d54/d2a/f6c to d4/d7/d40/d43/d49/fcf 0 2024-09-21T11:39:13.382 INFO:tasks.workunit.client.1.smithi149.stdout:1/529: symlink d2/dd/d35/d7c/laf 0 2024-09-21T11:39:13.384 INFO:tasks.workunit.client.1.smithi149.stdout:8/507: unlink d3/d12/l41 0 2024-09-21T11:39:13.385 INFO:tasks.workunit.client.1.smithi149.stdout:1/530: symlink d2/d2b/lb0 0 2024-09-21T11:39:13.386 INFO:tasks.workunit.client.1.smithi149.stdout:5/628: write d4/d1d/d50/d54/d2a/f3f [4045043,61356] 0 2024-09-21T11:39:13.386 INFO:tasks.workunit.client.1.smithi149.stdout:4/605: getdents d4/d6/d63/d2d/dd6/d32 0 2024-09-21T11:39:13.387 INFO:tasks.workunit.client.1.smithi149.stdout:9/553: rmdir d18/d19/d1a/d2f/d33/d91 39 2024-09-21T11:39:13.390 INFO:tasks.workunit.client.1.smithi149.stdout:3/610: fsync d6/d79/d7e/fdf 0 2024-09-21T11:39:13.391 INFO:tasks.workunit.client.1.smithi149.stdout:9/554: read d18/d1c/f46 [451506,23567] 0 2024-09-21T11:39:13.392 INFO:tasks.workunit.client.1.smithi149.stdout:2/673: write d8/d44/d63/db9/f4b [816387,52254] 0 2024-09-21T11:39:13.392 INFO:tasks.workunit.client.1.smithi149.stdout:4/606: stat d4/d6/d63/d2d/dd6/c3d 0 2024-09-21T11:39:13.394 INFO:tasks.workunit.client.1.smithi149.stdout:1/531: mknod d2/d5/d8/cb1 0 2024-09-21T11:39:13.395 INFO:tasks.workunit.client.1.smithi149.stdout:5/629: write d4/d7/d40/d43/d49/d88/f98 [316899,117641] 0 2024-09-21T11:39:13.395 INFO:tasks.workunit.client.1.smithi149.stdout:2/674: readlink d8/dd/d50/l92 0 2024-09-21T11:39:13.395 INFO:tasks.workunit.client.1.smithi149.stdout:3/611: symlink d6/d79/d7e/le0 0 2024-09-21T11:39:13.397 INFO:tasks.workunit.client.1.smithi149.stdout:6/500: dwrite d8/d32/d37/d28/f33 [0,4194304] 0 2024-09-21T11:39:13.401 INFO:tasks.workunit.client.1.smithi149.stdout:5/630: chown d4/d7/d40/d43/d85 10592 1 2024-09-21T11:39:13.405 INFO:tasks.workunit.client.1.smithi149.stdout:5/631: write d4/f18 [3208884,68733] 0 2024-09-21T11:39:13.406 INFO:tasks.workunit.client.1.smithi149.stdout:8/508: dwrite d3/dd/d21/d54/f56 [0,4194304] 0 2024-09-21T11:39:13.407 INFO:tasks.workunit.client.1.smithi149.stdout:2/675: write d8/da/d13/d1a/f3e [1024430,67741] 0 2024-09-21T11:39:13.410 INFO:tasks.workunit.client.0.smithi118.stdout:0/237: creat d5/d10/d1e/d20/f4d x:0 0 0 2024-09-21T11:39:13.412 INFO:tasks.workunit.client.0.smithi118.stdout:8/259: fsync d2/dc/d10/d2e/d18/d1a/f1f 0 2024-09-21T11:39:13.413 INFO:tasks.workunit.client.1.smithi149.stdout:6/501: mkdir d8/d32/d37/d2b/d7d/da9 0 2024-09-21T11:39:13.418 INFO:tasks.workunit.client.0.smithi118.stdout:0/238: dwrite d5/d34/f3b [0,4194304] 0 2024-09-21T11:39:13.419 INFO:tasks.workunit.client.1.smithi149.stdout:9/555: getdents d18/d19/d1a/d2f/d33/d91 0 2024-09-21T11:39:13.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/607: dwrite d4/d4d/d5f/d71/fb0 [0,4194304] 0 2024-09-21T11:39:13.420 INFO:tasks.workunit.client.0.smithi118.stdout:8/260: mknod d2/dc/d10/d2e/c52 0 2024-09-21T11:39:13.420 INFO:tasks.workunit.client.1.smithi149.stdout:6/502: write d8/d32/d37/d28/f74 [609638,5282] 0 2024-09-21T11:39:13.420 INFO:tasks.workunit.client.0.smithi118.stdout:0/239: truncate d5/d10/d1e/d21/f24 993068 0 2024-09-21T11:39:13.421 INFO:tasks.workunit.client.1.smithi149.stdout:5/632: creat d4/d7/d40/d43/d85/fd0 x:0 0 0 2024-09-21T11:39:13.425 INFO:tasks.workunit.client.0.smithi118.stdout:0/240: dread d5/f11 [4194304,4194304] 0 2024-09-21T11:39:13.426 INFO:tasks.workunit.client.1.smithi149.stdout:3/612: dwrite d6/d79/d7e/fc1 [0,4194304] 0 2024-09-21T11:39:13.428 INFO:tasks.workunit.client.0.smithi118.stdout:0/241: mkdir d5/d10/d1e/d23/d3a/d4e 0 2024-09-21T11:39:13.430 INFO:tasks.workunit.client.1.smithi149.stdout:0/504: sync 2024-09-21T11:39:13.431 INFO:tasks.workunit.client.1.smithi149.stdout:1/532: getdents d2/dd 0 2024-09-21T11:39:13.432 INFO:tasks.workunit.client.0.smithi118.stdout:0/242: symlink d5/d10/d1e/d21/d2a/d48/l4f 0 2024-09-21T11:39:13.434 INFO:tasks.workunit.client.0.smithi118.stdout:0/243: chown d5/le 15086988 1 2024-09-21T11:39:13.435 INFO:tasks.workunit.client.1.smithi149.stdout:0/505: truncate dd/f8e 802357 0 2024-09-21T11:39:13.435 INFO:tasks.workunit.client.1.smithi149.stdout:9/556: creat d18/d1c/fb3 x:0 0 0 2024-09-21T11:39:13.436 INFO:tasks.workunit.client.0.smithi118.stdout:0/244: creat d5/d34/f50 x:0 0 0 2024-09-21T11:39:13.436 INFO:tasks.workunit.client.1.smithi149.stdout:4/608: truncate d4/d6/d18/f2a 1531639 0 2024-09-21T11:39:13.438 INFO:tasks.workunit.client.0.smithi118.stdout:0/245: getdents d5/d10/d1e/d23/d3a/d4e 0 2024-09-21T11:39:13.439 INFO:tasks.workunit.client.0.smithi118.stdout:8/261: truncate d2/dc/d10/d2e/d18/f22 9036148 0 2024-09-21T11:39:13.439 INFO:tasks.workunit.client.0.smithi118.stdout:0/246: readlink d5/d10/d1e/d21/l30 0 2024-09-21T11:39:13.440 INFO:tasks.workunit.client.1.smithi149.stdout:6/503: mknod d8/da/d2c/d52/d5e/d9b/caa 0 2024-09-21T11:39:13.441 INFO:tasks.workunit.client.0.smithi118.stdout:8/262: mknod d2/d34/c53 0 2024-09-21T11:39:13.442 INFO:tasks.workunit.client.0.smithi118.stdout:0/247: creat d5/d10/f51 x:0 0 0 2024-09-21T11:39:13.446 INFO:tasks.workunit.client.0.smithi118.stdout:0/248: creat d5/d34/d44/f52 x:0 0 0 2024-09-21T11:39:13.448 INFO:tasks.workunit.client.1.smithi149.stdout:1/533: creat d2/dd/d35/d7c/fb2 x:0 0 0 2024-09-21T11:39:13.448 INFO:tasks.workunit.client.1.smithi149.stdout:3/613: dread d6/d1f/d47/d37/d3a/f46 [0,4194304] 0 2024-09-21T11:39:13.449 INFO:tasks.workunit.client.0.smithi118.stdout:0/249: mkdir d5/d29/d53 0 2024-09-21T11:39:13.449 INFO:tasks.workunit.client.0.smithi118.stdout:8/263: dwrite d2/d32/f3c [0,4194304] 0 2024-09-21T11:39:13.451 INFO:tasks.workunit.client.0.smithi118.stdout:0/250: mknod d5/d10/d1e/d3d/c54 0 2024-09-21T11:39:13.451 INFO:tasks.workunit.client.1.smithi149.stdout:2/676: dwrite d8/dcb/fa7 [4194304,4194304] 0 2024-09-21T11:39:13.452 INFO:tasks.workunit.client.0.smithi118.stdout:0/251: read d5/d10/d1e/d21/f2d [355092,81320] 0 2024-09-21T11:39:13.453 INFO:tasks.workunit.client.0.smithi118.stdout:8/264: dread d2/dc/d10/d2e/d18/f2f [0,4194304] 0 2024-09-21T11:39:13.454 INFO:tasks.workunit.client.1.smithi149.stdout:4/609: mkdir d4/d4d/d5f/d71/ddc 0 2024-09-21T11:39:13.456 INFO:tasks.workunit.client.0.smithi118.stdout:0/252: creat d5/d34/f55 x:0 0 0 2024-09-21T11:39:13.456 INFO:tasks.workunit.client.1.smithi149.stdout:6/504: truncate d8/da/f4e 126041 0 2024-09-21T11:39:13.457 INFO:tasks.workunit.client.1.smithi149.stdout:8/509: dwrite d3/f1d [4194304,4194304] 0 2024-09-21T11:39:13.457 INFO:tasks.workunit.client.1.smithi149.stdout:1/534: mkdir d2/d5/db3 0 2024-09-21T11:39:13.459 INFO:tasks.workunit.client.0.smithi118.stdout:8/265: dread d2/dc/d10/d2e/d18/d1a/f1b [0,4194304] 0 2024-09-21T11:39:13.460 INFO:tasks.workunit.client.1.smithi149.stdout:6/505: dread - d8/d32/d64/f9c zero size 2024-09-21T11:39:13.460 INFO:tasks.workunit.client.0.smithi118.stdout:0/253: creat d5/d29/d53/f56 x:0 0 0 2024-09-21T11:39:13.461 INFO:tasks.workunit.client.0.smithi118.stdout:8/266: symlink d2/l54 0 2024-09-21T11:39:13.470 INFO:tasks.workunit.client.1.smithi149.stdout:6/506: chown d8/fa3 13 1 2024-09-21T11:39:13.470 INFO:tasks.workunit.client.1.smithi149.stdout:1/535: write d2/f21 [699658,89754] 0 2024-09-21T11:39:13.473 INFO:tasks.workunit.client.0.smithi118.stdout:8/267: creat d2/dc/d10/d2e/f55 x:0 0 0 2024-09-21T11:39:13.476 INFO:tasks.workunit.client.1.smithi149.stdout:9/557: dwrite d18/d36/f7f [0,4194304] 0 2024-09-21T11:39:13.477 INFO:tasks.workunit.client.1.smithi149.stdout:6/507: mknod d8/da/d3d/cab 0 2024-09-21T11:39:13.477 INFO:tasks.workunit.client.0.smithi118.stdout:8/268: creat d2/dc/d10/d2e/d18/d1a/f56 x:0 0 0 2024-09-21T11:39:13.477 INFO:tasks.workunit.client.1.smithi149.stdout:4/610: link d4/d6/d63/d2d/dd6/d32/d4a/f61 d4/d6/d63/d15/fdd 0 2024-09-21T11:39:13.483 INFO:tasks.workunit.client.1.smithi149.stdout:3/614: getdents d6/d1f/d47/d37/d3a 0 2024-09-21T11:39:13.483 INFO:tasks.workunit.client.0.smithi118.stdout:8/269: dwrite d2/dc/d10/d2e/d18/f4f [0,4194304] 0 2024-09-21T11:39:13.484 INFO:tasks.workunit.client.1.smithi149.stdout:7/667: sync 2024-09-21T11:39:13.486 INFO:tasks.workunit.client.1.smithi149.stdout:6/508: readlink d8/d32/d37/d2b/d51/l73 0 2024-09-21T11:39:13.486 INFO:tasks.workunit.client.1.smithi149.stdout:4/611: unlink d4/d6/d63/d15/l3e 0 2024-09-21T11:39:13.487 INFO:tasks.workunit.client.1.smithi149.stdout:8/510: link d3/d33/c9d d3/d33/d34/d55/d5e/d9e/cae 0 2024-09-21T11:39:13.490 INFO:tasks.workunit.client.1.smithi149.stdout:2/677: dread d8/d44/d63/db9/f41 [0,4194304] 0 2024-09-21T11:39:13.490 INFO:tasks.workunit.client.1.smithi149.stdout:5/633: dread d4/d7/f32 [0,4194304] 0 2024-09-21T11:39:13.491 INFO:tasks.workunit.client.1.smithi149.stdout:6/509: readlink d8/da/d11/l13 0 2024-09-21T11:39:13.492 INFO:tasks.workunit.client.1.smithi149.stdout:1/536: dwrite d2/dd/d35/d5b/f6a [0,4194304] 0 2024-09-21T11:39:13.495 INFO:tasks.workunit.client.0.smithi118.stdout:8/270: dwrite d2/dc/d10/d2e/d18/d1a/f1b [0,4194304] 0 2024-09-21T11:39:13.499 INFO:tasks.workunit.client.1.smithi149.stdout:8/511: write d3/dd/d21/d54/d5c/d6d/f8d [941060,3515] 0 2024-09-21T11:39:13.500 INFO:tasks.workunit.client.0.smithi118.stdout:0/254: dwrite d5/d10/f28 [0,4194304] 0 2024-09-21T11:39:13.505 INFO:tasks.workunit.client.0.smithi118.stdout:0/255: write d5/d10/d1e/d20/f32 [3121294,70492] 0 2024-09-21T11:39:13.506 INFO:tasks.workunit.client.0.smithi118.stdout:8/271: creat d2/f57 x:0 0 0 2024-09-21T11:39:13.510 INFO:tasks.workunit.client.0.smithi118.stdout:8/272: mknod d2/dc/d16/c58 0 2024-09-21T11:39:13.511 INFO:tasks.workunit.client.0.smithi118.stdout:8/273: fsync d2/d34/f4a 0 2024-09-21T11:39:13.513 INFO:tasks.workunit.client.1.smithi149.stdout:9/558: dwrite d18/d19/d1a/d2f/d30/d90/f9d [0,4194304] 0 2024-09-21T11:39:13.513 INFO:tasks.workunit.client.0.smithi118.stdout:8/274: creat d2/d32/f59 x:0 0 0 2024-09-21T11:39:13.514 INFO:tasks.workunit.client.0.smithi118.stdout:8/275: readlink d2/dc/d10/d2e/l12 0 2024-09-21T11:39:13.519 INFO:tasks.workunit.client.1.smithi149.stdout:2/678: creat d8/d11/fee x:0 0 0 2024-09-21T11:39:13.519 INFO:tasks.workunit.client.0.smithi118.stdout:8/276: link d2/dc/d10/d2e/l19 d2/dc/d10/d2e/d18/l5a 0 2024-09-21T11:39:13.520 INFO:tasks.workunit.client.0.smithi118.stdout:8/277: fdatasync d2/dc/d10/d2e/d18/d1a/f1e 0 2024-09-21T11:39:13.523 INFO:tasks.workunit.client.0.smithi118.stdout:8/278: mknod d2/dc/c5b 0 2024-09-21T11:39:13.525 INFO:tasks.workunit.client.0.smithi118.stdout:8/279: creat d2/dc/d10/d2e/d18/d1a/f5c x:0 0 0 2024-09-21T11:39:13.526 INFO:tasks.workunit.client.1.smithi149.stdout:0/506: sync 2024-09-21T11:39:13.526 INFO:tasks.workunit.client.1.smithi149.stdout:9/559: unlink d18/d19/d1a/l8f 0 2024-09-21T11:39:13.533 INFO:tasks.workunit.client.1.smithi149.stdout:9/560: mkdir d18/d19/d1a/d2f/d53/db4 0 2024-09-21T11:39:13.535 INFO:tasks.workunit.client.1.smithi149.stdout:9/561: write d18/d1c/f98 [1885704,75985] 0 2024-09-21T11:39:13.539 INFO:tasks.workunit.client.1.smithi149.stdout:7/668: dread d12/d90/d68/f7b [0,4194304] 0 2024-09-21T11:39:13.540 INFO:tasks.workunit.client.1.smithi149.stdout:9/562: rename d18/d19/d1a/d2f/d53/db4 to d18/d36/d3c/d47/db5 0 2024-09-21T11:39:13.541 INFO:tasks.workunit.client.1.smithi149.stdout:7/669: creat d12/d90/d4a/d4f/d75/fcd x:0 0 0 2024-09-21T11:39:13.554 INFO:tasks.workunit.client.0.smithi118.stdout:0/256: dwrite d5/d10/d1e/d23/f25 [0,4194304] 0 2024-09-21T11:39:13.555 INFO:tasks.workunit.client.0.smithi118.stdout:8/280: truncate d2/fa 1566078 0 2024-09-21T11:39:13.558 INFO:tasks.workunit.client.1.smithi149.stdout:1/537: dwrite d2/d5/d8/fa6 [0,4194304] 0 2024-09-21T11:39:13.561 INFO:tasks.workunit.client.0.smithi118.stdout:8/281: link d2/dc/d10/d2e/c2b d2/d34/c5d 0 2024-09-21T11:39:13.562 INFO:tasks.workunit.client.1.smithi149.stdout:5/634: dwrite d4/d7/d40/d43/d49/f4b [4194304,4194304] 0 2024-09-21T11:39:13.563 INFO:tasks.workunit.client.0.smithi118.stdout:0/257: dwrite d5/d10/d1e/d20/f26 [0,4194304] 0 2024-09-21T11:39:13.563 INFO:tasks.workunit.client.0.smithi118.stdout:8/282: symlink d2/dc/d10/d2e/d18/l5e 0 2024-09-21T11:39:13.564 INFO:tasks.workunit.client.0.smithi118.stdout:0/258: readlink d5/d10/d1e/d23/l37 0 2024-09-21T11:39:13.565 INFO:tasks.workunit.client.1.smithi149.stdout:9/563: write fc [1521408,15156] 0 2024-09-21T11:39:13.565 INFO:tasks.workunit.client.0.smithi118.stdout:8/283: chown d2/dc/d10/d2e/d18/d36/c38 33796 1 2024-09-21T11:39:13.565 INFO:tasks.workunit.client.1.smithi149.stdout:7/670: write d12/d90/d4a/f87 [824634,4279] 0 2024-09-21T11:39:13.568 INFO:tasks.workunit.client.0.smithi118.stdout:8/284: chown d2/dc/d35/d42/l4b 2 1 2024-09-21T11:39:13.569 INFO:tasks.workunit.client.1.smithi149.stdout:8/512: dread d3/dd/d18/d2e/d80/f81 [0,4194304] 0 2024-09-21T11:39:13.569 INFO:tasks.workunit.client.1.smithi149.stdout:9/564: readlink lb 0 2024-09-21T11:39:13.570 INFO:tasks.workunit.client.1.smithi149.stdout:2/679: dwrite d8/f1c [0,4194304] 0 2024-09-21T11:39:13.570 INFO:tasks.workunit.client.0.smithi118.stdout:0/259: dread d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:13.571 INFO:tasks.workunit.client.0.smithi118.stdout:0/260: chown d5/le 41 1 2024-09-21T11:39:13.572 INFO:tasks.workunit.client.1.smithi149.stdout:5/635: dread - d4/d1d/d50/d54/d2a/d93/fa6 zero size 2024-09-21T11:39:13.574 INFO:tasks.workunit.client.0.smithi118.stdout:8/285: creat d2/dc/d10/d2e/f5f x:0 0 0 2024-09-21T11:39:13.574 INFO:tasks.workunit.client.1.smithi149.stdout:5/636: chown d4/d7/lc0 697 1 2024-09-21T11:39:13.576 INFO:tasks.workunit.client.0.smithi118.stdout:0/261: rename d5/d10/d1e/d21/c4b to d5/d10/c57 0 2024-09-21T11:39:13.577 INFO:tasks.workunit.client.1.smithi149.stdout:8/513: mkdir d3/dd/d21/d54/d5c/d6d/daf 0 2024-09-21T11:39:13.578 INFO:tasks.workunit.client.0.smithi118.stdout:8/286: unlink d2/dc/d10/c2a 0 2024-09-21T11:39:13.584 INFO:tasks.workunit.client.1.smithi149.stdout:2/680: creat d8/da/d13/d1a/d29/fef x:0 0 0 2024-09-21T11:39:13.584 INFO:tasks.workunit.client.1.smithi149.stdout:9/565: rename d18/d36/d3c/d47/d76/f7b to d18/d36/d3c/d47/d99/fb6 0 2024-09-21T11:39:13.584 INFO:tasks.workunit.client.1.smithi149.stdout:2/681: fdatasync d8/da/f28 0 2024-09-21T11:39:13.588 INFO:tasks.workunit.client.1.smithi149.stdout:2/682: write d8/d44/fbe [579039,69302] 0 2024-09-21T11:39:13.589 INFO:tasks.workunit.client.1.smithi149.stdout:9/566: creat d18/d19/d1a/d2f/d30/d90/fb7 x:0 0 0 2024-09-21T11:39:13.591 INFO:tasks.workunit.client.1.smithi149.stdout:5/637: write d4/d7/f27 [2175475,120703] 0 2024-09-21T11:39:13.592 INFO:tasks.workunit.client.1.smithi149.stdout:8/514: symlink d3/dd/d21/d54/d5c/d6d/daf/lb0 0 2024-09-21T11:39:13.593 INFO:tasks.workunit.client.1.smithi149.stdout:5/638: stat d4/d7/l1b 0 2024-09-21T11:39:13.593 INFO:tasks.workunit.client.1.smithi149.stdout:2/683: fdatasync d8/d44/d63/db9/f27 0 2024-09-21T11:39:13.595 INFO:tasks.workunit.client.1.smithi149.stdout:9/567: symlink d18/d19/d1a/lb8 0 2024-09-21T11:39:13.596 INFO:tasks.workunit.client.1.smithi149.stdout:5/639: mkdir d4/d7/d40/d43/d49/dd1 0 2024-09-21T11:39:13.597 INFO:tasks.workunit.client.1.smithi149.stdout:2/684: creat d8/dd/d8c/de0/ff0 x:0 0 0 2024-09-21T11:39:13.598 INFO:tasks.workunit.client.1.smithi149.stdout:5/640: write d4/d7/d40/d43/d49/d88/fae [77399,80020] 0 2024-09-21T11:39:13.606 INFO:tasks.workunit.client.1.smithi149.stdout:7/671: dread d12/d90/d4a/d4f/d75/d94/f3f [0,4194304] 0 2024-09-21T11:39:13.607 INFO:tasks.workunit.client.1.smithi149.stdout:5/641: dread d4/d1d/d50/d54/d2a/f67 [0,4194304] 0 2024-09-21T11:39:13.608 INFO:tasks.workunit.client.1.smithi149.stdout:7/672: chown d12/d90/d4a/d9e/f86 26556 1 2024-09-21T11:39:13.609 INFO:tasks.workunit.client.1.smithi149.stdout:3/615: sync 2024-09-21T11:39:13.609 INFO:tasks.workunit.client.1.smithi149.stdout:7/673: readlink d12/d90/d4a/d6c/lc2 0 2024-09-21T11:39:13.609 INFO:tasks.workunit.client.1.smithi149.stdout:2/685: dwrite d8/da/d13/d2d/f94 [4194304,4194304] 0 2024-09-21T11:39:13.615 INFO:tasks.workunit.client.1.smithi149.stdout:4/612: sync 2024-09-21T11:39:13.615 INFO:tasks.workunit.client.1.smithi149.stdout:6/510: sync 2024-09-21T11:39:13.615 INFO:tasks.workunit.client.1.smithi149.stdout:0/507: sync 2024-09-21T11:39:13.615 INFO:tasks.workunit.client.1.smithi149.stdout:8/515: dread d3/d33/f64 [0,4194304] 0 2024-09-21T11:39:13.618 INFO:tasks.workunit.client.1.smithi149.stdout:2/686: symlink d8/d44/d63/db9/d5a/lf1 0 2024-09-21T11:39:13.622 INFO:tasks.workunit.client.1.smithi149.stdout:7/674: rmdir d12/d5b 39 2024-09-21T11:39:13.623 INFO:tasks.workunit.client.1.smithi149.stdout:2/687: write f7 [631924,30386] 0 2024-09-21T11:39:13.626 INFO:tasks.workunit.client.1.smithi149.stdout:9/568: fsync d18/d36/d3c/d47/d99/fb6 0 2024-09-21T11:39:13.627 INFO:tasks.workunit.client.1.smithi149.stdout:1/538: dread d2/d2b/f31 [0,4194304] 0 2024-09-21T11:39:13.627 INFO:tasks.workunit.client.1.smithi149.stdout:3/616: dwrite d6/d1f/d47/fa3 [0,4194304] 0 2024-09-21T11:39:13.632 INFO:tasks.workunit.client.1.smithi149.stdout:4/613: chown d4/d6/d63/d2d/dd6/d32/d4a/cc0 0 1 2024-09-21T11:39:13.633 INFO:tasks.workunit.client.1.smithi149.stdout:8/516: read d3/dd/d18/d2e/d80/f93 [2830463,46189] 0 2024-09-21T11:39:13.633 INFO:tasks.workunit.client.1.smithi149.stdout:7/675: mkdir d12/d90/d4a/d4f/dce 0 2024-09-21T11:39:13.637 INFO:tasks.workunit.client.1.smithi149.stdout:5/642: write d4/f2f [1782238,61045] 0 2024-09-21T11:39:13.641 INFO:tasks.workunit.client.1.smithi149.stdout:7/676: write d12/d90/d4a/d4f/fb6 [286379,73312] 0 2024-09-21T11:39:13.642 INFO:tasks.workunit.client.0.smithi118.stdout:0/262: dwrite d5/d10/d1e/d21/d2a/f4a [0,4194304] 0 2024-09-21T11:39:13.643 INFO:tasks.workunit.client.0.smithi118.stdout:8/287: symlink d2/d34/l60 0 2024-09-21T11:39:13.644 INFO:tasks.workunit.client.0.smithi118.stdout:0/263: stat d5/d10/d1e/d23/d3a/d4e 0 2024-09-21T11:39:13.645 INFO:tasks.workunit.client.0.smithi118.stdout:0/264: fsync d5/d34/f55 0 2024-09-21T11:39:13.647 INFO:tasks.workunit.client.1.smithi149.stdout:8/517: mkdir d3/d12/db1 0 2024-09-21T11:39:13.647 INFO:tasks.workunit.client.0.smithi118.stdout:8/288: unlink d2/d32/l37 0 2024-09-21T11:39:13.648 INFO:tasks.workunit.client.1.smithi149.stdout:4/614: mknod d4/d6/d63/d15/d30/cde 0 2024-09-21T11:39:13.648 INFO:tasks.workunit.client.0.smithi118.stdout:0/265: mknod d5/d10/d1e/d3d/c58 0 2024-09-21T11:39:13.649 INFO:tasks.workunit.client.0.smithi118.stdout:0/266: chown d5/d10/d1e/d33/f35 4520068 1 2024-09-21T11:39:13.651 INFO:tasks.workunit.client.0.smithi118.stdout:8/289: truncate d2/f7 689620 0 2024-09-21T11:39:13.654 INFO:tasks.workunit.client.1.smithi149.stdout:7/677: dread - d12/d90/d4a/d4f/d75/fcd zero size 2024-09-21T11:39:13.654 INFO:tasks.workunit.client.1.smithi149.stdout:0/508: dread dd/d2d/f4b [0,4194304] 0 2024-09-21T11:39:13.655 INFO:tasks.workunit.client.1.smithi149.stdout:3/617: dwrite d6/d1f/d47/d37/d3f/fa7 [0,4194304] 0 2024-09-21T11:39:13.656 INFO:tasks.workunit.client.0.smithi118.stdout:8/290: symlink d2/dc/d35/d42/l61 0 2024-09-21T11:39:13.656 INFO:tasks.workunit.client.0.smithi118.stdout:0/267: dwrite d5/d34/d44/f52 [0,4194304] 0 2024-09-21T11:39:13.660 INFO:tasks.workunit.client.0.smithi118.stdout:0/268: read - d5/d10/d1e/d21/d2a/f45 zero size 2024-09-21T11:39:13.660 INFO:tasks.workunit.client.1.smithi149.stdout:0/509: dread - dd/d1a/f9f zero size 2024-09-21T11:39:13.665 INFO:tasks.workunit.client.1.smithi149.stdout:1/539: dread d2/dd/d2e/f77 [0,4194304] 0 2024-09-21T11:39:13.665 INFO:tasks.workunit.client.0.smithi118.stdout:0/269: rename d5/d10/d1e/d21/d2a/c3f to d5/d10/d1e/d21/d2a/d48/c59 0 2024-09-21T11:39:13.666 INFO:tasks.workunit.client.0.smithi118.stdout:0/270: write d5/d34/f3b [251910,104007] 0 2024-09-21T11:39:13.668 INFO:tasks.workunit.client.1.smithi149.stdout:5/643: read d4/d1d/d50/fc1 [653624,90185] 0 2024-09-21T11:39:13.668 INFO:tasks.workunit.client.1.smithi149.stdout:7/678: read d12/d90/d4a/f76 [2899905,73183] 0 2024-09-21T11:39:13.672 INFO:tasks.workunit.client.1.smithi149.stdout:2/688: creat d8/da/d13/ff2 x:0 0 0 2024-09-21T11:39:13.673 INFO:tasks.workunit.client.1.smithi149.stdout:5/644: readlink d4/d7/d40/d43/l48 0 2024-09-21T11:39:13.673 INFO:tasks.workunit.client.1.smithi149.stdout:6/511: getdents d8/da/d2c 0 2024-09-21T11:39:13.674 INFO:tasks.workunit.client.0.smithi118.stdout:0/271: dwrite d5/f15 [0,4194304] 0 2024-09-21T11:39:13.674 INFO:tasks.workunit.client.1.smithi149.stdout:0/510: dread dd/d1a/d1b/d50/d53/f42 [0,4194304] 0 2024-09-21T11:39:13.675 INFO:tasks.workunit.client.0.smithi118.stdout:0/272: fsync d5/d10/f14 0 2024-09-21T11:39:13.675 INFO:tasks.workunit.client.1.smithi149.stdout:3/618: fsync d6/d1f/d47/d37/d3a/f46 0 2024-09-21T11:39:13.676 INFO:tasks.workunit.client.1.smithi149.stdout:6/512: fsync d8/da/d3d/f5d 0 2024-09-21T11:39:13.677 INFO:tasks.workunit.client.1.smithi149.stdout:8/518: write d3/dd/d18/d2e/d80/f93 [8880390,105199] 0 2024-09-21T11:39:13.677 INFO:tasks.workunit.client.1.smithi149.stdout:1/540: fsync d2/dd/d2e/d4c/f5c 0 2024-09-21T11:39:13.681 INFO:tasks.workunit.client.1.smithi149.stdout:9/569: dread d18/d19/d1a/d2f/d53/d64/f74 [0,4194304] 0 2024-09-21T11:39:13.682 INFO:tasks.workunit.client.1.smithi149.stdout:8/519: write d3/f17 [1068681,24936] 0 2024-09-21T11:39:13.683 INFO:tasks.workunit.client.1.smithi149.stdout:0/511: symlink dd/d1a/d1b/d81/d97/lad 0 2024-09-21T11:39:13.685 INFO:tasks.workunit.client.1.smithi149.stdout:7/679: dwrite d12/d90/f45 [0,4194304] 0 2024-09-21T11:39:13.685 INFO:tasks.workunit.client.1.smithi149.stdout:3/619: creat d6/d1f/d47/dce/fe1 x:0 0 0 2024-09-21T11:39:13.687 INFO:tasks.workunit.client.1.smithi149.stdout:2/689: link d8/d20/d78/d7c/f9d d8/dcb/db8/dd3/ff3 0 2024-09-21T11:39:13.687 INFO:tasks.workunit.client.1.smithi149.stdout:0/512: chown dd/d2d/l48 7 1 2024-09-21T11:39:13.688 INFO:tasks.workunit.client.1.smithi149.stdout:9/570: write d18/d19/d1a/d2f/d33/d91/f96 [637676,120258] 0 2024-09-21T11:39:13.688 INFO:tasks.workunit.client.1.smithi149.stdout:7/680: chown d12/d90/db7 1516 1 2024-09-21T11:39:13.691 INFO:tasks.workunit.client.1.smithi149.stdout:8/520: getdents d3/d12/d98 0 2024-09-21T11:39:13.692 INFO:tasks.workunit.client.1.smithi149.stdout:2/690: read d8/d20/f97 [1789391,77281] 0 2024-09-21T11:39:13.695 INFO:tasks.workunit.client.1.smithi149.stdout:7/681: creat d12/d90/d4a/d9e/fcf x:0 0 0 2024-09-21T11:39:13.695 INFO:tasks.workunit.client.1.smithi149.stdout:3/620: mknod d6/ce2 0 2024-09-21T11:39:13.695 INFO:tasks.workunit.client.1.smithi149.stdout:6/513: dwrite d8/d32/f46 [0,4194304] 0 2024-09-21T11:39:13.699 INFO:tasks.workunit.client.1.smithi149.stdout:8/521: symlink d3/dd/d90/lb2 0 2024-09-21T11:39:13.700 INFO:tasks.workunit.client.1.smithi149.stdout:2/691: mknod d8/d44/cf4 0 2024-09-21T11:39:13.707 INFO:tasks.workunit.client.1.smithi149.stdout:9/571: dwrite d18/d1c/fb3 [0,4194304] 0 2024-09-21T11:39:13.708 INFO:tasks.workunit.client.1.smithi149.stdout:3/621: mkdir d6/d1f/d47/d37/d3f/dc5/de3 0 2024-09-21T11:39:13.711 INFO:tasks.workunit.client.1.smithi149.stdout:9/572: stat d18/d19/d29/d39/f69 0 2024-09-21T11:39:13.712 INFO:tasks.workunit.client.1.smithi149.stdout:2/692: unlink d8/d44/c71 0 2024-09-21T11:39:13.713 INFO:tasks.workunit.client.1.smithi149.stdout:8/522: symlink d3/d12/d6e/d79/lb3 0 2024-09-21T11:39:13.716 INFO:tasks.workunit.client.1.smithi149.stdout:7/682: symlink d12/d90/d4a/d4f/d75/d94/ld0 0 2024-09-21T11:39:13.716 INFO:tasks.workunit.client.0.smithi118.stdout:8/291: write d2/fa [2471130,73382] 0 2024-09-21T11:39:13.721 INFO:tasks.workunit.client.0.smithi118.stdout:8/292: mkdir d2/dc/d16/d46/d62 0 2024-09-21T11:39:13.723 INFO:tasks.workunit.client.1.smithi149.stdout:6/514: getdents d8/da/d14 0 2024-09-21T11:39:13.728 INFO:tasks.workunit.client.1.smithi149.stdout:2/693: dwrite d8/d20/d78/f93 [4194304,4194304] 0 2024-09-21T11:39:13.728 INFO:tasks.workunit.client.0.smithi118.stdout:8/293: rename d2/d34 to d2/dc/d16/d46/d4c/d63 0 2024-09-21T11:39:13.733 INFO:tasks.workunit.client.0.smithi118.stdout:8/294: truncate d2/f29 720306 0 2024-09-21T11:39:13.734 INFO:tasks.workunit.client.1.smithi149.stdout:0/513: dread dd/d1a/d1b/d81/fa5 [0,4194304] 0 2024-09-21T11:39:13.737 INFO:tasks.workunit.client.1.smithi149.stdout:1/541: dread d2/d5/fab [0,4194304] 0 2024-09-21T11:39:13.738 INFO:tasks.workunit.client.1.smithi149.stdout:2/694: rename d8/d44/fb1 to d8/da/d13/d83/ff5 0 2024-09-21T11:39:13.739 INFO:tasks.workunit.client.1.smithi149.stdout:4/615: dwrite d4/d6/d18/f2a [0,4194304] 0 2024-09-21T11:39:13.741 INFO:tasks.workunit.client.0.smithi118.stdout:0/273: truncate d5/d10/d1e/d23/d3a/f46 2857716 0 2024-09-21T11:39:13.742 INFO:tasks.workunit.client.1.smithi149.stdout:9/573: getdents d18/d19/d1a/d2f/d43 0 2024-09-21T11:39:13.746 INFO:tasks.workunit.client.0.smithi118.stdout:0/274: mknod d5/d10/d1e/d23/d3a/c5a 0 2024-09-21T11:39:13.746 INFO:tasks.workunit.client.1.smithi149.stdout:8/523: link d3/d33/d34/d55/d5e/c7f d3/d3c/d8f/d76/cb4 0 2024-09-21T11:39:13.747 INFO:tasks.workunit.client.0.smithi118.stdout:0/275: write d5/d10/d1e/d21/d2a/f45 [844123,93364] 0 2024-09-21T11:39:13.748 INFO:tasks.workunit.client.1.smithi149.stdout:5/645: dread d4/d7/f38 [0,4194304] 0 2024-09-21T11:39:13.752 INFO:tasks.workunit.client.0.smithi118.stdout:0/276: mknod d5/d34/d44/c5b 0 2024-09-21T11:39:13.753 INFO:tasks.workunit.client.1.smithi149.stdout:2/695: fsync d8/d20/f62 0 2024-09-21T11:39:13.753 INFO:tasks.workunit.client.0.smithi118.stdout:0/277: truncate d5/d34/f50 1028189 0 2024-09-21T11:39:13.754 INFO:tasks.workunit.client.1.smithi149.stdout:4/616: creat d4/d6/d63/d15/d30/d8a/fdf x:0 0 0 2024-09-21T11:39:13.758 INFO:tasks.workunit.client.1.smithi149.stdout:5/646: creat d4/d1d/d50/d60/db1/db4/fd2 x:0 0 0 2024-09-21T11:39:13.759 INFO:tasks.workunit.client.1.smithi149.stdout:5/647: dread - d4/d7/d40/d43/f95 zero size 2024-09-21T11:39:13.759 INFO:tasks.workunit.client.1.smithi149.stdout:2/696: mkdir d8/da/d13/d83/df6 0 2024-09-21T11:39:13.759 INFO:tasks.workunit.client.1.smithi149.stdout:7/683: dread d12/d90/d68/f7a [0,4194304] 0 2024-09-21T11:39:13.760 INFO:tasks.workunit.client.0.smithi118.stdout:0/278: creat d5/f5c x:0 0 0 2024-09-21T11:39:13.760 INFO:tasks.workunit.client.1.smithi149.stdout:2/697: stat d8/d44/d63/db9/f41 0 2024-09-21T11:39:13.760 INFO:tasks.workunit.client.1.smithi149.stdout:5/648: chown d4/d7/d40/d43/f95 0 1 2024-09-21T11:39:13.761 INFO:tasks.workunit.client.0.smithi118.stdout:0/279: write d5/d10/d1e/d23/d3a/f3e [2428493,126780] 0 2024-09-21T11:39:13.762 INFO:tasks.workunit.client.1.smithi149.stdout:2/698: chown d8/dd/d5c/d84 491280834 1 2024-09-21T11:39:13.762 INFO:tasks.workunit.client.1.smithi149.stdout:4/617: chown d4/d6/d63/cd 18 1 2024-09-21T11:39:13.762 INFO:tasks.workunit.client.1.smithi149.stdout:7/684: write d12/d90/d4a/d6c/d8c/fcb [362899,41793] 0 2024-09-21T11:39:13.763 INFO:tasks.workunit.client.1.smithi149.stdout:5/649: chown d4/l26 0 1 2024-09-21T11:39:13.764 INFO:tasks.workunit.client.0.smithi118.stdout:0/280: symlink d5/d10/d1e/d20/l5d 0 2024-09-21T11:39:13.766 INFO:tasks.workunit.client.1.smithi149.stdout:9/574: dread d18/d19/d29/d39/d63/f6c [0,4194304] 0 2024-09-21T11:39:13.769 INFO:tasks.workunit.client.0.smithi118.stdout:0/281: symlink d5/d10/d1e/d21/d2a/l5e 0 2024-09-21T11:39:13.773 INFO:tasks.workunit.client.1.smithi149.stdout:7/685: getdents d12/d90/db7 0 2024-09-21T11:39:13.777 INFO:tasks.workunit.client.0.smithi118.stdout:8/295: dwrite d2/dc/d10/d2e/d18/f22 [0,4194304] 0 2024-09-21T11:39:13.777 INFO:tasks.workunit.client.1.smithi149.stdout:2/699: dread d8/f46 [0,4194304] 0 2024-09-21T11:39:13.778 INFO:tasks.workunit.client.1.smithi149.stdout:2/700: write d8/dd/d8c/de0/ff0 [120360,127498] 0 2024-09-21T11:39:13.780 INFO:tasks.workunit.client.1.smithi149.stdout:8/524: dread d3/dd/f3f [0,4194304] 0 2024-09-21T11:39:13.780 INFO:tasks.workunit.client.0.smithi118.stdout:0/282: getdents d5/d29 0 2024-09-21T11:39:13.782 INFO:tasks.workunit.client.1.smithi149.stdout:8/525: truncate d3/dd/d21/d54/d5c/f9f 810102 0 2024-09-21T11:39:13.782 INFO:tasks.workunit.client.0.smithi118.stdout:0/283: write d5/d10/d1e/d20/f32 [8704662,7298] 0 2024-09-21T11:39:13.783 INFO:tasks.workunit.client.0.smithi118.stdout:8/296: dread d2/dc/d16/d46/d4c/d63/f4a [0,4194304] 0 2024-09-21T11:39:13.784 INFO:tasks.workunit.client.0.smithi118.stdout:8/297: write d2/dc/d10/d2e/f55 [939193,15043] 0 2024-09-21T11:39:13.786 INFO:tasks.workunit.client.1.smithi149.stdout:9/575: getdents d18/d19/d1a/d2f/d33 0 2024-09-21T11:39:13.787 INFO:tasks.workunit.client.0.smithi118.stdout:0/284: symlink d5/d34/d44/l5f 0 2024-09-21T11:39:13.789 INFO:tasks.workunit.client.1.smithi149.stdout:2/701: getdents d8/d11/d88/dd4/de5 0 2024-09-21T11:39:13.790 INFO:tasks.workunit.client.1.smithi149.stdout:8/526: fdatasync d3/d12/f15 0 2024-09-21T11:39:13.792 INFO:tasks.workunit.client.1.smithi149.stdout:4/618: truncate d4/d6/d63/d15/f49 8637571 0 2024-09-21T11:39:13.792 INFO:tasks.workunit.client.1.smithi149.stdout:7/686: write d12/d90/d4a/d4f/f88 [560178,5518] 0 2024-09-21T11:39:13.794 INFO:tasks.workunit.client.0.smithi118.stdout:0/285: rename d5/d10/d1e/d23/d3a/f3e to d5/d10/d1e/d21/d2a/d48/f60 0 2024-09-21T11:39:13.796 INFO:tasks.workunit.client.1.smithi149.stdout:2/702: mknod d8/da/d13/d5d/d6a/cf7 0 2024-09-21T11:39:13.796 INFO:tasks.workunit.client.1.smithi149.stdout:4/619: dread d4/d6/d63/d2d/dd6/d32/d4a/f85 [0,4194304] 0 2024-09-21T11:39:13.798 INFO:tasks.workunit.client.1.smithi149.stdout:4/620: dread d4/d6/d63/d10/f86 [0,4194304] 0 2024-09-21T11:39:13.803 INFO:tasks.workunit.client.0.smithi118.stdout:8/298: truncate d2/dc/f26 3386246 0 2024-09-21T11:39:13.804 INFO:tasks.workunit.client.0.smithi118.stdout:0/286: creat d5/d34/f61 x:0 0 0 2024-09-21T11:39:13.805 INFO:tasks.workunit.client.0.smithi118.stdout:0/287: write d5/d34/f3b [544140,112290] 0 2024-09-21T11:39:13.806 INFO:tasks.workunit.client.1.smithi149.stdout:9/576: truncate d18/d19/d29/f68 2190563 0 2024-09-21T11:39:13.807 INFO:tasks.workunit.client.0.smithi118.stdout:8/299: creat d2/dc/d10/d3b/f64 x:0 0 0 2024-09-21T11:39:13.810 INFO:tasks.workunit.client.0.smithi118.stdout:0/288: mknod d5/d10/c62 0 2024-09-21T11:39:13.810 INFO:tasks.workunit.client.0.smithi118.stdout:8/300: mknod d2/dc/d16/c65 0 2024-09-21T11:39:13.812 INFO:tasks.workunit.client.1.smithi149.stdout:9/577: creat d18/d19/d1a/d2f/d43/fb9 x:0 0 0 2024-09-21T11:39:13.813 INFO:tasks.workunit.client.1.smithi149.stdout:9/578: chown d18/d19/d1a/d2f/d53/l81 186 1 2024-09-21T11:39:13.813 INFO:tasks.workunit.client.0.smithi118.stdout:8/301: rmdir d2/dc/d10/d2e/d18/d36 39 2024-09-21T11:39:13.819 INFO:tasks.workunit.client.1.smithi149.stdout:9/579: mknod d18/d19/cba 0 2024-09-21T11:39:13.820 INFO:tasks.workunit.client.0.smithi118.stdout:8/302: dwrite d2/dc/d10/d3b/f64 [0,4194304] 0 2024-09-21T11:39:13.821 INFO:tasks.workunit.client.1.smithi149.stdout:7/687: getdents d12/d90 0 2024-09-21T11:39:13.827 INFO:tasks.workunit.client.1.smithi149.stdout:9/580: dwrite d18/d4c/f67 [0,4194304] 0 2024-09-21T11:39:13.827 INFO:tasks.workunit.client.1.smithi149.stdout:2/703: link d8/d11/l25 d8/d11/d88/dd4/de5/lf8 0 2024-09-21T11:39:13.828 INFO:tasks.workunit.client.0.smithi118.stdout:8/303: unlink d2/dc/d10/d2e/d18/d1a/l39 0 2024-09-21T11:39:13.829 INFO:tasks.workunit.client.0.smithi118.stdout:8/304: fsync d2/f57 0 2024-09-21T11:39:13.830 INFO:tasks.workunit.client.0.smithi118.stdout:8/305: read d2/dc/d10/d2e/d18/f4f [3454078,67599] 0 2024-09-21T11:39:13.835 INFO:tasks.workunit.client.1.smithi149.stdout:4/621: truncate d4/d6/f7f 3392075 0 2024-09-21T11:39:13.836 INFO:tasks.workunit.client.1.smithi149.stdout:2/704: dread d8/dd/d50/fd2 [0,4194304] 0 2024-09-21T11:39:13.836 INFO:tasks.workunit.client.0.smithi118.stdout:8/306: unlink d2/dc/d16/c58 0 2024-09-21T11:39:13.837 INFO:tasks.workunit.client.0.smithi118.stdout:8/307: chown d2/dc/d16 927890373 1 2024-09-21T11:39:13.839 INFO:tasks.workunit.client.0.smithi118.stdout:0/289: dwrite d5/f13 [0,4194304] 0 2024-09-21T11:39:13.842 INFO:tasks.workunit.client.1.smithi149.stdout:2/705: rename d8/d44/d63/db9/f27 to d8/da/d13/d83/df6/ff9 0 2024-09-21T11:39:13.843 INFO:tasks.workunit.client.1.smithi149.stdout:2/706: fdatasync d8/d11/f3a 0 2024-09-21T11:39:13.845 INFO:tasks.workunit.client.0.smithi118.stdout:8/308: mknod d2/dc/d35/c66 0 2024-09-21T11:39:13.847 INFO:tasks.workunit.client.0.smithi118.stdout:0/290: creat d5/d29/d53/f63 x:0 0 0 2024-09-21T11:39:13.848 INFO:tasks.workunit.client.1.smithi149.stdout:7/688: write d12/d90/d4a/d9e/f73 [590367,17299] 0 2024-09-21T11:39:13.850 INFO:tasks.workunit.client.0.smithi118.stdout:8/309: write d2/dc/d10/d2e/f21 [2547604,116572] 0 2024-09-21T11:39:13.858 INFO:tasks.workunit.client.1.smithi149.stdout:4/622: getdents d4/d6/d63/d15/d16/d23/d62 0 2024-09-21T11:39:13.859 INFO:tasks.workunit.client.0.smithi118.stdout:7/88: sync 2024-09-21T11:39:13.859 INFO:tasks.workunit.client.0.smithi118.stdout:3/112: sync 2024-09-21T11:39:13.859 INFO:tasks.workunit.client.0.smithi118.stdout:6/118: sync 2024-09-21T11:39:13.860 INFO:tasks.workunit.client.0.smithi118.stdout:8/310: dwrite d2/d32/f59 [0,4194304] 0 2024-09-21T11:39:13.861 INFO:tasks.workunit.client.1.smithi149.stdout:3/622: sync 2024-09-21T11:39:13.862 INFO:tasks.workunit.client.0.smithi118.stdout:0/291: dwrite d5/d10/d1e/d21/d2a/d48/f60 [0,4194304] 0 2024-09-21T11:39:13.864 INFO:tasks.workunit.client.0.smithi118.stdout:7/89: mknod d0/c1f 0 2024-09-21T11:39:13.865 INFO:tasks.workunit.client.1.smithi149.stdout:2/707: write d8/d44/d63/f75 [735914,94210] 0 2024-09-21T11:39:13.866 INFO:tasks.workunit.client.1.smithi149.stdout:9/581: write d18/d19/f20 [3405044,58267] 0 2024-09-21T11:39:13.867 INFO:tasks.workunit.client.1.smithi149.stdout:9/582: chown d18/d19/f20 29407896 1 2024-09-21T11:39:13.871 INFO:tasks.workunit.client.0.smithi118.stdout:6/119: dwrite d8/d14/f24 [0,4194304] 0 2024-09-21T11:39:13.872 INFO:tasks.workunit.client.1.smithi149.stdout:3/623: creat d6/d1f/d47/dbb/fe4 x:0 0 0 2024-09-21T11:39:13.875 INFO:tasks.workunit.client.0.smithi118.stdout:0/292: rename d5/d10/d1e/d20/f4d to d5/d10/d1e/d21/d2a/d48/f64 0 2024-09-21T11:39:13.876 INFO:tasks.workunit.client.1.smithi149.stdout:4/623: truncate d4/d6/f59 534722 0 2024-09-21T11:39:13.879 INFO:tasks.workunit.client.1.smithi149.stdout:4/624: write d4/d6/d63/d15/d30/d6b/daa/fac [175771,106668] 0 2024-09-21T11:39:13.880 INFO:tasks.workunit.client.1.smithi149.stdout:2/708: rmdir d8/d11/dac 39 2024-09-21T11:39:13.880 INFO:tasks.workunit.client.1.smithi149.stdout:9/583: readlink d18/d36/l8a 0 2024-09-21T11:39:13.881 INFO:tasks.workunit.client.0.smithi118.stdout:8/311: symlink d2/dc/d10/d2e/d18/d36/l67 0 2024-09-21T11:39:13.881 INFO:tasks.workunit.client.1.smithi149.stdout:3/624: dwrite d6/d1f/d47/fb3 [0,4194304] 0 2024-09-21T11:39:13.883 INFO:tasks.workunit.client.0.smithi118.stdout:8/312: write d2/dc/d10/d3b/f64 [602955,104684] 0 2024-09-21T11:39:13.883 INFO:tasks.workunit.client.0.smithi118.stdout:6/120: dread d8/f13 [0,4194304] 0 2024-09-21T11:39:13.883 INFO:tasks.workunit.client.0.smithi118.stdout:7/90: creat d0/d3/d1c/f20 x:0 0 0 2024-09-21T11:39:13.884 INFO:tasks.workunit.client.1.smithi149.stdout:7/689: getdents d12/d90/d4a/d4f/d75 0 2024-09-21T11:39:13.884 INFO:tasks.workunit.client.1.smithi149.stdout:2/709: chown d8/dd/d5c/d84/fed 1 1 2024-09-21T11:39:13.885 INFO:tasks.workunit.client.0.smithi118.stdout:7/91: write d0/d3/f11 [834361,6036] 0 2024-09-21T11:39:13.887 INFO:tasks.workunit.client.0.smithi118.stdout:3/113: write d5/d1d/f16 [221929,93350] 0 2024-09-21T11:39:13.894 INFO:tasks.workunit.client.0.smithi118.stdout:0/293: rename d5/d34/f61 to d5/d34/f65 0 2024-09-21T11:39:13.897 INFO:tasks.workunit.client.0.smithi118.stdout:3/114: dwrite d5/d1d/f23 [0,4194304] 0 2024-09-21T11:39:13.897 INFO:tasks.workunit.client.1.smithi149.stdout:3/625: read d6/d1f/d47/f52 [74015,130829] 0 2024-09-21T11:39:13.899 INFO:tasks.workunit.client.0.smithi118.stdout:6/121: rmdir d8 39 2024-09-21T11:39:13.904 INFO:tasks.workunit.client.0.smithi118.stdout:8/313: rename d2/dc/d16/d46/d62 to d2/dc/d16/d46/d4c/d63/d68 0 2024-09-21T11:39:13.905 INFO:tasks.workunit.client.0.smithi118.stdout:8/314: dread - d2/dc/d10/d2e/d18/d1a/f56 zero size 2024-09-21T11:39:13.908 INFO:tasks.workunit.client.1.smithi149.stdout:4/625: symlink d4/d6/d63/d15/dd2/le0 0 2024-09-21T11:39:13.909 INFO:tasks.workunit.client.0.smithi118.stdout:0/294: symlink d5/d29/d53/l66 0 2024-09-21T11:39:13.909 INFO:tasks.workunit.client.0.smithi118.stdout:8/315: dread d2/d32/f59 [0,4194304] 0 2024-09-21T11:39:13.910 INFO:tasks.workunit.client.1.smithi149.stdout:2/710: symlink d8/da/d13/d1a/dc5/lfa 0 2024-09-21T11:39:13.911 INFO:tasks.workunit.client.0.smithi118.stdout:5/61: sync 2024-09-21T11:39:13.911 INFO:tasks.workunit.client.0.smithi118.stdout:2/84: sync 2024-09-21T11:39:13.911 INFO:tasks.workunit.client.0.smithi118.stdout:4/118: sync 2024-09-21T11:39:13.913 INFO:tasks.workunit.client.0.smithi118.stdout:2/85: write de/f10 [966576,40218] 0 2024-09-21T11:39:13.915 INFO:tasks.workunit.client.1.smithi149.stdout:3/626: mkdir d6/d1f/de5 0 2024-09-21T11:39:13.916 INFO:tasks.workunit.client.0.smithi118.stdout:5/62: dread d0/fe [0,4194304] 0 2024-09-21T11:39:13.916 INFO:tasks.workunit.client.0.smithi118.stdout:7/92: mknod d0/d3/d1d/c21 0 2024-09-21T11:39:13.918 INFO:tasks.workunit.client.0.smithi118.stdout:5/63: fdatasync d0/d6/f7 0 2024-09-21T11:39:13.921 INFO:tasks.workunit.client.0.smithi118.stdout:4/119: dwrite d2/f13 [0,4194304] 0 2024-09-21T11:39:13.922 INFO:tasks.workunit.client.0.smithi118.stdout:8/316: creat d2/dc/d16/d46/f69 x:0 0 0 2024-09-21T11:39:13.923 INFO:tasks.workunit.client.1.smithi149.stdout:9/584: dwrite d18/d19/f40 [0,4194304] 0 2024-09-21T11:39:13.924 INFO:tasks.workunit.client.0.smithi118.stdout:0/295: truncate d5/d10/d1e/d21/f2d 2826057 0 2024-09-21T11:39:13.924 INFO:tasks.workunit.client.1.smithi149.stdout:9/585: write d18/d36/d3c/d47/d76/f86 [321618,122928] 0 2024-09-21T11:39:13.928 INFO:tasks.workunit.client.0.smithi118.stdout:7/93: dwrite d0/f16 [0,4194304] 0 2024-09-21T11:39:13.930 INFO:tasks.workunit.client.0.smithi118.stdout:7/94: chown d0/d3/d13/l1b 946 1 2024-09-21T11:39:13.930 INFO:tasks.workunit.client.0.smithi118.stdout:0/296: dread d5/d34/f3b [0,4194304] 0 2024-09-21T11:39:13.931 INFO:tasks.workunit.client.1.smithi149.stdout:2/711: dread d8/dd/d8c/fa1 [0,4194304] 0 2024-09-21T11:39:13.933 INFO:tasks.workunit.client.0.smithi118.stdout:6/122: mkdir d8/d14/d28 0 2024-09-21T11:39:13.936 INFO:tasks.workunit.client.0.smithi118.stdout:2/86: mkdir de/d1f 0 2024-09-21T11:39:13.936 INFO:tasks.workunit.client.0.smithi118.stdout:2/87: write f8 [1484833,64925] 0 2024-09-21T11:39:13.938 INFO:tasks.workunit.client.1.smithi149.stdout:3/627: dread d6/d1f/d47/d22/f5d [0,4194304] 0 2024-09-21T11:39:13.939 INFO:tasks.workunit.client.1.smithi149.stdout:2/712: creat d8/dcb/db8/dd3/ffb x:0 0 0 2024-09-21T11:39:13.940 INFO:tasks.workunit.client.1.smithi149.stdout:4/626: truncate d4/d6/d63/d15/d30/d6b/db3/f70 647960 0 2024-09-21T11:39:13.942 INFO:tasks.workunit.client.0.smithi118.stdout:5/64: mkdir d0/d6/d9/d10/d1a 0 2024-09-21T11:39:13.944 INFO:tasks.workunit.client.1.smithi149.stdout:3/628: creat d6/d5f/fe6 x:0 0 0 2024-09-21T11:39:13.949 INFO:tasks.workunit.client.0.smithi118.stdout:3/115: link d5/d1d/d1b/c22 d5/d1d/c2a 0 2024-09-21T11:39:13.949 INFO:tasks.workunit.client.1.smithi149.stdout:1/542: sync 2024-09-21T11:39:13.949 INFO:tasks.workunit.client.1.smithi149.stdout:6/515: sync 2024-09-21T11:39:13.950 INFO:tasks.workunit.client.1.smithi149.stdout:0/514: sync 2024-09-21T11:39:13.950 INFO:tasks.workunit.client.0.smithi118.stdout:7/95: symlink d0/d3/d1c/l22 0 2024-09-21T11:39:13.950 INFO:tasks.workunit.client.0.smithi118.stdout:6/123: dread d8/f1a [8388608,4194304] 0 2024-09-21T11:39:13.951 INFO:tasks.workunit.client.0.smithi118.stdout:0/297: write d5/d10/d1e/d21/f42 [2533650,114784] 0 2024-09-21T11:39:13.954 INFO:tasks.workunit.client.1.smithi149.stdout:6/516: fsync d8/da/d2c/d52/d5e/f67 0 2024-09-21T11:39:13.956 INFO:tasks.workunit.client.1.smithi149.stdout:2/713: dread d8/da/f39 [0,4194304] 0 2024-09-21T11:39:13.957 INFO:tasks.workunit.client.1.smithi149.stdout:0/515: rename dd/d1a/d5a/f74 to dd/d1a/d1b/d72/d78/d8b/fae 0 2024-09-21T11:39:13.958 INFO:tasks.workunit.client.0.smithi118.stdout:8/317: truncate d2/dc/f26 2871422 0 2024-09-21T11:39:13.962 INFO:tasks.workunit.client.0.smithi118.stdout:7/96: mknod d0/d3/d1c/c23 0 2024-09-21T11:39:13.963 INFO:tasks.workunit.client.0.smithi118.stdout:7/97: truncate d0/f2 4863277 0 2024-09-21T11:39:13.968 INFO:tasks.workunit.client.0.smithi118.stdout:8/318: mkdir d2/dc/d10/d6a 0 2024-09-21T11:39:13.971 INFO:tasks.workunit.client.0.smithi118.stdout:6/124: mknod d8/d14/d28/c29 0 2024-09-21T11:39:13.972 INFO:tasks.workunit.client.0.smithi118.stdout:7/98: mknod d0/d3/d1c/c24 0 2024-09-21T11:39:13.972 INFO:tasks.workunit.client.0.smithi118.stdout:8/319: dread d2/d32/f3c [0,4194304] 0 2024-09-21T11:39:13.974 INFO:tasks.workunit.client.0.smithi118.stdout:5/65: rename d0/d6/d9/d10/f15 to d0/f1b 0 2024-09-21T11:39:13.974 INFO:tasks.workunit.client.0.smithi118.stdout:8/320: dread d2/dc/d10/d2e/d18/d1a/f1e [0,4194304] 0 2024-09-21T11:39:13.975 INFO:tasks.workunit.client.0.smithi118.stdout:5/66: write d0/d6/d9/da/f18 [320199,34613] 0 2024-09-21T11:39:13.977 INFO:tasks.workunit.client.0.smithi118.stdout:2/88: mkdir de/d1f/d20 0 2024-09-21T11:39:13.980 INFO:tasks.workunit.client.0.smithi118.stdout:6/125: creat d8/d14/d28/f2a x:0 0 0 2024-09-21T11:39:13.981 INFO:tasks.workunit.client.0.smithi118.stdout:5/67: write d0/d6/d9/da/f18 [1254170,50330] 0 2024-09-21T11:39:13.981 INFO:tasks.workunit.client.0.smithi118.stdout:4/120: dwrite d2/d6/f18 [0,4194304] 0 2024-09-21T11:39:13.982 INFO:tasks.workunit.client.0.smithi118.stdout:4/121: readlink d2/d6/dd/l1a 0 2024-09-21T11:39:13.983 INFO:tasks.workunit.client.0.smithi118.stdout:7/99: creat d0/d3/d14/f25 x:0 0 0 2024-09-21T11:39:13.986 INFO:tasks.workunit.client.0.smithi118.stdout:3/116: rename d5/f1a to d5/d28/f2b 0 2024-09-21T11:39:13.988 INFO:tasks.workunit.client.0.smithi118.stdout:2/89: fsync de/f10 0 2024-09-21T11:39:13.990 INFO:tasks.workunit.client.0.smithi118.stdout:5/68: dwrite d0/d6/f8 [0,4194304] 0 2024-09-21T11:39:13.992 INFO:tasks.workunit.client.0.smithi118.stdout:6/126: creat d8/d14/f2b x:0 0 0 2024-09-21T11:39:13.992 INFO:tasks.workunit.client.0.smithi118.stdout:0/298: truncate d5/f13 2711529 0 2024-09-21T11:39:13.993 INFO:tasks.workunit.client.0.smithi118.stdout:0/299: chown d5/d10/d1e/f27 872630 1 2024-09-21T11:39:13.994 INFO:tasks.workunit.client.0.smithi118.stdout:7/100: fsync d0/f6 0 2024-09-21T11:39:13.996 INFO:tasks.workunit.client.0.smithi118.stdout:6/127: dread d8/d14/f1d [0,4194304] 0 2024-09-21T11:39:13.996 INFO:tasks.workunit.client.0.smithi118.stdout:6/128: write d8/d14/f24 [3765739,43226] 0 2024-09-21T11:39:13.997 INFO:tasks.workunit.client.1.smithi149.stdout:4/627: dread d4/d6/d63/d15/d16/f33 [0,4194304] 0 2024-09-21T11:39:14.004 INFO:tasks.workunit.client.0.smithi118.stdout:3/117: creat d5/d1d/d1b/d24/f2c x:0 0 0 2024-09-21T11:39:14.006 INFO:tasks.workunit.client.1.smithi149.stdout:2/714: rename d8/d20/f97 to d8/da/d13/d2d/ffc 0 2024-09-21T11:39:14.006 INFO:tasks.workunit.client.1.smithi149.stdout:3/629: dread d6/d1f/d27/f3c [0,4194304] 0 2024-09-21T11:39:14.007 INFO:tasks.workunit.client.1.smithi149.stdout:4/628: symlink d4/d6/d63/d2d/dd6/le1 0 2024-09-21T11:39:14.007 INFO:tasks.workunit.client.0.smithi118.stdout:8/321: link d2/dc/d10/d2e/l12 d2/dc/d10/d2e/d18/d1a/l6b 0 2024-09-21T11:39:14.008 INFO:tasks.workunit.client.1.smithi149.stdout:6/517: getdents d8/d32/d37/d79 0 2024-09-21T11:39:14.009 INFO:tasks.workunit.client.0.smithi118.stdout:6/129: creat d8/d14/d28/f2c x:0 0 0 2024-09-21T11:39:14.009 INFO:tasks.workunit.client.1.smithi149.stdout:6/518: write d8/da/fd [2449381,63777] 0 2024-09-21T11:39:14.011 INFO:tasks.workunit.client.1.smithi149.stdout:2/715: symlink d8/dd/d5c/d60/d67/d8a/lfd 0 2024-09-21T11:39:14.013 INFO:tasks.workunit.client.1.smithi149.stdout:2/716: chown d8/dcb/db8/dd3/ffb 19584 1 2024-09-21T11:39:14.015 INFO:tasks.workunit.client.1.smithi149.stdout:4/629: mknod d4/d6/d63/d10/ce2 0 2024-09-21T11:39:14.016 INFO:tasks.workunit.client.1.smithi149.stdout:6/519: creat d8/d32/d37/d28/d2f/d6a/d72/fac x:0 0 0 2024-09-21T11:39:14.017 INFO:tasks.workunit.client.1.smithi149.stdout:3/630: dwrite d6/d1f/d47/f81 [0,4194304] 0 2024-09-21T11:39:14.018 INFO:tasks.workunit.client.1.smithi149.stdout:8/527: sync 2024-09-21T11:39:14.018 INFO:tasks.workunit.client.1.smithi149.stdout:7/690: sync 2024-09-21T11:39:14.018 INFO:tasks.workunit.client.1.smithi149.stdout:5/650: sync 2024-09-21T11:39:14.021 INFO:tasks.workunit.client.1.smithi149.stdout:4/630: fsync d4/d6/d63/d2d/dd6/f90 0 2024-09-21T11:39:14.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/528: chown d3/dd/d18 773 1 2024-09-21T11:39:14.028 INFO:tasks.workunit.client.1.smithi149.stdout:5/651: truncate d4/d1d/d50/dc8/fc9 345077 0 2024-09-21T11:39:14.029 INFO:tasks.workunit.client.1.smithi149.stdout:2/717: rename d8/dd/d50/fad to d8/dd/d5c/d60/d67/ffe 0 2024-09-21T11:39:14.029 INFO:tasks.workunit.client.1.smithi149.stdout:6/520: truncate d8/d32/d37/d28/d2f/d6a/f95 946847 0 2024-09-21T11:39:14.029 INFO:tasks.workunit.client.1.smithi149.stdout:7/691: getdents d12/d90/d4a/d4f/dce 0 2024-09-21T11:39:14.052 INFO:tasks.workunit.client.1.smithi149.stdout:4/631: symlink d4/d6/d63/d2d/dd6/le3 0 2024-09-21T11:39:14.053 INFO:tasks.workunit.client.1.smithi149.stdout:3/631: getdents d6/d5f/d60/d88 0 2024-09-21T11:39:14.054 INFO:tasks.workunit.client.1.smithi149.stdout:6/521: creat d8/da/d14/fad x:0 0 0 2024-09-21T11:39:14.054 INFO:tasks.workunit.client.1.smithi149.stdout:2/718: readlink d8/d11/dac/lbc 0 2024-09-21T11:39:14.054 INFO:tasks.workunit.client.1.smithi149.stdout:5/652: rename d4/d7/l17 to d4/d1d/d50/d60/db1/db4/ld3 0 2024-09-21T11:39:14.055 INFO:tasks.workunit.client.1.smithi149.stdout:3/632: rmdir d6 39 2024-09-21T11:39:14.055 INFO:tasks.workunit.client.1.smithi149.stdout:0/516: dread dd/d1a/d1b/d72/d85/d8c/f89 [0,4194304] 0 2024-09-21T11:39:14.056 INFO:tasks.workunit.client.1.smithi149.stdout:4/632: readlink d4/d6/d63/d2d/dd6/d32/lcf 0 2024-09-21T11:39:14.057 INFO:tasks.workunit.client.1.smithi149.stdout:0/517: stat dd/l21 0 2024-09-21T11:39:14.057 INFO:tasks.workunit.client.1.smithi149.stdout:5/653: stat d4/d7/d40/d43/d5c/cb5 0 2024-09-21T11:39:14.057 INFO:tasks.workunit.client.1.smithi149.stdout:7/692: link fa d12/d90/d4a/d9e/fd1 0 2024-09-21T11:39:14.058 INFO:tasks.workunit.client.1.smithi149.stdout:6/522: creat d8/da/d2c/d2d/d9a/fae x:0 0 0 2024-09-21T11:39:14.060 INFO:tasks.workunit.client.1.smithi149.stdout:5/654: dread - d4/d7/d40/d43/d5c/fb0 zero size 2024-09-21T11:39:14.061 INFO:tasks.workunit.client.1.smithi149.stdout:0/518: readlink dd/d1a/d1b/d72/d78/d8b/l9e 0 2024-09-21T11:39:14.062 INFO:tasks.workunit.client.1.smithi149.stdout:6/523: read - d8/d32/d37/d2b/d51/f62 zero size 2024-09-21T11:39:14.064 INFO:tasks.workunit.client.1.smithi149.stdout:2/719: dwrite d8/dd/d5c/f76 [0,4194304] 0 2024-09-21T11:39:14.065 INFO:tasks.workunit.client.1.smithi149.stdout:6/524: rmdir d8/da/d2c/d2d 39 2024-09-21T11:39:14.065 INFO:tasks.workunit.client.1.smithi149.stdout:2/720: dread - d8/d44/d63/fa9 zero size 2024-09-21T11:39:14.068 INFO:tasks.workunit.client.1.smithi149.stdout:6/525: dread - d8/d32/d37/d2b/d7e/f86 zero size 2024-09-21T11:39:14.072 INFO:tasks.workunit.client.1.smithi149.stdout:2/721: rename d8/da/d13/dc3 to d8/da/d13/d2d/d6f/de8/dff 0 2024-09-21T11:39:14.073 INFO:tasks.workunit.client.1.smithi149.stdout:0/519: dwrite dd/d1a/d1b/f31 [8388608,4194304] 0 2024-09-21T11:39:14.074 INFO:tasks.workunit.client.0.smithi118.stdout:0/300: unlink d5/d10/d1e/d33/f35 0 2024-09-21T11:39:14.074 INFO:tasks.workunit.client.0.smithi118.stdout:3/118: rmdir d5/d28 39 2024-09-21T11:39:14.075 INFO:tasks.workunit.client.0.smithi118.stdout:8/322: creat d2/d32/f6c x:0 0 0 2024-09-21T11:39:14.076 INFO:tasks.workunit.client.1.smithi149.stdout:7/693: link d12/d90/d68/dc4/d30/c36 d12/d90/d4a/d4f/d75/d94/d47/cd2 0 2024-09-21T11:39:14.076 INFO:tasks.workunit.client.1.smithi149.stdout:3/633: write d6/d1f/d4c/fb4 [892337,87613] 0 2024-09-21T11:39:14.078 INFO:tasks.workunit.client.1.smithi149.stdout:2/722: mknod d8/dcb/c100 0 2024-09-21T11:39:14.078 INFO:tasks.workunit.client.0.smithi118.stdout:5/69: write d0/fe [592321,107020] 0 2024-09-21T11:39:14.079 INFO:tasks.workunit.client.0.smithi118.stdout:8/323: readlink d2/dc/d35/d42/l61 0 2024-09-21T11:39:14.079 INFO:tasks.workunit.client.1.smithi149.stdout:0/520: fdatasync dd/d1a/d1b/f27 0 2024-09-21T11:39:14.080 INFO:tasks.workunit.client.1.smithi149.stdout:2/723: write d8/da/d13/f21 [1108688,8978] 0 2024-09-21T11:39:14.081 INFO:tasks.workunit.client.1.smithi149.stdout:0/521: fdatasync dd/d1a/d5a/d65/f7b 0 2024-09-21T11:39:14.083 INFO:tasks.workunit.client.0.smithi118.stdout:6/130: dread d8/d14/f1e [0,4194304] 0 2024-09-21T11:39:14.083 INFO:tasks.workunit.client.1.smithi149.stdout:2/724: write d8/da/d13/d1a/f3e [1677815,78322] 0 2024-09-21T11:39:14.084 INFO:tasks.workunit.client.1.smithi149.stdout:5/655: dread d4/d90/f9e [0,4194304] 0 2024-09-21T11:39:14.085 INFO:tasks.workunit.client.1.smithi149.stdout:2/725: fdatasync d8/d20/d57/f6c 0 2024-09-21T11:39:14.086 INFO:tasks.workunit.client.1.smithi149.stdout:6/526: dread d8/da/d3d/f5d [0,4194304] 0 2024-09-21T11:39:14.087 INFO:tasks.workunit.client.0.smithi118.stdout:2/90: truncate de/f18 3130004 0 2024-09-21T11:39:14.088 INFO:tasks.workunit.client.1.smithi149.stdout:2/726: write d8/d44/d63/db9/d5a/fc7 [554638,93873] 0 2024-09-21T11:39:14.089 INFO:tasks.workunit.client.1.smithi149.stdout:7/694: creat d12/d5b/fd3 x:0 0 0 2024-09-21T11:39:14.089 INFO:tasks.workunit.client.1.smithi149.stdout:2/727: chown d8/da/cc 10063872 1 2024-09-21T11:39:14.092 INFO:tasks.workunit.client.1.smithi149.stdout:0/522: write dd/d1a/d1b/d50/d5d/f71 [854557,110927] 0 2024-09-21T11:39:14.092 INFO:tasks.workunit.client.0.smithi118.stdout:0/301: mknod d5/d10/c67 0 2024-09-21T11:39:14.094 INFO:tasks.workunit.client.0.smithi118.stdout:3/119: dwrite d5/d1d/f11 [0,4194304] 0 2024-09-21T11:39:14.095 INFO:tasks.workunit.client.0.smithi118.stdout:4/122: dwrite d2/f7 [0,4194304] 0 2024-09-21T11:39:14.097 INFO:tasks.workunit.client.0.smithi118.stdout:6/131: rename d8/f13 to d8/d14/f2d 0 2024-09-21T11:39:14.100 INFO:tasks.workunit.client.0.smithi118.stdout:0/302: fdatasync d5/d10/d1e/d21/f24 0 2024-09-21T11:39:14.102 INFO:tasks.workunit.client.1.smithi149.stdout:9/586: sync 2024-09-21T11:39:14.102 INFO:tasks.workunit.client.1.smithi149.stdout:1/543: sync 2024-09-21T11:39:14.103 INFO:tasks.workunit.client.1.smithi149.stdout:0/523: dwrite dd/d2d/f56 [0,4194304] 0 2024-09-21T11:39:14.103 INFO:tasks.workunit.client.1.smithi149.stdout:7/695: rename d12/d90/d68/dc4/d30/f34 to d12/d90/fd4 0 2024-09-21T11:39:14.103 INFO:tasks.workunit.client.0.smithi118.stdout:0/303: chown d5/d10/c67 4 1 2024-09-21T11:39:14.103 INFO:tasks.workunit.client.0.smithi118.stdout:8/324: dwrite d2/dc/d10/d2e/f5f [0,4194304] 0 2024-09-21T11:39:14.105 INFO:tasks.workunit.client.0.smithi118.stdout:5/70: dwrite d0/fd [0,4194304] 0 2024-09-21T11:39:14.107 INFO:tasks.workunit.client.1.smithi149.stdout:1/544: chown d2/d5/f34 1872581 1 2024-09-21T11:39:14.112 INFO:tasks.workunit.client.0.smithi118.stdout:6/132: rename d8/c18 to d8/c2e 0 2024-09-21T11:39:14.112 INFO:tasks.workunit.client.1.smithi149.stdout:5/656: dread d4/d7/f45 [0,4194304] 0 2024-09-21T11:39:14.113 INFO:tasks.workunit.client.0.smithi118.stdout:0/304: mkdir d5/d29/d68 0 2024-09-21T11:39:14.114 INFO:tasks.workunit.client.0.smithi118.stdout:0/305: chown d5/d34/l36 0 1 2024-09-21T11:39:14.116 INFO:tasks.workunit.client.0.smithi118.stdout:2/91: rename cb to de/d16/d1c/c21 0 2024-09-21T11:39:14.118 INFO:tasks.workunit.client.1.smithi149.stdout:0/524: rmdir dd/d6a 39 2024-09-21T11:39:14.126 INFO:tasks.workunit.client.1.smithi149.stdout:6/527: creat d8/da/d2c/d2d/d9a/faf x:0 0 0 2024-09-21T11:39:14.126 INFO:tasks.workunit.client.1.smithi149.stdout:2/728: link d8/d11/l6e d8/d11/dac/l101 0 2024-09-21T11:39:14.127 INFO:tasks.workunit.client.0.smithi118.stdout:2/92: dwrite de/f10 [0,4194304] 0 2024-09-21T11:39:14.128 INFO:tasks.workunit.client.1.smithi149.stdout:9/587: dread d18/d19/d1a/d2f/faa [0,4194304] 0 2024-09-21T11:39:14.130 INFO:tasks.workunit.client.0.smithi118.stdout:0/306: read d5/d10/d1e/d20/f2f [2558998,2365] 0 2024-09-21T11:39:14.132 INFO:tasks.workunit.client.0.smithi118.stdout:5/71: dwrite d0/db/f16 [0,4194304] 0 2024-09-21T11:39:14.136 INFO:tasks.workunit.client.0.smithi118.stdout:6/133: rename d8/d14/d28/c29 to d8/c2f 0 2024-09-21T11:39:14.141 INFO:tasks.workunit.client.0.smithi118.stdout:2/93: chown de/f14 14371 1 2024-09-21T11:39:14.142 INFO:tasks.workunit.client.1.smithi149.stdout:9/588: dwrite d18/d19/f40 [4194304,4194304] 0 2024-09-21T11:39:14.143 INFO:tasks.workunit.client.1.smithi149.stdout:6/528: rmdir d8/da/d3d 39 2024-09-21T11:39:14.144 INFO:tasks.workunit.client.0.smithi118.stdout:5/72: rename d0/d6/d9 to d0/d6/d1c 0 2024-09-21T11:39:14.145 INFO:tasks.workunit.client.0.smithi118.stdout:6/134: mknod d8/d14/d28/c30 0 2024-09-21T11:39:14.147 INFO:tasks.workunit.client.0.smithi118.stdout:4/123: link d2/d6/de/d1c/d23/l25 d2/d6/dd/l30 0 2024-09-21T11:39:14.148 INFO:tasks.workunit.client.0.smithi118.stdout:1/125: sync 2024-09-21T11:39:14.148 INFO:tasks.workunit.client.0.smithi118.stdout:9/138: sync 2024-09-21T11:39:14.148 INFO:tasks.workunit.client.1.smithi149.stdout:0/525: link dd/d1a/d1b/d72/d85/d8c/f89 dd/d1a/d1b/d72/d85/faf 0 2024-09-21T11:39:14.149 INFO:tasks.workunit.client.0.smithi118.stdout:2/94: unlink ld 0 2024-09-21T11:39:14.151 INFO:tasks.workunit.client.1.smithi149.stdout:2/729: getdents d8/d20/d78/ddb 0 2024-09-21T11:39:14.151 INFO:tasks.workunit.client.0.smithi118.stdout:6/135: creat d8/d14/d28/f31 x:0 0 0 2024-09-21T11:39:14.154 INFO:tasks.workunit.client.1.smithi149.stdout:9/589: creat d18/d19/d1a/d2f/d30/d54/fbb x:0 0 0 2024-09-21T11:39:14.154 INFO:tasks.workunit.client.0.smithi118.stdout:4/124: mkdir d2/d6/de/d1c/d23/d26/d31 0 2024-09-21T11:39:14.157 INFO:tasks.workunit.client.0.smithi118.stdout:1/126: stat d6/de/f11 0 2024-09-21T11:39:14.158 INFO:tasks.workunit.client.1.smithi149.stdout:6/529: dwrite d8/da/d2c/d2d/d9a/faf [0,4194304] 0 2024-09-21T11:39:14.160 INFO:tasks.workunit.client.1.smithi149.stdout:1/545: getdents d2/dd/d35/d1c/d7a 0 2024-09-21T11:39:14.160 INFO:tasks.workunit.client.1.smithi149.stdout:6/530: chown d8/d32/d64/l78 49639772 1 2024-09-21T11:39:14.160 INFO:tasks.workunit.client.0.smithi118.stdout:9/139: mknod d0/d20/c39 0 2024-09-21T11:39:14.162 INFO:tasks.workunit.client.0.smithi118.stdout:6/136: dwrite d8/f25 [0,4194304] 0 2024-09-21T11:39:14.162 INFO:tasks.workunit.client.1.smithi149.stdout:5/657: getdents d4/d1d/d50/d60/db1/db4 0 2024-09-21T11:39:14.162 INFO:tasks.workunit.client.1.smithi149.stdout:0/526: chown dd/d35/c7e 189 1 2024-09-21T11:39:14.165 INFO:tasks.workunit.client.0.smithi118.stdout:4/125: dwrite d2/f7 [0,4194304] 0 2024-09-21T11:39:14.173 INFO:tasks.workunit.client.0.smithi118.stdout:3/120: truncate d5/f8 3519099 0 2024-09-21T11:39:14.174 INFO:tasks.workunit.client.0.smithi118.stdout:8/325: dwrite d2/dc/d10/d2e/d18/f4f [0,4194304] 0 2024-09-21T11:39:14.175 INFO:tasks.workunit.client.0.smithi118.stdout:1/127: creat d6/de/f22 x:0 0 0 2024-09-21T11:39:14.177 INFO:tasks.workunit.client.0.smithi118.stdout:8/326: dread d2/dc/d10/d2e/d18/d1a/f1e [0,4194304] 0 2024-09-21T11:39:14.177 INFO:tasks.workunit.client.0.smithi118.stdout:2/95: mkdir de/d22 0 2024-09-21T11:39:14.178 INFO:tasks.workunit.client.0.smithi118.stdout:9/140: dread d0/d4/f8 [0,4194304] 0 2024-09-21T11:39:14.180 INFO:tasks.workunit.client.0.smithi118.stdout:9/141: dread d0/f26 [0,4194304] 0 2024-09-21T11:39:14.181 INFO:tasks.workunit.client.1.smithi149.stdout:0/527: dwrite dd/d1a/d1b/f24 [4194304,4194304] 0 2024-09-21T11:39:14.184 INFO:tasks.workunit.client.0.smithi118.stdout:0/307: getdents d5/d10/d1e/d21/d2a 0 2024-09-21T11:39:14.184 INFO:tasks.workunit.client.1.smithi149.stdout:6/531: dread d8/da/d11/f25 [0,4194304] 0 2024-09-21T11:39:14.187 INFO:tasks.workunit.client.0.smithi118.stdout:4/126: unlink d2/d6/dd/l1f 0 2024-09-21T11:39:14.187 INFO:tasks.workunit.client.1.smithi149.stdout:7/696: creat d12/d90/d4a/d6c/fd5 x:0 0 0 2024-09-21T11:39:14.190 INFO:tasks.workunit.client.1.smithi149.stdout:1/546: dwrite d2/dd/d2e/f77 [4194304,4194304] 0 2024-09-21T11:39:14.190 INFO:tasks.workunit.client.1.smithi149.stdout:0/528: stat dd/d1a/d1b/d50/d53/d3a 0 2024-09-21T11:39:14.192 INFO:tasks.workunit.client.0.smithi118.stdout:1/128: rename d6/de/f10 to d6/de/d21/f23 0 2024-09-21T11:39:14.192 INFO:tasks.workunit.client.1.smithi149.stdout:6/532: write d8/da/f4e [563010,46333] 0 2024-09-21T11:39:14.192 INFO:tasks.workunit.client.0.smithi118.stdout:1/129: chown d6/de/d16/c1b 60 1 2024-09-21T11:39:14.194 INFO:tasks.workunit.client.0.smithi118.stdout:8/327: chown d2/f29 4781 1 2024-09-21T11:39:14.200 INFO:tasks.workunit.client.0.smithi118.stdout:9/142: fdatasync d0/d4/f15 0 2024-09-21T11:39:14.203 INFO:tasks.workunit.client.0.smithi118.stdout:2/96: dwrite de/f14 [0,4194304] 0 2024-09-21T11:39:14.204 INFO:tasks.workunit.client.0.smithi118.stdout:4/127: unlink d2/d6/dd/l1d 0 2024-09-21T11:39:14.204 INFO:tasks.workunit.client.1.smithi149.stdout:7/697: symlink d12/d90/d4a/d6c/da0/dbb/ld6 0 2024-09-21T11:39:14.205 INFO:tasks.workunit.client.1.smithi149.stdout:7/698: dread - d12/d90/d4a/d6c/fd5 zero size 2024-09-21T11:39:14.206 INFO:tasks.workunit.client.0.smithi118.stdout:0/308: rename d5/d10/d1e/d33/l39 to d5/d10/d1e/d21/l69 0 2024-09-21T11:39:14.207 INFO:tasks.workunit.client.0.smithi118.stdout:0/309: dread - d5/f5c zero size 2024-09-21T11:39:14.208 INFO:tasks.workunit.client.0.smithi118.stdout:8/328: creat d2/dc/d10/d3b/f6d x:0 0 0 2024-09-21T11:39:14.209 INFO:tasks.workunit.client.1.smithi149.stdout:6/533: read d8/da/fc [2951349,47934] 0 2024-09-21T11:39:14.212 INFO:tasks.workunit.client.1.smithi149.stdout:1/547: dwrite d2/dd/d35/d1c/f39 [0,4194304] 0 2024-09-21T11:39:14.213 INFO:tasks.workunit.client.1.smithi149.stdout:8/529: sync 2024-09-21T11:39:14.215 INFO:tasks.workunit.client.1.smithi149.stdout:7/699: stat d12/d90/d68/dc4/l95 0 2024-09-21T11:39:14.217 INFO:tasks.workunit.client.1.smithi149.stdout:8/530: write d3/dd/d18/f68 [1401414,30918] 0 2024-09-21T11:39:14.218 INFO:tasks.workunit.client.0.smithi118.stdout:8/329: dwrite d2/dc/d10/d3b/f6d [0,4194304] 0 2024-09-21T11:39:14.219 INFO:tasks.workunit.client.0.smithi118.stdout:2/97: mkdir de/d1f/d23 0 2024-09-21T11:39:14.231 INFO:tasks.workunit.client.1.smithi149.stdout:8/531: creat d3/d3c/d8f/fb5 x:0 0 0 2024-09-21T11:39:14.232 INFO:tasks.workunit.client.1.smithi149.stdout:6/534: symlink d8/da/d3d/lb0 0 2024-09-21T11:39:14.238 INFO:tasks.workunit.client.0.smithi118.stdout:6/137: write d8/f11 [103031,21100] 0 2024-09-21T11:39:14.242 INFO:tasks.workunit.client.1.smithi149.stdout:7/700: dwrite d12/d90/f32 [0,4194304] 0 2024-09-21T11:39:14.242 INFO:tasks.workunit.client.1.smithi149.stdout:5/658: truncate d4/d1d/d50/d54/f23 6013536 0 2024-09-21T11:39:14.244 INFO:tasks.workunit.client.0.smithi118.stdout:6/138: dwrite d8/f1a [4194304,4194304] 0 2024-09-21T11:39:14.245 INFO:tasks.workunit.client.1.smithi149.stdout:8/532: mknod d3/dd/d21/cb6 0 2024-09-21T11:39:14.246 INFO:tasks.workunit.client.1.smithi149.stdout:1/548: dread d2/d2b/d6e/f6f [0,4194304] 0 2024-09-21T11:39:14.247 INFO:tasks.workunit.client.1.smithi149.stdout:6/535: unlink d8/da/d2c/f68 0 2024-09-21T11:39:14.249 INFO:tasks.workunit.client.0.smithi118.stdout:3/121: rename d5/l26 to d5/d28/l2d 0 2024-09-21T11:39:14.251 INFO:tasks.workunit.client.1.smithi149.stdout:4/633: sync 2024-09-21T11:39:14.252 INFO:tasks.workunit.client.0.smithi118.stdout:0/310: mknod d5/c6a 0 2024-09-21T11:39:14.255 INFO:tasks.workunit.client.0.smithi118.stdout:9/143: creat d0/f3a x:0 0 0 2024-09-21T11:39:14.256 INFO:tasks.workunit.client.1.smithi149.stdout:5/659: unlink d4/d1d/d50/f8b 0 2024-09-21T11:39:14.259 INFO:tasks.workunit.client.1.smithi149.stdout:9/590: write d18/d19/d29/f68 [341014,127801] 0 2024-09-21T11:39:14.261 INFO:tasks.workunit.client.1.smithi149.stdout:4/634: chown d4/d4d/d5f/d71/f8d 203085 1 2024-09-21T11:39:14.262 INFO:tasks.workunit.client.1.smithi149.stdout:8/533: dwrite d3/dd/d18/d2e/d80/fa1 [0,4194304] 0 2024-09-21T11:39:14.265 INFO:tasks.workunit.client.0.smithi118.stdout:1/130: getdents d6/de/d13 0 2024-09-21T11:39:14.265 INFO:tasks.workunit.client.0.smithi118.stdout:0/311: dread d5/d10/d1e/d21/d2a/f45 [0,4194304] 0 2024-09-21T11:39:14.266 INFO:tasks.workunit.client.1.smithi149.stdout:0/529: truncate dd/d32/f6b 1217319 0 2024-09-21T11:39:14.267 INFO:tasks.workunit.client.1.smithi149.stdout:6/536: rename d8/d32/d37/d2b/d51/l54 to d8/d32/d37/d28/d2e/lb1 0 2024-09-21T11:39:14.269 INFO:tasks.workunit.client.0.smithi118.stdout:3/122: rename d5/f8 to d5/d1d/f2e 0 2024-09-21T11:39:14.272 INFO:tasks.workunit.client.1.smithi149.stdout:5/660: symlink d4/d7/d40/d43/d5c/ld4 0 2024-09-21T11:39:14.272 INFO:tasks.workunit.client.1.smithi149.stdout:7/701: dwrite d12/d90/d4a/f93 [0,4194304] 0 2024-09-21T11:39:14.272 INFO:tasks.workunit.client.1.smithi149.stdout:6/537: stat d8/da/d14/l83 0 2024-09-21T11:39:14.276 INFO:tasks.workunit.client.1.smithi149.stdout:6/538: dread - d8/d32/d37/d2b/d51/f62 zero size 2024-09-21T11:39:14.276 INFO:tasks.workunit.client.1.smithi149.stdout:7/702: chown d12/d90/d4a/d9e/l62 1230215 1 2024-09-21T11:39:14.280 INFO:tasks.workunit.client.0.smithi118.stdout:8/330: dwrite d2/d32/f3c [4194304,4194304] 0 2024-09-21T11:39:14.281 INFO:tasks.workunit.client.0.smithi118.stdout:4/128: getdents d2 0 2024-09-21T11:39:14.282 INFO:tasks.workunit.client.1.smithi149.stdout:4/635: creat d4/d6/d63/d15/d30/d6b/db3/fe4 x:0 0 0 2024-09-21T11:39:14.283 INFO:tasks.workunit.client.1.smithi149.stdout:8/534: rename d3/dd/l26 to d3/d12/lb7 0 2024-09-21T11:39:14.284 INFO:tasks.workunit.client.0.smithi118.stdout:1/131: mknod d6/de/c24 0 2024-09-21T11:39:14.284 INFO:tasks.workunit.client.0.smithi118.stdout:8/331: fdatasync d2/dc/d16/d46/d4c/d63/f4a 0 2024-09-21T11:39:14.285 INFO:tasks.workunit.client.1.smithi149.stdout:5/661: dread d4/d7/f38 [0,4194304] 0 2024-09-21T11:39:14.286 INFO:tasks.workunit.client.0.smithi118.stdout:3/123: dread d5/f17 [0,4194304] 0 2024-09-21T11:39:14.286 INFO:tasks.workunit.client.0.smithi118.stdout:1/132: chown d6/de/c24 6114117 1 2024-09-21T11:39:14.288 INFO:tasks.workunit.client.0.smithi118.stdout:0/312: mkdir d5/d34/d6b 0 2024-09-21T11:39:14.289 INFO:tasks.workunit.client.1.smithi149.stdout:6/539: chown d8/da/d2c/d52/d5e/d69/l76 0 1 2024-09-21T11:39:14.290 INFO:tasks.workunit.client.1.smithi149.stdout:5/662: readlink d4/d7/d40/d51/d56/l99 0 2024-09-21T11:39:14.290 INFO:tasks.workunit.client.0.smithi118.stdout:0/313: fsync d5/d34/f55 0 2024-09-21T11:39:14.293 INFO:tasks.workunit.client.0.smithi118.stdout:9/144: symlink d0/l3b 0 2024-09-21T11:39:14.294 INFO:tasks.workunit.client.1.smithi149.stdout:5/663: write d4/d1d/d50/d54/d2a/fa2 [1647204,51876] 0 2024-09-21T11:39:14.297 INFO:tasks.workunit.client.0.smithi118.stdout:8/332: dread d2/d32/f3c [0,4194304] 0 2024-09-21T11:39:14.297 INFO:tasks.workunit.client.0.smithi118.stdout:3/124: dread d5/d1d/f23 [0,4194304] 0 2024-09-21T11:39:14.298 INFO:tasks.workunit.client.0.smithi118.stdout:4/129: symlink d2/d6/de/l32 0 2024-09-21T11:39:14.298 INFO:tasks.workunit.client.1.smithi149.stdout:0/530: dread dd/d2d/f7f [0,4194304] 0 2024-09-21T11:39:14.299 INFO:tasks.workunit.client.0.smithi118.stdout:1/133: dwrite d6/de/f22 [0,4194304] 0 2024-09-21T11:39:14.299 INFO:tasks.workunit.client.1.smithi149.stdout:1/549: write d2/dd/d35/d1c/f39 [4731354,121334] 0 2024-09-21T11:39:14.302 INFO:tasks.workunit.client.0.smithi118.stdout:6/139: dread d8/fc [0,4194304] 0 2024-09-21T11:39:14.302 INFO:tasks.workunit.client.1.smithi149.stdout:3/634: sync 2024-09-21T11:39:14.302 INFO:tasks.workunit.client.1.smithi149.stdout:2/730: sync 2024-09-21T11:39:14.303 INFO:tasks.workunit.client.1.smithi149.stdout:6/540: creat d8/d32/d64/d97/fb2 x:0 0 0 2024-09-21T11:39:14.303 INFO:tasks.workunit.client.0.smithi118.stdout:6/140: write d8/d14/d28/f2a [494317,22747] 0 2024-09-21T11:39:14.306 INFO:tasks.workunit.client.1.smithi149.stdout:6/541: fdatasync d8/d32/f46 0 2024-09-21T11:39:14.308 INFO:tasks.workunit.client.1.smithi149.stdout:9/591: rename d18/d19/d1a/d2f/d53/l57 to d18/d19/d1a/d2f/d5f/lbc 0 2024-09-21T11:39:14.309 INFO:tasks.workunit.client.0.smithi118.stdout:0/314: mknod d5/d34/c6c 0 2024-09-21T11:39:14.312 INFO:tasks.workunit.client.0.smithi118.stdout:9/145: creat d0/d20/f3c x:0 0 0 2024-09-21T11:39:14.312 INFO:tasks.workunit.client.1.smithi149.stdout:8/535: mkdir d3/d33/d34/d55/d95/db8 0 2024-09-21T11:39:14.313 INFO:tasks.workunit.client.1.smithi149.stdout:3/635: write d6/d1f/d47/f84 [3487519,76225] 0 2024-09-21T11:39:14.313 INFO:tasks.workunit.client.0.smithi118.stdout:2/98: truncate de/d16/d1c/f1d 7532872 0 2024-09-21T11:39:14.314 INFO:tasks.workunit.client.1.smithi149.stdout:4/636: dread d4/d6/d63/d2d/dd6/d32/d4a/f85 [0,4194304] 0 2024-09-21T11:39:14.317 INFO:tasks.workunit.client.1.smithi149.stdout:6/542: truncate d8/d32/d37/d2b/d51/f5a 1615036 0 2024-09-21T11:39:14.319 INFO:tasks.workunit.client.0.smithi118.stdout:3/125: symlink d5/d1d/d1b/d24/l2f 0 2024-09-21T11:39:14.321 INFO:tasks.workunit.client.0.smithi118.stdout:8/333: chown d2/dc/d10/d2e/d18/l5a 15174234 1 2024-09-21T11:39:14.323 INFO:tasks.workunit.client.0.smithi118.stdout:1/134: readlink d6/de/d13/l20 0 2024-09-21T11:39:14.323 INFO:tasks.workunit.client.0.smithi118.stdout:1/135: chown c2 47279 1 2024-09-21T11:39:14.323 INFO:tasks.workunit.client.1.smithi149.stdout:6/543: write d8/da/d14/f4c [279455,105571] 0 2024-09-21T11:39:14.323 INFO:tasks.workunit.client.0.smithi118.stdout:1/136: readlink d6/l18 0 2024-09-21T11:39:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:14 smithi118 ceph-mon[28757]: pgmap v22: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 174 MiB/s wr, 295 op/s 2024-09-21T11:39:14.326 INFO:tasks.workunit.client.1.smithi149.stdout:1/550: dwrite d2/dd/d2e/f33 [0,4194304] 0 2024-09-21T11:39:14.327 INFO:tasks.workunit.client.1.smithi149.stdout:5/664: dwrite d4/d7/d40/d43/d5c/d7a/fbe [4194304,4194304] 0 2024-09-21T11:39:14.327 INFO:tasks.workunit.client.1.smithi149.stdout:0/531: rename dd/d1a/d1b/d50/d53/d3a/d66/l8f to dd/d1a/d1b/d50/d53/lb0 0 2024-09-21T11:39:14.329 INFO:tasks.workunit.client.1.smithi149.stdout:7/703: truncate d12/d90/d4a/d6c/d8c/daa/fc6 179895 0 2024-09-21T11:39:14.331 INFO:tasks.workunit.client.1.smithi149.stdout:2/731: dwrite d8/d44/d63/db9/f4b [0,4194304] 0 2024-09-21T11:39:14.333 INFO:tasks.workunit.client.0.smithi118.stdout:0/315: fdatasync d5/d10/d1e/d20/f2f 0 2024-09-21T11:39:14.335 INFO:tasks.workunit.client.1.smithi149.stdout:9/592: symlink d18/d19/d1a/d2f/d30/d90/lbd 0 2024-09-21T11:39:14.337 INFO:tasks.workunit.client.1.smithi149.stdout:0/532: stat dd/d35/l58 0 2024-09-21T11:39:14.338 INFO:tasks.workunit.client.0.smithi118.stdout:9/146: rename d0/d4/f1f to d0/d4/f3d 0 2024-09-21T11:39:14.339 INFO:tasks.workunit.client.1.smithi149.stdout:4/637: fsync d4/d6/d63/d10/f86 0 2024-09-21T11:39:14.341 INFO:tasks.workunit.client.1.smithi149.stdout:4/638: chown d4/d6/d63/d15/d30/d8a/cbf 6084851 1 2024-09-21T11:39:14.344 INFO:tasks.workunit.client.1.smithi149.stdout:8/536: rename d3/dd/d21/d54/d5c/d6d to d3/dd/d18/d2e/db9 0 2024-09-21T11:39:14.347 INFO:tasks.workunit.client.0.smithi118.stdout:9/147: dwrite d0/fb [0,4194304] 0 2024-09-21T11:39:14.349 INFO:tasks.workunit.client.0.smithi118.stdout:8/334: unlink d2/dc/d16/d46/d4c/d63/l60 0 2024-09-21T11:39:14.350 INFO:tasks.workunit.client.0.smithi118.stdout:2/99: dwrite de/f19 [0,4194304] 0 2024-09-21T11:39:14.350 INFO:tasks.workunit.client.0.smithi118.stdout:8/335: stat d2/dc/d10/d2e/l19 0 2024-09-21T11:39:14.352 INFO:tasks.workunit.client.0.smithi118.stdout:1/137: creat d6/de/f25 x:0 0 0 2024-09-21T11:39:14.353 INFO:tasks.workunit.client.0.smithi118.stdout:1/138: stat d6/d1f 0 2024-09-21T11:39:14.356 INFO:tasks.workunit.client.0.smithi118.stdout:8/336: dread d2/dc/d10/d3b/f6d [0,4194304] 0 2024-09-21T11:39:14.357 INFO:tasks.workunit.client.1.smithi149.stdout:9/593: mkdir d18/d36/d3c/d47/d99/dbe 0 2024-09-21T11:39:14.357 INFO:tasks.workunit.client.0.smithi118.stdout:0/316: symlink d5/d34/l6d 0 2024-09-21T11:39:14.358 INFO:tasks.workunit.client.1.smithi149.stdout:9/594: dread - d18/d4c/d5b/f9a zero size 2024-09-21T11:39:14.361 INFO:tasks.workunit.client.1.smithi149.stdout:7/704: dwrite d12/f74 [0,4194304] 0 2024-09-21T11:39:14.371 INFO:tasks.workunit.client.1.smithi149.stdout:1/551: rename d2/dd/f30 to d2/dd/d35/d7c/fb4 0 2024-09-21T11:39:14.374 INFO:tasks.workunit.client.0.smithi118.stdout:2/100: fsync de/f15 0 2024-09-21T11:39:14.378 INFO:tasks.workunit.client.1.smithi149.stdout:9/595: creat d18/d19/d29/fbf x:0 0 0 2024-09-21T11:39:14.380 INFO:tasks.workunit.client.1.smithi149.stdout:9/596: dread - d18/d19/d1a/d2f/d30/d90/fb7 zero size 2024-09-21T11:39:14.381 INFO:tasks.workunit.client.0.smithi118.stdout:1/139: rename d6/de/d13/l20 to d6/d1f/l26 0 2024-09-21T11:39:14.381 INFO:tasks.workunit.client.0.smithi118.stdout:2/101: dwrite de/f14 [4194304,4194304] 0 2024-09-21T11:39:14.381 INFO:tasks.workunit.client.1.smithi149.stdout:7/705: creat d12/d5b/db5/fd7 x:0 0 0 2024-09-21T11:39:14.383 INFO:tasks.workunit.client.0.smithi118.stdout:0/317: creat d5/d10/d1e/f6e x:0 0 0 2024-09-21T11:39:14.385 INFO:tasks.workunit.client.1.smithi149.stdout:3/636: sync 2024-09-21T11:39:14.386 INFO:tasks.workunit.client.0.smithi118.stdout:4/130: creat d2/d6/dd/f33 x:0 0 0 2024-09-21T11:39:14.388 INFO:tasks.workunit.client.0.smithi118.stdout:1/140: dwrite d6/f15 [0,4194304] 0 2024-09-21T11:39:14.389 INFO:tasks.workunit.client.0.smithi118.stdout:3/126: creat d5/f30 x:0 0 0 2024-09-21T11:39:14.390 INFO:tasks.workunit.client.0.smithi118.stdout:3/127: chown d5/d28 156 1 2024-09-21T11:39:14.390 INFO:tasks.workunit.client.0.smithi118.stdout:0/318: dread d5/f15 [0,4194304] 0 2024-09-21T11:39:14.392 INFO:tasks.workunit.client.0.smithi118.stdout:9/148: mknod d0/c3e 0 2024-09-21T11:39:14.393 INFO:tasks.workunit.client.1.smithi149.stdout:6/544: rename d8/da/fc to d8/da/d2c/d2d/d9a/fb3 0 2024-09-21T11:39:14.393 INFO:tasks.workunit.client.1.smithi149.stdout:0/533: dwrite dd/d1a/d1b/d72/d85/d8c/f89 [0,4194304] 0 2024-09-21T11:39:14.394 INFO:tasks.workunit.client.1.smithi149.stdout:6/545: stat d8/d32/d37/d2b/d7d/f9f 0 2024-09-21T11:39:14.394 INFO:tasks.workunit.client.1.smithi149.stdout:1/552: symlink d2/dd/d35/d1c/d37/lb5 0 2024-09-21T11:39:14.395 INFO:tasks.workunit.client.1.smithi149.stdout:2/732: truncate d8/da/d13/f2e 95445 0 2024-09-21T11:39:14.396 INFO:tasks.workunit.client.0.smithi118.stdout:1/141: dwrite d6/de/f22 [0,4194304] 0 2024-09-21T11:39:14.396 INFO:tasks.workunit.client.1.smithi149.stdout:1/553: chown d2/dd/d35/d1c/d2c/f97 8362 1 2024-09-21T11:39:14.398 INFO:tasks.workunit.client.1.smithi149.stdout:8/537: write d3/d12/f15 [2709602,68207] 0 2024-09-21T11:39:14.399 INFO:tasks.workunit.client.1.smithi149.stdout:1/554: stat d2/dd/d35/d1c/d41/d51/d90/f91 0 2024-09-21T11:39:14.408 INFO:tasks.workunit.client.1.smithi149.stdout:3/637: mkdir d6/d5f/d60/d88/de7 0 2024-09-21T11:39:14.412 INFO:tasks.workunit.client.1.smithi149.stdout:6/546: dwrite d8/d32/d64/d97/fb2 [0,4194304] 0 2024-09-21T11:39:14.413 INFO:tasks.workunit.client.1.smithi149.stdout:4/639: rename d4/d6/d63/d2d/dd6/d32/c3f to d4/d6/d63/d15/d30/d8a/da7/ce5 0 2024-09-21T11:39:14.414 INFO:tasks.workunit.client.0.smithi118.stdout:4/131: mknod d2/d6/de/d1c/c34 0 2024-09-21T11:39:14.421 INFO:tasks.workunit.client.1.smithi149.stdout:0/534: readlink dd/d6a/la2 0 2024-09-21T11:39:14.421 INFO:tasks.workunit.client.0.smithi118.stdout:4/132: dwrite d2/f2d [0,4194304] 0 2024-09-21T11:39:14.423 INFO:tasks.workunit.client.0.smithi118.stdout:0/319: rename d5/d34/c6c to d5/d10/d1e/d21/d2a/d48/c6f 0 2024-09-21T11:39:14.424 INFO:tasks.workunit.client.1.smithi149.stdout:7/706: creat d12/d90/d4a/d4f/d75/d94/d47/dab/fd8 x:0 0 0 2024-09-21T11:39:14.426 INFO:tasks.workunit.client.0.smithi118.stdout:9/149: mknod d0/d20/c3f 0 2024-09-21T11:39:14.429 INFO:tasks.workunit.client.0.smithi118.stdout:1/142: creat d6/de/f27 x:0 0 0 2024-09-21T11:39:14.430 INFO:tasks.workunit.client.1.smithi149.stdout:2/733: rename d8/da/d13/d1a/d29/f32 to d8/da/d13/d2d/d6f/de8/dff/f102 0 2024-09-21T11:39:14.431 INFO:tasks.workunit.client.0.smithi118.stdout:1/143: dread d6/de/d13/f1c [0,4194304] 0 2024-09-21T11:39:14.432 INFO:tasks.workunit.client.0.smithi118.stdout:2/102: symlink de/d1f/d23/l24 0 2024-09-21T11:39:14.438 INFO:tasks.workunit.client.1.smithi149.stdout:1/555: dwrite d2/d5/f6c [0,4194304] 0 2024-09-21T11:39:14.439 INFO:tasks.workunit.client.0.smithi118.stdout:0/320: chown d5/l16 129860 1 2024-09-21T11:39:14.439 INFO:tasks.workunit.client.1.smithi149.stdout:0/535: write dd/d2d/f91 [958821,52040] 0 2024-09-21T11:39:14.440 INFO:tasks.workunit.client.1.smithi149.stdout:7/707: readlink d12/d90/l24 0 2024-09-21T11:39:14.440 INFO:tasks.workunit.client.1.smithi149.stdout:5/665: dwrite d4/d7/f31 [4194304,4194304] 0 2024-09-21T11:39:14.441 INFO:tasks.workunit.client.1.smithi149.stdout:3/638: creat d6/d79/d7e/ddd/fe8 x:0 0 0 2024-09-21T11:39:14.442 INFO:tasks.workunit.client.0.smithi118.stdout:9/150: rename d0/c3e to d0/d4/d23/c40 0 2024-09-21T11:39:14.444 INFO:tasks.workunit.client.1.smithi149.stdout:9/597: dwrite d18/d1c/f46 [4194304,4194304] 0 2024-09-21T11:39:14.447 INFO:tasks.workunit.client.0.smithi118.stdout:1/144: creat d6/de/d21/f28 x:0 0 0 2024-09-21T11:39:14.448 INFO:tasks.workunit.client.0.smithi118.stdout:1/145: readlink d6/l18 0 2024-09-21T11:39:14.450 INFO:tasks.workunit.client.0.smithi118.stdout:2/103: mkdir de/d16/d25 0 2024-09-21T11:39:14.450 INFO:tasks.workunit.client.1.smithi149.stdout:5/666: dread - d4/d1d/d50/d60/fb7 zero size 2024-09-21T11:39:14.450 INFO:tasks.workunit.client.1.smithi149.stdout:4/640: write d4/d6/d18/f4f [1830349,115593] 0 2024-09-21T11:39:14.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:14 smithi149 ceph-mon[36123]: pgmap v22: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 174 MiB/s wr, 295 op/s 2024-09-21T11:39:14.451 INFO:tasks.workunit.client.1.smithi149.stdout:6/547: link d8/d32/d37/d28/d2e/l40 d8/d32/d37/d28/d2f/lb4 0 2024-09-21T11:39:14.452 INFO:tasks.workunit.client.0.smithi118.stdout:3/128: creat d5/f31 x:0 0 0 2024-09-21T11:39:14.454 INFO:tasks.workunit.client.1.smithi149.stdout:0/536: symlink dd/d1a/d1b/d81/d97/lb1 0 2024-09-21T11:39:14.455 INFO:tasks.workunit.client.1.smithi149.stdout:1/556: fsync d2/dd/d35/d1c/d2c/f97 0 2024-09-21T11:39:14.456 INFO:tasks.workunit.client.0.smithi118.stdout:0/321: dread d5/d10/d1e/f27 [0,4194304] 0 2024-09-21T11:39:14.457 INFO:tasks.workunit.client.0.smithi118.stdout:1/146: dwrite d6/de/f27 [0,4194304] 0 2024-09-21T11:39:14.459 INFO:tasks.workunit.client.0.smithi118.stdout:1/147: readlink d6/l18 0 2024-09-21T11:39:14.462 INFO:tasks.workunit.client.1.smithi149.stdout:9/598: unlink d18/d19/d1a/d2f/d53/l81 0 2024-09-21T11:39:14.463 INFO:tasks.workunit.client.0.smithi118.stdout:4/133: mkdir d2/d6/dd/d35 0 2024-09-21T11:39:14.463 INFO:tasks.workunit.client.0.smithi118.stdout:4/134: fsync d2/fc 0 2024-09-21T11:39:14.464 INFO:tasks.workunit.client.1.smithi149.stdout:5/667: rmdir d4/d7/d40/d43/d85 39 2024-09-21T11:39:14.464 INFO:tasks.workunit.client.0.smithi118.stdout:4/135: chown d2 244284 1 2024-09-21T11:39:14.465 INFO:tasks.workunit.client.0.smithi118.stdout:4/136: read - d2/d6/de/d1c/d23/f2c zero size 2024-09-21T11:39:14.470 INFO:tasks.workunit.client.0.smithi118.stdout:3/129: unlink d5/d1d/fa 0 2024-09-21T11:39:14.470 INFO:tasks.workunit.client.1.smithi149.stdout:1/557: dread d2/d5/d8/f40 [0,4194304] 0 2024-09-21T11:39:14.475 INFO:tasks.workunit.client.0.smithi118.stdout:9/151: write d0/d4/f15 [1038902,126329] 0 2024-09-21T11:39:14.476 INFO:tasks.workunit.client.1.smithi149.stdout:8/538: sync 2024-09-21T11:39:14.479 INFO:tasks.workunit.client.1.smithi149.stdout:2/734: truncate d8/da/d13/d2d/f34 6327979 0 2024-09-21T11:39:14.480 INFO:tasks.workunit.client.1.smithi149.stdout:3/639: dwrite d6/f12 [0,4194304] 0 2024-09-21T11:39:14.482 INFO:tasks.workunit.client.1.smithi149.stdout:9/599: creat d18/d36/d3c/d47/d76/fc0 x:0 0 0 2024-09-21T11:39:14.482 INFO:tasks.workunit.client.1.smithi149.stdout:5/668: symlink d4/d7/d40/d43/d5c/d7a/ld5 0 2024-09-21T11:39:14.482 INFO:tasks.workunit.client.1.smithi149.stdout:7/708: write d12/d90/d4a/d4f/f51 [1208018,8289] 0 2024-09-21T11:39:14.483 INFO:tasks.workunit.client.0.smithi118.stdout:3/130: creat d5/d1d/f32 x:0 0 0 2024-09-21T11:39:14.485 INFO:tasks.workunit.client.0.smithi118.stdout:9/152: fsync d0/f26 0 2024-09-21T11:39:14.487 INFO:tasks.workunit.client.1.smithi149.stdout:7/709: write d12/d90/d4a/d4f/d75/d94/d47/d49/fad [4874960,90608] 0 2024-09-21T11:39:14.489 INFO:tasks.workunit.client.1.smithi149.stdout:0/537: mkdir dd/d32/db2 0 2024-09-21T11:39:14.491 INFO:tasks.workunit.client.0.smithi118.stdout:9/153: dwrite d0/f5 [4194304,4194304] 0 2024-09-21T11:39:14.495 INFO:tasks.workunit.client.1.smithi149.stdout:8/539: creat d3/d33/d34/d72/fba x:0 0 0 2024-09-21T11:39:14.498 INFO:tasks.workunit.client.1.smithi149.stdout:2/735: creat d8/dd/d50/f103 x:0 0 0 2024-09-21T11:39:14.500 INFO:tasks.workunit.client.0.smithi118.stdout:0/322: creat d5/f70 x:0 0 0 2024-09-21T11:39:14.502 INFO:tasks.workunit.client.1.smithi149.stdout:3/640: rename d6/d1f/d47/dbb/fe4 to d6/d1f/de5/fe9 0 2024-09-21T11:39:14.503 INFO:tasks.workunit.client.1.smithi149.stdout:3/641: chown d6/d1f/d47/d37/dd6/fba 655360 1 2024-09-21T11:39:14.503 INFO:tasks.workunit.client.1.smithi149.stdout:6/548: truncate d8/d32/d64/d97/fb2 2403293 0 2024-09-21T11:39:14.503 INFO:tasks.workunit.client.0.smithi118.stdout:0/323: dread d5/d10/d1e/f27 [0,4194304] 0 2024-09-21T11:39:14.504 INFO:tasks.workunit.client.1.smithi149.stdout:3/642: readlink d6/d1f/d4c/ld0 0 2024-09-21T11:39:14.504 INFO:tasks.workunit.client.1.smithi149.stdout:5/669: write d4/d7/f45 [935467,33670] 0 2024-09-21T11:39:14.505 INFO:tasks.workunit.client.1.smithi149.stdout:3/643: chown d6/d1f/d47/f77 0 1 2024-09-21T11:39:14.506 INFO:tasks.workunit.client.1.smithi149.stdout:1/558: mknod d2/dd/d35/d1c/d37/da3/cb6 0 2024-09-21T11:39:14.509 INFO:tasks.workunit.client.0.smithi118.stdout:1/148: dwrite d6/f1e [0,4194304] 0 2024-09-21T11:39:14.510 INFO:tasks.workunit.client.0.smithi118.stdout:2/104: link de/d16/d1c/c21 de/d16/d25/c26 0 2024-09-21T11:39:14.510 INFO:tasks.workunit.client.0.smithi118.stdout:1/149: readlink d6/l7 0 2024-09-21T11:39:14.515 INFO:tasks.workunit.client.1.smithi149.stdout:4/641: getdents d4/d4d/d58 0 2024-09-21T11:39:14.517 INFO:tasks.workunit.client.0.smithi118.stdout:1/150: dwrite d6/de/d21/f28 [0,4194304] 0 2024-09-21T11:39:14.518 INFO:tasks.workunit.client.1.smithi149.stdout:4/642: chown d4/d6/d63/d15/d16/d23/cab 2875 1 2024-09-21T11:39:14.519 INFO:tasks.workunit.client.1.smithi149.stdout:4/643: read - d4/d6/d63/d2d/dd6/d32/fa4 zero size 2024-09-21T11:39:14.519 INFO:tasks.workunit.client.1.smithi149.stdout:2/736: creat d8/dd/d5c/d84/f104 x:0 0 0 2024-09-21T11:39:14.521 INFO:tasks.workunit.client.1.smithi149.stdout:2/737: read d8/dd/d50/fd2 [429670,107] 0 2024-09-21T11:39:14.521 INFO:tasks.workunit.client.1.smithi149.stdout:4/644: chown d4/d6/d63/d15/d30/cde 116858 1 2024-09-21T11:39:14.523 INFO:tasks.workunit.client.1.smithi149.stdout:7/710: rename d12/d90/d4a/d4f/d75/d94/d47/d49/c8b to d12/d90/d4a/d6c/d8c/cd9 0 2024-09-21T11:39:14.524 INFO:tasks.workunit.client.0.smithi118.stdout:4/137: getdents d2/d6/de/d1c/d23/d26 0 2024-09-21T11:39:14.528 INFO:tasks.workunit.client.0.smithi118.stdout:9/154: mkdir d0/d4/d38/d41 0 2024-09-21T11:39:14.529 INFO:tasks.workunit.client.0.smithi118.stdout:9/155: dread - d0/d4/d23/f36 zero size 2024-09-21T11:39:14.530 INFO:tasks.workunit.client.1.smithi149.stdout:3/644: symlink d6/d1f/d47/d37/d3f/dc5/lea 0 2024-09-21T11:39:14.531 INFO:tasks.workunit.client.0.smithi118.stdout:1/151: rmdir d6/de/d16 39 2024-09-21T11:39:14.532 INFO:tasks.workunit.client.1.smithi149.stdout:1/559: mknod d2/dd/d35/d1c/d37/cb7 0 2024-09-21T11:39:14.532 INFO:tasks.workunit.client.1.smithi149.stdout:5/670: dread d4/d4f/f7f [0,4194304] 0 2024-09-21T11:39:14.534 INFO:tasks.workunit.client.1.smithi149.stdout:5/671: read d4/d7/d40/f65 [525959,108596] 0 2024-09-21T11:39:14.536 INFO:tasks.workunit.client.0.smithi118.stdout:0/324: dwrite d5/d10/d1e/d20/f2f [0,4194304] 0 2024-09-21T11:39:14.537 INFO:tasks.workunit.client.0.smithi118.stdout:9/156: stat d0/d4/f3d 0 2024-09-21T11:39:14.538 INFO:tasks.workunit.client.0.smithi118.stdout:1/152: dread d6/de/f27 [0,4194304] 0 2024-09-21T11:39:14.539 INFO:tasks.workunit.client.0.smithi118.stdout:9/157: fsync d0/f5 0 2024-09-21T11:39:14.542 INFO:tasks.workunit.client.1.smithi149.stdout:9/600: truncate d18/d1c/f46 7748076 0 2024-09-21T11:39:14.544 INFO:tasks.workunit.client.1.smithi149.stdout:0/538: truncate dd/d1a/d1b/d50/d53/d3a/f5b 4242542 0 2024-09-21T11:39:14.544 INFO:tasks.workunit.client.0.smithi118.stdout:4/138: mknod d2/d6/de/d1c/d23/d26/d31/c36 0 2024-09-21T11:39:14.546 INFO:tasks.workunit.client.1.smithi149.stdout:2/738: symlink d8/dd/d8c/l105 0 2024-09-21T11:39:14.546 INFO:tasks.workunit.client.0.smithi118.stdout:4/139: truncate d2/d6/de/d1c/d23/f2c 480258 0 2024-09-21T11:39:14.548 INFO:tasks.workunit.client.1.smithi149.stdout:4/645: read d4/d6/d63/d15/f54 [1088096,31660] 0 2024-09-21T11:39:14.550 INFO:tasks.workunit.client.1.smithi149.stdout:8/540: rename d3/d33/d34/d55/d95/db8 to d3/d33/d34/d72/dbb 0 2024-09-21T11:39:14.551 INFO:tasks.workunit.client.0.smithi118.stdout:9/158: dread d0/f26 [0,4194304] 0 2024-09-21T11:39:14.551 INFO:tasks.workunit.client.1.smithi149.stdout:6/549: truncate d8/da/d14/f31 2648331 0 2024-09-21T11:39:14.552 INFO:tasks.workunit.client.0.smithi118.stdout:9/159: chown d0/d20/l2d 4097 1 2024-09-21T11:39:14.553 INFO:tasks.workunit.client.1.smithi149.stdout:6/550: fsync d8/d32/d37/f3c 0 2024-09-21T11:39:14.554 INFO:tasks.workunit.client.1.smithi149.stdout:7/711: dwrite d12/d90/db8/fca [0,4194304] 0 2024-09-21T11:39:14.556 INFO:tasks.workunit.client.0.smithi118.stdout:1/153: creat d6/de/d16/f29 x:0 0 0 2024-09-21T11:39:14.557 INFO:tasks.workunit.client.1.smithi149.stdout:1/560: unlink d2/d5/d65/fa2 0 2024-09-21T11:39:14.563 INFO:tasks.workunit.client.0.smithi118.stdout:3/131: getdents d5/d1d/d1b/d24 0 2024-09-21T11:39:14.564 INFO:tasks.workunit.client.1.smithi149.stdout:5/672: creat d4/d7/d40/d43/d5c/d7a/d81/fd6 x:0 0 0 2024-09-21T11:39:14.566 INFO:tasks.workunit.client.0.smithi118.stdout:9/160: symlink d0/d4/d23/l42 0 2024-09-21T11:39:14.566 INFO:tasks.workunit.client.1.smithi149.stdout:4/646: dread d4/d6/f47 [0,4194304] 0 2024-09-21T11:39:14.568 INFO:tasks.workunit.client.0.smithi118.stdout:4/140: rename d2/d6/de/l19 to d2/d6/de/d1c/d23/d26/d31/l37 0 2024-09-21T11:39:14.569 INFO:tasks.workunit.client.1.smithi149.stdout:9/601: dread d18/d19/d1a/d2f/d33/d91/f96 [0,4194304] 0 2024-09-21T11:39:14.570 INFO:tasks.workunit.client.1.smithi149.stdout:2/739: creat d8/dd/d5c/f106 x:0 0 0 2024-09-21T11:39:14.571 INFO:tasks.workunit.client.0.smithi118.stdout:3/132: dwrite d5/d1d/f27 [0,4194304] 0 2024-09-21T11:39:14.571 INFO:tasks.workunit.client.1.smithi149.stdout:9/602: fsync d18/d19/d1a/d2f/d43/fb9 0 2024-09-21T11:39:14.572 INFO:tasks.workunit.client.0.smithi118.stdout:4/141: dread d2/d6/de/d1c/d23/f2c [0,4194304] 0 2024-09-21T11:39:14.573 INFO:tasks.workunit.client.1.smithi149.stdout:2/740: write d8/dcb/db8/dd3/ffb [709816,21495] 0 2024-09-21T11:39:14.573 INFO:tasks.workunit.client.0.smithi118.stdout:9/161: symlink d0/d20/l43 0 2024-09-21T11:39:14.575 INFO:tasks.workunit.client.1.smithi149.stdout:0/539: dwrite dd/d2d/f7f [4194304,4194304] 0 2024-09-21T11:39:14.576 INFO:tasks.workunit.client.0.smithi118.stdout:0/325: getdents d5/d10/d1e/d21/d2a/d48 0 2024-09-21T11:39:14.579 INFO:tasks.workunit.client.0.smithi118.stdout:3/133: dwrite d5/d1d/f32 [0,4194304] 0 2024-09-21T11:39:14.585 INFO:tasks.workunit.client.0.smithi118.stdout:0/326: mknod d5/d10/d1e/d23/c71 0 2024-09-21T11:39:14.591 INFO:tasks.workunit.client.0.smithi118.stdout:9/162: rename d0/d20/c3f to d0/c44 0 2024-09-21T11:39:14.592 INFO:tasks.workunit.client.0.smithi118.stdout:9/163: chown d0/f24 2516855 1 2024-09-21T11:39:14.593 INFO:tasks.workunit.client.0.smithi118.stdout:0/327: dwrite d5/d10/d1e/d20/f41 [0,4194304] 0 2024-09-21T11:39:14.595 INFO:tasks.workunit.client.0.smithi118.stdout:3/134: mkdir d5/d28/d33 0 2024-09-21T11:39:14.597 INFO:tasks.workunit.client.0.smithi118.stdout:1/154: dread d6/f8 [0,4194304] 0 2024-09-21T11:39:14.598 INFO:tasks.workunit.client.1.smithi149.stdout:6/551: write d8/d32/f55 [942922,5570] 0 2024-09-21T11:39:14.600 INFO:tasks.workunit.client.0.smithi118.stdout:0/328: creat d5/d10/d1e/d33/f72 x:0 0 0 2024-09-21T11:39:14.601 INFO:tasks.workunit.client.1.smithi149.stdout:9/603: creat d18/d4c/d5b/fc1 x:0 0 0 2024-09-21T11:39:14.602 INFO:tasks.workunit.client.0.smithi118.stdout:9/164: dwrite d0/f3a [0,4194304] 0 2024-09-21T11:39:14.602 INFO:tasks.workunit.client.1.smithi149.stdout:1/561: write d2/dd/d35/d1c/d2c/f5a [638555,108537] 0 2024-09-21T11:39:14.604 INFO:tasks.workunit.client.0.smithi118.stdout:3/135: mknod d5/d1d/d1b/d24/c34 0 2024-09-21T11:39:14.606 INFO:tasks.workunit.client.1.smithi149.stdout:0/540: readlink dd/l13 0 2024-09-21T11:39:14.607 INFO:tasks.workunit.client.1.smithi149.stdout:0/541: chown dd/d1a/d1b/d72/d87/l92 812839 1 2024-09-21T11:39:14.608 INFO:tasks.workunit.client.0.smithi118.stdout:9/165: unlink d0/d4/l2b 0 2024-09-21T11:39:14.609 INFO:tasks.workunit.client.0.smithi118.stdout:9/166: chown d0/f3a 3966 1 2024-09-21T11:39:14.610 INFO:tasks.workunit.client.0.smithi118.stdout:9/167: write d0/d4/f18 [559735,67669] 0 2024-09-21T11:39:14.611 INFO:tasks.workunit.client.1.smithi149.stdout:5/673: creat d4/d4f/dbf/fd7 x:0 0 0 2024-09-21T11:39:14.612 INFO:tasks.workunit.client.1.smithi149.stdout:5/674: stat d4/d7/d40/f59 0 2024-09-21T11:39:14.612 INFO:tasks.workunit.client.0.smithi118.stdout:0/329: getdents d5/d10/d1e/d21/d2a/d48 0 2024-09-21T11:39:14.612 INFO:tasks.workunit.client.1.smithi149.stdout:5/675: fsync d4/d1d/d50/d54/f23 0 2024-09-21T11:39:14.613 INFO:tasks.workunit.client.1.smithi149.stdout:5/676: fsync d4/d7/d40/d51/f58 0 2024-09-21T11:39:14.615 INFO:tasks.workunit.client.1.smithi149.stdout:6/552: mknod d8/d32/d37/cb5 0 2024-09-21T11:39:14.616 INFO:tasks.workunit.client.1.smithi149.stdout:9/604: truncate d18/d19/d1a/f26 3378316 0 2024-09-21T11:39:14.617 INFO:tasks.workunit.client.0.smithi118.stdout:0/330: dread d5/d10/d1e/d20/f2f [0,4194304] 0 2024-09-21T11:39:14.618 INFO:tasks.workunit.client.0.smithi118.stdout:0/331: write d5/d10/d1e/d20/f41 [3621330,94079] 0 2024-09-21T11:39:14.619 INFO:tasks.workunit.client.0.smithi118.stdout:9/168: mkdir d0/d4/d45 0 2024-09-21T11:39:14.621 INFO:tasks.workunit.client.1.smithi149.stdout:2/741: symlink d8/da/d13/d5d/dd7/l107 0 2024-09-21T11:39:14.623 INFO:tasks.workunit.client.0.smithi118.stdout:1/155: getdents d6/de 0 2024-09-21T11:39:14.624 INFO:tasks.workunit.client.1.smithi149.stdout:7/712: creat d12/d90/d4a/d6c/fda x:0 0 0 2024-09-21T11:39:14.625 INFO:tasks.workunit.client.0.smithi118.stdout:3/136: creat d5/f35 x:0 0 0 2024-09-21T11:39:14.632 INFO:tasks.workunit.client.1.smithi149.stdout:5/677: creat d4/d7/d40/d43/d49/d88/fd8 x:0 0 0 2024-09-21T11:39:14.633 INFO:tasks.workunit.client.1.smithi149.stdout:5/678: dread d4/d1d/d50/dc8/fc9 [0,4194304] 0 2024-09-21T11:39:14.634 INFO:tasks.workunit.client.1.smithi149.stdout:5/679: fdatasync d4/d7/d40/d43/d5c/faf 0 2024-09-21T11:39:14.635 INFO:tasks.workunit.client.1.smithi149.stdout:3/645: sync 2024-09-21T11:39:14.635 INFO:tasks.workunit.client.1.smithi149.stdout:9/605: creat d18/d19/d1a/d2f/d53/fc2 x:0 0 0 2024-09-21T11:39:14.636 INFO:tasks.workunit.client.0.smithi118.stdout:1/156: readlink d6/l9 0 2024-09-21T11:39:14.636 INFO:tasks.workunit.client.0.smithi118.stdout:1/157: write f1 [3752866,91551] 0 2024-09-21T11:39:14.638 INFO:tasks.workunit.client.0.smithi118.stdout:3/137: chown d5/d1d/f27 859 1 2024-09-21T11:39:14.639 INFO:tasks.workunit.client.0.smithi118.stdout:0/332: truncate d5/d10/d1e/d20/f2b 1243251 0 2024-09-21T11:39:14.640 INFO:tasks.workunit.client.1.smithi149.stdout:3/646: dwrite d6/fa [0,4194304] 0 2024-09-21T11:39:14.640 INFO:tasks.workunit.client.0.smithi118.stdout:0/333: chown d5/d10/d1e/d21/d2a 562 1 2024-09-21T11:39:14.641 INFO:tasks.workunit.client.1.smithi149.stdout:3/647: write d6/d5f/d60/f82 [2371036,64751] 0 2024-09-21T11:39:14.641 INFO:tasks.workunit.client.0.smithi118.stdout:0/334: write d5/d10/d1e/d23/f25 [4545830,121433] 0 2024-09-21T11:39:14.641 INFO:tasks.workunit.client.1.smithi149.stdout:2/742: rmdir d8/da/d13/d2d 39 2024-09-21T11:39:14.645 INFO:tasks.workunit.client.1.smithi149.stdout:0/542: mkdir dd/db3 0 2024-09-21T11:39:14.646 INFO:tasks.workunit.client.1.smithi149.stdout:1/562: truncate d2/dd/d35/d5b/f6a 2445023 0 2024-09-21T11:39:14.647 INFO:tasks.workunit.client.1.smithi149.stdout:7/713: fsync d12/f1e 0 2024-09-21T11:39:14.651 INFO:tasks.workunit.client.0.smithi118.stdout:9/169: rmdir d0/d4/d38/d41 0 2024-09-21T11:39:14.652 INFO:tasks.workunit.client.1.smithi149.stdout:2/743: fsync d8/dd/d5c/d60/d67/d8a/f96 0 2024-09-21T11:39:14.652 INFO:tasks.workunit.client.0.smithi118.stdout:9/170: dread d0/f24 [0,4194304] 0 2024-09-21T11:39:14.653 INFO:tasks.workunit.client.1.smithi149.stdout:5/680: mknod d4/d1d/d50/d60/db1/cd9 0 2024-09-21T11:39:14.655 INFO:tasks.workunit.client.1.smithi149.stdout:0/543: truncate dd/d1a/f2c 4537081 0 2024-09-21T11:39:14.656 INFO:tasks.workunit.client.0.smithi118.stdout:0/335: mknod d5/d29/d68/c73 0 2024-09-21T11:39:14.658 INFO:tasks.workunit.client.1.smithi149.stdout:6/553: truncate d8/d32/d37/d28/f33 4088411 0 2024-09-21T11:39:14.658 INFO:tasks.workunit.client.0.smithi118.stdout:9/171: rmdir d0/d4/d23 39 2024-09-21T11:39:14.659 INFO:tasks.workunit.client.0.smithi118.stdout:9/172: truncate d0/d4/f15 1553065 0 2024-09-21T11:39:14.660 INFO:tasks.workunit.client.1.smithi149.stdout:3/648: dwrite d6/d79/d7e/fdf [0,4194304] 0 2024-09-21T11:39:14.660 INFO:tasks.workunit.client.0.smithi118.stdout:1/158: rename d6/de/d21 to d6/d2a 0 2024-09-21T11:39:14.661 INFO:tasks.workunit.client.1.smithi149.stdout:3/649: fdatasync d6/fc 0 2024-09-21T11:39:14.661 INFO:tasks.workunit.client.1.smithi149.stdout:1/563: dread d2/dd/d35/d1c/d41/f49 [0,4194304] 0 2024-09-21T11:39:14.663 INFO:tasks.workunit.client.1.smithi149.stdout:1/564: readlink d2/d2b/lb0 0 2024-09-21T11:39:14.663 INFO:tasks.workunit.client.0.smithi118.stdout:9/173: creat d0/d4/d38/f46 x:0 0 0 2024-09-21T11:39:14.666 INFO:tasks.workunit.client.1.smithi149.stdout:2/744: dwrite d8/dd/d5c/d60/fcc [0,4194304] 0 2024-09-21T11:39:14.666 INFO:tasks.workunit.client.1.smithi149.stdout:1/565: dread - d2/dd/d35/d1c/d41/d51/f7f zero size 2024-09-21T11:39:14.668 INFO:tasks.workunit.client.0.smithi118.stdout:3/138: rename d5/d1d/f2e to d5/d1d/d1b/d24/f36 0 2024-09-21T11:39:14.676 INFO:tasks.workunit.client.0.smithi118.stdout:0/336: creat d5/f74 x:0 0 0 2024-09-21T11:39:14.680 INFO:tasks.workunit.client.0.smithi118.stdout:0/337: creat d5/d34/d44/f75 x:0 0 0 2024-09-21T11:39:14.681 INFO:tasks.workunit.client.0.smithi118.stdout:1/159: rmdir d6/de/d16 39 2024-09-21T11:39:14.682 INFO:tasks.workunit.client.0.smithi118.stdout:1/160: chown d6/d2a/f28 61 1 2024-09-21T11:39:14.683 INFO:tasks.workunit.client.0.smithi118.stdout:0/338: symlink d5/d10/d1e/d21/l76 0 2024-09-21T11:39:14.684 INFO:tasks.workunit.client.1.smithi149.stdout:8/541: sync 2024-09-21T11:39:14.685 INFO:tasks.workunit.client.0.smithi118.stdout:0/339: write d5/d34/d44/f52 [770748,57773] 0 2024-09-21T11:39:14.686 INFO:tasks.workunit.client.0.smithi118.stdout:1/161: symlink d6/l2b 0 2024-09-21T11:39:14.686 INFO:tasks.workunit.client.1.smithi149.stdout:8/542: write d3/dd/d18/d2e/d80/fa1 [4079,63432] 0 2024-09-21T11:39:14.687 INFO:tasks.workunit.client.0.smithi118.stdout:9/174: dwrite d0/d4/f8 [0,4194304] 0 2024-09-21T11:39:14.689 INFO:tasks.workunit.client.0.smithi118.stdout:0/340: symlink d5/d34/l77 0 2024-09-21T11:39:14.690 INFO:tasks.workunit.client.0.smithi118.stdout:0/341: chown d5/d34/d44 55 1 2024-09-21T11:39:14.691 INFO:tasks.workunit.client.0.smithi118.stdout:0/342: chown d5/d34/f3b 127481741 1 2024-09-21T11:39:14.697 INFO:tasks.workunit.client.0.smithi118.stdout:9/175: getdents d0/d4/d45 0 2024-09-21T11:39:14.700 INFO:tasks.workunit.client.0.smithi118.stdout:1/162: symlink d6/de/l2c 0 2024-09-21T11:39:14.701 INFO:tasks.workunit.client.0.smithi118.stdout:0/343: dwrite d5/f13 [4194304,4194304] 0 2024-09-21T11:39:14.702 INFO:tasks.workunit.client.0.smithi118.stdout:9/176: rmdir d0/d4/d38 39 2024-09-21T11:39:14.703 INFO:tasks.workunit.client.0.smithi118.stdout:1/163: mknod d6/d1f/c2d 0 2024-09-21T11:39:14.704 INFO:tasks.workunit.client.0.smithi118.stdout:9/177: read d0/f13 [241041,30557] 0 2024-09-21T11:39:14.705 INFO:tasks.workunit.client.0.smithi118.stdout:9/178: dread - d0/d20/f3c zero size 2024-09-21T11:39:14.705 INFO:tasks.workunit.client.0.smithi118.stdout:9/179: dread - d0/f2c zero size 2024-09-21T11:39:14.706 INFO:tasks.workunit.client.0.smithi118.stdout:0/344: readlink d5/l1a 0 2024-09-21T11:39:14.707 INFO:tasks.workunit.client.0.smithi118.stdout:9/180: chown d0/f3a 6157732 1 2024-09-21T11:39:14.708 INFO:tasks.workunit.client.1.smithi149.stdout:5/681: creat d4/d1d/d50/d54/d2a/d93/fda x:0 0 0 2024-09-21T11:39:14.708 INFO:tasks.workunit.client.0.smithi118.stdout:9/181: dread d0/d4/f3d [0,4194304] 0 2024-09-21T11:39:14.709 INFO:tasks.workunit.client.0.smithi118.stdout:9/182: chown d0/l1b 16277745 1 2024-09-21T11:39:14.711 INFO:tasks.workunit.client.0.smithi118.stdout:0/345: creat d5/d10/d1e/d21/d2a/f78 x:0 0 0 2024-09-21T11:39:14.712 INFO:tasks.workunit.client.1.smithi149.stdout:0/544: creat dd/d1a/d1b/d50/d53/d3a/d66/fb4 x:0 0 0 2024-09-21T11:39:14.713 INFO:tasks.workunit.client.1.smithi149.stdout:0/545: write dd/f15 [4578029,95238] 0 2024-09-21T11:39:14.714 INFO:tasks.workunit.client.1.smithi149.stdout:6/554: rmdir d8/da/d2c/d52 39 2024-09-21T11:39:14.715 INFO:tasks.workunit.client.0.smithi118.stdout:0/346: mknod d5/d29/c79 0 2024-09-21T11:39:14.715 INFO:tasks.workunit.client.1.smithi149.stdout:9/606: write d18/d4c/d5b/f6e [517269,74637] 0 2024-09-21T11:39:14.716 INFO:tasks.workunit.client.1.smithi149.stdout:9/607: readlink d18/d1c/l41 0 2024-09-21T11:39:14.718 INFO:tasks.workunit.client.1.smithi149.stdout:9/608: chown d18/d19/d1a/d2f/l56 129 1 2024-09-21T11:39:14.719 INFO:tasks.workunit.client.0.smithi118.stdout:9/183: symlink d0/d4/d23/l47 0 2024-09-21T11:39:14.720 INFO:tasks.workunit.client.0.smithi118.stdout:9/184: chown d0/d4/d45 121829005 1 2024-09-21T11:39:14.721 INFO:tasks.workunit.client.1.smithi149.stdout:6/555: dwrite d8/d32/d37/d28/d2f/f8e [0,4194304] 0 2024-09-21T11:39:14.723 INFO:tasks.workunit.client.0.smithi118.stdout:0/347: dwrite d5/d34/f3c [0,4194304] 0 2024-09-21T11:39:14.724 INFO:tasks.workunit.client.1.smithi149.stdout:5/682: dread d4/d1d/f6b [0,4194304] 0 2024-09-21T11:39:14.726 INFO:tasks.workunit.client.1.smithi149.stdout:4/647: sync 2024-09-21T11:39:14.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/650: creat d6/d1f/d47/d37/d50/feb x:0 0 0 2024-09-21T11:39:14.728 INFO:tasks.workunit.client.1.smithi149.stdout:3/651: dread - d6/d1f/d47/dbb/fbf zero size 2024-09-21T11:39:14.729 INFO:tasks.workunit.client.1.smithi149.stdout:3/652: dread - d6/d1f/d47/d37/d3f/f64 zero size 2024-09-21T11:39:14.731 INFO:tasks.workunit.client.0.smithi118.stdout:0/348: creat d5/d10/d1e/d21/f7a x:0 0 0 2024-09-21T11:39:14.732 INFO:tasks.workunit.client.0.smithi118.stdout:0/349: chown d5/d29/d68 381648 1 2024-09-21T11:39:14.733 INFO:tasks.workunit.client.1.smithi149.stdout:2/745: mknod d8/da/d13/d1a/dc5/c108 0 2024-09-21T11:39:14.733 INFO:tasks.workunit.client.0.smithi118.stdout:9/185: creat d0/d4/d45/f48 x:0 0 0 2024-09-21T11:39:14.734 INFO:tasks.workunit.client.1.smithi149.stdout:1/566: fdatasync d2/d5/d8/f40 0 2024-09-21T11:39:14.737 INFO:tasks.workunit.client.1.smithi149.stdout:8/543: creat d3/d12/d6e/d79/fbc x:0 0 0 2024-09-21T11:39:14.740 INFO:tasks.workunit.client.1.smithi149.stdout:7/714: mknod d12/d90/d68/dc4/d30/cdb 0 2024-09-21T11:39:14.742 INFO:tasks.workunit.client.0.smithi118.stdout:1/164: getdents d6/de/d13 0 2024-09-21T11:39:14.745 INFO:tasks.workunit.client.0.smithi118.stdout:1/165: truncate d6/de/f17 464592 0 2024-09-21T11:39:14.746 INFO:tasks.workunit.client.1.smithi149.stdout:9/609: fsync d18/d19/d1a/d2f/f3d 0 2024-09-21T11:39:14.748 INFO:tasks.workunit.client.1.smithi149.stdout:6/556: unlink d8/da/d2c/d2d/d9a/fae 0 2024-09-21T11:39:14.749 INFO:tasks.workunit.client.0.smithi118.stdout:9/186: write d0/f24 [1281550,6184] 0 2024-09-21T11:39:14.749 INFO:tasks.workunit.client.1.smithi149.stdout:6/557: write d8/d32/d37/f61 [1592419,96022] 0 2024-09-21T11:39:14.750 INFO:tasks.workunit.client.1.smithi149.stdout:5/683: creat d4/d1d/d50/d60/fdb x:0 0 0 2024-09-21T11:39:14.751 INFO:tasks.workunit.client.1.smithi149.stdout:4/648: mkdir d4/d6/d63/d15/d30/d6b/daa/de6 0 2024-09-21T11:39:14.754 INFO:tasks.workunit.client.1.smithi149.stdout:3/653: rename d6/d1f/d47/d37/d3a/d95/caf to d6/d1f/d47/d37/d3f/dc5/de3/cec 0 2024-09-21T11:39:14.754 INFO:tasks.workunit.client.1.smithi149.stdout:3/654: dread - d6/d1f/d47/d37/d3a/f90 zero size 2024-09-21T11:39:14.755 INFO:tasks.workunit.client.0.smithi118.stdout:0/350: dwrite d5/f7 [0,4194304] 0 2024-09-21T11:39:14.756 INFO:tasks.workunit.client.0.smithi118.stdout:0/351: chown d5/d10/d1e/d23/d3a/c5a 64 1 2024-09-21T11:39:14.757 INFO:tasks.workunit.client.0.smithi118.stdout:1/166: creat d6/de/f2e x:0 0 0 2024-09-21T11:39:14.758 INFO:tasks.workunit.client.0.smithi118.stdout:1/167: chown d6/f8 1926074250 1 2024-09-21T11:39:14.759 INFO:tasks.workunit.client.0.smithi118.stdout:9/187: symlink d0/d4/d38/l49 0 2024-09-21T11:39:14.761 INFO:tasks.workunit.client.0.smithi118.stdout:1/168: rmdir d6/de 39 2024-09-21T11:39:14.763 INFO:tasks.workunit.client.1.smithi149.stdout:0/546: symlink dd/lb5 0 2024-09-21T11:39:14.767 INFO:tasks.workunit.client.1.smithi149.stdout:9/610: creat d18/d36/d3c/d47/d76/fc3 x:0 0 0 2024-09-21T11:39:14.768 INFO:tasks.workunit.client.1.smithi149.stdout:9/611: dread - d18/d36/d3c/d47/fa1 zero size 2024-09-21T11:39:14.769 INFO:tasks.workunit.client.1.smithi149.stdout:9/612: stat d18/d19 0 2024-09-21T11:39:14.769 INFO:tasks.workunit.client.1.smithi149.stdout:0/547: dwrite dd/d1a/d5a/d65/f7b [0,4194304] 0 2024-09-21T11:39:14.771 INFO:tasks.workunit.client.1.smithi149.stdout:0/548: write dd/d1a/d1b/d50/d5d/f71 [1821018,26352] 0 2024-09-21T11:39:14.773 INFO:tasks.workunit.client.0.smithi118.stdout:9/188: rename d0/d4/f17 to d0/f4a 0 2024-09-21T11:39:14.774 INFO:tasks.workunit.client.1.smithi149.stdout:1/567: write d2/dd/d35/d1c/d37/f44 [5030118,2360] 0 2024-09-21T11:39:14.774 INFO:tasks.workunit.client.0.smithi118.stdout:1/169: symlink d6/de/d16/l2f 0 2024-09-21T11:39:14.775 INFO:tasks.workunit.client.1.smithi149.stdout:5/684: read d4/f5 [1969778,61178] 0 2024-09-21T11:39:14.777 INFO:tasks.workunit.client.0.smithi118.stdout:0/352: write d5/d10/d1e/d20/f2b [1949249,96365] 0 2024-09-21T11:39:14.778 INFO:tasks.workunit.client.1.smithi149.stdout:2/746: mknod d8/da/d13/d2d/d6f/de8/dff/c109 0 2024-09-21T11:39:14.778 INFO:tasks.workunit.client.0.smithi118.stdout:0/353: fdatasync d5/d10/d1e/d21/d2a/d48/f60 0 2024-09-21T11:39:14.780 INFO:tasks.workunit.client.0.smithi118.stdout:1/170: mkdir d6/d1f/d30 0 2024-09-21T11:39:14.780 INFO:tasks.workunit.client.1.smithi149.stdout:9/613: dwrite d18/d19/d1a/d2f/d43/fb9 [0,4194304] 0 2024-09-21T11:39:14.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/544: creat d3/d12/d6e/d79/d8e/fbd x:0 0 0 2024-09-21T11:39:14.782 INFO:tasks.workunit.client.1.smithi149.stdout:7/715: mkdir d12/d90/d4a/d4f/d75/d94/ddc 0 2024-09-21T11:39:14.784 INFO:tasks.workunit.client.0.smithi118.stdout:0/354: unlink d5/d10/d1e/d23/f25 0 2024-09-21T11:39:14.787 INFO:tasks.workunit.client.0.smithi118.stdout:1/171: symlink d6/d2a/l31 0 2024-09-21T11:39:14.788 INFO:tasks.workunit.client.1.smithi149.stdout:6/558: creat d8/da/d2c/d52/fb6 x:0 0 0 2024-09-21T11:39:14.790 INFO:tasks.workunit.client.0.smithi118.stdout:1/172: dread d6/f1e [0,4194304] 0 2024-09-21T11:39:14.791 INFO:tasks.workunit.client.0.smithi118.stdout:9/189: write d0/f26 [618197,10756] 0 2024-09-21T11:39:14.791 INFO:tasks.workunit.client.0.smithi118.stdout:0/355: rmdir d5 39 2024-09-21T11:39:14.792 INFO:tasks.workunit.client.0.smithi118.stdout:9/190: truncate d0/f25 406104 0 2024-09-21T11:39:14.793 INFO:tasks.workunit.client.0.smithi118.stdout:9/191: readlink d0/d20/l2d 0 2024-09-21T11:39:14.796 INFO:tasks.workunit.client.1.smithi149.stdout:0/549: unlink dd/d1a/d1b/f24 0 2024-09-21T11:39:14.799 INFO:tasks.workunit.client.0.smithi118.stdout:1/173: mkdir d6/d1f/d32 0 2024-09-21T11:39:14.803 INFO:tasks.workunit.client.1.smithi149.stdout:1/568: dwrite d2/f2d [0,4194304] 0 2024-09-21T11:39:14.803 INFO:tasks.workunit.client.0.smithi118.stdout:9/192: symlink d0/d4/d38/l4b 0 2024-09-21T11:39:14.804 INFO:tasks.workunit.client.1.smithi149.stdout:1/569: write d2/d5/d3d/f72 [1456161,102388] 0 2024-09-21T11:39:14.807 INFO:tasks.workunit.client.0.smithi118.stdout:9/193: mkdir d0/d20/d4c 0 2024-09-21T11:39:14.809 INFO:tasks.workunit.client.0.smithi118.stdout:0/356: dread d5/d10/d1e/d20/f32 [4194304,4194304] 0 2024-09-21T11:39:14.811 INFO:tasks.workunit.client.1.smithi149.stdout:8/545: creat d3/d33/d34/fbe x:0 0 0 2024-09-21T11:39:14.812 INFO:tasks.workunit.client.0.smithi118.stdout:9/194: unlink d0/l3b 0 2024-09-21T11:39:14.814 INFO:tasks.workunit.client.1.smithi149.stdout:6/559: mknod d8/cb7 0 2024-09-21T11:39:14.814 INFO:tasks.workunit.client.0.smithi118.stdout:9/195: mkdir d0/d4/d23/d4d 0 2024-09-21T11:39:14.815 INFO:tasks.workunit.client.1.smithi149.stdout:9/614: dwrite d18/d19/d29/f5c [4194304,4194304] 0 2024-09-21T11:39:14.815 INFO:tasks.workunit.client.1.smithi149.stdout:9/615: chown d18/d19/d29/d39/l87 186 1 2024-09-21T11:39:14.817 INFO:tasks.workunit.client.1.smithi149.stdout:4/649: link d4/d4d/l5a d4/d6/d63/d15/d30/d8a/da7/le7 0 2024-09-21T11:39:14.817 INFO:tasks.workunit.client.1.smithi149.stdout:5/685: symlink d4/d7/d40/d43/d49/d88/dcd/ldc 0 2024-09-21T11:39:14.818 INFO:tasks.workunit.client.1.smithi149.stdout:2/747: mknod d8/d20/d57/dda/c10a 0 2024-09-21T11:39:14.820 INFO:tasks.workunit.client.1.smithi149.stdout:3/655: sync 2024-09-21T11:39:14.820 INFO:tasks.workunit.client.1.smithi149.stdout:0/550: symlink dd/d32/lb6 0 2024-09-21T11:39:14.821 INFO:tasks.workunit.client.1.smithi149.stdout:5/686: chown d4/d7/d40/d43/d5c/c92 4010490 1 2024-09-21T11:39:14.822 INFO:tasks.workunit.client.1.smithi149.stdout:8/546: symlink d3/d12/d6e/lbf 0 2024-09-21T11:39:14.822 INFO:tasks.workunit.client.1.smithi149.stdout:2/748: write d8/d44/d63/db9/f2f [1348651,48863] 0 2024-09-21T11:39:14.826 INFO:tasks.workunit.client.1.smithi149.stdout:0/551: write dd/d1a/d1b/d72/d85/d8c/f89 [1124583,119372] 0 2024-09-21T11:39:14.828 INFO:tasks.workunit.client.1.smithi149.stdout:5/687: fsync d4/d7/d40/d43/d49/d88/fd8 0 2024-09-21T11:39:14.830 INFO:tasks.workunit.client.1.smithi149.stdout:1/570: dwrite d2/dd/d35/d7c/fb4 [0,4194304] 0 2024-09-21T11:39:14.830 INFO:tasks.workunit.client.1.smithi149.stdout:3/656: mknod d6/d1f/d27/ced 0 2024-09-21T11:39:14.831 INFO:tasks.workunit.client.1.smithi149.stdout:2/749: symlink d8/d44/d63/db9/d5a/l10b 0 2024-09-21T11:39:14.833 INFO:tasks.workunit.client.1.smithi149.stdout:5/688: dread - d4/d7/d40/d43/d49/d88/fd8 zero size 2024-09-21T11:39:14.833 INFO:tasks.workunit.client.1.smithi149.stdout:9/616: dread d18/d19/d29/f68 [0,4194304] 0 2024-09-21T11:39:14.834 INFO:tasks.workunit.client.1.smithi149.stdout:8/547: creat d3/dd/d21/fc0 x:0 0 0 2024-09-21T11:39:14.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/716: write d12/d90/d4a/d6c/d8c/daa/fc6 [466291,72315] 0 2024-09-21T11:39:14.835 INFO:tasks.workunit.client.1.smithi149.stdout:1/571: symlink d2/dd/d35/d1c/d2c/lb8 0 2024-09-21T11:39:14.839 INFO:tasks.workunit.client.1.smithi149.stdout:5/689: write d4/d7/f38 [4507824,18579] 0 2024-09-21T11:39:14.841 INFO:tasks.workunit.client.1.smithi149.stdout:8/548: mkdir d3/dd/d21/d54/d5c/dc1 0 2024-09-21T11:39:14.842 INFO:tasks.workunit.client.1.smithi149.stdout:7/717: mkdir d12/d90/d4a/ddd 0 2024-09-21T11:39:14.842 INFO:tasks.workunit.client.1.smithi149.stdout:0/552: getdents dd/d1a/d1b/d72/d87/da6 0 2024-09-21T11:39:14.844 INFO:tasks.workunit.client.1.smithi149.stdout:8/549: chown d3/d12/c84 10249 1 2024-09-21T11:39:14.845 INFO:tasks.workunit.client.1.smithi149.stdout:2/750: rename d8/da/d13/d5d/d6a/f8b to d8/f10c 0 2024-09-21T11:39:14.847 INFO:tasks.workunit.client.1.smithi149.stdout:6/560: dread d8/d32/d37/d28/d2e/f3b [0,4194304] 0 2024-09-21T11:39:14.847 INFO:tasks.workunit.client.1.smithi149.stdout:7/718: write d12/d90/d68/dc4/f29 [244652,103821] 0 2024-09-21T11:39:14.847 INFO:tasks.workunit.client.1.smithi149.stdout:4/650: dwrite d4/d6/d63/d15/d30/f6d [0,4194304] 0 2024-09-21T11:39:14.849 INFO:tasks.workunit.client.1.smithi149.stdout:1/572: truncate d2/dd/d35/d1c/d41/d51/d90/f9b 2012771 0 2024-09-21T11:39:14.852 INFO:tasks.workunit.client.1.smithi149.stdout:9/617: write d18/d1c/f46 [2358209,19018] 0 2024-09-21T11:39:14.855 INFO:tasks.workunit.client.1.smithi149.stdout:3/657: rename d6/d1f/d47/fa3 to d6/d1f/d47/d22/d8d/d97/dd2/fee 0 2024-09-21T11:39:14.856 INFO:tasks.workunit.client.1.smithi149.stdout:4/651: mknod d4/d4d/ce8 0 2024-09-21T11:39:14.856 INFO:tasks.workunit.client.1.smithi149.stdout:5/690: write d4/d4f/f7f [1731342,26281] 0 2024-09-21T11:39:14.857 INFO:tasks.workunit.client.1.smithi149.stdout:2/751: truncate d8/dd/f38 1138458 0 2024-09-21T11:39:14.859 INFO:tasks.workunit.client.1.smithi149.stdout:6/561: mkdir d8/d32/d37/d2b/d7d/db8 0 2024-09-21T11:39:14.864 INFO:tasks.workunit.client.1.smithi149.stdout:9/618: mknod d18/d4c/cc4 0 2024-09-21T11:39:14.865 INFO:tasks.workunit.client.1.smithi149.stdout:7/719: dread d12/d90/d4a/d4f/d75/f77 [0,4194304] 0 2024-09-21T11:39:14.865 INFO:tasks.workunit.client.1.smithi149.stdout:7/720: readlink d12/d90/d68/dc4/l43 0 2024-09-21T11:39:14.865 INFO:tasks.workunit.client.1.smithi149.stdout:8/550: rename d3/dd to d3/d33/d34/d55/d5e/d9e/dc2 0 2024-09-21T11:39:14.867 INFO:tasks.workunit.client.1.smithi149.stdout:5/691: mkdir d4/d90/ddd 0 2024-09-21T11:39:14.871 INFO:tasks.workunit.client.1.smithi149.stdout:1/573: symlink d2/dd/d35/d1c/d41/d51/lb9 0 2024-09-21T11:39:14.871 INFO:tasks.workunit.client.1.smithi149.stdout:0/553: creat dd/d32/fb7 x:0 0 0 2024-09-21T11:39:14.876 INFO:tasks.workunit.client.1.smithi149.stdout:3/658: creat d6/d79/d7e/dcb/fef x:0 0 0 2024-09-21T11:39:14.877 INFO:tasks.workunit.client.1.smithi149.stdout:8/551: mkdir d3/d33/d34/d55/d5e/d9e/dc3 0 2024-09-21T11:39:14.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/619: write d18/d19/d1a/f23 [2337892,71879] 0 2024-09-21T11:39:14.879 INFO:tasks.workunit.client.1.smithi149.stdout:6/562: mkdir d8/da/db9 0 2024-09-21T11:39:14.879 INFO:tasks.workunit.client.1.smithi149.stdout:8/552: chown d3/d33/d34/d55/d5e/d9e/dc2/d21/l5b 6 1 2024-09-21T11:39:14.879 INFO:tasks.workunit.client.1.smithi149.stdout:9/620: chown d18/d4c/f67 1571688679 1 2024-09-21T11:39:14.880 INFO:tasks.workunit.client.1.smithi149.stdout:9/621: fdatasync fc 0 2024-09-21T11:39:14.880 INFO:tasks.workunit.client.1.smithi149.stdout:0/554: symlink dd/d1a/d1b/d72/d87/lb8 0 2024-09-21T11:39:14.881 INFO:tasks.workunit.client.1.smithi149.stdout:8/553: write d3/d33/d34/d72/f9c [836298,92223] 0 2024-09-21T11:39:14.881 INFO:tasks.workunit.client.1.smithi149.stdout:4/652: rename d4/d6/f7f to d4/d6/d63/d15/d30/d6b/daa/fe9 0 2024-09-21T11:39:14.882 INFO:tasks.workunit.client.1.smithi149.stdout:4/653: fdatasync d4/d6/fb 0 2024-09-21T11:39:14.882 INFO:tasks.workunit.client.1.smithi149.stdout:7/721: unlink d12/d90/d4a/d4f/d75/d94/l56 0 2024-09-21T11:39:14.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/574: creat d2/d5/d65/d96/fba x:0 0 0 2024-09-21T11:39:14.885 INFO:tasks.workunit.client.1.smithi149.stdout:9/622: symlink d18/d4c/d5b/lc5 0 2024-09-21T11:39:14.895 INFO:tasks.workunit.client.1.smithi149.stdout:4/654: dwrite d4/d6/d18/f73 [0,4194304] 0 2024-09-21T11:39:14.896 INFO:tasks.workunit.client.1.smithi149.stdout:2/752: getdents d8/dd/d5c 0 2024-09-21T11:39:14.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/555: symlink dd/db3/lb9 0 2024-09-21T11:39:14.896 INFO:tasks.workunit.client.1.smithi149.stdout:9/623: truncate d18/d36/d3c/d47/d76/fc3 432258 0 2024-09-21T11:39:14.897 INFO:tasks.workunit.client.1.smithi149.stdout:1/575: readlink d2/d5/d65/lad 0 2024-09-21T11:39:14.900 INFO:tasks.workunit.client.1.smithi149.stdout:3/659: creat d6/d1f/d27/ff0 x:0 0 0 2024-09-21T11:39:14.900 INFO:tasks.workunit.client.1.smithi149.stdout:7/722: symlink d12/lde 0 2024-09-21T11:39:14.900 INFO:tasks.workunit.client.1.smithi149.stdout:1/576: write d2/d5/d8/f17 [6885763,20743] 0 2024-09-21T11:39:14.901 INFO:tasks.workunit.client.1.smithi149.stdout:6/563: creat d8/da/d2c/fba x:0 0 0 2024-09-21T11:39:14.902 INFO:tasks.workunit.client.1.smithi149.stdout:0/556: creat dd/d2d/fba x:0 0 0 2024-09-21T11:39:14.903 INFO:tasks.workunit.client.1.smithi149.stdout:5/692: rename d4/d1d/d50/d54/db2 to d4/d1d/dde 0 2024-09-21T11:39:14.904 INFO:tasks.workunit.client.1.smithi149.stdout:4/655: creat d4/d4d/d58/fea x:0 0 0 2024-09-21T11:39:14.904 INFO:tasks.workunit.client.1.smithi149.stdout:7/723: chown d12/d90/d4a/d4f/d75/c7d 28661154 1 2024-09-21T11:39:14.905 INFO:tasks.workunit.client.1.smithi149.stdout:2/753: write d8/d20/f40 [246911,43370] 0 2024-09-21T11:39:14.909 INFO:tasks.workunit.client.1.smithi149.stdout:1/577: creat d2/dd/d35/d1c/d41/d51/d73/fbb x:0 0 0 2024-09-21T11:39:14.910 INFO:tasks.workunit.client.1.smithi149.stdout:3/660: mkdir d6/d1f/df1 0 2024-09-21T11:39:14.911 INFO:tasks.workunit.client.1.smithi149.stdout:9/624: link d18/d1c/f46 d18/d19/d29/fc6 0 2024-09-21T11:39:14.912 INFO:tasks.workunit.client.1.smithi149.stdout:0/557: mkdir dd/d1a/d1b/d72/d78/dbb 0 2024-09-21T11:39:14.912 INFO:tasks.workunit.client.1.smithi149.stdout:2/754: dread d8/d44/d63/db9/f41 [0,4194304] 0 2024-09-21T11:39:14.913 INFO:tasks.workunit.client.1.smithi149.stdout:4/656: unlink d4/d6/d63/d15/fda 0 2024-09-21T11:39:14.914 INFO:tasks.workunit.client.1.smithi149.stdout:6/564: truncate d8/d32/d37/d28/d2e/f44 2077279 0 2024-09-21T11:39:14.914 INFO:tasks.workunit.client.1.smithi149.stdout:9/625: fsync d18/d1c/f4e 0 2024-09-21T11:39:14.914 INFO:tasks.workunit.client.1.smithi149.stdout:4/657: chown d4 10 1 2024-09-21T11:39:14.916 INFO:tasks.workunit.client.1.smithi149.stdout:1/578: symlink d2/dd/d35/lbc 0 2024-09-21T11:39:14.916 INFO:tasks.workunit.client.1.smithi149.stdout:3/661: chown d6/d1f/d4c/c68 2641 1 2024-09-21T11:39:14.916 INFO:tasks.workunit.client.1.smithi149.stdout:9/626: rmdir d18/d4c 39 2024-09-21T11:39:14.917 INFO:tasks.workunit.client.1.smithi149.stdout:7/724: dwrite d12/d90/d68/dc4/d30/f5a [0,4194304] 0 2024-09-21T11:39:14.921 INFO:tasks.workunit.client.1.smithi149.stdout:0/558: mkdir dd/d1a/d1b/d72/d78/d8b/d98/dbc 0 2024-09-21T11:39:14.921 INFO:tasks.workunit.client.1.smithi149.stdout:1/579: read d2/d2b/d6e/f6f [1081329,58267] 0 2024-09-21T11:39:14.922 INFO:tasks.workunit.client.1.smithi149.stdout:9/627: chown d18/d4c/d5b 16 1 2024-09-21T11:39:14.930 INFO:tasks.workunit.client.1.smithi149.stdout:3/662: mkdir d6/d1f/d27/d83/df2 0 2024-09-21T11:39:14.930 INFO:tasks.workunit.client.1.smithi149.stdout:5/693: dread d4/d1d/d50/d54/d2a/f34 [0,4194304] 0 2024-09-21T11:39:14.932 INFO:tasks.workunit.client.1.smithi149.stdout:6/565: dwrite d8/d32/d37/d2b/d7d/fa0 [0,4194304] 0 2024-09-21T11:39:14.935 INFO:tasks.workunit.client.1.smithi149.stdout:3/663: dread - d6/d1f/d27/ff0 zero size 2024-09-21T11:39:14.935 INFO:tasks.workunit.client.1.smithi149.stdout:9/628: chown d18/d19/d1a/d2f/d33/l78 51152329 1 2024-09-21T11:39:14.936 INFO:tasks.workunit.client.1.smithi149.stdout:2/755: link d8/da/d13/d1a/l26 d8/dcb/db8/l10d 0 2024-09-21T11:39:14.938 INFO:tasks.workunit.client.1.smithi149.stdout:2/756: readlink d8/d20/d78/l86 0 2024-09-21T11:39:14.939 INFO:tasks.workunit.client.1.smithi149.stdout:3/664: readlink d6/d1f/d47/l62 0 2024-09-21T11:39:14.939 INFO:tasks.workunit.client.1.smithi149.stdout:7/725: write d12/d90/d4a/d4f/d75/d94/fbc [1011931,74190] 0 2024-09-21T11:39:14.940 INFO:tasks.workunit.client.1.smithi149.stdout:2/757: stat d8/dd/d5c/f76 0 2024-09-21T11:39:14.940 INFO:tasks.workunit.client.1.smithi149.stdout:4/658: dread d4/d6/d18/f1c [0,4194304] 0 2024-09-21T11:39:14.941 INFO:tasks.workunit.client.1.smithi149.stdout:3/665: chown d6/d79/d7e/ca5 266 1 2024-09-21T11:39:14.943 INFO:tasks.workunit.client.1.smithi149.stdout:4/659: readlink d4/d6/d63/d15/d30/lba 0 2024-09-21T11:39:14.943 INFO:tasks.workunit.client.1.smithi149.stdout:2/758: dread - d8/da/d13/d83/fc9 zero size 2024-09-21T11:39:14.944 INFO:tasks.workunit.client.1.smithi149.stdout:7/726: truncate d12/d90/d4a/f76 5079072 0 2024-09-21T11:39:14.945 INFO:tasks.workunit.client.1.smithi149.stdout:9/629: mkdir d18/d36/d3c/d47/d99/dbe/dc7 0 2024-09-21T11:39:14.945 INFO:tasks.workunit.client.1.smithi149.stdout:4/660: chown d4/d6/d63/d15/d16/d23/l43 2098 1 2024-09-21T11:39:14.948 INFO:tasks.workunit.client.1.smithi149.stdout:7/727: chown d12/d90/d4a/d6c/d8c/cd9 885496212 1 2024-09-21T11:39:14.949 INFO:tasks.workunit.client.1.smithi149.stdout:9/630: creat d18/d19/d29/d39/d63/fc8 x:0 0 0 2024-09-21T11:39:14.951 INFO:tasks.workunit.client.1.smithi149.stdout:1/580: truncate d2/dd/d35/d1c/d41/d51/d73/f93 4346618 0 2024-09-21T11:39:14.951 INFO:tasks.workunit.client.1.smithi149.stdout:5/694: truncate d4/f2f 43830 0 2024-09-21T11:39:14.951 INFO:tasks.workunit.client.1.smithi149.stdout:0/559: dread f8 [0,4194304] 0 2024-09-21T11:39:14.953 INFO:tasks.workunit.client.1.smithi149.stdout:2/759: dwrite d8/dd/d5c/f76 [0,4194304] 0 2024-09-21T11:39:14.953 INFO:tasks.workunit.client.1.smithi149.stdout:5/695: dread - d4/d7/d40/d43/d5c/faf zero size 2024-09-21T11:39:14.953 INFO:tasks.workunit.client.1.smithi149.stdout:4/661: unlink d4/d6/d63/d15/lca 0 2024-09-21T11:39:14.954 INFO:tasks.workunit.client.1.smithi149.stdout:3/666: write d6/d1f/d47/d37/d3a/f6c [513034,103147] 0 2024-09-21T11:39:14.955 INFO:tasks.workunit.client.1.smithi149.stdout:7/728: symlink d12/d90/d4a/d6c/ldf 0 2024-09-21T11:39:14.956 INFO:tasks.workunit.client.1.smithi149.stdout:4/662: chown d4/d6/d18/f2a 0 1 2024-09-21T11:39:14.956 INFO:tasks.workunit.client.1.smithi149.stdout:5/696: fsync d4/d1d/d50/d60/fb7 0 2024-09-21T11:39:14.958 INFO:tasks.workunit.client.1.smithi149.stdout:9/631: mknod d18/d36/d3c/d47/d99/dbe/dc7/cc9 0 2024-09-21T11:39:14.958 INFO:tasks.workunit.client.1.smithi149.stdout:3/667: chown d6/d1f/lc9 9621992 1 2024-09-21T11:39:14.960 INFO:tasks.workunit.client.1.smithi149.stdout:9/632: chown d18/d36/d3c/d47/d99/dbe/dc7 16351 1 2024-09-21T11:39:14.960 INFO:tasks.workunit.client.1.smithi149.stdout:2/760: creat d8/da/d13/d1a/dc5/f10e x:0 0 0 2024-09-21T11:39:14.960 INFO:tasks.workunit.client.1.smithi149.stdout:0/560: rename dd/d1a/d1b/d81/fa5 to dd/d1a/d1b/d72/d78/d8b/d98/daa/fbd 0 2024-09-21T11:39:14.961 INFO:tasks.workunit.client.1.smithi149.stdout:7/729: rmdir d12/d5b/db5/dc5 39 2024-09-21T11:39:14.962 INFO:tasks.workunit.client.1.smithi149.stdout:3/668: creat d6/d79/d7e/ff3 x:0 0 0 2024-09-21T11:39:14.962 INFO:tasks.workunit.client.1.smithi149.stdout:2/761: write d8/da/d13/d2d/f6b [1393006,63010] 0 2024-09-21T11:39:14.965 INFO:tasks.workunit.client.0.smithi118.stdout:0/357: dwrite d5/d10/d1e/d20/f26 [0,4194304] 0 2024-09-21T11:39:14.965 INFO:tasks.workunit.client.1.smithi149.stdout:7/730: rmdir d12/d90 39 2024-09-21T11:39:14.967 INFO:tasks.workunit.client.1.smithi149.stdout:9/633: dwrite d18/d19/d1a/d2f/d30/d90/fb7 [0,4194304] 0 2024-09-21T11:39:14.968 INFO:tasks.workunit.client.1.smithi149.stdout:3/669: mkdir d6/d5f/d60/d88/df4 0 2024-09-21T11:39:14.970 INFO:tasks.workunit.client.0.smithi118.stdout:0/358: mkdir d5/d29/d68/d7b 0 2024-09-21T11:39:14.972 INFO:tasks.workunit.client.0.smithi118.stdout:9/196: mkdir d0/d4/d38/d4e 0 2024-09-21T11:39:14.973 INFO:tasks.workunit.client.1.smithi149.stdout:0/561: mkdir dd/d32/dbe 0 2024-09-21T11:39:14.974 INFO:tasks.workunit.client.1.smithi149.stdout:0/562: dread - dd/d1a/f9f zero size 2024-09-21T11:39:14.975 INFO:tasks.workunit.client.1.smithi149.stdout:0/563: write dd/d2d/fba [78010,101052] 0 2024-09-21T11:39:14.975 INFO:tasks.workunit.client.1.smithi149.stdout:2/762: creat d8/d44/d63/db9/f10f x:0 0 0 2024-09-21T11:39:14.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/763: read - d8/d44/d63/db9/f10f zero size 2024-09-21T11:39:14.978 INFO:tasks.workunit.client.0.smithi118.stdout:0/359: dwrite d5/d10/d1e/d33/f72 [0,4194304] 0 2024-09-21T11:39:14.982 INFO:tasks.workunit.client.0.smithi118.stdout:0/360: truncate d5/d10/d1e/d23/d3a/f46 2486161 0 2024-09-21T11:39:14.987 INFO:tasks.workunit.client.0.smithi118.stdout:9/197: symlink d0/l4f 0 2024-09-21T11:39:14.989 INFO:tasks.workunit.client.0.smithi118.stdout:0/361: rmdir d5 39 2024-09-21T11:39:14.991 INFO:tasks.workunit.client.1.smithi149.stdout:4/663: rename d4/d6/d63/d2d/l69 to d4/d6/d63/d10/leb 0 2024-09-21T11:39:14.992 INFO:tasks.workunit.client.0.smithi118.stdout:9/198: dread d0/f24 [0,4194304] 0 2024-09-21T11:39:14.993 INFO:tasks.workunit.client.0.smithi118.stdout:9/199: readlink d0/d4/d23/l47 0 2024-09-21T11:39:14.993 INFO:tasks.workunit.client.1.smithi149.stdout:4/664: write d4/d6/d63/d15/d30/d6b/daa/fad [3444468,37453] 0 2024-09-21T11:39:14.998 INFO:tasks.workunit.client.0.smithi118.stdout:9/200: mknod d0/d20/c50 0 2024-09-21T11:39:15.000 INFO:tasks.workunit.client.1.smithi149.stdout:9/634: mknod d18/d36/d3c/d47/d76/d97/cca 0 2024-09-21T11:39:15.001 INFO:tasks.workunit.client.0.smithi118.stdout:0/362: mkdir d5/d34/d44/d7c 0 2024-09-21T11:39:15.001 INFO:tasks.workunit.client.1.smithi149.stdout:9/635: chown d18/d19/d1a/d2f/d30/d90/f9d 541903 1 2024-09-21T11:39:15.002 INFO:tasks.workunit.client.0.smithi118.stdout:0/363: chown d5/d10/d1e/d21/d2a/d48/l4f 2789511 1 2024-09-21T11:39:15.002 INFO:tasks.workunit.client.1.smithi149.stdout:0/564: rename dd/d1a/d5a/f77 to dd/d32/db2/fbf 0 2024-09-21T11:39:15.002 INFO:tasks.workunit.client.1.smithi149.stdout:3/670: dread d6/f13 [0,4194304] 0 2024-09-21T11:39:15.002 INFO:tasks.workunit.client.1.smithi149.stdout:5/697: write d4/d7/d40/d43/d5c/d7a/d81/f8f [381866,72098] 0 2024-09-21T11:39:15.004 INFO:tasks.workunit.client.0.smithi118.stdout:9/201: mknod d0/d4/d38/d4e/c51 0 2024-09-21T11:39:15.006 INFO:tasks.workunit.client.1.smithi149.stdout:0/565: dread dd/d2d/f7f [4194304,4194304] 0 2024-09-21T11:39:15.007 INFO:tasks.workunit.client.1.smithi149.stdout:0/566: fdatasync dd/d1a/d1b/d72/d85/d8c/fa4 0 2024-09-21T11:39:15.009 INFO:tasks.workunit.client.0.smithi118.stdout:0/364: dwrite d5/f74 [0,4194304] 0 2024-09-21T11:39:15.010 INFO:tasks.workunit.client.1.smithi149.stdout:9/636: mkdir d18/d36/d3c/dcb 0 2024-09-21T11:39:15.010 INFO:tasks.workunit.client.0.smithi118.stdout:9/202: mknod d0/d4/d23/d4d/c52 0 2024-09-21T11:39:15.012 INFO:tasks.workunit.client.1.smithi149.stdout:3/671: creat d6/d1f/d47/dbb/ff5 x:0 0 0 2024-09-21T11:39:15.014 INFO:tasks.workunit.client.0.smithi118.stdout:9/203: dread d0/f26 [0,4194304] 0 2024-09-21T11:39:15.020 INFO:tasks.workunit.client.1.smithi149.stdout:5/698: dwrite d4/d1d/d50/d54/d2a/f34 [0,4194304] 0 2024-09-21T11:39:15.021 INFO:tasks.workunit.client.0.smithi118.stdout:0/365: dread d5/d10/d1e/d20/f2b [0,4194304] 0 2024-09-21T11:39:15.025 INFO:tasks.workunit.client.1.smithi149.stdout:7/731: creat d12/d90/d4a/d4f/d75/d94/fe0 x:0 0 0 2024-09-21T11:39:15.025 INFO:tasks.workunit.client.1.smithi149.stdout:0/567: creat dd/d35/fc0 x:0 0 0 2024-09-21T11:39:15.028 INFO:tasks.workunit.client.1.smithi149.stdout:9/637: chown l17 7266462 1 2024-09-21T11:39:15.028 INFO:tasks.workunit.client.0.smithi118.stdout:0/366: creat d5/d10/d1e/d23/f7d x:0 0 0 2024-09-21T11:39:15.029 INFO:tasks.workunit.client.1.smithi149.stdout:8/554: sync 2024-09-21T11:39:15.029 INFO:tasks.workunit.client.1.smithi149.stdout:4/665: truncate d4/d6/d63/d15/d30/f37 160741 0 2024-09-21T11:39:15.029 INFO:tasks.workunit.client.1.smithi149.stdout:9/638: chown d18/d19/d29/d39/d63/dac/lb0 1 1 2024-09-21T11:39:15.030 INFO:tasks.workunit.client.1.smithi149.stdout:4/666: dread - d4/d4d/d58/db4/fc1 zero size 2024-09-21T11:39:15.031 INFO:tasks.workunit.client.0.smithi118.stdout:9/204: rename d0/d20/c50 to d0/c53 0 2024-09-21T11:39:15.031 INFO:tasks.workunit.client.0.smithi118.stdout:9/205: chown d0/d4/d23/f32 889931 1 2024-09-21T11:39:15.032 INFO:tasks.workunit.client.1.smithi149.stdout:3/672: symlink d6/d1f/d47/d37/d3a/lf6 0 2024-09-21T11:39:15.032 INFO:tasks.workunit.client.1.smithi149.stdout:3/673: write d6/d1f/d4c/f87 [151087,58393] 0 2024-09-21T11:39:15.032 INFO:tasks.workunit.client.1.smithi149.stdout:2/764: getdents d8/d11/d88/dd4/de5 0 2024-09-21T11:39:15.033 INFO:tasks.workunit.client.1.smithi149.stdout:3/674: fsync d6/d5f/d60/f82 0 2024-09-21T11:39:15.034 INFO:tasks.workunit.client.1.smithi149.stdout:5/699: mkdir d4/d7/d40/d43/d49/d88/dcd/ddf 0 2024-09-21T11:39:15.034 INFO:tasks.workunit.client.0.smithi118.stdout:9/206: rmdir d0/d4/d38/d4e 39 2024-09-21T11:39:15.037 INFO:tasks.workunit.client.1.smithi149.stdout:0/568: rename dd/d1a/d1b/d50/d5d/d9c to dd/d1a/d1b/d72/dc1 0 2024-09-21T11:39:15.039 INFO:tasks.workunit.client.0.smithi118.stdout:9/207: rename d0/d20/c39 to d0/d20/d4c/c54 0 2024-09-21T11:39:15.039 INFO:tasks.workunit.client.1.smithi149.stdout:0/569: write dd/d32/f3c [2546332,87532] 0 2024-09-21T11:39:15.040 INFO:tasks.workunit.client.0.smithi118.stdout:9/208: stat d0/d4/l6 0 2024-09-21T11:39:15.040 INFO:tasks.workunit.client.1.smithi149.stdout:5/700: dwrite d4/d1d/d50/d54/f35 [0,4194304] 0 2024-09-21T11:39:15.041 INFO:tasks.workunit.client.0.smithi118.stdout:0/367: creat d5/f7e x:0 0 0 2024-09-21T11:39:15.042 INFO:tasks.workunit.client.1.smithi149.stdout:9/639: mkdir d18/d19/d1a/d2f/d30/d90/dcc 0 2024-09-21T11:39:15.043 INFO:tasks.workunit.client.1.smithi149.stdout:4/667: mkdir d4/d6/d63/d15/dec 0 2024-09-21T11:39:15.046 INFO:tasks.workunit.client.1.smithi149.stdout:3/675: creat d6/d1f/d47/d37/dd6/ff7 x:0 0 0 2024-09-21T11:39:15.048 INFO:tasks.workunit.client.0.smithi118.stdout:9/209: dwrite d0/d4/d38/f46 [0,4194304] 0 2024-09-21T11:39:15.049 INFO:tasks.workunit.client.1.smithi149.stdout:7/732: dread d12/d90/f45 [0,4194304] 0 2024-09-21T11:39:15.049 INFO:tasks.workunit.client.1.smithi149.stdout:5/701: readlink d4/l3c 0 2024-09-21T11:39:15.049 INFO:tasks.workunit.client.1.smithi149.stdout:0/570: symlink dd/d1a/d1b/d81/d97/lc2 0 2024-09-21T11:39:15.050 INFO:tasks.workunit.client.1.smithi149.stdout:7/733: chown d12/d90/d4a/d6c/d8c/fa2 57168168 1 2024-09-21T11:39:15.051 INFO:tasks.workunit.client.0.smithi118.stdout:0/368: dwrite d5/d10/f28 [0,4194304] 0 2024-09-21T11:39:15.051 INFO:tasks.workunit.client.1.smithi149.stdout:2/765: mknod d8/da/c110 0 2024-09-21T11:39:15.053 INFO:tasks.workunit.client.1.smithi149.stdout:4/668: rmdir d4/d4d/d58 39 2024-09-21T11:39:15.054 INFO:tasks.workunit.client.0.smithi118.stdout:9/210: mknod d0/d20/c55 0 2024-09-21T11:39:15.056 INFO:tasks.workunit.client.1.smithi149.stdout:3/676: fsync f3 0 2024-09-21T11:39:15.057 INFO:tasks.workunit.client.0.smithi118.stdout:9/211: dread d0/f25 [0,4194304] 0 2024-09-21T11:39:15.063 INFO:tasks.workunit.client.1.smithi149.stdout:8/555: creat d3/d33/fc4 x:0 0 0 2024-09-21T11:39:15.065 INFO:tasks.workunit.client.0.smithi118.stdout:9/212: mknod d0/d4/d23/c56 0 2024-09-21T11:39:15.065 INFO:tasks.workunit.client.0.smithi118.stdout:0/369: dwrite d5/d10/d1e/d21/d2a/d48/f64 [0,4194304] 0 2024-09-21T11:39:15.066 INFO:tasks.workunit.client.1.smithi149.stdout:5/702: mkdir d4/d7/d40/d43/d49/d88/de0 0 2024-09-21T11:39:15.068 INFO:tasks.workunit.client.0.smithi118.stdout:0/370: write d5/d10/d1e/d21/f42 [1761034,86105] 0 2024-09-21T11:39:15.072 INFO:tasks.workunit.client.0.smithi118.stdout:9/213: dwrite d0/d4/f15 [0,4194304] 0 2024-09-21T11:39:15.073 INFO:tasks.workunit.client.0.smithi118.stdout:9/214: chown d0/f1 3943 1 2024-09-21T11:39:15.075 INFO:tasks.workunit.client.1.smithi149.stdout:2/766: creat d8/d44/d63/f111 x:0 0 0 2024-09-21T11:39:15.082 INFO:tasks.workunit.client.1.smithi149.stdout:9/640: creat d18/d19/fcd x:0 0 0 2024-09-21T11:39:15.082 INFO:tasks.workunit.client.1.smithi149.stdout:0/571: dwrite dd/d1a/d1b/d50/d53/f42 [0,4194304] 0 2024-09-21T11:39:15.084 INFO:tasks.workunit.client.1.smithi149.stdout:0/572: truncate dd/d32/fb7 482 0 2024-09-21T11:39:15.085 INFO:tasks.workunit.client.1.smithi149.stdout:8/556: rename d3/d33/d34/d55/f59 to d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/fc5 0 2024-09-21T11:39:15.088 INFO:tasks.workunit.client.1.smithi149.stdout:8/557: write d3/d12/d6e/f94 [451693,43509] 0 2024-09-21T11:39:15.089 INFO:tasks.workunit.client.0.smithi118.stdout:9/215: mkdir d0/d4/d57 0 2024-09-21T11:39:15.095 INFO:tasks.workunit.client.1.smithi149.stdout:2/767: mkdir d8/da/d13/d83/df6/d112 0 2024-09-21T11:39:15.096 INFO:tasks.workunit.client.1.smithi149.stdout:2/768: write d8/d44/d63/f111 [621605,113219] 0 2024-09-21T11:39:15.101 INFO:tasks.workunit.client.1.smithi149.stdout:0/573: truncate dd/d1a/d1b/d50/d53/f6f 1384982 0 2024-09-21T11:39:15.104 INFO:tasks.workunit.client.1.smithi149.stdout:2/769: unlink d8/dd/d5c/f106 0 2024-09-21T11:39:15.105 INFO:tasks.workunit.client.0.smithi118.stdout:0/371: truncate d5/d34/f50 566456 0 2024-09-21T11:39:15.105 INFO:tasks.workunit.client.0.smithi118.stdout:0/372: fsync d5/f13 0 2024-09-21T11:39:15.105 INFO:tasks.workunit.client.1.smithi149.stdout:9/641: dwrite d18/d19/d1a/d2f/d5f/f80 [0,4194304] 0 2024-09-21T11:39:15.107 INFO:tasks.workunit.client.1.smithi149.stdout:9/642: write d18/d4c/d5b/f9a [614007,75823] 0 2024-09-21T11:39:15.107 INFO:tasks.workunit.client.1.smithi149.stdout:4/669: dwrite d4/d6/d63/d15/d30/d8a/fd5 [0,4194304] 0 2024-09-21T11:39:15.108 INFO:tasks.workunit.client.1.smithi149.stdout:0/574: mknod dd/d32/db2/cc3 0 2024-09-21T11:39:15.112 INFO:tasks.workunit.client.1.smithi149.stdout:9/643: stat d18/d19/d1a/d2f/d5f/c94 0 2024-09-21T11:39:15.113 INFO:tasks.workunit.client.1.smithi149.stdout:4/670: fsync d4/d6/d63/d15/d16/d23/d62/fa9 0 2024-09-21T11:39:15.122 INFO:tasks.workunit.client.1.smithi149.stdout:5/703: dwrite d4/f5 [0,4194304] 0 2024-09-21T11:39:15.146 INFO:tasks.workunit.client.1.smithi149.stdout:6/566: sync 2024-09-21T11:39:15.146 INFO:tasks.workunit.client.1.smithi149.stdout:4/671: dread d4/d6/f56 [0,4194304] 0 2024-09-21T11:39:15.146 INFO:tasks.workunit.client.1.smithi149.stdout:6/567: chown d8/da/d11 17 1 2024-09-21T11:39:15.149 INFO:tasks.workunit.client.1.smithi149.stdout:0/575: dread dd/d1a/d1b/d50/d53/f5c [0,4194304] 0 2024-09-21T11:39:15.150 INFO:tasks.workunit.client.1.smithi149.stdout:4/672: dread d4/d6/d63/d15/d30/f6d [0,4194304] 0 2024-09-21T11:39:15.151 INFO:tasks.workunit.client.1.smithi149.stdout:4/673: write d4/d6/d63/d15/d30/d6b/daa/fac [671360,3974] 0 2024-09-21T11:39:15.186 INFO:tasks.workunit.client.0.smithi118.stdout:0/373: rmdir d5/d10/d1e/d20 39 2024-09-21T11:39:15.186 INFO:tasks.workunit.client.1.smithi149.stdout:7/734: truncate d12/d90/db8/fca 2550482 0 2024-09-21T11:39:15.188 INFO:tasks.workunit.client.1.smithi149.stdout:2/770: symlink d8/da/d13/d1a/d29/l113 0 2024-09-21T11:39:15.189 INFO:tasks.workunit.client.0.smithi118.stdout:9/216: truncate d0/f3a 3416519 0 2024-09-21T11:39:15.191 INFO:tasks.workunit.client.0.smithi118.stdout:0/374: dwrite d5/d10/d1e/d21/f42 [0,4194304] 0 2024-09-21T11:39:15.192 INFO:tasks.workunit.client.0.smithi118.stdout:0/375: readlink d5/l1b 0 2024-09-21T11:39:15.195 INFO:tasks.workunit.client.1.smithi149.stdout:3/677: sync 2024-09-21T11:39:15.195 INFO:tasks.workunit.client.1.smithi149.stdout:1/581: sync 2024-09-21T11:39:15.196 INFO:tasks.workunit.client.0.smithi118.stdout:9/217: rename d0/f25 to d0/d4/d23/d4d/f58 0 2024-09-21T11:39:15.201 INFO:tasks.workunit.client.1.smithi149.stdout:8/558: truncate d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/d5c/f71 2156417 0 2024-09-21T11:39:15.201 INFO:tasks.workunit.client.1.smithi149.stdout:8/559: stat d3 0 2024-09-21T11:39:15.202 INFO:tasks.workunit.client.1.smithi149.stdout:2/771: dread f3 [0,4194304] 0 2024-09-21T11:39:15.205 INFO:tasks.workunit.client.1.smithi149.stdout:0/576: rename dd/d1a/d1b/d50/d53 to dd/d1a/d1b/d72/d78/dc4 0 2024-09-21T11:39:15.211 INFO:tasks.workunit.client.0.smithi118.stdout:9/218: mknod d0/d4/d38/d4e/c59 0 2024-09-21T11:39:15.212 INFO:tasks.workunit.client.0.smithi118.stdout:0/376: rmdir d5/d34/d6b 0 2024-09-21T11:39:15.213 INFO:tasks.workunit.client.1.smithi149.stdout:7/735: dread d12/d90/d4a/f76 [4194304,4194304] 0 2024-09-21T11:39:15.214 INFO:tasks.workunit.client.1.smithi149.stdout:7/736: fdatasync d12/d90/d4a/d4f/d75/d94/d47/dab/fd8 0 2024-09-21T11:39:15.216 INFO:tasks.workunit.client.0.smithi118.stdout:0/377: chown d5/d10/d1e/d20/f41 2169 1 2024-09-21T11:39:15.221 INFO:tasks.workunit.client.1.smithi149.stdout:9/644: mkdir d18/d19/d29/d39/d63/dac/dce 0 2024-09-21T11:39:15.223 INFO:tasks.workunit.client.0.smithi118.stdout:0/378: symlink d5/d34/l7f 0 2024-09-21T11:39:15.224 INFO:tasks.workunit.client.0.smithi118.stdout:0/379: read d5/d10/d1e/d21/f42 [1445616,2022] 0 2024-09-21T11:39:15.225 INFO:tasks.workunit.client.1.smithi149.stdout:1/582: rmdir d2/dd/d35 39 2024-09-21T11:39:15.227 INFO:tasks.workunit.client.1.smithi149.stdout:9/645: dwrite fc [4194304,4194304] 0 2024-09-21T11:39:15.227 INFO:tasks.workunit.client.0.smithi118.stdout:9/219: rmdir d0/d4/d57 0 2024-09-21T11:39:15.228 INFO:tasks.workunit.client.0.smithi118.stdout:9/220: fsync d0/f1 0 2024-09-21T11:39:15.233 INFO:tasks.workunit.client.1.smithi149.stdout:2/772: unlink d8/dd/d8c/fa1 0 2024-09-21T11:39:15.234 INFO:tasks.workunit.client.1.smithi149.stdout:2/773: stat d8/da/d13/d2d/f94 0 2024-09-21T11:39:15.234 INFO:tasks.workunit.client.1.smithi149.stdout:2/774: chown d8/da/d13/d53 2 1 2024-09-21T11:39:15.235 INFO:tasks.workunit.client.0.smithi118.stdout:9/221: rename d0/d4/d23/l42 to d0/d4/d45/l5a 0 2024-09-21T11:39:15.237 INFO:tasks.workunit.client.0.smithi118.stdout:0/380: dread d5/d10/f14 [0,4194304] 0 2024-09-21T11:39:15.239 INFO:tasks.workunit.client.0.smithi118.stdout:9/222: creat d0/d4/d23/f5b x:0 0 0 2024-09-21T11:39:15.240 INFO:tasks.workunit.client.0.smithi118.stdout:0/381: mknod d5/d10/d1e/d33/c80 0 2024-09-21T11:39:15.241 INFO:tasks.workunit.client.1.smithi149.stdout:0/577: dwrite dd/d1a/d5a/f93 [0,4194304] 0 2024-09-21T11:39:15.242 INFO:tasks.workunit.client.1.smithi149.stdout:7/737: mkdir d12/d90/d4a/d6c/db1/de1 0 2024-09-21T11:39:15.243 INFO:tasks.workunit.client.1.smithi149.stdout:5/704: creat d4/d1d/fe1 x:0 0 0 2024-09-21T11:39:15.245 INFO:tasks.workunit.client.1.smithi149.stdout:5/705: truncate d4/d1d/d50/d60/fdb 258309 0 2024-09-21T11:39:15.245 INFO:tasks.workunit.client.1.smithi149.stdout:5/706: readlink d4/d7/lc0 0 2024-09-21T11:39:15.245 INFO:tasks.workunit.client.1.smithi149.stdout:1/583: write d2/dd/d35/f24 [1357346,116743] 0 2024-09-21T11:39:15.250 INFO:tasks.workunit.client.1.smithi149.stdout:9/646: symlink d18/d19/d1a/d2f/d30/d54/d8c/lcf 0 2024-09-21T11:39:15.253 INFO:tasks.workunit.client.0.smithi118.stdout:9/223: creat d0/f5c x:0 0 0 2024-09-21T11:39:15.255 INFO:tasks.workunit.client.1.smithi149.stdout:8/560: link d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/f56 d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fc6 0 2024-09-21T11:39:15.256 INFO:tasks.workunit.client.1.smithi149.stdout:4/674: link d4/d6/d63/d2d/l5c d4/d6/d63/d78/d98/dcc/ddb/led 0 2024-09-21T11:39:15.260 INFO:tasks.workunit.client.1.smithi149.stdout:0/578: creat dd/db3/fc5 x:0 0 0 2024-09-21T11:39:15.261 INFO:tasks.workunit.client.1.smithi149.stdout:7/738: unlink d12/d90/d68/dc4/d30/fa6 0 2024-09-21T11:39:15.262 INFO:tasks.workunit.client.0.smithi118.stdout:9/224: link d0/d4/d23/c33 d0/d4/d45/c5d 0 2024-09-21T11:39:15.265 INFO:tasks.workunit.client.1.smithi149.stdout:1/584: creat d2/dd/d35/d5b/fbd x:0 0 0 2024-09-21T11:39:15.265 INFO:tasks.workunit.client.0.smithi118.stdout:9/225: creat d0/d4/d23/f5e x:0 0 0 2024-09-21T11:39:15.267 INFO:tasks.workunit.client.1.smithi149.stdout:5/707: rename d4/d1d/d50/dc8/fc9 to d4/d7/d40/d43/d49/d88/de0/fe2 0 2024-09-21T11:39:15.269 INFO:tasks.workunit.client.0.smithi118.stdout:9/226: mkdir d0/d20/d4c/d5f 0 2024-09-21T11:39:15.270 INFO:tasks.workunit.client.1.smithi149.stdout:6/568: getdents d8/d32/d37/d2b 0 2024-09-21T11:39:15.274 INFO:tasks.workunit.client.0.smithi118.stdout:0/382: dwrite d5/d34/f3b [0,4194304] 0 2024-09-21T11:39:15.275 INFO:tasks.workunit.client.1.smithi149.stdout:7/739: creat d12/d90/d4a/d4f/d75/d94/d47/d49/fe2 x:0 0 0 2024-09-21T11:39:15.275 INFO:tasks.workunit.client.0.smithi118.stdout:0/383: dread - d5/f7e zero size 2024-09-21T11:39:15.278 INFO:tasks.workunit.client.0.smithi118.stdout:9/227: rename d0/d4/d23/f5b to d0/d4/d38/f60 0 2024-09-21T11:39:15.281 INFO:tasks.workunit.client.1.smithi149.stdout:4/675: rename d4/d6/d63/d15/d30/d6b/db3 to d4/d6/d63/d78/d98/dee 0 2024-09-21T11:39:15.282 INFO:tasks.workunit.client.1.smithi149.stdout:3/678: getdents d6/d1f/d47/d37/d3a/d95 0 2024-09-21T11:39:15.282 INFO:tasks.workunit.client.0.smithi118.stdout:9/228: mknod d0/d20/d4c/c61 0 2024-09-21T11:39:15.284 INFO:tasks.workunit.client.1.smithi149.stdout:4/676: truncate d4/d6/d63/d2d/dd6/d32/d4a/f50 87267 0 2024-09-21T11:39:15.284 INFO:tasks.workunit.client.1.smithi149.stdout:3/679: read d6/d1f/d47/d37/d3a/f6c [467288,64102] 0 2024-09-21T11:39:15.285 INFO:tasks.workunit.client.1.smithi149.stdout:3/680: chown c0 28 1 2024-09-21T11:39:15.285 INFO:tasks.workunit.client.1.smithi149.stdout:6/569: symlink d8/d32/d37/d28/d87/da4/lbb 0 2024-09-21T11:39:15.286 INFO:tasks.workunit.client.0.smithi118.stdout:0/384: mkdir d5/d81 0 2024-09-21T11:39:15.288 INFO:tasks.workunit.client.0.smithi118.stdout:0/385: chown d5/d10/d1e/d20/f2f 3122 1 2024-09-21T11:39:15.291 INFO:tasks.workunit.client.0.smithi118.stdout:9/229: dwrite d0/d20/f30 [0,4194304] 0 2024-09-21T11:39:15.292 INFO:tasks.workunit.client.1.smithi149.stdout:3/681: dwrite d6/d1f/d47/d37/d3a/f6c [0,4194304] 0 2024-09-21T11:39:15.294 INFO:tasks.workunit.client.1.smithi149.stdout:3/682: write d6/d1f/d47/d37/d3f/fd3 [156229,1177] 0 2024-09-21T11:39:15.294 INFO:tasks.workunit.client.1.smithi149.stdout:8/561: rmdir d3/d33/d34/d55/d5e/d9e/dc3 0 2024-09-21T11:39:15.296 INFO:tasks.workunit.client.1.smithi149.stdout:8/562: readlink d3/d33/d34/d55/d5e/d9e/dc2/l30 0 2024-09-21T11:39:15.298 INFO:tasks.workunit.client.1.smithi149.stdout:4/677: truncate d4/d6/d63/d15/d16/f33 39916 0 2024-09-21T11:39:15.299 INFO:tasks.workunit.client.1.smithi149.stdout:8/563: chown d3/d33/d34/d55/d5e/d9e/dc2/d3a/l65 2144829238 1 2024-09-21T11:39:15.301 INFO:tasks.workunit.client.1.smithi149.stdout:1/585: creat d2/dd/d35/d1c/d41/fbe x:0 0 0 2024-09-21T11:39:15.302 INFO:tasks.workunit.client.1.smithi149.stdout:1/586: chown d2/dd/d35/d1c/d41/f49 0 1 2024-09-21T11:39:15.305 INFO:tasks.workunit.client.1.smithi149.stdout:5/708: creat d4/d1d/fe3 x:0 0 0 2024-09-21T11:39:15.313 INFO:tasks.workunit.client.0.smithi118.stdout:9/230: getdents d0/d4/d38/d4e 0 2024-09-21T11:39:15.313 INFO:tasks.workunit.client.0.smithi118.stdout:9/231: read d0/d20/f30 [3166285,22720] 0 2024-09-21T11:39:15.322 INFO:tasks.workunit.client.0.smithi118.stdout:9/232: rename d0/d4/c16 to d0/c62 0 2024-09-21T11:39:15.322 INFO:tasks.workunit.client.1.smithi149.stdout:2/775: sync 2024-09-21T11:39:15.322 INFO:tasks.workunit.client.1.smithi149.stdout:8/564: rmdir d3/d12/d98 39 2024-09-21T11:39:15.323 INFO:tasks.workunit.client.1.smithi149.stdout:0/579: rename dd/d1a/d1b/d81/d97/lc2 to dd/d1a/d1b/d50/lc6 0 2024-09-21T11:39:15.324 INFO:tasks.workunit.client.0.smithi118.stdout:0/386: dwrite d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:15.325 INFO:tasks.workunit.client.0.smithi118.stdout:0/387: truncate d5/f70 213633 0 2024-09-21T11:39:15.326 INFO:tasks.workunit.client.0.smithi118.stdout:9/233: mknod d0/d20/d4c/d5f/c63 0 2024-09-21T11:39:15.326 INFO:tasks.workunit.client.1.smithi149.stdout:0/580: write dd/d1a/f9f [590303,12680] 0 2024-09-21T11:39:15.328 INFO:tasks.workunit.client.1.smithi149.stdout:7/740: dwrite d12/f1e [0,4194304] 0 2024-09-21T11:39:15.329 INFO:tasks.workunit.client.0.smithi118.stdout:0/388: creat d5/d34/f82 x:0 0 0 2024-09-21T11:39:15.329 INFO:tasks.workunit.client.0.smithi118.stdout:0/389: dread - d5/d34/f82 zero size 2024-09-21T11:39:15.332 INFO:tasks.workunit.client.0.smithi118.stdout:9/234: creat d0/d20/f64 x:0 0 0 2024-09-21T11:39:15.334 INFO:tasks.workunit.client.0.smithi118.stdout:0/390: creat d5/d10/d1e/d21/d2a/f83 x:0 0 0 2024-09-21T11:39:15.335 INFO:tasks.workunit.client.0.smithi118.stdout:0/391: write d5/d34/f82 [87338,78868] 0 2024-09-21T11:39:15.336 INFO:tasks.workunit.client.1.smithi149.stdout:1/587: creat d2/d5/d8/fbf x:0 0 0 2024-09-21T11:39:15.336 INFO:tasks.workunit.client.0.smithi118.stdout:9/235: chown d0/d4/d45/l5a 442557238 1 2024-09-21T11:39:15.337 INFO:tasks.workunit.client.0.smithi118.stdout:9/236: chown d0/fb 183 1 2024-09-21T11:39:15.337 INFO:tasks.workunit.client.1.smithi149.stdout:8/565: mknod d3/d12/cc7 0 2024-09-21T11:39:15.338 INFO:tasks.workunit.client.1.smithi149.stdout:4/678: dwrite d4/d6/d63/d15/d30/d6b/daa/fe9 [0,4194304] 0 2024-09-21T11:39:15.339 INFO:tasks.workunit.client.1.smithi149.stdout:2/776: dwrite d8/da/d13/d1a/d29/f58 [4194304,4194304] 0 2024-09-21T11:39:15.339 INFO:tasks.workunit.client.1.smithi149.stdout:1/588: readlink d2/d5/la5 0 2024-09-21T11:39:15.340 INFO:tasks.workunit.client.0.smithi118.stdout:0/392: symlink d5/d10/l84 0 2024-09-21T11:39:15.341 INFO:tasks.workunit.client.1.smithi149.stdout:5/709: creat d4/d7/d40/d43/fe4 x:0 0 0 2024-09-21T11:39:15.343 INFO:tasks.workunit.client.0.smithi118.stdout:9/237: mknod d0/d4/d45/c65 0 2024-09-21T11:39:15.344 INFO:tasks.workunit.client.0.smithi118.stdout:9/238: dread - d0/f5c zero size 2024-09-21T11:39:15.344 INFO:tasks.workunit.client.0.smithi118.stdout:0/393: symlink d5/d29/l85 0 2024-09-21T11:39:15.345 INFO:tasks.workunit.client.1.smithi149.stdout:6/570: rename d8/d32/d37/d28/d2e/lb1 to d8/d32/d37/lbc 0 2024-09-21T11:39:15.345 INFO:tasks.workunit.client.1.smithi149.stdout:7/741: symlink d12/d90/d4a/le3 0 2024-09-21T11:39:15.348 INFO:tasks.workunit.client.0.smithi118.stdout:9/239: mkdir d0/d20/d4c/d5f/d66 0 2024-09-21T11:39:15.349 INFO:tasks.workunit.client.1.smithi149.stdout:1/589: mkdir d2/dd/d35/d5b/dc0 0 2024-09-21T11:39:15.352 INFO:tasks.workunit.client.0.smithi118.stdout:0/394: dwrite d5/d10/f51 [0,4194304] 0 2024-09-21T11:39:15.359 INFO:tasks.workunit.client.0.smithi118.stdout:9/240: mknod d0/d4/d38/d4e/c67 0 2024-09-21T11:39:15.359 INFO:tasks.workunit.client.0.smithi118.stdout:9/241: chown d0 0 1 2024-09-21T11:39:15.360 INFO:tasks.workunit.client.1.smithi149.stdout:6/571: dwrite d8/d32/d37/f90 [0,4194304] 0 2024-09-21T11:39:15.361 INFO:tasks.workunit.client.0.smithi118.stdout:9/242: truncate d0/f1c 414916 0 2024-09-21T11:39:15.362 INFO:tasks.workunit.client.0.smithi118.stdout:0/395: dwrite d5/d10/d1e/f4c [0,4194304] 0 2024-09-21T11:39:15.364 INFO:tasks.workunit.client.1.smithi149.stdout:7/742: dwrite d12/d90/d4a/d6c/fbf [0,4194304] 0 2024-09-21T11:39:15.366 INFO:tasks.workunit.client.0.smithi118.stdout:0/396: symlink d5/d10/d1e/d23/l86 0 2024-09-21T11:39:15.368 INFO:tasks.workunit.client.1.smithi149.stdout:5/710: creat d4/d7/d40/d43/d49/d88/dcd/ddf/fe5 x:0 0 0 2024-09-21T11:39:15.368 INFO:tasks.workunit.client.1.smithi149.stdout:0/581: rename dd/d1a/d1b/d72/d78/dc4/d3a/f5b to dd/d1a/d5a/d65/fc7 0 2024-09-21T11:39:15.375 INFO:tasks.workunit.client.1.smithi149.stdout:7/743: creat d12/d90/d4a/d6c/db1/fe4 x:0 0 0 2024-09-21T11:39:15.378 INFO:tasks.workunit.client.1.smithi149.stdout:1/590: mkdir d2/d5/d8/dc1 0 2024-09-21T11:39:15.384 INFO:tasks.workunit.client.0.smithi118.stdout:0/397: truncate d5/d10/d1e/d21/d2a/d48/f64 3005354 0 2024-09-21T11:39:15.386 INFO:tasks.workunit.client.1.smithi149.stdout:4/679: truncate d4/d6/d63/d2d/fae 786863 0 2024-09-21T11:39:15.386 INFO:tasks.workunit.client.0.smithi118.stdout:0/398: mkdir d5/d34/d44/d87 0 2024-09-21T11:39:15.388 INFO:tasks.workunit.client.0.smithi118.stdout:0/399: unlink d5/d10/d1e/d23/c71 0 2024-09-21T11:39:15.389 INFO:tasks.workunit.client.1.smithi149.stdout:4/680: fdatasync d4/f55 0 2024-09-21T11:39:15.390 INFO:tasks.workunit.client.0.smithi118.stdout:0/400: read d5/d10/d1e/d23/d3a/f46 [2007556,5104] 0 2024-09-21T11:39:15.390 INFO:tasks.workunit.client.1.smithi149.stdout:8/566: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fc6 [4194304,4194304] 0 2024-09-21T11:39:15.392 INFO:tasks.workunit.client.0.smithi118.stdout:0/401: mknod d5/d34/d44/d7c/c88 0 2024-09-21T11:39:15.393 INFO:tasks.workunit.client.1.smithi149.stdout:6/572: rmdir d8/da/db9 0 2024-09-21T11:39:15.394 INFO:tasks.workunit.client.0.smithi118.stdout:0/402: chown d5/d29/l85 351133581 1 2024-09-21T11:39:15.394 INFO:tasks.workunit.client.0.smithi118.stdout:0/403: stat d5/d10/d1e/d21/d2a 0 2024-09-21T11:39:15.395 INFO:tasks.workunit.client.1.smithi149.stdout:5/711: dwrite d4/d7/d40/d43/d49/d88/fd8 [0,4194304] 0 2024-09-21T11:39:15.395 INFO:tasks.workunit.client.1.smithi149.stdout:7/744: dread d12/d90/f45 [0,4194304] 0 2024-09-21T11:39:15.396 INFO:tasks.workunit.client.1.smithi149.stdout:0/582: getdents dd/d2d 0 2024-09-21T11:39:15.401 INFO:tasks.workunit.client.0.smithi118.stdout:0/404: dwrite d5/f5c [0,4194304] 0 2024-09-21T11:39:15.401 INFO:tasks.workunit.client.1.smithi149.stdout:4/681: unlink d4/d6/d18/f2a 0 2024-09-21T11:39:15.404 INFO:tasks.workunit.client.1.smithi149.stdout:8/567: unlink d3/d33/d34/d55/d5e/d9e/dc2/d3a/f73 0 2024-09-21T11:39:15.406 INFO:tasks.workunit.client.1.smithi149.stdout:9/647: sync 2024-09-21T11:39:15.407 INFO:tasks.workunit.client.1.smithi149.stdout:9/648: readlink d18/l3a 0 2024-09-21T11:39:15.408 INFO:tasks.workunit.client.0.smithi118.stdout:0/405: mknod d5/d10/d1e/d23/c89 0 2024-09-21T11:39:15.408 INFO:tasks.workunit.client.1.smithi149.stdout:6/573: mknod d8/d32/d37/d79/cbd 0 2024-09-21T11:39:15.410 INFO:tasks.workunit.client.1.smithi149.stdout:7/745: creat d12/d90/d4a/d6c/d8c/fe5 x:0 0 0 2024-09-21T11:39:15.413 INFO:tasks.workunit.client.1.smithi149.stdout:1/591: rename d2/d5/d8/f48 to d2/d5/fc2 0 2024-09-21T11:39:15.416 INFO:tasks.workunit.client.1.smithi149.stdout:5/712: creat d4/d7/d40/d43/d49/fe6 x:0 0 0 2024-09-21T11:39:15.416 INFO:tasks.workunit.client.0.smithi118.stdout:0/406: creat d5/d10/d1e/d21/d2a/d48/f8a x:0 0 0 2024-09-21T11:39:15.419 INFO:tasks.workunit.client.0.smithi118.stdout:0/407: creat d5/d10/d1e/d23/d3a/f8b x:0 0 0 2024-09-21T11:39:15.420 INFO:tasks.workunit.client.1.smithi149.stdout:4/682: dwrite d4/d6/d63/d15/d16/d23/d62/fa2 [0,4194304] 0 2024-09-21T11:39:15.421 INFO:tasks.workunit.client.1.smithi149.stdout:5/713: truncate d4/d1d/d50/fbc 510703 0 2024-09-21T11:39:15.421 INFO:tasks.workunit.client.1.smithi149.stdout:9/649: dwrite d18/d19/d29/fbf [0,4194304] 0 2024-09-21T11:39:15.423 INFO:tasks.workunit.client.1.smithi149.stdout:8/568: rename d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/c78 to d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/cc8 0 2024-09-21T11:39:15.469 INFO:tasks.workunit.client.1.smithi149.stdout:3/683: sync 2024-09-21T11:39:15.470 INFO:tasks.workunit.client.1.smithi149.stdout:3/684: dread - d6/d1f/d47/dce/fe1 zero size 2024-09-21T11:39:15.496 INFO:tasks.workunit.client.1.smithi149.stdout:2/777: sync 2024-09-21T11:39:15.506 INFO:tasks.workunit.client.1.smithi149.stdout:2/778: dread d8/da/d13/d2d/f94 [0,4194304] 0 2024-09-21T11:39:15.537 INFO:tasks.workunit.client.1.smithi149.stdout:4/683: sync 2024-09-21T11:39:15.550 INFO:tasks.workunit.client.0.smithi118.stdout:7/101: sync 2024-09-21T11:39:15.550 INFO:tasks.workunit.client.0.smithi118.stdout:6/141: sync 2024-09-21T11:39:15.550 INFO:tasks.workunit.client.0.smithi118.stdout:5/73: sync 2024-09-21T11:39:15.551 INFO:tasks.workunit.client.0.smithi118.stdout:6/142: dread - d8/d14/f26 zero size 2024-09-21T11:39:15.551 INFO:tasks.workunit.client.0.smithi118.stdout:6/143: dread - d8/d14/f26 zero size 2024-09-21T11:39:15.553 INFO:tasks.workunit.client.0.smithi118.stdout:7/102: mknod d0/c26 0 2024-09-21T11:39:15.554 INFO:tasks.workunit.client.1.smithi149.stdout:5/714: creat d4/d1d/d50/d54/d2a/fe7 x:0 0 0 2024-09-21T11:39:15.555 INFO:tasks.workunit.client.1.smithi149.stdout:9/650: fdatasync d18/d19/d1a/d2f/d5f/f73 0 2024-09-21T11:39:15.556 INFO:tasks.workunit.client.1.smithi149.stdout:9/651: chown d18/d19/d1a/lb8 0 1 2024-09-21T11:39:15.558 INFO:tasks.workunit.client.1.smithi149.stdout:7/746: creat d12/d90/d4a/d4f/d75/d94/ddc/fe6 x:0 0 0 2024-09-21T11:39:15.559 INFO:tasks.workunit.client.0.smithi118.stdout:7/103: mknod d0/c27 0 2024-09-21T11:39:15.560 INFO:tasks.workunit.client.1.smithi149.stdout:0/583: truncate dd/d2d/f91 542857 0 2024-09-21T11:39:15.561 INFO:tasks.workunit.client.1.smithi149.stdout:8/569: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9 0 2024-09-21T11:39:15.562 INFO:tasks.workunit.client.0.smithi118.stdout:5/74: symlink d0/d6/d1c/d10/d1a/l1d 0 2024-09-21T11:39:15.564 INFO:tasks.workunit.client.1.smithi149.stdout:3/685: mkdir d6/d1f/d47/d37/d3a/d95/df8 0 2024-09-21T11:39:15.565 INFO:tasks.workunit.client.0.smithi118.stdout:6/144: link d8/f22 d8/d14/f32 0 2024-09-21T11:39:15.565 INFO:tasks.workunit.client.0.smithi118.stdout:6/145: read - d8/f22 zero size 2024-09-21T11:39:15.569 INFO:tasks.workunit.client.1.smithi149.stdout:4/684: mkdir d4/d4d/d5f/d71/dd1/def 0 2024-09-21T11:39:15.570 INFO:tasks.workunit.client.1.smithi149.stdout:1/592: mkdir d2/dd/d35/d5b/dc0/dc3 0 2024-09-21T11:39:15.572 INFO:tasks.workunit.client.1.smithi149.stdout:6/574: link d8/d32/d37/d28/d87/c8c d8/da/d2c/d52/d5e/d69/cbe 0 2024-09-21T11:39:15.573 INFO:tasks.workunit.client.1.smithi149.stdout:5/715: symlink d4/d1d/d50/d54/d2a/le8 0 2024-09-21T11:39:15.574 INFO:tasks.workunit.client.1.smithi149.stdout:5/716: read - d4/fcc zero size 2024-09-21T11:39:15.577 INFO:tasks.workunit.client.1.smithi149.stdout:3/686: dread d6/d79/d7e/f89 [0,4194304] 0 2024-09-21T11:39:15.578 INFO:tasks.workunit.client.1.smithi149.stdout:9/652: creat d18/d4c/d5b/fd0 x:0 0 0 2024-09-21T11:39:15.579 INFO:tasks.workunit.client.1.smithi149.stdout:9/653: read d18/d19/d29/fc6 [477521,16654] 0 2024-09-21T11:39:15.580 INFO:tasks.workunit.client.0.smithi118.stdout:7/104: getdents d0/d3 0 2024-09-21T11:39:15.581 INFO:tasks.workunit.client.1.smithi149.stdout:0/584: fsync dd/d1a/d1b/d72/d78/dc4/d3a/d66/f69 0 2024-09-21T11:39:15.582 INFO:tasks.workunit.client.1.smithi149.stdout:0/585: chown dd/l3e 793564009 1 2024-09-21T11:39:15.582 INFO:tasks.workunit.client.1.smithi149.stdout:3/687: dwrite d6/d5f/d60/f82 [0,4194304] 0 2024-09-21T11:39:15.583 INFO:tasks.workunit.client.0.smithi118.stdout:7/105: creat d0/d3/d14/f28 x:0 0 0 2024-09-21T11:39:15.584 INFO:tasks.workunit.client.0.smithi118.stdout:7/106: stat d0/f9 0 2024-09-21T11:39:15.586 INFO:tasks.workunit.client.0.smithi118.stdout:5/75: dwrite d0/f5 [0,4194304] 0 2024-09-21T11:39:15.587 INFO:tasks.workunit.client.1.smithi149.stdout:4/685: unlink d4/d6/d63/d78/la3 0 2024-09-21T11:39:15.587 INFO:tasks.workunit.client.0.smithi118.stdout:5/76: write d0/d6/f8 [587029,31432] 0 2024-09-21T11:39:15.589 INFO:tasks.workunit.client.0.smithi118.stdout:7/107: fsync d0/d3/fd 0 2024-09-21T11:39:15.591 INFO:tasks.workunit.client.0.smithi118.stdout:7/108: dread d0/d3/f7 [0,4194304] 0 2024-09-21T11:39:15.592 INFO:tasks.workunit.client.1.smithi149.stdout:6/575: mknod d8/da/d2c/d2d/cbf 0 2024-09-21T11:39:15.594 INFO:tasks.workunit.client.0.smithi118.stdout:5/77: symlink d0/d6/d1c/l1e 0 2024-09-21T11:39:15.595 INFO:tasks.workunit.client.1.smithi149.stdout:6/576: chown d8/d32/d37/d28/d2f/c50 44470 1 2024-09-21T11:39:15.595 INFO:tasks.workunit.client.1.smithi149.stdout:6/577: stat d8/d32/d37/f61 0 2024-09-21T11:39:15.597 INFO:tasks.workunit.client.1.smithi149.stdout:4/686: dwrite d4/d6/d18/f73 [0,4194304] 0 2024-09-21T11:39:15.597 INFO:tasks.workunit.client.1.smithi149.stdout:2/779: truncate d8/da/d13/d83/ff5 2275722 0 2024-09-21T11:39:15.597 INFO:tasks.workunit.client.1.smithi149.stdout:6/578: chown d8/d32/d37/d2b/f96 413 1 2024-09-21T11:39:15.598 INFO:tasks.workunit.client.1.smithi149.stdout:4/687: read - d4/d6/d63/d2d/dd6/d32/fa4 zero size 2024-09-21T11:39:15.599 INFO:tasks.workunit.client.1.smithi149.stdout:6/579: stat d8/d32/d37/d28/f30 0 2024-09-21T11:39:15.600 INFO:tasks.workunit.client.0.smithi118.stdout:7/109: rename d0/d3/d1c to d0/d3/d29 0 2024-09-21T11:39:15.603 INFO:tasks.workunit.client.0.smithi118.stdout:5/78: symlink d0/d6/d1c/l1f 0 2024-09-21T11:39:15.605 INFO:tasks.workunit.client.1.smithi149.stdout:7/747: fsync d12/d90/db8/fca 0 2024-09-21T11:39:15.605 INFO:tasks.workunit.client.0.smithi118.stdout:7/110: creat d0/f2a x:0 0 0 2024-09-21T11:39:15.609 INFO:tasks.workunit.client.0.smithi118.stdout:5/79: mknod d0/db/c20 0 2024-09-21T11:39:15.610 INFO:tasks.workunit.client.1.smithi149.stdout:4/688: dwrite d4/d6/d63/d78/d98/dee/fe4 [0,4194304] 0 2024-09-21T11:39:15.611 INFO:tasks.workunit.client.0.smithi118.stdout:7/111: mknod d0/d3/d14/c2b 0 2024-09-21T11:39:15.613 INFO:tasks.workunit.client.1.smithi149.stdout:0/586: creat dd/d1a/d1b/d72/d78/fc8 x:0 0 0 2024-09-21T11:39:15.614 INFO:tasks.workunit.client.0.smithi118.stdout:5/80: chown d0/d6/d1c/c14 0 1 2024-09-21T11:39:15.614 INFO:tasks.workunit.client.1.smithi149.stdout:0/587: write dd/d1a/d5a/f93 [1216499,130601] 0 2024-09-21T11:39:15.614 INFO:tasks.workunit.client.1.smithi149.stdout:3/688: mknod d6/d1f/d47/d22/cf9 0 2024-09-21T11:39:15.616 INFO:tasks.workunit.client.0.smithi118.stdout:7/112: mknod d0/d3/c2c 0 2024-09-21T11:39:15.620 INFO:tasks.workunit.client.0.smithi118.stdout:5/81: creat d0/d6/d1c/da/f21 x:0 0 0 2024-09-21T11:39:15.622 INFO:tasks.workunit.client.1.smithi149.stdout:9/654: dwrite d18/d19/d1a/d2f/f38 [0,4194304] 0 2024-09-21T11:39:15.622 INFO:tasks.workunit.client.0.smithi118.stdout:7/113: mknod d0/d3/d14/c2d 0 2024-09-21T11:39:15.625 INFO:tasks.workunit.client.0.smithi118.stdout:5/82: symlink d0/l22 0 2024-09-21T11:39:15.625 INFO:tasks.workunit.client.1.smithi149.stdout:5/717: mknod d4/d1d/d50/d54/ce9 0 2024-09-21T11:39:15.626 INFO:tasks.workunit.client.0.smithi118.stdout:7/114: rename d0/d3/d14/c2d to d0/d3/d13/c2e 0 2024-09-21T11:39:15.627 INFO:tasks.workunit.client.0.smithi118.stdout:7/115: dread d0/d3/f7 [0,4194304] 0 2024-09-21T11:39:15.628 INFO:tasks.workunit.client.1.smithi149.stdout:5/718: truncate d4/d1d/fe3 526311 0 2024-09-21T11:39:15.630 INFO:tasks.workunit.client.1.smithi149.stdout:7/748: unlink d12/d90/d4a/d4f/d75/d94/d47/d49/l52 0 2024-09-21T11:39:15.631 INFO:tasks.workunit.client.1.smithi149.stdout:9/655: dwrite f16 [4194304,4194304] 0 2024-09-21T11:39:15.633 INFO:tasks.workunit.client.1.smithi149.stdout:9/656: chown d18/d19/d29/d39/l87 0 1 2024-09-21T11:39:15.634 INFO:tasks.workunit.client.1.smithi149.stdout:8/570: rename d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/c35 to d3/d12/d6e/cca 0 2024-09-21T11:39:15.640 INFO:tasks.workunit.client.1.smithi149.stdout:3/689: mkdir d6/d5f/d60/dfa 0 2024-09-21T11:39:15.643 INFO:tasks.workunit.client.1.smithi149.stdout:1/593: creat d2/d5/d8/fc4 x:0 0 0 2024-09-21T11:39:15.645 INFO:tasks.workunit.client.0.smithi118.stdout:5/83: truncate d0/fd 787498 0 2024-09-21T11:39:15.647 INFO:tasks.workunit.client.1.smithi149.stdout:2/780: unlink d8/dcb/db8/ld6 0 2024-09-21T11:39:15.648 INFO:tasks.workunit.client.1.smithi149.stdout:2/781: dread - d8/d20/d78/d7c/f9d zero size 2024-09-21T11:39:15.648 INFO:tasks.workunit.client.0.smithi118.stdout:7/116: write d0/f9 [5515832,130523] 0 2024-09-21T11:39:15.650 INFO:tasks.workunit.client.1.smithi149.stdout:5/719: mkdir d4/d7/d40/d43/d5c/d7a/d81/dea 0 2024-09-21T11:39:15.651 INFO:tasks.workunit.client.0.smithi118.stdout:5/84: dwrite d0/fe [0,4194304] 0 2024-09-21T11:39:15.651 INFO:tasks.workunit.client.1.smithi149.stdout:5/720: write d4/d1d/d50/d60/fb8 [541776,4695] 0 2024-09-21T11:39:15.652 INFO:tasks.workunit.client.0.smithi118.stdout:5/85: chown d0/d6/c17 1 1 2024-09-21T11:39:15.652 INFO:tasks.workunit.client.0.smithi118.stdout:7/117: creat d0/d3/d13/f2f x:0 0 0 2024-09-21T11:39:15.654 INFO:tasks.workunit.client.0.smithi118.stdout:7/118: write d0/f10 [319984,124168] 0 2024-09-21T11:39:15.656 INFO:tasks.workunit.client.1.smithi149.stdout:9/657: creat d18/d19/d1a/d2f/d53/fd1 x:0 0 0 2024-09-21T11:39:15.658 INFO:tasks.workunit.client.1.smithi149.stdout:6/580: rename d8/d32/d37/l4f to d8/d32/lc0 0 2024-09-21T11:39:15.659 INFO:tasks.workunit.client.0.smithi118.stdout:5/86: symlink d0/d6/d1c/l23 0 2024-09-21T11:39:15.659 INFO:tasks.workunit.client.1.smithi149.stdout:8/571: rmdir d3/d3c 39 2024-09-21T11:39:15.660 INFO:tasks.workunit.client.1.smithi149.stdout:4/689: truncate d4/d6/f5e 1523940 0 2024-09-21T11:39:15.660 INFO:tasks.workunit.client.0.smithi118.stdout:7/119: dread - d0/d3/d14/f15 zero size 2024-09-21T11:39:15.660 INFO:tasks.workunit.client.1.smithi149.stdout:0/588: getdents dd/d1a/d1b/d72/d87/da6 0 2024-09-21T11:39:15.662 INFO:tasks.workunit.client.0.smithi118.stdout:7/120: creat d0/d3/f30 x:0 0 0 2024-09-21T11:39:15.663 INFO:tasks.workunit.client.1.smithi149.stdout:8/572: dread - d3/d33/d34/d55/d5e/d9e/dc2/d21/fc0 zero size 2024-09-21T11:39:15.663 INFO:tasks.workunit.client.0.smithi118.stdout:5/87: fdatasync d0/fd 0 2024-09-21T11:39:15.664 INFO:tasks.workunit.client.1.smithi149.stdout:0/589: chown dd/d1a/d1b/d72/d78/dc4/f5c 32136180 1 2024-09-21T11:39:15.666 INFO:tasks.workunit.client.1.smithi149.stdout:7/749: creat d12/d90/d4a/d6c/da0/db9/fe7 x:0 0 0 2024-09-21T11:39:15.668 INFO:tasks.workunit.client.1.smithi149.stdout:1/594: dread d2/d2b/d6e/f76 [0,4194304] 0 2024-09-21T11:39:15.670 INFO:tasks.workunit.client.1.smithi149.stdout:3/690: dread d6/f8 [0,4194304] 0 2024-09-21T11:39:15.670 INFO:tasks.workunit.client.1.smithi149.stdout:4/690: dread d4/d6/f9a [0,4194304] 0 2024-09-21T11:39:15.671 INFO:tasks.workunit.client.1.smithi149.stdout:0/590: dread dd/d2d/f4f [0,4194304] 0 2024-09-21T11:39:15.672 INFO:tasks.workunit.client.1.smithi149.stdout:4/691: write d4/d4d/d5f/d71/fb0 [3056178,64780] 0 2024-09-21T11:39:15.673 INFO:tasks.workunit.client.1.smithi149.stdout:0/591: chown dd/db3/lb9 9844 1 2024-09-21T11:39:15.676 INFO:tasks.workunit.client.1.smithi149.stdout:3/691: dwrite d6/d79/d7e/fc1 [4194304,4194304] 0 2024-09-21T11:39:15.677 INFO:tasks.workunit.client.1.smithi149.stdout:3/692: readlink d6/l93 0 2024-09-21T11:39:15.678 INFO:tasks.workunit.client.1.smithi149.stdout:3/693: truncate d6/f1a 4752044 0 2024-09-21T11:39:15.678 INFO:tasks.workunit.client.1.smithi149.stdout:3/694: readlink d6/l3d 0 2024-09-21T11:39:15.678 INFO:tasks.workunit.client.1.smithi149.stdout:3/695: chown d6/d1f/de5/fe9 202894 1 2024-09-21T11:39:15.681 INFO:tasks.workunit.client.0.smithi118.stdout:7/121: write d0/d3/ff [3970033,88533] 0 2024-09-21T11:39:15.688 INFO:tasks.workunit.client.0.smithi118.stdout:5/88: dwrite d0/fd [0,4194304] 0 2024-09-21T11:39:15.690 INFO:tasks.workunit.client.0.smithi118.stdout:7/122: dwrite d0/f10 [0,4194304] 0 2024-09-21T11:39:15.691 INFO:tasks.workunit.client.0.smithi118.stdout:7/123: readlink d0/d3/la 0 2024-09-21T11:39:15.692 INFO:tasks.workunit.client.0.smithi118.stdout:7/124: write d0/f2a [115339,125675] 0 2024-09-21T11:39:15.694 INFO:tasks.workunit.client.0.smithi118.stdout:5/89: mknod d0/db/c24 0 2024-09-21T11:39:15.694 INFO:tasks.workunit.client.0.smithi118.stdout:8/337: sync 2024-09-21T11:39:15.694 INFO:tasks.workunit.client.0.smithi118.stdout:2/105: sync 2024-09-21T11:39:15.695 INFO:tasks.workunit.client.0.smithi118.stdout:8/338: chown d2/d32/f6c 278 1 2024-09-21T11:39:15.698 INFO:tasks.workunit.client.0.smithi118.stdout:5/90: dread d0/fd [0,4194304] 0 2024-09-21T11:39:15.702 INFO:tasks.workunit.client.1.smithi149.stdout:5/721: creat d4/d1d/d3e/d9a/feb x:0 0 0 2024-09-21T11:39:15.703 INFO:tasks.workunit.client.1.smithi149.stdout:5/722: chown d4/d1d/d3e 24237865 1 2024-09-21T11:39:15.704 INFO:tasks.workunit.client.0.smithi118.stdout:2/106: unlink de/d1f/d23/l24 0 2024-09-21T11:39:15.705 INFO:tasks.workunit.client.0.smithi118.stdout:8/339: write d2/dc/d10/d3b/f6d [887369,78777] 0 2024-09-21T11:39:15.707 INFO:tasks.workunit.client.1.smithi149.stdout:6/581: mknod d8/d32/d37/d28/d2f/d6a/cc1 0 2024-09-21T11:39:15.708 INFO:tasks.workunit.client.0.smithi118.stdout:5/91: mkdir d0/d6/d25 0 2024-09-21T11:39:15.709 INFO:tasks.workunit.client.1.smithi149.stdout:5/723: dwrite d4/d7/d40/d51/fbb [0,4194304] 0 2024-09-21T11:39:15.709 INFO:tasks.workunit.client.1.smithi149.stdout:8/573: fsync d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/f81 0 2024-09-21T11:39:15.711 INFO:tasks.workunit.client.0.smithi118.stdout:2/107: truncate de/f17 4932033 0 2024-09-21T11:39:15.714 INFO:tasks.workunit.client.0.smithi118.stdout:7/125: write d0/d3/f7 [448927,45608] 0 2024-09-21T11:39:15.714 INFO:tasks.workunit.client.1.smithi149.stdout:7/750: read d12/d90/f2c [487861,124275] 0 2024-09-21T11:39:15.715 INFO:tasks.workunit.client.0.smithi118.stdout:5/92: fdatasync d0/fd 0 2024-09-21T11:39:15.718 INFO:tasks.workunit.client.0.smithi118.stdout:2/108: write de/f10 [3658780,13330] 0 2024-09-21T11:39:15.719 INFO:tasks.workunit.client.0.smithi118.stdout:2/109: fdatasync de/f19 0 2024-09-21T11:39:15.719 INFO:tasks.workunit.client.1.smithi149.stdout:8/574: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/f68 [4194304,4194304] 0 2024-09-21T11:39:15.721 INFO:tasks.workunit.client.0.smithi118.stdout:8/340: rename d2/dc/l3f to d2/d32/l6e 0 2024-09-21T11:39:15.722 INFO:tasks.workunit.client.0.smithi118.stdout:5/93: dwrite d0/fd [0,4194304] 0 2024-09-21T11:39:15.722 INFO:tasks.workunit.client.0.smithi118.stdout:5/94: stat d0/f1b 0 2024-09-21T11:39:15.723 INFO:tasks.workunit.client.0.smithi118.stdout:7/126: symlink d0/d3/l31 0 2024-09-21T11:39:15.724 INFO:tasks.workunit.client.1.smithi149.stdout:2/782: truncate d8/da/d13/d1a/d29/f58 2623399 0 2024-09-21T11:39:15.725 INFO:tasks.workunit.client.1.smithi149.stdout:4/692: symlink d4/d6/d63/d92/lf0 0 2024-09-21T11:39:15.728 INFO:tasks.workunit.client.1.smithi149.stdout:0/592: creat dd/d1a/d1b/d72/d78/dc4/fc9 x:0 0 0 2024-09-21T11:39:15.728 INFO:tasks.workunit.client.0.smithi118.stdout:5/95: dread d0/f5 [0,4194304] 0 2024-09-21T11:39:15.732 INFO:tasks.workunit.client.0.smithi118.stdout:2/110: rename de/f10 to de/d1f/d20/f27 0 2024-09-21T11:39:15.737 INFO:tasks.workunit.client.0.smithi118.stdout:7/127: creat d0/d3/d14/f32 x:0 0 0 2024-09-21T11:39:15.741 INFO:tasks.workunit.client.0.smithi118.stdout:5/96: mkdir d0/db/d26 0 2024-09-21T11:39:15.745 INFO:tasks.workunit.client.1.smithi149.stdout:9/658: truncate f16 5942364 0 2024-09-21T11:39:15.745 INFO:tasks.workunit.client.0.smithi118.stdout:2/111: rename de to de/d28 22 2024-09-21T11:39:15.745 INFO:tasks.workunit.client.1.smithi149.stdout:3/696: dread d6/d1f/d47/f74 [0,4194304] 0 2024-09-21T11:39:15.751 INFO:tasks.workunit.client.1.smithi149.stdout:7/751: unlink d12/d90/f45 0 2024-09-21T11:39:15.755 INFO:tasks.workunit.client.0.smithi118.stdout:7/128: rename d0/d3/d29/l22 to d0/d3/d1d/l33 0 2024-09-21T11:39:15.756 INFO:tasks.workunit.client.0.smithi118.stdout:5/97: mknod d0/c27 0 2024-09-21T11:39:15.758 INFO:tasks.workunit.client.1.smithi149.stdout:4/693: rename d4/d6/d63/d2d/f6e to d4/d6/d18/ff1 0 2024-09-21T11:39:15.759 INFO:tasks.workunit.client.0.smithi118.stdout:2/112: rename c4 to de/d16/d25/c29 0 2024-09-21T11:39:15.759 INFO:tasks.workunit.client.0.smithi118.stdout:8/341: truncate d2/dc/d10/d2e/f55 416796 0 2024-09-21T11:39:15.761 INFO:tasks.workunit.client.1.smithi149.stdout:0/593: unlink dd/d1a/d1b/d72/d78/dc4/d3a/c68 0 2024-09-21T11:39:15.762 INFO:tasks.workunit.client.0.smithi118.stdout:7/129: rmdir d0/d3/d29 39 2024-09-21T11:39:15.762 INFO:tasks.workunit.client.0.smithi118.stdout:7/130: truncate d0/f9 6004438 0 2024-09-21T11:39:15.763 INFO:tasks.workunit.client.1.smithi149.stdout:6/582: mknod d8/da/d2c/d52/d5e/cc2 0 2024-09-21T11:39:15.764 INFO:tasks.workunit.client.1.smithi149.stdout:5/724: mkdir d4/d1d/d50/d54/dec 0 2024-09-21T11:39:15.766 INFO:tasks.workunit.client.0.smithi118.stdout:8/342: creat d2/dc/d16/d46/f6f x:0 0 0 2024-09-21T11:39:15.766 INFO:tasks.workunit.client.1.smithi149.stdout:3/697: write d6/d1f/d47/d22/f5d [4670647,79190] 0 2024-09-21T11:39:15.767 INFO:tasks.workunit.client.1.smithi149.stdout:3/698: readlink d6/d1f/d47/d22/l94 0 2024-09-21T11:39:15.772 INFO:tasks.workunit.client.0.smithi118.stdout:2/113: creat de/f2a x:0 0 0 2024-09-21T11:39:15.779 INFO:tasks.workunit.client.1.smithi149.stdout:4/694: symlink d4/d6/lf2 0 2024-09-21T11:39:15.780 INFO:tasks.workunit.client.0.smithi118.stdout:2/114: creat de/d22/f2b x:0 0 0 2024-09-21T11:39:15.783 INFO:tasks.workunit.client.1.smithi149.stdout:6/583: mkdir d8/da/d2c/d2d/d60/dc3 0 2024-09-21T11:39:15.783 INFO:tasks.workunit.client.0.smithi118.stdout:8/343: dread d2/dc/d10/d2e/f5f [0,4194304] 0 2024-09-21T11:39:15.783 INFO:tasks.workunit.client.0.smithi118.stdout:5/98: truncate d0/fe 2036679 0 2024-09-21T11:39:15.785 INFO:tasks.workunit.client.1.smithi149.stdout:9/659: creat d18/d36/d3c/dcb/fd2 x:0 0 0 2024-09-21T11:39:15.787 INFO:tasks.workunit.client.1.smithi149.stdout:5/725: mkdir d4/d7/d40/d51/ded 0 2024-09-21T11:39:15.788 INFO:tasks.workunit.client.0.smithi118.stdout:2/115: fdatasync de/f18 0 2024-09-21T11:39:15.788 INFO:tasks.workunit.client.1.smithi149.stdout:7/752: dwrite d12/d90/d68/dc4/f3e [4194304,4194304] 0 2024-09-21T11:39:15.789 INFO:tasks.workunit.client.1.smithi149.stdout:3/699: mknod d6/d1f/d47/d37/d3a/d95/cfb 0 2024-09-21T11:39:15.792 INFO:tasks.workunit.client.1.smithi149.stdout:1/595: link d2/dd/d35/d1c/d41/d74/lac d2/dd/d35/d1c/lc5 0 2024-09-21T11:39:15.798 INFO:tasks.workunit.client.1.smithi149.stdout:2/783: link d8/dd/f24 d8/da/d13/d1a/f114 0 2024-09-21T11:39:15.799 INFO:tasks.workunit.client.0.smithi118.stdout:5/99: mknod d0/d6/d25/c28 0 2024-09-21T11:39:15.800 INFO:tasks.workunit.client.1.smithi149.stdout:4/695: symlink d4/d6/d63/d92/lf3 0 2024-09-21T11:39:15.801 INFO:tasks.workunit.client.1.smithi149.stdout:4/696: chown d4/d6/d63/d2d/dd6/f40 46 1 2024-09-21T11:39:15.803 INFO:tasks.workunit.client.0.smithi118.stdout:8/344: creat d2/f70 x:0 0 0 2024-09-21T11:39:15.804 INFO:tasks.workunit.client.1.smithi149.stdout:9/660: creat d18/d19/d29/d39/d63/dac/fd3 x:0 0 0 2024-09-21T11:39:15.805 INFO:tasks.workunit.client.1.smithi149.stdout:9/661: chown d18/d36/d3c/d47/d99/dbe/dc7/cc9 4 1 2024-09-21T11:39:15.806 INFO:tasks.workunit.client.1.smithi149.stdout:5/726: unlink d4/d1d/d50/d60/fb7 0 2024-09-21T11:39:15.808 INFO:tasks.workunit.client.0.smithi118.stdout:5/100: mknod d0/db/d26/c29 0 2024-09-21T11:39:15.810 INFO:tasks.workunit.client.1.smithi149.stdout:8/575: getdents d3/d12 0 2024-09-21T11:39:15.810 INFO:tasks.workunit.client.0.smithi118.stdout:2/116: dread de/d16/d1c/f1d [4194304,4194304] 0 2024-09-21T11:39:15.811 INFO:tasks.workunit.client.1.smithi149.stdout:8/576: read d3/f20 [2704860,85630] 0 2024-09-21T11:39:15.812 INFO:tasks.workunit.client.0.smithi118.stdout:5/101: rmdir d0/db 39 2024-09-21T11:39:15.814 INFO:tasks.workunit.client.0.smithi118.stdout:2/117: readlink de/l13 0 2024-09-21T11:39:15.815 INFO:tasks.workunit.client.0.smithi118.stdout:2/118: chown c1 81301837 1 2024-09-21T11:39:15.819 INFO:tasks.workunit.client.0.smithi118.stdout:2/119: unlink c1 0 2024-09-21T11:39:15.820 INFO:tasks.workunit.client.0.smithi118.stdout:8/345: dread d2/dc/d10/d2e/d18/f4f [0,4194304] 0 2024-09-21T11:39:15.823 INFO:tasks.workunit.client.0.smithi118.stdout:8/346: symlink d2/dc/d16/d46/d4c/l71 0 2024-09-21T11:39:15.825 INFO:tasks.workunit.client.1.smithi149.stdout:4/697: write d4/d4d/d5f/d71/f8d [498504,5320] 0 2024-09-21T11:39:15.827 INFO:tasks.workunit.client.1.smithi149.stdout:1/596: dwrite d2/d5/d8/fa [0,4194304] 0 2024-09-21T11:39:15.829 INFO:tasks.workunit.client.1.smithi149.stdout:3/700: truncate d6/d1f/d47/d37/d3a/f46 242445 0 2024-09-21T11:39:15.829 INFO:tasks.workunit.client.0.smithi118.stdout:5/102: dwrite d0/f5 [0,4194304] 0 2024-09-21T11:39:15.830 INFO:tasks.workunit.client.0.smithi118.stdout:8/347: unlink d2/l5 0 2024-09-21T11:39:15.832 INFO:tasks.workunit.client.0.smithi118.stdout:8/348: truncate d2/dc/d10/d2e/d18/d1a/f5c 976739 0 2024-09-21T11:39:15.834 INFO:tasks.workunit.client.1.smithi149.stdout:7/753: truncate d12/d90/d4a/d4f/d75/d94/d47/d49/fa9 1452201 0 2024-09-21T11:39:15.835 INFO:tasks.workunit.client.1.smithi149.stdout:2/784: getdents d8/da/d13/d83/df6/d112 0 2024-09-21T11:39:15.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/754: chown d12/d90/d4a/ddd 529143949 1 2024-09-21T11:39:15.836 INFO:tasks.workunit.client.0.smithi118.stdout:5/103: creat d0/d6/d1c/d10/d1a/f2a x:0 0 0 2024-09-21T11:39:15.837 INFO:tasks.workunit.client.0.smithi118.stdout:5/104: write d0/f5 [3548425,74830] 0 2024-09-21T11:39:15.838 INFO:tasks.workunit.client.1.smithi149.stdout:7/755: write d12/d90/d4a/d4f/d75/d94/d47/d49/fe2 [115368,64050] 0 2024-09-21T11:39:15.838 INFO:tasks.workunit.client.0.smithi118.stdout:2/120: link de/l1b de/l2c 0 2024-09-21T11:39:15.839 INFO:tasks.workunit.client.0.smithi118.stdout:5/105: stat d0/d6/d1c/d10/d1a 0 2024-09-21T11:39:15.839 INFO:tasks.workunit.client.0.smithi118.stdout:8/349: readlink d2/dc/d10/d2e/l1d 0 2024-09-21T11:39:15.842 INFO:tasks.workunit.client.0.smithi118.stdout:8/350: write d2/dc/d10/d3b/f6d [3105078,109963] 0 2024-09-21T11:39:15.842 INFO:tasks.workunit.client.0.smithi118.stdout:2/121: truncate de/ff 335895 0 2024-09-21T11:39:15.844 INFO:tasks.workunit.client.0.smithi118.stdout:5/106: dread d0/f5 [0,4194304] 0 2024-09-21T11:39:15.845 INFO:tasks.workunit.client.1.smithi149.stdout:4/698: dread - d4/d4d/d58/fea zero size 2024-09-21T11:39:15.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/701: fsync d6/d1f/d27/f33 0 2024-09-21T11:39:15.851 INFO:tasks.workunit.client.0.smithi118.stdout:2/122: link de/ff de/d1f/d20/f2d 0 2024-09-21T11:39:15.851 INFO:tasks.workunit.client.1.smithi149.stdout:3/702: dwrite d6/d1f/fbd [0,4194304] 0 2024-09-21T11:39:15.852 INFO:tasks.workunit.client.0.smithi118.stdout:2/123: chown de/f17 64007 1 2024-09-21T11:39:15.852 INFO:tasks.workunit.client.0.smithi118.stdout:2/124: chown de 33402 1 2024-09-21T11:39:15.853 INFO:tasks.workunit.client.1.smithi149.stdout:3/703: write d6/d1f/d47/d37/d50/feb [818565,62140] 0 2024-09-21T11:39:15.853 INFO:tasks.workunit.client.1.smithi149.stdout:0/594: link dd/d32/db2/fbf dd/d1a/d5a/fca 0 2024-09-21T11:39:15.859 INFO:tasks.workunit.client.1.smithi149.stdout:5/727: rename d4/d1d/d50/d60/fdb to d4/fee 0 2024-09-21T11:39:15.859 INFO:tasks.workunit.client.1.smithi149.stdout:9/662: truncate d18/d1c/fb3 1810868 0 2024-09-21T11:39:15.860 INFO:tasks.workunit.client.1.smithi149.stdout:9/663: fdatasync d18/d19/d1a/d2f/d53/fc2 0 2024-09-21T11:39:15.861 INFO:tasks.workunit.client.1.smithi149.stdout:9/664: chown d18/d19/d1a/d2f/d5f/ca0 303352 1 2024-09-21T11:39:15.865 INFO:tasks.workunit.client.0.smithi118.stdout:2/125: truncate de/f19 3338761 0 2024-09-21T11:39:15.867 INFO:tasks.workunit.client.1.smithi149.stdout:8/577: link d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/c6f d3/d12/db1/ccb 0 2024-09-21T11:39:15.868 INFO:tasks.workunit.client.0.smithi118.stdout:8/351: dread d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:15.871 INFO:tasks.workunit.client.0.smithi118.stdout:2/126: dwrite f8 [0,4194304] 0 2024-09-21T11:39:15.873 INFO:tasks.workunit.client.0.smithi118.stdout:5/107: write d0/fe [2907029,87293] 0 2024-09-21T11:39:15.873 INFO:tasks.workunit.client.1.smithi149.stdout:8/578: dwrite d3/d33/d34/fbe [0,4194304] 0 2024-09-21T11:39:15.873 INFO:tasks.workunit.client.1.smithi149.stdout:6/584: sync 2024-09-21T11:39:15.875 INFO:tasks.workunit.client.1.smithi149.stdout:8/579: write d3/d33/d34/d72/f9c [1395551,48444] 0 2024-09-21T11:39:15.877 INFO:tasks.workunit.client.1.smithi149.stdout:8/580: fdatasync d3/d33/d34/d55/d5e/d9e/dc2/d90/f92 0 2024-09-21T11:39:15.879 INFO:tasks.workunit.client.1.smithi149.stdout:3/704: unlink d6/d1f/d27/f6a 0 2024-09-21T11:39:15.880 INFO:tasks.workunit.client.0.smithi118.stdout:5/108: dwrite d0/d6/d1c/da/f21 [0,4194304] 0 2024-09-21T11:39:15.886 INFO:tasks.workunit.client.1.smithi149.stdout:1/597: rename d2/f21 to d2/dd/d35/d1c/d37/da3/fc6 0 2024-09-21T11:39:15.888 INFO:tasks.workunit.client.0.smithi118.stdout:8/352: creat d2/f72 x:0 0 0 2024-09-21T11:39:15.889 INFO:tasks.workunit.client.1.smithi149.stdout:5/728: mkdir d4/d7/d40/d51/def 0 2024-09-21T11:39:15.891 INFO:tasks.workunit.client.0.smithi118.stdout:5/109: mknod d0/d6/c2b 0 2024-09-21T11:39:15.893 INFO:tasks.workunit.client.1.smithi149.stdout:9/665: mknod d18/d1c/cd4 0 2024-09-21T11:39:15.895 INFO:tasks.workunit.client.0.smithi118.stdout:8/353: dwrite d2/dc/d10/d3b/f64 [4194304,4194304] 0 2024-09-21T11:39:15.902 INFO:tasks.workunit.client.0.smithi118.stdout:8/354: mkdir d2/d73 0 2024-09-21T11:39:15.902 INFO:tasks.workunit.client.1.smithi149.stdout:0/595: dwrite dd/d32/f37 [0,4194304] 0 2024-09-21T11:39:15.903 INFO:tasks.workunit.client.1.smithi149.stdout:0/596: readlink dd/d1a/d1b/d72/d78/dc4/d3a/l41 0 2024-09-21T11:39:15.908 INFO:tasks.workunit.client.0.smithi118.stdout:8/355: mkdir d2/dc/d16/d46/d4c/d63/d74 0 2024-09-21T11:39:15.912 INFO:tasks.workunit.client.1.smithi149.stdout:0/597: dwrite dd/d1a/d5a/f80 [0,4194304] 0 2024-09-21T11:39:15.913 INFO:tasks.workunit.client.1.smithi149.stdout:5/729: creat d4/d7/d40/d43/d49/d88/ff0 x:0 0 0 2024-09-21T11:39:15.915 INFO:tasks.workunit.client.0.smithi118.stdout:8/356: mkdir d2/dc/d16/d46/d4c/d63/d75 0 2024-09-21T11:39:15.919 INFO:tasks.workunit.client.0.smithi118.stdout:8/357: unlink d2/c15 0 2024-09-21T11:39:15.920 INFO:tasks.workunit.client.0.smithi118.stdout:8/358: dread - d2/dc/d16/d46/f69 zero size 2024-09-21T11:39:15.921 INFO:tasks.workunit.client.1.smithi149.stdout:2/785: link d8/da/d13/f2e d8/d20/f115 0 2024-09-21T11:39:15.924 INFO:tasks.workunit.client.1.smithi149.stdout:6/585: mkdir d8/d32/d37/d2b/d7d/db8/dc4 0 2024-09-21T11:39:15.924 INFO:tasks.workunit.client.0.smithi118.stdout:8/359: symlink d2/dc/d10/d2e/d18/d1a/l76 0 2024-09-21T11:39:15.927 INFO:tasks.workunit.client.1.smithi149.stdout:8/581: mknod d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/ccc 0 2024-09-21T11:39:15.928 INFO:tasks.workunit.client.1.smithi149.stdout:2/786: dwrite d8/da/f28 [0,4194304] 0 2024-09-21T11:39:15.929 INFO:tasks.workunit.client.1.smithi149.stdout:1/598: link d2/d5/f34 d2/dd/d35/d1c/d7a/fc7 0 2024-09-21T11:39:15.931 INFO:tasks.workunit.client.1.smithi149.stdout:0/598: creat dd/d1a/fcb x:0 0 0 2024-09-21T11:39:15.935 INFO:tasks.workunit.client.1.smithi149.stdout:7/756: rename d12/d90/d4a/d4f/d75/d94/d47/d49/fa9 to d12/d90/d4a/d6c/da0/dbb/fe8 0 2024-09-21T11:39:15.936 INFO:tasks.workunit.client.0.smithi118.stdout:8/360: rmdir d2/dc/d16/d46/d4c/d63/d75 0 2024-09-21T11:39:15.937 INFO:tasks.workunit.client.1.smithi149.stdout:4/699: getdents d4/d6/d63/d15/d30/d6b/daa 0 2024-09-21T11:39:15.938 INFO:tasks.workunit.client.1.smithi149.stdout:3/705: truncate d6/d1f/d47/d37/f4b 1388608 0 2024-09-21T11:39:15.939 INFO:tasks.workunit.client.1.smithi149.stdout:6/586: symlink d8/d32/d64/d97/lc5 0 2024-09-21T11:39:15.939 INFO:tasks.workunit.client.0.smithi118.stdout:5/110: dread d0/d6/f7 [0,4194304] 0 2024-09-21T11:39:15.940 INFO:tasks.workunit.client.1.smithi149.stdout:8/582: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d90/f92 [0,4194304] 0 2024-09-21T11:39:15.941 INFO:tasks.workunit.client.0.smithi118.stdout:8/361: creat d2/dc/d49/f77 x:0 0 0 2024-09-21T11:39:15.942 INFO:tasks.workunit.client.0.smithi118.stdout:5/111: mkdir d0/d6/d1c/d2c 0 2024-09-21T11:39:15.943 INFO:tasks.workunit.client.1.smithi149.stdout:1/599: dwrite d2/dd/d35/d5b/fbd [0,4194304] 0 2024-09-21T11:39:15.946 INFO:tasks.workunit.client.0.smithi118.stdout:5/112: symlink d0/d6/d1c/d10/l2d 0 2024-09-21T11:39:15.946 INFO:tasks.workunit.client.1.smithi149.stdout:0/599: creat dd/d35/fcc x:0 0 0 2024-09-21T11:39:15.947 INFO:tasks.workunit.client.0.smithi118.stdout:5/113: fdatasync d0/d6/d1c/da/f21 0 2024-09-21T11:39:15.949 INFO:tasks.workunit.client.0.smithi118.stdout:8/362: symlink d2/dc/d35/d50/l78 0 2024-09-21T11:39:15.952 INFO:tasks.workunit.client.1.smithi149.stdout:3/706: creat d6/d79/d7e/dcb/ffc x:0 0 0 2024-09-21T11:39:15.953 INFO:tasks.workunit.client.1.smithi149.stdout:9/666: getdents d18/d19/d1a/d2f/d7d 0 2024-09-21T11:39:15.954 INFO:tasks.workunit.client.0.smithi118.stdout:8/363: dread d2/dc/d10/d3b/f6d [0,4194304] 0 2024-09-21T11:39:15.954 INFO:tasks.workunit.client.1.smithi149.stdout:6/587: mknod d8/d32/d37/d28/d87/cc6 0 2024-09-21T11:39:15.955 INFO:tasks.workunit.client.1.smithi149.stdout:4/700: dwrite d4/d6/d63/d2d/dd6/fbc [0,4194304] 0 2024-09-21T11:39:15.956 INFO:tasks.workunit.client.1.smithi149.stdout:8/583: symlink d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/lcd 0 2024-09-21T11:39:15.957 INFO:tasks.workunit.client.1.smithi149.stdout:2/787: dread d8/d20/d78/f93 [4194304,4194304] 0 2024-09-21T11:39:15.969 INFO:tasks.workunit.client.0.smithi118.stdout:4/142: sync 2024-09-21T11:39:15.972 INFO:tasks.workunit.client.0.smithi118.stdout:5/114: link d0/d6/d1c/da/f18 d0/f2e 0 2024-09-21T11:39:15.974 INFO:tasks.workunit.client.1.smithi149.stdout:5/730: rename d4/c6 to d4/d1d/d3e/cf1 0 2024-09-21T11:39:15.976 INFO:tasks.workunit.client.1.smithi149.stdout:5/731: chown d4/d7/d40/f59 0 1 2024-09-21T11:39:15.977 INFO:tasks.workunit.client.1.smithi149.stdout:0/600: write dd/d1a/d1b/d72/d78/dc4/f5c [274046,10948] 0 2024-09-21T11:39:15.979 INFO:tasks.workunit.client.0.smithi118.stdout:4/143: mknod d2/d6/de/d1c/d23/c38 0 2024-09-21T11:39:15.981 INFO:tasks.workunit.client.0.smithi118.stdout:5/115: mknod d0/d6/d1c/d10/c2f 0 2024-09-21T11:39:15.982 INFO:tasks.workunit.client.0.smithi118.stdout:5/116: read d0/f2e [428890,70493] 0 2024-09-21T11:39:15.982 INFO:tasks.workunit.client.0.smithi118.stdout:5/117: fdatasync d0/fe 0 2024-09-21T11:39:15.983 INFO:tasks.workunit.client.1.smithi149.stdout:3/707: mkdir d6/d1f/d47/d22/d8d/dfd 0 2024-09-21T11:39:15.983 INFO:tasks.workunit.client.1.smithi149.stdout:5/732: dwrite d4/d7/d40/d51/f8c [0,4194304] 0 2024-09-21T11:39:15.987 INFO:tasks.workunit.client.1.smithi149.stdout:8/584: symlink d3/d12/d6e/d79/d8e/lce 0 2024-09-21T11:39:15.988 INFO:tasks.workunit.client.1.smithi149.stdout:8/585: chown d3/d33/d34/d55/d5e/la0 35 1 2024-09-21T11:39:15.991 INFO:tasks.workunit.client.1.smithi149.stdout:8/586: dread d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/d5c/f9f [0,4194304] 0 2024-09-21T11:39:15.995 INFO:tasks.workunit.client.1.smithi149.stdout:7/757: rename d12/d90 to d12/d5b/db5/dc5/de9 0 2024-09-21T11:39:15.996 INFO:tasks.workunit.client.0.smithi118.stdout:8/364: getdents d2/dc/d16 0 2024-09-21T11:39:15.997 INFO:tasks.workunit.client.1.smithi149.stdout:7/758: write d12/d5b/db5/dc5/de9/d4a/d6c/fd5 [212581,128276] 0 2024-09-21T11:39:16.000 INFO:tasks.workunit.client.1.smithi149.stdout:7/759: dread d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/d49/fe2 [0,4194304] 0 2024-09-21T11:39:16.003 INFO:tasks.workunit.client.0.smithi118.stdout:4/144: write d2/d6/de/d1c/d23/f2c [1340479,33621] 0 2024-09-21T11:39:16.007 INFO:tasks.workunit.client.0.smithi118.stdout:8/365: mkdir d2/d73/d79 0 2024-09-21T11:39:16.007 INFO:tasks.workunit.client.0.smithi118.stdout:8/366: chown d2/dc/d10/d2e/d18/l4d 657 1 2024-09-21T11:39:16.012 INFO:tasks.workunit.client.1.smithi149.stdout:5/733: write d4/d7/d40/f53 [1596350,47799] 0 2024-09-21T11:39:16.012 INFO:tasks.workunit.client.1.smithi149.stdout:1/600: link d2/d5/d3d/d88/l70 d2/dd/d35/d1c/d7a/lc8 0 2024-09-21T11:39:16.015 INFO:tasks.workunit.client.1.smithi149.stdout:8/587: creat d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fcf x:0 0 0 2024-09-21T11:39:16.015 INFO:tasks.workunit.client.1.smithi149.stdout:2/788: write d8/dd/f38 [1751239,54948] 0 2024-09-21T11:39:16.015 INFO:tasks.workunit.client.1.smithi149.stdout:1/601: write d2/dd/d35/f8d [2834122,116868] 0 2024-09-21T11:39:16.016 INFO:tasks.workunit.client.1.smithi149.stdout:9/667: dwrite d18/d1c/fb3 [0,4194304] 0 2024-09-21T11:39:16.017 INFO:tasks.workunit.client.0.smithi118.stdout:5/118: getdents d0/db/d26 0 2024-09-21T11:39:16.020 INFO:tasks.workunit.client.0.smithi118.stdout:8/367: dwrite d2/dc/d10/d2e/d18/f2f [4194304,4194304] 0 2024-09-21T11:39:16.020 INFO:tasks.workunit.client.1.smithi149.stdout:4/701: rename d4/d6/d63/d15/d16/d23/d62/fa9 to d4/d4d/d5f/ff4 0 2024-09-21T11:39:16.020 INFO:tasks.workunit.client.1.smithi149.stdout:4/702: stat d4/d4d/d58/db4 0 2024-09-21T11:39:16.021 INFO:tasks.workunit.client.0.smithi118.stdout:4/145: rename d2/d6/de/d1c/d23/d26/c29 to d2/d6/c39 0 2024-09-21T11:39:16.029 INFO:tasks.workunit.client.0.smithi118.stdout:5/119: rename d0/d6/d1c/d10 to d0/d6/d1c/d30 0 2024-09-21T11:39:16.031 INFO:tasks.workunit.client.0.smithi118.stdout:4/146: symlink d2/l3a 0 2024-09-21T11:39:16.033 INFO:tasks.workunit.client.1.smithi149.stdout:0/601: dwrite dd/d2d/f91 [0,4194304] 0 2024-09-21T11:39:16.033 INFO:tasks.workunit.client.0.smithi118.stdout:4/147: write d2/d6/de/d1c/d23/f2c [563656,26581] 0 2024-09-21T11:39:16.035 INFO:tasks.workunit.client.1.smithi149.stdout:6/588: rmdir d8/da/d3d/d85 0 2024-09-21T11:39:16.038 INFO:tasks.workunit.client.1.smithi149.stdout:6/589: fdatasync d8/d32/d37/d28/d2f/d6a/f95 0 2024-09-21T11:39:16.038 INFO:tasks.workunit.client.0.smithi118.stdout:5/120: dread d0/d6/d1c/da/f18 [0,4194304] 0 2024-09-21T11:39:16.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/590: truncate d8/d32/d37/f61 4681782 0 2024-09-21T11:39:16.039 INFO:tasks.workunit.client.0.smithi118.stdout:4/148: creat d2/d6/de/d1c/d23/d26/d31/f3b x:0 0 0 2024-09-21T11:39:16.040 INFO:tasks.workunit.client.0.smithi118.stdout:8/368: link d2/dc/c33 d2/c7a 0 2024-09-21T11:39:16.044 INFO:tasks.workunit.client.0.smithi118.stdout:8/369: write d2/dc/d10/d2e/f5f [825981,30317] 0 2024-09-21T11:39:16.045 INFO:tasks.workunit.client.0.smithi118.stdout:8/370: chown d2/d32/l6e 7564 1 2024-09-21T11:39:16.047 INFO:tasks.workunit.client.0.smithi118.stdout:8/371: stat d2/dc/d10/d2e/d18/l5a 0 2024-09-21T11:39:16.048 INFO:tasks.workunit.client.0.smithi118.stdout:5/121: dwrite d0/d6/d1c/da/f21 [0,4194304] 0 2024-09-21T11:39:16.051 INFO:tasks.workunit.client.0.smithi118.stdout:8/372: chown d2/dc/d10/d2e/d18/l41 1 1 2024-09-21T11:39:16.052 INFO:tasks.workunit.client.1.smithi149.stdout:2/789: rmdir d8/da/d13/d1a/dc5 39 2024-09-21T11:39:16.052 INFO:tasks.workunit.client.1.smithi149.stdout:9/668: mkdir d18/d19/d1a/d2f/d43/dd5 0 2024-09-21T11:39:16.052 INFO:tasks.workunit.client.0.smithi118.stdout:8/373: read d2/dc/f26 [88595,34926] 0 2024-09-21T11:39:16.054 INFO:tasks.workunit.client.0.smithi118.stdout:4/149: dwrite d2/d6/dd/f15 [4194304,4194304] 0 2024-09-21T11:39:16.055 INFO:tasks.workunit.client.0.smithi118.stdout:5/122: rmdir d0/d6/d1c/d30 39 2024-09-21T11:39:16.059 INFO:tasks.workunit.client.1.smithi149.stdout:9/669: dwrite d18/d36/d3c/d47/f85 [0,4194304] 0 2024-09-21T11:39:16.060 INFO:tasks.workunit.client.1.smithi149.stdout:9/670: dread - d18/d36/d3c/dcb/fd2 zero size 2024-09-21T11:39:16.063 INFO:tasks.workunit.client.1.smithi149.stdout:8/588: write d3/fa [2554798,38238] 0 2024-09-21T11:39:16.071 INFO:tasks.workunit.client.0.smithi118.stdout:8/374: link d2/dc/d16/l31 d2/dc/d16/l7b 0 2024-09-21T11:39:16.073 INFO:tasks.workunit.client.0.smithi118.stdout:5/123: creat d0/f31 x:0 0 0 2024-09-21T11:39:16.074 INFO:tasks.workunit.client.1.smithi149.stdout:1/602: symlink d2/d5/lc9 0 2024-09-21T11:39:16.075 INFO:tasks.workunit.client.0.smithi118.stdout:4/150: write f1 [270465,27279] 0 2024-09-21T11:39:16.077 INFO:tasks.workunit.client.1.smithi149.stdout:7/760: dwrite fa [0,4194304] 0 2024-09-21T11:39:16.077 INFO:tasks.workunit.client.0.smithi118.stdout:5/124: symlink d0/db/l32 0 2024-09-21T11:39:16.079 INFO:tasks.workunit.client.1.smithi149.stdout:5/734: truncate d4/d7/f32 250814 0 2024-09-21T11:39:16.079 INFO:tasks.workunit.client.1.smithi149.stdout:2/790: fsync d8/d11/fb6 0 2024-09-21T11:39:16.079 INFO:tasks.workunit.client.1.smithi149.stdout:7/761: read d12/d5b/db5/dc5/de9/d4a/d4f/f51 [860256,62045] 0 2024-09-21T11:39:16.080 INFO:tasks.workunit.client.0.smithi118.stdout:8/375: mkdir d2/d7c 0 2024-09-21T11:39:16.082 INFO:tasks.workunit.client.1.smithi149.stdout:4/703: link d4/d4d/d5f/ff4 d4/d6/d63/d78/d98/dee/ff5 0 2024-09-21T11:39:16.083 INFO:tasks.workunit.client.0.smithi118.stdout:4/151: dwrite d2/d6/dd/f15 [12582912,4194304] 0 2024-09-21T11:39:16.085 INFO:tasks.workunit.client.0.smithi118.stdout:4/152: write d2/d6/f14 [803116,79008] 0 2024-09-21T11:39:16.085 INFO:tasks.workunit.client.0.smithi118.stdout:5/125: chown d0/d6/d1c/d30 22 1 2024-09-21T11:39:16.086 INFO:tasks.workunit.client.1.smithi149.stdout:3/708: getdents d6/d1f/d47/d37/d3f 0 2024-09-21T11:39:16.091 INFO:tasks.workunit.client.1.smithi149.stdout:8/589: unlink d3/d12/c48 0 2024-09-21T11:39:16.092 INFO:tasks.workunit.client.0.smithi118.stdout:4/153: readlink d2/d6/dd/l30 0 2024-09-21T11:39:16.093 INFO:tasks.workunit.client.0.smithi118.stdout:5/126: dwrite d0/fe [0,4194304] 0 2024-09-21T11:39:16.094 INFO:tasks.workunit.client.0.smithi118.stdout:5/127: stat d0/d6/d1c/l1f 0 2024-09-21T11:39:16.094 INFO:tasks.workunit.client.0.smithi118.stdout:4/154: chown d2/d6/de 18072 1 2024-09-21T11:39:16.098 INFO:tasks.workunit.client.1.smithi149.stdout:2/791: unlink d8/dd/f24 0 2024-09-21T11:39:16.100 INFO:tasks.workunit.client.1.smithi149.stdout:5/735: symlink d4/d7/d40/d43/d5c/d7a/d81/lf2 0 2024-09-21T11:39:16.103 INFO:tasks.workunit.client.1.smithi149.stdout:4/704: dread - d4/d4d/d5f/f94 zero size 2024-09-21T11:39:16.105 INFO:tasks.workunit.client.0.smithi118.stdout:5/128: mkdir d0/d6/d1c/d30/d1a/d33 0 2024-09-21T11:39:16.106 INFO:tasks.workunit.client.1.smithi149.stdout:7/762: symlink d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/d49/lea 0 2024-09-21T11:39:16.107 INFO:tasks.workunit.client.0.smithi118.stdout:8/376: getdents d2/dc/d16/d46/d4c/d63 0 2024-09-21T11:39:16.109 INFO:tasks.workunit.client.1.smithi149.stdout:9/671: fdatasync d18/d19/d1a/f26 0 2024-09-21T11:39:16.110 INFO:tasks.workunit.client.1.smithi149.stdout:9/672: write d18/d19/d29/f5c [2595886,1549] 0 2024-09-21T11:39:16.110 INFO:tasks.workunit.client.1.smithi149.stdout:7/763: dread d12/d5b/db5/dc5/de9/d4a/d9e/fd1 [0,4194304] 0 2024-09-21T11:39:16.112 INFO:tasks.workunit.client.1.smithi149.stdout:3/709: creat d6/d1f/d27/d83/ffe x:0 0 0 2024-09-21T11:39:16.114 INFO:tasks.workunit.client.1.smithi149.stdout:0/602: creat dd/d1a/d1b/d50/fcd x:0 0 0 2024-09-21T11:39:16.115 INFO:tasks.workunit.client.1.smithi149.stdout:0/603: write dd/d1a/d1b/d72/d85/faf [3563343,55435] 0 2024-09-21T11:39:16.116 INFO:tasks.workunit.client.1.smithi149.stdout:8/590: creat d3/d33/d34/d55/d5e/fd0 x:0 0 0 2024-09-21T11:39:16.118 INFO:tasks.workunit.client.0.smithi118.stdout:5/129: mknod d0/c34 0 2024-09-21T11:39:16.119 INFO:tasks.workunit.client.1.smithi149.stdout:6/591: link d8/da/d2c/d2d/f45 d8/da/d3d/d92/fc7 0 2024-09-21T11:39:16.120 INFO:tasks.workunit.client.0.smithi118.stdout:8/377: truncate d2/dc/d10/d2e/f55 656028 0 2024-09-21T11:39:16.123 INFO:tasks.workunit.client.0.smithi118.stdout:8/378: mknod d2/dc/d10/d2e/d18/d1a/c7d 0 2024-09-21T11:39:16.124 INFO:tasks.workunit.client.1.smithi149.stdout:2/792: symlink d8/d44/d63/db9/l116 0 2024-09-21T11:39:16.127 INFO:tasks.workunit.client.1.smithi149.stdout:4/705: creat d4/d6/ff6 x:0 0 0 2024-09-21T11:39:16.127 INFO:tasks.workunit.client.0.smithi118.stdout:4/155: dread d2/d6/f20 [0,4194304] 0 2024-09-21T11:39:16.130 INFO:tasks.workunit.client.0.smithi118.stdout:8/379: dwrite d2/dc/d10/d3b/f64 [0,4194304] 0 2024-09-21T11:39:16.131 INFO:tasks.workunit.client.0.smithi118.stdout:5/130: write d0/f2e [1620234,57334] 0 2024-09-21T11:39:16.133 INFO:tasks.workunit.client.0.smithi118.stdout:8/380: dread - d2/dc/d49/f77 zero size 2024-09-21T11:39:16.133 INFO:tasks.workunit.client.0.smithi118.stdout:4/156: rename d2/d6/dd/f15 to d2/d6/dd/d35/f3c 0 2024-09-21T11:39:16.135 INFO:tasks.workunit.client.0.smithi118.stdout:5/131: fdatasync d0/d6/d1c/da/f21 0 2024-09-21T11:39:16.137 INFO:tasks.workunit.client.0.smithi118.stdout:8/381: write d2/dc/d16/d46/f69 [646537,49063] 0 2024-09-21T11:39:16.139 INFO:tasks.workunit.client.0.smithi118.stdout:5/132: dread d0/d6/d1c/da/f18 [0,4194304] 0 2024-09-21T11:39:16.143 INFO:tasks.workunit.client.1.smithi149.stdout:3/710: rmdir d6/d1f/d47/d37 39 2024-09-21T11:39:16.144 INFO:tasks.workunit.client.1.smithi149.stdout:3/711: write d6/d1f/d47/d22/d8d/fcd [973116,21838] 0 2024-09-21T11:39:16.147 INFO:tasks.workunit.client.0.smithi118.stdout:8/382: creat d2/dc/d16/d46/d4c/d63/f7e x:0 0 0 2024-09-21T11:39:16.147 INFO:tasks.workunit.client.1.smithi149.stdout:0/604: rmdir dd/d1a/d1b/d50 39 2024-09-21T11:39:16.150 INFO:tasks.workunit.client.0.smithi118.stdout:5/133: rename d0/d6/d1c to d0/db/d35 0 2024-09-21T11:39:16.151 INFO:tasks.workunit.client.0.smithi118.stdout:5/134: chown d0/f31 33539207 1 2024-09-21T11:39:16.152 INFO:tasks.workunit.client.1.smithi149.stdout:0/605: dwrite dd/d1a/d1b/d72/d85/d8c/fa4 [0,4194304] 0 2024-09-21T11:39:16.153 INFO:tasks.workunit.client.0.smithi118.stdout:8/383: dwrite d2/dc/d10/d3b/f64 [0,4194304] 0 2024-09-21T11:39:16.155 INFO:tasks.workunit.client.1.smithi149.stdout:2/793: mkdir d8/d44/d63/db9/d117 0 2024-09-21T11:39:16.159 INFO:tasks.workunit.client.0.smithi118.stdout:4/157: getdents d2/d6/de/d1c/d23 0 2024-09-21T11:39:16.160 INFO:tasks.workunit.client.1.smithi149.stdout:2/794: truncate d8/d11/fce 99702 0 2024-09-21T11:39:16.163 INFO:tasks.workunit.client.0.smithi118.stdout:8/384: mknod d2/dc/c7f 0 2024-09-21T11:39:16.163 INFO:tasks.workunit.client.1.smithi149.stdout:0/606: dwrite dd/d35/fcc [0,4194304] 0 2024-09-21T11:39:16.165 INFO:tasks.workunit.client.0.smithi118.stdout:4/158: dwrite d2/f7 [0,4194304] 0 2024-09-21T11:39:16.169 INFO:tasks.workunit.client.0.smithi118.stdout:5/135: creat d0/f36 x:0 0 0 2024-09-21T11:39:16.169 INFO:tasks.workunit.client.0.smithi118.stdout:5/136: chown d0/db/d26 1 1 2024-09-21T11:39:16.172 INFO:tasks.workunit.client.0.smithi118.stdout:8/385: creat d2/d32/f80 x:0 0 0 2024-09-21T11:39:16.174 INFO:tasks.workunit.client.0.smithi118.stdout:4/159: symlink d2/d6/de/d1c/d23/d26/d31/l3d 0 2024-09-21T11:39:16.174 INFO:tasks.workunit.client.1.smithi149.stdout:9/673: write f16 [5939286,34395] 0 2024-09-21T11:39:16.174 INFO:tasks.workunit.client.0.smithi118.stdout:4/160: stat d2/d6/f14 0 2024-09-21T11:39:16.177 INFO:tasks.workunit.client.0.smithi118.stdout:5/137: fsync d0/f36 0 2024-09-21T11:39:16.179 INFO:tasks.workunit.client.0.smithi118.stdout:8/386: mknod d2/dc/d10/d2e/d18/d36/c81 0 2024-09-21T11:39:16.180 INFO:tasks.workunit.client.1.smithi149.stdout:4/706: mkdir d4/d6/d63/d78/d98/dcc/ddb/df7 0 2024-09-21T11:39:16.182 INFO:tasks.workunit.client.0.smithi118.stdout:4/161: unlink d2/f7 0 2024-09-21T11:39:16.183 INFO:tasks.workunit.client.1.smithi149.stdout:6/592: write d8/d32/d64/d97/fb2 [136895,48980] 0 2024-09-21T11:39:16.183 INFO:tasks.workunit.client.0.smithi118.stdout:5/138: fsync d0/f5 0 2024-09-21T11:39:16.184 INFO:tasks.workunit.client.0.smithi118.stdout:5/139: dread - d0/f1b zero size 2024-09-21T11:39:16.185 INFO:tasks.workunit.client.0.smithi118.stdout:8/387: mknod d2/dc/d35/d42/c82 0 2024-09-21T11:39:16.190 INFO:tasks.workunit.client.0.smithi118.stdout:5/140: dwrite d0/db/f16 [0,4194304] 0 2024-09-21T11:39:16.191 INFO:tasks.workunit.client.0.smithi118.stdout:4/162: mkdir d2/d6/de/d3e 0 2024-09-21T11:39:16.192 INFO:tasks.workunit.client.1.smithi149.stdout:7/764: link d12/d5b/db5/dc5/de9/d4a/d6c/lc2 d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/dab/leb 0 2024-09-21T11:39:16.195 INFO:tasks.workunit.client.1.smithi149.stdout:3/712: symlink d6/d1f/d47/d37/d3a/d95/lff 0 2024-09-21T11:39:16.197 INFO:tasks.workunit.client.1.smithi149.stdout:8/591: creat d3/d12/d6e/d79/fd1 x:0 0 0 2024-09-21T11:39:16.199 INFO:tasks.workunit.client.1.smithi149.stdout:9/674: mkdir d18/d36/d3c/d47/db5/dd6 0 2024-09-21T11:39:16.201 INFO:tasks.workunit.client.1.smithi149.stdout:5/736: getdents d4/d7/d40/d43/d49/d88/de0 0 2024-09-21T11:39:16.202 INFO:tasks.workunit.client.1.smithi149.stdout:8/592: truncate d3/d33/d34/d72/fba 456927 0 2024-09-21T11:39:16.203 INFO:tasks.workunit.client.1.smithi149.stdout:4/707: rename d4/d6/d63/c1b to d4/d6/d63/d15/dec/cf8 0 2024-09-21T11:39:16.205 INFO:tasks.workunit.client.0.smithi118.stdout:5/141: creat d0/f37 x:0 0 0 2024-09-21T11:39:16.205 INFO:tasks.workunit.client.1.smithi149.stdout:0/607: dwrite f8 [0,4194304] 0 2024-09-21T11:39:16.207 INFO:tasks.workunit.client.0.smithi118.stdout:8/388: getdents d2 0 2024-09-21T11:39:16.208 INFO:tasks.workunit.client.0.smithi118.stdout:5/142: symlink d0/db/d35/d30/d1a/l38 0 2024-09-21T11:39:16.209 INFO:tasks.workunit.client.1.smithi149.stdout:3/713: dwrite d6/d5f/d60/f82 [0,4194304] 0 2024-09-21T11:39:16.209 INFO:tasks.workunit.client.0.smithi118.stdout:5/143: write d0/f36 [918622,40383] 0 2024-09-21T11:39:16.211 INFO:tasks.workunit.client.1.smithi149.stdout:3/714: fsync d6/d1f/d47/d37/d50/fb0 0 2024-09-21T11:39:16.214 INFO:tasks.workunit.client.1.smithi149.stdout:7/765: creat d12/d5b/db5/dc5/de9/d4a/d4f/fec x:0 0 0 2024-09-21T11:39:16.215 INFO:tasks.workunit.client.1.smithi149.stdout:1/603: sync 2024-09-21T11:39:16.216 INFO:tasks.workunit.client.0.smithi118.stdout:4/163: truncate d2/d6/f20 325241 0 2024-09-21T11:39:16.216 INFO:tasks.workunit.client.1.smithi149.stdout:6/593: mkdir d8/d32/d37/d28/dc8 0 2024-09-21T11:39:16.217 INFO:tasks.workunit.client.0.smithi118.stdout:4/164: truncate d2/d6/de/f16 1661997 0 2024-09-21T11:39:16.218 INFO:tasks.workunit.client.0.smithi118.stdout:5/144: getdents d0/db/d35/d30 0 2024-09-21T11:39:16.218 INFO:tasks.workunit.client.0.smithi118.stdout:0/408: sync 2024-09-21T11:39:16.218 INFO:tasks.workunit.client.0.smithi118.stdout:9/243: sync 2024-09-21T11:39:16.218 INFO:tasks.workunit.client.0.smithi118.stdout:1/174: sync 2024-09-21T11:39:16.218 INFO:tasks.workunit.client.0.smithi118.stdout:3/139: sync 2024-09-21T11:39:16.223 INFO:tasks.workunit.client.1.smithi149.stdout:9/675: mkdir d18/d19/d1a/d2f/d33/d91/dd7 0 2024-09-21T11:39:16.224 INFO:tasks.workunit.client.0.smithi118.stdout:0/409: mknod d5/d10/d1e/d20/c8c 0 2024-09-21T11:39:16.226 INFO:tasks.workunit.client.0.smithi118.stdout:3/140: rename d5/f35 to d5/d1d/d1b/d24/f37 0 2024-09-21T11:39:16.227 INFO:tasks.workunit.client.1.smithi149.stdout:6/594: rmdir d8 39 2024-09-21T11:39:16.229 INFO:tasks.workunit.client.1.smithi149.stdout:3/715: creat d6/d5f/d60/dfa/f100 x:0 0 0 2024-09-21T11:39:16.230 INFO:tasks.workunit.client.1.smithi149.stdout:9/676: stat d18/d19/d1a/d2f/d30/d54/l5d 0 2024-09-21T11:39:16.231 INFO:tasks.workunit.client.1.smithi149.stdout:4/708: mknod d4/d6/d63/d15/d16/d23/cf9 0 2024-09-21T11:39:16.231 INFO:tasks.workunit.client.0.smithi118.stdout:5/145: dread d0/fd [0,4194304] 0 2024-09-21T11:39:16.233 INFO:tasks.workunit.client.0.smithi118.stdout:0/410: creat d5/d34/d44/d7c/f8d x:0 0 0 2024-09-21T11:39:16.233 INFO:tasks.workunit.client.0.smithi118.stdout:1/175: dwrite d6/de/f25 [0,4194304] 0 2024-09-21T11:39:16.234 INFO:tasks.workunit.client.1.smithi149.stdout:0/608: dwrite dd/db3/fc5 [0,4194304] 0 2024-09-21T11:39:16.235 INFO:tasks.workunit.client.1.smithi149.stdout:8/593: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/f8d [0,4194304] 0 2024-09-21T11:39:16.236 INFO:tasks.workunit.client.1.smithi149.stdout:2/795: dread d8/da/d13/d1a/d29/f98 [0,4194304] 0 2024-09-21T11:39:16.236 INFO:tasks.workunit.client.0.smithi118.stdout:3/141: creat d5/d1d/d1b/d24/f38 x:0 0 0 2024-09-21T11:39:16.239 INFO:tasks.workunit.client.0.smithi118.stdout:9/244: dread d0/d4/f27 [0,4194304] 0 2024-09-21T11:39:16.240 INFO:tasks.workunit.client.1.smithi149.stdout:4/709: fdatasync d4/d6/d63/d2d/dd6/fbc 0 2024-09-21T11:39:16.241 INFO:tasks.workunit.client.1.smithi149.stdout:7/766: write d12/d5b/db5/dc5/de9/f17 [509258,8981] 0 2024-09-21T11:39:16.241 INFO:tasks.workunit.client.0.smithi118.stdout:9/245: readlink d0/d20/l43 0 2024-09-21T11:39:16.242 INFO:tasks.workunit.client.0.smithi118.stdout:5/146: fdatasync d0/db/d35/da/f18 0 2024-09-21T11:39:16.245 INFO:tasks.workunit.client.1.smithi149.stdout:5/737: dwrite d4/d7/d40/d43/d85/fd0 [0,4194304] 0 2024-09-21T11:39:16.247 INFO:tasks.workunit.client.0.smithi118.stdout:4/165: dread d2/fc [0,4194304] 0 2024-09-21T11:39:16.248 INFO:tasks.workunit.client.0.smithi118.stdout:1/176: dwrite d6/f19 [4194304,4194304] 0 2024-09-21T11:39:16.248 INFO:tasks.workunit.client.0.smithi118.stdout:9/246: read d0/f13 [463136,87066] 0 2024-09-21T11:39:16.250 INFO:tasks.workunit.client.1.smithi149.stdout:2/796: truncate d8/dd/d5c/d60/d67/fe2 474496 0 2024-09-21T11:39:16.251 INFO:tasks.workunit.client.1.smithi149.stdout:2/797: chown d8/dd 38 1 2024-09-21T11:39:16.251 INFO:tasks.workunit.client.0.smithi118.stdout:9/247: stat d0/d4/c1e 0 2024-09-21T11:39:16.254 INFO:tasks.workunit.client.1.smithi149.stdout:3/716: mknod d6/d1f/d47/d37/d3f/c101 0 2024-09-21T11:39:16.259 INFO:tasks.workunit.client.0.smithi118.stdout:1/177: dwrite d6/f19 [4194304,4194304] 0 2024-09-21T11:39:16.262 INFO:tasks.workunit.client.0.smithi118.stdout:5/147: unlink d0/d6/l19 0 2024-09-21T11:39:16.262 INFO:tasks.workunit.client.0.smithi118.stdout:5/148: fsync d0/db/d35/da/f21 0 2024-09-21T11:39:16.263 INFO:tasks.workunit.client.0.smithi118.stdout:0/411: link d5/d34/f3b d5/d10/d1e/d20/f8e 0 2024-09-21T11:39:16.272 INFO:tasks.workunit.client.0.smithi118.stdout:8/389: dread d2/d32/f3c [4194304,4194304] 0 2024-09-21T11:39:16.274 INFO:tasks.workunit.client.1.smithi149.stdout:4/710: dwrite d4/d6/d63/d15/d30/f48 [0,4194304] 0 2024-09-21T11:39:16.277 INFO:tasks.workunit.client.0.smithi118.stdout:5/149: write d0/f1b [445401,24405] 0 2024-09-21T11:39:16.278 INFO:tasks.workunit.client.0.smithi118.stdout:8/390: dread d2/dc/d10/d3b/f6d [0,4194304] 0 2024-09-21T11:39:16.279 INFO:tasks.workunit.client.0.smithi118.stdout:0/412: creat d5/d34/d44/f8f x:0 0 0 2024-09-21T11:39:16.281 INFO:tasks.workunit.client.0.smithi118.stdout:5/150: dread d0/db/f16 [0,4194304] 0 2024-09-21T11:39:16.282 INFO:tasks.workunit.client.1.smithi149.stdout:1/604: dread d2/d5/d8/fa4 [0,4194304] 0 2024-09-21T11:39:16.282 INFO:tasks.workunit.client.1.smithi149.stdout:7/767: dwrite d12/d5b/db5/dc5/de9/d4a/d6c/db1/fb2 [0,4194304] 0 2024-09-21T11:39:16.284 INFO:tasks.workunit.client.1.smithi149.stdout:1/605: write d2/d5/f85 [1108040,55525] 0 2024-09-21T11:39:16.285 INFO:tasks.workunit.client.1.smithi149.stdout:1/606: stat d2/d5/d8/fbf 0 2024-09-21T11:39:16.287 INFO:tasks.workunit.client.1.smithi149.stdout:1/607: chown d2/d5/d65/l89 609736 1 2024-09-21T11:39:16.287 INFO:tasks.workunit.client.1.smithi149.stdout:3/717: rmdir d6/d1f/d47/d37/dd6 39 2024-09-21T11:39:16.288 INFO:tasks.workunit.client.0.smithi118.stdout:9/248: truncate d0/f1 12191419 0 2024-09-21T11:39:16.289 INFO:tasks.workunit.client.0.smithi118.stdout:5/151: dread d0/d6/f7 [0,4194304] 0 2024-09-21T11:39:16.293 INFO:tasks.workunit.client.0.smithi118.stdout:0/413: mkdir d5/d10/d1e/d23/d3a/d90 0 2024-09-21T11:39:16.294 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:16 smithi118 ceph-mon[28757]: pgmap v23: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 174 MiB/s wr, 295 op/s 2024-09-21T11:39:16.295 INFO:tasks.workunit.client.0.smithi118.stdout:0/414: write d5/d10/d1e/d21/d2a/f4a [677041,39785] 0 2024-09-21T11:39:16.295 INFO:tasks.workunit.client.0.smithi118.stdout:0/415: readlink d5/l1f 0 2024-09-21T11:39:16.296 INFO:tasks.workunit.client.0.smithi118.stdout:0/416: write d5/d10/d1e/f4c [2892191,119708] 0 2024-09-21T11:39:16.297 INFO:tasks.workunit.client.1.smithi149.stdout:2/798: mkdir d8/da/d13/d118 0 2024-09-21T11:39:16.302 INFO:tasks.workunit.client.1.smithi149.stdout:2/799: fdatasync d8/da/d13/d53/f91 0 2024-09-21T11:39:16.303 INFO:tasks.workunit.client.1.smithi149.stdout:1/608: dwrite d2/f2d [0,4194304] 0 2024-09-21T11:39:16.304 INFO:tasks.workunit.client.1.smithi149.stdout:6/595: dwrite d8/da/d2c/d52/d5e/f67 [0,4194304] 0 2024-09-21T11:39:16.305 INFO:tasks.workunit.client.0.smithi118.stdout:1/178: dwrite d6/de/d13/f1c [0,4194304] 0 2024-09-21T11:39:16.306 INFO:tasks.workunit.client.1.smithi149.stdout:1/609: chown d2/dd/d35/d1c/d37/lb5 19622860 1 2024-09-21T11:39:16.306 INFO:tasks.workunit.client.1.smithi149.stdout:4/711: fdatasync d4/d6/f8f 0 2024-09-21T11:39:16.309 INFO:tasks.workunit.client.1.smithi149.stdout:4/712: fsync d4/d6/d63/d15/d30/d6b/daa/fad 0 2024-09-21T11:39:16.312 INFO:tasks.workunit.client.1.smithi149.stdout:3/718: creat d6/d1f/d47/d37/d3f/dc5/f102 x:0 0 0 2024-09-21T11:39:16.316 INFO:tasks.workunit.client.1.smithi149.stdout:5/738: creat d4/ff3 x:0 0 0 2024-09-21T11:39:16.318 INFO:tasks.workunit.client.1.smithi149.stdout:5/739: stat d4/d4f/la3 0 2024-09-21T11:39:16.320 INFO:tasks.workunit.client.1.smithi149.stdout:5/740: dread - d4/d7/d40/d43/d5c/faf zero size 2024-09-21T11:39:16.321 INFO:tasks.workunit.client.1.smithi149.stdout:9/677: getdents d18/d36/d3c/d47/d76/d7c 0 2024-09-21T11:39:16.322 INFO:tasks.workunit.client.1.smithi149.stdout:5/741: dread - d4/d7/d40/d43/d5c/faf zero size 2024-09-21T11:39:16.323 INFO:tasks.workunit.client.1.smithi149.stdout:2/800: fdatasync d8/d11/fb6 0 2024-09-21T11:39:16.324 INFO:tasks.workunit.client.1.smithi149.stdout:7/768: dread d12/d5b/db5/dc5/de9/d68/dc4/f2e [0,4194304] 0 2024-09-21T11:39:16.325 INFO:tasks.workunit.client.1.smithi149.stdout:2/801: write d8/dd/d5c/d60/d67/d8a/f96 [18193,40985] 0 2024-09-21T11:39:16.326 INFO:tasks.workunit.client.1.smithi149.stdout:7/769: dread - d12/d5b/db5/dc5/de9/d4a/d6c/d8c/fa2 zero size 2024-09-21T11:39:16.326 INFO:tasks.workunit.client.1.smithi149.stdout:1/610: creat d2/dd/d35/d1c/d41/d51/d73/fca x:0 0 0 2024-09-21T11:39:16.327 INFO:tasks.workunit.client.1.smithi149.stdout:1/611: fdatasync d2/dd/d35/f24 0 2024-09-21T11:39:16.328 INFO:tasks.workunit.client.1.smithi149.stdout:7/770: write d12/d5b/db5/dc5/de9/d4a/d9e/fcf [250863,97555] 0 2024-09-21T11:39:16.331 INFO:tasks.workunit.client.0.smithi118.stdout:4/166: dwrite d2/d6/f20 [0,4194304] 0 2024-09-21T11:39:16.331 INFO:tasks.workunit.client.1.smithi149.stdout:4/713: unlink d4/d6/d18/lb5 0 2024-09-21T11:39:16.332 INFO:tasks.workunit.client.1.smithi149.stdout:4/714: write d4/f80 [946649,79807] 0 2024-09-21T11:39:16.334 INFO:tasks.workunit.client.1.smithi149.stdout:0/609: rename dd/d1a/d1b/d50/d5d/d79 to dd/d1a/d1b/dce 0 2024-09-21T11:39:16.336 INFO:tasks.workunit.client.0.smithi118.stdout:5/152: symlink d0/db/d35/d30/d1a/d33/l39 0 2024-09-21T11:39:16.337 INFO:tasks.workunit.client.0.smithi118.stdout:5/153: write d0/f36 [1702264,2577] 0 2024-09-21T11:39:16.338 INFO:tasks.workunit.client.0.smithi118.stdout:5/154: chown d0/f31 81 1 2024-09-21T11:39:16.338 INFO:tasks.workunit.client.1.smithi149.stdout:5/742: mkdir d4/d4f/df4 0 2024-09-21T11:39:16.338 INFO:tasks.workunit.client.0.smithi118.stdout:5/155: fdatasync d0/d6/f7 0 2024-09-21T11:39:16.339 INFO:tasks.workunit.client.0.smithi118.stdout:5/156: readlink d0/db/l32 0 2024-09-21T11:39:16.340 INFO:tasks.workunit.client.0.smithi118.stdout:0/417: truncate d5/f13 3768452 0 2024-09-21T11:39:16.342 INFO:tasks.workunit.client.0.smithi118.stdout:0/418: chown d5/d10/d1e/d23 238713948 1 2024-09-21T11:39:16.346 INFO:tasks.workunit.client.1.smithi149.stdout:0/610: dread dd/d1a/f44 [0,4194304] 0 2024-09-21T11:39:16.346 INFO:tasks.workunit.client.0.smithi118.stdout:5/157: dwrite d0/fe [0,4194304] 0 2024-09-21T11:39:16.347 INFO:tasks.workunit.client.1.smithi149.stdout:5/743: dwrite d4/d1d/d50/d54/d2a/fe7 [0,4194304] 0 2024-09-21T11:39:16.348 INFO:tasks.workunit.client.0.smithi118.stdout:5/158: write d0/f5 [390293,118214] 0 2024-09-21T11:39:16.348 INFO:tasks.workunit.client.0.smithi118.stdout:1/179: mkdir d6/d33 0 2024-09-21T11:39:16.348 INFO:tasks.workunit.client.1.smithi149.stdout:6/596: dwrite d8/d32/d37/f19 [0,4194304] 0 2024-09-21T11:39:16.349 INFO:tasks.workunit.client.0.smithi118.stdout:5/159: write d0/f36 [2733457,40512] 0 2024-09-21T11:39:16.351 INFO:tasks.workunit.client.0.smithi118.stdout:5/160: chown d0/f37 7 1 2024-09-21T11:39:16.351 INFO:tasks.workunit.client.0.smithi118.stdout:4/167: fdatasync d2/d6/f14 0 2024-09-21T11:39:16.352 INFO:tasks.workunit.client.0.smithi118.stdout:5/161: rename d0/db/d35/da to d0/db/d35/da/d3a 22 2024-09-21T11:39:16.355 INFO:tasks.workunit.client.1.smithi149.stdout:1/612: unlink d2/d5/f9e 0 2024-09-21T11:39:16.357 INFO:tasks.workunit.client.1.smithi149.stdout:7/771: mkdir d12/d5b/db5/dc5/de9/d68/ded 0 2024-09-21T11:39:16.358 INFO:tasks.workunit.client.0.smithi118.stdout:0/419: mknod d5/d10/d1e/d33/c91 0 2024-09-21T11:39:16.359 INFO:tasks.workunit.client.0.smithi118.stdout:0/420: stat d5/d29 0 2024-09-21T11:39:16.361 INFO:tasks.workunit.client.0.smithi118.stdout:0/421: write d5/d10/d1e/d33/f72 [5230103,54756] 0 2024-09-21T11:39:16.362 INFO:tasks.workunit.client.1.smithi149.stdout:4/715: rename d4/d6/d63/d15/dec to d4/d6/d63/d2d/dd6/d32/dfa 0 2024-09-21T11:39:16.364 INFO:tasks.workunit.client.1.smithi149.stdout:4/716: fsync d4/d6/d63/d78/d98/dee/fe4 0 2024-09-21T11:39:16.365 INFO:tasks.workunit.client.0.smithi118.stdout:4/168: creat d2/d6/dd/d35/f3f x:0 0 0 2024-09-21T11:39:16.369 INFO:tasks.workunit.client.1.smithi149.stdout:2/802: creat d8/d20/d78/ddb/f119 x:0 0 0 2024-09-21T11:39:16.371 INFO:tasks.workunit.client.1.smithi149.stdout:8/594: sync 2024-09-21T11:39:16.373 INFO:tasks.workunit.client.0.smithi118.stdout:0/422: unlink d5/d10/d1e/d21/f42 0 2024-09-21T11:39:16.375 INFO:tasks.workunit.client.1.smithi149.stdout:1/613: mknod d2/dd/d35/d7c/ccb 0 2024-09-21T11:39:16.377 INFO:tasks.workunit.client.0.smithi118.stdout:4/169: mkdir d2/d6/de/d1c/d40 0 2024-09-21T11:39:16.383 INFO:tasks.workunit.client.1.smithi149.stdout:6/597: rename d8/c23 to d8/d32/d70/cc9 0 2024-09-21T11:39:16.383 INFO:tasks.workunit.client.0.smithi118.stdout:0/423: mknod d5/d29/d68/c92 0 2024-09-21T11:39:16.384 INFO:tasks.workunit.client.1.smithi149.stdout:6/598: chown d8/d32/d37/d2b 8488252 1 2024-09-21T11:39:16.387 INFO:tasks.workunit.client.1.smithi149.stdout:1/614: dread d2/dd/d35/d1c/d2c/f5a [0,4194304] 0 2024-09-21T11:39:16.388 INFO:tasks.workunit.client.0.smithi118.stdout:9/249: dread d0/f1 [4194304,4194304] 0 2024-09-21T11:39:16.388 INFO:tasks.workunit.client.0.smithi118.stdout:0/424: dread d5/d10/d1e/f4c [0,4194304] 0 2024-09-21T11:39:16.388 INFO:tasks.workunit.client.0.smithi118.stdout:1/180: getdents d6/de/d16 0 2024-09-21T11:39:16.389 INFO:tasks.workunit.client.1.smithi149.stdout:1/615: truncate d2/d5/d8/fbf 647528 0 2024-09-21T11:39:16.389 INFO:tasks.workunit.client.1.smithi149.stdout:7/772: write d12/d5b/db5/dc5/de9/db8/fca [1984496,98973] 0 2024-09-21T11:39:16.390 INFO:tasks.workunit.client.0.smithi118.stdout:9/250: write d0/d4/d45/f48 [755620,18037] 0 2024-09-21T11:39:16.390 INFO:tasks.workunit.client.1.smithi149.stdout:4/717: dread d4/d6/d63/d15/d16/f33 [0,4194304] 0 2024-09-21T11:39:16.392 INFO:tasks.workunit.client.0.smithi118.stdout:9/251: truncate d0/d20/f64 614679 0 2024-09-21T11:39:16.392 INFO:tasks.workunit.client.1.smithi149.stdout:4/718: write d4/d4d/d5f/d71/fb0 [904072,130664] 0 2024-09-21T11:39:16.395 INFO:tasks.workunit.client.0.smithi118.stdout:5/162: getdents d0/d6/d25 0 2024-09-21T11:39:16.396 INFO:tasks.workunit.client.0.smithi118.stdout:5/163: chown d0/d6/f8 391 1 2024-09-21T11:39:16.396 INFO:tasks.workunit.client.1.smithi149.stdout:0/611: fdatasync dd/d32/db2/fbf 0 2024-09-21T11:39:16.399 INFO:tasks.workunit.client.0.smithi118.stdout:0/425: mkdir d5/d10/d1e/d3d/d93 0 2024-09-21T11:39:16.401 INFO:tasks.workunit.client.0.smithi118.stdout:9/252: rmdir d0/d4/d23 39 2024-09-21T11:39:16.402 INFO:tasks.workunit.client.1.smithi149.stdout:5/744: rename d4/d7/d40/d43/d5c/faf to d4/d7/d40/d43/d85/dce/ff5 0 2024-09-21T11:39:16.403 INFO:tasks.workunit.client.0.smithi118.stdout:5/164: symlink d0/d6/l3b 0 2024-09-21T11:39:16.403 INFO:tasks.workunit.client.1.smithi149.stdout:6/599: fdatasync d8/d32/d37/d2b/d51/f59 0 2024-09-21T11:39:16.404 INFO:tasks.workunit.client.1.smithi149.stdout:3/719: getdents d6/d1f/d47/dbb 0 2024-09-21T11:39:16.405 INFO:tasks.workunit.client.1.smithi149.stdout:3/720: chown d6/d1f/d47/d22/c85 523756323 1 2024-09-21T11:39:16.406 INFO:tasks.workunit.client.1.smithi149.stdout:3/721: write d6/d79/d7e/ddd/fe8 [506298,117011] 0 2024-09-21T11:39:16.407 INFO:tasks.workunit.client.1.smithi149.stdout:7/773: chown d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f64 9142 1 2024-09-21T11:39:16.408 INFO:tasks.workunit.client.0.smithi118.stdout:5/165: creat d0/d6/d25/f3c x:0 0 0 2024-09-21T11:39:16.409 INFO:tasks.workunit.client.0.smithi118.stdout:5/166: dread - d0/f37 zero size 2024-09-21T11:39:16.409 INFO:tasks.workunit.client.0.smithi118.stdout:9/253: dread d0/f3a [0,4194304] 0 2024-09-21T11:39:16.411 INFO:tasks.workunit.client.0.smithi118.stdout:1/181: creat d6/de/f34 x:0 0 0 2024-09-21T11:39:16.411 INFO:tasks.workunit.client.1.smithi149.stdout:8/595: dread d3/d12/f15 [0,4194304] 0 2024-09-21T11:39:16.412 INFO:tasks.workunit.client.1.smithi149.stdout:4/719: mkdir d4/d6/d63/d15/d30/d8a/da7/dfb 0 2024-09-21T11:39:16.413 INFO:tasks.workunit.client.1.smithi149.stdout:2/803: rmdir d8/da/d13/d1a/dc5 39 2024-09-21T11:39:16.414 INFO:tasks.workunit.client.1.smithi149.stdout:3/722: dwrite d6/d1f/d47/d37/fc7 [0,4194304] 0 2024-09-21T11:39:16.415 INFO:tasks.workunit.client.0.smithi118.stdout:9/254: mkdir d0/d20/d4c/d5f/d68 0 2024-09-21T11:39:16.418 INFO:tasks.workunit.client.1.smithi149.stdout:0/612: mkdir dd/d1a/d1b/d72/d78/dc4/d3a/d66/dcf 0 2024-09-21T11:39:16.418 INFO:tasks.workunit.client.1.smithi149.stdout:3/723: dread d6/d1f/d47/d37/d3f/fd3 [0,4194304] 0 2024-09-21T11:39:16.419 INFO:tasks.workunit.client.0.smithi118.stdout:9/255: stat d0/d4/d23/l47 0 2024-09-21T11:39:16.419 INFO:tasks.workunit.client.0.smithi118.stdout:0/426: truncate d5/f15 1278319 0 2024-09-21T11:39:16.421 INFO:tasks.workunit.client.0.smithi118.stdout:5/167: creat d0/db/d35/f3d x:0 0 0 2024-09-21T11:39:16.422 INFO:tasks.workunit.client.0.smithi118.stdout:5/168: dread - d0/d6/d25/f3c zero size 2024-09-21T11:39:16.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/678: sync 2024-09-21T11:39:16.423 INFO:tasks.workunit.client.1.smithi149.stdout:5/745: write d4/d90/f9e [3865633,93177] 0 2024-09-21T11:39:16.425 INFO:tasks.workunit.client.1.smithi149.stdout:2/804: dwrite d8/d20/f62 [4194304,4194304] 0 2024-09-21T11:39:16.425 INFO:tasks.workunit.client.0.smithi118.stdout:5/169: write d0/f36 [1485877,20150] 0 2024-09-21T11:39:16.425 INFO:tasks.workunit.client.1.smithi149.stdout:1/616: creat d2/d5/d8/dc1/fcc x:0 0 0 2024-09-21T11:39:16.426 INFO:tasks.workunit.client.0.smithi118.stdout:5/170: readlink d0/db/d35/d30/l13 0 2024-09-21T11:39:16.427 INFO:tasks.workunit.client.1.smithi149.stdout:7/774: mkdir d12/d5b/db5/dc5/de9/d4a/d6c/da0/dee 0 2024-09-21T11:39:16.428 INFO:tasks.workunit.client.0.smithi118.stdout:5/171: write d0/db/d35/da/f21 [1183748,53461] 0 2024-09-21T11:39:16.428 INFO:tasks.workunit.client.0.smithi118.stdout:0/427: mknod d5/c94 0 2024-09-21T11:39:16.428 INFO:tasks.workunit.client.1.smithi149.stdout:1/617: chown d2/dd/d35/d1c/d2c/lb8 135524559 1 2024-09-21T11:39:16.429 INFO:tasks.workunit.client.0.smithi118.stdout:0/428: readlink d5/d10/d1e/d23/l86 0 2024-09-21T11:39:16.430 INFO:tasks.workunit.client.1.smithi149.stdout:8/596: mkdir d3/d12/d6e/d79/dd2 0 2024-09-21T11:39:16.430 INFO:tasks.workunit.client.0.smithi118.stdout:0/429: dread - d5/d29/d53/f56 zero size 2024-09-21T11:39:16.432 INFO:tasks.workunit.client.0.smithi118.stdout:0/430: write d5/d10/f28 [4300158,69664] 0 2024-09-21T11:39:16.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/613: symlink dd/d32/db2/ld0 0 2024-09-21T11:39:16.436 INFO:tasks.workunit.client.0.smithi118.stdout:1/182: dread d6/d2a/f23 [0,4194304] 0 2024-09-21T11:39:16.437 INFO:tasks.workunit.client.0.smithi118.stdout:5/172: creat d0/db/d35/d2c/f3e x:0 0 0 2024-09-21T11:39:16.440 INFO:tasks.workunit.client.0.smithi118.stdout:1/183: read d6/d2a/f28 [1903176,66720] 0 2024-09-21T11:39:16.442 INFO:tasks.workunit.client.0.smithi118.stdout:0/431: dwrite d5/d10/d1e/d21/d2a/f78 [0,4194304] 0 2024-09-21T11:39:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:16 smithi149 ceph-mon[36123]: pgmap v23: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 174 MiB/s wr, 295 op/s 2024-09-21T11:39:16.451 INFO:tasks.workunit.client.1.smithi149.stdout:5/746: symlink d4/d7/d40/d51/lf6 0 2024-09-21T11:39:16.452 INFO:tasks.workunit.client.1.smithi149.stdout:5/747: chown d4/d7/f38 3 1 2024-09-21T11:39:16.454 INFO:tasks.workunit.client.0.smithi118.stdout:0/432: creat d5/d10/d1e/d23/d3a/f95 x:0 0 0 2024-09-21T11:39:16.455 INFO:tasks.workunit.client.0.smithi118.stdout:9/256: dwrite d0/f26 [0,4194304] 0 2024-09-21T11:39:16.455 INFO:tasks.workunit.client.1.smithi149.stdout:2/805: symlink d8/dd/d50/l11a 0 2024-09-21T11:39:16.457 INFO:tasks.workunit.client.1.smithi149.stdout:6/600: dwrite d8/da/d3d/f43 [0,4194304] 0 2024-09-21T11:39:16.459 INFO:tasks.workunit.client.0.smithi118.stdout:5/173: symlink d0/db/d35/l3f 0 2024-09-21T11:39:16.461 INFO:tasks.workunit.client.0.smithi118.stdout:1/184: mknod d6/d1f/d30/c35 0 2024-09-21T11:39:16.462 INFO:tasks.workunit.client.0.smithi118.stdout:1/185: chown c2 114434154 1 2024-09-21T11:39:16.467 INFO:tasks.workunit.client.1.smithi149.stdout:8/597: creat d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/d5c/fd3 x:0 0 0 2024-09-21T11:39:16.468 INFO:tasks.workunit.client.1.smithi149.stdout:2/806: dwrite d8/dd/d5c/f76 [0,4194304] 0 2024-09-21T11:39:16.471 INFO:tasks.workunit.client.1.smithi149.stdout:2/807: truncate d8/d44/fbe 653447 0 2024-09-21T11:39:16.471 INFO:tasks.workunit.client.1.smithi149.stdout:0/614: mkdir dd/d1a/d1b/d72/d78/dc4/d3a/dd1 0 2024-09-21T11:39:16.472 INFO:tasks.workunit.client.1.smithi149.stdout:3/724: truncate d6/d1f/f57 1210774 0 2024-09-21T11:39:16.473 INFO:tasks.workunit.client.1.smithi149.stdout:0/615: chown dd/d1a/d1b/d72/d78/dc4/d3a/dd1 101 1 2024-09-21T11:39:16.473 INFO:tasks.workunit.client.0.smithi118.stdout:1/186: rename d6/de/l2c to d6/de/d16/l36 0 2024-09-21T11:39:16.474 INFO:tasks.workunit.client.1.smithi149.stdout:9/679: write d18/d19/d1a/d2f/faa [752435,20046] 0 2024-09-21T11:39:16.475 INFO:tasks.workunit.client.0.smithi118.stdout:0/433: truncate d5/d10/d1e/d20/f2f 4517307 0 2024-09-21T11:39:16.479 INFO:tasks.workunit.client.1.smithi149.stdout:0/616: dwrite dd/d1a/d5a/f95 [0,4194304] 0 2024-09-21T11:39:16.484 INFO:tasks.workunit.client.1.smithi149.stdout:7/775: symlink d12/d5b/db5/dc5/de9/d4a/d6c/db1/de1/lef 0 2024-09-21T11:39:16.487 INFO:tasks.workunit.client.0.smithi118.stdout:9/257: write d0/f5 [10761674,4268] 0 2024-09-21T11:39:16.488 INFO:tasks.workunit.client.0.smithi118.stdout:1/187: rmdir d6/d2a 39 2024-09-21T11:39:16.494 INFO:tasks.workunit.client.0.smithi118.stdout:1/188: creat d6/d1f/d30/f37 x:0 0 0 2024-09-21T11:39:16.495 INFO:tasks.workunit.client.0.smithi118.stdout:5/174: truncate d0/f5 757964 0 2024-09-21T11:39:16.498 INFO:tasks.workunit.client.0.smithi118.stdout:0/434: creat d5/d10/d1e/d3d/d93/f96 x:0 0 0 2024-09-21T11:39:16.498 INFO:tasks.workunit.client.0.smithi118.stdout:1/189: dread d6/de/d13/f1c [0,4194304] 0 2024-09-21T11:39:16.499 INFO:tasks.workunit.client.1.smithi149.stdout:3/725: mknod d6/d1f/d4c/c103 0 2024-09-21T11:39:16.500 INFO:tasks.workunit.client.0.smithi118.stdout:1/190: dread - d6/de/f2e zero size 2024-09-21T11:39:16.501 INFO:tasks.workunit.client.1.smithi149.stdout:9/680: creat d18/d19/d1a/d2f/d7d/fd8 x:0 0 0 2024-09-21T11:39:16.504 INFO:tasks.workunit.client.0.smithi118.stdout:9/258: rename d0/c44 to d0/d4/d23/d4d/c69 0 2024-09-21T11:39:16.504 INFO:tasks.workunit.client.1.smithi149.stdout:7/776: dread d12/d5b/db5/dc5/de9/d68/f7a [0,4194304] 0 2024-09-21T11:39:16.504 INFO:tasks.workunit.client.1.smithi149.stdout:5/748: truncate d4/d7/f32 671868 0 2024-09-21T11:39:16.505 INFO:tasks.workunit.client.0.smithi118.stdout:5/175: mkdir d0/db/d35/d2c/d40 0 2024-09-21T11:39:16.505 INFO:tasks.workunit.client.1.smithi149.stdout:1/618: dwrite d2/dd/d35/d1c/d41/d51/d73/f93 [4194304,4194304] 0 2024-09-21T11:39:16.506 INFO:tasks.workunit.client.1.smithi149.stdout:1/619: readlink d2/d5/d8/l10 0 2024-09-21T11:39:16.506 INFO:tasks.workunit.client.1.smithi149.stdout:0/617: rmdir dd/d1a/d1b/d72/d87/da6 39 2024-09-21T11:39:16.508 INFO:tasks.workunit.client.0.smithi118.stdout:0/435: symlink d5/d34/l97 0 2024-09-21T11:39:16.511 INFO:tasks.workunit.client.0.smithi118.stdout:1/191: write d6/de/f1a [1047931,101760] 0 2024-09-21T11:39:16.582 INFO:tasks.workunit.client.0.smithi118.stdout:6/146: sync 2024-09-21T11:39:16.605 INFO:tasks.workunit.client.1.smithi149.stdout:4/720: getdents d4/d6/d63/d92 0 2024-09-21T11:39:16.606 INFO:tasks.workunit.client.0.smithi118.stdout:9/259: dread d0/f24 [0,4194304] 0 2024-09-21T11:39:16.606 INFO:tasks.workunit.client.0.smithi118.stdout:9/260: readlink d0/d4/l6 0 2024-09-21T11:39:16.607 INFO:tasks.workunit.client.1.smithi149.stdout:8/598: symlink d3/d12/d98/ld4 0 2024-09-21T11:39:16.617 INFO:tasks.workunit.client.1.smithi149.stdout:4/721: dread d4/d6/d63/d15/d30/d6b/fb1 [0,4194304] 0 2024-09-21T11:39:16.618 INFO:tasks.workunit.client.1.smithi149.stdout:4/722: chown d4/d6/d63/d10/d6f/fc8 384477710 1 2024-09-21T11:39:16.661 INFO:tasks.workunit.client.0.smithi118.stdout:7/131: sync 2024-09-21T11:39:16.665 INFO:tasks.workunit.client.0.smithi118.stdout:7/132: dwrite d0/d3/d14/f32 [0,4194304] 0 2024-09-21T11:39:16.666 INFO:tasks.workunit.client.0.smithi118.stdout:7/133: readlink d0/lb 0 2024-09-21T11:39:16.682 INFO:tasks.workunit.client.0.smithi118.stdout:1/192: symlink d6/d1f/l38 0 2024-09-21T11:39:16.682 INFO:tasks.workunit.client.1.smithi149.stdout:6/601: truncate d8/da/fd 3430717 0 2024-09-21T11:39:16.683 INFO:tasks.workunit.client.1.smithi149.stdout:6/602: stat d8/d32/d37/d2b/d51/f59 0 2024-09-21T11:39:16.684 INFO:tasks.workunit.client.0.smithi118.stdout:5/176: symlink d0/db/d35/d2c/d40/l41 0 2024-09-21T11:39:16.686 INFO:tasks.workunit.client.1.smithi149.stdout:9/681: creat d18/d19/d1a/d2f/d33/fd9 x:0 0 0 2024-09-21T11:39:16.687 INFO:tasks.workunit.client.0.smithi118.stdout:0/436: mknod d5/c98 0 2024-09-21T11:39:16.688 INFO:tasks.workunit.client.1.smithi149.stdout:7/777: mkdir d12/d5b/db5/dc5/de9/d4a/d6c/da0/df0 0 2024-09-21T11:39:16.688 INFO:tasks.workunit.client.0.smithi118.stdout:0/437: write d5/d10/d1e/d23/f7d [289537,97032] 0 2024-09-21T11:39:16.689 INFO:tasks.workunit.client.1.smithi149.stdout:2/808: dwrite d8/da/d13/d2d/d6f/de8/dff/f102 [0,4194304] 0 2024-09-21T11:39:16.690 INFO:tasks.workunit.client.1.smithi149.stdout:1/620: creat d2/dd/d35/d1c/d37/da3/fcd x:0 0 0 2024-09-21T11:39:16.691 INFO:tasks.workunit.client.1.smithi149.stdout:2/809: read - d8/d20/d78/ddb/f119 zero size 2024-09-21T11:39:16.692 INFO:tasks.workunit.client.1.smithi149.stdout:2/810: chown d8/da/d13/d1a 19 1 2024-09-21T11:39:16.692 INFO:tasks.workunit.client.1.smithi149.stdout:1/621: truncate d2/dd/d2e/d4c/f5c 656003 0 2024-09-21T11:39:16.693 INFO:tasks.workunit.client.1.smithi149.stdout:0/618: dread - dd/d6a/f88 zero size 2024-09-21T11:39:16.694 INFO:tasks.workunit.client.1.smithi149.stdout:0/619: chown dd/l3e 54822012 1 2024-09-21T11:39:16.695 INFO:tasks.workunit.client.1.smithi149.stdout:0/620: write dd/d1a/d1b/d72/d85/d8c/f89 [4843173,49108] 0 2024-09-21T11:39:16.696 INFO:tasks.workunit.client.1.smithi149.stdout:0/621: stat dd/d32 0 2024-09-21T11:39:16.700 INFO:tasks.workunit.client.1.smithi149.stdout:4/723: rmdir d4/d6/d63/d92 39 2024-09-21T11:39:16.702 INFO:tasks.workunit.client.0.smithi118.stdout:9/261: rename d0/d4/d23/c34 to d0/c6a 0 2024-09-21T11:39:16.704 INFO:tasks.workunit.client.0.smithi118.stdout:7/134: write d0/d3/fd [4647769,7405] 0 2024-09-21T11:39:16.706 INFO:tasks.workunit.client.1.smithi149.stdout:8/599: write d3/f20 [1140012,28894] 0 2024-09-21T11:39:16.708 INFO:tasks.workunit.client.0.smithi118.stdout:9/262: creat d0/d20/f6b x:0 0 0 2024-09-21T11:39:16.709 INFO:tasks.workunit.client.0.smithi118.stdout:5/177: link d0/db/d35/d30/d1a/d33/l39 d0/db/d35/d30/d1a/l42 0 2024-09-21T11:39:16.711 INFO:tasks.workunit.client.0.smithi118.stdout:7/135: creat d0/d3/d1d/f34 x:0 0 0 2024-09-21T11:39:16.712 INFO:tasks.workunit.client.0.smithi118.stdout:7/136: dread - d0/d3/d14/f25 zero size 2024-09-21T11:39:16.713 INFO:tasks.workunit.client.0.smithi118.stdout:1/193: rename d6/de/f17 to d6/d1f/f39 0 2024-09-21T11:39:16.715 INFO:tasks.workunit.client.0.smithi118.stdout:7/137: truncate d0/d3/f11 5000241 0 2024-09-21T11:39:16.715 INFO:tasks.workunit.client.0.smithi118.stdout:1/194: write d6/f19 [1656811,1704] 0 2024-09-21T11:39:16.716 INFO:tasks.workunit.client.0.smithi118.stdout:0/438: getdents d5/d34/d44/d7c 0 2024-09-21T11:39:16.716 INFO:tasks.workunit.client.0.smithi118.stdout:9/263: dwrite d0/d4/d23/f32 [0,4194304] 0 2024-09-21T11:39:16.718 INFO:tasks.workunit.client.0.smithi118.stdout:7/138: chown d0/f6 223081 1 2024-09-21T11:39:16.718 INFO:tasks.workunit.client.0.smithi118.stdout:9/264: write d0/f5 [10944802,125901] 0 2024-09-21T11:39:16.722 INFO:tasks.workunit.client.0.smithi118.stdout:5/178: link d0/db/d35/d2c/f3e d0/d6/d25/f43 0 2024-09-21T11:39:16.726 INFO:tasks.workunit.client.0.smithi118.stdout:7/139: mkdir d0/d3/d1d/d35 0 2024-09-21T11:39:16.732 INFO:tasks.workunit.client.0.smithi118.stdout:5/179: unlink d0/d6/d25/f3c 0 2024-09-21T11:39:16.735 INFO:tasks.workunit.client.0.smithi118.stdout:1/195: creat d6/d2a/f3a x:0 0 0 2024-09-21T11:39:16.737 INFO:tasks.workunit.client.0.smithi118.stdout:7/140: dread d0/d3/f11 [0,4194304] 0 2024-09-21T11:39:16.739 INFO:tasks.workunit.client.0.smithi118.stdout:0/439: creat d5/d10/d1e/d23/d3a/d90/f99 x:0 0 0 2024-09-21T11:39:16.743 INFO:tasks.workunit.client.0.smithi118.stdout:0/440: dread d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:16.743 INFO:tasks.workunit.client.0.smithi118.stdout:5/180: rmdir d0/db/d35/d30/d1a/d33 39 2024-09-21T11:39:16.749 INFO:tasks.workunit.client.0.smithi118.stdout:5/181: dwrite d0/fe [0,4194304] 0 2024-09-21T11:39:16.752 INFO:tasks.workunit.client.0.smithi118.stdout:1/196: mkdir d6/d3b 0 2024-09-21T11:39:16.752 INFO:tasks.workunit.client.0.smithi118.stdout:1/197: fdatasync d6/de/f25 0 2024-09-21T11:39:16.754 INFO:tasks.workunit.client.1.smithi149.stdout:6/603: stat d8/da/d2c/l89 0 2024-09-21T11:39:16.755 INFO:tasks.workunit.client.0.smithi118.stdout:7/141: mknod d0/d3/c36 0 2024-09-21T11:39:16.756 INFO:tasks.workunit.client.1.smithi149.stdout:3/726: getdents d6/d5f/d60/d88/de7 0 2024-09-21T11:39:16.757 INFO:tasks.workunit.client.1.smithi149.stdout:3/727: dread - d6/d79/d7e/dcb/ffc zero size 2024-09-21T11:39:16.759 INFO:tasks.workunit.client.0.smithi118.stdout:9/265: getdents d0/d4/d23 0 2024-09-21T11:39:16.760 INFO:tasks.workunit.client.0.smithi118.stdout:0/441: mkdir d5/d34/d44/d87/d9a 0 2024-09-21T11:39:16.763 INFO:tasks.workunit.client.0.smithi118.stdout:5/182: readlink d0/db/d35/d30/d1a/l42 0 2024-09-21T11:39:16.764 INFO:tasks.workunit.client.0.smithi118.stdout:5/183: write d0/fe [4605546,79336] 0 2024-09-21T11:39:16.768 INFO:tasks.workunit.client.0.smithi118.stdout:1/198: fsync d6/d2a/f28 0 2024-09-21T11:39:16.768 INFO:tasks.workunit.client.1.smithi149.stdout:2/811: dwrite d8/da/d13/d2d/ffc [4194304,4194304] 0 2024-09-21T11:39:16.770 INFO:tasks.workunit.client.0.smithi118.stdout:7/142: stat d0/d3/d1d/l33 0 2024-09-21T11:39:16.771 INFO:tasks.workunit.client.0.smithi118.stdout:7/143: chown d0/d3/d13/l1b 786121 1 2024-09-21T11:39:16.772 INFO:tasks.workunit.client.0.smithi118.stdout:9/266: mkdir d0/d20/d4c/d5f/d6c 0 2024-09-21T11:39:16.775 INFO:tasks.workunit.client.0.smithi118.stdout:0/442: unlink d5/d10/d1e/d20/f43 0 2024-09-21T11:39:16.778 INFO:tasks.workunit.client.1.smithi149.stdout:4/724: symlink d4/d6/d63/d15/d30/d8a/da7/lfc 0 2024-09-21T11:39:16.779 INFO:tasks.workunit.client.1.smithi149.stdout:4/725: chown d4/d6/d63/d10/l9f 14653435 1 2024-09-21T11:39:16.780 INFO:tasks.workunit.client.1.smithi149.stdout:4/726: stat d4/d6/d63/d15/d16/f33 0 2024-09-21T11:39:16.783 INFO:tasks.workunit.client.1.smithi149.stdout:6/604: symlink d8/da/d2c/d2d/d9a/lca 0 2024-09-21T11:39:16.784 INFO:tasks.workunit.client.1.smithi149.stdout:2/812: dread d8/d11/f3a [4194304,4194304] 0 2024-09-21T11:39:16.785 INFO:tasks.workunit.client.1.smithi149.stdout:6/605: truncate d8/d32/d37/d2b/f96 463595 0 2024-09-21T11:39:16.786 INFO:tasks.workunit.client.1.smithi149.stdout:2/813: readlink d8/d20/d78/d7c/laf 0 2024-09-21T11:39:16.786 INFO:tasks.workunit.client.1.smithi149.stdout:6/606: write d8/d32/d64/d97/fb2 [2066018,6170] 0 2024-09-21T11:39:16.787 INFO:tasks.workunit.client.1.smithi149.stdout:6/607: readlink d8/da/d14/l83 0 2024-09-21T11:39:16.788 INFO:tasks.workunit.client.1.smithi149.stdout:6/608: fdatasync d8/d32/d37/d28/f74 0 2024-09-21T11:39:16.788 INFO:tasks.workunit.client.0.smithi118.stdout:9/267: creat d0/d4/d45/f6d x:0 0 0 2024-09-21T11:39:16.790 INFO:tasks.workunit.client.0.smithi118.stdout:9/268: write d0/d4/d45/f6d [118769,129857] 0 2024-09-21T11:39:16.790 INFO:tasks.workunit.client.1.smithi149.stdout:5/749: rename d4/d7/d40/f59 to d4/d7/ff7 0 2024-09-21T11:39:16.793 INFO:tasks.workunit.client.0.smithi118.stdout:0/443: creat d5/d10/d1e/d3d/f9b x:0 0 0 2024-09-21T11:39:16.794 INFO:tasks.workunit.client.0.smithi118.stdout:5/184: mknod d0/c44 0 2024-09-21T11:39:16.795 INFO:tasks.workunit.client.1.smithi149.stdout:7/778: dwrite d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f64 [0,4194304] 0 2024-09-21T11:39:16.795 INFO:tasks.workunit.client.1.smithi149.stdout:0/622: symlink dd/d1a/d1b/d72/d78/dc4/d3a/d66/dcf/ld2 0 2024-09-21T11:39:16.797 INFO:tasks.workunit.client.0.smithi118.stdout:1/199: mkdir d6/d33/d3c 0 2024-09-21T11:39:16.797 INFO:tasks.workunit.client.0.smithi118.stdout:9/269: dwrite d0/d4/d38/f46 [0,4194304] 0 2024-09-21T11:39:16.799 INFO:tasks.workunit.client.0.smithi118.stdout:7/144: mkdir d0/d3/d29/d37 0 2024-09-21T11:39:16.800 INFO:tasks.workunit.client.0.smithi118.stdout:7/145: readlink d0/d3/d14/l1a 0 2024-09-21T11:39:16.801 INFO:tasks.workunit.client.0.smithi118.stdout:0/444: rename d5/d10/d1e/d20/c8c to d5/d10/c9c 0 2024-09-21T11:39:16.805 INFO:tasks.workunit.client.0.smithi118.stdout:2/127: sync 2024-09-21T11:39:16.806 INFO:tasks.workunit.client.0.smithi118.stdout:1/200: mkdir d6/d2a/d3d 0 2024-09-21T11:39:16.807 INFO:tasks.workunit.client.1.smithi149.stdout:9/682: rmdir d18/d36/d3c/d47/db5/dd6 0 2024-09-21T11:39:16.810 INFO:tasks.workunit.client.0.smithi118.stdout:7/146: creat d0/d3/d13/f38 x:0 0 0 2024-09-21T11:39:16.811 INFO:tasks.workunit.client.1.smithi149.stdout:3/728: rename d6/d1f/d4c/c71 to d6/d5f/d60/d88/de7/c104 0 2024-09-21T11:39:16.818 INFO:tasks.workunit.client.1.smithi149.stdout:7/779: creat d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/ff1 x:0 0 0 2024-09-21T11:39:16.819 INFO:tasks.workunit.client.0.smithi118.stdout:1/201: fdatasync d6/de/f22 0 2024-09-21T11:39:16.821 INFO:tasks.workunit.client.0.smithi118.stdout:9/270: mknod d0/d20/d4c/d5f/d68/c6e 0 2024-09-21T11:39:16.823 INFO:tasks.workunit.client.1.smithi149.stdout:7/780: dwrite d12/d5b/db5/dc5/de9/d68/dc4/f3e [0,4194304] 0 2024-09-21T11:39:16.826 INFO:tasks.workunit.client.1.smithi149.stdout:4/727: rename d4/d6/d63/d15/d16/f33 to d4/d6/d63/d2d/ffd 0 2024-09-21T11:39:16.828 INFO:tasks.workunit.client.1.smithi149.stdout:8/600: truncate d3/f17 687233 0 2024-09-21T11:39:16.829 INFO:tasks.workunit.client.1.smithi149.stdout:5/750: mknod d4/d7/dbd/cf8 0 2024-09-21T11:39:16.832 INFO:tasks.workunit.client.1.smithi149.stdout:4/728: dread d4/d6/d63/d2d/dd6/fbc [0,4194304] 0 2024-09-21T11:39:16.832 INFO:tasks.workunit.client.0.smithi118.stdout:1/202: mknod d6/d1f/c3e 0 2024-09-21T11:39:16.833 INFO:tasks.workunit.client.1.smithi149.stdout:1/622: link d2/dd/d35/d7c/ccb d2/dd/d35/d1c/d41/cce 0 2024-09-21T11:39:16.834 INFO:tasks.workunit.client.1.smithi149.stdout:1/623: fdatasync d2/dd/d35/d1c/f39 0 2024-09-21T11:39:16.835 INFO:tasks.workunit.client.0.smithi118.stdout:9/271: symlink d0/d4/d23/l6f 0 2024-09-21T11:39:16.835 INFO:tasks.workunit.client.1.smithi149.stdout:1/624: chown d2/d2b/f31 90579658 1 2024-09-21T11:39:16.838 INFO:tasks.workunit.client.1.smithi149.stdout:2/814: dwrite d8/dd/d5c/d60/d67/d8a/fa6 [0,4194304] 0 2024-09-21T11:39:16.838 INFO:tasks.workunit.client.1.smithi149.stdout:0/623: symlink dd/d1a/d1b/d72/d78/d8b/d98/dbc/ld3 0 2024-09-21T11:39:16.839 INFO:tasks.workunit.client.0.smithi118.stdout:7/147: truncate d0/f6 3482871 0 2024-09-21T11:39:16.841 INFO:tasks.workunit.client.0.smithi118.stdout:2/128: rmdir de/d1f/d23 0 2024-09-21T11:39:16.842 INFO:tasks.workunit.client.0.smithi118.stdout:2/129: dread - de/f2a zero size 2024-09-21T11:39:16.844 INFO:tasks.workunit.client.1.smithi149.stdout:6/609: rename d8/d32/d37/f3c to d8/da/d2c/d2d/fcb 0 2024-09-21T11:39:16.844 INFO:tasks.workunit.client.0.smithi118.stdout:5/185: truncate d0/f36 1631772 0 2024-09-21T11:39:16.844 INFO:tasks.workunit.client.1.smithi149.stdout:6/610: fsync d8/d32/d37/d2b/d7e/f86 0 2024-09-21T11:39:16.845 INFO:tasks.workunit.client.0.smithi118.stdout:5/186: read d0/fe [1126674,15729] 0 2024-09-21T11:39:16.847 INFO:tasks.workunit.client.0.smithi118.stdout:5/187: dread d0/f2e [0,4194304] 0 2024-09-21T11:39:16.848 INFO:tasks.workunit.client.1.smithi149.stdout:6/611: dread d8/da/d3d/f43 [0,4194304] 0 2024-09-21T11:39:16.849 INFO:tasks.workunit.client.0.smithi118.stdout:0/445: truncate d5/d10/d1e/f27 2333431 0 2024-09-21T11:39:16.849 INFO:tasks.workunit.client.1.smithi149.stdout:6/612: write d8/da/d11/f26 [5217760,50074] 0 2024-09-21T11:39:16.850 INFO:tasks.workunit.client.0.smithi118.stdout:2/130: symlink de/d1f/l2e 0 2024-09-21T11:39:16.851 INFO:tasks.workunit.client.0.smithi118.stdout:7/148: dread d0/d3/f11 [0,4194304] 0 2024-09-21T11:39:16.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.849+0000 7f6079c8f640 1 -- 172.21.15.118:0/3740920283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6074101a80 msgr2=0x7f6074101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:16.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.849+0000 7f6079c8f640 1 --2- 172.21.15.118:0/3740920283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6074101a80 0x7f6074101f00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f606c009c20 tx=0x7f606c02a970 comp rx=0 tx=0).stop 2024-09-21T11:39:16.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.850+0000 7f6079c8f640 1 -- 172.21.15.118:0/3740920283 shutdown_connections 2024-09-21T11:39:16.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.850+0000 7f6079c8f640 1 --2- 172.21.15.118:0/3740920283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6074101a80 0x7f6074101f00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:16.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.850+0000 7f6079c8f640 1 --2- 172.21.15.118:0/3740920283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6074100880 0x7f6074100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:16.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.850+0000 7f6079c8f640 1 -- 172.21.15.118:0/3740920283 >> 172.21.15.118:0/3740920283 conn(0x7f60740fc010 msgr2=0x7f60740fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:16.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.850+0000 7f6079c8f640 1 -- 172.21.15.118:0/3740920283 shutdown_connections 2024-09-21T11:39:16.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.850+0000 7f6079c8f640 1 -- 172.21.15.118:0/3740920283 wait complete. 2024-09-21T11:39:16.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.850+0000 7f6079c8f640 1 Processor -- start 2024-09-21T11:39:16.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.851+0000 7f6079c8f640 1 -- start start 2024-09-21T11:39:16.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.851+0000 7f6079c8f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6074100880 0x7f6074199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:16.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.851+0000 7f6079c8f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6074101a80 0x7f6074199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:16.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.851+0000 7f6079c8f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f60741086c0 con 0x7f6074101a80 2024-09-21T11:39:16.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.851+0000 7f6079c8f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6074108540 con 0x7f6074100880 2024-09-21T11:39:16.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.852+0000 7f60737fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6074100880 0x7f6074199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:16.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.852+0000 7f60737fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6074100880 0x7f6074199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:55994/0 (socket says 172.21.15.118:55994) 2024-09-21T11:39:16.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.852+0000 7f60737fe640 1 -- 172.21.15.118:0/2643421893 learned_addr learned my addr 172.21.15.118:0/2643421893 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:16.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.852+0000 7f6072ffd640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6074101a80 0x7f6074199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:16.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.852+0000 7f6072ffd640 1 -- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6074100880 msgr2=0x7f6074199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:16.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.852+0000 7f6072ffd640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6074100880 0x7f6074199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:16.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.852+0000 7f6072ffd640 1 -- 172.21.15.118:0/2643421893 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607419a230 con 0x7f6074101a80 2024-09-21T11:39:16.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.852+0000 7f60737fe640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6074100880 0x7f6074199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T11:39:16.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.853+0000 7f6072ffd640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6074101a80 0x7f6074199bb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f606c02f900 tx=0x7f606c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:16.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.853+0000 7f6070ff9640 1 -- 172.21.15.118:0/2643421893 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f606c034050 con 0x7f6074101a80 2024-09-21T11:39:16.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.853+0000 7f6070ff9640 1 -- 172.21.15.118:0/2643421893 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f606c003e30 con 0x7f6074101a80 2024-09-21T11:39:16.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.853+0000 7f6070ff9640 1 -- 172.21.15.118:0/2643421893 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f606c0047a0 con 0x7f6074101a80 2024-09-21T11:39:16.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.853+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607410a750 con 0x7f6074101a80 2024-09-21T11:39:16.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.853+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607410aca0 con 0x7f6074101a80 2024-09-21T11:39:16.857 INFO:tasks.workunit.client.0.smithi118.stdout:5/188: symlink d0/db/d35/da/l45 0 2024-09-21T11:39:16.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.855+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6074100c80 con 0x7f6074101a80 2024-09-21T11:39:16.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.855+0000 7f6070ff9640 1 -- 172.21.15.118:0/2643421893 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f606c053060 con 0x7f6074101a80 2024-09-21T11:39:16.858 INFO:tasks.workunit.client.1.smithi149.stdout:3/729: write d6/d1f/d4c/f8f [225883,128402] 0 2024-09-21T11:39:16.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.856+0000 7f6070ff9640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f605c074a80 0x7f605c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:16.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.856+0000 7f60737fe640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f605c074a80 0x7f605c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:16.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.856+0000 7f6070ff9640 1 -- 172.21.15.118:0/2643421893 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f606c0bfcb0 con 0x7f6074101a80 2024-09-21T11:39:16.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.857+0000 7f60737fe640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f605c074a80 0x7f605c076f40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f60640058c0 tx=0x7f6064005f90 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:16.860 INFO:tasks.workunit.client.0.smithi118.stdout:7/149: symlink d0/d3/d29/l39 0 2024-09-21T11:39:16.861 INFO:tasks.workunit.client.1.smithi149.stdout:1/625: truncate d2/dd/d35/d1c/f23 4238711 0 2024-09-21T11:39:16.865 INFO:tasks.workunit.client.0.smithi118.stdout:5/189: symlink d0/db/d26/l46 0 2024-09-21T11:39:16.866 INFO:tasks.workunit.client.1.smithi149.stdout:0/624: symlink dd/d1a/d1b/d81/d97/ld4 0 2024-09-21T11:39:16.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:16.864+0000 7f6070ff9640 1 -- 172.21.15.118:0/2643421893 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f606c047070 con 0x7f6074101a80 2024-09-21T11:39:16.867 INFO:tasks.workunit.client.1.smithi149.stdout:0/625: truncate dd/d1a/d1b/d50/fcd 158551 0 2024-09-21T11:39:16.868 INFO:tasks.workunit.client.0.smithi118.stdout:0/446: mkdir d5/d10/d1e/d23/d3a/d4e/d9d 0 2024-09-21T11:39:16.869 INFO:tasks.workunit.client.1.smithi149.stdout:7/781: getdents d12/d5b/db5/dc5/de9/d4a/d6c/da0/df0 0 2024-09-21T11:39:16.870 INFO:tasks.workunit.client.1.smithi149.stdout:7/782: chown d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f3f 767 1 2024-09-21T11:39:16.872 INFO:tasks.workunit.client.1.smithi149.stdout:7/783: write d12/d5b/db5/dc5/de9/db8/fca [1806422,107319] 0 2024-09-21T11:39:16.872 INFO:tasks.workunit.client.0.smithi118.stdout:7/150: rmdir d0/d3/d13 39 2024-09-21T11:39:16.879 INFO:tasks.workunit.client.1.smithi149.stdout:8/601: mknod d3/d12/cd5 0 2024-09-21T11:39:16.881 INFO:tasks.workunit.client.0.smithi118.stdout:0/447: unlink d5/d10/d1e/d21/l30 0 2024-09-21T11:39:16.881 INFO:tasks.workunit.client.1.smithi149.stdout:5/751: mkdir d4/d7/d40/d43/d49/dc3/df9 0 2024-09-21T11:39:16.882 INFO:tasks.workunit.client.1.smithi149.stdout:5/752: write d4/d1d/d50/f7d [374263,64507] 0 2024-09-21T11:39:16.882 INFO:tasks.workunit.client.0.smithi118.stdout:0/448: write d5/d34/f3c [3093433,34489] 0 2024-09-21T11:39:16.887 INFO:tasks.workunit.client.1.smithi149.stdout:4/729: truncate d4/d6/f59 1299526 0 2024-09-21T11:39:16.887 INFO:tasks.workunit.client.0.smithi118.stdout:7/151: dread d0/d3/fd [0,4194304] 0 2024-09-21T11:39:16.890 INFO:tasks.workunit.client.1.smithi149.stdout:6/613: dwrite d8/da/d2c/d2d/d60/f81 [0,4194304] 0 2024-09-21T11:39:16.890 INFO:tasks.workunit.client.1.smithi149.stdout:3/730: mknod d6/d1f/d47/d37/d3f/c105 0 2024-09-21T11:39:16.893 INFO:tasks.workunit.client.1.smithi149.stdout:0/626: mknod dd/d1a/cd5 0 2024-09-21T11:39:16.895 INFO:tasks.workunit.client.1.smithi149.stdout:4/730: dwrite d4/d6/d18/f4f [0,4194304] 0 2024-09-21T11:39:16.896 INFO:tasks.workunit.client.1.smithi149.stdout:4/731: readlink d4/l2f 0 2024-09-21T11:39:16.899 INFO:tasks.workunit.client.0.smithi118.stdout:5/190: getdents d0/db/d35/d30/d1a 0 2024-09-21T11:39:16.907 INFO:tasks.workunit.client.0.smithi118.stdout:5/191: dwrite d0/d6/f7 [0,4194304] 0 2024-09-21T11:39:16.910 INFO:tasks.workunit.client.0.smithi118.stdout:0/449: rename d5/d10/c1c to d5/c9e 0 2024-09-21T11:39:16.912 INFO:tasks.workunit.client.0.smithi118.stdout:5/192: mknod d0/db/d35/da/c47 0 2024-09-21T11:39:16.913 INFO:tasks.workunit.client.0.smithi118.stdout:0/450: creat d5/d34/f9f x:0 0 0 2024-09-21T11:39:16.915 INFO:tasks.workunit.client.0.smithi118.stdout:0/451: fdatasync d5/f7 0 2024-09-21T11:39:16.915 INFO:tasks.workunit.client.1.smithi149.stdout:8/602: write d3/d33/d34/d55/d5e/d9e/dc2/d18/f51 [4315709,78407] 0 2024-09-21T11:39:16.916 INFO:tasks.workunit.client.1.smithi149.stdout:2/815: link d8/da/d13/d1a/f48 d8/d20/f11b 0 2024-09-21T11:39:16.919 INFO:tasks.workunit.client.1.smithi149.stdout:6/614: read f4 [1643976,59077] 0 2024-09-21T11:39:16.920 INFO:tasks.workunit.client.0.smithi118.stdout:5/193: dwrite d0/db/d35/d30/d1a/f2a [0,4194304] 0 2024-09-21T11:39:16.923 INFO:tasks.workunit.client.0.smithi118.stdout:0/452: rename d5/d34/d44/d7c/c88 to d5/d29/d68/ca0 0 2024-09-21T11:39:16.923 INFO:tasks.workunit.client.0.smithi118.stdout:5/194: truncate d0/db/d35/da/f21 4665160 0 2024-09-21T11:39:16.924 INFO:tasks.workunit.client.0.smithi118.stdout:5/195: readlink d0/db/d26/l46 0 2024-09-21T11:39:16.925 INFO:tasks.workunit.client.0.smithi118.stdout:0/453: fdatasync d5/d10/d1e/d21/d2a/f78 0 2024-09-21T11:39:16.929 INFO:tasks.workunit.client.1.smithi149.stdout:2/816: symlink d8/da/d13/d53/l11c 0 2024-09-21T11:39:16.931 INFO:tasks.workunit.client.1.smithi149.stdout:2/817: write d8/dd/d8c/de0/ff0 [627535,64517] 0 2024-09-21T11:39:16.931 INFO:tasks.workunit.client.1.smithi149.stdout:6/615: write d8/da/d3d/f43 [1751121,111616] 0 2024-09-21T11:39:16.932 INFO:tasks.workunit.client.1.smithi149.stdout:2/818: write d8/da/d13/d1a/d29/f69 [5150609,21498] 0 2024-09-21T11:39:16.933 INFO:tasks.workunit.client.1.smithi149.stdout:6/616: chown d8/da/d3d/f43 3 1 2024-09-21T11:39:16.935 INFO:tasks.workunit.client.0.smithi118.stdout:0/454: rename d5/d34/d44/d7c/f8d to d5/d34/d44/fa1 0 2024-09-21T11:39:16.936 INFO:tasks.workunit.client.1.smithi149.stdout:0/627: write dd/d6a/f88 [700194,83331] 0 2024-09-21T11:39:16.937 INFO:tasks.workunit.client.1.smithi149.stdout:7/784: link d12/d5b/db5/dc5/de9/d4a/f76 d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/ff2 0 2024-09-21T11:39:16.938 INFO:tasks.workunit.client.0.smithi118.stdout:5/196: symlink d0/db/d35/l48 0 2024-09-21T11:39:16.939 INFO:tasks.workunit.client.1.smithi149.stdout:9/683: sync 2024-09-21T11:39:16.941 INFO:tasks.workunit.client.1.smithi149.stdout:7/785: read d12/d5b/db5/dc5/de9/d68/f7b [4850238,8753] 0 2024-09-21T11:39:16.942 INFO:tasks.workunit.client.0.smithi118.stdout:0/455: dwrite d5/d10/f28 [0,4194304] 0 2024-09-21T11:39:16.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/753: truncate d4/d7/f38 5584930 0 2024-09-21T11:39:16.944 INFO:tasks.workunit.client.1.smithi149.stdout:3/731: truncate d6/d1f/d47/d37/d3a/f6c 936895 0 2024-09-21T11:39:16.945 INFO:tasks.workunit.client.1.smithi149.stdout:6/617: dwrite d8/d32/d37/d28/d2f/d6a/d72/fac [0,4194304] 0 2024-09-21T11:39:16.945 INFO:tasks.workunit.client.0.smithi118.stdout:5/197: symlink d0/db/d35/d2c/d40/l49 0 2024-09-21T11:39:16.946 INFO:tasks.workunit.client.0.smithi118.stdout:5/198: dread - d0/f37 zero size 2024-09-21T11:39:16.946 INFO:tasks.workunit.client.0.smithi118.stdout:5/199: dread - d0/f31 zero size 2024-09-21T11:39:16.947 INFO:tasks.workunit.client.1.smithi149.stdout:3/732: chown d6/d1f/fbd 1 1 2024-09-21T11:39:16.947 INFO:tasks.workunit.client.0.smithi118.stdout:0/456: mknod d5/d10/ca2 0 2024-09-21T11:39:16.949 INFO:tasks.workunit.client.1.smithi149.stdout:2/819: dread d8/d20/d57/f47 [0,4194304] 0 2024-09-21T11:39:16.949 INFO:tasks.workunit.client.1.smithi149.stdout:0/628: dwrite f8 [8388608,4194304] 0 2024-09-21T11:39:16.950 INFO:tasks.workunit.client.1.smithi149.stdout:3/733: chown d6/d79/d7e/fb5 2791303 1 2024-09-21T11:39:16.950 INFO:tasks.workunit.client.0.smithi118.stdout:0/457: chown d5/d29/c49 18743572 1 2024-09-21T11:39:16.951 INFO:tasks.workunit.client.0.smithi118.stdout:0/458: dread - d5/d10/d1e/d3d/d93/f96 zero size 2024-09-21T11:39:16.952 INFO:tasks.workunit.client.0.smithi118.stdout:0/459: readlink d5/d10/d1e/d21/d2a/d48/l4f 0 2024-09-21T11:39:16.958 INFO:tasks.workunit.client.1.smithi149.stdout:6/618: mkdir d8/d32/dcc 0 2024-09-21T11:39:16.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/754: read d4/d7/d40/d43/d49/f4b [3445165,43917] 0 2024-09-21T11:39:16.961 INFO:tasks.workunit.client.1.smithi149.stdout:8/603: dwrite d3/d3c/d8f/f7a [0,4194304] 0 2024-09-21T11:39:16.963 INFO:tasks.workunit.client.0.smithi118.stdout:0/460: link d5/d34/l36 d5/d10/d1e/d21/d2a/d48/la3 0 2024-09-21T11:39:16.964 INFO:tasks.workunit.client.0.smithi118.stdout:0/461: fsync d5/d10/d1e/d21/d2a/f83 0 2024-09-21T11:39:16.965 INFO:tasks.workunit.client.0.smithi118.stdout:3/142: sync 2024-09-21T11:39:16.965 INFO:tasks.workunit.client.0.smithi118.stdout:4/170: sync 2024-09-21T11:39:16.965 INFO:tasks.workunit.client.0.smithi118.stdout:8/391: sync 2024-09-21T11:39:16.965 INFO:tasks.workunit.client.0.smithi118.stdout:6/147: sync 2024-09-21T11:39:16.967 INFO:tasks.workunit.client.1.smithi149.stdout:2/820: chown d8/dd/f1d 55470944 1 2024-09-21T11:39:16.971 INFO:tasks.workunit.client.1.smithi149.stdout:7/786: truncate d12/d5b/db5/dc5/de9/d4a/f76 3234470 0 2024-09-21T11:39:16.973 INFO:tasks.workunit.client.1.smithi149.stdout:6/619: creat d8/da/d11/fcd x:0 0 0 2024-09-21T11:39:16.974 INFO:tasks.workunit.client.1.smithi149.stdout:8/604: truncate d3/d33/d34/d72/fa3 259254 0 2024-09-21T11:39:16.975 INFO:tasks.workunit.client.1.smithi149.stdout:0/629: read dd/d1a/d5a/d65/fc7 [859827,18923] 0 2024-09-21T11:39:16.975 INFO:tasks.workunit.client.0.smithi118.stdout:6/148: mkdir d8/d14/d33 0 2024-09-21T11:39:16.977 INFO:tasks.workunit.client.1.smithi149.stdout:5/755: creat d4/d7/d40/d51/d56/ffa x:0 0 0 2024-09-21T11:39:16.977 INFO:tasks.workunit.client.0.smithi118.stdout:6/149: truncate d8/d14/d28/f31 704321 0 2024-09-21T11:39:16.978 INFO:tasks.workunit.client.1.smithi149.stdout:9/684: dwrite d18/d1c/f4f [0,4194304] 0 2024-09-21T11:39:16.978 INFO:tasks.workunit.client.0.smithi118.stdout:3/143: mknod d5/c39 0 2024-09-21T11:39:16.979 INFO:tasks.workunit.client.1.smithi149.stdout:9/685: chown d18 409 1 2024-09-21T11:39:16.983 INFO:tasks.workunit.client.0.smithi118.stdout:8/392: mkdir d2/dc/d10/d2e/d18/d83 0 2024-09-21T11:39:16.984 INFO:tasks.workunit.client.0.smithi118.stdout:6/150: dwrite d8/d14/d28/f2a [0,4194304] 0 2024-09-21T11:39:16.984 INFO:tasks.workunit.client.0.smithi118.stdout:8/393: readlink d2/dc/d35/d42/l4b 0 2024-09-21T11:39:16.984 INFO:tasks.workunit.client.1.smithi149.stdout:1/626: sync 2024-09-21T11:39:16.986 INFO:tasks.workunit.client.0.smithi118.stdout:0/462: write d5/f15 [296116,72464] 0 2024-09-21T11:39:16.990 INFO:tasks.workunit.client.1.smithi149.stdout:6/620: rmdir d8/d32/d37/d28/d2e 39 2024-09-21T11:39:16.992 INFO:tasks.workunit.client.1.smithi149.stdout:3/734: write d6/d1f/f57 [993093,63620] 0 2024-09-21T11:39:16.995 INFO:tasks.workunit.client.1.smithi149.stdout:6/621: truncate d8/fa3 490819 0 2024-09-21T11:39:16.996 INFO:tasks.workunit.client.1.smithi149.stdout:6/622: chown d8/d32/d37/d28/d87/da4/lbb 67404194 1 2024-09-21T11:39:16.997 INFO:tasks.workunit.client.1.smithi149.stdout:7/787: dread d12/f74 [0,4194304] 0 2024-09-21T11:39:16.998 INFO:tasks.workunit.client.1.smithi149.stdout:5/756: dread d4/d7/ff7 [0,4194304] 0 2024-09-21T11:39:17.000 INFO:tasks.workunit.client.0.smithi118.stdout:8/394: mkdir d2/dc/d49/d84 0 2024-09-21T11:39:17.003 INFO:tasks.workunit.client.1.smithi149.stdout:2/821: symlink d8/da/d13/d1a/dc5/l11d 0 2024-09-21T11:39:17.005 INFO:tasks.workunit.client.1.smithi149.stdout:5/757: dwrite d4/d7/d40/d43/d49/fe6 [0,4194304] 0 2024-09-21T11:39:17.007 INFO:tasks.workunit.client.1.smithi149.stdout:8/605: mknod d3/d33/cd6 0 2024-09-21T11:39:17.008 INFO:tasks.workunit.client.1.smithi149.stdout:1/627: fsync d2/dd/d35/d1c/d7a/f81 0 2024-09-21T11:39:17.008 INFO:tasks.workunit.client.0.smithi118.stdout:3/144: write d5/d1d/f19 [4698917,22700] 0 2024-09-21T11:39:17.009 INFO:tasks.workunit.client.0.smithi118.stdout:4/171: link d2/d6/cf d2/d6/de/d1c/d23/c41 0 2024-09-21T11:39:17.011 INFO:tasks.workunit.client.1.smithi149.stdout:3/735: mkdir d6/d1f/d47/d37/d3f/dc5/d106 0 2024-09-21T11:39:17.012 INFO:tasks.workunit.client.0.smithi118.stdout:6/151: mknod d8/d14/d33/c34 0 2024-09-21T11:39:17.014 INFO:tasks.workunit.client.1.smithi149.stdout:6/623: symlink d8/lce 0 2024-09-21T11:39:17.014 INFO:tasks.workunit.client.1.smithi149.stdout:8/606: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fcf [0,4194304] 0 2024-09-21T11:39:17.016 INFO:tasks.workunit.client.0.smithi118.stdout:8/395: unlink d2/dc/d10/d2e/d18/l4d 0 2024-09-21T11:39:17.018 INFO:tasks.workunit.client.1.smithi149.stdout:0/630: rename dd/d1a/d1b/d72/d87/da6 to dd/d1a/d1b/d72/d78/dd6 0 2024-09-21T11:39:17.020 INFO:tasks.workunit.client.0.smithi118.stdout:3/145: readlink d5/l14 0 2024-09-21T11:39:17.022 INFO:tasks.workunit.client.0.smithi118.stdout:4/172: rmdir d2/d6/de/d1c 39 2024-09-21T11:39:17.022 INFO:tasks.workunit.client.1.smithi149.stdout:0/631: read dd/d2d/f56 [1749493,79307] 0 2024-09-21T11:39:17.023 INFO:tasks.workunit.client.0.smithi118.stdout:0/463: dwrite d5/d10/d1e/d20/f2b [0,4194304] 0 2024-09-21T11:39:17.026 INFO:tasks.workunit.client.0.smithi118.stdout:8/396: dwrite d2/fa [0,4194304] 0 2024-09-21T11:39:17.029 INFO:tasks.workunit.client.1.smithi149.stdout:3/736: mkdir d6/d1f/d47/d37/d3a/d107 0 2024-09-21T11:39:17.029 INFO:tasks.workunit.client.1.smithi149.stdout:6/624: symlink d8/d32/d37/d2b/d7d/db8/lcf 0 2024-09-21T11:39:17.030 INFO:tasks.workunit.client.0.smithi118.stdout:8/397: truncate d2/dc/d10/d2e/f21 8483780 0 2024-09-21T11:39:17.030 INFO:tasks.workunit.client.1.smithi149.stdout:8/607: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7 0 2024-09-21T11:39:17.032 INFO:tasks.workunit.client.1.smithi149.stdout:8/608: read - d3/d12/d98/fa7 zero size 2024-09-21T11:39:17.034 INFO:tasks.workunit.client.0.smithi118.stdout:3/146: rename d5/l21 to d5/d1d/l3a 0 2024-09-21T11:39:17.038 INFO:tasks.workunit.client.0.smithi118.stdout:0/464: fdatasync d5/d10/d1e/d21/d2a/f45 0 2024-09-21T11:39:17.040 INFO:tasks.workunit.client.1.smithi149.stdout:9/686: rename d18/d19/d29/d39/l87 to d18/d36/d3c/d47/lda 0 2024-09-21T11:39:17.044 INFO:tasks.workunit.client.0.smithi118.stdout:6/152: getdents d8 0 2024-09-21T11:39:17.044 INFO:tasks.workunit.client.1.smithi149.stdout:5/758: mknod d4/d1d/cfb 0 2024-09-21T11:39:17.045 INFO:tasks.workunit.client.1.smithi149.stdout:4/732: sync 2024-09-21T11:39:17.046 INFO:tasks.workunit.client.1.smithi149.stdout:5/759: chown d4/d7/d40/d43 448939 1 2024-09-21T11:39:17.046 INFO:tasks.workunit.client.0.smithi118.stdout:3/147: truncate d5/d1d/f15 936448 0 2024-09-21T11:39:17.049 INFO:tasks.workunit.client.1.smithi149.stdout:6/625: dwrite d8/da/d2c/d2d/d60/f81 [0,4194304] 0 2024-09-21T11:39:17.050 INFO:tasks.workunit.client.1.smithi149.stdout:3/737: fsync d6/d1f/d47/d37/dd6/fba 0 2024-09-21T11:39:17.050 INFO:tasks.workunit.client.1.smithi149.stdout:1/628: dread d2/dd/d35/f8d [0,4194304] 0 2024-09-21T11:39:17.051 INFO:tasks.workunit.client.0.smithi118.stdout:0/465: mkdir d5/d34/d44/d87/da4 0 2024-09-21T11:39:17.054 INFO:tasks.workunit.client.0.smithi118.stdout:6/153: read - d8/d14/f23 zero size 2024-09-21T11:39:17.056 INFO:tasks.workunit.client.0.smithi118.stdout:3/148: stat d5/f30 0 2024-09-21T11:39:17.057 INFO:tasks.workunit.client.1.smithi149.stdout:8/609: creat d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/d5c/fd8 x:0 0 0 2024-09-21T11:39:17.058 INFO:tasks.workunit.client.0.smithi118.stdout:6/154: read d8/fc [199773,59969] 0 2024-09-21T11:39:17.059 INFO:tasks.workunit.client.1.smithi149.stdout:9/687: dwrite d18/d19/d1a/d2f/d30/d54/fbb [0,4194304] 0 2024-09-21T11:39:17.059 INFO:tasks.workunit.client.1.smithi149.stdout:0/632: rename dd/d1a/d1b/d81/f9d to dd/d6a/fd7 0 2024-09-21T11:39:17.060 INFO:tasks.workunit.client.0.smithi118.stdout:0/466: creat d5/d10/d1e/d21/d2a/d48/fa5 x:0 0 0 2024-09-21T11:39:17.062 INFO:tasks.workunit.client.1.smithi149.stdout:7/788: creat d12/d5b/db5/ff3 x:0 0 0 2024-09-21T11:39:17.065 INFO:tasks.workunit.client.0.smithi118.stdout:3/149: dwrite d5/d1d/d1b/d24/f38 [0,4194304] 0 2024-09-21T11:39:17.065 INFO:tasks.workunit.client.1.smithi149.stdout:1/629: dwrite d2/dd/d35/d1c/f39 [0,4194304] 0 2024-09-21T11:39:17.065 INFO:tasks.workunit.client.0.smithi118.stdout:0/467: truncate d5/d10/d1e/d21/d2a/d48/f8a 845184 0 2024-09-21T11:39:17.067 INFO:tasks.workunit.client.1.smithi149.stdout:2/822: dread d8/da/d13/d2d/f34 [0,4194304] 0 2024-09-21T11:39:17.067 INFO:tasks.workunit.client.1.smithi149.stdout:2/823: stat d8/dcb/db8 0 2024-09-21T11:39:17.071 INFO:tasks.workunit.client.0.smithi118.stdout:0/468: dread d5/f5c [0,4194304] 0 2024-09-21T11:39:17.075 INFO:tasks.workunit.client.1.smithi149.stdout:2/824: dwrite d8/d11/feb [0,4194304] 0 2024-09-21T11:39:17.106 INFO:tasks.workunit.client.1.smithi149.stdout:2/825: dread d8/f10c [0,4194304] 0 2024-09-21T11:39:17.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.193+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6074062740 con 0x7f605c074a80 2024-09-21T11:39:17.199 INFO:tasks.workunit.client.1.smithi149.stdout:5/760: dwrite d4/d7/d40/f65 [4194304,4194304] 0 2024-09-21T11:39:17.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.197+0000 7f6070ff9640 1 -- 172.21.15.118:0/2643421893 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f6074062740 con 0x7f605c074a80 2024-09-21T11:39:17.200 INFO:tasks.workunit.client.1.smithi149.stdout:5/761: write d4/d7/d40/d43/d5c/fb0 [432139,24255] 0 2024-09-21T11:39:17.201 INFO:tasks.workunit.client.1.smithi149.stdout:5/762: write d4/d7/f45 [383977,83240] 0 2024-09-21T11:39:17.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.204+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f605c074a80 msgr2=0x7f605c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:17.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.204+0000 7f6079c8f640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f605c074a80 0x7f605c076f40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f60640058c0 tx=0x7f6064005f90 comp rx=0 tx=0).stop 2024-09-21T11:39:17.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.204+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6074101a80 msgr2=0x7f6074199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:17.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.204+0000 7f6079c8f640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6074101a80 0x7f6074199bb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f606c02f900 tx=0x7f606c02f5f0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.206+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 shutdown_connections 2024-09-21T11:39:17.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.206+0000 7f6079c8f640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f605c074a80 0x7f605c076f40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.206+0000 7f6079c8f640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6074101a80 0x7f6074199bb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.206+0000 7f6079c8f640 1 --2- 172.21.15.118:0/2643421893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6074100880 0x7f6074199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.206+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 >> 172.21.15.118:0/2643421893 conn(0x7f60740fc010 msgr2=0x7f60740fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:17.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.206+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 shutdown_connections 2024-09-21T11:39:17.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.206+0000 7f6079c8f640 1 -- 172.21.15.118:0/2643421893 wait complete. 2024-09-21T11:39:17.213 INFO:tasks.workunit.client.0.smithi118.stdout:8/398: link d2/c7a d2/dc/d10/d6a/c85 0 2024-09-21T11:39:17.221 INFO:tasks.workunit.client.1.smithi149.stdout:4/733: dread d4/d6/d63/f28 [0,4194304] 0 2024-09-21T11:39:17.223 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:39:17.226 INFO:tasks.workunit.client.0.smithi118.stdout:0/469: creat d5/d10/d1e/d21/d2a/d48/fa6 x:0 0 0 2024-09-21T11:39:17.227 INFO:tasks.workunit.client.0.smithi118.stdout:0/470: truncate d5/d34/d44/fa1 526494 0 2024-09-21T11:39:17.227 INFO:tasks.workunit.client.1.smithi149.stdout:8/610: unlink d3/d33/d34/d55/d5e/d9e/dc2/d21/f4d 0 2024-09-21T11:39:17.230 INFO:tasks.workunit.client.1.smithi149.stdout:9/688: creat d18/d36/d3c/d47/db5/fdb x:0 0 0 2024-09-21T11:39:17.239 INFO:tasks.workunit.client.1.smithi149.stdout:7/789: dread d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/f8f [0,4194304] 0 2024-09-21T11:39:17.240 INFO:tasks.workunit.client.1.smithi149.stdout:1/630: symlink d2/dd/d35/d5b/dc0/lcf 0 2024-09-21T11:39:17.256 INFO:tasks.workunit.client.0.smithi118.stdout:0/471: creat d5/d10/d1e/d23/d3a/d4e/d9d/fa7 x:0 0 0 2024-09-21T11:39:17.261 INFO:tasks.workunit.client.1.smithi149.stdout:9/689: mknod d18/d4c/d5b/cdc 0 2024-09-21T11:39:17.262 INFO:tasks.workunit.client.1.smithi149.stdout:1/631: dread d2/d5/fc2 [0,4194304] 0 2024-09-21T11:39:17.265 INFO:tasks.workunit.client.0.smithi118.stdout:0/472: creat d5/d10/d1e/d23/d3a/d4e/fa8 x:0 0 0 2024-09-21T11:39:17.272 INFO:tasks.workunit.client.1.smithi149.stdout:1/632: creat d2/dd/d35/d5b/fd0 x:0 0 0 2024-09-21T11:39:17.273 INFO:tasks.workunit.client.1.smithi149.stdout:1/633: read d2/d5/d3d/d88/f3e [1712818,36571] 0 2024-09-21T11:39:17.278 INFO:tasks.workunit.client.1.smithi149.stdout:7/790: getdents d12/d5b/db5/dc5/de9/d4a/d6c/db1/de1 0 2024-09-21T11:39:17.279 INFO:tasks.workunit.client.1.smithi149.stdout:1/634: dwrite d2/d5/d3d/d88/f6d [4194304,4194304] 0 2024-09-21T11:39:17.281 INFO:tasks.workunit.client.1.smithi149.stdout:4/734: creat d4/d4d/d5f/ffe x:0 0 0 2024-09-21T11:39:17.281 INFO:tasks.workunit.client.1.smithi149.stdout:4/735: chown d4/d6/d18/f73 309 1 2024-09-21T11:39:17.285 INFO:tasks.workunit.client.0.smithi118.stdout:9/272: sync 2024-09-21T11:39:17.285 INFO:tasks.workunit.client.0.smithi118.stdout:1/203: sync 2024-09-21T11:39:17.286 INFO:tasks.workunit.client.0.smithi118.stdout:9/273: chown d0/f3a 183 1 2024-09-21T11:39:17.286 INFO:tasks.workunit.client.1.smithi149.stdout:7/791: mkdir d12/d5b/db5/dc5/de9/d4a/d6c/da0/df0/df4 0 2024-09-21T11:39:17.288 INFO:tasks.workunit.client.1.smithi149.stdout:4/736: dread d4/d6/d63/f28 [0,4194304] 0 2024-09-21T11:39:17.288 INFO:tasks.workunit.client.1.smithi149.stdout:1/635: symlink d2/dd/d35/d1c/d41/d74/d9d/ld1 0 2024-09-21T11:39:17.293 INFO:tasks.workunit.client.1.smithi149.stdout:7/792: dwrite d12/d5b/db5/dc5/de9/d4a/d6c/db1/fe4 [0,4194304] 0 2024-09-21T11:39:17.293 INFO:tasks.workunit.client.0.smithi118.stdout:9/274: mknod d0/d4/d45/c70 0 2024-09-21T11:39:17.294 INFO:tasks.workunit.client.0.smithi118.stdout:9/275: dread - d0/f2c zero size 2024-09-21T11:39:17.296 INFO:tasks.workunit.client.0.smithi118.stdout:1/204: dwrite d6/de/f34 [0,4194304] 0 2024-09-21T11:39:17.296 INFO:tasks.workunit.client.0.smithi118.stdout:9/276: write d0/d4/d23/f5e [256241,39202] 0 2024-09-21T11:39:17.298 INFO:tasks.workunit.client.0.smithi118.stdout:9/277: write d0/f5c [337435,128447] 0 2024-09-21T11:39:17.298 INFO:tasks.workunit.client.1.smithi149.stdout:1/636: symlink d2/dd/d2e/d4c/ld2 0 2024-09-21T11:39:17.300 INFO:tasks.workunit.client.1.smithi149.stdout:4/737: dwrite d4/d6/d18/f1c [0,4194304] 0 2024-09-21T11:39:17.301 INFO:tasks.workunit.client.0.smithi118.stdout:9/278: dread d0/f3a [0,4194304] 0 2024-09-21T11:39:17.302 INFO:tasks.workunit.client.0.smithi118.stdout:1/205: read d6/de/d13/f1c [2197237,106872] 0 2024-09-21T11:39:17.303 INFO:tasks.workunit.client.0.smithi118.stdout:9/279: truncate d0/d4/d45/f48 1091985 0 2024-09-21T11:39:17.310 INFO:tasks.workunit.client.1.smithi149.stdout:4/738: dread d4/d6/d18/f4f [0,4194304] 0 2024-09-21T11:39:17.310 INFO:tasks.workunit.client.0.smithi118.stdout:9/280: mkdir d0/d20/d71 0 2024-09-21T11:39:17.310 INFO:tasks.workunit.client.0.smithi118.stdout:1/206: dwrite f0 [0,4194304] 0 2024-09-21T11:39:17.311 INFO:tasks.workunit.client.1.smithi149.stdout:4/739: stat d4/d6/d63/d2d/dd6/d32/d4a 0 2024-09-21T11:39:17.313 INFO:tasks.workunit.client.0.smithi118.stdout:9/281: truncate d0/f24 57815 0 2024-09-21T11:39:17.314 INFO:tasks.workunit.client.0.smithi118.stdout:9/282: stat d0/d4/d23/d4d/c52 0 2024-09-21T11:39:17.319 INFO:tasks.workunit.client.1.smithi149.stdout:4/740: read d4/d6/d63/d15/d30/d6b/daa/fad [4355055,48415] 0 2024-09-21T11:39:17.328 INFO:tasks.workunit.client.1.smithi149.stdout:4/741: getdents d4/d6/d63/d78/d98 0 2024-09-21T11:39:17.331 INFO:tasks.workunit.client.1.smithi149.stdout:4/742: creat d4/d6/d63/d78/fff x:0 0 0 2024-09-21T11:39:17.332 INFO:tasks.workunit.client.1.smithi149.stdout:4/743: fsync d4/d6/d63/d15/d16/d23/d62/fa2 0 2024-09-21T11:39:17.335 INFO:tasks.workunit.client.1.smithi149.stdout:4/744: dread d4/d6/d63/d15/f49 [0,4194304] 0 2024-09-21T11:39:17.341 INFO:tasks.workunit.client.0.smithi118.stdout:6/155: dwrite d8/d14/f23 [0,4194304] 0 2024-09-21T11:39:17.343 INFO:tasks.workunit.client.1.smithi149.stdout:4/745: dwrite d4/d6/d63/d92/fd0 [0,4194304] 0 2024-09-21T11:39:17.343 INFO:tasks.workunit.client.0.smithi118.stdout:6/156: stat d8/c2e 0 2024-09-21T11:39:17.343 INFO:tasks.workunit.client.0.smithi118.stdout:1/207: dread d6/f8 [0,4194304] 0 2024-09-21T11:39:17.353 INFO:tasks.workunit.client.0.smithi118.stdout:6/157: rename d8/d14/l1c to d8/d14/l35 0 2024-09-21T11:39:17.357 INFO:tasks.workunit.client.0.smithi118.stdout:6/158: mknod d8/c36 0 2024-09-21T11:39:17.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.360+0000 7ff7c9c09640 1 -- 172.21.15.118:0/2077164468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4101a40 msgr2=0x7ff7c4101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:17.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.360+0000 7ff7c9c09640 1 --2- 172.21.15.118:0/2077164468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4101a40 0x7ff7c4101ec0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009880 tx=0x7ff7b802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.360+0000 7ff7c9c09640 1 -- 172.21.15.118:0/2077164468 shutdown_connections 2024-09-21T11:39:17.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.360+0000 7ff7c9c09640 1 --2- 172.21.15.118:0/2077164468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4101a40 0x7ff7c4101ec0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.360+0000 7ff7c9c09640 1 --2- 172.21.15.118:0/2077164468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7c4100840 0x7ff7c4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.360+0000 7ff7c9c09640 1 -- 172.21.15.118:0/2077164468 >> 172.21.15.118:0/2077164468 conn(0x7ff7c40fbff0 msgr2=0x7ff7c40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:17.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.360+0000 7ff7c9c09640 1 -- 172.21.15.118:0/2077164468 shutdown_connections 2024-09-21T11:39:17.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.360+0000 7ff7c9c09640 1 -- 172.21.15.118:0/2077164468 wait complete. 2024-09-21T11:39:17.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.361+0000 7ff7c9c09640 1 Processor -- start 2024-09-21T11:39:17.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.361+0000 7ff7c9c09640 1 -- start start 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.362+0000 7ff7c9c09640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4100840 0x7ff7c4196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.362+0000 7ff7c9c09640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7c4101a40 0x7ff7c41968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.362+0000 7ff7c9c09640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c4109660 con 0x7ff7c4100840 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.362+0000 7ff7c9c09640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c41094e0 con 0x7ff7c4101a40 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.362+0000 7ff7c37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4100840 0x7ff7c4196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.362+0000 7ff7c37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4100840 0x7ff7c4196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44872/0 (socket says 172.21.15.118:44872) 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.362+0000 7ff7c37fe640 1 -- 172.21.15.118:0/1682674225 learned_addr learned my addr 172.21.15.118:0/1682674225 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.362+0000 7ff7c2ffd640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7c4101a40 0x7ff7c41968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.362+0000 7ff7c37fe640 1 -- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7c4101a40 msgr2=0x7ff7c41968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.363+0000 7ff7c37fe640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7c4101a40 0x7ff7c41968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.363+0000 7ff7c37fe640 1 -- 172.21.15.118:0/1682674225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c4196f30 con 0x7ff7c4100840 2024-09-21T11:39:17.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.363+0000 7ff7c2ffd640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7c4101a40 0x7ff7c41968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:39:17.366 INFO:tasks.workunit.client.1.smithi149.stdout:3/738: rename d6/l70 to d6/d1f/de5/l108 0 2024-09-21T11:39:17.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.363+0000 7ff7c37fe640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4100840 0x7ff7c4196370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400e940 tx=0x7ff7b400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:17.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.363+0000 7ff7c0ff9640 1 -- 172.21.15.118:0/1682674225 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7b400cac0 con 0x7ff7c4100840 2024-09-21T11:39:17.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.363+0000 7ff7c0ff9640 1 -- 172.21.15.118:0/1682674225 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7b400cc60 con 0x7ff7c4100840 2024-09-21T11:39:17.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.363+0000 7ff7c0ff9640 1 -- 172.21.15.118:0/1682674225 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7b4003de0 con 0x7ff7c4100840 2024-09-21T11:39:17.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.363+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c4069bf0 con 0x7ff7c4100840 2024-09-21T11:39:17.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.363+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c406a180 con 0x7ff7c4100840 2024-09-21T11:39:17.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.365+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c4100c40 con 0x7ff7c4100840 2024-09-21T11:39:17.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.366+0000 7ff7c0ff9640 1 -- 172.21.15.118:0/1682674225 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff7b4003fe0 con 0x7ff7c4100840 2024-09-21T11:39:17.369 INFO:tasks.workunit.client.1.smithi149.stdout:3/739: unlink d6/d1f/d47/d37/dd6/d96/cb7 0 2024-09-21T11:39:17.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.366+0000 7ff7c0ff9640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff7ac074ad0 0x7ff7ac076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:17.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.367+0000 7ff7c0ff9640 1 -- 172.21.15.118:0/1682674225 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7ff7b4096a60 con 0x7ff7c4100840 2024-09-21T11:39:17.370 INFO:tasks.workunit.client.1.smithi149.stdout:3/740: stat d6/d1f/d47/d37/d50/fb0 0 2024-09-21T11:39:17.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.367+0000 7ff7c2ffd640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff7ac074ad0 0x7ff7ac076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:17.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.368+0000 7ff7c2ffd640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff7ac074ad0 0x7ff7ac076f90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8006010 tx=0x7ff7b8000bc0 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:17.371 INFO:tasks.workunit.client.1.smithi149.stdout:3/741: creat d6/d1f/d47/d37/dd6/f109 x:0 0 0 2024-09-21T11:39:17.373 INFO:tasks.workunit.client.0.smithi118.stdout:8/399: truncate d2/dc/d10/d2e/f5f 3191089 0 2024-09-21T11:39:17.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.372+0000 7ff7c0ff9640 1 -- 172.21.15.118:0/1682674225 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff7b4061f70 con 0x7ff7c4100840 2024-09-21T11:39:17.377 INFO:tasks.workunit.client.1.smithi149.stdout:6/626: truncate d8/d32/d37/d28/f30 6679210 0 2024-09-21T11:39:17.377 INFO:tasks.workunit.client.1.smithi149.stdout:6/627: chown d8/da/d2c/d52/d5e/d9b 138743726 1 2024-09-21T11:39:17.383 INFO:tasks.workunit.client.1.smithi149.stdout:0/633: truncate dd/d2d/f56 2550730 0 2024-09-21T11:39:17.386 INFO:tasks.workunit.client.1.smithi149.stdout:5/763: truncate d4/d7/d40/d43/d85/fd0 959041 0 2024-09-21T11:39:17.389 INFO:tasks.workunit.client.1.smithi149.stdout:0/634: dread dd/d1a/d5a/f95 [0,4194304] 0 2024-09-21T11:39:17.389 INFO:tasks.workunit.client.1.smithi149.stdout:0/635: truncate dd/d1a/d1b/d72/d85/d8c/f89 5549569 0 2024-09-21T11:39:17.389 INFO:tasks.workunit.client.1.smithi149.stdout:5/764: unlink d4/d1d/d50/d54/d2a/d93/cba 0 2024-09-21T11:39:17.390 INFO:tasks.workunit.client.1.smithi149.stdout:6/628: dread d8/da/d3d/d92/fc7 [0,4194304] 0 2024-09-21T11:39:17.390 INFO:tasks.workunit.client.1.smithi149.stdout:0/636: dread dd/d32/fb7 [0,4194304] 0 2024-09-21T11:39:17.391 INFO:tasks.workunit.client.1.smithi149.stdout:2/826: rename d8/d11/cdd to d8/d20/d78/c11e 0 2024-09-21T11:39:17.392 INFO:tasks.workunit.client.1.smithi149.stdout:5/765: read d4/d7/d40/d51/fbb [4126885,107643] 0 2024-09-21T11:39:17.392 INFO:tasks.workunit.client.1.smithi149.stdout:6/629: write d8/da/f4e [261873,66630] 0 2024-09-21T11:39:17.393 INFO:tasks.workunit.client.1.smithi149.stdout:9/690: truncate d18/d1c/f98 3162613 0 2024-09-21T11:39:17.395 INFO:tasks.workunit.client.1.smithi149.stdout:0/637: creat dd/d32/db2/fd8 x:0 0 0 2024-09-21T11:39:17.396 INFO:tasks.workunit.client.1.smithi149.stdout:0/638: write dd/d2d/f91 [4912818,84073] 0 2024-09-21T11:39:17.398 INFO:tasks.workunit.client.1.smithi149.stdout:2/827: symlink d8/dcb/db8/l11f 0 2024-09-21T11:39:17.398 INFO:tasks.workunit.client.1.smithi149.stdout:2/828: chown d8 0 1 2024-09-21T11:39:17.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/829: chown d8/dd/d50/f5b 191 1 2024-09-21T11:39:17.399 INFO:tasks.workunit.client.1.smithi149.stdout:5/766: dread d4/d7/f45 [0,4194304] 0 2024-09-21T11:39:17.402 INFO:tasks.workunit.client.1.smithi149.stdout:0/639: creat dd/d1a/d1b/d81/d97/fd9 x:0 0 0 2024-09-21T11:39:17.403 INFO:tasks.workunit.client.1.smithi149.stdout:6/630: symlink d8/da/d3d/d92/ld0 0 2024-09-21T11:39:17.406 INFO:tasks.workunit.client.1.smithi149.stdout:6/631: dread d8/da/d14/f4c [0,4194304] 0 2024-09-21T11:39:17.406 INFO:tasks.workunit.client.1.smithi149.stdout:0/640: write dd/d1a/d1b/d72/d78/d8b/d98/daa/fbd [5051491,41756] 0 2024-09-21T11:39:17.408 INFO:tasks.workunit.client.1.smithi149.stdout:1/637: sync 2024-09-21T11:39:17.409 INFO:tasks.workunit.client.1.smithi149.stdout:0/641: symlink dd/d1a/d1b/d72/d78/lda 0 2024-09-21T11:39:17.412 INFO:tasks.workunit.client.1.smithi149.stdout:5/767: dwrite d4/d7/d40/d43/d49/f4b [0,4194304] 0 2024-09-21T11:39:17.413 INFO:tasks.workunit.client.0.smithi118.stdout:9/283: truncate d0/d4/d38/f46 952026 0 2024-09-21T11:39:17.413 INFO:tasks.workunit.client.1.smithi149.stdout:0/642: write dd/db3/fc5 [2501686,54208] 0 2024-09-21T11:39:17.417 INFO:tasks.workunit.client.1.smithi149.stdout:1/638: write d2/dd/d35/d1c/d41/d51/d90/f91 [642273,71858] 0 2024-09-21T11:39:17.417 INFO:tasks.workunit.client.0.smithi118.stdout:3/150: rename d5/d1d/f27 to d5/d28/f3b 0 2024-09-21T11:39:17.419 INFO:tasks.workunit.client.1.smithi149.stdout:7/793: dwrite d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f60 [0,4194304] 0 2024-09-21T11:39:17.420 INFO:tasks.workunit.client.1.smithi149.stdout:8/611: rename d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/d5c to d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9 0 2024-09-21T11:39:17.422 INFO:tasks.workunit.client.1.smithi149.stdout:0/643: chown dd/d1a/d1b/d50/l7d 12138 1 2024-09-21T11:39:17.425 INFO:tasks.workunit.client.1.smithi149.stdout:6/632: dwrite d8/d32/d37/d2b/d51/f63 [0,4194304] 0 2024-09-21T11:39:17.427 INFO:tasks.workunit.client.0.smithi118.stdout:0/473: rename d5/d10/d1e/d23/d3a/f95 to d5/d10/d1e/fa9 0 2024-09-21T11:39:17.429 INFO:tasks.workunit.client.0.smithi118.stdout:0/474: chown d5/d34/d44/f75 1748 1 2024-09-21T11:39:17.429 INFO:tasks.workunit.client.1.smithi149.stdout:5/768: dwrite d4/d7/d40/d43/d49/f78 [0,4194304] 0 2024-09-21T11:39:17.431 INFO:tasks.workunit.client.0.smithi118.stdout:0/475: chown d5/d10/d1e/d23/d3a/d90/f99 730570 1 2024-09-21T11:39:17.432 INFO:tasks.workunit.client.0.smithi118.stdout:0/476: dread - d5/d10/d1e/fa9 zero size 2024-09-21T11:39:17.433 INFO:tasks.workunit.client.1.smithi149.stdout:5/769: write d4/d7/d40/d43/d5c/d7a/d81/f83 [749298,49456] 0 2024-09-21T11:39:17.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/746: dwrite d4/d4d/d58/f91 [0,4194304] 0 2024-09-21T11:39:17.437 INFO:tasks.workunit.client.0.smithi118.stdout:1/208: rename d6/d1f/d30 to d6/de/d16/d3f 0 2024-09-21T11:39:17.440 INFO:tasks.workunit.client.0.smithi118.stdout:6/159: write d8/d14/f1d [333972,43396] 0 2024-09-21T11:39:17.442 INFO:tasks.workunit.client.1.smithi149.stdout:8/612: mkdir d3/d33/d34/d72/dbb/dda 0 2024-09-21T11:39:17.442 INFO:tasks.workunit.client.1.smithi149.stdout:1/639: mknod d2/cd3 0 2024-09-21T11:39:17.450 INFO:tasks.workunit.client.0.smithi118.stdout:1/209: unlink d6/d2a/l31 0 2024-09-21T11:39:17.453 INFO:tasks.workunit.client.0.smithi118.stdout:0/477: creat d5/d34/d44/d87/d9a/faa x:0 0 0 2024-09-21T11:39:17.455 INFO:tasks.workunit.client.0.smithi118.stdout:6/160: mknod d8/d14/d28/c37 0 2024-09-21T11:39:17.456 INFO:tasks.workunit.client.0.smithi118.stdout:8/400: write d2/f7 [1657671,52015] 0 2024-09-21T11:39:17.457 INFO:tasks.workunit.client.0.smithi118.stdout:6/161: write d8/d14/f24 [1535045,42505] 0 2024-09-21T11:39:17.458 INFO:tasks.workunit.client.0.smithi118.stdout:6/162: readlink d8/d14/l21 0 2024-09-21T11:39:17.459 INFO:tasks.workunit.client.0.smithi118.stdout:6/163: chown d8/ce 4064 1 2024-09-21T11:39:17.460 INFO:tasks.workunit.client.0.smithi118.stdout:6/164: write f6 [1347198,20488] 0 2024-09-21T11:39:17.461 INFO:tasks.workunit.client.1.smithi149.stdout:3/742: dwrite d6/d1f/d47/d37/d3f/f64 [0,4194304] 0 2024-09-21T11:39:17.461 INFO:tasks.workunit.client.0.smithi118.stdout:3/151: rename d5/f31 to d5/d28/d33/f3c 0 2024-09-21T11:39:17.462 INFO:tasks.workunit.client.1.smithi149.stdout:5/770: mkdir d4/d7/d40/d43/d49/d88/de0/dfc 0 2024-09-21T11:39:17.463 INFO:tasks.workunit.client.1.smithi149.stdout:5/771: write d4/d7/d40/f53 [1350556,71199] 0 2024-09-21T11:39:17.465 INFO:tasks.workunit.client.1.smithi149.stdout:5/772: fsync d4/d7/d40/d43/d49/f76 0 2024-09-21T11:39:17.467 INFO:tasks.workunit.client.0.smithi118.stdout:0/478: creat d5/d10/d1e/d23/d3a/d4e/fab x:0 0 0 2024-09-21T11:39:17.474 INFO:tasks.workunit.client.1.smithi149.stdout:8/613: write d3/d33/f9b [509429,23578] 0 2024-09-21T11:39:17.474 INFO:tasks.workunit.client.1.smithi149.stdout:8/614: chown d3/d33/f9b 149832666 1 2024-09-21T11:39:17.475 INFO:tasks.workunit.client.0.smithi118.stdout:8/401: symlink d2/dc/d16/d46/d4c/l86 0 2024-09-21T11:39:17.478 INFO:tasks.workunit.client.0.smithi118.stdout:3/152: dread d5/d1d/f19 [0,4194304] 0 2024-09-21T11:39:17.478 INFO:tasks.workunit.client.1.smithi149.stdout:9/691: rename d18/d36/d3c/l34 to d18/ldd 0 2024-09-21T11:39:17.481 INFO:tasks.workunit.client.1.smithi149.stdout:8/615: dread d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fcf [0,4194304] 0 2024-09-21T11:39:17.482 INFO:tasks.workunit.client.1.smithi149.stdout:8/616: chown d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f9f 833966 1 2024-09-21T11:39:17.485 INFO:tasks.workunit.client.1.smithi149.stdout:2/830: write d8/da/d13/d5d/f7f [1829658,45479] 0 2024-09-21T11:39:17.485 INFO:tasks.workunit.client.0.smithi118.stdout:1/210: creat d6/d33/d3c/f40 x:0 0 0 2024-09-21T11:39:17.486 INFO:tasks.workunit.client.0.smithi118.stdout:1/211: chown d6/fd 6 1 2024-09-21T11:39:17.486 INFO:tasks.workunit.client.1.smithi149.stdout:0/644: creat dd/fdb x:0 0 0 2024-09-21T11:39:17.488 INFO:tasks.workunit.client.0.smithi118.stdout:8/402: rmdir d2/dc/d10/d2e/d18/d1a 39 2024-09-21T11:39:17.489 INFO:tasks.workunit.client.1.smithi149.stdout:4/747: truncate d4/d6/d63/d15/d16/d23/d62/fa2 3444783 0 2024-09-21T11:39:17.490 INFO:tasks.workunit.client.0.smithi118.stdout:3/153: symlink d5/d28/d33/l3d 0 2024-09-21T11:39:17.493 INFO:tasks.workunit.client.1.smithi149.stdout:9/692: creat d18/d36/d3c/d47/d99/dbe/fde x:0 0 0 2024-09-21T11:39:17.496 INFO:tasks.workunit.client.1.smithi149.stdout:7/794: link d12/d5b/db5/dc5/de9/d68/dc4/d30/cdb d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/dab/cf5 0 2024-09-21T11:39:17.499 INFO:tasks.workunit.client.0.smithi118.stdout:1/212: creat d6/de/d13/f41 x:0 0 0 2024-09-21T11:39:17.501 INFO:tasks.workunit.client.0.smithi118.stdout:0/479: getdents d5/d29/d68/d7b 0 2024-09-21T11:39:17.503 INFO:tasks.workunit.client.1.smithi149.stdout:0/645: write dd/d1a/f2f [2626916,755] 0 2024-09-21T11:39:17.508 INFO:tasks.workunit.client.0.smithi118.stdout:1/213: creat d6/d33/d3c/f42 x:0 0 0 2024-09-21T11:39:17.508 INFO:tasks.workunit.client.1.smithi149.stdout:6/633: dwrite d8/d32/d37/d79/f84 [0,4194304] 0 2024-09-21T11:39:17.509 INFO:tasks.workunit.client.0.smithi118.stdout:1/214: dread - d6/de/d16/d3f/f37 zero size 2024-09-21T11:39:17.509 INFO:tasks.workunit.client.1.smithi149.stdout:9/693: mknod d18/d19/d29/d39/d63/dac/cdf 0 2024-09-21T11:39:17.512 INFO:tasks.workunit.client.0.smithi118.stdout:3/154: dread d5/f10 [0,4194304] 0 2024-09-21T11:39:17.512 INFO:tasks.workunit.client.1.smithi149.stdout:3/743: creat d6/d1f/d27/f10a x:0 0 0 2024-09-21T11:39:17.512 INFO:tasks.workunit.client.1.smithi149.stdout:3/744: readlink d6/lc0 0 2024-09-21T11:39:17.515 INFO:tasks.workunit.client.0.smithi118.stdout:0/480: dread d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:17.520 INFO:tasks.workunit.client.1.smithi149.stdout:0/646: unlink dd/d1a/d1b/d72/d87/lb8 0 2024-09-21T11:39:17.521 INFO:tasks.workunit.client.1.smithi149.stdout:0/647: chown dd/d1a/d5a/d65/f7b 3 1 2024-09-21T11:39:17.522 INFO:tasks.workunit.client.1.smithi149.stdout:4/748: fsync d4/d6/d63/d2d/ffd 0 2024-09-21T11:39:17.526 INFO:tasks.workunit.client.0.smithi118.stdout:3/155: fdatasync d5/d1d/f11 0 2024-09-21T11:39:17.527 INFO:tasks.workunit.client.0.smithi118.stdout:3/156: write d5/f30 [587504,10695] 0 2024-09-21T11:39:17.531 INFO:tasks.workunit.client.1.smithi149.stdout:9/694: mkdir d18/d19/d1a/d2f/d7d/de0 0 2024-09-21T11:39:17.532 INFO:tasks.workunit.client.0.smithi118.stdout:1/215: creat d6/d3b/f43 x:0 0 0 2024-09-21T11:39:17.533 INFO:tasks.workunit.client.1.smithi149.stdout:3/745: creat d6/d79/d7e/ddd/f10b x:0 0 0 2024-09-21T11:39:17.534 INFO:tasks.workunit.client.1.smithi149.stdout:3/746: chown d6/f38 6 1 2024-09-21T11:39:17.535 INFO:tasks.workunit.client.1.smithi149.stdout:3/747: write d6/d1f/d47/d37/d50/fb0 [344378,69423] 0 2024-09-21T11:39:17.539 INFO:tasks.workunit.client.0.smithi118.stdout:1/216: rename d6/fd to d6/d33/f44 0 2024-09-21T11:39:17.540 INFO:tasks.workunit.client.0.smithi118.stdout:1/217: dread - d6/d3b/f43 zero size 2024-09-21T11:39:17.540 INFO:tasks.workunit.client.0.smithi118.stdout:1/218: chown d6/d1f/d32 50 1 2024-09-21T11:39:17.542 INFO:tasks.workunit.client.0.smithi118.stdout:0/481: link d5/f8 d5/d10/d1e/d21/d2a/fac 0 2024-09-21T11:39:17.542 INFO:tasks.workunit.client.0.smithi118.stdout:6/165: truncate d8/d14/d28/f31 146744 0 2024-09-21T11:39:17.543 INFO:tasks.workunit.client.0.smithi118.stdout:6/166: chown d8/d14/f24 2 1 2024-09-21T11:39:17.544 INFO:tasks.workunit.client.1.smithi149.stdout:0/648: unlink dd/d35/fcc 0 2024-09-21T11:39:17.544 INFO:tasks.workunit.client.1.smithi149.stdout:0/649: readlink dd/d1a/d1b/d81/d97/lb1 0 2024-09-21T11:39:17.545 INFO:tasks.workunit.client.0.smithi118.stdout:1/219: mkdir d6/d3b/d45 0 2024-09-21T11:39:17.545 INFO:tasks.workunit.client.1.smithi149.stdout:0/650: read dd/d2d/f4b [2590659,30286] 0 2024-09-21T11:39:17.547 INFO:tasks.workunit.client.0.smithi118.stdout:0/482: mknod d5/d10/d1e/d23/d3a/d4e/cad 0 2024-09-21T11:39:17.547 INFO:tasks.workunit.client.0.smithi118.stdout:0/483: rename d5 to d5/d10/d1e/d21/d2a/d48/dae 22 2024-09-21T11:39:17.548 INFO:tasks.workunit.client.1.smithi149.stdout:6/634: symlink d8/d32/d37/d2b/d7d/da9/ld1 0 2024-09-21T11:39:17.549 INFO:tasks.workunit.client.0.smithi118.stdout:0/484: truncate d5/d34/d44/f75 917079 0 2024-09-21T11:39:17.550 INFO:tasks.workunit.client.1.smithi149.stdout:9/695: dread - d18/d19/d1a/d2f/d5f/f73 zero size 2024-09-21T11:39:17.550 INFO:tasks.workunit.client.0.smithi118.stdout:0/485: write d5/d29/d53/f63 [467464,3981] 0 2024-09-21T11:39:17.550 INFO:tasks.workunit.client.1.smithi149.stdout:6/635: chown d8/d32/d37/d2b/d7d/db8/dc4 2613 1 2024-09-21T11:39:17.551 INFO:tasks.workunit.client.1.smithi149.stdout:2/831: dwrite d8/f59 [0,4194304] 0 2024-09-21T11:39:17.552 INFO:tasks.workunit.client.0.smithi118.stdout:8/403: write d2/dc/d10/d2e/d18/d1a/f1e [420226,16967] 0 2024-09-21T11:39:17.554 INFO:tasks.workunit.client.1.smithi149.stdout:3/748: creat d6/d5f/d60/f10c x:0 0 0 2024-09-21T11:39:17.554 INFO:tasks.workunit.client.1.smithi149.stdout:0/651: dwrite dd/d6a/f88 [0,4194304] 0 2024-09-21T11:39:17.556 INFO:tasks.workunit.client.1.smithi149.stdout:2/832: chown d8/da/d13/d1a/d29/c80 35113577 1 2024-09-21T11:39:17.557 INFO:tasks.workunit.client.1.smithi149.stdout:7/795: rename d12/d5b/db5/dc5/de9/d4a/d6c/fda to d12/d5b/db5/dc5/de9/d68/dc4/d30/ff6 0 2024-09-21T11:39:17.559 INFO:tasks.workunit.client.0.smithi118.stdout:1/220: creat d6/d1f/d32/f46 x:0 0 0 2024-09-21T11:39:17.563 INFO:tasks.workunit.client.0.smithi118.stdout:0/486: mknod d5/caf 0 2024-09-21T11:39:17.565 INFO:tasks.workunit.client.1.smithi149.stdout:9/696: creat d18/d36/d3c/d47/d99/fe1 x:0 0 0 2024-09-21T11:39:17.566 INFO:tasks.workunit.client.0.smithi118.stdout:1/221: mknod d6/d1f/d32/c47 0 2024-09-21T11:39:17.570 INFO:tasks.workunit.client.1.smithi149.stdout:9/697: dwrite d18/d19/d1a/f2d [0,4194304] 0 2024-09-21T11:39:17.571 INFO:tasks.workunit.client.0.smithi118.stdout:3/157: dwrite d5/f10 [0,4194304] 0 2024-09-21T11:39:17.572 INFO:tasks.workunit.client.1.smithi149.stdout:0/652: rmdir dd/d1a/d1b/d72/d78/d8b 39 2024-09-21T11:39:17.573 INFO:tasks.workunit.client.1.smithi149.stdout:0/653: stat dd/d2d/fba 0 2024-09-21T11:39:17.575 INFO:tasks.workunit.client.1.smithi149.stdout:0/654: write dd/d1a/d1b/d72/d78/dc4/f54 [930810,107243] 0 2024-09-21T11:39:17.576 INFO:tasks.workunit.client.1.smithi149.stdout:1/640: sync 2024-09-21T11:39:17.580 INFO:tasks.workunit.client.1.smithi149.stdout:3/749: creat d6/d1f/d47/d37/d3a/d95/f10d x:0 0 0 2024-09-21T11:39:17.587 INFO:tasks.workunit.client.1.smithi149.stdout:3/750: dwrite d6/d1f/d47/d37/d50/feb [0,4194304] 0 2024-09-21T11:39:17.593 INFO:tasks.workunit.client.1.smithi149.stdout:9/698: mknod d18/d19/d1a/d2f/d53/d64/ce2 0 2024-09-21T11:39:17.597 INFO:tasks.workunit.client.1.smithi149.stdout:0/655: truncate dd/d1a/d1b/f27 75837 0 2024-09-21T11:39:17.600 INFO:tasks.workunit.client.0.smithi118.stdout:6/167: link d8/d14/d28/f31 d8/f38 0 2024-09-21T11:39:17.601 INFO:tasks.workunit.client.0.smithi118.stdout:6/168: fsync d8/fa 0 2024-09-21T11:39:17.603 INFO:tasks.workunit.client.0.smithi118.stdout:0/487: dread d5/d10/d1e/d21/d2a/f4a [0,4194304] 0 2024-09-21T11:39:17.604 INFO:tasks.workunit.client.0.smithi118.stdout:8/404: dwrite d2/dc/d10/d2e/f5f [0,4194304] 0 2024-09-21T11:39:17.604 INFO:tasks.workunit.client.1.smithi149.stdout:7/796: write d12/d5b/db5/dc5/de9/d68/dc4/f65 [4300458,47668] 0 2024-09-21T11:39:17.604 INFO:tasks.workunit.client.0.smithi118.stdout:0/488: stat d5/d10/d1e/d20/c38 0 2024-09-21T11:39:17.606 INFO:tasks.workunit.client.0.smithi118.stdout:0/489: write d5/d10/d1e/d21/d2a/d48/f60 [4691097,113065] 0 2024-09-21T11:39:17.608 INFO:tasks.workunit.client.0.smithi118.stdout:0/490: chown d5/d34/d44/fa1 399205 1 2024-09-21T11:39:17.609 INFO:tasks.workunit.client.0.smithi118.stdout:6/169: rename d8/d14/f23 to d8/d14/d33/f39 0 2024-09-21T11:39:17.611 INFO:tasks.workunit.client.0.smithi118.stdout:0/491: chown d5/d10/d1e/d21/d2a/d48/c59 2690416 1 2024-09-21T11:39:17.613 INFO:tasks.workunit.client.1.smithi149.stdout:9/699: dread d18/d36/d3c/d47/d99/fb6 [0,4194304] 0 2024-09-21T11:39:17.615 INFO:tasks.workunit.client.0.smithi118.stdout:3/158: dwrite d5/d28/f2b [0,4194304] 0 2024-09-21T11:39:17.615 INFO:tasks.workunit.client.0.smithi118.stdout:6/170: mkdir d8/d14/d3a 0 2024-09-21T11:39:17.616 INFO:tasks.workunit.client.0.smithi118.stdout:8/405: getdents d2/dc/d16/d46/d4c/d63/d68 0 2024-09-21T11:39:17.619 INFO:tasks.workunit.client.1.smithi149.stdout:7/797: creat d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/ddc/ff7 x:0 0 0 2024-09-21T11:39:17.620 INFO:tasks.workunit.client.0.smithi118.stdout:3/159: dread d5/d28/f2b [0,4194304] 0 2024-09-21T11:39:17.621 INFO:tasks.workunit.client.1.smithi149.stdout:3/751: mkdir d6/d10e 0 2024-09-21T11:39:17.623 INFO:tasks.workunit.client.1.smithi149.stdout:1/641: dwrite d2/d5/d65/f7b [0,4194304] 0 2024-09-21T11:39:17.624 INFO:tasks.workunit.client.1.smithi149.stdout:6/636: getdents d8/d32/d37/d2b/d7d 0 2024-09-21T11:39:17.624 INFO:tasks.workunit.client.0.smithi118.stdout:0/492: dread d5/d10/d1e/d21/d2a/f45 [0,4194304] 0 2024-09-21T11:39:17.625 INFO:tasks.workunit.client.0.smithi118.stdout:0/493: readlink d5/d34/l7f 0 2024-09-21T11:39:17.626 INFO:tasks.workunit.client.1.smithi149.stdout:0/656: fsync dd/d2d/f56 0 2024-09-21T11:39:17.627 INFO:tasks.workunit.client.0.smithi118.stdout:6/171: symlink d8/l3b 0 2024-09-21T11:39:17.630 INFO:tasks.workunit.client.0.smithi118.stdout:8/406: creat d2/dc/d16/f87 x:0 0 0 2024-09-21T11:39:17.630 INFO:tasks.workunit.client.1.smithi149.stdout:7/798: dwrite d12/d5b/db5/dc5/de9/d4a/d6c/fd5 [0,4194304] 0 2024-09-21T11:39:17.632 INFO:tasks.workunit.client.0.smithi118.stdout:3/160: mkdir d5/d28/d3e 0 2024-09-21T11:39:17.633 INFO:tasks.workunit.client.0.smithi118.stdout:0/494: dwrite d5/d34/d44/f52 [0,4194304] 0 2024-09-21T11:39:17.634 INFO:tasks.workunit.client.1.smithi149.stdout:3/752: creat d6/d1f/de5/f10f x:0 0 0 2024-09-21T11:39:17.636 INFO:tasks.workunit.client.0.smithi118.stdout:8/407: write d2/dc/d10/d2e/d18/f4f [3033769,18877] 0 2024-09-21T11:39:17.637 INFO:tasks.workunit.client.0.smithi118.stdout:8/408: read - d2/dc/d49/f77 zero size 2024-09-21T11:39:17.638 INFO:tasks.workunit.client.0.smithi118.stdout:8/409: fdatasync d2/dc/d10/d2e/d18/d1a/f56 0 2024-09-21T11:39:17.639 INFO:tasks.workunit.client.0.smithi118.stdout:8/410: dread - d2/dc/d16/d46/d4c/d63/f7e zero size 2024-09-21T11:39:17.644 INFO:tasks.workunit.client.1.smithi149.stdout:6/637: stat d8/d32/d37/d28/d2f/d6a/d72/l8b 0 2024-09-21T11:39:17.645 INFO:tasks.workunit.client.0.smithi118.stdout:3/161: fdatasync d5/f17 0 2024-09-21T11:39:17.646 INFO:tasks.workunit.client.0.smithi118.stdout:3/162: chown d5/l14 37399622 1 2024-09-21T11:39:17.648 INFO:tasks.workunit.client.0.smithi118.stdout:8/411: mkdir d2/d7c/d88 0 2024-09-21T11:39:17.650 INFO:tasks.workunit.client.0.smithi118.stdout:8/412: fsync d2/dc/d10/d2e/d18/f2f 0 2024-09-21T11:39:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/833: getdents d8/da/d13/d1a/d3b 0 2024-09-21T11:39:17.651 INFO:tasks.workunit.client.1.smithi149.stdout:7/799: symlink d12/d5b/db5/dc5/de9/d4a/d4f/lf8 0 2024-09-21T11:39:17.652 INFO:tasks.workunit.client.1.smithi149.stdout:9/700: dread d18/d19/d29/fbf [0,4194304] 0 2024-09-21T11:39:17.652 INFO:tasks.workunit.client.1.smithi149.stdout:2/834: fdatasync d8/d20/d57/f6c 0 2024-09-21T11:39:17.653 INFO:tasks.workunit.client.0.smithi118.stdout:3/163: dread d5/d1d/d1b/d24/f38 [0,4194304] 0 2024-09-21T11:39:17.654 INFO:tasks.workunit.client.1.smithi149.stdout:0/657: mkdir dd/d32/dbe/ddc 0 2024-09-21T11:39:17.654 INFO:tasks.workunit.client.0.smithi118.stdout:3/164: write d5/d1d/d1b/d24/f36 [1644002,69889] 0 2024-09-21T11:39:17.656 INFO:tasks.workunit.client.1.smithi149.stdout:3/753: mknod d6/d1f/d47/c110 0 2024-09-21T11:39:17.656 INFO:tasks.workunit.client.1.smithi149.stdout:2/835: read d8/dd/d5c/d60/fcc [2866717,14510] 0 2024-09-21T11:39:17.658 INFO:tasks.workunit.client.0.smithi118.stdout:8/413: link d2/f57 d2/dc/d10/d6a/f89 0 2024-09-21T11:39:17.658 INFO:tasks.workunit.client.1.smithi149.stdout:9/701: rmdir d18/d36/d3c/d47/d99/dbe 39 2024-09-21T11:39:17.659 INFO:tasks.workunit.client.0.smithi118.stdout:8/414: fdatasync d2/dc/d10/d3b/f64 0 2024-09-21T11:39:17.662 INFO:tasks.workunit.client.0.smithi118.stdout:3/165: symlink d5/l3f 0 2024-09-21T11:39:17.664 INFO:tasks.workunit.client.1.smithi149.stdout:5/773: sync 2024-09-21T11:39:17.666 INFO:tasks.workunit.client.0.smithi118.stdout:8/415: rmdir d2/dc/d16/d46/d4c 39 2024-09-21T11:39:17.670 INFO:tasks.workunit.client.0.smithi118.stdout:3/166: creat d5/d1d/d1b/f40 x:0 0 0 2024-09-21T11:39:17.671 INFO:tasks.workunit.client.0.smithi118.stdout:3/167: stat d5/d1d/f32 0 2024-09-21T11:39:17.672 INFO:tasks.workunit.client.0.smithi118.stdout:3/168: stat d5/d1d/f19 0 2024-09-21T11:39:17.673 INFO:tasks.workunit.client.1.smithi149.stdout:6/638: symlink d8/d32/d37/d28/ld2 0 2024-09-21T11:39:17.674 INFO:tasks.workunit.client.0.smithi118.stdout:8/416: dwrite d2/dc/d16/d46/f6f [0,4194304] 0 2024-09-21T11:39:17.674 INFO:tasks.workunit.client.1.smithi149.stdout:0/658: rmdir dd/d1a/d5a 39 2024-09-21T11:39:17.675 INFO:tasks.workunit.client.1.smithi149.stdout:6/639: chown d8/d32/d64 2941055 1 2024-09-21T11:39:17.676 INFO:tasks.workunit.client.1.smithi149.stdout:9/702: symlink d18/d36/d3c/d47/d76/d7c/le3 0 2024-09-21T11:39:17.681 INFO:tasks.workunit.client.0.smithi118.stdout:0/495: dwrite d5/d10/d1e/d21/d2a/d48/f64 [0,4194304] 0 2024-09-21T11:39:17.682 INFO:tasks.workunit.client.0.smithi118.stdout:0/496: chown d5/d10/d1e/d20/f32 142817 1 2024-09-21T11:39:17.683 INFO:tasks.workunit.client.0.smithi118.stdout:0/497: write d5/f74 [4931396,130799] 0 2024-09-21T11:39:17.684 INFO:tasks.workunit.client.1.smithi149.stdout:1/642: dread d2/dd/d35/d1c/f23 [0,4194304] 0 2024-09-21T11:39:17.685 INFO:tasks.workunit.client.1.smithi149.stdout:1/643: write d2/dd/d35/d1c/d41/fbe [707019,71270] 0 2024-09-21T11:39:17.686 INFO:tasks.workunit.client.1.smithi149.stdout:1/644: stat d2/d5/d8/fa 0 2024-09-21T11:39:17.692 INFO:tasks.workunit.client.0.smithi118.stdout:0/498: dwrite d5/d10/d1e/d21/d2a/f83 [0,4194304] 0 2024-09-21T11:39:17.700 INFO:tasks.workunit.client.0.smithi118.stdout:0/499: dread d5/d10/d1e/d21/d2a/d48/f64 [0,4194304] 0 2024-09-21T11:39:17.701 INFO:tasks.workunit.client.0.smithi118.stdout:0/500: dread - d5/d10/d1e/fa9 zero size 2024-09-21T11:39:17.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/754: dwrite d6/d1f/d47/d22/d8d/fae [0,4194304] 0 2024-09-21T11:39:17.702 INFO:tasks.workunit.client.1.smithi149.stdout:2/836: dwrite d8/d44/d63/db9/d5a/f73 [0,4194304] 0 2024-09-21T11:39:17.703 INFO:tasks.workunit.client.0.smithi118.stdout:0/501: write d5/d10/d1e/d21/d2a/d48/f60 [2780202,114184] 0 2024-09-21T11:39:17.703 INFO:tasks.workunit.client.1.smithi149.stdout:3/755: stat d6/d79/d7e/dcb/fef 0 2024-09-21T11:39:17.712 INFO:tasks.workunit.client.0.smithi118.stdout:0/502: truncate d5/d10/d1e/d21/d2a/f78 2696220 0 2024-09-21T11:39:17.714 INFO:tasks.workunit.client.0.smithi118.stdout:0/503: write d5/d10/d1e/d23/d3a/f8b [507092,56553] 0 2024-09-21T11:39:17.723 INFO:tasks.workunit.client.1.smithi149.stdout:5/774: symlink d4/d1d/dde/lfd 0 2024-09-21T11:39:17.723 INFO:tasks.workunit.client.1.smithi149.stdout:8/617: sync 2024-09-21T11:39:17.724 INFO:tasks.workunit.client.1.smithi149.stdout:4/749: sync 2024-09-21T11:39:17.724 INFO:tasks.workunit.client.1.smithi149.stdout:6/640: chown d8/d32/d37/d28/d2e 243 1 2024-09-21T11:39:17.726 INFO:tasks.workunit.client.1.smithi149.stdout:1/645: symlink d2/dd/d35/d5b/ld4 0 2024-09-21T11:39:17.730 INFO:tasks.workunit.client.1.smithi149.stdout:3/756: truncate d6/d1f/d47/f74 3532630 0 2024-09-21T11:39:17.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.727+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff7c406a430 con 0x7ff7ac074ad0 2024-09-21T11:39:17.730 INFO:tasks.workunit.client.1.smithi149.stdout:3/757: chown d6/d1f/d47/d37/d3a/d107 13601 1 2024-09-21T11:39:17.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.729+0000 7ff7c0ff9640 1 -- 172.21.15.118:0/1682674225 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7ff7c406a430 con 0x7ff7ac074ad0 2024-09-21T11:39:17.732 INFO:tasks.workunit.client.1.smithi149.stdout:5/775: mknod d4/d1d/d3e/d9a/cfe 0 2024-09-21T11:39:17.734 INFO:tasks.workunit.client.1.smithi149.stdout:9/703: mknod d18/d19/d1a/d9b/ce4 0 2024-09-21T11:39:17.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.731+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff7ac074ad0 msgr2=0x7ff7ac076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:17.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.731+0000 7ff7c9c09640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff7ac074ad0 0x7ff7ac076f90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8006010 tx=0x7ff7b8000bc0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.732+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4100840 msgr2=0x7ff7c4196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.732+0000 7ff7c9c09640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4100840 0x7ff7c4196370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400e940 tx=0x7ff7b400ee00 comp rx=0 tx=0).stop 2024-09-21T11:39:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.732+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 shutdown_connections 2024-09-21T11:39:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.732+0000 7ff7c9c09640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff7ac074ad0 0x7ff7ac076f90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.732+0000 7ff7c9c09640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7c4101a40 0x7ff7c41968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.732+0000 7ff7c9c09640 1 --2- 172.21.15.118:0/1682674225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7c4100840 0x7ff7c4196370 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.732+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 >> 172.21.15.118:0/1682674225 conn(0x7ff7c40fbff0 msgr2=0x7ff7c4104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.732+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 shutdown_connections 2024-09-21T11:39:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.732+0000 7ff7c9c09640 1 -- 172.21.15.118:0/1682674225 wait complete. 2024-09-21T11:39:17.736 INFO:tasks.workunit.client.1.smithi149.stdout:1/646: mknod d2/d2b/cd5 0 2024-09-21T11:39:17.736 INFO:tasks.workunit.client.1.smithi149.stdout:1/647: chown d2/dd/d2e/d4c/f75 3595054 1 2024-09-21T11:39:17.737 INFO:tasks.workunit.client.1.smithi149.stdout:2/837: symlink d8/l120 0 2024-09-21T11:39:17.739 INFO:tasks.workunit.client.1.smithi149.stdout:3/758: mkdir d6/d1f/d47/d37/d3f/dc5/d111 0 2024-09-21T11:39:17.740 INFO:tasks.workunit.client.1.smithi149.stdout:3/759: dread - d6/d1f/d47/d37/d3f/dc5/f102 zero size 2024-09-21T11:39:17.740 INFO:tasks.workunit.client.1.smithi149.stdout:5/776: mkdir d4/d1d/d50/dc8/dff 0 2024-09-21T11:39:17.740 INFO:tasks.workunit.client.1.smithi149.stdout:3/760: dread - d6/d79/d7e/ddd/f10b zero size 2024-09-21T11:39:17.742 INFO:tasks.workunit.client.0.smithi118.stdout:0/504: dwrite d5/d10/d1e/f4c [0,4194304] 0 2024-09-21T11:39:17.744 INFO:tasks.workunit.client.1.smithi149.stdout:1/648: mkdir d2/d5/d8/dc1/dd6 0 2024-09-21T11:39:17.745 INFO:tasks.workunit.client.1.smithi149.stdout:2/838: fdatasync d8/da/d13/d2d/f34 0 2024-09-21T11:39:17.745 INFO:tasks.workunit.client.1.smithi149.stdout:1/649: chown d2/dd/d35 5201 1 2024-09-21T11:39:17.746 INFO:tasks.workunit.client.1.smithi149.stdout:6/641: rename d8/da/d2c/d52/c53 to d8/d32/d37/d28/cd3 0 2024-09-21T11:39:17.749 INFO:tasks.workunit.client.1.smithi149.stdout:5/777: dread d4/d7/d40/d43/d49/fe6 [0,4194304] 0 2024-09-21T11:39:17.750 INFO:tasks.workunit.client.1.smithi149.stdout:6/642: readlink d8/d32/d37/d2b/d7d/db8/lcf 0 2024-09-21T11:39:17.750 INFO:tasks.workunit.client.1.smithi149.stdout:1/650: chown d2/d5/d3d/d88/l70 192 1 2024-09-21T11:39:17.751 INFO:tasks.workunit.client.1.smithi149.stdout:9/704: link d18/d36/d3c/d47/d76/fc0 d18/d36/d3c/dcb/fe5 0 2024-09-21T11:39:17.753 INFO:tasks.workunit.client.1.smithi149.stdout:3/761: dwrite d6/d79/d7e/f89 [0,4194304] 0 2024-09-21T11:39:17.753 INFO:tasks.workunit.client.1.smithi149.stdout:0/659: write dd/d1a/d5a/fca [1078572,65130] 0 2024-09-21T11:39:17.755 INFO:tasks.workunit.client.1.smithi149.stdout:5/778: write d4/d1d/d50/d60/fb8 [747173,61107] 0 2024-09-21T11:39:17.756 INFO:tasks.workunit.client.1.smithi149.stdout:9/705: stat d18/d36/d3c/d47/f85 0 2024-09-21T11:39:17.759 INFO:tasks.workunit.client.1.smithi149.stdout:1/651: truncate d2/dd/d35/d1c/d2c/f8b 4263438 0 2024-09-21T11:39:17.760 INFO:tasks.workunit.client.1.smithi149.stdout:5/779: stat d4/d1d/d50/d54/d2a/f4d 0 2024-09-21T11:39:17.765 INFO:tasks.workunit.client.1.smithi149.stdout:8/618: dwrite d3/d33/f64 [0,4194304] 0 2024-09-21T11:39:17.765 INFO:tasks.workunit.client.1.smithi149.stdout:1/652: dread - d2/dd/d35/d1c/d7a/f81 zero size 2024-09-21T11:39:17.767 INFO:tasks.workunit.client.1.smithi149.stdout:6/643: truncate d8/d32/d37/d28/d2f/d6a/d72/f7f 3912133 0 2024-09-21T11:39:17.768 INFO:tasks.workunit.client.0.smithi118.stdout:0/505: truncate d5/d10/d1e/d21/d2a/f83 3866699 0 2024-09-21T11:39:17.768 INFO:tasks.workunit.client.0.smithi118.stdout:0/506: read d5/f74 [4980435,8724] 0 2024-09-21T11:39:17.769 INFO:tasks.workunit.client.1.smithi149.stdout:6/644: stat d8/da/d2c/d52/f5c 0 2024-09-21T11:39:17.769 INFO:tasks.workunit.client.1.smithi149.stdout:3/762: dwrite d6/d1f/d47/d37/d3f/fa7 [0,4194304] 0 2024-09-21T11:39:17.769 INFO:tasks.workunit.client.0.smithi118.stdout:0/507: read d5/d10/d1e/d21/f2d [807900,65543] 0 2024-09-21T11:39:17.770 INFO:tasks.workunit.client.1.smithi149.stdout:6/645: chown d8/d32/d37/d28/d2e/f82 1398 1 2024-09-21T11:39:17.770 INFO:tasks.workunit.client.1.smithi149.stdout:2/839: write d8/da/d13/d1a/d3b/f61 [177936,56932] 0 2024-09-21T11:39:17.771 INFO:tasks.workunit.client.1.smithi149.stdout:6/646: readlink d8/da/d2c/d2d/d9a/lca 0 2024-09-21T11:39:17.777 INFO:tasks.workunit.client.1.smithi149.stdout:3/763: symlink d6/d1f/d47/dbb/l112 0 2024-09-21T11:39:17.778 INFO:tasks.workunit.client.1.smithi149.stdout:3/764: fdatasync d6/f1a 0 2024-09-21T11:39:17.778 INFO:tasks.workunit.client.1.smithi149.stdout:8/619: rename d3/d33/d34/d55/d5e/d9e/dc2/d3a/c1e to d3/d33/d34/d55/d95/cdb 0 2024-09-21T11:39:17.780 INFO:tasks.workunit.client.1.smithi149.stdout:0/660: dwrite dd/d1a/d1b/d72/d78/dc4/d3a/f7c [0,4194304] 0 2024-09-21T11:39:17.781 INFO:tasks.workunit.client.1.smithi149.stdout:2/840: mknod d8/da/d13/d83/df6/c121 0 2024-09-21T11:39:17.781 INFO:tasks.workunit.client.0.smithi118.stdout:0/508: dwrite d5/d34/d44/fa1 [0,4194304] 0 2024-09-21T11:39:17.786 INFO:tasks.workunit.client.1.smithi149.stdout:7/800: sync 2024-09-21T11:39:17.789 INFO:tasks.workunit.client.1.smithi149.stdout:9/706: truncate d18/d19/d29/fbf 3979551 0 2024-09-21T11:39:17.791 INFO:tasks.workunit.client.0.smithi118.stdout:0/509: rename d5/d34/f55 to d5/d10/d1e/d23/d3a/d90/fb0 0 2024-09-21T11:39:17.791 INFO:tasks.workunit.client.1.smithi149.stdout:5/780: creat d4/d7/d40/f100 x:0 0 0 2024-09-21T11:39:17.793 INFO:tasks.workunit.client.1.smithi149.stdout:9/707: fsync d18/d19/d29/d39/d63/dac/fd3 0 2024-09-21T11:39:17.794 INFO:tasks.workunit.client.1.smithi149.stdout:5/781: write d4/d7/d40/d51/fa0 [2528033,4712] 0 2024-09-21T11:39:17.797 INFO:tasks.workunit.client.1.smithi149.stdout:5/782: fdatasync d4/ff3 0 2024-09-21T11:39:17.799 INFO:tasks.workunit.client.1.smithi149.stdout:0/661: creat dd/d1a/d1b/d72/dc1/fdd x:0 0 0 2024-09-21T11:39:17.799 INFO:tasks.workunit.client.1.smithi149.stdout:2/841: mknod d8/dd/d50/c122 0 2024-09-21T11:39:17.799 INFO:tasks.workunit.client.1.smithi149.stdout:7/801: symlink d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/lf9 0 2024-09-21T11:39:17.803 INFO:tasks.workunit.client.1.smithi149.stdout:1/653: dwrite d2/f13 [4194304,4194304] 0 2024-09-21T11:39:17.805 INFO:tasks.workunit.client.1.smithi149.stdout:1/654: write d2/d5/f85 [1702333,7388] 0 2024-09-21T11:39:17.805 INFO:tasks.workunit.client.1.smithi149.stdout:9/708: creat d18/d19/d1a/d2f/d53/fe6 x:0 0 0 2024-09-21T11:39:17.807 INFO:tasks.workunit.client.1.smithi149.stdout:7/802: truncate d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/dab/fd8 815846 0 2024-09-21T11:39:17.808 INFO:tasks.workunit.client.1.smithi149.stdout:5/783: creat d4/d1d/d3e/d9a/f101 x:0 0 0 2024-09-21T11:39:17.811 INFO:tasks.workunit.client.1.smithi149.stdout:3/765: link d6/d1f/d47/d37/l39 d6/d1f/df1/l113 0 2024-09-21T11:39:17.812 INFO:tasks.workunit.client.1.smithi149.stdout:6/647: dread d8/d32/d37/d28/f30 [4194304,4194304] 0 2024-09-21T11:39:17.812 INFO:tasks.workunit.client.1.smithi149.stdout:5/784: dread d4/d7/ff7 [0,4194304] 0 2024-09-21T11:39:17.817 INFO:tasks.workunit.client.1.smithi149.stdout:9/709: mknod d18/d19/d1a/d2f/d30/d90/dcc/ce7 0 2024-09-21T11:39:17.819 INFO:tasks.workunit.client.1.smithi149.stdout:7/803: symlink d12/d5b/db5/dc5/de9/d4a/ddd/lfa 0 2024-09-21T11:39:17.821 INFO:tasks.workunit.client.1.smithi149.stdout:3/766: dwrite d6/f1a [0,4194304] 0 2024-09-21T11:39:17.821 INFO:tasks.workunit.client.1.smithi149.stdout:0/662: rmdir dd/d1a/d1b/dce 0 2024-09-21T11:39:17.823 INFO:tasks.workunit.client.1.smithi149.stdout:6/648: symlink d8/da/ld4 0 2024-09-21T11:39:17.823 INFO:tasks.workunit.client.1.smithi149.stdout:1/655: dread d2/dd/d35/d1c/d37/da3/fc6 [0,4194304] 0 2024-09-21T11:39:17.828 INFO:tasks.workunit.client.1.smithi149.stdout:2/842: dread d8/da/d13/d83/ff5 [0,4194304] 0 2024-09-21T11:39:17.828 INFO:tasks.workunit.client.1.smithi149.stdout:3/767: dread - d6/d1f/d47/d22/fad zero size 2024-09-21T11:39:17.829 INFO:tasks.workunit.client.1.smithi149.stdout:1/656: unlink d2/dd/f71 0 2024-09-21T11:39:17.829 INFO:tasks.workunit.client.0.smithi118.stdout:7/152: sync 2024-09-21T11:39:17.830 INFO:tasks.workunit.client.0.smithi118.stdout:5/200: sync 2024-09-21T11:39:17.830 INFO:tasks.workunit.client.0.smithi118.stdout:4/173: sync 2024-09-21T11:39:17.830 INFO:tasks.workunit.client.0.smithi118.stdout:2/131: sync 2024-09-21T11:39:17.831 INFO:tasks.workunit.client.0.smithi118.stdout:5/201: chown d0/db/d35/d2c/d40/l49 1218228 1 2024-09-21T11:39:17.835 INFO:tasks.workunit.client.1.smithi149.stdout:3/768: dwrite d6/d1f/d27/ff0 [0,4194304] 0 2024-09-21T11:39:17.838 INFO:tasks.workunit.client.0.smithi118.stdout:4/174: dread f1 [0,4194304] 0 2024-09-21T11:39:17.839 INFO:tasks.workunit.client.0.smithi118.stdout:4/175: readlink d2/d6/dd/l30 0 2024-09-21T11:39:17.839 INFO:tasks.workunit.client.0.smithi118.stdout:5/202: creat d0/d6/f4a x:0 0 0 2024-09-21T11:39:17.843 INFO:tasks.workunit.client.1.smithi149.stdout:1/657: stat d2/dd/d35/d1c/d41/cce 0 2024-09-21T11:39:17.846 INFO:tasks.workunit.client.0.smithi118.stdout:2/132: rename de/l1a to de/d16/l2f 0 2024-09-21T11:39:17.847 INFO:tasks.workunit.client.1.smithi149.stdout:6/649: symlink d8/d32/d37/d28/ld5 0 2024-09-21T11:39:17.848 INFO:tasks.workunit.client.1.smithi149.stdout:0/663: write dd/d2d/f7f [8516522,109843] 0 2024-09-21T11:39:17.850 INFO:tasks.workunit.client.1.smithi149.stdout:7/804: creat d12/d5b/db5/dc5/de9/ffb x:0 0 0 2024-09-21T11:39:17.851 INFO:tasks.workunit.client.1.smithi149.stdout:3/769: rmdir d6/d1f/d47/d22/d8d 39 2024-09-21T11:39:17.852 INFO:tasks.workunit.client.1.smithi149.stdout:0/664: chown dd/d1a/d1b/d72/dc1 24 1 2024-09-21T11:39:17.852 INFO:tasks.workunit.client.1.smithi149.stdout:2/843: getdents d8/da/d13/d1a/d3b 0 2024-09-21T11:39:17.853 INFO:tasks.workunit.client.0.smithi118.stdout:2/133: rename de/d16/d1c/c21 to de/d16/d1c/c30 0 2024-09-21T11:39:17.853 INFO:tasks.workunit.client.1.smithi149.stdout:1/658: symlink d2/d5/d65/ld7 0 2024-09-21T11:39:17.855 INFO:tasks.workunit.client.1.smithi149.stdout:0/665: write dd/d1a/f2c [3217426,43006] 0 2024-09-21T11:39:17.855 INFO:tasks.workunit.client.1.smithi149.stdout:9/710: dwrite d18/d19/d1a/d2f/d5f/f73 [0,4194304] 0 2024-09-21T11:39:17.856 INFO:tasks.workunit.client.0.smithi118.stdout:7/153: rmdir d0/d3/d29/d37 0 2024-09-21T11:39:17.857 INFO:tasks.workunit.client.1.smithi149.stdout:5/785: dwrite d4/d7/d40/d43/d5c/d7a/fbe [0,4194304] 0 2024-09-21T11:39:17.857 INFO:tasks.workunit.client.1.smithi149.stdout:7/805: chown d12/d5b/db5/dc5/de9/d68/dc4/f65 12575597 1 2024-09-21T11:39:17.860 INFO:tasks.workunit.client.1.smithi149.stdout:6/650: mknod d8/cd6 0 2024-09-21T11:39:17.860 INFO:tasks.workunit.client.0.smithi118.stdout:4/176: truncate d2/d6/f14 5127180 0 2024-09-21T11:39:17.865 INFO:tasks.workunit.client.1.smithi149.stdout:3/770: mknod d6/d1f/d47/dbb/c114 0 2024-09-21T11:39:17.870 INFO:tasks.workunit.client.1.smithi149.stdout:7/806: write d12/d5b/db5/dc5/de9/f1f [2036358,82926] 0 2024-09-21T11:39:17.871 INFO:tasks.workunit.client.1.smithi149.stdout:4/750: sync 2024-09-21T11:39:17.873 INFO:tasks.workunit.client.0.smithi118.stdout:4/177: symlink d2/d6/de/d1c/d23/l42 0 2024-09-21T11:39:17.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.871+0000 7f867a686640 1 -- 172.21.15.118:0/2706325241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8674101a40 msgr2=0x7f8674101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:17.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.871+0000 7f867a686640 1 --2- 172.21.15.118:0/2706325241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8674101a40 0x7f8674101ec0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f866800d890 tx=0x7f866802c430 comp rx=0 tx=0).stop 2024-09-21T11:39:17.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.871+0000 7f867a686640 1 -- 172.21.15.118:0/2706325241 shutdown_connections 2024-09-21T11:39:17.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.871+0000 7f867a686640 1 --2- 172.21.15.118:0/2706325241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8674101a40 0x7f8674101ec0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.871+0000 7f867a686640 1 --2- 172.21.15.118:0/2706325241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8674100840 0x7f8674100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.871+0000 7f867a686640 1 -- 172.21.15.118:0/2706325241 >> 172.21.15.118:0/2706325241 conn(0x7f86740fbff0 msgr2=0x7f86740fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:17.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.871+0000 7f867a686640 1 -- 172.21.15.118:0/2706325241 shutdown_connections 2024-09-21T11:39:17.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.871+0000 7f867a686640 1 -- 172.21.15.118:0/2706325241 wait complete. 2024-09-21T11:39:17.875 INFO:tasks.workunit.client.0.smithi118.stdout:4/178: chown d2/d6/dd/f33 581507 1 2024-09-21T11:39:17.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.872+0000 7f867a686640 1 Processor -- start 2024-09-21T11:39:17.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.872+0000 7f867a686640 1 -- start start 2024-09-21T11:39:17.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.873+0000 7f867a686640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8674100840 0x7f8674199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:17.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.873+0000 7f867a686640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8674101a40 0x7f8674199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:17.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.873+0000 7f867a686640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f86741085f0 con 0x7f8674100840 2024-09-21T11:39:17.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.873+0000 7f867a686640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8674108470 con 0x7f8674101a40 2024-09-21T11:39:17.876 INFO:tasks.workunit.client.0.smithi118.stdout:4/179: rename d2/d6 to d2/d6/dd/d35/d43 22 2024-09-21T11:39:17.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.873+0000 7f8673fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8674100840 0x7f8674199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:17.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.873+0000 7f86737fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8674101a40 0x7f8674199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:17.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.873+0000 7f86737fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8674101a40 0x7f8674199ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:56034/0 (socket says 172.21.15.118:56034) 2024-09-21T11:39:17.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.873+0000 7f86737fe640 1 -- 172.21.15.118:0/3057028842 learned_addr learned my addr 172.21.15.118:0/3057028842 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:17.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.874+0000 7f86737fe640 1 -- 172.21.15.118:0/3057028842 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8674100840 msgr2=0x7f8674199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:17.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.874+0000 7f86737fe640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8674100840 0x7f8674199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:17.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.874+0000 7f86737fe640 1 -- 172.21.15.118:0/3057028842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867419a320 con 0x7f8674101a40 2024-09-21T11:39:17.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.874+0000 7f86737fe640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8674101a40 0x7f8674199ca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8668035040 tx=0x7f866800d4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:17.878 INFO:tasks.workunit.client.0.smithi118.stdout:5/203: write d0/f5 [414125,119164] 0 2024-09-21T11:39:17.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.874+0000 7f86717fa640 1 -- 172.21.15.118:0/3057028842 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8668043020 con 0x7f8674101a40 2024-09-21T11:39:17.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.874+0000 7f86717fa640 1 -- 172.21.15.118:0/3057028842 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f866800ce50 con 0x7f8674101a40 2024-09-21T11:39:17.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.874+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867419ed60 con 0x7f8674101a40 2024-09-21T11:39:17.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.875+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867419f340 con 0x7f8674101a40 2024-09-21T11:39:17.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.875+0000 7f86717fa640 1 -- 172.21.15.118:0/3057028842 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f866803f470 con 0x7f8674101a40 2024-09-21T11:39:17.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.876+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8674100cc0 con 0x7f8674101a40 2024-09-21T11:39:17.879 INFO:tasks.workunit.client.1.smithi149.stdout:2/844: dread f3 [0,4194304] 0 2024-09-21T11:39:17.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.877+0000 7f86717fa640 1 -- 172.21.15.118:0/3057028842 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f8668046020 con 0x7f8674101a40 2024-09-21T11:39:17.880 INFO:tasks.workunit.client.0.smithi118.stdout:5/204: symlink d0/db/l4b 0 2024-09-21T11:39:17.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.878+0000 7f86717fa640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f865c074a80 0x7f865c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:17.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.878+0000 7f86717fa640 1 -- 172.21.15.118:0/3057028842 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f86680b74a0 con 0x7f8674101a40 2024-09-21T11:39:17.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.878+0000 7f8673fff640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f865c074a80 0x7f865c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:17.881 INFO:tasks.workunit.client.0.smithi118.stdout:5/205: readlink d0/d6/l3b 0 2024-09-21T11:39:17.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.879+0000 7f8673fff640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f865c074a80 0x7f865c076f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f86741018a0 tx=0x7f8664009110 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:17.884 INFO:tasks.workunit.client.1.smithi149.stdout:7/807: rmdir d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/ddc 39 2024-09-21T11:39:17.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:17.884+0000 7f86717fa640 1 -- 172.21.15.118:0/3057028842 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f866804d020 con 0x7f8674101a40 2024-09-21T11:39:17.886 INFO:tasks.workunit.client.0.smithi118.stdout:5/206: dread d0/d6/f7 [0,4194304] 0 2024-09-21T11:39:17.888 INFO:tasks.workunit.client.0.smithi118.stdout:2/134: dwrite de/d1f/d20/f2d [0,4194304] 0 2024-09-21T11:39:17.889 INFO:tasks.workunit.client.1.smithi149.stdout:0/666: mkdir dd/d1a/d1b/d72/d78/dc4/d3a/dd1/dde 0 2024-09-21T11:39:17.890 INFO:tasks.workunit.client.1.smithi149.stdout:7/808: dwrite d12/d5b/db5/dc5/de9/f17 [0,4194304] 0 2024-09-21T11:39:17.892 INFO:tasks.workunit.client.1.smithi149.stdout:2/845: mkdir d8/d44/d63/db9/d123 0 2024-09-21T11:39:17.893 INFO:tasks.workunit.client.1.smithi149.stdout:2/846: dread - d8/da/d13/d83/fe6 zero size 2024-09-21T11:39:17.894 INFO:tasks.workunit.client.1.smithi149.stdout:2/847: chown d8/dd/d5c/d84 0 1 2024-09-21T11:39:17.895 INFO:tasks.workunit.client.1.smithi149.stdout:2/848: fdatasync d8/d44/d63/fa9 0 2024-09-21T11:39:17.896 INFO:tasks.workunit.client.0.smithi118.stdout:7/154: dwrite d0/f6 [4194304,4194304] 0 2024-09-21T11:39:17.897 INFO:tasks.workunit.client.1.smithi149.stdout:5/786: truncate d4/d7/d40/d51/f8c 3576752 0 2024-09-21T11:39:17.898 INFO:tasks.workunit.client.1.smithi149.stdout:2/849: chown d8/da/d13/d5d/dd7 159796 1 2024-09-21T11:39:17.900 INFO:tasks.workunit.client.1.smithi149.stdout:6/651: dwrite d8/da/d2c/d52/f5c [0,4194304] 0 2024-09-21T11:39:17.902 INFO:tasks.workunit.client.0.smithi118.stdout:2/135: mkdir de/d16/d31 0 2024-09-21T11:39:17.902 INFO:tasks.workunit.client.1.smithi149.stdout:2/850: write d8/da/d13/d53/f91 [1334693,12561] 0 2024-09-21T11:39:17.903 INFO:tasks.workunit.client.1.smithi149.stdout:4/751: write d4/d6/f47 [7529394,50127] 0 2024-09-21T11:39:17.910 INFO:tasks.workunit.client.1.smithi149.stdout:1/659: fsync d2/dd/d35/d1c/d2c/f97 0 2024-09-21T11:39:17.912 INFO:tasks.workunit.client.0.smithi118.stdout:7/155: rename d0/d3/l31 to d0/l3a 0 2024-09-21T11:39:17.913 INFO:tasks.workunit.client.1.smithi149.stdout:0/667: mknod dd/d1a/d1b/d81/d97/cdf 0 2024-09-21T11:39:17.914 INFO:tasks.workunit.client.0.smithi118.stdout:5/207: dwrite d0/db/d35/da/f18 [0,4194304] 0 2024-09-21T11:39:17.914 INFO:tasks.workunit.client.0.smithi118.stdout:2/136: creat de/d16/f32 x:0 0 0 2024-09-21T11:39:17.915 INFO:tasks.workunit.client.0.smithi118.stdout:2/137: readlink de/l13 0 2024-09-21T11:39:17.916 INFO:tasks.workunit.client.1.smithi149.stdout:7/809: unlink d12/d5b/db5/dc5/de9/d4a/d4f/f51 0 2024-09-21T11:39:17.919 INFO:tasks.workunit.client.1.smithi149.stdout:3/771: link d6/d5f/d60/d88/ld8 d6/d5f/d60/d88/df4/l115 0 2024-09-21T11:39:17.920 INFO:tasks.workunit.client.1.smithi149.stdout:3/772: stat d6/d1f/d47/f84 0 2024-09-21T11:39:17.920 INFO:tasks.workunit.client.1.smithi149.stdout:3/773: chown d6/f8 0 1 2024-09-21T11:39:17.924 INFO:tasks.workunit.client.1.smithi149.stdout:5/787: rename d4/f2f to d4/d7/d40/d43/d5c/f102 0 2024-09-21T11:39:17.925 INFO:tasks.workunit.client.1.smithi149.stdout:2/851: creat d8/dd/d5c/f124 x:0 0 0 2024-09-21T11:39:17.926 INFO:tasks.workunit.client.0.smithi118.stdout:7/156: dread d0/d3/f7 [0,4194304] 0 2024-09-21T11:39:17.927 INFO:tasks.workunit.client.0.smithi118.stdout:2/138: creat de/d16/f33 x:0 0 0 2024-09-21T11:39:17.928 INFO:tasks.workunit.client.1.smithi149.stdout:3/774: dwrite d6/d1f/d4c/fb8 [0,4194304] 0 2024-09-21T11:39:17.929 INFO:tasks.workunit.client.1.smithi149.stdout:4/752: mkdir d4/d6/d63/d15/d16/d23/d62/d100 0 2024-09-21T11:39:17.929 INFO:tasks.workunit.client.1.smithi149.stdout:6/652: truncate d8/d32/d37/d28/d2e/f3b 4858110 0 2024-09-21T11:39:17.930 INFO:tasks.workunit.client.0.smithi118.stdout:5/208: symlink d0/l4c 0 2024-09-21T11:39:17.931 INFO:tasks.workunit.client.0.smithi118.stdout:5/209: dread - d0/d6/d25/f43 zero size 2024-09-21T11:39:17.936 INFO:tasks.workunit.client.1.smithi149.stdout:0/668: creat dd/d32/db2/fe0 x:0 0 0 2024-09-21T11:39:17.937 INFO:tasks.workunit.client.0.smithi118.stdout:2/139: chown de/f1e 2473 1 2024-09-21T11:39:17.938 INFO:tasks.workunit.client.0.smithi118.stdout:2/140: write de/f15 [322993,49407] 0 2024-09-21T11:39:17.940 INFO:tasks.workunit.client.1.smithi149.stdout:2/852: mknod d8/dcb/db8/dd3/c125 0 2024-09-21T11:39:17.945 INFO:tasks.workunit.client.0.smithi118.stdout:5/210: creat d0/db/d35/f4d x:0 0 0 2024-09-21T11:39:17.946 INFO:tasks.workunit.client.1.smithi149.stdout:0/669: rmdir dd/d1a/d1b/d72/d78/dc4/d3a/d66 39 2024-09-21T11:39:17.946 INFO:tasks.workunit.client.0.smithi118.stdout:2/141: dwrite de/f2a [0,4194304] 0 2024-09-21T11:39:17.946 INFO:tasks.workunit.client.0.smithi118.stdout:5/211: fsync d0/f37 0 2024-09-21T11:39:17.949 INFO:tasks.workunit.client.0.smithi118.stdout:2/142: write de/d22/f2b [73724,84945] 0 2024-09-21T11:39:17.949 INFO:tasks.workunit.client.0.smithi118.stdout:5/212: read d0/db/d35/da/f18 [2948867,8446] 0 2024-09-21T11:39:17.951 INFO:tasks.workunit.client.0.smithi118.stdout:9/284: sync 2024-09-21T11:39:17.953 INFO:tasks.workunit.client.1.smithi149.stdout:7/810: symlink d12/lfc 0 2024-09-21T11:39:17.954 INFO:tasks.workunit.client.1.smithi149.stdout:2/853: fsync d8/da/d13/d1a/d29/f72 0 2024-09-21T11:39:17.955 INFO:tasks.workunit.client.1.smithi149.stdout:8/620: sync 2024-09-21T11:39:17.957 INFO:tasks.workunit.client.1.smithi149.stdout:2/854: fsync d8/d20/d78/ddb/f119 0 2024-09-21T11:39:17.957 INFO:tasks.workunit.client.1.smithi149.stdout:8/621: stat d3/d33/d34/d55/d5e/d9e/dc2/d18/l32 0 2024-09-21T11:39:17.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/788: link d4/d7/d40/d43/d49/f4b d4/d1d/d50/dc8/f103 0 2024-09-21T11:39:17.958 INFO:tasks.workunit.client.0.smithi118.stdout:5/213: creat d0/db/d35/da/f4e x:0 0 0 2024-09-21T11:39:17.960 INFO:tasks.workunit.client.1.smithi149.stdout:4/753: mkdir d4/d6/d63/d10/d101 0 2024-09-21T11:39:17.960 INFO:tasks.workunit.client.1.smithi149.stdout:5/789: read d4/d7/d40/d43/d49/d88/de0/fe2 [170071,40768] 0 2024-09-21T11:39:17.961 INFO:tasks.workunit.client.0.smithi118.stdout:9/285: mkdir d0/d4/d45/d72 0 2024-09-21T11:39:17.961 INFO:tasks.workunit.client.1.smithi149.stdout:4/754: readlink d4/d6/d63/d2d/dd6/le3 0 2024-09-21T11:39:17.962 INFO:tasks.workunit.client.1.smithi149.stdout:6/653: dread d8/da/d14/f1f [0,4194304] 0 2024-09-21T11:39:17.963 INFO:tasks.workunit.client.1.smithi149.stdout:6/654: dread - d8/d32/d37/d2b/d51/f62 zero size 2024-09-21T11:39:17.964 INFO:tasks.workunit.client.0.smithi118.stdout:5/214: creat d0/d6/d25/f4f x:0 0 0 2024-09-21T11:39:17.965 INFO:tasks.workunit.client.1.smithi149.stdout:0/670: rmdir dd/d1a/d1b/d72/d78 39 2024-09-21T11:39:17.969 INFO:tasks.workunit.client.0.smithi118.stdout:5/215: mkdir d0/d6/d25/d50 0 2024-09-21T11:39:17.970 INFO:tasks.workunit.client.0.smithi118.stdout:7/157: dread d0/f9 [0,4194304] 0 2024-09-21T11:39:17.970 INFO:tasks.workunit.client.0.smithi118.stdout:7/158: stat d0/c27 0 2024-09-21T11:39:17.971 INFO:tasks.workunit.client.1.smithi149.stdout:5/790: dwrite d4/d1d/d50/d54/d2a/d93/fa6 [0,4194304] 0 2024-09-21T11:39:17.973 INFO:tasks.workunit.client.0.smithi118.stdout:5/216: creat d0/db/d35/da/f51 x:0 0 0 2024-09-21T11:39:17.973 INFO:tasks.workunit.client.0.smithi118.stdout:5/217: fdatasync d0/db/d35/f4d 0 2024-09-21T11:39:17.974 INFO:tasks.workunit.client.0.smithi118.stdout:9/286: link d0/d4/d38/l4b d0/d20/l73 0 2024-09-21T11:39:17.974 INFO:tasks.workunit.client.0.smithi118.stdout:9/287: chown d0/f4a 421580 1 2024-09-21T11:39:17.977 INFO:tasks.workunit.client.1.smithi149.stdout:1/660: link d2/dd/d2e/d4c/c84 d2/cd8 0 2024-09-21T11:39:17.977 INFO:tasks.workunit.client.1.smithi149.stdout:3/775: dwrite d6/d1f/f3e [4194304,4194304] 0 2024-09-21T11:39:17.978 INFO:tasks.workunit.client.1.smithi149.stdout:6/655: dwrite d8/da/d11/fcd [0,4194304] 0 2024-09-21T11:39:17.979 INFO:tasks.workunit.client.1.smithi149.stdout:3/776: readlink d6/d1f/d27/ld5 0 2024-09-21T11:39:17.980 INFO:tasks.workunit.client.0.smithi118.stdout:5/218: creat d0/db/d35/d30/f52 x:0 0 0 2024-09-21T11:39:17.980 INFO:tasks.workunit.client.0.smithi118.stdout:9/288: readlink d0/d4/l37 0 2024-09-21T11:39:17.980 INFO:tasks.workunit.client.1.smithi149.stdout:1/661: chown d2/d2b/d6e/ca8 154137 1 2024-09-21T11:39:17.981 INFO:tasks.workunit.client.1.smithi149.stdout:0/671: dwrite dd/d32/db2/fd8 [0,4194304] 0 2024-09-21T11:39:17.983 INFO:tasks.workunit.client.1.smithi149.stdout:6/656: dread d8/da/d14/f4c [0,4194304] 0 2024-09-21T11:39:17.984 INFO:tasks.workunit.client.1.smithi149.stdout:9/711: sync 2024-09-21T11:39:17.985 INFO:tasks.workunit.client.1.smithi149.stdout:7/811: creat d12/d5b/db5/dc5/de9/d68/ded/ffd x:0 0 0 2024-09-21T11:39:17.986 INFO:tasks.workunit.client.0.smithi118.stdout:9/289: symlink d0/d4/d38/d4e/l74 0 2024-09-21T11:39:17.989 INFO:tasks.workunit.client.0.smithi118.stdout:7/159: rename d0/d3/d14/l1e to d0/d3/d13/l3b 0 2024-09-21T11:39:17.990 INFO:tasks.workunit.client.1.smithi149.stdout:8/622: creat d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/fdc x:0 0 0 2024-09-21T11:39:17.991 INFO:tasks.workunit.client.0.smithi118.stdout:5/219: dread d0/db/d35/da/f18 [0,4194304] 0 2024-09-21T11:39:17.992 INFO:tasks.workunit.client.0.smithi118.stdout:5/220: chown d0/db/d35/d2c 333669 1 2024-09-21T11:39:17.993 INFO:tasks.workunit.client.0.smithi118.stdout:9/290: creat d0/d4/d45/f75 x:0 0 0 2024-09-21T11:39:17.997 INFO:tasks.workunit.client.0.smithi118.stdout:7/160: creat d0/d3/d14/f3c x:0 0 0 2024-09-21T11:39:17.998 INFO:tasks.workunit.client.0.smithi118.stdout:7/161: write d0/f16 [41595,126296] 0 2024-09-21T11:39:18.002 INFO:tasks.workunit.client.1.smithi149.stdout:3/777: truncate d6/d1f/fb9 373098 0 2024-09-21T11:39:18.003 INFO:tasks.workunit.client.1.smithi149.stdout:3/778: write d6/d1f/d27/d83/ffe [998020,29851] 0 2024-09-21T11:39:18.004 INFO:tasks.workunit.client.1.smithi149.stdout:3/779: fsync d6/d1f/d47/d37/dd6/ff7 0 2024-09-21T11:39:18.004 INFO:tasks.workunit.client.1.smithi149.stdout:6/657: mkdir d8/d32/d37/dd7 0 2024-09-21T11:39:18.005 INFO:tasks.workunit.client.0.smithi118.stdout:5/221: fsync d0/db/d35/da/f51 0 2024-09-21T11:39:18.010 INFO:tasks.workunit.client.0.smithi118.stdout:7/162: mkdir d0/d3/d13/d3d 0 2024-09-21T11:39:18.010 INFO:tasks.workunit.client.1.smithi149.stdout:6/658: dwrite d8/d32/d64/d97/fb2 [0,4194304] 0 2024-09-21T11:39:18.011 INFO:tasks.workunit.client.1.smithi149.stdout:2/855: truncate d8/da/f55 2892750 0 2024-09-21T11:39:18.011 INFO:tasks.workunit.client.0.smithi118.stdout:7/163: chown d0/d3/d29/l39 69618 1 2024-09-21T11:39:18.013 INFO:tasks.workunit.client.1.smithi149.stdout:4/755: creat d4/d6/d63/d15/d16/d23/f102 x:0 0 0 2024-09-21T11:39:18.013 INFO:tasks.workunit.client.0.smithi118.stdout:5/222: symlink d0/db/d26/l53 0 2024-09-21T11:39:18.016 INFO:tasks.workunit.client.1.smithi149.stdout:8/623: rename d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/fa1 to d3/d33/d34/fdd 0 2024-09-21T11:39:18.017 INFO:tasks.workunit.client.0.smithi118.stdout:9/291: creat d0/f76 x:0 0 0 2024-09-21T11:39:18.018 INFO:tasks.workunit.client.0.smithi118.stdout:9/292: dread - d0/d20/f3c zero size 2024-09-21T11:39:18.018 INFO:tasks.workunit.client.1.smithi149.stdout:8/624: read d3/fa [1174113,100785] 0 2024-09-21T11:39:18.019 INFO:tasks.workunit.client.1.smithi149.stdout:1/662: mkdir d2/d5/db3/dd9 0 2024-09-21T11:39:18.023 INFO:tasks.workunit.client.1.smithi149.stdout:3/780: mkdir d6/d1f/d27/d83/d116 0 2024-09-21T11:39:18.024 INFO:tasks.workunit.client.0.smithi118.stdout:9/293: read d0/d20/f30 [358779,68115] 0 2024-09-21T11:39:18.026 INFO:tasks.workunit.client.1.smithi149.stdout:9/712: symlink d18/d19/d1a/le8 0 2024-09-21T11:39:18.027 INFO:tasks.workunit.client.1.smithi149.stdout:2/856: creat d8/dd/d5c/d60/d67/d8a/f126 x:0 0 0 2024-09-21T11:39:18.028 INFO:tasks.workunit.client.1.smithi149.stdout:7/812: dread d12/d5b/db5/dc5/de9/f20 [0,4194304] 0 2024-09-21T11:39:18.029 INFO:tasks.workunit.client.1.smithi149.stdout:9/713: truncate d18/d36/d3c/d47/d76/f86 641173 0 2024-09-21T11:39:18.034 INFO:tasks.workunit.client.1.smithi149.stdout:0/672: creat dd/d1a/d1b/d72/d78/dbb/fe1 x:0 0 0 2024-09-21T11:39:18.036 INFO:tasks.workunit.client.1.smithi149.stdout:5/791: getdents d4/d7/dbd 0 2024-09-21T11:39:18.037 INFO:tasks.workunit.client.0.smithi118.stdout:7/164: write d0/d3/f18 [1865289,14270] 0 2024-09-21T11:39:18.037 INFO:tasks.workunit.client.1.smithi149.stdout:6/659: mknod d8/d32/d37/d28/cd8 0 2024-09-21T11:39:18.041 INFO:tasks.workunit.client.1.smithi149.stdout:1/663: dwrite d2/dd/d35/d5b/fbd [0,4194304] 0 2024-09-21T11:39:18.043 INFO:tasks.workunit.client.1.smithi149.stdout:6/660: write d8/d32/d37/d2b/d7d/fa0 [3543961,87406] 0 2024-09-21T11:39:18.045 INFO:tasks.workunit.client.0.smithi118.stdout:5/223: dwrite d0/f36 [0,4194304] 0 2024-09-21T11:39:18.045 INFO:tasks.workunit.client.0.smithi118.stdout:7/165: mkdir d0/d3/d13/d3d/d3e 0 2024-09-21T11:39:18.046 INFO:tasks.workunit.client.1.smithi149.stdout:0/673: dwrite dd/d1a/f9f [0,4194304] 0 2024-09-21T11:39:18.050 INFO:tasks.workunit.client.0.smithi118.stdout:5/224: dread d0/f2e [0,4194304] 0 2024-09-21T11:39:18.051 INFO:tasks.workunit.client.0.smithi118.stdout:7/166: rename d0/d3/c2c to d0/d3/d1d/c3f 0 2024-09-21T11:39:18.052 INFO:tasks.workunit.client.0.smithi118.stdout:5/225: fsync d0/fd 0 2024-09-21T11:39:18.053 INFO:tasks.workunit.client.0.smithi118.stdout:5/226: fdatasync d0/d6/f4a 0 2024-09-21T11:39:18.054 INFO:tasks.workunit.client.0.smithi118.stdout:5/227: readlink d0/db/d35/d30/l2d 0 2024-09-21T11:39:18.055 INFO:tasks.workunit.client.1.smithi149.stdout:6/661: fdatasync d8/d32/d37/d2b/f99 0 2024-09-21T11:39:18.055 INFO:tasks.workunit.client.1.smithi149.stdout:7/813: creat d12/d5b/db5/dc5/de9/d4a/d4f/d75/ffe x:0 0 0 2024-09-21T11:39:18.055 INFO:tasks.workunit.client.1.smithi149.stdout:1/664: chown d2/d2b/d6e/ca8 6 1 2024-09-21T11:39:18.056 INFO:tasks.workunit.client.1.smithi149.stdout:5/792: creat d4/d1d/dde/f104 x:0 0 0 2024-09-21T11:39:18.060 INFO:tasks.workunit.client.0.smithi118.stdout:7/167: symlink d0/d3/d13/d3d/d3e/l40 0 2024-09-21T11:39:18.061 INFO:tasks.workunit.client.1.smithi149.stdout:5/793: chown d4/fcc 154113 1 2024-09-21T11:39:18.062 INFO:tasks.workunit.client.1.smithi149.stdout:9/714: dwrite d18/d19/f40 [0,4194304] 0 2024-09-21T11:39:18.062 INFO:tasks.workunit.client.0.smithi118.stdout:5/228: symlink d0/db/d35/d2c/l54 0 2024-09-21T11:39:18.065 INFO:tasks.workunit.client.1.smithi149.stdout:8/625: write d3/f17 [1242856,76081] 0 2024-09-21T11:39:18.065 INFO:tasks.workunit.client.0.smithi118.stdout:7/168: mkdir d0/d3/d14/d41 0 2024-09-21T11:39:18.066 INFO:tasks.workunit.client.1.smithi149.stdout:9/715: write d18/d19/d1a/d2f/d30/d90/fb7 [5035153,90403] 0 2024-09-21T11:39:18.067 INFO:tasks.workunit.client.0.smithi118.stdout:7/169: chown d0/f16 8404363 1 2024-09-21T11:39:18.068 INFO:tasks.workunit.client.1.smithi149.stdout:0/674: dwrite dd/d1a/d1b/d50/d5d/f71 [0,4194304] 0 2024-09-21T11:39:18.068 INFO:tasks.workunit.client.1.smithi149.stdout:3/781: dread d6/d1f/f54 [0,4194304] 0 2024-09-21T11:39:18.068 INFO:tasks.workunit.client.0.smithi118.stdout:7/170: fsync d0/d3/f30 0 2024-09-21T11:39:18.071 INFO:tasks.workunit.client.0.smithi118.stdout:7/171: write d0/d3/ff [328085,57947] 0 2024-09-21T11:39:18.071 INFO:tasks.workunit.client.0.smithi118.stdout:5/229: dwrite d0/db/d35/d30/f52 [0,4194304] 0 2024-09-21T11:39:18.072 INFO:tasks.workunit.client.1.smithi149.stdout:9/716: write d18/d19/d1a/d2f/d30/d90/f9d [244285,116191] 0 2024-09-21T11:39:18.073 INFO:tasks.workunit.client.1.smithi149.stdout:4/756: getdents d4/d6 0 2024-09-21T11:39:18.074 INFO:tasks.workunit.client.1.smithi149.stdout:1/665: write d2/dd/d2e/f77 [5892298,127597] 0 2024-09-21T11:39:18.076 INFO:tasks.workunit.client.1.smithi149.stdout:2/857: creat d8/d11/f127 x:0 0 0 2024-09-21T11:39:18.077 INFO:tasks.workunit.client.1.smithi149.stdout:5/794: rename d4/c9f to d4/d7/d40/d43/d85/dce/c105 0 2024-09-21T11:39:18.082 INFO:tasks.workunit.client.0.smithi118.stdout:5/230: dwrite d0/f31 [0,4194304] 0 2024-09-21T11:39:18.082 INFO:tasks.workunit.client.1.smithi149.stdout:0/675: fdatasync dd/d32/fb7 0 2024-09-21T11:39:18.084 INFO:tasks.workunit.client.1.smithi149.stdout:8/626: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde 0 2024-09-21T11:39:18.084 INFO:tasks.workunit.client.0.smithi118.stdout:7/172: creat d0/d3/d13/d3d/d3e/f42 x:0 0 0 2024-09-21T11:39:18.084 INFO:tasks.workunit.client.0.smithi118.stdout:5/231: write d0/db/d35/f3d [409657,119584] 0 2024-09-21T11:39:18.086 INFO:tasks.workunit.client.1.smithi149.stdout:4/757: symlink d4/d6/d63/d78/d98/dcc/l103 0 2024-09-21T11:39:18.086 INFO:tasks.workunit.client.1.smithi149.stdout:0/676: fdatasync dd/d1a/f9f 0 2024-09-21T11:39:18.093 INFO:tasks.workunit.client.0.smithi118.stdout:7/173: dwrite d0/d3/d13/f2f [0,4194304] 0 2024-09-21T11:39:18.094 INFO:tasks.workunit.client.1.smithi149.stdout:9/717: mkdir d18/de9 0 2024-09-21T11:39:18.094 INFO:tasks.workunit.client.0.smithi118.stdout:7/174: chown d0/d3/c36 510500 1 2024-09-21T11:39:18.096 INFO:tasks.workunit.client.0.smithi118.stdout:7/175: read - d0/d3/d13/d3d/d3e/f42 zero size 2024-09-21T11:39:18.106 INFO:tasks.workunit.client.0.smithi118.stdout:7/176: rename d0/d3/f7 to d0/d3/d1d/d35/f43 0 2024-09-21T11:39:18.107 INFO:tasks.workunit.client.0.smithi118.stdout:7/177: chown d0/d3/d1d/f34 8 1 2024-09-21T11:39:18.108 INFO:tasks.workunit.client.1.smithi149.stdout:6/662: getdents d8/d32/d37/d2b/d7d 0 2024-09-21T11:39:18.108 INFO:tasks.workunit.client.0.smithi118.stdout:7/178: fsync d0/d3/d29/f20 0 2024-09-21T11:39:18.109 INFO:tasks.workunit.client.0.smithi118.stdout:7/179: write d0/d3/d14/f28 [242365,44879] 0 2024-09-21T11:39:18.110 INFO:tasks.workunit.client.0.smithi118.stdout:7/180: readlink d0/d3/l19 0 2024-09-21T11:39:18.111 INFO:tasks.workunit.client.1.smithi149.stdout:0/677: creat dd/d1a/d1b/d72/d85/fe2 x:0 0 0 2024-09-21T11:39:18.111 INFO:tasks.workunit.client.1.smithi149.stdout:0/678: stat dd/d1a/cd5 0 2024-09-21T11:39:18.113 INFO:tasks.workunit.client.1.smithi149.stdout:4/758: creat d4/d6/d63/d15/d16/d23/d62/f104 x:0 0 0 2024-09-21T11:39:18.114 INFO:tasks.workunit.client.1.smithi149.stdout:4/759: dread - d4/d6/d63/d2d/dd6/d32/fa4 zero size 2024-09-21T11:39:18.115 INFO:tasks.workunit.client.0.smithi118.stdout:7/181: mkdir d0/d3/d14/d41/d44 0 2024-09-21T11:39:18.117 INFO:tasks.workunit.client.1.smithi149.stdout:3/782: getdents d6/d1f/d47/d37/d3f/dc5/de3 0 2024-09-21T11:39:18.118 INFO:tasks.workunit.client.0.smithi118.stdout:7/182: dread - d0/fe zero size 2024-09-21T11:39:18.119 INFO:tasks.workunit.client.1.smithi149.stdout:5/795: dread d4/d1d/d50/d54/f35 [0,4194304] 0 2024-09-21T11:39:18.120 INFO:tasks.workunit.client.1.smithi149.stdout:8/627: getdents d3/d12/d6e/d79/dd2 0 2024-09-21T11:39:18.120 INFO:tasks.workunit.client.0.smithi118.stdout:7/183: readlink d0/d3/l12 0 2024-09-21T11:39:18.123 INFO:tasks.workunit.client.0.smithi118.stdout:7/184: creat d0/d3/d1d/f45 x:0 0 0 2024-09-21T11:39:18.123 INFO:tasks.workunit.client.1.smithi149.stdout:2/858: write d8/d20/d78/d7c/f9d [800586,76137] 0 2024-09-21T11:39:18.123 INFO:tasks.workunit.client.0.smithi118.stdout:7/185: fdatasync d0/d3/d14/f3c 0 2024-09-21T11:39:18.124 INFO:tasks.workunit.client.1.smithi149.stdout:5/796: dread - d4/d7/d40/d43/fe4 zero size 2024-09-21T11:39:18.124 INFO:tasks.workunit.client.1.smithi149.stdout:4/760: creat d4/d6/f105 x:0 0 0 2024-09-21T11:39:18.125 INFO:tasks.workunit.client.0.smithi118.stdout:5/232: truncate d0/d6/f7 2793611 0 2024-09-21T11:39:18.126 INFO:tasks.workunit.client.1.smithi149.stdout:9/718: dwrite d18/d19/d1a/d2f/d53/d64/f74 [4194304,4194304] 0 2024-09-21T11:39:18.126 INFO:tasks.workunit.client.1.smithi149.stdout:8/628: fdatasync d3/d33/d34/d55/d5e/d9e/dc2/d90/f92 0 2024-09-21T11:39:18.126 INFO:tasks.workunit.client.1.smithi149.stdout:2/859: chown d8/dcb 6 1 2024-09-21T11:39:18.126 INFO:tasks.workunit.client.1.smithi149.stdout:1/666: link d2/dd/d35/d1c/d2c/c53 d2/dd/d35/d7c/cda 0 2024-09-21T11:39:18.126 INFO:tasks.workunit.client.0.smithi118.stdout:7/186: creat d0/d3/d1d/f46 x:0 0 0 2024-09-21T11:39:18.128 INFO:tasks.workunit.client.1.smithi149.stdout:0/679: creat dd/d1a/d1b/d72/d78/d8b/d98/daa/fe3 x:0 0 0 2024-09-21T11:39:18.128 INFO:tasks.workunit.client.1.smithi149.stdout:4/761: dread - d4/d4d/d5f/ffe zero size 2024-09-21T11:39:18.129 INFO:tasks.workunit.client.1.smithi149.stdout:5/797: chown d4/d7/d40/d51/lf6 69 1 2024-09-21T11:39:18.130 INFO:tasks.workunit.client.1.smithi149.stdout:7/814: dwrite d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/ff2 [0,4194304] 0 2024-09-21T11:39:18.130 INFO:tasks.workunit.client.1.smithi149.stdout:1/667: dread - d2/dd/d35/d5b/f82 zero size 2024-09-21T11:39:18.132 INFO:tasks.workunit.client.1.smithi149.stdout:1/668: read d2/dd/d35/d5b/fbd [2327744,8618] 0 2024-09-21T11:39:18.133 INFO:tasks.workunit.client.1.smithi149.stdout:7/815: write d12/d5b/db5/dc5/de9/ffb [945228,115649] 0 2024-09-21T11:39:18.137 INFO:tasks.workunit.client.0.smithi118.stdout:7/187: dwrite d0/f9 [4194304,4194304] 0 2024-09-21T11:39:18.140 INFO:tasks.workunit.client.1.smithi149.stdout:2/860: write d8/d44/d63/db9/f41 [257921,92154] 0 2024-09-21T11:39:18.143 INFO:tasks.workunit.client.0.smithi118.stdout:7/188: dread d0/d3/d13/f2f [0,4194304] 0 2024-09-21T11:39:18.143 INFO:tasks.workunit.client.0.smithi118.stdout:7/189: chown d0/f9 57819 1 2024-09-21T11:39:18.147 INFO:tasks.workunit.client.1.smithi149.stdout:5/798: dread d4/d7/d40/d43/d49/d88/f98 [0,4194304] 0 2024-09-21T11:39:18.147 INFO:tasks.workunit.client.0.smithi118.stdout:5/233: rename d0/d6/f7 to d0/d6/d25/d50/f55 0 2024-09-21T11:39:18.148 INFO:tasks.workunit.client.0.smithi118.stdout:5/234: chown d0/db/d35/d30 57016 1 2024-09-21T11:39:18.153 INFO:tasks.workunit.client.1.smithi149.stdout:6/663: link d8/d32/d37/d28/f33 d8/da/d2c/d52/d5e/d9b/fd9 0 2024-09-21T11:39:18.153 INFO:tasks.workunit.client.1.smithi149.stdout:2/861: dwrite d8/da/d13/f9b [0,4194304] 0 2024-09-21T11:39:18.156 INFO:tasks.workunit.client.1.smithi149.stdout:3/783: truncate d6/d1f/d47/d22/f5d 2060541 0 2024-09-21T11:39:18.156 INFO:tasks.workunit.client.0.smithi118.stdout:5/235: dread d0/db/d35/d30/d1a/f2a [0,4194304] 0 2024-09-21T11:39:18.156 INFO:tasks.workunit.client.0.smithi118.stdout:7/190: dwrite d0/d3/fd [0,4194304] 0 2024-09-21T11:39:18.157 INFO:tasks.workunit.client.0.smithi118.stdout:5/236: read - d0/d6/d25/f43 zero size 2024-09-21T11:39:18.158 INFO:tasks.workunit.client.0.smithi118.stdout:5/237: fsync d0/db/d35/da/f4e 0 2024-09-21T11:39:18.158 INFO:tasks.workunit.client.1.smithi149.stdout:7/816: fsync d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f3f 0 2024-09-21T11:39:18.160 INFO:tasks.workunit.client.0.smithi118.stdout:7/191: mkdir d0/d3/d29/d47 0 2024-09-21T11:39:18.160 INFO:tasks.workunit.client.1.smithi149.stdout:9/719: creat d18/d36/d3c/d47/d99/dbe/fea x:0 0 0 2024-09-21T11:39:18.161 INFO:tasks.workunit.client.0.smithi118.stdout:7/192: chown d0/f5 8 1 2024-09-21T11:39:18.161 INFO:tasks.workunit.client.1.smithi149.stdout:0/680: symlink dd/d1a/d5a/le4 0 2024-09-21T11:39:18.163 INFO:tasks.workunit.client.0.smithi118.stdout:7/193: fsync d0/d3/f30 0 2024-09-21T11:39:18.163 INFO:tasks.workunit.client.0.smithi118.stdout:5/238: dread d0/f36 [0,4194304] 0 2024-09-21T11:39:18.165 INFO:tasks.workunit.client.1.smithi149.stdout:9/720: write d18/d36/d3c/d47/d99/fe1 [915296,12669] 0 2024-09-21T11:39:18.165 INFO:tasks.workunit.client.1.smithi149.stdout:4/762: creat d4/d6/d63/d15/d30/da6/f106 x:0 0 0 2024-09-21T11:39:18.171 INFO:tasks.workunit.client.0.smithi118.stdout:5/239: rename d0/db/d35/d30/l2d to d0/db/d26/l56 0 2024-09-21T11:39:18.175 INFO:tasks.workunit.client.1.smithi149.stdout:1/669: link d2/dd/d35/d7c/fb2 d2/d5/d3d/fdb 0 2024-09-21T11:39:18.177 INFO:tasks.workunit.client.1.smithi149.stdout:2/862: creat d8/d11/d88/dd4/f128 x:0 0 0 2024-09-21T11:39:18.178 INFO:tasks.workunit.client.0.smithi118.stdout:5/240: mkdir d0/db/d35/d30/d57 0 2024-09-21T11:39:18.181 INFO:tasks.workunit.client.0.smithi118.stdout:5/241: unlink d0/d6/f4a 0 2024-09-21T11:39:18.181 INFO:tasks.workunit.client.1.smithi149.stdout:3/784: creat d6/d1f/de5/f117 x:0 0 0 2024-09-21T11:39:18.183 INFO:tasks.workunit.client.0.smithi118.stdout:7/194: write d0/d3/d14/f15 [249442,101493] 0 2024-09-21T11:39:18.183 INFO:tasks.workunit.client.1.smithi149.stdout:7/817: creat d12/d5b/db5/dc5/de9/d4a/fff x:0 0 0 2024-09-21T11:39:18.185 INFO:tasks.workunit.client.1.smithi149.stdout:1/670: dwrite d2/dd/d35/d1c/d41/fbe [0,4194304] 0 2024-09-21T11:39:18.188 INFO:tasks.workunit.client.1.smithi149.stdout:4/763: rename d4/d6/d18/ff1 to d4/d6/d63/d10/d6f/f107 0 2024-09-21T11:39:18.188 INFO:tasks.workunit.client.0.smithi118.stdout:5/242: dwrite d0/db/d35/da/f4e [0,4194304] 0 2024-09-21T11:39:18.189 INFO:tasks.workunit.client.0.smithi118.stdout:5/243: chown d0/c27 3767042 1 2024-09-21T11:39:18.191 INFO:tasks.workunit.client.1.smithi149.stdout:5/799: creat d4/d1d/d50/d54/dec/f106 x:0 0 0 2024-09-21T11:39:18.191 INFO:tasks.workunit.client.1.smithi149.stdout:2/863: dwrite d8/d20/f40 [0,4194304] 0 2024-09-21T11:39:18.192 INFO:tasks.workunit.client.0.smithi118.stdout:7/195: getdents d0/d3/d29/d47 0 2024-09-21T11:39:18.193 INFO:tasks.workunit.client.0.smithi118.stdout:7/196: chown d0/fe 1060026289 1 2024-09-21T11:39:18.197 INFO:tasks.workunit.client.0.smithi118.stdout:5/244: dwrite d0/db/d35/d30/f52 [0,4194304] 0 2024-09-21T11:39:18.198 INFO:tasks.workunit.client.1.smithi149.stdout:0/681: mkdir dd/de5 0 2024-09-21T11:39:18.199 INFO:tasks.workunit.client.0.smithi118.stdout:5/245: truncate d0/db/d35/da/f51 384952 0 2024-09-21T11:39:18.203 INFO:tasks.workunit.client.0.smithi118.stdout:5/246: mknod d0/db/d35/d2c/d40/c58 0 2024-09-21T11:39:18.207 INFO:tasks.workunit.client.1.smithi149.stdout:8/629: dread d3/d3c/d8f/d76/fa9 [0,4194304] 0 2024-09-21T11:39:18.210 INFO:tasks.workunit.client.0.smithi118.stdout:5/247: link d0/db/l4b d0/d6/d25/d50/l59 0 2024-09-21T11:39:18.211 INFO:tasks.workunit.client.1.smithi149.stdout:2/864: symlink d8/d11/d88/dd4/de5/l129 0 2024-09-21T11:39:18.216 INFO:tasks.workunit.client.1.smithi149.stdout:2/865: write d8/d20/f40 [500662,83593] 0 2024-09-21T11:39:18.216 INFO:tasks.workunit.client.0.smithi118.stdout:5/248: creat d0/d6/f5a x:0 0 0 2024-09-21T11:39:18.220 INFO:tasks.workunit.client.1.smithi149.stdout:4/764: dwrite d4/d6/d63/d15/d16/d23/d62/f104 [0,4194304] 0 2024-09-21T11:39:18.220 INFO:tasks.workunit.client.1.smithi149.stdout:5/800: dwrite d4/d7/d40/d43/d49/d88/fd8 [0,4194304] 0 2024-09-21T11:39:18.238 INFO:tasks.workunit.client.1.smithi149.stdout:7/818: dwrite ff [0,4194304] 0 2024-09-21T11:39:18.238 INFO:tasks.workunit.client.1.smithi149.stdout:3/785: write d6/d1f/d47/d37/d3a/f6b [1032693,28332] 0 2024-09-21T11:39:18.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.238+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8674106090 con 0x7f865c074a80 2024-09-21T11:39:18.244 INFO:tasks.workunit.client.1.smithi149.stdout:3/786: write d6/d79/d7e/ff3 [853620,65614] 0 2024-09-21T11:39:18.246 INFO:tasks.workunit.client.1.smithi149.stdout:2/866: dwrite d8/d20/d78/f93 [8388608,4194304] 0 2024-09-21T11:39:18.248 INFO:tasks.workunit.client.1.smithi149.stdout:9/721: truncate d18/d19/f20 6499602 0 2024-09-21T11:39:18.249 INFO:tasks.workunit.client.1.smithi149.stdout:3/787: readlink d6/d1f/d47/d37/d3f/dc5/lea 0 2024-09-21T11:39:18.249 INFO:tasks.workunit.client.1.smithi149.stdout:4/765: dread d4/f27 [0,4194304] 0 2024-09-21T11:39:18.250 INFO:tasks.workunit.client.1.smithi149.stdout:8/630: write d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f71 [1598080,98459] 0 2024-09-21T11:39:18.252 INFO:tasks.workunit.client.1.smithi149.stdout:5/801: mkdir d4/d90/ddd/d107 0 2024-09-21T11:39:18.252 INFO:tasks.workunit.client.0.smithi118.stdout:5/249: dwrite d0/d6/d25/f43 [0,4194304] 0 2024-09-21T11:39:18.253 INFO:tasks.workunit.client.1.smithi149.stdout:4/766: write d4/d6/f47 [3423420,102631] 0 2024-09-21T11:39:18.254 INFO:tasks.workunit.client.1.smithi149.stdout:7/819: write d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/ddc/ff7 [264341,9530] 0 2024-09-21T11:39:18.256 INFO:tasks.workunit.client.1.smithi149.stdout:2/867: mknod d8/dd/d5c/d84/c12a 0 2024-09-21T11:39:18.262 INFO:tasks.workunit.client.1.smithi149.stdout:8/631: truncate d3/d33/d34/d72/f9c 1893491 0 2024-09-21T11:39:18.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.264+0000 7f86717fa640 1 -- 172.21.15.118:0/3057028842 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8674106090 con 0x7f865c074a80 2024-09-21T11:39:18.267 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:39:18.267 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (6m) 28s ago 8m 23.6M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:39:18.267 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 starting - - - - 2024-09-21T11:39:18.267 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (7m) 33s ago 7m 5268k - 19.1.1-373-g4e45e6b4 164465d2334a b67cebd3ec35 2024-09-21T11:39:18.267 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (8m) 28s ago 8m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:39:18.267 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (7m) 33s ago 7m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:39:18.267 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (6m) 28s ago 7m 79.0M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:39:18.267 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (2m) 28s ago 2m 149M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:39:18.268 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (2m) 28s ago 2m 22.7M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:39:18.268 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (2m) 33s ago 2m 18.4M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:39:18.268 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (2m) 33s ago 2m 12.3M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:39:18.269 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:9283,8765,8443 running (9m) 28s ago 9m 298M - 19.1.1-373-g4e45e6b4 164465d2334a 74626178eaa8 2024-09-21T11:39:18.269 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (55s) 33s ago 7m 496M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f2f99ac4e912 2024-09-21T11:39:18.269 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (9m) 28s ago 9m 54.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:39:18.269 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (7m) 33s ago 7m 43.8M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:39:18.269 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (8m) 28s ago 8m 16.1M - 1.5.0 0da6a335fe13 92cdb77bc8bc 2024-09-21T11:39:18.270 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (7m) 33s ago 7m 15.5M - 1.5.0 0da6a335fe13 1a6e8f960a5b 2024-09-21T11:39:18.270 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (6m) 28s ago 6m 74.6M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:39:18.270 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (5m) 28s ago 5m 82.3M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:39:18.270 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (5m) 28s ago 5m 74.6M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:39:18.270 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (4m) 33s ago 4m 87.9M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:39:18.270 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (4m) 33s ago 4m 73.9M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:39:18.270 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (3m) 33s ago 3m 80.1M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:39:18.270 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (6m) 28s ago 7m 60.2M - 2.43.0 a07b618ecd1d 44053d283e3b 2024-09-21T11:39:18.271 INFO:tasks.workunit.client.1.smithi149.stdout:6/664: sync 2024-09-21T11:39:18.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.268+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f865c074a80 msgr2=0x7f865c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:18.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.268+0000 7f867a686640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f865c074a80 0x7f865c076f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f86741018a0 tx=0x7f8664009110 comp rx=0 tx=0).stop 2024-09-21T11:39:18.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.268+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8674101a40 msgr2=0x7f8674199ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:18.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.268+0000 7f867a686640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8674101a40 0x7f8674199ca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8668035040 tx=0x7f866800d4f0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.268+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 shutdown_connections 2024-09-21T11:39:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.268+0000 7f867a686640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f865c074a80 0x7f865c076f40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.268+0000 7f867a686640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8674101a40 0x7f8674199ca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.268+0000 7f867a686640 1 --2- 172.21.15.118:0/3057028842 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8674100840 0x7f8674199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.268+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 >> 172.21.15.118:0/3057028842 conn(0x7f86740fbff0 msgr2=0x7f86740fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.269+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 shutdown_connections 2024-09-21T11:39:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.269+0000 7f867a686640 1 -- 172.21.15.118:0/3057028842 wait complete. 2024-09-21T11:39:18.274 INFO:tasks.workunit.client.0.smithi118.stdout:7/197: dread d0/d3/f18 [0,4194304] 0 2024-09-21T11:39:18.274 INFO:tasks.workunit.client.0.smithi118.stdout:7/198: chown d0/f6 89792878 1 2024-09-21T11:39:18.274 INFO:tasks.workunit.client.0.smithi118.stdout:7/199: write d0/d3/d14/f32 [4204674,20571] 0 2024-09-21T11:39:18.275 INFO:tasks.workunit.client.1.smithi149.stdout:9/722: creat d18/d19/d1a/d9b/feb x:0 0 0 2024-09-21T11:39:18.275 INFO:tasks.workunit.client.1.smithi149.stdout:1/671: dread d2/dd/d35/d5b/f6a [0,4194304] 0 2024-09-21T11:39:18.276 INFO:tasks.workunit.client.1.smithi149.stdout:2/868: mknod d8/dd/d5c/d60/d67/d8a/c12b 0 2024-09-21T11:39:18.278 INFO:tasks.workunit.client.1.smithi149.stdout:6/665: creat d8/d32/d37/d28/d2e/fda x:0 0 0 2024-09-21T11:39:18.279 INFO:tasks.workunit.client.1.smithi149.stdout:8/632: truncate d3/d3c/d8f/fb5 143147 0 2024-09-21T11:39:18.279 INFO:tasks.workunit.client.1.smithi149.stdout:5/802: dread d4/d7/f45 [0,4194304] 0 2024-09-21T11:39:18.280 INFO:tasks.workunit.client.0.smithi118.stdout:5/250: dwrite d0/db/f16 [0,4194304] 0 2024-09-21T11:39:18.281 INFO:tasks.workunit.client.0.smithi118.stdout:5/251: truncate d0/f36 4701588 0 2024-09-21T11:39:18.281 INFO:tasks.workunit.client.1.smithi149.stdout:9/723: chown d18/d19/d1a/d2f/d43/c50 252223102 1 2024-09-21T11:39:18.282 INFO:tasks.workunit.client.0.smithi118.stdout:5/252: write d0/db/d35/da/f21 [3134239,51275] 0 2024-09-21T11:39:18.284 INFO:tasks.workunit.client.1.smithi149.stdout:0/682: dread dd/d2d/f7f [4194304,4194304] 0 2024-09-21T11:39:18.285 INFO:tasks.workunit.client.0.smithi118.stdout:5/253: write d0/db/d35/da/f51 [1415334,21892] 0 2024-09-21T11:39:18.285 INFO:tasks.workunit.client.1.smithi149.stdout:7/820: dwrite d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/ff2 [0,4194304] 0 2024-09-21T11:39:18.286 INFO:tasks.workunit.client.1.smithi149.stdout:1/672: creat d2/dd/d35/d1c/d41/d51/fdc x:0 0 0 2024-09-21T11:39:18.287 INFO:tasks.workunit.client.1.smithi149.stdout:5/803: write d4/d7/d40/d43/d49/f78 [183123,109392] 0 2024-09-21T11:39:18.287 INFO:tasks.workunit.client.1.smithi149.stdout:6/666: truncate d8/d32/d37/f19 5171502 0 2024-09-21T11:39:18.290 INFO:tasks.workunit.client.0.smithi118.stdout:5/254: symlink d0/db/d35/d30/d57/l5b 0 2024-09-21T11:39:18.290 INFO:tasks.workunit.client.1.smithi149.stdout:7/821: chown d12/d5b/db5/dc5/de9/d4a/d4f/cb3 88 1 2024-09-21T11:39:18.294 INFO:tasks.workunit.client.0.smithi118.stdout:5/255: write d0/db/d35/f4d [597619,109870] 0 2024-09-21T11:39:18.296 INFO:tasks.workunit.client.1.smithi149.stdout:0/683: fdatasync dd/d1a/d1b/d72/dc1/fdd 0 2024-09-21T11:39:18.296 INFO:tasks.workunit.client.1.smithi149.stdout:4/767: write d4/d6/d63/d2d/dd6/d32/d4a/f61 [3373036,17566] 0 2024-09-21T11:39:18.296 INFO:tasks.workunit.client.1.smithi149.stdout:5/804: chown d4/d7/d40/d43/d5c/f66 1292036 1 2024-09-21T11:39:18.296 INFO:tasks.workunit.client.0.smithi118.stdout:5/256: fdatasync d0/db/d35/da/f18 0 2024-09-21T11:39:18.299 INFO:tasks.workunit.client.1.smithi149.stdout:4/768: chown d4/d6/f8f 78260 1 2024-09-21T11:39:18.303 INFO:tasks.workunit.client.1.smithi149.stdout:5/805: write d4/d1d/d50/f7d [282887,6620] 0 2024-09-21T11:39:18.305 INFO:tasks.workunit.client.1.smithi149.stdout:1/673: write d2/dd/d35/f8d [3356674,114501] 0 2024-09-21T11:39:18.305 INFO:tasks.workunit.client.1.smithi149.stdout:7/822: symlink d12/d5b/db5/dc5/de9/d4a/d6c/db1/de1/l100 0 2024-09-21T11:39:18.308 INFO:tasks.workunit.client.1.smithi149.stdout:9/724: write d18/d19/f20 [553960,34752] 0 2024-09-21T11:39:18.313 INFO:tasks.workunit.client.1.smithi149.stdout:8/633: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/fd3 [0,4194304] 0 2024-09-21T11:39:18.313 INFO:tasks.workunit.client.1.smithi149.stdout:0/684: link dd/d2d/l48 dd/d1a/d5a/d8a/le6 0 2024-09-21T11:39:18.317 INFO:tasks.workunit.client.1.smithi149.stdout:1/674: mknod d2/dd/d35/d5b/dc0/dc3/cdd 0 2024-09-21T11:39:18.318 INFO:tasks.workunit.client.1.smithi149.stdout:3/788: dread d6/d79/d7e/fc1 [4194304,4194304] 0 2024-09-21T11:39:18.322 INFO:tasks.workunit.client.1.smithi149.stdout:9/725: truncate d18/d19/d1a/d2f/d7d/fd8 82391 0 2024-09-21T11:39:18.322 INFO:tasks.workunit.client.1.smithi149.stdout:6/667: dwrite d8/d32/d37/d28/d2f/d6a/f95 [0,4194304] 0 2024-09-21T11:39:18.323 INFO:tasks.workunit.client.1.smithi149.stdout:8/634: fsync d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f71 0 2024-09-21T11:39:18.324 INFO:tasks.workunit.client.1.smithi149.stdout:3/789: chown d6/d1f/d4c/f8f 183579853 1 2024-09-21T11:39:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:18 smithi118 ceph-mon[28757]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 290 MiB/s wr, 498 op/s 2024-09-21T11:39:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:18 smithi118 ceph-mon[28757]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:18.329 INFO:tasks.workunit.client.1.smithi149.stdout:4/769: dwrite d4/d6/d63/d2d/dd6/f40 [4194304,4194304] 0 2024-09-21T11:39:18.333 INFO:tasks.workunit.client.1.smithi149.stdout:9/726: dread - d18/d19/d29/d39/d63/dac/fd3 zero size 2024-09-21T11:39:18.335 INFO:tasks.workunit.client.1.smithi149.stdout:0/685: write dd/d1a/d1b/d72/d78/d8b/fae [219929,11160] 0 2024-09-21T11:39:18.341 INFO:tasks.workunit.client.1.smithi149.stdout:7/823: link d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/ld0 d12/l101 0 2024-09-21T11:39:18.344 INFO:tasks.workunit.client.1.smithi149.stdout:9/727: write d18/d19/d1a/d2f/d5f/f73 [4113535,37061] 0 2024-09-21T11:39:18.344 INFO:tasks.workunit.client.1.smithi149.stdout:3/790: chown d6/d1f/c2f 56 1 2024-09-21T11:39:18.344 INFO:tasks.workunit.client.1.smithi149.stdout:1/675: dwrite d2/dd/f12 [0,4194304] 0 2024-09-21T11:39:18.348 INFO:tasks.workunit.client.1.smithi149.stdout:6/668: rename d8/da/d2c/d2d/d60/f81 to d8/da/d3d/fdb 0 2024-09-21T11:39:18.348 INFO:tasks.workunit.client.1.smithi149.stdout:5/806: dread d4/d1d/d3e/f89 [0,4194304] 0 2024-09-21T11:39:18.352 INFO:tasks.workunit.client.1.smithi149.stdout:4/770: mkdir d4/d6/d63/d78/d98/dcc/ddb/d108 0 2024-09-21T11:39:18.354 INFO:tasks.workunit.client.1.smithi149.stdout:5/807: dread - d4/d1d/dde/f104 zero size 2024-09-21T11:39:18.355 INFO:tasks.workunit.client.1.smithi149.stdout:9/728: creat d18/d19/d1a/d9b/fec x:0 0 0 2024-09-21T11:39:18.355 INFO:tasks.workunit.client.1.smithi149.stdout:8/635: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7/ddf 0 2024-09-21T11:39:18.356 INFO:tasks.workunit.client.1.smithi149.stdout:0/686: dread dd/d1a/f44 [0,4194304] 0 2024-09-21T11:39:18.356 INFO:tasks.workunit.client.1.smithi149.stdout:6/669: symlink d8/ldc 0 2024-09-21T11:39:18.360 INFO:tasks.workunit.client.1.smithi149.stdout:5/808: fdatasync d4/d1d/d50/fc1 0 2024-09-21T11:39:18.361 INFO:tasks.workunit.client.1.smithi149.stdout:7/824: dread d12/d5b/db5/dc5/de9/d68/f7a [0,4194304] 0 2024-09-21T11:39:18.362 INFO:tasks.workunit.client.1.smithi149.stdout:6/670: fsync d8/da/d2c/d52/fb6 0 2024-09-21T11:39:18.363 INFO:tasks.workunit.client.1.smithi149.stdout:5/809: chown d4/lb3 305447 1 2024-09-21T11:39:18.365 INFO:tasks.workunit.client.1.smithi149.stdout:3/791: dread d6/f1a [0,4194304] 0 2024-09-21T11:39:18.365 INFO:tasks.workunit.client.1.smithi149.stdout:8/636: getdents d3/d33/d34/d55/d5e/d9e/dc2 0 2024-09-21T11:39:18.366 INFO:tasks.workunit.client.1.smithi149.stdout:6/671: chown d8/ldc 2869927 1 2024-09-21T11:39:18.368 INFO:tasks.workunit.client.1.smithi149.stdout:7/825: chown d12/d5b/db5/dc5/de9/d4a/d6c/da0/dee 7566 1 2024-09-21T11:39:18.368 INFO:tasks.workunit.client.1.smithi149.stdout:1/676: truncate d2/dd/d35/d1c/f39 3851502 0 2024-09-21T11:39:18.370 INFO:tasks.workunit.client.1.smithi149.stdout:5/810: creat d4/d7/d40/d43/d49/dd1/f108 x:0 0 0 2024-09-21T11:39:18.372 INFO:tasks.workunit.client.1.smithi149.stdout:3/792: write d6/d1f/d47/d37/d3a/d95/f10d [1041169,10825] 0 2024-09-21T11:39:18.372 INFO:tasks.workunit.client.1.smithi149.stdout:9/729: dwrite d18/d19/fcd [0,4194304] 0 2024-09-21T11:39:18.375 INFO:tasks.workunit.client.1.smithi149.stdout:8/637: write d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/f8d [1088402,116050] 0 2024-09-21T11:39:18.378 INFO:tasks.workunit.client.1.smithi149.stdout:3/793: dread - d6/d79/d7e/dcb/ffc zero size 2024-09-21T11:39:18.383 INFO:tasks.workunit.client.1.smithi149.stdout:6/672: rename d8/d32/d37/d2b/d51/f59 to d8/d32/d37/d28/d87/da4/fdd 0 2024-09-21T11:39:18.384 INFO:tasks.workunit.client.1.smithi149.stdout:9/730: write d18/d36/d3c/d47/d76/f86 [1619931,120827] 0 2024-09-21T11:39:18.385 INFO:tasks.workunit.client.1.smithi149.stdout:7/826: symlink d12/d5b/db5/dc5/de9/d4a/d4f/d75/l102 0 2024-09-21T11:39:18.386 INFO:tasks.workunit.client.1.smithi149.stdout:2/869: sync 2024-09-21T11:39:18.388 INFO:tasks.workunit.client.1.smithi149.stdout:4/771: dread d4/d6/d63/f28 [0,4194304] 0 2024-09-21T11:39:18.388 INFO:tasks.workunit.client.1.smithi149.stdout:2/870: fsync d8/d11/f3a 0 2024-09-21T11:39:18.389 INFO:tasks.workunit.client.1.smithi149.stdout:5/811: link d4/d7/d40/f53 d4/d1d/d50/d54/d2a/d93/f109 0 2024-09-21T11:39:18.389 INFO:tasks.workunit.client.1.smithi149.stdout:0/687: dread dd/d1a/f2f [0,4194304] 0 2024-09-21T11:39:18.389 INFO:tasks.workunit.client.1.smithi149.stdout:8/638: mknod d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/ce0 0 2024-09-21T11:39:18.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.387+0000 7f0665d9b640 1 -- 172.21.15.118:0/3120521212 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0654031740 con 0x7f0668100b40 2024-09-21T11:39:18.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.388+0000 7f066d0ac640 1 -- 172.21.15.118:0/3120521212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100b40 msgr2=0x7f0668100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:18.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.388+0000 7f066d0ac640 1 --2- 172.21.15.118:0/3120521212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100b40 0x7f0668100fa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0654009880 tx=0x7f065402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.388+0000 7f066d0ac640 1 -- 172.21.15.118:0/3120521212 shutdown_connections 2024-09-21T11:39:18.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.388+0000 7f066d0ac640 1 --2- 172.21.15.118:0/3120521212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100b40 0x7f0668100fa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.388+0000 7f066d0ac640 1 --2- 172.21.15.118:0/3120521212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0668100200 0x7f0668100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.388+0000 7f066d0ac640 1 -- 172.21.15.118:0/3120521212 >> 172.21.15.118:0/3120521212 conn(0x7f06680fbff0 msgr2=0x7f06680fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:18.391 INFO:tasks.workunit.client.1.smithi149.stdout:9/731: chown d18/d36/d3c/d47/d76/d7c/le3 3100310 1 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.388+0000 7f066d0ac640 1 -- 172.21.15.118:0/3120521212 shutdown_connections 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.388+0000 7f066d0ac640 1 -- 172.21.15.118:0/3120521212 wait complete. 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.389+0000 7f066d0ac640 1 Processor -- start 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.389+0000 7f066d0ac640 1 -- start start 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f066d0ac640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100200 0x7f066819dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f066d0ac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0668100b40 0x7f066819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f066d0ac640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f066810c970 con 0x7f0668100200 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f066d0ac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f066810c7f0 con 0x7f0668100b40 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f0666d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100200 0x7f066819dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:18.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f0666d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100200 0x7f066819dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44908/0 (socket says 172.21.15.118:44908) 2024-09-21T11:39:18.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f0666d9d640 1 -- 172.21.15.118:0/3265159410 learned_addr learned my addr 172.21.15.118:0/3265159410 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:18.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f066659c640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0668100b40 0x7f066819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:18.393 INFO:tasks.workunit.client.1.smithi149.stdout:3/794: truncate d6/d1f/d47/d37/d3f/f40 2303840 0 2024-09-21T11:39:18.394 INFO:tasks.workunit.client.1.smithi149.stdout:1/677: dwrite d2/d5/d65/f86 [0,4194304] 0 2024-09-21T11:39:18.394 INFO:tasks.workunit.client.1.smithi149.stdout:0/688: write dd/f15 [8438797,100504] 0 2024-09-21T11:39:18.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f0666d9d640 1 -- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0668100b40 msgr2=0x7f066819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:18.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f0666d9d640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0668100b40 0x7f066819e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.390+0000 7f0666d9d640 1 -- 172.21.15.118:0/3265159410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066819e680 con 0x7f0668100200 2024-09-21T11:39:18.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.391+0000 7f0666d9d640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100200 0x7f066819dac0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f065800e970 tx=0x7f065800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:18.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.391+0000 7f065ffff640 1 -- 172.21.15.118:0/3265159410 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f065800cac0 con 0x7f0668100200 2024-09-21T11:39:18.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.391+0000 7f065ffff640 1 -- 172.21.15.118:0/3265159410 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06580054e0 con 0x7f0668100200 2024-09-21T11:39:18.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.391+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06681a30c0 con 0x7f0668100200 2024-09-21T11:39:18.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.391+0000 7f065ffff640 1 -- 172.21.15.118:0/3265159410 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0658010430 con 0x7f0668100200 2024-09-21T11:39:18.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.391+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06681a3620 con 0x7f0668100200 2024-09-21T11:39:18.395 INFO:tasks.workunit.client.1.smithi149.stdout:9/732: write d18/d19/f40 [4603963,78656] 0 2024-09-21T11:39:18.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.392+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0668100600 con 0x7f0668100200 2024-09-21T11:39:18.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.393+0000 7f065ffff640 1 -- 172.21.15.118:0/3265159410 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f0658004f00 con 0x7f0668100200 2024-09-21T11:39:18.397 INFO:tasks.workunit.client.1.smithi149.stdout:2/871: fdatasync d8/d44/d63/db9/d5a/fc7 0 2024-09-21T11:39:18.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.394+0000 7f065ffff640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f064c074a80 0x7f064c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:18.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.394+0000 7f065ffff640 1 -- 172.21.15.118:0/3265159410 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f0658096900 con 0x7f0668100200 2024-09-21T11:39:18.397 INFO:tasks.workunit.client.1.smithi149.stdout:6/673: truncate d8/da/d2c/d52/d5e/d9b/fa6 352377 0 2024-09-21T11:39:18.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.396+0000 7f066659c640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f064c074a80 0x7f064c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:18.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.397+0000 7f066659c640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f064c074a80 0x7f064c076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f06540058d0 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:18.401 INFO:tasks.workunit.client.1.smithi149.stdout:3/795: mknod d6/d79/c118 0 2024-09-21T11:39:18.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.400+0000 7f065ffff640 1 -- 172.21.15.118:0/3265159410 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0658061eb0 con 0x7f0668100200 2024-09-21T11:39:18.404 INFO:tasks.workunit.client.1.smithi149.stdout:4/772: creat d4/d6/d63/d15/d30/d6b/daa/de6/f109 x:0 0 0 2024-09-21T11:39:18.407 INFO:tasks.workunit.client.1.smithi149.stdout:0/689: write dd/d1a/d1b/d72/d85/d8c/fa4 [3746792,39350] 0 2024-09-21T11:39:18.408 INFO:tasks.workunit.client.1.smithi149.stdout:5/812: dwrite d4/d7/d40/d43/fe4 [0,4194304] 0 2024-09-21T11:39:18.409 INFO:tasks.workunit.client.1.smithi149.stdout:6/674: creat d8/d32/d37/d2b/d51/fde x:0 0 0 2024-09-21T11:39:18.410 INFO:tasks.workunit.client.1.smithi149.stdout:0/690: stat dd/d1a/d1b/d72/d87/f96 0 2024-09-21T11:39:18.411 INFO:tasks.workunit.client.1.smithi149.stdout:2/872: mkdir d8/d44/d12c 0 2024-09-21T11:39:18.411 INFO:tasks.workunit.client.1.smithi149.stdout:6/675: read d8/d32/f55 [126648,81389] 0 2024-09-21T11:39:18.412 INFO:tasks.workunit.client.1.smithi149.stdout:3/796: rmdir d6/d1f/d47/d37 39 2024-09-21T11:39:18.412 INFO:tasks.workunit.client.1.smithi149.stdout:1/678: read d2/d5/d8/f40 [523511,99971] 0 2024-09-21T11:39:18.412 INFO:tasks.workunit.client.1.smithi149.stdout:0/691: write dd/d1a/d1b/d72/d78/dc4/f5c [3396867,86283] 0 2024-09-21T11:39:18.415 INFO:tasks.workunit.client.1.smithi149.stdout:4/773: rmdir d4/d6/d63/d15/d16 39 2024-09-21T11:39:18.417 INFO:tasks.workunit.client.1.smithi149.stdout:0/692: read - dd/d1a/fcb zero size 2024-09-21T11:39:18.418 INFO:tasks.workunit.client.1.smithi149.stdout:5/813: symlink d4/d1d/d50/d54/l10a 0 2024-09-21T11:39:18.419 INFO:tasks.workunit.client.1.smithi149.stdout:1/679: symlink d2/dd/d35/d1c/d37/lde 0 2024-09-21T11:39:18.420 INFO:tasks.workunit.client.1.smithi149.stdout:1/680: read d2/dd/d35/d1c/d41/f49 [2293124,50947] 0 2024-09-21T11:39:18.421 INFO:tasks.workunit.client.1.smithi149.stdout:3/797: dread f3 [0,4194304] 0 2024-09-21T11:39:18.423 INFO:tasks.workunit.client.1.smithi149.stdout:1/681: truncate d2/dd/d35/d5b/f82 948602 0 2024-09-21T11:39:18.426 INFO:tasks.workunit.client.1.smithi149.stdout:5/814: rename d4/d1d/d3e/cc7 to d4/d7/d40/d51/c10b 0 2024-09-21T11:39:18.427 INFO:tasks.workunit.client.1.smithi149.stdout:6/676: symlink d8/da/d2c/d2d/d60/dc3/ldf 0 2024-09-21T11:39:18.428 INFO:tasks.workunit.client.1.smithi149.stdout:3/798: chown d6/d1f/d47/d22/d8d/fae 4181 1 2024-09-21T11:39:18.430 INFO:tasks.workunit.client.1.smithi149.stdout:1/682: creat d2/dd/d35/d1c/d7a/fdf x:0 0 0 2024-09-21T11:39:18.431 INFO:tasks.workunit.client.1.smithi149.stdout:5/815: mkdir d4/d1d/dde/d10c 0 2024-09-21T11:39:18.432 INFO:tasks.workunit.client.1.smithi149.stdout:4/774: write d4/d6/d63/d10/f86 [93057,110135] 0 2024-09-21T11:39:18.434 INFO:tasks.workunit.client.1.smithi149.stdout:1/683: mknod d2/dd/d35/d1c/d37/da3/ce0 0 2024-09-21T11:39:18.434 INFO:tasks.workunit.client.1.smithi149.stdout:3/799: fsync d6/d1f/d47/d37/dd6/fba 0 2024-09-21T11:39:18.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/693: write dd/d1a/d1b/d72/d85/f9a [65325,5994] 0 2024-09-21T11:39:18.438 INFO:tasks.workunit.client.1.smithi149.stdout:6/677: dwrite d8/da/d2c/fba [0,4194304] 0 2024-09-21T11:39:18.439 INFO:tasks.workunit.client.1.smithi149.stdout:4/775: truncate d4/d6/f5e 850255 0 2024-09-21T11:39:18.440 INFO:tasks.workunit.client.1.smithi149.stdout:3/800: stat d6/d5f/d60/d88/de7 0 2024-09-21T11:39:18.440 INFO:tasks.workunit.client.1.smithi149.stdout:1/684: chown d2/dd/d2e/f77 112 1 2024-09-21T11:39:18.441 INFO:tasks.workunit.client.1.smithi149.stdout:8/639: dread d3/d33/d34/d55/d5e/d9e/dc2/d18/f68 [4194304,4194304] 0 2024-09-21T11:39:18.449 INFO:tasks.workunit.client.1.smithi149.stdout:0/694: mknod dd/d1a/d5a/ce7 0 2024-09-21T11:39:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:18 smithi149 ceph-mon[36123]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 290 MiB/s wr, 498 op/s 2024-09-21T11:39:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:18 smithi149 ceph-mon[36123]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:18.450 INFO:tasks.workunit.client.1.smithi149.stdout:3/801: stat d6/d1f/d47/d37/d3f/dc5/de3 0 2024-09-21T11:39:18.450 INFO:tasks.workunit.client.1.smithi149.stdout:1/685: chown d2/dd/d35/d1c/d2c/f8b 14528139 1 2024-09-21T11:39:18.450 INFO:tasks.workunit.client.1.smithi149.stdout:6/678: symlink d8/da/d2c/d52/d5e/d9b/le0 0 2024-09-21T11:39:18.451 INFO:tasks.workunit.client.1.smithi149.stdout:2/873: dwrite d8/da/d13/d1a/d29/fa4 [0,4194304] 0 2024-09-21T11:39:18.453 INFO:tasks.workunit.client.1.smithi149.stdout:1/686: chown d2/dd/d35/f8d 19 1 2024-09-21T11:39:18.453 INFO:tasks.workunit.client.1.smithi149.stdout:5/816: dwrite d4/d1d/d50/d60/fb8 [0,4194304] 0 2024-09-21T11:39:18.456 INFO:tasks.workunit.client.1.smithi149.stdout:2/874: chown d8/d44/d63/fd5 93399984 1 2024-09-21T11:39:18.457 INFO:tasks.workunit.client.1.smithi149.stdout:8/640: getdents d3/d12/d6e/d79 0 2024-09-21T11:39:18.459 INFO:tasks.workunit.client.1.smithi149.stdout:6/679: creat d8/d32/d37/d28/d2f/d6a/d72/fe1 x:0 0 0 2024-09-21T11:39:18.459 INFO:tasks.workunit.client.1.smithi149.stdout:8/641: write d3/d33/fc4 [568378,30242] 0 2024-09-21T11:39:18.460 INFO:tasks.workunit.client.1.smithi149.stdout:1/687: creat d2/dd/d35/d5b/dc0/dc3/fe1 x:0 0 0 2024-09-21T11:39:18.461 INFO:tasks.workunit.client.1.smithi149.stdout:5/817: unlink d4/d1d/d50/d60/c74 0 2024-09-21T11:39:18.462 INFO:tasks.workunit.client.1.smithi149.stdout:8/642: fdatasync d3/d33/f9b 0 2024-09-21T11:39:18.464 INFO:tasks.workunit.client.1.smithi149.stdout:3/802: rename d6/d1f/de5 to d6/d5f/d60/d88/de7/d119 0 2024-09-21T11:39:18.466 INFO:tasks.workunit.client.1.smithi149.stdout:3/803: read - d6/d1f/d47/d37/dd6/fba zero size 2024-09-21T11:39:18.467 INFO:tasks.workunit.client.1.smithi149.stdout:1/688: mkdir d2/de2 0 2024-09-21T11:39:18.469 INFO:tasks.workunit.client.1.smithi149.stdout:5/818: symlink d4/d1d/l10d 0 2024-09-21T11:39:18.471 INFO:tasks.workunit.client.1.smithi149.stdout:5/819: fdatasync d4/d7/d40/d43/fe4 0 2024-09-21T11:39:18.473 INFO:tasks.workunit.client.1.smithi149.stdout:2/875: rename d8/dd/d8c/de0/fec to d8/da/d13/f12d 0 2024-09-21T11:39:18.474 INFO:tasks.workunit.client.1.smithi149.stdout:5/820: read - d4/d7/d40/d51/f5a zero size 2024-09-21T11:39:18.475 INFO:tasks.workunit.client.1.smithi149.stdout:8/643: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/f51 [0,4194304] 0 2024-09-21T11:39:18.475 INFO:tasks.workunit.client.1.smithi149.stdout:4/776: dread d4/f55 [0,4194304] 0 2024-09-21T11:39:18.475 INFO:tasks.workunit.client.1.smithi149.stdout:2/876: fsync d8/dcb/db8/dd3/fe3 0 2024-09-21T11:39:18.478 INFO:tasks.workunit.client.1.smithi149.stdout:4/777: write d4/d6/d63/d2d/dd6/fbc [766405,77546] 0 2024-09-21T11:39:18.478 INFO:tasks.workunit.client.1.smithi149.stdout:8/644: chown d3/d33/d34/d55/d5e/d9e/dc2/c27 387776 1 2024-09-21T11:39:18.480 INFO:tasks.workunit.client.1.smithi149.stdout:4/778: chown d4/d6/l51 190388 1 2024-09-21T11:39:18.482 INFO:tasks.workunit.client.1.smithi149.stdout:5/821: rename d4/d7/l87 to d4/d1d/d50/d54/d2a/l10e 0 2024-09-21T11:39:18.483 INFO:tasks.workunit.client.1.smithi149.stdout:2/877: dread d8/dd/d50/fd2 [0,4194304] 0 2024-09-21T11:39:18.485 INFO:tasks.workunit.client.1.smithi149.stdout:4/779: truncate d4/d6/d63/d15/f54 1831398 0 2024-09-21T11:39:18.486 INFO:tasks.workunit.client.1.smithi149.stdout:2/878: write d8/dcb/db8/dd3/fe3 [641554,39420] 0 2024-09-21T11:39:18.487 INFO:tasks.workunit.client.1.smithi149.stdout:5/822: write d4/d1d/d50/d54/f35 [5197593,58315] 0 2024-09-21T11:39:18.491 INFO:tasks.workunit.client.1.smithi149.stdout:8/645: rename d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/lcd to d3/d33/d34/d55/d5e/d9e/le1 0 2024-09-21T11:39:18.493 INFO:tasks.workunit.client.1.smithi149.stdout:2/879: rmdir d8/da/d13/d2d/d6f/de8 39 2024-09-21T11:39:18.497 INFO:tasks.workunit.client.1.smithi149.stdout:4/780: getdents d4/d6/d63/d10/d6f 0 2024-09-21T11:39:18.499 INFO:tasks.workunit.client.1.smithi149.stdout:1/689: dwrite d2/d5/d3d/d88/f42 [4194304,4194304] 0 2024-09-21T11:39:18.499 INFO:tasks.workunit.client.1.smithi149.stdout:3/804: dwrite d6/d1f/fb9 [0,4194304] 0 2024-09-21T11:39:18.501 INFO:tasks.workunit.client.1.smithi149.stdout:5/823: dread - d4/d1d/d50/d60/db1/db4/fd2 zero size 2024-09-21T11:39:18.501 INFO:tasks.workunit.client.1.smithi149.stdout:4/781: readlink d4/d6/d63/d10/l9f 0 2024-09-21T11:39:18.503 INFO:tasks.workunit.client.1.smithi149.stdout:1/690: write d2/d5/d8/fbf [252430,76443] 0 2024-09-21T11:39:18.506 INFO:tasks.workunit.client.1.smithi149.stdout:2/880: creat d8/da/f12e x:0 0 0 2024-09-21T11:39:18.510 INFO:tasks.workunit.client.1.smithi149.stdout:4/782: chown d4/d6/f5e 1250550 1 2024-09-21T11:39:18.512 INFO:tasks.workunit.client.1.smithi149.stdout:3/805: rename d6/d1f/c2f to d6/d1f/d27/d83/df2/c11a 0 2024-09-21T11:39:18.513 INFO:tasks.workunit.client.1.smithi149.stdout:1/691: dread d2/dd/d35/d5b/f82 [0,4194304] 0 2024-09-21T11:39:18.513 INFO:tasks.workunit.client.1.smithi149.stdout:8/646: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/fc5 [0,4194304] 0 2024-09-21T11:39:18.517 INFO:tasks.workunit.client.1.smithi149.stdout:2/881: unlink d8/da/d13/d5d/d6a/cf7 0 2024-09-21T11:39:18.521 INFO:tasks.workunit.client.1.smithi149.stdout:1/692: unlink d2/d5/d65/d96/fba 0 2024-09-21T11:39:18.521 INFO:tasks.workunit.client.1.smithi149.stdout:2/882: chown d8/dd/d5c/f76 810658 1 2024-09-21T11:39:18.522 INFO:tasks.workunit.client.1.smithi149.stdout:3/806: creat d6/d10e/f11b x:0 0 0 2024-09-21T11:39:18.526 INFO:tasks.workunit.client.1.smithi149.stdout:1/693: rmdir d2/dd/d35/d1c 39 2024-09-21T11:39:18.528 INFO:tasks.workunit.client.1.smithi149.stdout:2/883: creat d8/d20/d78/f12f x:0 0 0 2024-09-21T11:39:18.529 INFO:tasks.workunit.client.1.smithi149.stdout:7/827: sync 2024-09-21T11:39:18.530 INFO:tasks.workunit.client.1.smithi149.stdout:4/783: dwrite d4/d6/d63/d2d/dd6/d32/d4a/f85 [4194304,4194304] 0 2024-09-21T11:39:18.530 INFO:tasks.workunit.client.1.smithi149.stdout:2/884: chown d8/d44/d63 10 1 2024-09-21T11:39:18.532 INFO:tasks.workunit.client.1.smithi149.stdout:5/824: truncate d4/d1d/d50/d54/d2a/f34 4938610 0 2024-09-21T11:39:18.535 INFO:tasks.workunit.client.1.smithi149.stdout:8/647: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/fc0 [0,4194304] 0 2024-09-21T11:39:18.536 INFO:tasks.workunit.client.1.smithi149.stdout:4/784: write d4/d6/d63/d2d/dd6/f90 [4458484,39214] 0 2024-09-21T11:39:18.540 INFO:tasks.workunit.client.1.smithi149.stdout:3/807: dwrite d6/d1f/d47/d37/dd6/f109 [0,4194304] 0 2024-09-21T11:39:18.541 INFO:tasks.workunit.client.1.smithi149.stdout:5/825: rmdir d4/d7/d40/d43/d49/d88/de0 39 2024-09-21T11:39:18.548 INFO:tasks.workunit.client.1.smithi149.stdout:1/694: dwrite d2/dd/d35/d1c/d41/d51/fdc [0,4194304] 0 2024-09-21T11:39:18.550 INFO:tasks.workunit.client.1.smithi149.stdout:7/828: write d12/d5b/db5/dc5/de9/f96 [932411,23796] 0 2024-09-21T11:39:18.550 INFO:tasks.workunit.client.1.smithi149.stdout:3/808: dread - d6/d1f/d47/d37/f4a zero size 2024-09-21T11:39:18.550 INFO:tasks.workunit.client.1.smithi149.stdout:4/785: chown d4/d6/d63/d15/d16/d23/c3c 209042 1 2024-09-21T11:39:18.553 INFO:tasks.workunit.client.1.smithi149.stdout:5/826: unlink d4/d1d/d3e/d9a/f101 0 2024-09-21T11:39:18.555 INFO:tasks.workunit.client.1.smithi149.stdout:5/827: fdatasync d4/d7/f32 0 2024-09-21T11:39:18.559 INFO:tasks.workunit.client.1.smithi149.stdout:7/829: symlink d12/d5b/db5/dc5/de9/d4a/d9e/l103 0 2024-09-21T11:39:18.563 INFO:tasks.workunit.client.1.smithi149.stdout:7/830: mkdir d12/d5b/db5/dc5/de9/d4a/d104 0 2024-09-21T11:39:18.564 INFO:tasks.workunit.client.1.smithi149.stdout:1/695: link d2/d5/d65/l89 d2/dd/d35/d1c/d7a/le3 0 2024-09-21T11:39:18.565 INFO:tasks.workunit.client.1.smithi149.stdout:8/648: dread d3/d33/d34/fbe [0,4194304] 0 2024-09-21T11:39:18.565 INFO:tasks.workunit.client.1.smithi149.stdout:1/696: readlink d2/d5/d3d/d88/l3f 0 2024-09-21T11:39:18.568 INFO:tasks.workunit.client.1.smithi149.stdout:8/649: symlink d3/d33/le2 0 2024-09-21T11:39:18.570 INFO:tasks.workunit.client.1.smithi149.stdout:7/831: mkdir d12/d5b/db5/dc5/de9/db7/d105 0 2024-09-21T11:39:18.572 INFO:tasks.workunit.client.1.smithi149.stdout:8/650: write d3/d33/d34/d55/d5e/d9e/dc2/d18/f8c [325039,60769] 0 2024-09-21T11:39:18.573 INFO:tasks.workunit.client.1.smithi149.stdout:1/697: symlink d2/dd/d35/d1c/d41/d51/le4 0 2024-09-21T11:39:18.575 INFO:tasks.workunit.client.1.smithi149.stdout:1/698: fdatasync d2/d5/fab 0 2024-09-21T11:39:18.577 INFO:tasks.workunit.client.1.smithi149.stdout:5/828: dread d4/d7/d40/d43/d5c/f66 [0,4194304] 0 2024-09-21T11:39:18.577 INFO:tasks.workunit.client.1.smithi149.stdout:7/832: rename d12/d5b/db5/dc5/de9/l38 to d12/d5b/db5/dc5/de9/db8/l106 0 2024-09-21T11:39:18.579 INFO:tasks.workunit.client.1.smithi149.stdout:3/809: dwrite d6/f13 [0,4194304] 0 2024-09-21T11:39:18.583 INFO:tasks.workunit.client.1.smithi149.stdout:8/651: rename d3/f17 to d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/fe3 0 2024-09-21T11:39:18.588 INFO:tasks.workunit.client.1.smithi149.stdout:1/699: dwrite d2/d5/fc2 [4194304,4194304] 0 2024-09-21T11:39:18.591 INFO:tasks.workunit.client.1.smithi149.stdout:7/833: rename d12/d5b/db5/dc5/de9/d4a/fff to d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/f107 0 2024-09-21T11:39:18.595 INFO:tasks.workunit.client.1.smithi149.stdout:5/829: link d4/d7/d40/d43/d5c/d7a/d81/f8f d4/d7/d40/d43/d5c/d7a/d81/dea/f10f 0 2024-09-21T11:39:18.595 INFO:tasks.workunit.client.1.smithi149.stdout:3/810: write d6/d1f/d47/fb3 [4470472,62014] 0 2024-09-21T11:39:18.597 INFO:tasks.workunit.client.1.smithi149.stdout:1/700: chown d2/dd/d35/d5b/ld4 0 1 2024-09-21T11:39:18.597 INFO:tasks.workunit.client.1.smithi149.stdout:8/652: dread d3/d33/d34/d72/f9c [0,4194304] 0 2024-09-21T11:39:18.597 INFO:tasks.workunit.client.1.smithi149.stdout:7/834: rmdir d12/d5b/db5 39 2024-09-21T11:39:18.598 INFO:tasks.workunit.client.1.smithi149.stdout:1/701: fdatasync d2/d5/d8/fbf 0 2024-09-21T11:39:18.599 INFO:tasks.workunit.client.1.smithi149.stdout:5/830: mkdir d4/d4f/df4/d110 0 2024-09-21T11:39:18.601 INFO:tasks.workunit.client.1.smithi149.stdout:1/702: mknod d2/dd/d35/d1c/d41/d74/ce5 0 2024-09-21T11:39:18.604 INFO:tasks.workunit.client.1.smithi149.stdout:8/653: rename d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/c97 to d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/ce4 0 2024-09-21T11:39:18.604 INFO:tasks.workunit.client.1.smithi149.stdout:5/831: dread d4/d1d/d3e/f89 [0,4194304] 0 2024-09-21T11:39:18.604 INFO:tasks.workunit.client.1.smithi149.stdout:1/703: mknod d2/dd/d35/d1c/d41/d51/d73/ce6 0 2024-09-21T11:39:18.610 INFO:tasks.workunit.client.1.smithi149.stdout:5/832: creat d4/d90/ddd/d107/f111 x:0 0 0 2024-09-21T11:39:18.612 INFO:tasks.workunit.client.1.smithi149.stdout:5/833: symlink d4/d7/d40/d43/l112 0 2024-09-21T11:39:18.613 INFO:tasks.workunit.client.1.smithi149.stdout:7/835: truncate d12/f21 812473 0 2024-09-21T11:39:18.617 INFO:tasks.workunit.client.1.smithi149.stdout:5/834: link d4/d7/d40/d51/l62 d4/d7/d40/d43/d49/dd1/l113 0 2024-09-21T11:39:18.618 INFO:tasks.workunit.client.1.smithi149.stdout:7/836: getdents d12/d5b/db5/dc5/de9/d4a/d6c/d8c 0 2024-09-21T11:39:18.619 INFO:tasks.workunit.client.1.smithi149.stdout:5/835: creat d4/d7/dbd/f114 x:0 0 0 2024-09-21T11:39:18.620 INFO:tasks.workunit.client.1.smithi149.stdout:1/704: dread d2/f2d [0,4194304] 0 2024-09-21T11:39:18.620 INFO:tasks.workunit.client.1.smithi149.stdout:8/654: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f6b [0,4194304] 0 2024-09-21T11:39:18.620 INFO:tasks.workunit.client.1.smithi149.stdout:5/836: stat d4/d7/d40/c9c 0 2024-09-21T11:39:18.622 INFO:tasks.workunit.client.1.smithi149.stdout:5/837: write d4/ff3 [735928,113624] 0 2024-09-21T11:39:18.622 INFO:tasks.workunit.client.1.smithi149.stdout:7/837: creat d12/d5b/db5/dc5/de9/db8/f108 x:0 0 0 2024-09-21T11:39:18.624 INFO:tasks.workunit.client.1.smithi149.stdout:8/655: mkdir d3/d12/db1/de5 0 2024-09-21T11:39:18.626 INFO:tasks.workunit.client.1.smithi149.stdout:8/656: write d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fc6 [3953157,75375] 0 2024-09-21T11:39:18.627 INFO:tasks.workunit.client.1.smithi149.stdout:8/657: readlink d3/la8 0 2024-09-21T11:39:18.629 INFO:tasks.workunit.client.1.smithi149.stdout:8/658: chown d3/d12/d6e/d79/fbc 662664 1 2024-09-21T11:39:18.630 INFO:tasks.workunit.client.1.smithi149.stdout:5/838: dwrite d4/d7/d40/d43/d49/d88/dcd/ddf/fe5 [0,4194304] 0 2024-09-21T11:39:18.631 INFO:tasks.workunit.client.1.smithi149.stdout:8/659: dread d3/d33/d34/d55/d5e/d9e/dc2/d3a/f3d [0,4194304] 0 2024-09-21T11:39:18.632 INFO:tasks.workunit.client.1.smithi149.stdout:8/660: chown d3/d12/d6e/d79/lb3 87366 1 2024-09-21T11:39:18.633 INFO:tasks.workunit.client.1.smithi149.stdout:9/733: sync 2024-09-21T11:39:18.637 INFO:tasks.workunit.client.1.smithi149.stdout:5/839: creat d4/d7/d40/d43/d49/d88/de0/f115 x:0 0 0 2024-09-21T11:39:18.639 INFO:tasks.workunit.client.1.smithi149.stdout:9/734: creat d18/d36/d3c/d47/d76/d7c/fed x:0 0 0 2024-09-21T11:39:18.645 INFO:tasks.workunit.client.1.smithi149.stdout:9/735: getdents d18/d19/d1a 0 2024-09-21T11:39:18.648 INFO:tasks.workunit.client.1.smithi149.stdout:9/736: write d18/d19/d1a/d2f/d53/fe6 [151897,117102] 0 2024-09-21T11:39:18.648 INFO:tasks.workunit.client.1.smithi149.stdout:5/840: dread d4/d7/f38 [4194304,4194304] 0 2024-09-21T11:39:18.651 INFO:tasks.workunit.client.1.smithi149.stdout:5/841: write d4/d1d/fe3 [377459,11422] 0 2024-09-21T11:39:18.652 INFO:tasks.workunit.client.1.smithi149.stdout:8/661: dwrite d3/fa [0,4194304] 0 2024-09-21T11:39:18.653 INFO:tasks.workunit.client.1.smithi149.stdout:9/737: unlink d18/d19/d1a/d2f/d53/d64/f74 0 2024-09-21T11:39:18.658 INFO:tasks.workunit.client.1.smithi149.stdout:7/838: dread d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/f59 [0,4194304] 0 2024-09-21T11:39:18.658 INFO:tasks.workunit.client.1.smithi149.stdout:8/662: unlink d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/cc8 0 2024-09-21T11:39:18.662 INFO:tasks.workunit.client.1.smithi149.stdout:9/738: dwrite d18/d19/d29/f68 [0,4194304] 0 2024-09-21T11:39:18.662 INFO:tasks.workunit.client.1.smithi149.stdout:5/842: write d4/d7/d40/d43/d5c/f102 [1443242,120822] 0 2024-09-21T11:39:18.666 INFO:tasks.workunit.client.1.smithi149.stdout:9/739: write d18/d19/d29/d39/d63/fc8 [305011,70434] 0 2024-09-21T11:39:18.668 INFO:tasks.workunit.client.1.smithi149.stdout:5/843: fsync d4/d7/d40/d43/d5c/f66 0 2024-09-21T11:39:18.668 INFO:tasks.workunit.client.1.smithi149.stdout:8/663: write d3/d33/d34/d55/d5e/d9e/dc2/d3a/f3d [244594,76] 0 2024-09-21T11:39:18.672 INFO:tasks.workunit.client.1.smithi149.stdout:7/839: dwrite d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/fe0 [0,4194304] 0 2024-09-21T11:39:18.673 INFO:tasks.workunit.client.1.smithi149.stdout:9/740: mkdir d18/d19/d1a/d2f/d30/d54/da7/dee 0 2024-09-21T11:39:18.685 INFO:tasks.workunit.client.1.smithi149.stdout:9/741: dread - d18/d36/d3c/dcb/fd2 zero size 2024-09-21T11:39:18.687 INFO:tasks.workunit.client.1.smithi149.stdout:5/844: dwrite d4/d1d/d50/f7d [0,4194304] 0 2024-09-21T11:39:18.687 INFO:tasks.workunit.client.1.smithi149.stdout:8/664: dread d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f6b [0,4194304] 0 2024-09-21T11:39:18.688 INFO:tasks.workunit.client.1.smithi149.stdout:5/845: fsync d4/d1d/d50/d60/db1/db4/fd2 0 2024-09-21T11:39:18.690 INFO:tasks.workunit.client.1.smithi149.stdout:5/846: write d4/d7/d40/d43/f95 [271738,70352] 0 2024-09-21T11:39:18.696 INFO:tasks.workunit.client.1.smithi149.stdout:8/665: dwrite d3/d12/d6e/d79/fbc [0,4194304] 0 2024-09-21T11:39:18.698 INFO:tasks.workunit.client.1.smithi149.stdout:9/742: mknod d18/d19/d1a/d2f/d53/cef 0 2024-09-21T11:39:18.702 INFO:tasks.workunit.client.1.smithi149.stdout:7/840: mkdir d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d109 0 2024-09-21T11:39:18.703 INFO:tasks.workunit.client.1.smithi149.stdout:9/743: unlink f16 0 2024-09-21T11:39:18.705 INFO:tasks.workunit.client.1.smithi149.stdout:9/744: write d18/d4c/f67 [30177,87511] 0 2024-09-21T11:39:18.709 INFO:tasks.workunit.client.1.smithi149.stdout:9/745: link d18/d19/d1a/d2f/c42 d18/d36/d3c/cf0 0 2024-09-21T11:39:18.711 INFO:tasks.workunit.client.1.smithi149.stdout:9/746: mkdir d18/d19/d1a/df1 0 2024-09-21T11:39:18.721 INFO:tasks.workunit.client.1.smithi149.stdout:5/847: dread d4/d7/d40/d51/f8c [0,4194304] 0 2024-09-21T11:39:18.721 INFO:tasks.workunit.client.1.smithi149.stdout:9/747: read - d18/d19/d1a/d9b/fec zero size 2024-09-21T11:39:18.722 INFO:tasks.workunit.client.1.smithi149.stdout:6/680: sync 2024-09-21T11:39:18.722 INFO:tasks.workunit.client.1.smithi149.stdout:0/695: sync 2024-09-21T11:39:18.722 INFO:tasks.workunit.client.1.smithi149.stdout:8/666: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d3a/f63 [0,4194304] 0 2024-09-21T11:39:18.723 INFO:tasks.workunit.client.1.smithi149.stdout:6/681: readlink d8/da/d3d/l47 0 2024-09-21T11:39:18.725 INFO:tasks.workunit.client.1.smithi149.stdout:5/848: truncate d4/d1d/d50/d60/fb8 4805586 0 2024-09-21T11:39:18.729 INFO:tasks.workunit.client.1.smithi149.stdout:8/667: write d3/f7d [622933,69975] 0 2024-09-21T11:39:18.730 INFO:tasks.workunit.client.1.smithi149.stdout:6/682: creat d8/da/d2c/d52/d5e/d9b/fe2 x:0 0 0 2024-09-21T11:39:18.731 INFO:tasks.workunit.client.0.smithi118.stdout:1/222: sync 2024-09-21T11:39:18.733 INFO:tasks.workunit.client.1.smithi149.stdout:8/668: stat d3/d33/d34/d72/d83 0 2024-09-21T11:39:18.733 INFO:tasks.workunit.client.1.smithi149.stdout:5/849: dread d4/d7/d40/d43/d5c/fb0 [0,4194304] 0 2024-09-21T11:39:18.733 INFO:tasks.workunit.client.1.smithi149.stdout:6/683: stat d8/d32/d37/d2b/d7d/db8/dc4 0 2024-09-21T11:39:18.736 INFO:tasks.workunit.client.1.smithi149.stdout:8/669: readlink d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/l5f 0 2024-09-21T11:39:18.736 INFO:tasks.workunit.client.1.smithi149.stdout:0/696: dwrite dd/d1a/d1b/d72/d78/d8b/fae [0,4194304] 0 2024-09-21T11:39:18.737 INFO:tasks.workunit.client.1.smithi149.stdout:5/850: read d4/d1d/f6b [2442816,66238] 0 2024-09-21T11:39:18.738 INFO:tasks.workunit.client.1.smithi149.stdout:0/697: chown dd/d1a/d1b/d72/d85/fe2 4459226 1 2024-09-21T11:39:18.740 INFO:tasks.workunit.client.0.smithi118.stdout:1/223: dwrite d6/de/f27 [4194304,4194304] 0 2024-09-21T11:39:18.740 INFO:tasks.workunit.client.1.smithi149.stdout:5/851: stat d4/d1d/f6f 0 2024-09-21T11:39:18.740 INFO:tasks.workunit.client.1.smithi149.stdout:8/670: readlink d3/d33/d34/d55/d5e/d9e/dc2/d18/l22 0 2024-09-21T11:39:18.741 INFO:tasks.workunit.client.0.smithi118.stdout:1/224: write d6/de/f1a [744047,33062] 0 2024-09-21T11:39:18.743 INFO:tasks.workunit.client.1.smithi149.stdout:0/698: write dd/d1a/d1b/d72/dc1/fdd [466452,111081] 0 2024-09-21T11:39:18.743 INFO:tasks.workunit.client.1.smithi149.stdout:9/748: dread d18/d19/d1a/f26 [0,4194304] 0 2024-09-21T11:39:18.745 INFO:tasks.workunit.client.0.smithi118.stdout:1/225: creat d6/d1f/d32/f48 x:0 0 0 2024-09-21T11:39:18.748 INFO:tasks.workunit.client.1.smithi149.stdout:5/852: mkdir d4/d7/d40/d43/d49/d88/d116 0 2024-09-21T11:39:18.749 INFO:tasks.workunit.client.0.smithi118.stdout:1/226: mknod d6/d3b/d45/c49 0 2024-09-21T11:39:18.749 INFO:tasks.workunit.client.1.smithi149.stdout:6/684: dwrite d8/d32/d37/d2b/d7d/fa0 [0,4194304] 0 2024-09-21T11:39:18.750 INFO:tasks.workunit.client.1.smithi149.stdout:5/853: stat d4/fee 0 2024-09-21T11:39:18.751 INFO:tasks.workunit.client.1.smithi149.stdout:9/749: stat d18/d19/l61 0 2024-09-21T11:39:18.754 INFO:tasks.workunit.client.1.smithi149.stdout:0/699: unlink dd/d1a/d1b/d72/d78/dbb/fe1 0 2024-09-21T11:39:18.754 INFO:tasks.workunit.client.1.smithi149.stdout:6/685: rename d8/d32/d37/d28 to d8/d32/d37/d28/d87/da4/de3 22 2024-09-21T11:39:18.754 INFO:tasks.workunit.client.1.smithi149.stdout:5/854: truncate d4/d1d/d50/d54/d2a/fe7 4273045 0 2024-09-21T11:39:18.755 INFO:tasks.workunit.client.1.smithi149.stdout:6/686: readlink d8/da/l12 0 2024-09-21T11:39:18.758 INFO:tasks.workunit.client.1.smithi149.stdout:5/855: mkdir d4/d1d/d50/dc8/d117 0 2024-09-21T11:39:18.760 INFO:tasks.workunit.client.1.smithi149.stdout:0/700: creat dd/d32/fe8 x:0 0 0 2024-09-21T11:39:18.761 INFO:tasks.workunit.client.1.smithi149.stdout:9/750: creat d18/d36/d3c/d47/d99/ff2 x:0 0 0 2024-09-21T11:39:18.763 INFO:tasks.workunit.client.1.smithi149.stdout:6/687: dwrite d8/d32/d37/f19 [0,4194304] 0 2024-09-21T11:39:18.764 INFO:tasks.workunit.client.1.smithi149.stdout:9/751: read d18/d4c/d5b/f9a [225962,11354] 0 2024-09-21T11:39:18.766 INFO:tasks.workunit.client.1.smithi149.stdout:0/701: truncate dd/d32/fa7 999888 0 2024-09-21T11:39:18.769 INFO:tasks.workunit.client.1.smithi149.stdout:8/671: dread d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f71 [0,4194304] 0 2024-09-21T11:39:18.770 INFO:tasks.workunit.client.1.smithi149.stdout:6/688: rename d8/d32/d37/d28/d2e/f66 to d8/d32/d37/dd7/fe4 0 2024-09-21T11:39:18.770 INFO:tasks.workunit.client.1.smithi149.stdout:6/689: fdatasync d8/d32/d37/d2b/d7e/f86 0 2024-09-21T11:39:18.775 INFO:tasks.workunit.client.1.smithi149.stdout:6/690: symlink d8/d32/d37/le5 0 2024-09-21T11:39:18.775 INFO:tasks.workunit.client.0.smithi118.stdout:1/227: truncate d6/d2a/f23 1036320 0 2024-09-21T11:39:18.776 INFO:tasks.workunit.client.0.smithi118.stdout:1/228: dread - d6/d33/d3c/f40 zero size 2024-09-21T11:39:18.777 INFO:tasks.workunit.client.1.smithi149.stdout:8/672: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fc6 [4194304,4194304] 0 2024-09-21T11:39:18.777 INFO:tasks.workunit.client.0.smithi118.stdout:1/229: write f1 [4325160,26689] 0 2024-09-21T11:39:18.779 INFO:tasks.workunit.client.0.smithi118.stdout:1/230: mknod d6/d1f/c4a 0 2024-09-21T11:39:18.782 INFO:tasks.workunit.client.0.smithi118.stdout:1/231: creat d6/de/d16/f4b x:0 0 0 2024-09-21T11:39:18.783 INFO:tasks.workunit.client.1.smithi149.stdout:5/856: truncate d4/d7/d40/d43/d49/f78 3091082 0 2024-09-21T11:39:18.783 INFO:tasks.workunit.client.0.smithi118.stdout:1/232: write d6/de/f27 [9199996,58643] 0 2024-09-21T11:39:18.785 INFO:tasks.workunit.client.1.smithi149.stdout:1/705: sync 2024-09-21T11:39:18.786 INFO:tasks.workunit.client.1.smithi149.stdout:2/885: sync 2024-09-21T11:39:18.786 INFO:tasks.workunit.client.1.smithi149.stdout:4/786: sync 2024-09-21T11:39:18.786 INFO:tasks.workunit.client.1.smithi149.stdout:3/811: sync 2024-09-21T11:39:18.788 INFO:tasks.workunit.client.0.smithi118.stdout:1/233: mknod d6/d1f/c4c 0 2024-09-21T11:39:18.788 INFO:tasks.workunit.client.0.smithi118.stdout:1/234: fsync d6/de/f1a 0 2024-09-21T11:39:18.789 INFO:tasks.workunit.client.1.smithi149.stdout:0/702: write dd/d1a/f44 [208883,84732] 0 2024-09-21T11:39:18.790 INFO:tasks.workunit.client.1.smithi149.stdout:1/706: write d2/d5/d8/fa4 [2764584,89095] 0 2024-09-21T11:39:18.792 INFO:tasks.workunit.client.0.smithi118.stdout:1/235: rename d6/f1e to d6/de/d16/d3f/f4d 0 2024-09-21T11:39:18.794 INFO:tasks.workunit.client.1.smithi149.stdout:4/787: write d4/d6/d63/d15/d30/d8a/fdf [13817,97283] 0 2024-09-21T11:39:18.795 INFO:tasks.workunit.client.0.smithi118.stdout:1/236: truncate d6/de/d13/f1c 300700 0 2024-09-21T11:39:18.795 INFO:tasks.workunit.client.1.smithi149.stdout:3/812: creat d6/d1f/d47/d37/d3a/d107/f11c x:0 0 0 2024-09-21T11:39:18.799 INFO:tasks.workunit.client.1.smithi149.stdout:4/788: stat d4/d6/d63/d2d/dd6/d32/d4a/c95 0 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.797+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0668062df0 con 0x7f0668100200 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.797+0000 7f065ffff640 1 -- 172.21.15.118:0/3265159410 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f0658066d60 con 0x7f0668100200 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:39:18.800 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:39:18.801 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:39:18.801 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:39:18.801 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:39:18.801 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:39:18.801 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:39:18.801 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T11:39:18.801 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T11:39:18.801 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:39:18.801 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:39:18.801 INFO:tasks.workunit.client.1.smithi149.stdout:9/752: dread d18/d19/d29/d39/f69 [0,4194304] 0 2024-09-21T11:39:18.803 INFO:tasks.workunit.client.1.smithi149.stdout:3/813: read d6/d1f/fc2 [73949,34226] 0 2024-09-21T11:39:18.803 INFO:tasks.workunit.client.1.smithi149.stdout:9/753: chown d18/d36/d3c/d47/d76/d7c/fed 59823445 1 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f064c074a80 msgr2=0x7f064c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f064c074a80 0x7f064c076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f06540058d0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100200 msgr2=0x7f066819dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100200 0x7f066819dac0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f065800e970 tx=0x7f065800ed70 comp rx=0 tx=0).stop 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 shutdown_connections 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f064c074a80 0x7f064c076f40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0668100b40 0x7f066819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 --2- 172.21.15.118:0/3265159410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0668100200 0x7f066819dac0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 >> 172.21.15.118:0/3265159410 conn(0x7f06680fbff0 msgr2=0x7f0668108ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 shutdown_connections 2024-09-21T11:39:18.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.801+0000 7f066d0ac640 1 -- 172.21.15.118:0/3265159410 wait complete. 2024-09-21T11:39:18.805 INFO:tasks.workunit.client.1.smithi149.stdout:2/886: dread d8/d44/fbe [0,4194304] 0 2024-09-21T11:39:18.805 INFO:tasks.workunit.client.1.smithi149.stdout:1/707: symlink d2/dd/d35/d7c/le7 0 2024-09-21T11:39:18.806 INFO:tasks.workunit.client.1.smithi149.stdout:4/789: symlink d4/d6/d63/d78/d98/dcc/l10a 0 2024-09-21T11:39:18.806 INFO:tasks.workunit.client.1.smithi149.stdout:6/691: dread d8/da/d2c/d52/f5c [0,4194304] 0 2024-09-21T11:39:18.809 INFO:tasks.workunit.client.1.smithi149.stdout:3/814: truncate d6/d1f/d47/f52 296906 0 2024-09-21T11:39:18.809 INFO:tasks.workunit.client.1.smithi149.stdout:8/673: dread d3/d3c/d8f/f7a [0,4194304] 0 2024-09-21T11:39:18.810 INFO:tasks.workunit.client.1.smithi149.stdout:2/887: fsync d8/dd/f9c 0 2024-09-21T11:39:18.812 INFO:tasks.workunit.client.1.smithi149.stdout:6/692: unlink d8/da/f4e 0 2024-09-21T11:39:18.813 INFO:tasks.workunit.client.1.smithi149.stdout:4/790: symlink d4/d6/d63/d15/d30/d8a/da7/l10b 0 2024-09-21T11:39:18.817 INFO:tasks.workunit.client.1.smithi149.stdout:1/708: dwrite d2/d5/d8/fbf [0,4194304] 0 2024-09-21T11:39:18.819 INFO:tasks.workunit.client.1.smithi149.stdout:5/857: dread d4/d1d/d50/d54/d2a/fe7 [0,4194304] 0 2024-09-21T11:39:18.819 INFO:tasks.workunit.client.1.smithi149.stdout:2/888: mknod d8/d20/d57/dda/c130 0 2024-09-21T11:39:18.822 INFO:tasks.workunit.client.1.smithi149.stdout:0/703: truncate f8 2558220 0 2024-09-21T11:39:18.825 INFO:tasks.workunit.client.1.smithi149.stdout:8/674: mknod d3/d33/d34/d72/dbb/dda/ce6 0 2024-09-21T11:39:18.825 INFO:tasks.workunit.client.1.smithi149.stdout:8/675: chown d3/d33 978 1 2024-09-21T11:39:18.827 INFO:tasks.workunit.client.1.smithi149.stdout:8/676: fdatasync d3/d12/d6e/f94 0 2024-09-21T11:39:18.827 INFO:tasks.workunit.client.1.smithi149.stdout:7/841: sync 2024-09-21T11:39:18.829 INFO:tasks.workunit.client.1.smithi149.stdout:8/677: write d3/d33/d34/d55/d5e/d9e/dc2/d3a/f3d [1160231,88121] 0 2024-09-21T11:39:18.829 INFO:tasks.workunit.client.1.smithi149.stdout:1/709: creat d2/d2b/d6e/fe8 x:0 0 0 2024-09-21T11:39:18.830 INFO:tasks.workunit.client.1.smithi149.stdout:9/754: dread d18/d19/d1a/d2f/d33/d91/f96 [0,4194304] 0 2024-09-21T11:39:18.832 INFO:tasks.workunit.client.1.smithi149.stdout:1/710: readlink d2/dd/d35/d1c/d41/d74/lac 0 2024-09-21T11:39:18.832 INFO:tasks.workunit.client.1.smithi149.stdout:6/693: rename d8/d32/d37/d28/d87/cc6 to d8/d32/d37/d28/dc8/ce6 0 2024-09-21T11:39:18.833 INFO:tasks.workunit.client.1.smithi149.stdout:5/858: creat d4/d1d/d50/dc8/f118 x:0 0 0 2024-09-21T11:39:18.834 INFO:tasks.workunit.client.1.smithi149.stdout:1/711: write d2/d5/d8/fbf [479163,66853] 0 2024-09-21T11:39:18.835 INFO:tasks.workunit.client.1.smithi149.stdout:4/791: mkdir d4/d6/d63/d15/d30/d8a/da7/dfb/d10c 0 2024-09-21T11:39:18.836 INFO:tasks.workunit.client.1.smithi149.stdout:3/815: dread d6/f38 [0,4194304] 0 2024-09-21T11:39:18.838 INFO:tasks.workunit.client.1.smithi149.stdout:4/792: write d4/d4d/d5f/ffe [884504,81608] 0 2024-09-21T11:39:18.838 INFO:tasks.workunit.client.1.smithi149.stdout:7/842: stat d12/f21 0 2024-09-21T11:39:18.838 INFO:tasks.workunit.client.0.smithi118.stdout:1/237: write d6/de/d13/f1c [666113,16448] 0 2024-09-21T11:39:18.839 INFO:tasks.workunit.client.0.smithi118.stdout:1/238: readlink d6/l7 0 2024-09-21T11:39:18.840 INFO:tasks.workunit.client.1.smithi149.stdout:9/755: dwrite d18/d19/d1a/d2f/d30/d90/f9d [0,4194304] 0 2024-09-21T11:39:18.840 INFO:tasks.workunit.client.1.smithi149.stdout:4/793: write d4/d6/d63/d15/fdd [97133,91178] 0 2024-09-21T11:39:18.841 INFO:tasks.workunit.client.1.smithi149.stdout:8/678: creat d3/d33/d34/d72/dbb/dda/fe7 x:0 0 0 2024-09-21T11:39:18.842 INFO:tasks.workunit.client.1.smithi149.stdout:9/756: dread - d18/d4c/d5b/fd0 zero size 2024-09-21T11:39:18.843 INFO:tasks.workunit.client.0.smithi118.stdout:1/239: symlink d6/d1f/l4e 0 2024-09-21T11:39:18.846 INFO:tasks.workunit.client.1.smithi149.stdout:9/757: write d18/d36/d3c/d47/d99/dbe/fde [848627,102549] 0 2024-09-21T11:39:18.846 INFO:tasks.workunit.client.1.smithi149.stdout:4/794: truncate d4/d6/d63/d2d/dd6/d32/fa4 733596 0 2024-09-21T11:39:18.849 INFO:tasks.workunit.client.1.smithi149.stdout:2/889: rename d8/da/d13/d1a/d29/f69 to d8/d44/d63/db9/d117/f131 0 2024-09-21T11:39:18.850 INFO:tasks.workunit.client.0.smithi118.stdout:1/240: dwrite d6/de/f1a [0,4194304] 0 2024-09-21T11:39:18.852 INFO:tasks.workunit.client.0.smithi118.stdout:1/241: read - d6/de/d16/f4b zero size 2024-09-21T11:39:18.854 INFO:tasks.workunit.client.1.smithi149.stdout:6/694: symlink d8/d32/d37/d28/d2f/le7 0 2024-09-21T11:39:18.857 INFO:tasks.workunit.client.1.smithi149.stdout:5/859: creat d4/d7/d40/d43/d49/dd1/f119 x:0 0 0 2024-09-21T11:39:18.858 INFO:tasks.workunit.client.1.smithi149.stdout:1/712: read d2/dd/d35/f8d [39361,66333] 0 2024-09-21T11:39:18.861 INFO:tasks.workunit.client.1.smithi149.stdout:3/816: mknod d6/d1f/d47/d37/d3f/c11d 0 2024-09-21T11:39:18.863 INFO:tasks.workunit.client.1.smithi149.stdout:8/679: dwrite d3/d33/d34/d72/dbb/dda/fe7 [0,4194304] 0 2024-09-21T11:39:18.865 INFO:tasks.workunit.client.1.smithi149.stdout:9/758: dread d18/d19/d29/f68 [0,4194304] 0 2024-09-21T11:39:18.866 INFO:tasks.workunit.client.1.smithi149.stdout:0/704: creat dd/d1a/d5a/fe9 x:0 0 0 2024-09-21T11:39:18.868 INFO:tasks.workunit.client.1.smithi149.stdout:2/890: dwrite d8/dd/d5c/d60/d67/d8a/fa6 [0,4194304] 0 2024-09-21T11:39:18.870 INFO:tasks.workunit.client.1.smithi149.stdout:7/843: dread d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f3f [0,4194304] 0 2024-09-21T11:39:18.871 INFO:tasks.workunit.client.1.smithi149.stdout:8/680: chown d3/d3c/d8f/d76/c99 94 1 2024-09-21T11:39:18.872 INFO:tasks.workunit.client.1.smithi149.stdout:8/681: stat d3/d33/fc4 0 2024-09-21T11:39:18.872 INFO:tasks.workunit.client.1.smithi149.stdout:9/759: read d18/d19/f20 [2993929,87855] 0 2024-09-21T11:39:18.872 INFO:tasks.workunit.client.1.smithi149.stdout:3/817: symlink d6/d1f/d47/d37/dd6/d96/l11e 0 2024-09-21T11:39:18.875 INFO:tasks.workunit.client.1.smithi149.stdout:5/860: mkdir d4/d7/d40/d51/def/d11a 0 2024-09-21T11:39:18.877 INFO:tasks.workunit.client.1.smithi149.stdout:3/818: chown d6/d1f/d47/dce/lda 38849 1 2024-09-21T11:39:18.877 INFO:tasks.workunit.client.1.smithi149.stdout:2/891: mkdir d8/d44/d132 0 2024-09-21T11:39:18.878 INFO:tasks.workunit.client.1.smithi149.stdout:8/682: creat d3/d12/d6e/d79/fe8 x:0 0 0 2024-09-21T11:39:18.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/760: unlink d18/d36/l6f 0 2024-09-21T11:39:18.879 INFO:tasks.workunit.client.1.smithi149.stdout:6/695: creat d8/da/fe8 x:0 0 0 2024-09-21T11:39:18.879 INFO:tasks.workunit.client.1.smithi149.stdout:7/844: mknod d12/d5b/db5/dc5/de9/d68/dc4/d30/c10a 0 2024-09-21T11:39:18.880 INFO:tasks.workunit.client.1.smithi149.stdout:3/819: mknod d6/d1f/d27/d83/df2/c11f 0 2024-09-21T11:39:18.882 INFO:tasks.workunit.client.1.smithi149.stdout:2/892: creat d8/d20/d78/d7c/f133 x:0 0 0 2024-09-21T11:39:18.882 INFO:tasks.workunit.client.1.smithi149.stdout:5/861: write d4/d7/d40/d43/d85/dce/ff5 [319960,52396] 0 2024-09-21T11:39:18.886 INFO:tasks.workunit.client.1.smithi149.stdout:9/761: read d18/d19/d1a/f2d [3636708,1466] 0 2024-09-21T11:39:18.886 INFO:tasks.workunit.client.1.smithi149.stdout:0/705: dwrite dd/d2d/f4b [4194304,4194304] 0 2024-09-21T11:39:18.887 INFO:tasks.workunit.client.1.smithi149.stdout:2/893: stat d8/da/d13/d83 0 2024-09-21T11:39:18.887 INFO:tasks.workunit.client.1.smithi149.stdout:6/696: mknod d8/da/d2c/d52/d5e/d9b/ce9 0 2024-09-21T11:39:18.887 INFO:tasks.workunit.client.1.smithi149.stdout:7/845: fdatasync d12/d5b/db5/dc5/de9/d4a/d9e/fcf 0 2024-09-21T11:39:18.891 INFO:tasks.workunit.client.1.smithi149.stdout:9/762: dread - d18/d36/d3c/dcb/fd2 zero size 2024-09-21T11:39:18.892 INFO:tasks.workunit.client.1.smithi149.stdout:3/820: truncate d6/d1f/d47/d37/f7b 1620967 0 2024-09-21T11:39:18.893 INFO:tasks.workunit.client.1.smithi149.stdout:6/697: truncate d8/da/d3d/fdb 3993680 0 2024-09-21T11:39:18.894 INFO:tasks.workunit.client.1.smithi149.stdout:0/706: rename dd/d32/db2/ld0 to dd/d1a/lea 0 2024-09-21T11:39:18.897 INFO:tasks.workunit.client.1.smithi149.stdout:7/846: creat d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f10b x:0 0 0 2024-09-21T11:39:18.900 INFO:tasks.workunit.client.1.smithi149.stdout:2/894: dwrite d8/d20/d78/f12f [0,4194304] 0 2024-09-21T11:39:18.901 INFO:tasks.workunit.client.1.smithi149.stdout:5/862: dread d4/d4f/f7f [0,4194304] 0 2024-09-21T11:39:18.901 INFO:tasks.workunit.client.1.smithi149.stdout:9/763: creat d18/d19/d1a/d2f/d7d/de0/ff3 x:0 0 0 2024-09-21T11:39:18.902 INFO:tasks.workunit.client.1.smithi149.stdout:6/698: getdents d8/da/d2c/d52 0 2024-09-21T11:39:18.903 INFO:tasks.workunit.client.1.smithi149.stdout:7/847: write d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/ff2 [3874544,105894] 0 2024-09-21T11:39:18.906 INFO:tasks.workunit.client.1.smithi149.stdout:9/764: chown d18/d19/d1a/d2f/d5f/ca0 252 1 2024-09-21T11:39:18.906 INFO:tasks.workunit.client.1.smithi149.stdout:3/821: dwrite d6/d79/d7e/ddd/fe8 [0,4194304] 0 2024-09-21T11:39:18.907 INFO:tasks.workunit.client.1.smithi149.stdout:6/699: unlink d8/da/fe8 0 2024-09-21T11:39:18.908 INFO:tasks.workunit.client.1.smithi149.stdout:7/848: dread - d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/ff1 zero size 2024-09-21T11:39:18.911 INFO:tasks.workunit.client.1.smithi149.stdout:6/700: creat d8/d32/d37/dd7/fea x:0 0 0 2024-09-21T11:39:18.912 INFO:tasks.workunit.client.1.smithi149.stdout:5/863: dread d4/d1d/d50/d54/d2a/f4d [0,4194304] 0 2024-09-21T11:39:18.913 INFO:tasks.workunit.client.1.smithi149.stdout:5/864: stat d4/d1d/d50/d60/cc2 0 2024-09-21T11:39:18.914 INFO:tasks.workunit.client.1.smithi149.stdout:9/765: rename d18/d19/d1a/d2f/d33/d91/f96 to d18/d19/d1a/d2f/d30/d54/da7/ff4 0 2024-09-21T11:39:18.914 INFO:tasks.workunit.client.1.smithi149.stdout:7/849: rmdir d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94 39 2024-09-21T11:39:18.917 INFO:tasks.workunit.client.1.smithi149.stdout:6/701: rename d8/da/d2c/d52/d5e/cc2 to d8/d32/d37/d28/d2f/ceb 0 2024-09-21T11:39:18.918 INFO:tasks.workunit.client.1.smithi149.stdout:5/865: creat d4/d1d/d3e/d9a/f11b x:0 0 0 2024-09-21T11:39:18.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/850: rmdir d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94 39 2024-09-21T11:39:18.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.920+0000 7f4cb3838640 1 -- 172.21.15.118:0/1079641302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 msgr2=0x7f4cac100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:18.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.920+0000 7f4cb3838640 1 --2- 172.21.15.118:0/1079641302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 0x7f4cac100040 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009880 tx=0x7f4ca802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.920+0000 7f4cb3838640 1 -- 172.21.15.118:0/1079641302 shutdown_connections 2024-09-21T11:39:18.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.920+0000 7f4cb3838640 1 --2- 172.21.15.118:0/1079641302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac102c20 0x7f4cac1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.920+0000 7f4cb3838640 1 --2- 172.21.15.118:0/1079641302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 0x7f4cac100040 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.920+0000 7f4cb3838640 1 -- 172.21.15.118:0/1079641302 >> 172.21.15.118:0/1079641302 conn(0x7f4cac0fb790 msgr2=0x7f4cac0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:18.923 INFO:tasks.workunit.client.1.smithi149.stdout:6/702: creat d8/d32/d37/d2b/d51/da7/fec x:0 0 0 2024-09-21T11:39:18.923 INFO:tasks.workunit.client.1.smithi149.stdout:9/766: dwrite d18/d19/d1a/d2f/d53/fc2 [0,4194304] 0 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.920+0000 7f4cb3838640 1 -- 172.21.15.118:0/1079641302 shutdown_connections 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.920+0000 7f4cb3838640 1 -- 172.21.15.118:0/1079641302 wait complete. 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb3838640 1 Processor -- start 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb3838640 1 -- start start 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb3838640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 0x7f4cac102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb3838640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac102c20 0x7f4cac100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb3838640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac10a7a0 con 0x7f4cac0ffc40 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb3838640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac10a620 con 0x7f4cac102c20 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb15d4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 0x7f4cac102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb15d4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 0x7f4cac102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44918/0 (socket says 172.21.15.118:44918) 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb15d4640 1 -- 172.21.15.118:0/3309522759 learned_addr learned my addr 172.21.15.118:0/3309522759 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:18.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.921+0000 7f4cb0dd3640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac102c20 0x7f4cac100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:18.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.922+0000 7f4cb15d4640 1 -- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac102c20 msgr2=0x7f4cac100bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:18.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.922+0000 7f4cb15d4640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac102c20 0x7f4cac100bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:18.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.922+0000 7f4cb15d4640 1 -- 172.21.15.118:0/3309522759 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac101110 con 0x7f4cac0ffc40 2024-09-21T11:39:18.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.922+0000 7f4cb15d4640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 0x7f4cac102510 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8006010 tx=0x7f4ca80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:18.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.922+0000 7f4ca27fc640 1 -- 172.21.15.118:0/3309522759 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ca803f070 con 0x7f4cac0ffc40 2024-09-21T11:39:18.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.922+0000 7f4ca27fc640 1 -- 172.21.15.118:0/3309522759 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ca8004a50 con 0x7f4cac0ffc40 2024-09-21T11:39:18.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.922+0000 7f4ca27fc640 1 -- 172.21.15.118:0/3309522759 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ca8035030 con 0x7f4cac0ffc40 2024-09-21T11:39:18.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.922+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cac1013a0 con 0x7f4cac0ffc40 2024-09-21T11:39:18.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.922+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cac1018d0 con 0x7f4cac0ffc40 2024-09-21T11:39:18.927 INFO:tasks.workunit.client.1.smithi149.stdout:6/703: symlink d8/d32/d37/d28/d2e/led 0 2024-09-21T11:39:18.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.923+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cac100040 con 0x7f4cac0ffc40 2024-09-21T11:39:18.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.924+0000 7f4ca27fc640 1 -- 172.21.15.118:0/3309522759 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f4ca8042070 con 0x7f4cac0ffc40 2024-09-21T11:39:18.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.925+0000 7f4ca27fc640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f4c98074a80 0x7f4c98076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:18.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.925+0000 7f4ca27fc640 1 -- 172.21.15.118:0/3309522759 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f4ca80b7230 con 0x7f4cac0ffc40 2024-09-21T11:39:18.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.925+0000 7f4cb0dd3640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f4c98074a80 0x7f4c98076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:18.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.926+0000 7f4cb0dd3640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f4c98074a80 0x7f4c98076f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c005fd0 tx=0x7f4c9c005850 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:18.929 INFO:tasks.workunit.client.1.smithi149.stdout:3/822: dread d6/d79/d7e/fdf [0,4194304] 0 2024-09-21T11:39:18.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:18.928+0000 7f4ca27fc640 1 -- 172.21.15.118:0/3309522759 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f4ca8004c00 con 0x7f4cac0ffc40 2024-09-21T11:39:18.934 INFO:tasks.workunit.client.1.smithi149.stdout:7/851: dwrite d12/d5b/db5/dc5/de9/fd4 [0,4194304] 0 2024-09-21T11:39:18.936 INFO:tasks.workunit.client.1.smithi149.stdout:6/704: link d8/d32/d37/d28/d2e/c34 d8/d32/d37/d2b/d7d/cee 0 2024-09-21T11:39:18.936 INFO:tasks.workunit.client.1.smithi149.stdout:9/767: dwrite d18/d19/d1a/d2f/faa [0,4194304] 0 2024-09-21T11:39:18.939 INFO:tasks.workunit.client.1.smithi149.stdout:7/852: chown d12/d5b/db5/dc5/de9/d4a/d6c/db1/de1 122973 1 2024-09-21T11:39:18.940 INFO:tasks.workunit.client.1.smithi149.stdout:9/768: write d18/d1c/f4e [89638,88278] 0 2024-09-21T11:39:18.940 INFO:tasks.workunit.client.1.smithi149.stdout:5/866: dread d4/d7/d40/f53 [0,4194304] 0 2024-09-21T11:39:18.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/705: creat d8/d32/d37/dd7/fef x:0 0 0 2024-09-21T11:39:18.948 INFO:tasks.workunit.client.1.smithi149.stdout:9/769: mkdir d18/d19/d1a/df1/df5 0 2024-09-21T11:39:18.950 INFO:tasks.workunit.client.1.smithi149.stdout:3/823: dwrite d6/d1f/d47/d37/d3a/d107/f11c [0,4194304] 0 2024-09-21T11:39:18.951 INFO:tasks.workunit.client.1.smithi149.stdout:5/867: symlink d4/d7/d40/d43/d49/d88/dcd/l11c 0 2024-09-21T11:39:18.954 INFO:tasks.workunit.client.1.smithi149.stdout:5/868: truncate d4/d7/d40/d43/d49/f76 1402149 0 2024-09-21T11:39:18.954 INFO:tasks.workunit.client.1.smithi149.stdout:7/853: link d12/d5b/db5/dc5/de9/f1f d12/d5b/db5/dc5/de9/d68/f10c 0 2024-09-21T11:39:18.955 INFO:tasks.workunit.client.1.smithi149.stdout:5/869: stat d4/d7/d40/d51/f8c 0 2024-09-21T11:39:18.956 INFO:tasks.workunit.client.1.smithi149.stdout:3/824: creat d6/d1f/d47/d37/d3a/d95/f120 x:0 0 0 2024-09-21T11:39:18.956 INFO:tasks.workunit.client.1.smithi149.stdout:5/870: write d4/d1d/d50/d60/fb8 [4993604,72590] 0 2024-09-21T11:39:18.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/871: rmdir d4/d7/d40/d43/d49/d88 39 2024-09-21T11:39:18.962 INFO:tasks.workunit.client.1.smithi149.stdout:5/872: getdents d4 0 2024-09-21T11:39:18.968 INFO:tasks.workunit.client.1.smithi149.stdout:5/873: dwrite d4/ff3 [0,4194304] 0 2024-09-21T11:39:18.974 INFO:tasks.workunit.client.1.smithi149.stdout:5/874: mknod d4/d7/d40/d43/d85/dce/c11d 0 2024-09-21T11:39:18.991 INFO:tasks.workunit.client.1.smithi149.stdout:1/713: truncate d2/d5/d3d/f72 3871509 0 2024-09-21T11:39:18.993 INFO:tasks.workunit.client.0.smithi118.stdout:1/242: dwrite d6/d33/f44 [0,4194304] 0 2024-09-21T11:39:18.998 INFO:tasks.workunit.client.1.smithi149.stdout:1/714: creat d2/d5/d65/fe9 x:0 0 0 2024-09-21T11:39:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:4/795: dread d4/d6/d63/fc5 [0,4194304] 0 2024-09-21T11:39:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:4/796: dread - d4/d4d/d5f/f94 zero size 2024-09-21T11:39:19.002 INFO:tasks.workunit.client.1.smithi149.stdout:8/683: dread d3/d33/d34/d55/d5e/d9e/dc2/d3a/f3d [0,4194304] 0 2024-09-21T11:39:19.004 INFO:tasks.workunit.client.1.smithi149.stdout:4/797: stat d4/d6/d63/d15/f54 0 2024-09-21T11:39:19.008 INFO:tasks.workunit.client.1.smithi149.stdout:1/715: creat d2/dd/d2e/fea x:0 0 0 2024-09-21T11:39:19.009 INFO:tasks.workunit.client.1.smithi149.stdout:8/684: read d3/d33/d34/d55/d5e/d9e/dc2/d18/f8c [190087,46189] 0 2024-09-21T11:39:19.012 INFO:tasks.workunit.client.1.smithi149.stdout:4/798: rename d4/d6/d63/d2d/dd6/d32/dfa to d4/d6/d63/d78/d98/dee/d10d 0 2024-09-21T11:39:19.013 INFO:tasks.workunit.client.1.smithi149.stdout:0/707: write dd/d1a/d5a/d65/fc7 [5201767,100702] 0 2024-09-21T11:39:19.016 INFO:tasks.workunit.client.1.smithi149.stdout:2/895: write d8/da/d13/d83/df6/ff9 [4125608,12904] 0 2024-09-21T11:39:19.019 INFO:tasks.workunit.client.1.smithi149.stdout:4/799: creat d4/d4d/d58/f10e x:0 0 0 2024-09-21T11:39:19.021 INFO:tasks.workunit.client.1.smithi149.stdout:4/800: dread d4/d6/f88 [0,4194304] 0 2024-09-21T11:39:19.021 INFO:tasks.workunit.client.1.smithi149.stdout:4/801: stat d4/d6/d63/d10/d101 0 2024-09-21T11:39:19.024 INFO:tasks.workunit.client.1.smithi149.stdout:2/896: readlink d8/da/d13/l7a 0 2024-09-21T11:39:19.034 INFO:tasks.workunit.client.0.smithi118.stdout:1/243: truncate d6/de/f34 3491295 0 2024-09-21T11:39:19.036 INFO:tasks.workunit.client.0.smithi118.stdout:1/244: creat d6/de/d16/d3f/f4f x:0 0 0 2024-09-21T11:39:19.040 INFO:tasks.workunit.client.1.smithi149.stdout:1/716: truncate d2/d5/d65/f79 8261838 0 2024-09-21T11:39:19.040 INFO:tasks.workunit.client.1.smithi149.stdout:6/706: dwrite d8/f48 [0,4194304] 0 2024-09-21T11:39:19.041 INFO:tasks.workunit.client.1.smithi149.stdout:9/770: dwrite d18/d1c/f60 [0,4194304] 0 2024-09-21T11:39:19.043 INFO:tasks.workunit.client.0.smithi118.stdout:1/245: dwrite d6/de/d16/f4b [0,4194304] 0 2024-09-21T11:39:19.045 INFO:tasks.workunit.client.1.smithi149.stdout:6/707: chown d8/d32/d37/l42 5182734 1 2024-09-21T11:39:19.045 INFO:tasks.workunit.client.1.smithi149.stdout:2/897: dread d8/d11/dac/fcf [0,4194304] 0 2024-09-21T11:39:19.045 INFO:tasks.workunit.client.1.smithi149.stdout:6/708: fsync d8/d32/d37/dd7/fea 0 2024-09-21T11:39:19.046 INFO:tasks.workunit.client.0.smithi118.stdout:1/246: mkdir d6/de/d16/d3f/d50 0 2024-09-21T11:39:19.048 INFO:tasks.workunit.client.1.smithi149.stdout:8/685: truncate d3/d12/d6e/d79/fbc 3012012 0 2024-09-21T11:39:19.052 INFO:tasks.workunit.client.0.smithi118.stdout:1/247: dread f0 [0,4194304] 0 2024-09-21T11:39:19.054 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:19 smithi118 ceph-mon[28757]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:19.054 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:19 smithi118 ceph-mon[28757]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:19.054 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:19 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3265159410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:39:19.054 INFO:tasks.workunit.client.0.smithi118.stdout:1/248: dread - d6/d1f/d32/f46 zero size 2024-09-21T11:39:19.055 INFO:tasks.workunit.client.1.smithi149.stdout:0/708: dread dd/d2d/f91 [0,4194304] 0 2024-09-21T11:39:19.058 INFO:tasks.workunit.client.1.smithi149.stdout:1/717: unlink d2/d5/f34 0 2024-09-21T11:39:19.059 INFO:tasks.workunit.client.1.smithi149.stdout:6/709: chown d8/d32/d37/c21 610001638 1 2024-09-21T11:39:19.059 INFO:tasks.workunit.client.0.smithi118.stdout:1/249: creat d6/d2a/f51 x:0 0 0 2024-09-21T11:39:19.062 INFO:tasks.workunit.client.1.smithi149.stdout:4/802: dread d4/d4d/f45 [0,4194304] 0 2024-09-21T11:39:19.062 INFO:tasks.workunit.client.1.smithi149.stdout:9/771: mknod d18/d19/d1a/d2f/d30/cf6 0 2024-09-21T11:39:19.065 INFO:tasks.workunit.client.1.smithi149.stdout:8/686: unlink d3/d33/d34/d55/d5e/d9e/dc2/l30 0 2024-09-21T11:39:19.070 INFO:tasks.workunit.client.0.smithi118.stdout:1/250: creat d6/de/d16/d3f/d50/f52 x:0 0 0 2024-09-21T11:39:19.074 INFO:tasks.workunit.client.1.smithi149.stdout:6/710: fdatasync d8/da/d14/f1f 0 2024-09-21T11:39:19.076 INFO:tasks.workunit.client.1.smithi149.stdout:6/711: write d8/d32/d37/dd7/fea [700674,113875] 0 2024-09-21T11:39:19.077 INFO:tasks.workunit.client.1.smithi149.stdout:4/803: fdatasync d4/d6/d63/d15/f54 0 2024-09-21T11:39:19.079 INFO:tasks.workunit.client.1.smithi149.stdout:9/772: chown l15 467 1 2024-09-21T11:39:19.083 INFO:tasks.workunit.client.1.smithi149.stdout:0/709: mknod dd/d1a/d1b/d72/d78/dc4/d3a/ceb 0 2024-09-21T11:39:19.084 INFO:tasks.workunit.client.1.smithi149.stdout:2/898: rename d8/dd/f4c to d8/d11/f134 0 2024-09-21T11:39:19.085 INFO:tasks.workunit.client.1.smithi149.stdout:9/773: dwrite d18/d19/d1a/d2f/d53/fc2 [4194304,4194304] 0 2024-09-21T11:39:19.088 INFO:tasks.workunit.client.1.smithi149.stdout:1/718: write d2/dd/d35/d1c/d41/d51/f57 [324549,77242] 0 2024-09-21T11:39:19.093 INFO:tasks.workunit.client.0.smithi118.stdout:1/251: write d6/d2a/f23 [517689,92642] 0 2024-09-21T11:39:19.095 INFO:tasks.workunit.client.1.smithi149.stdout:0/710: dwrite dd/d1a/d1b/d72/d78/dc4/fc9 [0,4194304] 0 2024-09-21T11:39:19.095 INFO:tasks.workunit.client.1.smithi149.stdout:6/712: mknod d8/d32/d37/d2b/d7d/db8/dc4/cf0 0 2024-09-21T11:39:19.097 INFO:tasks.workunit.client.1.smithi149.stdout:0/711: write dd/fdb [1044214,109614] 0 2024-09-21T11:39:19.097 INFO:tasks.workunit.client.0.smithi118.stdout:1/252: mkdir d6/d2a/d53 0 2024-09-21T11:39:19.100 INFO:tasks.workunit.client.1.smithi149.stdout:4/804: symlink d4/d6/d63/d15/d30/d6b/l10f 0 2024-09-21T11:39:19.100 INFO:tasks.workunit.client.1.smithi149.stdout:4/805: chown d4/d6/f5e 1342899635 1 2024-09-21T11:39:19.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/854: sync 2024-09-21T11:39:19.105 INFO:tasks.workunit.client.0.smithi118.stdout:1/253: dwrite d6/de/f25 [0,4194304] 0 2024-09-21T11:39:19.110 INFO:tasks.workunit.client.0.smithi118.stdout:1/254: chown d6/de/d16/d3f/f4d 6 1 2024-09-21T11:39:19.113 INFO:tasks.workunit.client.1.smithi149.stdout:0/712: creat dd/d1a/d1b/d72/d78/d8b/d98/dbc/fec x:0 0 0 2024-09-21T11:39:19.117 INFO:tasks.workunit.client.0.smithi118.stdout:1/255: dwrite d6/de/d16/f4b [0,4194304] 0 2024-09-21T11:39:19.118 INFO:tasks.workunit.client.1.smithi149.stdout:7/855: dwrite d12/d5b/db5/dc5/de9/d68/f7b [4194304,4194304] 0 2024-09-21T11:39:19.119 INFO:tasks.workunit.client.1.smithi149.stdout:6/713: write d8/da/d14/f27 [4315204,16500] 0 2024-09-21T11:39:19.119 INFO:tasks.workunit.client.1.smithi149.stdout:4/806: symlink d4/d6/d63/d10/l110 0 2024-09-21T11:39:19.121 INFO:tasks.workunit.client.1.smithi149.stdout:6/714: chown d8/da/d11/l3f 853 1 2024-09-21T11:39:19.122 INFO:tasks.workunit.client.1.smithi149.stdout:8/687: dread d3/d33/d34/d55/d5e/d9e/dc2/d18/f51 [0,4194304] 0 2024-09-21T11:39:19.122 INFO:tasks.workunit.client.1.smithi149.stdout:2/899: rename d8/d11/f134 to d8/da/d13/f135 0 2024-09-21T11:39:19.123 INFO:tasks.workunit.client.1.smithi149.stdout:6/715: fdatasync d8/d32/d37/d28/f74 0 2024-09-21T11:39:19.124 INFO:tasks.workunit.client.1.smithi149.stdout:2/900: truncate d8/d11/fce 134091 0 2024-09-21T11:39:19.125 INFO:tasks.workunit.client.1.smithi149.stdout:1/719: write d2/dd/d35/d1c/d7a/fc7 [1230767,4166] 0 2024-09-21T11:39:19.125 INFO:tasks.workunit.client.1.smithi149.stdout:8/688: fdatasync d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/fc5 0 2024-09-21T11:39:19.125 INFO:tasks.workunit.client.1.smithi149.stdout:0/713: creat dd/d1a/d1b/d72/d78/dc4/d3a/dd1/dde/fed x:0 0 0 2024-09-21T11:39:19.127 INFO:tasks.workunit.client.1.smithi149.stdout:8/689: chown d3/f1d 18813329 1 2024-09-21T11:39:19.127 INFO:tasks.workunit.client.1.smithi149.stdout:2/901: chown d8/da/d13/d2d/f34 0 1 2024-09-21T11:39:19.127 INFO:tasks.workunit.client.0.smithi118.stdout:1/256: dwrite d6/d1f/d32/f48 [0,4194304] 0 2024-09-21T11:39:19.128 INFO:tasks.workunit.client.1.smithi149.stdout:2/902: chown d8/d20/d57/f47 1231971202 1 2024-09-21T11:39:19.130 INFO:tasks.workunit.client.1.smithi149.stdout:9/774: getdents d18/d19/d29/d6a 0 2024-09-21T11:39:19.131 INFO:tasks.workunit.client.1.smithi149.stdout:9/775: stat d18/d19/d1a/d2f/d30/d54/fbb 0 2024-09-21T11:39:19.133 INFO:tasks.workunit.client.1.smithi149.stdout:0/714: mknod dd/d1a/d1b/d50/d5d/cee 0 2024-09-21T11:39:19.136 INFO:tasks.workunit.client.0.smithi118.stdout:1/257: dwrite f1 [0,4194304] 0 2024-09-21T11:39:19.139 INFO:tasks.workunit.client.0.smithi118.stdout:1/258: chown d6/de/f34 789245 1 2024-09-21T11:39:19.140 INFO:tasks.workunit.client.0.smithi118.stdout:1/259: chown d6/d1f/d32/f46 153849384 1 2024-09-21T11:39:19.146 INFO:tasks.workunit.client.1.smithi149.stdout:8/690: link d3/d12/d6e/d79/lb3 d3/d33/d34/d72/d83/le9 0 2024-09-21T11:39:19.146 INFO:tasks.workunit.client.0.smithi118.stdout:1/260: rename d6/d1f to d6/de/d16/d3f/d50/d54 0 2024-09-21T11:39:19.148 INFO:tasks.workunit.client.1.smithi149.stdout:1/720: getdents d2/dd/d35/d1c/d7a 0 2024-09-21T11:39:19.150 INFO:tasks.workunit.client.1.smithi149.stdout:1/721: write d2/dd/d35/d1c/d37/f44 [2579077,45687] 0 2024-09-21T11:39:19.150 INFO:tasks.workunit.client.1.smithi149.stdout:9/776: creat d18/d36/d3c/d47/d99/ff7 x:0 0 0 2024-09-21T11:39:19.151 INFO:tasks.workunit.client.1.smithi149.stdout:7/856: write d12/d5b/db5/dc5/de9/d4a/d4f/d75/fcd [524918,826] 0 2024-09-21T11:39:19.155 INFO:tasks.workunit.client.1.smithi149.stdout:9/777: stat c4 0 2024-09-21T11:39:19.158 INFO:tasks.workunit.client.1.smithi149.stdout:6/716: dwrite d8/d32/d37/f49 [0,4194304] 0 2024-09-21T11:39:19.158 INFO:tasks.workunit.client.1.smithi149.stdout:9/778: truncate d18/d36/d3c/dcb/fe5 145988 0 2024-09-21T11:39:19.160 INFO:tasks.workunit.client.1.smithi149.stdout:6/717: chown d8/d32/d64/c6c 2784 1 2024-09-21T11:39:19.160 INFO:tasks.workunit.client.1.smithi149.stdout:9/779: chown d18/d19/d1a/d2f/faa 393645875 1 2024-09-21T11:39:19.161 INFO:tasks.workunit.client.0.smithi118.stdout:1/261: link d6/de/d16/l2f d6/de/l55 0 2024-09-21T11:39:19.161 INFO:tasks.workunit.client.1.smithi149.stdout:0/715: truncate dd/d32/f37 2120713 0 2024-09-21T11:39:19.161 INFO:tasks.workunit.client.0.smithi118.stdout:1/262: read - d6/d33/d3c/f42 zero size 2024-09-21T11:39:19.162 INFO:tasks.workunit.client.1.smithi149.stdout:8/691: creat d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/fea x:0 0 0 2024-09-21T11:39:19.162 INFO:tasks.workunit.client.1.smithi149.stdout:1/722: truncate d2/dd/d2e/f77 6931506 0 2024-09-21T11:39:19.163 INFO:tasks.workunit.client.1.smithi149.stdout:4/807: dread d4/d6/d63/d2d/dd6/fbc [0,4194304] 0 2024-09-21T11:39:19.164 INFO:tasks.workunit.client.0.smithi118.stdout:1/263: truncate d6/de/d16/d3f/f4d 1730106 0 2024-09-21T11:39:19.164 INFO:tasks.workunit.client.1.smithi149.stdout:6/718: mkdir d8/d32/d37/d2b/d51/df1 0 2024-09-21T11:39:19.167 INFO:tasks.workunit.client.0.smithi118.stdout:1/264: unlink d6/de/f27 0 2024-09-21T11:39:19.167 INFO:tasks.workunit.client.1.smithi149.stdout:6/719: stat d8/d32/d37/d2b/d51/da7 0 2024-09-21T11:39:19.168 INFO:tasks.workunit.client.0.smithi118.stdout:1/265: dread - d6/d2a/f51 zero size 2024-09-21T11:39:19.168 INFO:tasks.workunit.client.1.smithi149.stdout:7/857: write d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f3f [4977257,18593] 0 2024-09-21T11:39:19.168 INFO:tasks.workunit.client.1.smithi149.stdout:5/875: sync 2024-09-21T11:39:19.168 INFO:tasks.workunit.client.1.smithi149.stdout:3/825: sync 2024-09-21T11:39:19.169 INFO:tasks.workunit.client.0.smithi118.stdout:1/266: chown d6/de/d16/d3f/d50/d54/c4a 66683225 1 2024-09-21T11:39:19.169 INFO:tasks.workunit.client.1.smithi149.stdout:2/903: dread d8/dcb/fa7 [4194304,4194304] 0 2024-09-21T11:39:19.170 INFO:tasks.workunit.client.0.smithi118.stdout:1/267: read d6/d33/f44 [2620302,117364] 0 2024-09-21T11:39:19.170 INFO:tasks.workunit.client.1.smithi149.stdout:2/904: chown d8/da/d13 0 1 2024-09-21T11:39:19.170 INFO:tasks.workunit.client.1.smithi149.stdout:0/716: mkdir dd/def 0 2024-09-21T11:39:19.171 INFO:tasks.workunit.client.0.smithi118.stdout:1/268: fsync f1 0 2024-09-21T11:39:19.175 INFO:tasks.workunit.client.1.smithi149.stdout:1/723: mkdir d2/dd/d2e/deb 0 2024-09-21T11:39:19.177 INFO:tasks.workunit.client.0.smithi118.stdout:1/269: symlink d6/d2a/l56 0 2024-09-21T11:39:19.178 INFO:tasks.workunit.client.1.smithi149.stdout:0/717: dwrite dd/d1a/d1b/d72/d78/dc4/f5c [0,4194304] 0 2024-09-21T11:39:19.180 INFO:tasks.workunit.client.1.smithi149.stdout:3/826: creat d6/d1f/d47/d37/d3a/f121 x:0 0 0 2024-09-21T11:39:19.183 INFO:tasks.workunit.client.1.smithi149.stdout:7/858: mknod d12/d5b/db5/dc5/de9/d68/ded/c10d 0 2024-09-21T11:39:19.183 INFO:tasks.workunit.client.1.smithi149.stdout:2/905: mknod d8/da/d13/d83/df6/c136 0 2024-09-21T11:39:19.185 INFO:tasks.workunit.client.1.smithi149.stdout:7/859: chown d12/lde 52349 1 2024-09-21T11:39:19.186 INFO:tasks.workunit.client.1.smithi149.stdout:0/718: rmdir dd/d1a/d1b/d72/d78/dc4/d3a/dd1/dde 39 2024-09-21T11:39:19.190 INFO:tasks.workunit.client.1.smithi149.stdout:4/808: rmdir d4/d6/d63/d15/d30/d8a/da7/dfb/d10c 0 2024-09-21T11:39:19.193 INFO:tasks.workunit.client.1.smithi149.stdout:4/809: fsync d4/d6/d63/d15/fdd 0 2024-09-21T11:39:19.194 INFO:tasks.workunit.client.1.smithi149.stdout:2/906: rename d8/dcb/db8/dd3/ff3 to d8/dd/d5c/d60/d67/d8a/f137 0 2024-09-21T11:39:19.194 INFO:tasks.workunit.client.1.smithi149.stdout:6/720: dread d8/da/d14/f31 [0,4194304] 0 2024-09-21T11:39:19.196 INFO:tasks.workunit.client.1.smithi149.stdout:9/780: dread d18/d19/d29/fc6 [4194304,4194304] 0 2024-09-21T11:39:19.197 INFO:tasks.workunit.client.1.smithi149.stdout:4/810: dread - d4/d6/d63/d15/d30/da6/f106 zero size 2024-09-21T11:39:19.198 INFO:tasks.workunit.client.1.smithi149.stdout:0/719: dwrite dd/d1a/d1b/d72/d85/fe2 [0,4194304] 0 2024-09-21T11:39:19.199 INFO:tasks.workunit.client.1.smithi149.stdout:1/724: rename d2/d5/d8/f1f to d2/dd/d2e/d4c/fec 0 2024-09-21T11:39:19.199 INFO:tasks.workunit.client.1.smithi149.stdout:9/781: dread - d18/d36/d3c/d47/db5/fdb zero size 2024-09-21T11:39:19.200 INFO:tasks.workunit.client.1.smithi149.stdout:0/720: fsync dd/d35/fc0 0 2024-09-21T11:39:19.201 INFO:tasks.workunit.client.1.smithi149.stdout:1/725: dread - d2/dd/d35/d1c/d41/d51/f7f zero size 2024-09-21T11:39:19.201 INFO:tasks.workunit.client.1.smithi149.stdout:0/721: chown dd/d2d/f4b 58809 1 2024-09-21T11:39:19.206 INFO:tasks.workunit.client.1.smithi149.stdout:9/782: mknod d18/d19/d1a/d2f/d53/cf8 0 2024-09-21T11:39:19.210 INFO:tasks.workunit.client.1.smithi149.stdout:3/827: dwrite f3 [0,4194304] 0 2024-09-21T11:39:19.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/783: chown d18/d19/d1a/d2f/d33/fd9 697992 1 2024-09-21T11:39:19.222 INFO:tasks.workunit.client.1.smithi149.stdout:4/811: mknod d4/d6/d63/d10/c111 0 2024-09-21T11:39:19.222 INFO:tasks.workunit.client.1.smithi149.stdout:1/726: dwrite d2/dd/d35/d1c/d41/d51/d73/fca [0,4194304] 0 2024-09-21T11:39:19.223 INFO:tasks.workunit.client.1.smithi149.stdout:9/784: write d18/d19/d1a/d2f/d7d/de0/ff3 [200848,20427] 0 2024-09-21T11:39:19.224 INFO:tasks.workunit.client.1.smithi149.stdout:7/860: truncate d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/fe0 4142921 0 2024-09-21T11:39:19.232 INFO:tasks.workunit.client.1.smithi149.stdout:1/727: write d2/dd/d35/d1c/d41/d51/d73/fca [29698,87696] 0 2024-09-21T11:39:19.232 INFO:tasks.workunit.client.1.smithi149.stdout:4/812: unlink d4/d6/d63/d15/d30/d8a/da7/lfc 0 2024-09-21T11:39:19.237 INFO:tasks.workunit.client.1.smithi149.stdout:9/785: link c4 d18/d19/d1a/d2f/d30/d54/da7/cf9 0 2024-09-21T11:39:19.238 INFO:tasks.workunit.client.1.smithi149.stdout:1/728: mknod d2/d5/d65/d96/ced 0 2024-09-21T11:39:19.240 INFO:tasks.workunit.client.1.smithi149.stdout:2/907: dwrite d8/da/d13/d1a/d3b/fb7 [0,4194304] 0 2024-09-21T11:39:19.240 INFO:tasks.workunit.client.1.smithi149.stdout:7/861: getdents d12/d5b/db5/dc5/de9/d68/dc4 0 2024-09-21T11:39:19.240 INFO:tasks.workunit.client.1.smithi149.stdout:6/721: dwrite d8/d32/d37/d28/d2e/f3b [0,4194304] 0 2024-09-21T11:39:19.241 INFO:tasks.workunit.client.1.smithi149.stdout:0/722: dread dd/d1a/d1b/d72/d85/d8c/f89 [0,4194304] 0 2024-09-21T11:39:19.243 INFO:tasks.workunit.client.1.smithi149.stdout:0/723: dread - dd/d1a/d1b/d50/f57 zero size 2024-09-21T11:39:19.244 INFO:tasks.workunit.client.0.smithi118.stdout:6/172: sync 2024-09-21T11:39:19.244 INFO:tasks.workunit.client.0.smithi118.stdout:3/169: sync 2024-09-21T11:39:19.245 INFO:tasks.workunit.client.1.smithi149.stdout:6/722: mkdir d8/d32/d37/d2b/d7e/df2 0 2024-09-21T11:39:19.246 INFO:tasks.workunit.client.1.smithi149.stdout:7/862: fsync d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/ddc/fe6 0 2024-09-21T11:39:19.247 INFO:tasks.workunit.client.0.smithi118.stdout:3/170: write d5/d1d/f11 [4165030,110643] 0 2024-09-21T11:39:19.247 INFO:tasks.workunit.client.1.smithi149.stdout:1/729: read d2/d5/d3d/d88/f6d [6816150,12615] 0 2024-09-21T11:39:19.247 INFO:tasks.workunit.client.0.smithi118.stdout:1/270: truncate d6/de/f2e 459846 0 2024-09-21T11:39:19.248 INFO:tasks.workunit.client.1.smithi149.stdout:3/828: write d6/d1f/d47/d37/d3a/fbc [354626,127655] 0 2024-09-21T11:39:19.248 INFO:tasks.workunit.client.0.smithi118.stdout:6/173: mknod d8/c3c 0 2024-09-21T11:39:19.249 INFO:tasks.workunit.client.0.smithi118.stdout:6/174: fsync f6 0 2024-09-21T11:39:19.250 INFO:tasks.workunit.client.1.smithi149.stdout:0/724: read dd/d2d/f7f [7737024,69125] 0 2024-09-21T11:39:19.272 INFO:tasks.workunit.client.1.smithi149.stdout:9/786: write d18/d19/d29/fc6 [3395753,75180] 0 2024-09-21T11:39:19.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.271+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4cac1071b0 con 0x7f4c98074a80 2024-09-21T11:39:19.273 INFO:tasks.workunit.client.1.smithi149.stdout:0/725: mkdir dd/d32/db2/df0 0 2024-09-21T11:39:19.274 INFO:tasks.workunit.client.1.smithi149.stdout:1/730: chown d2/dd/d35/d1c/d41/d51/f57 421979068 1 2024-09-21T11:39:19.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.272+0000 7f4ca27fc640 1 -- 172.21.15.118:0/3309522759 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f4cac1071b0 con 0x7f4c98074a80 2024-09-21T11:39:19.275 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:39:19.275 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:39:19.275 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:39:19.275 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:39:19.275 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [], 2024-09-21T11:39:19.275 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T11:39:19.275 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "", 2024-09-21T11:39:19.275 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:39:19.275 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:39:19.276 INFO:tasks.workunit.client.1.smithi149.stdout:7/863: creat d12/d5b/db5/dc5/de9/d68/dc4/f10e x:0 0 0 2024-09-21T11:39:19.276 INFO:tasks.workunit.client.1.smithi149.stdout:6/723: creat d8/d32/d37/d28/ff3 x:0 0 0 2024-09-21T11:39:19.276 INFO:tasks.workunit.client.1.smithi149.stdout:3/829: mkdir d6/d1f/d47/d37/d50/d122 0 2024-09-21T11:39:19.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f4c98074a80 msgr2=0x7f4c98076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:19.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f4c98074a80 0x7f4c98076f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c005fd0 tx=0x7f4c9c005850 comp rx=0 tx=0).stop 2024-09-21T11:39:19.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 msgr2=0x7f4cac102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:19.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 0x7f4cac102510 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8006010 tx=0x7f4ca80045e0 comp rx=0 tx=0).stop 2024-09-21T11:39:19.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 shutdown_connections 2024-09-21T11:39:19.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f4c98074a80 0x7f4c98076f40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:19.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cac102c20 0x7f4cac100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:19.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 --2- 172.21.15.118:0/3309522759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cac0ffc40 0x7f4cac102510 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:19.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 >> 172.21.15.118:0/3309522759 conn(0x7f4cac0fb790 msgr2=0x7f4cac0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:19.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 shutdown_connections 2024-09-21T11:39:19.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:19.275+0000 7f4cb3838640 1 -- 172.21.15.118:0/3309522759 wait complete. 2024-09-21T11:39:19.279 INFO:tasks.workunit.client.1.smithi149.stdout:6/724: chown d8/da/d3d/f43 9 1 2024-09-21T11:39:19.279 INFO:tasks.workunit.client.1.smithi149.stdout:1/731: chown d2/dd/d35/d1c/d41/d51/le4 1501088 1 2024-09-21T11:39:19.281 INFO:tasks.workunit.client.1.smithi149.stdout:3/830: stat d6/d5f/d60/d88/de7/d119/f10f 0 2024-09-21T11:39:19.281 INFO:tasks.workunit.client.1.smithi149.stdout:4/813: dwrite d4/d6/d63/d78/d98/dee/f70 [0,4194304] 0 2024-09-21T11:39:19.283 INFO:tasks.workunit.client.1.smithi149.stdout:6/725: mknod d8/d32/cf4 0 2024-09-21T11:39:19.284 INFO:tasks.workunit.client.1.smithi149.stdout:9/787: dwrite d18/d4c/f67 [4194304,4194304] 0 2024-09-21T11:39:19.285 INFO:tasks.workunit.client.1.smithi149.stdout:3/831: dread - d6/d79/f7d zero size 2024-09-21T11:39:19.285 INFO:tasks.workunit.client.1.smithi149.stdout:4/814: creat d4/f112 x:0 0 0 2024-09-21T11:39:19.287 INFO:tasks.workunit.client.1.smithi149.stdout:0/726: write dd/d1a/d1b/f27 [847169,122115] 0 2024-09-21T11:39:19.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/732: rename d2/dd/d35/d1c/d41/d74/d9d to d2/d5/d3d/d88/dee 0 2024-09-21T11:39:19.294 INFO:tasks.workunit.client.1.smithi149.stdout:6/726: fsync d8/da/fd 0 2024-09-21T11:39:19.295 INFO:tasks.workunit.client.1.smithi149.stdout:0/727: mkdir dd/d1a/d1b/d72/d78/d8b/d98/dbc/df1 0 2024-09-21T11:39:19.296 INFO:tasks.workunit.client.1.smithi149.stdout:0/728: chown dd/l13 5 1 2024-09-21T11:39:19.297 INFO:tasks.workunit.client.1.smithi149.stdout:4/815: creat d4/d6/d63/d15/d30/dd3/f113 x:0 0 0 2024-09-21T11:39:19.298 INFO:tasks.workunit.client.1.smithi149.stdout:0/729: fsync dd/d1a/d1b/d72/dc1/fdd 0 2024-09-21T11:39:19.299 INFO:tasks.workunit.client.1.smithi149.stdout:1/733: mknod d2/de2/cef 0 2024-09-21T11:39:19.300 INFO:tasks.workunit.client.1.smithi149.stdout:3/832: write d6/d1f/d47/d37/d3a/f9e [772957,105160] 0 2024-09-21T11:39:19.302 INFO:tasks.workunit.client.1.smithi149.stdout:6/727: truncate d8/d32/d37/d28/f74 49691 0 2024-09-21T11:39:19.303 INFO:tasks.workunit.client.1.smithi149.stdout:4/816: creat d4/d6/d63/d78/d98/dcc/ddb/f114 x:0 0 0 2024-09-21T11:39:19.304 INFO:tasks.workunit.client.1.smithi149.stdout:0/730: mkdir dd/d1a/d1b/d72/d78/d8b/d98/daa/df2 0 2024-09-21T11:39:19.306 INFO:tasks.workunit.client.1.smithi149.stdout:6/728: mkdir d8/d32/d37/d2b/d51/df5 0 2024-09-21T11:39:19.306 INFO:tasks.workunit.client.1.smithi149.stdout:4/817: chown d4/d4d/c83 25 1 2024-09-21T11:39:19.306 INFO:tasks.workunit.client.1.smithi149.stdout:0/731: readlink dd/d6a/la2 0 2024-09-21T11:39:19.307 INFO:tasks.workunit.client.1.smithi149.stdout:1/734: rename d2/d5/f85 to d2/dd/d2e/d4c/ff0 0 2024-09-21T11:39:19.309 INFO:tasks.workunit.client.1.smithi149.stdout:7/864: dread d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/faf [0,4194304] 0 2024-09-21T11:39:19.312 INFO:tasks.workunit.client.1.smithi149.stdout:6/729: rename d8/f48 to d8/da/ff6 0 2024-09-21T11:39:19.312 INFO:tasks.workunit.client.1.smithi149.stdout:0/732: symlink dd/d32/db2/df0/lf3 0 2024-09-21T11:39:19.312 INFO:tasks.workunit.client.1.smithi149.stdout:3/833: dwrite d6/d1f/d47/d37/d3a/d95/f10d [0,4194304] 0 2024-09-21T11:39:19.313 INFO:tasks.workunit.client.1.smithi149.stdout:4/818: mkdir d4/d4d/d5f/d71/ddc/d115 0 2024-09-21T11:39:19.316 INFO:tasks.workunit.client.1.smithi149.stdout:7/865: symlink d12/d5b/db5/dc5/de9/d4a/d6c/da0/df0/df4/l10f 0 2024-09-21T11:39:19.317 INFO:tasks.workunit.client.1.smithi149.stdout:6/730: readlink d8/da/d2c/d2d/d60/dc3/ldf 0 2024-09-21T11:39:19.318 INFO:tasks.workunit.client.1.smithi149.stdout:3/834: creat d6/d79/d7e/f123 x:0 0 0 2024-09-21T11:39:19.321 INFO:tasks.workunit.client.1.smithi149.stdout:1/735: dwrite d2/dd/d35/d1c/d37/f44 [0,4194304] 0 2024-09-21T11:39:19.325 INFO:tasks.workunit.client.1.smithi149.stdout:4/819: mkdir d4/d6/d63/d15/d30/d6b/d116 0 2024-09-21T11:39:19.325 INFO:tasks.workunit.client.1.smithi149.stdout:0/733: truncate dd/d1a/d1b/d50/f57 1046966 0 2024-09-21T11:39:19.329 INFO:tasks.workunit.client.1.smithi149.stdout:9/788: dread d18/d19/d1a/f4b [4194304,4194304] 0 2024-09-21T11:39:19.330 INFO:tasks.workunit.client.1.smithi149.stdout:7/866: chown d12/d5b/db5/dc5/de9/d68/dc4/d30/f57 126133 1 2024-09-21T11:39:19.332 INFO:tasks.workunit.client.1.smithi149.stdout:9/789: dread - d18/d36/d3c/d47/d99/ff7 zero size 2024-09-21T11:39:19.332 INFO:tasks.workunit.client.1.smithi149.stdout:1/736: fdatasync d2/d5/f6c 0 2024-09-21T11:39:19.332 INFO:tasks.workunit.client.1.smithi149.stdout:3/835: creat d6/d1f/d47/d37/d3f/dc5/d106/f124 x:0 0 0 2024-09-21T11:39:19.334 INFO:tasks.workunit.client.1.smithi149.stdout:0/734: read dd/d1a/d1b/f31 [431570,8208] 0 2024-09-21T11:39:19.335 INFO:tasks.workunit.client.1.smithi149.stdout:3/836: symlink d6/d10e/l125 0 2024-09-21T11:39:19.335 INFO:tasks.workunit.client.1.smithi149.stdout:9/790: unlink d18/d19/d1a/d2f/d43/c4a 0 2024-09-21T11:39:19.336 INFO:tasks.workunit.client.1.smithi149.stdout:7/867: symlink d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/d49/l110 0 2024-09-21T11:39:19.338 INFO:tasks.workunit.client.1.smithi149.stdout:1/737: unlink d2/dd/d35/d1c/d37/f44 0 2024-09-21T11:39:19.338 INFO:tasks.workunit.client.1.smithi149.stdout:1/738: chown d2 401 1 2024-09-21T11:39:19.338 INFO:tasks.workunit.client.1.smithi149.stdout:8/692: sync 2024-09-21T11:39:19.338 INFO:tasks.workunit.client.1.smithi149.stdout:5/876: sync 2024-09-21T11:39:19.339 INFO:tasks.workunit.client.1.smithi149.stdout:9/791: mknod d18/d19/d29/d6a/cfa 0 2024-09-21T11:39:19.340 INFO:tasks.workunit.client.1.smithi149.stdout:1/739: stat d2/dd/d35/d1c/d41/d51/fdc 0 2024-09-21T11:39:19.342 INFO:tasks.workunit.client.1.smithi149.stdout:3/837: symlink d6/d1f/d27/l126 0 2024-09-21T11:39:19.343 INFO:tasks.workunit.client.1.smithi149.stdout:8/693: readlink d3/d12/d6e/d79/lb3 0 2024-09-21T11:39:19.344 INFO:tasks.workunit.client.1.smithi149.stdout:4/820: write d4/d6/f8f [913400,72139] 0 2024-09-21T11:39:19.345 INFO:tasks.workunit.client.1.smithi149.stdout:9/792: dread - d18/d19/d29/d39/d63/dac/fd3 zero size 2024-09-21T11:39:19.345 INFO:tasks.workunit.client.1.smithi149.stdout:3/838: stat d6/d1f/d27/ced 0 2024-09-21T11:39:19.348 INFO:tasks.workunit.client.1.smithi149.stdout:3/839: chown d6/d79/d7e/ddd 28916 1 2024-09-21T11:39:19.350 INFO:tasks.workunit.client.1.smithi149.stdout:5/877: dread d4/d1d/d50/d54/d2a/f67 [0,4194304] 0 2024-09-21T11:39:19.350 INFO:tasks.workunit.client.1.smithi149.stdout:7/868: dwrite d12/d5b/db5/dc5/de9/d4a/d6c/db1/fb2 [4194304,4194304] 0 2024-09-21T11:39:19.351 INFO:tasks.workunit.client.1.smithi149.stdout:0/735: truncate dd/d1a/d1b/d72/d78/dc4/d3a/f7c 826440 0 2024-09-21T11:39:19.352 INFO:tasks.workunit.client.1.smithi149.stdout:8/694: dread - d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/fd8 zero size 2024-09-21T11:39:19.352 INFO:tasks.workunit.client.1.smithi149.stdout:6/731: dwrite d8/d32/d37/d28/d2e/f44 [0,4194304] 0 2024-09-21T11:39:19.352 INFO:tasks.workunit.client.1.smithi149.stdout:4/821: mknod d4/d6/d63/d2d/dd6/c117 0 2024-09-21T11:39:19.358 INFO:tasks.workunit.client.1.smithi149.stdout:3/840: truncate d6/d1f/d47/d37/dd6/f109 4379854 0 2024-09-21T11:39:19.363 INFO:tasks.workunit.client.1.smithi149.stdout:1/740: truncate d2/d5/d3d/d88/f3e 3930719 0 2024-09-21T11:39:19.367 INFO:tasks.workunit.client.1.smithi149.stdout:6/732: unlink d8/da/d2c/d52/d5e/c6b 0 2024-09-21T11:39:19.370 INFO:tasks.workunit.client.1.smithi149.stdout:4/822: unlink d4/d6/d63/d10/ce2 0 2024-09-21T11:39:19.371 INFO:tasks.workunit.client.1.smithi149.stdout:0/736: symlink dd/d1a/d1b/lf4 0 2024-09-21T11:39:19.371 INFO:tasks.workunit.client.1.smithi149.stdout:8/695: dwrite d3/d12/d6e/f94 [0,4194304] 0 2024-09-21T11:39:19.371 INFO:tasks.workunit.client.1.smithi149.stdout:7/869: mknod d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/c111 0 2024-09-21T11:39:19.372 INFO:tasks.workunit.client.1.smithi149.stdout:5/878: truncate d4/d7/d40/d43/d49/d88/de0/fe2 802695 0 2024-09-21T11:39:19.374 INFO:tasks.workunit.client.1.smithi149.stdout:6/733: rename d8/fa3 to d8/da/d14/ff7 0 2024-09-21T11:39:19.377 INFO:tasks.workunit.client.1.smithi149.stdout:4/823: read d4/d6/d63/f28 [4557242,48525] 0 2024-09-21T11:39:19.378 INFO:tasks.workunit.client.1.smithi149.stdout:0/737: dread dd/d1a/d1b/d72/d85/f9a [0,4194304] 0 2024-09-21T11:39:19.380 INFO:tasks.workunit.client.1.smithi149.stdout:7/870: creat d12/d5b/db5/dc5/de9/d4a/d6c/da0/dbb/f112 x:0 0 0 2024-09-21T11:39:19.382 INFO:tasks.workunit.client.1.smithi149.stdout:8/696: symlink d3/d33/d34/d55/d5e/d9e/dc2/leb 0 2024-09-21T11:39:19.382 INFO:tasks.workunit.client.1.smithi149.stdout:1/741: link d2/d5/d8/l10 d2/d5/db3/dd9/lf1 0 2024-09-21T11:39:19.383 INFO:tasks.workunit.client.1.smithi149.stdout:0/738: write dd/d1a/d1b/d50/fcd [94614,13146] 0 2024-09-21T11:39:19.383 INFO:tasks.workunit.client.1.smithi149.stdout:2/908: sync 2024-09-21T11:39:19.385 INFO:tasks.workunit.client.1.smithi149.stdout:8/697: dread - d3/d12/d98/fa7 zero size 2024-09-21T11:39:19.386 INFO:tasks.workunit.client.1.smithi149.stdout:5/879: dwrite d4/d7/d40/d43/d49/d88/ff0 [0,4194304] 0 2024-09-21T11:39:19.390 INFO:tasks.workunit.client.1.smithi149.stdout:3/841: dread d6/d1f/f54 [0,4194304] 0 2024-09-21T11:39:19.391 INFO:tasks.workunit.client.1.smithi149.stdout:0/739: creat dd/d1a/d1b/d72/d85/d8c/ff5 x:0 0 0 2024-09-21T11:39:19.391 INFO:tasks.workunit.client.1.smithi149.stdout:4/824: link d4/d4d/c9d d4/d6/d63/d78/c118 0 2024-09-21T11:39:19.393 INFO:tasks.workunit.client.1.smithi149.stdout:3/842: fdatasync d6/d1f/d47/f81 0 2024-09-21T11:39:19.393 INFO:tasks.workunit.client.1.smithi149.stdout:1/742: symlink d2/dd/d35/d1c/d41/lf2 0 2024-09-21T11:39:19.393 INFO:tasks.workunit.client.1.smithi149.stdout:0/740: fdatasync dd/d1a/d1b/d72/d85/fe2 0 2024-09-21T11:39:19.394 INFO:tasks.workunit.client.1.smithi149.stdout:3/843: readlink d6/lc0 0 2024-09-21T11:39:19.397 INFO:tasks.workunit.client.1.smithi149.stdout:8/698: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7/dec 0 2024-09-21T11:39:19.397 INFO:tasks.workunit.client.1.smithi149.stdout:0/741: write dd/d1a/d1b/d72/d85/fe2 [2330047,53715] 0 2024-09-21T11:39:19.400 INFO:tasks.workunit.client.1.smithi149.stdout:3/844: read d6/d79/d7e/fc1 [2852035,39054] 0 2024-09-21T11:39:19.401 INFO:tasks.workunit.client.1.smithi149.stdout:1/743: rename d2/d5/d3d/d88/c9a to d2/dd/d35/d5b/dc0/dc3/cf3 0 2024-09-21T11:39:19.402 INFO:tasks.workunit.client.0.smithi118.stdout:1/271: dread d6/de/f25 [0,4194304] 0 2024-09-21T11:39:19.403 INFO:tasks.workunit.client.0.smithi118.stdout:3/171: dwrite d5/d1d/d1b/d24/f2c [0,4194304] 0 2024-09-21T11:39:19.403 INFO:tasks.workunit.client.0.smithi118.stdout:1/272: readlink d6/l9 0 2024-09-21T11:39:19.404 INFO:tasks.workunit.client.1.smithi149.stdout:0/742: unlink dd/d35/c7e 0 2024-09-21T11:39:19.406 INFO:tasks.workunit.client.1.smithi149.stdout:7/871: link d12/d5b/db5/dc5/de9/d68/dc4/l95 d12/d5b/db5/dc5/de9/d4a/d6c/db1/de1/l113 0 2024-09-21T11:39:19.411 INFO:tasks.workunit.client.1.smithi149.stdout:5/880: truncate d4/d7/d40/d43/d5c/d7a/d81/f83 842003 0 2024-09-21T11:39:19.411 INFO:tasks.workunit.client.1.smithi149.stdout:7/872: readlink d12/d5b/db5/dc5/de9/d4a/d6c/da0/df0/df4/l10f 0 2024-09-21T11:39:19.411 INFO:tasks.workunit.client.1.smithi149.stdout:4/825: dwrite d4/d6/d63/d78/fff [0,4194304] 0 2024-09-21T11:39:19.413 INFO:tasks.workunit.client.1.smithi149.stdout:8/699: creat d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/fed x:0 0 0 2024-09-21T11:39:19.413 INFO:tasks.workunit.client.1.smithi149.stdout:5/881: chown d4/d7/l28 0 1 2024-09-21T11:39:19.416 INFO:tasks.workunit.client.1.smithi149.stdout:0/743: symlink dd/d32/db2/lf6 0 2024-09-21T11:39:19.427 INFO:tasks.workunit.client.1.smithi149.stdout:4/826: mknod d4/d4d/d5f/c119 0 2024-09-21T11:39:19.427 INFO:tasks.workunit.client.1.smithi149.stdout:2/909: dread f7 [4194304,4194304] 0 2024-09-21T11:39:19.428 INFO:tasks.workunit.client.1.smithi149.stdout:3/845: dwrite d6/d79/d7e/f89 [4194304,4194304] 0 2024-09-21T11:39:19.429 INFO:tasks.workunit.client.1.smithi149.stdout:5/882: creat d4/d7/d40/d43/d49/d88/de0/dfc/f11e x:0 0 0 2024-09-21T11:39:19.432 INFO:tasks.workunit.client.1.smithi149.stdout:7/873: rmdir d12/d5b/db5/dc5/de9/d4a/d6c/d8c 39 2024-09-21T11:39:19.433 INFO:tasks.workunit.client.1.smithi149.stdout:3/846: write d6/d1f/d4c/f87 [1154456,28510] 0 2024-09-21T11:39:19.435 INFO:tasks.workunit.client.1.smithi149.stdout:0/744: dwrite dd/d1a/d5a/f93 [0,4194304] 0 2024-09-21T11:39:19.436 INFO:tasks.workunit.client.0.smithi118.stdout:6/175: truncate d8/d14/f1e 1002982 0 2024-09-21T11:39:19.436 INFO:tasks.workunit.client.0.smithi118.stdout:6/176: readlink d8/l3b 0 2024-09-21T11:39:19.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/744: dwrite d2/dd/d35/d1c/d41/d51/d90/f9b [0,4194304] 0 2024-09-21T11:39:19.441 INFO:tasks.workunit.client.1.smithi149.stdout:4/827: creat d4/d6/d63/d15/d30/d8a/da7/f11a x:0 0 0 2024-09-21T11:39:19.442 INFO:tasks.workunit.client.0.smithi118.stdout:3/172: fsync d5/d1d/f16 0 2024-09-21T11:39:19.447 INFO:tasks.workunit.client.0.smithi118.stdout:1/273: creat d6/d3b/f57 x:0 0 0 2024-09-21T11:39:19.448 INFO:tasks.workunit.client.1.smithi149.stdout:8/700: rename d3/d3c/d8f/d76/cb4 to d3/d12/d6e/d79/d8e/cee 0 2024-09-21T11:39:19.448 INFO:tasks.workunit.client.1.smithi149.stdout:5/883: symlink d4/d7/d40/d43/d5c/d7a/d81/l11f 0 2024-09-21T11:39:19.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:19 smithi149 ceph-mon[36123]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:19.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:19 smithi149 ceph-mon[36123]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:19.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:19 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3265159410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:39:19.451 INFO:tasks.workunit.client.0.smithi118.stdout:6/177: write d8/fc [4219625,67457] 0 2024-09-21T11:39:19.451 INFO:tasks.workunit.client.0.smithi118.stdout:6/178: readlink d8/lf 0 2024-09-21T11:39:19.452 INFO:tasks.workunit.client.0.smithi118.stdout:6/179: chown d8/d14/l21 154 1 2024-09-21T11:39:19.454 INFO:tasks.workunit.client.1.smithi149.stdout:4/828: dwrite d4/d6/f105 [0,4194304] 0 2024-09-21T11:39:19.455 INFO:tasks.workunit.client.0.smithi118.stdout:3/173: creat d5/d1d/f41 x:0 0 0 2024-09-21T11:39:19.456 INFO:tasks.workunit.client.0.smithi118.stdout:3/174: chown d5/d1d/d1b/f40 7392 1 2024-09-21T11:39:19.464 INFO:tasks.workunit.client.1.smithi149.stdout:8/701: fsync d3/d12/f15 0 2024-09-21T11:39:19.465 INFO:tasks.workunit.client.1.smithi149.stdout:8/702: chown d3/la8 46 1 2024-09-21T11:39:19.467 INFO:tasks.workunit.client.0.smithi118.stdout:1/274: creat d6/de/f58 x:0 0 0 2024-09-21T11:39:19.467 INFO:tasks.workunit.client.1.smithi149.stdout:3/847: dwrite d6/d79/fa4 [0,4194304] 0 2024-09-21T11:39:19.468 INFO:tasks.workunit.client.0.smithi118.stdout:1/275: chown d6/de/d16/d3f/d50/f52 21 1 2024-09-21T11:39:19.469 INFO:tasks.workunit.client.1.smithi149.stdout:3/848: truncate d6/d1f/d47/d22/d8d/fcd 1153389 0 2024-09-21T11:39:19.470 INFO:tasks.workunit.client.1.smithi149.stdout:7/874: mkdir d12/d5b/db5/dc5/de9/d4a/d104/d114 0 2024-09-21T11:39:19.471 INFO:tasks.workunit.client.1.smithi149.stdout:3/849: readlink d6/d1f/d47/d22/l30 0 2024-09-21T11:39:19.471 INFO:tasks.workunit.client.1.smithi149.stdout:4/829: truncate d4/d4d/f45 224624 0 2024-09-21T11:39:19.472 INFO:tasks.workunit.client.1.smithi149.stdout:1/745: symlink d2/d5/d8/lf4 0 2024-09-21T11:39:19.472 INFO:tasks.workunit.client.0.smithi118.stdout:3/175: getdents d5/d1d/d1b 0 2024-09-21T11:39:19.475 INFO:tasks.workunit.client.0.smithi118.stdout:1/276: dwrite d6/de/d16/f29 [0,4194304] 0 2024-09-21T11:39:19.475 INFO:tasks.workunit.client.1.smithi149.stdout:3/850: read - d6/d1f/d47/d37/dd6/fba zero size 2024-09-21T11:39:19.476 INFO:tasks.workunit.client.1.smithi149.stdout:4/830: chown d4/d4d/d5f/ff4 436 1 2024-09-21T11:39:19.476 INFO:tasks.workunit.client.0.smithi118.stdout:1/277: chown d6/l7 43 1 2024-09-21T11:39:19.477 INFO:tasks.workunit.client.1.smithi149.stdout:8/703: stat d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/ce4 0 2024-09-21T11:39:19.477 INFO:tasks.workunit.client.1.smithi149.stdout:1/746: write d2/d5/d8/f17 [276797,90598] 0 2024-09-21T11:39:19.478 INFO:tasks.workunit.client.0.smithi118.stdout:1/278: readlink d6/de/d16/d3f/d50/d54/l38 0 2024-09-21T11:39:19.478 INFO:tasks.workunit.client.1.smithi149.stdout:0/745: dread dd/d1a/d5a/f80 [0,4194304] 0 2024-09-21T11:39:19.480 INFO:tasks.workunit.client.1.smithi149.stdout:2/910: rename d8/da/d13/f21 to d8/f138 0 2024-09-21T11:39:19.481 INFO:tasks.workunit.client.1.smithi149.stdout:0/746: write dd/d1a/d1b/d50/d5d/f71 [1595029,69703] 0 2024-09-21T11:39:19.481 INFO:tasks.workunit.client.0.smithi118.stdout:3/176: mknod d5/d28/d3e/c42 0 2024-09-21T11:39:19.486 INFO:tasks.workunit.client.0.smithi118.stdout:3/177: creat d5/d1d/f43 x:0 0 0 2024-09-21T11:39:19.488 INFO:tasks.workunit.client.1.smithi149.stdout:3/851: truncate d6/d1f/fc2 270980 0 2024-09-21T11:39:19.490 INFO:tasks.workunit.client.0.smithi118.stdout:6/180: dwrite d8/d14/d28/f31 [0,4194304] 0 2024-09-21T11:39:19.492 INFO:tasks.workunit.client.0.smithi118.stdout:6/181: write d8/d14/f24 [3336595,13517] 0 2024-09-21T11:39:19.497 INFO:tasks.workunit.client.1.smithi149.stdout:3/852: dwrite d6/d79/d7e/dcb/ffc [0,4194304] 0 2024-09-21T11:39:19.497 INFO:tasks.workunit.client.1.smithi149.stdout:2/911: mknod d8/da/d13/d1a/d3b/c139 0 2024-09-21T11:39:19.499 INFO:tasks.workunit.client.1.smithi149.stdout:0/747: rmdir dd/d1a/d5a 39 2024-09-21T11:39:19.503 INFO:tasks.workunit.client.1.smithi149.stdout:7/875: write d12/d5b/db5/dc5/de9/d4a/d9e/f86 [8024489,45033] 0 2024-09-21T11:39:19.504 INFO:tasks.workunit.client.1.smithi149.stdout:9/793: sync 2024-09-21T11:39:19.510 INFO:tasks.workunit.client.1.smithi149.stdout:5/884: dwrite d4/d1d/d50/d54/d2a/f34 [0,4194304] 0 2024-09-21T11:39:19.512 INFO:tasks.workunit.client.1.smithi149.stdout:1/747: dread d2/dd/d35/f24 [0,4194304] 0 2024-09-21T11:39:19.514 INFO:tasks.workunit.client.1.smithi149.stdout:5/885: fsync d4/d7/d40/d51/d56/ffa 0 2024-09-21T11:39:19.514 INFO:tasks.workunit.client.1.smithi149.stdout:3/853: dwrite d6/d1f/d47/fb3 [0,4194304] 0 2024-09-21T11:39:19.516 INFO:tasks.workunit.client.1.smithi149.stdout:5/886: write d4/d7/f31 [8711959,81257] 0 2024-09-21T11:39:19.519 INFO:tasks.workunit.client.1.smithi149.stdout:6/734: sync 2024-09-21T11:39:19.573 INFO:tasks.workunit.client.0.smithi118.stdout:8/417: sync 2024-09-21T11:39:19.573 INFO:tasks.workunit.client.0.smithi118.stdout:1/279: rename d6/de/l55 to d6/l59 0 2024-09-21T11:39:19.573 INFO:tasks.workunit.client.0.smithi118.stdout:6/182: rename d8/d14 to d8/d14/d28/d3d 22 2024-09-21T11:39:19.577 INFO:tasks.workunit.client.0.smithi118.stdout:6/183: write d8/d14/f24 [2696968,41431] 0 2024-09-21T11:39:19.577 INFO:tasks.workunit.client.1.smithi149.stdout:4/831: write d4/d6/d63/d10/d6f/f93 [673727,129987] 0 2024-09-21T11:39:19.579 INFO:tasks.workunit.client.1.smithi149.stdout:8/704: chown d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/l75 2810615 1 2024-09-21T11:39:19.582 INFO:tasks.workunit.client.0.smithi118.stdout:3/178: link d5/d1d/f19 d5/d28/d3e/f44 0 2024-09-21T11:39:19.584 INFO:tasks.workunit.client.0.smithi118.stdout:1/280: creat d6/de/d16/d3f/d50/d54/d32/f5a x:0 0 0 2024-09-21T11:39:19.585 INFO:tasks.workunit.client.0.smithi118.stdout:8/418: dwrite d2/dc/d10/d2e/d18/d1a/f1e [0,4194304] 0 2024-09-21T11:39:19.587 INFO:tasks.workunit.client.0.smithi118.stdout:8/419: write d2/fa [1676755,27444] 0 2024-09-21T11:39:19.588 INFO:tasks.workunit.client.0.smithi118.stdout:6/184: fdatasync d8/d14/d33/f39 0 2024-09-21T11:39:19.589 INFO:tasks.workunit.client.1.smithi149.stdout:0/748: dread dd/d2d/f4b [0,4194304] 0 2024-09-21T11:39:19.591 INFO:tasks.workunit.client.0.smithi118.stdout:3/179: dread d5/d28/f2b [0,4194304] 0 2024-09-21T11:39:19.595 INFO:tasks.workunit.client.0.smithi118.stdout:8/420: unlink d2/f70 0 2024-09-21T11:39:19.595 INFO:tasks.workunit.client.0.smithi118.stdout:8/421: truncate d2/f72 513467 0 2024-09-21T11:39:19.596 INFO:tasks.workunit.client.1.smithi149.stdout:5/887: symlink d4/d7/d40/d43/d49/dc3/l120 0 2024-09-21T11:39:19.597 INFO:tasks.workunit.client.0.smithi118.stdout:1/281: rename d6/de/d16/d3f/d50/f52 to d6/d33/f5b 0 2024-09-21T11:39:19.598 INFO:tasks.workunit.client.1.smithi149.stdout:6/735: mkdir d8/d32/d37/df8 0 2024-09-21T11:39:19.598 INFO:tasks.workunit.client.0.smithi118.stdout:1/282: dread d6/de/d16/d3f/d50/d54/f39 [0,4194304] 0 2024-09-21T11:39:19.599 INFO:tasks.workunit.client.0.smithi118.stdout:6/185: creat d8/d14/d33/f3e x:0 0 0 2024-09-21T11:39:19.599 INFO:tasks.workunit.client.0.smithi118.stdout:1/283: dread - d6/de/d13/f41 zero size 2024-09-21T11:39:19.601 INFO:tasks.workunit.client.0.smithi118.stdout:1/284: fdatasync d6/de/d16/d3f/d50/d54/d32/f5a 0 2024-09-21T11:39:19.602 INFO:tasks.workunit.client.1.smithi149.stdout:7/876: write d12/d5b/db5/dc5/fc9 [759580,80924] 0 2024-09-21T11:39:19.607 INFO:tasks.workunit.client.0.smithi118.stdout:8/422: read d2/dc/d10/d2e/f55 [438683,111315] 0 2024-09-21T11:39:19.608 INFO:tasks.workunit.client.1.smithi149.stdout:2/912: creat d8/da/d13/d2d/d6f/de8/f13a x:0 0 0 2024-09-21T11:39:19.608 INFO:tasks.workunit.client.0.smithi118.stdout:8/423: chown d2/dc/d10/d2e/f21 10331 1 2024-09-21T11:39:19.610 INFO:tasks.workunit.client.0.smithi118.stdout:8/424: write d2/dc/d10/d3b/f64 [6417329,118087] 0 2024-09-21T11:39:19.610 INFO:tasks.workunit.client.0.smithi118.stdout:1/285: mkdir d6/d2a/d5c 0 2024-09-21T11:39:19.611 INFO:tasks.workunit.client.1.smithi149.stdout:9/794: mkdir d18/d19/d29/d39/dfb 0 2024-09-21T11:39:19.613 INFO:tasks.workunit.client.0.smithi118.stdout:6/186: dread d8/fa [8388608,4194304] 0 2024-09-21T11:39:19.614 INFO:tasks.workunit.client.1.smithi149.stdout:6/736: mknod d8/d32/d37/d2b/d7d/db8/cf9 0 2024-09-21T11:39:19.615 INFO:tasks.workunit.client.1.smithi149.stdout:4/832: mkdir d4/d6/d63/d15/d16/d23/d11b 0 2024-09-21T11:39:19.616 INFO:tasks.workunit.client.0.smithi118.stdout:3/180: dwrite d5/d1d/f25 [0,4194304] 0 2024-09-21T11:39:19.617 INFO:tasks.workunit.client.1.smithi149.stdout:2/913: write d8/dd/d50/fd2 [1381473,92991] 0 2024-09-21T11:39:19.619 INFO:tasks.workunit.client.1.smithi149.stdout:0/749: symlink dd/d1a/d1b/d72/d78/dc4/d3a/d66/dcf/lf7 0 2024-09-21T11:39:19.620 INFO:tasks.workunit.client.1.smithi149.stdout:1/748: sync 2024-09-21T11:39:19.621 INFO:tasks.workunit.client.1.smithi149.stdout:3/854: sync 2024-09-21T11:39:19.622 INFO:tasks.workunit.client.0.smithi118.stdout:1/286: dwrite d6/de/d16/d3f/f4f [0,4194304] 0 2024-09-21T11:39:19.624 INFO:tasks.workunit.client.1.smithi149.stdout:5/888: link d4/d1d/d50/d60/db1/db4/fd2 d4/d1d/d50/d54/dec/f121 0 2024-09-21T11:39:19.625 INFO:tasks.workunit.client.1.smithi149.stdout:5/889: chown d4/d1d/d3e/d9a/f11b 16634948 1 2024-09-21T11:39:19.627 INFO:tasks.workunit.client.1.smithi149.stdout:4/833: mknod d4/d6/d63/d78/c11c 0 2024-09-21T11:39:19.630 INFO:tasks.workunit.client.1.smithi149.stdout:2/914: symlink d8/dd/d5c/d84/l13b 0 2024-09-21T11:39:19.630 INFO:tasks.workunit.client.0.smithi118.stdout:1/287: symlink d6/de/d16/l5d 0 2024-09-21T11:39:19.631 INFO:tasks.workunit.client.0.smithi118.stdout:1/288: fdatasync d6/de/f1a 0 2024-09-21T11:39:19.632 INFO:tasks.workunit.client.0.smithi118.stdout:3/181: truncate d5/d1d/f15 1369883 0 2024-09-21T11:39:19.633 INFO:tasks.workunit.client.1.smithi149.stdout:2/915: write d8/da/d13/d83/fe6 [449428,35131] 0 2024-09-21T11:39:19.633 INFO:tasks.workunit.client.1.smithi149.stdout:0/750: creat dd/d2d/ff8 x:0 0 0 2024-09-21T11:39:19.633 INFO:tasks.workunit.client.1.smithi149.stdout:1/749: dread - d2/d5/d3d/d88/f63 zero size 2024-09-21T11:39:19.634 INFO:tasks.workunit.client.0.smithi118.stdout:8/425: getdents d2/dc/d10/d2e/d18 0 2024-09-21T11:39:19.635 INFO:tasks.workunit.client.1.smithi149.stdout:3/855: mkdir d6/d1f/d47/d37/dd6/d96/d127 0 2024-09-21T11:39:19.635 INFO:tasks.workunit.client.0.smithi118.stdout:8/426: chown d2/dc/d10/d2e/d18/l41 10 1 2024-09-21T11:39:19.636 INFO:tasks.workunit.client.1.smithi149.stdout:3/856: chown d6/d1f/d47/dce 356 1 2024-09-21T11:39:19.637 INFO:tasks.workunit.client.1.smithi149.stdout:6/737: mknod d8/d32/d37/df8/cfa 0 2024-09-21T11:39:19.638 INFO:tasks.workunit.client.0.smithi118.stdout:6/187: dwrite d8/d14/f2b [0,4194304] 0 2024-09-21T11:39:19.638 INFO:tasks.workunit.client.1.smithi149.stdout:6/738: chown d8/d32/d37/d28/d87/da4 518527659 1 2024-09-21T11:39:19.639 INFO:tasks.workunit.client.0.smithi118.stdout:6/188: write d8/f38 [5012977,99693] 0 2024-09-21T11:39:19.639 INFO:tasks.workunit.client.0.smithi118.stdout:3/182: mknod d5/d28/d33/c45 0 2024-09-21T11:39:19.642 INFO:tasks.workunit.client.1.smithi149.stdout:8/705: rename d3/d12/d6e/d79/fbc to d3/d3c/fef 0 2024-09-21T11:39:19.644 INFO:tasks.workunit.client.1.smithi149.stdout:4/834: creat d4/d4d/d5f/d71/ddc/f11d x:0 0 0 2024-09-21T11:39:19.645 INFO:tasks.workunit.client.1.smithi149.stdout:5/890: dwrite d4/d7/d40/d43/d49/fe6 [0,4194304] 0 2024-09-21T11:39:19.647 INFO:tasks.workunit.client.1.smithi149.stdout:4/835: chown d4/d6/d63/d15/d16/d23/cab 561676802 1 2024-09-21T11:39:19.648 INFO:tasks.workunit.client.0.smithi118.stdout:6/189: creat d8/d14/d33/f3f x:0 0 0 2024-09-21T11:39:19.651 INFO:tasks.workunit.client.0.smithi118.stdout:8/427: symlink d2/dc/d16/d46/d4c/d63/l8a 0 2024-09-21T11:39:19.656 INFO:tasks.workunit.client.1.smithi149.stdout:7/877: rename d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f10b to d12/d5b/db5/dc5/de9/d4a/d4f/f115 0 2024-09-21T11:39:19.657 INFO:tasks.workunit.client.0.smithi118.stdout:8/428: rename d2 to d2/dc/d35/d8b 22 2024-09-21T11:39:19.660 INFO:tasks.workunit.client.1.smithi149.stdout:2/916: symlink d8/da/d13/l13c 0 2024-09-21T11:39:19.662 INFO:tasks.workunit.client.0.smithi118.stdout:8/429: mknod d2/dc/d16/c8c 0 2024-09-21T11:39:19.663 INFO:tasks.workunit.client.1.smithi149.stdout:5/891: symlink d4/d1d/d50/dc8/l122 0 2024-09-21T11:39:19.664 INFO:tasks.workunit.client.1.smithi149.stdout:6/739: mkdir d8/d32/d37/d2b/d51/df5/dfb 0 2024-09-21T11:39:19.665 INFO:tasks.workunit.client.0.smithi118.stdout:3/183: write d5/d28/d3e/f44 [3229412,129269] 0 2024-09-21T11:39:19.665 INFO:tasks.workunit.client.1.smithi149.stdout:5/892: stat d4/d7/d40/d43/d5c/c9d 0 2024-09-21T11:39:19.666 INFO:tasks.workunit.client.1.smithi149.stdout:6/740: fsync d8/d32/f46 0 2024-09-21T11:39:19.667 INFO:tasks.workunit.client.0.smithi118.stdout:3/184: write d5/d1d/f25 [4227693,115555] 0 2024-09-21T11:39:19.667 INFO:tasks.workunit.client.1.smithi149.stdout:9/795: rename d18/d36/d3c/d47/db5/fdb to d18/d19/d1a/d2f/d43/ffc 0 2024-09-21T11:39:19.668 INFO:tasks.workunit.client.1.smithi149.stdout:8/706: write d3/f37 [4772720,128806] 0 2024-09-21T11:39:19.668 INFO:tasks.workunit.client.1.smithi149.stdout:6/741: write d8/da/d11/fcd [424257,120467] 0 2024-09-21T11:39:19.669 INFO:tasks.workunit.client.1.smithi149.stdout:1/750: dwrite d2/dd/d35/d1c/d7a/fae [0,4194304] 0 2024-09-21T11:39:19.670 INFO:tasks.workunit.client.0.smithi118.stdout:8/430: dwrite d2/d32/f80 [0,4194304] 0 2024-09-21T11:39:19.670 INFO:tasks.workunit.client.1.smithi149.stdout:9/796: write d18/d4c/f67 [6332225,12648] 0 2024-09-21T11:39:19.672 INFO:tasks.workunit.client.1.smithi149.stdout:6/742: fsync d8/d32/d37/d28/d2e/f3b 0 2024-09-21T11:39:19.672 INFO:tasks.workunit.client.1.smithi149.stdout:0/751: creat dd/d1a/d1b/d72/d78/dc4/d3a/dd1/ff9 x:0 0 0 2024-09-21T11:39:19.677 INFO:tasks.workunit.client.0.smithi118.stdout:3/185: dwrite d5/d1d/f25 [0,4194304] 0 2024-09-21T11:39:19.679 INFO:tasks.workunit.client.1.smithi149.stdout:7/878: rename d12/d5b/db5/dc5/de9/d68/dc4/d30/c10a to d12/d5b/db5/dc5/de9/d4a/ddd/c116 0 2024-09-21T11:39:19.689 INFO:tasks.workunit.client.0.smithi118.stdout:8/431: link d2/dc/d10/d2e/l19 d2/dc/d16/d46/d4c/d63/d68/l8d 0 2024-09-21T11:39:19.691 INFO:tasks.workunit.client.1.smithi149.stdout:5/893: dwrite d4/d1d/f6f [0,4194304] 0 2024-09-21T11:39:19.694 INFO:tasks.workunit.client.0.smithi118.stdout:3/186: link d5/d1d/d1b/d24/l2f d5/d28/d3e/l46 0 2024-09-21T11:39:19.695 INFO:tasks.workunit.client.1.smithi149.stdout:9/797: symlink d18/d19/d1a/d2f/d53/d64/lfd 0 2024-09-21T11:39:19.695 INFO:tasks.workunit.client.1.smithi149.stdout:0/752: fsync dd/d2d/f7f 0 2024-09-21T11:39:19.695 INFO:tasks.workunit.client.0.smithi118.stdout:3/187: write d5/d28/f2b [1621652,8792] 0 2024-09-21T11:39:19.697 INFO:tasks.workunit.client.0.smithi118.stdout:3/188: write d5/d28/d3e/f44 [3886366,63696] 0 2024-09-21T11:39:19.700 INFO:tasks.workunit.client.1.smithi149.stdout:6/743: write d8/da/d14/ff7 [1316781,48434] 0 2024-09-21T11:39:19.700 INFO:tasks.workunit.client.1.smithi149.stdout:1/751: dwrite d2/d2b/f31 [0,4194304] 0 2024-09-21T11:39:19.700 INFO:tasks.workunit.client.0.smithi118.stdout:8/432: dread d2/dc/d10/d3b/f64 [0,4194304] 0 2024-09-21T11:39:19.709 INFO:tasks.workunit.client.0.smithi118.stdout:3/189: dwrite d5/d1d/d1b/d24/f37 [0,4194304] 0 2024-09-21T11:39:19.711 INFO:tasks.workunit.client.0.smithi118.stdout:8/433: creat d2/dc/d16/d46/f8e x:0 0 0 2024-09-21T11:39:19.715 INFO:tasks.workunit.client.0.smithi118.stdout:3/190: creat d5/d28/f47 x:0 0 0 2024-09-21T11:39:19.717 INFO:tasks.workunit.client.0.smithi118.stdout:8/434: mkdir d2/d7c/d88/d8f 0 2024-09-21T11:39:19.719 INFO:tasks.workunit.client.0.smithi118.stdout:3/191: mknod d5/d28/d33/c48 0 2024-09-21T11:39:19.720 INFO:tasks.workunit.client.0.smithi118.stdout:8/435: creat d2/dc/d10/f90 x:0 0 0 2024-09-21T11:39:19.724 INFO:tasks.workunit.client.0.smithi118.stdout:3/192: dwrite d5/f10 [0,4194304] 0 2024-09-21T11:39:19.725 INFO:tasks.workunit.client.0.smithi118.stdout:8/436: rmdir d2/dc/d16/d46/d4c/d63/d68 39 2024-09-21T11:39:19.729 INFO:tasks.workunit.client.0.smithi118.stdout:3/193: rmdir d5/d28 39 2024-09-21T11:39:19.731 INFO:tasks.workunit.client.0.smithi118.stdout:8/437: rename d2/cb to d2/dc/d10/d2e/d18/c91 0 2024-09-21T11:39:19.731 INFO:tasks.workunit.client.1.smithi149.stdout:3/857: sync 2024-09-21T11:39:19.732 INFO:tasks.workunit.client.1.smithi149.stdout:5/894: creat d4/d7/d40/d43/d49/d88/de0/f123 x:0 0 0 2024-09-21T11:39:19.733 INFO:tasks.workunit.client.0.smithi118.stdout:3/194: rmdir d5 39 2024-09-21T11:39:19.734 INFO:tasks.workunit.client.1.smithi149.stdout:2/917: getdents d8/d11/d88/dd4/de5 0 2024-09-21T11:39:19.734 INFO:tasks.workunit.client.1.smithi149.stdout:2/918: chown d8/d20/f40 193 1 2024-09-21T11:39:19.739 INFO:tasks.workunit.client.0.smithi118.stdout:3/195: creat d5/d1d/f49 x:0 0 0 2024-09-21T11:39:19.743 INFO:tasks.workunit.client.1.smithi149.stdout:5/895: mkdir d4/d1d/d50/d54/d2a/d124 0 2024-09-21T11:39:19.745 INFO:tasks.workunit.client.0.smithi118.stdout:3/196: mkdir d5/d28/d33/d4a 0 2024-09-21T11:39:19.746 INFO:tasks.workunit.client.0.smithi118.stdout:3/197: dread - d5/d28/d33/f3c zero size 2024-09-21T11:39:19.748 INFO:tasks.workunit.client.0.smithi118.stdout:3/198: mkdir d5/d1d/d1b/d4b 0 2024-09-21T11:39:19.750 INFO:tasks.workunit.client.1.smithi149.stdout:5/896: chown d4/d1d/d3e/cc6 68634 1 2024-09-21T11:39:19.750 INFO:tasks.workunit.client.1.smithi149.stdout:7/879: link d12/c40 d12/d5b/c117 0 2024-09-21T11:39:19.751 INFO:tasks.workunit.client.0.smithi118.stdout:3/199: mkdir d5/d1d/d1b/d4c 0 2024-09-21T11:39:19.752 INFO:tasks.workunit.client.1.smithi149.stdout:0/753: rename dd/l10 to dd/d1a/d1b/d72/d78/lfa 0 2024-09-21T11:39:19.753 INFO:tasks.workunit.client.1.smithi149.stdout:0/754: readlink dd/d1a/d1b/d72/d78/dc4/d3a/l61 0 2024-09-21T11:39:19.754 INFO:tasks.workunit.client.1.smithi149.stdout:3/858: creat d6/d1f/d47/f128 x:0 0 0 2024-09-21T11:39:19.755 INFO:tasks.workunit.client.0.smithi118.stdout:8/438: dread d2/d32/f3c [4194304,4194304] 0 2024-09-21T11:39:19.756 INFO:tasks.workunit.client.1.smithi149.stdout:0/755: dread dd/d1a/d1b/d50/fcd [0,4194304] 0 2024-09-21T11:39:19.756 INFO:tasks.workunit.client.0.smithi118.stdout:3/200: getdents d5/d1d/d1b/d4b 0 2024-09-21T11:39:19.759 INFO:tasks.workunit.client.0.smithi118.stdout:8/439: creat d2/d73/f92 x:0 0 0 2024-09-21T11:39:19.760 INFO:tasks.workunit.client.0.smithi118.stdout:3/201: chown d5/d1d/l3a 47273 1 2024-09-21T11:39:19.762 INFO:tasks.workunit.client.0.smithi118.stdout:8/440: mknod d2/dc/d10/c93 0 2024-09-21T11:39:19.763 INFO:tasks.workunit.client.1.smithi149.stdout:8/707: truncate d3/f1d 3480402 0 2024-09-21T11:39:19.765 INFO:tasks.workunit.client.1.smithi149.stdout:5/897: dread d4/d1d/d50/d54/d2a/d93/fab [0,4194304] 0 2024-09-21T11:39:19.766 INFO:tasks.workunit.client.0.smithi118.stdout:3/202: dwrite d5/d28/f2b [0,4194304] 0 2024-09-21T11:39:19.766 INFO:tasks.workunit.client.1.smithi149.stdout:6/744: write d8/da/d11/f25 [816605,104637] 0 2024-09-21T11:39:19.766 INFO:tasks.workunit.client.1.smithi149.stdout:8/708: dread d3/f20 [4194304,4194304] 0 2024-09-21T11:39:19.768 INFO:tasks.workunit.client.0.smithi118.stdout:8/441: creat d2/d73/f94 x:0 0 0 2024-09-21T11:39:19.769 INFO:tasks.workunit.client.0.smithi118.stdout:8/442: write d2/dc/d10/f90 [347487,34926] 0 2024-09-21T11:39:19.774 INFO:tasks.workunit.client.1.smithi149.stdout:7/880: creat d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/f118 x:0 0 0 2024-09-21T11:39:19.775 INFO:tasks.workunit.client.1.smithi149.stdout:1/752: dwrite d2/dd/fa1 [0,4194304] 0 2024-09-21T11:39:19.775 INFO:tasks.workunit.client.0.smithi118.stdout:3/203: mknod d5/c4d 0 2024-09-21T11:39:19.777 INFO:tasks.workunit.client.0.smithi118.stdout:8/443: dwrite d2/dc/d49/f77 [0,4194304] 0 2024-09-21T11:39:19.777 INFO:tasks.workunit.client.1.smithi149.stdout:1/753: write d2/dd/d35/d1c/d7a/fdf [742810,18407] 0 2024-09-21T11:39:19.780 INFO:tasks.workunit.client.0.smithi118.stdout:3/204: creat d5/d1d/f4e x:0 0 0 2024-09-21T11:39:19.781 INFO:tasks.workunit.client.1.smithi149.stdout:6/745: mknod d8/d32/d37/d28/d2e/cfc 0 2024-09-21T11:39:19.781 INFO:tasks.workunit.client.1.smithi149.stdout:2/919: dwrite d8/d44/d63/f75 [0,4194304] 0 2024-09-21T11:39:19.782 INFO:tasks.workunit.client.1.smithi149.stdout:2/920: chown d8/cc4 77 1 2024-09-21T11:39:19.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/709: write d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fc6 [8395157,85586] 0 2024-09-21T11:39:19.787 INFO:tasks.workunit.client.0.smithi118.stdout:3/205: creat d5/d28/d33/d4a/f4f x:0 0 0 2024-09-21T11:39:19.787 INFO:tasks.workunit.client.0.smithi118.stdout:8/444: dwrite d2/dc/d16/f87 [0,4194304] 0 2024-09-21T11:39:19.789 INFO:tasks.workunit.client.0.smithi118.stdout:3/206: fdatasync d5/d1d/f49 0 2024-09-21T11:39:19.797 INFO:tasks.workunit.client.0.smithi118.stdout:3/207: dwrite d5/d1d/f19 [0,4194304] 0 2024-09-21T11:39:19.799 INFO:tasks.workunit.client.1.smithi149.stdout:0/756: getdents dd/d1a/d5a 0 2024-09-21T11:39:19.800 INFO:tasks.workunit.client.1.smithi149.stdout:8/710: dwrite d3/d12/d98/fa7 [0,4194304] 0 2024-09-21T11:39:19.805 INFO:tasks.workunit.client.0.smithi118.stdout:3/208: mkdir d5/d1d/d1b/d50 0 2024-09-21T11:39:19.808 INFO:tasks.workunit.client.1.smithi149.stdout:5/898: getdents d4/d7/d40/d43/d49 0 2024-09-21T11:39:19.808 INFO:tasks.workunit.client.1.smithi149.stdout:3/859: truncate d6/d1f/d47/d37/d3a/f6b 914206 0 2024-09-21T11:39:19.814 INFO:tasks.workunit.client.1.smithi149.stdout:1/754: getdents d2/d5/d65/d96 0 2024-09-21T11:39:19.818 INFO:tasks.workunit.client.1.smithi149.stdout:8/711: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d90/df0 0 2024-09-21T11:39:19.819 INFO:tasks.workunit.client.1.smithi149.stdout:7/881: dread d12/d5b/db5/dc5/de9/d4a/f72 [0,4194304] 0 2024-09-21T11:39:19.820 INFO:tasks.workunit.client.1.smithi149.stdout:3/860: dread d6/d1f/d4c/f8f [0,4194304] 0 2024-09-21T11:39:19.820 INFO:tasks.workunit.client.1.smithi149.stdout:3/861: stat f3 0 2024-09-21T11:39:19.820 INFO:tasks.workunit.client.1.smithi149.stdout:2/921: write d8/da/d13/f2e [520615,60516] 0 2024-09-21T11:39:19.821 INFO:tasks.workunit.client.1.smithi149.stdout:5/899: mknod d4/d7/d40/d43/d5c/d7a/d81/dea/c125 0 2024-09-21T11:39:19.822 INFO:tasks.workunit.client.1.smithi149.stdout:6/746: write d8/d32/d37/d28/f30 [3631515,60438] 0 2024-09-21T11:39:19.823 INFO:tasks.workunit.client.1.smithi149.stdout:1/755: mkdir d2/d5/d8/dc1/dd6/df5 0 2024-09-21T11:39:19.824 INFO:tasks.workunit.client.1.smithi149.stdout:7/882: chown d12/d5b/db5/dc5/de9/d4a/d6c/da0/db9/fe7 57 1 2024-09-21T11:39:19.824 INFO:tasks.workunit.client.1.smithi149.stdout:8/712: chown d3/d3c/fef 1 1 2024-09-21T11:39:19.824 INFO:tasks.workunit.client.1.smithi149.stdout:5/900: chown d4/d7/d40/d43/d49/d88/d116 4398624 1 2024-09-21T11:39:19.828 INFO:tasks.workunit.client.1.smithi149.stdout:8/713: dread d3/d33/d34/d72/fba [0,4194304] 0 2024-09-21T11:39:19.828 INFO:tasks.workunit.client.0.smithi118.stdout:8/445: dwrite d2/d32/f6c [0,4194304] 0 2024-09-21T11:39:19.828 INFO:tasks.workunit.client.1.smithi149.stdout:2/922: mkdir d8/d13d 0 2024-09-21T11:39:19.833 INFO:tasks.workunit.client.0.smithi118.stdout:8/446: creat d2/dc/d35/d50/f95 x:0 0 0 2024-09-21T11:39:19.835 INFO:tasks.workunit.client.0.smithi118.stdout:3/209: dwrite d5/d1d/f12 [0,4194304] 0 2024-09-21T11:39:19.839 INFO:tasks.workunit.client.0.smithi118.stdout:8/447: mkdir d2/d32/d96 0 2024-09-21T11:39:19.840 INFO:tasks.workunit.client.0.smithi118.stdout:3/210: dread d5/d1d/f25 [0,4194304] 0 2024-09-21T11:39:19.845 INFO:tasks.workunit.client.1.smithi149.stdout:4/836: sync 2024-09-21T11:39:19.848 INFO:tasks.workunit.client.0.smithi118.stdout:3/211: dwrite d5/d1d/f32 [4194304,4194304] 0 2024-09-21T11:39:19.848 INFO:tasks.workunit.client.1.smithi149.stdout:2/923: chown d8/da/d13/d83/df6 51546149 1 2024-09-21T11:39:19.849 INFO:tasks.workunit.client.0.smithi118.stdout:3/212: fdatasync d5/d1d/f49 0 2024-09-21T11:39:19.849 INFO:tasks.workunit.client.1.smithi149.stdout:3/862: dwrite d6/d1f/fbd [0,4194304] 0 2024-09-21T11:39:19.850 INFO:tasks.workunit.client.1.smithi149.stdout:5/901: mkdir d4/d1d/d50/d60/db1/d126 0 2024-09-21T11:39:19.852 INFO:tasks.workunit.client.0.smithi118.stdout:3/213: symlink d5/d1d/d1b/d4c/l51 0 2024-09-21T11:39:19.855 INFO:tasks.workunit.client.0.smithi118.stdout:3/214: unlink d5/d1d/d1b/f40 0 2024-09-21T11:39:19.855 INFO:tasks.workunit.client.1.smithi149.stdout:4/837: dread - d4/d6/d63/d15/d30/d8a/da7/f11a zero size 2024-09-21T11:39:19.856 INFO:tasks.workunit.client.0.smithi118.stdout:3/215: write d5/d1d/d1b/d24/f36 [485290,5389] 0 2024-09-21T11:39:19.857 INFO:tasks.workunit.client.0.smithi118.stdout:3/216: dread - d5/d28/d33/d4a/f4f zero size 2024-09-21T11:39:19.858 INFO:tasks.workunit.client.1.smithi149.stdout:1/756: dwrite d2/f2d [0,4194304] 0 2024-09-21T11:39:19.860 INFO:tasks.workunit.client.0.smithi118.stdout:3/217: symlink d5/d28/d3e/l52 0 2024-09-21T11:39:19.860 INFO:tasks.workunit.client.1.smithi149.stdout:5/902: rmdir d4/d1d/d3e 39 2024-09-21T11:39:19.860 INFO:tasks.workunit.client.1.smithi149.stdout:2/924: fdatasync d8/da/d13/d1a/d29/f58 0 2024-09-21T11:39:19.863 INFO:tasks.workunit.client.1.smithi149.stdout:8/714: getdents d3/d33/d34/d72/dbb 0 2024-09-21T11:39:19.863 INFO:tasks.workunit.client.1.smithi149.stdout:4/838: stat d4/d6/d63/d15/d30/d6b/c96 0 2024-09-21T11:39:19.863 INFO:tasks.workunit.client.1.smithi149.stdout:6/747: dread d8/d32/f55 [0,4194304] 0 2024-09-21T11:39:19.864 INFO:tasks.workunit.client.0.smithi118.stdout:3/218: link d5/c39 d5/d28/d3e/c53 0 2024-09-21T11:39:19.864 INFO:tasks.workunit.client.1.smithi149.stdout:2/925: mknod d8/da/d13/d53/c13e 0 2024-09-21T11:39:19.866 INFO:tasks.workunit.client.1.smithi149.stdout:1/757: rename d2/dd/d2e/deb to d2/dd/d35/d1c/d41/d74/df6 0 2024-09-21T11:39:19.866 INFO:tasks.workunit.client.1.smithi149.stdout:5/903: readlink d4/d7/d40/d43/d49/d88/dcd/ldc 0 2024-09-21T11:39:19.869 INFO:tasks.workunit.client.0.smithi118.stdout:3/219: dwrite d5/d1d/d1b/d24/f36 [0,4194304] 0 2024-09-21T11:39:19.874 INFO:tasks.workunit.client.1.smithi149.stdout:3/863: dwrite d6/d5f/d60/d88/fb1 [0,4194304] 0 2024-09-21T11:39:19.875 INFO:tasks.workunit.client.1.smithi149.stdout:3/864: dread - d6/d1f/d47/d37/dd6/ff7 zero size 2024-09-21T11:39:19.876 INFO:tasks.workunit.client.0.smithi118.stdout:8/448: dread d2/dc/d10/d3b/f6d [0,4194304] 0 2024-09-21T11:39:19.884 INFO:tasks.workunit.client.1.smithi149.stdout:0/757: sync 2024-09-21T11:39:19.884 INFO:tasks.workunit.client.1.smithi149.stdout:9/798: sync 2024-09-21T11:39:19.908 INFO:tasks.workunit.client.0.smithi118.stdout:3/220: creat d5/d28/f54 x:0 0 0 2024-09-21T11:39:19.911 INFO:tasks.workunit.client.0.smithi118.stdout:8/449: symlink d2/dc/d10/d3b/l97 0 2024-09-21T11:39:19.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/926: mknod d8/d20/d78/ddb/c13f 0 2024-09-21T11:39:19.914 INFO:tasks.workunit.client.0.smithi118.stdout:3/221: mkdir d5/d28/d33/d55 0 2024-09-21T11:39:19.914 INFO:tasks.workunit.client.1.smithi149.stdout:1/758: creat d2/dd/d35/d1c/d7a/ff7 x:0 0 0 2024-09-21T11:39:19.916 INFO:tasks.workunit.client.1.smithi149.stdout:6/748: rename d8/da/ff6 to d8/d32/d37/d79/ffd 0 2024-09-21T11:39:19.918 INFO:tasks.workunit.client.1.smithi149.stdout:3/865: mknod d6/d5f/c129 0 2024-09-21T11:39:19.918 INFO:tasks.workunit.client.1.smithi149.stdout:6/749: chown d8/d32/d37/d28/d2f/d6a/f95 1 1 2024-09-21T11:39:19.919 INFO:tasks.workunit.client.1.smithi149.stdout:0/758: write dd/d2d/f91 [4281767,115704] 0 2024-09-21T11:39:19.920 INFO:tasks.workunit.client.0.smithi118.stdout:8/450: creat d2/dc/d10/d2e/d18/d1a/f98 x:0 0 0 2024-09-21T11:39:19.921 INFO:tasks.workunit.client.1.smithi149.stdout:8/715: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1 0 2024-09-21T11:39:19.921 INFO:tasks.workunit.client.0.smithi118.stdout:8/451: chown d2/dc/d10/d2e/f21 2 1 2024-09-21T11:39:19.921 INFO:tasks.workunit.client.0.smithi118.stdout:8/452: chown d2/fa 30206275 1 2024-09-21T11:39:19.922 INFO:tasks.workunit.client.1.smithi149.stdout:2/927: read - d8/dd/d5c/d84/f104 zero size 2024-09-21T11:39:19.923 INFO:tasks.workunit.client.0.smithi118.stdout:8/453: write d2/dc/d10/d2e/f21 [7853198,105883] 0 2024-09-21T11:39:19.924 INFO:tasks.workunit.client.1.smithi149.stdout:4/839: rename d4/d4d/d5f/d71/dd1/def to d4/d6/d63/d78/d98/dee/d11e 0 2024-09-21T11:39:19.925 INFO:tasks.workunit.client.1.smithi149.stdout:4/840: write d4/d6/d63/d10/d6f/f93 [752250,3860] 0 2024-09-21T11:39:19.926 INFO:tasks.workunit.client.1.smithi149.stdout:9/799: creat d18/d19/d1a/df1/df5/ffe x:0 0 0 2024-09-21T11:39:19.927 INFO:tasks.workunit.client.0.smithi118.stdout:8/454: write d2/dc/d10/d3b/f64 [1177286,41576] 0 2024-09-21T11:39:19.927 INFO:tasks.workunit.client.1.smithi149.stdout:6/750: fsync d8/da/d14/f1f 0 2024-09-21T11:39:19.929 INFO:tasks.workunit.client.1.smithi149.stdout:0/759: mkdir dd/db3/dfb 0 2024-09-21T11:39:19.929 INFO:tasks.workunit.client.1.smithi149.stdout:4/841: write d4/d6/d63/d15/d30/d8a/da7/f11a [489277,34707] 0 2024-09-21T11:39:19.931 INFO:tasks.workunit.client.1.smithi149.stdout:7/883: sync 2024-09-21T11:39:19.932 INFO:tasks.workunit.client.0.smithi118.stdout:8/455: rename d2/d32/d96 to d2/dc/d49/d84/d99 0 2024-09-21T11:39:19.933 INFO:tasks.workunit.client.1.smithi149.stdout:0/760: chown dd/d1a/d1b/d72/d78/dc4/d3a/d66/f69 1958 1 2024-09-21T11:39:19.933 INFO:tasks.workunit.client.1.smithi149.stdout:4/842: write d4/d6/d63/d78/d98/dee/fe4 [4232048,43092] 0 2024-09-21T11:39:19.934 INFO:tasks.workunit.client.1.smithi149.stdout:2/928: creat d8/da/d13/d2d/d6f/de8/f140 x:0 0 0 2024-09-21T11:39:19.937 INFO:tasks.workunit.client.1.smithi149.stdout:4/843: write d4/d6/d63/d78/d98/dee/fe4 [2960557,98686] 0 2024-09-21T11:39:19.939 INFO:tasks.workunit.client.1.smithi149.stdout:6/751: dwrite d8/d32/d37/d2b/d51/fde [0,4194304] 0 2024-09-21T11:39:19.940 INFO:tasks.workunit.client.1.smithi149.stdout:4/844: write d4/d6/d63/d78/fff [3723605,74279] 0 2024-09-21T11:39:19.940 INFO:tasks.workunit.client.1.smithi149.stdout:5/904: dread d4/d1d/d50/dc8/f103 [4194304,4194304] 0 2024-09-21T11:39:19.943 INFO:tasks.workunit.client.1.smithi149.stdout:1/759: creat d2/dd/ff8 x:0 0 0 2024-09-21T11:39:19.945 INFO:tasks.workunit.client.1.smithi149.stdout:9/800: dread d18/d19/d1a/f2d [0,4194304] 0 2024-09-21T11:39:19.946 INFO:tasks.workunit.client.1.smithi149.stdout:8/716: link d3/d12/d6e/d79/fe8 d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/ff2 0 2024-09-21T11:39:19.950 INFO:tasks.workunit.client.1.smithi149.stdout:3/866: creat d6/d1f/d47/d22/f12a x:0 0 0 2024-09-21T11:39:19.952 INFO:tasks.workunit.client.1.smithi149.stdout:2/929: creat d8/dd/d8c/de0/f141 x:0 0 0 2024-09-21T11:39:19.955 INFO:tasks.workunit.client.1.smithi149.stdout:5/905: fdatasync d4/d1d/dde/f104 0 2024-09-21T11:39:19.959 INFO:tasks.workunit.client.0.smithi118.stdout:8/456: truncate d2/dc/d10/d2e/f21 5237731 0 2024-09-21T11:39:19.963 INFO:tasks.workunit.client.1.smithi149.stdout:2/930: read - d8/d11/fee zero size 2024-09-21T11:39:19.968 INFO:tasks.workunit.client.1.smithi149.stdout:1/760: truncate d2/d5/d65/f79 7660500 0 2024-09-21T11:39:19.971 INFO:tasks.workunit.client.1.smithi149.stdout:0/761: creat dd/d1a/d1b/d72/d87/ffc x:0 0 0 2024-09-21T11:39:19.971 INFO:tasks.workunit.client.1.smithi149.stdout:5/906: write d4/d7/d40/d43/d5c/f66 [1129282,122063] 0 2024-09-21T11:39:19.972 INFO:tasks.workunit.client.1.smithi149.stdout:3/867: symlink d6/d1f/d47/d37/d3a/d95/df8/l12b 0 2024-09-21T11:39:19.973 INFO:tasks.workunit.client.1.smithi149.stdout:5/907: write d4/ff3 [3544576,47092] 0 2024-09-21T11:39:19.975 INFO:tasks.workunit.client.1.smithi149.stdout:2/931: chown d8/dd/d5c/l8f 7227559 1 2024-09-21T11:39:19.975 INFO:tasks.workunit.client.1.smithi149.stdout:3/868: chown d6/d1f/d47/d22/l30 802864 1 2024-09-21T11:39:19.977 INFO:tasks.workunit.client.1.smithi149.stdout:8/717: dread d3/d33/d34/d55/d5e/d9e/dc2/f3f [0,4194304] 0 2024-09-21T11:39:19.978 INFO:tasks.workunit.client.1.smithi149.stdout:5/908: chown d4/d1d/d50/d54/d2a/f3f 31680582 1 2024-09-21T11:39:19.978 INFO:tasks.workunit.client.1.smithi149.stdout:3/869: chown d6/d1f/d4c/cd4 43499 1 2024-09-21T11:39:19.978 INFO:tasks.workunit.client.1.smithi149.stdout:4/845: getdents d4/d4d/d5f/d71/dd1 0 2024-09-21T11:39:19.979 INFO:tasks.workunit.client.0.smithi118.stdout:8/457: dwrite d2/dc/d10/d2e/f21 [4194304,4194304] 0 2024-09-21T11:39:19.980 INFO:tasks.workunit.client.1.smithi149.stdout:7/884: dwrite d12/d5b/db5/dc5/de9/d4a/d6c/d8c/fcb [0,4194304] 0 2024-09-21T11:39:19.981 INFO:tasks.workunit.client.1.smithi149.stdout:6/752: link d8/d32/d37/d28/dc8/ce6 d8/d32/d37/d2b/cfe 0 2024-09-21T11:39:19.983 INFO:tasks.workunit.client.1.smithi149.stdout:1/761: write d2/dd/d35/d5b/fbd [1432799,119723] 0 2024-09-21T11:39:19.984 INFO:tasks.workunit.client.1.smithi149.stdout:4/846: chown d4/d6/d63/d78/d98/dcc/l10a 922693 1 2024-09-21T11:39:19.984 INFO:tasks.workunit.client.0.smithi118.stdout:8/458: write d2/d32/f59 [3085384,43901] 0 2024-09-21T11:39:19.986 INFO:tasks.workunit.client.1.smithi149.stdout:2/932: rename f7 to d8/d44/d63/db9/d5a/f142 0 2024-09-21T11:39:19.986 INFO:tasks.workunit.client.1.smithi149.stdout:3/870: mkdir d6/d5f/d60/d88/de7/d12c 0 2024-09-21T11:39:19.990 INFO:tasks.workunit.client.1.smithi149.stdout:6/753: write d8/d32/d37/d28/ff3 [675413,46120] 0 2024-09-21T11:39:19.997 INFO:tasks.workunit.client.1.smithi149.stdout:2/933: rmdir d8/da/d13/d2d/d6f 39 2024-09-21T11:39:19.997 INFO:tasks.workunit.client.0.smithi118.stdout:8/459: dwrite d2/dc/d10/d2e/f55 [0,4194304] 0 2024-09-21T11:39:19.998 INFO:tasks.workunit.client.1.smithi149.stdout:6/754: unlink d8/d32/f46 0 2024-09-21T11:39:19.999 INFO:tasks.workunit.client.0.smithi118.stdout:8/460: chown d2/dc/d10/d3b/f64 130065513 1 2024-09-21T11:39:19.999 INFO:tasks.workunit.client.1.smithi149.stdout:0/762: dwrite dd/d1a/d1b/d72/d78/dc4/d3a/dd1/dde/fed [0,4194304] 0 2024-09-21T11:39:20.001 INFO:tasks.workunit.client.1.smithi149.stdout:8/718: dread d3/d33/f9b [0,4194304] 0 2024-09-21T11:39:20.001 INFO:tasks.workunit.client.1.smithi149.stdout:5/909: truncate d4/d7/d40/f65 8111514 0 2024-09-21T11:39:20.002 INFO:tasks.workunit.client.0.smithi118.stdout:8/461: creat d2/d73/d79/f9a x:0 0 0 2024-09-21T11:39:20.003 INFO:tasks.workunit.client.1.smithi149.stdout:3/871: creat d6/d1f/d47/d37/f12d x:0 0 0 2024-09-21T11:39:20.003 INFO:tasks.workunit.client.0.smithi118.stdout:8/462: chown d2/dc/d10/d2e/d18/d1a/f1b 160920 1 2024-09-21T11:39:20.009 INFO:tasks.workunit.client.1.smithi149.stdout:9/801: sync 2024-09-21T11:39:20.009 INFO:tasks.workunit.client.0.smithi118.stdout:8/463: dwrite d2/d32/f6c [0,4194304] 0 2024-09-21T11:39:20.012 INFO:tasks.workunit.client.1.smithi149.stdout:4/847: link d4/d4d/d5f/c119 d4/d6/d63/d2d/dd6/c11f 0 2024-09-21T11:39:20.015 INFO:tasks.workunit.client.0.smithi118.stdout:8/464: mkdir d2/dc/d10/d2e/d9b 0 2024-09-21T11:39:20.016 INFO:tasks.workunit.client.1.smithi149.stdout:9/802: read d18/d36/d3c/d47/d76/fc3 [4178,21874] 0 2024-09-21T11:39:20.018 INFO:tasks.workunit.client.1.smithi149.stdout:1/762: dwrite d2/d5/f7d [4194304,4194304] 0 2024-09-21T11:39:20.020 INFO:tasks.workunit.client.1.smithi149.stdout:7/885: dwrite d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/dab/fd8 [0,4194304] 0 2024-09-21T11:39:20.021 INFO:tasks.workunit.client.1.smithi149.stdout:1/763: truncate d2/d5/d8/fc4 981050 0 2024-09-21T11:39:20.022 INFO:tasks.workunit.client.1.smithi149.stdout:0/763: unlink dd/d1a/d1b/d81/d97/lb1 0 2024-09-21T11:39:20.025 INFO:tasks.workunit.client.1.smithi149.stdout:7/886: write d12/d5b/db5/dc5/de9/d4a/d6c/db1/fe4 [698743,44580] 0 2024-09-21T11:39:20.025 INFO:tasks.workunit.client.1.smithi149.stdout:8/719: link d3/d33/fc4 d3/d33/d34/d72/dbb/dda/ff3 0 2024-09-21T11:39:20.029 INFO:tasks.workunit.client.0.smithi118.stdout:8/465: creat d2/dc/d10/d2e/d18/f9c x:0 0 0 2024-09-21T11:39:20.030 INFO:tasks.workunit.client.0.smithi118.stdout:8/466: dread d2/f72 [0,4194304] 0 2024-09-21T11:39:20.033 INFO:tasks.workunit.client.1.smithi149.stdout:0/764: symlink dd/d35/lfd 0 2024-09-21T11:39:20.034 INFO:tasks.workunit.client.1.smithi149.stdout:1/764: symlink d2/d5/d3d/d88/lf9 0 2024-09-21T11:39:20.039 INFO:tasks.workunit.client.1.smithi149.stdout:8/720: rmdir d3/d12/d6e/d79 39 2024-09-21T11:39:20.040 INFO:tasks.workunit.client.0.smithi118.stdout:8/467: creat d2/dc/d16/d46/d4c/d63/f9d x:0 0 0 2024-09-21T11:39:20.043 INFO:tasks.workunit.client.0.smithi118.stdout:8/468: fdatasync d2/f29 0 2024-09-21T11:39:20.046 INFO:tasks.workunit.client.1.smithi149.stdout:5/910: creat d4/d1d/d50/d54/f127 x:0 0 0 2024-09-21T11:39:20.046 INFO:tasks.workunit.client.1.smithi149.stdout:8/721: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/f8d [4194304,4194304] 0 2024-09-21T11:39:20.052 INFO:tasks.workunit.client.0.smithi118.stdout:8/469: rename d2/dc/d10/d2e/d18/d36/c81 to d2/d7c/d88/d8f/c9e 0 2024-09-21T11:39:20.054 INFO:tasks.workunit.client.1.smithi149.stdout:0/765: creat dd/db3/ffe x:0 0 0 2024-09-21T11:39:20.055 INFO:tasks.workunit.client.1.smithi149.stdout:2/934: getdents d8/da/d13/d5d 0 2024-09-21T11:39:20.057 INFO:tasks.workunit.client.1.smithi149.stdout:2/935: fdatasync d8/da/d13/d1a/d29/fa4 0 2024-09-21T11:39:20.061 INFO:tasks.workunit.client.1.smithi149.stdout:1/765: dread d2/dd/d35/d1c/d2c/f69 [0,4194304] 0 2024-09-21T11:39:20.062 INFO:tasks.workunit.client.1.smithi149.stdout:3/872: dwrite d6/d1f/d47/d37/f7b [0,4194304] 0 2024-09-21T11:39:20.064 INFO:tasks.workunit.client.1.smithi149.stdout:0/766: dwrite dd/f15 [0,4194304] 0 2024-09-21T11:39:20.158 INFO:tasks.workunit.client.1.smithi149.stdout:0/767: sync 2024-09-21T11:39:20.234 INFO:tasks.workunit.client.0.smithi118.stdout:0/510: sync 2024-09-21T11:39:20.234 INFO:tasks.workunit.client.0.smithi118.stdout:1/289: sync 2024-09-21T11:39:20.234 INFO:tasks.workunit.client.0.smithi118.stdout:7/200: sync 2024-09-21T11:39:20.234 INFO:tasks.workunit.client.0.smithi118.stdout:9/294: sync 2024-09-21T11:39:20.234 INFO:tasks.workunit.client.0.smithi118.stdout:5/257: sync 2024-09-21T11:39:20.234 INFO:tasks.workunit.client.0.smithi118.stdout:4/180: sync 2024-09-21T11:39:20.234 INFO:tasks.workunit.client.0.smithi118.stdout:2/143: sync 2024-09-21T11:39:20.234 INFO:tasks.workunit.client.1.smithi149.stdout:6/755: truncate d8/d32/d37/d28/d2f/d6a/d72/fac 1605705 0 2024-09-21T11:39:20.239 INFO:tasks.workunit.client.1.smithi149.stdout:4/848: creat d4/d6/d63/d15/f120 x:0 0 0 2024-09-21T11:39:20.240 INFO:tasks.workunit.client.1.smithi149.stdout:9/803: truncate d18/d19/d1a/d2f/faa 665857 0 2024-09-21T11:39:20.241 INFO:tasks.workunit.client.1.smithi149.stdout:9/804: chown d18/d36/d3c/d47/d99/dbe/dc7 5224 1 2024-09-21T11:39:20.242 INFO:tasks.workunit.client.1.smithi149.stdout:5/911: symlink d4/d7/d40/d43/d5c/l128 0 2024-09-21T11:39:20.242 INFO:tasks.workunit.client.0.smithi118.stdout:1/290: rmdir d6/d3b/d45 39 2024-09-21T11:39:20.244 INFO:tasks.workunit.client.1.smithi149.stdout:8/722: creat d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/ff4 x:0 0 0 2024-09-21T11:39:20.248 INFO:tasks.workunit.client.0.smithi118.stdout:4/181: mkdir d2/d44 0 2024-09-21T11:39:20.250 INFO:tasks.workunit.client.0.smithi118.stdout:9/295: mknod d0/d20/c77 0 2024-09-21T11:39:20.251 INFO:tasks.workunit.client.0.smithi118.stdout:9/296: stat d0/d20/d4c/c61 0 2024-09-21T11:39:20.254 INFO:tasks.workunit.client.1.smithi149.stdout:2/936: creat d8/dcb/db8/dd3/f143 x:0 0 0 2024-09-21T11:39:20.255 INFO:tasks.workunit.client.0.smithi118.stdout:2/144: symlink de/d16/d1c/l34 0 2024-09-21T11:39:20.255 INFO:tasks.workunit.client.1.smithi149.stdout:4/849: dread d4/d6/d63/d15/d30/d8a/fd5 [0,4194304] 0 2024-09-21T11:39:20.256 INFO:tasks.workunit.client.1.smithi149.stdout:4/850: dread - d4/d4d/d5f/d71/ddc/f11d zero size 2024-09-21T11:39:20.257 INFO:tasks.workunit.client.0.smithi118.stdout:0/511: write d5/d34/f3b [803783,114130] 0 2024-09-21T11:39:20.257 INFO:tasks.workunit.client.1.smithi149.stdout:4/851: write d4/d4d/d5f/d71/ddc/f11d [16210,72988] 0 2024-09-21T11:39:20.257 INFO:tasks.workunit.client.0.smithi118.stdout:8/470: getdents d2/dc 0 2024-09-21T11:39:20.261 INFO:tasks.workunit.client.1.smithi149.stdout:2/937: dread d8/d20/f115 [0,4194304] 0 2024-09-21T11:39:20.265 INFO:tasks.workunit.client.0.smithi118.stdout:5/258: symlink d0/db/d35/l5c 0 2024-09-21T11:39:20.266 INFO:tasks.workunit.client.1.smithi149.stdout:6/756: rmdir d8/d32/d37/d28/d87 39 2024-09-21T11:39:20.267 INFO:tasks.workunit.client.1.smithi149.stdout:3/873: dread d6/d1f/d4c/fb4 [0,4194304] 0 2024-09-21T11:39:20.268 INFO:tasks.workunit.client.1.smithi149.stdout:3/874: write d6/d79/d7e/dcb/ffc [3177801,18715] 0 2024-09-21T11:39:20.268 INFO:tasks.workunit.client.1.smithi149.stdout:7/887: creat d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f119 x:0 0 0 2024-09-21T11:39:20.269 INFO:tasks.workunit.client.1.smithi149.stdout:3/875: truncate d6/d1f/d4c/f87 1781355 0 2024-09-21T11:39:20.271 INFO:tasks.workunit.client.0.smithi118.stdout:2/145: creat de/d1f/d20/f35 x:0 0 0 2024-09-21T11:39:20.273 INFO:tasks.workunit.client.1.smithi149.stdout:9/805: creat d18/d19/d1a/df1/df5/fff x:0 0 0 2024-09-21T11:39:20.275 INFO:tasks.workunit.client.0.smithi118.stdout:8/471: mknod d2/dc/d10/d2e/d18/d1a/c9f 0 2024-09-21T11:39:20.277 INFO:tasks.workunit.client.1.smithi149.stdout:8/723: mkdir d3/d3c/d8f/df5 0 2024-09-21T11:39:20.280 INFO:tasks.workunit.client.0.smithi118.stdout:2/146: dread de/f18 [0,4194304] 0 2024-09-21T11:39:20.280 INFO:tasks.workunit.client.0.smithi118.stdout:5/259: mknod d0/d6/d25/d50/c5d 0 2024-09-21T11:39:20.283 INFO:tasks.workunit.client.0.smithi118.stdout:9/297: symlink d0/d4/d45/d72/l78 0 2024-09-21T11:39:20.284 INFO:tasks.workunit.client.0.smithi118.stdout:9/298: dread - d0/d4/d23/f36 zero size 2024-09-21T11:39:20.286 INFO:tasks.workunit.client.1.smithi149.stdout:1/766: dwrite d2/f60 [0,4194304] 0 2024-09-21T11:39:20.286 INFO:tasks.workunit.client.0.smithi118.stdout:8/472: symlink d2/dc/d35/d42/la0 0 2024-09-21T11:39:20.287 INFO:tasks.workunit.client.0.smithi118.stdout:1/291: dwrite d6/d2a/f28 [0,4194304] 0 2024-09-21T11:39:20.288 INFO:tasks.workunit.client.1.smithi149.stdout:6/757: mkdir d8/d32/d37/d28/d2f/d6a/dff 0 2024-09-21T11:39:20.288 INFO:tasks.workunit.client.0.smithi118.stdout:1/292: write d6/de/d16/f4b [4713098,58611] 0 2024-09-21T11:39:20.290 INFO:tasks.workunit.client.0.smithi118.stdout:2/147: rmdir de/d1f 39 2024-09-21T11:39:20.292 INFO:tasks.workunit.client.0.smithi118.stdout:0/512: write d5/f5c [4627601,72543] 0 2024-09-21T11:39:20.295 INFO:tasks.workunit.client.0.smithi118.stdout:8/473: dread d2/d32/f3c [4194304,4194304] 0 2024-09-21T11:39:20.297 INFO:tasks.workunit.client.1.smithi149.stdout:7/888: truncate d12/d5b/db5/dc5/de9/d4a/d4f/f88 626978 0 2024-09-21T11:39:20.298 INFO:tasks.workunit.client.0.smithi118.stdout:9/299: write d0/f1c [79197,35269] 0 2024-09-21T11:39:20.298 INFO:tasks.workunit.client.1.smithi149.stdout:2/938: dread d8/da/d13/d1a/f114 [0,4194304] 0 2024-09-21T11:39:20.300 INFO:tasks.workunit.client.0.smithi118.stdout:1/293: dwrite d6/de/f22 [0,4194304] 0 2024-09-21T11:39:20.300 INFO:tasks.workunit.client.1.smithi149.stdout:7/889: write d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/dab/fd8 [1468300,13638] 0 2024-09-21T11:39:20.301 INFO:tasks.workunit.client.0.smithi118.stdout:2/148: symlink de/d16/d1c/l36 0 2024-09-21T11:39:20.302 INFO:tasks.workunit.client.1.smithi149.stdout:7/890: chown d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/faf 11130155 1 2024-09-21T11:39:20.302 INFO:tasks.workunit.client.1.smithi149.stdout:7/891: readlink d12/l23 0 2024-09-21T11:39:20.302 INFO:tasks.workunit.client.0.smithi118.stdout:5/260: truncate d0/d6/d25/d50/f55 2566652 0 2024-09-21T11:39:20.303 INFO:tasks.workunit.client.0.smithi118.stdout:5/261: chown d0/db 919000 1 2024-09-21T11:39:20.304 INFO:tasks.workunit.client.0.smithi118.stdout:5/262: write d0/fd [3721883,130055] 0 2024-09-21T11:39:20.305 INFO:tasks.workunit.client.0.smithi118.stdout:1/294: chown d6/de/d16/d3f/d50/d54/d32/f5a 0 1 2024-09-21T11:39:20.305 INFO:tasks.workunit.client.1.smithi149.stdout:5/912: mknod d4/d1d/d50/dc8/dff/c129 0 2024-09-21T11:39:20.306 INFO:tasks.workunit.client.0.smithi118.stdout:4/182: link d2/d6/dd/c2a d2/d6/de/d1c/d23/d26/c45 0 2024-09-21T11:39:20.306 INFO:tasks.workunit.client.0.smithi118.stdout:1/295: stat d6/de/d16/d3f/d50/d54/d32/f5a 0 2024-09-21T11:39:20.306 INFO:tasks.workunit.client.1.smithi149.stdout:5/913: dread - d4/d1d/d50/d60/db1/db4/fd2 zero size 2024-09-21T11:39:20.307 INFO:tasks.workunit.client.0.smithi118.stdout:5/263: truncate d0/f37 503418 0 2024-09-21T11:39:20.309 INFO:tasks.workunit.client.0.smithi118.stdout:0/513: creat d5/d10/d1e/d20/fb1 x:0 0 0 2024-09-21T11:39:20.311 INFO:tasks.workunit.client.0.smithi118.stdout:8/474: creat d2/dc/d35/d42/fa1 x:0 0 0 2024-09-21T11:39:20.312 INFO:tasks.workunit.client.0.smithi118.stdout:8/475: readlink d2/dc/d10/d3b/l97 0 2024-09-21T11:39:20.314 INFO:tasks.workunit.client.0.smithi118.stdout:9/300: rename d0/d20/l28 to d0/d20/d4c/d5f/l79 0 2024-09-21T11:39:20.316 INFO:tasks.workunit.client.0.smithi118.stdout:4/183: symlink d2/l46 0 2024-09-21T11:39:20.317 INFO:tasks.workunit.client.0.smithi118.stdout:0/514: dwrite d5/d10/d1e/d23/d3a/f8b [0,4194304] 0 2024-09-21T11:39:20.319 INFO:tasks.workunit.client.1.smithi149.stdout:1/767: symlink d2/dd/d35/d1c/d41/d51/d90/lfa 0 2024-09-21T11:39:20.319 INFO:tasks.workunit.client.0.smithi118.stdout:0/515: dread - d5/d34/d44/d87/d9a/faa zero size 2024-09-21T11:39:20.321 INFO:tasks.workunit.client.1.smithi149.stdout:6/758: symlink d8/da/d2c/d2d/d60/dc3/l100 0 2024-09-21T11:39:20.322 INFO:tasks.workunit.client.0.smithi118.stdout:0/516: truncate d5/d34/f82 273494 0 2024-09-21T11:39:20.323 INFO:tasks.workunit.client.1.smithi149.stdout:1/768: dread d2/dd/fa1 [0,4194304] 0 2024-09-21T11:39:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:20 smithi118 ceph-mon[28757]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 68 MiB/s rd, 218 MiB/s wr, 377 op/s 2024-09-21T11:39:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:20 smithi118 ceph-mon[28757]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:20.328 INFO:tasks.workunit.client.0.smithi118.stdout:5/264: symlink d0/l5e 0 2024-09-21T11:39:20.330 INFO:tasks.workunit.client.1.smithi149.stdout:2/939: chown d8/da/d13/d1a/c7d 1927898833 1 2024-09-21T11:39:20.332 INFO:tasks.workunit.client.0.smithi118.stdout:5/265: dread d0/f1b [0,4194304] 0 2024-09-21T11:39:20.335 INFO:tasks.workunit.client.1.smithi149.stdout:9/806: mknod d18/d19/d1a/d2f/d33/d91/dd7/c100 0 2024-09-21T11:39:20.342 INFO:tasks.workunit.client.0.smithi118.stdout:2/149: link de/d16/f32 de/f37 0 2024-09-21T11:39:20.343 INFO:tasks.workunit.client.1.smithi149.stdout:7/892: dread d12/d5b/db5/dc5/de9/d4a/d6c/da0/dbb/fe8 [0,4194304] 0 2024-09-21T11:39:20.343 INFO:tasks.workunit.client.1.smithi149.stdout:8/724: mknod d3/d3c/d8f/d76/cf6 0 2024-09-21T11:39:20.345 INFO:tasks.workunit.client.1.smithi149.stdout:4/852: rename d4/d6/d63/d15/d30/dd3/f113 to d4/d6/d63/d15/f121 0 2024-09-21T11:39:20.345 INFO:tasks.workunit.client.0.smithi118.stdout:8/476: write d2/dc/d16/d46/d4c/d63/f4a [1891369,17035] 0 2024-09-21T11:39:20.346 INFO:tasks.workunit.client.0.smithi118.stdout:8/477: chown d2/f57 27170232 1 2024-09-21T11:39:20.347 INFO:tasks.workunit.client.1.smithi149.stdout:0/768: getdents dd/d1a/d1b/d72/d78/d8b/d98 0 2024-09-21T11:39:20.347 INFO:tasks.workunit.client.1.smithi149.stdout:0/769: chown dd/db3 516671 1 2024-09-21T11:39:20.348 INFO:tasks.workunit.client.1.smithi149.stdout:0/770: chown dd/d1a/d1b/d72/d78/dc4/l6e 2939101 1 2024-09-21T11:39:20.349 INFO:tasks.workunit.client.1.smithi149.stdout:0/771: chown dd/d1a/d1b/d72/d78/dc4/d3a/l41 16631 1 2024-09-21T11:39:20.350 INFO:tasks.workunit.client.0.smithi118.stdout:5/266: mknod d0/db/d35/d2c/d40/c5f 0 2024-09-21T11:39:20.350 INFO:tasks.workunit.client.0.smithi118.stdout:5/267: chown d0/c3 10 1 2024-09-21T11:39:20.351 INFO:tasks.workunit.client.1.smithi149.stdout:6/759: symlink d8/d32/d37/d28/d2e/l101 0 2024-09-21T11:39:20.351 INFO:tasks.workunit.client.0.smithi118.stdout:4/184: write d2/d6/f22 [14381,74296] 0 2024-09-21T11:39:20.354 INFO:tasks.workunit.client.1.smithi149.stdout:0/772: dread dd/d1a/d1b/d72/d78/dc4/d3a/dd1/dde/fed [0,4194304] 0 2024-09-21T11:39:20.355 INFO:tasks.workunit.client.0.smithi118.stdout:0/517: truncate d5/f7 3453285 0 2024-09-21T11:39:20.356 INFO:tasks.workunit.client.1.smithi149.stdout:1/769: read d2/dd/d35/d1c/f39 [1348794,108084] 0 2024-09-21T11:39:20.357 INFO:tasks.workunit.client.1.smithi149.stdout:8/725: dread d3/d33/f64 [0,4194304] 0 2024-09-21T11:39:20.363 INFO:tasks.workunit.client.1.smithi149.stdout:7/893: symlink d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/d49/l11a 0 2024-09-21T11:39:20.366 INFO:tasks.workunit.client.1.smithi149.stdout:5/914: rename d4/d7/d40/d51/d56/f70 to d4/d7/d40/d43/d5c/d7a/d81/dea/f12a 0 2024-09-21T11:39:20.367 INFO:tasks.workunit.client.1.smithi149.stdout:2/940: write d8/da/d13/d83/ff5 [69478,122035] 0 2024-09-21T11:39:20.367 INFO:tasks.workunit.client.0.smithi118.stdout:1/296: getdents d6/de/d16/d3f/d50/d54/d32 0 2024-09-21T11:39:20.370 INFO:tasks.workunit.client.0.smithi118.stdout:4/185: creat d2/d6/de/d1c/f47 x:0 0 0 2024-09-21T11:39:20.373 INFO:tasks.workunit.client.0.smithi118.stdout:0/518: creat d5/d29/fb2 x:0 0 0 2024-09-21T11:39:20.373 INFO:tasks.workunit.client.1.smithi149.stdout:4/853: dwrite d4/d4d/d58/fc7 [0,4194304] 0 2024-09-21T11:39:20.374 INFO:tasks.workunit.client.0.smithi118.stdout:9/301: link d0/d4/d38/d4e/c59 d0/c7a 0 2024-09-21T11:39:20.375 INFO:tasks.workunit.client.0.smithi118.stdout:9/302: readlink d0/d4/d45/l5a 0 2024-09-21T11:39:20.377 INFO:tasks.workunit.client.0.smithi118.stdout:8/478: rename d2/dc/d16/l7b to d2/dc/d35/d50/la2 0 2024-09-21T11:39:20.378 INFO:tasks.workunit.client.0.smithi118.stdout:5/268: dwrite d0/fe [0,4194304] 0 2024-09-21T11:39:20.380 INFO:tasks.workunit.client.0.smithi118.stdout:5/269: chown d0/db/d35/d30/d1a/d33/l39 6155654 1 2024-09-21T11:39:20.382 INFO:tasks.workunit.client.1.smithi149.stdout:3/876: getdents d6/d1f/df1 0 2024-09-21T11:39:20.385 INFO:tasks.workunit.client.0.smithi118.stdout:5/270: dread d0/fe [0,4194304] 0 2024-09-21T11:39:20.385 INFO:tasks.workunit.client.1.smithi149.stdout:1/770: mknod d2/d5/d3d/cfb 0 2024-09-21T11:39:20.386 INFO:tasks.workunit.client.0.smithi118.stdout:5/271: fsync d0/db/d35/d30/f52 0 2024-09-21T11:39:20.387 INFO:tasks.workunit.client.0.smithi118.stdout:4/186: readlink d2/d6/de/d1c/d23/d26/d31/l37 0 2024-09-21T11:39:20.388 INFO:tasks.workunit.client.0.smithi118.stdout:0/519: chown d5/d10/d1e/d21/d2a/fac 14588 1 2024-09-21T11:39:20.390 INFO:tasks.workunit.client.1.smithi149.stdout:7/894: symlink d12/d5b/db5/dc5/de9/d4a/d6c/da0/dbb/l11b 0 2024-09-21T11:39:20.391 INFO:tasks.workunit.client.0.smithi118.stdout:2/150: rename c5 to de/d1f/d20/c38 0 2024-09-21T11:39:20.393 INFO:tasks.workunit.client.0.smithi118.stdout:2/151: write de/f2a [4535903,7810] 0 2024-09-21T11:39:20.393 INFO:tasks.workunit.client.0.smithi118.stdout:8/479: creat d2/dc/d10/d2e/d18/d36/fa3 x:0 0 0 2024-09-21T11:39:20.394 INFO:tasks.workunit.client.1.smithi149.stdout:5/915: mkdir d4/d7/d40/d43/d49/d88/dcd/d12b 0 2024-09-21T11:39:20.395 INFO:tasks.workunit.client.1.smithi149.stdout:5/916: chown d4/d7/d40/d51/lf6 63 1 2024-09-21T11:39:20.396 INFO:tasks.workunit.client.0.smithi118.stdout:9/303: dwrite d0/d4/d38/f60 [0,4194304] 0 2024-09-21T11:39:20.396 INFO:tasks.workunit.client.0.smithi118.stdout:1/297: mknod d6/d2a/d53/c5e 0 2024-09-21T11:39:20.397 INFO:tasks.workunit.client.1.smithi149.stdout:4/854: write d4/d6/d63/d10/d6f/f107 [3401723,6125] 0 2024-09-21T11:39:20.397 INFO:tasks.workunit.client.0.smithi118.stdout:1/298: readlink d6/l18 0 2024-09-21T11:39:20.398 INFO:tasks.workunit.client.0.smithi118.stdout:1/299: fsync d6/de/d16/d3f/d50/d54/d32/f46 0 2024-09-21T11:39:20.399 INFO:tasks.workunit.client.1.smithi149.stdout:9/807: sync 2024-09-21T11:39:20.399 INFO:tasks.workunit.client.1.smithi149.stdout:9/808: stat d18/d1c/f4e 0 2024-09-21T11:39:20.401 INFO:tasks.workunit.client.1.smithi149.stdout:9/809: dread d18/d19/d1a/d2f/d7d/fd8 [0,4194304] 0 2024-09-21T11:39:20.403 INFO:tasks.workunit.client.0.smithi118.stdout:4/187: creat d2/d6/dd/d35/f48 x:0 0 0 2024-09-21T11:39:20.404 INFO:tasks.workunit.client.0.smithi118.stdout:4/188: chown d2/d6/de 51298 1 2024-09-21T11:39:20.406 INFO:tasks.workunit.client.1.smithi149.stdout:3/877: creat d6/d5f/d60/d88/f12e x:0 0 0 2024-09-21T11:39:20.406 INFO:tasks.workunit.client.1.smithi149.stdout:2/941: write d8/d20/fb0 [249487,122289] 0 2024-09-21T11:39:20.407 INFO:tasks.workunit.client.1.smithi149.stdout:2/942: chown d8/d44/d63/db9 314 1 2024-09-21T11:39:20.410 INFO:tasks.workunit.client.0.smithi118.stdout:1/300: dwrite d6/d2a/f51 [0,4194304] 0 2024-09-21T11:39:20.411 INFO:tasks.workunit.client.1.smithi149.stdout:8/726: symlink d3/d12/d6e/lf7 0 2024-09-21T11:39:20.413 INFO:tasks.workunit.client.1.smithi149.stdout:7/895: fsync d12/d5b/db5/dc5/de9/d4a/d4f/fb6 0 2024-09-21T11:39:20.415 INFO:tasks.workunit.client.1.smithi149.stdout:6/760: write d8/d32/d37/dd7/fe4 [1544050,105325] 0 2024-09-21T11:39:20.416 INFO:tasks.workunit.client.1.smithi149.stdout:7/896: write d12/d5b/db5/dc5/de9/d4a/d4f/d75/ffe [986638,80651] 0 2024-09-21T11:39:20.417 INFO:tasks.workunit.client.1.smithi149.stdout:0/773: write f8 [1677430,128495] 0 2024-09-21T11:39:20.417 INFO:tasks.workunit.client.1.smithi149.stdout:6/761: write d8/d32/d37/f90 [343787,107025] 0 2024-09-21T11:39:20.422 INFO:tasks.workunit.client.1.smithi149.stdout:4/855: fsync d4/d4d/d58/f79 0 2024-09-21T11:39:20.422 INFO:tasks.workunit.client.1.smithi149.stdout:0/774: chown dd/d1a/d1b/d72/d78/dc4/d3a/l41 58900 1 2024-09-21T11:39:20.424 INFO:tasks.workunit.client.1.smithi149.stdout:5/917: dread d4/d90/f9e [0,4194304] 0 2024-09-21T11:39:20.425 INFO:tasks.workunit.client.1.smithi149.stdout:0/775: fdatasync dd/d1a/d1b/d72/d78/dc4/f42 0 2024-09-21T11:39:20.428 INFO:tasks.workunit.client.1.smithi149.stdout:0/776: chown dd/d1a/d1b/d72/d78/d8b/d98/dbc/ld3 14 1 2024-09-21T11:39:20.431 INFO:tasks.workunit.client.1.smithi149.stdout:4/856: dwrite d4/d6/d63/d10/f86 [0,4194304] 0 2024-09-21T11:39:20.434 INFO:tasks.workunit.client.0.smithi118.stdout:8/480: dread d2/fa [0,4194304] 0 2024-09-21T11:39:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:20 smithi149 ceph-mon[36123]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 68 MiB/s rd, 218 MiB/s wr, 377 op/s 2024-09-21T11:39:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:20 smithi149 ceph-mon[36123]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:20.453 INFO:tasks.workunit.client.1.smithi149.stdout:3/878: creat d6/d1f/d47/dce/f12f x:0 0 0 2024-09-21T11:39:20.457 INFO:tasks.workunit.client.1.smithi149.stdout:8/727: fsync d3/d33/f64 0 2024-09-21T11:39:20.461 INFO:tasks.workunit.client.1.smithi149.stdout:2/943: write f3 [2628757,5170] 0 2024-09-21T11:39:20.465 INFO:tasks.workunit.client.1.smithi149.stdout:7/897: rename d12/d5b/db5/dc5/de9/db7/d105 to d12/d5b/db5/dc5/de9/d4a/d9e/d11c 0 2024-09-21T11:39:20.466 INFO:tasks.workunit.client.0.smithi118.stdout:0/520: truncate d5/d10/f14 128385 0 2024-09-21T11:39:20.466 INFO:tasks.workunit.client.1.smithi149.stdout:7/898: chown d12/d5b/db5/dc5/de9/d4a/d6c/da0/db9 5512 1 2024-09-21T11:39:20.467 INFO:tasks.workunit.client.1.smithi149.stdout:3/879: dread d6/d1f/d47/d37/d3a/d95/f10d [0,4194304] 0 2024-09-21T11:39:20.467 INFO:tasks.workunit.client.0.smithi118.stdout:4/189: write f1 [17391,39696] 0 2024-09-21T11:39:20.468 INFO:tasks.workunit.client.1.smithi149.stdout:3/880: readlink d6/d5f/d60/d88/ld8 0 2024-09-21T11:39:20.468 INFO:tasks.workunit.client.1.smithi149.stdout:7/899: write d12/d5b/db5/dc5/de9/d68/dc4/d30/f5a [590740,50159] 0 2024-09-21T11:39:20.469 INFO:tasks.workunit.client.1.smithi149.stdout:7/900: write d12/d5b/db5/ff3 [607546,46427] 0 2024-09-21T11:39:20.469 INFO:tasks.workunit.client.1.smithi149.stdout:3/881: write d6/d1f/d47/d37/d3a/d107/f11c [3506400,84895] 0 2024-09-21T11:39:20.470 INFO:tasks.workunit.client.1.smithi149.stdout:7/901: chown d12/d5b/db5 101543 1 2024-09-21T11:39:20.472 INFO:tasks.workunit.client.0.smithi118.stdout:1/301: stat d6/de/f11 0 2024-09-21T11:39:20.473 INFO:tasks.workunit.client.0.smithi118.stdout:1/302: dread - d6/de/d16/d3f/d50/d54/d32/f46 zero size 2024-09-21T11:39:20.479 INFO:tasks.workunit.client.0.smithi118.stdout:0/521: stat d5/d10/c57 0 2024-09-21T11:39:20.480 INFO:tasks.workunit.client.1.smithi149.stdout:9/810: write d18/d19/d29/fbf [193266,66913] 0 2024-09-21T11:39:20.480 INFO:tasks.workunit.client.1.smithi149.stdout:1/771: link d2/dd/d35/d5b/f82 d2/dd/d35/d5b/dc0/dc3/ffc 0 2024-09-21T11:39:20.481 INFO:tasks.workunit.client.0.smithi118.stdout:4/190: dread - d2/d6/f2b zero size 2024-09-21T11:39:20.483 INFO:tasks.workunit.client.0.smithi118.stdout:1/303: chown d6/de/d16/l2f 261800510 1 2024-09-21T11:39:20.483 INFO:tasks.workunit.client.1.smithi149.stdout:9/811: write d18/d19/d1a/d2f/d5f/f73 [1351380,48197] 0 2024-09-21T11:39:20.484 INFO:tasks.workunit.client.1.smithi149.stdout:8/728: mknod d3/d33/d34/cf8 0 2024-09-21T11:39:20.484 INFO:tasks.workunit.client.1.smithi149.stdout:4/857: dwrite d4/d6/f5e [0,4194304] 0 2024-09-21T11:39:20.485 INFO:tasks.workunit.client.0.smithi118.stdout:8/481: mknod d2/dc/d35/ca4 0 2024-09-21T11:39:20.487 INFO:tasks.workunit.client.0.smithi118.stdout:0/522: mkdir d5/d10/d1e/d21/db3 0 2024-09-21T11:39:20.487 INFO:tasks.workunit.client.0.smithi118.stdout:8/482: write d2/dc/d16/f87 [3047849,65443] 0 2024-09-21T11:39:20.487 INFO:tasks.workunit.client.1.smithi149.stdout:4/858: write d4/d6/d63/d78/d98/dcc/ddb/f114 [461131,74262] 0 2024-09-21T11:39:20.488 INFO:tasks.workunit.client.1.smithi149.stdout:1/772: dread d2/f60 [0,4194304] 0 2024-09-21T11:39:20.488 INFO:tasks.workunit.client.0.smithi118.stdout:0/523: fdatasync d5/d10/d1e/d3d/d93/f96 0 2024-09-21T11:39:20.488 INFO:tasks.workunit.client.0.smithi118.stdout:4/191: creat d2/f49 x:0 0 0 2024-09-21T11:39:20.490 INFO:tasks.workunit.client.1.smithi149.stdout:1/773: readlink d2/dd/d35/d5b/dc0/lcf 0 2024-09-21T11:39:20.490 INFO:tasks.workunit.client.1.smithi149.stdout:4/859: truncate d4/d6/d63/d2d/dd6/d32/d4a/f50 813362 0 2024-09-21T11:39:20.490 INFO:tasks.workunit.client.0.smithi118.stdout:2/152: link de/d16/d25/c26 de/d16/d1c/c39 0 2024-09-21T11:39:20.490 INFO:tasks.workunit.client.0.smithi118.stdout:2/153: chown de 0 1 2024-09-21T11:39:20.491 INFO:tasks.workunit.client.1.smithi149.stdout:4/860: fsync d4/d6/d63/d10/d6f/f107 0 2024-09-21T11:39:20.491 INFO:tasks.workunit.client.1.smithi149.stdout:4/861: fsync d4/d6/d63/d2d/dd6/d32/d4a/f61 0 2024-09-21T11:39:20.495 INFO:tasks.workunit.client.0.smithi118.stdout:9/304: getdents d0 0 2024-09-21T11:39:20.496 INFO:tasks.workunit.client.1.smithi149.stdout:5/918: link d4/d7/d40/d43/d49/d88/de0/f123 d4/d90/ddd/f12c 0 2024-09-21T11:39:20.498 INFO:tasks.workunit.client.0.smithi118.stdout:8/483: fdatasync d2/f29 0 2024-09-21T11:39:20.500 INFO:tasks.workunit.client.0.smithi118.stdout:0/524: symlink d5/d29/lb4 0 2024-09-21T11:39:20.501 INFO:tasks.workunit.client.0.smithi118.stdout:4/192: creat d2/d6/de/d1c/f4a x:0 0 0 2024-09-21T11:39:20.502 INFO:tasks.workunit.client.0.smithi118.stdout:4/193: read - d2/d6/dd/d35/f48 zero size 2024-09-21T11:39:20.506 INFO:tasks.workunit.client.1.smithi149.stdout:3/882: write d6/d1f/d27/f63 [48154,26719] 0 2024-09-21T11:39:20.508 INFO:tasks.workunit.client.1.smithi149.stdout:6/762: sync 2024-09-21T11:39:20.510 INFO:tasks.workunit.client.0.smithi118.stdout:1/304: dwrite f0 [0,4194304] 0 2024-09-21T11:39:20.510 INFO:tasks.workunit.client.0.smithi118.stdout:1/305: readlink d6/l9 0 2024-09-21T11:39:20.512 INFO:tasks.workunit.client.0.smithi118.stdout:0/525: creat d5/d10/fb5 x:0 0 0 2024-09-21T11:39:20.513 INFO:tasks.workunit.client.1.smithi149.stdout:2/944: symlink d8/d44/d132/l144 0 2024-09-21T11:39:20.513 INFO:tasks.workunit.client.1.smithi149.stdout:2/945: chown f3 32 1 2024-09-21T11:39:20.517 INFO:tasks.workunit.client.0.smithi118.stdout:2/154: dread de/d1f/d20/f2d [0,4194304] 0 2024-09-21T11:39:20.518 INFO:tasks.workunit.client.0.smithi118.stdout:1/306: rmdir d6/de/d16/d3f/d50/d54/d32 39 2024-09-21T11:39:20.521 INFO:tasks.workunit.client.0.smithi118.stdout:0/526: mknod d5/d29/d53/cb6 0 2024-09-21T11:39:20.521 INFO:tasks.workunit.client.0.smithi118.stdout:8/484: dread d2/dc/d10/d2e/d18/d1a/f1b [0,4194304] 0 2024-09-21T11:39:20.522 INFO:tasks.workunit.client.1.smithi149.stdout:4/862: truncate d4/d6/d63/fc5 237966 0 2024-09-21T11:39:20.526 INFO:tasks.workunit.client.1.smithi149.stdout:7/902: rename d12/d5b/db5/dc5/de9/d68/dc4/d30/c83 to d12/d5b/db5/dc5/c11d 0 2024-09-21T11:39:20.527 INFO:tasks.workunit.client.0.smithi118.stdout:0/527: truncate d5/d10/d1e/d21/d2a/f45 1573710 0 2024-09-21T11:39:20.528 INFO:tasks.workunit.client.1.smithi149.stdout:3/883: stat d6/d5f/d60/d88/de7/d119/l108 0 2024-09-21T11:39:20.528 INFO:tasks.workunit.client.0.smithi118.stdout:4/194: dwrite d2/d6/f18 [0,4194304] 0 2024-09-21T11:39:20.529 INFO:tasks.workunit.client.0.smithi118.stdout:2/155: truncate de/f19 775288 0 2024-09-21T11:39:20.529 INFO:tasks.workunit.client.0.smithi118.stdout:2/156: readlink de/d16/d1c/l34 0 2024-09-21T11:39:20.530 INFO:tasks.workunit.client.0.smithi118.stdout:2/157: fsync f8 0 2024-09-21T11:39:20.531 INFO:tasks.workunit.client.0.smithi118.stdout:2/158: dread - de/d1f/d20/f35 zero size 2024-09-21T11:39:20.532 INFO:tasks.workunit.client.0.smithi118.stdout:2/159: fdatasync de/f15 0 2024-09-21T11:39:20.532 INFO:tasks.workunit.client.1.smithi149.stdout:0/777: sync 2024-09-21T11:39:20.535 INFO:tasks.workunit.client.1.smithi149.stdout:1/774: dread d2/dd/d2e/f77 [4194304,4194304] 0 2024-09-21T11:39:20.536 INFO:tasks.workunit.client.1.smithi149.stdout:1/775: write d2/d5/d8/f40 [3406537,117053] 0 2024-09-21T11:39:20.537 INFO:tasks.workunit.client.1.smithi149.stdout:2/946: rename d8/dd/d5c/d84/f104 to d8/dcb/db8/dd3/f145 0 2024-09-21T11:39:20.537 INFO:tasks.workunit.client.0.smithi118.stdout:4/195: mknod d2/d6/de/d1c/d23/d26/d31/c4b 0 2024-09-21T11:39:20.538 INFO:tasks.workunit.client.0.smithi118.stdout:2/160: dwrite f8 [0,4194304] 0 2024-09-21T11:39:20.539 INFO:tasks.workunit.client.1.smithi149.stdout:5/919: symlink d4/d1d/l12d 0 2024-09-21T11:39:20.541 INFO:tasks.workunit.client.1.smithi149.stdout:5/920: read d4/d7/d40/d43/d49/d88/ff0 [241642,4722] 0 2024-09-21T11:39:20.546 INFO:tasks.workunit.client.1.smithi149.stdout:3/884: creat d6/d1f/d47/d37/d3f/dc5/d106/f130 x:0 0 0 2024-09-21T11:39:20.546 INFO:tasks.workunit.client.0.smithi118.stdout:8/485: rename d2/d32/f3c to d2/dc/d10/d2e/fa5 0 2024-09-21T11:39:20.549 INFO:tasks.workunit.client.1.smithi149.stdout:6/763: mkdir d8/da/d2c/d102 0 2024-09-21T11:39:20.550 INFO:tasks.workunit.client.0.smithi118.stdout:1/307: truncate d6/d2a/f23 250411 0 2024-09-21T11:39:20.550 INFO:tasks.workunit.client.1.smithi149.stdout:6/764: write d8/d32/d37/d2b/d7e/f86 [728026,67272] 0 2024-09-21T11:39:20.550 INFO:tasks.workunit.client.0.smithi118.stdout:4/196: dread - d2/d6/dd/f33 zero size 2024-09-21T11:39:20.551 INFO:tasks.workunit.client.0.smithi118.stdout:2/161: dread de/d16/d1c/f1d [0,4194304] 0 2024-09-21T11:39:20.552 INFO:tasks.workunit.client.1.smithi149.stdout:6/765: write d8/da/d14/ff7 [814150,49042] 0 2024-09-21T11:39:20.555 INFO:tasks.workunit.client.1.smithi149.stdout:9/812: dwrite d18/d1c/f98 [0,4194304] 0 2024-09-21T11:39:20.556 INFO:tasks.workunit.client.0.smithi118.stdout:0/528: rename d5/d10/d1e/d21/d2a to d5/d29/d68/d7b/db7 0 2024-09-21T11:39:20.557 INFO:tasks.workunit.client.0.smithi118.stdout:8/486: rmdir d2/dc/d49/d84 39 2024-09-21T11:39:20.561 INFO:tasks.workunit.client.0.smithi118.stdout:2/162: mkdir de/d1f/d20/d3a 0 2024-09-21T11:39:20.569 INFO:tasks.workunit.client.1.smithi149.stdout:8/729: getdents d3/d33/d34/d55/d5e 0 2024-09-21T11:39:20.570 INFO:tasks.workunit.client.0.smithi118.stdout:2/163: rmdir de/d1f 39 2024-09-21T11:39:20.572 INFO:tasks.workunit.client.0.smithi118.stdout:0/529: truncate d5/d29/d68/d7b/db7/f78 2052643 0 2024-09-21T11:39:20.574 INFO:tasks.workunit.client.1.smithi149.stdout:4/863: link d4/d6/d63/d10/d6f/f74 d4/d6/d63/d15/d30/d8a/da7/f122 0 2024-09-21T11:39:20.575 INFO:tasks.workunit.client.0.smithi118.stdout:8/487: symlink d2/dc/d35/la6 0 2024-09-21T11:39:20.578 INFO:tasks.workunit.client.0.smithi118.stdout:1/308: link d6/de/d16/d3f/f37 d6/de/f5f 0 2024-09-21T11:39:20.579 INFO:tasks.workunit.client.0.smithi118.stdout:1/309: write d6/d3b/f43 [484367,115622] 0 2024-09-21T11:39:20.582 INFO:tasks.workunit.client.0.smithi118.stdout:0/530: fsync d5/f7e 0 2024-09-21T11:39:20.583 INFO:tasks.workunit.client.0.smithi118.stdout:4/197: dread d2/d6/f14 [0,4194304] 0 2024-09-21T11:39:20.583 INFO:tasks.workunit.client.1.smithi149.stdout:0/778: dwrite dd/f19 [0,4194304] 0 2024-09-21T11:39:20.586 INFO:tasks.workunit.client.1.smithi149.stdout:3/885: symlink d6/d1f/d47/d37/d3f/dc5/d111/l131 0 2024-09-21T11:39:20.589 INFO:tasks.workunit.client.0.smithi118.stdout:2/164: link de/ff de/d16/d25/f3b 0 2024-09-21T11:39:20.590 INFO:tasks.workunit.client.1.smithi149.stdout:8/730: fdatasync d3/d33/d34/fbe 0 2024-09-21T11:39:20.590 INFO:tasks.workunit.client.0.smithi118.stdout:8/488: dwrite d2/dc/d10/d3b/f6d [0,4194304] 0 2024-09-21T11:39:20.591 INFO:tasks.workunit.client.1.smithi149.stdout:8/731: dread - d3/d33/d34/d55/d5e/fd0 zero size 2024-09-21T11:39:20.593 INFO:tasks.workunit.client.0.smithi118.stdout:8/489: write d2/dc/d35/d50/f95 [646635,123470] 0 2024-09-21T11:39:20.596 INFO:tasks.workunit.client.1.smithi149.stdout:4/864: fdatasync d4/d6/d63/d15/f54 0 2024-09-21T11:39:20.597 INFO:tasks.workunit.client.0.smithi118.stdout:1/310: mknod d6/d2a/d5c/c60 0 2024-09-21T11:39:20.599 INFO:tasks.workunit.client.1.smithi149.stdout:4/865: chown d4/d6/d63/d15 11019 1 2024-09-21T11:39:20.602 INFO:tasks.workunit.client.1.smithi149.stdout:1/776: creat d2/dd/d35/d1c/d41/d51/ffd x:0 0 0 2024-09-21T11:39:20.603 INFO:tasks.workunit.client.1.smithi149.stdout:0/779: unlink dd/d1a/d1b/d50/la9 0 2024-09-21T11:39:20.605 INFO:tasks.workunit.client.1.smithi149.stdout:8/732: dwrite d3/d33/d34/d55/d5e/fd0 [0,4194304] 0 2024-09-21T11:39:20.605 INFO:tasks.workunit.client.0.smithi118.stdout:2/165: rename de/d1f/d20/d3a to de/d22/d3c 0 2024-09-21T11:39:20.606 INFO:tasks.workunit.client.1.smithi149.stdout:0/780: write dd/db3/fc5 [1580135,62914] 0 2024-09-21T11:39:20.607 INFO:tasks.workunit.client.0.smithi118.stdout:8/490: link d2/d73/d79/f9a d2/dc/d10/d3b/fa7 0 2024-09-21T11:39:20.608 INFO:tasks.workunit.client.0.smithi118.stdout:8/491: write d2/dc/d10/d2e/d18/d1a/f98 [43439,98941] 0 2024-09-21T11:39:20.609 INFO:tasks.workunit.client.1.smithi149.stdout:9/813: creat d18/f101 x:0 0 0 2024-09-21T11:39:20.611 INFO:tasks.workunit.client.1.smithi149.stdout:2/947: sync 2024-09-21T11:39:20.611 INFO:tasks.workunit.client.1.smithi149.stdout:7/903: sync 2024-09-21T11:39:20.615 INFO:tasks.workunit.client.1.smithi149.stdout:5/921: rename d4/d1d/l3d to d4/d7/d40/l12e 0 2024-09-21T11:39:20.617 INFO:tasks.workunit.client.1.smithi149.stdout:0/781: mknod dd/d1a/d1b/d72/d78/d8b/d98/cff 0 2024-09-21T11:39:20.620 INFO:tasks.workunit.client.1.smithi149.stdout:4/866: getdents d4/d6/d63/d92 0 2024-09-21T11:39:20.620 INFO:tasks.workunit.client.1.smithi149.stdout:2/948: truncate d8/dcb/fa7 6423041 0 2024-09-21T11:39:20.623 INFO:tasks.workunit.client.0.smithi118.stdout:0/531: truncate d5/d10/d1e/d23/d3a/f8b 1880433 0 2024-09-21T11:39:20.624 INFO:tasks.workunit.client.1.smithi149.stdout:7/904: fsync d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/f107 0 2024-09-21T11:39:20.624 INFO:tasks.workunit.client.1.smithi149.stdout:1/777: dwrite d2/dd/d35/d5b/dc0/dc3/fe1 [0,4194304] 0 2024-09-21T11:39:20.626 INFO:tasks.workunit.client.1.smithi149.stdout:6/766: dwrite d8/d32/d37/d28/d2f/d6a/d72/f7f [4194304,4194304] 0 2024-09-21T11:39:20.626 INFO:tasks.workunit.client.0.smithi118.stdout:8/492: dread d2/dc/d10/d2e/d18/d1a/f1f [0,4194304] 0 2024-09-21T11:39:20.627 INFO:tasks.workunit.client.1.smithi149.stdout:0/782: creat dd/d32/dbe/f100 x:0 0 0 2024-09-21T11:39:20.627 INFO:tasks.workunit.client.1.smithi149.stdout:7/905: chown d12/l5c 3279 1 2024-09-21T11:39:20.627 INFO:tasks.workunit.client.0.smithi118.stdout:0/532: symlink d5/d10/d1e/d23/d3a/d4e/d9d/lb8 0 2024-09-21T11:39:20.628 INFO:tasks.workunit.client.1.smithi149.stdout:3/886: dread d6/d1f/d4c/fb8 [0,4194304] 0 2024-09-21T11:39:20.631 INFO:tasks.workunit.client.0.smithi118.stdout:2/166: write de/d16/d1c/f1d [2838688,60034] 0 2024-09-21T11:39:20.631 INFO:tasks.workunit.client.0.smithi118.stdout:0/533: dread - d5/d10/d1e/d21/f7a zero size 2024-09-21T11:39:20.631 INFO:tasks.workunit.client.1.smithi149.stdout:3/887: dread - d6/d79/d7e/ddd/f10b zero size 2024-09-21T11:39:20.634 INFO:tasks.workunit.client.0.smithi118.stdout:0/534: write d5/d10/d1e/d33/f72 [5610212,3698] 0 2024-09-21T11:39:20.634 INFO:tasks.workunit.client.0.smithi118.stdout:0/535: chown d5/d10/c67 1367123 1 2024-09-21T11:39:20.636 INFO:tasks.workunit.client.0.smithi118.stdout:2/167: dread de/d16/d25/f3b [0,4194304] 0 2024-09-21T11:39:20.636 INFO:tasks.workunit.client.1.smithi149.stdout:4/867: unlink d4/d6/d63/d15/d16/d23/d62/c8c 0 2024-09-21T11:39:20.638 INFO:tasks.workunit.client.1.smithi149.stdout:9/814: write d18/d19/d1a/d2f/d7d/fd8 [1121656,6373] 0 2024-09-21T11:39:20.640 INFO:tasks.workunit.client.1.smithi149.stdout:6/767: creat d8/d32/d37/d28/dc8/f103 x:0 0 0 2024-09-21T11:39:20.642 INFO:tasks.workunit.client.1.smithi149.stdout:0/783: mkdir dd/d1a/d1b/d72/d78/dc4/d3a/dd1/dde/d101 0 2024-09-21T11:39:20.643 INFO:tasks.workunit.client.0.smithi118.stdout:8/493: creat d2/dc/d35/fa8 x:0 0 0 2024-09-21T11:39:20.645 INFO:tasks.workunit.client.1.smithi149.stdout:3/888: stat d6/d1f/d47/d37/d3f/f40 0 2024-09-21T11:39:20.647 INFO:tasks.workunit.client.0.smithi118.stdout:2/168: rename de/f15 to de/d16/d31/f3d 0 2024-09-21T11:39:20.650 INFO:tasks.workunit.client.0.smithi118.stdout:8/494: creat d2/d7c/d88/fa9 x:0 0 0 2024-09-21T11:39:20.652 INFO:tasks.workunit.client.1.smithi149.stdout:1/778: mknod d2/d5/cfe 0 2024-09-21T11:39:20.652 INFO:tasks.workunit.client.1.smithi149.stdout:2/949: write d8/dd/f56 [4610631,120614] 0 2024-09-21T11:39:20.653 INFO:tasks.workunit.client.1.smithi149.stdout:9/815: chown d18/d4c/la2 11357875 1 2024-09-21T11:39:20.655 INFO:tasks.workunit.client.1.smithi149.stdout:6/768: fsync d8/da/d2c/d2d/d60/f6f 0 2024-09-21T11:39:20.659 INFO:tasks.workunit.client.1.smithi149.stdout:5/922: getdents d4/d4f/df4 0 2024-09-21T11:39:20.659 INFO:tasks.workunit.client.0.smithi118.stdout:2/169: write de/d1f/d20/f2d [2335949,29187] 0 2024-09-21T11:39:20.660 INFO:tasks.workunit.client.0.smithi118.stdout:2/170: readlink de/d1f/l2e 0 2024-09-21T11:39:20.660 INFO:tasks.workunit.client.0.smithi118.stdout:8/495: mkdir d2/d7c/d88/d8f/daa 0 2024-09-21T11:39:20.661 INFO:tasks.workunit.client.0.smithi118.stdout:2/171: chown de/d22/f2b 7 1 2024-09-21T11:39:20.662 INFO:tasks.workunit.client.0.smithi118.stdout:0/536: write d5/f7e [762309,24724] 0 2024-09-21T11:39:20.663 INFO:tasks.workunit.client.0.smithi118.stdout:8/496: truncate d2/dc/d35/d42/fa1 488639 0 2024-09-21T11:39:20.663 INFO:tasks.workunit.client.1.smithi149.stdout:4/868: unlink d4/d4d/d58/ccb 0 2024-09-21T11:39:20.663 INFO:tasks.workunit.client.1.smithi149.stdout:9/816: dread d18/d36/d3c/d47/d76/f86 [0,4194304] 0 2024-09-21T11:39:20.663 INFO:tasks.workunit.client.1.smithi149.stdout:2/950: dwrite d8/da/d13/d1a/d3b/fb7 [0,4194304] 0 2024-09-21T11:39:20.664 INFO:tasks.workunit.client.0.smithi118.stdout:8/497: dread - d2/dc/d16/d46/d4c/d63/f7e zero size 2024-09-21T11:39:20.667 INFO:tasks.workunit.client.0.smithi118.stdout:0/537: dread d5/d34/f82 [0,4194304] 0 2024-09-21T11:39:20.667 INFO:tasks.workunit.client.1.smithi149.stdout:4/869: chown d4/d6/d63/d15/d30/d8a/da7/f11a 523202 1 2024-09-21T11:39:20.667 INFO:tasks.workunit.client.1.smithi149.stdout:6/769: dwrite d8/d32/d70/f91 [0,4194304] 0 2024-09-21T11:39:20.669 INFO:tasks.workunit.client.0.smithi118.stdout:2/172: write de/d1f/d20/f2d [383403,72322] 0 2024-09-21T11:39:20.673 INFO:tasks.workunit.client.0.smithi118.stdout:0/538: creat d5/d10/fb9 x:0 0 0 2024-09-21T11:39:20.673 INFO:tasks.workunit.client.0.smithi118.stdout:2/173: dread f8 [0,4194304] 0 2024-09-21T11:39:20.674 INFO:tasks.workunit.client.0.smithi118.stdout:2/174: dread - de/d16/f32 zero size 2024-09-21T11:39:20.675 INFO:tasks.workunit.client.0.smithi118.stdout:0/539: fdatasync d5/d29/d68/d7b/db7/d48/f8a 0 2024-09-21T11:39:20.676 INFO:tasks.workunit.client.1.smithi149.stdout:9/817: dwrite d18/d19/fcd [0,4194304] 0 2024-09-21T11:39:20.680 INFO:tasks.workunit.client.1.smithi149.stdout:5/923: dwrite d4/d90/f9e [4194304,4194304] 0 2024-09-21T11:39:20.685 INFO:tasks.workunit.client.1.smithi149.stdout:5/924: write d4/d1d/d50/d54/f127 [323340,108983] 0 2024-09-21T11:39:20.685 INFO:tasks.workunit.client.1.smithi149.stdout:2/951: mkdir d8/d20/d57/d146 0 2024-09-21T11:39:20.688 INFO:tasks.workunit.client.1.smithi149.stdout:0/784: write dd/d1a/d1b/d50/f57 [602191,17825] 0 2024-09-21T11:39:20.690 INFO:tasks.workunit.client.0.smithi118.stdout:2/175: symlink de/d1f/l3e 0 2024-09-21T11:39:20.692 INFO:tasks.workunit.client.0.smithi118.stdout:0/540: fdatasync d5/d34/f82 0 2024-09-21T11:39:20.695 INFO:tasks.workunit.client.1.smithi149.stdout:3/889: truncate d6/d79/d7e/ff3 361812 0 2024-09-21T11:39:20.696 INFO:tasks.workunit.client.1.smithi149.stdout:3/890: fdatasync d6/d1f/fbd 0 2024-09-21T11:39:20.696 INFO:tasks.workunit.client.1.smithi149.stdout:2/952: symlink d8/d20/d78/l147 0 2024-09-21T11:39:20.697 INFO:tasks.workunit.client.1.smithi149.stdout:5/925: creat d4/d1d/d50/d54/d2a/f12f x:0 0 0 2024-09-21T11:39:20.698 INFO:tasks.workunit.client.0.smithi118.stdout:8/498: dwrite d2/dc/d10/d2e/d18/f22 [8388608,4194304] 0 2024-09-21T11:39:20.699 INFO:tasks.workunit.client.1.smithi149.stdout:6/770: mknod d8/d32/d37/d28/d87/da4/c104 0 2024-09-21T11:39:20.700 INFO:tasks.workunit.client.1.smithi149.stdout:6/771: stat d8/da/d3d/la2 0 2024-09-21T11:39:20.701 INFO:tasks.workunit.client.0.smithi118.stdout:2/176: unlink de/d1f/d20/c38 0 2024-09-21T11:39:20.703 INFO:tasks.workunit.client.1.smithi149.stdout:5/926: dread d4/d4f/f7f [0,4194304] 0 2024-09-21T11:39:20.704 INFO:tasks.workunit.client.0.smithi118.stdout:8/499: mkdir d2/dc/d35/dab 0 2024-09-21T11:39:20.706 INFO:tasks.workunit.client.0.smithi118.stdout:2/177: creat de/d22/d3c/f3f x:0 0 0 2024-09-21T11:39:20.707 INFO:tasks.workunit.client.0.smithi118.stdout:8/500: creat d2/dc/fac x:0 0 0 2024-09-21T11:39:20.708 INFO:tasks.workunit.client.0.smithi118.stdout:0/541: dread d5/d29/d68/d7b/db7/d48/f60 [0,4194304] 0 2024-09-21T11:39:20.713 INFO:tasks.workunit.client.0.smithi118.stdout:0/542: link d5/d10/d1e/d3d/c54 d5/d10/d1e/d23/d3a/cba 0 2024-09-21T11:39:20.715 INFO:tasks.workunit.client.1.smithi149.stdout:5/927: dread d4/d1d/d50/d54/f35 [4194304,4194304] 0 2024-09-21T11:39:20.716 INFO:tasks.workunit.client.0.smithi118.stdout:0/543: fsync d5/f13 0 2024-09-21T11:39:20.718 INFO:tasks.workunit.client.0.smithi118.stdout:0/544: creat d5/d10/d1e/d21/fbb x:0 0 0 2024-09-21T11:39:20.720 INFO:tasks.workunit.client.0.smithi118.stdout:0/545: creat d5/d29/fbc x:0 0 0 2024-09-21T11:39:20.728 INFO:tasks.workunit.client.1.smithi149.stdout:8/733: sync 2024-09-21T11:39:20.731 INFO:tasks.workunit.client.0.smithi118.stdout:0/546: link d5/d29/c49 d5/d10/d1e/cbd 0 2024-09-21T11:39:20.731 INFO:tasks.workunit.client.0.smithi118.stdout:0/547: chown d5/d29/d68 3688 1 2024-09-21T11:39:20.734 INFO:tasks.workunit.client.1.smithi149.stdout:8/734: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/fed [0,4194304] 0 2024-09-21T11:39:20.735 INFO:tasks.workunit.client.0.smithi118.stdout:0/548: mkdir d5/d10/d1e/d21/db3/dbe 0 2024-09-21T11:39:20.736 INFO:tasks.workunit.client.0.smithi118.stdout:0/549: chown d5/d10/d1e/d20 957151 1 2024-09-21T11:39:20.740 INFO:tasks.workunit.client.0.smithi118.stdout:8/501: rmdir d2/dc/d35/d42 39 2024-09-21T11:39:20.743 INFO:tasks.workunit.client.0.smithi118.stdout:0/550: link d5/d29/fb2 d5/d10/d1e/d20/fbf 0 2024-09-21T11:39:20.746 INFO:tasks.workunit.client.0.smithi118.stdout:8/502: write d2/dc/d10/d2e/f55 [4991857,115967] 0 2024-09-21T11:39:20.747 INFO:tasks.workunit.client.0.smithi118.stdout:0/551: creat d5/d29/d68/fc0 x:0 0 0 2024-09-21T11:39:20.751 INFO:tasks.workunit.client.0.smithi118.stdout:8/503: chown d2/dc/d16/d46/d4c/l86 31642882 1 2024-09-21T11:39:20.752 INFO:tasks.workunit.client.0.smithi118.stdout:0/552: creat d5/d10/d1e/d21/db3/fc1 x:0 0 0 2024-09-21T11:39:20.754 INFO:tasks.workunit.client.0.smithi118.stdout:8/504: mkdir d2/dc/d35/d50/dad 0 2024-09-21T11:39:20.755 INFO:tasks.workunit.client.1.smithi149.stdout:3/891: rmdir d6/d1f/d47/d37/d3a 39 2024-09-21T11:39:20.757 INFO:tasks.workunit.client.0.smithi118.stdout:0/553: rename d5/d10/d1e/d23/d3a/d4e/fab to d5/d34/d44/d87/da4/fc2 0 2024-09-21T11:39:20.758 INFO:tasks.workunit.client.1.smithi149.stdout:2/953: mknod d8/dcb/db8/dd3/c148 0 2024-09-21T11:39:20.760 INFO:tasks.workunit.client.0.smithi118.stdout:8/505: dwrite d2/dc/d10/d3b/f64 [4194304,4194304] 0 2024-09-21T11:39:20.760 INFO:tasks.workunit.client.1.smithi149.stdout:6/772: symlink d8/d32/l105 0 2024-09-21T11:39:20.761 INFO:tasks.workunit.client.0.smithi118.stdout:8/506: chown d2/dc/d16/d46/d4c/d63/f4a 1612 1 2024-09-21T11:39:20.768 INFO:tasks.workunit.client.1.smithi149.stdout:8/735: dread - d3/d12/d6e/d79/fe8 zero size 2024-09-21T11:39:20.769 INFO:tasks.workunit.client.1.smithi149.stdout:8/736: write d3/d33/d34/d55/d5e/d9e/dc2/d3a/f63 [2719925,78729] 0 2024-09-21T11:39:20.772 INFO:tasks.workunit.client.1.smithi149.stdout:9/818: rename d18/de9 to d18/d19/d102 0 2024-09-21T11:39:20.772 INFO:tasks.workunit.client.0.smithi118.stdout:0/554: link d5/d34/d44/c5b d5/d10/d1e/d21/db3/dbe/cc3 0 2024-09-21T11:39:20.776 INFO:tasks.workunit.client.1.smithi149.stdout:2/954: creat d8/d20/f149 x:0 0 0 2024-09-21T11:39:20.776 INFO:tasks.workunit.client.1.smithi149.stdout:1/779: sync 2024-09-21T11:39:20.776 INFO:tasks.workunit.client.1.smithi149.stdout:7/906: sync 2024-09-21T11:39:20.777 INFO:tasks.workunit.client.1.smithi149.stdout:1/780: chown d2/d2b/d6e/l8a 23322555 1 2024-09-21T11:39:20.778 INFO:tasks.workunit.client.0.smithi118.stdout:0/555: creat d5/d29/d68/d7b/db7/fc4 x:0 0 0 2024-09-21T11:39:20.778 INFO:tasks.workunit.client.1.smithi149.stdout:7/907: fsync d12/d5b/db5/dc5/de9/d68/f7b 0 2024-09-21T11:39:20.778 INFO:tasks.workunit.client.0.smithi118.stdout:0/556: fdatasync d5/d29/d68/fc0 0 2024-09-21T11:39:20.779 INFO:tasks.workunit.client.1.smithi149.stdout:1/781: chown d2/dd/d35/f8d 2 1 2024-09-21T11:39:20.782 INFO:tasks.workunit.client.0.smithi118.stdout:8/507: dread d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:20.786 INFO:tasks.workunit.client.1.smithi149.stdout:4/870: write d4/d6/d63/d10/d6f/f74 [2696591,77082] 0 2024-09-21T11:39:20.786 INFO:tasks.workunit.client.0.smithi118.stdout:8/508: fsync d2/dc/d10/d2e/d18/d1a/f1b 0 2024-09-21T11:39:20.789 INFO:tasks.workunit.client.0.smithi118.stdout:0/557: getdents d5 0 2024-09-21T11:39:20.789 INFO:tasks.workunit.client.1.smithi149.stdout:9/819: creat d18/d36/d3c/d47/f103 x:0 0 0 2024-09-21T11:39:20.796 INFO:tasks.workunit.client.1.smithi149.stdout:2/955: creat d8/d44/d63/db9/d117/f14a x:0 0 0 2024-09-21T11:39:20.796 INFO:tasks.workunit.client.0.smithi118.stdout:6/190: sync 2024-09-21T11:39:20.798 INFO:tasks.workunit.client.1.smithi149.stdout:2/956: read d8/dd/f56 [4007976,56970] 0 2024-09-21T11:39:20.799 INFO:tasks.workunit.client.0.smithi118.stdout:0/558: rename d5/d10/d1e/d23/d3a/cba to d5/d29/d68/d7b/db7/d48/cc5 0 2024-09-21T11:39:20.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/928: dwrite d4/d1d/d50/d54/d2a/d93/fab [0,4194304] 0 2024-09-21T11:39:20.800 INFO:tasks.workunit.client.0.smithi118.stdout:0/559: readlink d5/d29/d68/d7b/db7/d48/l4f 0 2024-09-21T11:39:20.802 INFO:tasks.workunit.client.0.smithi118.stdout:6/191: dwrite d8/d14/d28/f31 [0,4194304] 0 2024-09-21T11:39:20.805 INFO:tasks.workunit.client.1.smithi149.stdout:1/782: unlink d2/f2d 0 2024-09-21T11:39:20.807 INFO:tasks.workunit.client.1.smithi149.stdout:7/908: chown d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/cd2 1 1 2024-09-21T11:39:20.813 INFO:tasks.workunit.client.1.smithi149.stdout:0/785: getdents dd/d1a/d1b/d72/d87 0 2024-09-21T11:39:20.814 INFO:tasks.workunit.client.0.smithi118.stdout:8/509: write d2/f29 [734313,14688] 0 2024-09-21T11:39:20.814 INFO:tasks.workunit.client.0.smithi118.stdout:8/510: chown d2/d73/d79/f9a 223110352 1 2024-09-21T11:39:20.815 INFO:tasks.workunit.client.1.smithi149.stdout:2/957: truncate d8/da/d13/d2d/f6b 2407241 0 2024-09-21T11:39:20.816 INFO:tasks.workunit.client.0.smithi118.stdout:8/511: read d2/dc/d16/d46/f69 [211802,113035] 0 2024-09-21T11:39:20.817 INFO:tasks.workunit.client.1.smithi149.stdout:2/958: dread - d8/dd/f9c zero size 2024-09-21T11:39:20.818 INFO:tasks.workunit.client.1.smithi149.stdout:2/959: readlink d8/dd/d8c/l105 0 2024-09-21T11:39:20.821 INFO:tasks.workunit.client.1.smithi149.stdout:3/892: dwrite d6/d1f/d47/d37/d3a/f92 [4194304,4194304] 0 2024-09-21T11:39:20.823 INFO:tasks.workunit.client.0.smithi118.stdout:6/192: write d8/fb [4763740,3634] 0 2024-09-21T11:39:20.824 INFO:tasks.workunit.client.1.smithi149.stdout:4/871: symlink d4/d4d/d5f/d71/ddc/d115/l123 0 2024-09-21T11:39:20.827 INFO:tasks.workunit.client.0.smithi118.stdout:6/193: rename d8/l9 to d8/l40 0 2024-09-21T11:39:20.827 INFO:tasks.workunit.client.0.smithi118.stdout:0/560: dwrite d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:20.829 INFO:tasks.workunit.client.0.smithi118.stdout:8/512: symlink d2/dc/d49/d84/lae 0 2024-09-21T11:39:20.829 INFO:tasks.workunit.client.1.smithi149.stdout:6/773: getdents d8/d32/d37/d2b/d7d/db8/dc4 0 2024-09-21T11:39:20.835 INFO:tasks.workunit.client.0.smithi118.stdout:8/513: creat d2/d7c/d88/d8f/daa/faf x:0 0 0 2024-09-21T11:39:20.837 INFO:tasks.workunit.client.0.smithi118.stdout:6/194: dwrite d8/d14/f1d [0,4194304] 0 2024-09-21T11:39:20.837 INFO:tasks.workunit.client.1.smithi149.stdout:3/893: mknod d6/d1f/d47/d22/d8d/d97/c132 0 2024-09-21T11:39:20.837 INFO:tasks.workunit.client.1.smithi149.stdout:8/737: link d3/d12/d6e/cca d3/d33/d34/d72/d83/cf9 0 2024-09-21T11:39:20.837 INFO:tasks.workunit.client.1.smithi149.stdout:4/872: mknod d4/d6/d63/d15/dd2/c124 0 2024-09-21T11:39:20.838 INFO:tasks.workunit.client.0.smithi118.stdout:0/561: getdents d5/d29/d68 0 2024-09-21T11:39:20.839 INFO:tasks.workunit.client.0.smithi118.stdout:0/562: fdatasync d5/d10/fb9 0 2024-09-21T11:39:20.839 INFO:tasks.workunit.client.1.smithi149.stdout:0/786: creat dd/de5/f102 x:0 0 0 2024-09-21T11:39:20.840 INFO:tasks.workunit.client.0.smithi118.stdout:8/514: mkdir d2/dc/d16/d46/d4c/db0 0 2024-09-21T11:39:20.841 INFO:tasks.workunit.client.0.smithi118.stdout:8/515: write d2/dc/d10/d2e/f55 [2412245,94993] 0 2024-09-21T11:39:20.842 INFO:tasks.workunit.client.0.smithi118.stdout:8/516: chown d2/dc/d10/l24 500 1 2024-09-21T11:39:20.842 INFO:tasks.workunit.client.1.smithi149.stdout:8/738: write d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/f8d [8219684,70670] 0 2024-09-21T11:39:20.843 INFO:tasks.workunit.client.0.smithi118.stdout:6/195: rename d8/d14/d28/c30 to d8/d14/d28/c41 0 2024-09-21T11:39:20.843 INFO:tasks.workunit.client.0.smithi118.stdout:6/196: chown d8/lf 1500 1 2024-09-21T11:39:20.843 INFO:tasks.workunit.client.1.smithi149.stdout:8/739: fdatasync d3/fa 0 2024-09-21T11:39:20.844 INFO:tasks.workunit.client.0.smithi118.stdout:6/197: write d8/f1a [6015905,59977] 0 2024-09-21T11:39:20.844 INFO:tasks.workunit.client.0.smithi118.stdout:0/563: creat d5/d10/d1e/d3d/d93/fc6 x:0 0 0 2024-09-21T11:39:20.848 INFO:tasks.workunit.client.0.smithi118.stdout:8/517: fsync d2/fa 0 2024-09-21T11:39:20.850 INFO:tasks.workunit.client.0.smithi118.stdout:6/198: symlink d8/d14/d28/l42 0 2024-09-21T11:39:20.851 INFO:tasks.workunit.client.0.smithi118.stdout:6/199: write d8/d14/f1d [1765311,120157] 0 2024-09-21T11:39:20.851 INFO:tasks.workunit.client.1.smithi149.stdout:1/783: truncate d2/dd/d35/d1c/d41/d51/d73/fca 2844750 0 2024-09-21T11:39:20.852 INFO:tasks.workunit.client.1.smithi149.stdout:1/784: chown d2/dd/d35/d5b/fbd 6049575 1 2024-09-21T11:39:20.853 INFO:tasks.workunit.client.0.smithi118.stdout:0/564: mkdir d5/d10/d1e/d20/dc7 0 2024-09-21T11:39:20.853 INFO:tasks.workunit.client.1.smithi149.stdout:1/785: truncate d2/d5/d8/f17 9190574 0 2024-09-21T11:39:20.854 INFO:tasks.workunit.client.1.smithi149.stdout:0/787: symlink dd/d1a/d1b/d72/d78/dc4/d3a/d66/dcf/l103 0 2024-09-21T11:39:20.856 INFO:tasks.workunit.client.1.smithi149.stdout:0/788: write dd/d1a/d1b/d72/d78/dc4/d3a/dd1/ff9 [420261,66733] 0 2024-09-21T11:39:20.856 INFO:tasks.workunit.client.1.smithi149.stdout:2/960: creat d8/da/d13/d1a/f14b x:0 0 0 2024-09-21T11:39:20.857 INFO:tasks.workunit.client.1.smithi149.stdout:0/789: chown dd/d1a/d5a/fe9 59011395 1 2024-09-21T11:39:20.857 INFO:tasks.workunit.client.0.smithi118.stdout:6/200: creat d8/d14/d33/f43 x:0 0 0 2024-09-21T11:39:20.857 INFO:tasks.workunit.client.1.smithi149.stdout:0/790: chown dd/d1a/d1b/d50/c51 2818 1 2024-09-21T11:39:20.859 INFO:tasks.workunit.client.0.smithi118.stdout:6/201: mkdir d8/d14/d44 0 2024-09-21T11:39:20.860 INFO:tasks.workunit.client.1.smithi149.stdout:4/873: mkdir d4/d4d/d125 0 2024-09-21T11:39:20.860 INFO:tasks.workunit.client.0.smithi118.stdout:0/565: creat d5/d81/fc8 x:0 0 0 2024-09-21T11:39:20.861 INFO:tasks.workunit.client.0.smithi118.stdout:8/518: fsync d2/d7c/d88/d8f/daa/faf 0 2024-09-21T11:39:20.862 INFO:tasks.workunit.client.0.smithi118.stdout:8/519: readlink d2/dc/d35/d50/l78 0 2024-09-21T11:39:20.863 INFO:tasks.workunit.client.1.smithi149.stdout:0/791: dread dd/d1a/d1b/d72/d85/d8c/f89 [4194304,4194304] 0 2024-09-21T11:39:20.865 INFO:tasks.workunit.client.1.smithi149.stdout:6/774: rename d8/d32/d37/df8 to d8/d32/d37/d28/d106 0 2024-09-21T11:39:20.866 INFO:tasks.workunit.client.0.smithi118.stdout:0/566: creat d5/d10/d1e/d3d/d93/fc9 x:0 0 0 2024-09-21T11:39:20.866 INFO:tasks.workunit.client.1.smithi149.stdout:4/874: dwrite d4/f80 [0,4194304] 0 2024-09-21T11:39:20.867 INFO:tasks.workunit.client.1.smithi149.stdout:6/775: read d8/da/d14/ff7 [2459,126649] 0 2024-09-21T11:39:20.868 INFO:tasks.workunit.client.0.smithi118.stdout:8/520: fsync d2/f72 0 2024-09-21T11:39:20.869 INFO:tasks.workunit.client.1.smithi149.stdout:1/786: rmdir d2/d5/db3/dd9 39 2024-09-21T11:39:20.877 INFO:tasks.workunit.client.0.smithi118.stdout:0/567: dwrite d5/d29/d68/d7b/db7/d48/f60 [0,4194304] 0 2024-09-21T11:39:20.881 INFO:tasks.workunit.client.0.smithi118.stdout:8/521: symlink d2/dc/d16/d46/d4c/db0/lb1 0 2024-09-21T11:39:20.884 INFO:tasks.workunit.client.0.smithi118.stdout:8/522: truncate d2/d7c/d88/d8f/daa/faf 727066 0 2024-09-21T11:39:20.886 INFO:tasks.workunit.client.1.smithi149.stdout:3/894: link d6/d1f/d47/d22/l94 d6/d1f/d27/l133 0 2024-09-21T11:39:20.887 INFO:tasks.workunit.client.1.smithi149.stdout:4/875: dwrite d4/d6/d63/d15/d16/d23/f102 [0,4194304] 0 2024-09-21T11:39:20.887 INFO:tasks.workunit.client.1.smithi149.stdout:6/776: dwrite d8/d32/d37/d28/d2f/d6a/d72/fe1 [0,4194304] 0 2024-09-21T11:39:20.887 INFO:tasks.workunit.client.0.smithi118.stdout:6/202: write d8/f15 [4103999,92029] 0 2024-09-21T11:39:20.890 INFO:tasks.workunit.client.1.smithi149.stdout:3/895: read d6/d1f/d4c/fb8 [1027415,21684] 0 2024-09-21T11:39:20.891 INFO:tasks.workunit.client.0.smithi118.stdout:6/203: rmdir d8/d14 39 2024-09-21T11:39:20.892 INFO:tasks.workunit.client.0.smithi118.stdout:8/523: dwrite d2/dc/d16/f87 [4194304,4194304] 0 2024-09-21T11:39:20.892 INFO:tasks.workunit.client.0.smithi118.stdout:6/204: fsync f6 0 2024-09-21T11:39:20.896 INFO:tasks.workunit.client.1.smithi149.stdout:8/740: getdents d3/d33/d34/d55/d95 0 2024-09-21T11:39:20.896 INFO:tasks.workunit.client.0.smithi118.stdout:8/524: chown d2/dc/d10/d2e/d18/d1a/c1c 2962194 1 2024-09-21T11:39:20.898 INFO:tasks.workunit.client.0.smithi118.stdout:8/525: dread - d2/d73/d79/f9a zero size 2024-09-21T11:39:20.898 INFO:tasks.workunit.client.0.smithi118.stdout:6/205: write d8/d14/f24 [3167130,59241] 0 2024-09-21T11:39:20.899 INFO:tasks.workunit.client.0.smithi118.stdout:8/526: fdatasync d2/d73/f94 0 2024-09-21T11:39:20.900 INFO:tasks.workunit.client.0.smithi118.stdout:6/206: chown d8/d14/d33/f3f 6 1 2024-09-21T11:39:20.900 INFO:tasks.workunit.client.1.smithi149.stdout:8/741: chown d3/d12/d6e 5479919 1 2024-09-21T11:39:20.904 INFO:tasks.workunit.client.1.smithi149.stdout:4/876: fdatasync d4/d6/d63/d15/f54 0 2024-09-21T11:39:20.905 INFO:tasks.workunit.client.1.smithi149.stdout:2/961: dread d8/dd/d5c/d60/d67/d8a/f90 [0,4194304] 0 2024-09-21T11:39:20.907 INFO:tasks.workunit.client.0.smithi118.stdout:8/527: stat d2/dc/d35/d42 0 2024-09-21T11:39:20.910 INFO:tasks.workunit.client.1.smithi149.stdout:8/742: rmdir d3/d33/d34/d55 39 2024-09-21T11:39:20.911 INFO:tasks.workunit.client.1.smithi149.stdout:1/787: dread d2/dd/d35/f24 [0,4194304] 0 2024-09-21T11:39:20.912 INFO:tasks.workunit.client.0.smithi118.stdout:8/528: dwrite d2/dc/d10/d2e/f5f [0,4194304] 0 2024-09-21T11:39:20.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/962: creat d8/d44/d63/db9/d5a/f14c x:0 0 0 2024-09-21T11:39:20.913 INFO:tasks.workunit.client.1.smithi149.stdout:4/877: creat d4/d4d/d125/f126 x:0 0 0 2024-09-21T11:39:20.914 INFO:tasks.workunit.client.0.smithi118.stdout:8/529: mknod d2/dc/d10/cb2 0 2024-09-21T11:39:20.916 INFO:tasks.workunit.client.0.smithi118.stdout:8/530: dread - d2/dc/d16/d46/d4c/d63/f9d zero size 2024-09-21T11:39:20.918 INFO:tasks.workunit.client.0.smithi118.stdout:8/531: read d2/dc/d10/d3b/f6d [240486,126814] 0 2024-09-21T11:39:20.918 INFO:tasks.workunit.client.1.smithi149.stdout:2/963: symlink d8/da/d13/d53/l14d 0 2024-09-21T11:39:20.919 INFO:tasks.workunit.client.0.smithi118.stdout:0/568: dread d5/d29/d68/d7b/db7/d48/f64 [0,4194304] 0 2024-09-21T11:39:20.920 INFO:tasks.workunit.client.0.smithi118.stdout:8/532: write d2/dc/d16/d46/d4c/d63/f9d [249315,109193] 0 2024-09-21T11:39:20.923 INFO:tasks.workunit.client.0.smithi118.stdout:8/533: dread d2/dc/d35/d42/fa1 [0,4194304] 0 2024-09-21T11:39:20.923 INFO:tasks.workunit.client.1.smithi149.stdout:2/964: chown d8/da/d13/d83 2157 1 2024-09-21T11:39:20.924 INFO:tasks.workunit.client.1.smithi149.stdout:6/777: dwrite d8/d32/d37/d2b/d7d/fa0 [4194304,4194304] 0 2024-09-21T11:39:20.926 INFO:tasks.workunit.client.0.smithi118.stdout:0/569: dwrite d5/d29/d68/d7b/db7/d48/fa6 [0,4194304] 0 2024-09-21T11:39:20.926 INFO:tasks.workunit.client.1.smithi149.stdout:2/965: symlink d8/d44/d63/db9/l14e 0 2024-09-21T11:39:20.927 INFO:tasks.workunit.client.1.smithi149.stdout:9/820: sync 2024-09-21T11:39:20.927 INFO:tasks.workunit.client.0.smithi118.stdout:0/570: dread - d5/d10/d1e/d3d/d93/f96 zero size 2024-09-21T11:39:20.927 INFO:tasks.workunit.client.0.smithi118.stdout:3/222: sync 2024-09-21T11:39:20.927 INFO:tasks.workunit.client.0.smithi118.stdout:7/201: sync 2024-09-21T11:39:20.928 INFO:tasks.workunit.client.1.smithi149.stdout:6/778: chown d8/d32/d64/f9c 13 1 2024-09-21T11:39:20.928 INFO:tasks.workunit.client.0.smithi118.stdout:8/534: mknod d2/dc/d10/d6a/cb3 0 2024-09-21T11:39:20.931 INFO:tasks.workunit.client.0.smithi118.stdout:7/202: truncate d0/f16 5093505 0 2024-09-21T11:39:20.932 INFO:tasks.workunit.client.0.smithi118.stdout:3/223: dread d5/d1d/f16 [0,4194304] 0 2024-09-21T11:39:20.933 INFO:tasks.workunit.client.1.smithi149.stdout:0/792: dwrite dd/d2d/f4f [0,4194304] 0 2024-09-21T11:39:20.934 INFO:tasks.workunit.client.0.smithi118.stdout:8/535: mkdir d2/dc/d16/d46/d4c/d63/db4 0 2024-09-21T11:39:20.935 INFO:tasks.workunit.client.0.smithi118.stdout:7/203: write d0/d3/d13/f2f [1559949,67883] 0 2024-09-21T11:39:20.936 INFO:tasks.workunit.client.0.smithi118.stdout:3/224: readlink d5/l13 0 2024-09-21T11:39:20.936 INFO:tasks.workunit.client.0.smithi118.stdout:0/571: dwrite d5/d10/d1e/d21/db3/fc1 [0,4194304] 0 2024-09-21T11:39:20.939 INFO:tasks.workunit.client.0.smithi118.stdout:0/572: chown d5/d10/fb5 4 1 2024-09-21T11:39:20.939 INFO:tasks.workunit.client.0.smithi118.stdout:3/225: dread d5/d1d/f16 [0,4194304] 0 2024-09-21T11:39:20.941 INFO:tasks.workunit.client.0.smithi118.stdout:8/536: dread d2/dc/d10/d2e/f55 [0,4194304] 0 2024-09-21T11:39:20.942 INFO:tasks.workunit.client.1.smithi149.stdout:2/966: write d8/d11/f127 [528138,41253] 0 2024-09-21T11:39:20.946 INFO:tasks.workunit.client.0.smithi118.stdout:0/573: getdents d5/d10/d1e/d23/d3a/d4e/d9d 0 2024-09-21T11:39:20.949 INFO:tasks.workunit.client.1.smithi149.stdout:2/967: chown d8/dd/d50/c122 75997 1 2024-09-21T11:39:20.953 INFO:tasks.workunit.client.0.smithi118.stdout:0/574: creat d5/d10/d1e/d23/fca x:0 0 0 2024-09-21T11:39:20.954 INFO:tasks.workunit.client.0.smithi118.stdout:8/537: creat d2/dc/d49/fb5 x:0 0 0 2024-09-21T11:39:20.955 INFO:tasks.workunit.client.0.smithi118.stdout:6/207: dwrite d8/d14/f1e [0,4194304] 0 2024-09-21T11:39:20.956 INFO:tasks.workunit.client.1.smithi149.stdout:9/821: creat d18/d19/d1a/d2f/d33/d91/dd7/f104 x:0 0 0 2024-09-21T11:39:20.956 INFO:tasks.workunit.client.1.smithi149.stdout:4/878: dwrite d4/d6/d63/d15/d30/f6d [4194304,4194304] 0 2024-09-21T11:39:20.960 INFO:tasks.workunit.client.0.smithi118.stdout:6/208: unlink d8/c3c 0 2024-09-21T11:39:20.961 INFO:tasks.workunit.client.1.smithi149.stdout:5/929: sync 2024-09-21T11:39:20.962 INFO:tasks.workunit.client.1.smithi149.stdout:8/743: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/fc0 [0,4194304] 0 2024-09-21T11:39:20.962 INFO:tasks.workunit.client.1.smithi149.stdout:1/788: write d2/d5/d65/f79 [5019617,11677] 0 2024-09-21T11:39:20.965 INFO:tasks.workunit.client.0.smithi118.stdout:0/575: fdatasync d5/d29/d68/d7b/db7/f83 0 2024-09-21T11:39:20.967 INFO:tasks.workunit.client.1.smithi149.stdout:2/968: mknod d8/da/d13/d1a/d3b/c14f 0 2024-09-21T11:39:20.968 INFO:tasks.workunit.client.0.smithi118.stdout:6/209: mkdir d8/d14/d28/d45 0 2024-09-21T11:39:20.970 INFO:tasks.workunit.client.0.smithi118.stdout:8/538: unlink d2/dc/d10/d2e/d18/c91 0 2024-09-21T11:39:20.970 INFO:tasks.workunit.client.1.smithi149.stdout:3/896: sync 2024-09-21T11:39:20.970 INFO:tasks.workunit.client.1.smithi149.stdout:7/909: sync 2024-09-21T11:39:20.971 INFO:tasks.workunit.client.0.smithi118.stdout:8/539: readlink d2/dc/d35/d42/la0 0 2024-09-21T11:39:20.972 INFO:tasks.workunit.client.1.smithi149.stdout:1/789: stat d2/d5/d8/f40 0 2024-09-21T11:39:20.975 INFO:tasks.workunit.client.0.smithi118.stdout:0/576: mkdir d5/d10/d1e/d23/d3a/d4e/dcb 0 2024-09-21T11:39:20.976 INFO:tasks.workunit.client.1.smithi149.stdout:0/793: dwrite dd/d1a/d1b/d72/d78/dc4/d3a/dd1/dde/fed [0,4194304] 0 2024-09-21T11:39:20.976 INFO:tasks.workunit.client.0.smithi118.stdout:0/577: read - d5/d10/d1e/fa9 zero size 2024-09-21T11:39:20.977 INFO:tasks.workunit.client.1.smithi149.stdout:3/897: readlink d6/d1f/lc9 0 2024-09-21T11:39:20.980 INFO:tasks.workunit.client.0.smithi118.stdout:3/226: write d5/d28/f3b [2208041,114722] 0 2024-09-21T11:39:20.981 INFO:tasks.workunit.client.0.smithi118.stdout:6/210: mkdir d8/d46 0 2024-09-21T11:39:20.981 INFO:tasks.workunit.client.1.smithi149.stdout:9/822: truncate d18/d19/d29/d39/d63/f6c 433209 0 2024-09-21T11:39:20.982 INFO:tasks.workunit.client.0.smithi118.stdout:6/211: chown d8/d14/d33/c34 16536 1 2024-09-21T11:39:20.982 INFO:tasks.workunit.client.0.smithi118.stdout:6/212: chown d8/f25 1879859115 1 2024-09-21T11:39:20.985 INFO:tasks.workunit.client.0.smithi118.stdout:6/213: write d8/d14/d33/f3e [802287,123378] 0 2024-09-21T11:39:20.986 INFO:tasks.workunit.client.1.smithi149.stdout:1/790: dread - d2/dd/d35/d1c/d41/d51/d73/fbb zero size 2024-09-21T11:39:20.990 INFO:tasks.workunit.client.1.smithi149.stdout:2/969: truncate d8/da/d13/d1a/d3b/f51 480395 0 2024-09-21T11:39:20.991 INFO:tasks.workunit.client.1.smithi149.stdout:0/794: mkdir dd/d1a/d1b/d72/dc1/d104 0 2024-09-21T11:39:20.991 INFO:tasks.workunit.client.0.smithi118.stdout:6/214: rename d8/d14/c27 to d8/d14/d28/c47 0 2024-09-21T11:39:20.993 INFO:tasks.workunit.client.1.smithi149.stdout:9/823: dread - d18/d19/d1a/d2f/d33/fd9 zero size 2024-09-21T11:39:20.994 INFO:tasks.workunit.client.0.smithi118.stdout:7/204: dread d0/f5 [4194304,4194304] 0 2024-09-21T11:39:20.994 INFO:tasks.workunit.client.0.smithi118.stdout:0/578: dread d5/d29/d68/d7b/db7/f83 [0,4194304] 0 2024-09-21T11:39:20.995 INFO:tasks.workunit.client.1.smithi149.stdout:1/791: symlink d2/dd/d35/d5b/dc0/lff 0 2024-09-21T11:39:20.995 INFO:tasks.workunit.client.0.smithi118.stdout:6/215: fdatasync d8/f25 0 2024-09-21T11:39:20.996 INFO:tasks.workunit.client.0.smithi118.stdout:3/227: dread d5/d1d/d1b/d24/f38 [0,4194304] 0 2024-09-21T11:39:20.996 INFO:tasks.workunit.client.0.smithi118.stdout:0/579: readlink d5/d10/d1e/l22 0 2024-09-21T11:39:20.997 INFO:tasks.workunit.client.1.smithi149.stdout:2/970: creat d8/d44/f150 x:0 0 0 2024-09-21T11:39:20.999 INFO:tasks.workunit.client.0.smithi118.stdout:7/205: fsync d0/f2 0 2024-09-21T11:39:21.000 INFO:tasks.workunit.client.0.smithi118.stdout:7/206: write d0/d3/d13/f38 [201686,97886] 0 2024-09-21T11:39:21.002 INFO:tasks.workunit.client.1.smithi149.stdout:3/898: dwrite d6/d1f/d47/f128 [0,4194304] 0 2024-09-21T11:39:21.002 INFO:tasks.workunit.client.1.smithi149.stdout:6/779: dwrite d8/d32/d37/d2b/d51/f94 [0,4194304] 0 2024-09-21T11:39:21.007 INFO:tasks.workunit.client.1.smithi149.stdout:7/910: rename d12/d5b/db5/dc5/de9/d4a/f93 to d12/d5b/db5/dc5/de9/da1/f11e 0 2024-09-21T11:39:21.008 INFO:tasks.workunit.client.0.smithi118.stdout:8/540: truncate d2/dc/d10/d2e/fa5 6867822 0 2024-09-21T11:39:21.009 INFO:tasks.workunit.client.0.smithi118.stdout:8/541: chown d2/dc/d35/la6 272189 1 2024-09-21T11:39:21.010 INFO:tasks.workunit.client.0.smithi118.stdout:8/542: dread - d2/dc/fac zero size 2024-09-21T11:39:21.011 INFO:tasks.workunit.client.1.smithi149.stdout:5/930: getdents d4/d7/d40/d43 0 2024-09-21T11:39:21.016 INFO:tasks.workunit.client.1.smithi149.stdout:8/744: dread d3/d33/d34/d72/f9c [0,4194304] 0 2024-09-21T11:39:21.016 INFO:tasks.workunit.client.1.smithi149.stdout:2/971: mknod d8/dd/d5c/c151 0 2024-09-21T11:39:21.017 INFO:tasks.workunit.client.1.smithi149.stdout:0/795: dwrite dd/d1a/d1b/d72/d85/d8c/ff5 [0,4194304] 0 2024-09-21T11:39:21.017 INFO:tasks.workunit.client.1.smithi149.stdout:6/780: write d8/d32/d37/f49 [4562985,109921] 0 2024-09-21T11:39:21.020 INFO:tasks.workunit.client.1.smithi149.stdout:4/879: dwrite d4/d6/d63/d78/d98/dee/ff5 [0,4194304] 0 2024-09-21T11:39:21.024 INFO:tasks.workunit.client.0.smithi118.stdout:0/580: write d5/d10/d1e/d20/f2f [1739396,36870] 0 2024-09-21T11:39:21.025 INFO:tasks.workunit.client.0.smithi118.stdout:6/216: rename d8/d14/d28 to d8/d48 0 2024-09-21T11:39:21.026 INFO:tasks.workunit.client.1.smithi149.stdout:6/781: write d8/da/d3d/f43 [2904921,38220] 0 2024-09-21T11:39:21.029 INFO:tasks.workunit.client.0.smithi118.stdout:8/543: symlink d2/dc/d10/d2e/d9b/lb6 0 2024-09-21T11:39:21.030 INFO:tasks.workunit.client.0.smithi118.stdout:8/544: readlink d2/dc/d10/d2e/d18/d1a/l76 0 2024-09-21T11:39:21.030 INFO:tasks.workunit.client.1.smithi149.stdout:7/911: creat d12/d5b/db5/dc5/de9/d4a/d6c/da0/df0/f11f x:0 0 0 2024-09-21T11:39:21.032 INFO:tasks.workunit.client.0.smithi118.stdout:8/545: write d2/d7c/d88/fa9 [552782,105032] 0 2024-09-21T11:39:21.032 INFO:tasks.workunit.client.0.smithi118.stdout:0/581: creat d5/d10/d1e/d33/fcc x:0 0 0 2024-09-21T11:39:21.033 INFO:tasks.workunit.client.0.smithi118.stdout:8/546: chown d2/dc/d10/d2e/f55 695405522 1 2024-09-21T11:39:21.034 INFO:tasks.workunit.client.0.smithi118.stdout:8/547: write d2/f29 [1074875,4381] 0 2024-09-21T11:39:21.035 INFO:tasks.workunit.client.0.smithi118.stdout:8/548: dread - d2/dc/d49/fb5 zero size 2024-09-21T11:39:21.037 INFO:tasks.workunit.client.0.smithi118.stdout:8/549: write d2/dc/d16/d46/f8e [932839,33227] 0 2024-09-21T11:39:21.037 INFO:tasks.workunit.client.0.smithi118.stdout:3/228: rename d5/d28/d33/f3c to d5/d1d/d1b/d4c/f56 0 2024-09-21T11:39:21.037 INFO:tasks.workunit.client.0.smithi118.stdout:7/207: write d0/fe [715761,115193] 0 2024-09-21T11:39:21.039 INFO:tasks.workunit.client.0.smithi118.stdout:6/217: truncate d8/f22 478073 0 2024-09-21T11:39:21.039 INFO:tasks.workunit.client.1.smithi149.stdout:1/792: dwrite d2/d5/d8/fa [0,4194304] 0 2024-09-21T11:39:21.040 INFO:tasks.workunit.client.0.smithi118.stdout:8/550: truncate d2/d7c/d88/d8f/daa/faf 1350809 0 2024-09-21T11:39:21.041 INFO:tasks.workunit.client.0.smithi118.stdout:8/551: chown d2/dc/f26 46854463 1 2024-09-21T11:39:21.041 INFO:tasks.workunit.client.1.smithi149.stdout:5/931: mkdir d4/d1d/d50/d54/dec/d130 0 2024-09-21T11:39:21.042 INFO:tasks.workunit.client.0.smithi118.stdout:0/582: creat d5/d29/fcd x:0 0 0 2024-09-21T11:39:21.043 INFO:tasks.workunit.client.0.smithi118.stdout:0/583: readlink d5/d29/d68/d7b/db7/d48/l4f 0 2024-09-21T11:39:21.046 INFO:tasks.workunit.client.0.smithi118.stdout:7/208: symlink d0/d3/d1d/d35/l48 0 2024-09-21T11:39:21.049 INFO:tasks.workunit.client.0.smithi118.stdout:8/552: symlink d2/dc/d10/d3b/lb7 0 2024-09-21T11:39:21.049 INFO:tasks.workunit.client.1.smithi149.stdout:8/745: rmdir d3/d12/d6e/d79/d8e 39 2024-09-21T11:39:21.050 INFO:tasks.workunit.client.0.smithi118.stdout:0/584: mknod d5/d29/d68/cce 0 2024-09-21T11:39:21.052 INFO:tasks.workunit.client.0.smithi118.stdout:6/218: symlink d8/l49 0 2024-09-21T11:39:21.053 INFO:tasks.workunit.client.1.smithi149.stdout:8/746: dread d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/fed [0,4194304] 0 2024-09-21T11:39:21.053 INFO:tasks.workunit.client.1.smithi149.stdout:6/782: rename d8/d32/d37/d2b/d51/c5f to d8/d32/d64/c107 0 2024-09-21T11:39:21.054 INFO:tasks.workunit.client.0.smithi118.stdout:6/219: read d8/d14/d33/f39 [643665,53542] 0 2024-09-21T11:39:21.054 INFO:tasks.workunit.client.0.smithi118.stdout:7/209: mknod d0/d3/d14/c49 0 2024-09-21T11:39:21.054 INFO:tasks.workunit.client.0.smithi118.stdout:6/220: fdatasync d8/fc 0 2024-09-21T11:39:21.056 INFO:tasks.workunit.client.0.smithi118.stdout:0/585: creat d5/d10/d1e/d21/fcf x:0 0 0 2024-09-21T11:39:21.056 INFO:tasks.workunit.client.0.smithi118.stdout:0/586: readlink d5/d10/l84 0 2024-09-21T11:39:21.057 INFO:tasks.workunit.client.1.smithi149.stdout:1/793: creat d2/dd/d35/d7c/f100 x:0 0 0 2024-09-21T11:39:21.057 INFO:tasks.workunit.client.0.smithi118.stdout:0/587: chown d5/d10/d1e/d23/d3a/d4e 3 1 2024-09-21T11:39:21.059 INFO:tasks.workunit.client.1.smithi149.stdout:5/932: mknod d4/d1d/d50/d60/c131 0 2024-09-21T11:39:21.059 INFO:tasks.workunit.client.1.smithi149.stdout:5/933: readlink d4/d7/d40/d43/d49/dc3/l120 0 2024-09-21T11:39:21.059 INFO:tasks.workunit.client.0.smithi118.stdout:0/588: chown d5/d10/d1e/d21/f2d 1965498799 1 2024-09-21T11:39:21.060 INFO:tasks.workunit.client.0.smithi118.stdout:8/553: rename d2/dc/d10/d2e/d18/l5a to d2/dc/d16/d46/d4c/db0/lb8 0 2024-09-21T11:39:21.060 INFO:tasks.workunit.client.1.smithi149.stdout:9/824: write d18/d19/d29/d39/d63/f6c [424155,126294] 0 2024-09-21T11:39:21.061 INFO:tasks.workunit.client.1.smithi149.stdout:9/825: chown d18/d19/d1a/d2f/d53/cf8 6 1 2024-09-21T11:39:21.062 INFO:tasks.workunit.client.0.smithi118.stdout:7/210: mknod d0/d3/d13/d3d/d3e/c4a 0 2024-09-21T11:39:21.063 INFO:tasks.workunit.client.0.smithi118.stdout:8/554: dread d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:21.066 INFO:tasks.workunit.client.1.smithi149.stdout:6/783: mknod d8/c108 0 2024-09-21T11:39:21.069 INFO:tasks.workunit.client.0.smithi118.stdout:7/211: link d0/d3/d13/d3d/d3e/f42 d0/d3/d14/d41/f4b 0 2024-09-21T11:39:21.069 INFO:tasks.workunit.client.1.smithi149.stdout:7/912: getdents d12/d5b/db5/dc5/de9/d4a/d4f/dce 0 2024-09-21T11:39:21.071 INFO:tasks.workunit.client.0.smithi118.stdout:6/221: dread d8/d14/f32 [0,4194304] 0 2024-09-21T11:39:21.071 INFO:tasks.workunit.client.1.smithi149.stdout:1/794: fsync d2/dd/d2e/d4c/f75 0 2024-09-21T11:39:21.072 INFO:tasks.workunit.client.1.smithi149.stdout:1/795: dread - d2/d5/d8/dc1/fcc zero size 2024-09-21T11:39:21.075 INFO:tasks.workunit.client.1.smithi149.stdout:5/934: mkdir d4/d7/d40/d51/d56/d132 0 2024-09-21T11:39:21.077 INFO:tasks.workunit.client.0.smithi118.stdout:6/222: mkdir d8/d14/d4a 0 2024-09-21T11:39:21.077 INFO:tasks.workunit.client.1.smithi149.stdout:1/796: dwrite d2/dd/ff8 [0,4194304] 0 2024-09-21T11:39:21.080 INFO:tasks.workunit.client.0.smithi118.stdout:7/212: dread d0/d3/ff [0,4194304] 0 2024-09-21T11:39:21.085 INFO:tasks.workunit.client.1.smithi149.stdout:3/899: getdents d6/d1f/d27 0 2024-09-21T11:39:21.088 INFO:tasks.workunit.client.0.smithi118.stdout:7/213: dwrite d0/d3/d29/f20 [0,4194304] 0 2024-09-21T11:39:21.094 INFO:tasks.workunit.client.0.smithi118.stdout:6/223: creat d8/f4b x:0 0 0 2024-09-21T11:39:21.094 INFO:tasks.workunit.client.1.smithi149.stdout:2/972: getdents d8/d11/dac 0 2024-09-21T11:39:21.095 INFO:tasks.workunit.client.1.smithi149.stdout:4/880: write d4/d6/d63/d15/d16/d23/d62/fa2 [3913321,39924] 0 2024-09-21T11:39:21.096 INFO:tasks.workunit.client.0.smithi118.stdout:7/214: unlink d0/d3/d13/d3d/d3e/l40 0 2024-09-21T11:39:21.098 INFO:tasks.workunit.client.1.smithi149.stdout:7/913: dread d12/d5b/db5/dc5/de9/d68/dc4/f29 [0,4194304] 0 2024-09-21T11:39:21.099 INFO:tasks.workunit.client.1.smithi149.stdout:5/935: creat d4/d4f/df4/f133 x:0 0 0 2024-09-21T11:39:21.100 INFO:tasks.workunit.client.1.smithi149.stdout:5/936: chown d4/d7/l7e 0 1 2024-09-21T11:39:21.101 INFO:tasks.workunit.client.0.smithi118.stdout:0/589: dwrite d5/f7 [0,4194304] 0 2024-09-21T11:39:21.101 INFO:tasks.workunit.client.0.smithi118.stdout:7/215: write d0/d3/ff [3523344,23191] 0 2024-09-21T11:39:21.102 INFO:tasks.workunit.client.1.smithi149.stdout:1/797: mkdir d2/d2b/d101 0 2024-09-21T11:39:21.103 INFO:tasks.workunit.client.0.smithi118.stdout:0/590: dread - d5/d10/d1e/d3d/d93/fc6 zero size 2024-09-21T11:39:21.104 INFO:tasks.workunit.client.0.smithi118.stdout:6/224: mknod d8/c4c 0 2024-09-21T11:39:21.104 INFO:tasks.workunit.client.0.smithi118.stdout:6/225: dread - d8/f4b zero size 2024-09-21T11:39:21.106 INFO:tasks.workunit.client.1.smithi149.stdout:1/798: read d2/dd/d35/d7c/fb4 [5305000,11246] 0 2024-09-21T11:39:21.106 INFO:tasks.workunit.client.0.smithi118.stdout:7/216: rename d0/d3/ff to d0/d3/d14/f4c 0 2024-09-21T11:39:21.107 INFO:tasks.workunit.client.1.smithi149.stdout:9/826: write d18/d36/f7f [4888702,99422] 0 2024-09-21T11:39:21.108 INFO:tasks.workunit.client.1.smithi149.stdout:3/900: mknod d6/d79/c134 0 2024-09-21T11:39:21.108 INFO:tasks.workunit.client.0.smithi118.stdout:7/217: write d0/f16 [3402841,47793] 0 2024-09-21T11:39:21.108 INFO:tasks.workunit.client.1.smithi149.stdout:9/827: fdatasync d18/d36/d3c/dcb/fd2 0 2024-09-21T11:39:21.109 INFO:tasks.workunit.client.0.smithi118.stdout:7/218: dread - d0/d3/d14/f3c zero size 2024-09-21T11:39:21.112 INFO:tasks.workunit.client.1.smithi149.stdout:2/973: unlink d8/dcb/db8/dd3/ffb 0 2024-09-21T11:39:21.113 INFO:tasks.workunit.client.0.smithi118.stdout:8/555: dwrite d2/dc/d10/d2e/fa5 [0,4194304] 0 2024-09-21T11:39:21.114 INFO:tasks.workunit.client.0.smithi118.stdout:0/591: rename d5/f15 to d5/d10/d1e/d21/db3/dbe/fd0 0 2024-09-21T11:39:21.115 INFO:tasks.workunit.client.0.smithi118.stdout:8/556: chown d2/dc/d49/d84/d99 45738273 1 2024-09-21T11:39:21.116 INFO:tasks.workunit.client.0.smithi118.stdout:8/557: truncate d2/d73/f92 562596 0 2024-09-21T11:39:21.118 INFO:tasks.workunit.client.1.smithi149.stdout:5/937: mknod d4/d90/ddd/d107/c134 0 2024-09-21T11:39:21.120 INFO:tasks.workunit.client.1.smithi149.stdout:3/901: symlink d6/d1f/d47/d37/d3f/l135 0 2024-09-21T11:39:21.121 INFO:tasks.workunit.client.1.smithi149.stdout:8/747: rename d3/d33/d34/d55/d5e/c7f to d3/d12/d6e/cfa 0 2024-09-21T11:39:21.124 INFO:tasks.workunit.client.1.smithi149.stdout:4/881: creat d4/d6/d63/d15/d16/d23/d62/d100/f127 x:0 0 0 2024-09-21T11:39:21.124 INFO:tasks.workunit.client.1.smithi149.stdout:4/882: readlink d4/d4d/lce 0 2024-09-21T11:39:21.124 INFO:tasks.workunit.client.1.smithi149.stdout:0/796: sync 2024-09-21T11:39:21.126 INFO:tasks.workunit.client.1.smithi149.stdout:0/797: chown dd/d35/l58 0 1 2024-09-21T11:39:21.127 INFO:tasks.workunit.client.0.smithi118.stdout:8/558: mkdir d2/dc/d16/d46/d4c/d63/db9 0 2024-09-21T11:39:21.129 INFO:tasks.workunit.client.0.smithi118.stdout:6/226: getdents d8 0 2024-09-21T11:39:21.129 INFO:tasks.workunit.client.0.smithi118.stdout:6/227: fdatasync d8/d14/f1d 0 2024-09-21T11:39:21.130 INFO:tasks.workunit.client.0.smithi118.stdout:7/219: creat d0/d3/f4d x:0 0 0 2024-09-21T11:39:21.132 INFO:tasks.workunit.client.0.smithi118.stdout:8/559: dread d2/dc/d16/d46/f8e [0,4194304] 0 2024-09-21T11:39:21.133 INFO:tasks.workunit.client.1.smithi149.stdout:0/798: dwrite dd/d1a/d1b/f27 [0,4194304] 0 2024-09-21T11:39:21.133 INFO:tasks.workunit.client.0.smithi118.stdout:8/560: chown d2/f72 833219 1 2024-09-21T11:39:21.135 INFO:tasks.workunit.client.0.smithi118.stdout:5/272: sync 2024-09-21T11:39:21.136 INFO:tasks.workunit.client.1.smithi149.stdout:2/974: symlink d8/da/d13/d83/df6/d112/l152 0 2024-09-21T11:39:21.139 INFO:tasks.workunit.client.1.smithi149.stdout:8/748: dread d3/d33/d34/fbe [0,4194304] 0 2024-09-21T11:39:21.140 INFO:tasks.workunit.client.0.smithi118.stdout:6/228: dread - d8/d48/f2c zero size 2024-09-21T11:39:21.143 INFO:tasks.workunit.client.0.smithi118.stdout:7/220: fdatasync d0/f6 0 2024-09-21T11:39:21.143 INFO:tasks.workunit.client.0.smithi118.stdout:7/221: readlink d0/d3/l12 0 2024-09-21T11:39:21.145 INFO:tasks.workunit.client.1.smithi149.stdout:9/828: write d18/d19/d1a/f4b [8615555,127894] 0 2024-09-21T11:39:21.148 INFO:tasks.workunit.client.1.smithi149.stdout:1/799: write d2/d5/f6b [3718754,129400] 0 2024-09-21T11:39:21.149 INFO:tasks.workunit.client.0.smithi118.stdout:0/592: stat d5/d10/d1e/d23/d3a/d4e/d9d/fa7 0 2024-09-21T11:39:21.150 INFO:tasks.workunit.client.1.smithi149.stdout:0/799: dread dd/d6a/f88 [0,4194304] 0 2024-09-21T11:39:21.151 INFO:tasks.workunit.client.0.smithi118.stdout:6/229: unlink d8/d48/f2c 0 2024-09-21T11:39:21.152 INFO:tasks.workunit.client.0.smithi118.stdout:6/230: chown d8/l49 29765416 1 2024-09-21T11:39:21.153 INFO:tasks.workunit.client.1.smithi149.stdout:0/800: write dd/d1a/d1b/d72/d78/dc4/f5c [1260280,6686] 0 2024-09-21T11:39:21.153 INFO:tasks.workunit.client.1.smithi149.stdout:8/749: creat d3/d12/d98/ffb x:0 0 0 2024-09-21T11:39:21.154 INFO:tasks.workunit.client.0.smithi118.stdout:8/561: mkdir d2/dc/d10/d2e/dba 0 2024-09-21T11:39:21.156 INFO:tasks.workunit.client.1.smithi149.stdout:7/914: getdents d12/d5b/db5/dc5/de9 0 2024-09-21T11:39:21.157 INFO:tasks.workunit.client.0.smithi118.stdout:7/222: rename d0/f6 to d0/d3/d13/d3d/d3e/f4e 0 2024-09-21T11:39:21.157 INFO:tasks.workunit.client.1.smithi149.stdout:4/883: write d4/d6/d18/f73 [4907050,24199] 0 2024-09-21T11:39:21.157 INFO:tasks.workunit.client.0.smithi118.stdout:7/223: stat d0/d3/d14/d41 0 2024-09-21T11:39:21.158 INFO:tasks.workunit.client.0.smithi118.stdout:5/273: mknod d0/c60 0 2024-09-21T11:39:21.158 INFO:tasks.workunit.client.1.smithi149.stdout:0/801: write dd/d1a/d1b/d72/d78/d8b/d98/daa/fbd [5569010,69514] 0 2024-09-21T11:39:21.159 INFO:tasks.workunit.client.1.smithi149.stdout:2/975: dwrite d8/da/f39 [4194304,4194304] 0 2024-09-21T11:39:21.160 INFO:tasks.workunit.client.0.smithi118.stdout:0/593: creat d5/d10/d1e/d23/d3a/d4e/fd1 x:0 0 0 2024-09-21T11:39:21.162 INFO:tasks.workunit.client.1.smithi149.stdout:5/938: rename d4/d90/ddd/d107 to d4/d7/d135 0 2024-09-21T11:39:21.164 INFO:tasks.workunit.client.0.smithi118.stdout:6/231: rename d8/d14/d33/f39 to d8/d48/d45/f4d 0 2024-09-21T11:39:21.165 INFO:tasks.workunit.client.0.smithi118.stdout:7/224: rmdir d0/d3/d29 39 2024-09-21T11:39:21.165 INFO:tasks.workunit.client.0.smithi118.stdout:6/232: write d8/d14/f26 [187800,1338] 0 2024-09-21T11:39:21.168 INFO:tasks.workunit.client.1.smithi149.stdout:9/829: dread d18/d19/f40 [0,4194304] 0 2024-09-21T11:39:21.168 INFO:tasks.workunit.client.0.smithi118.stdout:7/225: read d0/f9 [5757235,79461] 0 2024-09-21T11:39:21.170 INFO:tasks.workunit.client.1.smithi149.stdout:0/802: dwrite dd/d35/fc0 [0,4194304] 0 2024-09-21T11:39:21.170 INFO:tasks.workunit.client.0.smithi118.stdout:8/562: rename d2/dc/d16/d46/d4c/d63/db4 to d2/dc/d10/d3b/dbb 0 2024-09-21T11:39:21.171 INFO:tasks.workunit.client.1.smithi149.stdout:2/976: dwrite d8/dd/f38 [0,4194304] 0 2024-09-21T11:39:21.177 INFO:tasks.workunit.client.1.smithi149.stdout:8/750: rename d3/d33/d34/d55/d5e/d9e/dc2/d18/f8c to d3/d12/db1/ffc 0 2024-09-21T11:39:21.178 INFO:tasks.workunit.client.0.smithi118.stdout:0/594: creat d5/d34/d44/d87/da4/fd2 x:0 0 0 2024-09-21T11:39:21.180 INFO:tasks.workunit.client.1.smithi149.stdout:4/884: chown d4/d6/d63/d15/d30/da6/lc6 3287 1 2024-09-21T11:39:21.181 INFO:tasks.workunit.client.0.smithi118.stdout:7/226: mknod d0/d3/d13/d3d/c4f 0 2024-09-21T11:39:21.183 INFO:tasks.workunit.client.1.smithi149.stdout:4/885: write d4/d6/d63/d10/d6f/f74 [3011801,63142] 0 2024-09-21T11:39:21.184 INFO:tasks.workunit.client.0.smithi118.stdout:7/227: read d0/d3/d1d/d35/f43 [33075,78426] 0 2024-09-21T11:39:21.186 INFO:tasks.workunit.client.0.smithi118.stdout:7/228: readlink d0/d3/d14/l1a 0 2024-09-21T11:39:21.186 INFO:tasks.workunit.client.1.smithi149.stdout:2/977: dwrite d8/da/d13/d1a/d3b/fb7 [0,4194304] 0 2024-09-21T11:39:21.186 INFO:tasks.workunit.client.0.smithi118.stdout:7/229: readlink d0/lb 0 2024-09-21T11:39:21.187 INFO:tasks.workunit.client.0.smithi118.stdout:0/595: dwrite d5/d10/d1e/d20/f2f [4194304,4194304] 0 2024-09-21T11:39:21.188 INFO:tasks.workunit.client.0.smithi118.stdout:0/596: chown d5/d10/d1e/d20/fbf 5227686 1 2024-09-21T11:39:21.194 INFO:tasks.workunit.client.0.smithi118.stdout:6/233: truncate d8/fc 325813 0 2024-09-21T11:39:21.195 INFO:tasks.workunit.client.0.smithi118.stdout:6/234: write d8/d14/f1e [880080,35215] 0 2024-09-21T11:39:21.196 INFO:tasks.workunit.client.1.smithi149.stdout:6/784: sync 2024-09-21T11:39:21.196 INFO:tasks.workunit.client.0.smithi118.stdout:6/235: fdatasync d8/d14/d33/f3f 0 2024-09-21T11:39:21.198 INFO:tasks.workunit.client.1.smithi149.stdout:6/785: write d8/d32/d37/d2b/f96 [198767,73186] 0 2024-09-21T11:39:21.199 INFO:tasks.workunit.client.1.smithi149.stdout:8/751: creat d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/ffd x:0 0 0 2024-09-21T11:39:21.200 INFO:tasks.workunit.client.0.smithi118.stdout:7/230: creat d0/d3/d13/d3d/d3e/f50 x:0 0 0 2024-09-21T11:39:21.200 INFO:tasks.workunit.client.1.smithi149.stdout:5/939: write d4/d7/d40/d51/f8c [3230497,65738] 0 2024-09-21T11:39:21.203 INFO:tasks.workunit.client.1.smithi149.stdout:4/886: mkdir d4/d4d/d125/d128 0 2024-09-21T11:39:21.203 INFO:tasks.workunit.client.1.smithi149.stdout:8/752: read d3/d33/d34/d55/d5e/d9e/dc2/d18/f68 [4677810,5797] 0 2024-09-21T11:39:21.205 INFO:tasks.workunit.client.1.smithi149.stdout:2/978: symlink d8/da/d13/d1a/d29/l153 0 2024-09-21T11:39:21.206 INFO:tasks.workunit.client.0.smithi118.stdout:6/236: mknod d8/d14/c4e 0 2024-09-21T11:39:21.208 INFO:tasks.workunit.client.0.smithi118.stdout:7/231: unlink d0/f2 0 2024-09-21T11:39:21.209 INFO:tasks.workunit.client.0.smithi118.stdout:7/232: write d0/d3/d14/f25 [207238,59996] 0 2024-09-21T11:39:21.210 INFO:tasks.workunit.client.1.smithi149.stdout:0/803: getdents dd/def 0 2024-09-21T11:39:21.211 INFO:tasks.workunit.client.0.smithi118.stdout:0/597: creat d5/d10/d1e/d23/d3a/d4e/dcb/fd3 x:0 0 0 2024-09-21T11:39:21.214 INFO:tasks.workunit.client.0.smithi118.stdout:6/237: mknod d8/d48/d45/c4f 0 2024-09-21T11:39:21.215 INFO:tasks.workunit.client.1.smithi149.stdout:6/786: mknod d8/da/d2c/d52/d5e/d9b/c109 0 2024-09-21T11:39:21.216 INFO:tasks.workunit.client.0.smithi118.stdout:8/563: link d2/dc/d10/d2e/l19 d2/dc/d10/d2e/d18/d1a/lbc 0 2024-09-21T11:39:21.216 INFO:tasks.workunit.client.1.smithi149.stdout:6/787: dread - d8/d32/d37/d2b/d51/f62 zero size 2024-09-21T11:39:21.217 INFO:tasks.workunit.client.1.smithi149.stdout:1/800: getdents d2/dd/d35/d1c/d2c 0 2024-09-21T11:39:21.218 INFO:tasks.workunit.client.0.smithi118.stdout:7/233: mknod d0/d3/d1d/d35/c51 0 2024-09-21T11:39:21.219 INFO:tasks.workunit.client.0.smithi118.stdout:7/234: chown d0/d3/d13/d3d 126 1 2024-09-21T11:39:21.220 INFO:tasks.workunit.client.0.smithi118.stdout:0/598: mkdir d5/d10/d1e/d33/dd4 0 2024-09-21T11:39:21.222 INFO:tasks.workunit.client.1.smithi149.stdout:2/979: fsync d8/dd/d5c/d84/fed 0 2024-09-21T11:39:21.223 INFO:tasks.workunit.client.1.smithi149.stdout:2/980: stat d8/d11/d88/dd4/de5/l129 0 2024-09-21T11:39:21.224 INFO:tasks.workunit.client.1.smithi149.stdout:7/915: getdents d12/d5b/db5/dc5/de9/db7 0 2024-09-21T11:39:21.224 INFO:tasks.workunit.client.1.smithi149.stdout:2/981: read d8/dd/d5c/f76 [2483917,95897] 0 2024-09-21T11:39:21.226 INFO:tasks.workunit.client.0.smithi118.stdout:7/235: creat d0/d3/d14/f52 x:0 0 0 2024-09-21T11:39:21.226 INFO:tasks.workunit.client.0.smithi118.stdout:6/238: dread d8/d14/f2d [0,4194304] 0 2024-09-21T11:39:21.227 INFO:tasks.workunit.client.0.smithi118.stdout:7/236: write d0/f16 [4512438,43989] 0 2024-09-21T11:39:21.227 INFO:tasks.workunit.client.0.smithi118.stdout:8/564: dread d2/dc/d10/d3b/f6d [0,4194304] 0 2024-09-21T11:39:21.228 INFO:tasks.workunit.client.1.smithi149.stdout:0/804: unlink dd/d1a/d1b/d72/d85/d8c/f89 0 2024-09-21T11:39:21.230 INFO:tasks.workunit.client.1.smithi149.stdout:6/788: creat d8/da/d3d/f10a x:0 0 0 2024-09-21T11:39:21.233 INFO:tasks.workunit.client.1.smithi149.stdout:3/902: sync 2024-09-21T11:39:21.233 INFO:tasks.workunit.client.1.smithi149.stdout:1/801: creat d2/d5/d8/dc1/f102 x:0 0 0 2024-09-21T11:39:21.235 INFO:tasks.workunit.client.1.smithi149.stdout:8/753: mkdir d3/d3c/d8f/df5/dfe 0 2024-09-21T11:39:21.235 INFO:tasks.workunit.client.1.smithi149.stdout:4/887: write d4/d6/d63/d15/d30/d6b/fb1 [393252,66769] 0 2024-09-21T11:39:21.239 INFO:tasks.workunit.client.1.smithi149.stdout:9/830: link c13 d18/d19/d1a/d2f/d43/c105 0 2024-09-21T11:39:21.239 INFO:tasks.workunit.client.0.smithi118.stdout:7/237: stat d0/d3/d29/d47 0 2024-09-21T11:39:21.240 INFO:tasks.workunit.client.1.smithi149.stdout:9/831: fsync d18/d19/d1a/d2f/d33/d91/dd7/f104 0 2024-09-21T11:39:21.240 INFO:tasks.workunit.client.1.smithi149.stdout:9/832: stat d18/d19/d1a/d2f/d33 0 2024-09-21T11:39:21.241 INFO:tasks.workunit.client.0.smithi118.stdout:8/565: mknod d2/d7c/d88/d8f/cbd 0 2024-09-21T11:39:21.241 INFO:tasks.workunit.client.0.smithi118.stdout:6/239: dread d8/fa [0,4194304] 0 2024-09-21T11:39:21.241 INFO:tasks.workunit.client.0.smithi118.stdout:8/566: dread - d2/dc/d35/fa8 zero size 2024-09-21T11:39:21.243 INFO:tasks.workunit.client.0.smithi118.stdout:8/567: write d2/dc/d35/fa8 [102950,85512] 0 2024-09-21T11:39:21.243 INFO:tasks.workunit.client.1.smithi149.stdout:7/916: fsync d12/d5b/db5/dc5/de9/d68/dc4/f65 0 2024-09-21T11:39:21.246 INFO:tasks.workunit.client.1.smithi149.stdout:2/982: dread - d8/dd/d5c/d60/fdc zero size 2024-09-21T11:39:21.246 INFO:tasks.workunit.client.1.smithi149.stdout:2/983: chown d8/d20/d57/f47 93729765 1 2024-09-21T11:39:21.249 INFO:tasks.workunit.client.1.smithi149.stdout:6/789: mkdir d8/d32/d37/dd7/d10b 0 2024-09-21T11:39:21.251 INFO:tasks.workunit.client.1.smithi149.stdout:6/790: truncate d8/da/d2c/d52/d5e/d9b/fa6 1125170 0 2024-09-21T11:39:21.252 INFO:tasks.workunit.client.1.smithi149.stdout:3/903: creat d6/d79/f136 x:0 0 0 2024-09-21T11:39:21.254 INFO:tasks.workunit.client.1.smithi149.stdout:1/802: unlink d2/dd/l92 0 2024-09-21T11:39:21.260 INFO:tasks.workunit.client.0.smithi118.stdout:8/568: symlink d2/dc/d35/dab/lbe 0 2024-09-21T11:39:21.267 INFO:tasks.workunit.client.0.smithi118.stdout:0/599: write d5/d29/d68/d7b/db7/f78 [353440,43309] 0 2024-09-21T11:39:21.268 INFO:tasks.workunit.client.0.smithi118.stdout:0/600: fsync d5/d34/d44/f75 0 2024-09-21T11:39:21.270 INFO:tasks.workunit.client.1.smithi149.stdout:6/791: creat d8/d32/d37/d28/d87/da4/f10c x:0 0 0 2024-09-21T11:39:21.271 INFO:tasks.workunit.client.1.smithi149.stdout:6/792: fsync d8/d32/d37/d28/ff3 0 2024-09-21T11:39:21.271 INFO:tasks.workunit.client.0.smithi118.stdout:8/569: rename d2/dc/d10/f90 to d2/dc/d10/d2e/fbf 0 2024-09-21T11:39:21.272 INFO:tasks.workunit.client.1.smithi149.stdout:3/904: mkdir d6/d1f/d47/d37/dd6/d96/d137 0 2024-09-21T11:39:21.273 INFO:tasks.workunit.client.1.smithi149.stdout:6/793: read d8/d32/d37/d2b/d51/f63 [3814150,121069] 0 2024-09-21T11:39:21.275 INFO:tasks.workunit.client.0.smithi118.stdout:6/240: write d8/fc [166562,111841] 0 2024-09-21T11:39:21.277 INFO:tasks.workunit.client.0.smithi118.stdout:0/601: read d5/d10/d1e/d21/f24 [456194,12292] 0 2024-09-21T11:39:21.279 INFO:tasks.workunit.client.1.smithi149.stdout:9/833: symlink d18/d36/l106 0 2024-09-21T11:39:21.279 INFO:tasks.workunit.client.0.smithi118.stdout:7/238: write d0/d3/d14/d41/f4b [869363,113534] 0 2024-09-21T11:39:21.280 INFO:tasks.workunit.client.1.smithi149.stdout:4/888: dwrite d4/d6/f59 [0,4194304] 0 2024-09-21T11:39:21.280 INFO:tasks.workunit.client.0.smithi118.stdout:7/239: stat d0/c1f 0 2024-09-21T11:39:21.280 INFO:tasks.workunit.client.0.smithi118.stdout:6/241: unlink d8/ce 0 2024-09-21T11:39:21.283 INFO:tasks.workunit.client.0.smithi118.stdout:0/602: chown d5/f70 13371 1 2024-09-21T11:39:21.284 INFO:tasks.workunit.client.1.smithi149.stdout:4/889: dread d4/d4d/d5f/ffe [0,4194304] 0 2024-09-21T11:39:21.285 INFO:tasks.workunit.client.1.smithi149.stdout:0/805: rename dd/d1a/d1b/d50/d5d to dd/d32/d105 0 2024-09-21T11:39:21.286 INFO:tasks.workunit.client.1.smithi149.stdout:0/806: stat dd/d1a/cd5 0 2024-09-21T11:39:21.287 INFO:tasks.workunit.client.0.smithi118.stdout:8/570: creat d2/dc/d10/d2e/dba/fc0 x:0 0 0 2024-09-21T11:39:21.289 INFO:tasks.workunit.client.0.smithi118.stdout:7/240: unlink d0/c27 0 2024-09-21T11:39:21.290 INFO:tasks.workunit.client.1.smithi149.stdout:4/890: dwrite d4/f112 [0,4194304] 0 2024-09-21T11:39:21.291 INFO:tasks.workunit.client.0.smithi118.stdout:0/603: rmdir d5/d29/d68/d7b/db7 39 2024-09-21T11:39:21.292 INFO:tasks.workunit.client.0.smithi118.stdout:0/604: write d5/d10/d1e/d33/fcc [707556,14996] 0 2024-09-21T11:39:21.292 INFO:tasks.workunit.client.1.smithi149.stdout:3/905: symlink d6/d1f/d47/d37/d50/l138 0 2024-09-21T11:39:21.293 INFO:tasks.workunit.client.1.smithi149.stdout:3/906: chown d6/d5f/d60/dfa/f100 1843 1 2024-09-21T11:39:21.294 INFO:tasks.workunit.client.1.smithi149.stdout:6/794: dread - d8/da/d14/fad zero size 2024-09-21T11:39:21.297 INFO:tasks.workunit.client.1.smithi149.stdout:8/754: creat d3/d33/d34/d55/d5e/d9e/dc2/d21/fff x:0 0 0 2024-09-21T11:39:21.298 INFO:tasks.workunit.client.0.smithi118.stdout:0/605: truncate d5/d10/f51 472418 0 2024-09-21T11:39:21.301 INFO:tasks.workunit.client.0.smithi118.stdout:7/241: unlink d0/d3/f30 0 2024-09-21T11:39:21.303 INFO:tasks.workunit.client.1.smithi149.stdout:9/834: mkdir d18/d19/d1a/df1/d107 0 2024-09-21T11:39:21.304 INFO:tasks.workunit.client.0.smithi118.stdout:0/606: dwrite d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:21.305 INFO:tasks.workunit.client.1.smithi149.stdout:9/835: write d18/d19/d1a/d2f/d30/d54/da7/ff4 [4727665,42649] 0 2024-09-21T11:39:21.307 INFO:tasks.workunit.client.0.smithi118.stdout:6/242: link d8/d14/f2b d8/d14/d3a/f50 0 2024-09-21T11:39:21.309 INFO:tasks.workunit.client.0.smithi118.stdout:8/571: write d2/f72 [733895,31933] 0 2024-09-21T11:39:21.311 INFO:tasks.workunit.client.1.smithi149.stdout:1/803: truncate d2/d5/d8/fbf 2897285 0 2024-09-21T11:39:21.313 INFO:tasks.workunit.client.1.smithi149.stdout:5/940: sync 2024-09-21T11:39:21.313 INFO:tasks.workunit.client.0.smithi118.stdout:7/242: stat d0/d3/d13/d3d/d3e 0 2024-09-21T11:39:21.317 INFO:tasks.workunit.client.1.smithi149.stdout:2/984: creat d8/da/d13/d1a/f154 x:0 0 0 2024-09-21T11:39:21.320 INFO:tasks.workunit.client.0.smithi118.stdout:7/243: write d0/d3/f4d [564167,98262] 0 2024-09-21T11:39:21.321 INFO:tasks.workunit.client.1.smithi149.stdout:6/795: creat d8/da/d3d/f10d x:0 0 0 2024-09-21T11:39:21.322 INFO:tasks.workunit.client.0.smithi118.stdout:0/607: link d5/d10/d1e/d23/d3a/d4e/fd1 d5/d10/d1e/d20/fd5 0 2024-09-21T11:39:21.323 INFO:tasks.workunit.client.0.smithi118.stdout:8/572: mkdir d2/dc/dc1 0 2024-09-21T11:39:21.324 INFO:tasks.workunit.client.0.smithi118.stdout:7/244: dread d0/f5 [4194304,4194304] 0 2024-09-21T11:39:21.325 INFO:tasks.workunit.client.1.smithi149.stdout:9/836: creat d18/d19/d1a/d2f/d30/d54/da7/f108 x:0 0 0 2024-09-21T11:39:21.328 INFO:tasks.workunit.client.1.smithi149.stdout:7/917: getdents d12/d5b/db5/dc5/de9/d4a/d6c/da0/dbb 0 2024-09-21T11:39:21.329 INFO:tasks.workunit.client.1.smithi149.stdout:7/918: readlink d12/d5b/db5/dc5/de9/d4a/l7f 0 2024-09-21T11:39:21.330 INFO:tasks.workunit.client.1.smithi149.stdout:0/807: write dd/d1a/d1b/d72/d85/d8c/ff5 [4091242,48157] 0 2024-09-21T11:39:21.331 INFO:tasks.workunit.client.0.smithi118.stdout:7/245: write d0/d3/d14/f15 [545466,127483] 0 2024-09-21T11:39:21.331 INFO:tasks.workunit.client.1.smithi149.stdout:9/837: dwrite fc [0,4194304] 0 2024-09-21T11:39:21.331 INFO:tasks.workunit.client.0.smithi118.stdout:7/246: chown d0/d3/d14/f4c 352086 1 2024-09-21T11:39:21.333 INFO:tasks.workunit.client.1.smithi149.stdout:5/941: stat d4/d1d/d3e/f96 0 2024-09-21T11:39:21.334 INFO:tasks.workunit.client.0.smithi118.stdout:0/608: creat d5/fd6 x:0 0 0 2024-09-21T11:39:21.338 INFO:tasks.workunit.client.1.smithi149.stdout:4/891: write d4/d6/d63/d15/d30/f53 [5168145,34548] 0 2024-09-21T11:39:21.339 INFO:tasks.workunit.client.1.smithi149.stdout:6/796: rmdir d8/d32/d37/dd7 39 2024-09-21T11:39:21.344 INFO:tasks.workunit.client.0.smithi118.stdout:7/247: dwrite d0/d3/d13/d3d/d3e/f4e [4194304,4194304] 0 2024-09-21T11:39:21.344 INFO:tasks.workunit.client.0.smithi118.stdout:4/198: sync 2024-09-21T11:39:21.345 INFO:tasks.workunit.client.0.smithi118.stdout:9/305: sync 2024-09-21T11:39:21.347 INFO:tasks.workunit.client.0.smithi118.stdout:6/243: fsync d8/d14/d33/f43 0 2024-09-21T11:39:21.350 INFO:tasks.workunit.client.1.smithi149.stdout:1/804: mkdir d2/d103 0 2024-09-21T11:39:21.351 INFO:tasks.workunit.client.0.smithi118.stdout:7/248: symlink d0/d3/d13/d3d/d3e/l53 0 2024-09-21T11:39:21.352 INFO:tasks.workunit.client.0.smithi118.stdout:8/573: truncate d2/dc/d10/d2e/fbf 207365 0 2024-09-21T11:39:21.354 INFO:tasks.workunit.client.0.smithi118.stdout:4/199: dwrite d2/d6/de/d1c/d23/f2c [0,4194304] 0 2024-09-21T11:39:21.355 INFO:tasks.workunit.client.0.smithi118.stdout:9/306: creat d0/d20/d4c/d5f/f7b x:0 0 0 2024-09-21T11:39:21.358 INFO:tasks.workunit.client.0.smithi118.stdout:0/609: dwrite d5/d34/d44/d87/da4/fc2 [0,4194304] 0 2024-09-21T11:39:21.359 INFO:tasks.workunit.client.0.smithi118.stdout:6/244: chown d8/f25 6703354 1 2024-09-21T11:39:21.364 INFO:tasks.workunit.client.1.smithi149.stdout:3/907: rename d6/d1f/d47/d37/d3a/c8c to d6/d1f/d47/d37/c139 0 2024-09-21T11:39:21.365 INFO:tasks.workunit.client.0.smithi118.stdout:8/574: mkdir d2/d7c/d88/dc2 0 2024-09-21T11:39:21.367 INFO:tasks.workunit.client.1.smithi149.stdout:8/755: creat d3/d33/d34/d55/d5e/d9e/dc2/f100 x:0 0 0 2024-09-21T11:39:21.367 INFO:tasks.workunit.client.1.smithi149.stdout:8/756: readlink d3/l4a 0 2024-09-21T11:39:21.369 INFO:tasks.workunit.client.0.smithi118.stdout:4/200: rename d2/l46 to d2/d6/de/d1c/d23/d26/l4c 0 2024-09-21T11:39:21.371 INFO:tasks.workunit.client.1.smithi149.stdout:9/838: symlink d18/d19/l109 0 2024-09-21T11:39:21.375 INFO:tasks.workunit.client.1.smithi149.stdout:2/985: creat d8/d11/f155 x:0 0 0 2024-09-21T11:39:21.375 INFO:tasks.workunit.client.1.smithi149.stdout:9/839: dread d18/d19/d29/d39/d63/fc8 [0,4194304] 0 2024-09-21T11:39:21.377 INFO:tasks.workunit.client.0.smithi118.stdout:8/575: mknod d2/dc/d10/cc3 0 2024-09-21T11:39:21.379 INFO:tasks.workunit.client.0.smithi118.stdout:9/307: truncate d0/f24 320881 0 2024-09-21T11:39:21.379 INFO:tasks.workunit.client.1.smithi149.stdout:3/908: rmdir d6/d1f 39 2024-09-21T11:39:21.380 INFO:tasks.workunit.client.0.smithi118.stdout:9/308: chown d0/d20/d4c/d5f/d68/c6e 807774 1 2024-09-21T11:39:21.381 INFO:tasks.workunit.client.0.smithi118.stdout:4/201: mkdir d2/d6/de/d1c/d4d 0 2024-09-21T11:39:21.382 INFO:tasks.workunit.client.1.smithi149.stdout:6/797: mkdir d8/d32/d37/d28/d10e 0 2024-09-21T11:39:21.382 INFO:tasks.workunit.client.0.smithi118.stdout:4/202: truncate d2/f49 810995 0 2024-09-21T11:39:21.382 INFO:tasks.workunit.client.0.smithi118.stdout:8/576: dread d2/f29 [0,4194304] 0 2024-09-21T11:39:21.383 INFO:tasks.workunit.client.1.smithi149.stdout:6/798: truncate d8/d32/d37/f49 5513163 0 2024-09-21T11:39:21.385 INFO:tasks.workunit.client.1.smithi149.stdout:5/942: link d4/d1d/d3e/f89 d4/d1d/d50/d54/d2a/f136 0 2024-09-21T11:39:21.386 INFO:tasks.workunit.client.0.smithi118.stdout:8/577: truncate d2/dc/d10/d2e/d18/d1a/f1e 4582671 0 2024-09-21T11:39:21.387 INFO:tasks.workunit.client.1.smithi149.stdout:5/943: stat d4/d7/d40/d43/d49/d88/d116 0 2024-09-21T11:39:21.387 INFO:tasks.workunit.client.1.smithi149.stdout:5/944: stat d4/d7/d40/d43/d49/dd1/f119 0 2024-09-21T11:39:21.387 INFO:tasks.workunit.client.0.smithi118.stdout:9/309: mkdir d0/d20/d4c/d5f/d68/d7c 0 2024-09-21T11:39:21.388 INFO:tasks.workunit.client.1.smithi149.stdout:9/840: truncate d18/d19/d1a/d2f/f38 4602963 0 2024-09-21T11:39:21.389 INFO:tasks.workunit.client.0.smithi118.stdout:0/610: dwrite d5/d29/d68/d7b/db7/fc4 [0,4194304] 0 2024-09-21T11:39:21.392 INFO:tasks.workunit.client.1.smithi149.stdout:9/841: dread d18/d19/fcd [0,4194304] 0 2024-09-21T11:39:21.395 INFO:tasks.workunit.client.0.smithi118.stdout:7/249: rename d0/d3/cc to d0/d3/c54 0 2024-09-21T11:39:21.396 INFO:tasks.workunit.client.1.smithi149.stdout:6/799: fdatasync d8/da/d14/f4c 0 2024-09-21T11:39:21.397 INFO:tasks.workunit.client.1.smithi149.stdout:0/808: getdents dd/d1a/d1b/d50 0 2024-09-21T11:39:21.398 INFO:tasks.workunit.client.1.smithi149.stdout:0/809: dread - dd/d2d/ff8 zero size 2024-09-21T11:39:21.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/986: symlink d8/da/d13/d2d/l156 0 2024-09-21T11:39:21.401 INFO:tasks.workunit.client.1.smithi149.stdout:5/945: mkdir d4/d7/d40/d51/d56/d137 0 2024-09-21T11:39:21.402 INFO:tasks.workunit.client.0.smithi118.stdout:3/229: sync 2024-09-21T11:39:21.402 INFO:tasks.workunit.client.0.smithi118.stdout:2/178: sync 2024-09-21T11:39:21.402 INFO:tasks.workunit.client.0.smithi118.stdout:5/274: sync 2024-09-21T11:39:21.402 INFO:tasks.workunit.client.0.smithi118.stdout:1/311: sync 2024-09-21T11:39:21.406 INFO:tasks.workunit.client.1.smithi149.stdout:6/800: chown d8/d32/d37/d28/d2e/c7c 968338 1 2024-09-21T11:39:21.407 INFO:tasks.workunit.client.1.smithi149.stdout:0/810: rename dd/d1a/d5a/d8a to dd/d1a/d5a/d106 0 2024-09-21T11:39:21.408 INFO:tasks.workunit.client.0.smithi118.stdout:7/250: dread d0/f2a [0,4194304] 0 2024-09-21T11:39:21.408 INFO:tasks.workunit.client.0.smithi118.stdout:6/245: truncate d8/d48/f31 840721 0 2024-09-21T11:39:21.408 INFO:tasks.workunit.client.0.smithi118.stdout:2/179: stat de/d1f/d20/f27 0 2024-09-21T11:39:21.409 INFO:tasks.workunit.client.0.smithi118.stdout:4/203: write d2/d6/de/f1e [657799,97885] 0 2024-09-21T11:39:21.410 INFO:tasks.workunit.client.1.smithi149.stdout:2/987: dread d8/da/d13/f2e [0,4194304] 0 2024-09-21T11:39:21.411 INFO:tasks.workunit.client.1.smithi149.stdout:7/919: rename d12/d5b/db5/dc5/de9/da1/f11e to d12/d5b/db5/dc5/de9/d68/dc4/d30/f120 0 2024-09-21T11:39:21.412 INFO:tasks.workunit.client.1.smithi149.stdout:3/909: write d6/d5f/fe6 [477561,76293] 0 2024-09-21T11:39:21.412 INFO:tasks.workunit.client.0.smithi118.stdout:4/204: dread d2/d6/f22 [0,4194304] 0 2024-09-21T11:39:21.415 INFO:tasks.workunit.client.1.smithi149.stdout:2/988: read d8/da/d13/f9b [2726878,86185] 0 2024-09-21T11:39:21.415 INFO:tasks.workunit.client.0.smithi118.stdout:9/310: write d0/fb [1208109,75604] 0 2024-09-21T11:39:21.416 INFO:tasks.workunit.client.1.smithi149.stdout:0/811: dwrite dd/d32/fe8 [0,4194304] 0 2024-09-21T11:39:21.421 INFO:tasks.workunit.client.1.smithi149.stdout:4/892: rename d4/d6/d63/d15/d30/dd3 to d4/d6/d18/d129 0 2024-09-21T11:39:21.427 INFO:tasks.workunit.client.1.smithi149.stdout:7/920: rmdir d12/d5b/db5/dc5 39 2024-09-21T11:39:21.429 INFO:tasks.workunit.client.1.smithi149.stdout:4/893: dwrite d4/d6/d63/d2d/dd6/f40 [4194304,4194304] 0 2024-09-21T11:39:21.430 INFO:tasks.workunit.client.1.smithi149.stdout:4/894: write d4/d6/d63/d10/d6f/f74 [5906989,87956] 0 2024-09-21T11:39:21.431 INFO:tasks.workunit.client.1.smithi149.stdout:2/989: mkdir d8/d44/d63/db9/d5a/d157 0 2024-09-21T11:39:21.431 INFO:tasks.workunit.client.0.smithi118.stdout:3/230: write d5/d1d/d1b/d24/f38 [4759958,84912] 0 2024-09-21T11:39:21.432 INFO:tasks.workunit.client.1.smithi149.stdout:6/801: truncate d8/d32/d37/d28/d2f/d6a/d72/fe1 923406 0 2024-09-21T11:39:21.433 INFO:tasks.workunit.client.1.smithi149.stdout:6/802: chown d8/da/d2c/l89 15 1 2024-09-21T11:39:21.433 INFO:tasks.workunit.client.0.smithi118.stdout:3/231: write d5/d28/d33/d4a/f4f [662426,92942] 0 2024-09-21T11:39:21.434 INFO:tasks.workunit.client.0.smithi118.stdout:3/232: stat d5/d28 0 2024-09-21T11:39:21.434 INFO:tasks.workunit.client.1.smithi149.stdout:4/895: read d4/d4d/d58/f91 [3609279,45155] 0 2024-09-21T11:39:21.435 INFO:tasks.workunit.client.0.smithi118.stdout:3/233: chown d5/d1d/f11 130101153 1 2024-09-21T11:39:21.437 INFO:tasks.workunit.client.1.smithi149.stdout:1/805: rename d2/dd/d35/d1c/d37/lb5 to d2/d2b/d6e/l104 0 2024-09-21T11:39:21.438 INFO:tasks.workunit.client.0.smithi118.stdout:7/251: readlink d0/d3/l12 0 2024-09-21T11:39:21.440 INFO:tasks.workunit.client.1.smithi149.stdout:5/946: getdents d4/d1d/d50 0 2024-09-21T11:39:21.444 INFO:tasks.workunit.client.1.smithi149.stdout:1/806: dwrite d2/dd/d2e/d4c/f5c [0,4194304] 0 2024-09-21T11:39:21.444 INFO:tasks.workunit.client.0.smithi118.stdout:5/275: mknod d0/c61 0 2024-09-21T11:39:21.445 INFO:tasks.workunit.client.0.smithi118.stdout:0/611: mkdir d5/d10/d1e/d21/db3/dbe/dd7 0 2024-09-21T11:39:21.445 INFO:tasks.workunit.client.0.smithi118.stdout:0/612: readlink d5/d29/lb4 0 2024-09-21T11:39:21.446 INFO:tasks.workunit.client.0.smithi118.stdout:0/613: dread - d5/d34/f9f zero size 2024-09-21T11:39:21.447 INFO:tasks.workunit.client.0.smithi118.stdout:0/614: dread - d5/d29/fcd zero size 2024-09-21T11:39:21.448 INFO:tasks.workunit.client.1.smithi149.stdout:0/812: creat dd/d1a/d5a/d65/f107 x:0 0 0 2024-09-21T11:39:21.449 INFO:tasks.workunit.client.1.smithi149.stdout:0/813: fsync dd/db3/fc5 0 2024-09-21T11:39:21.451 INFO:tasks.workunit.client.1.smithi149.stdout:6/803: fdatasync d8/da/d3d/f5d 0 2024-09-21T11:39:21.453 INFO:tasks.workunit.client.0.smithi118.stdout:8/578: truncate d2/dc/d49/f77 1319469 0 2024-09-21T11:39:21.454 INFO:tasks.workunit.client.1.smithi149.stdout:2/990: dread d8/d44/d63/f111 [0,4194304] 0 2024-09-21T11:39:21.456 INFO:tasks.workunit.client.0.smithi118.stdout:9/311: write d0/f4a [64846,82627] 0 2024-09-21T11:39:21.461 INFO:tasks.workunit.client.1.smithi149.stdout:5/947: truncate d4/d1d/d50/d54/f35 4656996 0 2024-09-21T11:39:21.462 INFO:tasks.workunit.client.0.smithi118.stdout:2/180: unlink de/l1b 0 2024-09-21T11:39:21.464 INFO:tasks.workunit.client.1.smithi149.stdout:7/921: creat d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/dab/f121 x:0 0 0 2024-09-21T11:39:21.466 INFO:tasks.workunit.client.0.smithi118.stdout:7/252: dwrite d0/d3/d1d/f34 [0,4194304] 0 2024-09-21T11:39:21.466 INFO:tasks.workunit.client.0.smithi118.stdout:2/181: dread de/d22/f2b [0,4194304] 0 2024-09-21T11:39:21.466 INFO:tasks.workunit.client.1.smithi149.stdout:4/896: dread d4/d6/fb [0,4194304] 0 2024-09-21T11:39:21.467 INFO:tasks.workunit.client.1.smithi149.stdout:5/948: dwrite f2 [0,4194304] 0 2024-09-21T11:39:21.469 INFO:tasks.workunit.client.0.smithi118.stdout:4/205: write d2/d6/dd/f33 [994267,26134] 0 2024-09-21T11:39:21.471 INFO:tasks.workunit.client.0.smithi118.stdout:0/615: readlink d5/l1a 0 2024-09-21T11:39:21.472 INFO:tasks.workunit.client.0.smithi118.stdout:2/182: dread de/d1f/d20/f2d [0,4194304] 0 2024-09-21T11:39:21.472 INFO:tasks.workunit.client.1.smithi149.stdout:1/807: mkdir d2/d5/d65/d96/d105 0 2024-09-21T11:39:21.473 INFO:tasks.workunit.client.0.smithi118.stdout:2/183: dread - de/d22/d3c/f3f zero size 2024-09-21T11:39:21.476 INFO:tasks.workunit.client.0.smithi118.stdout:6/246: mkdir d8/d14/d4a/d51 0 2024-09-21T11:39:21.483 INFO:tasks.workunit.client.1.smithi149.stdout:8/757: rename d3/d33/d34/d55/d5e/d9e/le1 to d3/d33/d34/d55/d5e/l101 0 2024-09-21T11:39:21.483 INFO:tasks.workunit.client.0.smithi118.stdout:9/312: stat d0/d20/l73 0 2024-09-21T11:39:21.486 INFO:tasks.workunit.client.1.smithi149.stdout:4/897: symlink d4/l12a 0 2024-09-21T11:39:21.487 INFO:tasks.workunit.client.1.smithi149.stdout:5/949: creat d4/d90/f138 x:0 0 0 2024-09-21T11:39:21.488 INFO:tasks.workunit.client.1.smithi149.stdout:5/950: chown d4/d4f/df4 4455116 1 2024-09-21T11:39:21.488 INFO:tasks.workunit.client.1.smithi149.stdout:1/808: write d2/dd/fa1 [4830021,121390] 0 2024-09-21T11:39:21.489 INFO:tasks.workunit.client.0.smithi118.stdout:1/312: rename d6/de/d16/d3f/d50/d54/l26 to d6/d3b/d45/l61 0 2024-09-21T11:39:21.490 INFO:tasks.workunit.client.0.smithi118.stdout:1/313: truncate d6/d2a/f51 4884380 0 2024-09-21T11:39:21.491 INFO:tasks.workunit.client.1.smithi149.stdout:8/758: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/fc5 [0,4194304] 0 2024-09-21T11:39:21.493 INFO:tasks.workunit.client.1.smithi149.stdout:3/910: rename d6/d1f/d47/dce/lda to d6/d1f/d47/d37/dd6/l13a 0 2024-09-21T11:39:21.494 INFO:tasks.workunit.client.0.smithi118.stdout:0/616: unlink d5/d10/fb5 0 2024-09-21T11:39:21.496 INFO:tasks.workunit.client.0.smithi118.stdout:2/184: dread - de/f12 zero size 2024-09-21T11:39:21.498 INFO:tasks.workunit.client.0.smithi118.stdout:6/247: stat d8/c2e 0 2024-09-21T11:39:21.499 INFO:tasks.workunit.client.0.smithi118.stdout:0/617: dread d5/d10/d1e/d21/f24 [0,4194304] 0 2024-09-21T11:39:21.500 INFO:tasks.workunit.client.1.smithi149.stdout:5/951: dread d4/d7/d40/d43/d49/d88/de0/fe2 [0,4194304] 0 2024-09-21T11:39:21.504 INFO:tasks.workunit.client.1.smithi149.stdout:2/991: rename d8/d20 to d8/d11/dac/d158 0 2024-09-21T11:39:21.505 INFO:tasks.workunit.client.0.smithi118.stdout:8/579: symlink d2/dc/d10/d2e/lc4 0 2024-09-21T11:39:21.507 INFO:tasks.workunit.client.0.smithi118.stdout:9/313: chown d0/d4/f3d 4 1 2024-09-21T11:39:21.507 INFO:tasks.workunit.client.1.smithi149.stdout:0/814: dwrite dd/d1a/d1b/d72/d78/fc8 [0,4194304] 0 2024-09-21T11:39:21.510 INFO:tasks.workunit.client.0.smithi118.stdout:3/234: creat d5/f57 x:0 0 0 2024-09-21T11:39:21.510 INFO:tasks.workunit.client.1.smithi149.stdout:1/809: mknod d2/dd/d35/d1c/d41/c106 0 2024-09-21T11:39:21.513 INFO:tasks.workunit.client.1.smithi149.stdout:1/810: truncate d2/dd/d35/d7c/fb4 9353012 0 2024-09-21T11:39:21.514 INFO:tasks.workunit.client.1.smithi149.stdout:1/811: write d2/d5/f6b [3948507,91865] 0 2024-09-21T11:39:21.515 INFO:tasks.workunit.client.1.smithi149.stdout:5/952: mkdir d4/d7/d40/d51/d139 0 2024-09-21T11:39:21.517 INFO:tasks.workunit.client.1.smithi149.stdout:8/759: mknod d3/d12/d6e/d79/c102 0 2024-09-21T11:39:21.520 INFO:tasks.workunit.client.1.smithi149.stdout:9/842: sync 2024-09-21T11:39:21.520 INFO:tasks.workunit.client.0.smithi118.stdout:4/206: symlink d2/d44/l4e 0 2024-09-21T11:39:21.521 INFO:tasks.workunit.client.0.smithi118.stdout:4/207: fsync d2/d6/de/d1c/f4a 0 2024-09-21T11:39:21.522 INFO:tasks.workunit.client.1.smithi149.stdout:2/992: rmdir d8/da/d13/d83/df6 39 2024-09-21T11:39:21.522 INFO:tasks.workunit.client.1.smithi149.stdout:3/911: write d6/d79/fcc [939014,48188] 0 2024-09-21T11:39:21.527 INFO:tasks.workunit.client.0.smithi118.stdout:6/248: unlink f6 0 2024-09-21T11:39:21.529 INFO:tasks.workunit.client.0.smithi118.stdout:0/618: write d5/d29/d68/d7b/db7/f4a [4526829,15443] 0 2024-09-21T11:39:21.533 INFO:tasks.workunit.client.0.smithi118.stdout:9/314: dread d0/f3a [0,4194304] 0 2024-09-21T11:39:21.533 INFO:tasks.workunit.client.0.smithi118.stdout:9/315: fsync d0/fb 0 2024-09-21T11:39:21.534 INFO:tasks.workunit.client.0.smithi118.stdout:3/235: chown d5/d1d/l18 1 1 2024-09-21T11:39:21.534 INFO:tasks.workunit.client.0.smithi118.stdout:7/253: truncate d0/d3/d13/d3d/d3e/f42 211638 0 2024-09-21T11:39:21.535 INFO:tasks.workunit.client.1.smithi149.stdout:8/760: creat d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/f103 x:0 0 0 2024-09-21T11:39:21.536 INFO:tasks.workunit.client.0.smithi118.stdout:9/316: dread d0/d4/f3d [0,4194304] 0 2024-09-21T11:39:21.537 INFO:tasks.workunit.client.1.smithi149.stdout:9/843: symlink d18/d36/d3c/l10a 0 2024-09-21T11:39:21.539 INFO:tasks.workunit.client.1.smithi149.stdout:2/993: rmdir d8/d11/dac/d158/d57/dda 39 2024-09-21T11:39:21.541 INFO:tasks.workunit.client.1.smithi149.stdout:4/898: getdents d4/d4d/d5f/d71 0 2024-09-21T11:39:21.542 INFO:tasks.workunit.client.0.smithi118.stdout:1/314: dwrite d6/f8 [0,4194304] 0 2024-09-21T11:39:21.543 INFO:tasks.workunit.client.0.smithi118.stdout:1/315: chown d6/l18 9897 1 2024-09-21T11:39:21.544 INFO:tasks.workunit.client.1.smithi149.stdout:5/953: dread d4/d1d/d50/d54/f35 [0,4194304] 0 2024-09-21T11:39:21.548 INFO:tasks.workunit.client.1.smithi149.stdout:3/912: write d6/d79/f7d [176942,41198] 0 2024-09-21T11:39:21.549 INFO:tasks.workunit.client.1.smithi149.stdout:8/761: creat d3/d33/d34/d55/d5e/d9e/dc2/d90/f104 x:0 0 0 2024-09-21T11:39:21.550 INFO:tasks.workunit.client.0.smithi118.stdout:3/236: symlink d5/d28/d33/l58 0 2024-09-21T11:39:21.551 INFO:tasks.workunit.client.0.smithi118.stdout:3/237: fsync d5/d1d/d1b/d24/f2c 0 2024-09-21T11:39:21.551 INFO:tasks.workunit.client.0.smithi118.stdout:7/254: creat d0/d3/d13/f55 x:0 0 0 2024-09-21T11:39:21.552 INFO:tasks.workunit.client.0.smithi118.stdout:3/238: chown d5/d28/d33/d4a/f4f 35453879 1 2024-09-21T11:39:21.552 INFO:tasks.workunit.client.0.smithi118.stdout:7/255: chown d0/f2a 1 1 2024-09-21T11:39:21.555 INFO:tasks.workunit.client.1.smithi149.stdout:0/815: link dd/d32/fb7 dd/d35/f108 0 2024-09-21T11:39:21.557 INFO:tasks.workunit.client.0.smithi118.stdout:2/185: symlink de/d1f/l40 0 2024-09-21T11:39:21.558 INFO:tasks.workunit.client.1.smithi149.stdout:5/954: rmdir d4/d1d/d50/d60/db1/db4 39 2024-09-21T11:39:21.560 INFO:tasks.workunit.client.0.smithi118.stdout:0/619: link d5/fd6 d5/d29/d68/fd8 0 2024-09-21T11:39:21.561 INFO:tasks.workunit.client.1.smithi149.stdout:6/804: sync 2024-09-21T11:39:21.562 INFO:tasks.workunit.client.1.smithi149.stdout:1/812: rmdir d2/d5/d8/dc1/dd6/df5 0 2024-09-21T11:39:21.564 INFO:tasks.workunit.client.1.smithi149.stdout:3/913: mknod d6/d1f/d47/d22/d8d/c13b 0 2024-09-21T11:39:21.564 INFO:tasks.workunit.client.1.smithi149.stdout:6/805: read d8/da/d2c/d2d/fcb [1736321,57703] 0 2024-09-21T11:39:21.564 INFO:tasks.workunit.client.1.smithi149.stdout:3/914: readlink d6/d1f/d4c/ld0 0 2024-09-21T11:39:21.565 INFO:tasks.workunit.client.1.smithi149.stdout:3/915: readlink d6/lc0 0 2024-09-21T11:39:21.568 INFO:tasks.workunit.client.0.smithi118.stdout:9/317: write d0/f3a [2544238,46465] 0 2024-09-21T11:39:21.568 INFO:tasks.workunit.client.1.smithi149.stdout:8/762: write d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f6b [5508222,40098] 0 2024-09-21T11:39:21.571 INFO:tasks.workunit.client.1.smithi149.stdout:2/994: dwrite d8/d44/fbe [0,4194304] 0 2024-09-21T11:39:21.572 INFO:tasks.workunit.client.1.smithi149.stdout:2/995: stat d8/dcb/db8/dd3 0 2024-09-21T11:39:21.573 INFO:tasks.workunit.client.0.smithi118.stdout:9/318: dwrite d0/f5 [4194304,4194304] 0 2024-09-21T11:39:21.578 INFO:tasks.workunit.client.0.smithi118.stdout:2/186: symlink de/d1f/d20/l41 0 2024-09-21T11:39:21.580 INFO:tasks.workunit.client.0.smithi118.stdout:6/249: creat d8/d46/f52 x:0 0 0 2024-09-21T11:39:21.581 INFO:tasks.workunit.client.1.smithi149.stdout:9/844: creat d18/d19/d1a/f10b x:0 0 0 2024-09-21T11:39:21.584 INFO:tasks.workunit.client.1.smithi149.stdout:3/916: rename d6/d1f/d47/d22/d8d/d97/l9d to d6/d5f/d60/d88/de7/d12c/l13c 0 2024-09-21T11:39:21.584 INFO:tasks.workunit.client.0.smithi118.stdout:7/256: dwrite d0/f10 [0,4194304] 0 2024-09-21T11:39:21.585 INFO:tasks.workunit.client.0.smithi118.stdout:0/620: creat d5/d10/d1e/d23/d3a/d4e/dcb/fd9 x:0 0 0 2024-09-21T11:39:21.586 INFO:tasks.workunit.client.0.smithi118.stdout:7/257: fdatasync d0/d3/d13/d3d/d3e/f50 0 2024-09-21T11:39:21.588 INFO:tasks.workunit.client.1.smithi149.stdout:6/806: dwrite d8/d32/d37/d79/ffd [0,4194304] 0 2024-09-21T11:39:21.591 INFO:tasks.workunit.client.1.smithi149.stdout:4/899: rmdir d4/d6/d63/d15/d30/d8a/da7/dfb 0 2024-09-21T11:39:21.592 INFO:tasks.workunit.client.1.smithi149.stdout:5/955: mknod d4/d1d/dde/d10c/c13a 0 2024-09-21T11:39:21.593 INFO:tasks.workunit.client.0.smithi118.stdout:9/319: rename d0/d20/c55 to d0/d20/d4c/d5f/d68/c7d 0 2024-09-21T11:39:21.594 INFO:tasks.workunit.client.0.smithi118.stdout:3/239: link d5/d1d/f25 d5/d1d/d1b/d50/f59 0 2024-09-21T11:39:21.595 INFO:tasks.workunit.client.1.smithi149.stdout:5/956: dread d4/fee [0,4194304] 0 2024-09-21T11:39:21.595 INFO:tasks.workunit.client.0.smithi118.stdout:4/208: link d2/d6/c39 d2/d6/de/d1c/d4d/c4f 0 2024-09-21T11:39:21.596 INFO:tasks.workunit.client.0.smithi118.stdout:3/240: fdatasync d5/d28/d3e/f44 0 2024-09-21T11:39:21.597 INFO:tasks.workunit.client.1.smithi149.stdout:0/816: dread dd/d1a/d5a/fca [0,4194304] 0 2024-09-21T11:39:21.598 INFO:tasks.workunit.client.1.smithi149.stdout:3/917: creat d6/d1f/d47/d37/d3a/d107/f13d x:0 0 0 2024-09-21T11:39:21.600 INFO:tasks.workunit.client.0.smithi118.stdout:0/621: mkdir d5/d10/d1e/d23/d3a/d4e/d9d/dda 0 2024-09-21T11:39:21.600 INFO:tasks.workunit.client.0.smithi118.stdout:4/209: chown d2/d6/de/d1c/f47 6 1 2024-09-21T11:39:21.603 INFO:tasks.workunit.client.0.smithi118.stdout:9/320: dwrite d0/f2c [0,4194304] 0 2024-09-21T11:39:21.603 INFO:tasks.workunit.client.1.smithi149.stdout:6/807: symlink d8/da/d2c/d52/d5e/d69/l10f 0 2024-09-21T11:39:21.604 INFO:tasks.workunit.client.0.smithi118.stdout:7/258: truncate d0/d3/f18 5082881 0 2024-09-21T11:39:21.604 INFO:tasks.workunit.client.0.smithi118.stdout:4/210: chown d2/d6/c28 0 1 2024-09-21T11:39:21.607 INFO:tasks.workunit.client.0.smithi118.stdout:8/580: getdents d2/dc/d35/d50 0 2024-09-21T11:39:21.607 INFO:tasks.workunit.client.0.smithi118.stdout:8/581: chown d2/d73 251524586 1 2024-09-21T11:39:21.608 INFO:tasks.workunit.client.1.smithi149.stdout:1/813: rename d2/d2b to d2/d107 0 2024-09-21T11:39:21.613 INFO:tasks.workunit.client.1.smithi149.stdout:4/900: rename d4/lb2 to d4/d6/d63/d2d/dd6/l12b 0 2024-09-21T11:39:21.614 INFO:tasks.workunit.client.1.smithi149.stdout:4/901: chown d4/d4d/d58/db4/fc1 397166428 1 2024-09-21T11:39:21.615 INFO:tasks.workunit.client.1.smithi149.stdout:4/902: fsync d4/d6/f59 0 2024-09-21T11:39:21.615 INFO:tasks.workunit.client.0.smithi118.stdout:8/582: dwrite d2/dc/d49/fb5 [0,4194304] 0 2024-09-21T11:39:21.617 INFO:tasks.workunit.client.0.smithi118.stdout:1/316: truncate d6/de/d16/f29 2526142 0 2024-09-21T11:39:21.617 INFO:tasks.workunit.client.0.smithi118.stdout:8/583: write d2/dc/d10/d2e/dba/fc0 [738393,110853] 0 2024-09-21T11:39:21.620 INFO:tasks.workunit.client.1.smithi149.stdout:0/817: creat dd/d1a/d5a/d106/f109 x:0 0 0 2024-09-21T11:39:21.623 INFO:tasks.workunit.client.0.smithi118.stdout:0/622: chown d5/f7 65112580 1 2024-09-21T11:39:21.624 INFO:tasks.workunit.client.0.smithi118.stdout:9/321: creat d0/f7e x:0 0 0 2024-09-21T11:39:21.625 INFO:tasks.workunit.client.1.smithi149.stdout:6/808: creat d8/d32/d37/d28/d2f/f110 x:0 0 0 2024-09-21T11:39:21.628 INFO:tasks.workunit.client.0.smithi118.stdout:7/259: creat d0/d3/d29/f56 x:0 0 0 2024-09-21T11:39:21.628 INFO:tasks.workunit.client.0.smithi118.stdout:6/250: dwrite d8/d14/d33/f3e [0,4194304] 0 2024-09-21T11:39:21.631 INFO:tasks.workunit.client.0.smithi118.stdout:4/211: truncate d2/f21 5039058 0 2024-09-21T11:39:21.639 INFO:tasks.workunit.client.1.smithi149.stdout:4/903: rename d4/d6/d63/d2d/dd6/le3 to d4/d6/d63/d2d/dd6/d32/d4a/l12c 0 2024-09-21T11:39:21.639 INFO:tasks.workunit.client.0.smithi118.stdout:1/317: fdatasync d6/d33/f44 0 2024-09-21T11:39:21.641 INFO:tasks.workunit.client.1.smithi149.stdout:8/763: getdents d3/d3c/d8f/df5 0 2024-09-21T11:39:21.642 INFO:tasks.workunit.client.1.smithi149.stdout:7/922: sync 2024-09-21T11:39:21.643 INFO:tasks.workunit.client.1.smithi149.stdout:2/996: dwrite d8/f138 [8388608,4194304] 0 2024-09-21T11:39:21.644 INFO:tasks.workunit.client.0.smithi118.stdout:7/260: dread d0/d3/d13/f2f [0,4194304] 0 2024-09-21T11:39:21.646 INFO:tasks.workunit.client.0.smithi118.stdout:7/261: fsync d0/d3/d13/f38 0 2024-09-21T11:39:21.647 INFO:tasks.workunit.client.0.smithi118.stdout:3/241: link d5/d28/f2b d5/d1d/d1b/d50/f5a 0 2024-09-21T11:39:21.648 INFO:tasks.workunit.client.0.smithi118.stdout:2/187: dwrite de/f18 [0,4194304] 0 2024-09-21T11:39:21.649 INFO:tasks.workunit.client.1.smithi149.stdout:6/809: mkdir d8/d32/d37/d28/d2f/d6a/d111 0 2024-09-21T11:39:21.651 INFO:tasks.workunit.client.0.smithi118.stdout:0/623: symlink d5/d29/ldb 0 2024-09-21T11:39:21.654 INFO:tasks.workunit.client.0.smithi118.stdout:0/624: dread - d5/d29/d53/f56 zero size 2024-09-21T11:39:21.655 INFO:tasks.workunit.client.0.smithi118.stdout:9/322: creat d0/d20/d4c/d5f/f7f x:0 0 0 2024-09-21T11:39:21.655 INFO:tasks.workunit.client.0.smithi118.stdout:7/262: dwrite d0/d3/d29/f20 [0,4194304] 0 2024-09-21T11:39:21.656 INFO:tasks.workunit.client.1.smithi149.stdout:5/957: creat d4/d7/f13b x:0 0 0 2024-09-21T11:39:21.660 INFO:tasks.workunit.client.1.smithi149.stdout:1/814: dwrite d2/d5/d3d/d88/f63 [0,4194304] 0 2024-09-21T11:39:21.660 INFO:tasks.workunit.client.1.smithi149.stdout:4/904: rmdir d4/d4d/d58/db4 39 2024-09-21T11:39:21.662 INFO:tasks.workunit.client.1.smithi149.stdout:0/818: mknod dd/d1a/d1b/d72/c10a 0 2024-09-21T11:39:21.664 INFO:tasks.workunit.client.1.smithi149.stdout:9/845: sync 2024-09-21T11:39:21.665 INFO:tasks.workunit.client.1.smithi149.stdout:8/764: read d3/d33/d34/d72/fba [287346,27566] 0 2024-09-21T11:39:21.665 INFO:tasks.workunit.client.0.smithi118.stdout:6/251: dwrite d8/fc [0,4194304] 0 2024-09-21T11:39:21.666 INFO:tasks.workunit.client.0.smithi118.stdout:4/212: read d2/d6/de/f10 [103734,79272] 0 2024-09-21T11:39:21.667 INFO:tasks.workunit.client.0.smithi118.stdout:6/252: fsync d8/d14/f1e 0 2024-09-21T11:39:21.668 INFO:tasks.workunit.client.1.smithi149.stdout:7/923: symlink d12/d5b/db5/dc5/de9/d4a/d6c/da0/l122 0 2024-09-21T11:39:21.668 INFO:tasks.workunit.client.1.smithi149.stdout:8/765: write d3/d33/d34/d55/d5e/d9e/dc2/d90/f104 [891500,91375] 0 2024-09-21T11:39:21.668 INFO:tasks.workunit.client.1.smithi149.stdout:2/997: dread - d8/da/d13/d1a/d29/fef zero size 2024-09-21T11:39:21.671 INFO:tasks.workunit.client.1.smithi149.stdout:2/998: fsync d8/d11/dac/d158/f40 0 2024-09-21T11:39:21.673 INFO:tasks.workunit.client.0.smithi118.stdout:2/188: write de/f2a [1443125,32953] 0 2024-09-21T11:39:21.675 INFO:tasks.workunit.client.0.smithi118.stdout:3/242: rename d5/d1d/f19 to d5/d1d/d1b/d24/f5b 0 2024-09-21T11:39:21.678 INFO:tasks.workunit.client.0.smithi118.stdout:9/323: creat d0/d4/d38/d4e/f80 x:0 0 0 2024-09-21T11:39:21.679 INFO:tasks.workunit.client.0.smithi118.stdout:7/263: mkdir d0/d3/d1d/d35/d57 0 2024-09-21T11:39:21.680 INFO:tasks.workunit.client.1.smithi149.stdout:3/918: getdents d6/d1f/d47/d37/d3f/dc5/d106 0 2024-09-21T11:39:21.680 INFO:tasks.workunit.client.0.smithi118.stdout:7/264: fsync d0/d3/d13/f55 0 2024-09-21T11:39:21.681 INFO:tasks.workunit.client.1.smithi149.stdout:3/919: write d6/d1f/d47/fb3 [3771681,65229] 0 2024-09-21T11:39:21.682 INFO:tasks.workunit.client.0.smithi118.stdout:7/265: truncate d0/d3/d13/f38 1307296 0 2024-09-21T11:39:21.684 INFO:tasks.workunit.client.1.smithi149.stdout:2/999: rmdir d8/dd/d5c/d60 39 2024-09-21T11:39:21.684 INFO:tasks.workunit.client.1.smithi149.stdout:0/819: dread dd/d1a/d1b/d72/d78/dc4/fc9 [0,4194304] 0 2024-09-21T11:39:21.686 INFO:tasks.workunit.client.1.smithi149.stdout:7/924: rename d12/d5b/db5/dc5/de9/da1 to d12/d5b/db5/dc5/de9/d4a/d6c/d8c/d123 0 2024-09-21T11:39:21.687 INFO:tasks.workunit.client.1.smithi149.stdout:5/958: creat d4/d1d/d50/d60/db1/db4/f13c x:0 0 0 2024-09-21T11:39:21.689 INFO:tasks.workunit.client.1.smithi149.stdout:1/815: unlink d2/dd/d2e/d4c/c84 0 2024-09-21T11:39:21.691 INFO:tasks.workunit.client.1.smithi149.stdout:9/846: symlink d18/d19/d1a/d2f/d7d/l10c 0 2024-09-21T11:39:21.691 INFO:tasks.workunit.client.1.smithi149.stdout:1/816: stat d2/d5/cfe 0 2024-09-21T11:39:21.700 INFO:tasks.workunit.client.1.smithi149.stdout:8/766: rename d3/d33/d34/d55/d5e/d9e/dc2/d18/c28 to d3/d33/d34/d55/d95/c105 0 2024-09-21T11:39:21.700 INFO:tasks.workunit.client.0.smithi118.stdout:0/625: mknod d5/d10/d1e/d33/dd4/cdc 0 2024-09-21T11:39:21.700 INFO:tasks.workunit.client.1.smithi149.stdout:7/925: truncate d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/d49/fe2 992995 0 2024-09-21T11:39:21.701 INFO:tasks.workunit.client.1.smithi149.stdout:5/959: dwrite d4/d90/f138 [0,4194304] 0 2024-09-21T11:39:21.702 INFO:tasks.workunit.client.0.smithi118.stdout:9/324: mknod d0/d20/d4c/d5f/d68/c81 0 2024-09-21T11:39:21.704 INFO:tasks.workunit.client.1.smithi149.stdout:8/767: write d3/d33/d34/d55/d5e/d9e/dc2/d90/f92 [3135822,32894] 0 2024-09-21T11:39:21.704 INFO:tasks.workunit.client.0.smithi118.stdout:9/325: write d0/f1c [1453865,129790] 0 2024-09-21T11:39:21.705 INFO:tasks.workunit.client.0.smithi118.stdout:7/266: creat d0/d3/d1d/d35/f58 x:0 0 0 2024-09-21T11:39:21.707 INFO:tasks.workunit.client.0.smithi118.stdout:8/584: dwrite d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:21.708 INFO:tasks.workunit.client.0.smithi118.stdout:4/213: dread d2/f13 [0,4194304] 0 2024-09-21T11:39:21.709 INFO:tasks.workunit.client.0.smithi118.stdout:6/253: mkdir d8/d46/d53 0 2024-09-21T11:39:21.712 INFO:tasks.workunit.client.0.smithi118.stdout:2/189: rename de/d1f/d20/l41 to de/d16/d25/l42 0 2024-09-21T11:39:21.712 INFO:tasks.workunit.client.0.smithi118.stdout:9/326: read d0/fb [2232490,115844] 0 2024-09-21T11:39:21.712 INFO:tasks.workunit.client.1.smithi149.stdout:1/817: creat d2/d5/d8/dc1/dd6/f108 x:0 0 0 2024-09-21T11:39:21.712 INFO:tasks.workunit.client.1.smithi149.stdout:0/820: dread f8 [0,4194304] 0 2024-09-21T11:39:21.712 INFO:tasks.workunit.client.1.smithi149.stdout:6/810: truncate d8/da/d2c/d52/f5c 3514372 0 2024-09-21T11:39:21.715 INFO:tasks.workunit.client.0.smithi118.stdout:3/243: mkdir d5/d1d/d1b/d50/d5c 0 2024-09-21T11:39:21.715 INFO:tasks.workunit.client.0.smithi118.stdout:4/214: dwrite d2/d6/de/d1c/f47 [0,4194304] 0 2024-09-21T11:39:21.718 INFO:tasks.workunit.client.1.smithi149.stdout:4/905: dwrite d4/d6/d18/f4f [0,4194304] 0 2024-09-21T11:39:21.721 INFO:tasks.workunit.client.0.smithi118.stdout:7/267: creat d0/d3/d1d/d35/f59 x:0 0 0 2024-09-21T11:39:21.721 INFO:tasks.workunit.client.0.smithi118.stdout:7/268: readlink d0/d3/d29/l39 0 2024-09-21T11:39:21.731 INFO:tasks.workunit.client.0.smithi118.stdout:8/585: dread d2/dc/d49/f77 [0,4194304] 0 2024-09-21T11:39:21.737 INFO:tasks.workunit.client.1.smithi149.stdout:9/847: dwrite d18/d36/d3c/d47/d76/fc0 [0,4194304] 0 2024-09-21T11:39:21.737 INFO:tasks.workunit.client.0.smithi118.stdout:3/244: mkdir d5/d28/d3e/d5d 0 2024-09-21T11:39:21.740 INFO:tasks.workunit.client.0.smithi118.stdout:7/269: write d0/d3/fd [152210,122575] 0 2024-09-21T11:39:21.745 INFO:tasks.workunit.client.0.smithi118.stdout:1/318: write d6/de/d16/f29 [2592690,10975] 0 2024-09-21T11:39:21.746 INFO:tasks.workunit.client.0.smithi118.stdout:1/319: dread - d6/d33/d3c/f40 zero size 2024-09-21T11:39:21.747 INFO:tasks.workunit.client.0.smithi118.stdout:8/586: creat d2/dc/d10/d2e/dba/fc5 x:0 0 0 2024-09-21T11:39:21.749 INFO:tasks.workunit.client.0.smithi118.stdout:8/587: write d2/d7c/d88/d8f/daa/faf [108962,54514] 0 2024-09-21T11:39:21.751 INFO:tasks.workunit.client.0.smithi118.stdout:8/588: chown d2/dc/d35/dab 51932 1 2024-09-21T11:39:21.751 INFO:tasks.workunit.client.0.smithi118.stdout:4/215: mknod d2/d6/de/c50 0 2024-09-21T11:39:21.752 INFO:tasks.workunit.client.0.smithi118.stdout:1/320: dwrite d6/d2a/f51 [0,4194304] 0 2024-09-21T11:39:21.753 INFO:tasks.workunit.client.0.smithi118.stdout:4/216: fsync d2/d6/f18 0 2024-09-21T11:39:21.753 INFO:tasks.workunit.client.0.smithi118.stdout:1/321: readlink d6/de/d16/l2f 0 2024-09-21T11:39:21.754 INFO:tasks.workunit.client.0.smithi118.stdout:8/589: dread d2/dc/d49/f77 [0,4194304] 0 2024-09-21T11:39:21.754 INFO:tasks.workunit.client.0.smithi118.stdout:3/245: symlink d5/d1d/d1b/d4c/l5e 0 2024-09-21T11:39:21.762 INFO:tasks.workunit.client.0.smithi118.stdout:7/270: creat d0/d3/d1d/d35/f5a x:0 0 0 2024-09-21T11:39:21.762 INFO:tasks.workunit.client.0.smithi118.stdout:6/254: rmdir d8/d14/d4a/d51 0 2024-09-21T11:39:21.764 INFO:tasks.workunit.client.0.smithi118.stdout:9/327: link d0/d4/f15 d0/d4/d23/d4d/f82 0 2024-09-21T11:39:21.765 INFO:tasks.workunit.client.0.smithi118.stdout:6/255: dread d8/d14/d33/f3e [0,4194304] 0 2024-09-21T11:39:21.768 INFO:tasks.workunit.client.1.smithi149.stdout:5/960: symlink d4/d7/d40/d43/d49/dd1/l13d 0 2024-09-21T11:39:21.769 INFO:tasks.workunit.client.0.smithi118.stdout:1/322: chown d6/de/d16/d3f/f4d 37837907 1 2024-09-21T11:39:21.770 INFO:tasks.workunit.client.1.smithi149.stdout:8/768: fsync d3/f20 0 2024-09-21T11:39:21.771 INFO:tasks.workunit.client.0.smithi118.stdout:9/328: dwrite d0/d4/d45/f48 [0,4194304] 0 2024-09-21T11:39:21.771 INFO:tasks.workunit.client.0.smithi118.stdout:1/323: truncate d6/d33/d3c/f40 1043708 0 2024-09-21T11:39:21.771 INFO:tasks.workunit.client.1.smithi149.stdout:8/769: chown d3/d33/d34/d55/d5e/d9e/dc2/d18/l32 10 1 2024-09-21T11:39:21.772 INFO:tasks.workunit.client.0.smithi118.stdout:9/329: stat d0/d4/d45/f48 0 2024-09-21T11:39:21.772 INFO:tasks.workunit.client.0.smithi118.stdout:1/324: chown d6/l18 19755 1 2024-09-21T11:39:21.776 INFO:tasks.workunit.client.0.smithi118.stdout:8/590: rename d2/dc/d35/d50/l78 to d2/dc/d10/d2e/dba/lc6 0 2024-09-21T11:39:21.778 INFO:tasks.workunit.client.0.smithi118.stdout:8/591: chown d2/d7c/d88 2 1 2024-09-21T11:39:21.780 INFO:tasks.workunit.client.0.smithi118.stdout:8/592: chown d2/dc/d35/d42/fa1 883487 1 2024-09-21T11:39:21.780 INFO:tasks.workunit.client.1.smithi149.stdout:6/811: mkdir d8/da/d2c/d52/d5e/d9b/d112 0 2024-09-21T11:39:21.781 INFO:tasks.workunit.client.0.smithi118.stdout:9/330: dwrite d0/d20/d4c/d5f/f7f [0,4194304] 0 2024-09-21T11:39:21.781 INFO:tasks.workunit.client.0.smithi118.stdout:7/271: mknod d0/d3/d13/d3d/c5b 0 2024-09-21T11:39:21.785 INFO:tasks.workunit.client.1.smithi149.stdout:1/818: rename d2/dd/d35/d1c/d7a/fc7 to d2/d107/f109 0 2024-09-21T11:39:21.787 INFO:tasks.workunit.client.0.smithi118.stdout:8/593: dwrite d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:21.793 INFO:tasks.workunit.client.1.smithi149.stdout:9/848: creat d18/d19/d1a/df1/f10d x:0 0 0 2024-09-21T11:39:21.794 INFO:tasks.workunit.client.0.smithi118.stdout:3/246: mkdir d5/d28/d3e/d5d/d5f 0 2024-09-21T11:39:21.796 INFO:tasks.workunit.client.1.smithi149.stdout:9/849: write d18/d19/d1a/d2f/d5f/f73 [2462939,105632] 0 2024-09-21T11:39:21.797 INFO:tasks.workunit.client.1.smithi149.stdout:5/961: symlink d4/d1d/d50/d54/d2a/d93/l13e 0 2024-09-21T11:39:21.797 INFO:tasks.workunit.client.0.smithi118.stdout:1/325: rename d6/de/d16/d3f to d6/de/d16/d3f/d50/d54/d62 22 2024-09-21T11:39:21.799 INFO:tasks.workunit.client.0.smithi118.stdout:2/190: link de/d16/d25/l42 de/d16/d1c/l43 0 2024-09-21T11:39:21.799 INFO:tasks.workunit.client.1.smithi149.stdout:3/920: sync 2024-09-21T11:39:21.801 INFO:tasks.workunit.client.1.smithi149.stdout:3/921: chown d6/d1f/d47/dbb/fbf 4575545 1 2024-09-21T11:39:21.802 INFO:tasks.workunit.client.1.smithi149.stdout:8/770: symlink d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/l106 0 2024-09-21T11:39:21.804 INFO:tasks.workunit.client.0.smithi118.stdout:9/331: chown d0/c62 832 1 2024-09-21T11:39:21.806 INFO:tasks.workunit.client.1.smithi149.stdout:8/771: chown d3/d33/d34/fbe 3332500 1 2024-09-21T11:39:21.806 INFO:tasks.workunit.client.0.smithi118.stdout:7/272: symlink d0/l5c 0 2024-09-21T11:39:21.807 INFO:tasks.workunit.client.0.smithi118.stdout:7/273: chown d0/d3/d14/f25 7467176 1 2024-09-21T11:39:21.807 INFO:tasks.workunit.client.0.smithi118.stdout:7/274: chown d0/d3/d14/f32 1881 1 2024-09-21T11:39:21.807 INFO:tasks.workunit.client.1.smithi149.stdout:7/926: dwrite d12/d5b/db5/dc5/de9/d4a/d6c/da0/dbb/fe8 [0,4194304] 0 2024-09-21T11:39:21.808 INFO:tasks.workunit.client.1.smithi149.stdout:9/850: dwrite d18/d36/d3c/d47/d99/fb6 [0,4194304] 0 2024-09-21T11:39:21.809 INFO:tasks.workunit.client.0.smithi118.stdout:6/256: mkdir d8/d14/d3a/d54 0 2024-09-21T11:39:21.811 INFO:tasks.workunit.client.1.smithi149.stdout:8/772: write d3/d33/d34/d55/d5e/d9e/dc2/d3a/f63 [5160191,102997] 0 2024-09-21T11:39:21.812 INFO:tasks.workunit.client.0.smithi118.stdout:1/326: symlink d6/de/d16/l63 0 2024-09-21T11:39:21.813 INFO:tasks.workunit.client.1.smithi149.stdout:9/851: chown d18/d19/d1a/d2f/d30/cf6 0 1 2024-09-21T11:39:21.813 INFO:tasks.workunit.client.0.smithi118.stdout:2/191: fdatasync de/d16/d25/f3b 0 2024-09-21T11:39:21.814 INFO:tasks.workunit.client.1.smithi149.stdout:5/962: write d4/fee [1161860,39892] 0 2024-09-21T11:39:21.814 INFO:tasks.workunit.client.1.smithi149.stdout:8/773: readlink d3/d33/d34/d55/d5e/la0 0 2024-09-21T11:39:21.816 INFO:tasks.workunit.client.1.smithi149.stdout:6/812: dread d8/da/d2c/fba [0,4194304] 0 2024-09-21T11:39:21.816 INFO:tasks.workunit.client.1.smithi149.stdout:5/963: chown d4/d7/d40/d51/d56/d132 30907 1 2024-09-21T11:39:21.817 INFO:tasks.workunit.client.0.smithi118.stdout:9/332: creat d0/d20/d4c/d5f/d68/f83 x:0 0 0 2024-09-21T11:39:21.819 INFO:tasks.workunit.client.0.smithi118.stdout:9/333: rename d0/d4 to d0/d4/d23/d4d/d84 22 2024-09-21T11:39:21.820 INFO:tasks.workunit.client.0.smithi118.stdout:9/334: chown d0/d4/d23/c56 492939674 1 2024-09-21T11:39:21.820 INFO:tasks.workunit.client.1.smithi149.stdout:0/821: creat dd/d1a/d1b/f10b x:0 0 0 2024-09-21T11:39:21.823 INFO:tasks.workunit.client.0.smithi118.stdout:7/275: unlink d0/d3/d13/d3d/d3e/f4e 0 2024-09-21T11:39:21.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/922: mknod d6/d1f/d47/d37/d3f/c13e 0 2024-09-21T11:39:21.828 INFO:tasks.workunit.client.0.smithi118.stdout:6/257: creat d8/d14/d33/f55 x:0 0 0 2024-09-21T11:39:21.828 INFO:tasks.workunit.client.0.smithi118.stdout:9/335: dwrite d0/d4/d38/d4e/f80 [0,4194304] 0 2024-09-21T11:39:21.829 INFO:tasks.workunit.client.0.smithi118.stdout:9/336: chown d0/d20/c77 101744396 1 2024-09-21T11:39:21.830 INFO:tasks.workunit.client.0.smithi118.stdout:9/337: truncate d0/f26 5061753 0 2024-09-21T11:39:21.831 INFO:tasks.workunit.client.1.smithi149.stdout:1/819: read - d2/dd/d35/d7c/f100 zero size 2024-09-21T11:39:21.831 INFO:tasks.workunit.client.0.smithi118.stdout:4/217: link d2/d6/f22 d2/d6/dd/f51 0 2024-09-21T11:39:21.834 INFO:tasks.workunit.client.1.smithi149.stdout:9/852: chown d18/d19/d1a/d2f/faa 30532 1 2024-09-21T11:39:21.837 INFO:tasks.workunit.client.1.smithi149.stdout:6/813: creat d8/da/d2c/d52/f113 x:0 0 0 2024-09-21T11:39:21.839 INFO:tasks.workunit.client.1.smithi149.stdout:4/906: sync 2024-09-21T11:39:21.840 INFO:tasks.workunit.client.0.smithi118.stdout:8/594: truncate d2/dc/d10/d2e/fa5 1155487 0 2024-09-21T11:39:21.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/923: creat d6/d1f/d47/d37/d3f/dc5/de3/f13f x:0 0 0 2024-09-21T11:39:21.845 INFO:tasks.workunit.client.0.smithi118.stdout:9/338: creat d0/d20/d4c/f85 x:0 0 0 2024-09-21T11:39:21.845 INFO:tasks.workunit.client.0.smithi118.stdout:1/327: dread d6/de/f25 [0,4194304] 0 2024-09-21T11:39:21.846 INFO:tasks.workunit.client.1.smithi149.stdout:7/927: symlink d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d109/l124 0 2024-09-21T11:39:21.846 INFO:tasks.workunit.client.1.smithi149.stdout:4/907: dwrite d4/d6/d63/d78/fff [0,4194304] 0 2024-09-21T11:39:21.848 INFO:tasks.workunit.client.1.smithi149.stdout:1/820: rename d2/dd/d35/d7c/laf to d2/dd/d35/d1c/d41/d74/df6/l10a 0 2024-09-21T11:39:21.849 INFO:tasks.workunit.client.1.smithi149.stdout:9/853: creat d18/d36/d3c/d47/d99/dbe/dc7/f10e x:0 0 0 2024-09-21T11:39:21.850 INFO:tasks.workunit.client.0.smithi118.stdout:7/276: creat d0/d3/d29/d47/f5d x:0 0 0 2024-09-21T11:39:21.852 INFO:tasks.workunit.client.1.smithi149.stdout:9/854: chown d18/d19/d1a/d2f/d7d/de0 239182843 1 2024-09-21T11:39:21.853 INFO:tasks.workunit.client.1.smithi149.stdout:6/814: mkdir d8/d32/d37/d28/d2f/d6a/d114 0 2024-09-21T11:39:21.854 INFO:tasks.workunit.client.1.smithi149.stdout:9/855: read - d18/d36/d3c/d47/d99/dbe/fea zero size 2024-09-21T11:39:21.854 INFO:tasks.workunit.client.1.smithi149.stdout:6/815: fsync d8/d32/d37/d2b/f99 0 2024-09-21T11:39:21.858 INFO:tasks.workunit.client.0.smithi118.stdout:4/218: mkdir d2/d6/de/d1c/d4d/d52 0 2024-09-21T11:39:21.860 INFO:tasks.workunit.client.0.smithi118.stdout:1/328: dread d6/de/d16/f4b [0,4194304] 0 2024-09-21T11:39:21.860 INFO:tasks.workunit.client.0.smithi118.stdout:9/339: mkdir d0/d4/d38/d4e/d86 0 2024-09-21T11:39:21.861 INFO:tasks.workunit.client.0.smithi118.stdout:2/192: dwrite de/d16/f32 [0,4194304] 0 2024-09-21T11:39:21.861 INFO:tasks.workunit.client.1.smithi149.stdout:0/822: getdents dd/d1a/d1b/d72/d87 0 2024-09-21T11:39:21.861 INFO:tasks.workunit.client.1.smithi149.stdout:5/964: dwrite d4/d7/d40/d43/d49/fcf [0,4194304] 0 2024-09-21T11:39:21.864 INFO:tasks.workunit.client.1.smithi149.stdout:0/823: readlink dd/d1a/d1b/d72/d78/dc4/d3a/d66/dcf/lf7 0 2024-09-21T11:39:21.866 INFO:tasks.workunit.client.0.smithi118.stdout:2/193: dread de/f18 [0,4194304] 0 2024-09-21T11:39:21.866 INFO:tasks.workunit.client.0.smithi118.stdout:8/595: mkdir d2/dc/d35/dc7 0 2024-09-21T11:39:21.869 INFO:tasks.workunit.client.1.smithi149.stdout:9/856: creat d18/d36/d3c/f10f x:0 0 0 2024-09-21T11:39:21.872 INFO:tasks.workunit.client.1.smithi149.stdout:6/816: unlink d8/d32/d37/d2b/d7d/f9f 0 2024-09-21T11:39:21.875 INFO:tasks.workunit.client.1.smithi149.stdout:1/821: dread d2/dd/d35/d1c/d2c/f5a [0,4194304] 0 2024-09-21T11:39:21.878 INFO:tasks.workunit.client.0.smithi118.stdout:1/329: unlink d6/l18 0 2024-09-21T11:39:21.879 INFO:tasks.workunit.client.0.smithi118.stdout:1/330: stat d6/de/d16/d3f/d50/d54/c4c 0 2024-09-21T11:39:21.880 INFO:tasks.workunit.client.1.smithi149.stdout:5/965: creat d4/d4f/dbf/f13f x:0 0 0 2024-09-21T11:39:21.880 INFO:tasks.workunit.client.0.smithi118.stdout:1/331: fsync d6/de/f22 0 2024-09-21T11:39:21.881 INFO:tasks.workunit.client.1.smithi149.stdout:5/966: chown d4/d7/d40/d43/d49/d88 0 1 2024-09-21T11:39:21.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/824: rmdir dd/db3 39 2024-09-21T11:39:21.883 INFO:tasks.workunit.client.1.smithi149.stdout:0/825: stat dd/d1a/d1b/d72/d78/d8b/d98/dbc/ld3 0 2024-09-21T11:39:21.883 INFO:tasks.workunit.client.0.smithi118.stdout:9/340: creat d0/d4/d45/d72/f87 x:0 0 0 2024-09-21T11:39:21.884 INFO:tasks.workunit.client.1.smithi149.stdout:0/826: fsync dd/d1a/d1b/d72/d85/d8c/fa4 0 2024-09-21T11:39:21.884 INFO:tasks.workunit.client.0.smithi118.stdout:9/341: readlink d0/d20/l73 0 2024-09-21T11:39:21.886 INFO:tasks.workunit.client.0.smithi118.stdout:6/258: dwrite d8/f22 [0,4194304] 0 2024-09-21T11:39:21.887 INFO:tasks.workunit.client.1.smithi149.stdout:4/908: rename d4/d6/d63/d78/c118 to d4/d6/d63/d78/d98/dee/d10d/c12d 0 2024-09-21T11:39:21.887 INFO:tasks.workunit.client.1.smithi149.stdout:4/909: chown d4/d6/d63/d15/d30/f53 716876 1 2024-09-21T11:39:21.888 INFO:tasks.workunit.client.1.smithi149.stdout:4/910: chown d4/d4d/d58/fea 1046873 1 2024-09-21T11:39:21.890 INFO:tasks.workunit.client.0.smithi118.stdout:2/194: symlink de/d1f/l44 0 2024-09-21T11:39:21.891 INFO:tasks.workunit.client.1.smithi149.stdout:7/928: write d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f98 [2905661,104877] 0 2024-09-21T11:39:21.895 INFO:tasks.workunit.client.0.smithi118.stdout:4/219: write d2/f13 [2310289,10029] 0 2024-09-21T11:39:21.896 INFO:tasks.workunit.client.1.smithi149.stdout:7/929: stat d12/d5b/db5/dc5/de9/d4a/d4f/d75/lb4 0 2024-09-21T11:39:21.896 INFO:tasks.workunit.client.1.smithi149.stdout:3/924: dwrite d6/d1f/d47/d37/d3f/f40 [0,4194304] 0 2024-09-21T11:39:21.897 INFO:tasks.workunit.client.1.smithi149.stdout:8/774: link d3/d33/d34/d55/d5e/d9e/dc2/d18/l22 d3/d33/d34/d55/d5e/d9e/dc2/d21/l107 0 2024-09-21T11:39:21.900 INFO:tasks.workunit.client.1.smithi149.stdout:1/822: creat d2/dd/d2e/d4c/f10b x:0 0 0 2024-09-21T11:39:21.900 INFO:tasks.workunit.client.1.smithi149.stdout:5/967: mkdir d4/d7/d40/d43/d85/dce/d140 0 2024-09-21T11:39:21.903 INFO:tasks.workunit.client.0.smithi118.stdout:6/259: chown d8/c2f 33 1 2024-09-21T11:39:21.904 INFO:tasks.workunit.client.0.smithi118.stdout:7/277: rmdir d0/d3/d14/d41/d44 0 2024-09-21T11:39:21.905 INFO:tasks.workunit.client.1.smithi149.stdout:6/817: mkdir d8/d32/dcc/d115 0 2024-09-21T11:39:21.906 INFO:tasks.workunit.client.0.smithi118.stdout:2/195: chown de/d16/d1c/l43 999 1 2024-09-21T11:39:21.906 INFO:tasks.workunit.client.0.smithi118.stdout:8/596: symlink d2/dc/d49/lc8 0 2024-09-21T11:39:21.908 INFO:tasks.workunit.client.1.smithi149.stdout:3/925: mkdir d6/d1f/d47/d22/d8d/d140 0 2024-09-21T11:39:21.908 INFO:tasks.workunit.client.0.smithi118.stdout:4/220: creat d2/d6/de/d1c/d23/d26/d31/f53 x:0 0 0 2024-09-21T11:39:21.912 INFO:tasks.workunit.client.1.smithi149.stdout:5/968: creat d4/d7/d135/f141 x:0 0 0 2024-09-21T11:39:21.913 INFO:tasks.workunit.client.1.smithi149.stdout:8/775: truncate d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/f81 1365552 0 2024-09-21T11:39:21.913 INFO:tasks.workunit.client.1.smithi149.stdout:7/930: dwrite d12/f74 [4194304,4194304] 0 2024-09-21T11:39:21.914 INFO:tasks.workunit.client.1.smithi149.stdout:9/857: dread d18/d19/d1a/d2f/d5f/f80 [4194304,4194304] 0 2024-09-21T11:39:21.914 INFO:tasks.workunit.client.0.smithi118.stdout:8/597: dwrite d2/dc/d49/fb5 [4194304,4194304] 0 2024-09-21T11:39:21.916 INFO:tasks.workunit.client.0.smithi118.stdout:1/332: link d6/de/f34 d6/d33/d3c/f64 0 2024-09-21T11:39:21.917 INFO:tasks.workunit.client.1.smithi149.stdout:3/926: creat d6/d5f/d60/d88/de7/d12c/f141 x:0 0 0 2024-09-21T11:39:21.918 INFO:tasks.workunit.client.1.smithi149.stdout:1/823: creat d2/d5/d8/dc1/f10c x:0 0 0 2024-09-21T11:39:21.919 INFO:tasks.workunit.client.0.smithi118.stdout:2/196: symlink de/l45 0 2024-09-21T11:39:21.922 INFO:tasks.workunit.client.0.smithi118.stdout:4/221: mkdir d2/d6/de/d3e/d54 0 2024-09-21T11:39:21.922 INFO:tasks.workunit.client.1.smithi149.stdout:0/827: creat dd/d1a/d1b/d72/d85/f10c x:0 0 0 2024-09-21T11:39:21.925 INFO:tasks.workunit.client.1.smithi149.stdout:5/969: write d4/d7/f27 [553271,71179] 0 2024-09-21T11:39:21.927 INFO:tasks.workunit.client.1.smithi149.stdout:7/931: truncate d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/f118 21193 0 2024-09-21T11:39:21.928 INFO:tasks.workunit.client.0.smithi118.stdout:7/278: creat d0/d3/f5e x:0 0 0 2024-09-21T11:39:21.929 INFO:tasks.workunit.client.0.smithi118.stdout:9/342: dread d0/fb [4194304,4194304] 0 2024-09-21T11:39:21.931 INFO:tasks.workunit.client.1.smithi149.stdout:8/776: dwrite d3/d33/d34/d72/dbb/dda/fe7 [4194304,4194304] 0 2024-09-21T11:39:21.931 INFO:tasks.workunit.client.1.smithi149.stdout:9/858: creat d18/d19/d1a/d2f/d33/f110 x:0 0 0 2024-09-21T11:39:21.936 INFO:tasks.workunit.client.1.smithi149.stdout:9/859: write d18/d19/d1a/d2f/d7d/de0/ff3 [696764,15618] 0 2024-09-21T11:39:21.937 INFO:tasks.workunit.client.0.smithi118.stdout:7/279: mkdir d0/d3/d29/d5f 0 2024-09-21T11:39:21.938 INFO:tasks.workunit.client.1.smithi149.stdout:8/777: read d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f6b [3533555,49442] 0 2024-09-21T11:39:21.938 INFO:tasks.workunit.client.1.smithi149.stdout:7/932: dread - d12/d5b/db5/fd7 zero size 2024-09-21T11:39:21.940 INFO:tasks.workunit.client.1.smithi149.stdout:3/927: fdatasync d6/d1f/d47/d22/f5d 0 2024-09-21T11:39:21.943 INFO:tasks.workunit.client.1.smithi149.stdout:9/860: fdatasync d18/d19/d1a/d2f/d33/d91/dd7/f104 0 2024-09-21T11:39:21.943 INFO:tasks.workunit.client.1.smithi149.stdout:0/828: dwrite dd/d1a/d1b/d72/d78/d8b/d98/daa/fe3 [0,4194304] 0 2024-09-21T11:39:21.944 INFO:tasks.workunit.client.1.smithi149.stdout:6/818: getdents d8/da/d2c/d52/d5e 0 2024-09-21T11:39:21.946 INFO:tasks.workunit.client.1.smithi149.stdout:8/778: write d3/d33/f9b [1219513,63290] 0 2024-09-21T11:39:21.948 INFO:tasks.workunit.client.0.smithi118.stdout:7/280: creat d0/d3/d1d/d35/f60 x:0 0 0 2024-09-21T11:39:21.949 INFO:tasks.workunit.client.1.smithi149.stdout:4/911: fsync d4/d6/d63/d2d/dd6/d32/d4a/f50 0 2024-09-21T11:39:21.949 INFO:tasks.workunit.client.0.smithi118.stdout:7/281: dread - d0/d3/f5e zero size 2024-09-21T11:39:21.949 INFO:tasks.workunit.client.0.smithi118.stdout:7/282: dread - d0/d3/d13/d3d/d3e/f50 zero size 2024-09-21T11:39:21.950 INFO:tasks.workunit.client.1.smithi149.stdout:7/933: truncate d12/d5b/db5/dc5/de9/d68/ded/ffd 318322 0 2024-09-21T11:39:21.951 INFO:tasks.workunit.client.0.smithi118.stdout:7/283: write d0/d3/d1d/f45 [704149,32907] 0 2024-09-21T11:39:21.952 INFO:tasks.workunit.client.0.smithi118.stdout:7/284: fsync d0/d3/d13/f38 0 2024-09-21T11:39:21.953 INFO:tasks.workunit.client.0.smithi118.stdout:8/598: getdents d2/d7c/d88/d8f 0 2024-09-21T11:39:21.956 INFO:tasks.workunit.client.0.smithi118.stdout:1/333: getdents d6/de/d16 0 2024-09-21T11:39:21.960 INFO:tasks.workunit.client.1.smithi149.stdout:0/829: creat dd/d2d/f10d x:0 0 0 2024-09-21T11:39:21.961 INFO:tasks.workunit.client.0.smithi118.stdout:8/599: mknod d2/d7c/d88/cc9 0 2024-09-21T11:39:21.961 INFO:tasks.workunit.client.0.smithi118.stdout:7/285: dwrite d0/d3/f5e [0,4194304] 0 2024-09-21T11:39:21.962 INFO:tasks.workunit.client.1.smithi149.stdout:8/779: dread d3/d33/d34/d72/f9c [0,4194304] 0 2024-09-21T11:39:21.966 INFO:tasks.workunit.client.1.smithi149.stdout:5/970: dread d4/d7/d40/d43/d49/d88/ff0 [0,4194304] 0 2024-09-21T11:39:21.966 INFO:tasks.workunit.client.1.smithi149.stdout:9/861: dwrite d18/d36/d3c/dcb/fe5 [0,4194304] 0 2024-09-21T11:39:21.966 INFO:tasks.workunit.client.1.smithi149.stdout:1/824: dread d2/d107/f109 [0,4194304] 0 2024-09-21T11:39:21.967 INFO:tasks.workunit.client.0.smithi118.stdout:1/334: unlink d6/f8 0 2024-09-21T11:39:21.967 INFO:tasks.workunit.client.0.smithi118.stdout:7/286: read - d0/d3/d1d/d35/f59 zero size 2024-09-21T11:39:21.967 INFO:tasks.workunit.client.0.smithi118.stdout:1/335: chown d6/de/f5f 12 1 2024-09-21T11:39:21.968 INFO:tasks.workunit.client.1.smithi149.stdout:4/912: dread d4/d6/d63/d2d/ffd [0,4194304] 0 2024-09-21T11:39:21.968 INFO:tasks.workunit.client.0.smithi118.stdout:7/287: readlink d0/d3/d29/l39 0 2024-09-21T11:39:21.969 INFO:tasks.workunit.client.0.smithi118.stdout:1/336: dread - d6/de/f5f zero size 2024-09-21T11:39:21.970 INFO:tasks.workunit.client.0.smithi118.stdout:2/197: dwrite de/d16/d25/f3b [0,4194304] 0 2024-09-21T11:39:21.970 INFO:tasks.workunit.client.0.smithi118.stdout:4/222: dwrite d2/d6/f20 [0,4194304] 0 2024-09-21T11:39:21.970 INFO:tasks.workunit.client.0.smithi118.stdout:8/600: rmdir d2/dc/d35/dab 39 2024-09-21T11:39:21.973 INFO:tasks.workunit.client.0.smithi118.stdout:1/337: write d6/de/f1a [4174610,107823] 0 2024-09-21T11:39:21.973 INFO:tasks.workunit.client.0.smithi118.stdout:8/601: dread - d2/dc/d10/d2e/dba/fc5 zero size 2024-09-21T11:39:21.977 INFO:tasks.workunit.client.1.smithi149.stdout:6/819: stat d8/d32/d37/d28/d2e/l40 0 2024-09-21T11:39:21.977 INFO:tasks.workunit.client.0.smithi118.stdout:4/223: dread d2/d6/f20 [0,4194304] 0 2024-09-21T11:39:21.978 INFO:tasks.workunit.client.0.smithi118.stdout:7/288: creat d0/d3/d1d/d35/f61 x:0 0 0 2024-09-21T11:39:21.982 INFO:tasks.workunit.client.1.smithi149.stdout:5/971: dread d4/d90/f138 [0,4194304] 0 2024-09-21T11:39:21.987 INFO:tasks.workunit.client.1.smithi149.stdout:1/825: dwrite d2/d5/d8/f40 [0,4194304] 0 2024-09-21T11:39:21.991 INFO:tasks.workunit.client.0.smithi118.stdout:2/198: link de/d16/d31/f3d de/d16/d1c/f46 0 2024-09-21T11:39:21.993 INFO:tasks.workunit.client.1.smithi149.stdout:0/830: creat dd/d1a/d1b/d72/dc1/f10e x:0 0 0 2024-09-21T11:39:21.995 INFO:tasks.workunit.client.0.smithi118.stdout:7/289: truncate d0/f5 2387610 0 2024-09-21T11:39:21.997 INFO:tasks.workunit.client.0.smithi118.stdout:8/602: mkdir d2/dc/d16/d46/dca 0 2024-09-21T11:39:21.998 INFO:tasks.workunit.client.1.smithi149.stdout:9/862: truncate d18/d19/d1a/d2f/d53/fd1 116842 0 2024-09-21T11:39:22.000 INFO:tasks.workunit.client.1.smithi149.stdout:7/934: read d12/d5b/db5/dc5/de9/d4a/d4f/d75/f77 [2222790,101583] 0 2024-09-21T11:39:22.000 INFO:tasks.workunit.client.1.smithi149.stdout:7/935: readlink d12/l23 0 2024-09-21T11:39:22.001 INFO:tasks.workunit.client.1.smithi149.stdout:4/913: symlink d4/d4d/d125/l12e 0 2024-09-21T11:39:22.002 INFO:tasks.workunit.client.0.smithi118.stdout:8/603: mknod d2/dc/d10/d6a/ccb 0 2024-09-21T11:39:22.002 INFO:tasks.workunit.client.0.smithi118.stdout:1/338: dread d6/de/d16/d3f/d50/d54/d32/f48 [0,4194304] 0 2024-09-21T11:39:22.004 INFO:tasks.workunit.client.1.smithi149.stdout:5/972: write d4/d7/ff7 [1564413,108373] 0 2024-09-21T11:39:22.005 INFO:tasks.workunit.client.1.smithi149.stdout:9/863: rmdir d18/d36/d3c/d47/d76/d97 39 2024-09-21T11:39:22.006 INFO:tasks.workunit.client.0.smithi118.stdout:7/290: dwrite d0/d3/d29/d47/f5d [0,4194304] 0 2024-09-21T11:39:22.007 INFO:tasks.workunit.client.0.smithi118.stdout:2/199: dwrite de/d1f/d20/f27 [0,4194304] 0 2024-09-21T11:39:22.008 INFO:tasks.workunit.client.0.smithi118.stdout:7/291: chown d0 3640 1 2024-09-21T11:39:22.008 INFO:tasks.workunit.client.1.smithi149.stdout:1/826: mkdir d2/d5/d65/d96/d105/d10d 0 2024-09-21T11:39:22.009 INFO:tasks.workunit.client.0.smithi118.stdout:1/339: truncate d6/de/d16/f4b 5815715 0 2024-09-21T11:39:22.009 INFO:tasks.workunit.client.1.smithi149.stdout:8/780: rmdir d3/d12/d6e/d79/dd2 0 2024-09-21T11:39:22.013 INFO:tasks.workunit.client.1.smithi149.stdout:7/936: write d12/d5b/db5/dc5/de9/d4a/d4f/f115 [453276,6301] 0 2024-09-21T11:39:22.014 INFO:tasks.workunit.client.1.smithi149.stdout:1/827: readlink d2/d5/la5 0 2024-09-21T11:39:22.015 INFO:tasks.workunit.client.0.smithi118.stdout:8/604: dwrite d2/dc/d10/d2e/d18/f9c [0,4194304] 0 2024-09-21T11:39:22.019 INFO:tasks.workunit.client.0.smithi118.stdout:8/605: mkdir d2/dc/d10/d2e/d9b/dcc 0 2024-09-21T11:39:22.021 INFO:tasks.workunit.client.1.smithi149.stdout:3/928: dwrite d6/ff [0,4194304] 0 2024-09-21T11:39:22.022 INFO:tasks.workunit.client.1.smithi149.stdout:9/864: mknod d18/d36/d3c/d47/d99/dbe/dc7/c111 0 2024-09-21T11:39:22.023 INFO:tasks.workunit.client.1.smithi149.stdout:0/831: dwrite dd/fdb [0,4194304] 0 2024-09-21T11:39:22.033 INFO:tasks.workunit.client.1.smithi149.stdout:4/914: dwrite d4/d6/d63/d92/fd0 [0,4194304] 0 2024-09-21T11:39:22.035 INFO:tasks.workunit.client.1.smithi149.stdout:0/832: dread - dd/d1a/d1b/d81/d97/fd9 zero size 2024-09-21T11:39:22.036 INFO:tasks.workunit.client.1.smithi149.stdout:7/937: truncate d12/d5b/db5/dc5/de9/f17 4926268 0 2024-09-21T11:39:22.040 INFO:tasks.workunit.client.1.smithi149.stdout:0/833: readlink dd/d1a/d1b/d72/d78/dc4/d3a/d66/dcf/lf7 0 2024-09-21T11:39:22.042 INFO:tasks.workunit.client.1.smithi149.stdout:9/865: write d18/d19/d1a/d2f/d30/d54/fbb [199452,61197] 0 2024-09-21T11:39:22.080 INFO:tasks.workunit.client.1.smithi149.stdout:6/820: sync 2024-09-21T11:39:22.094 INFO:tasks.workunit.client.0.smithi118.stdout:5/276: sync 2024-09-21T11:39:22.102 INFO:tasks.workunit.client.0.smithi118.stdout:2/200: rename de/f37 to de/d22/d3c/f47 0 2024-09-21T11:39:22.147 INFO:tasks.workunit.client.1.smithi149.stdout:5/973: truncate d4/d7/d40/d43/d5c/d7a/d81/dea/f12a 180433 0 2024-09-21T11:39:22.148 INFO:tasks.workunit.client.0.smithi118.stdout:5/277: creat d0/db/d35/d30/d1a/d33/f62 x:0 0 0 2024-09-21T11:39:22.148 INFO:tasks.workunit.client.1.smithi149.stdout:5/974: fdatasync d4/d7/ff7 0 2024-09-21T11:39:22.149 INFO:tasks.workunit.client.1.smithi149.stdout:8/781: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/f68 [4194304,4194304] 0 2024-09-21T11:39:22.150 INFO:tasks.workunit.client.0.smithi118.stdout:4/224: write d2/fc [1559292,125210] 0 2024-09-21T11:39:22.151 INFO:tasks.workunit.client.1.smithi149.stdout:8/782: write d3/fa [2874592,96627] 0 2024-09-21T11:39:22.153 INFO:tasks.workunit.client.0.smithi118.stdout:2/201: unlink l9 0 2024-09-21T11:39:22.155 INFO:tasks.workunit.client.0.smithi118.stdout:2/202: write de/d16/d1c/f1d [5877943,104726] 0 2024-09-21T11:39:22.155 INFO:tasks.workunit.client.0.smithi118.stdout:4/225: dread d2/d6/f20 [0,4194304] 0 2024-09-21T11:39:22.156 INFO:tasks.workunit.client.0.smithi118.stdout:7/292: rename d0/d3/d1d/f34 to d0/d3/d29/d5f/f62 0 2024-09-21T11:39:22.158 INFO:tasks.workunit.client.1.smithi149.stdout:3/929: mknod d6/d5f/d60/d88/de7/d119/c142 0 2024-09-21T11:39:22.159 INFO:tasks.workunit.client.0.smithi118.stdout:1/340: link d6/d3b/d45/c49 d6/de/d16/d3f/c65 0 2024-09-21T11:39:22.163 INFO:tasks.workunit.client.1.smithi149.stdout:8/783: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/f103 [0,4194304] 0 2024-09-21T11:39:22.164 INFO:tasks.workunit.client.0.smithi118.stdout:8/606: creat d2/dc/d35/dab/fcd x:0 0 0 2024-09-21T11:39:22.166 INFO:tasks.workunit.client.1.smithi149.stdout:8/784: write d3/f7d [225179,10061] 0 2024-09-21T11:39:22.172 INFO:tasks.workunit.client.0.smithi118.stdout:2/203: creat de/d1f/d20/f48 x:0 0 0 2024-09-21T11:39:22.173 INFO:tasks.workunit.client.0.smithi118.stdout:2/204: write de/f2a [2554248,52607] 0 2024-09-21T11:39:22.181 INFO:tasks.workunit.client.0.smithi118.stdout:7/293: unlink d0/d3/d29/l39 0 2024-09-21T11:39:22.182 INFO:tasks.workunit.client.1.smithi149.stdout:3/930: mkdir d6/d5f/d60/d88/de7/d143 0 2024-09-21T11:39:22.183 INFO:tasks.workunit.client.1.smithi149.stdout:3/931: chown d6/d1f/d47/l2b 33 1 2024-09-21T11:39:22.184 INFO:tasks.workunit.client.1.smithi149.stdout:3/932: chown d6/d79/d7e/c99 16117313 1 2024-09-21T11:39:22.189 INFO:tasks.workunit.client.0.smithi118.stdout:4/226: getdents d2/d6/de/d1c/d4d/d52 0 2024-09-21T11:39:22.196 INFO:tasks.workunit.client.1.smithi149.stdout:6/821: creat d8/d32/d37/dd7/d10b/f116 x:0 0 0 2024-09-21T11:39:22.199 INFO:tasks.workunit.client.1.smithi149.stdout:5/975: rmdir d4/d1d/d50/d60/db1/d126 0 2024-09-21T11:39:22.199 INFO:tasks.workunit.client.1.smithi149.stdout:9/866: dread d18/d19/d1a/d2f/d43/fb9 [0,4194304] 0 2024-09-21T11:39:22.200 INFO:tasks.workunit.client.1.smithi149.stdout:9/867: chown d18/d1c/f4f 69409497 1 2024-09-21T11:39:22.208 INFO:tasks.workunit.client.1.smithi149.stdout:9/868: dread d18/d19/d1a/d2f/faa [0,4194304] 0 2024-09-21T11:39:22.208 INFO:tasks.workunit.client.1.smithi149.stdout:5/976: dread d4/d7/f27 [0,4194304] 0 2024-09-21T11:39:22.213 INFO:tasks.workunit.client.0.smithi118.stdout:7/294: creat d0/d3/f63 x:0 0 0 2024-09-21T11:39:22.215 INFO:tasks.workunit.client.1.smithi149.stdout:9/869: symlink d18/d19/d1a/d2f/d7d/l112 0 2024-09-21T11:39:22.216 INFO:tasks.workunit.client.0.smithi118.stdout:8/607: getdents d2/dc/d10/d2e 0 2024-09-21T11:39:22.220 INFO:tasks.workunit.client.0.smithi118.stdout:7/295: creat d0/d3/d14/d41/f64 x:0 0 0 2024-09-21T11:39:22.228 INFO:tasks.workunit.client.1.smithi149.stdout:0/834: symlink dd/d1a/d1b/d50/l10f 0 2024-09-21T11:39:22.228 INFO:tasks.workunit.client.1.smithi149.stdout:0/835: fdatasync dd/d32/dbe/f100 0 2024-09-21T11:39:22.230 INFO:tasks.workunit.client.1.smithi149.stdout:0/836: mknod dd/de5/c110 0 2024-09-21T11:39:22.231 INFO:tasks.workunit.client.1.smithi149.stdout:0/837: dread - dd/d1a/d1b/d72/d87/ffc zero size 2024-09-21T11:39:22.232 INFO:tasks.workunit.client.1.smithi149.stdout:0/838: readlink dd/d1a/d1b/d72/d78/dc4/d3a/d66/dcf/l103 0 2024-09-21T11:39:22.234 INFO:tasks.workunit.client.1.smithi149.stdout:0/839: truncate dd/db3/ffe 437092 0 2024-09-21T11:39:22.241 INFO:tasks.workunit.client.1.smithi149.stdout:0/840: dwrite dd/d1a/f9f [0,4194304] 0 2024-09-21T11:39:22.249 INFO:tasks.workunit.client.0.smithi118.stdout:0/626: sync 2024-09-21T11:39:22.255 INFO:tasks.workunit.client.0.smithi118.stdout:0/627: link d5/d34/d44/l5f d5/d10/d1e/d33/dd4/ldd 0 2024-09-21T11:39:22.257 INFO:tasks.workunit.client.0.smithi118.stdout:0/628: truncate d5/d10/d1e/d23/d3a/d90/f99 594113 0 2024-09-21T11:39:22.258 INFO:tasks.workunit.client.0.smithi118.stdout:0/629: chown d5/d10/d1e/d33/fcc 943 1 2024-09-21T11:39:22.259 INFO:tasks.workunit.client.0.smithi118.stdout:4/227: mkdir d2/d6/dd/d55 0 2024-09-21T11:39:22.260 INFO:tasks.workunit.client.0.smithi118.stdout:4/228: chown d2/d6/de/d1c/d4d/d52 503857983 1 2024-09-21T11:39:22.260 INFO:tasks.workunit.client.0.smithi118.stdout:0/630: truncate d5/d10/d1e/d23/d3a/d4e/fa8 15707 0 2024-09-21T11:39:22.264 INFO:tasks.workunit.client.0.smithi118.stdout:4/229: symlink d2/d6/de/d1c/d4d/d52/l56 0 2024-09-21T11:39:22.267 INFO:tasks.workunit.client.0.smithi118.stdout:4/230: creat d2/d6/dd/f57 x:0 0 0 2024-09-21T11:39:22.270 INFO:tasks.workunit.client.0.smithi118.stdout:4/231: symlink d2/d6/de/d1c/d23/d26/d31/l58 0 2024-09-21T11:39:22.272 INFO:tasks.workunit.client.0.smithi118.stdout:4/232: symlink d2/d6/de/d1c/d23/l59 0 2024-09-21T11:39:22.273 INFO:tasks.workunit.client.0.smithi118.stdout:4/233: chown d2/d6/de/d1c/d23/d26/d31/l37 61130 1 2024-09-21T11:39:22.275 INFO:tasks.workunit.client.0.smithi118.stdout:4/234: symlink d2/d6/de/d1c/d23/d26/l5a 0 2024-09-21T11:39:22.286 INFO:tasks.workunit.client.0.smithi118.stdout:7/296: getdents d0/d3/d29 0 2024-09-21T11:39:22.287 INFO:tasks.workunit.client.0.smithi118.stdout:7/297: creat d0/d3/d14/f65 x:0 0 0 2024-09-21T11:39:22.290 INFO:tasks.workunit.client.1.smithi149.stdout:7/938: truncate d12/d5b/db5/dc5/de9/d4a/d6c/db1/fb2 2884822 0 2024-09-21T11:39:22.293 INFO:tasks.workunit.client.0.smithi118.stdout:1/341: dwrite d6/d33/f44 [4194304,4194304] 0 2024-09-21T11:39:22.294 INFO:tasks.workunit.client.0.smithi118.stdout:7/298: dread d0/d3/d13/f2f [0,4194304] 0 2024-09-21T11:39:22.294 INFO:tasks.workunit.client.1.smithi149.stdout:3/933: sync 2024-09-21T11:39:22.298 INFO:tasks.workunit.client.1.smithi149.stdout:3/934: mknod d6/d1f/d47/dce/c144 0 2024-09-21T11:39:22.299 INFO:tasks.workunit.client.1.smithi149.stdout:3/935: chown d6/d1f/d27/d83/d116 0 1 2024-09-21T11:39:22.300 INFO:tasks.workunit.client.0.smithi118.stdout:7/299: mkdir d0/d3/d14/d41/d66 0 2024-09-21T11:39:22.300 INFO:tasks.workunit.client.1.smithi149.stdout:3/936: readlink d6/d1f/d47/d37/d3f/dc5/d111/l131 0 2024-09-21T11:39:22.301 INFO:tasks.workunit.client.0.smithi118.stdout:7/300: fsync d0/f10 0 2024-09-21T11:39:22.301 INFO:tasks.workunit.client.0.smithi118.stdout:7/301: readlink d0/l5c 0 2024-09-21T11:39:22.301 INFO:tasks.workunit.client.0.smithi118.stdout:7/302: chown d0/d3/d14/c49 3814445 1 2024-09-21T11:39:22.302 INFO:tasks.workunit.client.0.smithi118.stdout:1/342: truncate d6/d2a/f23 665460 0 2024-09-21T11:39:22.309 INFO:tasks.workunit.client.0.smithi118.stdout:1/343: creat d6/d3b/f66 x:0 0 0 2024-09-21T11:39:22.310 INFO:tasks.workunit.client.1.smithi149.stdout:3/937: getdents d6/d5f/d60 0 2024-09-21T11:39:22.317 INFO:tasks.workunit.client.1.smithi149.stdout:3/938: dwrite d6/d1f/d47/d37/d3f/dc5/de3/f13f [0,4194304] 0 2024-09-21T11:39:22.323 INFO:tasks.workunit.client.1.smithi149.stdout:0/841: creat dd/d1a/d1b/d72/d78/f111 x:0 0 0 2024-09-21T11:39:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:22 smithi118 ceph-mon[28757]: pgmap v26: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 110 MiB/s rd, 322 MiB/s wr, 589 op/s 2024-09-21T11:39:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:22 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:39:22.324 INFO:tasks.workunit.client.1.smithi149.stdout:4/915: mkdir d4/d6/d63/d2d/dd6/d12f 0 2024-09-21T11:39:22.326 INFO:tasks.workunit.client.1.smithi149.stdout:0/842: mknod dd/d32/dbe/c112 0 2024-09-21T11:39:22.327 INFO:tasks.workunit.client.1.smithi149.stdout:5/977: dwrite d4/d1d/d50/d60/db1/db4/fd2 [0,4194304] 0 2024-09-21T11:39:22.327 INFO:tasks.workunit.client.0.smithi118.stdout:0/631: mknod d5/cde 0 2024-09-21T11:39:22.333 INFO:tasks.workunit.client.0.smithi118.stdout:2/205: rmdir de/d1f/d20 39 2024-09-21T11:39:22.337 INFO:tasks.workunit.client.0.smithi118.stdout:0/632: dwrite d5/d10/d1e/d21/db3/dbe/fd0 [0,4194304] 0 2024-09-21T11:39:22.339 INFO:tasks.workunit.client.0.smithi118.stdout:2/206: symlink de/d1f/l49 0 2024-09-21T11:39:22.341 INFO:tasks.workunit.client.0.smithi118.stdout:0/633: symlink d5/d34/d44/d87/d9a/ldf 0 2024-09-21T11:39:22.343 INFO:tasks.workunit.client.0.smithi118.stdout:5/278: rename d0/db/d35/d30/d57 to d0/d63 0 2024-09-21T11:39:22.346 INFO:tasks.workunit.client.0.smithi118.stdout:5/279: chown d0/db/d35/da/c47 2 1 2024-09-21T11:39:22.348 INFO:tasks.workunit.client.0.smithi118.stdout:2/207: dwrite de/d22/d3c/f3f [0,4194304] 0 2024-09-21T11:39:22.350 INFO:tasks.workunit.client.0.smithi118.stdout:4/235: rename d2/d6/de/d1c/d23/d26/d31/c36 to d2/d6/dd/c5b 0 2024-09-21T11:39:22.351 INFO:tasks.workunit.client.0.smithi118.stdout:5/280: fdatasync d0/db/d35/d30/d1a/f2a 0 2024-09-21T11:39:22.351 INFO:tasks.workunit.client.0.smithi118.stdout:5/281: fdatasync d0/db/d35/da/f21 0 2024-09-21T11:39:22.352 INFO:tasks.workunit.client.0.smithi118.stdout:5/282: dread - d0/d6/d25/f4f zero size 2024-09-21T11:39:22.353 INFO:tasks.workunit.client.0.smithi118.stdout:5/283: fdatasync d0/fd 0 2024-09-21T11:39:22.355 INFO:tasks.workunit.client.0.smithi118.stdout:2/208: mkdir de/d1f/d4a 0 2024-09-21T11:39:22.356 INFO:tasks.workunit.client.0.smithi118.stdout:8/608: creat d2/dc/d16/d46/fce x:0 0 0 2024-09-21T11:39:22.358 INFO:tasks.workunit.client.0.smithi118.stdout:7/303: truncate d0/f5 1896266 0 2024-09-21T11:39:22.358 INFO:tasks.workunit.client.0.smithi118.stdout:8/609: write d2/dc/d10/d2e/d18/f9c [4196177,7907] 0 2024-09-21T11:39:22.358 INFO:tasks.workunit.client.0.smithi118.stdout:5/284: rename d0 to d0/db/d35/d64 22 2024-09-21T11:39:22.359 INFO:tasks.workunit.client.0.smithi118.stdout:7/304: readlink d0/d3/l12 0 2024-09-21T11:39:22.360 INFO:tasks.workunit.client.0.smithi118.stdout:8/610: fdatasync d2/d32/f6c 0 2024-09-21T11:39:22.360 INFO:tasks.workunit.client.0.smithi118.stdout:4/236: creat d2/d6/de/f5c x:0 0 0 2024-09-21T11:39:22.362 INFO:tasks.workunit.client.0.smithi118.stdout:2/209: unlink de/d22/f2b 0 2024-09-21T11:39:22.363 INFO:tasks.workunit.client.0.smithi118.stdout:2/210: chown de/l45 220 1 2024-09-21T11:39:22.367 INFO:tasks.workunit.client.0.smithi118.stdout:5/285: dwrite d0/db/d35/da/f4e [0,4194304] 0 2024-09-21T11:39:22.374 INFO:tasks.workunit.client.0.smithi118.stdout:7/305: creat d0/d3/d14/d41/d66/f67 x:0 0 0 2024-09-21T11:39:22.374 INFO:tasks.workunit.client.0.smithi118.stdout:5/286: dwrite d0/db/d35/d2c/f3e [0,4194304] 0 2024-09-21T11:39:22.374 INFO:tasks.workunit.client.0.smithi118.stdout:7/306: dread - d0/d3/d1d/d35/f58 zero size 2024-09-21T11:39:22.378 INFO:tasks.workunit.client.0.smithi118.stdout:5/287: mkdir d0/db/d26/d65 0 2024-09-21T11:39:22.379 INFO:tasks.workunit.client.1.smithi149.stdout:1/828: rename d2/dd/d35/d5b to d2/dd/d35/d1c/d7a/d10e 0 2024-09-21T11:39:22.380 INFO:tasks.workunit.client.0.smithi118.stdout:7/307: mknod d0/d3/d29/c68 0 2024-09-21T11:39:22.381 INFO:tasks.workunit.client.0.smithi118.stdout:7/308: write d0/d3/d1d/d35/f58 [692108,33193] 0 2024-09-21T11:39:22.382 INFO:tasks.workunit.client.0.smithi118.stdout:5/288: rmdir d0/db/d35/d30/d1a 39 2024-09-21T11:39:22.382 INFO:tasks.workunit.client.0.smithi118.stdout:7/309: chown d0/d3/f5e 660 1 2024-09-21T11:39:22.382 INFO:tasks.workunit.client.1.smithi149.stdout:8/785: creat d3/d33/d34/d55/d5e/d9e/dc2/f108 x:0 0 0 2024-09-21T11:39:22.384 INFO:tasks.workunit.client.1.smithi149.stdout:6/822: rename d8/d32/d37/dd7 to d8/da/d2c/d102/d117 0 2024-09-21T11:39:22.390 INFO:tasks.workunit.client.0.smithi118.stdout:7/310: dwrite d0/d3/d29/d47/f5d [0,4194304] 0 2024-09-21T11:39:22.390 INFO:tasks.workunit.client.0.smithi118.stdout:5/289: mkdir d0/db/d35/d30/d66 0 2024-09-21T11:39:22.393 INFO:tasks.workunit.client.1.smithi149.stdout:9/870: rename d18/d36/d3c/d47/d99/fe1 to d18/d36/d3c/f113 0 2024-09-21T11:39:22.394 INFO:tasks.workunit.client.1.smithi149.stdout:5/978: write d4/d7/d40/f97 [562724,6805] 0 2024-09-21T11:39:22.398 INFO:tasks.workunit.client.0.smithi118.stdout:8/611: dread d2/dc/d16/f87 [0,4194304] 0 2024-09-21T11:39:22.400 INFO:tasks.workunit.client.0.smithi118.stdout:8/612: write d2/dc/d10/d2e/d18/f9c [761940,4438] 0 2024-09-21T11:39:22.400 INFO:tasks.workunit.client.1.smithi149.stdout:6/823: creat d8/d32/d37/d2b/d51/df5/dfb/f118 x:0 0 0 2024-09-21T11:39:22.401 INFO:tasks.workunit.client.1.smithi149.stdout:6/824: write d8/da/d2c/d52/d5e/d9b/fe2 [880221,63711] 0 2024-09-21T11:39:22.402 INFO:tasks.workunit.client.0.smithi118.stdout:0/634: write d5/f74 [4722867,125481] 0 2024-09-21T11:39:22.402 INFO:tasks.workunit.client.1.smithi149.stdout:6/825: chown d8/c108 6817 1 2024-09-21T11:39:22.404 INFO:tasks.workunit.client.1.smithi149.stdout:3/939: rename d6/d1f/d47/d22/d8d/d97/c132 to d6/d1f/d47/d37/d3f/dc5/de3/c145 0 2024-09-21T11:39:22.404 INFO:tasks.workunit.client.1.smithi149.stdout:6/826: chown d8/d32/d37/d28/dc8/f103 16 1 2024-09-21T11:39:22.406 INFO:tasks.workunit.client.0.smithi118.stdout:8/613: dread d2/dc/d10/d2e/d18/f9c [0,4194304] 0 2024-09-21T11:39:22.406 INFO:tasks.workunit.client.1.smithi149.stdout:3/940: chown d6/d1f/d47/d22/d8d/d97/dd2/fee 0 1 2024-09-21T11:39:22.406 INFO:tasks.workunit.client.0.smithi118.stdout:5/290: unlink d0/db/l4b 0 2024-09-21T11:39:22.406 INFO:tasks.workunit.client.1.smithi149.stdout:3/941: fdatasync d6/d1f/d27/d83/ffe 0 2024-09-21T11:39:22.408 INFO:tasks.workunit.client.1.smithi149.stdout:9/871: rmdir d18/d19/d1a/d2f/d33/d91 39 2024-09-21T11:39:22.409 INFO:tasks.workunit.client.1.smithi149.stdout:1/829: dread d2/dd/d35/d1c/d7a/fae [0,4194304] 0 2024-09-21T11:39:22.414 INFO:tasks.workunit.client.1.smithi149.stdout:4/916: rename d4/d6/d63/d15/d16/d23/d62/c75 to d4/d4d/d125/d128/c130 0 2024-09-21T11:39:22.415 INFO:tasks.workunit.client.0.smithi118.stdout:0/635: creat d5/d10/d1e/d21/db3/fe0 x:0 0 0 2024-09-21T11:39:22.417 INFO:tasks.workunit.client.1.smithi149.stdout:1/830: dwrite d2/d5/d3d/d88/f42 [4194304,4194304] 0 2024-09-21T11:39:22.417 INFO:tasks.workunit.client.1.smithi149.stdout:4/917: chown d4/d6/d63/d15/d16/d23/f102 41562447 1 2024-09-21T11:39:22.418 INFO:tasks.workunit.client.0.smithi118.stdout:8/614: creat d2/dc/d16/d46/d4c/db0/fcf x:0 0 0 2024-09-21T11:39:22.420 INFO:tasks.workunit.client.1.smithi149.stdout:3/942: symlink d6/d1f/d4c/l146 0 2024-09-21T11:39:22.422 INFO:tasks.workunit.client.0.smithi118.stdout:5/291: write d0/db/d35/d30/d1a/f2a [5039757,7406] 0 2024-09-21T11:39:22.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/872: unlink d18/d36/d3c/la5 0 2024-09-21T11:39:22.424 INFO:tasks.workunit.client.0.smithi118.stdout:2/211: write de/f12 [850491,128492] 0 2024-09-21T11:39:22.425 INFO:tasks.workunit.client.0.smithi118.stdout:2/212: chown de/d22/d3c/f3f 1 1 2024-09-21T11:39:22.429 INFO:tasks.workunit.client.1.smithi149.stdout:6/827: dread d8/da/d2c/d2d/f45 [0,4194304] 0 2024-09-21T11:39:22.429 INFO:tasks.workunit.client.0.smithi118.stdout:4/237: truncate d2/d6/de/d1c/f2e 3191234 0 2024-09-21T11:39:22.430 INFO:tasks.workunit.client.0.smithi118.stdout:4/238: write d2/d6/de/f1e [1097640,53807] 0 2024-09-21T11:39:22.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/828: truncate d8/d32/d37/d2b/d51/f93 112397 0 2024-09-21T11:39:22.432 INFO:tasks.workunit.client.0.smithi118.stdout:0/636: dread d5/d29/d68/d7b/db7/f4a [0,4194304] 0 2024-09-21T11:39:22.432 INFO:tasks.workunit.client.0.smithi118.stdout:7/311: dread d0/f5 [0,4194304] 0 2024-09-21T11:39:22.433 INFO:tasks.workunit.client.0.smithi118.stdout:7/312: fsync d0/d3/d1d/f45 0 2024-09-21T11:39:22.434 INFO:tasks.workunit.client.1.smithi149.stdout:0/843: rename dd/d1a/d1b/d72/d78/dc4/d3a/d66/fb4 to dd/d1a/d1b/d72/d78/d8b/d98/dbc/f113 0 2024-09-21T11:39:22.437 INFO:tasks.workunit.client.1.smithi149.stdout:1/831: creat d2/dd/d35/d1c/d37/da3/f10f x:0 0 0 2024-09-21T11:39:22.438 INFO:tasks.workunit.client.1.smithi149.stdout:4/918: dread d4/d6/d63/d15/d30/d8a/fd5 [4194304,4194304] 0 2024-09-21T11:39:22.440 INFO:tasks.workunit.client.1.smithi149.stdout:9/873: fdatasync d18/d1c/fb3 0 2024-09-21T11:39:22.443 INFO:tasks.workunit.client.1.smithi149.stdout:0/844: mknod dd/d1a/d1b/d72/d78/dbb/c114 0 2024-09-21T11:39:22.445 INFO:tasks.workunit.client.1.smithi149.stdout:3/943: fsync d6/d79/d7e/ff3 0 2024-09-21T11:39:22.446 INFO:tasks.workunit.client.1.smithi149.stdout:3/944: fsync d6/d5f/d60/f10c 0 2024-09-21T11:39:22.446 INFO:tasks.workunit.client.1.smithi149.stdout:5/979: write d4/d7/f4e [601247,94753] 0 2024-09-21T11:39:22.447 INFO:tasks.workunit.client.1.smithi149.stdout:1/832: fdatasync d2/d107/d6e/f6f 0 2024-09-21T11:39:22.448 INFO:tasks.workunit.client.1.smithi149.stdout:3/945: write d6/d1f/d4c/f87 [215817,80020] 0 2024-09-21T11:39:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:22 smithi149 ceph-mon[36123]: pgmap v26: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 110 MiB/s rd, 322 MiB/s wr, 589 op/s 2024-09-21T11:39:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:22 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:39:22.454 INFO:tasks.workunit.client.1.smithi149.stdout:1/833: dwrite d2/dd/d35/d1c/d2c/f97 [0,4194304] 0 2024-09-21T11:39:22.454 INFO:tasks.workunit.client.1.smithi149.stdout:7/939: truncate d12/d5b/db5/dc5/de9/d4a/d6c/db1/fb2 1533796 0 2024-09-21T11:39:22.461 INFO:tasks.workunit.client.1.smithi149.stdout:5/980: creat d4/d1d/d3e/f142 x:0 0 0 2024-09-21T11:39:22.462 INFO:tasks.workunit.client.0.smithi118.stdout:8/615: truncate d2/f29 1217921 0 2024-09-21T11:39:22.462 INFO:tasks.workunit.client.1.smithi149.stdout:0/845: dwrite dd/d2d/f4b [0,4194304] 0 2024-09-21T11:39:22.464 INFO:tasks.workunit.client.0.smithi118.stdout:8/616: truncate d2/dc/d10/d2e/d18/d36/fa3 547292 0 2024-09-21T11:39:22.465 INFO:tasks.workunit.client.0.smithi118.stdout:5/292: rename d0/db/d35/d30/d1a/d33 to d0/d6/d67 0 2024-09-21T11:39:22.471 INFO:tasks.workunit.client.1.smithi149.stdout:1/834: mkdir d2/dd/d35/d1c/d41/d74/df6/d110 0 2024-09-21T11:39:22.473 INFO:tasks.workunit.client.1.smithi149.stdout:7/940: mknod d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/ddc/c125 0 2024-09-21T11:39:22.478 INFO:tasks.workunit.client.0.smithi118.stdout:7/313: symlink d0/d3/d13/d3d/d3e/l69 0 2024-09-21T11:39:22.480 INFO:tasks.workunit.client.1.smithi149.stdout:8/786: rename d3/d33/d34/d55/d5e/d9e/cae to d3/d33/d34/d55/d5e/d9e/dc2/d18/c109 0 2024-09-21T11:39:22.483 INFO:tasks.workunit.client.1.smithi149.stdout:1/835: stat d2/d5/ca0 0 2024-09-21T11:39:22.483 INFO:tasks.workunit.client.1.smithi149.stdout:5/981: dread d4/d1d/d50/d60/fb8 [0,4194304] 0 2024-09-21T11:39:22.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/982: chown d4/d7/d40/d51/c63 7 1 2024-09-21T11:39:22.485 INFO:tasks.workunit.client.0.smithi118.stdout:8/617: creat d2/dc/d10/d2e/fd0 x:0 0 0 2024-09-21T11:39:22.488 INFO:tasks.workunit.client.0.smithi118.stdout:2/213: unlink de/d16/d1c/c30 0 2024-09-21T11:39:22.488 INFO:tasks.workunit.client.0.smithi118.stdout:2/214: chown de/d1f/d4a 414302 1 2024-09-21T11:39:22.489 INFO:tasks.workunit.client.0.smithi118.stdout:3/247: sync 2024-09-21T11:39:22.489 INFO:tasks.workunit.client.0.smithi118.stdout:2/215: rename de/d1f/d4a to de/d1f/d4a/d4b 22 2024-09-21T11:39:22.490 INFO:tasks.workunit.client.1.smithi149.stdout:3/946: creat d6/d1f/d47/d37/f147 x:0 0 0 2024-09-21T11:39:22.493 INFO:tasks.workunit.client.1.smithi149.stdout:8/787: fdatasync d3/d33/d34/d55/d5e/d9e/dc2/d18/f51 0 2024-09-21T11:39:22.494 INFO:tasks.workunit.client.1.smithi149.stdout:8/788: dread - d3/d33/d34/d55/d5e/d9e/dc2/d21/fff zero size 2024-09-21T11:39:22.496 INFO:tasks.workunit.client.0.smithi118.stdout:7/314: mknod d0/d3/d13/d3d/d3e/c6a 0 2024-09-21T11:39:22.497 INFO:tasks.workunit.client.0.smithi118.stdout:7/315: stat d0/d3/d1d/d35/c51 0 2024-09-21T11:39:22.497 INFO:tasks.workunit.client.0.smithi118.stdout:7/316: dread - d0/d3/d14/d41/d66/f67 zero size 2024-09-21T11:39:22.498 INFO:tasks.workunit.client.0.smithi118.stdout:7/317: dread - d0/d3/d1d/d35/f61 zero size 2024-09-21T11:39:22.499 INFO:tasks.workunit.client.1.smithi149.stdout:0/846: creat dd/d1a/d1b/d81/f115 x:0 0 0 2024-09-21T11:39:22.499 INFO:tasks.workunit.client.1.smithi149.stdout:0/847: chown dd/d6a/f88 1367278922 1 2024-09-21T11:39:22.502 INFO:tasks.workunit.client.0.smithi118.stdout:0/637: dwrite d5/d29/d68/d7b/db7/fac [0,4194304] 0 2024-09-21T11:39:22.504 INFO:tasks.workunit.client.1.smithi149.stdout:6/829: rename d8/d32/d70/cc9 to d8/d32/d37/d28/d106/c119 0 2024-09-21T11:39:22.507 INFO:tasks.workunit.client.0.smithi118.stdout:3/248: rename d5/d1d/d1b/f20 to d5/d1d/d1b/d24/f60 0 2024-09-21T11:39:22.510 INFO:tasks.workunit.client.1.smithi149.stdout:1/836: fdatasync d2/f60 0 2024-09-21T11:39:22.510 INFO:tasks.workunit.client.1.smithi149.stdout:8/789: truncate d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fcf 5044239 0 2024-09-21T11:39:22.511 INFO:tasks.workunit.client.1.smithi149.stdout:1/837: fdatasync d2/d5/d3d/d88/f63 0 2024-09-21T11:39:22.512 INFO:tasks.workunit.client.0.smithi118.stdout:4/239: rmdir d2/d6/de/d1c/d40 0 2024-09-21T11:39:22.513 INFO:tasks.workunit.client.1.smithi149.stdout:7/941: creat d12/d5b/db5/f126 x:0 0 0 2024-09-21T11:39:22.514 INFO:tasks.workunit.client.0.smithi118.stdout:7/318: fdatasync d0/d3/d29/d5f/f62 0 2024-09-21T11:39:22.514 INFO:tasks.workunit.client.0.smithi118.stdout:1/344: sync 2024-09-21T11:39:22.514 INFO:tasks.workunit.client.0.smithi118.stdout:6/260: sync 2024-09-21T11:39:22.514 INFO:tasks.workunit.client.0.smithi118.stdout:9/343: sync 2024-09-21T11:39:22.519 INFO:tasks.workunit.client.0.smithi118.stdout:0/638: dread d5/d10/d1e/d23/f7d [0,4194304] 0 2024-09-21T11:39:22.519 INFO:tasks.workunit.client.1.smithi149.stdout:4/919: rename d4/d4d/lce to d4/d4d/d5f/d71/dd1/l131 0 2024-09-21T11:39:22.521 INFO:tasks.workunit.client.0.smithi118.stdout:3/249: chown d5/d28/d3e/l46 74 1 2024-09-21T11:39:22.521 INFO:tasks.workunit.client.0.smithi118.stdout:7/319: dwrite d0/d3/d1d/d35/f58 [0,4194304] 0 2024-09-21T11:39:22.522 INFO:tasks.workunit.client.0.smithi118.stdout:3/250: fdatasync d5/d1d/f12 0 2024-09-21T11:39:22.523 INFO:tasks.workunit.client.0.smithi118.stdout:7/320: read - d0/d3/d14/f3c zero size 2024-09-21T11:39:22.525 INFO:tasks.workunit.client.0.smithi118.stdout:5/293: symlink d0/db/d35/d30/d1a/l68 0 2024-09-21T11:39:22.526 INFO:tasks.workunit.client.0.smithi118.stdout:5/294: read d0/fe [2338735,7197] 0 2024-09-21T11:39:22.527 INFO:tasks.workunit.client.1.smithi149.stdout:1/838: fsync d2/dd/d2e/d4c/ff0 0 2024-09-21T11:39:22.528 INFO:tasks.workunit.client.1.smithi149.stdout:6/830: dread d8/da/d3d/fdb [0,4194304] 0 2024-09-21T11:39:22.529 INFO:tasks.workunit.client.0.smithi118.stdout:7/321: dwrite d0/f16 [0,4194304] 0 2024-09-21T11:39:22.534 INFO:tasks.workunit.client.1.smithi149.stdout:7/942: rmdir d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa 39 2024-09-21T11:39:22.538 INFO:tasks.workunit.client.1.smithi149.stdout:9/874: rename ca to d18/d19/d1a/df1/c114 0 2024-09-21T11:39:22.539 INFO:tasks.workunit.client.1.smithi149.stdout:4/920: symlink d4/d4d/d5f/l132 0 2024-09-21T11:39:22.539 INFO:tasks.workunit.client.1.smithi149.stdout:1/839: dwrite d2/dd/d35/d1c/d37/da3/fc6 [0,4194304] 0 2024-09-21T11:39:22.546 INFO:tasks.workunit.client.1.smithi149.stdout:3/947: link d6/d1f/d47/d37/dd6/ca6 d6/d1f/d47/d37/dd6/d96/d127/c148 0 2024-09-21T11:39:22.547 INFO:tasks.workunit.client.1.smithi149.stdout:5/983: rename d4/d7/d40/d43/c44 to d4/d1d/d50/d60/c143 0 2024-09-21T11:39:22.548 INFO:tasks.workunit.client.0.smithi118.stdout:7/322: creat d0/d3/d29/f6b x:0 0 0 2024-09-21T11:39:22.549 INFO:tasks.workunit.client.1.smithi149.stdout:0/848: getdents dd/d32/db2 0 2024-09-21T11:39:22.550 INFO:tasks.workunit.client.1.smithi149.stdout:0/849: chown dd/d35/c40 30237 1 2024-09-21T11:39:22.550 INFO:tasks.workunit.client.1.smithi149.stdout:4/921: fsync d4/d6/d63/d10/d6f/fc8 0 2024-09-21T11:39:22.551 INFO:tasks.workunit.client.0.smithi118.stdout:6/261: symlink d8/d14/d3a/d54/l56 0 2024-09-21T11:39:22.552 INFO:tasks.workunit.client.1.smithi149.stdout:8/790: write d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f9f [1363903,48601] 0 2024-09-21T11:39:22.553 INFO:tasks.workunit.client.1.smithi149.stdout:1/840: symlink d2/dd/d35/d1c/d41/d51/d73/l111 0 2024-09-21T11:39:22.555 INFO:tasks.workunit.client.1.smithi149.stdout:0/850: dread dd/d32/fe8 [0,4194304] 0 2024-09-21T11:39:22.556 INFO:tasks.workunit.client.1.smithi149.stdout:6/831: rename d8/da/d14 to d8/da/d2c/d102/d117/d10b/d11a 0 2024-09-21T11:39:22.556 INFO:tasks.workunit.client.0.smithi118.stdout:9/344: getdents d0/d20/d4c/d5f/d66 0 2024-09-21T11:39:22.558 INFO:tasks.workunit.client.0.smithi118.stdout:9/345: dread d0/f24 [0,4194304] 0 2024-09-21T11:39:22.559 INFO:tasks.workunit.client.0.smithi118.stdout:9/346: read - d0/d4/d45/f75 zero size 2024-09-21T11:39:22.561 INFO:tasks.workunit.client.1.smithi149.stdout:4/922: creat d4/d6/d63/d78/d98/dcc/ddb/f133 x:0 0 0 2024-09-21T11:39:22.562 INFO:tasks.workunit.client.0.smithi118.stdout:7/323: dread d0/f2a [0,4194304] 0 2024-09-21T11:39:22.564 INFO:tasks.workunit.client.0.smithi118.stdout:7/324: fdatasync d0/d3/d14/f32 0 2024-09-21T11:39:22.564 INFO:tasks.workunit.client.0.smithi118.stdout:3/251: dwrite f2 [8388608,4194304] 0 2024-09-21T11:39:22.568 INFO:tasks.workunit.client.1.smithi149.stdout:7/943: rename d12/d5b/db5/dc5/de9/d68/f7b to d12/d5b/db5/dc5/de9/d4a/d6c/db1/de1/f127 0 2024-09-21T11:39:22.569 INFO:tasks.workunit.client.0.smithi118.stdout:1/345: getdents d6/de/d16 0 2024-09-21T11:39:22.570 INFO:tasks.workunit.client.0.smithi118.stdout:1/346: read - d6/de/d16/d3f/f37 zero size 2024-09-21T11:39:22.571 INFO:tasks.workunit.client.1.smithi149.stdout:7/944: fdatasync d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/fbc 0 2024-09-21T11:39:22.572 INFO:tasks.workunit.client.0.smithi118.stdout:2/216: rename de/ff to de/d1f/f4c 0 2024-09-21T11:39:22.572 INFO:tasks.workunit.client.0.smithi118.stdout:1/347: read d6/de/f11 [67997,27816] 0 2024-09-21T11:39:22.573 INFO:tasks.workunit.client.1.smithi149.stdout:4/923: mkdir d4/d6/d63/d15/d30/da6/d134 0 2024-09-21T11:39:22.574 INFO:tasks.workunit.client.0.smithi118.stdout:0/639: dread d5/d34/f3c [0,4194304] 0 2024-09-21T11:39:22.577 INFO:tasks.workunit.client.0.smithi118.stdout:0/640: truncate d5/d34/f9f 996418 0 2024-09-21T11:39:22.577 INFO:tasks.workunit.client.0.smithi118.stdout:4/240: getdents d2/d6/de/d1c/d23/d26 0 2024-09-21T11:39:22.578 INFO:tasks.workunit.client.0.smithi118.stdout:3/252: read d5/d1d/d1b/d24/f2c [3049192,117282] 0 2024-09-21T11:39:22.578 INFO:tasks.workunit.client.1.smithi149.stdout:4/924: dread d4/d6/f88 [0,4194304] 0 2024-09-21T11:39:22.578 INFO:tasks.workunit.client.1.smithi149.stdout:0/851: mkdir dd/d1a/d1b/d72/d116 0 2024-09-21T11:39:22.579 INFO:tasks.workunit.client.0.smithi118.stdout:3/253: write d5/f30 [87679,95965] 0 2024-09-21T11:39:22.579 INFO:tasks.workunit.client.1.smithi149.stdout:1/841: rename d2/dd/d35/d7c/caa to d2/d5/d65/d96/d105/d10d/c112 0 2024-09-21T11:39:22.580 INFO:tasks.workunit.client.1.smithi149.stdout:1/842: write d2/d5/d65/f86 [3235368,85964] 0 2024-09-21T11:39:22.582 INFO:tasks.workunit.client.1.smithi149.stdout:7/945: fsync d12/d5b/db5/dc5/de9/d4a/d6c/da0/db9/fe7 0 2024-09-21T11:39:22.583 INFO:tasks.workunit.client.0.smithi118.stdout:8/618: rename d2/fa to d2/dc/d10/d2e/d18/d1a/fd1 0 2024-09-21T11:39:22.586 INFO:tasks.workunit.client.0.smithi118.stdout:5/295: getdents d0/db/d35/d2c/d40 0 2024-09-21T11:39:22.587 INFO:tasks.workunit.client.0.smithi118.stdout:5/296: fdatasync d0/d6/d67/f62 0 2024-09-21T11:39:22.587 INFO:tasks.workunit.client.1.smithi149.stdout:5/984: truncate d4/d7/d40/d43/d49/d88/fae 341023 0 2024-09-21T11:39:22.591 INFO:tasks.workunit.client.0.smithi118.stdout:7/325: mknod d0/d3/c6c 0 2024-09-21T11:39:22.594 INFO:tasks.workunit.client.1.smithi149.stdout:6/832: rename d8/d32/d37/d28/d2e/l40 to d8/da/d2c/d2d/l11b 0 2024-09-21T11:39:22.596 INFO:tasks.workunit.client.0.smithi118.stdout:2/217: symlink de/d16/d1c/l4d 0 2024-09-21T11:39:22.597 INFO:tasks.workunit.client.1.smithi149.stdout:7/946: dread - d12/d5b/db5/dc5/de9/d4a/d6c/d8c/fa2 zero size 2024-09-21T11:39:22.599 INFO:tasks.workunit.client.0.smithi118.stdout:9/347: rename d0/d4/d23 to d0/d20/d4c/d5f/d6c/d88 0 2024-09-21T11:39:22.600 INFO:tasks.workunit.client.1.smithi149.stdout:8/791: link d3/d33/d34/d55/d5e/d9e/dc2/c88 d3/d3c/d8f/c10a 0 2024-09-21T11:39:22.601 INFO:tasks.workunit.client.0.smithi118.stdout:8/619: rmdir d2/d32 39 2024-09-21T11:39:22.603 INFO:tasks.workunit.client.1.smithi149.stdout:5/985: write d4/d1d/d50/d60/fb8 [2099935,21275] 0 2024-09-21T11:39:22.603 INFO:tasks.workunit.client.0.smithi118.stdout:9/348: dread d0/f2c [0,4194304] 0 2024-09-21T11:39:22.603 INFO:tasks.workunit.client.1.smithi149.stdout:5/986: chown d4/d1d/d50/d54/d2a 430 1 2024-09-21T11:39:22.604 INFO:tasks.workunit.client.0.smithi118.stdout:9/349: chown d0/f1 2 1 2024-09-21T11:39:22.604 INFO:tasks.workunit.client.0.smithi118.stdout:3/254: write d5/d1d/f16 [373237,35535] 0 2024-09-21T11:39:22.606 INFO:tasks.workunit.client.0.smithi118.stdout:3/255: chown d5/d1d/f4e 292664 1 2024-09-21T11:39:22.608 INFO:tasks.workunit.client.1.smithi149.stdout:0/852: fdatasync dd/d1a/d1b/d72/d85/f9a 0 2024-09-21T11:39:22.609 INFO:tasks.workunit.client.1.smithi149.stdout:4/925: truncate d4/d4d/d58/fc7 2865620 0 2024-09-21T11:39:22.610 INFO:tasks.workunit.client.0.smithi118.stdout:7/326: read d0/f9 [4694605,51056] 0 2024-09-21T11:39:22.611 INFO:tasks.workunit.client.1.smithi149.stdout:6/833: rename d8/da/d2c/d102/d117/d10b/d11a/f1f to d8/d32/d37/d2b/d51/df5/f11c 0 2024-09-21T11:39:22.611 INFO:tasks.workunit.client.0.smithi118.stdout:7/327: stat d0/d3/d13/d3d 0 2024-09-21T11:39:22.612 INFO:tasks.workunit.client.0.smithi118.stdout:4/241: symlink d2/d6/dd/l5d 0 2024-09-21T11:39:22.618 INFO:tasks.workunit.client.1.smithi149.stdout:4/926: creat d4/f135 x:0 0 0 2024-09-21T11:39:22.619 INFO:tasks.workunit.client.0.smithi118.stdout:5/297: dread d0/db/d35/d30/d1a/f2a [0,4194304] 0 2024-09-21T11:39:22.619 INFO:tasks.workunit.client.1.smithi149.stdout:4/927: write d4/d6/d63/d2d/dd6/d32/d4a/f61 [1476861,131051] 0 2024-09-21T11:39:22.623 INFO:tasks.workunit.client.0.smithi118.stdout:1/348: link d6/d2a/l56 d6/de/d16/d3f/d50/l67 0 2024-09-21T11:39:22.623 INFO:tasks.workunit.client.1.smithi149.stdout:0/853: dread dd/db3/fc5 [0,4194304] 0 2024-09-21T11:39:22.628 INFO:tasks.workunit.client.0.smithi118.stdout:1/349: dread d6/d3b/f43 [0,4194304] 0 2024-09-21T11:39:22.628 INFO:tasks.workunit.client.1.smithi149.stdout:8/792: mkdir d3/d33/d34/d72/d83/d10b 0 2024-09-21T11:39:22.629 INFO:tasks.workunit.client.0.smithi118.stdout:3/256: creat d5/d1d/d1b/d24/f61 x:0 0 0 2024-09-21T11:39:22.630 INFO:tasks.workunit.client.1.smithi149.stdout:1/843: truncate d2/d5/fab 4063942 0 2024-09-21T11:39:22.631 INFO:tasks.workunit.client.0.smithi118.stdout:4/242: mkdir d2/d6/de/d3e/d5e 0 2024-09-21T11:39:22.634 INFO:tasks.workunit.client.0.smithi118.stdout:4/243: read d2/d6/de/d1c/d23/f2c [3214939,48185] 0 2024-09-21T11:39:22.634 INFO:tasks.workunit.client.0.smithi118.stdout:6/262: rename d8/c16 to d8/d48/c57 0 2024-09-21T11:39:22.636 INFO:tasks.workunit.client.0.smithi118.stdout:9/350: dwrite d0/d20/d4c/d5f/d6c/d88/f32 [0,4194304] 0 2024-09-21T11:39:22.641 INFO:tasks.workunit.client.0.smithi118.stdout:0/641: getdents d5/d29/d68/d7b/db7 0 2024-09-21T11:39:22.642 INFO:tasks.workunit.client.1.smithi149.stdout:4/928: truncate d4/d6/f59 2969790 0 2024-09-21T11:39:22.642 INFO:tasks.workunit.client.0.smithi118.stdout:0/642: chown d5/d10/d1e/d20/f8e 42 1 2024-09-21T11:39:22.643 INFO:tasks.workunit.client.1.smithi149.stdout:6/834: link d8/d32/d37/d2b/d7d/db8/lcf d8/d32/d37/d2b/d51/df5/dfb/l11d 0 2024-09-21T11:39:22.643 INFO:tasks.workunit.client.0.smithi118.stdout:0/643: chown d5/d29/d68/d7b/db7/f45 104213 1 2024-09-21T11:39:22.644 INFO:tasks.workunit.client.0.smithi118.stdout:3/257: symlink d5/d28/d33/l62 0 2024-09-21T11:39:22.645 INFO:tasks.workunit.client.1.smithi149.stdout:0/854: symlink dd/d1a/d1b/d72/d78/dc4/d3a/dd1/dde/d101/l117 0 2024-09-21T11:39:22.646 INFO:tasks.workunit.client.1.smithi149.stdout:0/855: readlink dd/d32/lb6 0 2024-09-21T11:39:22.647 INFO:tasks.workunit.client.1.smithi149.stdout:7/947: getdents d12/d5b/db5/dc5/de9/d4a/d6c/da0/db9 0 2024-09-21T11:39:22.651 INFO:tasks.workunit.client.1.smithi149.stdout:8/793: symlink d3/d33/d34/d55/d5e/d9e/dc2/l10c 0 2024-09-21T11:39:22.652 INFO:tasks.workunit.client.0.smithi118.stdout:6/263: rmdir d8/d14/d3a/d54 39 2024-09-21T11:39:22.655 INFO:tasks.workunit.client.1.smithi149.stdout:1/844: creat d2/dd/d35/d1c/d41/d74/df6/d110/f113 x:0 0 0 2024-09-21T11:39:22.656 INFO:tasks.workunit.client.1.smithi149.stdout:1/845: chown d2/dd/d35/d1c/d41/d51/d90/lfa 342662 1 2024-09-21T11:39:22.656 INFO:tasks.workunit.client.0.smithi118.stdout:5/298: creat d0/db/d26/d65/f69 x:0 0 0 2024-09-21T11:39:22.657 INFO:tasks.workunit.client.0.smithi118.stdout:9/351: mkdir d0/d20/d4c/d5f/d89 0 2024-09-21T11:39:22.659 INFO:tasks.workunit.client.1.smithi149.stdout:4/929: creat d4/d6/d63/d10/d6f/f136 x:0 0 0 2024-09-21T11:39:22.661 INFO:tasks.workunit.client.1.smithi149.stdout:6/835: rmdir d8/da/d2c/d2d/d60 39 2024-09-21T11:39:22.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/948: dread d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/dab/fd8 [0,4194304] 0 2024-09-21T11:39:22.663 INFO:tasks.workunit.client.0.smithi118.stdout:9/352: dwrite d0/f1 [8388608,4194304] 0 2024-09-21T11:39:22.664 INFO:tasks.workunit.client.0.smithi118.stdout:1/350: unlink d6/de/d16/d3f/c65 0 2024-09-21T11:39:22.668 INFO:tasks.workunit.client.0.smithi118.stdout:3/258: creat d5/d1d/d1b/d4c/f63 x:0 0 0 2024-09-21T11:39:22.669 INFO:tasks.workunit.client.0.smithi118.stdout:3/259: chown d5/d1d/f43 485025 1 2024-09-21T11:39:22.670 INFO:tasks.workunit.client.1.smithi149.stdout:5/987: getdents d4/d7/d40/d43/d85/dce 0 2024-09-21T11:39:22.672 INFO:tasks.workunit.client.0.smithi118.stdout:2/218: getdents de/d16 0 2024-09-21T11:39:22.673 INFO:tasks.workunit.client.1.smithi149.stdout:1/846: symlink d2/d5/d8/dc1/dd6/l114 0 2024-09-21T11:39:22.674 INFO:tasks.workunit.client.1.smithi149.stdout:1/847: write d2/d5/f7d [4181704,24225] 0 2024-09-21T11:39:22.675 INFO:tasks.workunit.client.0.smithi118.stdout:8/620: link d2/dc/d10/d2e/lc4 d2/d7c/d88/d8f/ld2 0 2024-09-21T11:39:22.676 INFO:tasks.workunit.client.1.smithi149.stdout:6/836: chown d8/d32/d37/d28/d2e/c34 1773593 1 2024-09-21T11:39:22.677 INFO:tasks.workunit.client.0.smithi118.stdout:5/299: creat d0/d6/f6a x:0 0 0 2024-09-21T11:39:22.678 INFO:tasks.workunit.client.1.smithi149.stdout:0/856: rename dd/d1a/d1b/d72/d78/dc4/f6f to dd/d1a/d5a/d106/f118 0 2024-09-21T11:39:22.679 INFO:tasks.workunit.client.1.smithi149.stdout:7/949: stat d12/d5b/db5/dc5/de9/d68/dc4/f3e 0 2024-09-21T11:39:22.680 INFO:tasks.workunit.client.1.smithi149.stdout:7/950: stat d12/d5b/db5/fd7 0 2024-09-21T11:39:22.683 INFO:tasks.workunit.client.1.smithi149.stdout:5/988: rmdir d4/d1d/d50/d54/d2a 39 2024-09-21T11:39:22.684 INFO:tasks.workunit.client.1.smithi149.stdout:4/930: write d4/d4d/d58/fea [706061,99811] 0 2024-09-21T11:39:22.687 INFO:tasks.workunit.client.1.smithi149.stdout:9/875: sync 2024-09-21T11:39:22.687 INFO:tasks.workunit.client.1.smithi149.stdout:4/931: dread d4/d6/d63/d15/d30/d8a/fd5 [4194304,4194304] 0 2024-09-21T11:39:22.688 INFO:tasks.workunit.client.1.smithi149.stdout:6/837: readlink d8/da/d2c/d2d/l11b 0 2024-09-21T11:39:22.690 INFO:tasks.workunit.client.1.smithi149.stdout:8/794: rename d3/d12/d6e/d79/fe8 to d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/f10d 0 2024-09-21T11:39:22.691 INFO:tasks.workunit.client.0.smithi118.stdout:0/644: truncate d5/d29/d68/d7b/db7/fc4 2823366 0 2024-09-21T11:39:22.691 INFO:tasks.workunit.client.0.smithi118.stdout:9/353: dwrite d0/fc [0,4194304] 0 2024-09-21T11:39:22.691 INFO:tasks.workunit.client.0.smithi118.stdout:9/354: stat d0/f76 0 2024-09-21T11:39:22.693 INFO:tasks.workunit.client.1.smithi149.stdout:7/951: mkdir d12/d5b/db5/dc5/de9/d4a/d128 0 2024-09-21T11:39:22.694 INFO:tasks.workunit.client.0.smithi118.stdout:5/300: unlink d0/db/d35/d2c/d40/l49 0 2024-09-21T11:39:22.695 INFO:tasks.workunit.client.1.smithi149.stdout:7/952: write d12/d5b/db5/dc5/de9/d4a/d4f/d75/f91 [3367262,64056] 0 2024-09-21T11:39:22.695 INFO:tasks.workunit.client.0.smithi118.stdout:4/244: truncate d2/d6/de/d1c/d23/f2c 1715968 0 2024-09-21T11:39:22.695 INFO:tasks.workunit.client.0.smithi118.stdout:5/301: write d0/f37 [146249,53085] 0 2024-09-21T11:39:22.701 INFO:tasks.workunit.client.0.smithi118.stdout:2/219: mknod de/d1f/c4e 0 2024-09-21T11:39:22.704 INFO:tasks.workunit.client.1.smithi149.stdout:8/795: symlink d3/d33/d34/d55/l10e 0 2024-09-21T11:39:22.704 INFO:tasks.workunit.client.1.smithi149.stdout:0/857: symlink dd/d1a/d1b/d72/d116/l119 0 2024-09-21T11:39:22.707 INFO:tasks.workunit.client.1.smithi149.stdout:0/858: write dd/d2d/ff8 [840258,6080] 0 2024-09-21T11:39:22.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/953: dread d12/d5b/db5/dc5/de9/d4a/d6c/da0/dbb/fe8 [0,4194304] 0 2024-09-21T11:39:22.709 INFO:tasks.workunit.client.0.smithi118.stdout:8/621: rename d2/dc/d16/d46/d4c/d63/d68 to d2/dc/d10/dd3 0 2024-09-21T11:39:22.710 INFO:tasks.workunit.client.1.smithi149.stdout:9/876: symlink d18/d19/d1a/d9b/l115 0 2024-09-21T11:39:22.711 INFO:tasks.workunit.client.1.smithi149.stdout:9/877: readlink d18/d19/d1a/d2f/d30/d54/l5d 0 2024-09-21T11:39:22.712 INFO:tasks.workunit.client.0.smithi118.stdout:9/355: creat d0/d20/d4c/d5f/d6c/d88/d4d/f8a x:0 0 0 2024-09-21T11:39:22.716 INFO:tasks.workunit.client.0.smithi118.stdout:3/260: write d5/d1d/d1b/d24/f60 [21518,20382] 0 2024-09-21T11:39:22.717 INFO:tasks.workunit.client.0.smithi118.stdout:4/245: mkdir d2/d6/de/d1c/d23/d5f 0 2024-09-21T11:39:22.718 INFO:tasks.workunit.client.0.smithi118.stdout:4/246: fdatasync f1 0 2024-09-21T11:39:22.719 INFO:tasks.workunit.client.0.smithi118.stdout:9/356: dwrite d0/f76 [0,4194304] 0 2024-09-21T11:39:22.719 INFO:tasks.workunit.client.1.smithi149.stdout:6/838: dwrite d8/d32/d37/d2b/d51/f63 [0,4194304] 0 2024-09-21T11:39:22.720 INFO:tasks.workunit.client.0.smithi118.stdout:3/261: read d5/d1d/f11 [3780743,12785] 0 2024-09-21T11:39:22.720 INFO:tasks.workunit.client.0.smithi118.stdout:4/247: write d2/f49 [1494476,7624] 0 2024-09-21T11:39:22.720 INFO:tasks.workunit.client.0.smithi118.stdout:1/351: link d6/de/f5f d6/d33/d3c/f68 0 2024-09-21T11:39:22.721 INFO:tasks.workunit.client.0.smithi118.stdout:3/262: stat d5/d1d/f25 0 2024-09-21T11:39:22.722 INFO:tasks.workunit.client.0.smithi118.stdout:3/263: stat d5/d1d/d1b/d50/f5a 0 2024-09-21T11:39:22.726 INFO:tasks.workunit.client.0.smithi118.stdout:2/220: mkdir de/d16/d1c/d4f 0 2024-09-21T11:39:22.729 INFO:tasks.workunit.client.0.smithi118.stdout:6/264: getdents d8/d48 0 2024-09-21T11:39:22.730 INFO:tasks.workunit.client.0.smithi118.stdout:4/248: dwrite d2/f13 [0,4194304] 0 2024-09-21T11:39:22.732 INFO:tasks.workunit.client.0.smithi118.stdout:4/249: readlink d2/d6/de/d1c/d23/d26/d31/l3d 0 2024-09-21T11:39:22.741 INFO:tasks.workunit.client.0.smithi118.stdout:9/357: read d0/f5c [365589,111739] 0 2024-09-21T11:39:22.742 INFO:tasks.workunit.client.0.smithi118.stdout:1/352: creat d6/d2a/f69 x:0 0 0 2024-09-21T11:39:22.746 INFO:tasks.workunit.client.0.smithi118.stdout:3/264: symlink d5/d28/d3e/d5d/l64 0 2024-09-21T11:39:22.749 INFO:tasks.workunit.client.0.smithi118.stdout:5/302: truncate d0/f37 57380 0 2024-09-21T11:39:22.750 INFO:tasks.workunit.client.0.smithi118.stdout:6/265: symlink d8/d14/d4a/l58 0 2024-09-21T11:39:22.750 INFO:tasks.workunit.client.0.smithi118.stdout:6/266: fdatasync d8/d14/f32 0 2024-09-21T11:39:22.751 INFO:tasks.workunit.client.0.smithi118.stdout:5/303: read d0/db/d35/da/f21 [1934536,41036] 0 2024-09-21T11:39:22.752 INFO:tasks.workunit.client.0.smithi118.stdout:0/645: rename d5/d10/c9c to d5/d81/ce1 0 2024-09-21T11:39:22.752 INFO:tasks.workunit.client.0.smithi118.stdout:5/304: truncate d0/d6/d25/f4f 554865 0 2024-09-21T11:39:22.753 INFO:tasks.workunit.client.0.smithi118.stdout:5/305: write d0/f5 [1162886,42067] 0 2024-09-21T11:39:22.758 INFO:tasks.workunit.client.0.smithi118.stdout:9/358: symlink d0/d20/d4c/d5f/d6c/l8b 0 2024-09-21T11:39:22.761 INFO:tasks.workunit.client.0.smithi118.stdout:2/221: truncate de/d16/d1c/f46 736394 0 2024-09-21T11:39:22.763 INFO:tasks.workunit.client.0.smithi118.stdout:4/250: dread d2/fc [0,4194304] 0 2024-09-21T11:39:22.764 INFO:tasks.workunit.client.0.smithi118.stdout:6/267: stat d8/c20 0 2024-09-21T11:39:22.764 INFO:tasks.workunit.client.1.smithi149.stdout:5/989: link d4/d7/d40/d43/d49/d88/f98 d4/d7/f144 0 2024-09-21T11:39:22.765 INFO:tasks.workunit.client.1.smithi149.stdout:8/796: rmdir d3/d33/d34/d55/d5e/d9e 39 2024-09-21T11:39:22.766 INFO:tasks.workunit.client.0.smithi118.stdout:1/353: dwrite d6/de/d16/d3f/d50/d54/d32/f48 [0,4194304] 0 2024-09-21T11:39:22.768 INFO:tasks.workunit.client.1.smithi149.stdout:7/954: unlink d12/d5b/db5/dc5/de9/d4a/d4f/d75/lb4 0 2024-09-21T11:39:22.770 INFO:tasks.workunit.client.0.smithi118.stdout:0/646: unlink d5/d10/d1e/d23/l37 0 2024-09-21T11:39:22.771 INFO:tasks.workunit.client.0.smithi118.stdout:0/647: chown d5/d29/d68/d7b/db7/f78 3 1 2024-09-21T11:39:22.772 INFO:tasks.workunit.client.0.smithi118.stdout:0/648: dread - d5/d10/d1e/fa9 zero size 2024-09-21T11:39:22.776 INFO:tasks.workunit.client.0.smithi118.stdout:8/622: creat d2/dc/d16/d46/fd4 x:0 0 0 2024-09-21T11:39:22.781 INFO:tasks.workunit.client.1.smithi149.stdout:5/990: creat d4/d90/f145 x:0 0 0 2024-09-21T11:39:22.782 INFO:tasks.workunit.client.0.smithi118.stdout:3/265: link d5/d28/f54 d5/d28/f65 0 2024-09-21T11:39:22.783 INFO:tasks.workunit.client.1.smithi149.stdout:8/797: chown d3/d33/d34/d55/d5e/d9e/dc2/d90/df0 11519 1 2024-09-21T11:39:22.784 INFO:tasks.workunit.client.0.smithi118.stdout:8/623: dwrite d2/f7 [0,4194304] 0 2024-09-21T11:39:22.787 INFO:tasks.workunit.client.0.smithi118.stdout:6/268: symlink d8/d14/d4a/l59 0 2024-09-21T11:39:22.789 INFO:tasks.workunit.client.1.smithi149.stdout:4/932: getdents d4/d6/d63/d10 0 2024-09-21T11:39:22.791 INFO:tasks.workunit.client.1.smithi149.stdout:3/948: sync 2024-09-21T11:39:22.792 INFO:tasks.workunit.client.1.smithi149.stdout:6/839: rename d8/d32/d37/lbc to d8/d32/d37/d28/d2f/d6a/dff/l11e 0 2024-09-21T11:39:22.794 INFO:tasks.workunit.client.0.smithi118.stdout:5/306: symlink d0/l6b 0 2024-09-21T11:39:22.795 INFO:tasks.workunit.client.0.smithi118.stdout:3/266: dwrite d5/d1d/d1b/d4c/f63 [0,4194304] 0 2024-09-21T11:39:22.795 INFO:tasks.workunit.client.0.smithi118.stdout:0/649: dread d5/d10/d1e/d20/f32 [0,4194304] 0 2024-09-21T11:39:22.795 INFO:tasks.workunit.client.0.smithi118.stdout:5/307: chown d0/f31 40463 1 2024-09-21T11:39:22.797 INFO:tasks.workunit.client.1.smithi149.stdout:4/933: dwrite d4/d6/d63/d78/d98/dcc/ddb/f133 [0,4194304] 0 2024-09-21T11:39:22.801 INFO:tasks.workunit.client.0.smithi118.stdout:2/222: mkdir de/d50 0 2024-09-21T11:39:22.805 INFO:tasks.workunit.client.1.smithi149.stdout:6/840: unlink d8/d32/d37/d2b/l6e 0 2024-09-21T11:39:22.813 INFO:tasks.workunit.client.1.smithi149.stdout:4/934: unlink d4/d6/d63/d15/dd2/le0 0 2024-09-21T11:39:22.821 INFO:tasks.workunit.client.0.smithi118.stdout:0/650: symlink d5/d10/d1e/d23/d3a/d4e/le2 0 2024-09-21T11:39:22.826 INFO:tasks.workunit.client.0.smithi118.stdout:9/359: dwrite d0/d4/f29 [4194304,4194304] 0 2024-09-21T11:39:22.829 INFO:tasks.workunit.client.1.smithi149.stdout:7/955: dwrite d12/d5b/db5/dc5/de9/d4a/d4f/f54 [0,4194304] 0 2024-09-21T11:39:22.829 INFO:tasks.workunit.client.0.smithi118.stdout:4/251: rename d2/d6/dd/d35/f3c to d2/d6/de/f60 0 2024-09-21T11:39:22.832 INFO:tasks.workunit.client.1.smithi149.stdout:8/798: link d3/d3c/d8f/l7b d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7/ddf/l10f 0 2024-09-21T11:39:22.833 INFO:tasks.workunit.client.0.smithi118.stdout:8/624: write d2/d73/d79/f9a [387512,112763] 0 2024-09-21T11:39:22.834 INFO:tasks.workunit.client.1.smithi149.stdout:5/991: link d4/d7/ce d4/d7/d40/c146 0 2024-09-21T11:39:22.835 INFO:tasks.workunit.client.0.smithi118.stdout:2/223: mkdir de/d51 0 2024-09-21T11:39:22.840 INFO:tasks.workunit.client.1.smithi149.stdout:4/935: creat d4/d6/d63/f137 x:0 0 0 2024-09-21T11:39:22.841 INFO:tasks.workunit.client.1.smithi149.stdout:8/799: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/fc5 [0,4194304] 0 2024-09-21T11:39:22.841 INFO:tasks.workunit.client.0.smithi118.stdout:6/269: creat d8/d14/d3a/f5a x:0 0 0 2024-09-21T11:39:22.842 INFO:tasks.workunit.client.1.smithi149.stdout:4/936: fsync d4/d6/d63/d15/d30/f53 0 2024-09-21T11:39:22.842 INFO:tasks.workunit.client.0.smithi118.stdout:6/270: chown d8/d48/c37 50 1 2024-09-21T11:39:22.846 INFO:tasks.workunit.client.0.smithi118.stdout:4/252: symlink d2/d6/de/d1c/d4d/l61 0 2024-09-21T11:39:22.848 INFO:tasks.workunit.client.0.smithi118.stdout:3/267: dwrite d5/d28/f2b [0,4194304] 0 2024-09-21T11:39:22.850 INFO:tasks.workunit.client.0.smithi118.stdout:0/651: mknod d5/d10/d1e/d23/d3a/d4e/d9d/dda/ce3 0 2024-09-21T11:39:22.852 INFO:tasks.workunit.client.1.smithi149.stdout:8/800: mkdir d3/d3c/d110 0 2024-09-21T11:39:22.854 INFO:tasks.workunit.client.1.smithi149.stdout:5/992: write d4/d7/d40/d43/d5c/d7a/d81/dea/f10f [2115075,83486] 0 2024-09-21T11:39:22.856 INFO:tasks.workunit.client.1.smithi149.stdout:6/841: dwrite d8/f39 [0,4194304] 0 2024-09-21T11:39:22.856 INFO:tasks.workunit.client.0.smithi118.stdout:2/224: truncate de/f19 51827 0 2024-09-21T11:39:22.858 INFO:tasks.workunit.client.1.smithi149.stdout:4/937: dwrite d4/f112 [4194304,4194304] 0 2024-09-21T11:39:22.861 INFO:tasks.workunit.client.1.smithi149.stdout:4/938: chown d4/d6/d63/d78/d98/dee/f70 263358974 1 2024-09-21T11:39:22.861 INFO:tasks.workunit.client.1.smithi149.stdout:8/801: chown d3/d33/c6c 5 1 2024-09-21T11:39:22.861 INFO:tasks.workunit.client.0.smithi118.stdout:9/360: creat d0/d4/f8c x:0 0 0 2024-09-21T11:39:22.862 INFO:tasks.workunit.client.1.smithi149.stdout:1/848: sync 2024-09-21T11:39:22.862 INFO:tasks.workunit.client.0.smithi118.stdout:6/271: truncate d8/f11 1224484 0 2024-09-21T11:39:22.863 INFO:tasks.workunit.client.0.smithi118.stdout:6/272: dread - d8/d14/d33/f55 zero size 2024-09-21T11:39:22.863 INFO:tasks.workunit.client.0.smithi118.stdout:5/308: dread d0/d6/d25/d50/f55 [0,4194304] 0 2024-09-21T11:39:22.864 INFO:tasks.workunit.client.1.smithi149.stdout:1/849: chown d2/dd/d35/d1c/d2c/f69 940 1 2024-09-21T11:39:22.867 INFO:tasks.workunit.client.0.smithi118.stdout:2/225: unlink de/d16/f33 0 2024-09-21T11:39:22.870 INFO:tasks.workunit.client.1.smithi149.stdout:5/993: symlink d4/d7/d40/d43/d5c/d7a/d81/dea/l147 0 2024-09-21T11:39:22.872 INFO:tasks.workunit.client.0.smithi118.stdout:3/268: truncate d5/d1d/f12 2970169 0 2024-09-21T11:39:22.874 INFO:tasks.workunit.client.0.smithi118.stdout:3/269: truncate d5/d1d/d1b/d24/f60 253903 0 2024-09-21T11:39:22.874 INFO:tasks.workunit.client.1.smithi149.stdout:8/802: mkdir d3/d33/d34/d72/dbb/dda/d111 0 2024-09-21T11:39:22.874 INFO:tasks.workunit.client.1.smithi149.stdout:4/939: creat d4/d6/d63/d15/d30/d6b/daa/f138 x:0 0 0 2024-09-21T11:39:22.874 INFO:tasks.workunit.client.1.smithi149.stdout:5/994: write d4/d7/dbd/f114 [184546,78260] 0 2024-09-21T11:39:22.874 INFO:tasks.workunit.client.1.smithi149.stdout:7/956: dwrite d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f64 [0,4194304] 0 2024-09-21T11:39:22.875 INFO:tasks.workunit.client.1.smithi149.stdout:1/850: creat d2/d5/d3d/d88/dee/f115 x:0 0 0 2024-09-21T11:39:22.876 INFO:tasks.workunit.client.0.smithi118.stdout:5/309: dread d0/f2e [0,4194304] 0 2024-09-21T11:39:22.877 INFO:tasks.workunit.client.0.smithi118.stdout:8/625: getdents d2/dc/d10/d2e/d18 0 2024-09-21T11:39:22.877 INFO:tasks.workunit.client.0.smithi118.stdout:6/273: dread - d8/f4b zero size 2024-09-21T11:39:22.879 INFO:tasks.workunit.client.1.smithi149.stdout:6/842: read d8/d32/d37/d28/f33 [2925079,67275] 0 2024-09-21T11:39:22.879 INFO:tasks.workunit.client.0.smithi118.stdout:5/310: write d0/db/d35/f4d [118564,49552] 0 2024-09-21T11:39:22.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/851: creat d2/d5/d65/d96/d105/d10d/f116 x:0 0 0 2024-09-21T11:39:22.886 INFO:tasks.workunit.client.1.smithi149.stdout:6/843: creat d8/d32/d37/d2b/d7d/f11f x:0 0 0 2024-09-21T11:39:22.886 INFO:tasks.workunit.client.1.smithi149.stdout:1/852: chown d2/d5/d3d/d88/f6d 27306 1 2024-09-21T11:39:22.887 INFO:tasks.workunit.client.1.smithi149.stdout:7/957: dwrite d12/d5b/db5/dc5/de9/fd4 [0,4194304] 0 2024-09-21T11:39:22.889 INFO:tasks.workunit.client.0.smithi118.stdout:6/274: unlink d8/d14/d33/f43 0 2024-09-21T11:39:22.891 INFO:tasks.workunit.client.0.smithi118.stdout:6/275: truncate d8/d14/d33/f3f 391910 0 2024-09-21T11:39:22.891 INFO:tasks.workunit.client.1.smithi149.stdout:7/958: write d12/d5b/db5/dc5/de9/d68/dc4/f10e [888831,122467] 0 2024-09-21T11:39:22.891 INFO:tasks.workunit.client.1.smithi149.stdout:4/940: creat d4/d6/d63/d15/f139 x:0 0 0 2024-09-21T11:39:22.892 INFO:tasks.workunit.client.0.smithi118.stdout:6/276: write d8/d14/d3a/f5a [858482,87337] 0 2024-09-21T11:39:22.894 INFO:tasks.workunit.client.0.smithi118.stdout:0/652: getdents d5/d10/d1e/d33/dd4 0 2024-09-21T11:39:22.895 INFO:tasks.workunit.client.1.smithi149.stdout:6/844: readlink d8/d32/lc0 0 2024-09-21T11:39:22.895 INFO:tasks.workunit.client.0.smithi118.stdout:2/226: dread de/f19 [0,4194304] 0 2024-09-21T11:39:22.899 INFO:tasks.workunit.client.1.smithi149.stdout:9/878: sync 2024-09-21T11:39:22.899 INFO:tasks.workunit.client.1.smithi149.stdout:0/859: sync 2024-09-21T11:39:22.900 INFO:tasks.workunit.client.0.smithi118.stdout:8/626: symlink d2/dc/ld5 0 2024-09-21T11:39:22.901 INFO:tasks.workunit.client.0.smithi118.stdout:4/253: dwrite d2/f21 [0,4194304] 0 2024-09-21T11:39:22.903 INFO:tasks.workunit.client.1.smithi149.stdout:7/959: dwrite d12/d5b/db5/dc5/de9/d68/dc4/d30/f5a [0,4194304] 0 2024-09-21T11:39:22.906 INFO:tasks.workunit.client.1.smithi149.stdout:7/960: readlink d12/d5b/db5/dc5/de9/d4a/d6c/da0/dbb/l11b 0 2024-09-21T11:39:22.908 INFO:tasks.workunit.client.0.smithi118.stdout:0/653: truncate d5/f7e 1472899 0 2024-09-21T11:39:22.909 INFO:tasks.workunit.client.1.smithi149.stdout:0/860: rmdir dd/d1a/d1b/d81 39 2024-09-21T11:39:22.910 INFO:tasks.workunit.client.1.smithi149.stdout:5/995: write d4/d7/d40/d43/d85/faa [1598186,102827] 0 2024-09-21T11:39:22.913 INFO:tasks.workunit.client.1.smithi149.stdout:5/996: chown d4/d1d/dde 160 1 2024-09-21T11:39:22.914 INFO:tasks.workunit.client.0.smithi118.stdout:9/361: dread d0/d4/f15 [0,4194304] 0 2024-09-21T11:39:22.914 INFO:tasks.workunit.client.1.smithi149.stdout:6/845: mkdir d8/da/d120 0 2024-09-21T11:39:22.915 INFO:tasks.workunit.client.0.smithi118.stdout:0/654: dwrite d5/d10/d1e/d20/fb1 [0,4194304] 0 2024-09-21T11:39:22.916 INFO:tasks.workunit.client.0.smithi118.stdout:2/227: unlink de/d16/l2f 0 2024-09-21T11:39:22.916 INFO:tasks.workunit.client.0.smithi118.stdout:0/655: dread - d5/d10/fb9 zero size 2024-09-21T11:39:22.918 INFO:tasks.workunit.client.1.smithi149.stdout:5/997: dread - d4/d7/d40/d43/d49/d88/de0/f123 zero size 2024-09-21T11:39:22.918 INFO:tasks.workunit.client.0.smithi118.stdout:3/270: link d5/c4d d5/d28/d33/c66 0 2024-09-21T11:39:22.921 INFO:tasks.workunit.client.1.smithi149.stdout:8/803: dwrite d3/d12/f15 [0,4194304] 0 2024-09-21T11:39:22.922 INFO:tasks.workunit.client.0.smithi118.stdout:8/627: mknod d2/d73/d79/cd6 0 2024-09-21T11:39:22.926 INFO:tasks.workunit.client.1.smithi149.stdout:7/961: dwrite d12/d5b/db5/dc5/de9/d4a/d6c/da0/df0/f11f [0,4194304] 0 2024-09-21T11:39:22.927 INFO:tasks.workunit.client.0.smithi118.stdout:5/311: rename d0/d6 to d0/d6c 0 2024-09-21T11:39:22.928 INFO:tasks.workunit.client.0.smithi118.stdout:6/277: write d8/d48/f2a [976984,77385] 0 2024-09-21T11:39:22.928 INFO:tasks.workunit.client.1.smithi149.stdout:6/846: rmdir d8/d32/d37/d28/dc8 39 2024-09-21T11:39:22.928 INFO:tasks.workunit.client.1.smithi149.stdout:4/941: write d4/d6/fb [795591,106627] 0 2024-09-21T11:39:22.928 INFO:tasks.workunit.client.0.smithi118.stdout:5/312: chown d0/f2e 201 1 2024-09-21T11:39:22.933 INFO:tasks.workunit.client.0.smithi118.stdout:0/656: creat d5/d34/fe4 x:0 0 0 2024-09-21T11:39:22.933 INFO:tasks.workunit.client.0.smithi118.stdout:0/657: chown d5/fd6 1 1 2024-09-21T11:39:22.935 INFO:tasks.workunit.client.0.smithi118.stdout:0/658: readlink d5/d34/d44/d87/d9a/ldf 0 2024-09-21T11:39:22.936 INFO:tasks.workunit.client.0.smithi118.stdout:0/659: chown d5/d10/ca2 7057865 1 2024-09-21T11:39:22.936 INFO:tasks.workunit.client.1.smithi149.stdout:4/942: creat d4/d6/d63/d2d/dd6/d32/f13a x:0 0 0 2024-09-21T11:39:22.937 INFO:tasks.workunit.client.1.smithi149.stdout:6/847: symlink d8/da/d2c/d52/l121 0 2024-09-21T11:39:22.941 INFO:tasks.workunit.client.1.smithi149.stdout:5/998: creat d4/d1d/d50/d54/d2a/d93/f148 x:0 0 0 2024-09-21T11:39:22.942 INFO:tasks.workunit.client.1.smithi149.stdout:1/853: dwrite d2/d5/fa7 [0,4194304] 0 2024-09-21T11:39:22.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/848: symlink d8/l122 0 2024-09-21T11:39:22.943 INFO:tasks.workunit.client.1.smithi149.stdout:5/999: chown d4/l26 64042 1 2024-09-21T11:39:22.943 INFO:tasks.workunit.client.0.smithi118.stdout:6/278: fdatasync d8/d14/d33/f3e 0 2024-09-21T11:39:22.944 INFO:tasks.workunit.client.0.smithi118.stdout:5/313: mknod d0/db/d35/d2c/d40/c6d 0 2024-09-21T11:39:22.944 INFO:tasks.workunit.client.0.smithi118.stdout:0/660: dwrite d5/d29/fcd [0,4194304] 0 2024-09-21T11:39:22.946 INFO:tasks.workunit.client.1.smithi149.stdout:6/849: stat d8/d32/d37/d28/d2f/c50 0 2024-09-21T11:39:22.946 INFO:tasks.workunit.client.1.smithi149.stdout:4/943: fdatasync d4/d6/d63/d15/d30/d6b/daa/fad 0 2024-09-21T11:39:22.947 INFO:tasks.workunit.client.0.smithi118.stdout:9/362: creat d0/d20/d71/f8d x:0 0 0 2024-09-21T11:39:22.948 INFO:tasks.workunit.client.0.smithi118.stdout:2/228: mknod de/d50/c52 0 2024-09-21T11:39:22.948 INFO:tasks.workunit.client.1.smithi149.stdout:6/850: truncate d8/da/d2c/d52/d5e/d9b/fa6 1862470 0 2024-09-21T11:39:22.949 INFO:tasks.workunit.client.1.smithi149.stdout:3/949: sync 2024-09-21T11:39:22.952 INFO:tasks.workunit.client.1.smithi149.stdout:1/854: creat d2/d5/d8/dc1/f117 x:0 0 0 2024-09-21T11:39:22.955 INFO:tasks.workunit.client.1.smithi149.stdout:4/944: creat d4/d6/d63/d78/d98/dee/d11e/f13b x:0 0 0 2024-09-21T11:39:22.958 INFO:tasks.workunit.client.1.smithi149.stdout:4/945: chown d4/d4d/d5f/d71/ddc 60640 1 2024-09-21T11:39:22.958 INFO:tasks.workunit.client.1.smithi149.stdout:1/855: read d2/dd/d35/d1c/d2c/f8b [2122571,9322] 0 2024-09-21T11:39:22.958 INFO:tasks.workunit.client.1.smithi149.stdout:6/851: unlink d8/da/d3d/f43 0 2024-09-21T11:39:22.958 INFO:tasks.workunit.client.1.smithi149.stdout:9/879: dwrite d18/d19/d1a/f26 [0,4194304] 0 2024-09-21T11:39:22.960 INFO:tasks.workunit.client.0.smithi118.stdout:5/314: unlink d0/l5e 0 2024-09-21T11:39:22.960 INFO:tasks.workunit.client.1.smithi149.stdout:3/950: rmdir d6/d5f/d60/d88 39 2024-09-21T11:39:22.963 INFO:tasks.workunit.client.1.smithi149.stdout:0/861: truncate f8 1215975 0 2024-09-21T11:39:22.963 INFO:tasks.workunit.client.1.smithi149.stdout:6/852: write d8/d32/d37/d28/d2e/f44 [4776031,66266] 0 2024-09-21T11:39:22.965 INFO:tasks.workunit.client.1.smithi149.stdout:7/962: dread d12/d5b/db5/dc5/de9/d4a/d6c/db1/fb2 [0,4194304] 0 2024-09-21T11:39:22.965 INFO:tasks.workunit.client.1.smithi149.stdout:0/862: write dd/d1a/d1b/f10b [915485,58874] 0 2024-09-21T11:39:22.966 INFO:tasks.workunit.client.1.smithi149.stdout:0/863: fdatasync dd/d32/db2/fd8 0 2024-09-21T11:39:22.967 INFO:tasks.workunit.client.1.smithi149.stdout:7/963: chown d12/d5b/db5/dc5/de9/l19 180141259 1 2024-09-21T11:39:22.968 INFO:tasks.workunit.client.1.smithi149.stdout:0/864: write dd/d1a/d5a/d106/f109 [325823,117569] 0 2024-09-21T11:39:22.968 INFO:tasks.workunit.client.0.smithi118.stdout:9/363: stat d0/d4/d38/f46 0 2024-09-21T11:39:22.968 INFO:tasks.workunit.client.0.smithi118.stdout:3/271: write d5/d1d/d1b/d24/f36 [4942118,37836] 0 2024-09-21T11:39:22.970 INFO:tasks.workunit.client.1.smithi149.stdout:1/856: creat d2/dd/d2e/d4c/f118 x:0 0 0 2024-09-21T11:39:22.970 INFO:tasks.workunit.client.0.smithi118.stdout:4/254: truncate d2/d6/dd/f33 344696 0 2024-09-21T11:39:22.971 INFO:tasks.workunit.client.1.smithi149.stdout:8/804: dread d3/d33/f64 [0,4194304] 0 2024-09-21T11:39:22.973 INFO:tasks.workunit.client.0.smithi118.stdout:8/628: symlink d2/dc/d10/d2e/d9b/dcc/ld7 0 2024-09-21T11:39:22.973 INFO:tasks.workunit.client.0.smithi118.stdout:2/229: dread de/d1f/d20/f27 [0,4194304] 0 2024-09-21T11:39:22.980 INFO:tasks.workunit.client.0.smithi118.stdout:0/661: link d5/d10/d1e/d20/f32 d5/d10/d1e/d3d/fe5 0 2024-09-21T11:39:22.991 INFO:tasks.workunit.client.1.smithi149.stdout:6/853: dwrite d8/d32/d37/d28/dc8/f103 [0,4194304] 0 2024-09-21T11:39:22.991 INFO:tasks.workunit.client.1.smithi149.stdout:7/964: write d12/d5b/db5/dc5/de9/d4a/d6c/d8c/daa/f107 [903377,97857] 0 2024-09-21T11:39:22.992 INFO:tasks.workunit.client.1.smithi149.stdout:4/946: dread d4/d4d/d5f/d71/fb0 [0,4194304] 0 2024-09-21T11:39:22.993 INFO:tasks.workunit.client.1.smithi149.stdout:9/880: dread d18/d19/d29/f68 [0,4194304] 0 2024-09-21T11:39:22.993 INFO:tasks.workunit.client.0.smithi118.stdout:2/230: dread de/f18 [0,4194304] 0 2024-09-21T11:39:22.994 INFO:tasks.workunit.client.1.smithi149.stdout:4/947: fsync d4/d6/d63/d10/d6f/f136 0 2024-09-21T11:39:22.994 INFO:tasks.workunit.client.1.smithi149.stdout:1/857: unlink d2/dd/d35/d1c/d41/d74/df6/d110/f113 0 2024-09-21T11:39:22.995 INFO:tasks.workunit.client.0.smithi118.stdout:8/629: dread d2/dc/d35/d42/fa1 [0,4194304] 0 2024-09-21T11:39:22.995 INFO:tasks.workunit.client.1.smithi149.stdout:9/881: readlink d18/d36/d3c/d47/d76/l8e 0 2024-09-21T11:39:22.995 INFO:tasks.workunit.client.1.smithi149.stdout:8/805: rmdir d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6 39 2024-09-21T11:39:22.997 INFO:tasks.workunit.client.0.smithi118.stdout:6/279: write d8/fa [6119405,34462] 0 2024-09-21T11:39:22.998 INFO:tasks.workunit.client.1.smithi149.stdout:1/858: write d2/dd/f12 [2794133,124605] 0 2024-09-21T11:39:22.998 INFO:tasks.workunit.client.0.smithi118.stdout:6/280: chown d8/d48/f2a 54457647 1 2024-09-21T11:39:23.000 INFO:tasks.workunit.client.1.smithi149.stdout:3/951: rename d6/d1f/d47/d37/d50/l75 to d6/d1f/d47/d37/dd6/d96/l149 0 2024-09-21T11:39:23.001 INFO:tasks.workunit.client.1.smithi149.stdout:0/865: mknod dd/d1a/d1b/d72/d78/dc4/d3a/c11a 0 2024-09-21T11:39:23.002 INFO:tasks.workunit.client.0.smithi118.stdout:9/364: mkdir d0/d4/d38/d4e/d86/d8e 0 2024-09-21T11:39:23.003 INFO:tasks.workunit.client.0.smithi118.stdout:9/365: chown d0 30 1 2024-09-21T11:39:23.004 INFO:tasks.workunit.client.0.smithi118.stdout:3/272: creat d5/d28/d3e/d5d/d5f/f67 x:0 0 0 2024-09-21T11:39:23.005 INFO:tasks.workunit.client.0.smithi118.stdout:0/662: dwrite d5/d10/d1e/d23/d3a/d90/fb0 [0,4194304] 0 2024-09-21T11:39:23.008 INFO:tasks.workunit.client.0.smithi118.stdout:0/663: write d5/d10/d1e/d23/fca [644870,14901] 0 2024-09-21T11:39:23.011 INFO:tasks.workunit.client.1.smithi149.stdout:4/948: mkdir d4/d6/d63/d2d/dd6/d13c 0 2024-09-21T11:39:23.013 INFO:tasks.workunit.client.1.smithi149.stdout:9/882: creat d18/d36/d3c/f116 x:0 0 0 2024-09-21T11:39:23.013 INFO:tasks.workunit.client.0.smithi118.stdout:3/273: dread d5/f30 [0,4194304] 0 2024-09-21T11:39:23.014 INFO:tasks.workunit.client.1.smithi149.stdout:9/883: dread - d18/d19/d1a/df1/df5/ffe zero size 2024-09-21T11:39:23.014 INFO:tasks.workunit.client.0.smithi118.stdout:9/366: dwrite d0/d4/d38/d4e/f80 [0,4194304] 0 2024-09-21T11:39:23.016 INFO:tasks.workunit.client.1.smithi149.stdout:8/806: creat d3/d33/d34/d55/d5e/d9e/f112 x:0 0 0 2024-09-21T11:39:23.017 INFO:tasks.workunit.client.1.smithi149.stdout:8/807: chown d3/d3c/c8b 609534907 1 2024-09-21T11:39:23.018 INFO:tasks.workunit.client.1.smithi149.stdout:3/952: symlink d6/d1f/d47/d37/d50/l14a 0 2024-09-21T11:39:23.022 INFO:tasks.workunit.client.1.smithi149.stdout:6/854: mkdir d8/da/d123 0 2024-09-21T11:39:23.022 INFO:tasks.workunit.client.1.smithi149.stdout:0/866: creat dd/d1a/d5a/d106/f11b x:0 0 0 2024-09-21T11:39:23.023 INFO:tasks.workunit.client.0.smithi118.stdout:4/255: rmdir d2/d6/de/d3e/d54 0 2024-09-21T11:39:23.024 INFO:tasks.workunit.client.1.smithi149.stdout:4/949: mkdir d4/d6/d13d 0 2024-09-21T11:39:23.025 INFO:tasks.workunit.client.0.smithi118.stdout:0/664: rename d5/d34/f82 to d5/d34/d44/d87/fe6 0 2024-09-21T11:39:23.025 INFO:tasks.workunit.client.1.smithi149.stdout:4/950: readlink d4/d6/d63/d78/d98/dcc/l10a 0 2024-09-21T11:39:23.026 INFO:tasks.workunit.client.1.smithi149.stdout:4/951: chown d4/d6/d63/d15/d16/d23/d62/f104 37197 1 2024-09-21T11:39:23.027 INFO:tasks.workunit.client.0.smithi118.stdout:2/231: mkdir de/d53 0 2024-09-21T11:39:23.029 INFO:tasks.workunit.client.0.smithi118.stdout:8/630: creat d2/dc/d10/d2e/d18/d83/fd8 x:0 0 0 2024-09-21T11:39:23.029 INFO:tasks.workunit.client.1.smithi149.stdout:8/808: mknod d3/d33/d34/d72/c113 0 2024-09-21T11:39:23.031 INFO:tasks.workunit.client.0.smithi118.stdout:3/274: creat d5/d28/d3e/d5d/d5f/f68 x:0 0 0 2024-09-21T11:39:23.031 INFO:tasks.workunit.client.0.smithi118.stdout:3/275: readlink d5/d1d/d1b/d4c/l5e 0 2024-09-21T11:39:23.032 INFO:tasks.workunit.client.1.smithi149.stdout:3/953: unlink d6/d1f/d47/d22/l30 0 2024-09-21T11:39:23.035 INFO:tasks.workunit.client.1.smithi149.stdout:7/965: creat d12/d5b/db5/f129 x:0 0 0 2024-09-21T11:39:23.035 INFO:tasks.workunit.client.1.smithi149.stdout:3/954: stat d6/d1f/d47/d37/d3f/dc5/f102 0 2024-09-21T11:39:23.035 INFO:tasks.workunit.client.0.smithi118.stdout:5/315: getdents d0/db/d35/d30/d1a 0 2024-09-21T11:39:23.036 INFO:tasks.workunit.client.0.smithi118.stdout:5/316: chown d0/db/d35/d2c/l54 19 1 2024-09-21T11:39:23.037 INFO:tasks.workunit.client.1.smithi149.stdout:8/809: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/ffd [0,4194304] 0 2024-09-21T11:39:23.037 INFO:tasks.workunit.client.0.smithi118.stdout:6/281: truncate d8/f11 1830506 0 2024-09-21T11:39:23.038 INFO:tasks.workunit.client.0.smithi118.stdout:6/282: chown d8/d48/c47 13 1 2024-09-21T11:39:23.040 INFO:tasks.workunit.client.0.smithi118.stdout:4/256: rmdir d2/d6/dd 39 2024-09-21T11:39:23.041 INFO:tasks.workunit.client.0.smithi118.stdout:4/257: dread - d2/d6/de/d1c/d23/d26/d31/f53 zero size 2024-09-21T11:39:23.045 INFO:tasks.workunit.client.0.smithi118.stdout:7/328: sync 2024-09-21T11:39:23.046 INFO:tasks.workunit.client.0.smithi118.stdout:0/665: fsync d5/d29/d68/d7b/db7/d48/fa5 0 2024-09-21T11:39:23.052 INFO:tasks.workunit.client.0.smithi118.stdout:9/367: write d0/d20/f64 [1188967,124772] 0 2024-09-21T11:39:23.053 INFO:tasks.workunit.client.0.smithi118.stdout:9/368: chown d0/d20/d4c/d5f/d6c/d88 364460 1 2024-09-21T11:39:23.056 INFO:tasks.workunit.client.0.smithi118.stdout:5/317: creat d0/db/d35/da/f6e x:0 0 0 2024-09-21T11:39:23.057 INFO:tasks.workunit.client.0.smithi118.stdout:6/283: chown d8/d48/c57 3734268 1 2024-09-21T11:39:23.059 INFO:tasks.workunit.client.0.smithi118.stdout:7/329: mkdir d0/d3/d14/d41/d66/d6d 0 2024-09-21T11:39:23.059 INFO:tasks.workunit.client.1.smithi149.stdout:0/867: dread dd/d32/db2/fd8 [0,4194304] 0 2024-09-21T11:39:23.060 INFO:tasks.workunit.client.0.smithi118.stdout:0/666: mkdir d5/d34/d44/d87/de7 0 2024-09-21T11:39:23.060 INFO:tasks.workunit.client.1.smithi149.stdout:6/855: dwrite d8/d32/d37/d28/f30 [0,4194304] 0 2024-09-21T11:39:23.060 INFO:tasks.workunit.client.1.smithi149.stdout:7/966: dread - d12/d5b/db5/dc5/de9/d4a/d4f/fec zero size 2024-09-21T11:39:23.061 INFO:tasks.workunit.client.1.smithi149.stdout:9/884: creat d18/d36/d3c/d47/d99/f117 x:0 0 0 2024-09-21T11:39:23.062 INFO:tasks.workunit.client.0.smithi118.stdout:2/232: mknod de/d1f/c54 0 2024-09-21T11:39:23.062 INFO:tasks.workunit.client.0.smithi118.stdout:3/276: mkdir d5/d1d/d1b/d50/d5c/d69 0 2024-09-21T11:39:23.062 INFO:tasks.workunit.client.1.smithi149.stdout:4/952: mkdir d4/d6/d63/d78/d98/dcc/ddb/d108/d13e 0 2024-09-21T11:39:23.063 INFO:tasks.workunit.client.0.smithi118.stdout:0/667: fdatasync d5/d29/d53/f63 0 2024-09-21T11:39:23.063 INFO:tasks.workunit.client.1.smithi149.stdout:1/859: truncate d2/d5/fc2 4661041 0 2024-09-21T11:39:23.063 INFO:tasks.workunit.client.0.smithi118.stdout:9/369: unlink d0/c19 0 2024-09-21T11:39:23.064 INFO:tasks.workunit.client.0.smithi118.stdout:4/258: creat d2/d6/de/d3e/d5e/f62 x:0 0 0 2024-09-21T11:39:23.065 INFO:tasks.workunit.client.1.smithi149.stdout:8/810: dwrite d3/f7d [0,4194304] 0 2024-09-21T11:39:23.067 INFO:tasks.workunit.client.0.smithi118.stdout:9/370: chown d0/f4a 2923 1 2024-09-21T11:39:23.070 INFO:tasks.workunit.client.0.smithi118.stdout:8/631: dwrite d2/dc/d10/d3b/f6d [0,4194304] 0 2024-09-21T11:39:23.070 INFO:tasks.workunit.client.0.smithi118.stdout:7/330: write d0/d3/f18 [242759,23902] 0 2024-09-21T11:39:23.071 INFO:tasks.workunit.client.0.smithi118.stdout:5/318: dwrite d0/db/d26/d65/f69 [0,4194304] 0 2024-09-21T11:39:23.071 INFO:tasks.workunit.client.0.smithi118.stdout:6/284: fsync d8/f25 0 2024-09-21T11:39:23.073 INFO:tasks.workunit.client.0.smithi118.stdout:3/277: fsync d5/d1d/d1b/d50/f59 0 2024-09-21T11:39:23.073 INFO:tasks.workunit.client.1.smithi149.stdout:0/868: truncate dd/d32/fb7 569265 0 2024-09-21T11:39:23.077 INFO:tasks.workunit.client.0.smithi118.stdout:2/233: unlink de/d16/d1c/f46 0 2024-09-21T11:39:23.077 INFO:tasks.workunit.client.0.smithi118.stdout:4/259: unlink d2/d6/de/d1c/d4d/l61 0 2024-09-21T11:39:23.078 INFO:tasks.workunit.client.1.smithi149.stdout:1/860: unlink d2/d5/f6c 0 2024-09-21T11:39:23.078 INFO:tasks.workunit.client.0.smithi118.stdout:2/234: chown de/d16/d1c/l4d 624993 1 2024-09-21T11:39:23.079 INFO:tasks.workunit.client.0.smithi118.stdout:2/235: readlink de/d1f/l44 0 2024-09-21T11:39:23.084 INFO:tasks.workunit.client.0.smithi118.stdout:3/278: symlink d5/d28/d33/d4a/l6a 0 2024-09-21T11:39:23.086 INFO:tasks.workunit.client.1.smithi149.stdout:8/811: unlink d3/d33/d34/d55/d5e/d9e/dc2/d3a/c5d 0 2024-09-21T11:39:23.088 INFO:tasks.workunit.client.0.smithi118.stdout:8/632: rename d2/dc/d35/d42/la0 to d2/d7c/d88/d8f/ld9 0 2024-09-21T11:39:23.089 INFO:tasks.workunit.client.0.smithi118.stdout:8/633: chown d2/dc/d35/d42 422106 1 2024-09-21T11:39:23.089 INFO:tasks.workunit.client.0.smithi118.stdout:7/331: symlink d0/d3/l6e 0 2024-09-21T11:39:23.090 INFO:tasks.workunit.client.0.smithi118.stdout:4/260: write d2/d6/f20 [4991712,5323] 0 2024-09-21T11:39:23.091 INFO:tasks.workunit.client.1.smithi149.stdout:0/869: write dd/d1a/d1b/d72/d78/dc4/f5c [5228001,45375] 0 2024-09-21T11:39:23.091 INFO:tasks.workunit.client.0.smithi118.stdout:2/236: fdatasync de/d1f/d20/f2d 0 2024-09-21T11:39:23.091 INFO:tasks.workunit.client.0.smithi118.stdout:7/332: stat d0/c1f 0 2024-09-21T11:39:23.091 INFO:tasks.workunit.client.0.smithi118.stdout:9/371: symlink d0/d20/d4c/d5f/d66/l8f 0 2024-09-21T11:39:23.092 INFO:tasks.workunit.client.0.smithi118.stdout:6/285: dread d8/d14/d3a/f50 [0,4194304] 0 2024-09-21T11:39:23.094 INFO:tasks.workunit.client.0.smithi118.stdout:3/279: rename d5/d28/d3e/l46 to d5/d28/d33/d4a/l6b 0 2024-09-21T11:39:23.096 INFO:tasks.workunit.client.0.smithi118.stdout:7/333: dread - d0/d3/d29/f6b zero size 2024-09-21T11:39:23.097 INFO:tasks.workunit.client.1.smithi149.stdout:7/967: dwrite d12/d5b/db5/dc5/de9/d68/dc4/d30/f5a [0,4194304] 0 2024-09-21T11:39:23.097 INFO:tasks.workunit.client.1.smithi149.stdout:6/856: dwrite d8/da/d2c/d52/d5e/d9b/fe2 [0,4194304] 0 2024-09-21T11:39:23.097 INFO:tasks.workunit.client.1.smithi149.stdout:9/885: dread d18/d19/d29/d39/d63/f6c [0,4194304] 0 2024-09-21T11:39:23.100 INFO:tasks.workunit.client.0.smithi118.stdout:2/237: creat de/d1f/d20/f55 x:0 0 0 2024-09-21T11:39:23.100 INFO:tasks.workunit.client.0.smithi118.stdout:2/238: fdatasync de/d1f/d20/f55 0 2024-09-21T11:39:23.101 INFO:tasks.workunit.client.1.smithi149.stdout:4/953: dwrite d4/d6/d63/d92/fd0 [0,4194304] 0 2024-09-21T11:39:23.101 INFO:tasks.workunit.client.1.smithi149.stdout:6/857: chown d8/d32/d64/d97/fb2 58517 1 2024-09-21T11:39:23.102 INFO:tasks.workunit.client.1.smithi149.stdout:9/886: chown d18/d19/d1a/d2f/d7d/la9 28 1 2024-09-21T11:39:23.102 INFO:tasks.workunit.client.0.smithi118.stdout:6/286: symlink d8/d48/l5b 0 2024-09-21T11:39:23.103 INFO:tasks.workunit.client.0.smithi118.stdout:6/287: fsync d8/d14/f24 0 2024-09-21T11:39:23.105 INFO:tasks.workunit.client.1.smithi149.stdout:6/858: write d8/d32/d37/d2b/f99 [240608,2405] 0 2024-09-21T11:39:23.107 INFO:tasks.workunit.client.1.smithi149.stdout:6/859: chown d8/da/d3d/la2 14 1 2024-09-21T11:39:23.107 INFO:tasks.workunit.client.0.smithi118.stdout:6/288: read d8/fc [4085269,16702] 0 2024-09-21T11:39:23.108 INFO:tasks.workunit.client.1.smithi149.stdout:6/860: chown d8/da/d2c/d52/d5e/f67 3 1 2024-09-21T11:39:23.108 INFO:tasks.workunit.client.1.smithi149.stdout:0/870: unlink dd/d32/d105/la8 0 2024-09-21T11:39:23.108 INFO:tasks.workunit.client.0.smithi118.stdout:3/280: creat d5/d1d/d1b/d24/f6c x:0 0 0 2024-09-21T11:39:23.111 INFO:tasks.workunit.client.1.smithi149.stdout:0/871: chown dd/db3/dfb 0 1 2024-09-21T11:39:23.111 INFO:tasks.workunit.client.0.smithi118.stdout:8/634: rename d2/dc/d35/d42/c82 to d2/d7c/d88/d8f/daa/cda 0 2024-09-21T11:39:23.113 INFO:tasks.workunit.client.1.smithi149.stdout:4/954: creat d4/d6/d63/d78/d98/dee/f13f x:0 0 0 2024-09-21T11:39:23.115 INFO:tasks.workunit.client.1.smithi149.stdout:4/955: write d4/d6/d63/d15/d16/d23/f102 [2413087,16059] 0 2024-09-21T11:39:23.115 INFO:tasks.workunit.client.0.smithi118.stdout:7/334: fdatasync d0/f2a 0 2024-09-21T11:39:23.116 INFO:tasks.workunit.client.1.smithi149.stdout:0/872: read dd/d1a/d1b/f31 [6471706,77192] 0 2024-09-21T11:39:23.119 INFO:tasks.workunit.client.0.smithi118.stdout:0/668: dread d5/d34/d44/f52 [0,4194304] 0 2024-09-21T11:39:23.121 INFO:tasks.workunit.client.0.smithi118.stdout:0/669: write d5/d10/d1e/d20/f8e [4089790,90755] 0 2024-09-21T11:39:23.121 INFO:tasks.workunit.client.1.smithi149.stdout:8/812: rename d3/d33/d34/d55/d5e/d9e/dc2/d18/l2f to d3/d33/d34/d72/dbb/l114 0 2024-09-21T11:39:23.130 INFO:tasks.workunit.client.0.smithi118.stdout:3/281: creat d5/d28/d3e/d5d/d5f/f6d x:0 0 0 2024-09-21T11:39:23.133 INFO:tasks.workunit.client.1.smithi149.stdout:1/861: link d2/dd/d35/d1c/l9c d2/d5/d8/dc1/l119 0 2024-09-21T11:39:23.136 INFO:tasks.workunit.client.1.smithi149.stdout:8/813: mkdir d3/d3c/d8f/d115 0 2024-09-21T11:39:23.136 INFO:tasks.workunit.client.0.smithi118.stdout:2/239: symlink de/d51/l56 0 2024-09-21T11:39:23.141 INFO:tasks.workunit.client.0.smithi118.stdout:9/372: dread d0/d20/d4c/d5f/f7f [0,4194304] 0 2024-09-21T11:39:23.141 INFO:tasks.workunit.client.0.smithi118.stdout:9/373: fsync d0/f1 0 2024-09-21T11:39:23.142 INFO:tasks.workunit.client.0.smithi118.stdout:0/670: creat d5/d34/d44/d7c/fe8 x:0 0 0 2024-09-21T11:39:23.143 INFO:tasks.workunit.client.0.smithi118.stdout:0/671: truncate d5/d29/fb2 36556 0 2024-09-21T11:39:23.143 INFO:tasks.workunit.client.1.smithi149.stdout:4/956: unlink d4/d4d/d58/fc7 0 2024-09-21T11:39:23.144 INFO:tasks.workunit.client.0.smithi118.stdout:0/672: chown d5/d10/c67 4 1 2024-09-21T11:39:23.144 INFO:tasks.workunit.client.1.smithi149.stdout:4/957: write d4/d4d/d58/f10e [140292,130285] 0 2024-09-21T11:39:23.145 INFO:tasks.workunit.client.1.smithi149.stdout:4/958: chown d4/d6/d63/f28 2384710 1 2024-09-21T11:39:23.145 INFO:tasks.workunit.client.0.smithi118.stdout:4/261: link d2/d6/de/f16 d2/d6/de/d3e/f63 0 2024-09-21T11:39:23.146 INFO:tasks.workunit.client.1.smithi149.stdout:4/959: write d4/d6/fb [441146,11639] 0 2024-09-21T11:39:23.147 INFO:tasks.workunit.client.1.smithi149.stdout:1/862: chown d2/d5/d65/d96/d105/d10d/c112 105 1 2024-09-21T11:39:23.148 INFO:tasks.workunit.client.1.smithi149.stdout:8/814: rmdir d3/d33/d34/d72/dbb/dda 39 2024-09-21T11:39:23.150 INFO:tasks.workunit.client.0.smithi118.stdout:3/282: creat d5/d1d/d1b/d4c/f6e x:0 0 0 2024-09-21T11:39:23.156 INFO:tasks.workunit.client.0.smithi118.stdout:7/335: link d0/d3/fd d0/d3/d14/d41/f6f 0 2024-09-21T11:39:23.157 INFO:tasks.workunit.client.0.smithi118.stdout:2/240: symlink de/d16/l57 0 2024-09-21T11:39:23.160 INFO:tasks.workunit.client.1.smithi149.stdout:1/863: chown d2/d5/d65/l89 8 1 2024-09-21T11:39:23.161 INFO:tasks.workunit.client.1.smithi149.stdout:1/864: truncate d2/dd/d2e/d4c/ff0 2285060 0 2024-09-21T11:39:23.162 INFO:tasks.workunit.client.1.smithi149.stdout:4/960: truncate d4/d6/f88 35785 0 2024-09-21T11:39:23.164 INFO:tasks.workunit.client.0.smithi118.stdout:8/635: write d2/dc/d10/d6a/f89 [519977,89921] 0 2024-09-21T11:39:23.166 INFO:tasks.workunit.client.0.smithi118.stdout:4/262: chown d2/d6/dd/l30 1399539236 1 2024-09-21T11:39:23.166 INFO:tasks.workunit.client.0.smithi118.stdout:9/374: dwrite d0/f2c [0,4194304] 0 2024-09-21T11:39:23.167 INFO:tasks.workunit.client.1.smithi149.stdout:1/865: dread d2/dd/d2e/d4c/ff0 [0,4194304] 0 2024-09-21T11:39:23.167 INFO:tasks.workunit.client.0.smithi118.stdout:0/673: dread d5/d10/f51 [0,4194304] 0 2024-09-21T11:39:23.168 INFO:tasks.workunit.client.0.smithi118.stdout:4/263: chown d2/f13 3738 1 2024-09-21T11:39:23.168 INFO:tasks.workunit.client.1.smithi149.stdout:6/861: getdents d8/da/d2c/d52/d5e 0 2024-09-21T11:39:23.168 INFO:tasks.workunit.client.0.smithi118.stdout:6/289: creat d8/f5c x:0 0 0 2024-09-21T11:39:23.168 INFO:tasks.workunit.client.0.smithi118.stdout:1/354: sync 2024-09-21T11:39:23.171 INFO:tasks.workunit.client.0.smithi118.stdout:1/355: fsync d6/de/d13/f1c 0 2024-09-21T11:39:23.171 INFO:tasks.workunit.client.1.smithi149.stdout:9/887: truncate d18/d19/d1a/f2d 1100381 0 2024-09-21T11:39:23.171 INFO:tasks.workunit.client.1.smithi149.stdout:0/873: getdents dd/db3 0 2024-09-21T11:39:23.174 INFO:tasks.workunit.client.0.smithi118.stdout:1/356: write d6/de/d13/f41 [325802,90350] 0 2024-09-21T11:39:23.176 INFO:tasks.workunit.client.1.smithi149.stdout:3/955: sync 2024-09-21T11:39:23.177 INFO:tasks.workunit.client.1.smithi149.stdout:3/956: fsync d6/d1f/d47/d37/d3a/f9e 0 2024-09-21T11:39:23.178 INFO:tasks.workunit.client.1.smithi149.stdout:3/957: chown d6/d1f/f54 6971211 1 2024-09-21T11:39:23.178 INFO:tasks.workunit.client.0.smithi118.stdout:2/241: creat de/d16/f58 x:0 0 0 2024-09-21T11:39:23.180 INFO:tasks.workunit.client.0.smithi118.stdout:4/264: dwrite f1 [0,4194304] 0 2024-09-21T11:39:23.180 INFO:tasks.workunit.client.1.smithi149.stdout:4/961: creat d4/d6/d63/d78/d98/dcc/ddb/f140 x:0 0 0 2024-09-21T11:39:23.182 INFO:tasks.workunit.client.0.smithi118.stdout:9/375: dwrite d0/f3a [0,4194304] 0 2024-09-21T11:39:23.186 INFO:tasks.workunit.client.0.smithi118.stdout:8/636: rename d2/dc/d10/l24 to d2/d73/ldb 0 2024-09-21T11:39:23.186 INFO:tasks.workunit.client.1.smithi149.stdout:4/962: dwrite d4/d6/d63/d10/f86 [0,4194304] 0 2024-09-21T11:39:23.188 INFO:tasks.workunit.client.0.smithi118.stdout:9/376: stat d0/d20/d4c/d5f/f7b 0 2024-09-21T11:39:23.190 INFO:tasks.workunit.client.1.smithi149.stdout:1/866: read d2/d107/f109 [3506976,76661] 0 2024-09-21T11:39:23.191 INFO:tasks.workunit.client.0.smithi118.stdout:9/377: chown d0/d4/f8 1829332 1 2024-09-21T11:39:23.191 INFO:tasks.workunit.client.0.smithi118.stdout:4/265: truncate d2/d6/de/d1c/f4a 713688 0 2024-09-21T11:39:23.193 INFO:tasks.workunit.client.0.smithi118.stdout:6/290: dread d8/d14/d33/f3e [0,4194304] 0 2024-09-21T11:39:23.197 INFO:tasks.workunit.client.1.smithi149.stdout:9/888: creat d18/d19/d1a/d2f/d7d/de0/f118 x:0 0 0 2024-09-21T11:39:23.198 INFO:tasks.workunit.client.0.smithi118.stdout:2/242: dwrite de/d16/d25/f3b [4194304,4194304] 0 2024-09-21T11:39:23.199 INFO:tasks.workunit.client.0.smithi118.stdout:2/243: dread - de/d16/f58 zero size 2024-09-21T11:39:23.201 INFO:tasks.workunit.client.1.smithi149.stdout:7/968: sync 2024-09-21T11:39:23.202 INFO:tasks.workunit.client.0.smithi118.stdout:7/336: dwrite d0/d3/d14/d41/f6f [0,4194304] 0 2024-09-21T11:39:23.206 INFO:tasks.workunit.client.0.smithi118.stdout:8/637: symlink d2/dc/d10/d2e/d18/d83/ldc 0 2024-09-21T11:39:23.206 INFO:tasks.workunit.client.1.smithi149.stdout:8/815: creat d3/d33/d34/d55/d5e/d9e/dc2/d21/f116 x:0 0 0 2024-09-21T11:39:23.206 INFO:tasks.workunit.client.0.smithi118.stdout:2/244: dread de/f18 [0,4194304] 0 2024-09-21T11:39:23.212 INFO:tasks.workunit.client.0.smithi118.stdout:9/378: creat d0/d20/d4c/d5f/d6c/d88/d4d/f90 x:0 0 0 2024-09-21T11:39:23.212 INFO:tasks.workunit.client.0.smithi118.stdout:7/337: dwrite d0/d3/d14/f32 [0,4194304] 0 2024-09-21T11:39:23.214 INFO:tasks.workunit.client.1.smithi149.stdout:6/862: getdents d8/d32/d37/d28/d2f/d6a/d111 0 2024-09-21T11:39:23.214 INFO:tasks.workunit.client.0.smithi118.stdout:9/379: fsync d0/d20/f64 0 2024-09-21T11:39:23.214 INFO:tasks.workunit.client.0.smithi118.stdout:7/338: stat d0/d3/d13/d3d/d3e/c6a 0 2024-09-21T11:39:23.215 INFO:tasks.workunit.client.1.smithi149.stdout:6/863: chown d8/da/d2c/d52/d5e/d9b/fe2 799 1 2024-09-21T11:39:23.216 INFO:tasks.workunit.client.1.smithi149.stdout:4/963: dread d4/d6/d63/fc5 [0,4194304] 0 2024-09-21T11:39:23.217 INFO:tasks.workunit.client.0.smithi118.stdout:9/380: truncate d0/d20/d4c/f85 264916 0 2024-09-21T11:39:23.217 INFO:tasks.workunit.client.0.smithi118.stdout:7/339: dread - d0/d3/f63 zero size 2024-09-21T11:39:23.217 INFO:tasks.workunit.client.1.smithi149.stdout:1/867: creat d2/dd/d35/d1c/d7a/d10e/dc0/dc3/f11a x:0 0 0 2024-09-21T11:39:23.218 INFO:tasks.workunit.client.1.smithi149.stdout:1/868: readlink d2/dd/d2e/d4c/l8f 0 2024-09-21T11:39:23.222 INFO:tasks.workunit.client.0.smithi118.stdout:4/266: rename d2/d6/de/d1c/d23/d26/d31/l3d to d2/d44/l64 0 2024-09-21T11:39:23.224 INFO:tasks.workunit.client.0.smithi118.stdout:1/357: symlink d6/de/l6a 0 2024-09-21T11:39:23.225 INFO:tasks.workunit.client.0.smithi118.stdout:3/283: getdents d5/d1d/d1b/d24 0 2024-09-21T11:39:23.225 INFO:tasks.workunit.client.1.smithi149.stdout:9/889: dread d18/d36/f7f [0,4194304] 0 2024-09-21T11:39:23.226 INFO:tasks.workunit.client.0.smithi118.stdout:3/284: dread - d5/d1d/f43 zero size 2024-09-21T11:39:23.227 INFO:tasks.workunit.client.1.smithi149.stdout:7/969: mkdir d12/d5b/db5/dc5/de9/d4a/d104/d12a 0 2024-09-21T11:39:23.227 INFO:tasks.workunit.client.0.smithi118.stdout:8/638: creat d2/dc/d10/d6a/fdd x:0 0 0 2024-09-21T11:39:23.228 INFO:tasks.workunit.client.1.smithi149.stdout:0/874: dwrite dd/f8e [0,4194304] 0 2024-09-21T11:39:23.229 INFO:tasks.workunit.client.0.smithi118.stdout:2/245: mknod de/d51/c59 0 2024-09-21T11:39:23.230 INFO:tasks.workunit.client.1.smithi149.stdout:7/970: chown d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/d47/d49/l110 3622 1 2024-09-21T11:39:23.230 INFO:tasks.workunit.client.1.smithi149.stdout:0/875: dread - dd/d32/db2/fe0 zero size 2024-09-21T11:39:23.232 INFO:tasks.workunit.client.0.smithi118.stdout:7/340: mkdir d0/d3/d1d/d35/d70 0 2024-09-21T11:39:23.233 INFO:tasks.workunit.client.0.smithi118.stdout:4/267: mkdir d2/d65 0 2024-09-21T11:39:23.234 INFO:tasks.workunit.client.1.smithi149.stdout:4/964: mknod d4/d6/d63/d2d/c141 0 2024-09-21T11:39:23.236 INFO:tasks.workunit.client.0.smithi118.stdout:1/358: rename d6/l59 to d6/de/d16/d3f/l6b 0 2024-09-21T11:39:23.240 INFO:tasks.workunit.client.1.smithi149.stdout:1/869: rename d2/dd/d35/d1c/d41/d74/df6 to d2/d5/d65/d11b 0 2024-09-21T11:39:23.241 INFO:tasks.workunit.client.1.smithi149.stdout:1/870: fsync d2/dd/d2e/d4c/f5c 0 2024-09-21T11:39:23.242 INFO:tasks.workunit.client.0.smithi118.stdout:2/246: creat de/d50/f5a x:0 0 0 2024-09-21T11:39:23.243 INFO:tasks.workunit.client.1.smithi149.stdout:4/965: write d4/d6/d63/d10/f86 [5067556,91527] 0 2024-09-21T11:39:23.245 INFO:tasks.workunit.client.0.smithi118.stdout:0/674: getdents d5/d10/d1e/d3d 0 2024-09-21T11:39:23.250 INFO:tasks.workunit.client.0.smithi118.stdout:6/291: dwrite d8/d14/d3a/f50 [0,4194304] 0 2024-09-21T11:39:23.251 INFO:tasks.workunit.client.1.smithi149.stdout:8/816: chown d3/d12/d98/fa7 72677 1 2024-09-21T11:39:23.253 INFO:tasks.workunit.client.0.smithi118.stdout:4/268: read d2/d6/de/d1c/d23/f2c [19512,80168] 0 2024-09-21T11:39:23.254 INFO:tasks.workunit.client.0.smithi118.stdout:1/359: rmdir d6/d2a/d5c 39 2024-09-21T11:39:23.256 INFO:tasks.workunit.client.1.smithi149.stdout:7/971: write d12/d5b/db5/dc5/de9/d4a/d6c/db1/de1/f127 [3924992,8057] 0 2024-09-21T11:39:23.257 INFO:tasks.workunit.client.1.smithi149.stdout:7/972: chown d12/d5b/db5/dc5/de9/d4a/d9e/f73 39771203 1 2024-09-21T11:39:23.262 INFO:tasks.workunit.client.0.smithi118.stdout:4/269: dwrite d2/d6/de/f5c [0,4194304] 0 2024-09-21T11:39:23.264 INFO:tasks.workunit.client.0.smithi118.stdout:4/270: fdatasync d2/d6/de/d1c/d23/d26/d31/f53 0 2024-09-21T11:39:23.275 INFO:tasks.workunit.client.1.smithi149.stdout:3/958: getdents d6/d1f/d47/d37/d50 0 2024-09-21T11:39:23.276 INFO:tasks.workunit.client.0.smithi118.stdout:3/285: link d5/l3f d5/d1d/d1b/l6f 0 2024-09-21T11:39:23.282 INFO:tasks.workunit.client.0.smithi118.stdout:0/675: unlink d5/f5c 0 2024-09-21T11:39:23.284 INFO:tasks.workunit.client.1.smithi149.stdout:4/966: symlink d4/d6/d63/d78/d98/dcc/ddb/df7/l142 0 2024-09-21T11:39:23.284 INFO:tasks.workunit.client.1.smithi149.stdout:6/864: write d8/da/d2c/d2d/d60/f6f [470195,112489] 0 2024-09-21T11:39:23.285 INFO:tasks.workunit.client.0.smithi118.stdout:1/360: mknod d6/d2a/c6c 0 2024-09-21T11:39:23.285 INFO:tasks.workunit.client.1.smithi149.stdout:4/967: fdatasync d4/d6/d63/d78/d98/dee/ff5 0 2024-09-21T11:39:23.285 INFO:tasks.workunit.client.0.smithi118.stdout:1/361: chown d6/de/d16/f29 9437406 1 2024-09-21T11:39:23.286 INFO:tasks.workunit.client.1.smithi149.stdout:6/865: truncate d8/d32/d37/d2b/f99 1065987 0 2024-09-21T11:39:23.345 INFO:tasks.workunit.client.1.smithi149.stdout:9/890: sync 2024-09-21T11:39:23.376 INFO:tasks.workunit.client.1.smithi149.stdout:4/968: sync 2024-09-21T11:39:23.377 INFO:tasks.workunit.client.1.smithi149.stdout:4/969: rename d4/d6 to d4/d6/d63/d10/d143 22 2024-09-21T11:39:23.472 INFO:tasks.workunit.client.0.smithi118.stdout:8/639: truncate d2/dc/d10/d2e/d18/d1a/f1e 2266684 0 2024-09-21T11:39:23.474 INFO:tasks.workunit.client.0.smithi118.stdout:7/341: truncate d0/f5 35406 0 2024-09-21T11:39:23.474 INFO:tasks.workunit.client.0.smithi118.stdout:3/286: write d5/d1d/d1b/d24/f5b [5547201,123972] 0 2024-09-21T11:39:23.476 INFO:tasks.workunit.client.1.smithi149.stdout:0/876: unlink dd/d1a/d1b/d50/fcd 0 2024-09-21T11:39:23.476 INFO:tasks.workunit.client.0.smithi118.stdout:6/292: write d8/fc [2553509,23853] 0 2024-09-21T11:39:23.478 INFO:tasks.workunit.client.1.smithi149.stdout:7/973: mkdir d12/d5b/db5/dc5/de9/d4a/d6c/da0/dee/d12b 0 2024-09-21T11:39:23.483 INFO:tasks.workunit.client.0.smithi118.stdout:2/247: dwrite de/f17 [0,4194304] 0 2024-09-21T11:39:23.484 INFO:tasks.workunit.client.0.smithi118.stdout:2/248: write de/d50/f5a [72001,97416] 0 2024-09-21T11:39:23.485 INFO:tasks.workunit.client.0.smithi118.stdout:1/362: mknod d6/d2a/d53/c6d 0 2024-09-21T11:39:23.496 INFO:tasks.workunit.client.1.smithi149.stdout:9/891: dread d18/d19/d1a/f2d [0,4194304] 0 2024-09-21T11:39:23.499 INFO:tasks.workunit.client.1.smithi149.stdout:8/817: creat d3/d33/d34/d55/d5e/d9e/dc2/d3a/f117 x:0 0 0 2024-09-21T11:39:23.500 INFO:tasks.workunit.client.1.smithi149.stdout:3/959: truncate d6/f13 1116087 0 2024-09-21T11:39:23.502 INFO:tasks.workunit.client.1.smithi149.stdout:0/877: unlink dd/d32/dbe/c112 0 2024-09-21T11:39:23.503 INFO:tasks.workunit.client.1.smithi149.stdout:0/878: read - dd/d32/db2/fe0 zero size 2024-09-21T11:39:23.505 INFO:tasks.workunit.client.1.smithi149.stdout:1/871: link d2/d5/db3/dd9/lf1 d2/d5/d65/d11b/l11c 0 2024-09-21T11:39:23.507 INFO:tasks.workunit.client.1.smithi149.stdout:6/866: creat d8/d32/d37/d2b/d7e/df2/f124 x:0 0 0 2024-09-21T11:39:23.508 INFO:tasks.workunit.client.1.smithi149.stdout:7/974: dwrite ff [0,4194304] 0 2024-09-21T11:39:23.512 INFO:tasks.workunit.client.1.smithi149.stdout:7/975: truncate d12/d5b/db5/dc5/de9/ffb 1793825 0 2024-09-21T11:39:23.513 INFO:tasks.workunit.client.1.smithi149.stdout:1/872: chown d2/l95 20 1 2024-09-21T11:39:23.513 INFO:tasks.workunit.client.1.smithi149.stdout:4/970: dwrite d4/f80 [4194304,4194304] 0 2024-09-21T11:39:23.514 INFO:tasks.workunit.client.1.smithi149.stdout:9/892: creat d18/d19/d29/d39/dfb/f119 x:0 0 0 2024-09-21T11:39:23.515 INFO:tasks.workunit.client.1.smithi149.stdout:1/873: chown d2/dd/d35/d1c/d41/d51/d90/lfa 5 1 2024-09-21T11:39:23.518 INFO:tasks.workunit.client.0.smithi118.stdout:8/640: symlink d2/dc/d10/d3b/lde 0 2024-09-21T11:39:23.519 INFO:tasks.workunit.client.0.smithi118.stdout:8/641: readlink d2/dc/d10/d2e/d18/l5e 0 2024-09-21T11:39:23.520 INFO:tasks.workunit.client.0.smithi118.stdout:6/293: mknod d8/d46/c5d 0 2024-09-21T11:39:23.521 INFO:tasks.workunit.client.1.smithi149.stdout:7/976: rmdir d12/d5b/db5/dc5/de9/d68 39 2024-09-21T11:39:23.523 INFO:tasks.workunit.client.0.smithi118.stdout:0/676: link d5/f7 d5/d10/d1e/d21/db3/dbe/fe9 0 2024-09-21T11:39:23.523 INFO:tasks.workunit.client.1.smithi149.stdout:7/977: write d12/d5b/db5/dc5/fc9 [344757,67629] 0 2024-09-21T11:39:23.526 INFO:tasks.workunit.client.0.smithi118.stdout:4/271: rename d2/d6/de/d1c/d23/d26/d31/l37 to d2/d6/l66 0 2024-09-21T11:39:23.526 INFO:tasks.workunit.client.0.smithi118.stdout:3/287: rename d5 to d5/d28/d70 22 2024-09-21T11:39:23.527 INFO:tasks.workunit.client.1.smithi149.stdout:1/874: dwrite d2/dd/d35/d1c/d41/d51/ffd [0,4194304] 0 2024-09-21T11:39:23.527 INFO:tasks.workunit.client.0.smithi118.stdout:3/288: dread - d5/d1d/d1b/d4c/f6e zero size 2024-09-21T11:39:23.529 INFO:tasks.workunit.client.0.smithi118.stdout:1/363: creat d6/d33/f6e x:0 0 0 2024-09-21T11:39:23.529 INFO:tasks.workunit.client.0.smithi118.stdout:3/289: dread - d5/d1d/d1b/d24/f61 zero size 2024-09-21T11:39:23.530 INFO:tasks.workunit.client.1.smithi149.stdout:6/867: symlink d8/da/d2c/d52/d5e/d9b/d112/l125 0 2024-09-21T11:39:23.531 INFO:tasks.workunit.client.1.smithi149.stdout:6/868: chown d8/da/d2c/d102/d117/d10b/d11a/f4c 44853 1 2024-09-21T11:39:23.532 INFO:tasks.workunit.client.0.smithi118.stdout:3/290: chown d5/d28/d33/c48 19 1 2024-09-21T11:39:23.533 INFO:tasks.workunit.client.0.smithi118.stdout:4/272: dread d2/f13 [0,4194304] 0 2024-09-21T11:39:23.534 INFO:tasks.workunit.client.0.smithi118.stdout:3/291: write f2 [12522844,99877] 0 2024-09-21T11:39:23.534 INFO:tasks.workunit.client.1.smithi149.stdout:9/893: mknod d18/d19/d1a/d2f/d30/d90/dcc/c11a 0 2024-09-21T11:39:23.536 INFO:tasks.workunit.client.0.smithi118.stdout:4/273: chown d2/d6/f18 1254076 1 2024-09-21T11:39:23.536 INFO:tasks.workunit.client.1.smithi149.stdout:9/894: write d18/d36/d3c/d47/d99/dbe/fea [642567,108155] 0 2024-09-21T11:39:23.538 INFO:tasks.workunit.client.0.smithi118.stdout:1/364: dwrite f0 [0,4194304] 0 2024-09-21T11:39:23.540 INFO:tasks.workunit.client.1.smithi149.stdout:0/879: creat dd/d1a/d1b/d72/d78/f11c x:0 0 0 2024-09-21T11:39:23.541 INFO:tasks.workunit.client.0.smithi118.stdout:1/365: write d6/d33/f6e [397094,45329] 0 2024-09-21T11:39:23.545 INFO:tasks.workunit.client.1.smithi149.stdout:8/818: rename d3/d33/d34/d55/d5e/d9e/dc2/d18/f51 to d3/d12/d6e/d79/d8e/f118 0 2024-09-21T11:39:23.545 INFO:tasks.workunit.client.0.smithi118.stdout:1/366: dread d6/de/d16/d3f/d50/d54/f39 [0,4194304] 0 2024-09-21T11:39:23.545 INFO:tasks.workunit.client.0.smithi118.stdout:4/274: dwrite d2/f21 [0,4194304] 0 2024-09-21T11:39:23.546 INFO:tasks.workunit.client.0.smithi118.stdout:8/642: fdatasync d2/dc/d10/d2e/dba/fc0 0 2024-09-21T11:39:23.547 INFO:tasks.workunit.client.1.smithi149.stdout:9/895: dwrite d18/d19/d29/d39/dfb/f119 [0,4194304] 0 2024-09-21T11:39:23.548 INFO:tasks.workunit.client.0.smithi118.stdout:6/294: creat d8/d46/f5e x:0 0 0 2024-09-21T11:39:23.549 INFO:tasks.workunit.client.1.smithi149.stdout:8/819: fdatasync d3/d33/d34/d55/d5e/d9e/dc2/d21/fff 0 2024-09-21T11:39:23.550 INFO:tasks.workunit.client.0.smithi118.stdout:0/677: symlink d5/d29/d68/d7b/db7/d48/lea 0 2024-09-21T11:39:23.554 INFO:tasks.workunit.client.0.smithi118.stdout:8/643: dwrite d2/dc/d49/fb5 [0,4194304] 0 2024-09-21T11:39:23.555 INFO:tasks.workunit.client.1.smithi149.stdout:1/875: rmdir d2/d5/d65/d96/d105/d10d 39 2024-09-21T11:39:23.557 INFO:tasks.workunit.client.1.smithi149.stdout:0/880: dwrite dd/d1a/d5a/d65/fc7 [0,4194304] 0 2024-09-21T11:39:23.557 INFO:tasks.workunit.client.0.smithi118.stdout:2/249: mkdir de/d16/d1c/d4f/d5b 0 2024-09-21T11:39:23.561 INFO:tasks.workunit.client.0.smithi118.stdout:0/678: dwrite d5/d10/d1e/d21/db3/fc1 [0,4194304] 0 2024-09-21T11:39:23.566 INFO:tasks.workunit.client.1.smithi149.stdout:3/960: getdents d6/d1f/d4c 0 2024-09-21T11:39:23.569 INFO:tasks.workunit.client.0.smithi118.stdout:0/679: dwrite d5/d34/f3b [0,4194304] 0 2024-09-21T11:39:23.572 INFO:tasks.workunit.client.0.smithi118.stdout:0/680: truncate d5/d10/d1e/d33/fcc 799642 0 2024-09-21T11:39:23.576 INFO:tasks.workunit.client.0.smithi118.stdout:0/681: dread d5/d10/d1e/d20/fb1 [0,4194304] 0 2024-09-21T11:39:23.577 INFO:tasks.workunit.client.1.smithi149.stdout:1/876: dread d2/dd/d35/d1c/d7a/fdf [0,4194304] 0 2024-09-21T11:39:23.578 INFO:tasks.workunit.client.1.smithi149.stdout:4/971: creat d4/d4d/d58/f144 x:0 0 0 2024-09-21T11:39:23.580 INFO:tasks.workunit.client.0.smithi118.stdout:6/295: unlink d8/d14/f32 0 2024-09-21T11:39:23.584 INFO:tasks.workunit.client.1.smithi149.stdout:0/881: truncate dd/d1a/d1b/d50/f57 2054439 0 2024-09-21T11:39:23.584 INFO:tasks.workunit.client.1.smithi149.stdout:0/882: chown dd/db3/fc5 197 1 2024-09-21T11:39:23.585 INFO:tasks.workunit.client.0.smithi118.stdout:8/644: rmdir d2/dc/d10/d2e 39 2024-09-21T11:39:23.587 INFO:tasks.workunit.client.1.smithi149.stdout:3/961: symlink d6/d1f/d47/d37/d3f/dc5/d111/l14b 0 2024-09-21T11:39:23.590 INFO:tasks.workunit.client.1.smithi149.stdout:7/978: creat d12/d5b/db5/dc5/de9/f12c x:0 0 0 2024-09-21T11:39:23.590 INFO:tasks.workunit.client.1.smithi149.stdout:7/979: dread - d12/d5b/db5/f129 zero size 2024-09-21T11:39:23.595 INFO:tasks.workunit.client.1.smithi149.stdout:3/962: dread d6/d5f/fe6 [0,4194304] 0 2024-09-21T11:39:23.596 INFO:tasks.workunit.client.0.smithi118.stdout:7/342: getdents d0/d3/d14/d41/d66 0 2024-09-21T11:39:23.598 INFO:tasks.workunit.client.0.smithi118.stdout:7/343: chown d0/d3/d1d/d35/f43 28 1 2024-09-21T11:39:23.598 INFO:tasks.workunit.client.0.smithi118.stdout:7/344: fdatasync d0/d3/d1d/d35/f61 0 2024-09-21T11:39:23.599 INFO:tasks.workunit.client.1.smithi149.stdout:4/972: symlink d4/d6/d63/d78/l145 0 2024-09-21T11:39:23.600 INFO:tasks.workunit.client.0.smithi118.stdout:7/345: truncate d0/d3/d14/f25 453421 0 2024-09-21T11:39:23.605 INFO:tasks.workunit.client.0.smithi118.stdout:6/296: mkdir d8/d48/d5f 0 2024-09-21T11:39:23.609 INFO:tasks.workunit.client.1.smithi149.stdout:9/896: link d18/d36/c37 d18/d36/d3c/d47/db5/c11b 0 2024-09-21T11:39:23.610 INFO:tasks.workunit.client.0.smithi118.stdout:4/275: dread d2/d6/de/f60 [0,4194304] 0 2024-09-21T11:39:23.611 INFO:tasks.workunit.client.0.smithi118.stdout:3/292: rmdir d5/d28/d33/d55 0 2024-09-21T11:39:23.616 INFO:tasks.workunit.client.1.smithi149.stdout:9/897: dwrite d18/d4c/d5b/fd0 [0,4194304] 0 2024-09-21T11:39:23.616 INFO:tasks.workunit.client.0.smithi118.stdout:2/250: dread de/f14 [0,4194304] 0 2024-09-21T11:39:23.617 INFO:tasks.workunit.client.0.smithi118.stdout:2/251: fsync de/d1f/d20/f35 0 2024-09-21T11:39:23.617 INFO:tasks.workunit.client.1.smithi149.stdout:3/963: readlink d6/d1f/d47/d22/l94 0 2024-09-21T11:39:23.617 INFO:tasks.workunit.client.0.smithi118.stdout:2/252: dread - de/d1f/d20/f35 zero size 2024-09-21T11:39:23.618 INFO:tasks.workunit.client.0.smithi118.stdout:1/367: creat d6/de/d16/d3f/d50/d54/f6f x:0 0 0 2024-09-21T11:39:23.620 INFO:tasks.workunit.client.1.smithi149.stdout:8/820: creat d3/d33/d34/d55/d5e/d9e/dc2/d18/f119 x:0 0 0 2024-09-21T11:39:23.620 INFO:tasks.workunit.client.0.smithi118.stdout:7/346: mkdir d0/d3/d29/d5f/d71 0 2024-09-21T11:39:23.622 INFO:tasks.workunit.client.0.smithi118.stdout:7/347: truncate d0/d3/d14/d41/f64 942545 0 2024-09-21T11:39:23.622 INFO:tasks.workunit.client.1.smithi149.stdout:4/973: symlink d4/d6/d18/d129/l146 0 2024-09-21T11:39:23.623 INFO:tasks.workunit.client.1.smithi149.stdout:3/964: read d6/d1f/d47/d22/f5d [69570,130909] 0 2024-09-21T11:39:23.623 INFO:tasks.workunit.client.1.smithi149.stdout:4/974: read - d4/d6/d63/d15/d30/da6/f106 zero size 2024-09-21T11:39:23.624 INFO:tasks.workunit.client.1.smithi149.stdout:6/869: link d8/d32/d64/d97/c8f d8/da/d2c/d52/d5e/c126 0 2024-09-21T11:39:23.625 INFO:tasks.workunit.client.1.smithi149.stdout:4/975: chown d4/d4d/d58/l82 13 1 2024-09-21T11:39:23.625 INFO:tasks.workunit.client.1.smithi149.stdout:6/870: dread - d8/d32/d37/d2b/d7e/df2/f124 zero size 2024-09-21T11:39:23.626 INFO:tasks.workunit.client.0.smithi118.stdout:0/682: write d5/d29/fb2 [243118,76985] 0 2024-09-21T11:39:23.626 INFO:tasks.workunit.client.0.smithi118.stdout:8/645: truncate d2/dc/d10/d2e/d18/d1a/f5c 242821 0 2024-09-21T11:39:23.661 INFO:tasks.workunit.client.1.smithi149.stdout:0/883: sync 2024-09-21T11:39:23.667 INFO:tasks.workunit.client.0.smithi118.stdout:5/319: sync 2024-09-21T11:39:23.669 INFO:tasks.workunit.client.1.smithi149.stdout:1/877: truncate d2/d5/fa7 3556362 0 2024-09-21T11:39:23.670 INFO:tasks.workunit.client.1.smithi149.stdout:9/898: creat d18/d36/d3c/d47/f11c x:0 0 0 2024-09-21T11:39:23.671 INFO:tasks.workunit.client.0.smithi118.stdout:1/368: creat d6/d33/f70 x:0 0 0 2024-09-21T11:39:23.671 INFO:tasks.workunit.client.0.smithi118.stdout:1/369: chown d6/de/l6a 1454701 1 2024-09-21T11:39:23.672 INFO:tasks.workunit.client.1.smithi149.stdout:8/821: dread - d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/f10d zero size 2024-09-21T11:39:23.673 INFO:tasks.workunit.client.0.smithi118.stdout:7/348: creat d0/d3/d29/d47/f72 x:0 0 0 2024-09-21T11:39:23.678 INFO:tasks.workunit.client.0.smithi118.stdout:8/646: creat d2/dc/d35/d42/fdf x:0 0 0 2024-09-21T11:39:23.679 INFO:tasks.workunit.client.0.smithi118.stdout:8/647: chown d2/dc/d16/d46/dca 36631757 1 2024-09-21T11:39:23.680 INFO:tasks.workunit.client.1.smithi149.stdout:7/980: rmdir d12/d5b/db5/dc5/de9/db7 0 2024-09-21T11:39:23.682 INFO:tasks.workunit.client.1.smithi149.stdout:0/884: symlink dd/d1a/d1b/d72/d78/dbb/l11d 0 2024-09-21T11:39:23.685 INFO:tasks.workunit.client.0.smithi118.stdout:4/276: dwrite d2/d6/f22 [0,4194304] 0 2024-09-21T11:39:23.687 INFO:tasks.workunit.client.0.smithi118.stdout:4/277: fsync d2/d6/f20 0 2024-09-21T11:39:23.687 INFO:tasks.workunit.client.0.smithi118.stdout:1/370: chown d6/d3b/d45/l61 3 1 2024-09-21T11:39:23.690 INFO:tasks.workunit.client.1.smithi149.stdout:9/899: rename d18/d19/d1a/d2f/d30/d90/dcc to d18/d19/d102/d11d 0 2024-09-21T11:39:23.690 INFO:tasks.workunit.client.0.smithi118.stdout:2/253: dwrite de/f19 [0,4194304] 0 2024-09-21T11:39:23.692 INFO:tasks.workunit.client.0.smithi118.stdout:2/254: write de/d16/f58 [549124,126071] 0 2024-09-21T11:39:23.694 INFO:tasks.workunit.client.0.smithi118.stdout:6/297: creat d8/f60 x:0 0 0 2024-09-21T11:39:23.694 INFO:tasks.workunit.client.1.smithi149.stdout:4/976: dwrite d4/d6/d63/d15/d30/d6b/daa/fad [0,4194304] 0 2024-09-21T11:39:23.696 INFO:tasks.workunit.client.0.smithi118.stdout:8/648: mknod d2/d7c/d88/d8f/ce0 0 2024-09-21T11:39:23.697 INFO:tasks.workunit.client.0.smithi118.stdout:8/649: write d2/f57 [624635,46465] 0 2024-09-21T11:39:23.698 INFO:tasks.workunit.client.0.smithi118.stdout:8/650: stat d2/dc/d35/d42/fdf 0 2024-09-21T11:39:23.702 INFO:tasks.workunit.client.0.smithi118.stdout:3/293: link d5/d1d/f23 d5/d28/f71 0 2024-09-21T11:39:23.707 INFO:tasks.workunit.client.0.smithi118.stdout:4/278: dread d2/d6/f18 [0,4194304] 0 2024-09-21T11:39:23.709 INFO:tasks.workunit.client.1.smithi149.stdout:0/885: mkdir dd/d1a/d1b/d72/d78/d8b/d11e 0 2024-09-21T11:39:23.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/878: truncate d2/f1a 1505880 0 2024-09-21T11:39:23.710 INFO:tasks.workunit.client.1.smithi149.stdout:8/822: link d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/f103 d3/d33/d34/d55/d95/f11a 0 2024-09-21T11:39:23.710 INFO:tasks.workunit.client.1.smithi149.stdout:9/900: truncate d18/d19/d1a/d2f/d53/f62 859350 0 2024-09-21T11:39:23.711 INFO:tasks.workunit.client.1.smithi149.stdout:4/977: dwrite d4/d6/d63/d15/d16/d23/d62/d100/f127 [0,4194304] 0 2024-09-21T11:39:23.713 INFO:tasks.workunit.client.1.smithi149.stdout:8/823: chown d3/d33/d34/d55/d5e/d9e/dc2/d90/df0 942 1 2024-09-21T11:39:23.713 INFO:tasks.workunit.client.0.smithi118.stdout:1/371: mknod d6/de/d16/d3f/d50/d54/d32/c71 0 2024-09-21T11:39:23.714 INFO:tasks.workunit.client.1.smithi149.stdout:4/978: readlink d4/d6/d63/d78/d98/dcc/l10a 0 2024-09-21T11:39:23.714 INFO:tasks.workunit.client.0.smithi118.stdout:1/372: stat d6/de/d16/d3f/d50/d54/d32/c47 0 2024-09-21T11:39:23.714 INFO:tasks.workunit.client.1.smithi149.stdout:3/965: creat d6/d1f/f14c x:0 0 0 2024-09-21T11:39:23.715 INFO:tasks.workunit.client.1.smithi149.stdout:6/871: rename d8/da/d2c/d2d to d8/da/d2c/d127 0 2024-09-21T11:39:23.715 INFO:tasks.workunit.client.0.smithi118.stdout:1/373: write d6/de/d13/f1c [1369097,29641] 0 2024-09-21T11:39:23.720 INFO:tasks.workunit.client.1.smithi149.stdout:1/879: dread d2/dd/d35/d1c/d41/d51/ffd [0,4194304] 0 2024-09-21T11:39:23.720 INFO:tasks.workunit.client.1.smithi149.stdout:7/981: mknod d12/d5b/db5/dc5/de9/d4a/d104/d12a/c12d 0 2024-09-21T11:39:23.724 INFO:tasks.workunit.client.0.smithi118.stdout:7/349: truncate d0/d3/d29/d47/f5d 998291 0 2024-09-21T11:39:23.725 INFO:tasks.workunit.client.0.smithi118.stdout:7/350: fdatasync d0/d3/d1d/d35/f5a 0 2024-09-21T11:39:23.726 INFO:tasks.workunit.client.0.smithi118.stdout:7/351: chown d0/d3/d29 16067852 1 2024-09-21T11:39:23.726 INFO:tasks.workunit.client.0.smithi118.stdout:3/294: symlink d5/d28/d3e/l72 0 2024-09-21T11:39:23.732 INFO:tasks.workunit.client.0.smithi118.stdout:3/295: dread d5/d1d/d1b/d50/f5a [0,4194304] 0 2024-09-21T11:39:23.733 INFO:tasks.workunit.client.0.smithi118.stdout:7/352: dwrite d0/d3/d1d/d35/f58 [0,4194304] 0 2024-09-21T11:39:23.735 INFO:tasks.workunit.client.0.smithi118.stdout:1/374: mkdir d6/de/d16/d3f/d50/d72 0 2024-09-21T11:39:23.736 INFO:tasks.workunit.client.0.smithi118.stdout:9/381: sync 2024-09-21T11:39:23.739 INFO:tasks.workunit.client.0.smithi118.stdout:9/382: write d0/d20/d4c/d5f/d6c/d88/d4d/f8a [320783,88955] 0 2024-09-21T11:39:23.740 INFO:tasks.workunit.client.0.smithi118.stdout:6/298: rename d8/d14/d3a/d54 to d8/d48/d45/d61 0 2024-09-21T11:39:23.741 INFO:tasks.workunit.client.0.smithi118.stdout:6/299: chown d8/d46/d53 1693 1 2024-09-21T11:39:23.741 INFO:tasks.workunit.client.0.smithi118.stdout:6/300: chown d8/fa 1503 1 2024-09-21T11:39:23.742 INFO:tasks.workunit.client.0.smithi118.stdout:8/651: unlink d2/dc/d10/d2e/d18/d1a/lbc 0 2024-09-21T11:39:23.746 INFO:tasks.workunit.client.0.smithi118.stdout:3/296: dread d5/f17 [0,4194304] 0 2024-09-21T11:39:23.748 INFO:tasks.workunit.client.0.smithi118.stdout:2/255: truncate de/f19 263616 0 2024-09-21T11:39:23.754 INFO:tasks.workunit.client.0.smithi118.stdout:2/256: dwrite de/d16/d25/f3b [0,4194304] 0 2024-09-21T11:39:23.758 INFO:tasks.workunit.client.0.smithi118.stdout:4/279: rename d2/d6/de/d1c/d23/d26/d31/f3b to d2/d44/f67 0 2024-09-21T11:39:23.758 INFO:tasks.workunit.client.0.smithi118.stdout:7/353: dread d0/d3/f18 [0,4194304] 0 2024-09-21T11:39:23.760 INFO:tasks.workunit.client.0.smithi118.stdout:6/301: rmdir d8/d14/d3a 39 2024-09-21T11:39:23.764 INFO:tasks.workunit.client.0.smithi118.stdout:7/354: dwrite d0/d3/f4d [0,4194304] 0 2024-09-21T11:39:23.769 INFO:tasks.workunit.client.0.smithi118.stdout:1/375: link f1 d6/d33/d3c/f73 0 2024-09-21T11:39:23.772 INFO:tasks.workunit.client.0.smithi118.stdout:2/257: creat de/d51/f5c x:0 0 0 2024-09-21T11:39:23.775 INFO:tasks.workunit.client.0.smithi118.stdout:4/280: creat d2/d6/de/d1c/d4d/f68 x:0 0 0 2024-09-21T11:39:23.776 INFO:tasks.workunit.client.0.smithi118.stdout:6/302: creat d8/d14/d33/f62 x:0 0 0 2024-09-21T11:39:23.777 INFO:tasks.workunit.client.0.smithi118.stdout:6/303: chown d8/d46 192534 1 2024-09-21T11:39:23.779 INFO:tasks.workunit.client.0.smithi118.stdout:4/281: dread d2/d6/de/f5c [0,4194304] 0 2024-09-21T11:39:23.779 INFO:tasks.workunit.client.0.smithi118.stdout:3/297: getdents d5/d1d/d1b/d50/d5c/d69 0 2024-09-21T11:39:23.779 INFO:tasks.workunit.client.0.smithi118.stdout:3/298: dread - d5/f57 zero size 2024-09-21T11:39:23.781 INFO:tasks.workunit.client.0.smithi118.stdout:9/383: creat d0/d4/f91 x:0 0 0 2024-09-21T11:39:23.782 INFO:tasks.workunit.client.0.smithi118.stdout:1/376: rmdir d6/de/d16 39 2024-09-21T11:39:23.783 INFO:tasks.workunit.client.0.smithi118.stdout:9/384: truncate d0/d20/d4c/d5f/d6c/d88/f36 501504 0 2024-09-21T11:39:23.787 INFO:tasks.workunit.client.0.smithi118.stdout:8/652: creat d2/dc/d35/fe1 x:0 0 0 2024-09-21T11:39:23.788 INFO:tasks.workunit.client.0.smithi118.stdout:2/258: dread de/d1f/d20/f27 [0,4194304] 0 2024-09-21T11:39:23.790 INFO:tasks.workunit.client.0.smithi118.stdout:3/299: mkdir d5/d1d/d1b/d4c/d73 0 2024-09-21T11:39:23.791 INFO:tasks.workunit.client.0.smithi118.stdout:9/385: dwrite d0/f1c [0,4194304] 0 2024-09-21T11:39:23.793 INFO:tasks.workunit.client.0.smithi118.stdout:3/300: truncate d5/d1d/d1b/d24/f61 601919 0 2024-09-21T11:39:23.794 INFO:tasks.workunit.client.0.smithi118.stdout:1/377: read - d6/de/d16/d3f/d50/d54/d32/f46 zero size 2024-09-21T11:39:23.797 INFO:tasks.workunit.client.0.smithi118.stdout:9/386: dwrite d0/d4/d45/f48 [0,4194304] 0 2024-09-21T11:39:23.799 INFO:tasks.workunit.client.0.smithi118.stdout:9/387: write d0/d4/f8 [7142136,119373] 0 2024-09-21T11:39:23.802 INFO:tasks.workunit.client.0.smithi118.stdout:1/378: dread d6/de/d13/f41 [0,4194304] 0 2024-09-21T11:39:23.816 INFO:tasks.workunit.client.0.smithi118.stdout:6/304: rename d8/d48/f2a to d8/d14/f63 0 2024-09-21T11:39:23.818 INFO:tasks.workunit.client.0.smithi118.stdout:9/388: creat d0/d20/d4c/d5f/d68/f92 x:0 0 0 2024-09-21T11:39:23.821 INFO:tasks.workunit.client.0.smithi118.stdout:8/653: fdatasync d2/dc/d10/d2e/d18/d1a/f1e 0 2024-09-21T11:39:23.823 INFO:tasks.workunit.client.0.smithi118.stdout:1/379: truncate d6/d3b/f43 1598242 0 2024-09-21T11:39:23.824 INFO:tasks.workunit.client.0.smithi118.stdout:7/355: link d0/d3/c54 d0/d3/d13/c73 0 2024-09-21T11:39:23.826 INFO:tasks.workunit.client.0.smithi118.stdout:3/301: getdents d5/d1d/d1b/d4b 0 2024-09-21T11:39:23.828 INFO:tasks.workunit.client.0.smithi118.stdout:3/302: dread - d5/d28/d3e/d5d/d5f/f6d zero size 2024-09-21T11:39:23.830 INFO:tasks.workunit.client.0.smithi118.stdout:7/356: dwrite d0/d3/f4d [0,4194304] 0 2024-09-21T11:39:23.833 INFO:tasks.workunit.client.0.smithi118.stdout:6/305: chown d8/d48/f31 397225307 1 2024-09-21T11:39:23.836 INFO:tasks.workunit.client.0.smithi118.stdout:4/282: rename d2/d44 to d2/d6/de/d1c/d4d/d52/d69 0 2024-09-21T11:39:23.839 INFO:tasks.workunit.client.0.smithi118.stdout:9/389: creat d0/d20/f93 x:0 0 0 2024-09-21T11:39:23.839 INFO:tasks.workunit.client.0.smithi118.stdout:1/380: dread d6/d2a/f51 [0,4194304] 0 2024-09-21T11:39:23.841 INFO:tasks.workunit.client.0.smithi118.stdout:4/283: dread d2/fc [0,4194304] 0 2024-09-21T11:39:23.844 INFO:tasks.workunit.client.1.smithi149.stdout:0/886: symlink dd/d1a/d1b/d72/dc1/l11f 0 2024-09-21T11:39:23.847 INFO:tasks.workunit.client.1.smithi149.stdout:9/901: creat d18/d36/d3c/d47/d76/d7c/f11e x:0 0 0 2024-09-21T11:39:23.849 INFO:tasks.workunit.client.1.smithi149.stdout:4/979: stat d4/d4d/d58/db4/cc3 0 2024-09-21T11:39:23.849 INFO:tasks.workunit.client.1.smithi149.stdout:9/902: read d18/d19/d1a/d2f/d30/d54/da7/ff4 [2497582,48472] 0 2024-09-21T11:39:23.849 INFO:tasks.workunit.client.0.smithi118.stdout:3/303: mknod d5/d1d/d1b/c74 0 2024-09-21T11:39:23.850 INFO:tasks.workunit.client.1.smithi149.stdout:8/824: creat d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/f11b x:0 0 0 2024-09-21T11:39:23.851 INFO:tasks.workunit.client.0.smithi118.stdout:7/357: symlink d0/d3/d13/d3d/d3e/l74 0 2024-09-21T11:39:23.852 INFO:tasks.workunit.client.0.smithi118.stdout:7/358: truncate d0/f16 6095482 0 2024-09-21T11:39:23.853 INFO:tasks.workunit.client.0.smithi118.stdout:7/359: chown d0/d3/f63 1759760801 1 2024-09-21T11:39:23.853 INFO:tasks.workunit.client.0.smithi118.stdout:6/306: mkdir d8/d14/d4a/d64 0 2024-09-21T11:39:23.855 INFO:tasks.workunit.client.1.smithi149.stdout:3/966: rename d6/d1f/d47/d22/l2c to d6/d1f/d47/d37/d3a/d95/df8/l14d 0 2024-09-21T11:39:23.858 INFO:tasks.workunit.client.0.smithi118.stdout:9/390: creat d0/d4/d45/d72/f94 x:0 0 0 2024-09-21T11:39:23.860 INFO:tasks.workunit.client.1.smithi149.stdout:7/982: creat d12/d5b/db5/dc5/de9/d4a/d6c/db1/f12e x:0 0 0 2024-09-21T11:39:23.860 INFO:tasks.workunit.client.0.smithi118.stdout:2/259: getdents de/d51 0 2024-09-21T11:39:23.863 INFO:tasks.workunit.client.0.smithi118.stdout:8/654: mknod d2/dc/d35/ce2 0 2024-09-21T11:39:23.864 INFO:tasks.workunit.client.1.smithi149.stdout:8/825: dread d3/d33/d34/d55/d5e/d9e/dc2/d21/fc0 [0,4194304] 0 2024-09-21T11:39:23.864 INFO:tasks.workunit.client.0.smithi118.stdout:8/655: write d2/dc/d16/d46/d4c/db0/fcf [8213,92823] 0 2024-09-21T11:39:23.868 INFO:tasks.workunit.client.1.smithi149.stdout:4/980: symlink d4/d6/d63/d15/d30/d8a/da7/l147 0 2024-09-21T11:39:23.869 INFO:tasks.workunit.client.1.smithi149.stdout:1/880: dread d2/dd/d35/d1c/d2c/f8b [0,4194304] 0 2024-09-21T11:39:23.871 INFO:tasks.workunit.client.0.smithi118.stdout:6/307: rename d8/d14/l21 to d8/d48/d5f/l65 0 2024-09-21T11:39:23.874 INFO:tasks.workunit.client.1.smithi149.stdout:6/872: creat d8/da/d123/f128 x:0 0 0 2024-09-21T11:39:23.875 INFO:tasks.workunit.client.0.smithi118.stdout:9/391: creat d0/d20/d71/f95 x:0 0 0 2024-09-21T11:39:23.876 INFO:tasks.workunit.client.1.smithi149.stdout:0/887: rename dd/d32/lb6 to dd/db3/dfb/l120 0 2024-09-21T11:39:23.881 INFO:tasks.workunit.client.0.smithi118.stdout:8/656: rmdir d2/dc/d16/d46/d4c/db0 39 2024-09-21T11:39:23.882 INFO:tasks.workunit.client.1.smithi149.stdout:8/826: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/d11c 0 2024-09-21T11:39:23.883 INFO:tasks.workunit.client.1.smithi149.stdout:8/827: chown d3/d33/d34/d55/d5e/d9e/dc2/f108 703578 1 2024-09-21T11:39:23.884 INFO:tasks.workunit.client.1.smithi149.stdout:9/903: creat d18/d19/d1a/df1/d107/f11f x:0 0 0 2024-09-21T11:39:23.886 INFO:tasks.workunit.client.1.smithi149.stdout:9/904: truncate d18/d19/d1a/d2f/d30/d54/fbb 4653341 0 2024-09-21T11:39:23.889 INFO:tasks.workunit.client.0.smithi118.stdout:3/304: write d5/f17 [2965533,76818] 0 2024-09-21T11:39:23.891 INFO:tasks.workunit.client.0.smithi118.stdout:3/305: truncate d5/d1d/d1b/d24/f60 1019412 0 2024-09-21T11:39:23.893 INFO:tasks.workunit.client.0.smithi118.stdout:2/260: mknod de/d53/c5d 0 2024-09-21T11:39:23.893 INFO:tasks.workunit.client.1.smithi149.stdout:3/967: getdents d6/d1f/d47/d22/d8d/dfd 0 2024-09-21T11:39:23.894 INFO:tasks.workunit.client.1.smithi149.stdout:3/968: read d6/d1f/d47/fb3 [2713855,15769] 0 2024-09-21T11:39:23.895 INFO:tasks.workunit.client.1.smithi149.stdout:3/969: stat d6/d1f/d47/d37/f7b 0 2024-09-21T11:39:23.897 INFO:tasks.workunit.client.0.smithi118.stdout:1/381: dwrite d6/de/f34 [0,4194304] 0 2024-09-21T11:39:23.900 INFO:tasks.workunit.client.1.smithi149.stdout:7/983: dread d12/d5b/db5/dc5/de9/d68/dc4/d30/f57 [0,4194304] 0 2024-09-21T11:39:23.903 INFO:tasks.workunit.client.0.smithi118.stdout:9/392: creat d0/d20/d4c/d5f/d68/d7c/f96 x:0 0 0 2024-09-21T11:39:23.904 INFO:tasks.workunit.client.0.smithi118.stdout:3/306: read d5/d28/f2b [2070553,28816] 0 2024-09-21T11:39:23.905 INFO:tasks.workunit.client.1.smithi149.stdout:1/881: write d2/d5/f62 [5198353,107727] 0 2024-09-21T11:39:23.906 INFO:tasks.workunit.client.1.smithi149.stdout:1/882: chown d2/d5/d65/d96/d105 18 1 2024-09-21T11:39:23.907 INFO:tasks.workunit.client.0.smithi118.stdout:9/393: write d0/d20/d4c/d5f/d68/f92 [685513,129297] 0 2024-09-21T11:39:23.907 INFO:tasks.workunit.client.1.smithi149.stdout:0/888: mkdir dd/d1a/d1b/d72/d78/dc4/d3a/d121 0 2024-09-21T11:39:23.908 INFO:tasks.workunit.client.0.smithi118.stdout:4/284: getdents d2/d6/de/d1c/d4d/d52 0 2024-09-21T11:39:23.910 INFO:tasks.workunit.client.0.smithi118.stdout:7/360: dwrite d0/d3/d14/d41/f4b [0,4194304] 0 2024-09-21T11:39:23.911 INFO:tasks.workunit.client.1.smithi149.stdout:3/970: unlink d6/d1f/d47/f81 0 2024-09-21T11:39:23.912 INFO:tasks.workunit.client.1.smithi149.stdout:3/971: chown d6/d1f/d27 2 1 2024-09-21T11:39:23.913 INFO:tasks.workunit.client.1.smithi149.stdout:8/828: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d90/df0/d11d 0 2024-09-21T11:39:23.915 INFO:tasks.workunit.client.1.smithi149.stdout:4/981: truncate d4/d6/d63/d78/d98/dcc/ddb/f114 196908 0 2024-09-21T11:39:23.916 INFO:tasks.workunit.client.0.smithi118.stdout:6/308: dwrite d8/f38 [0,4194304] 0 2024-09-21T11:39:23.916 INFO:tasks.workunit.client.1.smithi149.stdout:4/982: stat d4/d6/d63/d15/fdd 0 2024-09-21T11:39:23.917 INFO:tasks.workunit.client.0.smithi118.stdout:2/261: symlink de/d1f/d4a/l5e 0 2024-09-21T11:39:23.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/984: symlink d12/d5b/db5/dc5/de9/d4a/d4f/l12f 0 2024-09-21T11:39:23.919 INFO:tasks.workunit.client.1.smithi149.stdout:8/829: read d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f9f [1295279,65773] 0 2024-09-21T11:39:23.920 INFO:tasks.workunit.client.1.smithi149.stdout:9/905: mknod d18/d19/d1a/d2f/d33/d91/c120 0 2024-09-21T11:39:23.923 INFO:tasks.workunit.client.0.smithi118.stdout:8/657: rename d2/dc/d10/d3b/fa7 to d2/dc/d10/fe3 0 2024-09-21T11:39:23.924 INFO:tasks.workunit.client.1.smithi149.stdout:0/889: symlink dd/d32/dbe/l122 0 2024-09-21T11:39:23.924 INFO:tasks.workunit.client.0.smithi118.stdout:3/307: dread d5/d1d/f32 [0,4194304] 0 2024-09-21T11:39:23.925 INFO:tasks.workunit.client.1.smithi149.stdout:1/883: read d2/dd/d35/d1c/d41/d51/fdc [1468088,126606] 0 2024-09-21T11:39:23.928 INFO:tasks.workunit.client.0.smithi118.stdout:2/262: dwrite de/d16/f58 [0,4194304] 0 2024-09-21T11:39:23.928 INFO:tasks.workunit.client.0.smithi118.stdout:7/361: creat d0/d3/d29/f75 x:0 0 0 2024-09-21T11:39:23.929 INFO:tasks.workunit.client.0.smithi118.stdout:2/263: dread - de/d51/f5c zero size 2024-09-21T11:39:23.935 INFO:tasks.workunit.client.1.smithi149.stdout:3/972: dread d6/d1f/d47/d37/d3a/f6b [0,4194304] 0 2024-09-21T11:39:23.935 INFO:tasks.workunit.client.0.smithi118.stdout:6/309: readlink d8/l3b 0 2024-09-21T11:39:23.939 INFO:tasks.workunit.client.1.smithi149.stdout:7/985: mknod d12/d5b/db5/dc5/de9/d4a/d9e/d11c/c130 0 2024-09-21T11:39:23.942 INFO:tasks.workunit.client.1.smithi149.stdout:8/830: symlink d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7/l11e 0 2024-09-21T11:39:23.945 INFO:tasks.workunit.client.0.smithi118.stdout:3/308: symlink d5/d1d/d1b/d50/l75 0 2024-09-21T11:39:23.945 INFO:tasks.workunit.client.0.smithi118.stdout:3/309: fsync d5/d1d/d1b/d24/f2c 0 2024-09-21T11:39:23.946 INFO:tasks.workunit.client.0.smithi118.stdout:4/285: write d2/f2d [4257161,52796] 0 2024-09-21T11:39:23.947 INFO:tasks.workunit.client.0.smithi118.stdout:3/310: fdatasync d5/d1d/f49 0 2024-09-21T11:39:23.947 INFO:tasks.workunit.client.1.smithi149.stdout:7/986: fsync d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/f60 0 2024-09-21T11:39:23.949 INFO:tasks.workunit.client.0.smithi118.stdout:7/362: creat d0/d3/d29/f76 x:0 0 0 2024-09-21T11:39:23.950 INFO:tasks.workunit.client.0.smithi118.stdout:7/363: chown d0/d3/d14/d41/f4b 1517309719 1 2024-09-21T11:39:23.952 INFO:tasks.workunit.client.1.smithi149.stdout:3/973: dread d6/d1f/d27/f3c [0,4194304] 0 2024-09-21T11:39:23.953 INFO:tasks.workunit.client.1.smithi149.stdout:3/974: stat d6/d5f/d60/cd7 0 2024-09-21T11:39:23.953 INFO:tasks.workunit.client.0.smithi118.stdout:6/310: mkdir d8/d48/d45/d61/d66 0 2024-09-21T11:39:23.956 INFO:tasks.workunit.client.0.smithi118.stdout:1/382: getdents d6/d33/d3c 0 2024-09-21T11:39:23.957 INFO:tasks.workunit.client.0.smithi118.stdout:9/394: rmdir d0/d4/d38/d4e/d86/d8e 0 2024-09-21T11:39:23.958 INFO:tasks.workunit.client.0.smithi118.stdout:9/395: write d0/fb [1018392,36638] 0 2024-09-21T11:39:23.960 INFO:tasks.workunit.client.0.smithi118.stdout:8/658: rename d2/dc/d10/d2e/d18/d1a/f1e to d2/d32/fe4 0 2024-09-21T11:39:23.962 INFO:tasks.workunit.client.1.smithi149.stdout:7/987: mkdir d12/d5b/db5/dc5/de9/d4a/d6c/db1/de1/d131 0 2024-09-21T11:39:23.963 INFO:tasks.workunit.client.0.smithi118.stdout:4/286: unlink d2/d6/c28 0 2024-09-21T11:39:23.965 INFO:tasks.workunit.client.0.smithi118.stdout:7/364: dread d0/f9 [0,4194304] 0 2024-09-21T11:39:23.967 INFO:tasks.workunit.client.0.smithi118.stdout:8/659: dwrite d2/d32/f80 [0,4194304] 0 2024-09-21T11:39:23.967 INFO:tasks.workunit.client.1.smithi149.stdout:0/890: creat dd/d1a/d1b/d72/d78/f123 x:0 0 0 2024-09-21T11:39:23.969 INFO:tasks.workunit.client.0.smithi118.stdout:2/264: symlink de/d16/d1c/d4f/d5b/l5f 0 2024-09-21T11:39:23.972 INFO:tasks.workunit.client.1.smithi149.stdout:8/831: write d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/fed [3956516,105037] 0 2024-09-21T11:39:23.972 INFO:tasks.workunit.client.0.smithi118.stdout:6/311: write d8/f15 [2786070,83673] 0 2024-09-21T11:39:23.974 INFO:tasks.workunit.client.0.smithi118.stdout:1/383: rmdir d6 39 2024-09-21T11:39:23.975 INFO:tasks.workunit.client.1.smithi149.stdout:9/906: dwrite d18/d36/d3c/f3f [0,4194304] 0 2024-09-21T11:39:23.976 INFO:tasks.workunit.client.1.smithi149.stdout:4/983: getdents d4/d6/d18 0 2024-09-21T11:39:23.977 INFO:tasks.workunit.client.0.smithi118.stdout:9/396: creat d0/f97 x:0 0 0 2024-09-21T11:39:23.977 INFO:tasks.workunit.client.0.smithi118.stdout:2/265: dwrite de/d50/f5a [0,4194304] 0 2024-09-21T11:39:23.978 INFO:tasks.workunit.client.1.smithi149.stdout:4/984: read - d4/d4d/d125/f126 zero size 2024-09-21T11:39:23.978 INFO:tasks.workunit.client.1.smithi149.stdout:9/907: fsync d18/d19/d1a/d2f/d7d/de0/f118 0 2024-09-21T11:39:23.979 INFO:tasks.workunit.client.1.smithi149.stdout:9/908: fsync d18/d19/d1a/d2f/d5f/f73 0 2024-09-21T11:39:23.983 INFO:tasks.workunit.client.0.smithi118.stdout:3/311: write d5/d1d/d1b/d50/f59 [776818,1286] 0 2024-09-21T11:39:23.983 INFO:tasks.workunit.client.1.smithi149.stdout:7/988: unlink d12/d5b/db5/dc5/de9/d4a/d6c/lc2 0 2024-09-21T11:39:23.985 INFO:tasks.workunit.client.0.smithi118.stdout:3/312: fdatasync d5/d1d/d1b/d24/f38 0 2024-09-21T11:39:23.986 INFO:tasks.workunit.client.1.smithi149.stdout:3/975: unlink d6/d1f/d47/d37/l39 0 2024-09-21T11:39:23.986 INFO:tasks.workunit.client.0.smithi118.stdout:3/313: fsync d5/d28/d3e/d5d/d5f/f6d 0 2024-09-21T11:39:23.990 INFO:tasks.workunit.client.1.smithi149.stdout:0/891: dread dd/d1a/d5a/d106/f118 [0,4194304] 0 2024-09-21T11:39:23.992 INFO:tasks.workunit.client.1.smithi149.stdout:0/892: read dd/d32/db2/fbf [2436842,34171] 0 2024-09-21T11:39:23.994 INFO:tasks.workunit.client.1.smithi149.stdout:4/985: unlink d4/d6/d63/d2d/dd6/le1 0 2024-09-21T11:39:23.995 INFO:tasks.workunit.client.0.smithi118.stdout:6/312: creat d8/d48/d45/f67 x:0 0 0 2024-09-21T11:39:23.997 INFO:tasks.workunit.client.1.smithi149.stdout:7/989: creat d12/d5b/db5/dc5/de9/d4a/d6c/da0/df0/f132 x:0 0 0 2024-09-21T11:39:23.998 INFO:tasks.workunit.client.0.smithi118.stdout:1/384: write d6/d2a/f69 [651772,65080] 0 2024-09-21T11:39:23.998 INFO:tasks.workunit.client.1.smithi149.stdout:0/893: dwrite dd/f15 [4194304,4194304] 0 2024-09-21T11:39:24.001 INFO:tasks.workunit.client.0.smithi118.stdout:9/397: mkdir d0/d20/d4c/d5f/d66/d98 0 2024-09-21T11:39:24.002 INFO:tasks.workunit.client.0.smithi118.stdout:9/398: write d0/d4/f91 [795272,71908] 0 2024-09-21T11:39:24.004 INFO:tasks.workunit.client.0.smithi118.stdout:4/287: truncate d2/d6/de/d3e/f63 502895 0 2024-09-21T11:39:24.004 INFO:tasks.workunit.client.0.smithi118.stdout:8/660: dwrite d2/dc/d10/d2e/d18/d1a/f1f [4194304,4194304] 0 2024-09-21T11:39:24.005 INFO:tasks.workunit.client.0.smithi118.stdout:7/365: getdents d0/d3/d29/d5f/d71 0 2024-09-21T11:39:24.006 INFO:tasks.workunit.client.1.smithi149.stdout:0/894: dwrite dd/d1a/d1b/d72/d78/f11c [0,4194304] 0 2024-09-21T11:39:24.006 INFO:tasks.workunit.client.0.smithi118.stdout:7/366: fsync d0/d3/d1d/d35/f61 0 2024-09-21T11:39:24.007 INFO:tasks.workunit.client.1.smithi149.stdout:9/909: unlink d18/d36/d3c/cf0 0 2024-09-21T11:39:24.010 INFO:tasks.workunit.client.0.smithi118.stdout:3/314: unlink d5/d1d/d1b/d24/f37 0 2024-09-21T11:39:24.010 INFO:tasks.workunit.client.1.smithi149.stdout:6/873: sync 2024-09-21T11:39:24.011 INFO:tasks.workunit.client.0.smithi118.stdout:6/313: symlink d8/d48/l68 0 2024-09-21T11:39:24.015 INFO:tasks.workunit.client.1.smithi149.stdout:3/976: mkdir d6/d5f/d60/d88/de7/d14e 0 2024-09-21T11:39:24.015 INFO:tasks.workunit.client.1.smithi149.stdout:7/990: truncate d12/d5b/db5/dc5/de9/d68/dc4/f3e 1140974 0 2024-09-21T11:39:24.015 INFO:tasks.workunit.client.0.smithi118.stdout:9/399: dwrite d0/d20/d4c/d5f/d68/f83 [0,4194304] 0 2024-09-21T11:39:24.016 INFO:tasks.workunit.client.1.smithi149.stdout:8/832: rename d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/c58 to d3/d33/d34/d55/d5e/d9e/dc2/d3a/c11f 0 2024-09-21T11:39:24.017 INFO:tasks.workunit.client.1.smithi149.stdout:7/991: dread - d12/d5b/db5/dc5/de9/d4a/d6c/d8c/fa2 zero size 2024-09-21T11:39:24.018 INFO:tasks.workunit.client.0.smithi118.stdout:8/661: mknod d2/dc/d35/d42/ce5 0 2024-09-21T11:39:24.018 INFO:tasks.workunit.client.0.smithi118.stdout:8/662: chown d2 47 1 2024-09-21T11:39:24.020 INFO:tasks.workunit.client.0.smithi118.stdout:3/315: dwrite d5/d1d/f4e [0,4194304] 0 2024-09-21T11:39:24.022 INFO:tasks.workunit.client.0.smithi118.stdout:3/316: chown d5/d28/d33/d4a/f4f 3178 1 2024-09-21T11:39:24.023 INFO:tasks.workunit.client.0.smithi118.stdout:3/317: read - d5/d1d/d1b/d4c/f6e zero size 2024-09-21T11:39:24.024 INFO:tasks.workunit.client.0.smithi118.stdout:3/318: rename d5 to d5/d1d/d1b/d24/d76 22 2024-09-21T11:39:24.025 INFO:tasks.workunit.client.0.smithi118.stdout:3/319: chown d5/d1d/d1b/d24 2013348 1 2024-09-21T11:39:24.027 INFO:tasks.workunit.client.0.smithi118.stdout:7/367: rmdir d0/d3/d29/d47 39 2024-09-21T11:39:24.028 INFO:tasks.workunit.client.0.smithi118.stdout:7/368: stat d0/d3/d14/f65 0 2024-09-21T11:39:24.031 INFO:tasks.workunit.client.1.smithi149.stdout:4/986: link d4/d6/d63/d15/d30/da6/f106 d4/d4d/d5f/d71/f148 0 2024-09-21T11:39:24.033 INFO:tasks.workunit.client.1.smithi149.stdout:4/987: chown d4/d6/d63/d15/f120 1 1 2024-09-21T11:39:24.034 INFO:tasks.workunit.client.1.smithi149.stdout:9/910: rename d18/d19/d1a/d2f/d30/d54/da7 to d18/d19/d1a/d2f/d30/d54/d121 0 2024-09-21T11:39:24.035 INFO:tasks.workunit.client.0.smithi118.stdout:2/266: link de/d1f/d20/f35 de/d1f/f60 0 2024-09-21T11:39:24.039 INFO:tasks.workunit.client.0.smithi118.stdout:0/683: sync 2024-09-21T11:39:24.040 INFO:tasks.workunit.client.1.smithi149.stdout:0/895: dread dd/d1a/d1b/f27 [0,4194304] 0 2024-09-21T11:39:24.040 INFO:tasks.workunit.client.0.smithi118.stdout:9/400: dread d0/d4/f8 [0,4194304] 0 2024-09-21T11:39:24.044 INFO:tasks.workunit.client.0.smithi118.stdout:0/684: dread d5/d10/d1e/d21/f24 [0,4194304] 0 2024-09-21T11:39:24.051 INFO:tasks.workunit.client.1.smithi149.stdout:9/911: readlink d18/d19/d1a/l2b 0 2024-09-21T11:39:24.051 INFO:tasks.workunit.client.0.smithi118.stdout:0/685: dwrite d5/d34/fe4 [0,4194304] 0 2024-09-21T11:39:24.052 INFO:tasks.workunit.client.0.smithi118.stdout:0/686: chown d5/f74 53336800 1 2024-09-21T11:39:24.052 INFO:tasks.workunit.client.1.smithi149.stdout:4/988: dread d4/d6/f5e [0,4194304] 0 2024-09-21T11:39:24.055 INFO:tasks.workunit.client.1.smithi149.stdout:3/977: mkdir d6/d1f/d47/d37/dd6/d96/d137/d14f 0 2024-09-21T11:39:24.057 INFO:tasks.workunit.client.0.smithi118.stdout:7/369: truncate d0/f9 1162759 0 2024-09-21T11:39:24.059 INFO:tasks.workunit.client.0.smithi118.stdout:2/267: creat de/d16/d1c/d4f/d5b/f61 x:0 0 0 2024-09-21T11:39:24.060 INFO:tasks.workunit.client.0.smithi118.stdout:2/268: stat de/d1f 0 2024-09-21T11:39:24.061 INFO:tasks.workunit.client.1.smithi149.stdout:8/833: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/d11c/d120 0 2024-09-21T11:39:24.062 INFO:tasks.workunit.client.0.smithi118.stdout:7/370: dread d0/d3/f18 [0,4194304] 0 2024-09-21T11:39:24.062 INFO:tasks.workunit.client.0.smithi118.stdout:6/314: getdents d8/d46/d53 0 2024-09-21T11:39:24.063 INFO:tasks.workunit.client.1.smithi149.stdout:7/992: write d12/d5b/db5/dc5/de9/d68/dc4/f2e [4533111,105148] 0 2024-09-21T11:39:24.063 INFO:tasks.workunit.client.1.smithi149.stdout:1/884: sync 2024-09-21T11:39:24.063 INFO:tasks.workunit.client.1.smithi149.stdout:7/993: chown fa 0 1 2024-09-21T11:39:24.064 INFO:tasks.workunit.client.0.smithi118.stdout:9/401: mkdir d0/d20/d4c/d5f/d68/d99 0 2024-09-21T11:39:24.065 INFO:tasks.workunit.client.0.smithi118.stdout:9/402: fdatasync d0/d20/f64 0 2024-09-21T11:39:24.066 INFO:tasks.workunit.client.0.smithi118.stdout:9/403: truncate d0/d4/d45/f75 42444 0 2024-09-21T11:39:24.067 INFO:tasks.workunit.client.0.smithi118.stdout:9/404: stat d0/d4 0 2024-09-21T11:39:24.068 INFO:tasks.workunit.client.0.smithi118.stdout:9/405: write d0/fc [5309281,73112] 0 2024-09-21T11:39:24.069 INFO:tasks.workunit.client.0.smithi118.stdout:9/406: fsync d0/d4/d38/f60 0 2024-09-21T11:39:24.069 INFO:tasks.workunit.client.1.smithi149.stdout:1/885: dwrite d2/dd/d2e/f77 [4194304,4194304] 0 2024-09-21T11:39:24.070 INFO:tasks.workunit.client.1.smithi149.stdout:3/978: creat d6/d5f/d60/d88/de7/f150 x:0 0 0 2024-09-21T11:39:24.071 INFO:tasks.workunit.client.1.smithi149.stdout:1/886: chown d2/dd/d35/d1c/d7a/d10e/dc0/dc3 2 1 2024-09-21T11:39:24.071 INFO:tasks.workunit.client.0.smithi118.stdout:4/288: rmdir d2/d6/dd/d55 0 2024-09-21T11:39:24.072 INFO:tasks.workunit.client.1.smithi149.stdout:1/887: dread - d2/dd/d2e/d4c/f118 zero size 2024-09-21T11:39:24.072 INFO:tasks.workunit.client.0.smithi118.stdout:0/687: dread d5/d10/d1e/d33/f72 [4194304,4194304] 0 2024-09-21T11:39:24.079 INFO:tasks.workunit.client.0.smithi118.stdout:0/688: dwrite d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:24.082 INFO:tasks.workunit.client.0.smithi118.stdout:2/269: rename de/d1f/f60 to de/d16/d25/f62 0 2024-09-21T11:39:24.084 INFO:tasks.workunit.client.1.smithi149.stdout:7/994: mkdir d12/d5b/db5/dc5/de9/d4a/d6c/da0/dee/d133 0 2024-09-21T11:39:24.084 INFO:tasks.workunit.client.1.smithi149.stdout:4/989: write d4/d6/d63/d15/f54 [1352997,89568] 0 2024-09-21T11:39:24.085 INFO:tasks.workunit.client.1.smithi149.stdout:6/874: getdents d8/d32/d37/d2b/d7e/df2 0 2024-09-21T11:39:24.088 INFO:tasks.workunit.client.1.smithi149.stdout:8/834: write d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/f10d [304067,64930] 0 2024-09-21T11:39:24.089 INFO:tasks.workunit.client.0.smithi118.stdout:6/315: creat d8/d14/d4a/f69 x:0 0 0 2024-09-21T11:39:24.092 INFO:tasks.workunit.client.1.smithi149.stdout:0/896: link dd/d1a/d1b/f31 dd/d1a/d1b/f124 0 2024-09-21T11:39:24.095 INFO:tasks.workunit.client.1.smithi149.stdout:1/888: creat d2/dd/d35/d1c/d41/d74/f11d x:0 0 0 2024-09-21T11:39:24.096 INFO:tasks.workunit.client.0.smithi118.stdout:8/663: creat d2/dc/d10/d2e/fe6 x:0 0 0 2024-09-21T11:39:24.097 INFO:tasks.workunit.client.1.smithi149.stdout:1/889: fdatasync d2/d5/d8/dc1/dd6/f108 0 2024-09-21T11:39:24.098 INFO:tasks.workunit.client.1.smithi149.stdout:4/990: symlink d4/d6/d63/d78/d98/dee/d11e/l149 0 2024-09-21T11:39:24.098 INFO:tasks.workunit.client.1.smithi149.stdout:0/897: dwrite dd/d1a/d1b/f10b [0,4194304] 0 2024-09-21T11:39:24.099 INFO:tasks.workunit.client.0.smithi118.stdout:4/289: creat d2/d6/de/d1c/d4d/d52/f6a x:0 0 0 2024-09-21T11:39:24.099 INFO:tasks.workunit.client.0.smithi118.stdout:8/664: dread d2/dc/d10/fe3 [0,4194304] 0 2024-09-21T11:39:24.100 INFO:tasks.workunit.client.1.smithi149.stdout:6/875: symlink d8/l129 0 2024-09-21T11:39:24.101 INFO:tasks.workunit.client.0.smithi118.stdout:8/665: write d2/dc/d35/dab/fcd [113100,61674] 0 2024-09-21T11:39:24.104 INFO:tasks.workunit.client.1.smithi149.stdout:3/979: dwrite d6/d1f/d47/f77 [0,4194304] 0 2024-09-21T11:39:24.105 INFO:tasks.workunit.client.1.smithi149.stdout:3/980: fsync d6/d1f/d47/d22/f12a 0 2024-09-21T11:39:24.105 INFO:tasks.workunit.client.0.smithi118.stdout:5/320: sync 2024-09-21T11:39:24.106 INFO:tasks.workunit.client.0.smithi118.stdout:0/689: rmdir d5/d34/d44/d7c 39 2024-09-21T11:39:24.107 INFO:tasks.workunit.client.0.smithi118.stdout:0/690: write d5/d29/d53/f63 [1186021,38558] 0 2024-09-21T11:39:24.110 INFO:tasks.workunit.client.0.smithi118.stdout:9/407: rename d0/d20/d4c/d5f/d6c/d88/f36 to d0/d20/d4c/d5f/d6c/d88/d4d/f9a 0 2024-09-21T11:39:24.111 INFO:tasks.workunit.client.0.smithi118.stdout:9/408: chown d0/d20/d4c/d5f 969054 1 2024-09-21T11:39:24.112 INFO:tasks.workunit.client.0.smithi118.stdout:2/270: mkdir de/d50/d63 0 2024-09-21T11:39:24.113 INFO:tasks.workunit.client.1.smithi149.stdout:0/898: symlink dd/d6a/l125 0 2024-09-21T11:39:24.114 INFO:tasks.workunit.client.0.smithi118.stdout:2/271: truncate de/d51/f5c 104612 0 2024-09-21T11:39:24.114 INFO:tasks.workunit.client.0.smithi118.stdout:0/691: dread d5/d34/d44/d87/fe6 [0,4194304] 0 2024-09-21T11:39:24.115 INFO:tasks.workunit.client.0.smithi118.stdout:6/316: symlink d8/d46/l6a 0 2024-09-21T11:39:24.116 INFO:tasks.workunit.client.0.smithi118.stdout:1/385: link d6/d3b/d45/c49 d6/de/c74 0 2024-09-21T11:39:24.116 INFO:tasks.workunit.client.0.smithi118.stdout:0/692: chown d5/d10/d1e/d20/f8e 204511 1 2024-09-21T11:39:24.117 INFO:tasks.workunit.client.1.smithi149.stdout:6/876: chown d8/d32/d37/d28/d2f/d6a/dff/l11e 9724 1 2024-09-21T11:39:24.118 INFO:tasks.workunit.client.0.smithi118.stdout:6/317: write d8/d14/d4a/f69 [570504,49882] 0 2024-09-21T11:39:24.121 INFO:tasks.workunit.client.1.smithi149.stdout:3/981: write d6/d1f/d47/d37/d3a/d95/f10d [817216,121688] 0 2024-09-21T11:39:24.123 INFO:tasks.workunit.client.0.smithi118.stdout:3/320: getdents d5/d28/d33 0 2024-09-21T11:39:24.125 INFO:tasks.workunit.client.1.smithi149.stdout:8/835: dwrite d3/d12/db1/ffc [0,4194304] 0 2024-09-21T11:39:24.126 INFO:tasks.workunit.client.1.smithi149.stdout:1/890: link d2/dd/d35/d7c/fb4 d2/dd/d35/d1c/d7a/d10e/f11e 0 2024-09-21T11:39:24.127 INFO:tasks.workunit.client.0.smithi118.stdout:2/272: dwrite de/d1f/d20/f55 [0,4194304] 0 2024-09-21T11:39:24.128 INFO:tasks.workunit.client.1.smithi149.stdout:6/877: unlink d8/da/d2c/fba 0 2024-09-21T11:39:24.131 INFO:tasks.workunit.client.1.smithi149.stdout:9/912: sync 2024-09-21T11:39:24.132 INFO:tasks.workunit.client.0.smithi118.stdout:7/371: fsync d0/d3/d29/d47/f5d 0 2024-09-21T11:39:24.132 INFO:tasks.workunit.client.0.smithi118.stdout:2/273: write de/d1f/f4c [7966718,13905] 0 2024-09-21T11:39:24.133 INFO:tasks.workunit.client.1.smithi149.stdout:3/982: unlink d6/d1f/d27/f5b 0 2024-09-21T11:39:24.134 INFO:tasks.workunit.client.0.smithi118.stdout:1/386: dwrite d6/de/f2e [0,4194304] 0 2024-09-21T11:39:24.137 INFO:tasks.workunit.client.1.smithi149.stdout:7/995: rename d12/d5b/db5/dc5/de9/d68/dc4/d30/f120 to d12/d5b/db5/dc5/de9/d4a/d4f/d75/f134 0 2024-09-21T11:39:24.142 INFO:tasks.workunit.client.0.smithi118.stdout:8/666: mkdir d2/dc/d35/dc7/de7 0 2024-09-21T11:39:24.142 INFO:tasks.workunit.client.0.smithi118.stdout:7/372: truncate d0/d3/d13/f38 2073786 0 2024-09-21T11:39:24.142 INFO:tasks.workunit.client.0.smithi118.stdout:1/387: dread - d6/de/f58 zero size 2024-09-21T11:39:24.143 INFO:tasks.workunit.client.0.smithi118.stdout:6/318: dwrite d8/d14/d33/f62 [0,4194304] 0 2024-09-21T11:39:24.147 INFO:tasks.workunit.client.1.smithi149.stdout:1/891: stat d2/d5/d65/d96/d105/d10d/f116 0 2024-09-21T11:39:24.147 INFO:tasks.workunit.client.0.smithi118.stdout:5/321: dread d0/db/d35/da/f21 [0,4194304] 0 2024-09-21T11:39:24.149 INFO:tasks.workunit.client.1.smithi149.stdout:1/892: chown d2/d5/d65/d96/ced 997484 1 2024-09-21T11:39:24.150 INFO:tasks.workunit.client.0.smithi118.stdout:3/321: symlink d5/d28/d3e/l77 0 2024-09-21T11:39:24.151 INFO:tasks.workunit.client.1.smithi149.stdout:6/878: dread d8/d32/d37/d28/d2e/f9e [0,4194304] 0 2024-09-21T11:39:24.152 INFO:tasks.workunit.client.1.smithi149.stdout:1/893: write d2/d5/d8/dc1/f10c [896861,6455] 0 2024-09-21T11:39:24.154 INFO:tasks.workunit.client.0.smithi118.stdout:9/409: symlink d0/d4/l9b 0 2024-09-21T11:39:24.154 INFO:tasks.workunit.client.1.smithi149.stdout:0/899: creat dd/f126 x:0 0 0 2024-09-21T11:39:24.158 INFO:tasks.workunit.client.1.smithi149.stdout:3/983: creat d6/d1f/d47/dce/f151 x:0 0 0 2024-09-21T11:39:24.158 INFO:tasks.workunit.client.1.smithi149.stdout:1/894: write d2/d5/d3d/d88/f42 [7160000,57613] 0 2024-09-21T11:39:24.159 INFO:tasks.workunit.client.1.smithi149.stdout:6/879: write d8/d32/d37/d28/d2e/f3b [2511071,14088] 0 2024-09-21T11:39:24.161 INFO:tasks.workunit.client.1.smithi149.stdout:4/991: rename d4/d4d/d5f/ff4 to d4/d6/d63/d78/d98/dee/d10d/f14a 0 2024-09-21T11:39:24.163 INFO:tasks.workunit.client.1.smithi149.stdout:6/880: read d8/d32/d37/d2b/d51/f94 [2638063,15409] 0 2024-09-21T11:39:24.163 INFO:tasks.workunit.client.0.smithi118.stdout:2/274: rmdir de/d1f/d20 39 2024-09-21T11:39:24.166 INFO:tasks.workunit.client.1.smithi149.stdout:7/996: dread d12/f74 [0,4194304] 0 2024-09-21T11:39:24.166 INFO:tasks.workunit.client.1.smithi149.stdout:6/881: readlink d8/d32/d37/d2b/la8 0 2024-09-21T11:39:24.167 INFO:tasks.workunit.client.1.smithi149.stdout:9/913: dwrite d18/d19/f40 [0,4194304] 0 2024-09-21T11:39:24.167 INFO:tasks.workunit.client.0.smithi118.stdout:7/373: symlink d0/d3/d1d/l77 0 2024-09-21T11:39:24.168 INFO:tasks.workunit.client.0.smithi118.stdout:7/374: stat d0/c1f 0 2024-09-21T11:39:24.168 INFO:tasks.workunit.client.1.smithi149.stdout:3/984: read d6/d79/d7e/ddd/fe8 [2575303,102659] 0 2024-09-21T11:39:24.170 INFO:tasks.workunit.client.1.smithi149.stdout:9/914: write d18/d36/d3c/d47/d99/ff7 [973961,113877] 0 2024-09-21T11:39:24.170 INFO:tasks.workunit.client.1.smithi149.stdout:3/985: readlink d6/d10e/l125 0 2024-09-21T11:39:24.172 INFO:tasks.workunit.client.0.smithi118.stdout:0/693: dwrite d5/d10/d1e/d21/f7a [0,4194304] 0 2024-09-21T11:39:24.173 INFO:tasks.workunit.client.0.smithi118.stdout:6/319: mkdir d8/d48/d5f/d6b 0 2024-09-21T11:39:24.173 INFO:tasks.workunit.client.1.smithi149.stdout:3/986: truncate d6/d5f/d60/d88/de7/d119/fe9 31453 0 2024-09-21T11:39:24.174 INFO:tasks.workunit.client.1.smithi149.stdout:3/987: dread - d6/d1f/d47/d37/dd6/ff7 zero size 2024-09-21T11:39:24.176 INFO:tasks.workunit.client.1.smithi149.stdout:1/895: rename d2/d5/f6b to d2/d107/d6e/f11f 0 2024-09-21T11:39:24.178 INFO:tasks.workunit.client.0.smithi118.stdout:5/322: rename d0/db/c24 to d0/d63/c6f 0 2024-09-21T11:39:24.179 INFO:tasks.workunit.client.0.smithi118.stdout:5/323: truncate d0/d6c/d67/f62 854352 0 2024-09-21T11:39:24.180 INFO:tasks.workunit.client.0.smithi118.stdout:5/324: fsync d0/db/d35/d2c/f3e 0 2024-09-21T11:39:24.184 INFO:tasks.workunit.client.0.smithi118.stdout:2/275: mkdir de/d16/d31/d64 0 2024-09-21T11:39:24.188 INFO:tasks.workunit.client.1.smithi149.stdout:4/992: creat d4/d6/d63/d2d/dd6/d32/d4a/f14b x:0 0 0 2024-09-21T11:39:24.191 INFO:tasks.workunit.client.1.smithi149.stdout:7/997: rename d12/d5b/db5/dc5/de9/d4a/ddd/lfa to d12/d5b/db5/dc5/de9/d4a/ddd/l135 0 2024-09-21T11:39:24.193 INFO:tasks.workunit.client.1.smithi149.stdout:9/915: creat d18/d36/d3c/f122 x:0 0 0 2024-09-21T11:39:24.195 INFO:tasks.workunit.client.0.smithi118.stdout:1/388: link d6/d3b/f66 d6/de/d16/d3f/d50/d72/f75 0 2024-09-21T11:39:24.196 INFO:tasks.workunit.client.0.smithi118.stdout:8/667: dwrite d2/dc/d49/f77 [0,4194304] 0 2024-09-21T11:39:24.196 INFO:tasks.workunit.client.0.smithi118.stdout:1/389: chown c2 9695 1 2024-09-21T11:39:24.197 INFO:tasks.workunit.client.0.smithi118.stdout:1/390: readlink d6/de/l6a 0 2024-09-21T11:39:24.197 INFO:tasks.workunit.client.0.smithi118.stdout:8/668: stat d2/d7c/d88/d8f 0 2024-09-21T11:39:24.198 INFO:tasks.workunit.client.0.smithi118.stdout:5/325: dread d0/f5 [0,4194304] 0 2024-09-21T11:39:24.198 INFO:tasks.workunit.client.0.smithi118.stdout:3/322: write d5/d1d/d1b/d50/f5a [1727547,34037] 0 2024-09-21T11:39:24.199 INFO:tasks.workunit.client.0.smithi118.stdout:1/391: chown d6/d3b/d45/l61 2797064 1 2024-09-21T11:39:24.200 INFO:tasks.workunit.client.0.smithi118.stdout:8/669: dread d2/d73/f92 [0,4194304] 0 2024-09-21T11:39:24.203 INFO:tasks.workunit.client.1.smithi149.stdout:8/836: getdents d3/d33/d34/d55/d5e/d9e/dc2/d3a 0 2024-09-21T11:39:24.204 INFO:tasks.workunit.client.0.smithi118.stdout:4/290: link d2/d6/dd/l1a d2/d6/de/l6b 0 2024-09-21T11:39:24.204 INFO:tasks.workunit.client.1.smithi149.stdout:8/837: readlink d3/d12/d6e/d79/lb3 0 2024-09-21T11:39:24.205 INFO:tasks.workunit.client.1.smithi149.stdout:8/838: write d3/f37 [2747410,112274] 0 2024-09-21T11:39:24.209 INFO:tasks.workunit.client.1.smithi149.stdout:9/916: rename d18/d19/d1a/d9b/fec to d18/d19/d1a/df1/df5/f123 0 2024-09-21T11:39:24.209 INFO:tasks.workunit.client.1.smithi149.stdout:7/998: dread d12/d5b/db5/dc5/de9/d4a/d4f/d75/d94/faf [0,4194304] 0 2024-09-21T11:39:24.209 INFO:tasks.workunit.client.1.smithi149.stdout:9/917: dread - d18/d19/d1a/f10b zero size 2024-09-21T11:39:24.210 INFO:tasks.workunit.client.1.smithi149.stdout:3/988: mknod d6/d1f/d47/d22/c152 0 2024-09-21T11:39:24.210 INFO:tasks.workunit.client.0.smithi118.stdout:5/326: creat d0/d6c/d67/f70 x:0 0 0 2024-09-21T11:39:24.215 INFO:tasks.workunit.client.1.smithi149.stdout:0/900: getdents dd/d6a 0 2024-09-21T11:39:24.217 INFO:tasks.workunit.client.0.smithi118.stdout:8/670: rmdir d2/dc/d35 39 2024-09-21T11:39:24.222 INFO:tasks.workunit.client.1.smithi149.stdout:6/882: truncate d8/d32/d37/d28/d2e/f44 296343 0 2024-09-21T11:39:24.226 INFO:tasks.workunit.client.0.smithi118.stdout:9/410: rename d0/d4/d45/l5a to d0/d4/l9c 0 2024-09-21T11:39:24.228 INFO:tasks.workunit.client.1.smithi149.stdout:9/918: readlink d18/d36/d3c/d47/lda 0 2024-09-21T11:39:24.228 INFO:tasks.workunit.client.1.smithi149.stdout:9/919: chown d18/d1c/f46 263 1 2024-09-21T11:39:24.228 INFO:tasks.workunit.client.0.smithi118.stdout:3/323: mknod d5/c78 0 2024-09-21T11:39:24.229 INFO:tasks.workunit.client.1.smithi149.stdout:1/896: link d2/dd/d35/d1c/d41/fbe d2/dd/d35/d1c/d7a/d10e/dc0/f120 0 2024-09-21T11:39:24.232 INFO:tasks.workunit.client.0.smithi118.stdout:8/671: mknod d2/d7c/d88/ce8 0 2024-09-21T11:39:24.236 INFO:tasks.workunit.client.0.smithi118.stdout:4/291: fsync d2/d6/de/f16 0 2024-09-21T11:39:24.237 INFO:tasks.workunit.client.0.smithi118.stdout:2/276: dwrite de/d16/d31/f3d [0,4194304] 0 2024-09-21T11:39:24.239 INFO:tasks.workunit.client.0.smithi118.stdout:0/694: getdents d5/d10/d1e/d23/d3a 0 2024-09-21T11:39:24.241 INFO:tasks.workunit.client.1.smithi149.stdout:8/839: truncate d3/d33/d34/fbe 2402976 0 2024-09-21T11:39:24.241 INFO:tasks.workunit.client.1.smithi149.stdout:0/901: write dd/d1a/d1b/d72/d78/d8b/fae [4541438,66325] 0 2024-09-21T11:39:24.243 INFO:tasks.workunit.client.0.smithi118.stdout:7/375: rename d0/d3/d14/d41/f64 to d0/d3/d13/d3d/d3e/f78 0 2024-09-21T11:39:24.245 INFO:tasks.workunit.client.0.smithi118.stdout:7/376: truncate d0/d3/d14/d41/d66/f67 633662 0 2024-09-21T11:39:24.248 INFO:tasks.workunit.client.0.smithi118.stdout:9/411: dread d0/d20/d4c/d5f/d6c/d88/d4d/f58 [0,4194304] 0 2024-09-21T11:39:24.250 INFO:tasks.workunit.client.1.smithi149.stdout:7/999: creat d12/d5b/db5/dc5/de9/d4a/d4f/dce/f136 x:0 0 0 2024-09-21T11:39:24.251 INFO:tasks.workunit.client.0.smithi118.stdout:3/324: creat d5/d28/d33/d4a/f79 x:0 0 0 2024-09-21T11:39:24.252 INFO:tasks.workunit.client.1.smithi149.stdout:9/920: chown d18/d19/d1a/d2f/d43/c105 3053 1 2024-09-21T11:39:24.254 INFO:tasks.workunit.client.0.smithi118.stdout:5/327: creat d0/db/d35/d30/d66/f71 x:0 0 0 2024-09-21T11:39:24.255 INFO:tasks.workunit.client.1.smithi149.stdout:4/993: link d4/d6/d63/d2d/dd6/c11f d4/d6/d63/d2d/c14c 0 2024-09-21T11:39:24.258 INFO:tasks.workunit.client.1.smithi149.stdout:0/902: rename dd/d35/l58 to dd/d1a/d1b/d72/d78/dc4/d3a/d121/l127 0 2024-09-21T11:39:24.261 INFO:tasks.workunit.client.0.smithi118.stdout:4/292: unlink d2/d6/de/f5c 0 2024-09-21T11:39:24.263 INFO:tasks.workunit.client.0.smithi118.stdout:2/277: mkdir de/d16/d1c/d65 0 2024-09-21T11:39:24.265 INFO:tasks.workunit.client.0.smithi118.stdout:0/695: fsync d5/d34/f3c 0 2024-09-21T11:39:24.266 INFO:tasks.workunit.client.0.smithi118.stdout:0/696: chown d5/d10/d1e/f6e 1005963 1 2024-09-21T11:39:24.266 INFO:tasks.workunit.client.1.smithi149.stdout:0/903: dwrite dd/d1a/d5a/d106/f109 [0,4194304] 0 2024-09-21T11:39:24.266 INFO:tasks.workunit.client.1.smithi149.stdout:1/897: symlink d2/dd/d35/l121 0 2024-09-21T11:39:24.268 INFO:tasks.workunit.client.1.smithi149.stdout:6/883: dread d8/d32/d37/d28/d2f/f8e [0,4194304] 0 2024-09-21T11:39:24.270 INFO:tasks.workunit.client.1.smithi149.stdout:6/884: read d8/d32/f55 [757278,2391] 0 2024-09-21T11:39:24.270 INFO:tasks.workunit.client.0.smithi118.stdout:6/320: rename d8/d14/d4a to d8/d48/d6c 0 2024-09-21T11:39:24.271 INFO:tasks.workunit.client.0.smithi118.stdout:7/377: creat d0/d3/d1d/f79 x:0 0 0 2024-09-21T11:39:24.272 INFO:tasks.workunit.client.1.smithi149.stdout:6/885: fsync d8/da/d2c/d52/d5e/d9b/fe2 0 2024-09-21T11:39:24.275 INFO:tasks.workunit.client.0.smithi118.stdout:5/328: unlink d0/f2e 0 2024-09-21T11:39:24.277 INFO:tasks.workunit.client.1.smithi149.stdout:9/921: rename d18/f101 to d18/d36/d3c/d47/d76/d97/f124 0 2024-09-21T11:39:24.280 INFO:tasks.workunit.client.1.smithi149.stdout:0/904: fsync dd/d1a/d1b/f124 0 2024-09-21T11:39:24.282 INFO:tasks.workunit.client.1.smithi149.stdout:1/898: dread d2/d5/fa7 [0,4194304] 0 2024-09-21T11:39:24.282 INFO:tasks.workunit.client.0.smithi118.stdout:5/329: dwrite d0/d6c/d25/f43 [4194304,4194304] 0 2024-09-21T11:39:24.284 INFO:tasks.workunit.client.0.smithi118.stdout:4/293: unlink d2/d6/de/d1c/f2e 0 2024-09-21T11:39:24.286 INFO:tasks.workunit.client.0.smithi118.stdout:0/697: creat d5/d34/d44/d87/d9a/feb x:0 0 0 2024-09-21T11:39:24.287 INFO:tasks.workunit.client.1.smithi149.stdout:4/994: write d4/d6/f56 [4887509,90094] 0 2024-09-21T11:39:24.293 INFO:tasks.workunit.client.0.smithi118.stdout:7/378: readlink d0/d3/la 0 2024-09-21T11:39:24.295 INFO:tasks.workunit.client.1.smithi149.stdout:4/995: dwrite d4/d6/d63/d78/d98/dee/d11e/f13b [0,4194304] 0 2024-09-21T11:39:24.296 INFO:tasks.workunit.client.1.smithi149.stdout:4/996: fsync d4/d6/d63/d2d/dd6/d32/d4a/f61 0 2024-09-21T11:39:24.297 INFO:tasks.workunit.client.0.smithi118.stdout:6/321: dwrite d8/d14/f63 [0,4194304] 0 2024-09-21T11:39:24.299 INFO:tasks.workunit.client.1.smithi149.stdout:4/997: write d4/d6/d63/d15/d30/d6b/fb1 [198572,127880] 0 2024-09-21T11:39:24.300 INFO:tasks.workunit.client.0.smithi118.stdout:3/325: truncate d5/d1d/d1b/d24/f38 601316 0 2024-09-21T11:39:24.300 INFO:tasks.workunit.client.1.smithi149.stdout:9/922: symlink d18/d19/d1a/d2f/d5f/l125 0 2024-09-21T11:39:24.303 INFO:tasks.workunit.client.0.smithi118.stdout:3/326: write d5/d1d/f16 [60093,115412] 0 2024-09-21T11:39:24.308 INFO:tasks.workunit.client.0.smithi118.stdout:0/698: dread d5/d10/d1e/d21/db3/dbe/fd0 [0,4194304] 0 2024-09-21T11:39:24.309 INFO:tasks.workunit.client.0.smithi118.stdout:5/330: creat d0/db/f72 x:0 0 0 2024-09-21T11:39:24.311 INFO:tasks.workunit.client.0.smithi118.stdout:4/294: creat d2/d6/dd/d35/f6c x:0 0 0 2024-09-21T11:39:24.311 INFO:tasks.workunit.client.1.smithi149.stdout:6/886: getdents d8/d32/d37/d28/d10e 0 2024-09-21T11:39:24.312 INFO:tasks.workunit.client.1.smithi149.stdout:6/887: write d8/da/d3d/f10a [1007909,78268] 0 2024-09-21T11:39:24.316 INFO:tasks.workunit.client.1.smithi149.stdout:4/998: dread - d4/d6/d63/d15/d30/d6b/daa/de6/f109 zero size 2024-09-21T11:39:24.317 INFO:tasks.workunit.client.0.smithi118.stdout:3/327: symlink d5/d28/d33/l7a 0 2024-09-21T11:39:24.318 INFO:tasks.workunit.client.0.smithi118.stdout:3/328: write d5/d28/f3b [3685495,8570] 0 2024-09-21T11:39:24.319 INFO:tasks.workunit.client.0.smithi118.stdout:3/329: fsync d5/d1d/f41 0 2024-09-21T11:39:24.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:24 smithi118 ceph-mon[28757]: pgmap v27: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 81 MiB/s rd, 220 MiB/s wr, 414 op/s 2024-09-21T11:39:24.325 INFO:tasks.workunit.client.0.smithi118.stdout:3/330: dread d5/d28/d33/d4a/f4f [0,4194304] 0 2024-09-21T11:39:24.326 INFO:tasks.workunit.client.0.smithi118.stdout:5/331: truncate d0/db/d35/da/f51 645247 0 2024-09-21T11:39:24.326 INFO:tasks.workunit.client.1.smithi149.stdout:1/899: dwrite d2/dd/d2e/d4c/f75 [0,4194304] 0 2024-09-21T11:39:24.332 INFO:tasks.workunit.client.0.smithi118.stdout:1/392: rename d6/de/d16/d3f/d50/d54/c3e to d6/c76 0 2024-09-21T11:39:24.333 INFO:tasks.workunit.client.1.smithi149.stdout:4/999: dread d4/d6/d63/d15/d30/f53 [0,4194304] 0 2024-09-21T11:39:24.333 INFO:tasks.workunit.client.1.smithi149.stdout:1/900: dwrite d2/dd/d2e/d4c/f75 [0,4194304] 0 2024-09-21T11:39:24.333 INFO:tasks.workunit.client.1.smithi149.stdout:0/905: link dd/d1a/cd5 dd/d1a/d1b/d72/d78/d8b/d98/c128 0 2024-09-21T11:39:24.334 INFO:tasks.workunit.client.1.smithi149.stdout:0/906: fdatasync dd/d1a/d1b/d72/d78/f123 0 2024-09-21T11:39:24.336 INFO:tasks.workunit.client.0.smithi118.stdout:6/322: symlink d8/d48/d5f/d6b/l6d 0 2024-09-21T11:39:24.337 INFO:tasks.workunit.client.1.smithi149.stdout:0/907: write dd/d1a/d1b/d72/d78/dc4/f42 [4806032,20597] 0 2024-09-21T11:39:24.337 INFO:tasks.workunit.client.0.smithi118.stdout:6/323: chown d8/d48/d6c 13875 1 2024-09-21T11:39:24.338 INFO:tasks.workunit.client.1.smithi149.stdout:0/908: write dd/d32/dbe/f100 [167318,100057] 0 2024-09-21T11:39:24.339 INFO:tasks.workunit.client.1.smithi149.stdout:9/923: mknod d18/d19/d29/d6a/c126 0 2024-09-21T11:39:24.342 INFO:tasks.workunit.client.1.smithi149.stdout:1/901: mknod d2/d107/c122 0 2024-09-21T11:39:24.343 INFO:tasks.workunit.client.0.smithi118.stdout:0/699: mknod d5/d10/d1e/d21/db3/dbe/dd7/cec 0 2024-09-21T11:39:24.346 INFO:tasks.workunit.client.0.smithi118.stdout:3/331: unlink d5/d1d/f25 0 2024-09-21T11:39:24.348 INFO:tasks.workunit.client.1.smithi149.stdout:6/888: dwrite d8/d32/d37/d28/f74 [0,4194304] 0 2024-09-21T11:39:24.349 INFO:tasks.workunit.client.1.smithi149.stdout:9/924: mkdir d18/d19/d1a/df1/d127 0 2024-09-21T11:39:24.352 INFO:tasks.workunit.client.1.smithi149.stdout:1/902: creat d2/dd/d35/d1c/d37/f123 x:0 0 0 2024-09-21T11:39:24.354 INFO:tasks.workunit.client.0.smithi118.stdout:9/412: rename d0/d4/le to d0/d4/d45/d72/l9d 0 2024-09-21T11:39:24.357 INFO:tasks.workunit.client.1.smithi149.stdout:6/889: rename d8/d32/d37/d28/d2e/f3b to d8/d32/d37/d2b/d51/da7/f12a 0 2024-09-21T11:39:24.359 INFO:tasks.workunit.client.0.smithi118.stdout:1/393: dwrite d6/de/f25 [4194304,4194304] 0 2024-09-21T11:39:24.360 INFO:tasks.workunit.client.0.smithi118.stdout:6/324: write d8/f1a [7337351,77078] 0 2024-09-21T11:39:24.361 INFO:tasks.workunit.client.0.smithi118.stdout:6/325: stat d8/d48/d45/f4d 0 2024-09-21T11:39:24.362 INFO:tasks.workunit.client.1.smithi149.stdout:9/925: rename d18/d36/d3c/d47/daf to d18/d19/d1a/d2f/d53/d64/d128 0 2024-09-21T11:39:24.364 INFO:tasks.workunit.client.0.smithi118.stdout:0/700: fdatasync d5/d34/d44/d7c/fe8 0 2024-09-21T11:39:24.364 INFO:tasks.workunit.client.1.smithi149.stdout:6/890: mkdir d8/da/d2c/d102/d117/d10b/d12b 0 2024-09-21T11:39:24.366 INFO:tasks.workunit.client.0.smithi118.stdout:0/701: chown d5/d10/d1e/d23/fca 1925602 1 2024-09-21T11:39:24.368 INFO:tasks.workunit.client.0.smithi118.stdout:3/332: creat d5/d1d/d1b/d50/d5c/f7b x:0 0 0 2024-09-21T11:39:24.368 INFO:tasks.workunit.client.0.smithi118.stdout:0/702: write d5/d29/d53/f63 [2151815,4820] 0 2024-09-21T11:39:24.370 INFO:tasks.workunit.client.0.smithi118.stdout:6/326: dwrite d8/d46/f52 [0,4194304] 0 2024-09-21T11:39:24.370 INFO:tasks.workunit.client.1.smithi149.stdout:8/840: sync 2024-09-21T11:39:24.370 INFO:tasks.workunit.client.1.smithi149.stdout:3/989: sync 2024-09-21T11:39:24.371 INFO:tasks.workunit.client.1.smithi149.stdout:3/990: truncate d6/d1f/d47/d37/d3a/f121 251411 0 2024-09-21T11:39:24.374 INFO:tasks.workunit.client.1.smithi149.stdout:1/903: rename d2/d5/d8/dc1 to d2/dd/d35/d1c/d7a/d10e/dc0/d124 0 2024-09-21T11:39:24.374 INFO:tasks.workunit.client.1.smithi149.stdout:1/904: chown d2/dd/d35/d7c/fb4 108 1 2024-09-21T11:39:24.380 INFO:tasks.workunit.client.0.smithi118.stdout:8/672: rename d2/dc/d10/d6a/fdd to d2/dc/d10/d2e/d9b/fe9 0 2024-09-21T11:39:24.381 INFO:tasks.workunit.client.1.smithi149.stdout:9/926: mkdir d18/d129 0 2024-09-21T11:39:24.381 INFO:tasks.workunit.client.0.smithi118.stdout:9/413: fdatasync d0/d4/f29 0 2024-09-21T11:39:24.386 INFO:tasks.workunit.client.1.smithi149.stdout:0/909: dwrite dd/d1a/d5a/f95 [4194304,4194304] 0 2024-09-21T11:39:24.386 INFO:tasks.workunit.client.0.smithi118.stdout:1/394: mknod d6/de/d16/d3f/c77 0 2024-09-21T11:39:24.387 INFO:tasks.workunit.client.1.smithi149.stdout:0/910: write dd/d1a/d1b/d72/d78/d8b/d98/daa/fe3 [5106604,75066] 0 2024-09-21T11:39:24.388 INFO:tasks.workunit.client.0.smithi118.stdout:1/395: write d6/d2a/f69 [962095,21453] 0 2024-09-21T11:39:24.388 INFO:tasks.workunit.client.0.smithi118.stdout:5/332: creat d0/d6c/d25/d50/f73 x:0 0 0 2024-09-21T11:39:24.389 INFO:tasks.workunit.client.1.smithi149.stdout:8/841: getdents d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1 0 2024-09-21T11:39:24.391 INFO:tasks.workunit.client.1.smithi149.stdout:8/842: dread - d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/fd8 zero size 2024-09-21T11:39:24.393 INFO:tasks.workunit.client.0.smithi118.stdout:3/333: symlink d5/d28/d33/d4a/l7c 0 2024-09-21T11:39:24.395 INFO:tasks.workunit.client.0.smithi118.stdout:0/703: rmdir d5/d29/d68 39 2024-09-21T11:39:24.399 INFO:tasks.workunit.client.1.smithi149.stdout:0/911: read f8 [1003337,62332] 0 2024-09-21T11:39:24.404 INFO:tasks.workunit.client.1.smithi149.stdout:8/843: rename d3/d33/d34/d55/d95/cdb to d3/d33/d34/d55/d5e/d9e/c121 0 2024-09-21T11:39:24.407 INFO:tasks.workunit.client.1.smithi149.stdout:0/912: read dd/d32/f37 [872745,25237] 0 2024-09-21T11:39:24.408 INFO:tasks.workunit.client.0.smithi118.stdout:7/379: rename d0/d3/d14/f52 to d0/d3/d1d/d35/f7a 0 2024-09-21T11:39:24.409 INFO:tasks.workunit.client.0.smithi118.stdout:7/380: chown d0/d3/d1d 8 1 2024-09-21T11:39:24.409 INFO:tasks.workunit.client.0.smithi118.stdout:8/673: mknod d2/dc/d49/d84/d99/cea 0 2024-09-21T11:39:24.410 INFO:tasks.workunit.client.1.smithi149.stdout:6/891: truncate d8/da/d2c/d102/d117/fea 188987 0 2024-09-21T11:39:24.410 INFO:tasks.workunit.client.1.smithi149.stdout:1/905: dwrite d2/dd/d35/d1c/d41/d51/fdc [0,4194304] 0 2024-09-21T11:39:24.411 INFO:tasks.workunit.client.1.smithi149.stdout:8/844: mknod d3/d33/d34/d55/d5e/c122 0 2024-09-21T11:39:24.413 INFO:tasks.workunit.client.1.smithi149.stdout:0/913: chown dd/d1a/d1b/d72/d78/lfa 10 1 2024-09-21T11:39:24.414 INFO:tasks.workunit.client.1.smithi149.stdout:0/914: chown dd/d1a/d1b/d50 19 1 2024-09-21T11:39:24.414 INFO:tasks.workunit.client.1.smithi149.stdout:9/927: write d18/d19/d1a/d2f/faa [883851,123734] 0 2024-09-21T11:39:24.415 INFO:tasks.workunit.client.1.smithi149.stdout:8/845: truncate d3/d33/d34/d55/d5e/d9e/dc2/d3a/f3d 2091970 0 2024-09-21T11:39:24.416 INFO:tasks.workunit.client.1.smithi149.stdout:8/846: readlink d3/d12/d6e/lf7 0 2024-09-21T11:39:24.417 INFO:tasks.workunit.client.1.smithi149.stdout:9/928: write d18/d1c/f4e [2764596,45542] 0 2024-09-21T11:39:24.417 INFO:tasks.workunit.client.1.smithi149.stdout:9/929: chown d18/d4c 404 1 2024-09-21T11:39:24.420 INFO:tasks.workunit.client.0.smithi118.stdout:0/704: mknod d5/d10/d1e/d21/db3/ced 0 2024-09-21T11:39:24.423 INFO:tasks.workunit.client.1.smithi149.stdout:1/906: dread d2/dd/d35/d1c/d41/d51/ffd [0,4194304] 0 2024-09-21T11:39:24.423 INFO:tasks.workunit.client.1.smithi149.stdout:8/847: creat d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/f123 x:0 0 0 2024-09-21T11:39:24.424 INFO:tasks.workunit.client.0.smithi118.stdout:4/295: rmdir d2/d6/de/d1c/d23/d5f 0 2024-09-21T11:39:24.426 INFO:tasks.workunit.client.1.smithi149.stdout:8/848: dread - d3/d33/d34/d55/d5e/d9e/dc2/d21/fff zero size 2024-09-21T11:39:24.426 INFO:tasks.workunit.client.1.smithi149.stdout:0/915: creat dd/f129 x:0 0 0 2024-09-21T11:39:24.427 INFO:tasks.workunit.client.1.smithi149.stdout:9/930: dwrite d18/d19/d29/d39/dfb/f119 [0,4194304] 0 2024-09-21T11:39:24.428 INFO:tasks.workunit.client.0.smithi118.stdout:1/396: rename d6/d33/f6e to d6/d2a/d3d/f78 0 2024-09-21T11:39:24.431 INFO:tasks.workunit.client.1.smithi149.stdout:1/907: chown d2/dd/d35/d1c/d2c/c53 239 1 2024-09-21T11:39:24.433 INFO:tasks.workunit.client.1.smithi149.stdout:9/931: dread d18/d19/d29/d39/dfb/f119 [0,4194304] 0 2024-09-21T11:39:24.434 INFO:tasks.workunit.client.0.smithi118.stdout:7/381: symlink d0/d3/d1d/l7b 0 2024-09-21T11:39:24.435 INFO:tasks.workunit.client.0.smithi118.stdout:5/333: write d0/f1b [1257849,21276] 0 2024-09-21T11:39:24.437 INFO:tasks.workunit.client.1.smithi149.stdout:1/908: creat d2/d5/db3/dd9/f125 x:0 0 0 2024-09-21T11:39:24.438 INFO:tasks.workunit.client.1.smithi149.stdout:6/892: dread d8/da/d2c/d127/d9a/faf [0,4194304] 0 2024-09-21T11:39:24.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/909: fsync d2/dd/d35/d1c/d7a/d10e/fbd 0 2024-09-21T11:39:24.439 INFO:tasks.workunit.client.0.smithi118.stdout:9/414: creat d0/d20/d4c/d5f/d89/f9e x:0 0 0 2024-09-21T11:39:24.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/910: stat d2/d5/d3d/d88/f63 0 2024-09-21T11:39:24.439 INFO:tasks.workunit.client.1.smithi149.stdout:6/893: dread - d8/da/d2c/d102/d117/fef zero size 2024-09-21T11:39:24.440 INFO:tasks.workunit.client.0.smithi118.stdout:6/327: truncate d8/d14/d33/f62 45884 0 2024-09-21T11:39:24.442 INFO:tasks.workunit.client.0.smithi118.stdout:9/415: write d0/d20/d71/f95 [576845,87887] 0 2024-09-21T11:39:24.443 INFO:tasks.workunit.client.1.smithi149.stdout:9/932: unlink d18/d1c/f4e 0 2024-09-21T11:39:24.444 INFO:tasks.workunit.client.0.smithi118.stdout:3/334: dwrite d5/d28/d33/d4a/f4f [0,4194304] 0 2024-09-21T11:39:24.446 INFO:tasks.workunit.client.1.smithi149.stdout:0/916: link dd/d1a/d1b/d72/d78/dc4/f5c dd/d1a/d5a/d106/f12a 0 2024-09-21T11:39:24.447 INFO:tasks.workunit.client.0.smithi118.stdout:7/382: dwrite d0/d3/d14/f15 [0,4194304] 0 2024-09-21T11:39:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:24 smithi149 ceph-mon[36123]: pgmap v27: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 81 MiB/s rd, 220 MiB/s wr, 414 op/s 2024-09-21T11:39:24.455 INFO:tasks.workunit.client.1.smithi149.stdout:6/894: mknod d8/d32/d37/d2b/d7e/c12c 0 2024-09-21T11:39:24.457 INFO:tasks.workunit.client.0.smithi118.stdout:7/383: dwrite d0/d3/d1d/d35/f59 [0,4194304] 0 2024-09-21T11:39:24.458 INFO:tasks.workunit.client.1.smithi149.stdout:0/917: symlink dd/d1a/d1b/d72/d78/d8b/l12b 0 2024-09-21T11:39:24.459 INFO:tasks.workunit.client.0.smithi118.stdout:8/674: dwrite d2/f7 [4194304,4194304] 0 2024-09-21T11:39:24.460 INFO:tasks.workunit.client.0.smithi118.stdout:8/675: truncate d2/f72 1473931 0 2024-09-21T11:39:24.462 INFO:tasks.workunit.client.1.smithi149.stdout:6/895: chown d8/d32/d37/d28/l77 1 1 2024-09-21T11:39:24.462 INFO:tasks.workunit.client.0.smithi118.stdout:8/676: chown d2/dc/d16/d46/d4c/d63/f9d 6524 1 2024-09-21T11:39:24.463 INFO:tasks.workunit.client.1.smithi149.stdout:6/896: chown d8/d32/d37/d28/d2f/d6a/d72/f7f 280212327 1 2024-09-21T11:39:24.467 INFO:tasks.workunit.client.0.smithi118.stdout:3/335: creat d5/d1d/d1b/d4c/f7d x:0 0 0 2024-09-21T11:39:24.471 INFO:tasks.workunit.client.1.smithi149.stdout:9/933: link d18/d36/d3c/f113 d18/d36/d3c/d47/d76/f12a 0 2024-09-21T11:39:24.472 INFO:tasks.workunit.client.0.smithi118.stdout:0/705: creat d5/d34/d44/d87/de7/fee x:0 0 0 2024-09-21T11:39:24.475 INFO:tasks.workunit.client.1.smithi149.stdout:0/918: link dd/d2d/f56 dd/d32/db2/f12c 0 2024-09-21T11:39:24.476 INFO:tasks.workunit.client.1.smithi149.stdout:0/919: readlink dd/l12 0 2024-09-21T11:39:24.476 INFO:tasks.workunit.client.0.smithi118.stdout:7/384: readlink d0/d3/l19 0 2024-09-21T11:39:24.477 INFO:tasks.workunit.client.1.smithi149.stdout:0/920: chown dd/d1a/d1b/d72/ca3 914110624 1 2024-09-21T11:39:24.478 INFO:tasks.workunit.client.0.smithi118.stdout:5/334: mkdir d0/db/d35/d74 0 2024-09-21T11:39:24.484 INFO:tasks.workunit.client.0.smithi118.stdout:6/328: symlink d8/d14/l6e 0 2024-09-21T11:39:24.486 INFO:tasks.workunit.client.0.smithi118.stdout:5/335: dwrite d0/d6c/d67/f70 [0,4194304] 0 2024-09-21T11:39:24.487 INFO:tasks.workunit.client.0.smithi118.stdout:3/336: chown d5/d1d/d1b/d24/l2f 9 1 2024-09-21T11:39:24.489 INFO:tasks.workunit.client.0.smithi118.stdout:3/337: chown d5/d1d/d1b/d4c/f56 1785288 1 2024-09-21T11:39:24.489 INFO:tasks.workunit.client.1.smithi149.stdout:0/921: symlink dd/d1a/d1b/d72/d78/dc4/d3a/l12d 0 2024-09-21T11:39:24.490 INFO:tasks.workunit.client.1.smithi149.stdout:0/922: write dd/d1a/d1b/d72/d85/f10c [226619,29838] 0 2024-09-21T11:39:24.491 INFO:tasks.workunit.client.0.smithi118.stdout:3/338: write d5/d1d/f43 [101360,17599] 0 2024-09-21T11:39:24.492 INFO:tasks.workunit.client.0.smithi118.stdout:4/296: creat d2/d65/f6d x:0 0 0 2024-09-21T11:39:24.494 INFO:tasks.workunit.client.0.smithi118.stdout:1/397: creat d6/f79 x:0 0 0 2024-09-21T11:39:24.495 INFO:tasks.workunit.client.1.smithi149.stdout:1/911: write d2/d5/fc2 [3785373,88898] 0 2024-09-21T11:39:24.495 INFO:tasks.workunit.client.0.smithi118.stdout:5/336: dwrite d0/fd [0,4194304] 0 2024-09-21T11:39:24.496 INFO:tasks.workunit.client.1.smithi149.stdout:0/923: dread - dd/d1a/d1b/d81/f115 zero size 2024-09-21T11:39:24.498 INFO:tasks.workunit.client.0.smithi118.stdout:7/385: symlink d0/l7c 0 2024-09-21T11:39:24.502 INFO:tasks.workunit.client.1.smithi149.stdout:6/897: dwrite d8/d32/d37/d28/d2f/d6a/f95 [0,4194304] 0 2024-09-21T11:39:24.502 INFO:tasks.workunit.client.1.smithi149.stdout:0/924: dread - dd/d1a/fcb zero size 2024-09-21T11:39:24.503 INFO:tasks.workunit.client.0.smithi118.stdout:6/329: symlink d8/d48/d45/d61/l6f 0 2024-09-21T11:39:24.506 INFO:tasks.workunit.client.1.smithi149.stdout:9/934: write d18/d19/d1a/d2f/d53/f62 [441922,26757] 0 2024-09-21T11:39:24.509 INFO:tasks.workunit.client.1.smithi149.stdout:9/935: chown d18/d19/d1a/df1/f10d 179150 1 2024-09-21T11:39:24.514 INFO:tasks.workunit.client.0.smithi118.stdout:4/297: creat d2/d6/dd/d35/f6e x:0 0 0 2024-09-21T11:39:24.515 INFO:tasks.workunit.client.1.smithi149.stdout:1/912: rmdir d2/d107/d101 0 2024-09-21T11:39:24.517 INFO:tasks.workunit.client.0.smithi118.stdout:1/398: mkdir d6/d33/d7a 0 2024-09-21T11:39:24.517 INFO:tasks.workunit.client.1.smithi149.stdout:0/925: mknod dd/d1a/d1b/d81/c12e 0 2024-09-21T11:39:24.519 INFO:tasks.workunit.client.1.smithi149.stdout:0/926: write dd/d1a/d5a/d65/fc7 [4492219,25731] 0 2024-09-21T11:39:24.520 INFO:tasks.workunit.client.1.smithi149.stdout:3/991: sync 2024-09-21T11:39:24.520 INFO:tasks.workunit.client.1.smithi149.stdout:9/936: unlink d18/d19/d1a/d2f/d33/d91/c120 0 2024-09-21T11:39:24.521 INFO:tasks.workunit.client.1.smithi149.stdout:3/992: dread - d6/d1f/d47/d37/f12d zero size 2024-09-21T11:39:24.521 INFO:tasks.workunit.client.1.smithi149.stdout:6/898: creat d8/da/d120/f12d x:0 0 0 2024-09-21T11:39:24.522 INFO:tasks.workunit.client.1.smithi149.stdout:3/993: dread - d6/d1f/d47/d37/d3f/dc5/d106/f124 zero size 2024-09-21T11:39:24.522 INFO:tasks.workunit.client.0.smithi118.stdout:7/386: rename d0/d3/d13/d3d/d3e/f78 to d0/d3/d1d/f7d 0 2024-09-21T11:39:24.524 INFO:tasks.workunit.client.1.smithi149.stdout:1/913: creat d2/dd/d35/d1c/d7a/d10e/dc0/d124/dd6/f126 x:0 0 0 2024-09-21T11:39:24.526 INFO:tasks.workunit.client.0.smithi118.stdout:6/330: mkdir d8/d48/d45/d61/d70 0 2024-09-21T11:39:24.527 INFO:tasks.workunit.client.0.smithi118.stdout:9/416: getdents d0/d20/d4c 0 2024-09-21T11:39:24.527 INFO:tasks.workunit.client.0.smithi118.stdout:9/417: readlink d0/d4/d38/l49 0 2024-09-21T11:39:24.528 INFO:tasks.workunit.client.1.smithi149.stdout:0/927: mknod dd/d1a/d1b/d72/d78/dbb/c12f 0 2024-09-21T11:39:24.531 INFO:tasks.workunit.client.0.smithi118.stdout:3/339: chown d5/d1d/d1b/d50/l75 62402 1 2024-09-21T11:39:24.531 INFO:tasks.workunit.client.1.smithi149.stdout:6/899: mkdir d8/da/d123/d12e 0 2024-09-21T11:39:24.532 INFO:tasks.workunit.client.1.smithi149.stdout:6/900: readlink d8/d32/d37/d28/d87/da4/lbb 0 2024-09-21T11:39:24.533 INFO:tasks.workunit.client.1.smithi149.stdout:3/994: rename d6/d1f/d47/ld1 to d6/d5f/d60/d88/l153 0 2024-09-21T11:39:24.534 INFO:tasks.workunit.client.0.smithi118.stdout:5/337: dread d0/db/f16 [0,4194304] 0 2024-09-21T11:39:24.534 INFO:tasks.workunit.client.1.smithi149.stdout:8/849: sync 2024-09-21T11:39:24.534 INFO:tasks.workunit.client.1.smithi149.stdout:1/914: symlink d2/dd/d35/d1c/d41/d74/l127 0 2024-09-21T11:39:24.536 INFO:tasks.workunit.client.0.smithi118.stdout:9/418: dwrite d0/d20/f64 [0,4194304] 0 2024-09-21T11:39:24.536 INFO:tasks.workunit.client.1.smithi149.stdout:8/850: write d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/ff4 [420378,46420] 0 2024-09-21T11:39:24.538 INFO:tasks.workunit.client.1.smithi149.stdout:8/851: write d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/f56 [2128858,57305] 0 2024-09-21T11:39:24.539 INFO:tasks.workunit.client.0.smithi118.stdout:9/419: fdatasync d0/d20/d4c/d5f/d6c/d88/d4d/f90 0 2024-09-21T11:39:24.541 INFO:tasks.workunit.client.1.smithi149.stdout:6/901: creat d8/da/d2c/d52/d5e/d9b/f12f x:0 0 0 2024-09-21T11:39:24.542 INFO:tasks.workunit.client.1.smithi149.stdout:1/915: dwrite d2/dd/d35/d1c/d37/da3/fc6 [4194304,4194304] 0 2024-09-21T11:39:24.550 INFO:tasks.workunit.client.1.smithi149.stdout:8/852: chown d3/d33/d34/fbe 1 1 2024-09-21T11:39:24.551 INFO:tasks.workunit.client.0.smithi118.stdout:0/706: truncate d5/d29/d68/d7b/db7/f78 946233 0 2024-09-21T11:39:24.552 INFO:tasks.workunit.client.0.smithi118.stdout:8/677: getdents d2/dc/d16/d46/d4c/db0 0 2024-09-21T11:39:24.555 INFO:tasks.workunit.client.1.smithi149.stdout:9/937: dwrite d18/d19/d1a/d2f/d5f/f80 [0,4194304] 0 2024-09-21T11:39:24.558 INFO:tasks.workunit.client.0.smithi118.stdout:1/399: rename d6/de/d16/l2f to d6/de/d16/d3f/l7b 0 2024-09-21T11:39:24.558 INFO:tasks.workunit.client.1.smithi149.stdout:0/928: creat dd/d1a/d1b/d72/d78/dc4/d3a/dd1/f130 x:0 0 0 2024-09-21T11:39:24.559 INFO:tasks.workunit.client.0.smithi118.stdout:1/400: chown d6/de/d16/d3f/d50/l67 6 1 2024-09-21T11:39:24.560 INFO:tasks.workunit.client.0.smithi118.stdout:9/420: creat d0/d4/d45/d72/f9f x:0 0 0 2024-09-21T11:39:24.561 INFO:tasks.workunit.client.0.smithi118.stdout:7/387: mkdir d0/d3/d1d/d35/d57/d7e 0 2024-09-21T11:39:24.563 INFO:tasks.workunit.client.0.smithi118.stdout:6/331: symlink d8/d14/l71 0 2024-09-21T11:39:24.563 INFO:tasks.workunit.client.0.smithi118.stdout:7/388: chown d0/d3/d1d/d35/f43 334503 1 2024-09-21T11:39:24.564 INFO:tasks.workunit.client.1.smithi149.stdout:9/938: creat d18/d19/d1a/d2f/d30/d54/f12b x:0 0 0 2024-09-21T11:39:24.566 INFO:tasks.workunit.client.1.smithi149.stdout:9/939: write d18/d19/d1a/d2f/d30/d54/f12b [92098,3554] 0 2024-09-21T11:39:24.567 INFO:tasks.workunit.client.1.smithi149.stdout:0/929: chown dd/c14 23016 1 2024-09-21T11:39:24.568 INFO:tasks.workunit.client.1.smithi149.stdout:8/853: symlink d3/d12/db1/de5/l124 0 2024-09-21T11:39:24.569 INFO:tasks.workunit.client.0.smithi118.stdout:8/678: dread d2/dc/d16/d46/d4c/d63/f4a [0,4194304] 0 2024-09-21T11:39:24.569 INFO:tasks.workunit.client.1.smithi149.stdout:6/902: link d8/d32/d37/d2b/la8 d8/d32/d37/l130 0 2024-09-21T11:39:24.571 INFO:tasks.workunit.client.1.smithi149.stdout:0/930: truncate dd/d1a/d1b/d72/d78/d8b/d98/dbc/fec 893195 0 2024-09-21T11:39:24.572 INFO:tasks.workunit.client.0.smithi118.stdout:9/421: creat d0/d20/d4c/d5f/d68/d7c/fa0 x:0 0 0 2024-09-21T11:39:24.573 INFO:tasks.workunit.client.0.smithi118.stdout:9/422: chown d0/d20/d4c/d5f/d68/f83 21 1 2024-09-21T11:39:24.574 INFO:tasks.workunit.client.0.smithi118.stdout:6/332: mkdir d8/d48/d72 0 2024-09-21T11:39:24.574 INFO:tasks.workunit.client.0.smithi118.stdout:9/423: readlink d0/d20/d4c/d5f/d6c/d88/l6f 0 2024-09-21T11:39:24.575 INFO:tasks.workunit.client.0.smithi118.stdout:3/340: creat d5/f7e x:0 0 0 2024-09-21T11:39:24.578 INFO:tasks.workunit.client.1.smithi149.stdout:0/931: creat dd/d32/dbe/ddc/f131 x:0 0 0 2024-09-21T11:39:24.579 INFO:tasks.workunit.client.1.smithi149.stdout:8/854: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d90/f92 [0,4194304] 0 2024-09-21T11:39:24.580 INFO:tasks.workunit.client.0.smithi118.stdout:6/333: dwrite d8/d14/f1e [0,4194304] 0 2024-09-21T11:39:24.581 INFO:tasks.workunit.client.1.smithi149.stdout:1/916: dread d2/dd/d35/d1c/d41/d51/d90/f9b [0,4194304] 0 2024-09-21T11:39:24.581 INFO:tasks.workunit.client.1.smithi149.stdout:6/903: dread d8/d32/d37/d28/d2f/f8e [0,4194304] 0 2024-09-21T11:39:24.582 INFO:tasks.workunit.client.0.smithi118.stdout:0/707: rename d5/d10/d1e/d21/db3/dbe/cc3 to d5/d10/d1e/d33/dd4/cef 0 2024-09-21T11:39:24.583 INFO:tasks.workunit.client.1.smithi149.stdout:6/904: chown d8/da/d2c/d127/d60/dc3/l100 9 1 2024-09-21T11:39:24.584 INFO:tasks.workunit.client.0.smithi118.stdout:5/338: getdents d0/db/d26 0 2024-09-21T11:39:24.586 INFO:tasks.workunit.client.1.smithi149.stdout:1/917: dread d2/dd/d35/d1c/d2c/f8b [0,4194304] 0 2024-09-21T11:39:24.586 INFO:tasks.workunit.client.1.smithi149.stdout:0/932: rename dd/f19 to dd/d1a/d1b/d72/d78/d8b/d98/dbc/df1/f132 0 2024-09-21T11:39:24.588 INFO:tasks.workunit.client.0.smithi118.stdout:9/424: write d0/d20/d4c/d5f/d6c/d88/d4d/f9a [179235,43216] 0 2024-09-21T11:39:24.593 INFO:tasks.workunit.client.1.smithi149.stdout:1/918: dwrite d2/d5/d65/f86 [4194304,4194304] 0 2024-09-21T11:39:24.596 INFO:tasks.workunit.client.1.smithi149.stdout:3/995: sync 2024-09-21T11:39:24.625 INFO:tasks.workunit.client.1.smithi149.stdout:8/855: symlink d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/l125 0 2024-09-21T11:39:24.627 INFO:tasks.workunit.client.0.smithi118.stdout:8/679: link d2/dc/d10/fe3 d2/dc/d49/d84/feb 0 2024-09-21T11:39:24.630 INFO:tasks.workunit.client.0.smithi118.stdout:5/339: dwrite d0/d6c/d25/f43 [0,4194304] 0 2024-09-21T11:39:24.632 INFO:tasks.workunit.client.0.smithi118.stdout:4/298: truncate d2/f21 621565 0 2024-09-21T11:39:24.632 INFO:tasks.workunit.client.0.smithi118.stdout:9/425: dwrite d0/fb [0,4194304] 0 2024-09-21T11:39:24.634 INFO:tasks.workunit.client.0.smithi118.stdout:4/299: dread - d2/d6/dd/d35/f48 zero size 2024-09-21T11:39:24.643 INFO:tasks.workunit.client.0.smithi118.stdout:9/426: chown d0/d4/d38/f60 0 1 2024-09-21T11:39:24.840 INFO:tasks.workunit.client.0.smithi118.stdout:0/708: mknod d5/d34/d44/d7c/cf0 0 2024-09-21T11:39:24.840 INFO:tasks.workunit.client.0.smithi118.stdout:0/709: chown d5/d34/f3c 1097826 1 2024-09-21T11:39:24.843 INFO:tasks.workunit.client.1.smithi149.stdout:6/905: rename d8/da/d2c/d52/fb6 to d8/da/d2c/d127/d60/f131 0 2024-09-21T11:39:24.845 INFO:tasks.workunit.client.1.smithi149.stdout:9/940: dwrite d18/d19/d1a/d2f/d53/fd1 [0,4194304] 0 2024-09-21T11:39:24.845 INFO:tasks.workunit.client.0.smithi118.stdout:8/680: mknod d2/d7c/d88/d8f/cec 0 2024-09-21T11:39:24.846 INFO:tasks.workunit.client.1.smithi149.stdout:9/941: chown d18/d19/d1a/d9b/ce4 0 1 2024-09-21T11:39:24.846 INFO:tasks.workunit.client.1.smithi149.stdout:9/942: chown d18/d19/d1a/d2f/faa 24044604 1 2024-09-21T11:39:24.849 INFO:tasks.workunit.client.0.smithi118.stdout:5/340: mknod d0/d6c/c75 0 2024-09-21T11:39:24.855 INFO:tasks.workunit.client.0.smithi118.stdout:9/427: fdatasync d0/f24 0 2024-09-21T11:39:24.858 INFO:tasks.workunit.client.0.smithi118.stdout:4/300: mknod d2/d6/de/d1c/d23/d26/d31/c6f 0 2024-09-21T11:39:24.858 INFO:tasks.workunit.client.0.smithi118.stdout:4/301: chown d2/d6/dd/l5d 2579 1 2024-09-21T11:39:24.863 INFO:tasks.workunit.client.1.smithi149.stdout:3/996: dread d6/d1f/d47/f1e [0,4194304] 0 2024-09-21T11:39:24.876 INFO:tasks.workunit.client.0.smithi118.stdout:8/681: read - d2/dc/d35/fe1 zero size 2024-09-21T11:39:24.877 INFO:tasks.workunit.client.0.smithi118.stdout:4/302: dread f1 [0,4194304] 0 2024-09-21T11:39:24.879 INFO:tasks.workunit.client.1.smithi149.stdout:1/919: dwrite d2/d5/d8/fa6 [0,4194304] 0 2024-09-21T11:39:24.879 INFO:tasks.workunit.client.0.smithi118.stdout:1/401: rename d6/de/l6a to d6/l7c 0 2024-09-21T11:39:24.884 INFO:tasks.workunit.client.0.smithi118.stdout:9/428: read - d0/d20/f6b zero size 2024-09-21T11:39:24.887 INFO:tasks.workunit.client.0.smithi118.stdout:4/303: dwrite d2/d6/de/d1c/d4d/f68 [0,4194304] 0 2024-09-21T11:39:24.890 INFO:tasks.workunit.client.0.smithi118.stdout:0/710: dwrite d5/d34/d44/fa1 [0,4194304] 0 2024-09-21T11:39:24.892 INFO:tasks.workunit.client.0.smithi118.stdout:7/389: rename d0/d3/d13/d3d to d0/d3/d14/d41/d7f 0 2024-09-21T11:39:24.893 INFO:tasks.workunit.client.0.smithi118.stdout:1/402: rmdir d6/d2a/d53 39 2024-09-21T11:39:24.896 INFO:tasks.workunit.client.0.smithi118.stdout:7/390: chown d0/d3/d14/d41/d7f/d3e/l69 8416 1 2024-09-21T11:39:24.899 INFO:tasks.workunit.client.0.smithi118.stdout:8/682: symlink d2/dc/dc1/led 0 2024-09-21T11:39:24.900 INFO:tasks.workunit.client.0.smithi118.stdout:0/711: dwrite d5/d10/d1e/d23/d3a/d90/f99 [0,4194304] 0 2024-09-21T11:39:24.906 INFO:tasks.workunit.client.0.smithi118.stdout:5/341: dread d0/d6c/f8 [0,4194304] 0 2024-09-21T11:39:24.906 INFO:tasks.workunit.client.0.smithi118.stdout:7/391: dwrite d0/d3/d1d/f45 [0,4194304] 0 2024-09-21T11:39:24.907 INFO:tasks.workunit.client.0.smithi118.stdout:5/342: chown d0/l4c 26919 1 2024-09-21T11:39:24.910 INFO:tasks.workunit.client.0.smithi118.stdout:6/334: rename d8/d14/d33/f3f to d8/d48/d5f/f73 0 2024-09-21T11:39:24.912 INFO:tasks.workunit.client.0.smithi118.stdout:6/335: write d8/d46/f52 [3897036,56606] 0 2024-09-21T11:39:24.918 INFO:tasks.workunit.client.0.smithi118.stdout:4/304: dread d2/d6/de/f1e [0,4194304] 0 2024-09-21T11:39:24.922 INFO:tasks.workunit.client.0.smithi118.stdout:0/712: unlink d5/d10/d1e/d23/d3a/d4e/cad 0 2024-09-21T11:39:24.924 INFO:tasks.workunit.client.0.smithi118.stdout:0/713: truncate d5/d10/d1e/d21/f2d 4839321 0 2024-09-21T11:39:24.928 INFO:tasks.workunit.client.0.smithi118.stdout:6/336: mknod d8/d48/d45/c74 0 2024-09-21T11:39:24.931 INFO:tasks.workunit.client.0.smithi118.stdout:9/429: link d0/d4/f27 d0/fa1 0 2024-09-21T11:39:24.934 INFO:tasks.workunit.client.0.smithi118.stdout:8/683: mknod d2/dc/d10/d2e/dba/cee 0 2024-09-21T11:39:24.936 INFO:tasks.workunit.client.0.smithi118.stdout:4/305: creat d2/d65/f70 x:0 0 0 2024-09-21T11:39:24.937 INFO:tasks.workunit.client.0.smithi118.stdout:0/714: creat d5/d10/d1e/d21/ff1 x:0 0 0 2024-09-21T11:39:24.938 INFO:tasks.workunit.client.0.smithi118.stdout:0/715: dread - d5/d10/d1e/d3d/d93/fc9 zero size 2024-09-21T11:39:24.941 INFO:tasks.workunit.client.0.smithi118.stdout:7/392: creat d0/d3/d1d/d35/d70/f80 x:0 0 0 2024-09-21T11:39:24.946 INFO:tasks.workunit.client.0.smithi118.stdout:9/430: rename d0/d20/d4c/d5f/d6c/d88/d4d/f9a to d0/d20/d4c/d5f/d6c/fa2 0 2024-09-21T11:39:24.952 INFO:tasks.workunit.client.0.smithi118.stdout:0/716: read d5/d10/d1e/d20/f26 [3961416,57685] 0 2024-09-21T11:39:24.957 INFO:tasks.workunit.client.0.smithi118.stdout:9/431: symlink d0/d20/d4c/d5f/d66/la3 0 2024-09-21T11:39:24.962 INFO:tasks.workunit.client.0.smithi118.stdout:1/403: dwrite d6/de/d16/f4b [0,4194304] 0 2024-09-21T11:39:24.966 INFO:tasks.workunit.client.0.smithi118.stdout:8/684: creat d2/dc/d35/fef x:0 0 0 2024-09-21T11:39:24.966 INFO:tasks.workunit.client.0.smithi118.stdout:0/717: dread d5/d34/f3c [0,4194304] 0 2024-09-21T11:39:24.968 INFO:tasks.workunit.client.0.smithi118.stdout:9/432: mknod d0/d20/d4c/d5f/d68/ca4 0 2024-09-21T11:39:24.971 INFO:tasks.workunit.client.0.smithi118.stdout:6/337: write d8/f25 [547744,28226] 0 2024-09-21T11:39:24.972 INFO:tasks.workunit.client.0.smithi118.stdout:5/343: dwrite d0/db/d35/da/f18 [0,4194304] 0 2024-09-21T11:39:24.974 INFO:tasks.workunit.client.0.smithi118.stdout:5/344: stat d0/db/d35/d30/d1a/l38 0 2024-09-21T11:39:24.976 INFO:tasks.workunit.client.0.smithi118.stdout:0/718: readlink d5/d10/d1e/d21/l69 0 2024-09-21T11:39:24.978 INFO:tasks.workunit.client.0.smithi118.stdout:9/433: readlink d0/d20/d4c/d5f/l79 0 2024-09-21T11:39:24.980 INFO:tasks.workunit.client.0.smithi118.stdout:4/306: getdents d2/d6/de/d1c/d4d 0 2024-09-21T11:39:24.983 INFO:tasks.workunit.client.0.smithi118.stdout:7/393: getdents d0/d3/d14 0 2024-09-21T11:39:24.983 INFO:tasks.workunit.client.0.smithi118.stdout:4/307: read - d2/d6/dd/d35/f6e zero size 2024-09-21T11:39:24.986 INFO:tasks.workunit.client.0.smithi118.stdout:0/719: dwrite d5/d10/d1e/d23/d3a/d4e/fa8 [0,4194304] 0 2024-09-21T11:39:24.986 INFO:tasks.workunit.client.0.smithi118.stdout:1/404: mknod d6/de/c7d 0 2024-09-21T11:39:24.996 INFO:tasks.workunit.client.1.smithi149.stdout:0/933: truncate dd/d2d/f7f 1362608 0 2024-09-21T11:39:24.998 INFO:tasks.workunit.client.0.smithi118.stdout:6/338: fdatasync d8/f11 0 2024-09-21T11:39:25.000 INFO:tasks.workunit.client.1.smithi149.stdout:6/906: rename d8/da/d3d/cab to d8/da/d123/d12e/c132 0 2024-09-21T11:39:25.001 INFO:tasks.workunit.client.0.smithi118.stdout:0/720: dread d5/d10/d1e/d23/d3a/f8b [0,4194304] 0 2024-09-21T11:39:25.002 INFO:tasks.workunit.client.0.smithi118.stdout:7/394: mkdir d0/d3/d14/d41/d7f/d3e/d81 0 2024-09-21T11:39:25.004 INFO:tasks.workunit.client.0.smithi118.stdout:4/308: rename d2/d6/de/c50 to d2/d6/de/d3e/d5e/c71 0 2024-09-21T11:39:25.005 INFO:tasks.workunit.client.0.smithi118.stdout:6/339: dwrite d8/d48/d45/f67 [0,4194304] 0 2024-09-21T11:39:25.009 INFO:tasks.workunit.client.0.smithi118.stdout:5/345: link d0/db/d35/d30/d66/f71 d0/db/d35/d30/d1a/f76 0 2024-09-21T11:39:25.010 INFO:tasks.workunit.client.0.smithi118.stdout:5/346: fdatasync d0/d6c/d25/f43 0 2024-09-21T11:39:25.049 INFO:tasks.workunit.client.0.smithi118.stdout:2/278: sync 2024-09-21T11:39:25.049 INFO:tasks.workunit.client.0.smithi118.stdout:3/341: sync 2024-09-21T11:39:25.049 INFO:tasks.workunit.client.0.smithi118.stdout:8/685: dwrite d2/d73/f92 [0,4194304] 0 2024-09-21T11:39:25.054 INFO:tasks.workunit.client.1.smithi149.stdout:0/934: fdatasync dd/d1a/d1b/d72/d78/dc4/d3a/d66/f69 0 2024-09-21T11:39:25.055 INFO:tasks.workunit.client.0.smithi118.stdout:9/434: write d0/d20/f6b [855709,97337] 0 2024-09-21T11:39:25.059 INFO:tasks.workunit.client.0.smithi118.stdout:0/721: rename d5/d29/d53/f63 to d5/d10/d1e/d23/d3a/d4e/dcb/ff2 0 2024-09-21T11:39:25.064 INFO:tasks.workunit.client.0.smithi118.stdout:0/722: dread d5/d10/d1e/d21/f7a [0,4194304] 0 2024-09-21T11:39:25.065 INFO:tasks.workunit.client.0.smithi118.stdout:0/723: dread - d5/d10/fb9 zero size 2024-09-21T11:39:25.066 INFO:tasks.workunit.client.1.smithi149.stdout:1/920: link d2/d107/d6e/f11f d2/dd/d35/d1c/d41/d51/d73/f128 0 2024-09-21T11:39:25.068 INFO:tasks.workunit.client.1.smithi149.stdout:8/856: truncate d3/d33/d34/d55/d5e/d9e/dc2/d90/f104 588444 0 2024-09-21T11:39:25.070 INFO:tasks.workunit.client.1.smithi149.stdout:8/857: read d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/ffd [2848214,11036] 0 2024-09-21T11:39:25.071 INFO:tasks.workunit.client.0.smithi118.stdout:1/405: dwrite d6/de/d16/d3f/d50/d72/f75 [0,4194304] 0 2024-09-21T11:39:25.072 INFO:tasks.workunit.client.0.smithi118.stdout:5/347: rmdir d0/db/d26 39 2024-09-21T11:39:25.072 INFO:tasks.workunit.client.0.smithi118.stdout:1/406: chown d6/d3b 576452834 1 2024-09-21T11:39:25.073 INFO:tasks.workunit.client.0.smithi118.stdout:5/348: chown d0/d6c/d67/f62 1066777097 1 2024-09-21T11:39:25.073 INFO:tasks.workunit.client.0.smithi118.stdout:1/407: write d6/de/f22 [2797083,91181] 0 2024-09-21T11:39:25.075 INFO:tasks.workunit.client.0.smithi118.stdout:2/279: mkdir de/d16/d1c/d66 0 2024-09-21T11:39:25.078 INFO:tasks.workunit.client.0.smithi118.stdout:8/686: creat d2/dc/d35/d42/ff0 x:0 0 0 2024-09-21T11:39:25.081 INFO:tasks.workunit.client.1.smithi149.stdout:6/907: rename d8/da/d123/d12e/c132 to d8/d32/d37/d28/dc8/c133 0 2024-09-21T11:39:25.082 INFO:tasks.workunit.client.0.smithi118.stdout:7/395: dwrite d0/d3/d14/f28 [0,4194304] 0 2024-09-21T11:39:25.083 INFO:tasks.workunit.client.0.smithi118.stdout:9/435: unlink d0/d20/d4c/d5f/d6c/d88/l6f 0 2024-09-21T11:39:25.089 INFO:tasks.workunit.client.0.smithi118.stdout:8/687: dwrite d2/f7 [0,4194304] 0 2024-09-21T11:39:25.090 INFO:tasks.workunit.client.0.smithi118.stdout:3/342: rename d5/d1d/d1b/d24/f61 to d5/d28/d33/d4a/f7f 0 2024-09-21T11:39:25.090 INFO:tasks.workunit.client.1.smithi149.stdout:1/921: dread d2/dd/d35/d1c/d41/d51/f57 [0,4194304] 0 2024-09-21T11:39:25.091 INFO:tasks.workunit.client.1.smithi149.stdout:1/922: write d2/dd/d35/d7c/f100 [415164,29217] 0 2024-09-21T11:39:25.091 INFO:tasks.workunit.client.0.smithi118.stdout:6/340: symlink d8/d46/d53/l75 0 2024-09-21T11:39:25.092 INFO:tasks.workunit.client.1.smithi149.stdout:9/943: getdents d18/d19/d1a/d9b 0 2024-09-21T11:39:25.093 INFO:tasks.workunit.client.0.smithi118.stdout:8/688: read d2/dc/d16/f87 [6840157,12440] 0 2024-09-21T11:39:25.098 INFO:tasks.workunit.client.0.smithi118.stdout:0/724: creat d5/d10/d1e/d21/db3/dbe/ff3 x:0 0 0 2024-09-21T11:39:25.099 INFO:tasks.workunit.client.1.smithi149.stdout:8/858: rename d3/d3c to d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126 0 2024-09-21T11:39:25.100 INFO:tasks.workunit.client.1.smithi149.stdout:9/944: dread d18/d36/d3c/d47/d76/f12a [0,4194304] 0 2024-09-21T11:39:25.101 INFO:tasks.workunit.client.0.smithi118.stdout:8/689: dread d2/dc/d10/d6a/f89 [0,4194304] 0 2024-09-21T11:39:25.103 INFO:tasks.workunit.client.0.smithi118.stdout:5/349: creat d0/db/d35/d2c/f77 x:0 0 0 2024-09-21T11:39:25.104 INFO:tasks.workunit.client.0.smithi118.stdout:5/350: chown d0/f5 4610401 1 2024-09-21T11:39:25.105 INFO:tasks.workunit.client.1.smithi149.stdout:3/997: creat d6/d1f/df1/f154 x:0 0 0 2024-09-21T11:39:25.106 INFO:tasks.workunit.client.0.smithi118.stdout:1/408: symlink d6/de/d16/d3f/d50/l7e 0 2024-09-21T11:39:25.108 INFO:tasks.workunit.client.0.smithi118.stdout:6/341: dread d8/d14/f24 [0,4194304] 0 2024-09-21T11:39:25.109 INFO:tasks.workunit.client.0.smithi118.stdout:2/280: fdatasync de/f18 0 2024-09-21T11:39:25.111 INFO:tasks.workunit.client.1.smithi149.stdout:0/935: creat dd/f133 x:0 0 0 2024-09-21T11:39:25.115 INFO:tasks.workunit.client.1.smithi149.stdout:1/923: creat d2/d107/d6e/f129 x:0 0 0 2024-09-21T11:39:25.115 INFO:tasks.workunit.client.1.smithi149.stdout:1/924: stat d2/d5/d65/f7b 0 2024-09-21T11:39:25.118 INFO:tasks.workunit.client.0.smithi118.stdout:9/436: mkdir d0/d4/d45/da5 0 2024-09-21T11:39:25.119 INFO:tasks.workunit.client.0.smithi118.stdout:9/437: readlink d0/l1b 0 2024-09-21T11:39:25.122 INFO:tasks.workunit.client.1.smithi149.stdout:6/908: symlink d8/da/d2c/d102/d117/d10b/d12b/l134 0 2024-09-21T11:39:25.123 INFO:tasks.workunit.client.1.smithi149.stdout:9/945: creat d18/d36/d3c/d47/d76/d7c/f12c x:0 0 0 2024-09-21T11:39:25.124 INFO:tasks.workunit.client.0.smithi118.stdout:3/343: rmdir d5/d28/d3e/d5d/d5f 39 2024-09-21T11:39:25.127 INFO:tasks.workunit.client.1.smithi149.stdout:0/936: mknod dd/d1a/d1b/d72/d85/d8c/c134 0 2024-09-21T11:39:25.130 INFO:tasks.workunit.client.0.smithi118.stdout:5/351: creat d0/d63/f78 x:0 0 0 2024-09-21T11:39:25.132 INFO:tasks.workunit.client.0.smithi118.stdout:7/396: dwrite d0/d3/d14/f15 [4194304,4194304] 0 2024-09-21T11:39:25.134 INFO:tasks.workunit.client.1.smithi149.stdout:6/909: creat d8/da/d2c/d52/f135 x:0 0 0 2024-09-21T11:39:25.135 INFO:tasks.workunit.client.1.smithi149.stdout:6/910: read d8/d32/d37/d2b/d7e/f86 [485366,93588] 0 2024-09-21T11:39:25.138 INFO:tasks.workunit.client.1.smithi149.stdout:9/946: unlink d18/d19/d29/d39/f69 0 2024-09-21T11:39:25.139 INFO:tasks.workunit.client.0.smithi118.stdout:8/690: write d2/dc/d16/d46/f69 [641364,81928] 0 2024-09-21T11:39:25.142 INFO:tasks.workunit.client.1.smithi149.stdout:0/937: creat dd/d1a/d1b/d72/d87/f135 x:0 0 0 2024-09-21T11:39:25.143 INFO:tasks.workunit.client.0.smithi118.stdout:9/438: unlink d0/f24 0 2024-09-21T11:39:25.144 INFO:tasks.workunit.client.0.smithi118.stdout:9/439: stat d0/d20/d4c/d5f/d68 0 2024-09-21T11:39:25.146 INFO:tasks.workunit.client.0.smithi118.stdout:3/344: read d5/d1d/d1b/d50/f59 [3235420,78157] 0 2024-09-21T11:39:25.148 INFO:tasks.workunit.client.0.smithi118.stdout:9/440: dread d0/d20/f6b [0,4194304] 0 2024-09-21T11:39:25.148 INFO:tasks.workunit.client.0.smithi118.stdout:3/345: dread d5/d28/d33/d4a/f7f [0,4194304] 0 2024-09-21T11:39:25.148 INFO:tasks.workunit.client.1.smithi149.stdout:9/947: rename d18/d19/d1a/d2f/d30/d54/d121/dee to d18/d19/d1a/d2f/d30/d54/d121/d12d 0 2024-09-21T11:39:25.149 INFO:tasks.workunit.client.1.smithi149.stdout:3/998: link d6/d5f/d60/d88/de7/d119/f10f d6/d1f/d47/d37/dd6/f155 0 2024-09-21T11:39:25.152 INFO:tasks.workunit.client.0.smithi118.stdout:6/342: unlink d8/ld 0 2024-09-21T11:39:25.152 INFO:tasks.workunit.client.0.smithi118.stdout:6/343: read d8/d48/d45/f67 [358462,3328] 0 2024-09-21T11:39:25.178 INFO:tasks.workunit.client.1.smithi149.stdout:6/911: creat d8/d32/dcc/d115/f136 x:0 0 0 2024-09-21T11:39:25.213 INFO:tasks.workunit.client.1.smithi149.stdout:8/859: sync 2024-09-21T11:39:25.214 INFO:tasks.workunit.client.1.smithi149.stdout:8/860: stat d3/d33/d34/d55/d5e/d9e/dc2/d18/c9a 0 2024-09-21T11:39:25.310 INFO:tasks.workunit.client.0.smithi118.stdout:2/281: mkdir de/d1f/d20/d67 0 2024-09-21T11:39:25.315 INFO:tasks.workunit.client.1.smithi149.stdout:9/948: rename d18/d19/d1a to d18/d36/d3c/d47/db5/d12e 0 2024-09-21T11:39:25.315 INFO:tasks.workunit.client.1.smithi149.stdout:3/999: rmdir d6/d5f/d60/d88/de7 39 2024-09-21T11:39:25.316 INFO:tasks.workunit.client.0.smithi118.stdout:1/409: truncate d6/de/f1a 234275 0 2024-09-21T11:39:25.317 INFO:tasks.workunit.client.0.smithi118.stdout:3/346: fdatasync d5/d1d/d1b/d50/d5c/f7b 0 2024-09-21T11:39:25.318 INFO:tasks.workunit.client.1.smithi149.stdout:0/938: write dd/d1a/d1b/f31 [8959965,100381] 0 2024-09-21T11:39:25.318 INFO:tasks.workunit.client.0.smithi118.stdout:5/352: mknod d0/db/d35/d30/c79 0 2024-09-21T11:39:25.320 INFO:tasks.workunit.client.1.smithi149.stdout:1/925: rmdir d2/d103 0 2024-09-21T11:39:25.322 INFO:tasks.workunit.client.1.smithi149.stdout:6/912: mknod d8/d32/dcc/d115/c137 0 2024-09-21T11:39:25.324 INFO:tasks.workunit.client.1.smithi149.stdout:0/939: dwrite dd/d1a/d1b/f10b [0,4194304] 0 2024-09-21T11:39:25.324 INFO:tasks.workunit.client.0.smithi118.stdout:8/691: mkdir d2/dc/d49/df1 0 2024-09-21T11:39:25.325 INFO:tasks.workunit.client.1.smithi149.stdout:0/940: chown dd/d1a/d1b/d72/d85/f10c 564304787 1 2024-09-21T11:39:25.326 INFO:tasks.workunit.client.1.smithi149.stdout:9/949: truncate d18/d1c/f60 604924 0 2024-09-21T11:39:25.332 INFO:tasks.workunit.client.0.smithi118.stdout:8/692: dwrite d2/dc/d16/d46/d4c/d63/f9d [0,4194304] 0 2024-09-21T11:39:25.334 INFO:tasks.workunit.client.0.smithi118.stdout:8/693: dread d2/dc/d35/d42/fa1 [0,4194304] 0 2024-09-21T11:39:25.339 INFO:tasks.workunit.client.0.smithi118.stdout:3/347: mkdir d5/d28/d33/d80 0 2024-09-21T11:39:25.344 INFO:tasks.workunit.client.1.smithi149.stdout:9/950: dread d18/d4c/f67 [4194304,4194304] 0 2024-09-21T11:39:25.346 INFO:tasks.workunit.client.0.smithi118.stdout:6/344: unlink d8/l49 0 2024-09-21T11:39:25.349 INFO:tasks.workunit.client.1.smithi149.stdout:8/861: rename d3/d12/c85 to d3/d33/d34/d55/d5e/d9e/dc2/c127 0 2024-09-21T11:39:25.349 INFO:tasks.workunit.client.0.smithi118.stdout:2/282: mknod de/d16/d1c/d66/c68 0 2024-09-21T11:39:25.354 INFO:tasks.workunit.client.1.smithi149.stdout:8/862: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/d128 0 2024-09-21T11:39:25.355 INFO:tasks.workunit.client.0.smithi118.stdout:3/348: fsync d5/d28/f65 0 2024-09-21T11:39:25.359 INFO:tasks.workunit.client.1.smithi149.stdout:6/913: write d8/da/d2c/d102/d117/d10b/d11a/f27 [5038311,19844] 0 2024-09-21T11:39:25.359 INFO:tasks.workunit.client.0.smithi118.stdout:2/283: fsync de/f19 0 2024-09-21T11:39:25.360 INFO:tasks.workunit.client.0.smithi118.stdout:2/284: fsync de/d1f/f4c 0 2024-09-21T11:39:25.361 INFO:tasks.workunit.client.0.smithi118.stdout:2/285: stat de/d16/d1c/l43 0 2024-09-21T11:39:25.361 INFO:tasks.workunit.client.1.smithi149.stdout:1/926: rename d2/d5/d8/fc4 to d2/d5/db3/f12a 0 2024-09-21T11:39:25.362 INFO:tasks.workunit.client.0.smithi118.stdout:2/286: write de/d16/d31/f3d [221929,29480] 0 2024-09-21T11:39:25.365 INFO:tasks.workunit.client.0.smithi118.stdout:8/694: fdatasync d2/dc/d10/d2e/d18/f9c 0 2024-09-21T11:39:25.365 INFO:tasks.workunit.client.0.smithi118.stdout:1/410: write d6/d33/d3c/f73 [136314,181] 0 2024-09-21T11:39:25.368 INFO:tasks.workunit.client.1.smithi149.stdout:1/927: dwrite d2/dd/d35/d1c/d7a/d10e/dc0/d124/fcc [0,4194304] 0 2024-09-21T11:39:25.370 INFO:tasks.workunit.client.0.smithi118.stdout:5/353: link d0/db/d35/d30/l13 d0/db/d35/da/l7a 0 2024-09-21T11:39:25.373 INFO:tasks.workunit.client.0.smithi118.stdout:6/345: mknod d8/d48/d45/d61/d66/c76 0 2024-09-21T11:39:25.375 INFO:tasks.workunit.client.1.smithi149.stdout:6/914: link d8/da/d3d/f10d d8/d32/d37/d28/d2f/d6a/d111/f138 0 2024-09-21T11:39:25.378 INFO:tasks.workunit.client.0.smithi118.stdout:8/695: dread d2/d32/f6c [0,4194304] 0 2024-09-21T11:39:25.379 INFO:tasks.workunit.client.1.smithi149.stdout:1/928: truncate d2/dd/d35/d1c/d7a/d10e/f82 1620021 0 2024-09-21T11:39:25.379 INFO:tasks.workunit.client.1.smithi149.stdout:1/929: chown d2/d5/d3d/fdb 17716 1 2024-09-21T11:39:25.383 INFO:tasks.workunit.client.1.smithi149.stdout:8/863: rename d3/d33/d34/d55/d5e/d9e/dc2/d21/fff to d3/d12/d6e/d79/f129 0 2024-09-21T11:39:25.384 INFO:tasks.workunit.client.1.smithi149.stdout:9/951: write d18/d36/d3c/d47/db5/d12e/d2f/d30/d90/fb7 [2018910,41035] 0 2024-09-21T11:39:25.385 INFO:tasks.workunit.client.1.smithi149.stdout:6/915: creat d8/da/d2c/d102/d117/f139 x:0 0 0 2024-09-21T11:39:25.385 INFO:tasks.workunit.client.0.smithi118.stdout:8/696: dwrite d2/dc/d10/d2e/dba/fc0 [0,4194304] 0 2024-09-21T11:39:25.387 INFO:tasks.workunit.client.1.smithi149.stdout:1/930: rmdir d2/d5/d65/d96/d105 39 2024-09-21T11:39:25.388 INFO:tasks.workunit.client.1.smithi149.stdout:1/931: fsync d2/dd/ff8 0 2024-09-21T11:39:25.388 INFO:tasks.workunit.client.1.smithi149.stdout:0/941: sync 2024-09-21T11:39:25.391 INFO:tasks.workunit.client.0.smithi118.stdout:5/354: mknod d0/d63/c7b 0 2024-09-21T11:39:25.392 INFO:tasks.workunit.client.0.smithi118.stdout:1/411: dwrite d6/d33/f5b [0,4194304] 0 2024-09-21T11:39:25.394 INFO:tasks.workunit.client.0.smithi118.stdout:1/412: dread - d6/de/d16/d3f/f37 zero size 2024-09-21T11:39:25.395 INFO:tasks.workunit.client.0.smithi118.stdout:1/413: readlink d6/de/d16/d3f/d50/l7e 0 2024-09-21T11:39:25.395 INFO:tasks.workunit.client.0.smithi118.stdout:6/346: mknod d8/d48/d5f/d6b/c77 0 2024-09-21T11:39:25.397 INFO:tasks.workunit.client.0.smithi118.stdout:3/349: write d5/d1d/d1b/d50/f59 [1671363,104074] 0 2024-09-21T11:39:25.401 INFO:tasks.workunit.client.0.smithi118.stdout:6/347: dread d8/d14/f1e [0,4194304] 0 2024-09-21T11:39:25.408 INFO:tasks.workunit.client.1.smithi149.stdout:1/932: mknod d2/d5/d3d/c12b 0 2024-09-21T11:39:25.408 INFO:tasks.workunit.client.0.smithi118.stdout:6/348: dwrite d8/d14/f1d [0,4194304] 0 2024-09-21T11:39:25.411 INFO:tasks.workunit.client.1.smithi149.stdout:0/942: creat dd/d1a/d1b/d72/d78/dc4/d3a/d66/dcf/f136 x:0 0 0 2024-09-21T11:39:25.412 INFO:tasks.workunit.client.0.smithi118.stdout:5/355: dread d0/fe [0,4194304] 0 2024-09-21T11:39:25.414 INFO:tasks.workunit.client.0.smithi118.stdout:2/287: rename de/d16/d25/f3b to de/d1f/f69 0 2024-09-21T11:39:25.415 INFO:tasks.workunit.client.0.smithi118.stdout:2/288: chown de/d1f/d4a 0 1 2024-09-21T11:39:25.418 INFO:tasks.workunit.client.1.smithi149.stdout:6/916: write d8/da/d11/f26 [2936391,41671] 0 2024-09-21T11:39:25.419 INFO:tasks.workunit.client.0.smithi118.stdout:3/350: creat d5/d1d/f81 x:0 0 0 2024-09-21T11:39:25.419 INFO:tasks.workunit.client.0.smithi118.stdout:8/697: write d2/d73/d79/f9a [292208,18145] 0 2024-09-21T11:39:25.421 INFO:tasks.workunit.client.1.smithi149.stdout:8/864: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/f103 [0,4194304] 0 2024-09-21T11:39:25.421 INFO:tasks.workunit.client.0.smithi118.stdout:3/351: chown d5/d1d/d1b/d4c/l5e 462 1 2024-09-21T11:39:25.421 INFO:tasks.workunit.client.0.smithi118.stdout:8/698: truncate d2/dc/d35/fef 201475 0 2024-09-21T11:39:25.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/952: rmdir d18/d129 0 2024-09-21T11:39:25.424 INFO:tasks.workunit.client.1.smithi149.stdout:6/917: mkdir d8/da/d3d/d92/d13a 0 2024-09-21T11:39:25.427 INFO:tasks.workunit.client.1.smithi149.stdout:0/943: mkdir dd/d1a/d1b/d72/d78/dc4/d3a/d137 0 2024-09-21T11:39:25.429 INFO:tasks.workunit.client.1.smithi149.stdout:6/918: write d8/da/d2c/d102/d117/d10b/d11a/f4c [1360716,70238] 0 2024-09-21T11:39:25.429 INFO:tasks.workunit.client.1.smithi149.stdout:1/933: getdents d2/dd/d35/d1c/d7a 0 2024-09-21T11:39:25.432 INFO:tasks.workunit.client.1.smithi149.stdout:8/865: dread d3/f20 [4194304,4194304] 0 2024-09-21T11:39:25.432 INFO:tasks.workunit.client.0.smithi118.stdout:1/414: creat d6/f7f x:0 0 0 2024-09-21T11:39:25.432 INFO:tasks.workunit.client.1.smithi149.stdout:0/944: write dd/d1a/d1b/d72/d78/dc4/f42 [4063592,18055] 0 2024-09-21T11:39:25.434 INFO:tasks.workunit.client.0.smithi118.stdout:8/699: stat d2/dc/d16/d46/d4c/d63/c5d 0 2024-09-21T11:39:25.436 INFO:tasks.workunit.client.1.smithi149.stdout:9/953: dwrite d18/d36/d3c/d47/f103 [0,4194304] 0 2024-09-21T11:39:25.437 INFO:tasks.workunit.client.0.smithi118.stdout:2/289: truncate de/f1e 672433 0 2024-09-21T11:39:25.438 INFO:tasks.workunit.client.1.smithi149.stdout:1/934: mknod d2/d5/d8/c12c 0 2024-09-21T11:39:25.438 INFO:tasks.workunit.client.0.smithi118.stdout:6/349: creat d8/d14/f78 x:0 0 0 2024-09-21T11:39:25.439 INFO:tasks.workunit.client.0.smithi118.stdout:6/350: chown d8/f25 250 1 2024-09-21T11:39:25.439 INFO:tasks.workunit.client.1.smithi149.stdout:8/866: mknod d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/c12a 0 2024-09-21T11:39:25.440 INFO:tasks.workunit.client.0.smithi118.stdout:6/351: stat d8/d48/d6c/f69 0 2024-09-21T11:39:25.440 INFO:tasks.workunit.client.0.smithi118.stdout:8/700: dwrite d2/d73/f92 [0,4194304] 0 2024-09-21T11:39:25.441 INFO:tasks.workunit.client.0.smithi118.stdout:8/701: stat d2/d32/l6e 0 2024-09-21T11:39:25.442 INFO:tasks.workunit.client.1.smithi149.stdout:0/945: truncate dd/d32/f3c 1420466 0 2024-09-21T11:39:25.443 INFO:tasks.workunit.client.0.smithi118.stdout:8/702: fdatasync d2/dc/d10/d2e/d18/d83/fd8 0 2024-09-21T11:39:25.448 INFO:tasks.workunit.client.0.smithi118.stdout:6/352: dwrite d8/d46/f5e [0,4194304] 0 2024-09-21T11:39:25.449 INFO:tasks.workunit.client.0.smithi118.stdout:2/290: symlink de/d16/d25/l6a 0 2024-09-21T11:39:25.451 INFO:tasks.workunit.client.0.smithi118.stdout:1/415: creat d6/de/d16/d3f/d50/d72/f80 x:0 0 0 2024-09-21T11:39:25.452 INFO:tasks.workunit.client.1.smithi149.stdout:0/946: mknod dd/d1a/d1b/d72/d78/dc4/d3a/d66/dcf/c138 0 2024-09-21T11:39:25.453 INFO:tasks.workunit.client.1.smithi149.stdout:8/867: dwrite d3/d33/d34/d55/d95/f11a [0,4194304] 0 2024-09-21T11:39:25.457 INFO:tasks.workunit.client.0.smithi118.stdout:6/353: symlink d8/d48/d45/l79 0 2024-09-21T11:39:25.458 INFO:tasks.workunit.client.1.smithi149.stdout:1/935: rename d2/f1a to d2/dd/d35/d7c/f12d 0 2024-09-21T11:39:25.458 INFO:tasks.workunit.client.0.smithi118.stdout:1/416: dwrite d6/de/d16/f29 [0,4194304] 0 2024-09-21T11:39:25.459 INFO:tasks.workunit.client.0.smithi118.stdout:2/291: creat de/d51/f6b x:0 0 0 2024-09-21T11:39:25.463 INFO:tasks.workunit.client.1.smithi149.stdout:0/947: mknod dd/d1a/d1b/d72/d78/dc4/c139 0 2024-09-21T11:39:25.464 INFO:tasks.workunit.client.0.smithi118.stdout:8/703: symlink d2/dc/d35/dc7/de7/lf2 0 2024-09-21T11:39:25.469 INFO:tasks.workunit.client.0.smithi118.stdout:5/356: write d0/db/d35/d30/d1a/f76 [954330,87924] 0 2024-09-21T11:39:25.470 INFO:tasks.workunit.client.0.smithi118.stdout:6/354: dwrite d8/d48/d6c/f69 [0,4194304] 0 2024-09-21T11:39:25.471 INFO:tasks.workunit.client.0.smithi118.stdout:1/417: dread - d6/d2a/f3a zero size 2024-09-21T11:39:25.472 INFO:tasks.workunit.client.1.smithi149.stdout:0/948: symlink dd/d1a/d1b/d72/d78/dc4/l13a 0 2024-09-21T11:39:25.473 INFO:tasks.workunit.client.0.smithi118.stdout:2/292: mknod de/d1f/d4a/c6c 0 2024-09-21T11:39:25.475 INFO:tasks.workunit.client.0.smithi118.stdout:3/352: dwrite d5/d1d/f23 [4194304,4194304] 0 2024-09-21T11:39:25.476 INFO:tasks.workunit.client.0.smithi118.stdout:3/353: chown d5/d1d/f23 112049266 1 2024-09-21T11:39:25.477 INFO:tasks.workunit.client.0.smithi118.stdout:3/354: write d5/d1d/d1b/d24/f5b [3720234,26025] 0 2024-09-21T11:39:25.480 INFO:tasks.workunit.client.1.smithi149.stdout:6/919: dread d8/da/d2c/d52/d5e/d9b/fd9 [0,4194304] 0 2024-09-21T11:39:25.486 INFO:tasks.workunit.client.1.smithi149.stdout:0/949: symlink dd/d1a/d1b/d72/d78/l13b 0 2024-09-21T11:39:25.488 INFO:tasks.workunit.client.0.smithi118.stdout:3/355: dwrite d5/d1d/d1b/d24/f60 [0,4194304] 0 2024-09-21T11:39:25.490 INFO:tasks.workunit.client.1.smithi149.stdout:0/950: creat dd/d2d/f13c x:0 0 0 2024-09-21T11:39:25.491 INFO:tasks.workunit.client.1.smithi149.stdout:0/951: chown dd/d2d/f4b 6 1 2024-09-21T11:39:25.492 INFO:tasks.workunit.client.0.smithi118.stdout:2/293: dread de/d16/f58 [0,4194304] 0 2024-09-21T11:39:25.494 INFO:tasks.workunit.client.1.smithi149.stdout:6/920: creat d8/d32/d37/d28/f13b x:0 0 0 2024-09-21T11:39:25.498 INFO:tasks.workunit.client.0.smithi118.stdout:8/704: creat d2/dc/d16/d46/d4c/d63/ff3 x:0 0 0 2024-09-21T11:39:25.498 INFO:tasks.workunit.client.1.smithi149.stdout:8/868: write d3/d12/d6e/f94 [52130,69436] 0 2024-09-21T11:39:25.499 INFO:tasks.workunit.client.0.smithi118.stdout:8/705: chown d2/dc/d10/d2e/d18/d1a/l76 214701 1 2024-09-21T11:39:25.500 INFO:tasks.workunit.client.1.smithi149.stdout:6/921: symlink d8/da/d2c/d52/d5e/l13c 0 2024-09-21T11:39:25.501 INFO:tasks.workunit.client.0.smithi118.stdout:8/706: write d2/dc/d16/d46/fd4 [212376,100056] 0 2024-09-21T11:39:25.502 INFO:tasks.workunit.client.0.smithi118.stdout:8/707: dread - d2/dc/fac zero size 2024-09-21T11:39:25.502 INFO:tasks.workunit.client.1.smithi149.stdout:9/954: dread d18/d36/d3c/d47/db5/d12e/f4b [4194304,4194304] 0 2024-09-21T11:39:25.503 INFO:tasks.workunit.client.1.smithi149.stdout:6/922: dread - d8/da/d123/f128 zero size 2024-09-21T11:39:25.504 INFO:tasks.workunit.client.0.smithi118.stdout:5/357: rmdir d0/db/d35/d74 0 2024-09-21T11:39:25.505 INFO:tasks.workunit.client.1.smithi149.stdout:0/952: dwrite dd/d1a/d1b/f124 [8388608,4194304] 0 2024-09-21T11:39:25.506 INFO:tasks.workunit.client.0.smithi118.stdout:3/356: creat d5/d1d/d1b/d4b/f82 x:0 0 0 2024-09-21T11:39:25.506 INFO:tasks.workunit.client.1.smithi149.stdout:9/955: chown d18/d36/d3c/d47/db5 41 1 2024-09-21T11:39:25.506 INFO:tasks.workunit.client.0.smithi118.stdout:1/418: write d6/d3b/f57 [201247,47966] 0 2024-09-21T11:39:25.507 INFO:tasks.workunit.client.0.smithi118.stdout:3/357: chown d5/d28/f65 1912416 1 2024-09-21T11:39:25.507 INFO:tasks.workunit.client.1.smithi149.stdout:8/869: truncate d3/d33/d34/d72/f9c 2001039 0 2024-09-21T11:39:25.507 INFO:tasks.workunit.client.1.smithi149.stdout:0/953: readlink dd/d32/l52 0 2024-09-21T11:39:25.509 INFO:tasks.workunit.client.0.smithi118.stdout:2/294: mkdir de/d16/d31/d64/d6d 0 2024-09-21T11:39:25.510 INFO:tasks.workunit.client.1.smithi149.stdout:1/936: dwrite d2/dd/d2e/d4c/ff0 [0,4194304] 0 2024-09-21T11:39:25.511 INFO:tasks.workunit.client.0.smithi118.stdout:8/708: creat d2/d7c/d88/d8f/daa/ff4 x:0 0 0 2024-09-21T11:39:25.514 INFO:tasks.workunit.client.1.smithi149.stdout:6/923: creat d8/d32/d37/d2b/d7d/db8/f13d x:0 0 0 2024-09-21T11:39:25.515 INFO:tasks.workunit.client.0.smithi118.stdout:1/419: chown d6/d2a/d5c 90861422 1 2024-09-21T11:39:25.519 INFO:tasks.workunit.client.1.smithi149.stdout:6/924: write d8/d32/dcc/d115/f136 [46522,6365] 0 2024-09-21T11:39:25.519 INFO:tasks.workunit.client.0.smithi118.stdout:5/358: dwrite d0/db/d26/d65/f69 [0,4194304] 0 2024-09-21T11:39:25.519 INFO:tasks.workunit.client.1.smithi149.stdout:9/956: mkdir d18/d12f 0 2024-09-21T11:39:25.520 INFO:tasks.workunit.client.0.smithi118.stdout:5/359: chown d0/l4c 1075239 1 2024-09-21T11:39:25.523 INFO:tasks.workunit.client.0.smithi118.stdout:2/295: rename de/d16/d1c/f1d to de/d1f/d4a/f6e 0 2024-09-21T11:39:25.527 INFO:tasks.workunit.client.0.smithi118.stdout:3/358: dwrite d5/d28/d3e/d5d/d5f/f68 [0,4194304] 0 2024-09-21T11:39:25.528 INFO:tasks.workunit.client.0.smithi118.stdout:8/709: dread d2/dc/d10/d6a/f89 [0,4194304] 0 2024-09-21T11:39:25.528 INFO:tasks.workunit.client.1.smithi149.stdout:8/870: creat d3/d33/d34/d72/dbb/dda/f12b x:0 0 0 2024-09-21T11:39:25.529 INFO:tasks.workunit.client.0.smithi118.stdout:6/355: truncate d8/d14/d3a/f50 637812 0 2024-09-21T11:39:25.533 INFO:tasks.workunit.client.1.smithi149.stdout:6/925: creat d8/da/d3d/d92/f13e x:0 0 0 2024-09-21T11:39:25.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/926: chown d8/d32/lc0 170 1 2024-09-21T11:39:25.535 INFO:tasks.workunit.client.1.smithi149.stdout:9/957: creat d18/d36/d3c/d47/db5/d12e/d2f/d33/d91/f130 x:0 0 0 2024-09-21T11:39:25.536 INFO:tasks.workunit.client.0.smithi118.stdout:3/359: dwrite d5/d1d/d1b/d50/d5c/f7b [0,4194304] 0 2024-09-21T11:39:25.538 INFO:tasks.workunit.client.0.smithi118.stdout:5/360: mknod d0/db/d26/d65/c7c 0 2024-09-21T11:39:25.539 INFO:tasks.workunit.client.0.smithi118.stdout:5/361: truncate d0/d6c/d67/f62 1477907 0 2024-09-21T11:39:25.539 INFO:tasks.workunit.client.0.smithi118.stdout:5/362: fdatasync d0/d63/f78 0 2024-09-21T11:39:25.542 INFO:tasks.workunit.client.0.smithi118.stdout:8/710: symlink d2/dc/d10/d2e/d18/lf5 0 2024-09-21T11:39:25.550 INFO:tasks.workunit.client.0.smithi118.stdout:3/360: creat d5/d1d/d1b/d4b/f83 x:0 0 0 2024-09-21T11:39:25.552 INFO:tasks.workunit.client.0.smithi118.stdout:5/363: truncate d0/d6c/f5a 1038858 0 2024-09-21T11:39:25.552 INFO:tasks.workunit.client.0.smithi118.stdout:5/364: chown d0/d6c/d25/d50/f73 1807 1 2024-09-21T11:39:25.555 INFO:tasks.workunit.client.1.smithi149.stdout:8/871: getdents d3/d33/d34/d55/d5e/d9e/dc2/d21/d54 0 2024-09-21T11:39:25.557 INFO:tasks.workunit.client.0.smithi118.stdout:8/711: symlink d2/dc/d10/d2e/d9b/lf6 0 2024-09-21T11:39:25.557 INFO:tasks.workunit.client.1.smithi149.stdout:1/937: dwrite d2/d107/d6e/f76 [4194304,4194304] 0 2024-09-21T11:39:25.558 INFO:tasks.workunit.client.0.smithi118.stdout:1/420: write d6/de/d16/d3f/f4f [594768,33247] 0 2024-09-21T11:39:25.560 INFO:tasks.workunit.client.0.smithi118.stdout:8/712: truncate d2/dc/d16/d46/d4c/d63/f9d 4945908 0 2024-09-21T11:39:25.562 INFO:tasks.workunit.client.0.smithi118.stdout:8/713: write d2/dc/d49/f77 [1625914,59506] 0 2024-09-21T11:39:25.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/938: rename d2/dd/d2e/l46 to d2/d5/d3d/l12e 0 2024-09-21T11:39:25.567 INFO:tasks.workunit.client.1.smithi149.stdout:9/958: write d18/d1c/f4f [3440772,44700] 0 2024-09-21T11:39:25.568 INFO:tasks.workunit.client.1.smithi149.stdout:8/872: truncate d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/f81 1718898 0 2024-09-21T11:39:25.570 INFO:tasks.workunit.client.0.smithi118.stdout:3/361: rename d5/d1d/d1b/c22 to d5/d1d/d1b/d4c/d73/c84 0 2024-09-21T11:39:25.570 INFO:tasks.workunit.client.1.smithi149.stdout:1/939: symlink d2/dd/d35/d1c/d7a/d10e/dc0/d124/l12f 0 2024-09-21T11:39:25.572 INFO:tasks.workunit.client.1.smithi149.stdout:9/959: mknod d18/d36/d3c/d47/db5/d12e/df1/c131 0 2024-09-21T11:39:25.574 INFO:tasks.workunit.client.1.smithi149.stdout:9/960: write d18/d1c/f4f [4971158,25587] 0 2024-09-21T11:39:25.575 INFO:tasks.workunit.client.1.smithi149.stdout:1/940: fsync d2/d107/f109 0 2024-09-21T11:39:25.575 INFO:tasks.workunit.client.1.smithi149.stdout:6/927: dwrite d8/da/d2c/d102/d117/d10b/d11a/f31 [0,4194304] 0 2024-09-21T11:39:25.575 INFO:tasks.workunit.client.0.smithi118.stdout:8/714: rmdir d2/dc/d16/d46/d4c/db0 39 2024-09-21T11:39:25.576 INFO:tasks.workunit.client.0.smithi118.stdout:2/296: link de/d16/d25/c26 de/d22/c6f 0 2024-09-21T11:39:25.577 INFO:tasks.workunit.client.1.smithi149.stdout:1/941: chown d2/dd/d35/d7c/fb2 117789 1 2024-09-21T11:39:25.577 INFO:tasks.workunit.client.1.smithi149.stdout:6/928: chown d8/da/d2c/d102/d117/d10b/d11a/f27 1 1 2024-09-21T11:39:25.577 INFO:tasks.workunit.client.1.smithi149.stdout:9/961: write d18/d36/d3c/d47/db5/d12e/d2f/d30/d54/d121/f108 [418864,30565] 0 2024-09-21T11:39:25.578 INFO:tasks.workunit.client.0.smithi118.stdout:6/356: getdents d8/d48/d45/d61 0 2024-09-21T11:39:25.581 INFO:tasks.workunit.client.1.smithi149.stdout:8/873: symlink d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7/dec/l12c 0 2024-09-21T11:39:25.582 INFO:tasks.workunit.client.0.smithi118.stdout:5/365: dwrite d0/db/d35/f3d [0,4194304] 0 2024-09-21T11:39:25.584 INFO:tasks.workunit.client.0.smithi118.stdout:5/366: write d0/d63/f78 [493911,19694] 0 2024-09-21T11:39:25.587 INFO:tasks.workunit.client.1.smithi149.stdout:8/874: dread d3/d33/d34/d55/d5e/d9e/dc2/d90/f92 [0,4194304] 0 2024-09-21T11:39:25.588 INFO:tasks.workunit.client.1.smithi149.stdout:0/954: sync 2024-09-21T11:39:25.588 INFO:tasks.workunit.client.0.smithi118.stdout:1/421: symlink d6/de/d16/d3f/d50/d54/l81 0 2024-09-21T11:39:25.591 INFO:tasks.workunit.client.0.smithi118.stdout:8/715: creat d2/d73/ff7 x:0 0 0 2024-09-21T11:39:25.591 INFO:tasks.workunit.client.1.smithi149.stdout:0/955: write dd/db3/fc5 [5036850,114306] 0 2024-09-21T11:39:25.592 INFO:tasks.workunit.client.1.smithi149.stdout:1/942: mknod d2/dd/d35/d1c/d41/d51/d90/c130 0 2024-09-21T11:39:25.593 INFO:tasks.workunit.client.1.smithi149.stdout:1/943: fdatasync d2/dd/d35/d1c/d7a/d10e/dc0/d124/f10c 0 2024-09-21T11:39:25.593 INFO:tasks.workunit.client.0.smithi118.stdout:2/297: unlink de/f17 0 2024-09-21T11:39:25.597 INFO:tasks.workunit.client.1.smithi149.stdout:8/875: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/df5/d12d 0 2024-09-21T11:39:25.598 INFO:tasks.workunit.client.0.smithi118.stdout:3/362: mknod d5/d1d/d1b/d50/d5c/d69/c85 0 2024-09-21T11:39:25.598 INFO:tasks.workunit.client.1.smithi149.stdout:0/956: truncate f8 1219075 0 2024-09-21T11:39:25.599 INFO:tasks.workunit.client.0.smithi118.stdout:8/716: dwrite d2/dc/d16/d46/d4c/d63/f7e [0,4194304] 0 2024-09-21T11:39:25.599 INFO:tasks.workunit.client.1.smithi149.stdout:0/957: chown dd/d1a/d1b/d81 55 1 2024-09-21T11:39:25.623 INFO:tasks.workunit.client.0.smithi118.stdout:4/309: sync 2024-09-21T11:39:25.623 INFO:tasks.workunit.client.0.smithi118.stdout:7/397: sync 2024-09-21T11:39:25.623 INFO:tasks.workunit.client.0.smithi118.stdout:0/725: sync 2024-09-21T11:39:25.623 INFO:tasks.workunit.client.0.smithi118.stdout:9/441: sync 2024-09-21T11:39:25.623 INFO:tasks.workunit.client.0.smithi118.stdout:0/726: chown d5/d29/d68/d7b/db7 1587 1 2024-09-21T11:39:25.627 INFO:tasks.workunit.client.1.smithi149.stdout:1/944: unlink d2/d5/d3d/c12b 0 2024-09-21T11:39:25.628 INFO:tasks.workunit.client.1.smithi149.stdout:1/945: fdatasync d2/d107/d6e/f76 0 2024-09-21T11:39:25.628 INFO:tasks.workunit.client.1.smithi149.stdout:6/929: write d8/da/d3d/d92/fc7 [926548,2306] 0 2024-09-21T11:39:25.630 INFO:tasks.workunit.client.1.smithi149.stdout:6/930: chown d8/d32/d37/d28/dc8/ce6 612698 1 2024-09-21T11:39:25.631 INFO:tasks.workunit.client.1.smithi149.stdout:8/876: mknod d3/d12/d6e/d79/d8e/c12e 0 2024-09-21T11:39:25.633 INFO:tasks.workunit.client.1.smithi149.stdout:0/958: rename dd/d1a/d1b/d72/d78/d8b/d98/dbc to dd/d1a/d5a/d106/d13d 0 2024-09-21T11:39:25.636 INFO:tasks.workunit.client.0.smithi118.stdout:8/717: creat d2/dc/d49/d84/ff8 x:0 0 0 2024-09-21T11:39:25.636 INFO:tasks.workunit.client.1.smithi149.stdout:9/962: link c4 d18/d36/d3c/d47/db5/d12e/df1/d127/c132 0 2024-09-21T11:39:25.637 INFO:tasks.workunit.client.1.smithi149.stdout:9/963: chown d18/d36/d3c/d47/db5/d12e/d2f/d30/d54/d121/f108 522613568 1 2024-09-21T11:39:25.637 INFO:tasks.workunit.client.0.smithi118.stdout:6/357: dwrite d8/d14/f1e [0,4194304] 0 2024-09-21T11:39:25.638 INFO:tasks.workunit.client.0.smithi118.stdout:9/442: creat d0/d20/d4c/d5f/d68/d7c/fa6 x:0 0 0 2024-09-21T11:39:25.641 INFO:tasks.workunit.client.0.smithi118.stdout:5/367: dwrite d0/db/f16 [0,4194304] 0 2024-09-21T11:39:25.647 INFO:tasks.workunit.client.1.smithi149.stdout:0/959: symlink dd/d1a/d5a/d106/l13e 0 2024-09-21T11:39:25.650 INFO:tasks.workunit.client.0.smithi118.stdout:1/422: rename d6/de/d16/l36 to d6/d2a/d53/l82 0 2024-09-21T11:39:25.650 INFO:tasks.workunit.client.0.smithi118.stdout:0/727: truncate d5/d29/d68/d7b/db7/d48/fa5 601086 0 2024-09-21T11:39:25.654 INFO:tasks.workunit.client.0.smithi118.stdout:3/363: symlink d5/d28/d33/d80/l86 0 2024-09-21T11:39:25.654 INFO:tasks.workunit.client.0.smithi118.stdout:6/358: stat d8/d14/d3a/f50 0 2024-09-21T11:39:25.654 INFO:tasks.workunit.client.1.smithi149.stdout:0/960: dwrite dd/d2d/f4b [0,4194304] 0 2024-09-21T11:39:25.655 INFO:tasks.workunit.client.0.smithi118.stdout:0/728: truncate d5/d10/d1e/d21/f7a 4617412 0 2024-09-21T11:39:25.656 INFO:tasks.workunit.client.0.smithi118.stdout:1/423: symlink d6/de/d16/d3f/d50/d54/d32/l83 0 2024-09-21T11:39:25.656 INFO:tasks.workunit.client.0.smithi118.stdout:6/359: chown d8/d14/c19 291 1 2024-09-21T11:39:25.657 INFO:tasks.workunit.client.1.smithi149.stdout:9/964: getdents d18/d12f 0 2024-09-21T11:39:25.660 INFO:tasks.workunit.client.1.smithi149.stdout:0/961: chown dd/d1a/d1b/d72/d78/d8b/l9e 3653960 1 2024-09-21T11:39:25.662 INFO:tasks.workunit.client.0.smithi118.stdout:5/368: fsync d0/db/d35/da/f51 0 2024-09-21T11:39:25.663 INFO:tasks.workunit.client.0.smithi118.stdout:5/369: truncate d0/f1b 2010979 0 2024-09-21T11:39:25.664 INFO:tasks.workunit.client.0.smithi118.stdout:5/370: fdatasync d0/db/d26/d65/f69 0 2024-09-21T11:39:25.664 INFO:tasks.workunit.client.0.smithi118.stdout:4/310: rename d2/d6/de/f10 to d2/d6/dd/d35/f72 0 2024-09-21T11:39:25.665 INFO:tasks.workunit.client.0.smithi118.stdout:4/311: readlink d2/d6/de/d1c/d23/l25 0 2024-09-21T11:39:25.666 INFO:tasks.workunit.client.1.smithi149.stdout:1/946: dwrite d2/dd/d35/d1c/d41/d51/d73/f93 [0,4194304] 0 2024-09-21T11:39:25.666 INFO:tasks.workunit.client.0.smithi118.stdout:0/729: mkdir d5/d10/df4 0 2024-09-21T11:39:25.668 INFO:tasks.workunit.client.1.smithi149.stdout:0/962: symlink dd/d1a/d1b/d72/d78/dc4/d3a/dd1/dde/d101/l13f 0 2024-09-21T11:39:25.668 INFO:tasks.workunit.client.0.smithi118.stdout:6/360: write d8/fb [1038068,96687] 0 2024-09-21T11:39:25.669 INFO:tasks.workunit.client.0.smithi118.stdout:6/361: readlink d8/d48/d45/l79 0 2024-09-21T11:39:25.670 INFO:tasks.workunit.client.0.smithi118.stdout:1/424: mkdir d6/de/d13/d84 0 2024-09-21T11:39:25.671 INFO:tasks.workunit.client.1.smithi149.stdout:6/931: truncate d8/da/d2c/d102/d117/d10b/d11a/f31 2677440 0 2024-09-21T11:39:25.674 INFO:tasks.workunit.client.0.smithi118.stdout:9/443: truncate d0/d20/d4c/f85 231070 0 2024-09-21T11:39:25.676 INFO:tasks.workunit.client.0.smithi118.stdout:5/371: rmdir d0/db/d35/d30/d1a 39 2024-09-21T11:39:25.676 INFO:tasks.workunit.client.1.smithi149.stdout:9/965: write d18/d36/d3c/d47/db5/d12e/d2f/d53/fc2 [603453,27672] 0 2024-09-21T11:39:25.678 INFO:tasks.workunit.client.1.smithi149.stdout:6/932: symlink d8/da/d2c/d52/d5e/l13f 0 2024-09-21T11:39:25.678 INFO:tasks.workunit.client.1.smithi149.stdout:8/877: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/fef [0,4194304] 0 2024-09-21T11:39:25.678 INFO:tasks.workunit.client.0.smithi118.stdout:4/312: dread - d2/d6/de/d1c/d4d/d52/d69/f67 zero size 2024-09-21T11:39:25.682 INFO:tasks.workunit.client.1.smithi149.stdout:9/966: creat d18/d36/d3c/d47/db5/d12e/df1/f133 x:0 0 0 2024-09-21T11:39:25.683 INFO:tasks.workunit.client.0.smithi118.stdout:0/730: creat d5/d29/d68/d7b/db7/d48/ff5 x:0 0 0 2024-09-21T11:39:25.687 INFO:tasks.workunit.client.1.smithi149.stdout:6/933: truncate d8/da/d2c/d52/d5e/f67 1714464 0 2024-09-21T11:39:25.691 INFO:tasks.workunit.client.0.smithi118.stdout:1/425: mkdir d6/d2a/d5c/d85 0 2024-09-21T11:39:25.692 INFO:tasks.workunit.client.0.smithi118.stdout:1/426: write d6/d33/d3c/f64 [756698,44588] 0 2024-09-21T11:39:25.692 INFO:tasks.workunit.client.0.smithi118.stdout:5/372: creat d0/d6c/d25/f7d x:0 0 0 2024-09-21T11:39:25.693 INFO:tasks.workunit.client.1.smithi149.stdout:8/878: dwrite d3/d12/d6e/d79/d8e/f118 [0,4194304] 0 2024-09-21T11:39:25.695 INFO:tasks.workunit.client.1.smithi149.stdout:0/963: dwrite dd/d1a/fcb [0,4194304] 0 2024-09-21T11:39:25.697 INFO:tasks.workunit.client.0.smithi118.stdout:6/362: mknod d8/d48/d72/c7a 0 2024-09-21T11:39:25.697 INFO:tasks.workunit.client.0.smithi118.stdout:6/363: stat d8/d48/d45/d61/l56 0 2024-09-21T11:39:25.697 INFO:tasks.workunit.client.1.smithi149.stdout:8/879: chown d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/d76 28898 1 2024-09-21T11:39:25.698 INFO:tasks.workunit.client.0.smithi118.stdout:5/373: rmdir d0/d6c/d67 39 2024-09-21T11:39:25.699 INFO:tasks.workunit.client.0.smithi118.stdout:5/374: readlink d0/db/d26/l46 0 2024-09-21T11:39:25.701 INFO:tasks.workunit.client.0.smithi118.stdout:4/313: link d2/d65/f6d d2/d6/de/d1c/d23/d26/f73 0 2024-09-21T11:39:25.705 INFO:tasks.workunit.client.0.smithi118.stdout:6/364: unlink d8/d46/f5e 0 2024-09-21T11:39:25.707 INFO:tasks.workunit.client.1.smithi149.stdout:9/967: getdents d18/d36/d3c/d47/db5/d12e/d2f/d30/d54/d121 0 2024-09-21T11:39:25.709 INFO:tasks.workunit.client.1.smithi149.stdout:8/880: stat d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/c87 0 2024-09-21T11:39:25.711 INFO:tasks.workunit.client.0.smithi118.stdout:0/731: creat d5/d34/d44/ff6 x:0 0 0 2024-09-21T11:39:25.713 INFO:tasks.workunit.client.0.smithi118.stdout:6/365: dwrite d8/d14/f78 [0,4194304] 0 2024-09-21T11:39:25.715 INFO:tasks.workunit.client.0.smithi118.stdout:4/314: mkdir d2/d6/de/d1c/d23/d26/d74 0 2024-09-21T11:39:25.716 INFO:tasks.workunit.client.1.smithi149.stdout:0/964: link dd/d1a/d1b/d72/d78/dc4/f54 dd/d35/f140 0 2024-09-21T11:39:25.716 INFO:tasks.workunit.client.0.smithi118.stdout:4/315: write d2/d6/de/d1c/d4d/f68 [1724506,57038] 0 2024-09-21T11:39:25.719 INFO:tasks.workunit.client.0.smithi118.stdout:9/444: dread d0/d4/d38/f60 [0,4194304] 0 2024-09-21T11:39:25.723 INFO:tasks.workunit.client.0.smithi118.stdout:0/732: creat d5/d34/d44/d87/d9a/ff7 x:0 0 0 2024-09-21T11:39:25.723 INFO:tasks.workunit.client.1.smithi149.stdout:9/968: creat d18/d36/d3c/d47/db5/d12e/d2f/d30/d54/d121/d12d/f134 x:0 0 0 2024-09-21T11:39:25.725 INFO:tasks.workunit.client.1.smithi149.stdout:8/881: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/f116 [0,4194304] 0 2024-09-21T11:39:25.728 INFO:tasks.workunit.client.0.smithi118.stdout:9/445: mkdir d0/d20/d4c/d5f/d6c/da7 0 2024-09-21T11:39:25.729 INFO:tasks.workunit.client.1.smithi149.stdout:1/947: dread d2/dd/d35/d1c/d37/da3/fc6 [0,4194304] 0 2024-09-21T11:39:25.729 INFO:tasks.workunit.client.0.smithi118.stdout:9/446: write d0/f3a [2880387,117098] 0 2024-09-21T11:39:25.730 INFO:tasks.workunit.client.0.smithi118.stdout:5/375: creat d0/d6c/f7e x:0 0 0 2024-09-21T11:39:25.731 INFO:tasks.workunit.client.0.smithi118.stdout:5/376: stat d0/db/d35/da/f18 0 2024-09-21T11:39:25.732 INFO:tasks.workunit.client.0.smithi118.stdout:0/733: symlink d5/d34/d44/d87/d9a/lf8 0 2024-09-21T11:39:25.732 INFO:tasks.workunit.client.0.smithi118.stdout:9/447: dread - d0/d20/d4c/d5f/d6c/d88/d4d/f90 zero size 2024-09-21T11:39:25.734 INFO:tasks.workunit.client.0.smithi118.stdout:0/734: fsync d5/d29/d68/d7b/db7/fac 0 2024-09-21T11:39:25.734 INFO:tasks.workunit.client.0.smithi118.stdout:0/735: readlink d5/d29/l85 0 2024-09-21T11:39:25.735 INFO:tasks.workunit.client.1.smithi149.stdout:0/965: dwrite dd/d1a/d5a/f95 [0,4194304] 0 2024-09-21T11:39:25.735 INFO:tasks.workunit.client.1.smithi149.stdout:1/948: read d2/d5/d65/f86 [585588,37008] 0 2024-09-21T11:39:25.740 INFO:tasks.workunit.client.0.smithi118.stdout:0/736: rename d5/d10/d1e/d20/l31 to d5/d10/d1e/d21/db3/dbe/dd7/lf9 0 2024-09-21T11:39:25.741 INFO:tasks.workunit.client.0.smithi118.stdout:1/427: write d6/de/f5f [205619,81895] 0 2024-09-21T11:39:25.742 INFO:tasks.workunit.client.1.smithi149.stdout:0/966: dread dd/d32/dbe/f100 [0,4194304] 0 2024-09-21T11:39:25.744 INFO:tasks.workunit.client.0.smithi118.stdout:9/448: symlink d0/d4/d45/da5/la8 0 2024-09-21T11:39:25.744 INFO:tasks.workunit.client.0.smithi118.stdout:5/377: dwrite d0/d63/f78 [0,4194304] 0 2024-09-21T11:39:25.744 INFO:tasks.workunit.client.0.smithi118.stdout:0/737: chown d5/d10/d1e/d21/db3/fc1 193 1 2024-09-21T11:39:25.746 INFO:tasks.workunit.client.0.smithi118.stdout:1/428: write d6/de/d16/d3f/f4f [150905,709] 0 2024-09-21T11:39:25.747 INFO:tasks.workunit.client.0.smithi118.stdout:1/429: read - d6/f7f zero size 2024-09-21T11:39:25.752 INFO:tasks.workunit.client.0.smithi118.stdout:5/378: rmdir d0/db/d35 39 2024-09-21T11:39:25.754 INFO:tasks.workunit.client.1.smithi149.stdout:1/949: dread d2/dd/d35/d1c/d2c/f5a [0,4194304] 0 2024-09-21T11:39:25.754 INFO:tasks.workunit.client.0.smithi118.stdout:0/738: dwrite d5/d34/d44/d87/d9a/ff7 [0,4194304] 0 2024-09-21T11:39:25.755 INFO:tasks.workunit.client.1.smithi149.stdout:1/950: write d2/d5/d8/fa4 [8559787,128186] 0 2024-09-21T11:39:25.764 INFO:tasks.workunit.client.0.smithi118.stdout:9/449: link d0/f3a d0/d20/d4c/d5f/d66/d98/fa9 0 2024-09-21T11:39:25.765 INFO:tasks.workunit.client.0.smithi118.stdout:6/366: dwrite d8/f11 [0,4194304] 0 2024-09-21T11:39:25.778 INFO:tasks.workunit.client.0.smithi118.stdout:9/450: truncate d0/d4/d38/f46 1219089 0 2024-09-21T11:39:25.780 INFO:tasks.workunit.client.1.smithi149.stdout:1/951: dread d2/d5/d8/f17 [0,4194304] 0 2024-09-21T11:39:25.781 INFO:tasks.workunit.client.1.smithi149.stdout:1/952: read - d2/dd/d35/d1c/d37/f123 zero size 2024-09-21T11:39:25.782 INFO:tasks.workunit.client.0.smithi118.stdout:9/451: dread d0/d4/d38/f60 [0,4194304] 0 2024-09-21T11:39:25.782 INFO:tasks.workunit.client.0.smithi118.stdout:0/739: link d5/d29/d68/d7b/db7/l5e d5/d34/d44/d87/d9a/lfa 0 2024-09-21T11:39:25.783 INFO:tasks.workunit.client.0.smithi118.stdout:0/740: write d5/d10/d1e/d23/d3a/d4e/fa8 [2214258,1959] 0 2024-09-21T11:39:25.786 INFO:tasks.workunit.client.0.smithi118.stdout:5/379: link d0/db/d35/l1e d0/db/d35/d2c/l7f 0 2024-09-21T11:39:25.788 INFO:tasks.workunit.client.0.smithi118.stdout:9/452: symlink d0/d20/d71/laa 0 2024-09-21T11:39:25.792 INFO:tasks.workunit.client.0.smithi118.stdout:1/430: write d6/d2a/f51 [5622576,104040] 0 2024-09-21T11:39:25.794 INFO:tasks.workunit.client.1.smithi149.stdout:6/934: dwrite d8/da/d2c/d102/d117/d10b/d11a/f31 [0,4194304] 0 2024-09-21T11:39:25.794 INFO:tasks.workunit.client.0.smithi118.stdout:6/367: rename d8/d14/f1e to d8/f7b 0 2024-09-21T11:39:25.795 INFO:tasks.workunit.client.0.smithi118.stdout:6/368: stat d8/d48/d6c/l59 0 2024-09-21T11:39:25.795 INFO:tasks.workunit.client.0.smithi118.stdout:6/369: write d8/f25 [5206772,26783] 0 2024-09-21T11:39:25.796 INFO:tasks.workunit.client.1.smithi149.stdout:6/935: fdatasync d8/da/d2c/d102/d117/d10b/d11a/f4c 0 2024-09-21T11:39:25.796 INFO:tasks.workunit.client.0.smithi118.stdout:6/370: dread - d8/f60 zero size 2024-09-21T11:39:25.797 INFO:tasks.workunit.client.0.smithi118.stdout:0/741: fsync d5/d29/d68/d7b/db7/fc4 0 2024-09-21T11:39:25.803 INFO:tasks.workunit.client.0.smithi118.stdout:9/453: link d0/d20/d4c/d5f/d68/d7c/fa6 d0/d20/d4c/d5f/d6c/d88/d4d/fab 0 2024-09-21T11:39:25.805 INFO:tasks.workunit.client.0.smithi118.stdout:9/454: dread - d0/d20/d4c/d5f/d6c/d88/d4d/fab zero size 2024-09-21T11:39:25.808 INFO:tasks.workunit.client.0.smithi118.stdout:5/380: link d0/db/cc d0/d63/c80 0 2024-09-21T11:39:25.811 INFO:tasks.workunit.client.0.smithi118.stdout:9/455: creat d0/d20/d4c/d5f/d6c/d88/fac x:0 0 0 2024-09-21T11:39:25.812 INFO:tasks.workunit.client.0.smithi118.stdout:6/371: fsync d8/f25 0 2024-09-21T11:39:25.812 INFO:tasks.workunit.client.1.smithi149.stdout:9/969: mkdir d18/d36/d3c/d47/db5/d12e/d2f/d5f/d135 0 2024-09-21T11:39:25.813 INFO:tasks.workunit.client.1.smithi149.stdout:9/970: dread - d18/d36/d3c/d47/d99/f117 zero size 2024-09-21T11:39:25.814 INFO:tasks.workunit.client.1.smithi149.stdout:8/882: creat d3/d33/d34/d55/d5e/d9e/dc2/d90/f12f x:0 0 0 2024-09-21T11:39:25.816 INFO:tasks.workunit.client.0.smithi118.stdout:5/381: chown d0/d6c/f5a 27 1 2024-09-21T11:39:25.822 INFO:tasks.workunit.client.0.smithi118.stdout:9/456: rename d0/d20/d4c/d5f/d6c/d88/fac to d0/d20/d4c/d5f/d68/d7c/fad 0 2024-09-21T11:39:25.822 INFO:tasks.workunit.client.0.smithi118.stdout:5/382: dwrite d0/db/d35/f3d [4194304,4194304] 0 2024-09-21T11:39:25.824 INFO:tasks.workunit.client.0.smithi118.stdout:1/431: getdents d6/de 0 2024-09-21T11:39:25.827 INFO:tasks.workunit.client.1.smithi149.stdout:1/953: symlink d2/d5/d3d/l131 0 2024-09-21T11:39:25.828 INFO:tasks.workunit.client.0.smithi118.stdout:0/742: link d5/c6a d5/d34/d44/d87/cfb 0 2024-09-21T11:39:25.829 INFO:tasks.workunit.client.1.smithi149.stdout:1/954: write d2/dd/d35/f8d [3578445,73111] 0 2024-09-21T11:39:25.831 INFO:tasks.workunit.client.1.smithi149.stdout:6/936: truncate d8/d32/d37/d2b/d51/fde 2482097 0 2024-09-21T11:39:25.831 INFO:tasks.workunit.client.0.smithi118.stdout:5/383: dwrite d0/db/f72 [0,4194304] 0 2024-09-21T11:39:25.832 INFO:tasks.workunit.client.1.smithi149.stdout:6/937: write d8/d32/d37/d28/d2f/d6a/f95 [4967655,43277] 0 2024-09-21T11:39:25.843 INFO:tasks.workunit.client.1.smithi149.stdout:9/971: fdatasync d18/d1c/f98 0 2024-09-21T11:39:25.844 INFO:tasks.workunit.client.0.smithi118.stdout:9/457: mknod d0/d20/d4c/d5f/d6c/d88/cae 0 2024-09-21T11:39:25.845 INFO:tasks.workunit.client.0.smithi118.stdout:9/458: stat d0/d4/d45/d72 0 2024-09-21T11:39:25.845 INFO:tasks.workunit.client.0.smithi118.stdout:9/459: chown d0/f5c 27738413 1 2024-09-21T11:39:25.846 INFO:tasks.workunit.client.0.smithi118.stdout:9/460: stat d0/d20 0 2024-09-21T11:39:25.848 INFO:tasks.workunit.client.0.smithi118.stdout:1/432: mkdir d6/de/d16/d3f/d86 0 2024-09-21T11:39:25.849 INFO:tasks.workunit.client.0.smithi118.stdout:1/433: truncate d6/de/f5f 845176 0 2024-09-21T11:39:25.850 INFO:tasks.workunit.client.0.smithi118.stdout:1/434: fdatasync d6/de/d16/d3f/f37 0 2024-09-21T11:39:25.851 INFO:tasks.workunit.client.0.smithi118.stdout:0/743: mkdir d5/d10/d1e/d23/d3a/d4e/dfc 0 2024-09-21T11:39:25.855 INFO:tasks.workunit.client.0.smithi118.stdout:0/744: dread d5/d10/d1e/d23/f7d [0,4194304] 0 2024-09-21T11:39:25.857 INFO:tasks.workunit.client.0.smithi118.stdout:9/461: unlink d0/d4/d38/d4e/c67 0 2024-09-21T11:39:25.858 INFO:tasks.workunit.client.0.smithi118.stdout:9/462: readlink d0/d20/l2d 0 2024-09-21T11:39:25.858 INFO:tasks.workunit.client.1.smithi149.stdout:1/955: creat d2/d107/f132 x:0 0 0 2024-09-21T11:39:25.859 INFO:tasks.workunit.client.0.smithi118.stdout:1/435: readlink d6/l7c 0 2024-09-21T11:39:25.860 INFO:tasks.workunit.client.1.smithi149.stdout:6/938: fsync d8/d32/d37/d28/f33 0 2024-09-21T11:39:25.861 INFO:tasks.workunit.client.1.smithi149.stdout:6/939: chown d8/d32/d37/d2b/f96 13446548 1 2024-09-21T11:39:25.863 INFO:tasks.workunit.client.1.smithi149.stdout:9/972: mknod d18/d36/d3c/d47/c136 0 2024-09-21T11:39:25.864 INFO:tasks.workunit.client.1.smithi149.stdout:9/973: write d18/d36/d3c/d47/db5/d12e/d2f/d53/fc2 [8650073,57243] 0 2024-09-21T11:39:25.864 INFO:tasks.workunit.client.1.smithi149.stdout:8/883: creat d3/d33/d34/d72/d83/d10b/f130 x:0 0 0 2024-09-21T11:39:25.866 INFO:tasks.workunit.client.0.smithi118.stdout:9/463: creat d0/d20/d71/faf x:0 0 0 2024-09-21T11:39:25.868 INFO:tasks.workunit.client.0.smithi118.stdout:1/436: truncate d6/f15 2290088 0 2024-09-21T11:39:25.869 INFO:tasks.workunit.client.0.smithi118.stdout:1/437: dread d6/d3b/f57 [0,4194304] 0 2024-09-21T11:39:25.870 INFO:tasks.workunit.client.1.smithi149.stdout:1/956: dwrite d2/dd/d35/d1c/d41/d51/d90/f9b [4194304,4194304] 0 2024-09-21T11:39:25.876 INFO:tasks.workunit.client.0.smithi118.stdout:9/464: unlink d0/d20/l73 0 2024-09-21T11:39:25.878 INFO:tasks.workunit.client.1.smithi149.stdout:6/940: rename d8/d32/d70/f91 to d8/d32/d37/d28/d2f/f140 0 2024-09-21T11:39:25.881 INFO:tasks.workunit.client.0.smithi118.stdout:5/384: link d0/db/d35/d30/f52 d0/d6c/d67/f81 0 2024-09-21T11:39:25.881 INFO:tasks.workunit.client.0.smithi118.stdout:6/372: write d8/d14/d33/f62 [1080285,27862] 0 2024-09-21T11:39:25.882 INFO:tasks.workunit.client.1.smithi149.stdout:1/957: symlink d2/dd/d2e/d4c/l133 0 2024-09-21T11:39:25.882 INFO:tasks.workunit.client.0.smithi118.stdout:5/385: write d0/d6c/d67/f70 [4627865,127139] 0 2024-09-21T11:39:25.883 INFO:tasks.workunit.client.0.smithi118.stdout:6/373: chown d8/d14/d33/f62 0 1 2024-09-21T11:39:25.885 INFO:tasks.workunit.client.0.smithi118.stdout:1/438: mknod d6/d3b/d45/c87 0 2024-09-21T11:39:25.889 INFO:tasks.workunit.client.1.smithi149.stdout:8/884: dread d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/ffd [0,4194304] 0 2024-09-21T11:39:25.890 INFO:tasks.workunit.client.1.smithi149.stdout:1/958: unlink d2/d5/db3/f12a 0 2024-09-21T11:39:25.891 INFO:tasks.workunit.client.1.smithi149.stdout:0/967: truncate dd/f8e 863900 0 2024-09-21T11:39:25.891 INFO:tasks.workunit.client.1.smithi149.stdout:1/959: truncate d2/d107/f132 121469 0 2024-09-21T11:39:25.896 INFO:tasks.workunit.client.0.smithi118.stdout:9/465: truncate d0/d4/f29 4286497 0 2024-09-21T11:39:25.899 INFO:tasks.workunit.client.1.smithi149.stdout:0/968: mknod dd/d1a/d1b/d72/d85/c141 0 2024-09-21T11:39:25.899 INFO:tasks.workunit.client.1.smithi149.stdout:0/969: stat dd/d1a/d1b/d72/dc1/l11f 0 2024-09-21T11:39:25.900 INFO:tasks.workunit.client.1.smithi149.stdout:8/885: mknod d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/df5/dfe/c131 0 2024-09-21T11:39:25.906 INFO:tasks.workunit.client.0.smithi118.stdout:0/745: truncate d5/d29/d68/d7b/db7/d48/f60 2307603 0 2024-09-21T11:39:25.907 INFO:tasks.workunit.client.1.smithi149.stdout:8/886: dread d3/d33/d34/d55/d5e/d9e/dc2/d90/f104 [0,4194304] 0 2024-09-21T11:39:25.908 INFO:tasks.workunit.client.0.smithi118.stdout:1/439: dread d6/f19 [4194304,4194304] 0 2024-09-21T11:39:25.909 INFO:tasks.workunit.client.0.smithi118.stdout:0/746: unlink d5/d10/d1e/d23/d3a/f8b 0 2024-09-21T11:39:25.910 INFO:tasks.workunit.client.0.smithi118.stdout:0/747: write d5/d81/fc8 [660999,98812] 0 2024-09-21T11:39:25.911 INFO:tasks.workunit.client.0.smithi118.stdout:0/748: readlink d5/d29/ldb 0 2024-09-21T11:39:25.911 INFO:tasks.workunit.client.1.smithi149.stdout:9/974: dwrite d18/d36/d3c/f113 [0,4194304] 0 2024-09-21T11:39:25.913 INFO:tasks.workunit.client.1.smithi149.stdout:6/941: write d8/d32/d37/d28/d2f/d6a/d72/f7f [7818243,69920] 0 2024-09-21T11:39:25.913 INFO:tasks.workunit.client.0.smithi118.stdout:0/749: mkdir d5/d10/d1e/d23/d3a/d4e/dfd 0 2024-09-21T11:39:25.915 INFO:tasks.workunit.client.1.smithi149.stdout:0/970: dread dd/d1a/f2f [0,4194304] 0 2024-09-21T11:39:25.917 INFO:tasks.workunit.client.1.smithi149.stdout:8/887: creat d3/d12/f132 x:0 0 0 2024-09-21T11:39:25.918 INFO:tasks.workunit.client.1.smithi149.stdout:6/942: read d8/da/d11/f25 [169082,44925] 0 2024-09-21T11:39:25.920 INFO:tasks.workunit.client.0.smithi118.stdout:0/750: mkdir d5/d10/d1e/d20/dfe 0 2024-09-21T11:39:25.921 INFO:tasks.workunit.client.0.smithi118.stdout:5/386: write d0/f5 [1416681,49090] 0 2024-09-21T11:39:25.924 INFO:tasks.workunit.client.1.smithi149.stdout:0/971: read dd/d1a/d1b/d72/d85/fe2 [2532750,332] 0 2024-09-21T11:39:25.924 INFO:tasks.workunit.client.0.smithi118.stdout:0/751: creat d5/d10/d1e/d3d/fff x:0 0 0 2024-09-21T11:39:25.925 INFO:tasks.workunit.client.0.smithi118.stdout:5/387: dread d0/db/f72 [0,4194304] 0 2024-09-21T11:39:25.926 INFO:tasks.workunit.client.0.smithi118.stdout:0/752: dread - d5/d10/d1e/d3d/d93/f96 zero size 2024-09-21T11:39:25.926 INFO:tasks.workunit.client.1.smithi149.stdout:8/888: mknod d3/d33/d34/d55/d5e/d9e/dc2/d90/df0/c133 0 2024-09-21T11:39:25.929 INFO:tasks.workunit.client.1.smithi149.stdout:1/960: truncate d2/dd/d35/d1c/d7a/fae 3679574 0 2024-09-21T11:39:25.935 INFO:tasks.workunit.client.0.smithi118.stdout:0/753: truncate d5/d10/d1e/d21/f24 1269126 0 2024-09-21T11:39:25.936 INFO:tasks.workunit.client.1.smithi149.stdout:6/943: mknod d8/d32/d37/d28/d2f/d6a/d114/c141 0 2024-09-21T11:39:25.936 INFO:tasks.workunit.client.0.smithi118.stdout:0/754: write d5/d10/d1e/d21/f2d [1902801,87214] 0 2024-09-21T11:39:25.940 INFO:tasks.workunit.client.0.smithi118.stdout:5/388: symlink d0/db/d35/l82 0 2024-09-21T11:39:25.940 INFO:tasks.workunit.client.1.smithi149.stdout:9/975: write d18/d36/d3c/d47/db5/d12e/d2f/d7d/fd8 [320006,104255] 0 2024-09-21T11:39:25.941 INFO:tasks.workunit.client.1.smithi149.stdout:8/889: mknod d3/d33/d34/d55/d5e/d9e/dc2/d18/c134 0 2024-09-21T11:39:25.942 INFO:tasks.workunit.client.1.smithi149.stdout:9/976: dread - d18/d36/d3c/d47/db5/d12e/d2f/d30/d54/d121/d12d/f134 zero size 2024-09-21T11:39:25.943 INFO:tasks.workunit.client.0.smithi118.stdout:0/755: dwrite d5/d34/d44/d87/de7/fee [0,4194304] 0 2024-09-21T11:39:25.949 INFO:tasks.workunit.client.1.smithi149.stdout:0/972: rmdir dd/def 0 2024-09-21T11:39:25.952 INFO:tasks.workunit.client.1.smithi149.stdout:9/977: truncate d18/d36/d3c/d47/db5/d12e/f2d 251493 0 2024-09-21T11:39:25.957 INFO:tasks.workunit.client.0.smithi118.stdout:5/389: creat d0/f83 x:0 0 0 2024-09-21T11:39:25.962 INFO:tasks.workunit.client.0.smithi118.stdout:5/390: dwrite d0/db/d35/da/f21 [0,4194304] 0 2024-09-21T11:39:25.964 INFO:tasks.workunit.client.0.smithi118.stdout:0/756: dwrite d5/d10/d1e/d20/f26 [0,4194304] 0 2024-09-21T11:39:25.967 INFO:tasks.workunit.client.0.smithi118.stdout:0/757: write d5/d10/d1e/d23/d3a/d4e/dcb/ff2 [1506733,43816] 0 2024-09-21T11:39:25.970 INFO:tasks.workunit.client.0.smithi118.stdout:0/758: mknod d5/d10/d1e/d20/dc7/c100 0 2024-09-21T11:39:25.972 INFO:tasks.workunit.client.0.smithi118.stdout:5/391: dread d0/db/d35/da/f51 [0,4194304] 0 2024-09-21T11:39:25.972 INFO:tasks.workunit.client.0.smithi118.stdout:0/759: write d5/d10/d1e/d21/fcf [293815,17731] 0 2024-09-21T11:39:25.972 INFO:tasks.workunit.client.1.smithi149.stdout:0/973: unlink dd/d32/dbe/f100 0 2024-09-21T11:39:25.973 INFO:tasks.workunit.client.0.smithi118.stdout:0/760: chown d5/l1a 60 1 2024-09-21T11:39:25.973 INFO:tasks.workunit.client.1.smithi149.stdout:0/974: fdatasync dd/de5/f102 0 2024-09-21T11:39:25.975 INFO:tasks.workunit.client.0.smithi118.stdout:5/392: mknod d0/d6c/d67/c84 0 2024-09-21T11:39:25.975 INFO:tasks.workunit.client.1.smithi149.stdout:0/975: write dd/d2d/f4f [750391,51132] 0 2024-09-21T11:39:25.975 INFO:tasks.workunit.client.1.smithi149.stdout:8/890: dread d3/d33/f64 [0,4194304] 0 2024-09-21T11:39:25.976 INFO:tasks.workunit.client.0.smithi118.stdout:0/761: rmdir d5/d34/d44/d87/de7 39 2024-09-21T11:39:25.978 INFO:tasks.workunit.client.0.smithi118.stdout:5/393: mknod d0/db/d35/da/c85 0 2024-09-21T11:39:25.979 INFO:tasks.workunit.client.1.smithi149.stdout:8/891: creat d3/d12/d6e/d79/d8e/f135 x:0 0 0 2024-09-21T11:39:25.981 INFO:tasks.workunit.client.1.smithi149.stdout:6/944: dread d8/d32/d37/d2b/d51/f94 [0,4194304] 0 2024-09-21T11:39:25.981 INFO:tasks.workunit.client.1.smithi149.stdout:9/978: truncate d18/d36/d3c/d47/db5/d12e/d2f/f3d 1275132 0 2024-09-21T11:39:25.981 INFO:tasks.workunit.client.0.smithi118.stdout:0/762: dread d5/d10/d1e/d20/f26 [0,4194304] 0 2024-09-21T11:39:25.982 INFO:tasks.workunit.client.1.smithi149.stdout:9/979: chown d18/d36/d3c/d47/db5/d12e/df1/df5/fff 0 1 2024-09-21T11:39:25.983 INFO:tasks.workunit.client.1.smithi149.stdout:6/945: creat d8/f142 x:0 0 0 2024-09-21T11:39:25.984 INFO:tasks.workunit.client.1.smithi149.stdout:6/946: chown d8/da/d2c/d52/f135 4 1 2024-09-21T11:39:25.984 INFO:tasks.workunit.client.0.smithi118.stdout:0/763: mkdir d5/d10/d1e/d21/d101 0 2024-09-21T11:39:25.985 INFO:tasks.workunit.client.1.smithi149.stdout:6/947: write d8/da/d2c/d102/d117/f139 [516475,127178] 0 2024-09-21T11:39:25.986 INFO:tasks.workunit.client.0.smithi118.stdout:0/764: write d5/d29/d53/f56 [846073,78061] 0 2024-09-21T11:39:25.986 INFO:tasks.workunit.client.1.smithi149.stdout:6/948: dread - d8/f142 zero size 2024-09-21T11:39:25.986 INFO:tasks.workunit.client.1.smithi149.stdout:9/980: unlink d18/d36/d3c/d47/db5/d12e/d2f/d30/d54/d8c/lcf 0 2024-09-21T11:39:25.987 INFO:tasks.workunit.client.0.smithi118.stdout:5/394: getdents d0/d6c/d25 0 2024-09-21T11:39:25.987 INFO:tasks.workunit.client.1.smithi149.stdout:9/981: read - d18/d36/d3c/dcb/fd2 zero size 2024-09-21T11:39:25.988 INFO:tasks.workunit.client.1.smithi149.stdout:6/949: mkdir d8/da/d2c/d127/d60/d143 0 2024-09-21T11:39:25.993 INFO:tasks.workunit.client.1.smithi149.stdout:9/982: truncate d18/d36/d3c/d47/db5/d12e/d2f/d53/fe6 975269 0 2024-09-21T11:39:25.994 INFO:tasks.workunit.client.1.smithi149.stdout:9/983: write d18/d36/d3c/d47/db5/d12e/d2f/d30/d90/fb7 [5463048,43666] 0 2024-09-21T11:39:26.000 INFO:tasks.workunit.client.1.smithi149.stdout:0/976: write dd/d1a/d5a/f93 [4699307,24733] 0 2024-09-21T11:39:26.004 INFO:tasks.workunit.client.0.smithi118.stdout:0/765: write d5/d10/d1e/d23/d3a/d4e/d9d/fa7 [909571,62908] 0 2024-09-21T11:39:26.005 INFO:tasks.workunit.client.1.smithi149.stdout:8/892: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/fea [0,4194304] 0 2024-09-21T11:39:26.005 INFO:tasks.workunit.client.0.smithi118.stdout:0/766: fdatasync d5/d10/fb9 0 2024-09-21T11:39:26.006 INFO:tasks.workunit.client.1.smithi149.stdout:6/950: truncate d8/d32/d37/d28/d2f/d6a/d72/f7f 4585185 0 2024-09-21T11:39:26.008 INFO:tasks.workunit.client.0.smithi118.stdout:5/395: dwrite d0/d6c/f5a [0,4194304] 0 2024-09-21T11:39:26.010 INFO:tasks.workunit.client.1.smithi149.stdout:6/951: creat d8/d32/d37/d28/d2f/d6a/dff/f144 x:0 0 0 2024-09-21T11:39:26.010 INFO:tasks.workunit.client.0.smithi118.stdout:5/396: truncate d0/db/d35/da/f4e 4220340 0 2024-09-21T11:39:26.011 INFO:tasks.workunit.client.1.smithi149.stdout:9/984: dwrite d18/d36/d3c/d47/db5/d12e/d2f/d30/d90/f9d [0,4194304] 0 2024-09-21T11:39:26.012 INFO:tasks.workunit.client.0.smithi118.stdout:5/397: dread d0/fe [4194304,4194304] 0 2024-09-21T11:39:26.019 INFO:tasks.workunit.client.1.smithi149.stdout:8/893: link d3/d33/d34/d55/d5e/d9e/dc2/l10c d3/d33/d34/d72/dbb/dda/d111/l136 0 2024-09-21T11:39:26.020 INFO:tasks.workunit.client.0.smithi118.stdout:0/767: link d5/d10/d1e/d23/d3a/d4e/le2 d5/d10/d1e/d33/l102 0 2024-09-21T11:39:26.023 INFO:tasks.workunit.client.0.smithi118.stdout:0/768: fdatasync d5/d34/d44/d87/de7/fee 0 2024-09-21T11:39:26.024 INFO:tasks.workunit.client.1.smithi149.stdout:8/894: unlink d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/c62 0 2024-09-21T11:39:26.025 INFO:tasks.workunit.client.1.smithi149.stdout:9/985: dread d18/d1c/f98 [4194304,4194304] 0 2024-09-21T11:39:26.027 INFO:tasks.workunit.client.1.smithi149.stdout:6/952: getdents d8/da/d2c/d102/d117/d10b/d12b 0 2024-09-21T11:39:26.029 INFO:tasks.workunit.client.0.smithi118.stdout:5/398: link d0/d6c/c75 d0/c86 0 2024-09-21T11:39:26.032 INFO:tasks.workunit.client.1.smithi149.stdout:6/953: mkdir d8/da/d2c/d127/d60/d143/d145 0 2024-09-21T11:39:26.033 INFO:tasks.workunit.client.1.smithi149.stdout:6/954: chown d8/d32/d37/d2b/d7d/db8/f13d 91 1 2024-09-21T11:39:26.033 INFO:tasks.workunit.client.1.smithi149.stdout:9/986: creat d18/d36/d3c/d47/db5/d12e/d2f/d33/f137 x:0 0 0 2024-09-21T11:39:26.034 INFO:tasks.workunit.client.0.smithi118.stdout:5/399: creat d0/db/f87 x:0 0 0 2024-09-21T11:39:26.034 INFO:tasks.workunit.client.1.smithi149.stdout:9/987: read d18/d36/d3c/d47/f103 [1440932,30464] 0 2024-09-21T11:39:26.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/955: fsync d8/d32/d37/d28/d2f/d6a/dff/f144 0 2024-09-21T11:39:26.035 INFO:tasks.workunit.client.1.smithi149.stdout:6/956: chown d8/d32/d37/d79 40312 1 2024-09-21T11:39:26.038 INFO:tasks.workunit.client.0.smithi118.stdout:5/400: symlink d0/l88 0 2024-09-21T11:39:26.039 INFO:tasks.workunit.client.0.smithi118.stdout:5/401: fdatasync d0/d63/f78 0 2024-09-21T11:39:26.040 INFO:tasks.workunit.client.1.smithi149.stdout:9/988: creat d18/d36/d3c/d47/db5/d12e/d2f/d53/d64/f138 x:0 0 0 2024-09-21T11:39:26.041 INFO:tasks.workunit.client.1.smithi149.stdout:6/957: mkdir d8/d32/d37/d28/d106/d146 0 2024-09-21T11:39:26.041 INFO:tasks.workunit.client.1.smithi149.stdout:9/989: chown d18/d19/d29/d39/d63/dac/lb1 14 1 2024-09-21T11:39:26.041 INFO:tasks.workunit.client.1.smithi149.stdout:8/895: write d3/d33/d34/d55/d5e/d9e/dc2/d21/fc0 [4726864,114941] 0 2024-09-21T11:39:26.042 INFO:tasks.workunit.client.1.smithi149.stdout:6/958: chown d8/d32/d37/d28/ff3 15612572 1 2024-09-21T11:39:26.043 INFO:tasks.workunit.client.0.smithi118.stdout:5/402: mkdir d0/d89 0 2024-09-21T11:39:26.044 INFO:tasks.workunit.client.1.smithi149.stdout:8/896: chown d3/d33/d34/d55/d5e/d9e/dc2/d21/fc0 2364 1 2024-09-21T11:39:26.045 INFO:tasks.workunit.client.1.smithi149.stdout:9/990: creat d18/d36/d3c/d47/db5/d12e/df1/d107/f139 x:0 0 0 2024-09-21T11:39:26.047 INFO:tasks.workunit.client.1.smithi149.stdout:8/897: creat d3/d33/d34/d55/d5e/d9e/dc2/d3a/f137 x:0 0 0 2024-09-21T11:39:26.048 INFO:tasks.workunit.client.1.smithi149.stdout:9/991: symlink d18/d12f/l13a 0 2024-09-21T11:39:26.051 INFO:tasks.workunit.client.1.smithi149.stdout:8/898: rmdir d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1 39 2024-09-21T11:39:26.052 INFO:tasks.workunit.client.1.smithi149.stdout:9/992: mknod d18/d36/d3c/c13b 0 2024-09-21T11:39:26.054 INFO:tasks.workunit.client.1.smithi149.stdout:8/899: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/d138 0 2024-09-21T11:39:26.056 INFO:tasks.workunit.client.1.smithi149.stdout:9/993: link d18/d19/d102/d11d/ce7 d18/d36/d3c/d47/db5/d12e/df1/d127/c13c 0 2024-09-21T11:39:26.057 INFO:tasks.workunit.client.1.smithi149.stdout:8/900: mknod d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/d138/c139 0 2024-09-21T11:39:26.063 INFO:tasks.workunit.client.0.smithi118.stdout:5/403: dread d0/db/d35/d30/f52 [0,4194304] 0 2024-09-21T11:39:26.063 INFO:tasks.workunit.client.0.smithi118.stdout:5/404: readlink d0/d63/l5b 0 2024-09-21T11:39:26.063 INFO:tasks.workunit.client.0.smithi118.stdout:5/405: readlink d0/l4c 0 2024-09-21T11:39:26.063 INFO:tasks.workunit.client.1.smithi149.stdout:6/959: dwrite d8/da/d2c/d102/d117/fe4 [0,4194304] 0 2024-09-21T11:39:26.063 INFO:tasks.workunit.client.1.smithi149.stdout:9/994: creat d18/d19/d29/d39/d63/dac/f13d x:0 0 0 2024-09-21T11:39:26.063 INFO:tasks.workunit.client.1.smithi149.stdout:6/960: creat d8/da/d3d/d92/f147 x:0 0 0 2024-09-21T11:39:26.064 INFO:tasks.workunit.client.1.smithi149.stdout:9/995: chown d18/d36/d3c/d47/l65 3912741 1 2024-09-21T11:39:26.064 INFO:tasks.workunit.client.1.smithi149.stdout:8/901: truncate d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f9f 721404 0 2024-09-21T11:39:26.065 INFO:tasks.workunit.client.1.smithi149.stdout:6/961: creat d8/d32/d37/d28/d87/da4/f148 x:0 0 0 2024-09-21T11:39:26.066 INFO:tasks.workunit.client.0.smithi118.stdout:5/406: mknod d0/d6c/c8a 0 2024-09-21T11:39:26.067 INFO:tasks.workunit.client.0.smithi118.stdout:5/407: readlink d0/db/d26/l46 0 2024-09-21T11:39:26.067 INFO:tasks.workunit.client.1.smithi149.stdout:6/962: write d8/d32/d37/d28/f13b [513936,128673] 0 2024-09-21T11:39:26.068 INFO:tasks.workunit.client.1.smithi149.stdout:6/963: write d8/d32/d37/d2b/d7d/fa0 [8861359,54560] 0 2024-09-21T11:39:26.069 INFO:tasks.workunit.client.1.smithi149.stdout:9/996: creat d18/d36/d3c/d47/db5/d12e/d2f/d33/d91/f13e x:0 0 0 2024-09-21T11:39:26.070 INFO:tasks.workunit.client.1.smithi149.stdout:6/964: read d8/da/d2c/d102/d117/d10b/d11a/f15 [1273625,12000] 0 2024-09-21T11:39:26.071 INFO:tasks.workunit.client.1.smithi149.stdout:9/997: dread - d18/d36/d3c/d47/db5/d12e/d2f/d33/d91/f130 zero size 2024-09-21T11:39:26.071 INFO:tasks.workunit.client.0.smithi118.stdout:5/408: mknod d0/d6c/d25/c8b 0 2024-09-21T11:39:26.072 INFO:tasks.workunit.client.0.smithi118.stdout:5/409: dread - d0/db/d35/d2c/f77 zero size 2024-09-21T11:39:26.072 INFO:tasks.workunit.client.1.smithi149.stdout:9/998: fdatasync d18/d36/d3c/d47/db5/d12e/d2f/d33/f137 0 2024-09-21T11:39:26.074 INFO:tasks.workunit.client.0.smithi118.stdout:5/410: symlink d0/db/d35/da/l8c 0 2024-09-21T11:39:26.075 INFO:tasks.workunit.client.0.smithi118.stdout:5/411: chown d0/d6c/d25/d50/f55 86411 1 2024-09-21T11:39:26.076 INFO:tasks.workunit.client.1.smithi149.stdout:6/965: dread d8/da/d2c/d102/d117/fe4 [0,4194304] 0 2024-09-21T11:39:26.079 INFO:tasks.workunit.client.1.smithi149.stdout:9/999: link d18/d36/d3c/d47/db5/d12e/df1/df5/f123 d18/d36/d3c/d47/d99/dbe/f13f 0 2024-09-21T11:39:26.080 INFO:tasks.workunit.client.0.smithi118.stdout:5/412: creat d0/d89/f8d x:0 0 0 2024-09-21T11:39:26.083 INFO:tasks.workunit.client.1.smithi149.stdout:6/966: dwrite d8/da/d120/f12d [0,4194304] 0 2024-09-21T11:39:26.084 INFO:tasks.workunit.client.0.smithi118.stdout:5/413: link d0/db/d35/da/f21 d0/d89/f8e 0 2024-09-21T11:39:26.087 INFO:tasks.workunit.client.1.smithi149.stdout:6/967: mknod d8/d32/d37/c149 0 2024-09-21T11:39:26.087 INFO:tasks.workunit.client.0.smithi118.stdout:5/414: write d0/db/d35/da/f21 [2680820,39989] 0 2024-09-21T11:39:26.089 INFO:tasks.workunit.client.0.smithi118.stdout:5/415: write d0/d6c/f6a [345384,75874] 0 2024-09-21T11:39:26.090 INFO:tasks.workunit.client.1.smithi149.stdout:6/968: mkdir d8/da/d2c/d52/d5e/d14a 0 2024-09-21T11:39:26.093 INFO:tasks.workunit.client.1.smithi149.stdout:6/969: creat d8/da/d3d/d92/f14b x:0 0 0 2024-09-21T11:39:26.095 INFO:tasks.workunit.client.1.smithi149.stdout:8/902: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f9f [0,4194304] 0 2024-09-21T11:39:26.096 INFO:tasks.workunit.client.0.smithi118.stdout:5/416: dwrite d0/db/d35/d2c/f77 [0,4194304] 0 2024-09-21T11:39:26.102 INFO:tasks.workunit.client.1.smithi149.stdout:8/903: mknod d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/dc1/c13a 0 2024-09-21T11:39:26.103 INFO:tasks.workunit.client.1.smithi149.stdout:6/970: dwrite d8/da/d2c/d127/d60/f6f [0,4194304] 0 2024-09-21T11:39:26.105 INFO:tasks.workunit.client.1.smithi149.stdout:1/961: sync 2024-09-21T11:39:26.114 INFO:tasks.workunit.client.1.smithi149.stdout:1/962: creat d2/dd/d35/d1c/d7a/d10e/dc0/d124/f134 x:0 0 0 2024-09-21T11:39:26.119 INFO:tasks.workunit.client.1.smithi149.stdout:8/904: dwrite d3/d12/f132 [0,4194304] 0 2024-09-21T11:39:26.121 INFO:tasks.workunit.client.1.smithi149.stdout:6/971: dread d8/da/d2c/d102/d117/d10b/d11a/ff7 [0,4194304] 0 2024-09-21T11:39:26.122 INFO:tasks.workunit.client.1.smithi149.stdout:1/963: mknod d2/d5/d65/d96/d105/c135 0 2024-09-21T11:39:26.125 INFO:tasks.workunit.client.1.smithi149.stdout:1/964: mknod d2/dd/d35/d7c/c136 0 2024-09-21T11:39:26.128 INFO:tasks.workunit.client.1.smithi149.stdout:1/965: unlink d2/dd/d35/d1c/d37/da3/f10f 0 2024-09-21T11:39:26.130 INFO:tasks.workunit.client.1.smithi149.stdout:1/966: chown d2/d5/d8/cb1 109 1 2024-09-21T11:39:26.132 INFO:tasks.workunit.client.1.smithi149.stdout:6/972: dwrite d8/da/d3d/d92/f147 [0,4194304] 0 2024-09-21T11:39:26.137 INFO:tasks.workunit.client.1.smithi149.stdout:1/967: mknod d2/dd/d35/d1c/d41/d51/d90/c137 0 2024-09-21T11:39:26.138 INFO:tasks.workunit.client.1.smithi149.stdout:0/977: sync 2024-09-21T11:39:26.139 INFO:tasks.workunit.client.1.smithi149.stdout:6/973: chown d8/d32/d64/d97/c8f 77 1 2024-09-21T11:39:26.140 INFO:tasks.workunit.client.1.smithi149.stdout:1/968: read - d2/d107/d6e/f129 zero size 2024-09-21T11:39:26.141 INFO:tasks.workunit.client.1.smithi149.stdout:6/974: chown d8/cd6 0 1 2024-09-21T11:39:26.141 INFO:tasks.workunit.client.1.smithi149.stdout:0/978: rmdir dd/d1a/d5a/d106 39 2024-09-21T11:39:26.142 INFO:tasks.workunit.client.1.smithi149.stdout:8/905: dwrite d3/d33/f64 [0,4194304] 0 2024-09-21T11:39:26.143 INFO:tasks.workunit.client.1.smithi149.stdout:0/979: chown dd/d1a/d1b/d72/d116 3411013 1 2024-09-21T11:39:26.144 INFO:tasks.workunit.client.1.smithi149.stdout:1/969: write d2/dd/d35/d1c/d7a/d10e/dc0/d124/f10c [925918,36513] 0 2024-09-21T11:39:26.146 INFO:tasks.workunit.client.1.smithi149.stdout:8/906: fsync d3/d12/d6e/d79/d8e/f118 0 2024-09-21T11:39:26.146 INFO:tasks.workunit.client.1.smithi149.stdout:0/980: readlink dd/d1a/d1b/d72/d78/dc4/d3a/l41 0 2024-09-21T11:39:26.147 INFO:tasks.workunit.client.1.smithi149.stdout:1/970: write d2/dd/d2e/f33 [5446445,23494] 0 2024-09-21T11:39:26.149 INFO:tasks.workunit.client.1.smithi149.stdout:0/981: mknod dd/d6a/c142 0 2024-09-21T11:39:26.150 INFO:tasks.workunit.client.0.smithi118.stdout:5/417: dread d0/db/d35/d30/d1a/f2a [0,4194304] 0 2024-09-21T11:39:26.153 INFO:tasks.workunit.client.1.smithi149.stdout:1/971: rename d2/d5/f7d to d2/d5/d3d/f138 0 2024-09-21T11:39:26.157 INFO:tasks.workunit.client.0.smithi118.stdout:5/418: mkdir d0/db/d35/d30/d1a/d8f 0 2024-09-21T11:39:26.157 INFO:tasks.workunit.client.0.smithi118.stdout:5/419: stat d0/d6c/d67/c84 0 2024-09-21T11:39:26.157 INFO:tasks.workunit.client.1.smithi149.stdout:8/907: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/d76/fa9 [4194304,4194304] 0 2024-09-21T11:39:26.158 INFO:tasks.workunit.client.1.smithi149.stdout:0/982: link dd/d1a/d1b/d72/d85/d8c/fa4 dd/d6a/f143 0 2024-09-21T11:39:26.159 INFO:tasks.workunit.client.0.smithi118.stdout:5/420: symlink d0/db/d35/da/l90 0 2024-09-21T11:39:26.160 INFO:tasks.workunit.client.1.smithi149.stdout:0/983: write dd/d2d/f4f [3787198,41626] 0 2024-09-21T11:39:26.160 INFO:tasks.workunit.client.0.smithi118.stdout:5/421: read d0/db/d35/da/f18 [2714059,108429] 0 2024-09-21T11:39:26.161 INFO:tasks.workunit.client.1.smithi149.stdout:1/972: getdents d2/dd 0 2024-09-21T11:39:26.166 INFO:tasks.workunit.client.0.smithi118.stdout:5/422: read d0/f31 [1738950,67021] 0 2024-09-21T11:39:26.167 INFO:tasks.workunit.client.0.smithi118.stdout:5/423: chown d0/d6c/f8 757 1 2024-09-21T11:39:26.167 INFO:tasks.workunit.client.1.smithi149.stdout:0/984: rename dd/d35/c73 to dd/de5/c144 0 2024-09-21T11:39:26.170 INFO:tasks.workunit.client.1.smithi149.stdout:8/908: dwrite d3/d33/d34/d55/d5e/d9e/dc2/f100 [0,4194304] 0 2024-09-21T11:39:26.172 INFO:tasks.workunit.client.0.smithi118.stdout:5/424: creat d0/d6c/d25/d50/f91 x:0 0 0 2024-09-21T11:39:26.173 INFO:tasks.workunit.client.1.smithi149.stdout:6/975: dread d8/da/d2c/d127/fcb [0,4194304] 0 2024-09-21T11:39:26.173 INFO:tasks.workunit.client.0.smithi118.stdout:5/425: dread - d0/d6c/d25/d50/f73 zero size 2024-09-21T11:39:26.174 INFO:tasks.workunit.client.0.smithi118.stdout:5/426: read d0/db/d26/d65/f69 [1888754,45585] 0 2024-09-21T11:39:26.175 INFO:tasks.workunit.client.1.smithi149.stdout:0/985: rmdir dd/d1a/d1b/d72/d78/d8b/d11e 0 2024-09-21T11:39:26.178 INFO:tasks.workunit.client.0.smithi118.stdout:5/427: mkdir d0/d6c/d67/d92 0 2024-09-21T11:39:26.179 INFO:tasks.workunit.client.0.smithi118.stdout:5/428: readlink d0/d6c/l3b 0 2024-09-21T11:39:26.179 INFO:tasks.workunit.client.1.smithi149.stdout:8/909: symlink d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7/ddf/l13b 0 2024-09-21T11:39:26.181 INFO:tasks.workunit.client.1.smithi149.stdout:6/976: fdatasync d8/d32/d37/f19 0 2024-09-21T11:39:26.182 INFO:tasks.workunit.client.1.smithi149.stdout:6/977: stat d8/d32/d64/f9c 0 2024-09-21T11:39:26.184 INFO:tasks.workunit.client.1.smithi149.stdout:0/986: rename dd/l13 to dd/d1a/d1b/d72/d85/d8c/l145 0 2024-09-21T11:39:26.185 INFO:tasks.workunit.client.1.smithi149.stdout:8/910: creat d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/f13c x:0 0 0 2024-09-21T11:39:26.188 INFO:tasks.workunit.client.1.smithi149.stdout:6/978: symlink d8/d32/dcc/l14c 0 2024-09-21T11:39:26.189 INFO:tasks.workunit.client.1.smithi149.stdout:8/911: dread d3/d33/f64 [0,4194304] 0 2024-09-21T11:39:26.190 INFO:tasks.workunit.client.1.smithi149.stdout:8/912: fdatasync d3/d33/d34/d55/d5e/d9e/dc2/d18/f119 0 2024-09-21T11:39:26.191 INFO:tasks.workunit.client.0.smithi118.stdout:5/429: getdents d0/db/d35/da 0 2024-09-21T11:39:26.192 INFO:tasks.workunit.client.0.smithi118.stdout:5/430: write d0/d6c/f5a [2356345,12894] 0 2024-09-21T11:39:26.192 INFO:tasks.workunit.client.0.smithi118.stdout:5/431: fdatasync d0/d6c/f7e 0 2024-09-21T11:39:26.194 INFO:tasks.workunit.client.1.smithi149.stdout:8/913: write d3/d33/d34/d55/d95/f11a [305540,61357] 0 2024-09-21T11:39:26.194 INFO:tasks.workunit.client.1.smithi149.stdout:6/979: creat d8/da/d2c/d52/d5e/f14d x:0 0 0 2024-09-21T11:39:26.194 INFO:tasks.workunit.client.1.smithi149.stdout:0/987: dread f8 [0,4194304] 0 2024-09-21T11:39:26.196 INFO:tasks.workunit.client.1.smithi149.stdout:1/973: dwrite d2/d5/d65/f86 [0,4194304] 0 2024-09-21T11:39:26.197 INFO:tasks.workunit.client.0.smithi118.stdout:5/432: creat d0/db/d26/f93 x:0 0 0 2024-09-21T11:39:26.197 INFO:tasks.workunit.client.1.smithi149.stdout:6/980: truncate d8/da/d3d/f10a 1854094 0 2024-09-21T11:39:26.198 INFO:tasks.workunit.client.1.smithi149.stdout:0/988: rmdir dd/d1a/d1b/d72/d78/dbb 39 2024-09-21T11:39:26.198 INFO:tasks.workunit.client.1.smithi149.stdout:1/974: fdatasync d2/dd/d2e/d4c/f75 0 2024-09-21T11:39:26.200 INFO:tasks.workunit.client.1.smithi149.stdout:6/981: dread - d8/da/d3d/f10d zero size 2024-09-21T11:39:26.201 INFO:tasks.workunit.client.0.smithi118.stdout:5/433: symlink d0/l94 0 2024-09-21T11:39:26.205 INFO:tasks.workunit.client.0.smithi118.stdout:5/434: truncate d0/d6c/d67/f81 1498780 0 2024-09-21T11:39:26.206 INFO:tasks.workunit.client.0.smithi118.stdout:5/435: dread - d0/d6c/d25/d50/f91 zero size 2024-09-21T11:39:26.206 INFO:tasks.workunit.client.1.smithi149.stdout:0/989: mknod dd/d1a/d1b/d72/d85/d8c/c146 0 2024-09-21T11:39:26.211 INFO:tasks.workunit.client.1.smithi149.stdout:0/990: rmdir dd/d1a/d1b/d72/d116 39 2024-09-21T11:39:26.213 INFO:tasks.workunit.client.0.smithi118.stdout:2/298: sync 2024-09-21T11:39:26.213 INFO:tasks.workunit.client.0.smithi118.stdout:2/299: readlink de/d16/d1c/l36 0 2024-09-21T11:39:26.213 INFO:tasks.workunit.client.1.smithi149.stdout:1/975: unlink d2/dd/d35/d1c/d7a/d10e/f82 0 2024-09-21T11:39:26.214 INFO:tasks.workunit.client.1.smithi149.stdout:6/982: creat d8/da/d2c/d127/d60/d143/d145/f14e x:0 0 0 2024-09-21T11:39:26.215 INFO:tasks.workunit.client.1.smithi149.stdout:0/991: rmdir dd/d1a/d1b/d72/d78/dc4/d3a/d66 39 2024-09-21T11:39:26.217 INFO:tasks.workunit.client.1.smithi149.stdout:0/992: chown dd/d1a/d5a/fca 1530313 1 2024-09-21T11:39:26.217 INFO:tasks.workunit.client.1.smithi149.stdout:0/993: truncate dd/db3/ffe 1418368 0 2024-09-21T11:39:26.219 INFO:tasks.workunit.client.1.smithi149.stdout:1/976: creat d2/d5/d65/d96/d105/d10d/f139 x:0 0 0 2024-09-21T11:39:26.219 INFO:tasks.workunit.client.0.smithi118.stdout:2/300: dwrite de/d16/d31/f3d [0,4194304] 0 2024-09-21T11:39:26.219 INFO:tasks.workunit.client.1.smithi149.stdout:1/977: dread - d2/dd/d2e/d4c/f10b zero size 2024-09-21T11:39:26.222 INFO:tasks.workunit.client.0.smithi118.stdout:2/301: truncate de/f18 980137 0 2024-09-21T11:39:26.223 INFO:tasks.workunit.client.1.smithi149.stdout:8/914: dread d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/d76/fa9 [0,4194304] 0 2024-09-21T11:39:26.223 INFO:tasks.workunit.client.1.smithi149.stdout:6/983: mkdir d8/da/d2c/d52/d5e/d14a/d14f 0 2024-09-21T11:39:26.225 INFO:tasks.workunit.client.0.smithi118.stdout:5/436: dwrite d0/db/d35/d30/f52 [0,4194304] 0 2024-09-21T11:39:26.225 INFO:tasks.workunit.client.1.smithi149.stdout:1/978: creat d2/dd/d35/d1c/d41/d51/d90/f13a x:0 0 0 2024-09-21T11:39:26.229 INFO:tasks.workunit.client.1.smithi149.stdout:0/994: creat dd/d1a/d5a/d106/f147 x:0 0 0 2024-09-21T11:39:26.231 INFO:tasks.workunit.client.0.smithi118.stdout:2/302: mkdir de/d16/d31/d64/d6d/d70 0 2024-09-21T11:39:26.233 INFO:tasks.workunit.client.0.smithi118.stdout:5/437: mkdir d0/db/d35/d95 0 2024-09-21T11:39:26.234 INFO:tasks.workunit.client.0.smithi118.stdout:2/303: write de/d16/f58 [1616822,106916] 0 2024-09-21T11:39:26.235 INFO:tasks.workunit.client.1.smithi149.stdout:0/995: mkdir dd/d1a/d1b/d72/d78/dc4/d148 0 2024-09-21T11:39:26.237 INFO:tasks.workunit.client.0.smithi118.stdout:5/438: symlink d0/db/d26/l96 0 2024-09-21T11:39:26.239 INFO:tasks.workunit.client.1.smithi149.stdout:1/979: truncate d2/dd/d2e/d4c/f5c 3206791 0 2024-09-21T11:39:26.242 INFO:tasks.workunit.client.0.smithi118.stdout:5/439: rmdir d0/db/d35/d2c/d40 39 2024-09-21T11:39:26.243 INFO:tasks.workunit.client.0.smithi118.stdout:5/440: chown d0/c34 1286 1 2024-09-21T11:39:26.243 INFO:tasks.workunit.client.0.smithi118.stdout:2/304: mknod de/d16/d31/d64/d6d/d70/c71 0 2024-09-21T11:39:26.245 INFO:tasks.workunit.client.1.smithi149.stdout:0/996: creat dd/d2d/f149 x:0 0 0 2024-09-21T11:39:26.246 INFO:tasks.workunit.client.1.smithi149.stdout:0/997: write dd/fdb [3104039,129188] 0 2024-09-21T11:39:26.246 INFO:tasks.workunit.client.1.smithi149.stdout:1/980: mkdir d2/dd/d35/d1c/d7a/d10e/dc0/d13b 0 2024-09-21T11:39:26.247 INFO:tasks.workunit.client.1.smithi149.stdout:0/998: dread - dd/d1a/d1b/d72/d87/ffc zero size 2024-09-21T11:39:26.248 INFO:tasks.workunit.client.1.smithi149.stdout:8/915: rename d3/d33/d34/d55/d5e/d9e/dc2/d21/l5b to d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/l13d 0 2024-09-21T11:39:26.249 INFO:tasks.workunit.client.1.smithi149.stdout:8/916: chown d3/d33/d34/d72/fba 2194 1 2024-09-21T11:39:26.254 INFO:tasks.workunit.client.1.smithi149.stdout:0/999: unlink dd/d1a/d1b/d72/d85/d8c/l145 0 2024-09-21T11:39:26.254 INFO:tasks.workunit.client.1.smithi149.stdout:1/981: read d2/dd/d35/d1c/d7a/d10e/dc0/dc3/fe1 [346725,95491] 0 2024-09-21T11:39:26.254 INFO:tasks.workunit.client.1.smithi149.stdout:6/984: dread d8/d32/d37/f49 [0,4194304] 0 2024-09-21T11:39:26.256 INFO:tasks.workunit.client.1.smithi149.stdout:8/917: symlink d3/l13e 0 2024-09-21T11:39:26.258 INFO:tasks.workunit.client.1.smithi149.stdout:8/918: write d3/d33/d34/d55/d5e/d9e/dc2/f100 [4620927,111984] 0 2024-09-21T11:39:26.259 INFO:tasks.workunit.client.1.smithi149.stdout:1/982: mknod d2/dd/d35/d1c/d7a/d10e/dc0/d124/c13c 0 2024-09-21T11:39:26.261 INFO:tasks.workunit.client.1.smithi149.stdout:8/919: chown d3/d33/d34/d55/d95/f11a 48492049 1 2024-09-21T11:39:26.262 INFO:tasks.workunit.client.1.smithi149.stdout:1/983: unlink d2/d5/db3/dd9/f125 0 2024-09-21T11:39:26.263 INFO:tasks.workunit.client.1.smithi149.stdout:6/985: dwrite d8/da/d2c/d102/d117/f139 [0,4194304] 0 2024-09-21T11:39:26.266 INFO:tasks.workunit.client.0.smithi118.stdout:2/305: dread de/f14 [4194304,4194304] 0 2024-09-21T11:39:26.266 INFO:tasks.workunit.client.1.smithi149.stdout:6/986: creat d8/d32/d37/d28/dc8/f150 x:0 0 0 2024-09-21T11:39:26.267 INFO:tasks.workunit.client.1.smithi149.stdout:1/984: rename d2/dd/d35/d1c/d2c/c53 to d2/dd/d35/d7c/c13d 0 2024-09-21T11:39:26.269 INFO:tasks.workunit.client.1.smithi149.stdout:1/985: write d2/d5/d65/d96/d105/d10d/f139 [920509,52384] 0 2024-09-21T11:39:26.270 INFO:tasks.workunit.client.0.smithi118.stdout:2/306: dwrite de/d50/f5a [0,4194304] 0 2024-09-21T11:39:26.272 INFO:tasks.workunit.client.1.smithi149.stdout:1/986: symlink d2/dd/d35/d1c/d2c/l13e 0 2024-09-21T11:39:26.273 INFO:tasks.workunit.client.1.smithi149.stdout:8/920: link d3/d12/cc7 d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/d11c/c13f 0 2024-09-21T11:39:26.275 INFO:tasks.workunit.client.1.smithi149.stdout:6/987: truncate d8/d32/d37/d28/d2f/d6a/d72/f7f 265243 0 2024-09-21T11:39:26.275 INFO:tasks.workunit.client.1.smithi149.stdout:8/921: read - d3/d12/d6e/d79/f129 zero size 2024-09-21T11:39:26.276 INFO:tasks.workunit.client.1.smithi149.stdout:6/988: write d8/d32/d37/d28/f13b [1416130,98338] 0 2024-09-21T11:39:26.277 INFO:tasks.workunit.client.1.smithi149.stdout:6/989: readlink d8/da/d3d/la2 0 2024-09-21T11:39:26.277 INFO:tasks.workunit.client.0.smithi118.stdout:2/307: rename de/d1f/l49 to de/d16/d31/d64/d6d/l72 0 2024-09-21T11:39:26.279 INFO:tasks.workunit.client.0.smithi118.stdout:2/308: rmdir de/d1f 39 2024-09-21T11:39:26.281 INFO:tasks.workunit.client.1.smithi149.stdout:6/990: symlink d8/d32/dcc/d115/l151 0 2024-09-21T11:39:26.281 INFO:tasks.workunit.client.0.smithi118.stdout:2/309: rmdir de/d16/d1c 39 2024-09-21T11:39:26.282 INFO:tasks.workunit.client.1.smithi149.stdout:8/922: write d3/d33/d34/d55/d5e/d9e/dc2/d3a/f117 [820215,91003] 0 2024-09-21T11:39:26.283 INFO:tasks.workunit.client.0.smithi118.stdout:2/310: mknod de/d51/c73 0 2024-09-21T11:39:26.285 INFO:tasks.workunit.client.1.smithi149.stdout:6/991: mknod d8/da/d2c/d127/c152 0 2024-09-21T11:39:26.289 INFO:tasks.workunit.client.1.smithi149.stdout:1/987: getdents d2/d5/d65/d11b/d110 0 2024-09-21T11:39:26.290 INFO:tasks.workunit.client.0.smithi118.stdout:2/311: creat de/d1f/d4a/f74 x:0 0 0 2024-09-21T11:39:26.291 INFO:tasks.workunit.client.1.smithi149.stdout:6/992: dwrite d8/da/d2c/d102/d117/f139 [0,4194304] 0 2024-09-21T11:39:26.293 INFO:tasks.workunit.client.0.smithi118.stdout:2/312: dread de/f19 [0,4194304] 0 2024-09-21T11:39:26.296 INFO:tasks.workunit.client.1.smithi149.stdout:1/988: creat d2/d5/f13f x:0 0 0 2024-09-21T11:39:26.296 INFO:tasks.workunit.client.1.smithi149.stdout:8/923: link d3/d12/l5a d3/d33/d34/d72/dbb/dda/l140 0 2024-09-21T11:39:26.297 INFO:tasks.workunit.client.1.smithi149.stdout:8/924: chown d3/c8a 451 1 2024-09-21T11:39:26.297 INFO:tasks.workunit.client.0.smithi118.stdout:2/313: link de/d51/c59 de/d51/c75 0 2024-09-21T11:39:26.298 INFO:tasks.workunit.client.1.smithi149.stdout:1/989: write d2/d5/d3d/d88/f63 [1712363,72684] 0 2024-09-21T11:39:26.300 INFO:tasks.workunit.client.1.smithi149.stdout:1/990: mknod d2/d5/d3d/d88/c140 0 2024-09-21T11:39:26.301 INFO:tasks.workunit.client.0.smithi118.stdout:2/314: symlink de/d16/d1c/d4f/d5b/l76 0 2024-09-21T11:39:26.303 INFO:tasks.workunit.client.1.smithi149.stdout:8/925: mkdir d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/df5/d12d/d141 0 2024-09-21T11:39:26.303 INFO:tasks.workunit.client.1.smithi149.stdout:1/991: mknod d2/d5/d65/d96/d105/c141 0 2024-09-21T11:39:26.305 INFO:tasks.workunit.client.0.smithi118.stdout:2/315: link de/d50/f5a de/d1f/d20/f77 0 2024-09-21T11:39:26.305 INFO:tasks.workunit.client.1.smithi149.stdout:1/992: dread - d2/d107/d6e/fe8 zero size 2024-09-21T11:39:26.307 INFO:tasks.workunit.client.1.smithi149.stdout:1/993: write d2/d5/d3d/d88/f63 [1771633,96575] 0 2024-09-21T11:39:26.307 INFO:tasks.workunit.client.0.smithi118.stdout:2/316: readlink de/d16/d31/d64/d6d/l72 0 2024-09-21T11:39:26.308 INFO:tasks.workunit.client.0.smithi118.stdout:2/317: dread - de/d51/f6b zero size 2024-09-21T11:39:26.309 INFO:tasks.workunit.client.1.smithi149.stdout:8/926: rename d3/d33/d34/d55/d5e/d9e/dc2/d3a/c16 to d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7/dec/c142 0 2024-09-21T11:39:26.311 INFO:tasks.workunit.client.0.smithi118.stdout:2/318: mkdir de/d1f/d20/d78 0 2024-09-21T11:39:26.312 INFO:tasks.workunit.client.1.smithi149.stdout:6/993: truncate d8/da/d2c/d52/d5e/d9b/fa6 1090617 0 2024-09-21T11:39:26.313 INFO:tasks.workunit.client.1.smithi149.stdout:1/994: mkdir d2/d5/db3/dd9/d142 0 2024-09-21T11:39:26.314 INFO:tasks.workunit.client.1.smithi149.stdout:1/995: fsync d2/dd/d35/d1c/d41/d51/d90/f9b 0 2024-09-21T11:39:26.315 INFO:tasks.workunit.client.1.smithi149.stdout:8/927: mknod d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/df5/c143 0 2024-09-21T11:39:26.316 INFO:tasks.workunit.client.1.smithi149.stdout:6/994: rmdir d8/da/d2c/d52/d5e/d69 39 2024-09-21T11:39:26.317 INFO:tasks.workunit.client.1.smithi149.stdout:6/995: dread - d8/da/d2c/d52/d5e/d9b/f12f zero size 2024-09-21T11:39:26.317 INFO:tasks.workunit.client.0.smithi118.stdout:2/319: symlink de/l79 0 2024-09-21T11:39:26.318 INFO:tasks.workunit.client.1.smithi149.stdout:6/996: chown d8/d32/d37/d79/f84 232884 1 2024-09-21T11:39:26.318 INFO:tasks.workunit.client.1.smithi149.stdout:1/996: mkdir d2/dd/d35/d1c/d41/d143 0 2024-09-21T11:39:26.319 INFO:tasks.workunit.client.0.smithi118.stdout:2/320: getdents de/d50/d63 0 2024-09-21T11:39:26.319 INFO:tasks.workunit.client.0.smithi118.stdout:2/321: chown de/d1f/d4a 11 1 2024-09-21T11:39:26.322 INFO:tasks.workunit.client.1.smithi149.stdout:8/928: dwrite d3/d33/d34/d55/d5e/d9e/dc2/f100 [0,4194304] 0 2024-09-21T11:39:26.322 INFO:tasks.workunit.client.0.smithi118.stdout:2/322: unlink de/d1f/f69 0 2024-09-21T11:39:26.324 INFO:tasks.workunit.client.1.smithi149.stdout:6/997: creat d8/d32/d37/d28/d2f/d6a/d114/f153 x:0 0 0 2024-09-21T11:39:26.324 INFO:tasks.workunit.client.0.smithi118.stdout:2/323: mkdir de/d16/d31/d7a 0 2024-09-21T11:39:26.326 INFO:tasks.workunit.client.1.smithi149.stdout:8/929: write d3/d33/d34/d55/d5e/d9e/dc2/f108 [331881,14687] 0 2024-09-21T11:39:26.329 INFO:tasks.workunit.client.1.smithi149.stdout:6/998: truncate d8/d32/d37/d2b/f96 990838 0 2024-09-21T11:39:26.329 INFO:tasks.workunit.client.1.smithi149.stdout:1/997: truncate d2/dd/d35/d1c/d41/d51/d90/f91 892677 0 2024-09-21T11:39:26.331 INFO:tasks.workunit.client.1.smithi149.stdout:8/930: mknod d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/df5/dfe/c144 0 2024-09-21T11:39:26.333 INFO:tasks.workunit.client.1.smithi149.stdout:1/998: creat d2/d5/d65/d96/d105/d10d/f144 x:0 0 0 2024-09-21T11:39:26.336 INFO:tasks.workunit.client.1.smithi149.stdout:8/931: readlink d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/l7b 0 2024-09-21T11:39:26.338 INFO:tasks.workunit.client.1.smithi149.stdout:6/999: dwrite d8/d32/d37/d28/d2f/d6a/dff/f144 [0,4194304] 0 2024-09-21T11:39:26.339 INFO:tasks.workunit.client.1.smithi149.stdout:1/999: truncate d2/dd/d35/d1c/d41/fbe 1339015 0 2024-09-21T11:39:26.340 INFO:tasks.workunit.client.1.smithi149.stdout:8/932: readlink d3/d33/d34/d55/d5e/d9e/dc2/d90/lb2 0 2024-09-21T11:39:26.341 INFO:tasks.workunit.client.1.smithi149.stdout:8/933: write d3/d12/f132 [3414777,43462] 0 2024-09-21T11:39:26.342 INFO:tasks.workunit.client.1.smithi149.stdout:8/934: chown d3/c8a 110800783 1 2024-09-21T11:39:26.344 INFO:tasks.workunit.client.0.smithi118.stdout:2/324: truncate de/d16/f32 805517 0 2024-09-21T11:39:26.344 INFO:tasks.workunit.client.1.smithi149.stdout:8/935: stat d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1 0 2024-09-21T11:39:26.347 INFO:tasks.workunit.client.1.smithi149.stdout:8/936: write d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/f123 [719586,117816] 0 2024-09-21T11:39:26.350 INFO:tasks.workunit.client.1.smithi149.stdout:8/937: creat d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/f145 x:0 0 0 2024-09-21T11:39:26.352 INFO:tasks.workunit.client.1.smithi149.stdout:8/938: truncate d3/d33/d34/d55/d5e/d9e/f112 388488 0 2024-09-21T11:39:26.356 INFO:tasks.workunit.client.1.smithi149.stdout:8/939: dread d3/d33/d34/d55/d5e/d9e/dc2/f100 [0,4194304] 0 2024-09-21T11:39:26.362 INFO:tasks.workunit.client.1.smithi149.stdout:8/940: dwrite d3/f7d [0,4194304] 0 2024-09-21T11:39:26.364 INFO:tasks.workunit.client.1.smithi149.stdout:8/941: dread - d3/d33/d34/d72/dbb/dda/f12b zero size 2024-09-21T11:39:26.372 INFO:tasks.workunit.client.1.smithi149.stdout:8/942: write d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/f93 [221191,85826] 0 2024-09-21T11:39:26.381 INFO:tasks.workunit.client.0.smithi118.stdout:2/325: dread de/d1f/f4c [0,4194304] 0 2024-09-21T11:39:26.384 INFO:tasks.workunit.client.0.smithi118.stdout:2/326: dread de/d1f/d20/f77 [0,4194304] 0 2024-09-21T11:39:26.387 INFO:tasks.workunit.client.0.smithi118.stdout:2/327: creat de/d22/d3c/f7b x:0 0 0 2024-09-21T11:39:26.387 INFO:tasks.workunit.client.0.smithi118.stdout:2/328: chown de/d16/d1c/l36 28758 1 2024-09-21T11:39:26.396 INFO:tasks.workunit.client.0.smithi118.stdout:2/329: dread de/d1f/d4a/f6e [0,4194304] 0 2024-09-21T11:39:26.401 INFO:tasks.workunit.client.0.smithi118.stdout:2/330: truncate de/f2a 3785204 0 2024-09-21T11:39:26.402 INFO:tasks.workunit.client.0.smithi118.stdout:2/331: creat de/d16/d31/f7c x:0 0 0 2024-09-21T11:39:26.408 INFO:tasks.workunit.client.0.smithi118.stdout:2/332: dread de/d16/f32 [0,4194304] 0 2024-09-21T11:39:26.409 INFO:tasks.workunit.client.0.smithi118.stdout:2/333: chown de/f1e 1895 1 2024-09-21T11:39:26.410 INFO:tasks.workunit.client.0.smithi118.stdout:2/334: chown de/d1f/d20/d67 5686 1 2024-09-21T11:39:26.411 INFO:tasks.workunit.client.0.smithi118.stdout:2/335: symlink de/d16/d31/d64/d6d/l7d 0 2024-09-21T11:39:26.412 INFO:tasks.workunit.client.0.smithi118.stdout:2/336: symlink de/d16/d31/d64/l7e 0 2024-09-21T11:39:26.414 INFO:tasks.workunit.client.0.smithi118.stdout:2/337: unlink de/d1f/d20/f35 0 2024-09-21T11:39:26.415 INFO:tasks.workunit.client.0.smithi118.stdout:2/338: write de/d1f/d20/f77 [3371394,118593] 0 2024-09-21T11:39:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:26 smithi149 ceph-mon[36123]: pgmap v28: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 81 MiB/s rd, 220 MiB/s wr, 414 op/s 2024-09-21T11:39:26.498 INFO:tasks.workunit.client.1.smithi149.stdout:8/943: sync 2024-09-21T11:39:26.500 INFO:tasks.workunit.client.1.smithi149.stdout:8/944: read d3/d33/d34/d72/dbb/dda/fe7 [7248999,67343] 0 2024-09-21T11:39:26.503 INFO:tasks.workunit.client.1.smithi149.stdout:8/945: write d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/fe3 [807602,33061] 0 2024-09-21T11:39:26.505 INFO:tasks.workunit.client.1.smithi149.stdout:8/946: fsync d3/d12/d98/fa7 0 2024-09-21T11:39:26.506 INFO:tasks.workunit.client.1.smithi149.stdout:8/947: readlink d3/d12/d6e/d79/d8e/lce 0 2024-09-21T11:39:26.508 INFO:tasks.workunit.client.1.smithi149.stdout:8/948: symlink d3/d12/db1/l146 0 2024-09-21T11:39:26.510 INFO:tasks.workunit.client.1.smithi149.stdout:8/949: truncate d3/d33/d34/d55/d5e/d9e/dc2/d90/f12f 712910 0 2024-09-21T11:39:26.528 INFO:tasks.workunit.client.0.smithi118.stdout:7/398: sync 2024-09-21T11:39:26.534 INFO:tasks.workunit.client.0.smithi118.stdout:7/399: dwrite d0/d3/d1d/d35/d70/f80 [0,4194304] 0 2024-09-21T11:39:26.537 INFO:tasks.workunit.client.0.smithi118.stdout:7/400: mkdir d0/d3/d1d/d35/d57/d7e/d82 0 2024-09-21T11:39:26.539 INFO:tasks.workunit.client.0.smithi118.stdout:7/401: getdents d0/d3/d29/d5f 0 2024-09-21T11:39:26.541 INFO:tasks.workunit.client.0.smithi118.stdout:7/402: creat d0/d3/d14/d41/d7f/d3e/d81/f83 x:0 0 0 2024-09-21T11:39:26.543 INFO:tasks.workunit.client.0.smithi118.stdout:7/403: creat d0/d3/d29/d47/f84 x:0 0 0 2024-09-21T11:39:26.554 INFO:tasks.workunit.client.0.smithi118.stdout:7/404: dwrite d0/d3/d13/f2f [0,4194304] 0 2024-09-21T11:39:26.556 INFO:tasks.workunit.client.0.smithi118.stdout:7/405: truncate d0/d3/d1d/d35/f61 532559 0 2024-09-21T11:39:26.558 INFO:tasks.workunit.client.0.smithi118.stdout:7/406: fsync d0/d3/d1d/f7d 0 2024-09-21T11:39:26.560 INFO:tasks.workunit.client.0.smithi118.stdout:7/407: rmdir d0/d3/d14/d41/d7f/d3e/d81 39 2024-09-21T11:39:26.565 INFO:tasks.workunit.client.0.smithi118.stdout:7/408: dwrite d0/d3/fd [0,4194304] 0 2024-09-21T11:39:26.572 INFO:tasks.workunit.client.1.smithi149.stdout:8/950: sync 2024-09-21T11:39:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:26 smithi118 ceph-mon[28757]: pgmap v28: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 81 MiB/s rd, 220 MiB/s wr, 414 op/s 2024-09-21T11:39:26.577 INFO:tasks.workunit.client.1.smithi149.stdout:8/951: rename d3/d12/d6e/d79/d8e/c12e to d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7/dec/c147 0 2024-09-21T11:39:26.578 INFO:tasks.workunit.client.1.smithi149.stdout:8/952: write d3/f1d [4019102,75609] 0 2024-09-21T11:39:26.582 INFO:tasks.workunit.client.1.smithi149.stdout:8/953: dread d3/d12/f132 [0,4194304] 0 2024-09-21T11:39:26.585 INFO:tasks.workunit.client.1.smithi149.stdout:8/954: dread d3/d12/f132 [0,4194304] 0 2024-09-21T11:39:26.587 INFO:tasks.workunit.client.1.smithi149.stdout:8/955: symlink d3/d12/d98/l148 0 2024-09-21T11:39:26.596 INFO:tasks.workunit.client.1.smithi149.stdout:8/956: dwrite d3/d12/d6e/d79/d8e/fbd [0,4194304] 0 2024-09-21T11:39:26.602 INFO:tasks.workunit.client.1.smithi149.stdout:8/957: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/fc5 [0,4194304] 0 2024-09-21T11:39:26.611 INFO:tasks.workunit.client.1.smithi149.stdout:8/958: truncate d3/d12/d6e/f94 3855900 0 2024-09-21T11:39:26.613 INFO:tasks.workunit.client.1.smithi149.stdout:8/959: creat d3/d33/d34/d55/d95/f149 x:0 0 0 2024-09-21T11:39:26.615 INFO:tasks.workunit.client.1.smithi149.stdout:8/960: creat d3/d12/f14a x:0 0 0 2024-09-21T11:39:26.617 INFO:tasks.workunit.client.0.smithi118.stdout:8/718: sync 2024-09-21T11:39:26.620 INFO:tasks.workunit.client.0.smithi118.stdout:8/719: dread d2/f7 [0,4194304] 0 2024-09-21T11:39:26.621 INFO:tasks.workunit.client.1.smithi149.stdout:8/961: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/f68 [4194304,4194304] 0 2024-09-21T11:39:26.622 INFO:tasks.workunit.client.0.smithi118.stdout:8/720: symlink d2/dc/d10/lf9 0 2024-09-21T11:39:26.622 INFO:tasks.workunit.client.1.smithi149.stdout:8/962: chown d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/f56 82607842 1 2024-09-21T11:39:26.625 INFO:tasks.workunit.client.0.smithi118.stdout:8/721: symlink d2/dc/d35/lfa 0 2024-09-21T11:39:26.626 INFO:tasks.workunit.client.1.smithi149.stdout:8/963: creat d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f14b x:0 0 0 2024-09-21T11:39:26.627 INFO:tasks.workunit.client.1.smithi149.stdout:8/964: rmdir d3/d12/d6e/d79 39 2024-09-21T11:39:26.630 INFO:tasks.workunit.client.1.smithi149.stdout:8/965: read d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/f8d [926099,122847] 0 2024-09-21T11:39:26.634 INFO:tasks.workunit.client.0.smithi118.stdout:8/722: write d2/dc/d35/d42/fa1 [171733,107815] 0 2024-09-21T11:39:26.635 INFO:tasks.workunit.client.0.smithi118.stdout:8/723: read d2/d32/f6c [752348,73211] 0 2024-09-21T11:39:26.635 INFO:tasks.workunit.client.1.smithi149.stdout:8/966: dread d3/d33/d34/d55/d5e/d9e/dc2/d90/f92 [0,4194304] 0 2024-09-21T11:39:26.639 INFO:tasks.workunit.client.0.smithi118.stdout:8/724: dread d2/dc/d16/d46/f69 [0,4194304] 0 2024-09-21T11:39:26.641 INFO:tasks.workunit.client.0.smithi118.stdout:8/725: symlink d2/d7c/d88/dc2/lfb 0 2024-09-21T11:39:26.642 INFO:tasks.workunit.client.0.smithi118.stdout:8/726: read d2/dc/d49/d84/feb [421384,65047] 0 2024-09-21T11:39:26.644 INFO:tasks.workunit.client.1.smithi149.stdout:8/967: write d3/d33/d34/d72/f9c [2544867,111257] 0 2024-09-21T11:39:26.645 INFO:tasks.workunit.client.1.smithi149.stdout:8/968: chown d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/dd7/ddf/l13b 0 1 2024-09-21T11:39:26.646 INFO:tasks.workunit.client.1.smithi149.stdout:8/969: chown d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/l7b 578843 1 2024-09-21T11:39:26.648 INFO:tasks.workunit.client.1.smithi149.stdout:8/970: truncate d3/d33/d34/d72/fa3 152446 0 2024-09-21T11:39:26.649 INFO:tasks.workunit.client.1.smithi149.stdout:8/971: fdatasync d3/d12/f14a 0 2024-09-21T11:39:26.652 INFO:tasks.workunit.client.0.smithi118.stdout:8/727: dwrite d2/dc/d10/d2e/d18/f2f [4194304,4194304] 0 2024-09-21T11:39:26.653 INFO:tasks.workunit.client.1.smithi149.stdout:8/972: link d3/d33/d34/d72/fba d3/d33/d34/d55/d5e/d9e/dc2/d90/f14c 0 2024-09-21T11:39:26.654 INFO:tasks.workunit.client.0.smithi118.stdout:8/728: write d2/dc/d16/d46/d4c/d63/ff3 [826690,117321] 0 2024-09-21T11:39:26.654 INFO:tasks.workunit.client.1.smithi149.stdout:8/973: read - d3/d33/d34/d55/d5e/d9e/dc2/d21/da2/dc9/fdc zero size 2024-09-21T11:39:26.655 INFO:tasks.workunit.client.1.smithi149.stdout:8/974: write d3/f37 [2662968,42208] 0 2024-09-21T11:39:26.660 INFO:tasks.workunit.client.0.smithi118.stdout:8/729: write d2/d73/d79/f9a [800977,30248] 0 2024-09-21T11:39:26.661 INFO:tasks.workunit.client.1.smithi149.stdout:8/975: read d3/d33/d34/d55/d5e/d9e/dc2/d3a/f63 [2915993,64641] 0 2024-09-21T11:39:26.661 INFO:tasks.workunit.client.0.smithi118.stdout:8/730: chown d2/d32/f80 21599265 1 2024-09-21T11:39:26.669 INFO:tasks.workunit.client.1.smithi149.stdout:8/976: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/f145 [0,4194304] 0 2024-09-21T11:39:26.670 INFO:tasks.workunit.client.1.smithi149.stdout:8/977: dread - d3/d12/d98/ffb zero size 2024-09-21T11:39:26.671 INFO:tasks.workunit.client.0.smithi118.stdout:8/731: dwrite d2/dc/d16/d46/f8e [0,4194304] 0 2024-09-21T11:39:26.675 INFO:tasks.workunit.client.1.smithi149.stdout:8/978: rename d3/d12/d98/ld4 to d3/d33/d34/d55/d5e/d9e/dc2/d21/d54/dde/df1/d126/d8f/df5/d12d/l14d 0 2024-09-21T11:39:26.700 INFO:tasks.workunit.client.1.smithi149.stdout:8/979: dread d3/d33/d34/d55/d5e/d9e/dc2/d3a/f63 [0,4194304] 0 2024-09-21T11:39:26.702 INFO:tasks.workunit.client.1.smithi149.stdout:8/980: chown d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/db9/daf/fc5 7526 1 2024-09-21T11:39:26.703 INFO:tasks.workunit.client.1.smithi149.stdout:8/981: symlink d3/d12/d98/l14e 0 2024-09-21T11:39:26.704 INFO:tasks.workunit.client.1.smithi149.stdout:8/982: chown d3/d12/f15 32146768 1 2024-09-21T11:39:26.706 INFO:tasks.workunit.client.1.smithi149.stdout:8/983: symlink d3/d33/l14f 0 2024-09-21T11:39:26.716 INFO:tasks.workunit.client.1.smithi149.stdout:8/984: dread d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/fed [0,4194304] 0 2024-09-21T11:39:26.770 INFO:tasks.workunit.client.0.smithi118.stdout:3/364: sync 2024-09-21T11:39:26.772 INFO:tasks.workunit.client.0.smithi118.stdout:3/365: creat d5/d1d/f87 x:0 0 0 2024-09-21T11:39:26.773 INFO:tasks.workunit.client.0.smithi118.stdout:3/366: write d5/d28/d3e/d5d/d5f/f68 [4885162,57427] 0 2024-09-21T11:39:26.774 INFO:tasks.workunit.client.0.smithi118.stdout:3/367: readlink d5/l3f 0 2024-09-21T11:39:26.776 INFO:tasks.workunit.client.0.smithi118.stdout:3/368: mkdir d5/d28/d3e/d5d/d5f/d88 0 2024-09-21T11:39:26.778 INFO:tasks.workunit.client.0.smithi118.stdout:3/369: symlink d5/d1d/d1b/d4c/l89 0 2024-09-21T11:39:26.781 INFO:tasks.workunit.client.0.smithi118.stdout:3/370: creat d5/d28/d3e/d5d/f8a x:0 0 0 2024-09-21T11:39:26.786 INFO:tasks.workunit.client.0.smithi118.stdout:3/371: dwrite d5/d1d/d1b/d4b/f83 [0,4194304] 0 2024-09-21T11:39:26.790 INFO:tasks.workunit.client.1.smithi149.stdout:8/985: sync 2024-09-21T11:39:26.793 INFO:tasks.workunit.client.1.smithi149.stdout:8/986: write d3/d33/d34/d72/dbb/dda/fe7 [1142330,103250] 0 2024-09-21T11:39:26.794 INFO:tasks.workunit.client.0.smithi118.stdout:3/372: dwrite d5/d1d/d1b/d24/f60 [0,4194304] 0 2024-09-21T11:39:26.795 INFO:tasks.workunit.client.1.smithi149.stdout:8/987: dread - d3/d12/d6e/d79/d8e/f135 zero size 2024-09-21T11:39:26.797 INFO:tasks.workunit.client.1.smithi149.stdout:8/988: dread - d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/f14b zero size 2024-09-21T11:39:26.798 INFO:tasks.workunit.client.0.smithi118.stdout:3/373: creat d5/d28/d3e/d5d/d5f/f8b x:0 0 0 2024-09-21T11:39:26.799 INFO:tasks.workunit.client.0.smithi118.stdout:3/374: write d5/d28/f2b [2920178,127589] 0 2024-09-21T11:39:26.803 INFO:tasks.workunit.client.1.smithi149.stdout:8/989: dread d3/d33/d34/d55/d5e/d9e/dc2/d90/f14c [0,4194304] 0 2024-09-21T11:39:26.805 INFO:tasks.workunit.client.0.smithi118.stdout:3/375: dwrite f2 [8388608,4194304] 0 2024-09-21T11:39:26.808 INFO:tasks.workunit.client.1.smithi149.stdout:8/990: truncate d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/f81 1210942 0 2024-09-21T11:39:26.813 INFO:tasks.workunit.client.1.smithi149.stdout:8/991: rename d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/fd8 to d3/d33/f150 0 2024-09-21T11:39:26.819 INFO:tasks.workunit.client.0.smithi118.stdout:3/376: write d5/d1d/f12 [2337376,103526] 0 2024-09-21T11:39:26.821 INFO:tasks.workunit.client.0.smithi118.stdout:3/377: mkdir d5/d1d/d8c 0 2024-09-21T11:39:26.823 INFO:tasks.workunit.client.0.smithi118.stdout:3/378: mkdir d5/d28/d3e/d5d/d8d 0 2024-09-21T11:39:26.827 INFO:tasks.workunit.client.0.smithi118.stdout:3/379: truncate d5/d1d/d1b/d24/f2c 3310639 0 2024-09-21T11:39:26.828 INFO:tasks.workunit.client.0.smithi118.stdout:3/380: dread - d5/d28/d3e/d5d/d5f/f67 zero size 2024-09-21T11:39:26.829 INFO:tasks.workunit.client.0.smithi118.stdout:4/316: sync 2024-09-21T11:39:26.829 INFO:tasks.workunit.client.0.smithi118.stdout:6/374: sync 2024-09-21T11:39:26.830 INFO:tasks.workunit.client.1.smithi149.stdout:8/992: dread d3/d33/d34/d55/d5e/d9e/dc2/d3a/da6/fc6 [4194304,4194304] 0 2024-09-21T11:39:26.832 INFO:tasks.workunit.client.0.smithi118.stdout:3/381: dread f2 [8388608,4194304] 0 2024-09-21T11:39:26.833 INFO:tasks.workunit.client.0.smithi118.stdout:3/382: chown d5/d1d/d1b/d24/f6c 1625874 1 2024-09-21T11:39:26.835 INFO:tasks.workunit.client.0.smithi118.stdout:3/383: write d5/d1d/d1b/d24/f5b [3869735,126016] 0 2024-09-21T11:39:26.836 INFO:tasks.workunit.client.1.smithi149.stdout:8/993: dwrite d3/d33/d34/d55/d5e/d9e/dc2/d21/dd9/fe3 [0,4194304] 0 2024-09-21T11:39:26.836 INFO:tasks.workunit.client.0.smithi118.stdout:4/317: dwrite d2/d6/f22 [0,4194304] 0 2024-09-21T11:39:26.840 INFO:tasks.workunit.client.0.smithi118.stdout:3/384: symlink d5/d28/d3e/l8e 0 2024-09-21T11:39:26.842 INFO:tasks.workunit.client.1.smithi149.stdout:8/994: mknod d3/d33/d34/d55/d5e/d9e/dc2/d18/d2e/d80/c151 0 2024-09-21T11:39:26.845 INFO:tasks.workunit.client.0.smithi118.stdout:4/318: truncate d2/d6/f20 2135407 0 2024-09-21T11:39:26.847 INFO:tasks.workunit.client.0.smithi118.stdout:3/385: rename d5/d1d/f15 to d5/d28/d3e/f8f 0 2024-09-21T11:39:26.848 INFO:tasks.workunit.client.0.smithi118.stdout:4/319: chown d2/d6/de/d1c/d4d/c4f 22178869 1 2024-09-21T11:39:26.848 INFO:tasks.workunit.client.0.smithi118.stdout:3/386: creat d5/d1d/d1b/d4b/f90 x:0 0 0 2024-09-21T11:39:26.853 INFO:tasks.workunit.client.0.smithi118.stdout:3/387: getdents d5/d1d/d1b/d24 0 2024-09-21T11:39:26.854 INFO:tasks.workunit.client.0.smithi118.stdout:3/388: chown d5/d1d/d1b/d50/f5a 79550 1 2024-09-21T11:39:26.854 INFO:tasks.workunit.client.0.smithi118.stdout:3/389: fdatasync f2 0 2024-09-21T11:39:26.857 INFO:tasks.workunit.client.0.smithi118.stdout:3/390: rename d5/d1d/d1b/d50/d5c to d5/d1d/d1b/d4c/d91 0 2024-09-21T11:39:26.860 INFO:tasks.workunit.client.1.smithi149.stdout:8/995: truncate d3/f1d 3310452 0 2024-09-21T11:39:26.861 INFO:tasks.workunit.client.0.smithi118.stdout:4/320: truncate d2/f2d 3412918 0 2024-09-21T11:39:26.865 INFO:tasks.workunit.client.0.smithi118.stdout:4/321: rename d2/d6/de/d1c/d23/d26/d31/l58 to d2/d6/de/l75 0 2024-09-21T11:39:26.867 INFO:tasks.workunit.client.0.smithi118.stdout:4/322: symlink d2/d6/de/d1c/d23/d26/d31/l76 0 2024-09-21T11:39:26.878 INFO:tasks.workunit.client.0.smithi118.stdout:3/391: dwrite d5/d28/d3e/f8f [0,4194304] 0 2024-09-21T11:39:26.881 INFO:tasks.workunit.client.0.smithi118.stdout:4/323: dwrite d2/d6/de/d3e/f63 [0,4194304] 0 2024-09-21T11:39:26.883 INFO:tasks.workunit.client.0.smithi118.stdout:3/392: rename d5/d28/d33/d4a/f7f to d5/d28/d33/d80/f92 0 2024-09-21T11:39:26.886 INFO:tasks.workunit.client.0.smithi118.stdout:3/393: chown f0 216494007 1 2024-09-21T11:39:26.886 INFO:tasks.workunit.client.0.smithi118.stdout:3/394: readlink d5/d1d/l18 0 2024-09-21T11:39:26.886 INFO:tasks.workunit.client.0.smithi118.stdout:4/324: rename f1 to d2/d6/de/d3e/f77 0 2024-09-21T11:39:26.887 INFO:tasks.workunit.client.0.smithi118.stdout:4/325: symlink d2/d6/de/d3e/l78 0 2024-09-21T11:39:26.889 INFO:tasks.workunit.client.0.smithi118.stdout:4/326: mknod d2/d6/de/d1c/d23/c79 0 2024-09-21T11:39:26.902 INFO:tasks.workunit.client.0.smithi118.stdout:4/327: dread d2/d6/f18 [0,4194304] 0 2024-09-21T11:39:26.912 INFO:tasks.workunit.client.0.smithi118.stdout:4/328: dwrite d2/d6/de/d1c/d4d/d52/d69/f67 [0,4194304] 0 2024-09-21T11:39:26.913 INFO:tasks.workunit.client.0.smithi118.stdout:4/329: rmdir d2/d6/de/d1c 39 2024-09-21T11:39:26.916 INFO:tasks.workunit.client.0.smithi118.stdout:4/330: fdatasync d2/d6/f14 0 2024-09-21T11:39:26.921 INFO:tasks.workunit.client.0.smithi118.stdout:4/331: write d2/d65/f6d [11410,8854] 0 2024-09-21T11:39:26.922 INFO:tasks.workunit.client.1.smithi149.stdout:8/996: sync 2024-09-21T11:39:26.924 INFO:tasks.workunit.client.1.smithi149.stdout:8/997: symlink d3/d33/d34/d72/dbb/dda/l152 0 2024-09-21T11:39:26.927 INFO:tasks.workunit.client.0.smithi118.stdout:4/332: rename d2/d6/de/d1c/d23/d26/c45 to d2/d6/de/d1c/d23/d26/d74/c7a 0 2024-09-21T11:39:26.929 INFO:tasks.workunit.client.0.smithi118.stdout:4/333: mkdir d2/d6/dd/d35/d7b 0 2024-09-21T11:39:26.932 INFO:tasks.workunit.client.0.smithi118.stdout:4/334: unlink d2/d6/de/d3e/d5e/c71 0 2024-09-21T11:39:26.933 INFO:tasks.workunit.client.1.smithi149.stdout:8/998: truncate d3/d12/db1/ffc 1109724 0 2024-09-21T11:39:26.933 INFO:tasks.workunit.client.0.smithi118.stdout:4/335: truncate d2/d6/de/d1c/f47 4613461 0 2024-09-21T11:39:26.935 INFO:tasks.workunit.client.1.smithi149.stdout:8/999: mknod d3/d12/d6e/d79/c153 0 2024-09-21T11:39:26.938 INFO:tasks.workunit.client.0.smithi118.stdout:4/336: rmdir d2/d6/dd/d35/d7b 0 2024-09-21T11:39:26.938 INFO:tasks.workunit.client.1.smithi149.stderr:+ rm -rf -- ./tmp.rGM16ijZwg 2024-09-21T11:39:26.942 INFO:tasks.workunit.client.0.smithi118.stdout:4/337: dwrite d2/d6/f18 [0,4194304] 0 2024-09-21T11:39:26.946 INFO:tasks.workunit.client.0.smithi118.stdout:4/338: creat d2/f7c x:0 0 0 2024-09-21T11:39:26.949 INFO:tasks.workunit.client.0.smithi118.stdout:4/339: mknod d2/d6/de/d1c/d23/d26/d74/c7d 0 2024-09-21T11:39:26.950 INFO:tasks.workunit.client.0.smithi118.stdout:4/340: read d2/d6/de/d1c/d23/f2c [1086215,64944] 0 2024-09-21T11:39:26.952 INFO:tasks.workunit.client.0.smithi118.stdout:4/341: write d2/d6/de/d1c/d23/d26/f73 [1020132,66396] 0 2024-09-21T11:39:26.952 INFO:tasks.workunit.client.0.smithi118.stdout:4/342: readlink d2/d6/de/d1c/d23/l59 0 2024-09-21T11:39:26.954 INFO:tasks.workunit.client.0.smithi118.stdout:4/343: write d2/d65/f70 [1000423,515] 0 2024-09-21T11:39:26.956 INFO:tasks.workunit.client.0.smithi118.stdout:8/732: sync 2024-09-21T11:39:26.956 INFO:tasks.workunit.client.0.smithi118.stdout:5/441: sync 2024-09-21T11:39:26.956 INFO:tasks.workunit.client.0.smithi118.stdout:0/769: sync 2024-09-21T11:39:26.956 INFO:tasks.workunit.client.0.smithi118.stdout:9/466: sync 2024-09-21T11:39:26.956 INFO:tasks.workunit.client.0.smithi118.stdout:1/440: sync 2024-09-21T11:39:26.957 INFO:tasks.workunit.client.0.smithi118.stdout:2/339: sync 2024-09-21T11:39:26.957 INFO:tasks.workunit.client.0.smithi118.stdout:7/409: sync 2024-09-21T11:39:26.957 INFO:tasks.workunit.client.0.smithi118.stdout:9/467: dread - d0/d4/f8c zero size 2024-09-21T11:39:26.959 INFO:tasks.workunit.client.0.smithi118.stdout:2/340: write de/d51/f5c [869280,68180] 0 2024-09-21T11:39:26.959 INFO:tasks.workunit.client.0.smithi118.stdout:7/410: write d0/d3/d1d/d35/d70/f80 [5010863,108873] 0 2024-09-21T11:39:26.961 INFO:tasks.workunit.client.0.smithi118.stdout:9/468: write d0/d4/d45/f48 [2180191,51182] 0 2024-09-21T11:39:26.961 INFO:tasks.workunit.client.0.smithi118.stdout:2/341: chown de/d1f/f4c 6 1 2024-09-21T11:39:26.963 INFO:tasks.workunit.client.0.smithi118.stdout:5/442: mkdir d0/d6c/d97 0 2024-09-21T11:39:26.964 INFO:tasks.workunit.client.0.smithi118.stdout:5/443: read - d0/db/d26/f93 zero size 2024-09-21T11:39:26.974 INFO:tasks.workunit.client.0.smithi118.stdout:4/344: truncate d2/d6/f22 3428901 0 2024-09-21T11:39:26.976 INFO:tasks.workunit.client.0.smithi118.stdout:2/342: rmdir de/d16/d25 39 2024-09-21T11:39:26.977 INFO:tasks.workunit.client.0.smithi118.stdout:0/770: write d5/d10/d1e/d33/f72 [261578,113111] 0 2024-09-21T11:39:26.979 INFO:tasks.workunit.client.0.smithi118.stdout:0/771: stat d5/d29/d68/c73 0 2024-09-21T11:39:26.980 INFO:tasks.workunit.client.0.smithi118.stdout:1/441: write d6/d2a/f28 [3975625,57950] 0 2024-09-21T11:39:26.981 INFO:tasks.workunit.client.0.smithi118.stdout:5/444: link d0/d6c/d67/f62 d0/db/d35/d95/f98 0 2024-09-21T11:39:26.982 INFO:tasks.workunit.client.0.smithi118.stdout:9/469: dread d0/d4/f15 [0,4194304] 0 2024-09-21T11:39:26.983 INFO:tasks.workunit.client.0.smithi118.stdout:2/343: creat de/d16/d1c/d4f/f7f x:0 0 0 2024-09-21T11:39:26.984 INFO:tasks.workunit.client.0.smithi118.stdout:7/411: dread d0/d3/d14/d41/f4b [0,4194304] 0 2024-09-21T11:39:26.985 INFO:tasks.workunit.client.0.smithi118.stdout:4/345: unlink d2/f49 0 2024-09-21T11:39:26.989 INFO:tasks.workunit.client.0.smithi118.stdout:0/772: dwrite d5/d29/d68/d7b/db7/fac [0,4194304] 0 2024-09-21T11:39:26.990 INFO:tasks.workunit.client.0.smithi118.stdout:4/346: write d2/d6/dd/d35/f6c [614979,44062] 0 2024-09-21T11:39:26.993 INFO:tasks.workunit.client.0.smithi118.stdout:2/344: dread de/d50/f5a [0,4194304] 0 2024-09-21T11:39:26.994 INFO:tasks.workunit.client.0.smithi118.stdout:4/347: fsync d2/d6/dd/d35/f48 0 2024-09-21T11:39:26.995 INFO:tasks.workunit.client.0.smithi118.stdout:9/470: mknod d0/d20/cb0 0 2024-09-21T11:39:26.996 INFO:tasks.workunit.client.0.smithi118.stdout:7/412: dwrite d0/d3/d14/d41/f6f [0,4194304] 0 2024-09-21T11:39:26.997 INFO:tasks.workunit.client.0.smithi118.stdout:7/413: chown d0/d3/d29/d47 320863 1 2024-09-21T11:39:26.998 INFO:tasks.workunit.client.0.smithi118.stdout:9/471: chown d0/d20/d4c/d5f/d68 17636 1 2024-09-21T11:39:27.001 INFO:tasks.workunit.client.0.smithi118.stdout:7/414: read - d0/d3/d29/d47/f84 zero size 2024-09-21T11:39:27.004 INFO:tasks.workunit.client.0.smithi118.stdout:1/442: symlink d6/d33/d7a/l88 0 2024-09-21T11:39:27.006 INFO:tasks.workunit.client.0.smithi118.stdout:9/472: read d0/d20/d4c/d5f/d6c/d88/d4d/f8a [11833,70286] 0 2024-09-21T11:39:27.009 INFO:tasks.workunit.client.0.smithi118.stdout:2/345: dwrite de/d1f/d20/f48 [0,4194304] 0 2024-09-21T11:39:27.010 INFO:tasks.workunit.client.0.smithi118.stdout:4/348: dwrite d2/d6/dd/d35/f6e [0,4194304] 0 2024-09-21T11:39:27.010 INFO:tasks.workunit.client.0.smithi118.stdout:9/473: readlink d0/d4/d38/d4e/l74 0 2024-09-21T11:39:27.011 INFO:tasks.workunit.client.0.smithi118.stdout:2/346: dread - de/d16/d31/f7c zero size 2024-09-21T11:39:27.013 INFO:tasks.workunit.client.0.smithi118.stdout:9/474: write d0/f2c [432194,38236] 0 2024-09-21T11:39:27.017 INFO:tasks.workunit.client.0.smithi118.stdout:5/445: dwrite d0/db/d35/da/f18 [0,4194304] 0 2024-09-21T11:39:27.018 INFO:tasks.workunit.client.0.smithi118.stdout:5/446: read - d0/f83 zero size 2024-09-21T11:39:27.022 INFO:tasks.workunit.client.0.smithi118.stdout:7/415: creat d0/d3/d29/d5f/f85 x:0 0 0 2024-09-21T11:39:27.023 INFO:tasks.workunit.client.0.smithi118.stdout:4/349: dwrite d2/d6/de/d3e/d5e/f62 [0,4194304] 0 2024-09-21T11:39:27.026 INFO:tasks.workunit.client.0.smithi118.stdout:1/443: mknod d6/d2a/d3d/c89 0 2024-09-21T11:39:27.028 INFO:tasks.workunit.client.0.smithi118.stdout:9/475: creat d0/fb1 x:0 0 0 2024-09-21T11:39:27.031 INFO:tasks.workunit.client.0.smithi118.stdout:2/347: rename de/d1f/c4e to de/d50/d63/c80 0 2024-09-21T11:39:27.038 INFO:tasks.workunit.client.0.smithi118.stdout:1/444: dread - d6/de/d16/d3f/d50/d54/d32/f5a zero size 2024-09-21T11:39:27.039 INFO:tasks.workunit.client.0.smithi118.stdout:9/476: rmdir d0/d20 39 2024-09-21T11:39:27.043 INFO:tasks.workunit.client.0.smithi118.stdout:0/773: dwrite d5/d34/d44/d87/d9a/faa [0,4194304] 0 2024-09-21T11:39:27.044 INFO:tasks.workunit.client.0.smithi118.stdout:5/447: mkdir d0/db/d35/d30/d1a/d8f/d99 0 2024-09-21T11:39:27.045 INFO:tasks.workunit.client.0.smithi118.stdout:5/448: fsync d0/db/f87 0 2024-09-21T11:39:27.047 INFO:tasks.workunit.client.0.smithi118.stdout:4/350: symlink d2/l7e 0 2024-09-21T11:39:27.047 INFO:tasks.workunit.client.0.smithi118.stdout:5/449: dread d0/db/d35/d95/f98 [0,4194304] 0 2024-09-21T11:39:27.048 INFO:tasks.workunit.client.0.smithi118.stdout:5/450: write d0/d6c/f6a [539481,10879] 0 2024-09-21T11:39:27.049 INFO:tasks.workunit.client.0.smithi118.stdout:4/351: fsync d2/d6/de/d1c/d23/d26/d31/f53 0 2024-09-21T11:39:27.049 INFO:tasks.workunit.client.0.smithi118.stdout:9/477: unlink d0/f1 0 2024-09-21T11:39:27.050 INFO:tasks.workunit.client.0.smithi118.stdout:4/352: readlink d2/d6/dd/l5d 0 2024-09-21T11:39:27.057 INFO:tasks.workunit.client.0.smithi118.stdout:5/451: dwrite d0/d6c/f7e [0,4194304] 0 2024-09-21T11:39:27.059 INFO:tasks.workunit.client.0.smithi118.stdout:7/416: getdents d0/d3/d29 0 2024-09-21T11:39:27.064 INFO:tasks.workunit.client.0.smithi118.stdout:5/452: dwrite d0/db/d35/f3d [4194304,4194304] 0 2024-09-21T11:39:27.066 INFO:tasks.workunit.client.0.smithi118.stdout:5/453: write d0/db/d26/d65/f69 [4652299,71020] 0 2024-09-21T11:39:27.067 INFO:tasks.workunit.client.0.smithi118.stdout:2/348: getdents de/d51 0 2024-09-21T11:39:27.073 INFO:tasks.workunit.client.0.smithi118.stdout:4/353: mknod d2/d6/de/c7f 0 2024-09-21T11:39:27.076 INFO:tasks.workunit.client.0.smithi118.stdout:7/417: dread - d0/d3/d1d/f46 zero size 2024-09-21T11:39:27.078 INFO:tasks.workunit.client.0.smithi118.stdout:0/774: creat d5/d34/d44/d87/f103 x:0 0 0 2024-09-21T11:39:27.078 INFO:tasks.workunit.client.0.smithi118.stdout:0/775: chown d5 3775 1 2024-09-21T11:39:27.081 INFO:tasks.workunit.client.0.smithi118.stdout:0/776: dread d5/d10/d1e/d21/fcf [0,4194304] 0 2024-09-21T11:39:27.087 INFO:tasks.workunit.client.0.smithi118.stdout:0/777: dwrite d5/d29/fb2 [0,4194304] 0 2024-09-21T11:39:27.092 INFO:tasks.workunit.client.0.smithi118.stdout:1/445: dwrite d6/d2a/f23 [0,4194304] 0 2024-09-21T11:39:27.099 INFO:tasks.workunit.client.0.smithi118.stdout:9/478: rmdir d0/d20/d4c/d5f/d68/d99 0 2024-09-21T11:39:27.105 INFO:tasks.workunit.client.0.smithi118.stdout:7/418: dread d0/d3/f11 [0,4194304] 0 2024-09-21T11:39:27.154 INFO:tasks.workunit.client.0.smithi118.stdout:6/375: sync 2024-09-21T11:39:27.170 INFO:tasks.workunit.client.0.smithi118.stdout:2/349: truncate de/d16/d31/f3d 4160968 0 2024-09-21T11:39:27.170 INFO:tasks.workunit.client.0.smithi118.stdout:1/446: write d6/de/d16/d3f/d50/d54/f39 [806779,99569] 0 2024-09-21T11:39:27.177 INFO:tasks.workunit.client.0.smithi118.stdout:2/350: dwrite de/d16/d31/f7c [0,4194304] 0 2024-09-21T11:39:27.178 INFO:tasks.workunit.client.0.smithi118.stdout:2/351: chown de/d16/d1c/d4f/f7f 501 1 2024-09-21T11:39:27.190 INFO:tasks.workunit.client.0.smithi118.stdout:7/419: mknod d0/d3/d14/d41/c86 0 2024-09-21T11:39:27.193 INFO:tasks.workunit.client.0.smithi118.stdout:6/376: creat d8/d48/d5f/f7c x:0 0 0 2024-09-21T11:39:27.196 INFO:tasks.workunit.client.0.smithi118.stdout:1/447: fdatasync d6/d2a/f3a 0 2024-09-21T11:39:27.199 INFO:tasks.workunit.client.0.smithi118.stdout:5/454: link d0/db/d35/c14 d0/db/d35/d2c/c9a 0 2024-09-21T11:39:27.200 INFO:tasks.workunit.client.0.smithi118.stdout:5/455: dread - d0/d89/f8d zero size 2024-09-21T11:39:27.203 INFO:tasks.workunit.client.0.smithi118.stdout:9/479: readlink d0/d20/l2d 0 2024-09-21T11:39:27.209 INFO:tasks.workunit.client.0.smithi118.stdout:6/377: write d8/d48/d5f/f73 [41018,81390] 0 2024-09-21T11:39:27.213 INFO:tasks.workunit.client.0.smithi118.stdout:1/448: mknod d6/de/d16/d3f/d50/c8a 0 2024-09-21T11:39:27.216 INFO:tasks.workunit.client.0.smithi118.stdout:6/378: dwrite d8/d48/d5f/f7c [0,4194304] 0 2024-09-21T11:39:27.217 INFO:tasks.workunit.client.0.smithi118.stdout:2/352: fdatasync de/d16/d31/f3d 0 2024-09-21T11:39:27.217 INFO:tasks.workunit.client.0.smithi118.stdout:8/733: sync 2024-09-21T11:39:27.217 INFO:tasks.workunit.client.0.smithi118.stdout:3/395: sync 2024-09-21T11:39:27.222 INFO:tasks.workunit.client.0.smithi118.stdout:9/480: mkdir d0/d20/d4c/d5f/d68/d7c/db2 0 2024-09-21T11:39:27.224 INFO:tasks.workunit.client.0.smithi118.stdout:1/449: dwrite d6/f79 [0,4194304] 0 2024-09-21T11:39:27.231 INFO:tasks.workunit.client.0.smithi118.stdout:2/353: creat de/d50/f81 x:0 0 0 2024-09-21T11:39:27.237 INFO:tasks.workunit.client.0.smithi118.stdout:3/396: creat d5/d1d/d1b/d4c/d91/f93 x:0 0 0 2024-09-21T11:39:27.241 INFO:tasks.workunit.client.0.smithi118.stdout:9/481: write d0/f1c [1645732,96010] 0 2024-09-21T11:39:27.245 INFO:tasks.workunit.client.0.smithi118.stdout:1/450: dread d6/de/d16/d3f/f4d [0,4194304] 0 2024-09-21T11:39:27.252 INFO:tasks.workunit.client.0.smithi118.stdout:8/734: creat d2/dc/d10/d2e/d18/d36/ffc x:0 0 0 2024-09-21T11:39:27.253 INFO:tasks.workunit.client.0.smithi118.stdout:2/354: dwrite de/d1f/d20/f2d [8388608,4194304] 0 2024-09-21T11:39:27.255 INFO:tasks.workunit.client.0.smithi118.stdout:2/355: write de/d51/f5c [123750,3715] 0 2024-09-21T11:39:27.255 INFO:tasks.workunit.client.0.smithi118.stdout:6/379: dread d8/d46/f52 [0,4194304] 0 2024-09-21T11:39:27.255 INFO:tasks.workunit.client.0.smithi118.stdout:8/735: dread - d2/dc/d49/d84/ff8 zero size 2024-09-21T11:39:27.257 INFO:tasks.workunit.client.0.smithi118.stdout:2/356: fsync de/d1f/d20/f48 0 2024-09-21T11:39:27.260 INFO:tasks.workunit.client.0.smithi118.stdout:9/482: symlink d0/d20/d71/lb3 0 2024-09-21T11:39:27.261 INFO:tasks.workunit.client.0.smithi118.stdout:1/451: creat d6/de/d13/f8b x:0 0 0 2024-09-21T11:39:27.266 INFO:tasks.workunit.client.0.smithi118.stdout:2/357: dwrite de/d51/f6b [0,4194304] 0 2024-09-21T11:39:27.267 INFO:tasks.workunit.client.0.smithi118.stdout:2/358: fsync de/d16/d1c/d4f/f7f 0 2024-09-21T11:39:27.268 INFO:tasks.workunit.client.0.smithi118.stdout:1/452: dread - d6/d33/d3c/f42 zero size 2024-09-21T11:39:27.269 INFO:tasks.workunit.client.0.smithi118.stdout:9/483: truncate d0/d20/d4c/d5f/d68/d7c/fa6 254270 0 2024-09-21T11:39:27.271 INFO:tasks.workunit.client.0.smithi118.stdout:6/380: mkdir d8/d48/d45/d61/d70/d7d 0 2024-09-21T11:39:27.271 INFO:tasks.workunit.client.0.smithi118.stdout:6/381: fsync d8/f5c 0 2024-09-21T11:39:27.274 INFO:tasks.workunit.client.0.smithi118.stdout:2/359: creat de/d16/d1c/d65/f82 x:0 0 0 2024-09-21T11:39:27.276 INFO:tasks.workunit.client.0.smithi118.stdout:6/382: mkdir d8/d48/d72/d7e 0 2024-09-21T11:39:27.279 INFO:tasks.workunit.client.0.smithi118.stdout:2/360: rmdir de/d1f 39 2024-09-21T11:39:27.280 INFO:tasks.workunit.client.0.smithi118.stdout:2/361: fdatasync de/d16/d31/f7c 0 2024-09-21T11:39:27.283 INFO:tasks.workunit.client.0.smithi118.stdout:6/383: dwrite d8/f25 [0,4194304] 0 2024-09-21T11:39:27.286 INFO:tasks.workunit.client.0.smithi118.stdout:6/384: truncate d8/d48/d6c/f69 4915584 0 2024-09-21T11:39:27.292 INFO:tasks.workunit.client.0.smithi118.stdout:9/484: dread d0/d4/f8 [0,4194304] 0 2024-09-21T11:39:27.293 INFO:tasks.workunit.client.0.smithi118.stdout:9/485: readlink d0/d4/l9b 0 2024-09-21T11:39:27.295 INFO:tasks.workunit.client.0.smithi118.stdout:9/486: chown d0/fa1 922 1 2024-09-21T11:39:27.296 INFO:tasks.workunit.client.0.smithi118.stdout:9/487: write d0/d20/d4c/d5f/d89/f9e [282631,24369] 0 2024-09-21T11:39:27.298 INFO:tasks.workunit.client.0.smithi118.stdout:9/488: write d0/d20/d71/f8d [484374,66803] 0 2024-09-21T11:39:27.300 INFO:tasks.workunit.client.0.smithi118.stdout:6/385: dread d8/d48/d45/f4d [0,4194304] 0 2024-09-21T11:39:27.300 INFO:tasks.workunit.client.0.smithi118.stdout:9/489: chown d0/d20/d4c/d5f/d68/f92 60 1 2024-09-21T11:39:27.303 INFO:tasks.workunit.client.0.smithi118.stdout:9/490: mkdir d0/d20/d4c/d5f/d6c/d88/db4 0 2024-09-21T11:39:27.308 INFO:tasks.workunit.client.0.smithi118.stdout:7/420: symlink d0/d3/d29/l87 0 2024-09-21T11:39:27.309 INFO:tasks.workunit.client.0.smithi118.stdout:7/421: write d0/d3/d14/f3c [110874,4196] 0 2024-09-21T11:39:27.310 INFO:tasks.workunit.client.0.smithi118.stdout:9/491: dwrite d0/d20/f64 [0,4194304] 0 2024-09-21T11:39:27.329 INFO:tasks.workunit.client.0.smithi118.stdout:0/778: dwrite d5/d29/d68/d7b/db7/f78 [0,4194304] 0 2024-09-21T11:39:27.332 INFO:tasks.workunit.client.0.smithi118.stdout:0/779: symlink d5/d81/l104 0 2024-09-21T11:39:27.343 INFO:tasks.workunit.client.0.smithi118.stdout:3/397: creat d5/d28/f94 x:0 0 0 2024-09-21T11:39:27.344 INFO:tasks.workunit.client.0.smithi118.stdout:3/398: dread - d5/d1d/d1b/d4b/f90 zero size 2024-09-21T11:39:27.347 INFO:tasks.workunit.client.0.smithi118.stdout:5/456: truncate d0/db/d35/d30/d66/f71 431697 0 2024-09-21T11:39:27.350 INFO:tasks.workunit.client.0.smithi118.stdout:5/457: unlink d0/db/d35/d30/d1a/l38 0 2024-09-21T11:39:27.351 INFO:tasks.workunit.client.0.smithi118.stdout:5/458: chown d0/d6c/d25/d50 111545 1 2024-09-21T11:39:27.365 INFO:tasks.workunit.client.0.smithi118.stdout:3/399: dread d5/d28/f71 [0,4194304] 0 2024-09-21T11:39:27.367 INFO:tasks.workunit.client.0.smithi118.stdout:3/400: creat d5/d1d/d1b/d4b/f95 x:0 0 0 2024-09-21T11:39:27.378 INFO:tasks.workunit.client.0.smithi118.stdout:3/401: dread d5/f17 [0,4194304] 0 2024-09-21T11:39:27.384 INFO:tasks.workunit.client.0.smithi118.stdout:3/402: dwrite d5/d1d/d1b/d4c/f63 [0,4194304] 0 2024-09-21T11:39:27.386 INFO:tasks.workunit.client.0.smithi118.stdout:1/453: rmdir d6/d2a/d5c 39 2024-09-21T11:39:27.388 INFO:tasks.workunit.client.0.smithi118.stdout:3/403: creat d5/d1d/d1b/d4b/f96 x:0 0 0 2024-09-21T11:39:27.390 INFO:tasks.workunit.client.0.smithi118.stdout:6/386: rmdir d8/d48/d45 39 2024-09-21T11:39:27.393 INFO:tasks.workunit.client.0.smithi118.stdout:3/404: creat d5/d28/d33/d80/f97 x:0 0 0 2024-09-21T11:39:27.397 INFO:tasks.workunit.client.0.smithi118.stdout:4/354: creat d2/d6/de/f80 x:0 0 0 2024-09-21T11:39:27.397 INFO:tasks.workunit.client.0.smithi118.stdout:6/387: dwrite d8/fc [0,4194304] 0 2024-09-21T11:39:27.402 INFO:tasks.workunit.client.0.smithi118.stdout:3/405: write d5/d1d/f23 [8566929,93152] 0 2024-09-21T11:39:27.403 INFO:tasks.workunit.client.0.smithi118.stdout:4/355: stat d2/f21 0 2024-09-21T11:39:27.403 INFO:tasks.workunit.client.0.smithi118.stdout:3/406: fsync d5/d1d/d1b/d24/f36 0 2024-09-21T11:39:27.405 INFO:tasks.workunit.client.0.smithi118.stdout:3/407: chown d5/d1d/d1b/d4b/f90 0 1 2024-09-21T11:39:27.405 INFO:tasks.workunit.client.0.smithi118.stdout:4/356: truncate d2/d6/de/d1c/f4a 1364383 0 2024-09-21T11:39:27.405 INFO:tasks.workunit.client.0.smithi118.stdout:9/492: write d0/f13 [415465,59448] 0 2024-09-21T11:39:27.408 INFO:tasks.workunit.client.0.smithi118.stdout:4/357: truncate d2/d6/dd/f57 632537 0 2024-09-21T11:39:27.412 INFO:tasks.workunit.client.0.smithi118.stdout:9/493: rename d0/d4/d38/d4e to d0/d4/d45/db5 0 2024-09-21T11:39:27.413 INFO:tasks.workunit.client.0.smithi118.stdout:4/358: creat d2/d6/de/d1c/d4d/d52/d69/f81 x:0 0 0 2024-09-21T11:39:27.417 INFO:tasks.workunit.client.0.smithi118.stdout:4/359: truncate d2/f2d 4353146 0 2024-09-21T11:39:27.420 INFO:tasks.workunit.client.0.smithi118.stdout:4/360: creat d2/d6/de/d1c/d4d/d52/d69/f82 x:0 0 0 2024-09-21T11:39:27.427 INFO:tasks.workunit.client.0.smithi118.stdout:0/780: dwrite d5/d10/d1e/d23/d3a/d4e/fd1 [0,4194304] 0 2024-09-21T11:39:27.428 INFO:tasks.workunit.client.0.smithi118.stdout:4/361: truncate d2/d6/de/d1c/d23/d26/f73 1788548 0 2024-09-21T11:39:27.434 INFO:tasks.workunit.client.0.smithi118.stdout:4/362: dwrite d2/d6/de/d1c/f47 [0,4194304] 0 2024-09-21T11:39:27.435 INFO:tasks.workunit.client.0.smithi118.stdout:7/422: unlink d0/d3/d14/f15 0 2024-09-21T11:39:27.449 INFO:tasks.workunit.client.0.smithi118.stdout:1/454: write d6/d3b/f43 [2230470,80196] 0 2024-09-21T11:39:27.450 INFO:tasks.workunit.client.0.smithi118.stdout:1/455: write d6/de/f25 [3721211,64699] 0 2024-09-21T11:39:27.451 INFO:tasks.workunit.client.0.smithi118.stdout:1/456: stat d6/d33/f44 0 2024-09-21T11:39:27.452 INFO:tasks.workunit.client.0.smithi118.stdout:1/457: fdatasync d6/de/d13/f8b 0 2024-09-21T11:39:27.456 INFO:tasks.workunit.client.0.smithi118.stdout:6/388: truncate d8/fa 4499167 0 2024-09-21T11:39:27.465 INFO:tasks.workunit.client.0.smithi118.stdout:4/363: rename d2/d65/f70 to d2/d6/de/d3e/d5e/f83 0 2024-09-21T11:39:27.467 INFO:tasks.workunit.client.0.smithi118.stdout:4/364: truncate d2/d6/de/d1c/d4d/d52/d69/f82 171397 0 2024-09-21T11:39:27.468 INFO:tasks.workunit.client.0.smithi118.stdout:4/365: chown d2/d6/de/d1c/d23/l25 5302580 1 2024-09-21T11:39:27.472 INFO:tasks.workunit.client.0.smithi118.stdout:0/781: creat d5/d10/d1e/d20/dfe/f105 x:0 0 0 2024-09-21T11:39:27.473 INFO:tasks.workunit.client.0.smithi118.stdout:7/423: symlink d0/d3/d14/d41/d7f/d3e/d81/l88 0 2024-09-21T11:39:27.478 INFO:tasks.workunit.client.0.smithi118.stdout:4/366: unlink d2/d6/f14 0 2024-09-21T11:39:27.479 INFO:tasks.workunit.client.0.smithi118.stdout:4/367: truncate d2/d6/dd/d35/f48 476535 0 2024-09-21T11:39:27.483 INFO:tasks.workunit.client.0.smithi118.stdout:7/424: mknod d0/d3/c89 0 2024-09-21T11:39:27.484 INFO:tasks.workunit.client.0.smithi118.stdout:4/368: creat d2/d6/de/d1c/d4d/d52/d69/f84 x:0 0 0 2024-09-21T11:39:27.485 INFO:tasks.workunit.client.0.smithi118.stdout:7/425: chown d0/d3/d1d/c3f 226 1 2024-09-21T11:39:27.493 INFO:tasks.workunit.client.0.smithi118.stdout:7/426: dread d0/f16 [4194304,4194304] 0 2024-09-21T11:39:27.496 INFO:tasks.workunit.client.0.smithi118.stdout:7/427: read d0/d3/d14/f28 [1334079,21172] 0 2024-09-21T11:39:27.497 INFO:tasks.workunit.client.0.smithi118.stdout:6/389: write d8/d14/f26 [454749,89380] 0 2024-09-21T11:39:27.498 INFO:tasks.workunit.client.0.smithi118.stdout:4/369: dread d2/f2d [0,4194304] 0 2024-09-21T11:39:27.504 INFO:tasks.workunit.client.0.smithi118.stdout:6/390: creat d8/d46/f7f x:0 0 0 2024-09-21T11:39:27.509 INFO:tasks.workunit.client.0.smithi118.stdout:6/391: chown d8/l17 0 1 2024-09-21T11:39:27.511 INFO:tasks.workunit.client.0.smithi118.stdout:7/428: dread d0/d3/d1d/d35/f58 [0,4194304] 0 2024-09-21T11:39:27.511 INFO:tasks.workunit.client.0.smithi118.stdout:4/370: link d2/d6/de/d1c/d23/d26/d31/f53 d2/d6/de/d1c/f85 0 2024-09-21T11:39:27.512 INFO:tasks.workunit.client.0.smithi118.stdout:7/429: write d0/d3/d1d/f45 [888887,86978] 0 2024-09-21T11:39:27.518 INFO:tasks.workunit.client.0.smithi118.stdout:6/392: truncate d8/d48/d45/f4d 4383298 0 2024-09-21T11:39:27.525 INFO:tasks.workunit.client.0.smithi118.stdout:7/430: creat d0/d3/d14/d41/d7f/f8a x:0 0 0 2024-09-21T11:39:27.527 INFO:tasks.workunit.client.0.smithi118.stdout:6/393: fsync d8/d46/f52 0 2024-09-21T11:39:27.536 INFO:tasks.workunit.client.0.smithi118.stdout:6/394: dwrite d8/d48/d45/f4d [4194304,4194304] 0 2024-09-21T11:39:27.537 INFO:tasks.workunit.client.0.smithi118.stdout:7/431: dwrite d0/d3/f5e [0,4194304] 0 2024-09-21T11:39:27.540 INFO:tasks.workunit.client.0.smithi118.stdout:7/432: mkdir d0/d3/d14/d41/d8b 0 2024-09-21T11:39:27.541 INFO:tasks.workunit.client.0.smithi118.stdout:4/371: dread d2/d6/de/d1c/d23/f2c [0,4194304] 0 2024-09-21T11:39:27.546 INFO:tasks.workunit.client.0.smithi118.stdout:6/395: dwrite d8/d46/f52 [0,4194304] 0 2024-09-21T11:39:27.548 INFO:tasks.workunit.client.0.smithi118.stdout:4/372: symlink d2/d6/de/d1c/l86 0 2024-09-21T11:39:27.549 INFO:tasks.workunit.client.0.smithi118.stdout:6/396: creat d8/d48/d5f/f80 x:0 0 0 2024-09-21T11:39:27.558 INFO:tasks.workunit.client.0.smithi118.stdout:7/433: dread d0/d3/d29/f20 [0,4194304] 0 2024-09-21T11:39:27.562 INFO:tasks.workunit.client.0.smithi118.stdout:7/434: write d0/d3/d14/d41/f4b [2188965,52837] 0 2024-09-21T11:39:27.563 INFO:tasks.workunit.client.0.smithi118.stdout:7/435: rmdir d0/d3/d14/d41/d66 39 2024-09-21T11:39:27.589 INFO:tasks.workunit.client.0.smithi118.stdout:6/397: truncate d8/d48/d45/f4d 8186231 0 2024-09-21T11:39:27.592 INFO:tasks.workunit.client.0.smithi118.stdout:6/398: creat d8/d46/f81 x:0 0 0 2024-09-21T11:39:27.594 INFO:tasks.workunit.client.0.smithi118.stdout:7/436: dread d0/d3/d1d/d35/d70/f80 [0,4194304] 0 2024-09-21T11:39:27.594 INFO:tasks.workunit.client.0.smithi118.stdout:6/399: readlink d8/d48/d6c/l58 0 2024-09-21T11:39:27.596 INFO:tasks.workunit.client.0.smithi118.stdout:4/373: dwrite d2/d6/de/d3e/f77 [0,4194304] 0 2024-09-21T11:39:27.598 INFO:tasks.workunit.client.0.smithi118.stdout:6/400: creat d8/d14/f82 x:0 0 0 2024-09-21T11:39:27.603 INFO:tasks.workunit.client.0.smithi118.stdout:4/374: dread d2/f21 [0,4194304] 0 2024-09-21T11:39:27.603 INFO:tasks.workunit.client.0.smithi118.stdout:6/401: write d8/d48/d45/f4d [6551993,21107] 0 2024-09-21T11:39:27.604 INFO:tasks.workunit.client.0.smithi118.stdout:7/437: getdents d0/d3/d14/d41/d7f 0 2024-09-21T11:39:27.605 INFO:tasks.workunit.client.0.smithi118.stdout:6/402: readlink d8/l40 0 2024-09-21T11:39:27.608 INFO:tasks.workunit.client.0.smithi118.stdout:4/375: mkdir d2/d6/de/d1c/d87 0 2024-09-21T11:39:27.611 INFO:tasks.workunit.client.0.smithi118.stdout:6/403: chown d8/c4c 60 1 2024-09-21T11:39:27.617 INFO:tasks.workunit.client.0.smithi118.stdout:6/404: creat d8/d48/d45/d61/d70/f83 x:0 0 0 2024-09-21T11:39:27.617 INFO:tasks.workunit.client.0.smithi118.stdout:4/376: dwrite d2/f7c [0,4194304] 0 2024-09-21T11:39:27.618 INFO:tasks.workunit.client.0.smithi118.stdout:7/438: dwrite d0/d3/d29/f76 [0,4194304] 0 2024-09-21T11:39:27.619 INFO:tasks.workunit.client.0.smithi118.stdout:6/405: write d8/f38 [4747794,51064] 0 2024-09-21T11:39:27.621 INFO:tasks.workunit.client.0.smithi118.stdout:4/377: write d2/d6/de/d1c/f4a [1772822,42723] 0 2024-09-21T11:39:27.622 INFO:tasks.workunit.client.0.smithi118.stdout:6/406: chown d8/d48/d6c/l58 2711 1 2024-09-21T11:39:27.623 INFO:tasks.workunit.client.0.smithi118.stdout:4/378: write d2/d6/de/d3e/f77 [4558394,92900] 0 2024-09-21T11:39:27.625 INFO:tasks.workunit.client.0.smithi118.stdout:7/439: mknod d0/d3/d1d/d35/d70/c8c 0 2024-09-21T11:39:27.629 INFO:tasks.workunit.client.0.smithi118.stdout:4/379: read d2/d6/f22 [356610,55430] 0 2024-09-21T11:39:27.631 INFO:tasks.workunit.client.0.smithi118.stdout:4/380: symlink d2/l88 0 2024-09-21T11:39:27.632 INFO:tasks.workunit.client.0.smithi118.stdout:7/440: creat d0/d3/d29/f8d x:0 0 0 2024-09-21T11:39:27.646 INFO:tasks.workunit.client.0.smithi118.stdout:7/441: write d0/d3/d1d/d35/f43 [395584,92523] 0 2024-09-21T11:39:27.652 INFO:tasks.workunit.client.0.smithi118.stdout:4/381: dwrite d2/d6/de/d1c/d23/f2c [0,4194304] 0 2024-09-21T11:39:27.652 INFO:tasks.workunit.client.0.smithi118.stdout:6/407: dread d8/d48/f31 [0,4194304] 0 2024-09-21T11:39:27.654 INFO:tasks.workunit.client.0.smithi118.stdout:6/408: chown d8/d48/d45/d61/d70 104 1 2024-09-21T11:39:27.654 INFO:tasks.workunit.client.0.smithi118.stdout:7/442: creat d0/d3/d14/d41/d66/f8e x:0 0 0 2024-09-21T11:39:27.656 INFO:tasks.workunit.client.0.smithi118.stdout:4/382: mkdir d2/d65/d89 0 2024-09-21T11:39:27.658 INFO:tasks.workunit.client.0.smithi118.stdout:6/409: read d8/d48/d45/f67 [1452585,80262] 0 2024-09-21T11:39:27.658 INFO:tasks.workunit.client.0.smithi118.stdout:7/443: unlink d0/d3/d29/l87 0 2024-09-21T11:39:27.659 INFO:tasks.workunit.client.0.smithi118.stdout:6/410: chown d8/c4c 6 1 2024-09-21T11:39:27.661 INFO:tasks.workunit.client.0.smithi118.stdout:7/444: mkdir d0/d3/d13/d8f 0 2024-09-21T11:39:27.664 INFO:tasks.workunit.client.0.smithi118.stdout:4/383: dwrite d2/d6/dd/d35/f6c [0,4194304] 0 2024-09-21T11:39:27.666 INFO:tasks.workunit.client.0.smithi118.stdout:6/411: dread d8/f38 [0,4194304] 0 2024-09-21T11:39:27.666 INFO:tasks.workunit.client.0.smithi118.stdout:7/445: unlink d0/d3/l19 0 2024-09-21T11:39:27.670 INFO:tasks.workunit.client.0.smithi118.stdout:6/412: creat d8/d48/d45/d61/d70/f84 x:0 0 0 2024-09-21T11:39:27.672 INFO:tasks.workunit.client.0.smithi118.stdout:6/413: read d8/d14/d33/f62 [1033266,36681] 0 2024-09-21T11:39:27.672 INFO:tasks.workunit.client.0.smithi118.stdout:7/446: rmdir d0/d3/d29 39 2024-09-21T11:39:27.673 INFO:tasks.workunit.client.0.smithi118.stdout:4/384: link d2/f7c d2/f8a 0 2024-09-21T11:39:27.674 INFO:tasks.workunit.client.0.smithi118.stdout:4/385: fsync d2/d6/de/d1c/d4d/d52/d69/f67 0 2024-09-21T11:39:27.675 INFO:tasks.workunit.client.0.smithi118.stdout:7/447: chown d0/d3/d29/f8d 44642717 1 2024-09-21T11:39:27.675 INFO:tasks.workunit.client.0.smithi118.stdout:4/386: chown d2/d6/dd/d35/f6e 1522051 1 2024-09-21T11:39:27.676 INFO:tasks.workunit.client.0.smithi118.stdout:6/414: symlink d8/d14/d33/l85 0 2024-09-21T11:39:27.679 INFO:tasks.workunit.client.0.smithi118.stdout:7/448: chown d0/d3/c17 129443625 1 2024-09-21T11:39:27.681 INFO:tasks.workunit.client.0.smithi118.stdout:7/449: write d0/d3/d14/f32 [2200203,56974] 0 2024-09-21T11:39:27.683 INFO:tasks.workunit.client.0.smithi118.stdout:4/387: dwrite d2/d6/de/d1c/d4d/f68 [4194304,4194304] 0 2024-09-21T11:39:27.685 INFO:tasks.workunit.client.0.smithi118.stdout:6/415: creat d8/d48/d45/d61/d66/f86 x:0 0 0 2024-09-21T11:39:27.685 INFO:tasks.workunit.client.0.smithi118.stdout:4/388: truncate d2/d6/de/d1c/f85 602946 0 2024-09-21T11:39:27.689 INFO:tasks.workunit.client.0.smithi118.stdout:7/450: symlink d0/d3/d14/l90 0 2024-09-21T11:39:27.692 INFO:tasks.workunit.client.0.smithi118.stdout:7/451: fsync d0/d3/d14/d41/d7f/d3e/d81/f83 0 2024-09-21T11:39:27.693 INFO:tasks.workunit.client.0.smithi118.stdout:6/416: dwrite d8/d14/f82 [0,4194304] 0 2024-09-21T11:39:27.693 INFO:tasks.workunit.client.0.smithi118.stdout:4/389: mknod d2/d6/de/d1c/d4d/c8b 0 2024-09-21T11:39:27.694 INFO:tasks.workunit.client.0.smithi118.stdout:4/390: chown d2/d6/de/d1c/d87 2001 1 2024-09-21T11:39:27.696 INFO:tasks.workunit.client.0.smithi118.stdout:4/391: fdatasync d2/d6/dd/d35/f6e 0 2024-09-21T11:39:27.702 INFO:tasks.workunit.client.0.smithi118.stdout:4/392: symlink d2/d6/dd/d35/l8c 0 2024-09-21T11:39:27.703 INFO:tasks.workunit.client.0.smithi118.stdout:4/393: chown d2/d6/de/d1c/d4d/d52/f6a 25797 1 2024-09-21T11:39:27.707 INFO:tasks.workunit.client.0.smithi118.stdout:4/394: mkdir d2/d6/dd/d8d 0 2024-09-21T11:39:27.708 INFO:tasks.workunit.client.0.smithi118.stdout:4/395: chown d2/d6/de/d1c/d23/c38 13938846 1 2024-09-21T11:39:27.711 INFO:tasks.workunit.client.0.smithi118.stdout:4/396: mkdir d2/d8e 0 2024-09-21T11:39:27.716 INFO:tasks.workunit.client.0.smithi118.stdout:4/397: dread d2/d6/de/d1c/d4d/f68 [4194304,4194304] 0 2024-09-21T11:39:27.718 INFO:tasks.workunit.client.0.smithi118.stdout:6/417: truncate d8/d14/f78 3441509 0 2024-09-21T11:39:27.718 INFO:tasks.workunit.client.0.smithi118.stdout:7/452: dwrite d0/d3/d14/f65 [0,4194304] 0 2024-09-21T11:39:27.720 INFO:tasks.workunit.client.0.smithi118.stdout:7/453: write d0/d3/d1d/f45 [2077278,80579] 0 2024-09-21T11:39:27.729 INFO:tasks.workunit.client.0.smithi118.stdout:7/454: dwrite d0/d3/d14/d41/d66/f8e [0,4194304] 0 2024-09-21T11:39:27.731 INFO:tasks.workunit.client.0.smithi118.stdout:6/418: creat d8/d48/d45/d61/d70/f87 x:0 0 0 2024-09-21T11:39:27.736 INFO:tasks.workunit.client.0.smithi118.stdout:7/455: fsync d0/f2a 0 2024-09-21T11:39:27.739 INFO:tasks.workunit.client.0.smithi118.stdout:6/419: creat d8/d14/d33/f88 x:0 0 0 2024-09-21T11:39:27.740 INFO:tasks.workunit.client.0.smithi118.stdout:4/398: write d2/d6/dd/d35/f72 [524851,27422] 0 2024-09-21T11:39:27.746 INFO:tasks.workunit.client.0.smithi118.stdout:7/456: rename d0/f10 to d0/d3/d1d/d35/d57/f91 0 2024-09-21T11:39:27.746 INFO:tasks.workunit.client.0.smithi118.stdout:6/420: dwrite d8/f60 [0,4194304] 0 2024-09-21T11:39:27.747 INFO:tasks.workunit.client.0.smithi118.stdout:7/457: chown d0/d3/d1d/d35/f7a 1950741 1 2024-09-21T11:39:27.749 INFO:tasks.workunit.client.0.smithi118.stdout:7/458: write d0/d3/d14/f65 [3850399,31308] 0 2024-09-21T11:39:27.751 INFO:tasks.workunit.client.0.smithi118.stdout:7/459: fsync d0/d3/d14/f65 0 2024-09-21T11:39:27.752 INFO:tasks.workunit.client.0.smithi118.stdout:6/421: fdatasync d8/d48/d45/f67 0 2024-09-21T11:39:27.753 INFO:tasks.workunit.client.0.smithi118.stdout:7/460: write d0/d3/d13/f2f [4697988,65185] 0 2024-09-21T11:39:27.754 INFO:tasks.workunit.client.0.smithi118.stdout:7/461: chown d0/d3/d14/l90 118039689 1 2024-09-21T11:39:27.755 INFO:tasks.workunit.client.0.smithi118.stdout:4/399: mknod d2/d65/d89/c8f 0 2024-09-21T11:39:27.757 INFO:tasks.workunit.client.0.smithi118.stdout:4/400: write d2/d6/de/d1c/d4d/d52/d69/f81 [71291,34377] 0 2024-09-21T11:39:27.766 INFO:tasks.workunit.client.0.smithi118.stdout:6/422: mknod d8/d14/d44/c89 0 2024-09-21T11:39:27.770 INFO:tasks.workunit.client.0.smithi118.stdout:6/423: mknod d8/d48/d45/d61/d66/c8a 0 2024-09-21T11:39:27.773 INFO:tasks.workunit.client.0.smithi118.stdout:6/424: fdatasync d8/d48/d45/f67 0 2024-09-21T11:39:27.775 INFO:tasks.workunit.client.0.smithi118.stdout:4/401: link d2/l7e d2/d6/dd/l90 0 2024-09-21T11:39:27.781 INFO:tasks.workunit.client.0.smithi118.stdout:7/462: dwrite d0/fe [0,4194304] 0 2024-09-21T11:39:27.783 INFO:tasks.workunit.client.0.smithi118.stdout:4/402: dwrite d2/d6/de/d3e/f77 [0,4194304] 0 2024-09-21T11:39:27.784 INFO:tasks.workunit.client.0.smithi118.stdout:4/403: fsync d2/d65/f6d 0 2024-09-21T11:39:27.789 INFO:tasks.workunit.client.0.smithi118.stdout:7/463: write d0/d3/d29/f75 [849814,98994] 0 2024-09-21T11:39:27.790 INFO:tasks.workunit.client.0.smithi118.stdout:7/464: chown d0/d3/d14/d41/d66/f67 30655 1 2024-09-21T11:39:27.791 INFO:tasks.workunit.client.0.smithi118.stdout:7/465: readlink d0/d3/d14/d41/d7f/d3e/d81/l88 0 2024-09-21T11:39:27.792 INFO:tasks.workunit.client.0.smithi118.stdout:4/404: mknod d2/d6/dd/d35/c91 0 2024-09-21T11:39:27.795 INFO:tasks.workunit.client.0.smithi118.stdout:6/425: link d8/d48/d45/f4d d8/f8b 0 2024-09-21T11:39:27.804 INFO:tasks.workunit.client.0.smithi118.stdout:6/426: dwrite d8/d48/d45/f4d [4194304,4194304] 0 2024-09-21T11:39:27.812 INFO:tasks.workunit.client.0.smithi118.stdout:6/427: dread d8/d14/d33/f62 [0,4194304] 0 2024-09-21T11:39:27.812 INFO:tasks.workunit.client.0.smithi118.stdout:6/428: fsync d8/d14/f63 0 2024-09-21T11:39:27.815 INFO:tasks.workunit.client.0.smithi118.stdout:7/466: write d0/d3/d14/d41/d7f/d3e/f50 [457694,130996] 0 2024-09-21T11:39:27.816 INFO:tasks.workunit.client.0.smithi118.stdout:7/467: stat d0/d3/d13/f2f 0 2024-09-21T11:39:27.817 INFO:tasks.workunit.client.0.smithi118.stdout:7/468: write d0/d3/d1d/f7d [285110,3543] 0 2024-09-21T11:39:27.819 INFO:tasks.workunit.client.0.smithi118.stdout:6/429: creat d8/d48/d45/d61/d70/d7d/f8c x:0 0 0 2024-09-21T11:39:27.821 INFO:tasks.workunit.client.0.smithi118.stdout:6/430: write d8/d14/f26 [1450667,97964] 0 2024-09-21T11:39:27.822 INFO:tasks.workunit.client.0.smithi118.stdout:7/469: creat d0/d3/d13/f92 x:0 0 0 2024-09-21T11:39:27.823 INFO:tasks.workunit.client.0.smithi118.stdout:4/405: dwrite d2/f8a [0,4194304] 0 2024-09-21T11:39:27.824 INFO:tasks.workunit.client.0.smithi118.stdout:7/470: read d0/d3/d1d/d35/d70/f80 [4232240,123379] 0 2024-09-21T11:39:27.825 INFO:tasks.workunit.client.0.smithi118.stdout:6/431: fsync d8/f22 0 2024-09-21T11:39:27.826 INFO:tasks.workunit.client.0.smithi118.stdout:4/406: creat d2/d6/de/d1c/d23/f92 x:0 0 0 2024-09-21T11:39:27.830 INFO:tasks.workunit.client.0.smithi118.stdout:4/407: dread d2/f7c [0,4194304] 0 2024-09-21T11:39:27.830 INFO:tasks.workunit.client.0.smithi118.stdout:6/432: dread d8/d48/f31 [0,4194304] 0 2024-09-21T11:39:27.832 INFO:tasks.workunit.client.0.smithi118.stdout:7/471: write d0/d3/d29/d5f/f62 [2975273,104827] 0 2024-09-21T11:39:27.836 INFO:tasks.workunit.client.0.smithi118.stdout:6/433: mkdir d8/d48/d5f/d8d 0 2024-09-21T11:39:27.837 INFO:tasks.workunit.client.0.smithi118.stdout:7/472: creat d0/d3/d13/f93 x:0 0 0 2024-09-21T11:39:27.840 INFO:tasks.workunit.client.0.smithi118.stdout:6/434: truncate d8/d14/d33/f3e 3904793 0 2024-09-21T11:39:27.842 INFO:tasks.workunit.client.0.smithi118.stdout:7/473: creat d0/d3/d13/d8f/f94 x:0 0 0 2024-09-21T11:39:27.842 INFO:tasks.workunit.client.0.smithi118.stdout:7/474: fdatasync d0/d3/d13/f93 0 2024-09-21T11:39:27.846 INFO:tasks.workunit.client.0.smithi118.stdout:7/475: link d0/d3/d13/f38 d0/d3/d1d/d35/d57/f95 0 2024-09-21T11:39:27.849 INFO:tasks.workunit.client.0.smithi118.stdout:7/476: unlink d0/d3/l6e 0 2024-09-21T11:39:27.855 INFO:tasks.workunit.client.0.smithi118.stdout:4/408: dwrite d2/d6/dd/f51 [0,4194304] 0 2024-09-21T11:39:27.857 INFO:tasks.workunit.client.0.smithi118.stdout:4/409: dread - d2/d6/de/d1c/d4d/d52/f6a zero size 2024-09-21T11:39:27.863 INFO:tasks.workunit.client.0.smithi118.stdout:4/410: symlink d2/d6/dd/l93 0 2024-09-21T11:39:27.864 INFO:tasks.workunit.client.0.smithi118.stdout:7/477: write d0/d3/d14/f28 [5191120,103761] 0 2024-09-21T11:39:27.865 INFO:tasks.workunit.client.0.smithi118.stdout:7/478: dread - d0/d3/d29/f56 zero size 2024-09-21T11:39:27.866 INFO:tasks.workunit.client.0.smithi118.stdout:4/411: creat d2/d6/f94 x:0 0 0 2024-09-21T11:39:27.867 INFO:tasks.workunit.client.0.smithi118.stdout:7/479: mkdir d0/d3/d1d/d35/d57/d96 0 2024-09-21T11:39:27.868 INFO:tasks.workunit.client.0.smithi118.stdout:4/412: write d2/d6/de/d3e/d5e/f83 [1767262,2383] 0 2024-09-21T11:39:27.870 INFO:tasks.workunit.client.0.smithi118.stdout:7/480: write d0/d3/d29/d47/f84 [576837,40969] 0 2024-09-21T11:39:27.871 INFO:tasks.workunit.client.0.smithi118.stdout:4/413: creat d2/d6/de/d1c/d23/d26/f95 x:0 0 0 2024-09-21T11:39:27.877 INFO:tasks.workunit.client.0.smithi118.stdout:7/481: unlink d0/d3/d1d/d35/f43 0 2024-09-21T11:39:27.882 INFO:tasks.workunit.client.0.smithi118.stdout:7/482: creat d0/d3/d1d/d35/d57/d7e/f97 x:0 0 0 2024-09-21T11:39:27.884 INFO:tasks.workunit.client.0.smithi118.stdout:4/414: getdents d2/d6/dd/d35 0 2024-09-21T11:39:27.885 INFO:tasks.workunit.client.0.smithi118.stdout:4/415: write d2/d6/dd/d35/f6c [293186,88725] 0 2024-09-21T11:39:27.887 INFO:tasks.workunit.client.0.smithi118.stdout:4/416: dread d2/d6/de/d1c/f85 [0,4194304] 0 2024-09-21T11:39:27.888 INFO:tasks.workunit.client.0.smithi118.stdout:7/483: rename d0/d3/d1d/l7b to d0/d3/d13/l98 0 2024-09-21T11:39:27.888 INFO:tasks.workunit.client.0.smithi118.stdout:7/484: chown d0/f2a 4945901 1 2024-09-21T11:39:27.899 INFO:tasks.workunit.client.0.smithi118.stdout:7/485: getdents d0/d3/d14/d41 0 2024-09-21T11:39:27.901 INFO:tasks.workunit.client.0.smithi118.stdout:4/417: dwrite d2/d6/de/f1e [0,4194304] 0 2024-09-21T11:39:27.903 INFO:tasks.workunit.client.0.smithi118.stdout:4/418: dread d2/d6/de/d1c/d4d/d52/d69/f82 [0,4194304] 0 2024-09-21T11:39:27.905 INFO:tasks.workunit.client.0.smithi118.stdout:7/486: mknod d0/d3/d29/c99 0 2024-09-21T11:39:27.905 INFO:tasks.workunit.client.0.smithi118.stdout:7/487: chown d0/d3/d1d/d35/d70 262573302 1 2024-09-21T11:39:27.910 INFO:tasks.workunit.client.0.smithi118.stdout:7/488: creat d0/d3/d13/f9a x:0 0 0 2024-09-21T11:39:27.911 INFO:tasks.workunit.client.0.smithi118.stdout:7/489: write d0/d3/d13/d8f/f94 [574195,62730] 0 2024-09-21T11:39:27.913 INFO:tasks.workunit.client.0.smithi118.stdout:4/419: rename d2/d6/dd/d35/f48 to d2/d6/dd/f96 0 2024-09-21T11:39:27.914 INFO:tasks.workunit.client.0.smithi118.stdout:4/420: chown d2/d6/de/d1c/f85 9461 1 2024-09-21T11:39:27.915 INFO:tasks.workunit.client.0.smithi118.stdout:4/421: mkdir d2/d6/de/d1c/d23/d26/d31/d97 0 2024-09-21T11:39:27.918 INFO:tasks.workunit.client.0.smithi118.stdout:4/422: rename d2/d6/de/d3e/d5e/f62 to d2/d6/de/d1c/d23/d26/d31/f98 0 2024-09-21T11:39:27.921 INFO:tasks.workunit.client.0.smithi118.stdout:4/423: link d2/d6/de/d3e/l78 d2/d6/de/d1c/d23/l99 0 2024-09-21T11:39:27.922 INFO:tasks.workunit.client.0.smithi118.stdout:4/424: read - d2/d6/dd/d35/f3f zero size 2024-09-21T11:39:27.922 INFO:tasks.workunit.client.0.smithi118.stdout:4/425: chown d2/d6/de/d1c 719911 1 2024-09-21T11:39:27.924 INFO:tasks.workunit.client.0.smithi118.stdout:4/426: write d2/d6/de/d1c/d4d/d52/d69/f67 [3394442,94293] 0 2024-09-21T11:39:27.925 INFO:tasks.workunit.client.0.smithi118.stdout:4/427: write d2/d6/de/d1c/d23/f2c [3248691,108301] 0 2024-09-21T11:39:27.929 INFO:tasks.workunit.client.0.smithi118.stdout:4/428: rename d2/d6/de/d3e/f77 to d2/d6/de/d1c/d4d/f9a 0 2024-09-21T11:39:27.932 INFO:tasks.workunit.client.0.smithi118.stdout:4/429: rmdir d2/d6/de/d1c/d4d/d52 39 2024-09-21T11:39:27.936 INFO:tasks.workunit.client.0.smithi118.stdout:4/430: mkdir d2/d6/de/d1c/d23/d26/d31/d97/d9b 0 2024-09-21T11:39:27.936 INFO:tasks.workunit.client.0.smithi118.stdout:4/431: fsync d2/f7c 0 2024-09-21T11:39:27.942 INFO:tasks.workunit.client.0.smithi118.stdout:4/432: dwrite d2/d6/de/d3e/f63 [0,4194304] 0 2024-09-21T11:39:27.946 INFO:tasks.workunit.client.0.smithi118.stdout:4/433: fdatasync d2/d6/de/d1c/d23/d26/d31/f53 0 2024-09-21T11:39:27.953 INFO:tasks.workunit.client.0.smithi118.stdout:4/434: readlink d2/d6/de/d1c/d4d/d52/d69/l64 0 2024-09-21T11:39:27.957 INFO:tasks.workunit.client.0.smithi118.stdout:4/435: rename d2/d6/de/d3e/d5e/f83 to d2/d6/de/d1c/f9c 0 2024-09-21T11:39:27.960 INFO:tasks.workunit.client.0.smithi118.stdout:4/436: mknod d2/d6/dd/c9d 0 2024-09-21T11:39:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:28 smithi149 ceph-mon[36123]: pgmap v29: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 119 MiB/s rd, 316 MiB/s wr, 610 op/s 2024-09-21T11:39:28.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:28 smithi118 ceph-mon[28757]: pgmap v29: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 119 MiB/s rd, 316 MiB/s wr, 610 op/s 2024-09-21T11:39:29.217 INFO:tasks.workunit.client.0.smithi118.stdout:8/736: sync 2024-09-21T11:39:29.219 INFO:tasks.workunit.client.0.smithi118.stdout:8/737: write d2/dc/d10/d2e/dba/fc0 [3032185,35338] 0 2024-09-21T11:39:29.221 INFO:tasks.workunit.client.0.smithi118.stdout:8/738: creat d2/dc/d10/dd3/ffd x:0 0 0 2024-09-21T11:39:29.224 INFO:tasks.workunit.client.0.smithi118.stdout:8/739: symlink d2/dc/d10/d3b/dbb/lfe 0 2024-09-21T11:39:29.224 INFO:tasks.workunit.client.0.smithi118.stdout:8/740: chown d2/dc/d10/d3b/f6d 13509305 1 2024-09-21T11:39:29.230 INFO:tasks.workunit.client.0.smithi118.stdout:8/741: dwrite d2/dc/fac [0,4194304] 0 2024-09-21T11:39:29.231 INFO:tasks.workunit.client.0.smithi118.stdout:8/742: write d2/dc/d16/d46/d4c/d63/f9d [1319649,8881] 0 2024-09-21T11:39:29.238 INFO:tasks.workunit.client.0.smithi118.stdout:8/743: fdatasync d2/dc/d10/d2e/f5f 0 2024-09-21T11:39:29.241 INFO:tasks.workunit.client.0.smithi118.stdout:8/744: dread d2/dc/d10/d2e/d18/d36/fa3 [0,4194304] 0 2024-09-21T11:39:29.246 INFO:tasks.workunit.client.0.smithi118.stdout:8/745: symlink d2/dc/d35/lff 0 2024-09-21T11:39:29.250 INFO:tasks.workunit.client.0.smithi118.stdout:8/746: creat d2/d7c/d88/d8f/f100 x:0 0 0 2024-09-21T11:39:29.252 INFO:tasks.workunit.client.0.smithi118.stdout:8/747: fdatasync d2/dc/fac 0 2024-09-21T11:39:29.258 INFO:tasks.workunit.client.0.smithi118.stdout:8/748: dwrite d2/d73/f92 [0,4194304] 0 2024-09-21T11:39:29.262 INFO:tasks.workunit.client.0.smithi118.stdout:3/408: sync 2024-09-21T11:39:29.262 INFO:tasks.workunit.client.0.smithi118.stdout:5/459: sync 2024-09-21T11:39:29.262 INFO:tasks.workunit.client.0.smithi118.stdout:2/362: sync 2024-09-21T11:39:29.264 INFO:tasks.workunit.client.0.smithi118.stdout:2/363: stat de/d51/c73 0 2024-09-21T11:39:29.265 INFO:tasks.workunit.client.0.smithi118.stdout:8/749: dwrite d2/dc/d35/fef [0,4194304] 0 2024-09-21T11:39:29.267 INFO:tasks.workunit.client.0.smithi118.stdout:5/460: unlink d0/c34 0 2024-09-21T11:39:29.267 INFO:tasks.workunit.client.0.smithi118.stdout:8/750: write d2/d7c/d88/d8f/f100 [623522,95699] 0 2024-09-21T11:39:29.268 INFO:tasks.workunit.client.0.smithi118.stdout:2/364: chown de/d1f/l40 2065385 1 2024-09-21T11:39:29.275 INFO:tasks.workunit.client.0.smithi118.stdout:8/751: mkdir d2/dc/d10/d3b/d101 0 2024-09-21T11:39:29.281 INFO:tasks.workunit.client.0.smithi118.stdout:5/461: fdatasync d0/db/d35/d30/d1a/f76 0 2024-09-21T11:39:29.282 INFO:tasks.workunit.client.0.smithi118.stdout:8/752: mkdir d2/dc/d10/d3b/d102 0 2024-09-21T11:39:29.287 INFO:tasks.workunit.client.0.smithi118.stdout:5/462: creat d0/d63/f9b x:0 0 0 2024-09-21T11:39:29.287 INFO:tasks.workunit.client.0.smithi118.stdout:5/463: chown d0/db/d26/l56 69 1 2024-09-21T11:39:29.288 INFO:tasks.workunit.client.0.smithi118.stdout:5/464: read - d0/d6c/d25/d50/f91 zero size 2024-09-21T11:39:29.289 INFO:tasks.workunit.client.0.smithi118.stdout:3/409: truncate d5/d28/d3e/f44 3247103 0 2024-09-21T11:39:29.290 INFO:tasks.workunit.client.0.smithi118.stdout:3/410: readlink d5/d1d/d1b/d4c/l89 0 2024-09-21T11:39:29.291 INFO:tasks.workunit.client.0.smithi118.stdout:2/365: getdents de/d16/d31/d64 0 2024-09-21T11:39:29.294 INFO:tasks.workunit.client.0.smithi118.stdout:5/465: creat d0/d6c/d67/d92/f9c x:0 0 0 2024-09-21T11:39:29.297 INFO:tasks.workunit.client.0.smithi118.stdout:8/753: dread d2/d7c/d88/d8f/daa/faf [0,4194304] 0 2024-09-21T11:39:29.297 INFO:tasks.workunit.client.0.smithi118.stdout:2/366: dread de/d22/d3c/f47 [0,4194304] 0 2024-09-21T11:39:29.298 INFO:tasks.workunit.client.0.smithi118.stdout:3/411: dwrite d5/d1d/f81 [0,4194304] 0 2024-09-21T11:39:29.299 INFO:tasks.workunit.client.0.smithi118.stdout:2/367: chown de/d50/c52 68 1 2024-09-21T11:39:29.304 INFO:tasks.workunit.client.0.smithi118.stdout:8/754: rename d2/dc/d35/dc7 to d2/dc/d10/d3b/d101/d103 0 2024-09-21T11:39:29.310 INFO:tasks.workunit.client.0.smithi118.stdout:5/466: truncate d0/db/d35/d2c/f3e 4037056 0 2024-09-21T11:39:29.312 INFO:tasks.workunit.client.0.smithi118.stdout:3/412: rename d5/d1d/f41 to d5/d28/d3e/d5d/d5f/f98 0 2024-09-21T11:39:29.318 INFO:tasks.workunit.client.0.smithi118.stdout:7/490: sync 2024-09-21T11:39:29.318 INFO:tasks.workunit.client.0.smithi118.stdout:4/437: sync 2024-09-21T11:39:29.318 INFO:tasks.workunit.client.0.smithi118.stdout:0/782: sync 2024-09-21T11:39:29.318 INFO:tasks.workunit.client.0.smithi118.stdout:9/494: sync 2024-09-21T11:39:29.318 INFO:tasks.workunit.client.0.smithi118.stdout:6/435: sync 2024-09-21T11:39:29.318 INFO:tasks.workunit.client.0.smithi118.stdout:1/458: sync 2024-09-21T11:39:29.318 INFO:tasks.workunit.client.0.smithi118.stdout:5/467: mkdir d0/d89/d9d 0 2024-09-21T11:39:29.320 INFO:tasks.workunit.client.0.smithi118.stdout:4/438: readlink d2/d6/de/d1c/l86 0 2024-09-21T11:39:29.323 INFO:tasks.workunit.client.0.smithi118.stdout:7/491: write d0/d3/d14/f65 [3458327,9046] 0 2024-09-21T11:39:29.324 INFO:tasks.workunit.client.0.smithi118.stdout:8/755: mknod d2/dc/d16/d46/c104 0 2024-09-21T11:39:29.325 INFO:tasks.workunit.client.0.smithi118.stdout:8/756: fsync d2/dc/d16/d46/fd4 0 2024-09-21T11:39:29.327 INFO:tasks.workunit.client.0.smithi118.stdout:5/468: mknod d0/d6c/d67/c9e 0 2024-09-21T11:39:29.328 INFO:tasks.workunit.client.0.smithi118.stdout:0/783: rmdir d5/d10/d1e/d33 39 2024-09-21T11:39:29.329 INFO:tasks.workunit.client.0.smithi118.stdout:0/784: dread - d5/d34/d44/d87/f103 zero size 2024-09-21T11:39:29.332 INFO:tasks.workunit.client.0.smithi118.stdout:4/439: creat d2/d6/de/d1c/d23/f9e x:0 0 0 2024-09-21T11:39:29.336 INFO:tasks.workunit.client.0.smithi118.stdout:2/368: getdents de/d22 0 2024-09-21T11:39:29.340 INFO:tasks.workunit.client.0.smithi118.stdout:5/469: stat d0/db/d35/da/l7a 0 2024-09-21T11:39:29.343 INFO:tasks.workunit.client.0.smithi118.stdout:1/459: creat d6/de/d16/d3f/d86/f8c x:0 0 0 2024-09-21T11:39:29.345 INFO:tasks.workunit.client.0.smithi118.stdout:9/495: getdents d0/d20/d4c/d5f/d6c/da7 0 2024-09-21T11:39:29.353 INFO:tasks.workunit.client.0.smithi118.stdout:2/369: mkdir de/d22/d3c/d83 0 2024-09-21T11:39:29.355 INFO:tasks.workunit.client.0.smithi118.stdout:5/470: mkdir d0/d89/d9f 0 2024-09-21T11:39:29.356 INFO:tasks.workunit.client.0.smithi118.stdout:5/471: fsync d0/db/f16 0 2024-09-21T11:39:29.357 INFO:tasks.workunit.client.0.smithi118.stdout:6/436: creat d8/d14/f8e x:0 0 0 2024-09-21T11:39:29.360 INFO:tasks.workunit.client.0.smithi118.stdout:1/460: mknod d6/de/d16/d3f/d50/c8d 0 2024-09-21T11:39:29.363 INFO:tasks.workunit.client.0.smithi118.stdout:0/785: creat d5/d10/d1e/d33/f106 x:0 0 0 2024-09-21T11:39:29.365 INFO:tasks.workunit.client.0.smithi118.stdout:7/492: rename d0/c26 to d0/d3/c9b 0 2024-09-21T11:39:29.369 INFO:tasks.workunit.client.0.smithi118.stdout:1/461: dwrite f0 [0,4194304] 0 2024-09-21T11:39:29.370 INFO:tasks.workunit.client.0.smithi118.stdout:3/413: getdents d5/d1d/d1b/d4c/d73 0 2024-09-21T11:39:29.373 INFO:tasks.workunit.client.0.smithi118.stdout:2/370: dread de/d1f/d20/f55 [0,4194304] 0 2024-09-21T11:39:29.377 INFO:tasks.workunit.client.0.smithi118.stdout:6/437: creat d8/d48/d6c/f8f x:0 0 0 2024-09-21T11:39:29.380 INFO:tasks.workunit.client.0.smithi118.stdout:4/440: dwrite d2/f2d [0,4194304] 0 2024-09-21T11:39:29.380 INFO:tasks.workunit.client.0.smithi118.stdout:8/757: link d2/dc/d10/d2e/dba/lc6 d2/dc/d10/d2e/dba/l105 0 2024-09-21T11:39:29.383 INFO:tasks.workunit.client.0.smithi118.stdout:4/441: stat d2/d6/de/d1c/d23/d26/d31/d97 0 2024-09-21T11:39:29.386 INFO:tasks.workunit.client.0.smithi118.stdout:5/472: mknod d0/db/d35/d2c/ca0 0 2024-09-21T11:39:29.387 INFO:tasks.workunit.client.0.smithi118.stdout:4/442: readlink d2/d6/de/d1c/d23/l59 0 2024-09-21T11:39:29.388 INFO:tasks.workunit.client.0.smithi118.stdout:7/493: mknod d0/d3/d29/d5f/c9c 0 2024-09-21T11:39:29.389 INFO:tasks.workunit.client.0.smithi118.stdout:8/758: mknod d2/dc/d10/dd3/c106 0 2024-09-21T11:39:29.390 INFO:tasks.workunit.client.0.smithi118.stdout:6/438: truncate d8/d48/d45/d61/d70/f84 482105 0 2024-09-21T11:39:29.392 INFO:tasks.workunit.client.0.smithi118.stdout:7/494: dread - d0/d3/d14/d41/d7f/f8a zero size 2024-09-21T11:39:29.397 INFO:tasks.workunit.client.0.smithi118.stdout:1/462: getdents d6/de/d16/d3f 0 2024-09-21T11:39:29.398 INFO:tasks.workunit.client.0.smithi118.stdout:3/414: dwrite d5/d1d/f32 [0,4194304] 0 2024-09-21T11:39:29.399 INFO:tasks.workunit.client.0.smithi118.stdout:6/439: chown d8/l17 386220233 1 2024-09-21T11:39:29.399 INFO:tasks.workunit.client.0.smithi118.stdout:8/759: fdatasync d2/dc/d35/d50/f95 0 2024-09-21T11:39:29.401 INFO:tasks.workunit.client.0.smithi118.stdout:9/496: dread d0/fc [0,4194304] 0 2024-09-21T11:39:29.407 INFO:tasks.workunit.client.0.smithi118.stdout:7/495: dread d0/d3/d29/f20 [0,4194304] 0 2024-09-21T11:39:29.408 INFO:tasks.workunit.client.0.smithi118.stdout:7/496: write d0/d3/d13/f93 [304978,122978] 0 2024-09-21T11:39:29.408 INFO:tasks.workunit.client.0.smithi118.stdout:8/760: chown d2/dc/d10/d3b/d101/d103/de7/lf2 26644 1 2024-09-21T11:39:29.410 INFO:tasks.workunit.client.0.smithi118.stdout:0/786: write d5/d34/f9f [44947,30997] 0 2024-09-21T11:39:29.411 INFO:tasks.workunit.client.0.smithi118.stdout:4/443: dread d2/d6/de/d1c/d4d/d52/d69/f82 [0,4194304] 0 2024-09-21T11:39:29.413 INFO:tasks.workunit.client.0.smithi118.stdout:3/415: dread d5/d1d/f23 [4194304,4194304] 0 2024-09-21T11:39:29.415 INFO:tasks.workunit.client.0.smithi118.stdout:1/463: unlink d6/de/d16/d3f/d50/d54/d32/l83 0 2024-09-21T11:39:29.416 INFO:tasks.workunit.client.0.smithi118.stdout:1/464: write d6/de/d16/f4b [5215190,69247] 0 2024-09-21T11:39:29.418 INFO:tasks.workunit.client.0.smithi118.stdout:6/440: symlink d8/d48/d72/d7e/l90 0 2024-09-21T11:39:29.420 INFO:tasks.workunit.client.0.smithi118.stdout:4/444: creat d2/d6/de/d1c/f9f x:0 0 0 2024-09-21T11:39:29.421 INFO:tasks.workunit.client.0.smithi118.stdout:4/445: chown d2/d6/dd/d35 281 1 2024-09-21T11:39:29.422 INFO:tasks.workunit.client.0.smithi118.stdout:1/465: dread d6/de/d16/d3f/d50/d54/f39 [0,4194304] 0 2024-09-21T11:39:29.424 INFO:tasks.workunit.client.0.smithi118.stdout:3/416: mkdir d5/d1d/d1b/d4c/d91/d69/d99 0 2024-09-21T11:39:29.425 INFO:tasks.workunit.client.0.smithi118.stdout:5/473: dread d0/d6c/d67/f70 [0,4194304] 0 2024-09-21T11:39:29.434 INFO:tasks.workunit.client.0.smithi118.stdout:6/441: write d8/f7b [2805673,55374] 0 2024-09-21T11:39:29.437 INFO:tasks.workunit.client.0.smithi118.stdout:0/787: getdents d5/d10/d1e/d23/d3a/d4e/dfc 0 2024-09-21T11:39:29.437 INFO:tasks.workunit.client.0.smithi118.stdout:8/761: dwrite d2/dc/d10/d2e/dba/fc5 [0,4194304] 0 2024-09-21T11:39:29.437 INFO:tasks.workunit.client.0.smithi118.stdout:9/497: write d0/d20/d4c/d5f/d68/d7c/fa6 [595822,123403] 0 2024-09-21T11:39:29.445 INFO:tasks.workunit.client.0.smithi118.stdout:3/417: dwrite d5/d28/d33/d4a/f4f [0,4194304] 0 2024-09-21T11:39:29.463 INFO:tasks.workunit.client.0.smithi118.stdout:1/466: dread d6/d2a/f51 [0,4194304] 0 2024-09-21T11:39:29.488 INFO:tasks.workunit.client.0.smithi118.stdout:5/474: unlink d0/db/d35/da/c85 0 2024-09-21T11:39:29.489 INFO:tasks.workunit.client.0.smithi118.stdout:5/475: read d0/d6c/f5a [2150783,318] 0 2024-09-21T11:39:29.489 INFO:tasks.workunit.client.0.smithi118.stdout:4/446: mknod d2/d6/de/ca0 0 2024-09-21T11:39:29.491 INFO:tasks.workunit.client.0.smithi118.stdout:6/442: creat d8/d46/f91 x:0 0 0 2024-09-21T11:39:29.496 INFO:tasks.workunit.client.0.smithi118.stdout:9/498: mknod d0/d4/d45/cb6 0 2024-09-21T11:39:29.497 INFO:tasks.workunit.client.0.smithi118.stdout:9/499: stat d0/d4/d38 0 2024-09-21T11:39:29.498 INFO:tasks.workunit.client.0.smithi118.stdout:6/443: dwrite d8/d48/d5f/f80 [0,4194304] 0 2024-09-21T11:39:29.502 INFO:tasks.workunit.client.0.smithi118.stdout:7/497: getdents d0/d3/d14/d41/d7f/d3e 0 2024-09-21T11:39:29.503 INFO:tasks.workunit.client.0.smithi118.stdout:7/498: dread - d0/d3/d29/f8d zero size 2024-09-21T11:39:29.504 INFO:tasks.workunit.client.0.smithi118.stdout:7/499: fdatasync d0/d3/d13/f9a 0 2024-09-21T11:39:29.505 INFO:tasks.workunit.client.0.smithi118.stdout:7/500: write d0/d3/d29/f8d [458856,11226] 0 2024-09-21T11:39:29.507 INFO:tasks.workunit.client.0.smithi118.stdout:4/447: write d2/d6/de/d1c/d4d/d52/f6a [266199,86321] 0 2024-09-21T11:39:29.513 INFO:tasks.workunit.client.0.smithi118.stdout:9/500: mknod d0/d20/cb7 0 2024-09-21T11:39:29.513 INFO:tasks.workunit.client.0.smithi118.stdout:9/501: chown d0/d20/d4c/d5f/d6c/d88/f32 1280436 1 2024-09-21T11:39:29.514 INFO:tasks.workunit.client.0.smithi118.stdout:6/444: mkdir d8/d14/d33/d92 0 2024-09-21T11:39:29.515 INFO:tasks.workunit.client.0.smithi118.stdout:9/502: stat d0/d20/d4c/d5f/d6c/d88/f5e 0 2024-09-21T11:39:29.516 INFO:tasks.workunit.client.0.smithi118.stdout:3/418: symlink d5/d28/d3e/d5d/l9a 0 2024-09-21T11:39:29.517 INFO:tasks.workunit.client.0.smithi118.stdout:1/467: symlink d6/d2a/d5c/l8e 0 2024-09-21T11:39:29.519 INFO:tasks.workunit.client.0.smithi118.stdout:3/419: chown d5/d1d/d1b/d24/f36 930 1 2024-09-21T11:39:29.521 INFO:tasks.workunit.client.0.smithi118.stdout:7/501: write d0/d3/d1d/d35/d70/f80 [1862059,72070] 0 2024-09-21T11:39:29.522 INFO:tasks.workunit.client.0.smithi118.stdout:6/445: dwrite d8/d46/f52 [4194304,4194304] 0 2024-09-21T11:39:29.522 INFO:tasks.workunit.client.0.smithi118.stdout:7/502: stat d0/l5c 0 2024-09-21T11:39:29.525 INFO:tasks.workunit.client.0.smithi118.stdout:5/476: mknod d0/db/d35/d30/d1a/ca1 0 2024-09-21T11:39:29.530 INFO:tasks.workunit.client.0.smithi118.stdout:8/762: write d2/dc/d10/d6a/f89 [807113,68301] 0 2024-09-21T11:39:29.535 INFO:tasks.workunit.client.0.smithi118.stdout:4/448: dread d2/fc [0,4194304] 0 2024-09-21T11:39:29.538 INFO:tasks.workunit.client.0.smithi118.stdout:1/468: write d6/d2a/f51 [1891264,124990] 0 2024-09-21T11:39:29.540 INFO:tasks.workunit.client.0.smithi118.stdout:3/420: rename d5/d28/d33/d80 to d5/d1d/d1b/d4c/d73/d9b 0 2024-09-21T11:39:29.541 INFO:tasks.workunit.client.0.smithi118.stdout:7/503: dread d0/d3/fd [0,4194304] 0 2024-09-21T11:39:29.542 INFO:tasks.workunit.client.0.smithi118.stdout:7/504: readlink d0/lb 0 2024-09-21T11:39:29.543 INFO:tasks.workunit.client.0.smithi118.stdout:4/449: dwrite d2/d6/de/d1c/f47 [0,4194304] 0 2024-09-21T11:39:29.545 INFO:tasks.workunit.client.0.smithi118.stdout:5/477: creat d0/db/d35/da/fa2 x:0 0 0 2024-09-21T11:39:29.545 INFO:tasks.workunit.client.0.smithi118.stdout:0/788: getdents d5/d29/d68/d7b 0 2024-09-21T11:39:29.545 INFO:tasks.workunit.client.0.smithi118.stdout:3/421: stat d5/d1d/d1b/d4c/d73/d9b/f92 0 2024-09-21T11:39:29.549 INFO:tasks.workunit.client.0.smithi118.stdout:1/469: dread - d6/de/f58 zero size 2024-09-21T11:39:29.550 INFO:tasks.workunit.client.0.smithi118.stdout:1/470: chown d6/de/d16/d3f/d50/d54/l81 102 1 2024-09-21T11:39:29.551 INFO:tasks.workunit.client.0.smithi118.stdout:8/763: rename d2/d7c/d88/d8f/f100 to d2/dc/d10/dd3/f107 0 2024-09-21T11:39:29.553 INFO:tasks.workunit.client.0.smithi118.stdout:7/505: mkdir d0/d3/d14/d41/d66/d9d 0 2024-09-21T11:39:29.554 INFO:tasks.workunit.client.0.smithi118.stdout:4/450: dread - d2/d6/de/f80 zero size 2024-09-21T11:39:29.554 INFO:tasks.workunit.client.0.smithi118.stdout:7/506: stat d0/d3/d1d/l33 0 2024-09-21T11:39:29.558 INFO:tasks.workunit.client.0.smithi118.stdout:7/507: dread d0/d3/d29/d47/f84 [0,4194304] 0 2024-09-21T11:39:29.561 INFO:tasks.workunit.client.0.smithi118.stdout:4/451: rmdir d2/d6/dd 39 2024-09-21T11:39:29.563 INFO:tasks.workunit.client.0.smithi118.stdout:0/789: creat d5/d10/df4/f107 x:0 0 0 2024-09-21T11:39:29.564 INFO:tasks.workunit.client.0.smithi118.stdout:9/503: getdents d0/d4/d45/db5/d86 0 2024-09-21T11:39:29.565 INFO:tasks.workunit.client.0.smithi118.stdout:8/764: dwrite d2/f7 [8388608,4194304] 0 2024-09-21T11:39:29.566 INFO:tasks.workunit.client.0.smithi118.stdout:8/765: chown d2/d73/d79/f9a 39987745 1 2024-09-21T11:39:29.567 INFO:tasks.workunit.client.0.smithi118.stdout:3/422: creat d5/d28/d3e/d5d/d5f/d88/f9c x:0 0 0 2024-09-21T11:39:29.568 INFO:tasks.workunit.client.0.smithi118.stdout:8/766: write d2/dc/d16/d46/fd4 [1022454,70565] 0 2024-09-21T11:39:29.569 INFO:tasks.workunit.client.0.smithi118.stdout:1/471: symlink d6/d2a/d5c/d85/l8f 0 2024-09-21T11:39:29.574 INFO:tasks.workunit.client.0.smithi118.stdout:9/504: rmdir d0/d20/d4c/d5f/d68 39 2024-09-21T11:39:29.577 INFO:tasks.workunit.client.0.smithi118.stdout:8/767: creat d2/dc/d16/f108 x:0 0 0 2024-09-21T11:39:29.577 INFO:tasks.workunit.client.0.smithi118.stdout:1/472: symlink d6/d33/l90 0 2024-09-21T11:39:29.578 INFO:tasks.workunit.client.0.smithi118.stdout:1/473: readlink d6/de/d16/l5d 0 2024-09-21T11:39:29.580 INFO:tasks.workunit.client.0.smithi118.stdout:7/508: mkdir d0/d3/d1d/d35/d57/d96/d9e 0 2024-09-21T11:39:29.585 INFO:tasks.workunit.client.0.smithi118.stdout:7/509: creat d0/d3/d1d/f9f x:0 0 0 2024-09-21T11:39:29.586 INFO:tasks.workunit.client.0.smithi118.stdout:9/505: mkdir d0/d4/d38/db8 0 2024-09-21T11:39:29.589 INFO:tasks.workunit.client.0.smithi118.stdout:0/790: dread d5/d10/d1e/d21/f2d [0,4194304] 0 2024-09-21T11:39:29.591 INFO:tasks.workunit.client.0.smithi118.stdout:5/478: dwrite d0/d6c/d67/f62 [0,4194304] 0 2024-09-21T11:39:29.592 INFO:tasks.workunit.client.0.smithi118.stdout:7/510: mkdir d0/d3/d14/d41/da0 0 2024-09-21T11:39:29.595 INFO:tasks.workunit.client.0.smithi118.stdout:4/452: dread d2/d6/dd/d35/f6e [0,4194304] 0 2024-09-21T11:39:29.595 INFO:tasks.workunit.client.0.smithi118.stdout:1/474: creat d6/f91 x:0 0 0 2024-09-21T11:39:29.604 INFO:tasks.workunit.client.0.smithi118.stdout:1/475: dwrite d6/de/d16/d3f/d50/d72/f80 [0,4194304] 0 2024-09-21T11:39:29.605 INFO:tasks.workunit.client.0.smithi118.stdout:1/476: chown d6/de/d16/d3f/d50/d72 27 1 2024-09-21T11:39:29.606 INFO:tasks.workunit.client.0.smithi118.stdout:1/477: readlink d6/de/d16/l63 0 2024-09-21T11:39:29.606 INFO:tasks.workunit.client.0.smithi118.stdout:5/479: symlink d0/db/d35/da/la3 0 2024-09-21T11:39:29.606 INFO:tasks.workunit.client.0.smithi118.stdout:5/480: readlink d0/d63/l5b 0 2024-09-21T11:39:29.608 INFO:tasks.workunit.client.0.smithi118.stdout:1/478: write d6/d33/d3c/f68 [27726,19164] 0 2024-09-21T11:39:29.610 INFO:tasks.workunit.client.0.smithi118.stdout:9/506: rename d0/d20/d4c/d5f/d68 to d0/d20/d4c/d5f/d6c/d88/db9 0 2024-09-21T11:39:29.616 INFO:tasks.workunit.client.0.smithi118.stdout:4/453: mkdir d2/da1 0 2024-09-21T11:39:29.617 INFO:tasks.workunit.client.0.smithi118.stdout:4/454: chown d2/d6/dd/l93 124 1 2024-09-21T11:39:29.618 INFO:tasks.workunit.client.0.smithi118.stdout:8/768: dwrite d2/d32/fe4 [0,4194304] 0 2024-09-21T11:39:29.620 INFO:tasks.workunit.client.0.smithi118.stdout:9/507: readlink d0/d4/l9c 0 2024-09-21T11:39:29.622 INFO:tasks.workunit.client.0.smithi118.stdout:4/455: write d2/d6/de/d1c/d23/f9e [642589,125966] 0 2024-09-21T11:39:29.624 INFO:tasks.workunit.client.0.smithi118.stdout:4/456: write d2/d6/de/d1c/d23/f2c [3566196,71883] 0 2024-09-21T11:39:29.627 INFO:tasks.workunit.client.0.smithi118.stdout:0/791: write d5/d29/d68/d7b/db7/d48/f60 [3290748,7869] 0 2024-09-21T11:39:29.628 INFO:tasks.workunit.client.0.smithi118.stdout:8/769: chown d2/dc/d16/d46/d4c/d63/l48 51378 1 2024-09-21T11:39:29.630 INFO:tasks.workunit.client.0.smithi118.stdout:5/481: write d0/db/d35/f4d [1526401,107597] 0 2024-09-21T11:39:29.635 INFO:tasks.workunit.client.0.smithi118.stdout:0/792: creat d5/d34/d44/d87/d9a/f108 x:0 0 0 2024-09-21T11:39:29.638 INFO:tasks.workunit.client.0.smithi118.stdout:8/770: dwrite d2/dc/d10/fe3 [0,4194304] 0 2024-09-21T11:39:29.639 INFO:tasks.workunit.client.0.smithi118.stdout:1/479: dwrite d6/de/f1a [0,4194304] 0 2024-09-21T11:39:29.640 INFO:tasks.workunit.client.0.smithi118.stdout:1/480: chown d6/de/d16 317 1 2024-09-21T11:39:29.642 INFO:tasks.workunit.client.0.smithi118.stdout:4/457: rename d2/d6/de/f60 to d2/da1/fa2 0 2024-09-21T11:39:29.643 INFO:tasks.workunit.client.0.smithi118.stdout:4/458: chown d2/d6/de/d1c/d23/d26/d74/c7d 42183501 1 2024-09-21T11:39:29.648 INFO:tasks.workunit.client.0.smithi118.stdout:0/793: unlink d5/d10/d1e/d20/f26 0 2024-09-21T11:39:29.648 INFO:tasks.workunit.client.0.smithi118.stdout:5/482: mknod d0/d89/d9d/ca4 0 2024-09-21T11:39:29.649 INFO:tasks.workunit.client.0.smithi118.stdout:5/483: chown d0/db/d26/l96 3519 1 2024-09-21T11:39:29.651 INFO:tasks.workunit.client.0.smithi118.stdout:9/508: truncate d0/fc 1108903 0 2024-09-21T11:39:29.655 INFO:tasks.workunit.client.0.smithi118.stdout:0/794: dwrite d5/d10/d1e/d3d/d93/fc9 [0,4194304] 0 2024-09-21T11:39:29.658 INFO:tasks.workunit.client.0.smithi118.stdout:7/511: rename d0/d3/d14/d41/d7f/d3e/l74 to d0/d3/d14/d41/da0/la1 0 2024-09-21T11:39:29.661 INFO:tasks.workunit.client.0.smithi118.stdout:5/484: mknod d0/d89/d9d/ca5 0 2024-09-21T11:39:29.663 INFO:tasks.workunit.client.0.smithi118.stdout:5/485: write d0/db/d26/f93 [170624,129077] 0 2024-09-21T11:39:29.663 INFO:tasks.workunit.client.0.smithi118.stdout:8/771: mkdir d2/dc/d16/d46/d4c/d109 0 2024-09-21T11:39:29.665 INFO:tasks.workunit.client.0.smithi118.stdout:0/795: mknod d5/d10/c109 0 2024-09-21T11:39:29.666 INFO:tasks.workunit.client.0.smithi118.stdout:0/796: chown d5/d29/d68/d7b/db7/f45 14369 1 2024-09-21T11:39:29.666 INFO:tasks.workunit.client.0.smithi118.stdout:0/797: chown d5/d10/d1e/f6e 737011 1 2024-09-21T11:39:29.667 INFO:tasks.workunit.client.0.smithi118.stdout:9/509: rename d0/d20/d4c/d5f/f7f to d0/d20/d4c/d5f/d66/d98/fba 0 2024-09-21T11:39:29.668 INFO:tasks.workunit.client.0.smithi118.stdout:4/459: link d2/f7c d2/d65/fa3 0 2024-09-21T11:39:29.670 INFO:tasks.workunit.client.0.smithi118.stdout:7/512: mkdir d0/d3/d14/d41/d7f/da2 0 2024-09-21T11:39:29.674 INFO:tasks.workunit.client.0.smithi118.stdout:0/798: symlink d5/d29/d53/l10a 0 2024-09-21T11:39:29.675 INFO:tasks.workunit.client.0.smithi118.stdout:7/513: dwrite d0/d3/d14/f65 [0,4194304] 0 2024-09-21T11:39:29.677 INFO:tasks.workunit.client.0.smithi118.stdout:9/510: creat d0/d4/d45/d72/fbb x:0 0 0 2024-09-21T11:39:29.679 INFO:tasks.workunit.client.0.smithi118.stdout:4/460: fsync d2/d6/dd/d35/f72 0 2024-09-21T11:39:29.685 INFO:tasks.workunit.client.0.smithi118.stdout:1/481: getdents d6/d33/d7a 0 2024-09-21T11:39:29.686 INFO:tasks.workunit.client.0.smithi118.stdout:8/772: symlink d2/dc/d35/d50/dad/l10a 0 2024-09-21T11:39:29.687 INFO:tasks.workunit.client.0.smithi118.stdout:4/461: dwrite d2/d6/dd/d35/f6c [0,4194304] 0 2024-09-21T11:39:29.693 INFO:tasks.workunit.client.0.smithi118.stdout:5/486: link d0/d6c/f5a d0/d89/d9f/fa6 0 2024-09-21T11:39:29.696 INFO:tasks.workunit.client.0.smithi118.stdout:1/482: creat d6/de/d16/f92 x:0 0 0 2024-09-21T11:39:29.700 INFO:tasks.workunit.client.0.smithi118.stdout:5/487: symlink d0/db/d35/d30/d1a/d8f/la7 0 2024-09-21T11:39:29.702 INFO:tasks.workunit.client.0.smithi118.stdout:7/514: dread d0/d3/d1d/d35/d57/f91 [0,4194304] 0 2024-09-21T11:39:29.704 INFO:tasks.workunit.client.0.smithi118.stdout:8/773: mkdir d2/dc/d16/d46/d4c/d63/d10b 0 2024-09-21T11:39:29.707 INFO:tasks.workunit.client.0.smithi118.stdout:8/774: dread d2/dc/d16/d46/d4c/d63/f9d [4194304,4194304] 0 2024-09-21T11:39:29.710 INFO:tasks.workunit.client.0.smithi118.stdout:0/799: write d5/d10/d1e/f27 [850070,2238] 0 2024-09-21T11:39:29.711 INFO:tasks.workunit.client.0.smithi118.stdout:5/488: dwrite d0/fe [0,4194304] 0 2024-09-21T11:39:29.713 INFO:tasks.workunit.client.0.smithi118.stdout:1/483: link d6/d33/d3c/f64 d6/d2a/f93 0 2024-09-21T11:39:29.714 INFO:tasks.workunit.client.0.smithi118.stdout:1/484: readlink d6/de/d16/l63 0 2024-09-21T11:39:29.724 INFO:tasks.workunit.client.0.smithi118.stdout:5/489: rename d0/db/d35/c14 to d0/d6c/d67/d92/ca8 0 2024-09-21T11:39:29.725 INFO:tasks.workunit.client.0.smithi118.stdout:7/515: truncate d0/d3/d1d/f45 3011070 0 2024-09-21T11:39:29.726 INFO:tasks.workunit.client.0.smithi118.stdout:7/516: write d0/d3/d13/f93 [1059388,12504] 0 2024-09-21T11:39:29.727 INFO:tasks.workunit.client.0.smithi118.stdout:5/490: rmdir d0/d6c/d25 39 2024-09-21T11:39:29.730 INFO:tasks.workunit.client.0.smithi118.stdout:1/485: creat d6/d2a/f94 x:0 0 0 2024-09-21T11:39:29.732 INFO:tasks.workunit.client.0.smithi118.stdout:7/517: chown d0/d3/d14/d41/f6f 0 1 2024-09-21T11:39:29.733 INFO:tasks.workunit.client.0.smithi118.stdout:0/800: dwrite d5/d10/d1e/d33/fcc [0,4194304] 0 2024-09-21T11:39:29.734 INFO:tasks.workunit.client.0.smithi118.stdout:8/775: dread d2/dc/d10/d2e/d18/f9c [0,4194304] 0 2024-09-21T11:39:29.738 INFO:tasks.workunit.client.0.smithi118.stdout:0/801: write d5/d29/d68/d7b/db7/d48/ff5 [1018580,4312] 0 2024-09-21T11:39:29.742 INFO:tasks.workunit.client.0.smithi118.stdout:1/486: dread d6/de/d16/d3f/f4d [0,4194304] 0 2024-09-21T11:39:29.743 INFO:tasks.workunit.client.0.smithi118.stdout:7/518: dread d0/d3/d13/f38 [0,4194304] 0 2024-09-21T11:39:29.746 INFO:tasks.workunit.client.0.smithi118.stdout:5/491: unlink d0/d6c/d25/d50/l59 0 2024-09-21T11:39:29.750 INFO:tasks.workunit.client.0.smithi118.stdout:0/802: mknod d5/d10/c10b 0 2024-09-21T11:39:29.752 INFO:tasks.workunit.client.0.smithi118.stdout:1/487: creat d6/d33/d7a/f95 x:0 0 0 2024-09-21T11:39:29.755 INFO:tasks.workunit.client.0.smithi118.stdout:5/492: mknod d0/db/d35/d30/d1a/d8f/ca9 0 2024-09-21T11:39:29.761 INFO:tasks.workunit.client.0.smithi118.stdout:7/519: creat d0/d3/d1d/d35/d57/d7e/d82/fa3 x:0 0 0 2024-09-21T11:39:29.762 INFO:tasks.workunit.client.0.smithi118.stdout:7/520: chown d0/d3/d13/d8f 0 1 2024-09-21T11:39:29.763 INFO:tasks.workunit.client.0.smithi118.stdout:5/493: rename d0/d6c/d97 to d0/d89/daa 0 2024-09-21T11:39:29.764 INFO:tasks.workunit.client.0.smithi118.stdout:5/494: dread - d0/d89/f8d zero size 2024-09-21T11:39:29.765 INFO:tasks.workunit.client.0.smithi118.stdout:8/776: creat d2/dc/d16/d46/f10c x:0 0 0 2024-09-21T11:39:29.766 INFO:tasks.workunit.client.0.smithi118.stdout:8/777: chown d2/d32/l40 1469942 1 2024-09-21T11:39:29.768 INFO:tasks.workunit.client.0.smithi118.stdout:1/488: mkdir d6/de/d13/d84/d96 0 2024-09-21T11:39:29.769 INFO:tasks.workunit.client.0.smithi118.stdout:1/489: chown d6/d3b/d45/l61 25586411 1 2024-09-21T11:39:29.772 INFO:tasks.workunit.client.0.smithi118.stdout:5/495: rmdir d0/d6c 39 2024-09-21T11:39:29.774 INFO:tasks.workunit.client.0.smithi118.stdout:8/778: unlink d2/dc/d35/lff 0 2024-09-21T11:39:29.779 INFO:tasks.workunit.client.0.smithi118.stdout:0/803: dwrite d5/d34/d44/d7c/fe8 [0,4194304] 0 2024-09-21T11:39:29.783 INFO:tasks.workunit.client.0.smithi118.stdout:8/779: mknod d2/dc/d49/c10d 0 2024-09-21T11:39:29.784 INFO:tasks.workunit.client.0.smithi118.stdout:8/780: chown d2/dc/d35/d50/dad/l10a 1395722 1 2024-09-21T11:39:29.787 INFO:tasks.workunit.client.0.smithi118.stdout:0/804: mkdir d5/d29/d68/d7b/db7/d10c 0 2024-09-21T11:39:29.792 INFO:tasks.workunit.client.0.smithi118.stdout:1/490: getdents d6/d2a 0 2024-09-21T11:39:29.796 INFO:tasks.workunit.client.0.smithi118.stdout:5/496: link d0/db/d35/d2c/c9a d0/d89/cab 0 2024-09-21T11:39:29.796 INFO:tasks.workunit.client.0.smithi118.stdout:5/497: stat d0/f31 0 2024-09-21T11:39:29.798 INFO:tasks.workunit.client.0.smithi118.stdout:1/491: creat d6/d2a/f97 x:0 0 0 2024-09-21T11:39:29.806 INFO:tasks.workunit.client.0.smithi118.stdout:1/492: creat d6/d33/d3c/f98 x:0 0 0 2024-09-21T11:39:29.807 INFO:tasks.workunit.client.0.smithi118.stdout:8/781: creat d2/dc/d10/d2e/d18/f10e x:0 0 0 2024-09-21T11:39:29.815 INFO:tasks.workunit.client.0.smithi118.stdout:5/498: link d0/d6c/d25/c8b d0/db/d35/d30/d1a/d8f/d99/cac 0 2024-09-21T11:39:29.820 INFO:tasks.workunit.client.0.smithi118.stdout:8/782: rename d2/dc/d10/d2e/d18/d83/ldc to d2/l10f 0 2024-09-21T11:39:29.824 INFO:tasks.workunit.client.0.smithi118.stdout:8/783: unlink d2/dc/d10/d2e/d18/f9c 0 2024-09-21T11:39:29.824 INFO:tasks.workunit.client.0.smithi118.stdout:8/784: dread - d2/dc/d16/f108 zero size 2024-09-21T11:39:29.826 INFO:tasks.workunit.client.0.smithi118.stdout:5/499: creat d0/d6c/d25/d50/fad x:0 0 0 2024-09-21T11:39:29.828 INFO:tasks.workunit.client.0.smithi118.stdout:1/493: write d6/de/d16/d3f/f4d [681354,124630] 0 2024-09-21T11:39:29.834 INFO:tasks.workunit.client.0.smithi118.stdout:5/500: mknod d0/db/d35/d30/cae 0 2024-09-21T11:39:29.835 INFO:tasks.workunit.client.0.smithi118.stdout:1/494: dread - d6/d2a/f3a zero size 2024-09-21T11:39:29.839 INFO:tasks.workunit.client.0.smithi118.stdout:1/495: unlink d6/de/c74 0 2024-09-21T11:39:29.842 INFO:tasks.workunit.client.0.smithi118.stdout:1/496: fsync d6/d2a/f28 0 2024-09-21T11:39:29.844 INFO:tasks.workunit.client.0.smithi118.stdout:5/501: creat d0/db/faf x:0 0 0 2024-09-21T11:39:29.849 INFO:tasks.workunit.client.0.smithi118.stdout:8/785: dwrite d2/dc/d16/d46/fce [0,4194304] 0 2024-09-21T11:39:29.855 INFO:tasks.workunit.client.0.smithi118.stdout:5/502: mknod d0/d6c/d25/cb0 0 2024-09-21T11:39:29.856 INFO:tasks.workunit.client.0.smithi118.stdout:5/503: write d0/db/faf [398207,89901] 0 2024-09-21T11:39:29.859 INFO:tasks.workunit.client.0.smithi118.stdout:8/786: truncate d2/dc/d10/d2e/f55 1761240 0 2024-09-21T11:39:29.862 INFO:tasks.workunit.client.0.smithi118.stdout:8/787: unlink d2/dc/d16/c65 0 2024-09-21T11:39:29.863 INFO:tasks.workunit.client.0.smithi118.stdout:8/788: dread - d2/dc/d35/d42/ff0 zero size 2024-09-21T11:39:29.869 INFO:tasks.workunit.client.0.smithi118.stdout:8/789: creat d2/dc/d10/d2e/d18/f110 x:0 0 0 2024-09-21T11:39:29.873 INFO:tasks.workunit.client.0.smithi118.stdout:8/790: rename d2/dc/d10/d2e/d18/l5e to d2/d73/l111 0 2024-09-21T11:39:29.876 INFO:tasks.workunit.client.0.smithi118.stdout:1/497: dwrite d6/d3b/f57 [0,4194304] 0 2024-09-21T11:39:29.877 INFO:tasks.workunit.client.0.smithi118.stdout:5/504: write d0/d6c/f8 [4691173,114111] 0 2024-09-21T11:39:29.879 INFO:tasks.workunit.client.0.smithi118.stdout:5/505: truncate d0/db/d26/f93 1312126 0 2024-09-21T11:39:29.883 INFO:tasks.workunit.client.0.smithi118.stdout:8/791: rename d2/dc/d35/d42/fdf to d2/dc/d49/f112 0 2024-09-21T11:39:29.885 INFO:tasks.workunit.client.0.smithi118.stdout:5/506: symlink d0/d6c/d67/d92/lb1 0 2024-09-21T11:39:29.889 INFO:tasks.workunit.client.0.smithi118.stdout:8/792: dwrite d2/d73/f92 [0,4194304] 0 2024-09-21T11:39:29.892 INFO:tasks.workunit.client.0.smithi118.stdout:5/507: unlink d0/c44 0 2024-09-21T11:39:29.894 INFO:tasks.workunit.client.0.smithi118.stdout:5/508: write d0/d6c/f6a [1079248,127047] 0 2024-09-21T11:39:29.898 INFO:tasks.workunit.client.0.smithi118.stdout:8/793: creat d2/dc/d10/d2e/d9b/f113 x:0 0 0 2024-09-21T11:39:29.899 INFO:tasks.workunit.client.0.smithi118.stdout:1/498: write d6/f15 [2694827,61194] 0 2024-09-21T11:39:29.901 INFO:tasks.workunit.client.0.smithi118.stdout:1/499: truncate d6/d33/d3c/f64 4443994 0 2024-09-21T11:39:29.905 INFO:tasks.workunit.client.0.smithi118.stdout:1/500: mknod d6/d3b/d45/c99 0 2024-09-21T11:39:29.906 INFO:tasks.workunit.client.0.smithi118.stdout:8/794: truncate d2/dc/d16/d46/d4c/db0/fcf 131172 0 2024-09-21T11:39:29.907 INFO:tasks.workunit.client.0.smithi118.stdout:8/795: truncate d2/dc/d35/fe1 971587 0 2024-09-21T11:39:29.908 INFO:tasks.workunit.client.0.smithi118.stdout:1/501: chown d6/de/d16/c1d 5947 1 2024-09-21T11:39:29.909 INFO:tasks.workunit.client.0.smithi118.stdout:1/502: write d6/d33/d3c/f73 [1809835,116092] 0 2024-09-21T11:39:29.909 INFO:tasks.workunit.client.0.smithi118.stdout:8/796: symlink d2/d7c/d88/l114 0 2024-09-21T11:39:29.917 INFO:tasks.workunit.client.0.smithi118.stdout:1/503: rename d6/de/d16/f4b to d6/de/d13/d84/f9a 0 2024-09-21T11:39:29.918 INFO:tasks.workunit.client.0.smithi118.stdout:5/509: dread d0/db/d35/d30/f52 [0,4194304] 0 2024-09-21T11:39:29.919 INFO:tasks.workunit.client.0.smithi118.stdout:5/510: dread - d0/d6c/d25/f7d zero size 2024-09-21T11:39:29.921 INFO:tasks.workunit.client.0.smithi118.stdout:8/797: getdents d2/dc/d10/d3b/d101/d103/de7 0 2024-09-21T11:39:29.922 INFO:tasks.workunit.client.0.smithi118.stdout:8/798: stat d2/dc/d49/d84/lae 0 2024-09-21T11:39:29.922 INFO:tasks.workunit.client.0.smithi118.stdout:5/511: chown d0/d6c/d25/f43 0 1 2024-09-21T11:39:29.924 INFO:tasks.workunit.client.0.smithi118.stdout:8/799: write d2/dc/d16/d46/f69 [879880,53390] 0 2024-09-21T11:39:29.932 INFO:tasks.workunit.client.0.smithi118.stdout:8/800: rename d2/dc/d10/d2e/d18/d36/fa3 to d2/dc/d10/d2e/f115 0 2024-09-21T11:39:29.934 INFO:tasks.workunit.client.0.smithi118.stdout:8/801: creat d2/dc/d10/d2e/dba/f116 x:0 0 0 2024-09-21T11:39:29.939 INFO:tasks.workunit.client.0.smithi118.stdout:5/512: dwrite d0/db/d35/d30/d66/f71 [0,4194304] 0 2024-09-21T11:39:29.940 INFO:tasks.workunit.client.0.smithi118.stdout:5/513: stat d0/l6b 0 2024-09-21T11:39:29.940 INFO:tasks.workunit.client.0.smithi118.stdout:1/504: dread d6/d2a/f93 [0,4194304] 0 2024-09-21T11:39:29.949 INFO:tasks.workunit.client.0.smithi118.stdout:5/514: write d0/db/d35/d30/d66/f71 [4602660,56553] 0 2024-09-21T11:39:29.953 INFO:tasks.workunit.client.0.smithi118.stdout:8/802: dread d2/dc/d16/d46/f6f [0,4194304] 0 2024-09-21T11:39:29.961 INFO:tasks.workunit.client.0.smithi118.stdout:1/505: dwrite d6/de/d16/d3f/d50/d54/d32/f5a [0,4194304] 0 2024-09-21T11:39:29.963 INFO:tasks.workunit.client.0.smithi118.stdout:8/803: dwrite d2/f72 [0,4194304] 0 2024-09-21T11:39:29.963 INFO:tasks.workunit.client.0.smithi118.stdout:5/515: dwrite d0/db/f72 [0,4194304] 0 2024-09-21T11:39:29.977 INFO:tasks.workunit.client.0.smithi118.stdout:5/516: mknod d0/d6c/d25/cb2 0 2024-09-21T11:39:29.978 INFO:tasks.workunit.client.0.smithi118.stdout:8/804: read d2/dc/d35/dab/fcd [37642,81637] 0 2024-09-21T11:39:29.979 INFO:tasks.workunit.client.0.smithi118.stdout:8/805: stat d2/dc/d16/f87 0 2024-09-21T11:39:29.980 INFO:tasks.workunit.client.0.smithi118.stdout:8/806: rmdir d2/dc 39 2024-09-21T11:39:29.983 INFO:tasks.workunit.client.0.smithi118.stdout:5/517: mkdir d0/db/d35/d30/d1a/db3 0 2024-09-21T11:39:29.985 INFO:tasks.workunit.client.0.smithi118.stdout:5/518: creat d0/d89/daa/fb4 x:0 0 0 2024-09-21T11:39:29.986 INFO:tasks.workunit.client.0.smithi118.stdout:1/506: dread f1 [0,4194304] 0 2024-09-21T11:39:29.987 INFO:tasks.workunit.client.0.smithi118.stdout:8/807: creat d2/dc/d10/d2e/f117 x:0 0 0 2024-09-21T11:39:29.988 INFO:tasks.workunit.client.0.smithi118.stdout:5/519: read d0/db/d35/da/f18 [1168212,106212] 0 2024-09-21T11:39:29.991 INFO:tasks.workunit.client.0.smithi118.stdout:8/808: mknod d2/d73/c118 0 2024-09-21T11:39:29.994 INFO:tasks.workunit.client.0.smithi118.stdout:1/507: write d6/de/f34 [3243945,127168] 0 2024-09-21T11:39:29.996 INFO:tasks.workunit.client.0.smithi118.stdout:5/520: mknod d0/db/d35/d30/d1a/db3/cb5 0 2024-09-21T11:39:29.997 INFO:tasks.workunit.client.0.smithi118.stdout:5/521: chown d0/db/d26/f93 346348623 1 2024-09-21T11:39:29.997 INFO:tasks.workunit.client.0.smithi118.stdout:1/508: creat d6/d33/d3c/f9b x:0 0 0 2024-09-21T11:39:29.998 INFO:tasks.workunit.client.0.smithi118.stdout:5/522: readlink d0/db/d35/d30/l13 0 2024-09-21T11:39:29.998 INFO:tasks.workunit.client.0.smithi118.stdout:8/809: rename d2/dc/d10/d2e/d18/d1a/l76 to d2/dc/d10/d2e/d9b/dcc/l119 0 2024-09-21T11:39:29.999 INFO:tasks.workunit.client.0.smithi118.stdout:8/810: chown d2/dc/d35/dab/fcd 728042 1 2024-09-21T11:39:30.000 INFO:tasks.workunit.client.0.smithi118.stdout:5/523: mknod d0/db/d26/cb6 0 2024-09-21T11:39:30.002 INFO:tasks.workunit.client.0.smithi118.stdout:1/509: creat d6/d2a/d5c/d85/f9c x:0 0 0 2024-09-21T11:39:30.004 INFO:tasks.workunit.client.0.smithi118.stdout:5/524: creat d0/d63/fb7 x:0 0 0 2024-09-21T11:39:30.005 INFO:tasks.workunit.client.0.smithi118.stdout:8/811: mkdir d2/dc/d16/d46/d4c/d63/db9/d11a 0 2024-09-21T11:39:30.008 INFO:tasks.workunit.client.0.smithi118.stdout:8/812: creat d2/d73/f11b x:0 0 0 2024-09-21T11:39:30.009 INFO:tasks.workunit.client.0.smithi118.stdout:1/510: dwrite d6/d33/d3c/f9b [0,4194304] 0 2024-09-21T11:39:30.012 INFO:tasks.workunit.client.0.smithi118.stdout:8/813: rmdir d2/d73 39 2024-09-21T11:39:30.014 INFO:tasks.workunit.client.0.smithi118.stdout:5/525: creat d0/fb8 x:0 0 0 2024-09-21T11:39:30.018 INFO:tasks.workunit.client.0.smithi118.stdout:8/814: dwrite d2/dc/d16/f108 [0,4194304] 0 2024-09-21T11:39:30.018 INFO:tasks.workunit.client.0.smithi118.stdout:1/511: link d6/de/d16/c1b d6/de/d16/c9d 0 2024-09-21T11:39:30.023 INFO:tasks.workunit.client.0.smithi118.stdout:1/512: dread d6/d33/d3c/f40 [0,4194304] 0 2024-09-21T11:39:30.026 INFO:tasks.workunit.client.0.smithi118.stdout:1/513: mkdir d6/de/d13/d84/d96/d9e 0 2024-09-21T11:39:30.040 INFO:tasks.workunit.client.0.smithi118.stdout:1/514: truncate d6/de/d16/f29 3264754 0 2024-09-21T11:39:30.040 INFO:tasks.workunit.client.0.smithi118.stdout:8/815: dread d2/dc/d10/d2e/fa5 [0,4194304] 0 2024-09-21T11:39:30.042 INFO:tasks.workunit.client.0.smithi118.stdout:1/515: creat d6/d2a/d5c/f9f x:0 0 0 2024-09-21T11:39:30.043 INFO:tasks.workunit.client.0.smithi118.stdout:8/816: creat d2/dc/d10/d2e/d18/d1a/f11c x:0 0 0 2024-09-21T11:39:30.043 INFO:tasks.workunit.client.0.smithi118.stdout:1/516: fdatasync d6/de/d16/d3f/d50/d54/d32/f5a 0 2024-09-21T11:39:30.045 INFO:tasks.workunit.client.0.smithi118.stdout:8/817: dread d2/dc/d35/fe1 [0,4194304] 0 2024-09-21T11:39:30.047 INFO:tasks.workunit.client.0.smithi118.stdout:8/818: dread - d2/dc/d35/d42/ff0 zero size 2024-09-21T11:39:30.052 INFO:tasks.workunit.client.0.smithi118.stdout:1/517: dwrite d6/d2a/f23 [4194304,4194304] 0 2024-09-21T11:39:30.053 INFO:tasks.workunit.client.0.smithi118.stdout:8/819: dread d2/dc/d16/d46/fce [0,4194304] 0 2024-09-21T11:39:30.067 INFO:tasks.workunit.client.0.smithi118.stdout:8/820: dwrite d2/d7c/d88/d8f/daa/faf [0,4194304] 0 2024-09-21T11:39:30.408 INFO:tasks.workunit.client.0.smithi118.stdout:2/371: sync 2024-09-21T11:39:30.408 INFO:tasks.workunit.client.0.smithi118.stdout:6/446: sync 2024-09-21T11:39:30.409 INFO:tasks.workunit.client.0.smithi118.stdout:6/447: write d8/d46/f52 [379256,33325] 0 2024-09-21T11:39:30.416 INFO:tasks.workunit.client.0.smithi118.stdout:2/372: chown de/d16/d25/c29 1145 1 2024-09-21T11:39:30.420 INFO:tasks.workunit.client.0.smithi118.stdout:6/448: creat d8/f93 x:0 0 0 2024-09-21T11:39:30.421 INFO:tasks.workunit.client.0.smithi118.stdout:2/373: symlink de/d16/d31/d64/d6d/d70/l84 0 2024-09-21T11:39:30.422 INFO:tasks.workunit.client.0.smithi118.stdout:2/374: dread - de/d50/f81 zero size 2024-09-21T11:39:30.423 INFO:tasks.workunit.client.0.smithi118.stdout:6/449: creat d8/d14/d33/d92/f94 x:0 0 0 2024-09-21T11:39:30.424 INFO:tasks.workunit.client.0.smithi118.stdout:2/375: mkdir de/d50/d85 0 2024-09-21T11:39:30.427 INFO:tasks.workunit.client.0.smithi118.stdout:2/376: creat de/d53/f86 x:0 0 0 2024-09-21T11:39:30.435 INFO:tasks.workunit.client.0.smithi118.stdout:6/450: dwrite d8/d46/f91 [0,4194304] 0 2024-09-21T11:39:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:30 smithi149 ceph-mon[36123]: pgmap v30: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 80 MiB/s rd, 201 MiB/s wr, 407 op/s 2024-09-21T11:39:30.459 INFO:tasks.workunit.client.0.smithi118.stdout:2/377: dwrite de/d16/f32 [0,4194304] 0 2024-09-21T11:39:30.468 INFO:tasks.workunit.client.0.smithi118.stdout:6/451: creat d8/d48/d72/d7e/f95 x:0 0 0 2024-09-21T11:39:30.471 INFO:tasks.workunit.client.0.smithi118.stdout:2/378: creat de/d16/d1c/d66/f87 x:0 0 0 2024-09-21T11:39:30.479 INFO:tasks.workunit.client.0.smithi118.stdout:2/379: dwrite de/d16/d1c/d4f/f7f [0,4194304] 0 2024-09-21T11:39:30.493 INFO:tasks.workunit.client.0.smithi118.stdout:2/380: write de/d16/f32 [4919669,54326] 0 2024-09-21T11:39:30.495 INFO:tasks.workunit.client.0.smithi118.stdout:2/381: read de/d1f/d4a/f6e [1137272,21134] 0 2024-09-21T11:39:30.495 INFO:tasks.workunit.client.0.smithi118.stdout:2/382: stat de/l45 0 2024-09-21T11:39:30.505 INFO:tasks.workunit.client.0.smithi118.stdout:6/452: dread d8/fa [0,4194304] 0 2024-09-21T11:39:30.511 INFO:tasks.workunit.client.0.smithi118.stdout:2/383: write de/f18 [1450138,50200] 0 2024-09-21T11:39:30.513 INFO:tasks.workunit.client.0.smithi118.stdout:2/384: truncate de/d22/d3c/f7b 461921 0 2024-09-21T11:39:30.514 INFO:tasks.workunit.client.0.smithi118.stdout:6/453: truncate d8/d14/f63 1893030 0 2024-09-21T11:39:30.520 INFO:tasks.workunit.client.0.smithi118.stdout:6/454: creat d8/f96 x:0 0 0 2024-09-21T11:39:30.521 INFO:tasks.workunit.client.0.smithi118.stdout:2/385: link de/d16/d1c/l36 de/d50/l88 0 2024-09-21T11:39:30.521 INFO:tasks.workunit.client.0.smithi118.stdout:6/455: readlink d8/l3b 0 2024-09-21T11:39:30.524 INFO:tasks.workunit.client.0.smithi118.stdout:2/386: mknod de/d22/c89 0 2024-09-21T11:39:30.529 INFO:tasks.workunit.client.0.smithi118.stdout:6/456: dwrite d8/f8b [8388608,4194304] 0 2024-09-21T11:39:30.535 INFO:tasks.workunit.client.0.smithi118.stdout:2/387: dwrite de/d1f/d20/f2d [0,4194304] 0 2024-09-21T11:39:30.545 INFO:tasks.workunit.client.0.smithi118.stdout:3/423: sync 2024-09-21T11:39:30.549 INFO:tasks.workunit.client.0.smithi118.stdout:3/424: getdents d5/d1d/d8c 0 2024-09-21T11:39:30.551 INFO:tasks.workunit.client.0.smithi118.stdout:3/425: write d5/d1d/d1b/d24/f60 [1455060,121236] 0 2024-09-21T11:39:30.555 INFO:tasks.workunit.client.0.smithi118.stdout:3/426: rmdir d5/d1d/d1b/d4c/d73/d9b 39 2024-09-21T11:39:30.558 INFO:tasks.workunit.client.0.smithi118.stdout:6/457: dwrite d8/f4b [0,4194304] 0 2024-09-21T11:39:30.561 INFO:tasks.workunit.client.0.smithi118.stdout:3/427: truncate d5/d1d/f49 636204 0 2024-09-21T11:39:30.564 INFO:tasks.workunit.client.0.smithi118.stdout:3/428: write d5/d1d/d1b/d24/f60 [2102954,47300] 0 2024-09-21T11:39:30.568 INFO:tasks.workunit.client.0.smithi118.stdout:6/458: dwrite d8/d46/f81 [0,4194304] 0 2024-09-21T11:39:30.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:30 smithi118 ceph-mon[28757]: pgmap v30: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 80 MiB/s rd, 201 MiB/s wr, 407 op/s 2024-09-21T11:39:30.576 INFO:tasks.workunit.client.0.smithi118.stdout:6/459: dwrite d8/fc [4194304,4194304] 0 2024-09-21T11:39:30.581 INFO:tasks.workunit.client.0.smithi118.stdout:2/388: dread f8 [0,4194304] 0 2024-09-21T11:39:30.585 INFO:tasks.workunit.client.0.smithi118.stdout:3/429: truncate d5/f17 3938384 0 2024-09-21T11:39:30.587 INFO:tasks.workunit.client.0.smithi118.stdout:6/460: dwrite d8/fc [4194304,4194304] 0 2024-09-21T11:39:30.590 INFO:tasks.workunit.client.0.smithi118.stdout:2/389: rename de/d16/d31/d64 to de/d1f/d20/d67/d8a 0 2024-09-21T11:39:30.591 INFO:tasks.workunit.client.0.smithi118.stdout:6/461: fsync d8/d14/f1d 0 2024-09-21T11:39:30.592 INFO:tasks.workunit.client.0.smithi118.stdout:6/462: chown d8/d46/f52 2 1 2024-09-21T11:39:30.592 INFO:tasks.workunit.client.0.smithi118.stdout:4/462: sync 2024-09-21T11:39:30.593 INFO:tasks.workunit.client.0.smithi118.stdout:9/511: sync 2024-09-21T11:39:30.593 INFO:tasks.workunit.client.0.smithi118.stdout:1/518: sync 2024-09-21T11:39:30.593 INFO:tasks.workunit.client.0.smithi118.stdout:8/821: sync 2024-09-21T11:39:30.593 INFO:tasks.workunit.client.0.smithi118.stdout:0/805: sync 2024-09-21T11:39:30.593 INFO:tasks.workunit.client.0.smithi118.stdout:5/526: sync 2024-09-21T11:39:30.593 INFO:tasks.workunit.client.0.smithi118.stdout:7/521: sync 2024-09-21T11:39:30.599 INFO:tasks.workunit.client.0.smithi118.stdout:4/463: write d2/d6/de/d1c/d23/f9e [735098,111034] 0 2024-09-21T11:39:30.605 INFO:tasks.workunit.client.0.smithi118.stdout:9/512: unlink d0/d20/d4c/d5f/d6c/d88/c40 0 2024-09-21T11:39:30.606 INFO:tasks.workunit.client.0.smithi118.stdout:6/463: dwrite d8/d48/f31 [0,4194304] 0 2024-09-21T11:39:30.607 INFO:tasks.workunit.client.0.smithi118.stdout:1/519: write d6/de/f1a [5222872,108211] 0 2024-09-21T11:39:30.609 INFO:tasks.workunit.client.0.smithi118.stdout:6/464: write d8/d48/d45/d61/d70/f87 [29439,13990] 0 2024-09-21T11:39:30.611 INFO:tasks.workunit.client.0.smithi118.stdout:3/430: write d5/d1d/d1b/d24/f2c [3523289,79567] 0 2024-09-21T11:39:30.619 INFO:tasks.workunit.client.0.smithi118.stdout:0/806: write d5/d34/fe4 [95645,83898] 0 2024-09-21T11:39:30.624 INFO:tasks.workunit.client.0.smithi118.stdout:4/464: symlink d2/da1/la4 0 2024-09-21T11:39:30.624 INFO:tasks.workunit.client.0.smithi118.stdout:2/390: write de/f2a [2606717,111471] 0 2024-09-21T11:39:30.630 INFO:tasks.workunit.client.0.smithi118.stdout:4/465: dwrite d2/d6/f18 [0,4194304] 0 2024-09-21T11:39:30.631 INFO:tasks.workunit.client.0.smithi118.stdout:4/466: fsync d2/d6/de/f80 0 2024-09-21T11:39:30.632 INFO:tasks.workunit.client.0.smithi118.stdout:6/465: truncate d8/d14/f1d 926147 0 2024-09-21T11:39:30.634 INFO:tasks.workunit.client.0.smithi118.stdout:6/466: read d8/fc [2442467,38421] 0 2024-09-21T11:39:30.638 INFO:tasks.workunit.client.0.smithi118.stdout:0/807: mknod d5/d10/d1e/d20/c10d 0 2024-09-21T11:39:30.645 INFO:tasks.workunit.client.0.smithi118.stdout:2/391: mknod de/d50/d63/c8b 0 2024-09-21T11:39:30.648 INFO:tasks.workunit.client.0.smithi118.stdout:4/467: dread d2/d6/de/d1c/d4d/d52/d69/f67 [0,4194304] 0 2024-09-21T11:39:30.648 INFO:tasks.workunit.client.0.smithi118.stdout:7/522: mkdir d0/d3/d14/d41/d8b/da4 0 2024-09-21T11:39:30.649 INFO:tasks.workunit.client.0.smithi118.stdout:7/523: stat d0/d3/c89 0 2024-09-21T11:39:30.649 INFO:tasks.workunit.client.0.smithi118.stdout:4/468: chown d2/d6/de/d1c/d23/d26/d31/d97 426256 1 2024-09-21T11:39:30.651 INFO:tasks.workunit.client.0.smithi118.stdout:7/524: write d0/d3/d29/d5f/f85 [1047598,6574] 0 2024-09-21T11:39:30.655 INFO:tasks.workunit.client.0.smithi118.stdout:3/431: symlink d5/d1d/d1b/d4c/d73/l9d 0 2024-09-21T11:39:30.660 INFO:tasks.workunit.client.0.smithi118.stdout:6/467: symlink d8/d48/d45/d61/d70/d7d/l97 0 2024-09-21T11:39:30.662 INFO:tasks.workunit.client.0.smithi118.stdout:0/808: symlink d5/d34/d44/d7c/l10e 0 2024-09-21T11:39:30.662 INFO:tasks.workunit.client.0.smithi118.stdout:5/527: getdents d0/db/d35/d30/d66 0 2024-09-21T11:39:30.665 INFO:tasks.workunit.client.0.smithi118.stdout:9/513: creat d0/fbc x:0 0 0 2024-09-21T11:39:30.667 INFO:tasks.workunit.client.0.smithi118.stdout:1/520: rename d6/de/d16/c1b to d6/d2a/d3d/ca0 0 2024-09-21T11:39:30.668 INFO:tasks.workunit.client.0.smithi118.stdout:7/525: creat d0/d3/d1d/d35/d57/d7e/fa5 x:0 0 0 2024-09-21T11:39:30.669 INFO:tasks.workunit.client.0.smithi118.stdout:8/822: link d2/dc/d16/d46/d4c/db0/lb8 d2/d32/l11d 0 2024-09-21T11:39:30.671 INFO:tasks.workunit.client.0.smithi118.stdout:8/823: write d2/dc/d10/d2e/dba/f116 [269697,126314] 0 2024-09-21T11:39:30.677 INFO:tasks.workunit.client.0.smithi118.stdout:9/514: write d0/d20/d4c/d5f/d89/f9e [450875,112934] 0 2024-09-21T11:39:30.679 INFO:tasks.workunit.client.0.smithi118.stdout:3/432: rename d5/d1d/f11 to d5/d1d/d1b/d4c/f9e 0 2024-09-21T11:39:30.685 INFO:tasks.workunit.client.0.smithi118.stdout:5/528: mkdir d0/db/d35/d30/d1a/d8f/d99/db9 0 2024-09-21T11:39:30.687 INFO:tasks.workunit.client.0.smithi118.stdout:0/809: truncate d5/f13 8909374 0 2024-09-21T11:39:30.688 INFO:tasks.workunit.client.0.smithi118.stdout:0/810: readlink d5/d10/d1e/d23/l2e 0 2024-09-21T11:39:30.688 INFO:tasks.workunit.client.0.smithi118.stdout:2/392: write de/d16/d25/f62 [639662,122959] 0 2024-09-21T11:39:30.689 INFO:tasks.workunit.client.0.smithi118.stdout:4/469: creat d2/d6/de/fa5 x:0 0 0 2024-09-21T11:39:30.690 INFO:tasks.workunit.client.0.smithi118.stdout:2/393: fdatasync de/d16/d31/f3d 0 2024-09-21T11:39:30.692 INFO:tasks.workunit.client.0.smithi118.stdout:2/394: write de/d22/d3c/f47 [3937753,39151] 0 2024-09-21T11:39:30.693 INFO:tasks.workunit.client.0.smithi118.stdout:6/468: dwrite d8/fa [0,4194304] 0 2024-09-21T11:39:30.721 INFO:tasks.workunit.client.0.smithi118.stdout:1/521: symlink d6/d3b/la1 0 2024-09-21T11:39:30.724 INFO:tasks.workunit.client.0.smithi118.stdout:7/526: rename d0/d3/fd to d0/d3/d14/d41/d66/d9d/fa6 0 2024-09-21T11:39:30.725 INFO:tasks.workunit.client.0.smithi118.stdout:3/433: dwrite d5/d1d/d1b/d4c/d73/d9b/f97 [0,4194304] 0 2024-09-21T11:39:30.727 INFO:tasks.workunit.client.0.smithi118.stdout:8/824: creat d2/dc/d10/d3b/d102/f11e x:0 0 0 2024-09-21T11:39:30.730 INFO:tasks.workunit.client.0.smithi118.stdout:4/470: rmdir d2/d65/d89 39 2024-09-21T11:39:30.732 INFO:tasks.workunit.client.0.smithi118.stdout:4/471: write d2/d6/de/d1c/d23/d26/f95 [863155,27927] 0 2024-09-21T11:39:30.736 INFO:tasks.workunit.client.0.smithi118.stdout:1/522: creat d6/de/d16/d3f/fa2 x:0 0 0 2024-09-21T11:39:30.737 INFO:tasks.workunit.client.0.smithi118.stdout:1/523: fsync d6/d3b/f57 0 2024-09-21T11:39:30.740 INFO:tasks.workunit.client.0.smithi118.stdout:0/811: symlink d5/d10/d1e/l10f 0 2024-09-21T11:39:30.741 INFO:tasks.workunit.client.0.smithi118.stdout:4/472: chown d2/d6/de/c7f 0 1 2024-09-21T11:39:30.742 INFO:tasks.workunit.client.0.smithi118.stdout:4/473: chown d2/d6/de/d1c/d4d/f9a 866792 1 2024-09-21T11:39:30.746 INFO:tasks.workunit.client.0.smithi118.stdout:9/515: symlink d0/d4/d38/lbd 0 2024-09-21T11:39:30.750 INFO:tasks.workunit.client.0.smithi118.stdout:1/524: mknod d6/de/d13/ca3 0 2024-09-21T11:39:30.752 INFO:tasks.workunit.client.0.smithi118.stdout:6/469: truncate d8/f7b 2870570 0 2024-09-21T11:39:30.752 INFO:tasks.workunit.client.0.smithi118.stdout:7/527: dwrite d0/f2a [0,4194304] 0 2024-09-21T11:39:30.758 INFO:tasks.workunit.client.0.smithi118.stdout:0/812: creat d5/d10/df4/f110 x:0 0 0 2024-09-21T11:39:30.759 INFO:tasks.workunit.client.0.smithi118.stdout:2/395: creat de/d16/f8c x:0 0 0 2024-09-21T11:39:30.760 INFO:tasks.workunit.client.0.smithi118.stdout:4/474: mknod d2/d6/de/d1c/d23/d26/ca6 0 2024-09-21T11:39:30.762 INFO:tasks.workunit.client.0.smithi118.stdout:7/528: dwrite d0/d3/d14/f32 [0,4194304] 0 2024-09-21T11:39:30.763 INFO:tasks.workunit.client.0.smithi118.stdout:4/475: write d2/d6/de/d1c/d4d/d52/f6a [443539,71190] 0 2024-09-21T11:39:30.765 INFO:tasks.workunit.client.0.smithi118.stdout:7/529: stat d0/d3/d14/d41/d7f/c5b 0 2024-09-21T11:39:30.765 INFO:tasks.workunit.client.0.smithi118.stdout:1/525: symlink d6/d33/la4 0 2024-09-21T11:39:30.772 INFO:tasks.workunit.client.0.smithi118.stdout:2/396: chown de/d16/d25/c26 12 1 2024-09-21T11:39:30.773 INFO:tasks.workunit.client.0.smithi118.stdout:2/397: chown de/d22/d3c/f47 2 1 2024-09-21T11:39:30.774 INFO:tasks.workunit.client.0.smithi118.stdout:0/813: dread - d5/d10/d1e/d23/d3a/d4e/dcb/fd9 zero size 2024-09-21T11:39:30.777 INFO:tasks.workunit.client.0.smithi118.stdout:9/516: fdatasync d0/fb 0 2024-09-21T11:39:30.778 INFO:tasks.workunit.client.0.smithi118.stdout:0/814: dread d5/d10/d1e/d33/fcc [0,4194304] 0 2024-09-21T11:39:30.782 INFO:tasks.workunit.client.0.smithi118.stdout:1/526: mknod d6/d33/d7a/ca5 0 2024-09-21T11:39:30.783 INFO:tasks.workunit.client.0.smithi118.stdout:3/434: link d5/d1d/c2a d5/d1d/d1b/d4b/c9f 0 2024-09-21T11:39:30.786 INFO:tasks.workunit.client.0.smithi118.stdout:7/530: creat d0/d3/d13/d8f/fa7 x:0 0 0 2024-09-21T11:39:30.788 INFO:tasks.workunit.client.0.smithi118.stdout:6/470: link d8/d46/f81 d8/d48/d6c/d64/f98 0 2024-09-21T11:39:30.789 INFO:tasks.workunit.client.0.smithi118.stdout:8/825: getdents d2/dc/d49/d84 0 2024-09-21T11:39:30.791 INFO:tasks.workunit.client.0.smithi118.stdout:2/398: rmdir de/d1f/d20/d67/d8a 39 2024-09-21T11:39:30.792 INFO:tasks.workunit.client.0.smithi118.stdout:2/399: readlink de/d1f/l40 0 2024-09-21T11:39:30.796 INFO:tasks.workunit.client.0.smithi118.stdout:9/517: fsync d0/fb1 0 2024-09-21T11:39:30.797 INFO:tasks.workunit.client.0.smithi118.stdout:2/400: dread de/f18 [0,4194304] 0 2024-09-21T11:39:30.797 INFO:tasks.workunit.client.0.smithi118.stdout:0/815: creat d5/d10/d1e/d21/db3/f111 x:0 0 0 2024-09-21T11:39:30.798 INFO:tasks.workunit.client.0.smithi118.stdout:4/476: mknod d2/ca7 0 2024-09-21T11:39:30.800 INFO:tasks.workunit.client.0.smithi118.stdout:4/477: read d2/f7c [3834469,16097] 0 2024-09-21T11:39:30.800 INFO:tasks.workunit.client.0.smithi118.stdout:1/527: creat d6/de/d16/d3f/d50/fa6 x:0 0 0 2024-09-21T11:39:30.801 INFO:tasks.workunit.client.0.smithi118.stdout:4/478: chown d2/d6/dd/f51 1103334 1 2024-09-21T11:39:30.801 INFO:tasks.workunit.client.0.smithi118.stdout:3/435: dread - d5/d1d/d1b/d4c/f7d zero size 2024-09-21T11:39:30.804 INFO:tasks.workunit.client.0.smithi118.stdout:6/471: unlink d8/d14/d3a/f50 0 2024-09-21T11:39:30.811 INFO:tasks.workunit.client.0.smithi118.stdout:0/816: creat d5/d10/d1e/d3d/f112 x:0 0 0 2024-09-21T11:39:30.815 INFO:tasks.workunit.client.0.smithi118.stdout:1/528: write d6/d2a/d3d/f78 [386085,102336] 0 2024-09-21T11:39:30.816 INFO:tasks.workunit.client.0.smithi118.stdout:4/479: mkdir d2/d6/de/d1c/d23/d26/d31/da8 0 2024-09-21T11:39:30.819 INFO:tasks.workunit.client.0.smithi118.stdout:1/529: write d6/d2a/d3d/f78 [1346020,113297] 0 2024-09-21T11:39:30.819 INFO:tasks.workunit.client.0.smithi118.stdout:4/480: write d2/d6/f22 [3728670,68786] 0 2024-09-21T11:39:30.820 INFO:tasks.workunit.client.0.smithi118.stdout:7/531: dwrite d0/d3/d1d/d35/d57/f91 [4194304,4194304] 0 2024-09-21T11:39:30.827 INFO:tasks.workunit.client.0.smithi118.stdout:1/530: dwrite d6/d2a/d5c/d85/f9c [0,4194304] 0 2024-09-21T11:39:30.829 INFO:tasks.workunit.client.0.smithi118.stdout:7/532: dread d0/d3/d14/d41/d66/d9d/fa6 [0,4194304] 0 2024-09-21T11:39:30.830 INFO:tasks.workunit.client.0.smithi118.stdout:1/531: truncate d6/f91 502925 0 2024-09-21T11:39:30.834 INFO:tasks.workunit.client.0.smithi118.stdout:1/532: dread f1 [0,4194304] 0 2024-09-21T11:39:30.836 INFO:tasks.workunit.client.0.smithi118.stdout:3/436: link d5/d1d/d1b/d4c/f9e d5/d1d/d1b/d4c/d91/d69/d99/fa0 0 2024-09-21T11:39:30.837 INFO:tasks.workunit.client.0.smithi118.stdout:3/437: chown d5/d28/d3e/l72 0 1 2024-09-21T11:39:30.842 INFO:tasks.workunit.client.0.smithi118.stdout:4/481: rename d2/d6/de/d1c/d23/d26/d31 to d2/d6/de/d1c/d87/da9 0 2024-09-21T11:39:30.843 INFO:tasks.workunit.client.0.smithi118.stdout:8/826: dwrite d2/dc/d10/d2e/d18/f22 [8388608,4194304] 0 2024-09-21T11:39:30.851 INFO:tasks.workunit.client.0.smithi118.stdout:3/438: truncate d5/d28/f65 749969 0 2024-09-21T11:39:30.852 INFO:tasks.workunit.client.0.smithi118.stdout:3/439: fdatasync d5/d28/d3e/d5d/d5f/f67 0 2024-09-21T11:39:30.853 INFO:tasks.workunit.client.0.smithi118.stdout:3/440: write d5/d28/f94 [794508,23382] 0 2024-09-21T11:39:30.854 INFO:tasks.workunit.client.0.smithi118.stdout:4/482: fsync d2/d65/fa3 0 2024-09-21T11:39:30.856 INFO:tasks.workunit.client.0.smithi118.stdout:4/483: write d2/d6/de/d1c/d4d/d52/d69/f84 [787001,76827] 0 2024-09-21T11:39:30.857 INFO:tasks.workunit.client.0.smithi118.stdout:8/827: creat d2/d7c/d88/dc2/f11f x:0 0 0 2024-09-21T11:39:30.857 INFO:tasks.workunit.client.0.smithi118.stdout:4/484: chown d2/d6/dd/l5d 15 1 2024-09-21T11:39:30.858 INFO:tasks.workunit.client.0.smithi118.stdout:2/401: getdents de/d22/d3c 0 2024-09-21T11:39:30.858 INFO:tasks.workunit.client.0.smithi118.stdout:4/485: stat d2/d6/de/d1c/d4d 0 2024-09-21T11:39:30.859 INFO:tasks.workunit.client.0.smithi118.stdout:2/402: stat de/d16/d25 0 2024-09-21T11:39:30.864 INFO:tasks.workunit.client.0.smithi118.stdout:0/817: dread d5/d10/d1e/d23/d3a/d90/f99 [0,4194304] 0 2024-09-21T11:39:30.867 INFO:tasks.workunit.client.0.smithi118.stdout:8/828: rename d2/dc/d10/d2e/d18/f10e to d2/dc/d10/d3b/d101/d103/f120 0 2024-09-21T11:39:30.868 INFO:tasks.workunit.client.0.smithi118.stdout:7/533: mknod d0/d3/d14/d41/d7f/d3e/d81/ca8 0 2024-09-21T11:39:30.870 INFO:tasks.workunit.client.0.smithi118.stdout:4/486: truncate d2/d6/dd/d35/f3f 814962 0 2024-09-21T11:39:30.871 INFO:tasks.workunit.client.0.smithi118.stdout:7/534: truncate d0/d3/d1d/f7d 1489410 0 2024-09-21T11:39:30.874 INFO:tasks.workunit.client.0.smithi118.stdout:1/533: truncate d6/de/d16/d3f/f4d 1357845 0 2024-09-21T11:39:30.875 INFO:tasks.workunit.client.0.smithi118.stdout:8/829: dwrite d2/dc/d10/d2e/f117 [0,4194304] 0 2024-09-21T11:39:30.875 INFO:tasks.workunit.client.0.smithi118.stdout:3/441: dread d5/f17 [0,4194304] 0 2024-09-21T11:39:30.876 INFO:tasks.workunit.client.0.smithi118.stdout:0/818: mkdir d5/d10/d1e/d23/d3a/d4e/dfd/d113 0 2024-09-21T11:39:30.877 INFO:tasks.workunit.client.0.smithi118.stdout:1/534: fdatasync d6/d33/d3c/f9b 0 2024-09-21T11:39:30.879 INFO:tasks.workunit.client.0.smithi118.stdout:3/442: chown d5/d1d/d1b/c74 1451164044 1 2024-09-21T11:39:30.881 INFO:tasks.workunit.client.0.smithi118.stdout:4/487: dwrite d2/d6/de/d1c/d23/f2c [0,4194304] 0 2024-09-21T11:39:30.886 INFO:tasks.workunit.client.0.smithi118.stdout:2/403: truncate de/d1f/d4a/f6e 1062624 0 2024-09-21T11:39:30.887 INFO:tasks.workunit.client.0.smithi118.stdout:4/488: dwrite d2/f2d [4194304,4194304] 0 2024-09-21T11:39:30.891 INFO:tasks.workunit.client.0.smithi118.stdout:1/535: creat d6/de/d16/d3f/d50/d54/d32/fa7 x:0 0 0 2024-09-21T11:39:30.904 INFO:tasks.workunit.client.0.smithi118.stdout:1/536: creat d6/d33/d7a/fa8 x:0 0 0 2024-09-21T11:39:30.904 INFO:tasks.workunit.client.0.smithi118.stdout:0/819: link d5/d34/d44/d7c/cf0 d5/d29/d68/d7b/db7/c114 0 2024-09-21T11:39:30.905 INFO:tasks.workunit.client.0.smithi118.stdout:0/820: chown d5/d10/d1e/f27 176858 1 2024-09-21T11:39:30.906 INFO:tasks.workunit.client.0.smithi118.stdout:0/821: write d5/d34/d44/d87/d9a/ff7 [1998312,25136] 0 2024-09-21T11:39:30.913 INFO:tasks.workunit.client.0.smithi118.stdout:8/830: write d2/dc/d10/d2e/d18/d1a/f5c [1153453,45493] 0 2024-09-21T11:39:30.917 INFO:tasks.workunit.client.0.smithi118.stdout:0/822: rename d5/d29/d68/d7b/db7/f45 to d5/d29/d53/f115 0 2024-09-21T11:39:30.917 INFO:tasks.workunit.client.0.smithi118.stdout:2/404: dread de/d1f/d20/f48 [0,4194304] 0 2024-09-21T11:39:30.919 INFO:tasks.workunit.client.0.smithi118.stdout:0/823: read - d5/d10/d1e/d33/f106 zero size 2024-09-21T11:39:30.921 INFO:tasks.workunit.client.0.smithi118.stdout:2/405: rmdir de/d51 39 2024-09-21T11:39:30.923 INFO:tasks.workunit.client.0.smithi118.stdout:4/489: dwrite d2/d6/f20 [0,4194304] 0 2024-09-21T11:39:30.925 INFO:tasks.workunit.client.0.smithi118.stdout:4/490: readlink d2/d6/dd/l30 0 2024-09-21T11:39:30.925 INFO:tasks.workunit.client.0.smithi118.stdout:1/537: getdents d6/de/d16/d3f/d50 0 2024-09-21T11:39:30.926 INFO:tasks.workunit.client.0.smithi118.stdout:1/538: readlink d6/d2a/d5c/d85/l8f 0 2024-09-21T11:39:30.927 INFO:tasks.workunit.client.0.smithi118.stdout:8/831: write d2/dc/d35/fa8 [745040,117152] 0 2024-09-21T11:39:30.928 INFO:tasks.workunit.client.0.smithi118.stdout:2/406: creat de/d53/f8d x:0 0 0 2024-09-21T11:39:30.928 INFO:tasks.workunit.client.0.smithi118.stdout:8/832: fsync d2/d7c/d88/dc2/f11f 0 2024-09-21T11:39:30.929 INFO:tasks.workunit.client.0.smithi118.stdout:2/407: readlink de/d1f/l2e 0 2024-09-21T11:39:30.930 INFO:tasks.workunit.client.0.smithi118.stdout:2/408: read - de/d50/f81 zero size 2024-09-21T11:39:30.931 INFO:tasks.workunit.client.0.smithi118.stdout:2/409: read de/d1f/d20/f48 [2359731,50643] 0 2024-09-21T11:39:30.931 INFO:tasks.workunit.client.0.smithi118.stdout:4/491: symlink d2/d6/de/d1c/d23/d26/laa 0 2024-09-21T11:39:30.933 INFO:tasks.workunit.client.0.smithi118.stdout:4/492: truncate d2/d6/de/f80 721293 0 2024-09-21T11:39:30.933 INFO:tasks.workunit.client.0.smithi118.stdout:8/833: unlink d2/dc/d35/d42/c44 0 2024-09-21T11:39:30.934 INFO:tasks.workunit.client.0.smithi118.stdout:4/493: dread - d2/d6/de/fa5 zero size 2024-09-21T11:39:30.935 INFO:tasks.workunit.client.0.smithi118.stdout:8/834: write d2/dc/d16/d46/d4c/d63/f7e [2784874,45114] 0 2024-09-21T11:39:30.935 INFO:tasks.workunit.client.0.smithi118.stdout:0/824: creat d5/d10/d1e/d23/d3a/d4e/dfc/f116 x:0 0 0 2024-09-21T11:39:30.938 INFO:tasks.workunit.client.0.smithi118.stdout:2/410: write de/d51/f5c [1145306,6028] 0 2024-09-21T11:39:30.942 INFO:tasks.workunit.client.0.smithi118.stdout:8/835: creat d2/d7c/d88/d8f/f121 x:0 0 0 2024-09-21T11:39:30.943 INFO:tasks.workunit.client.0.smithi118.stdout:8/836: write d2/dc/d35/fef [3959203,119481] 0 2024-09-21T11:39:30.946 INFO:tasks.workunit.client.0.smithi118.stdout:1/539: creat d6/d3b/fa9 x:0 0 0 2024-09-21T11:39:30.948 INFO:tasks.workunit.client.0.smithi118.stdout:2/411: rename de/f18 to de/d22/d3c/f8e 0 2024-09-21T11:39:30.955 INFO:tasks.workunit.client.0.smithi118.stdout:2/412: dwrite de/d22/d3c/f7b [0,4194304] 0 2024-09-21T11:39:30.956 INFO:tasks.workunit.client.0.smithi118.stdout:2/413: write de/f2a [3703324,32954] 0 2024-09-21T11:39:30.957 INFO:tasks.workunit.client.0.smithi118.stdout:1/540: stat d6/de/d16/d3f/f4d 0 2024-09-21T11:39:30.958 INFO:tasks.workunit.client.0.smithi118.stdout:1/541: readlink d6/de/d16/d3f/d50/d54/l4e 0 2024-09-21T11:39:30.960 INFO:tasks.workunit.client.0.smithi118.stdout:4/494: write d2/da1/fa2 [834520,51730] 0 2024-09-21T11:39:30.961 INFO:tasks.workunit.client.0.smithi118.stdout:1/542: write d6/de/d16/d3f/d50/d72/f80 [2845170,103471] 0 2024-09-21T11:39:30.965 INFO:tasks.workunit.client.0.smithi118.stdout:0/825: link d5/f74 d5/d10/d1e/d21/db3/f117 0 2024-09-21T11:39:30.967 INFO:tasks.workunit.client.0.smithi118.stdout:0/826: read d5/d34/d44/d87/d9a/ff7 [3610990,59177] 0 2024-09-21T11:39:31.032 INFO:tasks.workunit.client.0.smithi118.stdout:2/414: symlink de/d1f/d20/d67/d8a/d6d/d70/l8f 0 2024-09-21T11:39:31.036 INFO:tasks.workunit.client.0.smithi118.stdout:1/543: rename d6/de/f5f to d6/de/d13/d84/d96/d9e/faa 0 2024-09-21T11:39:31.037 INFO:tasks.workunit.client.0.smithi118.stdout:1/544: chown c2 380541281 1 2024-09-21T11:39:31.037 INFO:tasks.workunit.client.0.smithi118.stdout:0/827: dwrite d5/d10/d1e/d3d/d93/f96 [0,4194304] 0 2024-09-21T11:39:31.041 INFO:tasks.workunit.client.0.smithi118.stdout:2/415: creat de/d1f/d20/d67/d8a/d6d/d70/f90 x:0 0 0 2024-09-21T11:39:31.043 INFO:tasks.workunit.client.0.smithi118.stdout:4/495: rename d2/d6/de/d1c/f4a to d2/d65/d89/fab 0 2024-09-21T11:39:31.044 INFO:tasks.workunit.client.0.smithi118.stdout:1/545: symlink d6/de/d13/d84/d96/d9e/lab 0 2024-09-21T11:39:31.046 INFO:tasks.workunit.client.0.smithi118.stdout:4/496: truncate d2/d6/de/d1c/d23/f92 288700 0 2024-09-21T11:39:31.046 INFO:tasks.workunit.client.0.smithi118.stdout:2/416: truncate de/d22/d3c/f3f 238837 0 2024-09-21T11:39:31.050 INFO:tasks.workunit.client.0.smithi118.stdout:2/417: fsync de/d1f/d20/f55 0 2024-09-21T11:39:31.056 INFO:tasks.workunit.client.0.smithi118.stdout:1/546: unlink d6/d2a/d3d/ca0 0 2024-09-21T11:39:31.058 INFO:tasks.workunit.client.0.smithi118.stdout:1/547: write d6/de/d13/f8b [354539,61531] 0 2024-09-21T11:39:31.061 INFO:tasks.workunit.client.0.smithi118.stdout:4/497: rename d2/d6/de/d1c/d87/da9/f53 to d2/d6/de/d1c/d4d/d52/d69/fac 0 2024-09-21T11:39:31.065 INFO:tasks.workunit.client.0.smithi118.stdout:2/418: creat de/d1f/d20/d67/d8a/d6d/d70/f91 x:0 0 0 2024-09-21T11:39:31.065 INFO:tasks.workunit.client.0.smithi118.stdout:4/498: rename d2/d6 to d2/d6/de/d1c/d87/da9/dad 22 2024-09-21T11:39:31.066 INFO:tasks.workunit.client.0.smithi118.stdout:4/499: chown d2/d6/de/d1c/d4d/c8b 2220 1 2024-09-21T11:39:31.076 INFO:tasks.workunit.client.0.smithi118.stdout:2/419: creat de/d50/d63/f92 x:0 0 0 2024-09-21T11:39:31.076 INFO:tasks.workunit.client.0.smithi118.stdout:9/518: dread d0/d4/f27 [0,4194304] 0 2024-09-21T11:39:31.077 INFO:tasks.workunit.client.0.smithi118.stdout:8/837: dread d2/f7 [4194304,4194304] 0 2024-09-21T11:39:31.079 INFO:tasks.workunit.client.0.smithi118.stdout:4/500: dread d2/d65/f6d [0,4194304] 0 2024-09-21T11:39:31.079 INFO:tasks.workunit.client.0.smithi118.stdout:9/519: truncate d0/d4/f8c 257084 0 2024-09-21T11:39:31.082 INFO:tasks.workunit.client.0.smithi118.stdout:2/420: creat de/d1f/d20/d67/d8a/d6d/d70/f93 x:0 0 0 2024-09-21T11:39:31.082 INFO:tasks.workunit.client.0.smithi118.stdout:8/838: mkdir d2/d73/d122 0 2024-09-21T11:39:31.085 INFO:tasks.workunit.client.0.smithi118.stdout:1/548: dread d6/f79 [0,4194304] 0 2024-09-21T11:39:31.087 INFO:tasks.workunit.client.0.smithi118.stdout:1/549: write d6/d33/d7a/fa8 [767517,53388] 0 2024-09-21T11:39:31.091 INFO:tasks.workunit.client.0.smithi118.stdout:9/520: mknod d0/d20/d4c/d5f/d6c/d88/db9/d7c/db2/cbe 0 2024-09-21T11:39:31.094 INFO:tasks.workunit.client.0.smithi118.stdout:2/421: mknod de/d1f/d20/d67/c94 0 2024-09-21T11:39:31.108 INFO:tasks.workunit.client.0.smithi118.stdout:8/839: creat d2/dc/d16/d46/d4c/d63/f123 x:0 0 0 2024-09-21T11:39:31.112 INFO:tasks.workunit.client.0.smithi118.stdout:4/501: dwrite d2/f21 [0,4194304] 0 2024-09-21T11:39:31.113 INFO:tasks.workunit.client.0.smithi118.stdout:2/422: mknod de/d50/d85/c95 0 2024-09-21T11:39:31.115 INFO:tasks.workunit.client.0.smithi118.stdout:2/423: read de/f19 [166990,96210] 0 2024-09-21T11:39:31.117 INFO:tasks.workunit.client.0.smithi118.stdout:1/550: write d6/de/d16/d3f/f4d [1191895,114423] 0 2024-09-21T11:39:31.118 INFO:tasks.workunit.client.0.smithi118.stdout:8/840: dwrite d2/d73/f11b [0,4194304] 0 2024-09-21T11:39:31.126 INFO:tasks.workunit.client.0.smithi118.stdout:9/521: dwrite d0/d20/f6b [0,4194304] 0 2024-09-21T11:39:31.140 INFO:tasks.workunit.client.0.smithi118.stdout:4/502: dwrite d2/d6/de/d1c/d4d/d52/d69/f82 [0,4194304] 0 2024-09-21T11:39:31.141 INFO:tasks.workunit.client.0.smithi118.stdout:2/424: creat de/d1f/f96 x:0 0 0 2024-09-21T11:39:31.144 INFO:tasks.workunit.client.0.smithi118.stdout:2/425: write de/d1f/d20/f48 [3170397,104156] 0 2024-09-21T11:39:31.146 INFO:tasks.workunit.client.0.smithi118.stdout:1/551: creat d6/d2a/fac x:0 0 0 2024-09-21T11:39:31.150 INFO:tasks.workunit.client.0.smithi118.stdout:1/552: stat d6/c76 0 2024-09-21T11:39:31.152 INFO:tasks.workunit.client.0.smithi118.stdout:2/426: rename de/d1f/d20/f2d to de/d1f/d20/f97 0 2024-09-21T11:39:31.153 INFO:tasks.workunit.client.0.smithi118.stdout:9/522: dread d0/d20/f64 [0,4194304] 0 2024-09-21T11:39:31.155 INFO:tasks.workunit.client.0.smithi118.stdout:8/841: dwrite d2/dc/d10/d2e/fe6 [0,4194304] 0 2024-09-21T11:39:31.160 INFO:tasks.workunit.client.0.smithi118.stdout:1/553: dread d6/d33/d3c/f73 [0,4194304] 0 2024-09-21T11:39:31.160 INFO:tasks.workunit.client.0.smithi118.stdout:9/523: rmdir d0/d20/d4c/d5f/d6c/d88/d4d 39 2024-09-21T11:39:31.166 INFO:tasks.workunit.client.0.smithi118.stdout:2/427: mkdir de/d1f/d20/d78/d98 0 2024-09-21T11:39:31.169 INFO:tasks.workunit.client.0.smithi118.stdout:2/428: fsync de/d1f/d20/d67/d8a/d6d/d70/f93 0 2024-09-21T11:39:31.171 INFO:tasks.workunit.client.0.smithi118.stdout:8/842: dwrite d2/dc/d10/d3b/d101/d103/f120 [0,4194304] 0 2024-09-21T11:39:31.172 INFO:tasks.workunit.client.0.smithi118.stdout:1/554: mknod d6/de/d16/cad 0 2024-09-21T11:39:31.174 INFO:tasks.workunit.client.0.smithi118.stdout:2/429: chown de/d22/d3c/f8e 442 1 2024-09-21T11:39:31.175 INFO:tasks.workunit.client.0.smithi118.stdout:8/843: read d2/dc/d16/d46/f8e [633900,67555] 0 2024-09-21T11:39:31.176 INFO:tasks.workunit.client.0.smithi118.stdout:4/503: dread d2/f8a [0,4194304] 0 2024-09-21T11:39:31.178 INFO:tasks.workunit.client.0.smithi118.stdout:2/430: write de/d1f/d20/d67/d8a/d6d/d70/f90 [684763,52236] 0 2024-09-21T11:39:31.179 INFO:tasks.workunit.client.0.smithi118.stdout:8/844: write d2/dc/d16/d46/d4c/d63/f123 [802518,55973] 0 2024-09-21T11:39:31.182 INFO:tasks.workunit.client.0.smithi118.stdout:4/504: write d2/d6/de/d1c/d23/d26/f73 [1268571,20147] 0 2024-09-21T11:39:31.183 INFO:tasks.workunit.client.0.smithi118.stdout:8/845: rmdir d2/dc/d49/d84/d99 39 2024-09-21T11:39:31.184 INFO:tasks.workunit.client.0.smithi118.stdout:2/431: dread de/d22/d3c/f8e [0,4194304] 0 2024-09-21T11:39:31.185 INFO:tasks.workunit.client.0.smithi118.stdout:8/846: stat d2/dc/d49/df1 0 2024-09-21T11:39:31.190 INFO:tasks.workunit.client.0.smithi118.stdout:2/432: rmdir de/d16/d25 39 2024-09-21T11:39:31.190 INFO:tasks.workunit.client.0.smithi118.stdout:9/524: dwrite d0/d20/d71/f95 [0,4194304] 0 2024-09-21T11:39:31.190 INFO:tasks.workunit.client.0.smithi118.stdout:1/555: write d6/d2a/f69 [1868330,72035] 0 2024-09-21T11:39:31.191 INFO:tasks.workunit.client.0.smithi118.stdout:4/505: mknod d2/d6/de/d1c/d4d/d52/d69/cae 0 2024-09-21T11:39:31.197 INFO:tasks.workunit.client.0.smithi118.stdout:8/847: dwrite d2/dc/d10/d2e/d18/f2f [0,4194304] 0 2024-09-21T11:39:31.197 INFO:tasks.workunit.client.0.smithi118.stdout:2/433: mkdir de/d1f/d20/d67/d99 0 2024-09-21T11:39:31.201 INFO:tasks.workunit.client.0.smithi118.stdout:4/506: mknod d2/d6/de/d1c/d23/d26/caf 0 2024-09-21T11:39:31.204 INFO:tasks.workunit.client.0.smithi118.stdout:2/434: fdatasync de/d16/d25/f62 0 2024-09-21T11:39:31.206 INFO:tasks.workunit.client.0.smithi118.stdout:1/556: dwrite d6/d2a/d5c/d85/f9c [4194304,4194304] 0 2024-09-21T11:39:31.210 INFO:tasks.workunit.client.0.smithi118.stdout:8/848: creat d2/dc/d16/d46/d4c/d63/d74/f124 x:0 0 0 2024-09-21T11:39:31.216 INFO:tasks.workunit.client.0.smithi118.stdout:8/849: mkdir d2/dc/d10/d3b/d101/d103/de7/d125 0 2024-09-21T11:39:31.219 INFO:tasks.workunit.client.0.smithi118.stdout:9/525: link d0/d4/d45/d72/l9d d0/d4/lbf 0 2024-09-21T11:39:31.219 INFO:tasks.workunit.client.0.smithi118.stdout:2/435: truncate de/d1f/d4a/f6e 49885 0 2024-09-21T11:39:31.220 INFO:tasks.workunit.client.0.smithi118.stdout:2/436: stat de/l79 0 2024-09-21T11:39:31.224 INFO:tasks.workunit.client.0.smithi118.stdout:8/850: mknod d2/dc/dc1/c126 0 2024-09-21T11:39:31.225 INFO:tasks.workunit.client.0.smithi118.stdout:8/851: read - d2/dc/d10/d2e/d9b/fe9 zero size 2024-09-21T11:39:31.226 INFO:tasks.workunit.client.0.smithi118.stdout:9/526: fdatasync d0/f13 0 2024-09-21T11:39:31.227 INFO:tasks.workunit.client.0.smithi118.stdout:9/527: stat d0/d4/d45/d72/f94 0 2024-09-21T11:39:31.228 INFO:tasks.workunit.client.0.smithi118.stdout:1/557: creat d6/de/d16/d3f/d50/fae x:0 0 0 2024-09-21T11:39:31.232 INFO:tasks.workunit.client.0.smithi118.stdout:8/852: dwrite d2/dc/d10/d2e/dba/fc0 [0,4194304] 0 2024-09-21T11:39:31.237 INFO:tasks.workunit.client.0.smithi118.stdout:9/528: unlink d0/d20/l22 0 2024-09-21T11:39:31.238 INFO:tasks.workunit.client.0.smithi118.stdout:1/558: symlink d6/de/d13/d84/laf 0 2024-09-21T11:39:31.239 INFO:tasks.workunit.client.0.smithi118.stdout:1/559: fsync d6/d2a/f23 0 2024-09-21T11:39:31.244 INFO:tasks.workunit.client.0.smithi118.stdout:9/529: rename d0/d20/f30 to d0/d20/d4c/d5f/d66/fc0 0 2024-09-21T11:39:31.244 INFO:tasks.workunit.client.0.smithi118.stdout:2/437: truncate de/d51/f6b 2233684 0 2024-09-21T11:39:31.246 INFO:tasks.workunit.client.0.smithi118.stdout:2/438: write de/d1f/d20/d67/d8a/d6d/d70/f93 [1030657,71876] 0 2024-09-21T11:39:31.248 INFO:tasks.workunit.client.0.smithi118.stdout:8/853: mkdir d2/dc/d16/d46/dca/d127 0 2024-09-21T11:39:31.252 INFO:tasks.workunit.client.0.smithi118.stdout:2/439: mkdir de/d16/d1c/d66/d9a 0 2024-09-21T11:39:31.253 INFO:tasks.workunit.client.0.smithi118.stdout:2/440: chown de/d1f/d20/f55 3881 1 2024-09-21T11:39:31.256 INFO:tasks.workunit.client.0.smithi118.stdout:8/854: rmdir d2/dc 39 2024-09-21T11:39:31.261 INFO:tasks.workunit.client.0.smithi118.stdout:2/441: rename de/d50/d63 to de/d1f/d4a/d9b 0 2024-09-21T11:39:31.262 INFO:tasks.workunit.client.0.smithi118.stdout:2/442: chown de/d16/d1c/d4f/d5b 5 1 2024-09-21T11:39:31.263 INFO:tasks.workunit.client.0.smithi118.stdout:9/530: write d0/d20/f3c [298122,92528] 0 2024-09-21T11:39:31.266 INFO:tasks.workunit.client.0.smithi118.stdout:2/443: creat de/d16/d1c/d65/f9c x:0 0 0 2024-09-21T11:39:31.270 INFO:tasks.workunit.client.0.smithi118.stdout:8/855: dread d2/dc/d16/d46/fd4 [0,4194304] 0 2024-09-21T11:39:31.271 INFO:tasks.workunit.client.0.smithi118.stdout:8/856: chown d2/dc/fac 342377403 1 2024-09-21T11:39:31.273 INFO:tasks.workunit.client.0.smithi118.stdout:2/444: fsync de/f1e 0 2024-09-21T11:39:31.274 INFO:tasks.workunit.client.0.smithi118.stdout:2/445: write de/d1f/d20/d67/d8a/d6d/d70/f90 [679587,86193] 0 2024-09-21T11:39:31.276 INFO:tasks.workunit.client.0.smithi118.stdout:2/446: write de/d50/f81 [93201,84309] 0 2024-09-21T11:39:31.279 INFO:tasks.workunit.client.0.smithi118.stdout:8/857: creat d2/dc/d10/d2e/d18/d36/f128 x:0 0 0 2024-09-21T11:39:31.282 INFO:tasks.workunit.client.0.smithi118.stdout:8/858: mknod d2/dc/d10/dd3/c129 0 2024-09-21T11:39:31.283 INFO:tasks.workunit.client.0.smithi118.stdout:8/859: write d2/d32/fe4 [1504639,8911] 0 2024-09-21T11:39:31.285 INFO:tasks.workunit.client.0.smithi118.stdout:2/447: mknod de/d16/d31/d7a/c9d 0 2024-09-21T11:39:31.285 INFO:tasks.workunit.client.0.smithi118.stdout:2/448: write de/d16/f58 [3806836,34235] 0 2024-09-21T11:39:31.286 INFO:tasks.workunit.client.0.smithi118.stdout:9/531: mknod d0/d4/d38/db8/cc1 0 2024-09-21T11:39:31.287 INFO:tasks.workunit.client.0.smithi118.stdout:8/860: rmdir d2/dc/dc1 39 2024-09-21T11:39:31.288 INFO:tasks.workunit.client.0.smithi118.stdout:8/861: chown d2/dc/d35/d42/ff0 17 1 2024-09-21T11:39:31.289 INFO:tasks.workunit.client.0.smithi118.stdout:8/862: fdatasync d2/d73/f11b 0 2024-09-21T11:39:31.290 INFO:tasks.workunit.client.0.smithi118.stdout:9/532: dread - d0/f7e zero size 2024-09-21T11:39:31.296 INFO:tasks.workunit.client.0.smithi118.stdout:8/863: dwrite d2/dc/d16/d46/d4c/d63/ff3 [0,4194304] 0 2024-09-21T11:39:31.298 INFO:tasks.workunit.client.0.smithi118.stdout:8/864: write d2/dc/d35/fa8 [1598042,37459] 0 2024-09-21T11:39:31.300 INFO:tasks.workunit.client.0.smithi118.stdout:2/449: rename de/d16/d1c/d65/f9c to de/d1f/d20/d67/f9e 0 2024-09-21T11:39:31.303 INFO:tasks.workunit.client.0.smithi118.stdout:9/533: truncate d0/d4/d38/f46 1342290 0 2024-09-21T11:39:31.306 INFO:tasks.workunit.client.0.smithi118.stdout:2/450: dwrite de/d51/f5c [0,4194304] 0 2024-09-21T11:39:31.307 INFO:tasks.workunit.client.0.smithi118.stdout:2/451: chown de/d1f/d20/d67 226917 1 2024-09-21T11:39:31.308 INFO:tasks.workunit.client.0.smithi118.stdout:8/865: mknod d2/dc/d10/d2e/d18/c12a 0 2024-09-21T11:39:31.309 INFO:tasks.workunit.client.0.smithi118.stdout:8/866: readlink d2/l6 0 2024-09-21T11:39:31.310 INFO:tasks.workunit.client.0.smithi118.stdout:9/534: write d0/fbc [795697,42797] 0 2024-09-21T11:39:31.313 INFO:tasks.workunit.client.0.smithi118.stdout:9/535: chown d0/d20/d4c/d5f/d89 24915 1 2024-09-21T11:39:31.314 INFO:tasks.workunit.client.0.smithi118.stdout:2/452: getdents de/d1f/d20 0 2024-09-21T11:39:31.316 INFO:tasks.workunit.client.0.smithi118.stdout:9/536: mkdir d0/d20/d4c/d5f/d6c/d88/d4d/dc2 0 2024-09-21T11:39:31.316 INFO:tasks.workunit.client.0.smithi118.stdout:2/453: write de/d1f/d20/d67/d8a/d6d/d70/f91 [811207,104053] 0 2024-09-21T11:39:31.318 INFO:tasks.workunit.client.0.smithi118.stdout:8/867: dread d2/dc/d16/d46/d4c/db0/fcf [0,4194304] 0 2024-09-21T11:39:31.320 INFO:tasks.workunit.client.0.smithi118.stdout:9/537: creat d0/d20/fc3 x:0 0 0 2024-09-21T11:39:31.323 INFO:tasks.workunit.client.0.smithi118.stdout:9/538: symlink d0/d20/d4c/d5f/d6c/d88/db9/d7c/db2/lc4 0 2024-09-21T11:39:31.324 INFO:tasks.workunit.client.0.smithi118.stdout:9/539: rmdir d0/d20/d4c/d5f/d6c/d88/d4d 39 2024-09-21T11:39:31.327 INFO:tasks.workunit.client.0.smithi118.stdout:9/540: fsync d0/f3a 0 2024-09-21T11:39:31.331 INFO:tasks.workunit.client.0.smithi118.stdout:9/541: creat d0/d20/d4c/d5f/d6c/d88/fc5 x:0 0 0 2024-09-21T11:39:31.334 INFO:tasks.workunit.client.0.smithi118.stdout:9/542: stat d0/d20/d4c/d5f/d6c/d88/d4d/fab 0 2024-09-21T11:39:31.338 INFO:tasks.workunit.client.0.smithi118.stdout:9/543: getdents d0/d20/d4c 0 2024-09-21T11:39:31.340 INFO:tasks.workunit.client.0.smithi118.stdout:8/868: dread d2/d73/f92 [0,4194304] 0 2024-09-21T11:39:31.343 INFO:tasks.workunit.client.0.smithi118.stdout:8/869: symlink d2/dc/d49/d84/l12b 0 2024-09-21T11:39:31.345 INFO:tasks.workunit.client.0.smithi118.stdout:8/870: creat d2/dc/d16/d46/d4c/d63/db9/f12c x:0 0 0 2024-09-21T11:39:31.346 INFO:tasks.workunit.client.0.smithi118.stdout:8/871: fdatasync d2/dc/d10/d2e/d18/f2f 0 2024-09-21T11:39:31.350 INFO:tasks.workunit.client.0.smithi118.stdout:8/872: creat d2/dc/d49/d84/d99/f12d x:0 0 0 2024-09-21T11:39:31.351 INFO:tasks.workunit.client.0.smithi118.stdout:8/873: mkdir d2/dc/d10/d2e/d18/d1a/d12e 0 2024-09-21T11:39:31.355 INFO:tasks.workunit.client.0.smithi118.stdout:8/874: creat d2/dc/d10/d2e/d18/f12f x:0 0 0 2024-09-21T11:39:31.375 INFO:tasks.workunit.client.0.smithi118.stdout:8/875: dwrite d2/dc/d16/d46/d4c/db0/fcf [0,4194304] 0 2024-09-21T11:39:31.375 INFO:tasks.workunit.client.0.smithi118.stdout:8/876: chown d2/d73/d79/f9a 22779 1 2024-09-21T11:39:31.381 INFO:tasks.workunit.client.0.smithi118.stdout:8/877: dwrite d2/dc/d10/d2e/d9b/f113 [0,4194304] 0 2024-09-21T11:39:31.384 INFO:tasks.workunit.client.0.smithi118.stdout:8/878: symlink d2/dc/d10/d6a/l130 0 2024-09-21T11:39:31.390 INFO:tasks.workunit.client.0.smithi118.stdout:8/879: getdents d2/d7c/d88/dc2 0 2024-09-21T11:39:31.391 INFO:tasks.workunit.client.0.smithi118.stdout:8/880: dread - d2/dc/d10/d2e/d18/d36/ffc zero size 2024-09-21T11:39:31.394 INFO:tasks.workunit.client.0.smithi118.stdout:8/881: creat d2/dc/d16/d46/d4c/d109/f131 x:0 0 0 2024-09-21T11:39:31.398 INFO:tasks.workunit.client.0.smithi118.stdout:8/882: mknod d2/dc/d10/d2e/d18/d1a/d12e/c132 0 2024-09-21T11:39:31.399 INFO:tasks.workunit.client.0.smithi118.stdout:8/883: write d2/d7c/d88/dc2/f11f [836381,107696] 0 2024-09-21T11:39:31.399 INFO:tasks.workunit.client.0.smithi118.stdout:8/884: dread - d2/dc/d10/d2e/d9b/fe9 zero size 2024-09-21T11:39:31.424 INFO:tasks.workunit.client.0.smithi118.stdout:8/885: dwrite d2/dc/d10/dd3/f107 [0,4194304] 0 2024-09-21T11:39:31.426 INFO:tasks.workunit.client.0.smithi118.stdout:8/886: dread d2/dc/d16/d46/fd4 [0,4194304] 0 2024-09-21T11:39:31.429 INFO:tasks.workunit.client.0.smithi118.stdout:8/887: creat d2/dc/d16/d46/d4c/d63/d10b/f133 x:0 0 0 2024-09-21T11:39:31.440 INFO:tasks.workunit.client.0.smithi118.stdout:8/888: dwrite d2/dc/d10/d2e/d18/d36/f128 [0,4194304] 0 2024-09-21T11:39:31.479 INFO:tasks.workunit.client.0.smithi118.stdout:8/889: write d2/dc/d10/d2e/d18/f4f [3543778,106534] 0 2024-09-21T11:39:31.482 INFO:tasks.workunit.client.0.smithi118.stdout:8/890: creat d2/dc/d10/d2e/f134 x:0 0 0 2024-09-21T11:39:31.484 INFO:tasks.workunit.client.0.smithi118.stdout:8/891: rmdir d2/dc/d10/d2e/d9b 39 2024-09-21T11:39:31.485 INFO:tasks.workunit.client.0.smithi118.stdout:8/892: readlink d2/d73/ldb 0 2024-09-21T11:39:31.488 INFO:tasks.workunit.client.0.smithi118.stdout:8/893: creat d2/dc/d16/d46/dca/d127/f135 x:0 0 0 2024-09-21T11:39:31.489 INFO:tasks.workunit.client.0.smithi118.stdout:8/894: readlink d2/dc/d16/d46/d4c/db0/lb8 0 2024-09-21T11:39:31.495 INFO:tasks.workunit.client.0.smithi118.stdout:8/895: dwrite d2/dc/d49/d84/d99/f12d [0,4194304] 0 2024-09-21T11:39:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:32 smithi149 ceph-mon[36123]: pgmap v31: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 94 MiB/s rd, 234 MiB/s wr, 483 op/s 2024-09-21T11:39:32.573 INFO:tasks.workunit.client.0.smithi118.stdout:6/472: sync 2024-09-21T11:39:32.573 INFO:tasks.workunit.client.0.smithi118.stdout:7/535: sync 2024-09-21T11:39:32.573 INFO:tasks.workunit.client.0.smithi118.stdout:5/529: sync 2024-09-21T11:39:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:32 smithi118 ceph-mon[28757]: pgmap v31: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 94 MiB/s rd, 234 MiB/s wr, 483 op/s 2024-09-21T11:39:32.578 INFO:tasks.workunit.client.0.smithi118.stdout:7/536: creat d0/d3/d14/fa9 x:0 0 0 2024-09-21T11:39:32.581 INFO:tasks.workunit.client.0.smithi118.stdout:6/473: creat d8/d14/f99 x:0 0 0 2024-09-21T11:39:32.582 INFO:tasks.workunit.client.0.smithi118.stdout:7/537: symlink d0/d3/d14/d41/d7f/da2/laa 0 2024-09-21T11:39:32.586 INFO:tasks.workunit.client.0.smithi118.stdout:7/538: unlink d0/d3/d13/f93 0 2024-09-21T11:39:32.589 INFO:tasks.workunit.client.0.smithi118.stdout:5/530: write d0/d6c/d25/f43 [3515007,14199] 0 2024-09-21T11:39:32.590 INFO:tasks.workunit.client.0.smithi118.stdout:5/531: chown d0/c61 2762 1 2024-09-21T11:39:32.596 INFO:tasks.workunit.client.0.smithi118.stdout:5/532: chown d0/d63/c80 52 1 2024-09-21T11:39:32.596 INFO:tasks.workunit.client.0.smithi118.stdout:6/474: write d8/fb [5437400,67937] 0 2024-09-21T11:39:32.600 INFO:tasks.workunit.client.0.smithi118.stdout:7/539: write d0/d3/d13/f38 [2213753,72909] 0 2024-09-21T11:39:32.604 INFO:tasks.workunit.client.0.smithi118.stdout:5/533: dwrite d0/d6c/f6a [0,4194304] 0 2024-09-21T11:39:32.611 INFO:tasks.workunit.client.0.smithi118.stdout:7/540: rename d0/d3/d14/d41/d7f/d3e/c4a to d0/d3/d1d/d35/d57/cab 0 2024-09-21T11:39:32.614 INFO:tasks.workunit.client.0.smithi118.stdout:5/534: getdents d0/d89/d9d 0 2024-09-21T11:39:32.616 INFO:tasks.workunit.client.0.smithi118.stdout:7/541: truncate d0/d3/d1d/d35/f60 308102 0 2024-09-21T11:39:32.617 INFO:tasks.workunit.client.0.smithi118.stdout:6/475: dwrite d8/f25 [0,4194304] 0 2024-09-21T11:39:32.622 INFO:tasks.workunit.client.0.smithi118.stdout:6/476: read d8/d48/d45/d61/d70/f87 [27464,125710] 0 2024-09-21T11:39:32.622 INFO:tasks.workunit.client.0.smithi118.stdout:6/477: stat d8/d14/l71 0 2024-09-21T11:39:32.623 INFO:tasks.workunit.client.0.smithi118.stdout:7/542: unlink d0/d3/d29/d47/f5d 0 2024-09-21T11:39:32.626 INFO:tasks.workunit.client.0.smithi118.stdout:7/543: write d0/d3/d14/d41/d7f/d3e/d81/f83 [439573,43947] 0 2024-09-21T11:39:32.627 INFO:tasks.workunit.client.0.smithi118.stdout:7/544: stat d0/d3/d14/d41/d7f 0 2024-09-21T11:39:32.628 INFO:tasks.workunit.client.0.smithi118.stdout:6/478: rmdir d8/d48/d45/d61/d66 39 2024-09-21T11:39:32.630 INFO:tasks.workunit.client.0.smithi118.stdout:0/828: sync 2024-09-21T11:39:32.630 INFO:tasks.workunit.client.0.smithi118.stdout:3/443: sync 2024-09-21T11:39:32.630 INFO:tasks.workunit.client.0.smithi118.stdout:4/507: sync 2024-09-21T11:39:32.637 INFO:tasks.workunit.client.0.smithi118.stdout:5/535: dwrite d0/f1b [0,4194304] 0 2024-09-21T11:39:32.638 INFO:tasks.workunit.client.0.smithi118.stdout:5/536: write d0/d6c/f8 [3148924,101375] 0 2024-09-21T11:39:32.640 INFO:tasks.workunit.client.0.smithi118.stdout:4/508: dread d2/d6/f20 [0,4194304] 0 2024-09-21T11:39:32.652 INFO:tasks.workunit.client.0.smithi118.stdout:0/829: rename d5/d29/d68/d7b/db7/d48/fa5 to d5/d81/f118 0 2024-09-21T11:39:32.653 INFO:tasks.workunit.client.0.smithi118.stdout:0/830: chown d5/d10/d1e/d20/dfe 14 1 2024-09-21T11:39:32.654 INFO:tasks.workunit.client.0.smithi118.stdout:0/831: stat d5/d10/d1e/d21/db3/dbe/dd7 0 2024-09-21T11:39:32.654 INFO:tasks.workunit.client.0.smithi118.stdout:7/545: getdents d0/d3/d13 0 2024-09-21T11:39:32.656 INFO:tasks.workunit.client.0.smithi118.stdout:3/444: link d5/d28/d3e/l72 d5/d28/d3e/d5d/la1 0 2024-09-21T11:39:32.657 INFO:tasks.workunit.client.0.smithi118.stdout:7/546: unlink d0/d3/d1d/l77 0 2024-09-21T11:39:32.659 INFO:tasks.workunit.client.0.smithi118.stdout:3/445: creat d5/d1d/d1b/d4c/d91/fa2 x:0 0 0 2024-09-21T11:39:32.660 INFO:tasks.workunit.client.0.smithi118.stdout:0/832: rename d5/d29/d53 to d5/d29/d119 0 2024-09-21T11:39:32.662 INFO:tasks.workunit.client.0.smithi118.stdout:7/547: rename d0/d3/d14/d41/d7f/d3e/d81/ca8 to d0/d3/d1d/d35/d57/cac 0 2024-09-21T11:39:32.662 INFO:tasks.workunit.client.0.smithi118.stdout:3/446: symlink d5/d1d/la3 0 2024-09-21T11:39:32.670 INFO:tasks.workunit.client.0.smithi118.stdout:6/479: dread d8/f8b [4194304,4194304] 0 2024-09-21T11:39:32.676 INFO:tasks.workunit.client.0.smithi118.stdout:4/509: dwrite d2/f8a [0,4194304] 0 2024-09-21T11:39:32.681 INFO:tasks.workunit.client.0.smithi118.stdout:4/510: mkdir d2/d65/d89/db0 0 2024-09-21T11:39:32.683 INFO:tasks.workunit.client.0.smithi118.stdout:0/833: write d5/d10/d1e/d21/fcf [1181436,113577] 0 2024-09-21T11:39:32.684 INFO:tasks.workunit.client.0.smithi118.stdout:6/480: dwrite d8/d48/d45/d61/d70/f87 [0,4194304] 0 2024-09-21T11:39:32.692 INFO:tasks.workunit.client.0.smithi118.stdout:7/548: dwrite d0/d3/f18 [4194304,4194304] 0 2024-09-21T11:39:32.694 INFO:tasks.workunit.client.0.smithi118.stdout:3/447: dwrite d5/d1d/d1b/d4c/f9e [0,4194304] 0 2024-09-21T11:39:32.697 INFO:tasks.workunit.client.0.smithi118.stdout:7/549: truncate d0/d3/d1d/f46 623993 0 2024-09-21T11:39:32.699 INFO:tasks.workunit.client.0.smithi118.stdout:0/834: write d5/d34/d44/f52 [1689409,33772] 0 2024-09-21T11:39:32.699 INFO:tasks.workunit.client.0.smithi118.stdout:3/448: write d5/d1d/f23 [1770060,104894] 0 2024-09-21T11:39:32.701 INFO:tasks.workunit.client.0.smithi118.stdout:7/550: creat d0/d3/d14/d41/da0/fad x:0 0 0 2024-09-21T11:39:32.702 INFO:tasks.workunit.client.0.smithi118.stdout:7/551: chown d0/d3/d14/d41/d66/d9d/fa6 11 1 2024-09-21T11:39:32.703 INFO:tasks.workunit.client.0.smithi118.stdout:3/449: creat d5/d1d/d1b/d4c/fa4 x:0 0 0 2024-09-21T11:39:32.705 INFO:tasks.workunit.client.0.smithi118.stdout:0/835: mknod d5/c11a 0 2024-09-21T11:39:32.706 INFO:tasks.workunit.client.0.smithi118.stdout:0/836: chown d5/d34/d44/ff6 380687 1 2024-09-21T11:39:32.710 INFO:tasks.workunit.client.0.smithi118.stdout:0/837: write d5/d10/d1e/d21/db3/dbe/fd0 [196048,93521] 0 2024-09-21T11:39:32.713 INFO:tasks.workunit.client.0.smithi118.stdout:0/838: truncate d5/d10/d1e/d23/f7d 516175 0 2024-09-21T11:39:32.715 INFO:tasks.workunit.client.0.smithi118.stdout:0/839: creat d5/d10/d1e/d20/f11b x:0 0 0 2024-09-21T11:39:32.716 INFO:tasks.workunit.client.0.smithi118.stdout:0/840: chown d5/d10/d1e/d3d/d93/fc6 168 1 2024-09-21T11:39:32.718 INFO:tasks.workunit.client.0.smithi118.stdout:7/552: dread d0/d3/d14/f65 [0,4194304] 0 2024-09-21T11:39:32.719 INFO:tasks.workunit.client.0.smithi118.stdout:0/841: link d5/l1a d5/d10/d1e/d21/db3/l11c 0 2024-09-21T11:39:32.724 INFO:tasks.workunit.client.0.smithi118.stdout:7/553: dwrite d0/d3/d13/d8f/f94 [0,4194304] 0 2024-09-21T11:39:32.724 INFO:tasks.workunit.client.0.smithi118.stdout:0/842: link d5/d34/l97 d5/d10/d1e/d21/db3/dbe/dd7/l11d 0 2024-09-21T11:39:32.726 INFO:tasks.workunit.client.0.smithi118.stdout:0/843: chown d5/le 52154 1 2024-09-21T11:39:32.728 INFO:tasks.workunit.client.0.smithi118.stdout:7/554: rename d0/d3/d1d/d35/f7a to d0/d3/d14/d41/d66/d9d/fae 0 2024-09-21T11:39:32.730 INFO:tasks.workunit.client.0.smithi118.stdout:0/844: rmdir d5/d29/d119 39 2024-09-21T11:39:32.735 INFO:tasks.workunit.client.0.smithi118.stdout:0/845: mkdir d5/d29/d68/d7b/db7/d48/d11e 0 2024-09-21T11:39:32.736 INFO:tasks.workunit.client.0.smithi118.stdout:3/450: dwrite d5/d1d/f43 [0,4194304] 0 2024-09-21T11:39:32.738 INFO:tasks.workunit.client.0.smithi118.stdout:7/555: dwrite d0/d3/d14/f32 [0,4194304] 0 2024-09-21T11:39:32.739 INFO:tasks.workunit.client.0.smithi118.stdout:3/451: symlink d5/d28/la5 0 2024-09-21T11:39:32.741 INFO:tasks.workunit.client.0.smithi118.stdout:3/452: write d5/d1d/f23 [981858,82374] 0 2024-09-21T11:39:32.746 INFO:tasks.workunit.client.0.smithi118.stdout:3/453: unlink d5/f30 0 2024-09-21T11:39:32.748 INFO:tasks.workunit.client.0.smithi118.stdout:7/556: truncate d0/d3/d1d/f46 426053 0 2024-09-21T11:39:32.753 INFO:tasks.workunit.client.0.smithi118.stdout:0/846: link d5/d10/d1e/f27 d5/d29/d68/d7b/db7/d48/f11f 0 2024-09-21T11:39:32.754 INFO:tasks.workunit.client.0.smithi118.stdout:7/557: dwrite d0/d3/d13/f2f [4194304,4194304] 0 2024-09-21T11:39:32.759 INFO:tasks.workunit.client.0.smithi118.stdout:3/454: fsync d5/d1d/d1b/d4b/f82 0 2024-09-21T11:39:32.762 INFO:tasks.workunit.client.0.smithi118.stdout:0/847: creat d5/d10/d1e/d21/db3/dbe/dd7/f120 x:0 0 0 2024-09-21T11:39:32.765 INFO:tasks.workunit.client.0.smithi118.stdout:3/455: mknod d5/d1d/ca6 0 2024-09-21T11:39:32.769 INFO:tasks.workunit.client.0.smithi118.stdout:7/558: dwrite d0/d3/d14/d41/d66/d9d/fae [0,4194304] 0 2024-09-21T11:39:32.783 INFO:tasks.workunit.client.0.smithi118.stdout:7/559: symlink d0/d3/d14/d41/d8b/da4/laf 0 2024-09-21T11:39:32.787 INFO:tasks.workunit.client.0.smithi118.stdout:0/848: getdents d5/d10/d1e/d23/d3a/d4e/dfc 0 2024-09-21T11:39:32.789 INFO:tasks.workunit.client.0.smithi118.stdout:3/456: getdents d5/d28/d33 0 2024-09-21T11:39:32.793 INFO:tasks.workunit.client.0.smithi118.stdout:7/560: symlink d0/d3/d29/d5f/lb0 0 2024-09-21T11:39:32.804 INFO:tasks.workunit.client.0.smithi118.stdout:3/457: write d5/d1d/d1b/d4b/f90 [189960,41418] 0 2024-09-21T11:39:32.805 INFO:tasks.workunit.client.0.smithi118.stdout:3/458: write d5/d28/f94 [69076,34701] 0 2024-09-21T11:39:32.811 INFO:tasks.workunit.client.0.smithi118.stdout:7/561: link d0/c1f d0/d3/d1d/d35/d57/d96/cb1 0 2024-09-21T11:39:32.811 INFO:tasks.workunit.client.0.smithi118.stdout:0/849: dwrite d5/d29/d119/f56 [0,4194304] 0 2024-09-21T11:39:32.813 INFO:tasks.workunit.client.0.smithi118.stdout:3/459: unlink d5/d1d/f49 0 2024-09-21T11:39:32.816 INFO:tasks.workunit.client.0.smithi118.stdout:7/562: truncate d0/d3/d14/f3c 226846 0 2024-09-21T11:39:32.817 INFO:tasks.workunit.client.0.smithi118.stdout:7/563: chown d0/d3/d1d/d35 9253840 1 2024-09-21T11:39:32.817 INFO:tasks.workunit.client.0.smithi118.stdout:7/564: readlink d0/d3/d14/l90 0 2024-09-21T11:39:32.820 INFO:tasks.workunit.client.0.smithi118.stdout:3/460: mkdir d5/d1d/d1b/da7 0 2024-09-21T11:39:32.825 INFO:tasks.workunit.client.0.smithi118.stdout:7/565: mkdir d0/d3/d14/d41/d8b/da4/db2 0 2024-09-21T11:39:32.826 INFO:tasks.workunit.client.0.smithi118.stdout:3/461: dread - d5/d1d/d1b/d4b/f96 zero size 2024-09-21T11:39:32.827 INFO:tasks.workunit.client.0.smithi118.stdout:0/850: dread d5/f11 [0,4194304] 0 2024-09-21T11:39:32.833 INFO:tasks.workunit.client.0.smithi118.stdout:3/462: creat d5/d28/d3e/fa8 x:0 0 0 2024-09-21T11:39:32.834 INFO:tasks.workunit.client.0.smithi118.stdout:7/566: dwrite d0/d3/d14/d41/f6f [0,4194304] 0 2024-09-21T11:39:32.836 INFO:tasks.workunit.client.0.smithi118.stdout:0/851: rename d5/d10/d1e/d23/d3a/d4e/dfc/f116 to d5/d10/d1e/d23/d3a/d4e/d9d/f121 0 2024-09-21T11:39:32.839 INFO:tasks.workunit.client.0.smithi118.stdout:7/567: read d0/d3/d14/f3c [143056,23179] 0 2024-09-21T11:39:32.840 INFO:tasks.workunit.client.0.smithi118.stdout:0/852: truncate d5/d34/d44/ff6 354396 0 2024-09-21T11:39:32.841 INFO:tasks.workunit.client.0.smithi118.stdout:7/568: truncate d0/d3/d13/f9a 4285 0 2024-09-21T11:39:32.841 INFO:tasks.workunit.client.0.smithi118.stdout:0/853: rmdir d5/d34/d44/d87/da4 39 2024-09-21T11:39:32.842 INFO:tasks.workunit.client.0.smithi118.stdout:7/569: readlink d0/d3/d29/d5f/lb0 0 2024-09-21T11:39:32.849 INFO:tasks.workunit.client.0.smithi118.stdout:7/570: link d0/f5 d0/d3/d14/d41/d7f/da2/fb3 0 2024-09-21T11:39:32.849 INFO:tasks.workunit.client.0.smithi118.stdout:3/463: dwrite d5/d1d/d1b/d24/f5b [0,4194304] 0 2024-09-21T11:39:32.855 INFO:tasks.workunit.client.0.smithi118.stdout:3/464: mknod d5/d28/d3e/d5d/d5f/ca9 0 2024-09-21T11:39:32.857 INFO:tasks.workunit.client.0.smithi118.stdout:7/571: dwrite d0/f2a [0,4194304] 0 2024-09-21T11:39:32.864 INFO:tasks.workunit.client.0.smithi118.stdout:0/854: dwrite d5/d10/d1e/d23/d3a/d4e/d9d/fa7 [0,4194304] 0 2024-09-21T11:39:32.869 INFO:tasks.workunit.client.0.smithi118.stdout:7/572: dwrite d0/d3/d1d/f9f [0,4194304] 0 2024-09-21T11:39:32.872 INFO:tasks.workunit.client.0.smithi118.stdout:7/573: mknod d0/d3/d1d/d35/cb4 0 2024-09-21T11:39:32.874 INFO:tasks.workunit.client.0.smithi118.stdout:3/465: write d5/d1d/d1b/d4b/f96 [788226,31754] 0 2024-09-21T11:39:32.874 INFO:tasks.workunit.client.0.smithi118.stdout:7/574: fsync d0/d3/d1d/d35/d57/d7e/fa5 0 2024-09-21T11:39:32.876 INFO:tasks.workunit.client.0.smithi118.stdout:3/466: chown d5/d28/d3e/d5d/d5f/d88/f9c 29 1 2024-09-21T11:39:32.878 INFO:tasks.workunit.client.0.smithi118.stdout:7/575: rename d0/d3/d13/l98 to d0/d3/d1d/d35/d57/d96/lb5 0 2024-09-21T11:39:32.882 INFO:tasks.workunit.client.0.smithi118.stdout:3/467: write d5/f7e [45703,12461] 0 2024-09-21T11:39:32.884 INFO:tasks.workunit.client.0.smithi118.stdout:3/468: mkdir d5/d28/d3e/daa 0 2024-09-21T11:39:32.887 INFO:tasks.workunit.client.0.smithi118.stdout:3/469: creat d5/d28/d33/fab x:0 0 0 2024-09-21T11:39:32.900 INFO:tasks.workunit.client.0.smithi118.stdout:3/470: write d5/d28/d3e/d5d/d5f/f6d [236323,108492] 0 2024-09-21T11:39:32.902 INFO:tasks.workunit.client.0.smithi118.stdout:3/471: symlink d5/d28/d3e/d5d/d5f/lac 0 2024-09-21T11:39:32.904 INFO:tasks.workunit.client.0.smithi118.stdout:3/472: symlink d5/d1d/d1b/d4b/lad 0 2024-09-21T11:39:32.905 INFO:tasks.workunit.client.0.smithi118.stdout:3/473: chown d5/d1d/la3 52176015 1 2024-09-21T11:39:32.906 INFO:tasks.workunit.client.0.smithi118.stdout:7/576: dread d0/d3/f5e [0,4194304] 0 2024-09-21T11:39:32.906 INFO:tasks.workunit.client.0.smithi118.stdout:3/474: dread d5/f7e [0,4194304] 0 2024-09-21T11:39:32.908 INFO:tasks.workunit.client.0.smithi118.stdout:3/475: write d5/d1d/f43 [2009062,40022] 0 2024-09-21T11:39:32.912 INFO:tasks.workunit.client.0.smithi118.stdout:3/476: symlink d5/d1d/d1b/d4c/d73/d9b/lae 0 2024-09-21T11:39:32.914 INFO:tasks.workunit.client.0.smithi118.stdout:7/577: dwrite d0/d3/d14/fa9 [0,4194304] 0 2024-09-21T11:39:32.916 INFO:tasks.workunit.client.0.smithi118.stdout:3/477: dread - d5/d28/d3e/d5d/f8a zero size 2024-09-21T11:39:32.917 INFO:tasks.workunit.client.0.smithi118.stdout:3/478: write d5/d1d/d1b/d24/f60 [53138,103452] 0 2024-09-21T11:39:32.920 INFO:tasks.workunit.client.0.smithi118.stdout:7/578: mkdir d0/d3/d14/d41/d7f/d3e/d81/db6 0 2024-09-21T11:39:32.921 INFO:tasks.workunit.client.0.smithi118.stdout:9/544: sync 2024-09-21T11:39:32.921 INFO:tasks.workunit.client.0.smithi118.stdout:2/454: sync 2024-09-21T11:39:32.921 INFO:tasks.workunit.client.0.smithi118.stdout:1/560: sync 2024-09-21T11:39:32.921 INFO:tasks.workunit.client.0.smithi118.stdout:8/896: sync 2024-09-21T11:39:32.921 INFO:tasks.workunit.client.0.smithi118.stdout:2/455: chown de/d16 14120 1 2024-09-21T11:39:32.922 INFO:tasks.workunit.client.0.smithi118.stdout:3/479: dread - d5/f57 zero size 2024-09-21T11:39:32.922 INFO:tasks.workunit.client.0.smithi118.stdout:8/897: fsync d2/dc/d35/fef 0 2024-09-21T11:39:32.923 INFO:tasks.workunit.client.0.smithi118.stdout:2/456: chown de/d50/d85/c95 66577834 1 2024-09-21T11:39:32.925 INFO:tasks.workunit.client.0.smithi118.stdout:7/579: mknod d0/d3/d14/d41/d66/d6d/cb7 0 2024-09-21T11:39:32.929 INFO:tasks.workunit.client.0.smithi118.stdout:1/561: dread d6/d2a/f69 [0,4194304] 0 2024-09-21T11:39:32.931 INFO:tasks.workunit.client.0.smithi118.stdout:2/457: unlink de/d16/d1c/d4f/d5b/f61 0 2024-09-21T11:39:32.932 INFO:tasks.workunit.client.0.smithi118.stdout:7/580: creat d0/d3/d14/d41/d7f/da2/fb8 x:0 0 0 2024-09-21T11:39:32.933 INFO:tasks.workunit.client.0.smithi118.stdout:3/480: mkdir d5/d1d/d1b/da7/daf 0 2024-09-21T11:39:32.935 INFO:tasks.workunit.client.0.smithi118.stdout:1/562: symlink d6/de/d13/d84/d96/lb0 0 2024-09-21T11:39:32.936 INFO:tasks.workunit.client.0.smithi118.stdout:8/898: dread d2/dc/d35/fef [0,4194304] 0 2024-09-21T11:39:32.936 INFO:tasks.workunit.client.0.smithi118.stdout:7/581: rename d0/d3/d1d/d35/f61 to d0/d3/d14/fb9 0 2024-09-21T11:39:32.937 INFO:tasks.workunit.client.0.smithi118.stdout:3/481: truncate f0 2252083 0 2024-09-21T11:39:32.943 INFO:tasks.workunit.client.0.smithi118.stdout:7/582: rename d0/d3/la to d0/d3/d13/lba 0 2024-09-21T11:39:32.945 INFO:tasks.workunit.client.0.smithi118.stdout:1/563: dwrite d6/d3b/f43 [0,4194304] 0 2024-09-21T11:39:32.945 INFO:tasks.workunit.client.0.smithi118.stdout:3/482: mknod d5/d1d/d1b/d4c/d91/d69/cb0 0 2024-09-21T11:39:32.948 INFO:tasks.workunit.client.0.smithi118.stdout:2/458: dread de/d1f/d20/f55 [0,4194304] 0 2024-09-21T11:39:32.948 INFO:tasks.workunit.client.0.smithi118.stdout:9/545: dread d0/f76 [0,4194304] 0 2024-09-21T11:39:32.948 INFO:tasks.workunit.client.0.smithi118.stdout:9/546: chown d0/d4 7 1 2024-09-21T11:39:32.948 INFO:tasks.workunit.client.0.smithi118.stdout:1/564: chown d6/de/d16/d3f/d50/d54/d32/f48 36 1 2024-09-21T11:39:32.960 INFO:tasks.workunit.client.0.smithi118.stdout:2/459: dread de/d1f/d20/f27 [0,4194304] 0 2024-09-21T11:39:32.963 INFO:tasks.workunit.client.0.smithi118.stdout:3/483: mknod d5/d1d/d8c/cb1 0 2024-09-21T11:39:32.964 INFO:tasks.workunit.client.0.smithi118.stdout:2/460: readlink de/l13 0 2024-09-21T11:39:32.964 INFO:tasks.workunit.client.0.smithi118.stdout:2/461: stat de/d50/d85 0 2024-09-21T11:39:32.965 INFO:tasks.workunit.client.0.smithi118.stdout:8/899: truncate d2/dc/d10/d2e/d18/f4f 1871976 0 2024-09-21T11:39:32.969 INFO:tasks.workunit.client.0.smithi118.stdout:9/547: rmdir d0/d20/d4c/d5f/d6c/da7 0 2024-09-21T11:39:32.972 INFO:tasks.workunit.client.0.smithi118.stdout:8/900: symlink d2/dc/d35/d42/l136 0 2024-09-21T11:39:32.973 INFO:tasks.workunit.client.0.smithi118.stdout:7/583: dread d0/f16 [0,4194304] 0 2024-09-21T11:39:32.976 INFO:tasks.workunit.client.0.smithi118.stdout:9/548: fsync d0/d4/d45/d72/f94 0 2024-09-21T11:39:32.978 INFO:tasks.workunit.client.0.smithi118.stdout:3/484: dwrite d5/d1d/d1b/d4c/d91/f7b [0,4194304] 0 2024-09-21T11:39:32.979 INFO:tasks.workunit.client.0.smithi118.stdout:8/901: unlink d2/d7c/d88/d8f/c9e 0 2024-09-21T11:39:32.980 INFO:tasks.workunit.client.0.smithi118.stdout:8/902: dread - d2/dc/d10/d2e/f134 zero size 2024-09-21T11:39:32.982 INFO:tasks.workunit.client.0.smithi118.stdout:2/462: truncate de/d22/d3c/f47 4001644 0 2024-09-21T11:39:32.987 INFO:tasks.workunit.client.0.smithi118.stdout:3/485: creat d5/d28/d3e/d5d/d5f/fb2 x:0 0 0 2024-09-21T11:39:32.988 INFO:tasks.workunit.client.0.smithi118.stdout:7/584: symlink d0/d3/d14/d41/lbb 0 2024-09-21T11:39:32.990 INFO:tasks.workunit.client.0.smithi118.stdout:3/486: dread - d5/d1d/d1b/d4c/fa4 zero size 2024-09-21T11:39:32.990 INFO:tasks.workunit.client.0.smithi118.stdout:9/549: dwrite d0/d20/f64 [0,4194304] 0 2024-09-21T11:39:32.990 INFO:tasks.workunit.client.0.smithi118.stdout:8/903: creat d2/d73/f137 x:0 0 0 2024-09-21T11:39:32.992 INFO:tasks.workunit.client.0.smithi118.stdout:8/904: chown d2/d73/f92 54826598 1 2024-09-21T11:39:32.993 INFO:tasks.workunit.client.0.smithi118.stdout:8/905: stat d2/dc/d49/df1 0 2024-09-21T11:39:32.994 INFO:tasks.workunit.client.0.smithi118.stdout:9/550: fsync d0/f76 0 2024-09-21T11:39:32.995 INFO:tasks.workunit.client.0.smithi118.stdout:8/906: readlink d2/dc/d35/lfa 0 2024-09-21T11:39:32.997 INFO:tasks.workunit.client.0.smithi118.stdout:3/487: creat d5/d1d/d1b/d4b/fb3 x:0 0 0 2024-09-21T11:39:33.003 INFO:tasks.workunit.client.0.smithi118.stdout:2/463: dread f8 [0,4194304] 0 2024-09-21T11:39:33.013 INFO:tasks.workunit.client.0.smithi118.stdout:2/464: symlink de/d16/d1c/l9f 0 2024-09-21T11:39:33.015 INFO:tasks.workunit.client.0.smithi118.stdout:2/465: dread de/d22/d3c/f8e [0,4194304] 0 2024-09-21T11:39:33.017 INFO:tasks.workunit.client.0.smithi118.stdout:3/488: getdents d5/d1d/d1b/d24 0 2024-09-21T11:39:33.018 INFO:tasks.workunit.client.0.smithi118.stdout:8/907: write d2/dc/d49/fb5 [6493666,71935] 0 2024-09-21T11:39:33.019 INFO:tasks.workunit.client.0.smithi118.stdout:7/585: link d0/d3/d14/d41/d8b/da4/laf d0/d3/d1d/d35/d57/d96/d9e/lbc 0 2024-09-21T11:39:33.020 INFO:tasks.workunit.client.0.smithi118.stdout:7/586: write d0/d3/d13/d8f/fa7 [969205,123843] 0 2024-09-21T11:39:33.027 INFO:tasks.workunit.client.0.smithi118.stdout:2/466: symlink de/d16/d1c/d66/d9a/la0 0 2024-09-21T11:39:33.028 INFO:tasks.workunit.client.0.smithi118.stdout:9/551: truncate d0/d20/d71/f95 1635051 0 2024-09-21T11:39:33.028 INFO:tasks.workunit.client.0.smithi118.stdout:2/467: chown de/d1f/d4a/d9b 251652239 1 2024-09-21T11:39:33.030 INFO:tasks.workunit.client.0.smithi118.stdout:2/468: dread - de/d16/d1c/d66/f87 zero size 2024-09-21T11:39:33.031 INFO:tasks.workunit.client.0.smithi118.stdout:9/552: mknod d0/d20/d4c/d5f/d6c/cc6 0 2024-09-21T11:39:33.033 INFO:tasks.workunit.client.0.smithi118.stdout:3/489: dread d5/d28/f2b [0,4194304] 0 2024-09-21T11:39:33.034 INFO:tasks.workunit.client.0.smithi118.stdout:7/587: rename d0/d3/d1d/d35/d57/d96/lb5 to d0/d3/d1d/d35/d57/d7e/d82/lbd 0 2024-09-21T11:39:33.035 INFO:tasks.workunit.client.0.smithi118.stdout:8/908: link d2/dc/d10/d2e/d9b/fe9 d2/dc/d16/d46/f138 0 2024-09-21T11:39:33.038 INFO:tasks.workunit.client.0.smithi118.stdout:9/553: creat d0/d20/d4c/d5f/d6c/d88/d4d/fc7 x:0 0 0 2024-09-21T11:39:33.039 INFO:tasks.workunit.client.0.smithi118.stdout:3/490: symlink d5/d1d/d1b/d4c/d91/lb4 0 2024-09-21T11:39:33.041 INFO:tasks.workunit.client.0.smithi118.stdout:8/909: readlink d2/dc/d10/d2e/dba/lc6 0 2024-09-21T11:39:33.043 INFO:tasks.workunit.client.0.smithi118.stdout:2/469: dwrite de/d1f/d20/d67/f9e [0,4194304] 0 2024-09-21T11:39:33.045 INFO:tasks.workunit.client.0.smithi118.stdout:9/554: symlink d0/d4/d45/lc8 0 2024-09-21T11:39:33.046 INFO:tasks.workunit.client.0.smithi118.stdout:9/555: chown d0/d20/f6b 7953283 1 2024-09-21T11:39:33.047 INFO:tasks.workunit.client.0.smithi118.stdout:9/556: stat d0/d20/d4c/d5f/d6c/d88/f32 0 2024-09-21T11:39:33.053 INFO:tasks.workunit.client.0.smithi118.stdout:8/910: unlink d2/dc/d10/dd3/f107 0 2024-09-21T11:39:33.058 INFO:tasks.workunit.client.0.smithi118.stdout:9/557: mknod d0/d20/d4c/d5f/d6c/d88/db9/d7c/cc9 0 2024-09-21T11:39:33.060 INFO:tasks.workunit.client.0.smithi118.stdout:7/588: write d0/d3/d1d/d35/f59 [5209106,81402] 0 2024-09-21T11:39:33.062 INFO:tasks.workunit.client.0.smithi118.stdout:8/911: readlink d2/d73/l111 0 2024-09-21T11:39:33.074 INFO:tasks.workunit.client.0.smithi118.stdout:8/912: dwrite d2/dc/d10/d2e/f117 [0,4194304] 0 2024-09-21T11:39:33.075 INFO:tasks.workunit.client.0.smithi118.stdout:7/589: rename d0/d3/d14/d41/c86 to d0/d3/d14/d41/d66/d9d/cbe 0 2024-09-21T11:39:33.076 INFO:tasks.workunit.client.0.smithi118.stdout:3/491: dwrite d5/d1d/d1b/d4c/f6e [0,4194304] 0 2024-09-21T11:39:33.081 INFO:tasks.workunit.client.0.smithi118.stdout:2/470: dread de/d22/d3c/f47 [0,4194304] 0 2024-09-21T11:39:33.081 INFO:tasks.workunit.client.0.smithi118.stdout:8/913: chown d2/dc/d10/d6a/ccb 2510 1 2024-09-21T11:39:33.081 INFO:tasks.workunit.client.0.smithi118.stdout:9/558: dwrite d0/f13 [0,4194304] 0 2024-09-21T11:39:33.086 INFO:tasks.workunit.client.0.smithi118.stdout:8/914: chown d2/dc/d10/d2e/d18/d83 141847603 1 2024-09-21T11:39:33.088 INFO:tasks.workunit.client.0.smithi118.stdout:2/471: truncate de/d16/d31/f7c 4383879 0 2024-09-21T11:39:33.089 INFO:tasks.workunit.client.0.smithi118.stdout:8/915: fdatasync d2/dc/d16/d46/f10c 0 2024-09-21T11:39:33.090 INFO:tasks.workunit.client.0.smithi118.stdout:7/590: dread d0/d3/d14/f32 [0,4194304] 0 2024-09-21T11:39:33.093 INFO:tasks.workunit.client.0.smithi118.stdout:9/559: mkdir d0/d20/d4c/d5f/d6c/d88/d4d/dca 0 2024-09-21T11:39:33.093 INFO:tasks.workunit.client.0.smithi118.stdout:8/916: write d2/dc/d10/d2e/dba/f116 [567958,5698] 0 2024-09-21T11:39:33.095 INFO:tasks.workunit.client.0.smithi118.stdout:3/492: creat d5/d1d/d1b/d4c/d73/fb5 x:0 0 0 2024-09-21T11:39:33.096 INFO:tasks.workunit.client.0.smithi118.stdout:8/917: read d2/dc/d49/fb5 [291080,50090] 0 2024-09-21T11:39:33.097 INFO:tasks.workunit.client.0.smithi118.stdout:3/493: write d5/d1d/d1b/d4b/f96 [380176,106102] 0 2024-09-21T11:39:33.098 INFO:tasks.workunit.client.0.smithi118.stdout:2/472: write de/d1f/d20/f97 [9914111,85900] 0 2024-09-21T11:39:33.102 INFO:tasks.workunit.client.0.smithi118.stdout:2/473: symlink de/d16/d31/d7a/la1 0 2024-09-21T11:39:33.104 INFO:tasks.workunit.client.0.smithi118.stdout:9/560: creat d0/d20/d4c/d5f/d6c/d88/d4d/dca/fcb x:0 0 0 2024-09-21T11:39:33.105 INFO:tasks.workunit.client.0.smithi118.stdout:7/591: creat d0/d3/d14/d41/fbf x:0 0 0 2024-09-21T11:39:33.108 INFO:tasks.workunit.client.0.smithi118.stdout:9/561: chown d0/d20/d4c/d5f/d6c/d88/db9/d7c/db2/lc4 6 1 2024-09-21T11:39:33.109 INFO:tasks.workunit.client.0.smithi118.stdout:8/918: dwrite d2/dc/d16/d46/fce [4194304,4194304] 0 2024-09-21T11:39:33.110 INFO:tasks.workunit.client.0.smithi118.stdout:8/919: fsync d2/dc/d16/d46/dca/d127/f135 0 2024-09-21T11:39:33.117 INFO:tasks.workunit.client.0.smithi118.stdout:8/920: truncate d2/dc/d10/d3b/f6d 3360118 0 2024-09-21T11:39:33.118 INFO:tasks.workunit.client.0.smithi118.stdout:9/562: truncate d0/fb1 653857 0 2024-09-21T11:39:33.119 INFO:tasks.workunit.client.0.smithi118.stdout:7/592: dwrite d0/d3/d14/d41/d7f/f8a [0,4194304] 0 2024-09-21T11:39:33.121 INFO:tasks.workunit.client.0.smithi118.stdout:9/563: chown d0/d20/d71/f95 0 1 2024-09-21T11:39:33.123 INFO:tasks.workunit.client.0.smithi118.stdout:7/593: stat d0/d3/c36 0 2024-09-21T11:39:33.123 INFO:tasks.workunit.client.0.smithi118.stdout:9/564: chown d0/d20/d4c/d5f/d6c 13 1 2024-09-21T11:39:33.123 INFO:tasks.workunit.client.0.smithi118.stdout:8/921: dread d2/dc/d10/d2e/fbf [0,4194304] 0 2024-09-21T11:39:33.125 INFO:tasks.workunit.client.0.smithi118.stdout:2/474: dread de/f2a [0,4194304] 0 2024-09-21T11:39:33.127 INFO:tasks.workunit.client.0.smithi118.stdout:2/475: fsync de/d1f/d20/d67/d8a/d6d/d70/f93 0 2024-09-21T11:39:33.129 INFO:tasks.workunit.client.0.smithi118.stdout:2/476: chown de/d16/d31/f3d 462 1 2024-09-21T11:39:33.130 INFO:tasks.workunit.client.0.smithi118.stdout:9/565: creat d0/d20/d4c/d5f/d66/fcc x:0 0 0 2024-09-21T11:39:33.134 INFO:tasks.workunit.client.0.smithi118.stdout:8/922: fsync d2/dc/d49/fb5 0 2024-09-21T11:39:33.136 INFO:tasks.workunit.client.0.smithi118.stdout:7/594: symlink d0/d3/d29/lc0 0 2024-09-21T11:39:33.139 INFO:tasks.workunit.client.0.smithi118.stdout:2/477: rename de/d1f/d4a to de/d16/d1c/d65/da2 0 2024-09-21T11:39:33.140 INFO:tasks.workunit.client.0.smithi118.stdout:2/478: readlink de/d16/d1c/l4d 0 2024-09-21T11:39:33.140 INFO:tasks.workunit.client.0.smithi118.stdout:9/566: creat d0/d20/d4c/d5f/d6c/d88/db9/d7c/fcd x:0 0 0 2024-09-21T11:39:33.146 INFO:tasks.workunit.client.0.smithi118.stdout:2/479: creat de/d16/d1c/d66/d9a/fa3 x:0 0 0 2024-09-21T11:39:33.148 INFO:tasks.workunit.client.0.smithi118.stdout:9/567: rename d0/d20/d4c/c54 to d0/d20/d4c/d5f/d6c/d88/d4d/dca/cce 0 2024-09-21T11:39:33.151 INFO:tasks.workunit.client.0.smithi118.stdout:2/480: creat de/d16/d1c/d65/fa4 x:0 0 0 2024-09-21T11:39:33.152 INFO:tasks.workunit.client.0.smithi118.stdout:7/595: creat d0/d3/fc1 x:0 0 0 2024-09-21T11:39:33.154 INFO:tasks.workunit.client.0.smithi118.stdout:2/481: creat de/d1f/d20/d67/d8a/fa5 x:0 0 0 2024-09-21T11:39:33.155 INFO:tasks.workunit.client.0.smithi118.stdout:7/596: symlink d0/d3/d29/d5f/lc2 0 2024-09-21T11:39:33.157 INFO:tasks.workunit.client.0.smithi118.stdout:9/568: rename d0/l12 to d0/d4/d45/da5/lcf 0 2024-09-21T11:39:33.158 INFO:tasks.workunit.client.0.smithi118.stdout:8/923: dread d2/dc/f26 [0,4194304] 0 2024-09-21T11:39:33.162 INFO:tasks.workunit.client.0.smithi118.stdout:7/597: link d0/d3/f18 d0/d3/d1d/d35/d57/d7e/fc3 0 2024-09-21T11:39:33.163 INFO:tasks.workunit.client.0.smithi118.stdout:8/924: truncate d2/d7c/d88/d8f/daa/ff4 175473 0 2024-09-21T11:39:33.165 INFO:tasks.workunit.client.0.smithi118.stdout:8/925: fsync d2/dc/d16/d46/d4c/db0/fcf 0 2024-09-21T11:39:33.166 INFO:tasks.workunit.client.0.smithi118.stdout:7/598: link d0/d3/d1d/d35/f59 d0/d3/d1d/d35/fc4 0 2024-09-21T11:39:33.169 INFO:tasks.workunit.client.0.smithi118.stdout:8/926: readlink d2/dc/d10/d2e/d18/l4e 0 2024-09-21T11:39:33.172 INFO:tasks.workunit.client.0.smithi118.stdout:2/482: write de/f12 [444199,77497] 0 2024-09-21T11:39:33.174 INFO:tasks.workunit.client.0.smithi118.stdout:7/599: unlink d0/d3/d14/d41/d7f/d3e/c6a 0 2024-09-21T11:39:33.179 INFO:tasks.workunit.client.0.smithi118.stdout:2/483: creat de/d16/d1c/d4f/d5b/fa6 x:0 0 0 2024-09-21T11:39:33.181 INFO:tasks.workunit.client.0.smithi118.stdout:7/600: mknod d0/d3/d14/d41/d7f/da2/cc5 0 2024-09-21T11:39:33.182 INFO:tasks.workunit.client.0.smithi118.stdout:7/601: chown d0/d3/d1d/d35/d57/d7e/fa5 1 1 2024-09-21T11:39:33.183 INFO:tasks.workunit.client.0.smithi118.stdout:9/569: mkdir d0/d20/d4c/d5f/d6c/dd0 0 2024-09-21T11:39:33.183 INFO:tasks.workunit.client.0.smithi118.stdout:8/927: dread d2/dc/d10/d2e/d9b/f113 [0,4194304] 0 2024-09-21T11:39:33.185 INFO:tasks.workunit.client.0.smithi118.stdout:2/484: truncate f8 2428249 0 2024-09-21T11:39:33.185 INFO:tasks.workunit.client.0.smithi118.stdout:7/602: mknod d0/d3/d1d/d35/cc6 0 2024-09-21T11:39:33.187 INFO:tasks.workunit.client.0.smithi118.stdout:9/570: truncate d0/d20/d4c/d5f/d6c/d88/d4d/dca/fcb 148254 0 2024-09-21T11:39:33.187 INFO:tasks.workunit.client.0.smithi118.stdout:2/485: mknod de/d16/ca7 0 2024-09-21T11:39:33.188 INFO:tasks.workunit.client.0.smithi118.stdout:2/486: write de/f12 [1684451,53886] 0 2024-09-21T11:39:33.189 INFO:tasks.workunit.client.0.smithi118.stdout:8/928: creat d2/dc/d49/df1/f139 x:0 0 0 2024-09-21T11:39:33.190 INFO:tasks.workunit.client.0.smithi118.stdout:8/929: chown d2/dc/d35/dab/fcd 0 1 2024-09-21T11:39:33.190 INFO:tasks.workunit.client.0.smithi118.stdout:7/603: creat d0/d3/d13/d8f/fc7 x:0 0 0 2024-09-21T11:39:33.193 INFO:tasks.workunit.client.0.smithi118.stdout:7/604: rmdir d0/d3/d14/d41/d66/d9d 39 2024-09-21T11:39:33.194 INFO:tasks.workunit.client.0.smithi118.stdout:7/605: chown d0/d3/d14/d41/d7f 13616 1 2024-09-21T11:39:33.195 INFO:tasks.workunit.client.0.smithi118.stdout:9/571: rename d0/d4/f18 to d0/d20/d4c/d5f/d6c/d88/db9/fd1 0 2024-09-21T11:39:33.198 INFO:tasks.workunit.client.0.smithi118.stdout:8/930: dwrite d2/dc/d16/d46/dca/d127/f135 [0,4194304] 0 2024-09-21T11:39:33.199 INFO:tasks.workunit.client.0.smithi118.stdout:7/606: truncate d0/d3/d13/d8f/fc7 610981 0 2024-09-21T11:39:33.200 INFO:tasks.workunit.client.0.smithi118.stdout:9/572: mkdir d0/d4/d38/db8/dd2 0 2024-09-21T11:39:33.205 INFO:tasks.workunit.client.0.smithi118.stdout:2/487: dread de/d16/d31/f3d [0,4194304] 0 2024-09-21T11:39:33.214 INFO:tasks.workunit.client.0.smithi118.stdout:2/488: unlink de/d1f/d20/d67/d8a/fa5 0 2024-09-21T11:39:33.218 INFO:tasks.workunit.client.0.smithi118.stdout:7/607: creat d0/d3/d29/fc8 x:0 0 0 2024-09-21T11:39:33.222 INFO:tasks.workunit.client.0.smithi118.stdout:7/608: creat d0/d3/d14/fc9 x:0 0 0 2024-09-21T11:39:33.224 INFO:tasks.workunit.client.0.smithi118.stdout:8/931: write d2/dc/d10/d3b/f6d [4015285,118283] 0 2024-09-21T11:39:33.228 INFO:tasks.workunit.client.0.smithi118.stdout:7/609: dread d0/d3/f5e [0,4194304] 0 2024-09-21T11:39:33.228 INFO:tasks.workunit.client.0.smithi118.stdout:9/573: dwrite d0/d4/d45/f48 [0,4194304] 0 2024-09-21T11:39:33.230 INFO:tasks.workunit.client.0.smithi118.stdout:2/489: dread de/f14 [4194304,4194304] 0 2024-09-21T11:39:33.232 INFO:tasks.workunit.client.0.smithi118.stdout:8/932: rename d2/dc/d10/d2e/dba/fc5 to d2/dc/d16/f13a 0 2024-09-21T11:39:33.234 INFO:tasks.workunit.client.0.smithi118.stdout:9/574: truncate d0/d20/d4c/d5f/d6c/d88/d4d/dca/fcb 1106913 0 2024-09-21T11:39:33.237 INFO:tasks.workunit.client.0.smithi118.stdout:8/933: readlink d2/dc/d10/d2e/d18/lf5 0 2024-09-21T11:39:33.237 INFO:tasks.workunit.client.0.smithi118.stdout:2/490: readlink de/d16/d1c/l36 0 2024-09-21T11:39:33.238 INFO:tasks.workunit.client.0.smithi118.stdout:7/610: dwrite d0/d3/d14/d41/d7f/d3e/d81/f83 [0,4194304] 0 2024-09-21T11:39:33.245 INFO:tasks.workunit.client.0.smithi118.stdout:8/934: dwrite d2/dc/d16/d46/d4c/db0/fcf [0,4194304] 0 2024-09-21T11:39:33.262 INFO:tasks.workunit.client.0.smithi118.stdout:2/491: getdents de/d16/d31 0 2024-09-21T11:39:33.266 INFO:tasks.workunit.client.0.smithi118.stdout:9/575: dwrite d0/d4/d38/f46 [0,4194304] 0 2024-09-21T11:39:33.266 INFO:tasks.workunit.client.0.smithi118.stdout:2/492: fdatasync de/d1f/d20/f77 0 2024-09-21T11:39:33.268 INFO:tasks.workunit.client.0.smithi118.stdout:2/493: write de/d53/f8d [284110,71246] 0 2024-09-21T11:39:33.270 INFO:tasks.workunit.client.0.smithi118.stdout:8/935: dread d2/dc/d49/f77 [0,4194304] 0 2024-09-21T11:39:33.271 INFO:tasks.workunit.client.0.smithi118.stdout:7/611: write d0/d3/d1d/d35/f5a [353633,76749] 0 2024-09-21T11:39:33.277 INFO:tasks.workunit.client.0.smithi118.stdout:2/494: creat de/d16/d1c/d65/fa8 x:0 0 0 2024-09-21T11:39:33.278 INFO:tasks.workunit.client.0.smithi118.stdout:2/495: chown de/d51/f5c 470 1 2024-09-21T11:39:33.280 INFO:tasks.workunit.client.0.smithi118.stdout:7/612: creat d0/d3/d13/fca x:0 0 0 2024-09-21T11:39:33.281 INFO:tasks.workunit.client.0.smithi118.stdout:8/936: rename d2/dc/d16/d46/d4c/d63/ff3 to d2/dc/d10/d2e/d9b/dcc/f13b 0 2024-09-21T11:39:33.282 INFO:tasks.workunit.client.0.smithi118.stdout:8/937: chown d2/dc/d49/d84/d99/cea 82 1 2024-09-21T11:39:33.282 INFO:tasks.workunit.client.0.smithi118.stdout:9/576: creat d0/fd3 x:0 0 0 2024-09-21T11:39:33.285 INFO:tasks.workunit.client.0.smithi118.stdout:7/613: truncate d0/d3/d29/d47/f84 1168089 0 2024-09-21T11:39:33.291 INFO:tasks.workunit.client.0.smithi118.stdout:8/938: unlink d2/dc/d10/d2e/l12 0 2024-09-21T11:39:33.292 INFO:tasks.workunit.client.0.smithi118.stdout:7/614: readlink d0/d3/d1d/d35/d57/d7e/d82/lbd 0 2024-09-21T11:39:33.294 INFO:tasks.workunit.client.0.smithi118.stdout:7/615: truncate d0/d3/d1d/f7d 2167027 0 2024-09-21T11:39:33.294 INFO:tasks.workunit.client.0.smithi118.stdout:9/577: mknod d0/d20/d4c/d5f/d6c/d88/db9/d7c/cd4 0 2024-09-21T11:39:33.295 INFO:tasks.workunit.client.0.smithi118.stdout:7/616: stat d0/d3/d14/d41/d66/f8e 0 2024-09-21T11:39:33.295 INFO:tasks.workunit.client.0.smithi118.stdout:8/939: truncate d2/dc/d10/d2e/d18/d1a/f1f 2456396 0 2024-09-21T11:39:33.296 INFO:tasks.workunit.client.0.smithi118.stdout:2/496: getdents de/d50 0 2024-09-21T11:39:33.297 INFO:tasks.workunit.client.0.smithi118.stdout:2/497: fdatasync de/d1f/d20/d67/d8a/d6d/d70/f90 0 2024-09-21T11:39:33.298 INFO:tasks.workunit.client.0.smithi118.stdout:2/498: dread - de/d16/d1c/d66/d9a/fa3 zero size 2024-09-21T11:39:33.307 INFO:tasks.workunit.client.0.smithi118.stdout:9/578: write d0/d4/d45/d72/f94 [869394,60908] 0 2024-09-21T11:39:33.308 INFO:tasks.workunit.client.0.smithi118.stdout:8/940: truncate d2/d32/fe4 164449 0 2024-09-21T11:39:33.313 INFO:tasks.workunit.client.0.smithi118.stdout:9/579: fdatasync d0/d4/d45/f75 0 2024-09-21T11:39:33.315 INFO:tasks.workunit.client.0.smithi118.stdout:8/941: creat d2/dc/d16/d46/d4c/d63/d10b/f13c x:0 0 0 2024-09-21T11:39:33.316 INFO:tasks.workunit.client.0.smithi118.stdout:7/617: truncate d0/d3/d29/d47/f84 1335585 0 2024-09-21T11:39:33.322 INFO:tasks.workunit.client.0.smithi118.stdout:9/580: symlink d0/d20/d4c/d5f/d89/ld5 0 2024-09-21T11:39:33.324 INFO:tasks.workunit.client.0.smithi118.stdout:8/942: unlink d2/d7c/d88/cc9 0 2024-09-21T11:39:33.326 INFO:tasks.workunit.client.0.smithi118.stdout:9/581: chown d0/f2c 131896369 1 2024-09-21T11:39:33.327 INFO:tasks.workunit.client.0.smithi118.stdout:9/582: write d0/d4/d45/d72/f94 [1914055,96356] 0 2024-09-21T11:39:33.328 INFO:tasks.workunit.client.0.smithi118.stdout:7/618: link d0/d3/d1d/d35/f5a d0/d3/d1d/d35/d57/d7e/d82/fcb 0 2024-09-21T11:39:33.329 INFO:tasks.workunit.client.0.smithi118.stdout:8/943: unlink d2/dc/d10/d2e/d9b/lf6 0 2024-09-21T11:39:33.331 INFO:tasks.workunit.client.0.smithi118.stdout:9/583: mkdir d0/d4/d45/db5/d86/dd6 0 2024-09-21T11:39:33.333 INFO:tasks.workunit.client.0.smithi118.stdout:8/944: rename d2/dc/d10/d2e/d18/d83 to d2/dc/d35/d50/dad/d13d 0 2024-09-21T11:39:33.334 INFO:tasks.workunit.client.0.smithi118.stdout:9/584: dread - d0/d20/d4c/d5f/f7b zero size 2024-09-21T11:39:33.335 INFO:tasks.workunit.client.0.smithi118.stdout:8/945: mknod d2/dc/d10/dd3/c13e 0 2024-09-21T11:39:33.337 INFO:tasks.workunit.client.0.smithi118.stdout:9/585: mknod d0/d20/d4c/d5f/d6c/d88/db4/cd7 0 2024-09-21T11:39:33.338 INFO:tasks.workunit.client.0.smithi118.stdout:9/586: chown d0/d4/l9b 47 1 2024-09-21T11:39:33.339 INFO:tasks.workunit.client.0.smithi118.stdout:8/946: dwrite d2/dc/d35/fef [0,4194304] 0 2024-09-21T11:39:33.340 INFO:tasks.workunit.client.0.smithi118.stdout:9/587: dread - d0/d20/d4c/d5f/d6c/d88/fc5 zero size 2024-09-21T11:39:33.341 INFO:tasks.workunit.client.0.smithi118.stdout:8/947: write d2/dc/d10/d2e/dba/f116 [1105233,84948] 0 2024-09-21T11:39:33.346 INFO:tasks.workunit.client.0.smithi118.stdout:8/948: rename d2/d7c/d88/dc2/lfb to d2/d7c/d88/l13f 0 2024-09-21T11:39:33.349 INFO:tasks.workunit.client.0.smithi118.stdout:8/949: creat d2/dc/d35/d42/f140 x:0 0 0 2024-09-21T11:39:33.349 INFO:tasks.workunit.client.0.smithi118.stdout:9/588: dwrite d0/fbc [0,4194304] 0 2024-09-21T11:39:33.352 INFO:tasks.workunit.client.0.smithi118.stdout:9/589: creat d0/d20/d4c/d5f/d6c/fd8 x:0 0 0 2024-09-21T11:39:33.354 INFO:tasks.workunit.client.0.smithi118.stdout:9/590: dread - d0/f7e zero size 2024-09-21T11:39:33.354 INFO:tasks.workunit.client.0.smithi118.stdout:9/591: stat d0/d20/d71/faf 0 2024-09-21T11:39:33.356 INFO:tasks.workunit.client.0.smithi118.stdout:8/950: link d2/dc/d35/l3d d2/dc/d10/d3b/d101/d103/de7/l141 0 2024-09-21T11:39:33.357 INFO:tasks.workunit.client.0.smithi118.stdout:9/592: creat d0/d20/d4c/d5f/d89/fd9 x:0 0 0 2024-09-21T11:39:33.359 INFO:tasks.workunit.client.0.smithi118.stdout:8/951: unlink d2/dc/d35/d42/f140 0 2024-09-21T11:39:33.363 INFO:tasks.workunit.client.0.smithi118.stdout:8/952: creat d2/dc/d10/d6a/f142 x:0 0 0 2024-09-21T11:39:33.379 INFO:tasks.workunit.client.0.smithi118.stdout:9/593: write d0/f5 [413793,68767] 0 2024-09-21T11:39:33.381 INFO:tasks.workunit.client.0.smithi118.stdout:9/594: mknod d0/d4/d45/db5/d86/cda 0 2024-09-21T11:39:33.383 INFO:tasks.workunit.client.0.smithi118.stdout:9/595: mknod d0/d4/d45/da5/cdb 0 2024-09-21T11:39:33.385 INFO:tasks.workunit.client.0.smithi118.stdout:9/596: mkdir d0/d4/d45/db5/d86/dd6/ddc 0 2024-09-21T11:39:33.394 INFO:tasks.workunit.client.0.smithi118.stdout:9/597: write d0/fbc [4770035,122410] 0 2024-09-21T11:39:33.395 INFO:tasks.workunit.client.0.smithi118.stdout:9/598: readlink d0/d20/d4c/d5f/d89/ld5 0 2024-09-21T11:39:33.397 INFO:tasks.workunit.client.0.smithi118.stdout:9/599: write d0/d20/d4c/d5f/d6c/d88/db9/d7c/fcd [734475,33683] 0 2024-09-21T11:39:33.399 INFO:tasks.workunit.client.0.smithi118.stdout:9/600: creat d0/d20/d4c/d5f/d6c/d88/d4d/dca/fdd x:0 0 0 2024-09-21T11:39:33.400 INFO:tasks.workunit.client.0.smithi118.stdout:9/601: fdatasync d0/d20/d4c/d5f/d6c/d88/d4d/fab 0 2024-09-21T11:39:33.402 INFO:tasks.workunit.client.0.smithi118.stdout:9/602: rmdir d0/d20/d4c/d5f/d6c/d88/db9/d7c 39 2024-09-21T11:39:33.412 INFO:tasks.workunit.client.0.smithi118.stdout:9/603: truncate d0/d4/d45/d72/f94 1877914 0 2024-09-21T11:39:33.426 INFO:tasks.workunit.client.0.smithi118.stdout:9/604: dread d0/d20/d4c/d5f/d66/d98/fa9 [0,4194304] 0 2024-09-21T11:39:33.428 INFO:tasks.workunit.client.0.smithi118.stdout:9/605: dread - d0/f97 zero size 2024-09-21T11:39:33.432 INFO:tasks.workunit.client.0.smithi118.stdout:9/606: creat d0/d20/d4c/d5f/d6c/d88/db9/fde x:0 0 0 2024-09-21T11:39:33.435 INFO:tasks.workunit.client.0.smithi118.stdout:9/607: symlink d0/d4/d38/ldf 0 2024-09-21T11:39:33.435 INFO:tasks.workunit.client.0.smithi118.stdout:9/608: readlink d0/d4/d45/da5/la8 0 2024-09-21T11:39:33.440 INFO:tasks.workunit.client.0.smithi118.stdout:9/609: truncate d0/d20/d4c/f85 442769 0 2024-09-21T11:39:33.441 INFO:tasks.workunit.client.0.smithi118.stdout:9/610: dread - d0/d20/d4c/d5f/d89/fd9 zero size 2024-09-21T11:39:33.489 INFO:tasks.workunit.client.0.smithi118.stdout:9/611: dwrite d0/d4/d45/f6d [0,4194304] 0 2024-09-21T11:39:33.502 INFO:tasks.workunit.client.0.smithi118.stdout:9/612: mkdir d0/d20/d4c/d5f/d6c/d88/d4d/de0 0 2024-09-21T11:39:33.504 INFO:tasks.workunit.client.0.smithi118.stdout:9/613: write d0/d4/d45/f48 [2091087,49734] 0 2024-09-21T11:39:33.518 INFO:tasks.workunit.client.0.smithi118.stdout:9/614: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/f82 [0,4194304] 0 2024-09-21T11:39:33.520 INFO:tasks.workunit.client.0.smithi118.stdout:9/615: chown d0/f26 408652 1 2024-09-21T11:39:33.526 INFO:tasks.workunit.client.0.smithi118.stdout:9/616: getdents d0/d4/d38/db8 0 2024-09-21T11:39:33.529 INFO:tasks.workunit.client.0.smithi118.stdout:9/617: creat d0/d4/d38/db8/fe1 x:0 0 0 2024-09-21T11:39:33.532 INFO:tasks.workunit.client.0.smithi118.stdout:9/618: mkdir d0/de2 0 2024-09-21T11:39:33.545 INFO:tasks.workunit.client.0.smithi118.stdout:9/619: dwrite d0/fa1 [0,4194304] 0 2024-09-21T11:39:33.549 INFO:tasks.workunit.client.0.smithi118.stdout:9/620: creat d0/d4/fe3 x:0 0 0 2024-09-21T11:39:33.559 INFO:tasks.workunit.client.0.smithi118.stdout:9/621: write d0/d4/d45/f75 [351213,99367] 0 2024-09-21T11:39:33.563 INFO:tasks.workunit.client.0.smithi118.stdout:9/622: fsync d0/d20/d4c/d5f/d6c/d88/db9/d7c/fa6 0 2024-09-21T11:39:33.565 INFO:tasks.workunit.client.0.smithi118.stdout:9/623: mkdir d0/d4/d45/d72/de4 0 2024-09-21T11:39:33.565 INFO:tasks.workunit.client.0.smithi118.stdout:9/624: readlink d0/d20/d4c/d5f/l79 0 2024-09-21T11:39:33.567 INFO:tasks.workunit.client.0.smithi118.stdout:9/625: symlink d0/d20/d4c/d5f/d6c/d88/d4d/le5 0 2024-09-21T11:39:33.570 INFO:tasks.workunit.client.0.smithi118.stdout:9/626: truncate d0/d20/d4c/d5f/d6c/d88/db9/d7c/fa0 905436 0 2024-09-21T11:39:33.576 INFO:tasks.workunit.client.0.smithi118.stdout:9/627: symlink d0/d20/d4c/d5f/d6c/d88/db9/le6 0 2024-09-21T11:39:33.586 INFO:tasks.workunit.client.0.smithi118.stdout:9/628: write d0/d20/d4c/d5f/d6c/d88/f32 [4902963,117595] 0 2024-09-21T11:39:33.587 INFO:tasks.workunit.client.0.smithi118.stdout:9/629: chown d0/d20/d4c/d5f/f7b 228551070 1 2024-09-21T11:39:33.596 INFO:tasks.workunit.client.0.smithi118.stdout:9/630: dwrite d0/d20/d4c/d5f/f7b [0,4194304] 0 2024-09-21T11:39:33.603 INFO:tasks.workunit.client.0.smithi118.stdout:9/631: dwrite d0/d4/fe3 [0,4194304] 0 2024-09-21T11:39:33.607 INFO:tasks.workunit.client.0.smithi118.stdout:9/632: rename d0/d20/d4c/d5f/d6c/d88/fc5 to d0/d20/d4c/d5f/d89/fe7 0 2024-09-21T11:39:33.616 INFO:tasks.workunit.client.0.smithi118.stdout:9/633: write d0/d4/f91 [483851,71443] 0 2024-09-21T11:39:33.620 INFO:tasks.workunit.client.0.smithi118.stdout:9/634: rename d0/d20/c2e to d0/d20/d4c/d5f/d66/ce8 0 2024-09-21T11:39:33.622 INFO:tasks.workunit.client.0.smithi118.stdout:9/635: truncate d0/d20/d4c/d5f/d6c/d88/db9/fde 723209 0 2024-09-21T11:39:33.625 INFO:tasks.workunit.client.0.smithi118.stdout:9/636: fdatasync d0/f76 0 2024-09-21T11:39:33.630 INFO:tasks.workunit.client.0.smithi118.stdout:9/637: unlink d0/d4/d45/d72/f9f 0 2024-09-21T11:39:33.633 INFO:tasks.workunit.client.0.smithi118.stdout:9/638: mkdir d0/d4/d38/db8/de9 0 2024-09-21T11:39:33.635 INFO:tasks.workunit.client.0.smithi118.stdout:9/639: read - d0/d4/d45/d72/f87 zero size 2024-09-21T11:39:33.637 INFO:tasks.workunit.client.0.smithi118.stdout:9/640: symlink d0/d20/d4c/d5f/d89/lea 0 2024-09-21T11:39:33.639 INFO:tasks.workunit.client.0.smithi118.stdout:9/641: symlink d0/d20/d4c/d5f/d66/d98/leb 0 2024-09-21T11:39:33.649 INFO:tasks.workunit.client.0.smithi118.stdout:9/642: dwrite d0/d20/d4c/d5f/d6c/d88/db9/fd1 [0,4194304] 0 2024-09-21T11:39:33.653 INFO:tasks.workunit.client.0.smithi118.stdout:9/643: creat d0/d20/d4c/d5f/d6c/d88/d4d/dca/fec x:0 0 0 2024-09-21T11:39:33.656 INFO:tasks.workunit.client.0.smithi118.stdout:9/644: unlink d0/d20/f6b 0 2024-09-21T11:39:33.658 INFO:tasks.workunit.client.0.smithi118.stdout:9/645: symlink d0/d4/d45/da5/led 0 2024-09-21T11:39:34.164 INFO:tasks.workunit.client.0.smithi118.stdout:5/537: sync 2024-09-21T11:39:34.164 INFO:tasks.workunit.client.0.smithi118.stdout:4/511: sync 2024-09-21T11:39:34.166 INFO:tasks.workunit.client.0.smithi118.stdout:4/512: mknod d2/d6/de/d1c/d4d/d52/d69/cb1 0 2024-09-21T11:39:34.173 INFO:tasks.workunit.client.0.smithi118.stdout:4/513: dwrite d2/d6/de/d1c/d87/da9/f98 [0,4194304] 0 2024-09-21T11:39:34.175 INFO:tasks.workunit.client.0.smithi118.stdout:4/514: symlink d2/d6/dd/d35/lb2 0 2024-09-21T11:39:34.181 INFO:tasks.workunit.client.0.smithi118.stdout:5/538: dread d0/d63/f78 [0,4194304] 0 2024-09-21T11:39:34.182 INFO:tasks.workunit.client.0.smithi118.stdout:4/515: dwrite d2/f8a [0,4194304] 0 2024-09-21T11:39:34.184 INFO:tasks.workunit.client.0.smithi118.stdout:5/539: write d0/db/d35/da/fa2 [70604,72687] 0 2024-09-21T11:39:34.185 INFO:tasks.workunit.client.0.smithi118.stdout:5/540: write d0/db/d35/d30/d66/f71 [2022407,68828] 0 2024-09-21T11:39:34.189 INFO:tasks.workunit.client.0.smithi118.stdout:4/516: mkdir d2/d6/dd/db3 0 2024-09-21T11:39:34.194 INFO:tasks.workunit.client.0.smithi118.stdout:5/541: read d0/d6c/f7e [2074807,83374] 0 2024-09-21T11:39:34.194 INFO:tasks.workunit.client.0.smithi118.stdout:5/542: dread - d0/d63/fb7 zero size 2024-09-21T11:39:34.196 INFO:tasks.workunit.client.0.smithi118.stdout:5/543: rmdir d0/db/d35/d30/d1a/d8f/d99 39 2024-09-21T11:39:34.206 INFO:tasks.workunit.client.0.smithi118.stdout:5/544: dread d0/db/d35/d95/f98 [0,4194304] 0 2024-09-21T11:39:34.212 INFO:tasks.workunit.client.0.smithi118.stdout:5/545: dwrite d0/db/d35/d95/f98 [0,4194304] 0 2024-09-21T11:39:34.213 INFO:tasks.workunit.client.0.smithi118.stdout:4/517: write d2/d6/f94 [753044,71182] 0 2024-09-21T11:39:34.217 INFO:tasks.workunit.client.0.smithi118.stdout:5/546: mkdir d0/d6c/dba 0 2024-09-21T11:39:34.218 INFO:tasks.workunit.client.0.smithi118.stdout:4/518: rmdir d2/d6/de/d1c/d23/d26 39 2024-09-21T11:39:34.218 INFO:tasks.workunit.client.0.smithi118.stdout:5/547: readlink d0/db/d35/l5c 0 2024-09-21T11:39:34.221 INFO:tasks.workunit.client.0.smithi118.stdout:5/548: mkdir d0/db/d35/d30/d66/dbb 0 2024-09-21T11:39:34.223 INFO:tasks.workunit.client.0.smithi118.stdout:5/549: symlink d0/db/d26/lbc 0 2024-09-21T11:39:34.226 INFO:tasks.workunit.client.0.smithi118.stdout:4/519: link d2/d6/de/d1c/d23/d26/c27 d2/d6/de/d1c/d23/d26/d74/cb4 0 2024-09-21T11:39:34.227 INFO:tasks.workunit.client.0.smithi118.stdout:4/520: write d2/d6/f18 [851417,27667] 0 2024-09-21T11:39:34.230 INFO:tasks.workunit.client.0.smithi118.stdout:4/521: rename d2/d6/de/d1c/d23/d26/ca6 to d2/da1/cb5 0 2024-09-21T11:39:34.231 INFO:tasks.workunit.client.0.smithi118.stdout:4/522: write d2/f7c [1151190,123364] 0 2024-09-21T11:39:34.234 INFO:tasks.workunit.client.0.smithi118.stdout:5/550: write d0/d89/f8e [3456250,68067] 0 2024-09-21T11:39:34.235 INFO:tasks.workunit.client.0.smithi118.stdout:4/523: dread d2/d65/fa3 [0,4194304] 0 2024-09-21T11:39:34.239 INFO:tasks.workunit.client.0.smithi118.stdout:5/551: creat d0/db/d35/d30/d1a/d8f/d99/fbd x:0 0 0 2024-09-21T11:39:34.241 INFO:tasks.workunit.client.0.smithi118.stdout:4/524: link d2/d6/dd/f96 d2/d65/fb6 0 2024-09-21T11:39:34.245 INFO:tasks.workunit.client.0.smithi118.stdout:4/525: creat d2/d6/de/d1c/d87/da9/d97/d9b/fb7 x:0 0 0 2024-09-21T11:39:34.246 INFO:tasks.workunit.client.0.smithi118.stdout:5/552: getdents d0/db 0 2024-09-21T11:39:34.247 INFO:tasks.workunit.client.0.smithi118.stdout:5/553: write d0/d6c/f8 [5250910,73910] 0 2024-09-21T11:39:34.263 INFO:tasks.workunit.client.0.smithi118.stdout:5/554: dread d0/fd [0,4194304] 0 2024-09-21T11:39:34.265 INFO:tasks.workunit.client.0.smithi118.stdout:5/555: mknod d0/d6c/cbe 0 2024-09-21T11:39:34.267 INFO:tasks.workunit.client.0.smithi118.stdout:5/556: chown d0/db/d26/l96 333 1 2024-09-21T11:39:34.269 INFO:tasks.workunit.client.0.smithi118.stdout:5/557: mkdir d0/dbf 0 2024-09-21T11:39:34.269 INFO:tasks.workunit.client.0.smithi118.stdout:4/526: dwrite d2/d6/de/d1c/d4d/d52/d69/f67 [0,4194304] 0 2024-09-21T11:39:34.270 INFO:tasks.workunit.client.0.smithi118.stdout:5/558: write d0/d89/f8e [1049472,40718] 0 2024-09-21T11:39:34.270 INFO:tasks.workunit.client.0.smithi118.stdout:5/559: stat d0/d89/daa 0 2024-09-21T11:39:34.271 INFO:tasks.workunit.client.0.smithi118.stdout:5/560: fdatasync d0/d6c/d25/f43 0 2024-09-21T11:39:34.272 INFO:tasks.workunit.client.0.smithi118.stdout:5/561: chown d0/c61 161006077 1 2024-09-21T11:39:34.275 INFO:tasks.workunit.client.0.smithi118.stdout:4/527: dread d2/d6/de/d1c/d87/da9/f98 [0,4194304] 0 2024-09-21T11:39:34.278 INFO:tasks.workunit.client.0.smithi118.stdout:4/528: write d2/f7c [1666079,67008] 0 2024-09-21T11:39:34.282 INFO:tasks.workunit.client.0.smithi118.stdout:5/562: link d0/db/d35/d2c/d40/c5f d0/d6c/d67/cc0 0 2024-09-21T11:39:34.286 INFO:tasks.workunit.client.0.smithi118.stdout:5/563: getdents d0/db/d35/d95 0 2024-09-21T11:39:34.287 INFO:tasks.workunit.client.0.smithi118.stdout:5/564: dread - d0/d6c/d25/f7d zero size 2024-09-21T11:39:34.288 INFO:tasks.workunit.client.0.smithi118.stdout:5/565: write d0/db/d26/f93 [478540,63182] 0 2024-09-21T11:39:34.293 INFO:tasks.workunit.client.0.smithi118.stdout:5/566: rename d0/db/d35/da/l8c to d0/d6c/lc1 0 2024-09-21T11:39:34.293 INFO:tasks.workunit.client.0.smithi118.stdout:5/567: chown d0/d89/d9d/ca5 159922 1 2024-09-21T11:39:34.298 INFO:tasks.workunit.client.0.smithi118.stdout:4/529: dwrite d2/d6/de/d1c/d4d/d52/d69/f81 [0,4194304] 0 2024-09-21T11:39:34.298 INFO:tasks.workunit.client.0.smithi118.stdout:4/530: read d2/d65/fa3 [2777074,18640] 0 2024-09-21T11:39:34.306 INFO:tasks.workunit.client.0.smithi118.stdout:5/568: truncate d0/d6c/d67/f62 1496886 0 2024-09-21T11:39:34.306 INFO:tasks.workunit.client.0.smithi118.stdout:5/569: dread - d0/d63/fb7 zero size 2024-09-21T11:39:34.307 INFO:tasks.workunit.client.0.smithi118.stdout:4/531: creat d2/d6/de/d1c/d4d/d52/fb8 x:0 0 0 2024-09-21T11:39:34.309 INFO:tasks.workunit.client.0.smithi118.stdout:5/570: creat d0/d89/d9d/fc2 x:0 0 0 2024-09-21T11:39:34.311 INFO:tasks.workunit.client.0.smithi118.stdout:4/532: read d2/d6/de/d1c/d23/d26/f73 [1278063,49955] 0 2024-09-21T11:39:34.312 INFO:tasks.workunit.client.0.smithi118.stdout:5/571: dread d0/fe [4194304,4194304] 0 2024-09-21T11:39:34.313 INFO:tasks.workunit.client.0.smithi118.stdout:4/533: dread - d2/d6/de/d1c/d4d/d52/fb8 zero size 2024-09-21T11:39:34.314 INFO:tasks.workunit.client.0.smithi118.stdout:4/534: readlink d2/d6/de/d1c/d23/d26/l5a 0 2024-09-21T11:39:34.316 INFO:tasks.workunit.client.0.smithi118.stdout:5/572: write d0/d6c/d25/f7d [958,9499] 0 2024-09-21T11:39:34.318 INFO:tasks.workunit.client.0.smithi118.stdout:5/573: chown d0/db/d35/f3d 17980032 1 2024-09-21T11:39:34.321 INFO:tasks.workunit.client.0.smithi118.stdout:4/535: dwrite d2/d6/de/d1c/d87/da9/f98 [0,4194304] 0 2024-09-21T11:39:34.322 INFO:tasks.workunit.client.0.smithi118.stdout:5/574: creat d0/db/d35/d30/d1a/d8f/d99/db9/fc3 x:0 0 0 2024-09-21T11:39:34.323 INFO:tasks.workunit.client.0.smithi118.stdout:4/536: fdatasync d2/d6/de/d1c/d4d/d52/d69/f67 0 2024-09-21T11:39:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:34 smithi118 ceph-mon[28757]: pgmap v32: 65 pgs: 65 active+clean; 3.1 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 57 MiB/s rd, 146 MiB/s wr, 334 op/s 2024-09-21T11:39:34.344 INFO:tasks.workunit.client.0.smithi118.stdout:4/537: truncate d2/d6/dd/f51 1419603 0 2024-09-21T11:39:34.344 INFO:tasks.workunit.client.0.smithi118.stdout:1/565: sync 2024-09-21T11:39:34.344 INFO:tasks.workunit.client.0.smithi118.stdout:6/481: sync 2024-09-21T11:39:34.345 INFO:tasks.workunit.client.0.smithi118.stdout:0/855: sync 2024-09-21T11:39:34.345 INFO:tasks.workunit.client.0.smithi118.stdout:5/575: dwrite d0/fd [0,4194304] 0 2024-09-21T11:39:34.351 INFO:tasks.workunit.client.0.smithi118.stdout:1/566: dwrite d6/f15 [0,4194304] 0 2024-09-21T11:39:34.359 INFO:tasks.workunit.client.0.smithi118.stdout:6/482: creat d8/d48/d72/f9a x:0 0 0 2024-09-21T11:39:34.363 INFO:tasks.workunit.client.0.smithi118.stdout:8/953: sync 2024-09-21T11:39:34.364 INFO:tasks.workunit.client.0.smithi118.stdout:2/499: sync 2024-09-21T11:39:34.364 INFO:tasks.workunit.client.0.smithi118.stdout:9/646: sync 2024-09-21T11:39:34.364 INFO:tasks.workunit.client.0.smithi118.stdout:3/494: sync 2024-09-21T11:39:34.364 INFO:tasks.workunit.client.0.smithi118.stdout:7/619: sync 2024-09-21T11:39:34.364 INFO:tasks.workunit.client.0.smithi118.stdout:1/567: rmdir d6/d3b/d45 39 2024-09-21T11:39:34.367 INFO:tasks.workunit.client.0.smithi118.stdout:5/576: mknod d0/cc4 0 2024-09-21T11:39:34.369 INFO:tasks.workunit.client.0.smithi118.stdout:3/495: rmdir d5/d28/d3e/d5d/d5f 39 2024-09-21T11:39:34.371 INFO:tasks.workunit.client.0.smithi118.stdout:5/577: readlink d0/db/d35/d30/l13 0 2024-09-21T11:39:34.374 INFO:tasks.workunit.client.0.smithi118.stdout:0/856: dwrite d5/d10/f28 [0,4194304] 0 2024-09-21T11:39:34.376 INFO:tasks.workunit.client.0.smithi118.stdout:7/620: mknod d0/d3/d29/ccc 0 2024-09-21T11:39:34.377 INFO:tasks.workunit.client.0.smithi118.stdout:9/647: dwrite d0/d20/d4c/d5f/d6c/d88/f32 [0,4194304] 0 2024-09-21T11:39:34.382 INFO:tasks.workunit.client.0.smithi118.stdout:2/500: link de/d1f/d20/f48 de/d51/fa9 0 2024-09-21T11:39:34.387 INFO:tasks.workunit.client.0.smithi118.stdout:0/857: mknod d5/d10/d1e/d23/d3a/d90/c122 0 2024-09-21T11:39:34.388 INFO:tasks.workunit.client.0.smithi118.stdout:6/483: write d8/d48/d45/d61/d70/f83 [654280,54445] 0 2024-09-21T11:39:34.389 INFO:tasks.workunit.client.0.smithi118.stdout:7/621: mknod d0/d3/d1d/d35/ccd 0 2024-09-21T11:39:34.392 INFO:tasks.workunit.client.0.smithi118.stdout:1/568: creat d6/de/fb1 x:0 0 0 2024-09-21T11:39:34.393 INFO:tasks.workunit.client.0.smithi118.stdout:4/538: dwrite d2/d6/dd/d35/f3f [0,4194304] 0 2024-09-21T11:39:34.395 INFO:tasks.workunit.client.0.smithi118.stdout:7/622: write d0/d3/fc1 [10080,128874] 0 2024-09-21T11:39:34.395 INFO:tasks.workunit.client.0.smithi118.stdout:5/578: unlink d0/d89/cab 0 2024-09-21T11:39:34.396 INFO:tasks.workunit.client.0.smithi118.stdout:4/539: chown d2/d6/c39 400 1 2024-09-21T11:39:34.401 INFO:tasks.workunit.client.0.smithi118.stdout:0/858: truncate d5/d29/d68/d7b/db7/f4a 2463863 0 2024-09-21T11:39:34.402 INFO:tasks.workunit.client.0.smithi118.stdout:0/859: chown d5/d29/d119 956 1 2024-09-21T11:39:34.402 INFO:tasks.workunit.client.0.smithi118.stdout:2/501: dread de/d51/fa9 [0,4194304] 0 2024-09-21T11:39:34.404 INFO:tasks.workunit.client.0.smithi118.stdout:6/484: symlink d8/d48/d45/d61/d66/l9b 0 2024-09-21T11:39:34.404 INFO:tasks.workunit.client.0.smithi118.stdout:5/579: dread - d0/d6c/d25/d50/f73 zero size 2024-09-21T11:39:34.405 INFO:tasks.workunit.client.0.smithi118.stdout:7/623: symlink d0/d3/d14/d41/da0/lce 0 2024-09-21T11:39:34.406 INFO:tasks.workunit.client.0.smithi118.stdout:1/569: mknod d6/d2a/cb2 0 2024-09-21T11:39:34.406 INFO:tasks.workunit.client.0.smithi118.stdout:5/580: dread - d0/fb8 zero size 2024-09-21T11:39:34.406 INFO:tasks.workunit.client.0.smithi118.stdout:8/954: dwrite d2/dc/d35/d50/dad/d13d/fd8 [0,4194304] 0 2024-09-21T11:39:34.409 INFO:tasks.workunit.client.0.smithi118.stdout:5/581: chown d0/d6c/d25/d50 1317716 1 2024-09-21T11:39:34.409 INFO:tasks.workunit.client.0.smithi118.stdout:3/496: getdents d5/d1d/d1b/d4c/d91/d69 0 2024-09-21T11:39:34.416 INFO:tasks.workunit.client.0.smithi118.stdout:1/570: dwrite d6/de/d16/d3f/d50/d72/f80 [0,4194304] 0 2024-09-21T11:39:34.418 INFO:tasks.workunit.client.0.smithi118.stdout:0/860: symlink d5/d10/d1e/d21/db3/dbe/dd7/l123 0 2024-09-21T11:39:34.418 INFO:tasks.workunit.client.0.smithi118.stdout:0/861: readlink d5/d34/l6d 0 2024-09-21T11:39:34.419 INFO:tasks.workunit.client.0.smithi118.stdout:8/955: creat d2/dc/d35/d42/f143 x:0 0 0 2024-09-21T11:39:34.424 INFO:tasks.workunit.client.0.smithi118.stdout:7/624: chown d0/d3/d1d/d35/f60 5 1 2024-09-21T11:39:34.428 INFO:tasks.workunit.client.0.smithi118.stdout:5/582: stat d0/d6c/d25/d50/c5d 0 2024-09-21T11:39:34.435 INFO:tasks.workunit.client.0.smithi118.stdout:1/571: rename d6/l7c to d6/de/d16/d3f/lb3 0 2024-09-21T11:39:34.438 INFO:tasks.workunit.client.0.smithi118.stdout:2/502: write de/d16/d31/f7c [3832006,86870] 0 2024-09-21T11:39:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:34 smithi149 ceph-mon[36123]: pgmap v32: 65 pgs: 65 active+clean; 3.1 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 57 MiB/s rd, 146 MiB/s wr, 334 op/s 2024-09-21T11:39:34.451 INFO:tasks.workunit.client.0.smithi118.stdout:1/572: creat d6/de/d13/d84/d96/d9e/fb4 x:0 0 0 2024-09-21T11:39:34.453 INFO:tasks.workunit.client.0.smithi118.stdout:0/862: dread d5/d34/d44/d87/d9a/faa [0,4194304] 0 2024-09-21T11:39:34.453 INFO:tasks.workunit.client.0.smithi118.stdout:8/956: rename d2/dc/dc1/led to d2/dc/d10/d3b/d101/d103/de7/l144 0 2024-09-21T11:39:34.454 INFO:tasks.workunit.client.0.smithi118.stdout:6/485: dwrite d8/d48/d5f/f7c [0,4194304] 0 2024-09-21T11:39:34.456 INFO:tasks.workunit.client.0.smithi118.stdout:7/625: mkdir d0/d3/d14/d41/d66/dcf 0 2024-09-21T11:39:34.474 INFO:tasks.workunit.client.0.smithi118.stdout:3/497: creat d5/d1d/d1b/d4c/d73/fb6 x:0 0 0 2024-09-21T11:39:34.475 INFO:tasks.workunit.client.0.smithi118.stdout:2/503: mknod de/d1f/d20/d67/caa 0 2024-09-21T11:39:34.476 INFO:tasks.workunit.client.0.smithi118.stdout:1/573: fsync d6/d2a/f69 0 2024-09-21T11:39:34.478 INFO:tasks.workunit.client.0.smithi118.stdout:0/863: fsync d5/d10/d1e/d20/fbf 0 2024-09-21T11:39:34.478 INFO:tasks.workunit.client.0.smithi118.stdout:8/957: readlink d2/dc/d35/l3d 0 2024-09-21T11:39:34.479 INFO:tasks.workunit.client.0.smithi118.stdout:8/958: chown d2/dc/d16/d46/d4c/d63 854 1 2024-09-21T11:39:34.480 INFO:tasks.workunit.client.0.smithi118.stdout:6/486: rename d8/fb to d8/d48/d72/f9c 0 2024-09-21T11:39:34.482 INFO:tasks.workunit.client.0.smithi118.stdout:5/583: creat d0/d6c/fc5 x:0 0 0 2024-09-21T11:39:34.487 INFO:tasks.workunit.client.0.smithi118.stdout:1/574: mkdir d6/d2a/d3d/db5 0 2024-09-21T11:39:34.488 INFO:tasks.workunit.client.0.smithi118.stdout:1/575: dread - d6/d2a/d5c/f9f zero size 2024-09-21T11:39:34.489 INFO:tasks.workunit.client.0.smithi118.stdout:1/576: write d6/de/d16/d3f/d50/fa6 [541167,100523] 0 2024-09-21T11:39:34.492 INFO:tasks.workunit.client.0.smithi118.stdout:8/959: creat d2/dc/d16/d46/d4c/d63/db9/f145 x:0 0 0 2024-09-21T11:39:34.494 INFO:tasks.workunit.client.0.smithi118.stdout:7/626: rename d0/d3/d13/l1b to d0/d3/d29/d5f/d71/ld0 0 2024-09-21T11:39:34.494 INFO:tasks.workunit.client.0.smithi118.stdout:8/960: dread d2/dc/d10/d2e/fbf [0,4194304] 0 2024-09-21T11:39:34.500 INFO:tasks.workunit.client.0.smithi118.stdout:3/498: mknod d5/d28/d3e/d5d/d5f/d88/cb7 0 2024-09-21T11:39:34.500 INFO:tasks.workunit.client.0.smithi118.stdout:7/627: dwrite d0/d3/d1d/d35/d57/f95 [0,4194304] 0 2024-09-21T11:39:34.501 INFO:tasks.workunit.client.0.smithi118.stdout:2/504: truncate de/d51/fa9 1063252 0 2024-09-21T11:39:34.502 INFO:tasks.workunit.client.0.smithi118.stdout:7/628: fsync d0/d3/d29/d5f/f85 0 2024-09-21T11:39:34.502 INFO:tasks.workunit.client.0.smithi118.stdout:2/505: chown de/d16/d31 401957162 1 2024-09-21T11:39:34.503 INFO:tasks.workunit.client.0.smithi118.stdout:2/506: chown de/d16/d1c/d4f 339163606 1 2024-09-21T11:39:34.505 INFO:tasks.workunit.client.0.smithi118.stdout:0/864: mkdir d5/d34/d44/d87/d124 0 2024-09-21T11:39:34.513 INFO:tasks.workunit.client.0.smithi118.stdout:5/584: symlink d0/dbf/lc6 0 2024-09-21T11:39:34.514 INFO:tasks.workunit.client.0.smithi118.stdout:5/585: fdatasync d0/d63/fb7 0 2024-09-21T11:39:34.517 INFO:tasks.workunit.client.0.smithi118.stdout:7/629: read d0/d3/d29/d5f/f62 [3397740,5827] 0 2024-09-21T11:39:34.520 INFO:tasks.workunit.client.0.smithi118.stdout:1/577: symlink d6/de/lb6 0 2024-09-21T11:39:34.521 INFO:tasks.workunit.client.0.smithi118.stdout:0/865: rmdir d5/d10/d1e/d23/d3a/d4e/d9d 39 2024-09-21T11:39:34.522 INFO:tasks.workunit.client.0.smithi118.stdout:3/499: dread d5/d1d/f16 [0,4194304] 0 2024-09-21T11:39:34.523 INFO:tasks.workunit.client.0.smithi118.stdout:3/500: chown d5/d28/d3e/l77 951499 1 2024-09-21T11:39:34.524 INFO:tasks.workunit.client.0.smithi118.stdout:5/586: rmdir d0/db/d26 39 2024-09-21T11:39:34.525 INFO:tasks.workunit.client.0.smithi118.stdout:7/630: rmdir d0/d3/d14/d41/d66 39 2024-09-21T11:39:34.526 INFO:tasks.workunit.client.0.smithi118.stdout:0/866: rmdir d5/d10/d1e 39 2024-09-21T11:39:34.530 INFO:tasks.workunit.client.0.smithi118.stdout:1/578: rename d6/de/d16/d3f/d50/d54/f6f to d6/de/d16/d3f/d50/fb7 0 2024-09-21T11:39:34.531 INFO:tasks.workunit.client.0.smithi118.stdout:1/579: stat d6/de/d13/f8b 0 2024-09-21T11:39:34.532 INFO:tasks.workunit.client.0.smithi118.stdout:3/501: dwrite d5/d1d/d1b/d4c/f9e [0,4194304] 0 2024-09-21T11:39:34.538 INFO:tasks.workunit.client.0.smithi118.stdout:2/507: getdents de/d16/d25 0 2024-09-21T11:39:34.539 INFO:tasks.workunit.client.0.smithi118.stdout:2/508: write de/d16/f8c [86247,92528] 0 2024-09-21T11:39:34.541 INFO:tasks.workunit.client.0.smithi118.stdout:7/631: truncate d0/d3/d14/d41/d66/d9d/fa6 5682993 0 2024-09-21T11:39:34.542 INFO:tasks.workunit.client.0.smithi118.stdout:0/867: rmdir d5/d10/d1e/d20/dc7 39 2024-09-21T11:39:34.544 INFO:tasks.workunit.client.0.smithi118.stdout:5/587: creat d0/d6c/d25/d50/fc7 x:0 0 0 2024-09-21T11:39:34.549 INFO:tasks.workunit.client.0.smithi118.stdout:0/868: read d5/d10/d1e/d33/f72 [2197583,17055] 0 2024-09-21T11:39:34.550 INFO:tasks.workunit.client.0.smithi118.stdout:3/502: link d5/d1d/d1b/d4c/f56 d5/d28/d3e/d5d/d5f/fb8 0 2024-09-21T11:39:34.550 INFO:tasks.workunit.client.0.smithi118.stdout:3/503: dread - d5/f57 zero size 2024-09-21T11:39:34.556 INFO:tasks.workunit.client.0.smithi118.stdout:7/632: getdents d0/d3/d14/d41/d7f/da2 0 2024-09-21T11:39:34.557 INFO:tasks.workunit.client.0.smithi118.stdout:3/504: mknod d5/d28/d3e/d5d/cb9 0 2024-09-21T11:39:34.558 INFO:tasks.workunit.client.0.smithi118.stdout:5/588: getdents d0/d89/d9f 0 2024-09-21T11:39:34.560 INFO:tasks.workunit.client.0.smithi118.stdout:3/505: symlink d5/d1d/d1b/d24/lba 0 2024-09-21T11:39:34.562 INFO:tasks.workunit.client.0.smithi118.stdout:7/633: truncate d0/d3/f18 5959911 0 2024-09-21T11:39:34.564 INFO:tasks.workunit.client.0.smithi118.stdout:1/580: dread d6/d2a/f23 [0,4194304] 0 2024-09-21T11:39:34.564 INFO:tasks.workunit.client.0.smithi118.stdout:3/506: fdatasync d5/d1d/f81 0 2024-09-21T11:39:34.566 INFO:tasks.workunit.client.0.smithi118.stdout:3/507: write d5/d28/d3e/d5d/d5f/f6d [1183623,81680] 0 2024-09-21T11:39:34.567 INFO:tasks.workunit.client.0.smithi118.stdout:7/634: creat d0/d3/d29/d5f/fd1 x:0 0 0 2024-09-21T11:39:34.569 INFO:tasks.workunit.client.0.smithi118.stdout:1/581: mkdir d6/d2a/d5c/db8 0 2024-09-21T11:39:34.570 INFO:tasks.workunit.client.0.smithi118.stdout:3/508: creat d5/d1d/d1b/d4b/fbb x:0 0 0 2024-09-21T11:39:34.571 INFO:tasks.workunit.client.0.smithi118.stdout:7/635: symlink d0/d3/d1d/ld2 0 2024-09-21T11:39:34.572 INFO:tasks.workunit.client.0.smithi118.stdout:7/636: chown d0/d3/d1d/d35/d57/d96/d9e 5900334 1 2024-09-21T11:39:34.572 INFO:tasks.workunit.client.0.smithi118.stdout:1/582: mkdir d6/d2a/d3d/db9 0 2024-09-21T11:39:34.576 INFO:tasks.workunit.client.0.smithi118.stdout:7/637: truncate d0/d3/d14/f28 94651 0 2024-09-21T11:39:34.577 INFO:tasks.workunit.client.0.smithi118.stdout:1/583: truncate d6/de/d16/d3f/d50/d54/d32/f46 445807 0 2024-09-21T11:39:34.578 INFO:tasks.workunit.client.0.smithi118.stdout:7/638: mknod d0/d3/d14/d41/d7f/da2/cd3 0 2024-09-21T11:39:34.582 INFO:tasks.workunit.client.0.smithi118.stdout:6/487: write d8/d14/f26 [1361058,102839] 0 2024-09-21T11:39:34.583 INFO:tasks.workunit.client.0.smithi118.stdout:7/639: dread d0/d3/d1d/f7d [0,4194304] 0 2024-09-21T11:39:34.586 INFO:tasks.workunit.client.0.smithi118.stdout:6/488: rename d8/d14/f26 to d8/d14/d44/f9d 0 2024-09-21T11:39:34.588 INFO:tasks.workunit.client.0.smithi118.stdout:7/640: dread d0/d3/d1d/f46 [0,4194304] 0 2024-09-21T11:39:34.591 INFO:tasks.workunit.client.0.smithi118.stdout:6/489: dwrite d8/d46/f52 [4194304,4194304] 0 2024-09-21T11:39:34.597 INFO:tasks.workunit.client.0.smithi118.stdout:7/641: truncate d0/d3/d14/d41/d7f/da2/fb3 789297 0 2024-09-21T11:39:34.600 INFO:tasks.workunit.client.0.smithi118.stdout:7/642: unlink d0/d3/d29/fc8 0 2024-09-21T11:39:34.606 INFO:tasks.workunit.client.0.smithi118.stdout:0/869: write d5/d29/d68/fc0 [690100,58176] 0 2024-09-21T11:39:34.608 INFO:tasks.workunit.client.0.smithi118.stdout:8/961: dwrite d2/dc/d10/d2e/d18/d1a/f1b [0,4194304] 0 2024-09-21T11:39:34.608 INFO:tasks.workunit.client.0.smithi118.stdout:0/870: readlink d5/l1d 0 2024-09-21T11:39:34.610 INFO:tasks.workunit.client.0.smithi118.stdout:8/962: chown d2/d7c/d88/d8f/daa/cda 56062939 1 2024-09-21T11:39:34.613 INFO:tasks.workunit.client.0.smithi118.stdout:8/963: rmdir d2/dc/d10/d2e 39 2024-09-21T11:39:34.615 INFO:tasks.workunit.client.0.smithi118.stdout:8/964: write d2/dc/d16/d46/d4c/d63/db9/f12c [457608,24765] 0 2024-09-21T11:39:34.616 INFO:tasks.workunit.client.0.smithi118.stdout:3/509: write d5/d28/d3e/d5d/d5f/fb8 [768793,31472] 0 2024-09-21T11:39:34.618 INFO:tasks.workunit.client.0.smithi118.stdout:1/584: read d6/de/d16/d3f/d50/d54/d32/f46 [146366,58268] 0 2024-09-21T11:39:34.620 INFO:tasks.workunit.client.0.smithi118.stdout:3/510: creat d5/d28/d3e/fbc x:0 0 0 2024-09-21T11:39:34.622 INFO:tasks.workunit.client.0.smithi118.stdout:8/965: truncate d2/dc/d35/d50/f95 1715516 0 2024-09-21T11:39:34.626 INFO:tasks.workunit.client.0.smithi118.stdout:1/585: symlink d6/d3b/lba 0 2024-09-21T11:39:34.627 INFO:tasks.workunit.client.0.smithi118.stdout:1/586: write d6/d33/d3c/f9b [1113173,101968] 0 2024-09-21T11:39:34.629 INFO:tasks.workunit.client.0.smithi118.stdout:1/587: write d6/de/fb1 [518846,5058] 0 2024-09-21T11:39:34.630 INFO:tasks.workunit.client.0.smithi118.stdout:7/643: write d0/d3/d1d/d35/f60 [115860,12564] 0 2024-09-21T11:39:34.633 INFO:tasks.workunit.client.0.smithi118.stdout:6/490: dwrite d8/d48/d45/d61/d66/f86 [0,4194304] 0 2024-09-21T11:39:34.635 INFO:tasks.workunit.client.0.smithi118.stdout:0/871: write d5/d29/d68/d7b/db7/d48/fa6 [2968013,77063] 0 2024-09-21T11:39:34.636 INFO:tasks.workunit.client.0.smithi118.stdout:8/966: chown d2/dc/d10/d2e/d18/d1a/d12e/c132 27 1 2024-09-21T11:39:34.636 INFO:tasks.workunit.client.0.smithi118.stdout:0/872: chown d5/d10/d1e/d21/fcf 7636 1 2024-09-21T11:39:34.639 INFO:tasks.workunit.client.0.smithi118.stdout:7/644: readlink d0/d3/d13/lba 0 2024-09-21T11:39:34.642 INFO:tasks.workunit.client.0.smithi118.stdout:3/511: write d5/d28/d3e/f8f [4758684,31701] 0 2024-09-21T11:39:34.644 INFO:tasks.workunit.client.0.smithi118.stdout:3/512: dread - d5/d1d/d1b/d4c/d91/fa2 zero size 2024-09-21T11:39:34.648 INFO:tasks.workunit.client.0.smithi118.stdout:8/967: dread d2/f7 [0,4194304] 0 2024-09-21T11:39:34.650 INFO:tasks.workunit.client.0.smithi118.stdout:7/645: creat d0/d3/d1d/d35/d70/fd4 x:0 0 0 2024-09-21T11:39:34.653 INFO:tasks.workunit.client.0.smithi118.stdout:1/588: creat d6/d2a/fbb x:0 0 0 2024-09-21T11:39:34.654 INFO:tasks.workunit.client.0.smithi118.stdout:3/513: mknod d5/d1d/d8c/cbd 0 2024-09-21T11:39:34.654 INFO:tasks.workunit.client.0.smithi118.stdout:1/589: rename d6/d2a/d3d to d6/d2a/d3d/db9/dbc 22 2024-09-21T11:39:34.656 INFO:tasks.workunit.client.0.smithi118.stdout:3/514: dread - d5/d28/d3e/d5d/d5f/f98 zero size 2024-09-21T11:39:34.659 INFO:tasks.workunit.client.0.smithi118.stdout:7/646: dwrite d0/d3/d13/d8f/fa7 [0,4194304] 0 2024-09-21T11:39:34.663 INFO:tasks.workunit.client.0.smithi118.stdout:7/647: stat d0/d3/d1d/d35/d57/f91 0 2024-09-21T11:39:34.664 INFO:tasks.workunit.client.0.smithi118.stdout:6/491: dwrite d8/d14/f1d [0,4194304] 0 2024-09-21T11:39:34.667 INFO:tasks.workunit.client.0.smithi118.stdout:6/492: read - d8/d48/d72/d7e/f95 zero size 2024-09-21T11:39:34.670 INFO:tasks.workunit.client.0.smithi118.stdout:1/590: unlink d6/de/d16/f92 0 2024-09-21T11:39:34.670 INFO:tasks.workunit.client.0.smithi118.stdout:3/515: truncate d5/d1d/d1b/d50/f5a 3497267 0 2024-09-21T11:39:34.670 INFO:tasks.workunit.client.0.smithi118.stdout:0/873: getdents d5/d10/d1e/d20/dc7 0 2024-09-21T11:39:34.672 INFO:tasks.workunit.client.0.smithi118.stdout:7/648: mkdir d0/d3/d13/dd5 0 2024-09-21T11:39:34.676 INFO:tasks.workunit.client.0.smithi118.stdout:6/493: unlink d8/d48/d72/f9a 0 2024-09-21T11:39:34.677 INFO:tasks.workunit.client.0.smithi118.stdout:6/494: chown d8/d14/d33 1200 1 2024-09-21T11:39:34.677 INFO:tasks.workunit.client.0.smithi118.stdout:8/968: truncate d2/dc/d49/d84/feb 1705117 0 2024-09-21T11:39:34.680 INFO:tasks.workunit.client.0.smithi118.stdout:0/874: mkdir d5/d10/d1e/d23/d3a/d4e/dfc/d125 0 2024-09-21T11:39:34.681 INFO:tasks.workunit.client.0.smithi118.stdout:7/649: dwrite d0/d3/d14/d41/fbf [0,4194304] 0 2024-09-21T11:39:34.687 INFO:tasks.workunit.client.0.smithi118.stdout:8/969: rmdir d2/dc/d10/d2e/d18 39 2024-09-21T11:39:34.690 INFO:tasks.workunit.client.0.smithi118.stdout:6/495: dread - d8/d48/d45/d61/d70/d7d/f8c zero size 2024-09-21T11:39:34.693 INFO:tasks.workunit.client.0.smithi118.stdout:7/650: creat d0/d3/d14/d41/d66/d6d/fd6 x:0 0 0 2024-09-21T11:39:34.698 INFO:tasks.workunit.client.0.smithi118.stdout:8/970: mknod d2/dc/d10/d3b/d101/c146 0 2024-09-21T11:39:34.701 INFO:tasks.workunit.client.0.smithi118.stdout:3/516: truncate d5/d28/f71 5223787 0 2024-09-21T11:39:34.702 INFO:tasks.workunit.client.0.smithi118.stdout:7/651: read d0/d3/d1d/f45 [504483,53838] 0 2024-09-21T11:39:34.703 INFO:tasks.workunit.client.0.smithi118.stdout:3/517: dread - d5/d28/d3e/fa8 zero size 2024-09-21T11:39:34.706 INFO:tasks.workunit.client.0.smithi118.stdout:6/496: truncate d8/d14/f2b 1164018 0 2024-09-21T11:39:34.706 INFO:tasks.workunit.client.0.smithi118.stdout:0/875: link d5/d10/d1e/d21/fbb d5/d10/d1e/d20/dc7/f126 0 2024-09-21T11:39:34.716 INFO:tasks.workunit.client.0.smithi118.stdout:6/497: creat d8/d48/d6c/f9e x:0 0 0 2024-09-21T11:39:34.720 INFO:tasks.workunit.client.0.smithi118.stdout:7/652: creat d0/d3/d14/d41/d8b/da4/db2/fd7 x:0 0 0 2024-09-21T11:39:34.723 INFO:tasks.workunit.client.0.smithi118.stdout:8/971: rename d2/dc/d10/d2e/d18/f4f to d2/dc/d10/d2e/d18/d36/f147 0 2024-09-21T11:39:34.727 INFO:tasks.workunit.client.0.smithi118.stdout:3/518: dwrite d5/d1d/f16 [0,4194304] 0 2024-09-21T11:39:34.729 INFO:tasks.workunit.client.0.smithi118.stdout:7/653: rename d0/d3/d13/f92 to d0/d3/d1d/d35/d57/d7e/d82/fd8 0 2024-09-21T11:39:34.735 INFO:tasks.workunit.client.0.smithi118.stdout:6/498: mkdir d8/d48/d9f 0 2024-09-21T11:39:34.739 INFO:tasks.workunit.client.0.smithi118.stdout:7/654: dwrite d0/d3/d14/d41/d66/d6d/fd6 [0,4194304] 0 2024-09-21T11:39:34.744 INFO:tasks.workunit.client.0.smithi118.stdout:3/519: mknod d5/d28/d3e/d5d/cbe 0 2024-09-21T11:39:34.746 INFO:tasks.workunit.client.0.smithi118.stdout:0/876: dwrite d5/d10/d1e/d21/fbb [0,4194304] 0 2024-09-21T11:39:34.748 INFO:tasks.workunit.client.0.smithi118.stdout:8/972: dwrite d2/dc/d10/d2e/d9b/dcc/f13b [0,4194304] 0 2024-09-21T11:39:34.749 INFO:tasks.workunit.client.0.smithi118.stdout:7/655: dread - d0/d3/d29/f6b zero size 2024-09-21T11:39:34.750 INFO:tasks.workunit.client.0.smithi118.stdout:6/499: creat d8/d48/d6c/d64/fa0 x:0 0 0 2024-09-21T11:39:34.754 INFO:tasks.workunit.client.0.smithi118.stdout:6/500: chown d8/d48/d45/c74 290380 1 2024-09-21T11:39:34.761 INFO:tasks.workunit.client.0.smithi118.stdout:3/520: dwrite d5/d1d/d1b/d4c/d73/fb6 [0,4194304] 0 2024-09-21T11:39:34.762 INFO:tasks.workunit.client.0.smithi118.stdout:0/877: unlink d5/d29/d68/d7b/db7/fac 0 2024-09-21T11:39:34.767 INFO:tasks.workunit.client.0.smithi118.stdout:3/521: write d5/d1d/d1b/d24/f60 [28405,31715] 0 2024-09-21T11:39:34.770 INFO:tasks.workunit.client.0.smithi118.stdout:7/656: dwrite d0/d3/d13/d8f/fc7 [0,4194304] 0 2024-09-21T11:39:34.771 INFO:tasks.workunit.client.0.smithi118.stdout:6/501: dwrite d8/d48/d45/d61/d66/f86 [0,4194304] 0 2024-09-21T11:39:34.773 INFO:tasks.workunit.client.0.smithi118.stdout:6/502: stat d8/f93 0 2024-09-21T11:39:34.773 INFO:tasks.workunit.client.0.smithi118.stdout:3/522: chown d5/d1d/d1b/d4b/c9f 72 1 2024-09-21T11:39:34.777 INFO:tasks.workunit.client.0.smithi118.stdout:3/523: read - d5/f57 zero size 2024-09-21T11:39:34.777 INFO:tasks.workunit.client.0.smithi118.stdout:7/657: truncate d0/d3/d29/f20 4311484 0 2024-09-21T11:39:34.779 INFO:tasks.workunit.client.0.smithi118.stdout:0/878: dwrite d5/d10/d1e/d21/db3/dbe/fd0 [0,4194304] 0 2024-09-21T11:39:34.780 INFO:tasks.workunit.client.0.smithi118.stdout:6/503: mkdir d8/d48/d9f/da1 0 2024-09-21T11:39:34.786 INFO:tasks.workunit.client.0.smithi118.stdout:7/658: mkdir d0/d3/dd9 0 2024-09-21T11:39:34.791 INFO:tasks.workunit.client.0.smithi118.stdout:3/524: link d5/d1d/f16 d5/d1d/d1b/d4c/fbf 0 2024-09-21T11:39:34.792 INFO:tasks.workunit.client.0.smithi118.stdout:3/525: readlink d5/d28/d3e/l52 0 2024-09-21T11:39:34.795 INFO:tasks.workunit.client.0.smithi118.stdout:8/973: write d2/dc/d49/f112 [56566,122210] 0 2024-09-21T11:39:34.796 INFO:tasks.workunit.client.0.smithi118.stdout:7/659: mkdir d0/d3/d29/d5f/d71/dda 0 2024-09-21T11:39:34.798 INFO:tasks.workunit.client.0.smithi118.stdout:6/504: fsync d8/d14/f2b 0 2024-09-21T11:39:34.801 INFO:tasks.workunit.client.0.smithi118.stdout:3/526: creat d5/d1d/d1b/d24/fc0 x:0 0 0 2024-09-21T11:39:34.804 INFO:tasks.workunit.client.0.smithi118.stdout:8/974: unlink d2/d32/l40 0 2024-09-21T11:39:34.805 INFO:tasks.workunit.client.0.smithi118.stdout:7/660: unlink d0/d3/d29/d5f/fd1 0 2024-09-21T11:39:34.809 INFO:tasks.workunit.client.0.smithi118.stdout:6/505: rmdir d8/d48/d5f 39 2024-09-21T11:39:34.809 INFO:tasks.workunit.client.0.smithi118.stdout:3/527: dread d5/d28/f94 [0,4194304] 0 2024-09-21T11:39:34.820 INFO:tasks.workunit.client.0.smithi118.stdout:0/879: dwrite d5/d34/d44/ff6 [0,4194304] 0 2024-09-21T11:39:34.821 INFO:tasks.workunit.client.0.smithi118.stdout:8/975: symlink d2/dc/d35/d50/dad/d13d/l148 0 2024-09-21T11:39:34.823 INFO:tasks.workunit.client.0.smithi118.stdout:7/661: mknod d0/d3/d13/cdb 0 2024-09-21T11:39:34.825 INFO:tasks.workunit.client.0.smithi118.stdout:7/662: dread - d0/d3/d14/d41/d8b/da4/db2/fd7 zero size 2024-09-21T11:39:34.826 INFO:tasks.workunit.client.0.smithi118.stdout:3/528: mkdir d5/d1d/d1b/d4b/dc1 0 2024-09-21T11:39:34.829 INFO:tasks.workunit.client.0.smithi118.stdout:3/529: chown d5/d1d/d1b/d4c/d73/c84 2879536 1 2024-09-21T11:39:34.833 INFO:tasks.workunit.client.0.smithi118.stdout:6/506: dwrite d8/d48/d5f/f7c [4194304,4194304] 0 2024-09-21T11:39:34.835 INFO:tasks.workunit.client.0.smithi118.stdout:7/663: creat d0/d3/d29/d5f/d71/fdc x:0 0 0 2024-09-21T11:39:34.840 INFO:tasks.workunit.client.0.smithi118.stdout:7/664: read d0/d3/d1d/d35/d57/f91 [5367384,78110] 0 2024-09-21T11:39:34.843 INFO:tasks.workunit.client.0.smithi118.stdout:8/976: write d2/dc/d35/fe1 [1517913,76225] 0 2024-09-21T11:39:34.846 INFO:tasks.workunit.client.0.smithi118.stdout:8/977: fsync d2/dc/d10/d2e/f5f 0 2024-09-21T11:39:34.847 INFO:tasks.workunit.client.0.smithi118.stdout:8/978: dread - d2/dc/d16/d46/f10c zero size 2024-09-21T11:39:34.848 INFO:tasks.workunit.client.0.smithi118.stdout:8/979: stat d2/dc/d35/l3e 0 2024-09-21T11:39:34.851 INFO:tasks.workunit.client.0.smithi118.stdout:6/507: dread d8/fc [4194304,4194304] 0 2024-09-21T11:39:34.858 INFO:tasks.workunit.client.0.smithi118.stdout:8/980: truncate d2/d73/f92 12364 0 2024-09-21T11:39:34.858 INFO:tasks.workunit.client.0.smithi118.stdout:6/508: write d8/f5c [765809,119856] 0 2024-09-21T11:39:34.862 INFO:tasks.workunit.client.0.smithi118.stdout:8/981: creat d2/dc/d10/d2e/f149 x:0 0 0 2024-09-21T11:39:34.870 INFO:tasks.workunit.client.0.smithi118.stdout:6/509: dwrite d8/f22 [0,4194304] 0 2024-09-21T11:39:34.873 INFO:tasks.workunit.client.0.smithi118.stdout:8/982: truncate d2/dc/d49/d84/d99/f12d 3529574 0 2024-09-21T11:39:34.876 INFO:tasks.workunit.client.0.smithi118.stdout:6/510: mkdir d8/d48/d5f/d8d/da2 0 2024-09-21T11:39:34.884 INFO:tasks.workunit.client.0.smithi118.stdout:8/983: write d2/dc/d35/dab/fcd [970393,58946] 0 2024-09-21T11:39:34.885 INFO:tasks.workunit.client.0.smithi118.stdout:6/511: rename d8/d48/d5f/d8d to d8/d48/d5f/da3 0 2024-09-21T11:39:34.886 INFO:tasks.workunit.client.0.smithi118.stdout:6/512: truncate d8/d48/d45/f4d 12832042 0 2024-09-21T11:39:34.887 INFO:tasks.workunit.client.0.smithi118.stdout:6/513: chown d8/d48/d45/c74 1453 1 2024-09-21T11:39:34.889 INFO:tasks.workunit.client.0.smithi118.stdout:6/514: rmdir d8/d48 39 2024-09-21T11:39:34.890 INFO:tasks.workunit.client.0.smithi118.stdout:8/984: creat d2/dc/d49/d84/f14a x:0 0 0 2024-09-21T11:39:34.891 INFO:tasks.workunit.client.0.smithi118.stdout:8/985: write d2/dc/d16/d46/f69 [974435,17898] 0 2024-09-21T11:39:34.892 INFO:tasks.workunit.client.0.smithi118.stdout:8/986: fdatasync d2/dc/d49/d84/f14a 0 2024-09-21T11:39:34.907 INFO:tasks.workunit.client.0.smithi118.stdout:8/987: dwrite d2/f29 [0,4194304] 0 2024-09-21T11:39:34.910 INFO:tasks.workunit.client.0.smithi118.stdout:6/515: dread d8/d48/f31 [0,4194304] 0 2024-09-21T11:39:34.915 INFO:tasks.workunit.client.0.smithi118.stdout:6/516: getdents d8/d48/d45/d61/d66 0 2024-09-21T11:39:34.917 INFO:tasks.workunit.client.0.smithi118.stdout:8/988: dwrite d2/dc/d16/d46/d4c/d63/db9/f12c [0,4194304] 0 2024-09-21T11:39:34.918 INFO:tasks.workunit.client.0.smithi118.stdout:6/517: truncate d8/d14/d33/d92/f94 60005 0 2024-09-21T11:39:34.918 INFO:tasks.workunit.client.0.smithi118.stdout:8/989: chown d2/dc/d10/d3b/d101/d103/de7/lf2 204 1 2024-09-21T11:39:34.920 INFO:tasks.workunit.client.0.smithi118.stdout:6/518: symlink d8/d48/d9f/la4 0 2024-09-21T11:39:34.922 INFO:tasks.workunit.client.0.smithi118.stdout:8/990: getdents d2/d7c 0 2024-09-21T11:39:34.934 INFO:tasks.workunit.client.0.smithi118.stdout:8/991: dread d2/dc/d10/d2e/dba/f116 [0,4194304] 0 2024-09-21T11:39:34.937 INFO:tasks.workunit.client.0.smithi118.stdout:8/992: fsync d2/dc/d10/d2e/d18/d1a/f98 0 2024-09-21T11:39:34.940 INFO:tasks.workunit.client.0.smithi118.stdout:8/993: creat d2/dc/d49/df1/f14b x:0 0 0 2024-09-21T11:39:34.942 INFO:tasks.workunit.client.0.smithi118.stdout:8/994: creat d2/d7c/f14c x:0 0 0 2024-09-21T11:39:34.947 INFO:tasks.workunit.client.0.smithi118.stdout:8/995: link d2/dc/d10/d3b/d101/c146 d2/d7c/d88/dc2/c14d 0 2024-09-21T11:39:34.948 INFO:tasks.workunit.client.0.smithi118.stdout:6/519: dread d8/f60 [0,4194304] 0 2024-09-21T11:39:34.949 INFO:tasks.workunit.client.0.smithi118.stdout:8/996: chown d2/dc/d10/d2e/l1d 985113 1 2024-09-21T11:39:34.950 INFO:tasks.workunit.client.0.smithi118.stdout:6/520: symlink d8/d48/d45/d61/d70/la5 0 2024-09-21T11:39:34.951 INFO:tasks.workunit.client.0.smithi118.stdout:8/997: unlink d2/c7a 0 2024-09-21T11:39:34.952 INFO:tasks.workunit.client.0.smithi118.stdout:6/521: creat d8/d14/d33/fa6 x:0 0 0 2024-09-21T11:39:34.964 INFO:tasks.workunit.client.0.smithi118.stdout:8/998: write d2/d32/f59 [3736280,92051] 0 2024-09-21T11:39:34.964 INFO:tasks.workunit.client.0.smithi118.stdout:6/522: write d8/d48/d45/d61/d70/f84 [604143,69681] 0 2024-09-21T11:39:34.967 INFO:tasks.workunit.client.0.smithi118.stdout:6/523: creat d8/d48/d5f/da3/fa7 x:0 0 0 2024-09-21T11:39:34.970 INFO:tasks.workunit.client.0.smithi118.stdout:8/999: rename d2/dc/d10/d3b/l51 to d2/dc/d16/d46/d4c/d63/d10b/l14e 0 2024-09-21T11:39:34.979 INFO:tasks.workunit.client.0.smithi118.stdout:6/524: truncate d8/d14/f1d 1007576 0 2024-09-21T11:39:35.260 INFO:tasks.workunit.client.0.smithi118.stdout:9/648: sync 2024-09-21T11:39:35.263 INFO:tasks.workunit.client.0.smithi118.stdout:9/649: fdatasync d0/f5c 0 2024-09-21T11:39:35.265 INFO:tasks.workunit.client.0.smithi118.stdout:9/650: write d0/d20/d4c/d5f/d6c/d88/db9/fde [249660,32527] 0 2024-09-21T11:39:35.270 INFO:tasks.workunit.client.0.smithi118.stdout:9/651: creat d0/d4/d38/db8/de9/fee x:0 0 0 2024-09-21T11:39:35.271 INFO:tasks.workunit.client.0.smithi118.stdout:9/652: stat d0/f7e 0 2024-09-21T11:39:35.274 INFO:tasks.workunit.client.0.smithi118.stdout:9/653: creat d0/d4/d38/db8/fef x:0 0 0 2024-09-21T11:39:35.275 INFO:tasks.workunit.client.0.smithi118.stdout:9/654: read d0/d4/d45/f48 [1342308,71637] 0 2024-09-21T11:39:35.422 INFO:tasks.workunit.client.0.smithi118.stdout:5/589: sync 2024-09-21T11:39:35.422 INFO:tasks.workunit.client.0.smithi118.stdout:4/540: sync 2024-09-21T11:39:35.422 INFO:tasks.workunit.client.0.smithi118.stdout:2/509: sync 2024-09-21T11:39:35.423 INFO:tasks.workunit.client.0.smithi118.stdout:2/510: read de/f19 [70735,72985] 0 2024-09-21T11:39:35.424 INFO:tasks.workunit.client.0.smithi118.stdout:5/590: mkdir d0/d6c/d67/d92/dc8 0 2024-09-21T11:39:35.425 INFO:tasks.workunit.client.0.smithi118.stdout:4/541: fsync d2/d6/dd/f33 0 2024-09-21T11:39:35.426 INFO:tasks.workunit.client.0.smithi118.stdout:2/511: chown de/l2c 12397 1 2024-09-21T11:39:35.427 INFO:tasks.workunit.client.0.smithi118.stdout:2/512: chown de/d1f/d20/d67/d8a/d6d/d70 1144949145 1 2024-09-21T11:39:35.430 INFO:tasks.workunit.client.0.smithi118.stdout:2/513: creat de/d50/d85/fab x:0 0 0 2024-09-21T11:39:35.432 INFO:tasks.workunit.client.0.smithi118.stdout:2/514: creat de/d1f/d20/d67/d8a/fac x:0 0 0 2024-09-21T11:39:35.432 INFO:tasks.workunit.client.0.smithi118.stdout:2/515: fsync de/d16/d1c/d65/fa8 0 2024-09-21T11:39:35.434 INFO:tasks.workunit.client.0.smithi118.stdout:2/516: unlink de/d16/ca7 0 2024-09-21T11:39:35.440 INFO:tasks.workunit.client.0.smithi118.stdout:2/517: dwrite de/d16/d1c/d65/fa8 [0,4194304] 0 2024-09-21T11:39:35.455 INFO:tasks.workunit.client.0.smithi118.stdout:2/518: rename de/d16/d1c/d65/fa8 to de/d51/fad 0 2024-09-21T11:39:35.489 INFO:tasks.workunit.client.0.smithi118.stdout:2/519: link de/d1f/l44 de/d51/lae 0 2024-09-21T11:39:35.490 INFO:tasks.workunit.client.0.smithi118.stdout:2/520: truncate de/d53/f8d 488356 0 2024-09-21T11:39:35.490 INFO:tasks.workunit.client.0.smithi118.stdout:2/521: chown de/d16/d1c/d66/c68 1 1 2024-09-21T11:39:35.492 INFO:tasks.workunit.client.0.smithi118.stdout:2/522: creat de/d50/d85/faf x:0 0 0 2024-09-21T11:39:35.508 INFO:tasks.workunit.client.0.smithi118.stdout:2/523: dread de/d16/d31/f3d [0,4194304] 0 2024-09-21T11:39:35.513 INFO:tasks.workunit.client.0.smithi118.stdout:2/524: link de/f19 de/d1f/d20/fb0 0 2024-09-21T11:39:35.514 INFO:tasks.workunit.client.0.smithi118.stdout:2/525: chown de/d1f/d20/d67/d8a/d6d/d70 1147 1 2024-09-21T11:39:35.514 INFO:tasks.workunit.client.0.smithi118.stdout:2/526: fsync de/d1f/d20/f55 0 2024-09-21T11:39:35.517 INFO:tasks.workunit.client.0.smithi118.stdout:2/527: mknod de/d51/cb1 0 2024-09-21T11:39:35.521 INFO:tasks.workunit.client.0.smithi118.stdout:2/528: creat de/d16/fb2 x:0 0 0 2024-09-21T11:39:35.522 INFO:tasks.workunit.client.0.smithi118.stdout:2/529: dread - de/d16/d1c/d65/da2/d9b/f92 zero size 2024-09-21T11:39:35.553 INFO:tasks.workunit.client.0.smithi118.stdout:2/530: write f8 [1158645,101393] 0 2024-09-21T11:39:35.556 INFO:tasks.workunit.client.0.smithi118.stdout:2/531: creat de/d53/fb3 x:0 0 0 2024-09-21T11:39:35.560 INFO:tasks.workunit.client.0.smithi118.stdout:2/532: rename de/d16/f58 to de/d1f/d20/d78/fb4 0 2024-09-21T11:39:35.567 INFO:tasks.workunit.client.0.smithi118.stdout:2/533: dwrite de/d53/f8d [0,4194304] 0 2024-09-21T11:39:35.575 INFO:tasks.workunit.client.0.smithi118.stdout:2/534: dwrite de/d1f/d20/d67/d8a/d6d/d70/f91 [0,4194304] 0 2024-09-21T11:39:35.577 INFO:tasks.workunit.client.0.smithi118.stdout:2/535: read de/d22/d3c/f7b [2885117,53964] 0 2024-09-21T11:39:35.583 INFO:tasks.workunit.client.0.smithi118.stdout:2/536: truncate de/d1f/d20/f55 3204512 0 2024-09-21T11:39:35.586 INFO:tasks.workunit.client.0.smithi118.stdout:2/537: mkdir de/d16/d31/d7a/db5 0 2024-09-21T11:39:35.592 INFO:tasks.workunit.client.0.smithi118.stdout:2/538: dwrite de/d16/d1c/d66/f87 [0,4194304] 0 2024-09-21T11:39:35.594 INFO:tasks.workunit.client.0.smithi118.stdout:2/539: write de/d1f/f4c [11593994,99413] 0 2024-09-21T11:39:35.598 INFO:tasks.workunit.client.0.smithi118.stdout:2/540: fdatasync de/d16/d1c/d65/da2/f74 0 2024-09-21T11:39:35.599 INFO:tasks.workunit.client.0.smithi118.stdout:2/541: read - de/d16/d1c/d65/da2/d9b/f92 zero size 2024-09-21T11:39:35.600 INFO:tasks.workunit.client.0.smithi118.stdout:2/542: chown de/d16/d1c/d4f/d5b/l5f 1515 1 2024-09-21T11:39:35.601 INFO:tasks.workunit.client.0.smithi118.stdout:2/543: write de/d1f/d20/d67/d8a/fac [56813,115725] 0 2024-09-21T11:39:35.607 INFO:tasks.workunit.client.0.smithi118.stdout:2/544: dwrite de/f2a [0,4194304] 0 2024-09-21T11:39:35.610 INFO:tasks.workunit.client.0.smithi118.stdout:2/545: fdatasync de/f1e 0 2024-09-21T11:39:35.613 INFO:tasks.workunit.client.0.smithi118.stdout:2/546: mknod de/d50/d85/cb6 0 2024-09-21T11:39:35.615 INFO:tasks.workunit.client.0.smithi118.stdout:2/547: creat de/d1f/d20/fb7 x:0 0 0 2024-09-21T11:39:35.617 INFO:tasks.workunit.client.0.smithi118.stdout:2/548: mknod de/d1f/d20/d78/cb8 0 2024-09-21T11:39:35.627 INFO:tasks.workunit.client.0.smithi118.stdout:2/549: write de/d51/fa9 [343452,4343] 0 2024-09-21T11:39:35.629 INFO:tasks.workunit.client.0.smithi118.stdout:2/550: dread de/f19 [0,4194304] 0 2024-09-21T11:39:35.631 INFO:tasks.workunit.client.0.smithi118.stdout:2/551: creat de/d16/d1c/fb9 x:0 0 0 2024-09-21T11:39:35.632 INFO:tasks.workunit.client.0.smithi118.stdout:2/552: chown de/d16/d1c/d65/f82 45371 1 2024-09-21T11:39:35.636 INFO:tasks.workunit.client.0.smithi118.stdout:2/553: rename de/d16/d31/d7a to de/d16/d25/dba 0 2024-09-21T11:39:35.636 INFO:tasks.workunit.client.0.smithi118.stdout:2/554: write de/d51/f5c [2254439,82726] 0 2024-09-21T11:39:35.641 INFO:tasks.workunit.client.0.smithi118.stdout:2/555: dread de/d22/d3c/f8e [0,4194304] 0 2024-09-21T11:39:35.643 INFO:tasks.workunit.client.0.smithi118.stdout:2/556: symlink de/d16/d31/lbb 0 2024-09-21T11:39:35.646 INFO:tasks.workunit.client.0.smithi118.stdout:2/557: mknod de/d16/d25/cbc 0 2024-09-21T11:39:35.648 INFO:tasks.workunit.client.0.smithi118.stdout:2/558: creat de/d16/d1c/d66/fbd x:0 0 0 2024-09-21T11:39:35.648 INFO:tasks.workunit.client.0.smithi118.stdout:2/559: readlink de/d51/l56 0 2024-09-21T11:39:35.653 INFO:tasks.workunit.client.0.smithi118.stdout:2/560: dwrite de/d16/d1c/d66/fbd [0,4194304] 0 2024-09-21T11:39:35.655 INFO:tasks.workunit.client.0.smithi118.stdout:2/561: read de/d53/f8d [3049395,94318] 0 2024-09-21T11:39:35.656 INFO:tasks.workunit.client.0.smithi118.stdout:2/562: write de/d53/fb3 [552187,20115] 0 2024-09-21T11:39:35.664 INFO:tasks.workunit.client.0.smithi118.stdout:2/563: mknod de/d1f/d20/cbe 0 2024-09-21T11:39:35.672 INFO:tasks.workunit.client.0.smithi118.stdout:2/564: dwrite de/d16/d1c/d65/f82 [0,4194304] 0 2024-09-21T11:39:35.675 INFO:tasks.workunit.client.0.smithi118.stdout:2/565: mknod de/d53/cbf 0 2024-09-21T11:39:35.681 INFO:tasks.workunit.client.0.smithi118.stdout:2/566: creat de/d16/d25/dba/fc0 x:0 0 0 2024-09-21T11:39:35.681 INFO:tasks.workunit.client.0.smithi118.stdout:2/567: chown de/d50/d85/c95 485 1 2024-09-21T11:39:35.683 INFO:tasks.workunit.client.0.smithi118.stdout:2/568: creat de/d16/d25/dba/fc1 x:0 0 0 2024-09-21T11:39:35.684 INFO:tasks.workunit.client.0.smithi118.stdout:2/569: mkdir de/d53/dc2 0 2024-09-21T11:39:35.685 INFO:tasks.workunit.client.0.smithi118.stdout:2/570: dread de/f1e [0,4194304] 0 2024-09-21T11:39:35.690 INFO:tasks.workunit.client.0.smithi118.stdout:7/665: sync 2024-09-21T11:39:35.690 INFO:tasks.workunit.client.0.smithi118.stdout:0/880: sync 2024-09-21T11:39:35.690 INFO:tasks.workunit.client.0.smithi118.stdout:3/530: sync 2024-09-21T11:39:35.690 INFO:tasks.workunit.client.0.smithi118.stdout:6/525: sync 2024-09-21T11:39:35.690 INFO:tasks.workunit.client.0.smithi118.stdout:1/591: sync 2024-09-21T11:39:35.692 INFO:tasks.workunit.client.0.smithi118.stdout:7/666: stat d0/d3/d13/f2f 0 2024-09-21T11:39:35.696 INFO:tasks.workunit.client.0.smithi118.stdout:2/571: dread de/d1f/d20/f55 [0,4194304] 0 2024-09-21T11:39:35.697 INFO:tasks.workunit.client.0.smithi118.stdout:3/531: symlink d5/d1d/d1b/lc2 0 2024-09-21T11:39:35.700 INFO:tasks.workunit.client.0.smithi118.stdout:1/592: truncate d6/d33/d3c/f98 701686 0 2024-09-21T11:39:35.702 INFO:tasks.workunit.client.0.smithi118.stdout:6/526: symlink d8/d48/d45/d61/la8 0 2024-09-21T11:39:35.704 INFO:tasks.workunit.client.0.smithi118.stdout:6/527: chown d8/d14/f2d 116986 1 2024-09-21T11:39:35.704 INFO:tasks.workunit.client.0.smithi118.stdout:0/881: dwrite d5/d10/d1e/d20/fd5 [0,4194304] 0 2024-09-21T11:39:35.706 INFO:tasks.workunit.client.0.smithi118.stdout:3/532: rename d5/d1d/f12 to d5/d1d/d8c/fc3 0 2024-09-21T11:39:35.708 INFO:tasks.workunit.client.0.smithi118.stdout:7/667: dwrite d0/d3/d29/f75 [0,4194304] 0 2024-09-21T11:39:35.709 INFO:tasks.workunit.client.0.smithi118.stdout:3/533: fsync d5/d28/d3e/d5d/d5f/f6d 0 2024-09-21T11:39:35.709 INFO:tasks.workunit.client.0.smithi118.stdout:1/593: symlink d6/de/d13/d84/d96/d9e/lbd 0 2024-09-21T11:39:35.713 INFO:tasks.workunit.client.0.smithi118.stdout:0/882: symlink d5/d10/d1e/d20/dc7/l127 0 2024-09-21T11:39:35.715 INFO:tasks.workunit.client.0.smithi118.stdout:1/594: read d6/d2a/f69 [548433,105531] 0 2024-09-21T11:39:35.716 INFO:tasks.workunit.client.0.smithi118.stdout:6/528: dwrite d8/f5c [0,4194304] 0 2024-09-21T11:39:35.723 INFO:tasks.workunit.client.0.smithi118.stdout:6/529: creat d8/d46/fa9 x:0 0 0 2024-09-21T11:39:35.724 INFO:tasks.workunit.client.0.smithi118.stdout:1/595: unlink d6/de/d16/f29 0 2024-09-21T11:39:35.727 INFO:tasks.workunit.client.0.smithi118.stdout:3/534: rename d5/d1d/d1b/d4c/d91/d69/d99 to d5/d1d/d1b/d4c/d73/dc4 0 2024-09-21T11:39:35.731 INFO:tasks.workunit.client.0.smithi118.stdout:1/596: mknod d6/d33/d7a/cbe 0 2024-09-21T11:39:35.733 INFO:tasks.workunit.client.0.smithi118.stdout:6/530: creat d8/d48/d5f/da3/da2/faa x:0 0 0 2024-09-21T11:39:35.736 INFO:tasks.workunit.client.0.smithi118.stdout:1/597: creat d6/d33/d3c/fbf x:0 0 0 2024-09-21T11:39:35.740 INFO:tasks.workunit.client.0.smithi118.stdout:0/883: dwrite d5/f7e [0,4194304] 0 2024-09-21T11:39:35.744 INFO:tasks.workunit.client.0.smithi118.stdout:1/598: dread d6/de/f11 [0,4194304] 0 2024-09-21T11:39:35.746 INFO:tasks.workunit.client.0.smithi118.stdout:7/668: dread d0/d3/d14/d41/d66/d9d/fa6 [0,4194304] 0 2024-09-21T11:39:35.749 INFO:tasks.workunit.client.0.smithi118.stdout:3/535: truncate d5/d1d/d1b/d4c/d73/d9b/f97 2023766 0 2024-09-21T11:39:35.749 INFO:tasks.workunit.client.0.smithi118.stdout:3/536: chown d5/d28/d33/l62 918360457 1 2024-09-21T11:39:35.750 INFO:tasks.workunit.client.0.smithi118.stdout:3/537: write d5/d1d/d1b/d24/fc0 [931373,53740] 0 2024-09-21T11:39:35.751 INFO:tasks.workunit.client.0.smithi118.stdout:1/599: unlink d6/de/d16/d3f/fa2 0 2024-09-21T11:39:35.759 INFO:tasks.workunit.client.0.smithi118.stdout:0/884: dwrite d5/d29/fb2 [0,4194304] 0 2024-09-21T11:39:35.763 INFO:tasks.workunit.client.0.smithi118.stdout:1/600: dwrite d6/d33/d3c/f68 [0,4194304] 0 2024-09-21T11:39:35.765 INFO:tasks.workunit.client.0.smithi118.stdout:7/669: write d0/d3/d1d/d35/f58 [3468590,8209] 0 2024-09-21T11:39:35.767 INFO:tasks.workunit.client.0.smithi118.stdout:3/538: write d5/d1d/d1b/d24/f6c [135060,127337] 0 2024-09-21T11:39:35.772 INFO:tasks.workunit.client.0.smithi118.stdout:3/539: symlink d5/d1d/d1b/d4c/d91/lc5 0 2024-09-21T11:39:35.776 INFO:tasks.workunit.client.0.smithi118.stdout:7/670: rename d0/d3/d1d/d35/d57/d7e/fc3 to d0/d3/d1d/d35/d57/d96/d9e/fdd 0 2024-09-21T11:39:35.778 INFO:tasks.workunit.client.0.smithi118.stdout:3/540: dwrite d5/d1d/d1b/d4c/f9e [0,4194304] 0 2024-09-21T11:39:35.779 INFO:tasks.workunit.client.0.smithi118.stdout:7/671: read d0/d3/d14/d41/f6f [1827454,42583] 0 2024-09-21T11:39:35.784 INFO:tasks.workunit.client.0.smithi118.stdout:7/672: rename d0/l7c to d0/d3/d14/d41/d66/d6d/lde 0 2024-09-21T11:39:35.786 INFO:tasks.workunit.client.0.smithi118.stdout:7/673: symlink d0/d3/d14/d41/d66/d6d/ldf 0 2024-09-21T11:39:35.789 INFO:tasks.workunit.client.0.smithi118.stdout:7/674: mkdir d0/d3/d29/d5f/de0 0 2024-09-21T11:39:35.802 INFO:tasks.workunit.client.0.smithi118.stdout:3/541: dwrite d5/d28/f94 [0,4194304] 0 2024-09-21T11:39:35.803 INFO:tasks.workunit.client.0.smithi118.stdout:3/542: write d5/d28/d3e/d5d/d5f/f67 [753312,107531] 0 2024-09-21T11:39:35.807 INFO:tasks.workunit.client.0.smithi118.stdout:7/675: write d0/d3/d1d/d35/d57/d7e/d82/fa3 [841336,51650] 0 2024-09-21T11:39:35.809 INFO:tasks.workunit.client.0.smithi118.stdout:7/676: fsync d0/d3/d29/f76 0 2024-09-21T11:39:35.810 INFO:tasks.workunit.client.0.smithi118.stdout:7/677: fsync d0/d3/d13/fca 0 2024-09-21T11:39:35.820 INFO:tasks.workunit.client.0.smithi118.stdout:3/543: dwrite d5/d1d/d1b/d4c/f63 [0,4194304] 0 2024-09-21T11:39:35.820 INFO:tasks.workunit.client.0.smithi118.stdout:7/678: write d0/d3/d29/d5f/f62 [2795355,12736] 0 2024-09-21T11:39:35.822 INFO:tasks.workunit.client.0.smithi118.stdout:7/679: fdatasync d0/d3/d1d/d35/d70/f80 0 2024-09-21T11:39:35.824 INFO:tasks.workunit.client.0.smithi118.stdout:3/544: mkdir d5/d1d/d1b/d50/dc6 0 2024-09-21T11:39:35.829 INFO:tasks.workunit.client.0.smithi118.stdout:3/545: dread d5/d1d/d1b/d4c/f56 [0,4194304] 0 2024-09-21T11:39:35.830 INFO:tasks.workunit.client.0.smithi118.stdout:7/680: dwrite d0/d3/d14/d41/fbf [0,4194304] 0 2024-09-21T11:39:35.835 INFO:tasks.workunit.client.0.smithi118.stdout:7/681: creat d0/d3/d14/d41/d8b/fe1 x:0 0 0 2024-09-21T11:39:35.836 INFO:tasks.workunit.client.0.smithi118.stdout:7/682: fdatasync d0/d3/d13/d8f/fa7 0 2024-09-21T11:39:35.836 INFO:tasks.workunit.client.0.smithi118.stdout:3/546: symlink d5/d1d/d1b/d50/lc7 0 2024-09-21T11:39:35.850 INFO:tasks.workunit.client.0.smithi118.stdout:7/683: write d0/d3/d29/d47/f72 [852824,94577] 0 2024-09-21T11:39:35.851 INFO:tasks.workunit.client.0.smithi118.stdout:7/684: stat d0/d3/c89 0 2024-09-21T11:39:35.853 INFO:tasks.workunit.client.0.smithi118.stdout:3/547: dread d5/d28/d33/d4a/f4f [0,4194304] 0 2024-09-21T11:39:35.855 INFO:tasks.workunit.client.0.smithi118.stdout:7/685: rename d0/d3/d14/f32 to d0/d3/d14/fe2 0 2024-09-21T11:39:35.856 INFO:tasks.workunit.client.0.smithi118.stdout:7/686: fdatasync d0/fe 0 2024-09-21T11:39:35.858 INFO:tasks.workunit.client.0.smithi118.stdout:7/687: dread - d0/d3/d1d/d35/d57/d7e/fa5 zero size 2024-09-21T11:39:35.858 INFO:tasks.workunit.client.0.smithi118.stdout:7/688: stat d0/d3/d13/f2f 0 2024-09-21T11:39:35.862 INFO:tasks.workunit.client.0.smithi118.stdout:7/689: mknod d0/d3/d14/d41/d7f/ce3 0 2024-09-21T11:39:35.863 INFO:tasks.workunit.client.0.smithi118.stdout:3/548: dread d5/f17 [0,4194304] 0 2024-09-21T11:39:35.865 INFO:tasks.workunit.client.0.smithi118.stdout:3/549: fdatasync d5/d1d/d1b/d4c/d91/f93 0 2024-09-21T11:39:35.868 INFO:tasks.workunit.client.0.smithi118.stdout:7/690: dwrite d0/d3/d14/d41/d7f/f8a [4194304,4194304] 0 2024-09-21T11:39:35.870 INFO:tasks.workunit.client.0.smithi118.stdout:3/550: mkdir d5/d28/d33/d4a/dc8 0 2024-09-21T11:39:35.873 INFO:tasks.workunit.client.0.smithi118.stdout:3/551: mkdir d5/d1d/d1b/da7/dc9 0 2024-09-21T11:39:35.876 INFO:tasks.workunit.client.0.smithi118.stdout:3/552: creat d5/d1d/d1b/d4c/d91/fca x:0 0 0 2024-09-21T11:39:35.877 INFO:tasks.workunit.client.0.smithi118.stdout:3/553: mknod d5/d1d/d1b/d4c/ccb 0 2024-09-21T11:39:35.880 INFO:tasks.workunit.client.0.smithi118.stdout:7/691: dread d0/d3/d29/d47/f84 [0,4194304] 0 2024-09-21T11:39:35.883 INFO:tasks.workunit.client.0.smithi118.stdout:3/554: link d5/d1d/ca6 d5/d1d/d1b/da7/dc9/ccc 0 2024-09-21T11:39:35.886 INFO:tasks.workunit.client.0.smithi118.stdout:7/692: dwrite d0/d3/d14/d41/da0/fad [0,4194304] 0 2024-09-21T11:39:35.888 INFO:tasks.workunit.client.0.smithi118.stdout:3/555: rename d5/d1d/d1b/d4b to d5/d1d/d1b/d24/dcd 0 2024-09-21T11:39:35.894 INFO:tasks.workunit.client.0.smithi118.stdout:7/693: mknod d0/d3/d1d/d35/d57/d7e/d82/ce4 0 2024-09-21T11:39:35.894 INFO:tasks.workunit.client.0.smithi118.stdout:3/556: mknod d5/d1d/d1b/d4c/d91/d69/cce 0 2024-09-21T11:39:35.895 INFO:tasks.workunit.client.0.smithi118.stdout:3/557: fdatasync d5/d1d/d1b/d4c/d73/dc4/fa0 0 2024-09-21T11:39:35.897 INFO:tasks.workunit.client.0.smithi118.stdout:7/694: rename d0/d3/d13/l3b to d0/d3/d1d/d35/d57/d96/le5 0 2024-09-21T11:39:35.898 INFO:tasks.workunit.client.0.smithi118.stdout:7/695: chown d0/d3/d1d/d35/d57/d7e/fa5 25 1 2024-09-21T11:39:35.899 INFO:tasks.workunit.client.0.smithi118.stdout:3/558: rmdir d5/d28/d33 39 2024-09-21T11:39:35.902 INFO:tasks.workunit.client.0.smithi118.stdout:7/696: rename d0/d3/d14/d41/d7f/c5b to d0/d3/d1d/d35/d57/d96/d9e/ce6 0 2024-09-21T11:39:35.904 INFO:tasks.workunit.client.0.smithi118.stdout:3/559: symlink d5/d1d/d1b/da7/daf/lcf 0 2024-09-21T11:39:35.905 INFO:tasks.workunit.client.0.smithi118.stdout:7/697: creat d0/d3/d1d/d35/d57/fe7 x:0 0 0 2024-09-21T11:39:35.905 INFO:tasks.workunit.client.0.smithi118.stdout:3/560: read - d5/d28/d3e/d5d/d5f/fb2 zero size 2024-09-21T11:39:35.907 INFO:tasks.workunit.client.0.smithi118.stdout:3/561: symlink d5/d1d/ld0 0 2024-09-21T11:39:35.908 INFO:tasks.workunit.client.0.smithi118.stdout:3/562: chown d5/d1d/d1b/d50/f59 7726 1 2024-09-21T11:39:35.909 INFO:tasks.workunit.client.0.smithi118.stdout:7/698: dread d0/d3/d29/d47/f72 [0,4194304] 0 2024-09-21T11:39:35.912 INFO:tasks.workunit.client.0.smithi118.stdout:7/699: creat d0/d3/d29/d5f/fe8 x:0 0 0 2024-09-21T11:39:35.915 INFO:tasks.workunit.client.0.smithi118.stdout:3/563: dwrite d5/d1d/d1b/d24/dcd/f96 [0,4194304] 0 2024-09-21T11:39:35.915 INFO:tasks.workunit.client.0.smithi118.stdout:3/564: chown d5/d1d/f81 11 1 2024-09-21T11:39:35.917 INFO:tasks.workunit.client.0.smithi118.stdout:3/565: write d5/d1d/d1b/d24/f5b [60518,65137] 0 2024-09-21T11:39:35.918 INFO:tasks.workunit.client.0.smithi118.stdout:9/655: sync 2024-09-21T11:39:35.924 INFO:tasks.workunit.client.0.smithi118.stdout:9/656: mknod d0/de2/cf0 0 2024-09-21T11:39:35.926 INFO:tasks.workunit.client.0.smithi118.stdout:7/700: getdents d0/d3/d14/d41/d8b/da4/db2 0 2024-09-21T11:39:35.930 INFO:tasks.workunit.client.0.smithi118.stdout:3/566: getdents d5/d1d/d1b/da7 0 2024-09-21T11:39:35.930 INFO:tasks.workunit.client.0.smithi118.stdout:3/567: chown d5/d1d/d1b/da7 46 1 2024-09-21T11:39:35.931 INFO:tasks.workunit.client.0.smithi118.stdout:7/701: unlink d0/d3/f18 0 2024-09-21T11:39:35.932 INFO:tasks.workunit.client.0.smithi118.stdout:9/657: dread d0/d20/d71/f95 [0,4194304] 0 2024-09-21T11:39:35.932 INFO:tasks.workunit.client.0.smithi118.stdout:3/568: chown d5/d28/d33/fab 676065603 1 2024-09-21T11:39:35.933 INFO:tasks.workunit.client.0.smithi118.stdout:9/658: chown d0/d20/d4c/d5f/d6c/d88/c2a 97 1 2024-09-21T11:39:35.934 INFO:tasks.workunit.client.0.smithi118.stdout:7/702: creat d0/d3/d13/fe9 x:0 0 0 2024-09-21T11:39:35.934 INFO:tasks.workunit.client.0.smithi118.stdout:9/659: fsync d0/d20/d4c/d5f/f7b 0 2024-09-21T11:39:35.938 INFO:tasks.workunit.client.0.smithi118.stdout:7/703: dread d0/d3/d14/d41/f6f [4194304,4194304] 0 2024-09-21T11:39:35.939 INFO:tasks.workunit.client.0.smithi118.stdout:9/660: fsync d0/d20/d4c/d5f/d66/d98/fa9 0 2024-09-21T11:39:35.939 INFO:tasks.workunit.client.0.smithi118.stdout:3/569: dwrite d5/d1d/f43 [0,4194304] 0 2024-09-21T11:39:35.945 INFO:tasks.workunit.client.0.smithi118.stdout:7/704: unlink d0/d3/d1d/d35/d70/c8c 0 2024-09-21T11:39:35.948 INFO:tasks.workunit.client.0.smithi118.stdout:3/570: unlink d5/d1d/d1b/d24/dcd/f83 0 2024-09-21T11:39:35.949 INFO:tasks.workunit.client.0.smithi118.stdout:3/571: chown d5/d28/d3e/d5d/d5f/ca9 243563 1 2024-09-21T11:39:35.950 INFO:tasks.workunit.client.0.smithi118.stdout:3/572: chown d5/d1d/d1b/d50/lc7 5013281 1 2024-09-21T11:39:35.950 INFO:tasks.workunit.client.0.smithi118.stdout:9/661: rename d0/f97 to d0/d4/d38/db8/de9/ff1 0 2024-09-21T11:39:35.955 INFO:tasks.workunit.client.0.smithi118.stdout:3/573: rename d5/d28/d3e/l77 to d5/d1d/d1b/da7/ld1 0 2024-09-21T11:39:35.961 INFO:tasks.workunit.client.0.smithi118.stdout:7/705: write d0/d3/d14/f28 [822085,67099] 0 2024-09-21T11:39:35.966 INFO:tasks.workunit.client.0.smithi118.stdout:7/706: chown d0/d3/d1d/d35/d57/cab 312618749 1 2024-09-21T11:39:35.968 INFO:tasks.workunit.client.0.smithi118.stdout:9/662: truncate d0/d20/d4c/d5f/d6c/d88/db9/fd1 1738068 0 2024-09-21T11:39:35.969 INFO:tasks.workunit.client.0.smithi118.stdout:3/574: getdents d5/d1d/d1b/d50 0 2024-09-21T11:39:35.970 INFO:tasks.workunit.client.0.smithi118.stdout:7/707: fdatasync d0/d3/d1d/d35/d57/d7e/f97 0 2024-09-21T11:39:35.971 INFO:tasks.workunit.client.0.smithi118.stdout:3/575: creat d5/d28/d33/fd2 x:0 0 0 2024-09-21T11:39:35.972 INFO:tasks.workunit.client.0.smithi118.stdout:3/576: stat d5/d28/d3e/d5d/d5f/f8b 0 2024-09-21T11:39:35.977 INFO:tasks.workunit.client.0.smithi118.stdout:7/708: unlink d0/d3/d29/f76 0 2024-09-21T11:39:35.978 INFO:tasks.workunit.client.0.smithi118.stdout:3/577: symlink d5/d28/d3e/d5d/d5f/ld3 0 2024-09-21T11:39:35.983 INFO:tasks.workunit.client.0.smithi118.stdout:7/709: dwrite d0/d3/d13/f9a [0,4194304] 0 2024-09-21T11:39:35.983 INFO:tasks.workunit.client.0.smithi118.stdout:9/663: link d0/d20/d4c/d5f/d6c/d88/d4d/fab d0/d20/d4c/d5f/d6c/d88/d4d/dca/ff2 0 2024-09-21T11:39:35.991 INFO:tasks.workunit.client.0.smithi118.stdout:9/664: rename d0/d20/d4c/d5f/f7b to d0/d20/d4c/d5f/d6c/ff3 0 2024-09-21T11:39:35.991 INFO:tasks.workunit.client.0.smithi118.stdout:9/665: fdatasync d0/fbc 0 2024-09-21T11:39:35.994 INFO:tasks.workunit.client.0.smithi118.stdout:7/710: truncate d0/f9 507921 0 2024-09-21T11:39:35.995 INFO:tasks.workunit.client.0.smithi118.stdout:7/711: chown d0/d3/d13/lba 8023 1 2024-09-21T11:39:35.995 INFO:tasks.workunit.client.0.smithi118.stdout:7/712: chown d0/d3/d29 31 1 2024-09-21T11:39:36.013 INFO:tasks.workunit.client.0.smithi118.stdout:9/666: write d0/d4/d45/d72/f94 [1921697,54395] 0 2024-09-21T11:39:36.017 INFO:tasks.workunit.client.0.smithi118.stdout:7/713: dwrite d0/d3/d1d/d35/fc4 [0,4194304] 0 2024-09-21T11:39:36.021 INFO:tasks.workunit.client.0.smithi118.stdout:9/667: mkdir d0/d4/d45/d72/de4/df4 0 2024-09-21T11:39:36.024 INFO:tasks.workunit.client.0.smithi118.stdout:7/714: truncate d0/d3/d13/d8f/fa7 3039903 0 2024-09-21T11:39:36.025 INFO:tasks.workunit.client.0.smithi118.stdout:9/668: truncate d0/d20/d4c/d5f/d66/fc0 2832359 0 2024-09-21T11:39:36.026 INFO:tasks.workunit.client.0.smithi118.stdout:9/669: stat d0/d20/d4c/d5f/d6c/d88/d4d/le5 0 2024-09-21T11:39:36.027 INFO:tasks.workunit.client.0.smithi118.stdout:9/670: readlink d0/d20/d4c/d5f/d89/lea 0 2024-09-21T11:39:36.030 INFO:tasks.workunit.client.0.smithi118.stdout:9/671: fdatasync d0/f13 0 2024-09-21T11:39:36.036 INFO:tasks.workunit.client.0.smithi118.stdout:9/672: unlink d0/d4/d45/c70 0 2024-09-21T11:39:36.042 INFO:tasks.workunit.client.0.smithi118.stdout:9/673: truncate d0/d20/d4c/d5f/d6c/d88/db9/f92 560129 0 2024-09-21T11:39:36.045 INFO:tasks.workunit.client.0.smithi118.stdout:7/715: dwrite d0/d3/d1d/d35/d57/d7e/f97 [0,4194304] 0 2024-09-21T11:39:36.046 INFO:tasks.workunit.client.0.smithi118.stdout:9/674: fdatasync d0/d20/d4c/d5f/d6c/fa2 0 2024-09-21T11:39:36.053 INFO:tasks.workunit.client.0.smithi118.stdout:9/675: dread - d0/d20/d71/faf zero size 2024-09-21T11:39:36.056 INFO:tasks.workunit.client.0.smithi118.stdout:7/716: creat d0/d3/fea x:0 0 0 2024-09-21T11:39:36.057 INFO:tasks.workunit.client.0.smithi118.stdout:9/676: dread - d0/d20/d4c/d5f/d6c/d88/d4d/f90 zero size 2024-09-21T11:39:36.059 INFO:tasks.workunit.client.0.smithi118.stdout:9/677: creat d0/d4/ff5 x:0 0 0 2024-09-21T11:39:36.062 INFO:tasks.workunit.client.0.smithi118.stdout:9/678: fsync d0/f4a 0 2024-09-21T11:39:36.078 INFO:tasks.workunit.client.0.smithi118.stdout:4/542: sync 2024-09-21T11:39:36.078 INFO:tasks.workunit.client.0.smithi118.stdout:5/591: sync 2024-09-21T11:39:36.080 INFO:tasks.workunit.client.0.smithi118.stdout:5/592: dread d0/d6c/d25/f4f [0,4194304] 0 2024-09-21T11:39:36.081 INFO:tasks.workunit.client.0.smithi118.stdout:4/543: fsync d2/d6/de/d1c/d4d/d52/d69/fac 0 2024-09-21T11:39:36.089 INFO:tasks.workunit.client.0.smithi118.stdout:5/593: mknod d0/db/cc9 0 2024-09-21T11:39:36.098 INFO:tasks.workunit.client.0.smithi118.stdout:5/594: mkdir d0/db/d35/d2c/d40/dca 0 2024-09-21T11:39:36.098 INFO:tasks.workunit.client.0.smithi118.stdout:5/595: chown d0/d89/d9d/ca5 123429 1 2024-09-21T11:39:36.099 INFO:tasks.workunit.client.0.smithi118.stdout:4/544: dread d2/d65/fa3 [0,4194304] 0 2024-09-21T11:39:36.099 INFO:tasks.workunit.client.0.smithi118.stdout:5/596: dread - d0/fb8 zero size 2024-09-21T11:39:36.100 INFO:tasks.workunit.client.0.smithi118.stdout:4/545: creat d2/da1/fb9 x:0 0 0 2024-09-21T11:39:36.111 INFO:tasks.workunit.client.0.smithi118.stdout:4/546: write d2/f13 [5282064,118771] 0 2024-09-21T11:39:36.111 INFO:tasks.workunit.client.0.smithi118.stdout:5/597: dwrite d0/db/d35/f3d [0,4194304] 0 2024-09-21T11:39:36.112 INFO:tasks.workunit.client.0.smithi118.stdout:4/547: chown d2/d6/f18 2 1 2024-09-21T11:39:36.113 INFO:tasks.workunit.client.0.smithi118.stdout:4/548: chown d2/d6/dd/f33 483419872 1 2024-09-21T11:39:36.114 INFO:tasks.workunit.client.0.smithi118.stdout:5/598: rmdir d0/d89/d9d 39 2024-09-21T11:39:36.119 INFO:tasks.workunit.client.0.smithi118.stdout:5/599: creat d0/d6c/fcb x:0 0 0 2024-09-21T11:39:36.122 INFO:tasks.workunit.client.0.smithi118.stdout:4/549: getdents d2/d6/de/d1c/d23/d26 0 2024-09-21T11:39:36.125 INFO:tasks.workunit.client.0.smithi118.stdout:5/600: link d0/d6c/d25/f7d d0/d6c/d25/d50/fcc 0 2024-09-21T11:39:36.126 INFO:tasks.workunit.client.0.smithi118.stdout:4/550: mkdir d2/d6/de/d1c/d4d/dba 0 2024-09-21T11:39:36.129 INFO:tasks.workunit.client.0.smithi118.stdout:5/601: rename d0/d6c/d25/d50/fc7 to d0/d89/daa/fcd 0 2024-09-21T11:39:36.130 INFO:tasks.workunit.client.0.smithi118.stdout:5/602: dread - d0/d6c/fcb zero size 2024-09-21T11:39:36.133 INFO:tasks.workunit.client.0.smithi118.stdout:4/551: dread d2/d6/f94 [0,4194304] 0 2024-09-21T11:39:36.137 INFO:tasks.workunit.client.0.smithi118.stdout:4/552: rename d2/d6/de/d1c/d4d/d52/d69/fac to d2/d6/de/d1c/d87/da9/d97/d9b/fbb 0 2024-09-21T11:39:36.137 INFO:tasks.workunit.client.0.smithi118.stdout:5/603: link d0/f31 d0/d89/daa/fce 0 2024-09-21T11:39:36.140 INFO:tasks.workunit.client.0.smithi118.stdout:5/604: creat d0/db/d35/d30/d1a/d8f/d99/fcf x:0 0 0 2024-09-21T11:39:36.143 INFO:tasks.workunit.client.0.smithi118.stdout:4/553: rmdir d2/d6/dd/d8d 0 2024-09-21T11:39:36.149 INFO:tasks.workunit.client.0.smithi118.stdout:4/554: creat d2/d6/de/d3e/d5e/fbc x:0 0 0 2024-09-21T11:39:36.150 INFO:tasks.workunit.client.0.smithi118.stdout:4/555: dread - d2/d6/f2b zero size 2024-09-21T11:39:36.172 INFO:tasks.workunit.client.0.smithi118.stdout:5/605: write d0/d89/daa/fce [3768681,108472] 0 2024-09-21T11:39:36.175 INFO:tasks.workunit.client.0.smithi118.stdout:4/556: write d2/d6/de/d1c/f9f [476394,17779] 0 2024-09-21T11:39:36.178 INFO:tasks.workunit.client.0.smithi118.stdout:4/557: mknod d2/d8e/cbd 0 2024-09-21T11:39:36.179 INFO:tasks.workunit.client.0.smithi118.stdout:4/558: write d2/d6/de/d1c/d4d/d52/d69/f82 [2390783,62410] 0 2024-09-21T11:39:36.181 INFO:tasks.workunit.client.0.smithi118.stdout:4/559: write d2/d6/de/d1c/d4d/d52/d69/f82 [4297220,76894] 0 2024-09-21T11:39:36.185 INFO:tasks.workunit.client.0.smithi118.stdout:4/560: creat d2/d6/de/d1c/d23/d26/fbe x:0 0 0 2024-09-21T11:39:36.187 INFO:tasks.workunit.client.0.smithi118.stdout:4/561: creat d2/d6/de/d1c/d4d/dba/fbf x:0 0 0 2024-09-21T11:39:36.188 INFO:tasks.workunit.client.0.smithi118.stdout:4/562: chown d2/d6/de/d1c/d87/da9/f98 30 1 2024-09-21T11:39:36.190 INFO:tasks.workunit.client.0.smithi118.stdout:5/606: dread d0/f1b [0,4194304] 0 2024-09-21T11:39:36.192 INFO:tasks.workunit.client.0.smithi118.stdout:5/607: mknod d0/d6c/d25/cd0 0 2024-09-21T11:39:36.198 INFO:tasks.workunit.client.0.smithi118.stdout:4/563: dread d2/d6/dd/d35/f72 [0,4194304] 0 2024-09-21T11:39:36.201 INFO:tasks.workunit.client.0.smithi118.stdout:4/564: creat d2/d6/de/d1c/d87/da9/d97/d9b/fc0 x:0 0 0 2024-09-21T11:39:36.204 INFO:tasks.workunit.client.0.smithi118.stdout:4/565: unlink d2/f21 0 2024-09-21T11:39:36.206 INFO:tasks.workunit.client.0.smithi118.stdout:4/566: rmdir d2/d6/de/d1c/d4d/d52/d69 39 2024-09-21T11:39:36.208 INFO:tasks.workunit.client.0.smithi118.stdout:5/608: dwrite d0/d6c/f7e [4194304,4194304] 0 2024-09-21T11:39:36.208 INFO:tasks.workunit.client.0.smithi118.stdout:4/567: write d2/da1/fb9 [62214,117123] 0 2024-09-21T11:39:36.210 INFO:tasks.workunit.client.0.smithi118.stdout:4/568: fdatasync d2/d6/de/d1c/d87/da9/d97/d9b/fc0 0 2024-09-21T11:39:36.212 INFO:tasks.workunit.client.0.smithi118.stdout:5/609: mkdir d0/dd1 0 2024-09-21T11:39:36.215 INFO:tasks.workunit.client.0.smithi118.stdout:4/569: creat d2/d6/de/d1c/d87/da9/fc1 x:0 0 0 2024-09-21T11:39:36.226 INFO:tasks.workunit.client.0.smithi118.stdout:4/570: mknod d2/d6/de/d1c/d87/da9/cc2 0 2024-09-21T11:39:36.228 INFO:tasks.workunit.client.0.smithi118.stdout:4/571: truncate d2/f8a 5224133 0 2024-09-21T11:39:36.230 INFO:tasks.workunit.client.0.smithi118.stdout:4/572: truncate d2/d6/f2b 738615 0 2024-09-21T11:39:36.232 INFO:tasks.workunit.client.0.smithi118.stdout:4/573: truncate d2/fc 4196428 0 2024-09-21T11:39:36.233 INFO:tasks.workunit.client.0.smithi118.stdout:5/610: truncate d0/db/d35/f3d 5341082 0 2024-09-21T11:39:36.235 INFO:tasks.workunit.client.0.smithi118.stdout:4/574: creat d2/d6/de/d1c/d87/fc3 x:0 0 0 2024-09-21T11:39:36.235 INFO:tasks.workunit.client.0.smithi118.stdout:4/575: fsync d2/da1/fa2 0 2024-09-21T11:39:36.237 INFO:tasks.workunit.client.0.smithi118.stdout:4/576: readlink d2/d6/dd/l1a 0 2024-09-21T11:39:36.241 INFO:tasks.workunit.client.0.smithi118.stdout:4/577: creat d2/d6/de/d1c/d4d/d52/d69/fc4 x:0 0 0 2024-09-21T11:39:36.242 INFO:tasks.workunit.client.0.smithi118.stdout:4/578: rmdir d2/d6/de/d1c/d4d/d52 39 2024-09-21T11:39:36.245 INFO:tasks.workunit.client.0.smithi118.stdout:4/579: mknod d2/d6/de/d1c/d87/da9/d97/d9b/cc5 0 2024-09-21T11:39:36.254 INFO:tasks.workunit.client.0.smithi118.stdout:5/611: truncate d0/db/d35/f3d 5875756 0 2024-09-21T11:39:36.255 INFO:tasks.workunit.client.0.smithi118.stdout:4/580: link d2/d6/dd/l30 d2/d6/de/d1c/d4d/dba/lc6 0 2024-09-21T11:39:36.258 INFO:tasks.workunit.client.0.smithi118.stdout:4/581: mknod d2/d65/cc7 0 2024-09-21T11:39:36.260 INFO:tasks.workunit.client.0.smithi118.stdout:5/612: dwrite d0/db/d35/d30/d66/f71 [0,4194304] 0 2024-09-21T11:39:36.263 INFO:tasks.workunit.client.0.smithi118.stdout:5/613: symlink d0/dd1/ld2 0 2024-09-21T11:39:36.277 INFO:tasks.workunit.client.0.smithi118.stdout:4/582: dwrite d2/d6/dd/f33 [0,4194304] 0 2024-09-21T11:39:36.279 INFO:tasks.workunit.client.0.smithi118.stdout:5/614: dwrite d0/db/f16 [0,4194304] 0 2024-09-21T11:39:36.283 INFO:tasks.workunit.client.0.smithi118.stdout:4/583: getdents d2/d65 0 2024-09-21T11:39:36.285 INFO:tasks.workunit.client.0.smithi118.stdout:5/615: creat d0/db/d35/d2c/fd3 x:0 0 0 2024-09-21T11:39:36.287 INFO:tasks.workunit.client.0.smithi118.stdout:4/584: mknod d2/d6/dd/d35/cc8 0 2024-09-21T11:39:36.289 INFO:tasks.workunit.client.0.smithi118.stdout:5/616: stat d0/db/cc 0 2024-09-21T11:39:36.289 INFO:tasks.workunit.client.0.smithi118.stdout:5/617: fsync d0/d6c/f7e 0 2024-09-21T11:39:36.291 INFO:tasks.workunit.client.0.smithi118.stdout:4/585: rename d2/d6/de/c7f to d2/d8e/cc9 0 2024-09-21T11:39:36.293 INFO:tasks.workunit.client.0.smithi118.stdout:4/586: dread d2/da1/fb9 [0,4194304] 0 2024-09-21T11:39:36.302 INFO:tasks.workunit.client.0.smithi118.stdout:5/618: dwrite d0/db/d35/da/f4e [0,4194304] 0 2024-09-21T11:39:36.307 INFO:tasks.workunit.client.0.smithi118.stdout:5/619: rename d0/db/d35/d30/d1a/d8f/d99/fcf to d0/db/d26/d65/fd4 0 2024-09-21T11:39:36.310 INFO:tasks.workunit.client.0.smithi118.stdout:5/620: mkdir d0/db/d35/dd5 0 2024-09-21T11:39:36.310 INFO:tasks.workunit.client.0.smithi118.stdout:5/621: stat d0/db/d35/d30/d66 0 2024-09-21T11:39:36.317 INFO:tasks.workunit.client.0.smithi118.stdout:5/622: dread d0/d6c/d67/f62 [0,4194304] 0 2024-09-21T11:39:36.319 INFO:tasks.workunit.client.0.smithi118.stdout:5/623: creat d0/d6c/d67/d92/dc8/fd6 x:0 0 0 2024-09-21T11:39:36.322 INFO:tasks.workunit.client.0.smithi118.stdout:5/624: mkdir d0/db/d35/da/dd7 0 2024-09-21T11:39:36.323 INFO:tasks.workunit.client.0.smithi118.stdout:5/625: rmdir d0/d6c/d67/d92 39 2024-09-21T11:39:36.325 INFO:tasks.workunit.client.0.smithi118.stdout:5/626: symlink d0/db/d35/d30/d1a/db3/ld8 0 2024-09-21T11:39:36.330 INFO:tasks.workunit.client.0.smithi118.stdout:5/627: write d0/d89/daa/fb4 [490776,35068] 0 2024-09-21T11:39:36.333 INFO:tasks.workunit.client.0.smithi118.stdout:5/628: rename d0/db/d26/d65/c7c to d0/d63/cd9 0 2024-09-21T11:39:36.334 INFO:tasks.workunit.client.0.smithi118.stdout:5/629: chown d0/d6c/d67/d92 862710 1 2024-09-21T11:39:36.338 INFO:tasks.workunit.client.0.smithi118.stdout:5/630: creat d0/db/d35/fda x:0 0 0 2024-09-21T11:39:36.340 INFO:tasks.workunit.client.0.smithi118.stdout:5/631: creat d0/db/d35/d30/d1a/db3/fdb x:0 0 0 2024-09-21T11:39:36.342 INFO:tasks.workunit.client.0.smithi118.stdout:5/632: creat d0/db/d35/d2c/d40/fdc x:0 0 0 2024-09-21T11:39:36.348 INFO:tasks.workunit.client.0.smithi118.stdout:5/633: stat d0/d63/cd9 0 2024-09-21T11:39:36.360 INFO:tasks.workunit.client.0.smithi118.stdout:5/634: dwrite d0/d6c/d25/d50/f91 [0,4194304] 0 2024-09-21T11:39:36.368 INFO:tasks.workunit.client.0.smithi118.stdout:2/572: sync 2024-09-21T11:39:36.371 INFO:tasks.workunit.client.0.smithi118.stdout:2/573: dread de/d16/d31/f3d [0,4194304] 0 2024-09-21T11:39:36.382 INFO:tasks.workunit.client.0.smithi118.stdout:5/635: dread d0/d6c/f8 [0,4194304] 0 2024-09-21T11:39:36.383 INFO:tasks.workunit.client.0.smithi118.stdout:2/574: write de/d53/f8d [4005842,56853] 0 2024-09-21T11:39:36.394 INFO:tasks.workunit.client.0.smithi118.stdout:5/636: dwrite d0/db/d35/d95/f98 [0,4194304] 0 2024-09-21T11:39:36.394 INFO:tasks.workunit.client.0.smithi118.stdout:2/575: dwrite de/f14 [0,4194304] 0 2024-09-21T11:39:36.395 INFO:tasks.workunit.client.0.smithi118.stdout:5/637: dread - d0/db/d35/fda zero size 2024-09-21T11:39:36.396 INFO:tasks.workunit.client.0.smithi118.stdout:5/638: chown d0/db/d35/l5c 454312535 1 2024-09-21T11:39:36.397 INFO:tasks.workunit.client.0.smithi118.stdout:5/639: stat d0/d6c/fcb 0 2024-09-21T11:39:36.398 INFO:tasks.workunit.client.0.smithi118.stdout:2/576: mknod de/d1f/d20/d67/d8a/d6d/cc3 0 2024-09-21T11:39:36.399 INFO:tasks.workunit.client.0.smithi118.stdout:2/577: dread - de/d50/d85/faf zero size 2024-09-21T11:39:36.407 INFO:tasks.workunit.client.0.smithi118.stdout:2/578: dwrite de/d16/d25/dba/fc0 [0,4194304] 0 2024-09-21T11:39:36.411 INFO:tasks.workunit.client.0.smithi118.stdout:2/579: fdatasync de/d1f/d20/d78/fb4 0 2024-09-21T11:39:36.417 INFO:tasks.workunit.client.0.smithi118.stdout:2/580: link de/d50/l88 de/d16/d1c/d4f/d5b/lc4 0 2024-09-21T11:39:36.431 INFO:tasks.workunit.client.0.smithi118.stdout:2/581: dwrite de/d1f/d20/f77 [0,4194304] 0 2024-09-21T11:39:36.438 INFO:tasks.workunit.client.0.smithi118.stdout:2/582: dwrite de/d16/d25/dba/fc0 [0,4194304] 0 2024-09-21T11:39:36.440 INFO:tasks.workunit.client.0.smithi118.stdout:5/640: dread d0/f31 [0,4194304] 0 2024-09-21T11:39:36.440 INFO:tasks.workunit.client.0.smithi118.stdout:2/583: write de/d16/d1c/d4f/d5b/fa6 [965477,96148] 0 2024-09-21T11:39:36.444 INFO:tasks.workunit.client.0.smithi118.stdout:2/584: mknod de/d16/d1c/d4f/d5b/cc5 0 2024-09-21T11:39:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:36 smithi149 ceph-mon[36123]: pgmap v33: 65 pgs: 65 active+clean; 3.1 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 57 MiB/s rd, 146 MiB/s wr, 334 op/s 2024-09-21T11:39:36.450 INFO:tasks.workunit.client.0.smithi118.stdout:2/585: fsync de/d16/d1c/d4f/d5b/fa6 0 2024-09-21T11:39:36.455 INFO:tasks.workunit.client.0.smithi118.stdout:5/641: dwrite d0/f36 [0,4194304] 0 2024-09-21T11:39:36.461 INFO:tasks.workunit.client.0.smithi118.stdout:2/586: creat de/d16/d1c/d66/d9a/fc6 x:0 0 0 2024-09-21T11:39:36.479 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:36 smithi118 ceph-mon[28757]: pgmap v33: 65 pgs: 65 active+clean; 3.1 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 57 MiB/s rd, 146 MiB/s wr, 334 op/s 2024-09-21T11:39:36.507 INFO:tasks.workunit.client.0.smithi118.stdout:5/642: truncate d0/d89/f8d 244333 0 2024-09-21T11:39:36.510 INFO:tasks.workunit.client.0.smithi118.stdout:2/587: symlink de/d1f/lc7 0 2024-09-21T11:39:36.512 INFO:tasks.workunit.client.0.smithi118.stdout:2/588: write de/d1f/d20/fb7 [418623,75281] 0 2024-09-21T11:39:36.514 INFO:tasks.workunit.client.0.smithi118.stdout:2/589: stat de/d16/d1c/d66/d9a/fc6 0 2024-09-21T11:39:36.515 INFO:tasks.workunit.client.0.smithi118.stdout:5/643: dwrite d0/d6c/d25/f43 [4194304,4194304] 0 2024-09-21T11:39:36.519 INFO:tasks.workunit.client.0.smithi118.stdout:2/590: dread de/f2a [0,4194304] 0 2024-09-21T11:39:36.521 INFO:tasks.workunit.client.0.smithi118.stdout:5/644: symlink d0/db/d35/da/ldd 0 2024-09-21T11:39:36.522 INFO:tasks.workunit.client.0.smithi118.stdout:2/591: symlink de/d51/lc8 0 2024-09-21T11:39:36.525 INFO:tasks.workunit.client.0.smithi118.stdout:2/592: rmdir de/d51 39 2024-09-21T11:39:36.526 INFO:tasks.workunit.client.0.smithi118.stdout:5/645: getdents d0/d6c/dba 0 2024-09-21T11:39:36.527 INFO:tasks.workunit.client.0.smithi118.stdout:5/646: fdatasync d0/db/f16 0 2024-09-21T11:39:36.528 INFO:tasks.workunit.client.0.smithi118.stdout:2/593: symlink de/d16/d25/dba/lc9 0 2024-09-21T11:39:36.531 INFO:tasks.workunit.client.0.smithi118.stdout:5/647: mknod d0/db/d35/da/cde 0 2024-09-21T11:39:36.565 INFO:tasks.workunit.client.0.smithi118.stdout:5/648: rename d0/db/d35/d2c/d40/c5f to d0/d6c/d25/d50/cdf 0 2024-09-21T11:39:36.582 INFO:tasks.workunit.client.0.smithi118.stdout:5/649: readlink d0/db/d35/l1e 0 2024-09-21T11:39:36.586 INFO:tasks.workunit.client.0.smithi118.stdout:5/650: dread d0/d6c/d25/f43 [4194304,4194304] 0 2024-09-21T11:39:36.791 INFO:tasks.workunit.client.0.smithi118.stdout:6/531: sync 2024-09-21T11:39:36.792 INFO:tasks.workunit.client.0.smithi118.stdout:6/532: fsync d8/d14/f24 0 2024-09-21T11:39:36.794 INFO:tasks.workunit.client.0.smithi118.stdout:6/533: mknod d8/d48/d5f/da3/cab 0 2024-09-21T11:39:36.801 INFO:tasks.workunit.client.0.smithi118.stdout:6/534: dwrite d8/f8b [4194304,4194304] 0 2024-09-21T11:39:36.802 INFO:tasks.workunit.client.0.smithi118.stdout:6/535: read d8/d14/f24 [859772,69901] 0 2024-09-21T11:39:36.803 INFO:tasks.workunit.client.0.smithi118.stdout:6/536: chown c2 19357777 1 2024-09-21T11:39:36.810 INFO:tasks.workunit.client.0.smithi118.stdout:6/537: dwrite d8/d14/d44/f9d [0,4194304] 0 2024-09-21T11:39:36.813 INFO:tasks.workunit.client.0.smithi118.stdout:6/538: symlink d8/d48/d5f/da3/lac 0 2024-09-21T11:39:36.815 INFO:tasks.workunit.client.0.smithi118.stdout:6/539: creat d8/d48/d45/d61/d66/fad x:0 0 0 2024-09-21T11:39:36.817 INFO:tasks.workunit.client.0.smithi118.stdout:6/540: truncate d8/d48/d45/d61/d70/f83 1186997 0 2024-09-21T11:39:36.821 INFO:tasks.workunit.client.0.smithi118.stdout:6/541: creat d8/d48/d45/d61/d70/d7d/fae x:0 0 0 2024-09-21T11:39:36.823 INFO:tasks.workunit.client.0.smithi118.stdout:6/542: truncate d8/d14/f2b 1290898 0 2024-09-21T11:39:36.840 INFO:tasks.workunit.client.0.smithi118.stdout:6/543: dwrite d8/d48/d6c/d64/f98 [0,4194304] 0 2024-09-21T11:39:36.842 INFO:tasks.workunit.client.0.smithi118.stdout:6/544: symlink d8/d48/d6c/laf 0 2024-09-21T11:39:36.846 INFO:tasks.workunit.client.0.smithi118.stdout:6/545: symlink d8/d48/d5f/da3/lb0 0 2024-09-21T11:39:36.847 INFO:tasks.workunit.client.0.smithi118.stdout:6/546: creat d8/d48/d5f/fb1 x:0 0 0 2024-09-21T11:39:36.849 INFO:tasks.workunit.client.0.smithi118.stdout:6/547: mknod d8/d46/d53/cb2 0 2024-09-21T11:39:36.850 INFO:tasks.workunit.client.0.smithi118.stdout:6/548: mkdir d8/d46/db3 0 2024-09-21T11:39:36.852 INFO:tasks.workunit.client.0.smithi118.stdout:6/549: creat d8/d14/fb4 x:0 0 0 2024-09-21T11:39:36.859 INFO:tasks.workunit.client.0.smithi118.stdout:6/550: dread d8/d14/f63 [0,4194304] 0 2024-09-21T11:39:37.053 INFO:tasks.workunit.client.0.smithi118.stdout:0/885: sync 2024-09-21T11:39:37.056 INFO:tasks.workunit.client.0.smithi118.stdout:0/886: symlink d5/d10/d1e/d20/l128 0 2024-09-21T11:39:37.060 INFO:tasks.workunit.client.0.smithi118.stdout:0/887: dread d5/d10/d1e/d20/fbf [0,4194304] 0 2024-09-21T11:39:37.060 INFO:tasks.workunit.client.0.smithi118.stdout:0/888: chown d5/d10/d1e/d33/dd4/cdc 7 1 2024-09-21T11:39:37.075 INFO:tasks.workunit.client.0.smithi118.stdout:0/889: dwrite d5/d10/d1e/d23/fca [0,4194304] 0 2024-09-21T11:39:37.081 INFO:tasks.workunit.client.0.smithi118.stdout:0/890: mkdir d5/d34/d44/d87/d129 0 2024-09-21T11:39:37.083 INFO:tasks.workunit.client.0.smithi118.stdout:0/891: creat d5/d81/f12a x:0 0 0 2024-09-21T11:39:37.085 INFO:tasks.workunit.client.0.smithi118.stdout:0/892: truncate d5/d29/fbc 74617 0 2024-09-21T11:39:37.085 INFO:tasks.workunit.client.0.smithi118.stdout:0/893: chown d5/le 67 1 2024-09-21T11:39:37.100 INFO:tasks.workunit.client.0.smithi118.stdout:0/894: dwrite d5/d10/d1e/d20/f2b [0,4194304] 0 2024-09-21T11:39:37.105 INFO:tasks.workunit.client.0.smithi118.stdout:0/895: creat d5/d10/d1e/d23/d3a/d4e/d9d/f12b x:0 0 0 2024-09-21T11:39:37.145 INFO:tasks.workunit.client.0.smithi118.stdout:0/896: getdents d5/d10/d1e/d23/d3a/d4e/dfc 0 2024-09-21T11:39:37.171 INFO:tasks.workunit.client.0.smithi118.stdout:1/601: sync 2024-09-21T11:39:37.173 INFO:tasks.workunit.client.0.smithi118.stdout:1/602: truncate d6/f19 2258488 0 2024-09-21T11:39:37.174 INFO:tasks.workunit.client.0.smithi118.stdout:1/603: dread - d6/d2a/fac zero size 2024-09-21T11:39:37.175 INFO:tasks.workunit.client.0.smithi118.stdout:1/604: write d6/d2a/fbb [66271,33858] 0 2024-09-21T11:39:37.178 INFO:tasks.workunit.client.0.smithi118.stdout:1/605: fdatasync d6/de/d16/d3f/d50/fb7 0 2024-09-21T11:39:37.182 INFO:tasks.workunit.client.0.smithi118.stdout:1/606: getdents d6/d33 0 2024-09-21T11:39:37.197 INFO:tasks.workunit.client.0.smithi118.stdout:0/897: mknod d5/d10/d1e/c12c 0 2024-09-21T11:39:37.198 INFO:tasks.workunit.client.0.smithi118.stdout:0/898: truncate d5/fd6 477416 0 2024-09-21T11:39:37.201 INFO:tasks.workunit.client.0.smithi118.stdout:0/899: truncate d5/d29/d68/d7b/db7/d48/f64 1159951 0 2024-09-21T11:39:37.203 INFO:tasks.workunit.client.0.smithi118.stdout:0/900: truncate d5/f70 1124634 0 2024-09-21T11:39:37.205 INFO:tasks.workunit.client.0.smithi118.stdout:0/901: chown d5/d34/d44/d7c/cf0 481574 1 2024-09-21T11:39:37.210 INFO:tasks.workunit.client.0.smithi118.stdout:1/607: write d6/de/f2e [1766694,122895] 0 2024-09-21T11:39:37.212 INFO:tasks.workunit.client.0.smithi118.stdout:1/608: symlink d6/d2a/d3d/lc0 0 2024-09-21T11:39:37.213 INFO:tasks.workunit.client.0.smithi118.stdout:1/609: chown d6/de/d13/d84/f9a 19 1 2024-09-21T11:39:37.214 INFO:tasks.workunit.client.0.smithi118.stdout:1/610: chown d6/d2a/d3d 19570746 1 2024-09-21T11:39:37.220 INFO:tasks.workunit.client.0.smithi118.stdout:1/611: dwrite d6/d33/d3c/f68 [4194304,4194304] 0 2024-09-21T11:39:37.231 INFO:tasks.workunit.client.0.smithi118.stdout:1/612: dwrite d6/d3b/fa9 [0,4194304] 0 2024-09-21T11:39:37.249 INFO:tasks.workunit.client.0.smithi118.stdout:1/613: dread d6/de/d16/d3f/d50/d72/f75 [0,4194304] 0 2024-09-21T11:39:37.252 INFO:tasks.workunit.client.0.smithi118.stdout:1/614: creat d6/d3b/fc1 x:0 0 0 2024-09-21T11:39:37.256 INFO:tasks.workunit.client.0.smithi118.stdout:1/615: rename d6/de/d13/d84/d96 to d6/d2a/dc2 0 2024-09-21T11:39:37.257 INFO:tasks.workunit.client.0.smithi118.stdout:1/616: fsync d6/d2a/dc2/d9e/faa 0 2024-09-21T11:39:37.259 INFO:tasks.workunit.client.0.smithi118.stdout:1/617: mknod d6/de/d16/cc3 0 2024-09-21T11:39:37.261 INFO:tasks.workunit.client.0.smithi118.stdout:1/618: chown d6/de/d16/d3f/l7b 51605246 1 2024-09-21T11:39:37.276 INFO:tasks.workunit.client.0.smithi118.stdout:1/619: dwrite d6/de/d16/d3f/d50/d54/d32/f48 [0,4194304] 0 2024-09-21T11:39:37.283 INFO:tasks.workunit.client.0.smithi118.stdout:1/620: write d6/d2a/f94 [481957,98158] 0 2024-09-21T11:39:37.286 INFO:tasks.workunit.client.0.smithi118.stdout:1/621: symlink d6/d2a/d3d/db9/lc4 0 2024-09-21T11:39:37.287 INFO:tasks.workunit.client.0.smithi118.stdout:1/622: symlink d6/d2a/d3d/lc5 0 2024-09-21T11:39:37.289 INFO:tasks.workunit.client.0.smithi118.stdout:1/623: dread d6/de/d16/d3f/d50/d54/d32/f46 [0,4194304] 0 2024-09-21T11:39:37.298 INFO:tasks.workunit.client.0.smithi118.stdout:1/624: dwrite d6/d33/d7a/fa8 [0,4194304] 0 2024-09-21T11:39:37.303 INFO:tasks.workunit.client.0.smithi118.stdout:1/625: write f1 [239541,105443] 0 2024-09-21T11:39:37.309 INFO:tasks.workunit.client.0.smithi118.stdout:1/626: write d6/de/f22 [3289209,75094] 0 2024-09-21T11:39:37.315 INFO:tasks.workunit.client.0.smithi118.stdout:1/627: dwrite d6/d3b/fa9 [0,4194304] 0 2024-09-21T11:39:37.344 INFO:tasks.workunit.client.0.smithi118.stdout:1/628: dread d6/de/f2e [0,4194304] 0 2024-09-21T11:39:37.347 INFO:tasks.workunit.client.0.smithi118.stdout:1/629: unlink d6/d33/d7a/fa8 0 2024-09-21T11:39:37.347 INFO:tasks.workunit.client.0.smithi118.stdout:1/630: chown d6/de/d16/d3f/d86 29 1 2024-09-21T11:39:37.351 INFO:tasks.workunit.client.0.smithi118.stdout:1/631: getdents d6/de/d16/d3f 0 2024-09-21T11:39:37.352 INFO:tasks.workunit.client.0.smithi118.stdout:1/632: chown d6/d2a/d5c/d85/l8f 360743690 1 2024-09-21T11:39:37.353 INFO:tasks.workunit.client.0.smithi118.stdout:1/633: symlink d6/de/d13/lc6 0 2024-09-21T11:39:37.358 INFO:tasks.workunit.client.0.smithi118.stdout:1/634: dread d6/de/d13/d84/f9a [4194304,4194304] 0 2024-09-21T11:39:37.358 INFO:tasks.workunit.client.0.smithi118.stdout:1/635: stat d6/de/d13 0 2024-09-21T11:39:37.360 INFO:tasks.workunit.client.0.smithi118.stdout:9/679: sync 2024-09-21T11:39:37.360 INFO:tasks.workunit.client.0.smithi118.stdout:3/578: sync 2024-09-21T11:39:37.360 INFO:tasks.workunit.client.0.smithi118.stdout:5/651: sync 2024-09-21T11:39:37.360 INFO:tasks.workunit.client.0.smithi118.stdout:2/594: sync 2024-09-21T11:39:37.361 INFO:tasks.workunit.client.0.smithi118.stdout:7/717: sync 2024-09-21T11:39:37.361 INFO:tasks.workunit.client.0.smithi118.stdout:6/551: sync 2024-09-21T11:39:37.361 INFO:tasks.workunit.client.0.smithi118.stdout:4/587: sync 2024-09-21T11:39:37.362 INFO:tasks.workunit.client.0.smithi118.stdout:7/718: write d0/d3/fc1 [320176,36278] 0 2024-09-21T11:39:37.364 INFO:tasks.workunit.client.0.smithi118.stdout:9/680: fdatasync d0/f4a 0 2024-09-21T11:39:37.364 INFO:tasks.workunit.client.0.smithi118.stdout:7/719: write d0/d3/d1d/d35/f58 [3511873,12567] 0 2024-09-21T11:39:37.366 INFO:tasks.workunit.client.0.smithi118.stdout:2/595: mknod de/d50/cca 0 2024-09-21T11:39:37.368 INFO:tasks.workunit.client.0.smithi118.stdout:5/652: dwrite d0/d6c/f7e [4194304,4194304] 0 2024-09-21T11:39:37.371 INFO:tasks.workunit.client.0.smithi118.stdout:4/588: readlink d2/d6/de/l32 0 2024-09-21T11:39:37.374 INFO:tasks.workunit.client.0.smithi118.stdout:6/552: mkdir d8/d46/d53/db5 0 2024-09-21T11:39:37.382 INFO:tasks.workunit.client.0.smithi118.stdout:0/902: sync 2024-09-21T11:39:37.383 INFO:tasks.workunit.client.0.smithi118.stdout:7/720: symlink d0/d3/d14/d41/d8b/da4/leb 0 2024-09-21T11:39:37.385 INFO:tasks.workunit.client.0.smithi118.stdout:1/636: dwrite d6/de/f11 [0,4194304] 0 2024-09-21T11:39:37.385 INFO:tasks.workunit.client.0.smithi118.stdout:5/653: creat d0/db/d26/d65/fe0 x:0 0 0 2024-09-21T11:39:37.390 INFO:tasks.workunit.client.0.smithi118.stdout:6/553: unlink d8/d48/d45/d61/d70/f87 0 2024-09-21T11:39:37.395 INFO:tasks.workunit.client.0.smithi118.stdout:0/903: mknod d5/d10/d1e/d33/dd4/c12d 0 2024-09-21T11:39:37.397 INFO:tasks.workunit.client.0.smithi118.stdout:9/681: dwrite d0/d4/d45/d72/fbb [0,4194304] 0 2024-09-21T11:39:37.398 INFO:tasks.workunit.client.0.smithi118.stdout:9/682: chown d0/d4/d45/d72/l78 29 1 2024-09-21T11:39:37.400 INFO:tasks.workunit.client.0.smithi118.stdout:9/683: stat d0/d20/d4c/d5f/d6c/d88/db9/d7c/fcd 0 2024-09-21T11:39:37.405 INFO:tasks.workunit.client.0.smithi118.stdout:5/654: write d0/db/d35/da/f6e [911559,29016] 0 2024-09-21T11:39:37.406 INFO:tasks.workunit.client.0.smithi118.stdout:2/596: creat de/fcb x:0 0 0 2024-09-21T11:39:37.408 INFO:tasks.workunit.client.0.smithi118.stdout:1/637: mkdir d6/de/dc7 0 2024-09-21T11:39:37.409 INFO:tasks.workunit.client.0.smithi118.stdout:1/638: chown d6/d2a/d3d/db9 389 1 2024-09-21T11:39:37.412 INFO:tasks.workunit.client.0.smithi118.stdout:7/721: symlink d0/d3/d14/d41/d7f/d3e/d81/db6/lec 0 2024-09-21T11:39:37.414 INFO:tasks.workunit.client.0.smithi118.stdout:4/589: rename d2/d6/de/d1c/d87/da9/d97/d9b/fb7 to d2/d6/de/d1c/d4d/fca 0 2024-09-21T11:39:37.416 INFO:tasks.workunit.client.0.smithi118.stdout:1/639: dwrite d6/de/d16/d3f/d50/d54/d32/f48 [0,4194304] 0 2024-09-21T11:39:37.418 INFO:tasks.workunit.client.0.smithi118.stdout:3/579: getdents d5/d1d 0 2024-09-21T11:39:37.418 INFO:tasks.workunit.client.0.smithi118.stdout:1/640: readlink d6/l2b 0 2024-09-21T11:39:37.419 INFO:tasks.workunit.client.0.smithi118.stdout:0/904: truncate d5/d29/fbc 279519 0 2024-09-21T11:39:37.423 INFO:tasks.workunit.client.0.smithi118.stdout:6/554: rename d8/d46/f7f to d8/d48/d9f/fb6 0 2024-09-21T11:39:37.426 INFO:tasks.workunit.client.0.smithi118.stdout:9/684: mkdir d0/d4/d38/df6 0 2024-09-21T11:39:37.428 INFO:tasks.workunit.client.0.smithi118.stdout:7/722: getdents d0/d3/d29/d5f/d71/dda 0 2024-09-21T11:39:37.428 INFO:tasks.workunit.client.0.smithi118.stdout:1/641: mknod d6/d2a/dc2/cc8 0 2024-09-21T11:39:37.429 INFO:tasks.workunit.client.0.smithi118.stdout:0/905: fdatasync d5/d10/d1e/d33/fcc 0 2024-09-21T11:39:37.431 INFO:tasks.workunit.client.0.smithi118.stdout:5/655: dread d0/db/d35/d30/d1a/f2a [0,4194304] 0 2024-09-21T11:39:37.433 INFO:tasks.workunit.client.0.smithi118.stdout:3/580: symlink d5/d1d/d1b/da7/dc9/ld4 0 2024-09-21T11:39:37.433 INFO:tasks.workunit.client.0.smithi118.stdout:6/555: dwrite d8/d48/d45/d61/d70/f83 [0,4194304] 0 2024-09-21T11:39:37.434 INFO:tasks.workunit.client.0.smithi118.stdout:4/590: dread d2/d6/f20 [0,4194304] 0 2024-09-21T11:39:37.435 INFO:tasks.workunit.client.0.smithi118.stdout:5/656: write d0/db/d35/d30/d1a/d8f/d99/fbd [876767,71536] 0 2024-09-21T11:39:37.436 INFO:tasks.workunit.client.0.smithi118.stdout:4/591: chown d2/d6/de/d1c/d87 2414066 1 2024-09-21T11:39:37.437 INFO:tasks.workunit.client.0.smithi118.stdout:5/657: chown d0/db/d35/d95/f98 6365 1 2024-09-21T11:39:37.438 INFO:tasks.workunit.client.0.smithi118.stdout:7/723: mknod d0/d3/d13/ced 0 2024-09-21T11:39:37.439 INFO:tasks.workunit.client.0.smithi118.stdout:7/724: stat d0/d3/d1d/d35/c51 0 2024-09-21T11:39:37.442 INFO:tasks.workunit.client.0.smithi118.stdout:2/597: getdents de/d53 0 2024-09-21T11:39:37.443 INFO:tasks.workunit.client.0.smithi118.stdout:2/598: fsync de/f12 0 2024-09-21T11:39:37.447 INFO:tasks.workunit.client.0.smithi118.stdout:6/556: symlink d8/d46/d53/lb7 0 2024-09-21T11:39:37.450 INFO:tasks.workunit.client.0.smithi118.stdout:4/592: fdatasync d2/d6/de/fa5 0 2024-09-21T11:39:37.450 INFO:tasks.workunit.client.0.smithi118.stdout:6/557: fsync d8/d48/d45/f4d 0 2024-09-21T11:39:37.450 INFO:tasks.workunit.client.0.smithi118.stdout:9/685: dwrite d0/f26 [4194304,4194304] 0 2024-09-21T11:39:37.456 INFO:tasks.workunit.client.0.smithi118.stdout:0/906: dwrite d5/d10/d1e/d3d/fff [0,4194304] 0 2024-09-21T11:39:37.464 INFO:tasks.workunit.client.0.smithi118.stdout:6/558: dwrite d8/d46/f81 [0,4194304] 0 2024-09-21T11:39:37.471 INFO:tasks.workunit.client.0.smithi118.stdout:2/599: rename de/d1f/d20/f48 to de/d1f/d20/fcc 0 2024-09-21T11:39:37.476 INFO:tasks.workunit.client.0.smithi118.stdout:4/593: rename d2/d65/d89 to d2/d6/de/d3e/dcb 0 2024-09-21T11:39:37.477 INFO:tasks.workunit.client.0.smithi118.stdout:4/594: dread - d2/d6/de/d1c/d87/da9/fc1 zero size 2024-09-21T11:39:37.480 INFO:tasks.workunit.client.0.smithi118.stdout:0/907: fdatasync d5/d29/d68/d7b/db7/d48/ff5 0 2024-09-21T11:39:37.481 INFO:tasks.workunit.client.0.smithi118.stdout:6/559: mknod d8/d48/d45/d61/d70/d7d/cb8 0 2024-09-21T11:39:37.482 INFO:tasks.workunit.client.0.smithi118.stdout:6/560: write d8/d14/d44/f9d [2760870,40634] 0 2024-09-21T11:39:37.487 INFO:tasks.workunit.client.0.smithi118.stdout:9/686: mknod d0/d4/d45/d72/de4/df4/cf7 0 2024-09-21T11:39:37.493 INFO:tasks.workunit.client.0.smithi118.stdout:1/642: getdents d6/de/d16/d3f/d50/d54 0 2024-09-21T11:39:37.493 INFO:tasks.workunit.client.0.smithi118.stdout:4/595: dread d2/d6/dd/d35/f72 [0,4194304] 0 2024-09-21T11:39:37.496 INFO:tasks.workunit.client.0.smithi118.stdout:0/908: chown d5/d10/d1e/d20/f2f 823899 1 2024-09-21T11:39:37.499 INFO:tasks.workunit.client.0.smithi118.stdout:6/561: dread - d8/f96 zero size 2024-09-21T11:39:37.499 INFO:tasks.workunit.client.0.smithi118.stdout:1/643: dwrite d6/de/fb1 [0,4194304] 0 2024-09-21T11:39:37.499 INFO:tasks.workunit.client.0.smithi118.stdout:0/909: chown d5/d10/d1e/d21/db3/dbe/fd0 0 1 2024-09-21T11:39:37.499 INFO:tasks.workunit.client.0.smithi118.stdout:6/562: stat d8/d48 0 2024-09-21T11:39:37.500 INFO:tasks.workunit.client.0.smithi118.stdout:9/687: mknod d0/d4/d45/d72/de4/cf8 0 2024-09-21T11:39:37.504 INFO:tasks.workunit.client.0.smithi118.stdout:4/596: mknod d2/d6/de/d3e/ccc 0 2024-09-21T11:39:37.505 INFO:tasks.workunit.client.0.smithi118.stdout:4/597: chown d2/d8e/cbd 0 1 2024-09-21T11:39:37.506 INFO:tasks.workunit.client.0.smithi118.stdout:0/910: dwrite d5/d10/d1e/d21/fbb [0,4194304] 0 2024-09-21T11:39:37.508 INFO:tasks.workunit.client.0.smithi118.stdout:4/598: chown d2/d6/de/d1c/d23/d26/laa 514218 1 2024-09-21T11:39:37.511 INFO:tasks.workunit.client.0.smithi118.stdout:6/563: read d8/d14/f82 [647102,4329] 0 2024-09-21T11:39:37.512 INFO:tasks.workunit.client.0.smithi118.stdout:7/725: link d0/d3/d14/d41/d7f/d3e/d81/db6/lec d0/d3/d1d/d35/d57/d96/d9e/lee 0 2024-09-21T11:39:37.513 INFO:tasks.workunit.client.0.smithi118.stdout:0/911: truncate d5/d10/d1e/d21/db3/fe0 29475 0 2024-09-21T11:39:37.514 INFO:tasks.workunit.client.0.smithi118.stdout:2/600: write de/d53/f86 [290332,95177] 0 2024-09-21T11:39:37.514 INFO:tasks.workunit.client.0.smithi118.stdout:7/726: fdatasync d0/d3/d14/d41/d66/d9d/fae 0 2024-09-21T11:39:37.516 INFO:tasks.workunit.client.0.smithi118.stdout:2/601: fsync de/d50/d85/fab 0 2024-09-21T11:39:37.520 INFO:tasks.workunit.client.0.smithi118.stdout:0/912: rmdir d5 39 2024-09-21T11:39:37.523 INFO:tasks.workunit.client.0.smithi118.stdout:4/599: mkdir d2/d6/de/d3e/dcb/db0/dcd 0 2024-09-21T11:39:37.523 INFO:tasks.workunit.client.0.smithi118.stdout:7/727: dwrite d0/d3/d1d/d35/f60 [0,4194304] 0 2024-09-21T11:39:37.524 INFO:tasks.workunit.client.0.smithi118.stdout:6/564: mknod d8/d14/d3a/cb9 0 2024-09-21T11:39:37.527 INFO:tasks.workunit.client.0.smithi118.stdout:7/728: fsync d0/f16 0 2024-09-21T11:39:37.528 INFO:tasks.workunit.client.0.smithi118.stdout:2/602: dread de/f12 [0,4194304] 0 2024-09-21T11:39:37.529 INFO:tasks.workunit.client.0.smithi118.stdout:6/565: fsync d8/d48/d5f/f73 0 2024-09-21T11:39:37.531 INFO:tasks.workunit.client.0.smithi118.stdout:0/913: unlink d5/d10/d1e/l22 0 2024-09-21T11:39:37.534 INFO:tasks.workunit.client.0.smithi118.stdout:7/729: unlink d0/d3/f5e 0 2024-09-21T11:39:37.536 INFO:tasks.workunit.client.0.smithi118.stdout:0/914: mknod d5/d10/d1e/d23/d3a/c12e 0 2024-09-21T11:39:37.538 INFO:tasks.workunit.client.0.smithi118.stdout:0/915: read d5/d10/d1e/d33/f72 [3870516,21561] 0 2024-09-21T11:39:37.538 INFO:tasks.workunit.client.0.smithi118.stdout:7/730: write d0/d3/d14/d41/d66/d9d/fa6 [2274230,11998] 0 2024-09-21T11:39:37.541 INFO:tasks.workunit.client.0.smithi118.stdout:6/566: rename d8/d48/d5f/da3/da2 to d8/d14/dba 0 2024-09-21T11:39:37.542 INFO:tasks.workunit.client.0.smithi118.stdout:0/916: mknod d5/d10/d1e/d33/c12f 0 2024-09-21T11:39:37.545 INFO:tasks.workunit.client.0.smithi118.stdout:0/917: dread d5/d10/d1e/d3d/fff [0,4194304] 0 2024-09-21T11:39:37.549 INFO:tasks.workunit.client.0.smithi118.stdout:7/731: mkdir d0/d3/d14/d41/d66/def 0 2024-09-21T11:39:37.550 INFO:tasks.workunit.client.0.smithi118.stdout:6/567: symlink d8/d46/db3/lbb 0 2024-09-21T11:39:37.550 INFO:tasks.workunit.client.0.smithi118.stdout:6/568: chown d8 10123 1 2024-09-21T11:39:37.551 INFO:tasks.workunit.client.0.smithi118.stdout:1/644: write d6/d3b/f57 [2888353,115499] 0 2024-09-21T11:39:37.552 INFO:tasks.workunit.client.0.smithi118.stdout:1/645: readlink d6/l7 0 2024-09-21T11:39:37.555 INFO:tasks.workunit.client.0.smithi118.stdout:7/732: creat d0/d3/d14/d41/da0/ff0 x:0 0 0 2024-09-21T11:39:37.558 INFO:tasks.workunit.client.0.smithi118.stdout:1/646: creat d6/d2a/d3d/db9/fc9 x:0 0 0 2024-09-21T11:39:37.559 INFO:tasks.workunit.client.0.smithi118.stdout:9/688: write d0/f4a [1161991,130282] 0 2024-09-21T11:39:37.563 INFO:tasks.workunit.client.0.smithi118.stdout:7/733: dwrite d0/d3/d1d/d35/d57/f95 [4194304,4194304] 0 2024-09-21T11:39:37.563 INFO:tasks.workunit.client.0.smithi118.stdout:1/647: getdents d6/d2a 0 2024-09-21T11:39:37.564 INFO:tasks.workunit.client.0.smithi118.stdout:9/689: chown d0/d20/d4c/d5f/d66/d98/fba 409775 1 2024-09-21T11:39:37.568 INFO:tasks.workunit.client.0.smithi118.stdout:7/734: mknod d0/d3/d14/d41/d7f/da2/cf1 0 2024-09-21T11:39:37.570 INFO:tasks.workunit.client.0.smithi118.stdout:9/690: mkdir d0/d20/d4c/d5f/d89/df9 0 2024-09-21T11:39:37.571 INFO:tasks.workunit.client.0.smithi118.stdout:9/691: chown d0/d20/d4c/d5f/d66/d98 126818350 1 2024-09-21T11:39:37.571 INFO:tasks.workunit.client.0.smithi118.stdout:7/735: truncate d0/d3/d29/f56 627977 0 2024-09-21T11:39:37.575 INFO:tasks.workunit.client.0.smithi118.stdout:9/692: write d0/d20/d4c/d5f/d89/fe7 [49744,62380] 0 2024-09-21T11:39:37.577 INFO:tasks.workunit.client.0.smithi118.stdout:7/736: creat d0/d3/d14/d41/d66/dcf/ff2 x:0 0 0 2024-09-21T11:39:37.579 INFO:tasks.workunit.client.0.smithi118.stdout:7/737: chown d0/d3/d14/c49 121864 1 2024-09-21T11:39:37.582 INFO:tasks.workunit.client.0.smithi118.stdout:7/738: mknod d0/d3/d29/d47/cf3 0 2024-09-21T11:39:37.586 INFO:tasks.workunit.client.0.smithi118.stdout:7/739: creat d0/d3/d13/ff4 x:0 0 0 2024-09-21T11:39:37.589 INFO:tasks.workunit.client.0.smithi118.stdout:7/740: read d0/f2a [273810,121243] 0 2024-09-21T11:39:37.602 INFO:tasks.workunit.client.0.smithi118.stdout:7/741: dread d0/d3/d14/d41/d7f/f8a [0,4194304] 0 2024-09-21T11:39:37.606 INFO:tasks.workunit.client.0.smithi118.stdout:7/742: creat d0/d3/d1d/d35/d57/d7e/d82/ff5 x:0 0 0 2024-09-21T11:39:37.610 INFO:tasks.workunit.client.0.smithi118.stdout:7/743: creat d0/d3/d1d/d35/d57/d7e/d82/ff6 x:0 0 0 2024-09-21T11:39:37.613 INFO:tasks.workunit.client.0.smithi118.stdout:0/918: dwrite d5/d34/fe4 [0,4194304] 0 2024-09-21T11:39:37.615 INFO:tasks.workunit.client.0.smithi118.stdout:6/569: write d8/f96 [266267,40021] 0 2024-09-21T11:39:37.615 INFO:tasks.workunit.client.0.smithi118.stdout:1/648: getdents d6/d2a/d3d/db9 0 2024-09-21T11:39:37.619 INFO:tasks.workunit.client.0.smithi118.stdout:6/570: fdatasync d8/d48/d45/d61/d66/fad 0 2024-09-21T11:39:37.625 INFO:tasks.workunit.client.0.smithi118.stdout:9/693: write d0/d20/d4c/d5f/d6c/d88/db9/fd1 [1816061,81295] 0 2024-09-21T11:39:37.628 INFO:tasks.workunit.client.0.smithi118.stdout:9/694: rmdir d0/d20/d4c/d5f/d6c 39 2024-09-21T11:39:37.628 INFO:tasks.workunit.client.0.smithi118.stdout:6/571: dwrite d8/d48/d5f/fb1 [0,4194304] 0 2024-09-21T11:39:37.632 INFO:tasks.workunit.client.0.smithi118.stdout:1/649: link d6/d2a/d5c/d85/f9c d6/d3b/fca 0 2024-09-21T11:39:37.637 INFO:tasks.workunit.client.0.smithi118.stdout:1/650: unlink d6/de/d16/d3f/f4f 0 2024-09-21T11:39:37.642 INFO:tasks.workunit.client.0.smithi118.stdout:9/695: creat d0/d20/d4c/d5f/d6c/dd0/ffa x:0 0 0 2024-09-21T11:39:37.642 INFO:tasks.workunit.client.0.smithi118.stdout:1/651: dread - d6/f7f zero size 2024-09-21T11:39:37.644 INFO:tasks.workunit.client.0.smithi118.stdout:1/652: chown d6/de/d13/lc6 42 1 2024-09-21T11:39:37.646 INFO:tasks.workunit.client.0.smithi118.stdout:9/696: rmdir d0/d20/d4c/d5f/d6c/d88 39 2024-09-21T11:39:37.646 INFO:tasks.workunit.client.0.smithi118.stdout:7/744: write d0/d3/d14/d41/d7f/d3e/f42 [2683693,121063] 0 2024-09-21T11:39:37.647 INFO:tasks.workunit.client.0.smithi118.stdout:0/919: write d5/d10/d1e/d3d/fff [3853783,117035] 0 2024-09-21T11:39:37.649 INFO:tasks.workunit.client.0.smithi118.stdout:0/920: stat d5/d10/d1e/d3d/fe5 0 2024-09-21T11:39:37.652 INFO:tasks.workunit.client.0.smithi118.stdout:9/697: creat d0/d20/d4c/d5f/d66/d98/ffb x:0 0 0 2024-09-21T11:39:37.652 INFO:tasks.workunit.client.0.smithi118.stdout:6/572: write d8/fc [2826428,106965] 0 2024-09-21T11:39:37.652 INFO:tasks.workunit.client.0.smithi118.stdout:1/653: truncate d6/de/d16/d3f/d50/d54/d32/f5a 4058596 0 2024-09-21T11:39:37.655 INFO:tasks.workunit.client.0.smithi118.stdout:7/745: creat d0/d3/d1d/d35/d57/d7e/d82/ff7 x:0 0 0 2024-09-21T11:39:37.656 INFO:tasks.workunit.client.0.smithi118.stdout:0/921: symlink d5/d34/d44/d87/d9a/l130 0 2024-09-21T11:39:37.657 INFO:tasks.workunit.client.0.smithi118.stdout:1/654: creat d6/de/d16/d3f/d50/fcb x:0 0 0 2024-09-21T11:39:37.662 INFO:tasks.workunit.client.0.smithi118.stdout:9/698: creat d0/d4/d38/df6/ffc x:0 0 0 2024-09-21T11:39:37.663 INFO:tasks.workunit.client.0.smithi118.stdout:0/922: rename d5/d10/d1e/c12c to d5/d34/d44/d87/de7/c131 0 2024-09-21T11:39:37.664 INFO:tasks.workunit.client.0.smithi118.stdout:1/655: dread d6/de/d16/d3f/f37 [4194304,4194304] 0 2024-09-21T11:39:37.666 INFO:tasks.workunit.client.0.smithi118.stdout:0/923: readlink d5/d10/d1e/d21/db3/dbe/dd7/l123 0 2024-09-21T11:39:37.669 INFO:tasks.workunit.client.0.smithi118.stdout:9/699: mknod d0/d4/d45/d72/de4/df4/cfd 0 2024-09-21T11:39:37.673 INFO:tasks.workunit.client.0.smithi118.stdout:1/656: dwrite d6/de/d16/d3f/d50/d54/d32/f48 [0,4194304] 0 2024-09-21T11:39:37.678 INFO:tasks.workunit.client.0.smithi118.stdout:0/924: creat d5/d10/d1e/d21/db3/dbe/f132 x:0 0 0 2024-09-21T11:39:37.680 INFO:tasks.workunit.client.0.smithi118.stdout:0/925: stat d5/d10/d1e/l10f 0 2024-09-21T11:39:37.681 INFO:tasks.workunit.client.0.smithi118.stdout:9/700: fdatasync d0/d4/d38/f60 0 2024-09-21T11:39:37.685 INFO:tasks.workunit.client.0.smithi118.stdout:1/657: creat d6/d33/d3c/fcc x:0 0 0 2024-09-21T11:39:37.687 INFO:tasks.workunit.client.0.smithi118.stdout:7/746: dwrite d0/d3/d1d/d35/d70/f80 [4194304,4194304] 0 2024-09-21T11:39:37.687 INFO:tasks.workunit.client.0.smithi118.stdout:6/573: dwrite d8/d48/d45/d61/d70/d7d/f8c [0,4194304] 0 2024-09-21T11:39:37.689 INFO:tasks.workunit.client.0.smithi118.stdout:7/747: chown d0/d3/fea 54021 1 2024-09-21T11:39:37.696 INFO:tasks.workunit.client.0.smithi118.stdout:1/658: truncate d6/de/f34 2360038 0 2024-09-21T11:39:37.696 INFO:tasks.workunit.client.0.smithi118.stdout:6/574: rmdir d8/d14/d3a 39 2024-09-21T11:39:37.697 INFO:tasks.workunit.client.0.smithi118.stdout:7/748: symlink d0/d3/d1d/d35/d57/d96/lf8 0 2024-09-21T11:39:37.699 INFO:tasks.workunit.client.0.smithi118.stdout:7/749: read - d0/d3/d13/fe9 zero size 2024-09-21T11:39:37.699 INFO:tasks.workunit.client.0.smithi118.stdout:6/575: symlink d8/d48/d6c/d64/lbc 0 2024-09-21T11:39:37.701 INFO:tasks.workunit.client.0.smithi118.stdout:0/926: getdents d5/d34/d44/d87/da4 0 2024-09-21T11:39:37.703 INFO:tasks.workunit.client.0.smithi118.stdout:6/576: mkdir d8/d48/d5f/dbd 0 2024-09-21T11:39:37.703 INFO:tasks.workunit.client.0.smithi118.stdout:1/659: dwrite d6/de/d16/d3f/d50/fcb [0,4194304] 0 2024-09-21T11:39:37.704 INFO:tasks.workunit.client.0.smithi118.stdout:0/927: mkdir d5/d34/d44/d133 0 2024-09-21T11:39:37.705 INFO:tasks.workunit.client.0.smithi118.stdout:0/928: chown d5/d34/d44/d7c 94 1 2024-09-21T11:39:37.706 INFO:tasks.workunit.client.0.smithi118.stdout:1/660: creat d6/d2a/dc2/fcd x:0 0 0 2024-09-21T11:39:37.708 INFO:tasks.workunit.client.0.smithi118.stdout:6/577: dread d8/d48/d45/d61/d70/d7d/f8c [0,4194304] 0 2024-09-21T11:39:37.709 INFO:tasks.workunit.client.0.smithi118.stdout:1/661: rename d6/d2a/cb2 to d6/d33/d3c/cce 0 2024-09-21T11:39:37.710 INFO:tasks.workunit.client.0.smithi118.stdout:0/929: getdents d5/d34/d44/d87 0 2024-09-21T11:39:37.712 INFO:tasks.workunit.client.0.smithi118.stdout:0/930: write d5/d10/d1e/d23/d3a/d4e/d9d/fa7 [3060682,13060] 0 2024-09-21T11:39:37.713 INFO:tasks.workunit.client.0.smithi118.stdout:6/578: dread d8/d46/f81 [0,4194304] 0 2024-09-21T11:39:37.715 INFO:tasks.workunit.client.0.smithi118.stdout:0/931: unlink d5/d10/d1e/d3d/c54 0 2024-09-21T11:39:37.717 INFO:tasks.workunit.client.0.smithi118.stdout:0/932: mkdir d5/d34/d44/d87/de7/d134 0 2024-09-21T11:39:37.719 INFO:tasks.workunit.client.0.smithi118.stdout:0/933: dread d5/d34/d44/f75 [0,4194304] 0 2024-09-21T11:39:37.719 INFO:tasks.workunit.client.0.smithi118.stdout:0/934: chown d5/d81/l104 18 1 2024-09-21T11:39:37.721 INFO:tasks.workunit.client.0.smithi118.stdout:0/935: symlink d5/d10/d1e/d23/d3a/d4e/d9d/l135 0 2024-09-21T11:39:37.732 INFO:tasks.workunit.client.0.smithi118.stdout:0/936: dread d5/d29/d68/d7b/db7/fc4 [0,4194304] 0 2024-09-21T11:39:37.733 INFO:tasks.workunit.client.0.smithi118.stdout:0/937: read d5/d29/d68/d7b/db7/d48/f8a [275867,121265] 0 2024-09-21T11:39:37.734 INFO:tasks.workunit.client.0.smithi118.stdout:0/938: fdatasync d5/d10/d1e/d3d/d93/fc6 0 2024-09-21T11:39:37.735 INFO:tasks.workunit.client.0.smithi118.stdout:0/939: stat d5/d10/d1e/d21/db3/dbe/dd7 0 2024-09-21T11:39:37.737 INFO:tasks.workunit.client.0.smithi118.stdout:0/940: mkdir d5/d34/d44/d7c/d136 0 2024-09-21T11:39:37.737 INFO:tasks.workunit.client.0.smithi118.stdout:0/941: chown d5/d29/d68 766 1 2024-09-21T11:39:37.738 INFO:tasks.workunit.client.0.smithi118.stdout:0/942: fsync d5/d29/d68/d7b/db7/fc4 0 2024-09-21T11:39:37.761 INFO:tasks.workunit.client.0.smithi118.stdout:6/579: dread d8/d48/d45/d61/d70/f84 [0,4194304] 0 2024-09-21T11:39:37.762 INFO:tasks.workunit.client.0.smithi118.stdout:0/943: dread d5/d29/d68/d7b/db7/d48/ff5 [0,4194304] 0 2024-09-21T11:39:37.767 INFO:tasks.workunit.client.0.smithi118.stdout:9/701: write d0/d4/f29 [1652619,22754] 0 2024-09-21T11:39:37.767 INFO:tasks.workunit.client.0.smithi118.stdout:0/944: symlink d5/d34/d44/d87/d129/l137 0 2024-09-21T11:39:37.769 INFO:tasks.workunit.client.0.smithi118.stdout:0/945: dread - d5/d10/d1e/d21/db3/dbe/f132 zero size 2024-09-21T11:39:37.772 INFO:tasks.workunit.client.0.smithi118.stdout:9/702: creat d0/d4/d45/db5/d86/ffe x:0 0 0 2024-09-21T11:39:37.772 INFO:tasks.workunit.client.0.smithi118.stdout:0/946: rmdir d5/d34/d44/d7c 39 2024-09-21T11:39:37.776 INFO:tasks.workunit.client.0.smithi118.stdout:0/947: mknod d5/d29/d119/c138 0 2024-09-21T11:39:37.782 INFO:tasks.workunit.client.0.smithi118.stdout:0/948: getdents d5/d29/d68/d7b/db7/d48/d11e 0 2024-09-21T11:39:37.788 INFO:tasks.workunit.client.0.smithi118.stdout:1/662: rmdir d6/d2a/d53 39 2024-09-21T11:39:37.797 INFO:tasks.workunit.client.0.smithi118.stdout:9/703: link d0/c62 d0/d20/d4c/d5f/d6c/d88/db9/cff 0 2024-09-21T11:39:37.798 INFO:tasks.workunit.client.0.smithi118.stdout:9/704: truncate d0/d20/d4c/d5f/d6c/d88/db9/fde 1498888 0 2024-09-21T11:39:37.799 INFO:tasks.workunit.client.0.smithi118.stdout:1/663: rmdir d6/d2a 39 2024-09-21T11:39:37.801 INFO:tasks.workunit.client.0.smithi118.stdout:9/705: mknod d0/de2/c100 0 2024-09-21T11:39:37.803 INFO:tasks.workunit.client.0.smithi118.stdout:1/664: creat d6/de/d16/d3f/d50/d54/fcf x:0 0 0 2024-09-21T11:39:37.804 INFO:tasks.workunit.client.0.smithi118.stdout:9/706: dread - d0/d20/f93 zero size 2024-09-21T11:39:37.805 INFO:tasks.workunit.client.0.smithi118.stdout:9/707: truncate d0/d4/d38/df6/ffc 2167 0 2024-09-21T11:39:37.805 INFO:tasks.workunit.client.0.smithi118.stdout:1/665: readlink d6/de/d16/l5d 0 2024-09-21T11:39:37.805 INFO:tasks.workunit.client.0.smithi118.stdout:0/949: write d5/d10/d1e/d20/f2f [4313700,91197] 0 2024-09-21T11:39:37.809 INFO:tasks.workunit.client.0.smithi118.stdout:9/708: symlink d0/d20/d4c/d5f/d6c/d88/d4d/dca/l101 0 2024-09-21T11:39:37.811 INFO:tasks.workunit.client.0.smithi118.stdout:1/666: write d6/d2a/dc2/d9e/fb4 [179003,39944] 0 2024-09-21T11:39:37.812 INFO:tasks.workunit.client.0.smithi118.stdout:0/950: symlink d5/d10/d1e/d21/db3/dbe/dd7/l139 0 2024-09-21T11:39:37.815 INFO:tasks.workunit.client.0.smithi118.stdout:0/951: chown d5/d34/f50 2129094118 1 2024-09-21T11:39:37.817 INFO:tasks.workunit.client.0.smithi118.stdout:1/667: dwrite d6/d33/d3c/fcc [0,4194304] 0 2024-09-21T11:39:37.820 INFO:tasks.workunit.client.0.smithi118.stdout:0/952: unlink d5/d10/d1e/d21/db3/f111 0 2024-09-21T11:39:37.820 INFO:tasks.workunit.client.0.smithi118.stdout:0/953: dread - d5/d34/f65 zero size 2024-09-21T11:39:37.823 INFO:tasks.workunit.client.0.smithi118.stdout:9/709: write d0/d20/d4c/d5f/d66/d98/fba [4470050,95126] 0 2024-09-21T11:39:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:37 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:37 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:37 smithi118 ceph-mon[28757]: Reconfiguring ceph-exporter.smithi149 (dependencies changed)... 2024-09-21T11:39:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:37 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:39:37.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:37 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:39:37.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:37 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:39:37.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:37 smithi118 ceph-mon[28757]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-09-21T11:39:37.825 INFO:tasks.workunit.client.0.smithi118.stdout:1/668: mknod d6/d2a/d3d/cd0 0 2024-09-21T11:39:37.827 INFO:tasks.workunit.client.0.smithi118.stdout:0/954: mkdir d5/d10/d1e/d21/d101/d13a 0 2024-09-21T11:39:37.828 INFO:tasks.workunit.client.0.smithi118.stdout:1/669: chown d6/de/f34 28486769 1 2024-09-21T11:39:37.833 INFO:tasks.workunit.client.0.smithi118.stdout:0/955: unlink d5/d34/d44/d87/d9a/l130 0 2024-09-21T11:39:37.839 INFO:tasks.workunit.client.0.smithi118.stdout:9/710: truncate d0/f4a 1177105 0 2024-09-21T11:39:37.840 INFO:tasks.workunit.client.0.smithi118.stdout:0/956: mknod d5/d10/d1e/d23/d3a/d4e/c13b 0 2024-09-21T11:39:37.847 INFO:tasks.workunit.client.0.smithi118.stdout:1/670: dwrite d6/d33/f5b [4194304,4194304] 0 2024-09-21T11:39:37.852 INFO:tasks.workunit.client.0.smithi118.stdout:1/671: symlink d6/d3b/d45/ld1 0 2024-09-21T11:39:37.853 INFO:tasks.workunit.client.0.smithi118.stdout:1/672: read - d6/d2a/d3d/db9/fc9 zero size 2024-09-21T11:39:37.856 INFO:tasks.workunit.client.0.smithi118.stdout:1/673: fsync d6/d2a/f3a 0 2024-09-21T11:39:37.891 INFO:tasks.workunit.client.0.smithi118.stdout:3/581: sync 2024-09-21T11:39:37.892 INFO:tasks.workunit.client.0.smithi118.stdout:3/582: write d5/d1d/f43 [5167011,30016] 0 2024-09-21T11:39:37.893 INFO:tasks.workunit.client.0.smithi118.stdout:3/583: stat d5/d1d/d1b/d4c/l5e 0 2024-09-21T11:39:37.893 INFO:tasks.workunit.client.0.smithi118.stdout:1/674: truncate d6/de/d16/d3f/d50/d54/d32/f5a 4740982 0 2024-09-21T11:39:37.894 INFO:tasks.workunit.client.0.smithi118.stdout:3/584: dread - d5/d1d/f87 zero size 2024-09-21T11:39:37.896 INFO:tasks.workunit.client.0.smithi118.stdout:3/585: read d5/d1d/d1b/d4c/d73/dc4/fa0 [4406648,103188] 0 2024-09-21T11:39:37.897 INFO:tasks.workunit.client.0.smithi118.stdout:1/675: fsync d6/d2a/f97 0 2024-09-21T11:39:37.898 INFO:tasks.workunit.client.0.smithi118.stdout:1/676: stat d6/d3b/d45 0 2024-09-21T11:39:37.902 INFO:tasks.workunit.client.0.smithi118.stdout:1/677: mknod d6/de/d16/d3f/d50/d54/d32/cd2 0 2024-09-21T11:39:37.903 INFO:tasks.workunit.client.0.smithi118.stdout:3/586: dwrite d5/d1d/d1b/d4c/fa4 [0,4194304] 0 2024-09-21T11:39:37.909 INFO:tasks.workunit.client.0.smithi118.stdout:1/678: link d6/d2a/dc2/fcd d6/fd3 0 2024-09-21T11:39:37.910 INFO:tasks.workunit.client.0.smithi118.stdout:1/679: chown d6/de/d16/cc3 116185473 1 2024-09-21T11:39:37.910 INFO:tasks.workunit.client.0.smithi118.stdout:3/587: fsync f0 0 2024-09-21T11:39:37.914 INFO:tasks.workunit.client.0.smithi118.stdout:3/588: creat d5/d1d/fd5 x:0 0 0 2024-09-21T11:39:37.915 INFO:tasks.workunit.client.0.smithi118.stdout:3/589: write d5/d1d/fd5 [760253,46989] 0 2024-09-21T11:39:37.916 INFO:tasks.workunit.client.0.smithi118.stdout:3/590: dread - d5/d28/d3e/fbc zero size 2024-09-21T11:39:37.920 INFO:tasks.workunit.client.0.smithi118.stdout:1/680: write d6/de/d16/d3f/d50/d72/f75 [3077276,19266] 0 2024-09-21T11:39:37.924 INFO:tasks.workunit.client.0.smithi118.stdout:3/591: write d5/d28/f54 [499711,38326] 0 2024-09-21T11:39:37.926 INFO:tasks.workunit.client.0.smithi118.stdout:1/681: write d6/d2a/f23 [5513482,12539] 0 2024-09-21T11:39:37.927 INFO:tasks.workunit.client.0.smithi118.stdout:3/592: fsync d5/d28/f54 0 2024-09-21T11:39:37.929 INFO:tasks.workunit.client.0.smithi118.stdout:3/593: symlink d5/d1d/d1b/da7/ld6 0 2024-09-21T11:39:37.930 INFO:tasks.workunit.client.0.smithi118.stdout:1/682: mkdir d6/de/d16/d3f/d50/d54/d32/dd4 0 2024-09-21T11:39:37.935 INFO:tasks.workunit.client.0.smithi118.stdout:3/594: dwrite d5/d1d/d1b/d4c/d73/fb5 [0,4194304] 0 2024-09-21T11:39:37.936 INFO:tasks.workunit.client.0.smithi118.stdout:3/595: chown d5/d1d/d1b/d4c/l5e 6 1 2024-09-21T11:39:37.941 INFO:tasks.workunit.client.0.smithi118.stdout:1/683: write d6/f7f [817453,119003] 0 2024-09-21T11:39:37.945 INFO:tasks.workunit.client.0.smithi118.stdout:1/684: creat d6/d2a/d5c/fd5 x:0 0 0 2024-09-21T11:39:37.949 INFO:tasks.workunit.client.0.smithi118.stdout:3/596: dwrite f2 [8388608,4194304] 0 2024-09-21T11:39:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:37 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:37 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:37 smithi149 ceph-mon[36123]: Reconfiguring ceph-exporter.smithi149 (dependencies changed)... 2024-09-21T11:39:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:37 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T11:39:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:37 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:39:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:37 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:39:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:37 smithi149 ceph-mon[36123]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-09-21T11:39:37.950 INFO:tasks.workunit.client.0.smithi118.stdout:3/597: chown d5/d1d/d1b/d4c/l51 21088030 1 2024-09-21T11:39:37.951 INFO:tasks.workunit.client.0.smithi118.stdout:3/598: chown d5/d1d/d1b/d4c/f63 0 1 2024-09-21T11:39:37.952 INFO:tasks.workunit.client.0.smithi118.stdout:1/685: creat d6/de/d16/fd6 x:0 0 0 2024-09-21T11:39:37.953 INFO:tasks.workunit.client.0.smithi118.stdout:1/686: fdatasync d6/d33/f5b 0 2024-09-21T11:39:37.953 INFO:tasks.workunit.client.0.smithi118.stdout:1/687: readlink d6/d3b/la1 0 2024-09-21T11:39:37.958 INFO:tasks.workunit.client.0.smithi118.stdout:1/688: getdents d6/d2a/dc2 0 2024-09-21T11:39:37.958 INFO:tasks.workunit.client.0.smithi118.stdout:1/689: read - d6/d33/d3c/fbf zero size 2024-09-21T11:39:37.961 INFO:tasks.workunit.client.0.smithi118.stdout:1/690: getdents d6/de/d16/d3f/d50/d54/d32/dd4 0 2024-09-21T11:39:37.976 INFO:tasks.workunit.client.0.smithi118.stdout:3/599: dwrite d5/d1d/f16 [4194304,4194304] 0 2024-09-21T11:39:37.977 INFO:tasks.workunit.client.0.smithi118.stdout:3/600: fdatasync d5/d28/d3e/f8f 0 2024-09-21T11:39:37.980 INFO:tasks.workunit.client.0.smithi118.stdout:3/601: read d5/d1d/d1b/d24/dcd/f90 [93060,48710] 0 2024-09-21T11:39:37.981 INFO:tasks.workunit.client.0.smithi118.stdout:3/602: truncate d5/d28/d3e/fbc 1030940 0 2024-09-21T11:39:37.985 INFO:tasks.workunit.client.0.smithi118.stdout:3/603: creat d5/d28/d3e/d5d/d8d/fd7 x:0 0 0 2024-09-21T11:39:37.987 INFO:tasks.workunit.client.0.smithi118.stdout:3/604: truncate d5/d1d/f32 1036384 0 2024-09-21T11:39:37.990 INFO:tasks.workunit.client.0.smithi118.stdout:3/605: creat d5/d28/d3e/daa/fd8 x:0 0 0 2024-09-21T11:39:37.992 INFO:tasks.workunit.client.0.smithi118.stdout:3/606: creat d5/d1d/d1b/da7/daf/fd9 x:0 0 0 2024-09-21T11:39:37.993 INFO:tasks.workunit.client.0.smithi118.stdout:3/607: rmdir d5/d1d/d1b/d24 39 2024-09-21T11:39:37.994 INFO:tasks.workunit.client.0.smithi118.stdout:3/608: chown d5/d1d/d1b/d4c/d91/d69 97086 1 2024-09-21T11:39:37.996 INFO:tasks.workunit.client.0.smithi118.stdout:3/609: creat d5/d1d/d1b/d4c/d73/d9b/fda x:0 0 0 2024-09-21T11:39:37.999 INFO:tasks.workunit.client.0.smithi118.stdout:3/610: link d5/d28/d3e/fbc d5/d1d/d1b/d4c/d91/fdb 0 2024-09-21T11:39:38.005 INFO:tasks.workunit.client.0.smithi118.stdout:3/611: dwrite d5/d1d/d1b/d24/dcd/fbb [0,4194304] 0 2024-09-21T11:39:38.006 INFO:tasks.workunit.client.0.smithi118.stdout:3/612: fdatasync d5/d1d/d1b/d24/f6c 0 2024-09-21T11:39:38.007 INFO:tasks.workunit.client.0.smithi118.stdout:3/613: fsync d5/d1d/d1b/d4c/d91/fa2 0 2024-09-21T11:39:38.011 INFO:tasks.workunit.client.0.smithi118.stdout:3/614: rename d5/d28/d3e/d5d/d5f/ld3 to d5/d1d/d1b/d4c/d73/dc4/ldc 0 2024-09-21T11:39:38.022 INFO:tasks.workunit.client.0.smithi118.stdout:3/615: dread d5/d1d/f81 [0,4194304] 0 2024-09-21T11:39:38.025 INFO:tasks.workunit.client.0.smithi118.stdout:3/616: mkdir d5/d1d/d1b/d4c/d91/d69/ddd 0 2024-09-21T11:39:38.030 INFO:tasks.workunit.client.0.smithi118.stdout:3/617: getdents d5/d28/d3e/d5d/d5f 0 2024-09-21T11:39:38.042 INFO:tasks.workunit.client.0.smithi118.stdout:2/603: sync 2024-09-21T11:39:38.042 INFO:tasks.workunit.client.0.smithi118.stdout:5/658: sync 2024-09-21T11:39:38.042 INFO:tasks.workunit.client.0.smithi118.stdout:4/600: sync 2024-09-21T11:39:38.043 INFO:tasks.workunit.client.0.smithi118.stdout:2/604: read - de/d16/d1c/d66/d9a/fa3 zero size 2024-09-21T11:39:38.044 INFO:tasks.workunit.client.0.smithi118.stdout:5/659: dread d0/d6c/d25/f7d [0,4194304] 0 2024-09-21T11:39:38.047 INFO:tasks.workunit.client.0.smithi118.stdout:3/618: truncate d5/d1d/d1b/d24/f36 400271 0 2024-09-21T11:39:38.048 INFO:tasks.workunit.client.0.smithi118.stdout:2/605: dread de/d1f/d20/d67/d8a/d6d/d70/f90 [0,4194304] 0 2024-09-21T11:39:38.048 INFO:tasks.workunit.client.0.smithi118.stdout:4/601: creat d2/d6/de/d1c/d87/fce x:0 0 0 2024-09-21T11:39:38.050 INFO:tasks.workunit.client.0.smithi118.stdout:5/660: rmdir d0 39 2024-09-21T11:39:38.053 INFO:tasks.workunit.client.0.smithi118.stdout:4/602: chown d2/d6/dd/c5b 10100118 1 2024-09-21T11:39:38.054 INFO:tasks.workunit.client.0.smithi118.stdout:3/619: mknod d5/d28/d3e/d5d/cde 0 2024-09-21T11:39:38.055 INFO:tasks.workunit.client.0.smithi118.stdout:2/606: stat de/d51/c75 0 2024-09-21T11:39:38.056 INFO:tasks.workunit.client.0.smithi118.stdout:2/607: read de/d1f/d20/d67/d8a/d6d/d70/f90 [149380,90152] 0 2024-09-21T11:39:38.059 INFO:tasks.workunit.client.0.smithi118.stdout:5/661: creat d0/db/d35/d30/d1a/fe1 x:0 0 0 2024-09-21T11:39:38.060 INFO:tasks.workunit.client.0.smithi118.stdout:2/608: mknod de/d16/ccd 0 2024-09-21T11:39:38.061 INFO:tasks.workunit.client.0.smithi118.stdout:3/620: dwrite d5/d1d/d1b/d24/fc0 [0,4194304] 0 2024-09-21T11:39:38.063 INFO:tasks.workunit.client.0.smithi118.stdout:3/621: chown d5/d28/d3e/f8f 320 1 2024-09-21T11:39:38.068 INFO:tasks.workunit.client.0.smithi118.stdout:3/622: mkdir d5/d1d/d1b/da7/ddf 0 2024-09-21T11:39:38.070 INFO:tasks.workunit.client.0.smithi118.stdout:2/609: dwrite de/d51/fad [0,4194304] 0 2024-09-21T11:39:38.070 INFO:tasks.workunit.client.0.smithi118.stdout:5/662: link d0/db/d35/d2c/ca0 d0/d6c/d25/d50/ce2 0 2024-09-21T11:39:38.071 INFO:tasks.workunit.client.0.smithi118.stdout:4/603: dread d2/d6/de/d1c/d23/f2c [0,4194304] 0 2024-09-21T11:39:38.072 INFO:tasks.workunit.client.0.smithi118.stdout:5/663: readlink d0/db/d35/l23 0 2024-09-21T11:39:38.072 INFO:tasks.workunit.client.0.smithi118.stdout:3/623: rmdir d5/d1d/d1b/d4c/d91 39 2024-09-21T11:39:38.074 INFO:tasks.workunit.client.0.smithi118.stdout:3/624: chown d5/d1d/d1b/d4c/f9e 3760688 1 2024-09-21T11:39:38.074 INFO:tasks.workunit.client.0.smithi118.stdout:2/610: rename de/d16/d1c to de/d16/d31/dce 0 2024-09-21T11:39:38.076 INFO:tasks.workunit.client.0.smithi118.stdout:2/611: write de/d53/f86 [1313029,2087] 0 2024-09-21T11:39:38.080 INFO:tasks.workunit.client.0.smithi118.stdout:4/604: rename d2/f7c to d2/d6/de/d1c/fcf 0 2024-09-21T11:39:38.081 INFO:tasks.workunit.client.0.smithi118.stdout:4/605: truncate d2/d6/de/d1c/f9f 1239851 0 2024-09-21T11:39:38.083 INFO:tasks.workunit.client.0.smithi118.stdout:5/664: link d0/db/d35/da/c47 d0/db/d35/d30/ce3 0 2024-09-21T11:39:38.085 INFO:tasks.workunit.client.0.smithi118.stdout:5/665: truncate d0/d89/daa/fcd 514709 0 2024-09-21T11:39:38.088 INFO:tasks.workunit.client.0.smithi118.stdout:4/606: dwrite d2/d6/dd/d35/f3f [0,4194304] 0 2024-09-21T11:39:38.102 INFO:tasks.workunit.client.0.smithi118.stdout:4/607: dread d2/f8a [4194304,4194304] 0 2024-09-21T11:39:38.106 INFO:tasks.workunit.client.0.smithi118.stdout:3/625: write d5/d1d/d1b/d4c/f7d [378685,19341] 0 2024-09-21T11:39:38.111 INFO:tasks.workunit.client.0.smithi118.stdout:2/612: dwrite de/d1f/d20/f27 [0,4194304] 0 2024-09-21T11:39:38.116 INFO:tasks.workunit.client.0.smithi118.stdout:2/613: creat de/d16/d31/dce/d4f/d5b/fcf x:0 0 0 2024-09-21T11:39:38.117 INFO:tasks.workunit.client.0.smithi118.stdout:2/614: write de/d1f/d20/fb7 [371140,48610] 0 2024-09-21T11:39:38.119 INFO:tasks.workunit.client.0.smithi118.stdout:2/615: stat de/d1f/d20/d67/d8a/d6d/d70/l8f 0 2024-09-21T11:39:38.119 INFO:tasks.workunit.client.0.smithi118.stdout:5/666: write d0/db/f87 [1048429,61455] 0 2024-09-21T11:39:38.120 INFO:tasks.workunit.client.0.smithi118.stdout:5/667: write d0/db/f16 [5135820,53082] 0 2024-09-21T11:39:38.123 INFO:tasks.workunit.client.0.smithi118.stdout:4/608: write d2/d6/dd/d35/f72 [1496170,60718] 0 2024-09-21T11:39:38.124 INFO:tasks.workunit.client.0.smithi118.stdout:2/616: creat de/d1f/d20/fd0 x:0 0 0 2024-09-21T11:39:38.125 INFO:tasks.workunit.client.0.smithi118.stdout:5/668: symlink d0/dd1/le4 0 2024-09-21T11:39:38.126 INFO:tasks.workunit.client.0.smithi118.stdout:3/626: write d5/d28/f71 [4273569,25595] 0 2024-09-21T11:39:38.127 INFO:tasks.workunit.client.0.smithi118.stdout:5/669: chown d0/db/d35/d30/c79 261381891 1 2024-09-21T11:39:38.128 INFO:tasks.workunit.client.0.smithi118.stdout:4/609: readlink d2/d6/de/d3e/l78 0 2024-09-21T11:39:38.130 INFO:tasks.workunit.client.0.smithi118.stdout:3/627: creat d5/d1d/d1b/d50/fe0 x:0 0 0 2024-09-21T11:39:38.131 INFO:tasks.workunit.client.0.smithi118.stdout:5/670: mknod d0/db/d35/d30/d1a/db3/ce5 0 2024-09-21T11:39:38.132 INFO:tasks.workunit.client.0.smithi118.stdout:3/628: fsync d5/d1d/f81 0 2024-09-21T11:39:38.133 INFO:tasks.workunit.client.0.smithi118.stdout:3/629: dread - d5/d28/d33/fd2 zero size 2024-09-21T11:39:38.134 INFO:tasks.workunit.client.0.smithi118.stdout:2/617: getdents de/d16/d31/dce/d66/d9a 0 2024-09-21T11:39:38.135 INFO:tasks.workunit.client.0.smithi118.stdout:3/630: chown d5/d1d/d1b/d24/dcd/f82 851 1 2024-09-21T11:39:38.135 INFO:tasks.workunit.client.0.smithi118.stdout:4/610: dread d2/d6/de/d1c/f9c [0,4194304] 0 2024-09-21T11:39:38.136 INFO:tasks.workunit.client.0.smithi118.stdout:5/671: creat d0/db/d35/d30/d1a/d8f/d99/fe6 x:0 0 0 2024-09-21T11:39:38.137 INFO:tasks.workunit.client.0.smithi118.stdout:2/618: unlink de/d1f/d20/f97 0 2024-09-21T11:39:38.139 INFO:tasks.workunit.client.0.smithi118.stdout:4/611: write d2/d6/de/d1c/d4d/d52/d69/f82 [4515475,92696] 0 2024-09-21T11:39:38.143 INFO:tasks.workunit.client.0.smithi118.stdout:5/672: creat d0/db/d35/d30/d1a/db3/fe7 x:0 0 0 2024-09-21T11:39:38.150 INFO:tasks.workunit.client.0.smithi118.stdout:3/631: truncate d5/d1d/d1b/d4c/d73/dc4/fa0 612887 0 2024-09-21T11:39:38.150 INFO:tasks.workunit.client.0.smithi118.stdout:2/619: symlink de/d16/d25/ld1 0 2024-09-21T11:39:38.155 INFO:tasks.workunit.client.0.smithi118.stdout:5/673: mkdir d0/d6c/d67/de8 0 2024-09-21T11:39:38.155 INFO:tasks.workunit.client.0.smithi118.stdout:4/612: write d2/d6/de/d1c/d23/f92 [739575,16334] 0 2024-09-21T11:39:38.157 INFO:tasks.workunit.client.0.smithi118.stdout:3/632: chown d5/d1d/d1b/d50/l75 58598142 1 2024-09-21T11:39:38.158 INFO:tasks.workunit.client.0.smithi118.stdout:5/674: mknod d0/db/d35/d2c/d40/ce9 0 2024-09-21T11:39:38.160 INFO:tasks.workunit.client.0.smithi118.stdout:2/620: creat de/d1f/d20/d67/fd2 x:0 0 0 2024-09-21T11:39:38.160 INFO:tasks.workunit.client.0.smithi118.stdout:3/633: creat d5/d28/d3e/daa/fe1 x:0 0 0 2024-09-21T11:39:38.160 INFO:tasks.workunit.client.0.smithi118.stdout:2/621: dread - de/d16/d31/dce/d4f/d5b/fcf zero size 2024-09-21T11:39:38.162 INFO:tasks.workunit.client.0.smithi118.stdout:4/613: symlink d2/d6/de/d1c/d23/ld0 0 2024-09-21T11:39:38.164 INFO:tasks.workunit.client.0.smithi118.stdout:3/634: chown d5/d1d/d1b/d4c/d91/f93 57369 1 2024-09-21T11:39:38.166 INFO:tasks.workunit.client.0.smithi118.stdout:2/622: dread de/d22/d3c/f8e [0,4194304] 0 2024-09-21T11:39:38.170 INFO:tasks.workunit.client.0.smithi118.stdout:3/635: dwrite d5/d1d/d1b/d4c/d73/fb5 [0,4194304] 0 2024-09-21T11:39:38.176 INFO:tasks.workunit.client.0.smithi118.stdout:3/636: symlink d5/d28/d3e/le2 0 2024-09-21T11:39:38.178 INFO:tasks.workunit.client.0.smithi118.stdout:2/623: creat de/d1f/d20/d78/d98/fd3 x:0 0 0 2024-09-21T11:39:38.178 INFO:tasks.workunit.client.0.smithi118.stdout:3/637: readlink d5/d1d/d1b/d4c/d73/l9d 0 2024-09-21T11:39:38.179 INFO:tasks.workunit.client.0.smithi118.stdout:5/675: dread d0/db/d35/f3d [0,4194304] 0 2024-09-21T11:39:38.179 INFO:tasks.workunit.client.0.smithi118.stdout:2/624: fdatasync de/f14 0 2024-09-21T11:39:38.180 INFO:tasks.workunit.client.0.smithi118.stdout:4/614: write d2/d6/de/d1c/d23/d26/f95 [1330503,23905] 0 2024-09-21T11:39:38.180 INFO:tasks.workunit.client.0.smithi118.stdout:3/638: dread - d5/d1d/f87 zero size 2024-09-21T11:39:38.182 INFO:tasks.workunit.client.0.smithi118.stdout:4/615: chown d2/d6/de/d1c/d23/l42 1745 1 2024-09-21T11:39:38.183 INFO:tasks.workunit.client.0.smithi118.stdout:5/676: rename d0 to d0/db/d35/d30/d1a/d8f/dea 22 2024-09-21T11:39:38.187 INFO:tasks.workunit.client.0.smithi118.stdout:3/639: rmdir d5/d1d/d1b/da7 39 2024-09-21T11:39:38.192 INFO:tasks.workunit.client.0.smithi118.stdout:2/625: link de/d1f/d20/f27 de/d16/d25/fd4 0 2024-09-21T11:39:38.194 INFO:tasks.workunit.client.0.smithi118.stdout:2/626: dread de/d1f/d20/d67/d8a/d6d/d70/f90 [0,4194304] 0 2024-09-21T11:39:38.194 INFO:tasks.workunit.client.0.smithi118.stdout:3/640: read d5/d28/f3b [3350016,96433] 0 2024-09-21T11:39:38.195 INFO:tasks.workunit.client.0.smithi118.stdout:4/616: write d2/f2d [1454509,24258] 0 2024-09-21T11:39:38.202 INFO:tasks.workunit.client.0.smithi118.stdout:4/617: symlink d2/d6/de/d1c/d87/ld1 0 2024-09-21T11:39:38.202 INFO:tasks.workunit.client.0.smithi118.stdout:5/677: dwrite d0/d6c/d25/f4f [0,4194304] 0 2024-09-21T11:39:38.206 INFO:tasks.workunit.client.0.smithi118.stdout:2/627: dwrite de/d16/d31/dce/fb9 [0,4194304] 0 2024-09-21T11:39:38.206 INFO:tasks.workunit.client.0.smithi118.stdout:4/618: creat d2/d8e/fd2 x:0 0 0 2024-09-21T11:39:38.209 INFO:tasks.workunit.client.0.smithi118.stdout:3/641: dwrite d5/d28/d3e/d5d/d5f/f68 [0,4194304] 0 2024-09-21T11:39:38.210 INFO:tasks.workunit.client.0.smithi118.stdout:5/678: mkdir d0/db/deb 0 2024-09-21T11:39:38.211 INFO:tasks.workunit.client.0.smithi118.stdout:2/628: creat de/d16/d31/dce/d66/fd5 x:0 0 0 2024-09-21T11:39:38.212 INFO:tasks.workunit.client.0.smithi118.stdout:3/642: write d5/d28/d3e/d5d/d5f/f67 [1879617,117406] 0 2024-09-21T11:39:38.214 INFO:tasks.workunit.client.0.smithi118.stdout:5/679: truncate d0/d63/f9b 492171 0 2024-09-21T11:39:38.217 INFO:tasks.workunit.client.0.smithi118.stdout:2/629: creat de/d16/d31/dce/d65/da2/fd6 x:0 0 0 2024-09-21T11:39:38.218 INFO:tasks.workunit.client.0.smithi118.stdout:4/619: link d2/d6/de/d1c/d87/da9/fc1 d2/d6/dd/fd3 0 2024-09-21T11:39:38.219 INFO:tasks.workunit.client.0.smithi118.stdout:4/620: dread - d2/d6/de/d1c/d87/fc3 zero size 2024-09-21T11:39:38.221 INFO:tasks.workunit.client.0.smithi118.stdout:3/643: creat d5/d1d/d8c/fe3 x:0 0 0 2024-09-21T11:39:38.221 INFO:tasks.workunit.client.0.smithi118.stdout:2/630: mknod de/d1f/d20/d78/cd7 0 2024-09-21T11:39:38.225 INFO:tasks.workunit.client.0.smithi118.stdout:3/644: mknod d5/d28/ce4 0 2024-09-21T11:39:38.228 INFO:tasks.workunit.client.0.smithi118.stdout:3/645: unlink d5/d28/d3e/d5d/d5f/d88/cb7 0 2024-09-21T11:39:38.230 INFO:tasks.workunit.client.0.smithi118.stdout:3/646: creat d5/d28/d3e/fe5 x:0 0 0 2024-09-21T11:39:38.231 INFO:tasks.workunit.client.0.smithi118.stdout:3/647: rmdir d5/d1d/d1b/d4c/d91/d69 39 2024-09-21T11:39:38.256 INFO:tasks.workunit.client.0.smithi118.stdout:2/631: write de/d22/d3c/f8e [2022319,118144] 0 2024-09-21T11:39:38.256 INFO:tasks.workunit.client.0.smithi118.stdout:4/621: truncate d2/d6/de/d1c/d23/f92 536809 0 2024-09-21T11:39:38.256 INFO:tasks.workunit.client.0.smithi118.stdout:7/750: sync 2024-09-21T11:39:38.259 INFO:tasks.workunit.client.0.smithi118.stdout:5/680: dwrite d0/f5 [0,4194304] 0 2024-09-21T11:39:38.262 INFO:tasks.workunit.client.0.smithi118.stdout:2/632: creat de/d50/d85/fd8 x:0 0 0 2024-09-21T11:39:38.262 INFO:tasks.workunit.client.0.smithi118.stdout:4/622: unlink d2/d6/de/d1c/d4d/f9a 0 2024-09-21T11:39:38.262 INFO:tasks.workunit.client.0.smithi118.stdout:3/648: write d5/d1d/d8c/fc3 [3624757,16241] 0 2024-09-21T11:39:38.269 INFO:tasks.workunit.client.0.smithi118.stdout:2/633: write de/f2a [1968804,58269] 0 2024-09-21T11:39:38.270 INFO:tasks.workunit.client.0.smithi118.stdout:3/649: mknod d5/d28/d3e/d5d/d8d/ce6 0 2024-09-21T11:39:38.272 INFO:tasks.workunit.client.0.smithi118.stdout:7/751: symlink d0/d3/dd9/lf9 0 2024-09-21T11:39:38.276 INFO:tasks.workunit.client.0.smithi118.stdout:4/623: stat d2/d65/f6d 0 2024-09-21T11:39:38.277 INFO:tasks.workunit.client.0.smithi118.stdout:3/650: dwrite d5/d1d/fd5 [0,4194304] 0 2024-09-21T11:39:38.278 INFO:tasks.workunit.client.0.smithi118.stdout:3/651: chown d5/d28/d33/l58 367522754 1 2024-09-21T11:39:38.282 INFO:tasks.workunit.client.0.smithi118.stdout:5/681: write d0/d63/f78 [1656496,43892] 0 2024-09-21T11:39:38.284 INFO:tasks.workunit.client.0.smithi118.stdout:3/652: dread d5/d1d/d1b/d4c/d73/fb5 [0,4194304] 0 2024-09-21T11:39:38.284 INFO:tasks.workunit.client.0.smithi118.stdout:7/752: creat d0/ffa x:0 0 0 2024-09-21T11:39:38.288 INFO:tasks.workunit.client.0.smithi118.stdout:4/624: creat d2/d6/de/d1c/fd4 x:0 0 0 2024-09-21T11:39:38.290 INFO:tasks.workunit.client.0.smithi118.stdout:3/653: dwrite d5/d1d/d1b/d4c/d91/f7b [0,4194304] 0 2024-09-21T11:39:38.293 INFO:tasks.workunit.client.0.smithi118.stdout:7/753: rmdir d0/d3/d29/d5f/d71 39 2024-09-21T11:39:38.298 INFO:tasks.workunit.client.0.smithi118.stdout:3/654: symlink d5/d1d/le7 0 2024-09-21T11:39:38.300 INFO:tasks.workunit.client.0.smithi118.stdout:5/682: rename d0/d89/f8e to d0/d89/d9d/fec 0 2024-09-21T11:39:38.302 INFO:tasks.workunit.client.0.smithi118.stdout:2/634: link de/d1f/f4c de/d16/d25/dba/db5/fd9 0 2024-09-21T11:39:38.303 INFO:tasks.workunit.client.0.smithi118.stdout:4/625: symlink d2/d6/de/d1c/d23/ld5 0 2024-09-21T11:39:38.304 INFO:tasks.workunit.client.0.smithi118.stdout:3/655: creat d5/d28/d33/fe8 x:0 0 0 2024-09-21T11:39:38.308 INFO:tasks.workunit.client.0.smithi118.stdout:7/754: rename d0/d3/d1d/d35/d57/d96/d9e/lbc to d0/d3/d14/d41/d7f/d3e/d81/db6/lfb 0 2024-09-21T11:39:38.309 INFO:tasks.workunit.client.0.smithi118.stdout:3/656: truncate d5/d1d/d1b/d24/dcd/f95 567680 0 2024-09-21T11:39:38.311 INFO:tasks.workunit.client.0.smithi118.stdout:5/683: dwrite d0/db/d35/d2c/d40/fdc [0,4194304] 0 2024-09-21T11:39:38.313 INFO:tasks.workunit.client.0.smithi118.stdout:4/626: rename d2/d6/de/d3e to d2/d6/de/d1c/d23/d26/dd6 0 2024-09-21T11:39:38.315 INFO:tasks.workunit.client.0.smithi118.stdout:2/635: getdents de/d1f/d20/d67/d8a/d6d/d70 0 2024-09-21T11:39:38.315 INFO:tasks.workunit.client.0.smithi118.stdout:2/636: chown de/d1f/d20/d78 30254 1 2024-09-21T11:39:38.322 INFO:tasks.workunit.client.0.smithi118.stdout:4/627: mknod d2/d6/de/d1c/d23/d26/d74/cd7 0 2024-09-21T11:39:38.326 INFO:tasks.workunit.client.0.smithi118.stdout:7/755: rmdir d0/d3/d29/d5f/d71 39 2024-09-21T11:39:38.327 INFO:tasks.workunit.client.0.smithi118.stdout:3/657: mknod d5/d28/d33/d4a/dc8/ce9 0 2024-09-21T11:39:38.331 INFO:tasks.workunit.client.0.smithi118.stdout:7/756: mknod d0/d3/d14/d41/d66/d9d/cfc 0 2024-09-21T11:39:38.334 INFO:tasks.workunit.client.0.smithi118.stdout:3/658: mknod d5/d1d/d1b/d4c/d91/d69/cea 0 2024-09-21T11:39:38.336 INFO:tasks.workunit.client.0.smithi118.stdout:4/628: link d2/d6/de/d1c/d23/d26/dd6/dcb/c8f d2/d6/de/d1c/d87/da9/da8/cd8 0 2024-09-21T11:39:38.339 INFO:tasks.workunit.client.0.smithi118.stdout:7/757: rename d0/d3/d1d/d35/d57/d96/le5 to d0/d3/d14/d41/d7f/lfd 0 2024-09-21T11:39:38.345 INFO:tasks.workunit.client.0.smithi118.stdout:7/758: read d0/d3/d13/d8f/fa7 [174042,25899] 0 2024-09-21T11:39:38.346 INFO:tasks.workunit.client.0.smithi118.stdout:2/637: write de/d16/d25/dba/db5/fd9 [2496367,78864] 0 2024-09-21T11:39:38.352 INFO:tasks.workunit.client.0.smithi118.stdout:2/638: rename de/d1f/d20/d78/d98/fd3 to de/d1f/d20/d67/d99/fda 0 2024-09-21T11:39:38.352 INFO:tasks.workunit.client.0.smithi118.stdout:3/659: write d5/d1d/d1b/d24/f36 [1368906,4929] 0 2024-09-21T11:39:38.353 INFO:tasks.workunit.client.0.smithi118.stdout:3/660: chown d5/d1d/d1b/d4c/f9e 25054 1 2024-09-21T11:39:38.353 INFO:tasks.workunit.client.0.smithi118.stdout:2/639: write de/d53/f86 [1643087,101568] 0 2024-09-21T11:39:38.354 INFO:tasks.workunit.client.0.smithi118.stdout:4/629: write d2/f8a [710839,127741] 0 2024-09-21T11:39:38.355 INFO:tasks.workunit.client.0.smithi118.stdout:3/661: write d5/d1d/d1b/d4c/f7d [762173,106906] 0 2024-09-21T11:39:38.361 INFO:tasks.workunit.client.0.smithi118.stdout:7/759: dwrite d0/d3/d13/f55 [0,4194304] 0 2024-09-21T11:39:38.361 INFO:tasks.workunit.client.0.smithi118.stdout:2/640: unlink de/d16/f8c 0 2024-09-21T11:39:38.364 INFO:tasks.workunit.client.0.smithi118.stdout:2/641: read de/d1f/d20/d67/d8a/d6d/d70/f93 [757076,76234] 0 2024-09-21T11:39:38.364 INFO:tasks.workunit.client.0.smithi118.stdout:4/630: creat d2/d6/de/d1c/d23/d26/dd6/dcb/fd9 x:0 0 0 2024-09-21T11:39:38.366 INFO:tasks.workunit.client.0.smithi118.stdout:3/662: rmdir d5/d1d/d1b/da7 39 2024-09-21T11:39:38.368 INFO:tasks.workunit.client.0.smithi118.stdout:7/760: mkdir d0/d3/d14/d41/d66/d9d/dfe 0 2024-09-21T11:39:38.368 INFO:tasks.workunit.client.0.smithi118.stdout:4/631: stat d2/d65/fb6 0 2024-09-21T11:39:38.372 INFO:tasks.workunit.client.0.smithi118.stdout:3/663: symlink d5/d28/d3e/d5d/d5f/leb 0 2024-09-21T11:39:38.375 INFO:tasks.workunit.client.0.smithi118.stdout:7/761: symlink d0/d3/d1d/d35/d57/d7e/lff 0 2024-09-21T11:39:38.376 INFO:tasks.workunit.client.0.smithi118.stdout:2/642: dwrite de/d1f/d20/d67/d99/fda [0,4194304] 0 2024-09-21T11:39:38.377 INFO:tasks.workunit.client.0.smithi118.stdout:7/762: chown d0/d3/d14/d41/d66/d9d 22636 1 2024-09-21T11:39:38.378 INFO:tasks.workunit.client.0.smithi118.stdout:2/643: write de/d53/fb3 [157706,23107] 0 2024-09-21T11:39:38.379 INFO:tasks.workunit.client.0.smithi118.stdout:3/664: mkdir d5/d28/d33/dec 0 2024-09-21T11:39:38.381 INFO:tasks.workunit.client.0.smithi118.stdout:4/632: symlink d2/lda 0 2024-09-21T11:39:38.381 INFO:tasks.workunit.client.0.smithi118.stdout:2/644: dread de/f12 [0,4194304] 0 2024-09-21T11:39:38.383 INFO:tasks.workunit.client.0.smithi118.stdout:4/633: write d2/d6/de/d1c/f9f [2076814,20702] 0 2024-09-21T11:39:38.383 INFO:tasks.workunit.client.0.smithi118.stdout:2/645: write de/d1f/d20/fb7 [896553,29504] 0 2024-09-21T11:39:38.384 INFO:tasks.workunit.client.0.smithi118.stdout:2/646: fsync de/d53/f86 0 2024-09-21T11:39:38.384 INFO:tasks.workunit.client.0.smithi118.stdout:4/634: fdatasync d2/d6/de/d1c/d4d/d52/d69/fc4 0 2024-09-21T11:39:38.386 INFO:tasks.workunit.client.0.smithi118.stdout:7/763: mkdir d0/d3/d14/d41/d8b/da4/db2/d100 0 2024-09-21T11:39:38.387 INFO:tasks.workunit.client.0.smithi118.stdout:7/764: chown d0/d3/d1d/d35/d57/d7e/d82/ff5 80782 1 2024-09-21T11:39:38.387 INFO:tasks.workunit.client.0.smithi118.stdout:3/665: mkdir d5/d1d/d1b/d4c/d73/dc4/ded 0 2024-09-21T11:39:38.389 INFO:tasks.workunit.client.0.smithi118.stdout:7/765: chown d0/d3/d1d/d35/d57/fe7 141519 1 2024-09-21T11:39:38.395 INFO:tasks.workunit.client.0.smithi118.stdout:2/647: unlink de/d22/d3c/f8e 0 2024-09-21T11:39:38.395 INFO:tasks.workunit.client.0.smithi118.stdout:2/648: dread - de/d16/d31/dce/d66/fd5 zero size 2024-09-21T11:39:38.396 INFO:tasks.workunit.client.0.smithi118.stdout:2/649: write de/d53/fb3 [1288361,51276] 0 2024-09-21T11:39:38.398 INFO:tasks.workunit.client.0.smithi118.stdout:3/666: unlink d5/d1d/d8c/fc3 0 2024-09-21T11:39:38.399 INFO:tasks.workunit.client.0.smithi118.stdout:7/766: rename d0/d3/d1d/d35/d57/d7e/lff to d0/l101 0 2024-09-21T11:39:38.401 INFO:tasks.workunit.client.0.smithi118.stdout:4/635: symlink d2/d6/de/d1c/d4d/ldb 0 2024-09-21T11:39:38.404 INFO:tasks.workunit.client.0.smithi118.stdout:2/650: mkdir de/d1f/d20/d67/d99/ddb 0 2024-09-21T11:39:38.404 INFO:tasks.workunit.client.0.smithi118.stdout:2/651: chown de/d1f/d20/d67 269786 1 2024-09-21T11:39:38.405 INFO:tasks.workunit.client.0.smithi118.stdout:3/667: write d5/d1d/d1b/da7/daf/fd9 [874867,72553] 0 2024-09-21T11:39:38.406 INFO:tasks.workunit.client.0.smithi118.stdout:7/767: chown d0/d3/d1d/d35/d57/d96/d9e/fdd 26 1 2024-09-21T11:39:38.407 INFO:tasks.workunit.client.0.smithi118.stdout:4/636: mknod d2/d6/de/d1c/cdc 0 2024-09-21T11:39:38.412 INFO:tasks.workunit.client.0.smithi118.stdout:7/768: mkdir d0/d3/d13/d102 0 2024-09-21T11:39:38.413 INFO:tasks.workunit.client.0.smithi118.stdout:7/769: fdatasync d0/d3/d14/d41/da0/fad 0 2024-09-21T11:39:38.415 INFO:tasks.workunit.client.0.smithi118.stdout:2/652: link de/f14 de/d22/fdc 0 2024-09-21T11:39:38.416 INFO:tasks.workunit.client.0.smithi118.stdout:3/668: mkdir d5/d1d/d1b/d4c/d73/dee 0 2024-09-21T11:39:38.416 INFO:tasks.workunit.client.0.smithi118.stdout:2/653: write de/d16/d31/dce/d66/d9a/fa3 [443408,44348] 0 2024-09-21T11:39:38.418 INFO:tasks.workunit.client.0.smithi118.stdout:4/637: symlink d2/ldd 0 2024-09-21T11:39:38.421 INFO:tasks.workunit.client.0.smithi118.stdout:4/638: write d2/d6/de/d1c/d4d/dba/fbf [87925,104247] 0 2024-09-21T11:39:38.422 INFO:tasks.workunit.client.0.smithi118.stdout:7/770: rename d0/d3/d29/d5f/f62 to d0/d3/d1d/d35/d57/f103 0 2024-09-21T11:39:38.423 INFO:tasks.workunit.client.0.smithi118.stdout:2/654: dwrite de/d50/f5a [0,4194304] 0 2024-09-21T11:39:38.425 INFO:tasks.workunit.client.0.smithi118.stdout:3/669: creat d5/d1d/d1b/da7/fef x:0 0 0 2024-09-21T11:39:38.426 INFO:tasks.workunit.client.0.smithi118.stdout:3/670: chown d5/d1d/d1b/da7/daf/fd9 2774730 1 2024-09-21T11:39:38.429 INFO:tasks.workunit.client.0.smithi118.stdout:7/771: creat d0/f104 x:0 0 0 2024-09-21T11:39:38.431 INFO:tasks.workunit.client.0.smithi118.stdout:2/655: truncate de/d16/d31/dce/d65/da2/f74 873631 0 2024-09-21T11:39:38.435 INFO:tasks.workunit.client.0.smithi118.stdout:7/772: creat d0/d3/d1d/d35/f105 x:0 0 0 2024-09-21T11:39:38.438 INFO:tasks.workunit.client.0.smithi118.stdout:4/639: dwrite d2/d6/de/d1c/d23/d26/f73 [0,4194304] 0 2024-09-21T11:39:38.439 INFO:tasks.workunit.client.0.smithi118.stdout:3/671: creat d5/d1d/d1b/d50/dc6/ff0 x:0 0 0 2024-09-21T11:39:38.442 INFO:tasks.workunit.client.0.smithi118.stdout:2/656: dwrite de/d1f/d20/d67/fd2 [0,4194304] 0 2024-09-21T11:39:38.442 INFO:tasks.workunit.client.0.smithi118.stdout:4/640: chown d2/l3a 151 1 2024-09-21T11:39:38.443 INFO:tasks.workunit.client.0.smithi118.stdout:7/773: symlink d0/d3/d14/d41/d66/d9d/dfe/l106 0 2024-09-21T11:39:38.444 INFO:tasks.workunit.client.0.smithi118.stdout:3/672: write d5/d1d/d1b/da7/daf/fd9 [775012,41899] 0 2024-09-21T11:39:38.445 INFO:tasks.workunit.client.0.smithi118.stdout:4/641: chown d2/d6/de/d1c/c34 29032 1 2024-09-21T11:39:38.445 INFO:tasks.workunit.client.0.smithi118.stdout:2/657: chown de/d1f/d20/cbe 199 1 2024-09-21T11:39:38.449 INFO:tasks.workunit.client.0.smithi118.stdout:4/642: rmdir d2/d6/de/d1c/d23/d26 39 2024-09-21T11:39:38.451 INFO:tasks.workunit.client.0.smithi118.stdout:4/643: fsync d2/d6/de/d1c/d4d/dba/fbf 0 2024-09-21T11:39:38.452 INFO:tasks.workunit.client.0.smithi118.stdout:2/658: creat de/d1f/d20/d78/d98/fdd x:0 0 0 2024-09-21T11:39:38.454 INFO:tasks.workunit.client.0.smithi118.stdout:2/659: write de/d16/d31/dce/d66/fbd [1110689,77714] 0 2024-09-21T11:39:38.457 INFO:tasks.workunit.client.0.smithi118.stdout:3/673: rename d5/d1d/d1b/d4c/f63 to d5/d1d/ff1 0 2024-09-21T11:39:38.459 INFO:tasks.workunit.client.0.smithi118.stdout:7/774: dread d0/d3/d14/fe2 [0,4194304] 0 2024-09-21T11:39:38.459 INFO:tasks.workunit.client.0.smithi118.stdout:3/674: read d5/d1d/d1b/d4c/d91/f7b [1021779,40173] 0 2024-09-21T11:39:38.468 INFO:tasks.workunit.client.0.smithi118.stdout:2/660: rename de/d16/d31/dce/d65/da2/c6c to de/d22/d3c/d83/cde 0 2024-09-21T11:39:38.469 INFO:tasks.workunit.client.0.smithi118.stdout:3/675: creat d5/d1d/d1b/d4c/d91/d69/ff2 x:0 0 0 2024-09-21T11:39:38.469 INFO:tasks.workunit.client.0.smithi118.stdout:4/644: creat d2/d6/de/d1c/d23/d26/dd6/dcb/db0/fde x:0 0 0 2024-09-21T11:39:38.475 INFO:tasks.workunit.client.0.smithi118.stdout:3/676: dwrite d5/d1d/d1b/d4c/f7d [0,4194304] 0 2024-09-21T11:39:38.515 INFO:tasks.workunit.client.0.smithi118.stdout:7/775: rename d0/d3/d14/d41/d8b/fe1 to d0/d3/d14/f107 0 2024-09-21T11:39:38.518 INFO:tasks.workunit.client.0.smithi118.stdout:2/661: dread de/d50/f81 [0,4194304] 0 2024-09-21T11:39:38.523 INFO:tasks.workunit.client.0.smithi118.stdout:7/776: dwrite d0/d3/d29/d5f/fe8 [0,4194304] 0 2024-09-21T11:39:38.526 INFO:tasks.workunit.client.0.smithi118.stdout:3/677: dwrite d5/d1d/ff1 [0,4194304] 0 2024-09-21T11:39:38.527 INFO:tasks.workunit.client.0.smithi118.stdout:2/662: dread de/d51/fad [0,4194304] 0 2024-09-21T11:39:38.535 INFO:tasks.workunit.client.0.smithi118.stdout:3/678: mknod d5/d1d/d1b/d4c/d91/cf3 0 2024-09-21T11:39:38.537 INFO:tasks.workunit.client.0.smithi118.stdout:3/679: write d5/d28/d3e/fa8 [716259,105047] 0 2024-09-21T11:39:38.539 INFO:tasks.workunit.client.0.smithi118.stdout:7/777: getdents d0/d3/d14/d41/d7f/d3e 0 2024-09-21T11:39:38.539 INFO:tasks.workunit.client.0.smithi118.stdout:3/680: rmdir d5 39 2024-09-21T11:39:38.539 INFO:tasks.workunit.client.0.smithi118.stdout:7/778: chown d0/d3/d14/d41/d7f 0 1 2024-09-21T11:39:38.542 INFO:tasks.workunit.client.0.smithi118.stdout:2/663: getdents de/d51 0 2024-09-21T11:39:38.543 INFO:tasks.workunit.client.0.smithi118.stdout:2/664: write de/d50/f5a [1446881,64883] 0 2024-09-21T11:39:38.548 INFO:tasks.workunit.client.0.smithi118.stdout:6/580: sync 2024-09-21T11:39:38.548 INFO:tasks.workunit.client.0.smithi118.stdout:9/711: sync 2024-09-21T11:39:38.548 INFO:tasks.workunit.client.0.smithi118.stdout:3/681: mkdir d5/d1d/d1b/da7/dc9/df4 0 2024-09-21T11:39:38.553 INFO:tasks.workunit.client.0.smithi118.stdout:6/581: fdatasync d8/d48/d6c/f8f 0 2024-09-21T11:39:38.555 INFO:tasks.workunit.client.0.smithi118.stdout:3/682: dread d5/d1d/d1b/d24/f36 [0,4194304] 0 2024-09-21T11:39:38.556 INFO:tasks.workunit.client.0.smithi118.stdout:9/712: dwrite d0/d4/d38/df6/ffc [0,4194304] 0 2024-09-21T11:39:38.558 INFO:tasks.workunit.client.0.smithi118.stdout:2/665: link de/d50/f5a de/d1f/d20/d67/d8a/fdf 0 2024-09-21T11:39:38.559 INFO:tasks.workunit.client.0.smithi118.stdout:2/666: stat de/d1f/d20/d78 0 2024-09-21T11:39:38.567 INFO:tasks.workunit.client.0.smithi118.stdout:6/582: truncate d8/d48/d5f/f80 4066209 0 2024-09-21T11:39:38.570 INFO:tasks.workunit.client.0.smithi118.stdout:2/667: creat de/d16/d25/dba/fe0 x:0 0 0 2024-09-21T11:39:38.571 INFO:tasks.workunit.client.0.smithi118.stdout:2/668: write de/fcb [708009,98323] 0 2024-09-21T11:39:38.573 INFO:tasks.workunit.client.0.smithi118.stdout:6/583: chown d8/d14/d33/f3e 6587 1 2024-09-21T11:39:38.575 INFO:tasks.workunit.client.0.smithi118.stdout:9/713: rename d0/d4/l37 to d0/d20/d4c/l102 0 2024-09-21T11:39:38.576 INFO:tasks.workunit.client.0.smithi118.stdout:6/584: rmdir d8/d48/d45/d61 39 2024-09-21T11:39:38.576 INFO:tasks.workunit.client.0.smithi118.stdout:6/585: chown d8/d46/f52 128153 1 2024-09-21T11:39:38.578 INFO:tasks.workunit.client.0.smithi118.stdout:2/669: rename de/d1f/d20/d78/cd7 to de/d50/d85/ce1 0 2024-09-21T11:39:38.579 INFO:tasks.workunit.client.0.smithi118.stdout:2/670: stat de/d1f/d20/d67/d99/ddb 0 2024-09-21T11:39:38.583 INFO:tasks.workunit.client.0.smithi118.stdout:1/691: sync 2024-09-21T11:39:38.583 INFO:tasks.workunit.client.0.smithi118.stdout:0/957: sync 2024-09-21T11:39:38.583 INFO:tasks.workunit.client.0.smithi118.stdout:2/671: unlink de/d16/d31/dce/l4d 0 2024-09-21T11:39:38.585 INFO:tasks.workunit.client.0.smithi118.stdout:0/958: chown d5/d10/c57 7754 1 2024-09-21T11:39:38.585 INFO:tasks.workunit.client.0.smithi118.stdout:9/714: dwrite d0/d20/d4c/d5f/d6c/ff3 [4194304,4194304] 0 2024-09-21T11:39:38.587 INFO:tasks.workunit.client.0.smithi118.stdout:0/959: chown d5/d81/fc8 9 1 2024-09-21T11:39:38.588 INFO:tasks.workunit.client.0.smithi118.stdout:1/692: truncate d6/de/d16/d3f/d50/d72/f75 4278964 0 2024-09-21T11:39:38.593 INFO:tasks.workunit.client.0.smithi118.stdout:1/693: mkdir d6/d2a/dc2/dd7 0 2024-09-21T11:39:38.594 INFO:tasks.workunit.client.0.smithi118.stdout:1/694: fdatasync d6/d3b/fc1 0 2024-09-21T11:39:38.595 INFO:tasks.workunit.client.0.smithi118.stdout:0/960: dwrite d5/d10/d1e/d23/fca [4194304,4194304] 0 2024-09-21T11:39:38.598 INFO:tasks.workunit.client.0.smithi118.stdout:0/961: chown d5/d10/d1e/d23/d3a/c12e 6595672 1 2024-09-21T11:39:38.598 INFO:tasks.workunit.client.0.smithi118.stdout:2/672: link de/d51/f6b de/d1f/d20/fe2 0 2024-09-21T11:39:38.601 INFO:tasks.workunit.client.0.smithi118.stdout:1/695: fsync d6/d33/d3c/f64 0 2024-09-21T11:39:38.604 INFO:tasks.workunit.client.0.smithi118.stdout:1/696: chown d6/d33/d3c/f9b 180587 1 2024-09-21T11:39:38.607 INFO:tasks.workunit.client.0.smithi118.stdout:6/586: dread d8/d48/d6c/f69 [0,4194304] 0 2024-09-21T11:39:38.609 INFO:tasks.workunit.client.0.smithi118.stdout:2/673: mknod de/d16/d31/dce/ce3 0 2024-09-21T11:39:38.616 INFO:tasks.workunit.client.0.smithi118.stdout:0/962: creat d5/d29/f13c x:0 0 0 2024-09-21T11:39:38.619 INFO:tasks.workunit.client.0.smithi118.stdout:2/674: dwrite de/d22/d3c/f7b [0,4194304] 0 2024-09-21T11:39:38.621 INFO:tasks.workunit.client.0.smithi118.stdout:2/675: write de/fcb [842500,11554] 0 2024-09-21T11:39:38.623 INFO:tasks.workunit.client.0.smithi118.stdout:1/697: rename d6/de/d16/d3f/d50/d54/d32/dd4 to d6/dd8 0 2024-09-21T11:39:38.631 INFO:tasks.workunit.client.0.smithi118.stdout:6/587: dread d8/d48/d72/f9c [0,4194304] 0 2024-09-21T11:39:38.631 INFO:tasks.workunit.client.0.smithi118.stdout:4/645: write d2/d6/de/d1c/d87/da9/d97/d9b/fbb [460965,1146] 0 2024-09-21T11:39:38.639 INFO:tasks.workunit.client.0.smithi118.stdout:5/684: sync 2024-09-21T11:39:38.641 INFO:tasks.workunit.client.0.smithi118.stdout:4/646: creat d2/d65/fdf x:0 0 0 2024-09-21T11:39:38.642 INFO:tasks.workunit.client.0.smithi118.stdout:6/588: dwrite d8/d46/f52 [0,4194304] 0 2024-09-21T11:39:38.646 INFO:tasks.workunit.client.0.smithi118.stdout:5/685: dread d0/d63/f9b [0,4194304] 0 2024-09-21T11:39:38.651 INFO:tasks.workunit.client.0.smithi118.stdout:4/647: rename d2/d6/de/d1c/d4d/f68 to d2/d6/de/d1c/d23/d26/dd6/dcb/fe0 0 2024-09-21T11:39:38.654 INFO:tasks.workunit.client.0.smithi118.stdout:6/589: symlink d8/d14/d3a/lbe 0 2024-09-21T11:39:38.654 INFO:tasks.workunit.client.0.smithi118.stdout:7/779: dwrite d0/d3/f63 [0,4194304] 0 2024-09-21T11:39:38.656 INFO:tasks.workunit.client.0.smithi118.stdout:4/648: write d2/d6/dd/d35/f72 [731200,123674] 0 2024-09-21T11:39:38.656 INFO:tasks.workunit.client.0.smithi118.stdout:7/780: dread - d0/f104 zero size 2024-09-21T11:39:38.658 INFO:tasks.workunit.client.0.smithi118.stdout:6/590: mkdir d8/d46/d53/dbf 0 2024-09-21T11:39:38.659 INFO:tasks.workunit.client.0.smithi118.stdout:4/649: write d2/f8a [3017969,46914] 0 2024-09-21T11:39:38.662 INFO:tasks.workunit.client.0.smithi118.stdout:5/686: dwrite d0/d6c/fcb [0,4194304] 0 2024-09-21T11:39:38.664 INFO:tasks.workunit.client.0.smithi118.stdout:7/781: creat d0/d3/d14/f108 x:0 0 0 2024-09-21T11:39:38.666 INFO:tasks.workunit.client.0.smithi118.stdout:3/683: write d5/d28/d33/d4a/f79 [527242,124505] 0 2024-09-21T11:39:38.669 INFO:tasks.workunit.client.0.smithi118.stdout:3/684: write d5/d1d/d1b/d50/fe0 [969433,63257] 0 2024-09-21T11:39:38.669 INFO:tasks.workunit.client.0.smithi118.stdout:4/650: unlink d2/d6/de/d1c/d23/c41 0 2024-09-21T11:39:38.671 INFO:tasks.workunit.client.0.smithi118.stdout:7/782: rmdir d0/d3 39 2024-09-21T11:39:38.673 INFO:tasks.workunit.client.0.smithi118.stdout:6/591: dwrite d8/d14/dba/faa [0,4194304] 0 2024-09-21T11:39:38.678 INFO:tasks.workunit.client.0.smithi118.stdout:6/592: chown d8/f22 144994 1 2024-09-21T11:39:38.678 INFO:tasks.workunit.client.0.smithi118.stdout:3/685: mknod d5/d28/d33/d4a/dc8/cf5 0 2024-09-21T11:39:38.682 INFO:tasks.workunit.client.0.smithi118.stdout:3/686: write d5/d28/d33/fe8 [307768,33369] 0 2024-09-21T11:39:38.684 INFO:tasks.workunit.client.0.smithi118.stdout:7/783: read - d0/d3/d14/f108 zero size 2024-09-21T11:39:38.686 INFO:tasks.workunit.client.0.smithi118.stdout:6/593: creat d8/d14/d33/d92/fc0 x:0 0 0 2024-09-21T11:39:38.688 INFO:tasks.workunit.client.0.smithi118.stdout:4/651: rename d2/d6/de/d1c/c34 to d2/d6/de/d1c/d23/d26/dd6/d5e/ce1 0 2024-09-21T11:39:38.692 INFO:tasks.workunit.client.0.smithi118.stdout:3/687: mknod d5/d28/d33/d4a/dc8/cf6 0 2024-09-21T11:39:38.694 INFO:tasks.workunit.client.0.smithi118.stdout:3/688: chown d5/l3f 44694 1 2024-09-21T11:39:38.702 INFO:tasks.workunit.client.0.smithi118.stdout:3/689: dwrite d5/d1d/d1b/d50/dc6/ff0 [0,4194304] 0 2024-09-21T11:39:38.711 INFO:tasks.workunit.client.0.smithi118.stdout:9/715: dwrite d0/d20/d4c/f85 [0,4194304] 0 2024-09-21T11:39:38.711 INFO:tasks.workunit.client.0.smithi118.stdout:7/784: rename d0/d3/d14/d41/d7f/d3e/d81/db6/lec to d0/d3/d14/d41/d7f/d3e/d81/l109 0 2024-09-21T11:39:38.713 INFO:tasks.workunit.client.0.smithi118.stdout:1/698: truncate d6/d33/d3c/f73 826445 0 2024-09-21T11:39:38.720 INFO:tasks.workunit.client.0.smithi118.stdout:4/652: creat d2/d6/de/d1c/d23/d26/dd6/dcb/db0/dcd/fe2 x:0 0 0 2024-09-21T11:39:38.722 INFO:tasks.workunit.client.0.smithi118.stdout:0/963: dwrite d5/d10/d1e/d21/f2d [4194304,4194304] 0 2024-09-21T11:39:38.725 INFO:tasks.workunit.client.0.smithi118.stdout:0/964: stat d5/d34/d44/d87/d9a/ff7 0 2024-09-21T11:39:38.727 INFO:tasks.workunit.client.0.smithi118.stdout:2/676: dwrite de/f19 [0,4194304] 0 2024-09-21T11:39:38.731 INFO:tasks.workunit.client.0.smithi118.stdout:9/716: fsync d0/d20/d4c/d5f/d6c/fd8 0 2024-09-21T11:39:38.732 INFO:tasks.workunit.client.0.smithi118.stdout:4/653: dread d2/d6/de/d1c/d23/f2c [0,4194304] 0 2024-09-21T11:39:38.733 INFO:tasks.workunit.client.0.smithi118.stdout:9/717: chown d0/d20/d4c/d5f/d6c/d88/d4d/le5 0 1 2024-09-21T11:39:38.734 INFO:tasks.workunit.client.0.smithi118.stdout:4/654: readlink d2/d6/de/d1c/d87/ld1 0 2024-09-21T11:39:38.738 INFO:tasks.workunit.client.0.smithi118.stdout:9/718: chown d0/d4/d45/db5/c51 3 1 2024-09-21T11:39:38.738 INFO:tasks.workunit.client.0.smithi118.stdout:4/655: fdatasync d2/d6/de/d1c/d23/d26/dd6/dcb/db0/fde 0 2024-09-21T11:39:38.741 INFO:tasks.workunit.client.0.smithi118.stdout:5/687: dwrite d0/d6c/f5a [0,4194304] 0 2024-09-21T11:39:38.742 INFO:tasks.workunit.client.0.smithi118.stdout:9/719: write d0/d4/d45/f75 [1482961,110088] 0 2024-09-21T11:39:38.743 INFO:tasks.workunit.client.0.smithi118.stdout:7/785: fsync d0/f9 0 2024-09-21T11:39:38.745 INFO:tasks.workunit.client.0.smithi118.stdout:4/656: write d2/fc [4172538,20476] 0 2024-09-21T11:39:38.745 INFO:tasks.workunit.client.0.smithi118.stdout:1/699: fdatasync d6/d2a/f28 0 2024-09-21T11:39:38.745 INFO:tasks.workunit.client.0.smithi118.stdout:0/965: read d5/d29/d119/f115 [92796,118665] 0 2024-09-21T11:39:38.750 INFO:tasks.workunit.client.0.smithi118.stdout:2/677: truncate de/d22/d3c/f47 76262 0 2024-09-21T11:39:38.752 INFO:tasks.workunit.client.0.smithi118.stdout:6/594: dwrite d8/f11 [0,4194304] 0 2024-09-21T11:39:38.755 INFO:tasks.workunit.client.0.smithi118.stdout:0/966: write d5/d10/d1e/d20/f2f [403614,78715] 0 2024-09-21T11:39:38.758 INFO:tasks.workunit.client.0.smithi118.stdout:5/688: creat d0/d63/fed x:0 0 0 2024-09-21T11:39:38.759 INFO:tasks.workunit.client.0.smithi118.stdout:7/786: chown d0/d3/d29/d5f/d71 14616730 1 2024-09-21T11:39:38.761 INFO:tasks.workunit.client.0.smithi118.stdout:4/657: dwrite d2/d6/de/d1c/d23/d26/f73 [0,4194304] 0 2024-09-21T11:39:38.762 INFO:tasks.workunit.client.0.smithi118.stdout:4/658: readlink d2/d6/de/d1c/d87/ld1 0 2024-09-21T11:39:38.763 INFO:tasks.workunit.client.0.smithi118.stdout:9/720: symlink d0/d4/d45/db5/d86/dd6/l103 0 2024-09-21T11:39:38.771 INFO:tasks.workunit.client.0.smithi118.stdout:6/595: mkdir d8/d14/d33/d92/dc1 0 2024-09-21T11:39:38.774 INFO:tasks.workunit.client.0.smithi118.stdout:4/659: mknod d2/d8e/ce3 0 2024-09-21T11:39:38.776 INFO:tasks.workunit.client.0.smithi118.stdout:9/721: creat d0/d20/d4c/d5f/d6c/d88/db4/f104 x:0 0 0 2024-09-21T11:39:38.778 INFO:tasks.workunit.client.0.smithi118.stdout:6/596: creat d8/d46/db3/fc2 x:0 0 0 2024-09-21T11:39:38.779 INFO:tasks.workunit.client.0.smithi118.stdout:5/689: truncate d0/d89/f8d 779756 0 2024-09-21T11:39:38.780 INFO:tasks.workunit.client.0.smithi118.stdout:1/700: link d6/d33/f70 d6/de/d13/fd9 0 2024-09-21T11:39:38.781 INFO:tasks.workunit.client.0.smithi118.stdout:9/722: creat d0/d20/d4c/d5f/d6c/d88/d4d/f105 x:0 0 0 2024-09-21T11:39:38.783 INFO:tasks.workunit.client.0.smithi118.stdout:1/701: readlink d6/de/d16/d3f/d50/d54/l38 0 2024-09-21T11:39:38.785 INFO:tasks.workunit.client.0.smithi118.stdout:5/690: truncate d0/db/f72 4093361 0 2024-09-21T11:39:38.785 INFO:tasks.workunit.client.0.smithi118.stdout:9/723: fdatasync d0/fb1 0 2024-09-21T11:39:38.788 INFO:tasks.workunit.client.0.smithi118.stdout:6/597: dread d8/d14/f82 [0,4194304] 0 2024-09-21T11:39:38.790 INFO:tasks.workunit.client.0.smithi118.stdout:6/598: creat d8/d48/d6c/fc3 x:0 0 0 2024-09-21T11:39:38.792 INFO:tasks.workunit.client.0.smithi118.stdout:6/599: write d8/d48/d45/d61/d70/f83 [3532963,106496] 0 2024-09-21T11:39:38.796 INFO:tasks.workunit.client.0.smithi118.stdout:6/600: fdatasync d8/f1a 0 2024-09-21T11:39:38.800 INFO:tasks.workunit.client.0.smithi118.stdout:2/678: rename de/d22/d3c/f47 to de/d16/d25/dba/db5/fe4 0 2024-09-21T11:39:38.800 INFO:tasks.workunit.client.0.smithi118.stdout:0/967: write d5/d10/d1e/d3d/d93/fc9 [2822568,62519] 0 2024-09-21T11:39:38.801 INFO:tasks.workunit.client.0.smithi118.stdout:7/787: write d0/d3/d1d/d35/d57/d96/d9e/fdd [5089856,24269] 0 2024-09-21T11:39:38.808 INFO:tasks.workunit.client.0.smithi118.stdout:4/660: rename d2/d6/de/d1c/d23/c38 to d2/d6/de/d1c/d87/ce4 0 2024-09-21T11:39:38.809 INFO:tasks.workunit.client.0.smithi118.stdout:2/679: creat de/d22/d3c/d83/fe5 x:0 0 0 2024-09-21T11:39:38.809 INFO:tasks.workunit.client.0.smithi118.stdout:4/661: chown d2/d6/de/d1c/d23/d26/dd6/dcb/db0 47126534 1 2024-09-21T11:39:38.813 INFO:tasks.workunit.client.0.smithi118.stdout:7/788: unlink d0/d3/d14/d41/d7f/d3e/l53 0 2024-09-21T11:39:38.815 INFO:tasks.workunit.client.0.smithi118.stdout:1/702: write d6/d33/d7a/f95 [786641,934] 0 2024-09-21T11:39:38.817 INFO:tasks.workunit.client.0.smithi118.stdout:1/703: write d6/d33/d3c/f68 [5291723,46917] 0 2024-09-21T11:39:38.818 INFO:tasks.workunit.client.0.smithi118.stdout:1/704: chown d6/de/d16/d3f/d50/fa6 1159959 1 2024-09-21T11:39:38.821 INFO:tasks.workunit.client.0.smithi118.stdout:4/662: dread d2/d6/de/d1c/d4d/d52/d69/f67 [0,4194304] 0 2024-09-21T11:39:38.821 INFO:tasks.workunit.client.0.smithi118.stdout:2/680: mknod de/d16/d25/dba/ce6 0 2024-09-21T11:39:38.822 INFO:tasks.workunit.client.0.smithi118.stdout:4/663: readlink d2/d6/de/d1c/d87/ld1 0 2024-09-21T11:39:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:38 smithi118 ceph-mon[28757]: pgmap v34: 65 pgs: 65 active+clean; 2.9 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 73 MiB/s rd, 186 MiB/s wr, 453 op/s 2024-09-21T11:39:38.824 INFO:tasks.workunit.client.0.smithi118.stdout:0/968: symlink d5/d29/d68/d7b/db7/d10c/l13d 0 2024-09-21T11:39:38.827 INFO:tasks.workunit.client.0.smithi118.stdout:1/705: creat d6/d33/fda x:0 0 0 2024-09-21T11:39:38.830 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:38 smithi149 ceph-mon[36123]: pgmap v34: 65 pgs: 65 active+clean; 2.9 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 73 MiB/s rd, 186 MiB/s wr, 453 op/s 2024-09-21T11:39:38.831 INFO:tasks.workunit.client.0.smithi118.stdout:6/601: write d8/d14/f1d [231991,83960] 0 2024-09-21T11:39:38.832 INFO:tasks.workunit.client.0.smithi118.stdout:2/681: creat de/d1f/d20/fe7 x:0 0 0 2024-09-21T11:39:38.834 INFO:tasks.workunit.client.0.smithi118.stdout:7/789: mknod d0/c10a 0 2024-09-21T11:39:38.835 INFO:tasks.workunit.client.0.smithi118.stdout:7/790: write d0/d3/d14/d41/fbf [2138307,36928] 0 2024-09-21T11:39:38.837 INFO:tasks.workunit.client.0.smithi118.stdout:5/691: rename d0/db/d35/da/la3 to d0/db/d35/d2c/lee 0 2024-09-21T11:39:38.839 INFO:tasks.workunit.client.0.smithi118.stdout:5/692: read d0/db/d35/d2c/d40/fdc [3961114,19348] 0 2024-09-21T11:39:38.849 INFO:tasks.workunit.client.0.smithi118.stdout:2/682: getdents de/d16/d31/dce/d66/d9a 0 2024-09-21T11:39:38.852 INFO:tasks.workunit.client.0.smithi118.stdout:7/791: chown d0/d3/d14/d41/d7f/d3e/f50 389 1 2024-09-21T11:39:38.852 INFO:tasks.workunit.client.0.smithi118.stdout:4/664: write d2/d6/de/f1e [3282181,120917] 0 2024-09-21T11:39:38.853 INFO:tasks.workunit.client.0.smithi118.stdout:1/706: write d6/d33/f70 [624025,81840] 0 2024-09-21T11:39:38.854 INFO:tasks.workunit.client.0.smithi118.stdout:6/602: dread d8/d14/f78 [0,4194304] 0 2024-09-21T11:39:38.859 INFO:tasks.workunit.client.0.smithi118.stdout:5/693: rename d0/d6c/d67 to d0/db/d35/def 0 2024-09-21T11:39:38.859 INFO:tasks.workunit.client.0.smithi118.stdout:7/792: dread d0/d3/d29/f8d [0,4194304] 0 2024-09-21T11:39:38.861 INFO:tasks.workunit.client.0.smithi118.stdout:6/603: fdatasync d8/d14/d33/f55 0 2024-09-21T11:39:38.862 INFO:tasks.workunit.client.0.smithi118.stdout:4/665: dwrite d2/d65/fdf [0,4194304] 0 2024-09-21T11:39:38.864 INFO:tasks.workunit.client.0.smithi118.stdout:5/694: rmdir d0/db 39 2024-09-21T11:39:38.865 INFO:tasks.workunit.client.0.smithi118.stdout:2/683: dwrite de/d1f/d20/fcc [0,4194304] 0 2024-09-21T11:39:38.871 INFO:tasks.workunit.client.0.smithi118.stdout:1/707: creat d6/de/fdb x:0 0 0 2024-09-21T11:39:38.872 INFO:tasks.workunit.client.0.smithi118.stdout:1/708: readlink d6/d2a/d3d/db9/lc4 0 2024-09-21T11:39:38.873 INFO:tasks.workunit.client.0.smithi118.stdout:4/666: mknod d2/d6/de/d1c/ce5 0 2024-09-21T11:39:38.874 INFO:tasks.workunit.client.0.smithi118.stdout:6/604: getdents d8/d46/d53/dbf 0 2024-09-21T11:39:38.876 INFO:tasks.workunit.client.0.smithi118.stdout:6/605: chown d8/d46/f91 396951926 1 2024-09-21T11:39:38.878 INFO:tasks.workunit.client.0.smithi118.stdout:2/684: rename de/d16/d31/dce/d4f/d5b/fa6 to de/d16/fe8 0 2024-09-21T11:39:38.879 INFO:tasks.workunit.client.0.smithi118.stdout:4/667: creat d2/d6/de/d1c/d87/da9/d97/d9b/fe6 x:0 0 0 2024-09-21T11:39:38.883 INFO:tasks.workunit.client.0.smithi118.stdout:5/695: dwrite d0/db/d35/da/f6e [0,4194304] 0 2024-09-21T11:39:38.883 INFO:tasks.workunit.client.0.smithi118.stdout:7/793: write d0/d3/d13/f2f [8797393,71759] 0 2024-09-21T11:39:38.887 INFO:tasks.workunit.client.0.smithi118.stdout:4/668: write d2/d6/de/d1c/f9c [275385,71315] 0 2024-09-21T11:39:38.888 INFO:tasks.workunit.client.0.smithi118.stdout:6/606: mkdir d8/d14/dc4 0 2024-09-21T11:39:38.890 INFO:tasks.workunit.client.0.smithi118.stdout:5/696: unlink d0/d6c/f7e 0 2024-09-21T11:39:38.892 INFO:tasks.workunit.client.0.smithi118.stdout:2/685: dwrite de/d1f/d20/d67/d8a/d6d/d70/f90 [0,4194304] 0 2024-09-21T11:39:38.894 INFO:tasks.workunit.client.0.smithi118.stdout:7/794: creat d0/d3/d1d/f10b x:0 0 0 2024-09-21T11:39:38.896 INFO:tasks.workunit.client.0.smithi118.stdout:1/709: dwrite d6/d3b/fca [4194304,4194304] 0 2024-09-21T11:39:38.897 INFO:tasks.workunit.client.0.smithi118.stdout:1/710: readlink d6/d2a/d3d/db9/lc4 0 2024-09-21T11:39:38.898 INFO:tasks.workunit.client.0.smithi118.stdout:6/607: unlink d8/d48/d45/l79 0 2024-09-21T11:39:38.900 INFO:tasks.workunit.client.0.smithi118.stdout:1/711: read d6/d33/d3c/f64 [1630962,33107] 0 2024-09-21T11:39:38.902 INFO:tasks.workunit.client.0.smithi118.stdout:1/712: stat d6/d2a/d5c/d85/f9c 0 2024-09-21T11:39:38.905 INFO:tasks.workunit.client.0.smithi118.stdout:4/669: mkdir d2/d6/de/d1c/d87/da9/d97/de7 0 2024-09-21T11:39:38.908 INFO:tasks.workunit.client.0.smithi118.stdout:7/795: chown d0/d3/d14/d41/d7f/d3e/f42 16 1 2024-09-21T11:39:38.909 INFO:tasks.workunit.client.0.smithi118.stdout:2/686: dread de/d16/d31/f7c [0,4194304] 0 2024-09-21T11:39:38.909 INFO:tasks.workunit.client.0.smithi118.stdout:6/608: unlink d8/d46/l6a 0 2024-09-21T11:39:38.912 INFO:tasks.workunit.client.0.smithi118.stdout:7/796: truncate d0/d3/d1d/d35/d57/fe7 169150 0 2024-09-21T11:39:38.912 INFO:tasks.workunit.client.0.smithi118.stdout:6/609: dread - d8/d48/d6c/d64/fa0 zero size 2024-09-21T11:39:38.912 INFO:tasks.workunit.client.0.smithi118.stdout:1/713: dread d6/f91 [0,4194304] 0 2024-09-21T11:39:38.915 INFO:tasks.workunit.client.0.smithi118.stdout:4/670: creat d2/d6/de/fe8 x:0 0 0 2024-09-21T11:39:38.916 INFO:tasks.workunit.client.0.smithi118.stdout:4/671: dread - d2/d6/de/d1c/d87/da9/fc1 zero size 2024-09-21T11:39:38.917 INFO:tasks.workunit.client.0.smithi118.stdout:4/672: fdatasync d2/d6/de/d1c/d4d/d52/fb8 0 2024-09-21T11:39:38.919 INFO:tasks.workunit.client.0.smithi118.stdout:5/697: link d0/d6c/lc1 d0/db/d35/d30/lf0 0 2024-09-21T11:39:38.919 INFO:tasks.workunit.client.0.smithi118.stdout:5/698: chown d0/f83 57745390 1 2024-09-21T11:39:38.923 INFO:tasks.workunit.client.0.smithi118.stdout:2/687: truncate de/d53/f86 1050324 0 2024-09-21T11:39:38.929 INFO:tasks.workunit.client.0.smithi118.stdout:5/699: rmdir d0/db/d35/def/d92 39 2024-09-21T11:39:38.929 INFO:tasks.workunit.client.0.smithi118.stdout:5/700: read - d0/d89/d9d/fc2 zero size 2024-09-21T11:39:38.931 INFO:tasks.workunit.client.0.smithi118.stdout:2/688: symlink de/d16/d31/dce/d65/da2/le9 0 2024-09-21T11:39:38.932 INFO:tasks.workunit.client.0.smithi118.stdout:2/689: chown de/d1f/d20/d67/d8a 3437554 1 2024-09-21T11:39:38.933 INFO:tasks.workunit.client.0.smithi118.stdout:2/690: write de/d50/d85/faf [943709,120768] 0 2024-09-21T11:39:38.933 INFO:tasks.workunit.client.0.smithi118.stdout:6/610: truncate d8/d48/d72/f9c 4466521 0 2024-09-21T11:39:38.936 INFO:tasks.workunit.client.0.smithi118.stdout:5/701: symlink d0/d89/d9d/lf1 0 2024-09-21T11:39:38.940 INFO:tasks.workunit.client.0.smithi118.stdout:4/673: rename d2/d65/fdf to d2/fe9 0 2024-09-21T11:39:38.941 INFO:tasks.workunit.client.0.smithi118.stdout:2/691: symlink de/d1f/d20/d67/d8a/d6d/d70/lea 0 2024-09-21T11:39:38.941 INFO:tasks.workunit.client.0.smithi118.stdout:4/674: readlink d2/d6/de/d1c/d23/d26/dd6/l78 0 2024-09-21T11:39:38.942 INFO:tasks.workunit.client.0.smithi118.stdout:4/675: read d2/f8a [5178031,129125] 0 2024-09-21T11:39:38.942 INFO:tasks.workunit.client.0.smithi118.stdout:7/797: getdents d0/d3/d14/d41/d7f/d3e/d81 0 2024-09-21T11:39:38.944 INFO:tasks.workunit.client.0.smithi118.stdout:5/702: creat d0/d6c/d25/ff2 x:0 0 0 2024-09-21T11:39:38.945 INFO:tasks.workunit.client.0.smithi118.stdout:6/611: dread d8/d14/d33/f3e [0,4194304] 0 2024-09-21T11:39:38.945 INFO:tasks.workunit.client.0.smithi118.stdout:6/612: readlink d8/l17 0 2024-09-21T11:39:38.948 INFO:tasks.workunit.client.0.smithi118.stdout:2/692: symlink de/d1f/d20/d78/leb 0 2024-09-21T11:39:38.949 INFO:tasks.workunit.client.0.smithi118.stdout:4/676: creat d2/d6/de/d1c/d23/d26/dd6/dcb/db0/fea x:0 0 0 2024-09-21T11:39:38.952 INFO:tasks.workunit.client.0.smithi118.stdout:6/613: mkdir d8/d48/d9f/dc5 0 2024-09-21T11:39:38.953 INFO:tasks.workunit.client.0.smithi118.stdout:6/614: write d8/d48/d45/f4d [3601592,49328] 0 2024-09-21T11:39:38.956 INFO:tasks.workunit.client.0.smithi118.stdout:4/677: chown d2/d6/de/d1c/d23/d26/dd6/dcb/c8f 3007 1 2024-09-21T11:39:38.957 INFO:tasks.workunit.client.0.smithi118.stdout:4/678: truncate d2/da1/fa2 5905942 0 2024-09-21T11:39:38.957 INFO:tasks.workunit.client.0.smithi118.stdout:5/703: unlink d0/db/d26/f93 0 2024-09-21T11:39:38.958 INFO:tasks.workunit.client.0.smithi118.stdout:5/704: fsync d0/db/d35/d30/d1a/d8f/d99/fe6 0 2024-09-21T11:39:38.963 INFO:tasks.workunit.client.0.smithi118.stdout:2/693: link de/d1f/l3e de/lec 0 2024-09-21T11:39:38.973 INFO:tasks.workunit.client.0.smithi118.stdout:4/679: dread d2/f13 [0,4194304] 0 2024-09-21T11:39:38.973 INFO:tasks.workunit.client.0.smithi118.stdout:2/694: write de/d50/f81 [332960,129820] 0 2024-09-21T11:39:38.977 INFO:tasks.workunit.client.0.smithi118.stdout:5/705: dwrite d0/db/d35/d2c/f77 [0,4194304] 0 2024-09-21T11:39:38.979 INFO:tasks.workunit.client.0.smithi118.stdout:2/695: rename de/d16/d25/ld1 to de/d53/led 0 2024-09-21T11:39:38.983 INFO:tasks.workunit.client.0.smithi118.stdout:2/696: symlink de/d1f/d20/d67/d8a/lee 0 2024-09-21T11:39:38.984 INFO:tasks.workunit.client.0.smithi118.stdout:4/680: getdents d2/d6/dd 0 2024-09-21T11:39:38.985 INFO:tasks.workunit.client.0.smithi118.stdout:2/697: chown de/d1f/d20/d67/d8a/d6d/d70/l8f 104 1 2024-09-21T11:39:38.986 INFO:tasks.workunit.client.0.smithi118.stdout:2/698: chown de/d1f/d20/fb0 299842 1 2024-09-21T11:39:38.987 INFO:tasks.workunit.client.0.smithi118.stdout:5/706: creat d0/db/d35/def/d92/dc8/ff3 x:0 0 0 2024-09-21T11:39:38.988 INFO:tasks.workunit.client.0.smithi118.stdout:4/681: write d2/d6/f20 [4207032,130508] 0 2024-09-21T11:39:38.989 INFO:tasks.workunit.client.0.smithi118.stdout:4/682: fsync d2/d6/dd/f33 0 2024-09-21T11:39:38.993 INFO:tasks.workunit.client.0.smithi118.stdout:2/699: rmdir de/d1f/d20/d67/d99/ddb 0 2024-09-21T11:39:38.994 INFO:tasks.workunit.client.0.smithi118.stdout:4/683: mkdir d2/d6/de/d1c/d87/da9/da8/deb 0 2024-09-21T11:39:38.994 INFO:tasks.workunit.client.0.smithi118.stdout:2/700: stat de/d16/d31/dce/d65/fa4 0 2024-09-21T11:39:38.999 INFO:tasks.workunit.client.0.smithi118.stdout:2/701: creat de/d53/dc2/fef x:0 0 0 2024-09-21T11:39:39.008 INFO:tasks.workunit.client.0.smithi118.stdout:5/707: dwrite d0/db/d35/d30/d1a/f2a [4194304,4194304] 0 2024-09-21T11:39:39.010 INFO:tasks.workunit.client.0.smithi118.stdout:4/684: truncate d2/d6/de/d1c/f85 435016 0 2024-09-21T11:39:39.012 INFO:tasks.workunit.client.0.smithi118.stdout:2/702: write de/d16/d31/dce/d65/da2/f6e [227772,59749] 0 2024-09-21T11:39:39.013 INFO:tasks.workunit.client.0.smithi118.stdout:4/685: creat d2/d6/de/d1c/d4d/dba/fec x:0 0 0 2024-09-21T11:39:39.015 INFO:tasks.workunit.client.0.smithi118.stdout:4/686: write d2/d6/de/d1c/d87/fc3 [144074,110298] 0 2024-09-21T11:39:39.016 INFO:tasks.workunit.client.0.smithi118.stdout:2/703: creat de/d16/d31/dce/d65/ff0 x:0 0 0 2024-09-21T11:39:39.019 INFO:tasks.workunit.client.0.smithi118.stdout:4/687: chown d2/d6/de/d1c/d4d/dba/lc6 29 1 2024-09-21T11:39:39.021 INFO:tasks.workunit.client.0.smithi118.stdout:4/688: creat d2/da1/fed x:0 0 0 2024-09-21T11:39:39.023 INFO:tasks.workunit.client.0.smithi118.stdout:5/708: dwrite d0/f37 [0,4194304] 0 2024-09-21T11:39:39.025 INFO:tasks.workunit.client.0.smithi118.stdout:4/689: mknod d2/d6/dd/d35/cee 0 2024-09-21T11:39:39.027 INFO:tasks.workunit.client.0.smithi118.stdout:2/704: write de/d22/fdc [5347760,24532] 0 2024-09-21T11:39:39.029 INFO:tasks.workunit.client.0.smithi118.stdout:2/705: truncate de/f1e 1546403 0 2024-09-21T11:39:39.032 INFO:tasks.workunit.client.0.smithi118.stdout:4/690: mkdir d2/d6/de/d1c/d4d/def 0 2024-09-21T11:39:39.033 INFO:tasks.workunit.client.0.smithi118.stdout:4/691: chown d2/d6/de/d1c/d4d/d52/fb8 5676813 1 2024-09-21T11:39:39.035 INFO:tasks.workunit.client.0.smithi118.stdout:5/709: dread d0/db/d35/f3d [0,4194304] 0 2024-09-21T11:39:39.035 INFO:tasks.workunit.client.0.smithi118.stdout:2/706: mknod de/d1f/d20/d67/cf1 0 2024-09-21T11:39:39.036 INFO:tasks.workunit.client.0.smithi118.stdout:4/692: creat d2/d6/de/d1c/d23/d26/d74/ff0 x:0 0 0 2024-09-21T11:39:39.041 INFO:tasks.workunit.client.0.smithi118.stdout:2/707: mknod de/d16/d25/cf2 0 2024-09-21T11:39:39.043 INFO:tasks.workunit.client.0.smithi118.stdout:2/708: creat de/d51/ff3 x:0 0 0 2024-09-21T11:39:39.043 INFO:tasks.workunit.client.0.smithi118.stdout:4/693: dwrite d2/d6/de/d1c/d87/da9/d97/d9b/fe6 [0,4194304] 0 2024-09-21T11:39:39.050 INFO:tasks.workunit.client.0.smithi118.stdout:4/694: symlink d2/d6/de/d1c/d4d/d52/lf1 0 2024-09-21T11:39:39.055 INFO:tasks.workunit.client.0.smithi118.stdout:5/710: dwrite d0/db/d35/f4d [0,4194304] 0 2024-09-21T11:39:39.057 INFO:tasks.workunit.client.0.smithi118.stdout:4/695: write d2/da1/fb9 [198671,111243] 0 2024-09-21T11:39:39.058 INFO:tasks.workunit.client.0.smithi118.stdout:4/696: chown d2/d65/fb6 645913 1 2024-09-21T11:39:39.060 INFO:tasks.workunit.client.0.smithi118.stdout:5/711: read d0/db/faf [137140,119930] 0 2024-09-21T11:39:39.062 INFO:tasks.workunit.client.0.smithi118.stdout:2/709: truncate de/d16/d31/dce/d66/fbd 3306164 0 2024-09-21T11:39:39.064 INFO:tasks.workunit.client.0.smithi118.stdout:5/712: mkdir d0/db/d35/d30/d1a/d8f/d99/df4 0 2024-09-21T11:39:39.068 INFO:tasks.workunit.client.0.smithi118.stdout:5/713: unlink d0/d6c/d25/c28 0 2024-09-21T11:39:39.068 INFO:tasks.workunit.client.0.smithi118.stdout:5/714: fdatasync d0/d6c/d25/ff2 0 2024-09-21T11:39:39.069 INFO:tasks.workunit.client.0.smithi118.stdout:4/697: link d2/d6/de/d1c/c2f d2/d6/de/d1c/d87/da9/cf2 0 2024-09-21T11:39:39.070 INFO:tasks.workunit.client.0.smithi118.stdout:5/715: mkdir d0/dd1/df5 0 2024-09-21T11:39:39.071 INFO:tasks.workunit.client.0.smithi118.stdout:4/698: write d2/d6/de/d1c/d23/d26/dd6/dcb/fd9 [787676,27139] 0 2024-09-21T11:39:39.072 INFO:tasks.workunit.client.0.smithi118.stdout:4/699: write d2/fc [956096,104458] 0 2024-09-21T11:39:39.073 INFO:tasks.workunit.client.0.smithi118.stdout:5/716: chown d0/db/cc 775 1 2024-09-21T11:39:39.075 INFO:tasks.workunit.client.0.smithi118.stdout:4/700: mkdir d2/da1/df3 0 2024-09-21T11:39:39.075 INFO:tasks.workunit.client.0.smithi118.stdout:5/717: write d0/db/d35/d30/d1a/d8f/d99/fe6 [860395,9352] 0 2024-09-21T11:39:39.076 INFO:tasks.workunit.client.0.smithi118.stdout:5/718: dread - d0/db/d35/d30/d1a/db3/fe7 zero size 2024-09-21T11:39:39.077 INFO:tasks.workunit.client.0.smithi118.stdout:5/719: stat d0/l88 0 2024-09-21T11:39:39.078 INFO:tasks.workunit.client.0.smithi118.stdout:2/710: write de/d1f/d20/f27 [609873,75396] 0 2024-09-21T11:39:39.080 INFO:tasks.workunit.client.0.smithi118.stdout:4/701: rename d2/d6/de/d1c/d4d/d52/d69/f82 to d2/da1/df3/ff4 0 2024-09-21T11:39:39.081 INFO:tasks.workunit.client.0.smithi118.stdout:4/702: readlink d2/d6/de/d1c/l86 0 2024-09-21T11:39:39.092 INFO:tasks.workunit.client.0.smithi118.stdout:2/711: getdents de/d1f/d20/d67 0 2024-09-21T11:39:39.094 INFO:tasks.workunit.client.0.smithi118.stdout:4/703: dwrite d2/d6/de/f80 [0,4194304] 0 2024-09-21T11:39:39.095 INFO:tasks.workunit.client.0.smithi118.stdout:5/720: dread d0/d63/f78 [0,4194304] 0 2024-09-21T11:39:39.096 INFO:tasks.workunit.client.0.smithi118.stdout:2/712: fdatasync de/d51/fad 0 2024-09-21T11:39:39.098 INFO:tasks.workunit.client.0.smithi118.stdout:4/704: fdatasync d2/d6/de/d1c/d4d/d52/f6a 0 2024-09-21T11:39:39.100 INFO:tasks.workunit.client.0.smithi118.stdout:2/713: symlink de/d1f/d20/d67/lf4 0 2024-09-21T11:39:39.103 INFO:tasks.workunit.client.0.smithi118.stdout:4/705: creat d2/d6/de/d1c/d23/d26/d74/ff5 x:0 0 0 2024-09-21T11:39:39.103 INFO:tasks.workunit.client.0.smithi118.stdout:4/706: dread - d2/d8e/fd2 zero size 2024-09-21T11:39:39.103 INFO:tasks.workunit.client.0.smithi118.stdout:2/714: rmdir de/d16/d31/dce/d4f 39 2024-09-21T11:39:39.104 INFO:tasks.workunit.client.0.smithi118.stdout:4/707: chown d2/d6/dd/d35/f6e 14 1 2024-09-21T11:39:39.105 INFO:tasks.workunit.client.0.smithi118.stdout:2/715: write de/d22/d3c/f7b [4230090,83172] 0 2024-09-21T11:39:39.105 INFO:tasks.workunit.client.0.smithi118.stdout:4/708: dread - d2/d6/de/fe8 zero size 2024-09-21T11:39:39.107 INFO:tasks.workunit.client.0.smithi118.stdout:4/709: creat d2/d6/de/d1c/ff6 x:0 0 0 2024-09-21T11:39:39.109 INFO:tasks.workunit.client.0.smithi118.stdout:4/710: write d2/d6/de/d1c/d4d/d52/fb8 [124719,8450] 0 2024-09-21T11:39:39.111 INFO:tasks.workunit.client.0.smithi118.stdout:2/716: link de/f1e de/d50/d85/ff5 0 2024-09-21T11:39:39.113 INFO:tasks.workunit.client.0.smithi118.stdout:4/711: symlink d2/d6/de/d1c/d87/da9/d97/lf7 0 2024-09-21T11:39:39.114 INFO:tasks.workunit.client.0.smithi118.stdout:4/712: dread - d2/d6/de/d1c/d87/fce zero size 2024-09-21T11:39:39.115 INFO:tasks.workunit.client.0.smithi118.stdout:2/717: creat de/d16/d31/dce/d4f/d5b/ff6 x:0 0 0 2024-09-21T11:39:39.130 INFO:tasks.workunit.client.0.smithi118.stdout:2/718: link de/d1f/d20/d67/d8a/d6d/d70/f90 de/d22/d3c/d83/ff7 0 2024-09-21T11:39:39.135 INFO:tasks.workunit.client.0.smithi118.stdout:2/719: dwrite de/f2a [0,4194304] 0 2024-09-21T11:39:39.142 INFO:tasks.workunit.client.0.smithi118.stdout:2/720: dwrite de/d16/d25/fd4 [0,4194304] 0 2024-09-21T11:39:39.149 INFO:tasks.workunit.client.0.smithi118.stdout:2/721: dwrite de/d1f/d20/fe7 [0,4194304] 0 2024-09-21T11:39:39.150 INFO:tasks.workunit.client.0.smithi118.stdout:2/722: readlink de/d16/d31/dce/d66/d9a/la0 0 2024-09-21T11:39:39.519 INFO:tasks.workunit.client.0.smithi118.stdout:7/798: sync 2024-09-21T11:39:39.519 INFO:tasks.workunit.client.0.smithi118.stdout:5/721: sync 2024-09-21T11:39:39.520 INFO:tasks.workunit.client.0.smithi118.stdout:4/713: sync 2024-09-21T11:39:39.520 INFO:tasks.workunit.client.0.smithi118.stdout:6/615: sync 2024-09-21T11:39:39.520 INFO:tasks.workunit.client.0.smithi118.stdout:0/969: sync 2024-09-21T11:39:39.520 INFO:tasks.workunit.client.0.smithi118.stdout:3/690: sync 2024-09-21T11:39:39.520 INFO:tasks.workunit.client.0.smithi118.stdout:9/724: sync 2024-09-21T11:39:39.520 INFO:tasks.workunit.client.0.smithi118.stdout:2/723: sync 2024-09-21T11:39:39.520 INFO:tasks.workunit.client.0.smithi118.stdout:1/714: sync 2024-09-21T11:39:39.523 INFO:tasks.workunit.client.0.smithi118.stdout:9/725: rmdir d0/d4 39 2024-09-21T11:39:39.525 INFO:tasks.workunit.client.0.smithi118.stdout:3/691: unlink d5/d28/f54 0 2024-09-21T11:39:39.528 INFO:tasks.workunit.client.0.smithi118.stdout:5/722: write d0/d63/f78 [3353902,117450] 0 2024-09-21T11:39:39.531 INFO:tasks.workunit.client.0.smithi118.stdout:2/724: creat de/d50/d85/ff8 x:0 0 0 2024-09-21T11:39:39.534 INFO:tasks.workunit.client.0.smithi118.stdout:2/725: chown de/l13 32 1 2024-09-21T11:39:39.534 INFO:tasks.workunit.client.0.smithi118.stdout:5/723: write d0/db/d35/da/f6e [3347039,116489] 0 2024-09-21T11:39:39.535 INFO:tasks.workunit.client.0.smithi118.stdout:6/616: mknod d8/d48/d45/d61/d70/cc6 0 2024-09-21T11:39:39.537 INFO:tasks.workunit.client.0.smithi118.stdout:4/714: dwrite d2/d6/de/d1c/d4d/d52/fb8 [0,4194304] 0 2024-09-21T11:39:39.539 INFO:tasks.workunit.client.0.smithi118.stdout:6/617: write d8/d48/d72/d7e/f95 [316423,125900] 0 2024-09-21T11:39:39.546 INFO:tasks.workunit.client.0.smithi118.stdout:9/726: dread d0/d4/f8c [0,4194304] 0 2024-09-21T11:39:39.547 INFO:tasks.workunit.client.0.smithi118.stdout:4/715: mknod d2/d6/de/d1c/d23/d26/cf8 0 2024-09-21T11:39:39.549 INFO:tasks.workunit.client.0.smithi118.stdout:2/726: dwrite de/d1f/d20/f27 [0,4194304] 0 2024-09-21T11:39:39.553 INFO:tasks.workunit.client.0.smithi118.stdout:0/970: creat d5/d10/d1e/d23/d3a/d4e/f13e x:0 0 0 2024-09-21T11:39:39.562 INFO:tasks.workunit.client.0.smithi118.stdout:9/727: creat d0/d4/d38/df6/f106 x:0 0 0 2024-09-21T11:39:39.563 INFO:tasks.workunit.client.0.smithi118.stdout:2/727: chown de/d1f/d20/d67/c94 2114 1 2024-09-21T11:39:39.564 INFO:tasks.workunit.client.0.smithi118.stdout:4/716: rmdir d2/d6/de/d1c/d87/da9/d97 39 2024-09-21T11:39:39.574 INFO:tasks.workunit.client.0.smithi118.stdout:7/799: dread d0/d3/d13/f2f [4194304,4194304] 0 2024-09-21T11:39:39.576 INFO:tasks.workunit.client.0.smithi118.stdout:5/724: write d0/d6c/d25/d50/fad [457598,94012] 0 2024-09-21T11:39:39.576 INFO:tasks.workunit.client.0.smithi118.stdout:3/692: dwrite d5/d1d/d1b/d4c/d91/f93 [0,4194304] 0 2024-09-21T11:39:39.579 INFO:tasks.workunit.client.0.smithi118.stdout:1/715: dwrite d6/de/d13/f1c [0,4194304] 0 2024-09-21T11:39:39.579 INFO:tasks.workunit.client.0.smithi118.stdout:6/618: getdents d8/d14/d33/d92 0 2024-09-21T11:39:39.581 INFO:tasks.workunit.client.0.smithi118.stdout:6/619: chown d8/d14/d33/c34 90868676 1 2024-09-21T11:39:39.584 INFO:tasks.workunit.client.0.smithi118.stdout:6/620: chown d8/d48/d45/d61/d70/d7d/fae 640 1 2024-09-21T11:39:39.588 INFO:tasks.workunit.client.0.smithi118.stdout:9/728: write d0/f76 [1880532,36728] 0 2024-09-21T11:39:39.593 INFO:tasks.workunit.client.0.smithi118.stdout:9/729: chown d0/d20/d4c/d5f/d6c/d88/d4d/dca/fec 129 1 2024-09-21T11:39:39.593 INFO:tasks.workunit.client.0.smithi118.stdout:6/621: dread d8/d14/d33/f62 [0,4194304] 0 2024-09-21T11:39:39.596 INFO:tasks.workunit.client.0.smithi118.stdout:2/728: truncate de/d1f/d20/d78/fb4 3439274 0 2024-09-21T11:39:39.596 INFO:tasks.workunit.client.0.smithi118.stdout:7/800: symlink d0/d3/d29/l10c 0 2024-09-21T11:39:39.597 INFO:tasks.workunit.client.0.smithi118.stdout:2/729: chown de/d16/d25/dba/c9d 4094 1 2024-09-21T11:39:39.604 INFO:tasks.workunit.client.0.smithi118.stdout:9/730: rename d0/d4/ff5 to d0/d20/d4c/d5f/d6c/dd0/f107 0 2024-09-21T11:39:39.605 INFO:tasks.workunit.client.0.smithi118.stdout:4/717: write d2/d6/de/d1c/d23/d26/dd6/dcb/fe0 [2583008,74988] 0 2024-09-21T11:39:39.607 INFO:tasks.workunit.client.0.smithi118.stdout:2/730: dwrite de/f14 [4194304,4194304] 0 2024-09-21T11:39:39.610 INFO:tasks.workunit.client.0.smithi118.stdout:4/718: stat d2/d6/de/d1c/ce5 0 2024-09-21T11:39:39.610 INFO:tasks.workunit.client.0.smithi118.stdout:7/801: creat d0/d3/d13/d8f/f10d x:0 0 0 2024-09-21T11:39:39.614 INFO:tasks.workunit.client.0.smithi118.stdout:7/802: chown d0/d3/d14/fc9 0 1 2024-09-21T11:39:39.615 INFO:tasks.workunit.client.0.smithi118.stdout:5/725: dwrite d0/db/faf [0,4194304] 0 2024-09-21T11:39:39.616 INFO:tasks.workunit.client.0.smithi118.stdout:4/719: write d2/d6/de/d1c/d87/fc3 [833052,73687] 0 2024-09-21T11:39:39.617 INFO:tasks.workunit.client.0.smithi118.stdout:1/716: link d6/de/d16/fd6 d6/fdc 0 2024-09-21T11:39:39.621 INFO:tasks.workunit.client.0.smithi118.stdout:5/726: write d0/db/d35/d30/d1a/fe1 [227380,115675] 0 2024-09-21T11:39:39.621 INFO:tasks.workunit.client.0.smithi118.stdout:3/693: rmdir d5/d1d/d1b/d4c/d73/dee 0 2024-09-21T11:39:39.623 INFO:tasks.workunit.client.0.smithi118.stdout:5/727: dread - d0/db/d26/d65/fe0 zero size 2024-09-21T11:39:39.625 INFO:tasks.workunit.client.0.smithi118.stdout:9/731: symlink d0/d4/d45/d72/de4/df4/l108 0 2024-09-21T11:39:39.627 INFO:tasks.workunit.client.0.smithi118.stdout:9/732: chown d0/d20/d4c/d5f/d89/fd9 43609 1 2024-09-21T11:39:39.627 INFO:tasks.workunit.client.0.smithi118.stdout:7/803: mkdir d0/d3/d1d/d35/d70/d10e 0 2024-09-21T11:39:39.630 INFO:tasks.workunit.client.0.smithi118.stdout:4/720: mknod d2/cf9 0 2024-09-21T11:39:39.630 INFO:tasks.workunit.client.0.smithi118.stdout:6/622: dwrite d8/d14/d33/f3e [0,4194304] 0 2024-09-21T11:39:39.631 INFO:tasks.workunit.client.0.smithi118.stdout:5/728: mkdir d0/db/d35/d30/d1a/df6 0 2024-09-21T11:39:39.634 INFO:tasks.workunit.client.0.smithi118.stdout:3/694: write d5/d28/d3e/daa/fe1 [221802,82883] 0 2024-09-21T11:39:39.636 INFO:tasks.workunit.client.0.smithi118.stdout:9/733: unlink d0/d20/d4c/f85 0 2024-09-21T11:39:39.638 INFO:tasks.workunit.client.0.smithi118.stdout:7/804: dread d0/d3/d14/f28 [0,4194304] 0 2024-09-21T11:39:39.644 INFO:tasks.workunit.client.0.smithi118.stdout:6/623: write d8/d48/d45/d61/d70/f84 [871344,36743] 0 2024-09-21T11:39:39.644 INFO:tasks.workunit.client.0.smithi118.stdout:4/721: dread d2/d6/de/d1c/d87/da9/d97/d9b/fe6 [0,4194304] 0 2024-09-21T11:39:39.645 INFO:tasks.workunit.client.0.smithi118.stdout:4/722: chown d2/d6/de/d1c/d4d/c8b 491 1 2024-09-21T11:39:39.649 INFO:tasks.workunit.client.0.smithi118.stdout:9/734: unlink d0/d4/d38/df6/ffc 0 2024-09-21T11:39:39.652 INFO:tasks.workunit.client.0.smithi118.stdout:7/805: mkdir d0/d3/d14/d41/d7f/d3e/d81/db6/d10f 0 2024-09-21T11:39:39.655 INFO:tasks.workunit.client.0.smithi118.stdout:5/729: mknod d0/d6c/dba/cf7 0 2024-09-21T11:39:39.656 INFO:tasks.workunit.client.0.smithi118.stdout:5/730: stat d0/db/d35/da/fa2 0 2024-09-21T11:39:39.657 INFO:tasks.workunit.client.0.smithi118.stdout:4/723: chown d2/d6/de/d1c/d23/d26/dd6/d5e/ce1 679403780 1 2024-09-21T11:39:39.658 INFO:tasks.workunit.client.0.smithi118.stdout:4/724: write d2/d6/de/d1c/d4d/d52/d69/fc4 [233212,89061] 0 2024-09-21T11:39:39.660 INFO:tasks.workunit.client.0.smithi118.stdout:9/735: creat d0/d20/d4c/d5f/d6c/d88/db4/f109 x:0 0 0 2024-09-21T11:39:39.666 INFO:tasks.workunit.client.0.smithi118.stdout:4/725: dread d2/d65/fa3 [4194304,4194304] 0 2024-09-21T11:39:39.667 INFO:tasks.workunit.client.0.smithi118.stdout:4/726: chown d2/d6/de/d1c/l86 7759 1 2024-09-21T11:39:39.670 INFO:tasks.workunit.client.0.smithi118.stdout:6/624: write d8/d14/f99 [252056,39447] 0 2024-09-21T11:39:39.672 INFO:tasks.workunit.client.0.smithi118.stdout:3/695: write d5/d28/d33/d4a/f4f [2742138,18821] 0 2024-09-21T11:39:39.673 INFO:tasks.workunit.client.0.smithi118.stdout:5/731: rename d0/d6c/d25/d50/cdf to d0/d6c/d25/d50/cf8 0 2024-09-21T11:39:39.677 INFO:tasks.workunit.client.0.smithi118.stdout:6/625: fdatasync d8/d48/d6c/f8f 0 2024-09-21T11:39:39.679 INFO:tasks.workunit.client.0.smithi118.stdout:4/727: rename d2/d8e/fd2 to d2/d6/de/d1c/d23/ffa 0 2024-09-21T11:39:39.680 INFO:tasks.workunit.client.0.smithi118.stdout:7/806: truncate d0/d3/d29/d5f/fe8 2019643 0 2024-09-21T11:39:39.683 INFO:tasks.workunit.client.0.smithi118.stdout:4/728: dread - d2/d6/de/d1c/d23/d26/dd6/d5e/fbc zero size 2024-09-21T11:39:39.684 INFO:tasks.workunit.client.0.smithi118.stdout:9/736: dwrite d0/d20/d4c/d5f/d6c/d88/f32 [4194304,4194304] 0 2024-09-21T11:39:39.684 INFO:tasks.workunit.client.0.smithi118.stdout:5/732: mknod d0/d6c/d25/cf9 0 2024-09-21T11:39:39.685 INFO:tasks.workunit.client.0.smithi118.stdout:4/729: stat d2/d8e/ce3 0 2024-09-21T11:39:39.686 INFO:tasks.workunit.client.0.smithi118.stdout:3/696: dread d5/d1d/d1b/d4c/fbf [4194304,4194304] 0 2024-09-21T11:39:39.686 INFO:tasks.workunit.client.0.smithi118.stdout:5/733: chown d0/db/d35/l1e 1 1 2024-09-21T11:39:39.689 INFO:tasks.workunit.client.0.smithi118.stdout:9/737: chown d0/d20/d4c/d5f/d6c/d88/db9/fde 252505231 1 2024-09-21T11:39:39.690 INFO:tasks.workunit.client.0.smithi118.stdout:3/697: write d5/d28/d33/fd2 [1038919,66034] 0 2024-09-21T11:39:39.690 INFO:tasks.workunit.client.0.smithi118.stdout:7/807: truncate d0/d3/d14/fa9 72792 0 2024-09-21T11:39:39.693 INFO:tasks.workunit.client.0.smithi118.stdout:7/808: stat d0/d3/d13/f2f 0 2024-09-21T11:39:39.694 INFO:tasks.workunit.client.0.smithi118.stdout:6/626: truncate d8/d48/d72/f9c 3682400 0 2024-09-21T11:39:39.698 INFO:tasks.workunit.client.0.smithi118.stdout:9/738: dwrite d0/d4/d45/db5/d86/ffe [0,4194304] 0 2024-09-21T11:39:39.704 INFO:tasks.workunit.client.0.smithi118.stdout:4/730: dread d2/fc [0,4194304] 0 2024-09-21T11:39:39.704 INFO:tasks.workunit.client.0.smithi118.stdout:9/739: truncate d0/fd3 453727 0 2024-09-21T11:39:39.709 INFO:tasks.workunit.client.0.smithi118.stdout:3/698: rmdir d5/d1d/d1b/d4c/d91/d69/ddd 0 2024-09-21T11:39:39.715 INFO:tasks.workunit.client.0.smithi118.stdout:9/740: mknod d0/d20/d4c/d5f/d6c/d88/d4d/dca/c10a 0 2024-09-21T11:39:39.721 INFO:tasks.workunit.client.0.smithi118.stdout:7/809: write d0/d3/d29/f6b [701155,76507] 0 2024-09-21T11:39:39.721 INFO:tasks.workunit.client.0.smithi118.stdout:9/741: fsync d0/d4/d38/f46 0 2024-09-21T11:39:39.723 INFO:tasks.workunit.client.0.smithi118.stdout:3/699: creat d5/d1d/d1b/d4c/ff7 x:0 0 0 2024-09-21T11:39:39.724 INFO:tasks.workunit.client.0.smithi118.stdout:6/627: write d8/f93 [108502,30306] 0 2024-09-21T11:39:39.726 INFO:tasks.workunit.client.0.smithi118.stdout:7/810: dread d0/d3/d1d/d35/f5a [0,4194304] 0 2024-09-21T11:39:39.729 INFO:tasks.workunit.client.0.smithi118.stdout:9/742: unlink d0/d20/d4c/d5f/d6c/d88/db9/d7c/cd4 0 2024-09-21T11:39:39.732 INFO:tasks.workunit.client.0.smithi118.stdout:6/628: dwrite d8/d48/d45/d61/d70/d7d/fae [0,4194304] 0 2024-09-21T11:39:39.736 INFO:tasks.workunit.client.0.smithi118.stdout:7/811: rename d0/d3/d29 to d0/d3/d1d/d35/d70/d10e/d110 0 2024-09-21T11:39:39.739 INFO:tasks.workunit.client.0.smithi118.stdout:4/731: dwrite d2/d6/de/f16 [0,4194304] 0 2024-09-21T11:39:39.742 INFO:tasks.workunit.client.0.smithi118.stdout:3/700: mknod d5/d1d/d1b/d4c/d73/cf8 0 2024-09-21T11:39:39.750 INFO:tasks.workunit.client.0.smithi118.stdout:6/629: symlink d8/d48/d45/lc7 0 2024-09-21T11:39:39.750 INFO:tasks.workunit.client.0.smithi118.stdout:7/812: symlink d0/d3/d14/d41/d7f/d3e/d81/db6/d10f/l111 0 2024-09-21T11:39:39.751 INFO:tasks.workunit.client.0.smithi118.stdout:6/630: write d8/d48/d45/d61/d66/fad [959943,10313] 0 2024-09-21T11:39:39.751 INFO:tasks.workunit.client.0.smithi118.stdout:7/813: dread - d0/d3/d13/ff4 zero size 2024-09-21T11:39:39.753 INFO:tasks.workunit.client.0.smithi118.stdout:6/631: dread - d8/d48/d6c/d64/fa0 zero size 2024-09-21T11:39:39.758 INFO:tasks.workunit.client.0.smithi118.stdout:9/743: link d0/d20/d4c/d5f/d6c/d88/db4/cd7 d0/d4/c10b 0 2024-09-21T11:39:39.759 INFO:tasks.workunit.client.0.smithi118.stdout:4/732: rename d2/d65/cc7 to d2/d6/cfb 0 2024-09-21T11:39:39.760 INFO:tasks.workunit.client.0.smithi118.stdout:3/701: dwrite d5/d1d/d1b/d4c/d91/f7b [0,4194304] 0 2024-09-21T11:39:39.760 INFO:tasks.workunit.client.0.smithi118.stdout:6/632: mknod d8/cc8 0 2024-09-21T11:39:39.760 INFO:tasks.workunit.client.0.smithi118.stdout:9/744: chown d0/d20/d4c/d5f/d6c/d88/db9/d7c/fad 1483 1 2024-09-21T11:39:39.767 INFO:tasks.workunit.client.0.smithi118.stdout:6/633: creat d8/d48/d5f/d6b/fc9 x:0 0 0 2024-09-21T11:39:39.773 INFO:tasks.workunit.client.0.smithi118.stdout:4/733: rename d2/d6/de/d1c/d23/d26/dd6/dcb/c8f to d2/d6/de/d1c/d4d/def/cfc 0 2024-09-21T11:39:39.777 INFO:tasks.workunit.client.0.smithi118.stdout:6/634: mkdir d8/d46/dca 0 2024-09-21T11:39:39.777 INFO:tasks.workunit.client.0.smithi118.stdout:3/702: dread d5/d1d/fd5 [0,4194304] 0 2024-09-21T11:39:39.781 INFO:tasks.workunit.client.0.smithi118.stdout:9/745: creat d0/d4/d38/f10c x:0 0 0 2024-09-21T11:39:39.786 INFO:tasks.workunit.client.0.smithi118.stdout:4/734: mkdir d2/d6/de/d1c/d23/d26/dd6/d5e/dfd 0 2024-09-21T11:39:39.786 INFO:tasks.workunit.client.0.smithi118.stdout:4/735: chown d2/d6/de/d1c/d23/d26/dd6/dcb/db0/dcd/fe2 13271 1 2024-09-21T11:39:39.787 INFO:tasks.workunit.client.0.smithi118.stdout:4/736: mknod d2/d6/de/d1c/d23/cfe 0 2024-09-21T11:39:39.793 INFO:tasks.workunit.client.0.smithi118.stdout:4/737: dread d2/d6/de/d1c/d4d/d52/d69/f84 [0,4194304] 0 2024-09-21T11:39:39.798 INFO:tasks.workunit.client.0.smithi118.stdout:4/738: dwrite d2/d6/de/d1c/d4d/dba/fec [0,4194304] 0 2024-09-21T11:39:39.805 INFO:tasks.workunit.client.0.smithi118.stdout:4/739: creat d2/d6/de/d1c/d87/da9/d97/de7/fff x:0 0 0 2024-09-21T11:39:39.841 INFO:tasks.workunit.client.0.smithi118.stdout:4/740: truncate d2/d6/dd/f57 241143 0 2024-09-21T11:39:39.852 INFO:tasks.workunit.client.0.smithi118.stdout:4/741: dread d2/d6/de/d1c/f47 [0,4194304] 0 2024-09-21T11:39:39.853 INFO:tasks.workunit.client.0.smithi118.stdout:4/742: dread d2/d65/fb6 [0,4194304] 0 2024-09-21T11:39:39.857 INFO:tasks.workunit.client.0.smithi118.stdout:4/743: truncate d2/d6/dd/f51 1493649 0 2024-09-21T11:39:39.860 INFO:tasks.workunit.client.0.smithi118.stdout:4/744: creat d2/d6/de/d1c/d23/d26/dd6/dcb/db0/f100 x:0 0 0 2024-09-21T11:39:39.863 INFO:tasks.workunit.client.0.smithi118.stdout:4/745: unlink d2/d6/de/d1c/d4d/dba/fbf 0 2024-09-21T11:39:39.866 INFO:tasks.workunit.client.0.smithi118.stdout:4/746: fdatasync d2/d65/fa3 0 2024-09-21T11:39:39.875 INFO:tasks.workunit.client.0.smithi118.stdout:4/747: creat d2/d6/de/d1c/d4d/d52/f101 x:0 0 0 2024-09-21T11:39:39.876 INFO:tasks.workunit.client.0.smithi118.stdout:4/748: chown d2/d6/de/d1c/d23/d26/f73 500315317 1 2024-09-21T11:39:39.878 INFO:tasks.workunit.client.0.smithi118.stdout:4/749: creat d2/d6/de/d1c/d87/da9/da8/deb/f102 x:0 0 0 2024-09-21T11:39:39.880 INFO:tasks.workunit.client.0.smithi118.stdout:4/750: truncate d2/d6/de/d1c/d87/da9/d97/d9b/fc0 248086 0 2024-09-21T11:39:39.882 INFO:tasks.workunit.client.0.smithi118.stdout:4/751: creat d2/d6/de/d1c/d4d/def/f103 x:0 0 0 2024-09-21T11:39:39.887 INFO:tasks.workunit.client.0.smithi118.stdout:4/752: dwrite d2/d6/de/d1c/d87/fce [0,4194304] 0 2024-09-21T11:39:39.890 INFO:tasks.workunit.client.0.smithi118.stdout:4/753: readlink d2/d6/dd/l90 0 2024-09-21T11:39:39.892 INFO:tasks.workunit.client.0.smithi118.stdout:4/754: write d2/d6/de/d1c/d4d/d52/f101 [706393,6296] 0 2024-09-21T11:39:39.899 INFO:tasks.workunit.client.0.smithi118.stdout:4/755: dwrite d2/d6/de/f16 [0,4194304] 0 2024-09-21T11:39:39.904 INFO:tasks.workunit.client.0.smithi118.stdout:4/756: creat d2/d6/de/d1c/d87/da9/da8/deb/f104 x:0 0 0 2024-09-21T11:39:39.906 INFO:tasks.workunit.client.0.smithi118.stdout:4/757: mkdir d2/d6/de/d1c/d87/d105 0 2024-09-21T11:39:39.907 INFO:tasks.workunit.client.0.smithi118.stdout:4/758: write d2/d6/de/d1c/d4d/def/f103 [920685,86162] 0 2024-09-21T11:39:39.908 INFO:tasks.workunit.client.0.smithi118.stdout:4/759: chown d2/d6/de/f80 6568 1 2024-09-21T11:39:39.908 INFO:tasks.workunit.client.0.smithi118.stdout:4/760: readlink d2/l88 0 2024-09-21T11:39:39.912 INFO:tasks.workunit.client.0.smithi118.stdout:4/761: unlink d2/d6/de/d1c/d87/da9/d97/d9b/fe6 0 2024-09-21T11:39:39.915 INFO:tasks.workunit.client.0.smithi118.stdout:4/762: mkdir d2/d65/d106 0 2024-09-21T11:39:39.916 INFO:tasks.workunit.client.0.smithi118.stdout:4/763: write d2/d6/de/f1e [2586081,25646] 0 2024-09-21T11:39:39.917 INFO:tasks.workunit.client.0.smithi118.stdout:4/764: symlink d2/d6/dd/d35/l107 0 2024-09-21T11:39:39.918 INFO:tasks.workunit.client.0.smithi118.stdout:4/765: fsync d2/d6/de/d1c/d4d/dba/fec 0 2024-09-21T11:39:39.921 INFO:tasks.workunit.client.0.smithi118.stdout:4/766: creat d2/d6/de/d1c/d4d/dba/f108 x:0 0 0 2024-09-21T11:39:39.923 INFO:tasks.workunit.client.0.smithi118.stdout:4/767: dread d2/d6/de/d1c/d4d/d52/d69/f84 [0,4194304] 0 2024-09-21T11:39:39.926 INFO:tasks.workunit.client.0.smithi118.stdout:4/768: dread d2/d6/de/d1c/d4d/dba/fec [0,4194304] 0 2024-09-21T11:39:39.928 INFO:tasks.workunit.client.0.smithi118.stdout:4/769: dread d2/d6/f2b [0,4194304] 0 2024-09-21T11:39:39.932 INFO:tasks.workunit.client.0.smithi118.stdout:4/770: rename d2/d6/de/d1c/d23/d26/dd6/dcb/fd9 to d2/d6/de/d1c/d23/d26/dd6/dcb/db0/f109 0 2024-09-21T11:39:39.933 INFO:tasks.workunit.client.0.smithi118.stdout:4/771: rename d2/d6/de to d2/d6/de/d1c/d23/d26/dd6/dcb/db0/d10a 22 2024-09-21T11:39:39.938 INFO:tasks.workunit.client.0.smithi118.stdout:4/772: dwrite d2/d6/de/d1c/d87/da9/da8/deb/f104 [0,4194304] 0 2024-09-21T11:39:39.941 INFO:tasks.workunit.client.0.smithi118.stdout:4/773: write d2/d6/de/d1c/d4d/d52/f101 [428226,75093] 0 2024-09-21T11:39:39.944 INFO:tasks.workunit.client.0.smithi118.stdout:4/774: symlink d2/da1/df3/l10b 0 2024-09-21T11:39:39.945 INFO:tasks.workunit.client.0.smithi118.stdout:4/775: chown d2/d6/de/d1c/d23/d26/f95 17409389 1 2024-09-21T11:39:39.946 INFO:tasks.workunit.client.0.smithi118.stdout:4/776: write d2/d6/de/d1c/d23/d26/f95 [952623,101460] 0 2024-09-21T11:39:39.951 INFO:tasks.workunit.client.0.smithi118.stdout:4/777: unlink d2/d6/dd/d35/l8c 0 2024-09-21T11:39:39.952 INFO:tasks.workunit.client.0.smithi118.stdout:4/778: stat d2/da1/df3 0 2024-09-21T11:39:39.952 INFO:tasks.workunit.client.0.smithi118.stdout:4/779: chown d2/d6/dd/d35 3466746 1 2024-09-21T11:39:39.953 INFO:tasks.workunit.client.0.smithi118.stdout:4/780: truncate d2/d6/de/d1c/ff6 409698 0 2024-09-21T11:39:39.955 INFO:tasks.workunit.client.0.smithi118.stdout:4/781: chown d2/d6/de/d1c/d23/f92 2327186 1 2024-09-21T11:39:39.956 INFO:tasks.workunit.client.0.smithi118.stdout:4/782: write d2/d6/de/d1c/d23/ffa [117371,50571] 0 2024-09-21T11:39:39.958 INFO:tasks.workunit.client.0.smithi118.stdout:4/783: chown d2/d6/de/d1c/d23/l59 188065153 1 2024-09-21T11:39:39.958 INFO:tasks.workunit.client.0.smithi118.stdout:4/784: chown d2/d6/de/d1c/d4d 8 1 2024-09-21T11:39:39.960 INFO:tasks.workunit.client.0.smithi118.stdout:4/785: unlink d2/d6/dd/c9d 0 2024-09-21T11:39:39.961 INFO:tasks.workunit.client.0.smithi118.stdout:4/786: chown d2/d6/de/d1c/d4d/dba/f108 9 1 2024-09-21T11:39:39.964 INFO:tasks.workunit.client.0.smithi118.stdout:4/787: mkdir d2/d6/de/d1c/d87/da9/d97/de7/d10c 0 2024-09-21T11:39:39.974 INFO:tasks.workunit.client.0.smithi118.stdout:4/788: dread d2/d6/dd/d35/f3f [0,4194304] 0 2024-09-21T11:39:39.979 INFO:tasks.workunit.client.0.smithi118.stdout:4/789: dwrite d2/d6/de/d1c/d4d/d52/d69/fc4 [0,4194304] 0 2024-09-21T11:39:39.981 INFO:tasks.workunit.client.0.smithi118.stdout:4/790: read d2/d6/de/d1c/d4d/d52/d69/f67 [85138,148] 0 2024-09-21T11:39:39.983 INFO:tasks.workunit.client.0.smithi118.stdout:4/791: chown d2/d6/de/d1c/d87/fce 9748 1 2024-09-21T11:39:39.989 INFO:tasks.workunit.client.0.smithi118.stdout:4/792: write d2/d6/dd/d35/f6e [4720060,62698] 0 2024-09-21T11:39:39.991 INFO:tasks.workunit.client.0.smithi118.stdout:4/793: mkdir d2/d6/dd/d35/d10d 0 2024-09-21T11:39:39.998 INFO:tasks.workunit.client.0.smithi118.stdout:4/794: truncate d2/d6/f20 2491416 0 2024-09-21T11:39:39.999 INFO:tasks.workunit.client.0.smithi118.stdout:4/795: read d2/d6/de/d1c/d4d/d52/d69/f84 [157527,6586] 0 2024-09-21T11:39:39.999 INFO:tasks.workunit.client.0.smithi118.stdout:4/796: chown d2/d6/de/d1c/d87/d105 748913652 1 2024-09-21T11:39:40.001 INFO:tasks.workunit.client.0.smithi118.stdout:4/797: rmdir d2/d6/de/d1c/d23 39 2024-09-21T11:39:40.004 INFO:tasks.workunit.client.0.smithi118.stdout:4/798: dread d2/d6/de/d1c/d87/da9/da8/deb/f104 [0,4194304] 0 2024-09-21T11:39:40.010 INFO:tasks.workunit.client.0.smithi118.stdout:4/799: creat d2/d65/f10e x:0 0 0 2024-09-21T11:39:40.014 INFO:tasks.workunit.client.0.smithi118.stdout:4/800: creat d2/d6/de/d1c/d4d/d52/f10f x:0 0 0 2024-09-21T11:39:40.016 INFO:tasks.workunit.client.0.smithi118.stdout:4/801: read - d2/d6/de/d1c/d23/d26/fbe zero size 2024-09-21T11:39:40.017 INFO:tasks.workunit.client.0.smithi118.stdout:4/802: read d2/d6/de/d1c/d87/fc3 [446906,67540] 0 2024-09-21T11:39:40.020 INFO:tasks.workunit.client.0.smithi118.stdout:4/803: write d2/d6/dd/d35/f72 [2435887,55892] 0 2024-09-21T11:39:40.024 INFO:tasks.workunit.client.0.smithi118.stdout:4/804: creat d2/d6/f110 x:0 0 0 2024-09-21T11:39:40.024 INFO:tasks.workunit.client.0.smithi118.stdout:2/731: sync 2024-09-21T11:39:40.024 INFO:tasks.workunit.client.0.smithi118.stdout:0/971: sync 2024-09-21T11:39:40.025 INFO:tasks.workunit.client.0.smithi118.stdout:4/805: write d2/d6/de/d1c/d4d/d52/f101 [586548,10710] 0 2024-09-21T11:39:40.026 INFO:tasks.workunit.client.0.smithi118.stdout:2/732: chown de/f1e 0 1 2024-09-21T11:39:40.027 INFO:tasks.workunit.client.0.smithi118.stdout:0/972: mkdir d5/d10/d1e/d23/d13f 0 2024-09-21T11:39:40.034 INFO:tasks.workunit.client.0.smithi118.stdout:0/973: rename d5/l16 to d5/d10/d1e/d23/d3a/d4e/dfd/d113/l140 0 2024-09-21T11:39:40.037 INFO:tasks.workunit.client.0.smithi118.stdout:0/974: creat d5/d10/d1e/d3d/f141 x:0 0 0 2024-09-21T11:39:40.039 INFO:tasks.workunit.client.0.smithi118.stdout:0/975: creat d5/d34/d44/d87/d129/f142 x:0 0 0 2024-09-21T11:39:40.041 INFO:tasks.workunit.client.0.smithi118.stdout:0/976: creat d5/d10/d1e/d23/d3a/d4e/dfd/d113/f143 x:0 0 0 2024-09-21T11:39:40.044 INFO:tasks.workunit.client.0.smithi118.stdout:4/806: write d2/d6/dd/f51 [2514317,37441] 0 2024-09-21T11:39:40.045 INFO:tasks.workunit.client.0.smithi118.stdout:4/807: dread - d2/d6/de/fe8 zero size 2024-09-21T11:39:40.046 INFO:tasks.workunit.client.0.smithi118.stdout:4/808: readlink d2/d6/de/d1c/d23/d26/l5a 0 2024-09-21T11:39:40.049 INFO:tasks.workunit.client.0.smithi118.stdout:4/809: truncate d2/d6/de/d1c/d23/d26/dd6/d5e/fbc 361879 0 2024-09-21T11:39:40.051 INFO:tasks.workunit.client.0.smithi118.stdout:2/733: dwrite de/d22/d3c/f3f [0,4194304] 0 2024-09-21T11:39:40.051 INFO:tasks.workunit.client.0.smithi118.stdout:4/810: chown d2/d6/de/d1c/d4d/d52 379979 1 2024-09-21T11:39:40.053 INFO:tasks.workunit.client.0.smithi118.stdout:2/734: chown de/d1f/d20/d78/leb 66 1 2024-09-21T11:39:40.059 INFO:tasks.workunit.client.0.smithi118.stdout:2/735: read de/d16/d31/dce/d66/f87 [3794138,81323] 0 2024-09-21T11:39:40.061 INFO:tasks.workunit.client.0.smithi118.stdout:0/977: dwrite d5/d10/df4/f110 [0,4194304] 0 2024-09-21T11:39:40.063 INFO:tasks.workunit.client.0.smithi118.stdout:4/811: dread d2/d6/de/f80 [0,4194304] 0 2024-09-21T11:39:40.066 INFO:tasks.workunit.client.0.smithi118.stdout:2/736: mkdir de/d16/d25/df9 0 2024-09-21T11:39:40.068 INFO:tasks.workunit.client.0.smithi118.stdout:4/812: unlink d2/d6/dd/f96 0 2024-09-21T11:39:40.072 INFO:tasks.workunit.client.0.smithi118.stdout:2/737: stat de/d1f/d20/d78/fb4 0 2024-09-21T11:39:40.075 INFO:tasks.workunit.client.0.smithi118.stdout:4/813: link d2/d6/de/d1c/d23/d26/dd6/dcb/db0/fea d2/d6/de/d1c/d23/d26/dd6/dcb/f111 0 2024-09-21T11:39:40.081 INFO:tasks.workunit.client.0.smithi118.stdout:0/978: truncate d5/d10/d1e/d20/fbf 3985081 0 2024-09-21T11:39:40.082 INFO:tasks.workunit.client.0.smithi118.stdout:4/814: mknod d2/d6/de/d1c/d87/d105/c112 0 2024-09-21T11:39:40.084 INFO:tasks.workunit.client.0.smithi118.stdout:0/979: fsync d5/d10/d1e/d21/fcf 0 2024-09-21T11:39:40.086 INFO:tasks.workunit.client.0.smithi118.stdout:2/738: dwrite de/d1f/d20/f55 [0,4194304] 0 2024-09-21T11:39:40.087 INFO:tasks.workunit.client.0.smithi118.stdout:2/739: fsync de/d1f/d20/fd0 0 2024-09-21T11:39:40.089 INFO:tasks.workunit.client.0.smithi118.stdout:2/740: write de/d51/fa9 [961854,119277] 0 2024-09-21T11:39:40.095 INFO:tasks.workunit.client.0.smithi118.stdout:2/741: mkdir de/d53/dfa 0 2024-09-21T11:39:40.095 INFO:tasks.workunit.client.0.smithi118.stdout:4/815: write d2/d6/f20 [3426274,14645] 0 2024-09-21T11:39:40.097 INFO:tasks.workunit.client.0.smithi118.stdout:4/816: write d2/d6/de/d1c/d4d/d52/d69/f67 [3981624,83058] 0 2024-09-21T11:39:40.100 INFO:tasks.workunit.client.0.smithi118.stdout:2/742: unlink de/d16/d25/fd4 0 2024-09-21T11:39:40.101 INFO:tasks.workunit.client.0.smithi118.stdout:2/743: write de/d1f/d20/d78/d98/fdd [848545,76751] 0 2024-09-21T11:39:40.103 INFO:tasks.workunit.client.0.smithi118.stdout:2/744: mknod de/d53/dc2/cfb 0 2024-09-21T11:39:40.105 INFO:tasks.workunit.client.0.smithi118.stdout:2/745: write de/f2a [2907389,69939] 0 2024-09-21T11:39:40.107 INFO:tasks.workunit.client.0.smithi118.stdout:4/817: getdents d2/d6/de/d1c/d87/da9 0 2024-09-21T11:39:40.109 INFO:tasks.workunit.client.0.smithi118.stdout:4/818: chown d2/d6/dd/d35/f3f 2926 1 2024-09-21T11:39:40.109 INFO:tasks.workunit.client.0.smithi118.stdout:0/980: dwrite d5/d10/d1e/d20/fbf [0,4194304] 0 2024-09-21T11:39:40.113 INFO:tasks.workunit.client.0.smithi118.stdout:2/746: rename de/d16/d31/dce/d65/da2/fd6 to de/d16/ffc 0 2024-09-21T11:39:40.114 INFO:tasks.workunit.client.0.smithi118.stdout:2/747: chown de/d1f/d20/d67/d8a/d6d/d70/f91 7033 1 2024-09-21T11:39:40.115 INFO:tasks.workunit.client.0.smithi118.stdout:2/748: write de/d53/f8d [1635503,72013] 0 2024-09-21T11:39:40.117 INFO:tasks.workunit.client.0.smithi118.stdout:0/981: rename d5/d10/d1e/d3d/d93/f96 to d5/d29/d68/f144 0 2024-09-21T11:39:40.124 INFO:tasks.workunit.client.0.smithi118.stdout:4/819: write d2/d6/de/d1c/f47 [1981279,11225] 0 2024-09-21T11:39:40.125 INFO:tasks.workunit.client.0.smithi118.stdout:4/820: chown d2/f2d 3313 1 2024-09-21T11:39:40.128 INFO:tasks.workunit.client.0.smithi118.stdout:4/821: fsync d2/da1/df3/ff4 0 2024-09-21T11:39:40.129 INFO:tasks.workunit.client.0.smithi118.stdout:0/982: link d5/d81/f118 d5/d10/df4/f145 0 2024-09-21T11:39:40.132 INFO:tasks.workunit.client.0.smithi118.stdout:0/983: truncate d5/d34/d44/f75 1612286 0 2024-09-21T11:39:40.137 INFO:tasks.workunit.client.0.smithi118.stdout:2/749: dwrite de/d16/d31/dce/d65/da2/f74 [0,4194304] 0 2024-09-21T11:39:40.137 INFO:tasks.workunit.client.0.smithi118.stdout:4/822: symlink d2/d65/d106/l113 0 2024-09-21T11:39:40.139 INFO:tasks.workunit.client.0.smithi118.stdout:4/823: write d2/d6/de/d1c/d4d/d52/fb8 [468128,25296] 0 2024-09-21T11:39:40.141 INFO:tasks.workunit.client.0.smithi118.stdout:2/750: mknod de/d16/d25/cfd 0 2024-09-21T11:39:40.143 INFO:tasks.workunit.client.0.smithi118.stdout:4/824: creat d2/d6/de/d1c/d87/d105/f114 x:0 0 0 2024-09-21T11:39:40.143 INFO:tasks.workunit.client.0.smithi118.stdout:4/825: fsync d2/da1/fb9 0 2024-09-21T11:39:40.150 INFO:tasks.workunit.client.0.smithi118.stdout:4/826: dwrite d2/d6/de/d1c/d23/d26/fbe [0,4194304] 0 2024-09-21T11:39:40.150 INFO:tasks.workunit.client.0.smithi118.stdout:2/751: rename de/d16/d25/dba/db5/fe4 to de/d16/d25/dba/ffe 0 2024-09-21T11:39:40.150 INFO:tasks.workunit.client.0.smithi118.stdout:0/984: write d5/d29/d68/d7b/db7/d48/f8a [1343189,20914] 0 2024-09-21T11:39:40.158 INFO:tasks.workunit.client.0.smithi118.stdout:2/752: creat de/d1f/d20/d78/d98/fff x:0 0 0 2024-09-21T11:39:40.163 INFO:tasks.workunit.client.0.smithi118.stdout:0/985: creat d5/d34/d44/d87/de7/d134/f146 x:0 0 0 2024-09-21T11:39:40.170 INFO:tasks.workunit.client.0.smithi118.stdout:4/827: write d2/d6/de/d1c/f85 [625375,88432] 0 2024-09-21T11:39:40.173 INFO:tasks.workunit.client.0.smithi118.stdout:4/828: creat d2/d6/dd/db3/f115 x:0 0 0 2024-09-21T11:39:40.175 INFO:tasks.workunit.client.0.smithi118.stdout:4/829: fdatasync d2/d6/de/d1c/d23/d26/dd6/dcb/fe0 0 2024-09-21T11:39:40.176 INFO:tasks.workunit.client.0.smithi118.stdout:2/753: dwrite de/d16/f32 [0,4194304] 0 2024-09-21T11:39:40.182 INFO:tasks.workunit.client.0.smithi118.stdout:2/754: mknod de/d16/d31/dce/c100 0 2024-09-21T11:39:40.183 INFO:tasks.workunit.client.0.smithi118.stdout:4/830: dwrite d2/d6/de/d1c/d23/ffa [0,4194304] 0 2024-09-21T11:39:40.185 INFO:tasks.workunit.client.0.smithi118.stdout:2/755: symlink de/d16/d31/dce/d4f/d5b/l101 0 2024-09-21T11:39:40.186 INFO:tasks.workunit.client.0.smithi118.stdout:4/831: mkdir d2/d6/dd/d116 0 2024-09-21T11:39:40.188 INFO:tasks.workunit.client.0.smithi118.stdout:4/832: dread - d2/d6/de/d1c/d23/d26/dd6/dcb/f111 zero size 2024-09-21T11:39:40.189 INFO:tasks.workunit.client.0.smithi118.stdout:4/833: write d2/d6/de/d1c/f9c [626287,100229] 0 2024-09-21T11:39:40.192 INFO:tasks.workunit.client.0.smithi118.stdout:4/834: symlink d2/d6/de/d1c/d87/da9/da8/l117 0 2024-09-21T11:39:40.195 INFO:tasks.workunit.client.0.smithi118.stdout:4/835: symlink d2/d6/de/d1c/d23/d26/dd6/d5e/l118 0 2024-09-21T11:39:40.197 INFO:tasks.workunit.client.0.smithi118.stdout:4/836: write d2/d6/dd/db3/f115 [926970,20937] 0 2024-09-21T11:39:40.199 INFO:tasks.workunit.client.0.smithi118.stdout:4/837: symlink d2/d6/de/d1c/d23/d26/d74/l119 0 2024-09-21T11:39:40.201 INFO:tasks.workunit.client.0.smithi118.stdout:4/838: mkdir d2/d6/de/d1c/d87/da9/d11a 0 2024-09-21T11:39:40.216 INFO:tasks.workunit.client.0.smithi118.stdout:4/839: truncate d2/d6/de/d1c/d87/da9/fc1 208372 0 2024-09-21T11:39:40.222 INFO:tasks.workunit.client.0.smithi118.stdout:4/840: write d2/d6/f18 [4054849,39953] 0 2024-09-21T11:39:40.225 INFO:tasks.workunit.client.0.smithi118.stdout:4/841: creat d2/d6/de/d1c/d23/d26/d74/f11b x:0 0 0 2024-09-21T11:39:40.225 INFO:tasks.workunit.client.0.smithi118.stdout:4/842: chown d2/d6/de/d1c/d23/cfe 97345321 1 2024-09-21T11:39:40.226 INFO:tasks.workunit.client.0.smithi118.stdout:4/843: rmdir d2 39 2024-09-21T11:39:40.228 INFO:tasks.workunit.client.0.smithi118.stdout:4/844: truncate d2/d6/de/d1c/d4d/d52/f10f 172710 0 2024-09-21T11:39:40.230 INFO:tasks.workunit.client.0.smithi118.stdout:4/845: creat d2/d6/de/d1c/d23/d26/f11c x:0 0 0 2024-09-21T11:39:40.231 INFO:tasks.workunit.client.0.smithi118.stdout:4/846: read d2/d6/de/d1c/d4d/def/f103 [335555,4258] 0 2024-09-21T11:39:40.233 INFO:tasks.workunit.client.0.smithi118.stdout:4/847: mkdir d2/d6/dd/d35/d10d/d11d 0 2024-09-21T11:39:40.235 INFO:tasks.workunit.client.0.smithi118.stdout:4/848: write d2/d6/de/d1c/d23/d26/d74/ff0 [662073,106268] 0 2024-09-21T11:39:40.238 INFO:tasks.workunit.client.0.smithi118.stdout:4/849: creat d2/d6/de/f11e x:0 0 0 2024-09-21T11:39:40.239 INFO:tasks.workunit.client.0.smithi118.stdout:4/850: fdatasync d2/d6/dd/d35/f6c 0 2024-09-21T11:39:40.242 INFO:tasks.workunit.client.0.smithi118.stdout:4/851: rename d2/d6/de/d1c/d23/l25 to d2/d6/de/d1c/d4d/dba/l11f 0 2024-09-21T11:39:40.247 INFO:tasks.workunit.client.0.smithi118.stdout:4/852: dwrite d2/d6/de/d1c/d4d/d52/d69/fc4 [0,4194304] 0 2024-09-21T11:39:40.248 INFO:tasks.workunit.client.0.smithi118.stdout:4/853: write d2/d6/dd/d35/f6e [1967453,120178] 0 2024-09-21T11:39:40.253 INFO:tasks.workunit.client.0.smithi118.stdout:4/854: write d2/d6/de/d1c/d87/da9/da8/deb/f102 [140155,89043] 0 2024-09-21T11:39:40.264 INFO:tasks.workunit.client.0.smithi118.stdout:4/855: dwrite d2/d6/de/d1c/d4d/d52/d69/f84 [0,4194304] 0 2024-09-21T11:39:40.266 INFO:tasks.workunit.client.0.smithi118.stdout:4/856: fsync d2/d6/de/d1c/d23/f92 0 2024-09-21T11:39:40.268 INFO:tasks.workunit.client.0.smithi118.stdout:4/857: rmdir d2/d6/de/d1c/d4d/def 39 2024-09-21T11:39:40.273 INFO:tasks.workunit.client.0.smithi118.stdout:4/858: mkdir d2/d6/de/d1c/d23/d26/dd6/d5e/dfd/d120 0 2024-09-21T11:39:40.275 INFO:tasks.workunit.client.0.smithi118.stdout:4/859: truncate d2/d6/de/d1c/d23/d26/dd6/dcb/fe0 9135001 0 2024-09-21T11:39:40.280 INFO:tasks.workunit.client.0.smithi118.stdout:4/860: creat d2/d6/de/d1c/d87/da9/d97/f121 x:0 0 0 2024-09-21T11:39:40.286 INFO:tasks.workunit.client.0.smithi118.stdout:4/861: dwrite d2/d6/de/d1c/d87/da9/d97/d9b/fbb [0,4194304] 0 2024-09-21T11:39:40.290 INFO:tasks.workunit.client.0.smithi118.stdout:4/862: getdents d2/d65/d106 0 2024-09-21T11:39:40.291 INFO:tasks.workunit.client.0.smithi118.stdout:4/863: chown d2/d6/de/d1c/d4d/d52/f6a 136130556 1 2024-09-21T11:39:40.293 INFO:tasks.workunit.client.0.smithi118.stdout:4/864: chown d2/d6/de/d1c/d87/da9/c6f 24639023 1 2024-09-21T11:39:40.296 INFO:tasks.workunit.client.0.smithi118.stdout:4/865: mkdir d2/d6/de/d1c/d87/da9/d11a/d122 0 2024-09-21T11:39:40.297 INFO:tasks.workunit.client.0.smithi118.stdout:4/866: write d2/d6/dd/db3/f115 [986643,12967] 0 2024-09-21T11:39:40.302 INFO:tasks.workunit.client.0.smithi118.stdout:4/867: getdents d2/d6/de/d1c/d4d 0 2024-09-21T11:39:40.306 INFO:tasks.workunit.client.0.smithi118.stdout:4/868: rename d2/d6/de/d1c/d87/da9/c6f to d2/d6/de/d1c/d87/da9/da8/c123 0 2024-09-21T11:39:40.310 INFO:tasks.workunit.client.0.smithi118.stdout:4/869: truncate d2/d6/de/d1c/d23/f92 1099129 0 2024-09-21T11:39:40.313 INFO:tasks.workunit.client.0.smithi118.stdout:4/870: creat d2/d6/dd/d35/d10d/d11d/f124 x:0 0 0 2024-09-21T11:39:40.313 INFO:tasks.workunit.client.0.smithi118.stdout:4/871: readlink d2/lda 0 2024-09-21T11:39:40.324 INFO:tasks.workunit.client.0.smithi118.stdout:4/872: link d2/d6/de/d1c/d87/da9/da8/cd8 d2/d6/de/d1c/d23/d26/dd6/dcb/db0/dcd/c125 0 2024-09-21T11:39:40.328 INFO:tasks.workunit.client.0.smithi118.stdout:4/873: dread d2/fc [0,4194304] 0 2024-09-21T11:39:40.329 INFO:tasks.workunit.client.0.smithi118.stdout:4/874: dread d2/f8a [4194304,4194304] 0 2024-09-21T11:39:40.331 INFO:tasks.workunit.client.0.smithi118.stdout:4/875: read - d2/d6/de/d1c/d87/da9/d97/f121 zero size 2024-09-21T11:39:40.334 INFO:tasks.workunit.client.0.smithi118.stdout:4/876: symlink d2/da1/l126 0 2024-09-21T11:39:40.335 INFO:tasks.workunit.client.0.smithi118.stdout:5/734: sync 2024-09-21T11:39:40.335 INFO:tasks.workunit.client.0.smithi118.stdout:1/717: sync 2024-09-21T11:39:40.336 INFO:tasks.workunit.client.0.smithi118.stdout:4/877: write d2/d65/f10e [18183,62925] 0 2024-09-21T11:39:40.339 INFO:tasks.workunit.client.0.smithi118.stdout:1/718: mkdir d6/de/d16/ddd 0 2024-09-21T11:39:40.341 INFO:tasks.workunit.client.0.smithi118.stdout:1/719: write d6/d33/d3c/f68 [2858697,31040] 0 2024-09-21T11:39:40.344 INFO:tasks.workunit.client.0.smithi118.stdout:4/878: dwrite d2/d6/de/d1c/d23/d26/dd6/dcb/db0/dcd/fe2 [0,4194304] 0 2024-09-21T11:39:40.348 INFO:tasks.workunit.client.0.smithi118.stdout:1/720: creat d6/d3b/fde x:0 0 0 2024-09-21T11:39:40.349 INFO:tasks.workunit.client.0.smithi118.stdout:5/735: dwrite d0/db/d26/d65/f69 [0,4194304] 0 2024-09-21T11:39:40.352 INFO:tasks.workunit.client.0.smithi118.stdout:5/736: chown d0/db/d35/d30/d66 227099814 1 2024-09-21T11:39:40.352 INFO:tasks.workunit.client.0.smithi118.stdout:4/879: mknod d2/c127 0 2024-09-21T11:39:40.355 INFO:tasks.workunit.client.0.smithi118.stdout:5/737: mkdir d0/d89/dfa 0 2024-09-21T11:39:40.358 INFO:tasks.workunit.client.0.smithi118.stdout:4/880: symlink d2/d6/de/d1c/d23/d26/dd6/d5e/dfd/d120/l128 0 2024-09-21T11:39:40.359 INFO:tasks.workunit.client.0.smithi118.stdout:5/738: mknod d0/db/d26/cfb 0 2024-09-21T11:39:40.360 INFO:tasks.workunit.client.0.smithi118.stdout:1/721: write d6/d3b/f43 [2457278,123027] 0 2024-09-21T11:39:40.363 INFO:tasks.workunit.client.0.smithi118.stdout:4/881: creat d2/da1/f129 x:0 0 0 2024-09-21T11:39:40.363 INFO:tasks.workunit.client.0.smithi118.stdout:5/739: mkdir d0/db/d35/d30/d66/dfc 0 2024-09-21T11:39:40.366 INFO:tasks.workunit.client.0.smithi118.stdout:5/740: mkdir d0/d6c/d25/d50/dfd 0 2024-09-21T11:39:40.369 INFO:tasks.workunit.client.0.smithi118.stdout:1/722: getdents d6/de/d16/d3f 0 2024-09-21T11:39:40.370 INFO:tasks.workunit.client.0.smithi118.stdout:4/882: rename d2/da1 to d2/d6/d12a 0 2024-09-21T11:39:40.374 INFO:tasks.workunit.client.0.smithi118.stdout:4/883: mknod d2/d6/de/d1c/d87/da9/d97/de7/c12b 0 2024-09-21T11:39:40.375 INFO:tasks.workunit.client.0.smithi118.stdout:5/741: getdents d0/db 0 2024-09-21T11:39:40.377 INFO:tasks.workunit.client.0.smithi118.stdout:5/742: getdents d0/d6c/d25/d50/dfd 0 2024-09-21T11:39:40.379 INFO:tasks.workunit.client.0.smithi118.stdout:5/743: creat d0/d89/daa/ffe x:0 0 0 2024-09-21T11:39:40.436 INFO:tasks.workunit.client.0.smithi118.stdout:5/744: fsync d0/d63/fed 0 2024-09-21T11:39:40.440 INFO:tasks.workunit.client.0.smithi118.stdout:5/745: mknod d0/db/d35/d30/d1a/d8f/cff 0 2024-09-21T11:39:40.440 INFO:tasks.workunit.client.0.smithi118.stdout:4/884: dwrite d2/d6/de/d1c/d23/f92 [0,4194304] 0 2024-09-21T11:39:40.448 INFO:tasks.workunit.client.0.smithi118.stdout:4/885: creat d2/d65/f12c x:0 0 0 2024-09-21T11:39:40.536 INFO:tasks.workunit.client.0.smithi118.stdout:6/635: sync 2024-09-21T11:39:40.536 INFO:tasks.workunit.client.0.smithi118.stdout:9/746: sync 2024-09-21T11:39:40.536 INFO:tasks.workunit.client.0.smithi118.stdout:7/814: sync 2024-09-21T11:39:40.536 INFO:tasks.workunit.client.0.smithi118.stdout:3/703: sync 2024-09-21T11:39:40.538 INFO:tasks.workunit.client.0.smithi118.stdout:3/704: read - d5/d1d/d1b/d4c/d73/d9b/fda zero size 2024-09-21T11:39:40.538 INFO:tasks.workunit.client.0.smithi118.stdout:6/636: stat d8/d48/d5f/da3/lac 0 2024-09-21T11:39:40.540 INFO:tasks.workunit.client.0.smithi118.stdout:7/815: stat d0/d3/d1d/d35/d70/d10e/d110/d5f/d71/fdc 0 2024-09-21T11:39:40.545 INFO:tasks.workunit.client.0.smithi118.stdout:3/705: creat d5/d1d/d1b/da7/dc9/ff9 x:0 0 0 2024-09-21T11:39:40.545 INFO:tasks.workunit.client.0.smithi118.stdout:6/637: rmdir d8/d14/d3a 39 2024-09-21T11:39:40.552 INFO:tasks.workunit.client.0.smithi118.stdout:9/747: dread d0/d20/f64 [0,4194304] 0 2024-09-21T11:39:40.554 INFO:tasks.workunit.client.0.smithi118.stdout:6/638: rename d8/d48/d45/d61 to d8/d46/d53/dbf/dcb 0 2024-09-21T11:39:40.561 INFO:tasks.workunit.client.0.smithi118.stdout:6/639: unlink d8/d14/d44/c89 0 2024-09-21T11:39:40.562 INFO:tasks.workunit.client.0.smithi118.stdout:9/748: mkdir d0/d20/d4c/d5f/d6c/d88/d10d 0 2024-09-21T11:39:40.565 INFO:tasks.workunit.client.0.smithi118.stdout:3/706: link d5/d1d/d1b/d4c/d73/d9b/f92 d5/d1d/d1b/d50/dc6/ffa 0 2024-09-21T11:39:40.568 INFO:tasks.workunit.client.0.smithi118.stdout:6/640: dwrite d8/d14/dba/faa [4194304,4194304] 0 2024-09-21T11:39:40.572 INFO:tasks.workunit.client.0.smithi118.stdout:6/641: read d8/fc [4732870,6591] 0 2024-09-21T11:39:40.573 INFO:tasks.workunit.client.0.smithi118.stdout:3/707: rename d5/d28/d3e/f8f to d5/d1d/d1b/d4c/d73/dc4/ded/ffb 0 2024-09-21T11:39:40.577 INFO:tasks.workunit.client.0.smithi118.stdout:6/642: unlink d8/d46/d53/dbf/dcb/d70/cc6 0 2024-09-21T11:39:40.578 INFO:tasks.workunit.client.0.smithi118.stdout:3/708: mknod d5/d28/d33/d4a/dc8/cfc 0 2024-09-21T11:39:40.583 INFO:tasks.workunit.client.0.smithi118.stdout:7/816: truncate d0/d3/d1d/d35/d70/f80 7671530 0 2024-09-21T11:39:40.588 INFO:tasks.workunit.client.0.smithi118.stdout:7/817: getdents d0/d3/d14 0 2024-09-21T11:39:40.593 INFO:tasks.workunit.client.0.smithi118.stdout:9/749: dwrite d0/d4/d38/db8/fef [0,4194304] 0 2024-09-21T11:39:40.597 INFO:tasks.workunit.client.0.smithi118.stdout:7/818: dread d0/d3/d1d/d35/d57/d7e/d82/fa3 [0,4194304] 0 2024-09-21T11:39:40.598 INFO:tasks.workunit.client.0.smithi118.stdout:6/643: dread d8/f25 [0,4194304] 0 2024-09-21T11:39:40.599 INFO:tasks.workunit.client.0.smithi118.stdout:9/750: truncate d0/d4/d38/db8/de9/ff1 242831 0 2024-09-21T11:39:40.599 INFO:tasks.workunit.client.0.smithi118.stdout:7/819: write d0/d3/d14/d41/d66/dcf/ff2 [626216,11529] 0 2024-09-21T11:39:40.602 INFO:tasks.workunit.client.0.smithi118.stdout:3/709: dread d5/d28/f3b [0,4194304] 0 2024-09-21T11:39:40.602 INFO:tasks.workunit.client.0.smithi118.stdout:9/751: symlink d0/d20/d4c/d5f/d89/l10e 0 2024-09-21T11:39:40.603 INFO:tasks.workunit.client.0.smithi118.stdout:9/752: chown d0/f5 461472 1 2024-09-21T11:39:40.603 INFO:tasks.workunit.client.0.smithi118.stdout:6/644: mkdir d8/d14/dc4/dcc 0 2024-09-21T11:39:40.605 INFO:tasks.workunit.client.0.smithi118.stdout:9/753: read d0/d20/d71/f95 [1505846,103039] 0 2024-09-21T11:39:40.605 INFO:tasks.workunit.client.0.smithi118.stdout:6/645: truncate d8/d48/d6c/d64/fa0 206489 0 2024-09-21T11:39:40.605 INFO:tasks.workunit.client.0.smithi118.stdout:7/820: creat d0/d3/d14/d41/d66/d6d/f112 x:0 0 0 2024-09-21T11:39:40.610 INFO:tasks.workunit.client.0.smithi118.stdout:9/754: readlink d0/d4/d38/ldf 0 2024-09-21T11:39:40.610 INFO:tasks.workunit.client.0.smithi118.stdout:7/821: readlink d0/d3/d14/l90 0 2024-09-21T11:39:40.610 INFO:tasks.workunit.client.0.smithi118.stdout:9/755: chown d0/d20/d4c/c61 104623 1 2024-09-21T11:39:40.610 INFO:tasks.workunit.client.0.smithi118.stdout:3/710: rename d5/d1d/d1b/da7 to d5/d28/d3e/d5d/dfd 0 2024-09-21T11:39:40.610 INFO:tasks.workunit.client.0.smithi118.stdout:6/646: symlink d8/d46/d53/db5/lcd 0 2024-09-21T11:39:40.611 INFO:tasks.workunit.client.0.smithi118.stdout:3/711: chown d5/d1d/d1b/d4c/d73/fb5 3555 1 2024-09-21T11:39:40.611 INFO:tasks.workunit.client.0.smithi118.stdout:3/712: chown d5/d1d/d1b/d24/dcd/fb3 126321374 1 2024-09-21T11:39:40.613 INFO:tasks.workunit.client.0.smithi118.stdout:9/756: rmdir d0/de2 39 2024-09-21T11:39:40.616 INFO:tasks.workunit.client.0.smithi118.stdout:6/647: creat d8/d48/d5f/fce x:0 0 0 2024-09-21T11:39:40.617 INFO:tasks.workunit.client.0.smithi118.stdout:6/648: truncate d8/d48/d6c/d64/f98 4529449 0 2024-09-21T11:39:40.617 INFO:tasks.workunit.client.0.smithi118.stdout:6/649: stat d8/d48/l42 0 2024-09-21T11:39:40.618 INFO:tasks.workunit.client.0.smithi118.stdout:3/713: fdatasync d5/d28/d3e/d5d/d5f/f98 0 2024-09-21T11:39:40.619 INFO:tasks.workunit.client.0.smithi118.stdout:3/714: write d5/d1d/d1b/d50/dc6/ff0 [1058827,40478] 0 2024-09-21T11:39:40.620 INFO:tasks.workunit.client.0.smithi118.stdout:9/757: fsync d0/d20/f64 0 2024-09-21T11:39:40.628 INFO:tasks.workunit.client.0.smithi118.stdout:7/822: dwrite d0/d3/d14/f28 [0,4194304] 0 2024-09-21T11:39:40.630 INFO:tasks.workunit.client.0.smithi118.stdout:6/650: dread d8/d48/d5f/fb1 [0,4194304] 0 2024-09-21T11:39:40.632 INFO:tasks.workunit.client.0.smithi118.stdout:6/651: stat d8/l3b 0 2024-09-21T11:39:40.633 INFO:tasks.workunit.client.0.smithi118.stdout:7/823: dread d0/d3/d14/f28 [0,4194304] 0 2024-09-21T11:39:40.635 INFO:tasks.workunit.client.0.smithi118.stdout:9/758: rename d0/d20/d4c/d5f/d6c/d88/db9 to d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f 0 2024-09-21T11:39:40.641 INFO:tasks.workunit.client.0.smithi118.stdout:6/652: unlink d8/d46/d53/dbf/dcb/d66/c76 0 2024-09-21T11:39:40.649 INFO:tasks.workunit.client.0.smithi118.stdout:3/715: rmdir d5/d28/d33/dec 0 2024-09-21T11:39:40.650 INFO:tasks.workunit.client.0.smithi118.stdout:3/716: write d5/d28/d3e/fe5 [874005,6846] 0 2024-09-21T11:39:40.654 INFO:tasks.workunit.client.0.smithi118.stdout:6/653: dwrite d8/d48/d6c/d64/f98 [0,4194304] 0 2024-09-21T11:39:40.661 INFO:tasks.workunit.client.0.smithi118.stdout:7/824: dwrite d0/d3/d1d/d35/d70/fd4 [0,4194304] 0 2024-09-21T11:39:40.662 INFO:tasks.workunit.client.0.smithi118.stdout:9/759: link d0/fc d0/d4/d45/d72/de4/df4/f110 0 2024-09-21T11:39:40.665 INFO:tasks.workunit.client.0.smithi118.stdout:3/717: creat d5/d1d/d1b/ffe x:0 0 0 2024-09-21T11:39:40.666 INFO:tasks.workunit.client.0.smithi118.stdout:9/760: truncate d0/d20/d4c/d5f/d6c/dd0/f107 975920 0 2024-09-21T11:39:40.667 INFO:tasks.workunit.client.0.smithi118.stdout:7/825: dread d0/d3/d14/d41/d66/dcf/ff2 [0,4194304] 0 2024-09-21T11:39:40.670 INFO:tasks.workunit.client.0.smithi118.stdout:6/654: getdents d8/d46 0 2024-09-21T11:39:40.671 INFO:tasks.workunit.client.0.smithi118.stdout:3/718: read d5/d1d/d1b/d4c/f56 [680406,85366] 0 2024-09-21T11:39:40.674 INFO:tasks.workunit.client.0.smithi118.stdout:7/826: fdatasync d0/d3/d1d/d35/f5a 0 2024-09-21T11:39:40.680 INFO:tasks.workunit.client.0.smithi118.stdout:7/827: mkdir d0/d3/d1d/d35/d70/d10e/d110/d113 0 2024-09-21T11:39:40.683 INFO:tasks.workunit.client.0.smithi118.stdout:6/655: dread d8/d14/f1d [0,4194304] 0 2024-09-21T11:39:40.685 INFO:tasks.workunit.client.0.smithi118.stdout:6/656: write d8/d46/f81 [3196691,19575] 0 2024-09-21T11:39:40.687 INFO:tasks.workunit.client.0.smithi118.stdout:7/828: link d0/d3/d1d/d35/d57/f91 d0/d3/d14/d41/d66/d6d/f114 0 2024-09-21T11:39:40.689 INFO:tasks.workunit.client.0.smithi118.stdout:9/761: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/fab [0,4194304] 0 2024-09-21T11:39:40.691 INFO:tasks.workunit.client.0.smithi118.stdout:6/657: unlink d8/d48/d5f/f7c 0 2024-09-21T11:39:40.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:40 smithi149 ceph-mon[36123]: pgmap v35: 65 pgs: 65 active+clean; 2.9 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 35 MiB/s rd, 89 MiB/s wr, 257 op/s 2024-09-21T11:39:40.696 INFO:tasks.workunit.client.0.smithi118.stdout:3/719: dwrite d5/d1d/d1b/d24/f38 [0,4194304] 0 2024-09-21T11:39:40.699 INFO:tasks.workunit.client.0.smithi118.stdout:7/829: dwrite d0/d3/f63 [0,4194304] 0 2024-09-21T11:39:40.704 INFO:tasks.workunit.client.0.smithi118.stdout:9/762: mkdir d0/d20/d4c/d5f/d6c/d88/d10d/d111 0 2024-09-21T11:39:40.706 INFO:tasks.workunit.client.0.smithi118.stdout:3/720: symlink d5/d1d/d1b/d4c/d91/d69/lff 0 2024-09-21T11:39:40.707 INFO:tasks.workunit.client.0.smithi118.stdout:3/721: stat d5/d1d/d1b/d4c/f7d 0 2024-09-21T11:39:40.707 INFO:tasks.workunit.client.0.smithi118.stdout:3/722: fsync d5/d28/d33/fe8 0 2024-09-21T11:39:40.709 INFO:tasks.workunit.client.0.smithi118.stdout:7/830: truncate d0/d3/d1d/d35/d57/d7e/d82/fcb 1339077 0 2024-09-21T11:39:40.710 INFO:tasks.workunit.client.0.smithi118.stdout:6/658: write d8/f15 [505366,41093] 0 2024-09-21T11:39:40.712 INFO:tasks.workunit.client.0.smithi118.stdout:3/723: fdatasync d5/d1d/d1b/d24/f2c 0 2024-09-21T11:39:40.713 INFO:tasks.workunit.client.0.smithi118.stdout:9/763: unlink d0/d4/d45/da5/lcf 0 2024-09-21T11:39:40.714 INFO:tasks.workunit.client.0.smithi118.stdout:9/764: chown d0/d20/d4c/d5f/d6c/d88/f5e 434 1 2024-09-21T11:39:40.715 INFO:tasks.workunit.client.0.smithi118.stdout:6/659: unlink d8/d46/f52 0 2024-09-21T11:39:40.717 INFO:tasks.workunit.client.0.smithi118.stdout:7/831: creat d0/d3/d1d/d35/d57/d96/f115 x:0 0 0 2024-09-21T11:39:40.722 INFO:tasks.workunit.client.0.smithi118.stdout:9/765: symlink d0/d4/d45/d72/l112 0 2024-09-21T11:39:40.723 INFO:tasks.workunit.client.0.smithi118.stdout:6/660: symlink d8/d46/d53/lcf 0 2024-09-21T11:39:40.723 INFO:tasks.workunit.client.0.smithi118.stdout:9/766: write d0/f26 [7474887,44129] 0 2024-09-21T11:39:40.724 INFO:tasks.workunit.client.0.smithi118.stdout:9/767: chown d0/d20/c77 3042 1 2024-09-21T11:39:40.733 INFO:tasks.workunit.client.0.smithi118.stdout:3/724: link d5/d28/f65 d5/d28/d3e/daa/f100 0 2024-09-21T11:39:40.736 INFO:tasks.workunit.client.0.smithi118.stdout:9/768: rename d0/d4/d45/d72 to d0/d113 0 2024-09-21T11:39:40.737 INFO:tasks.workunit.client.0.smithi118.stdout:9/769: readlink d0/d20/l43 0 2024-09-21T11:39:40.737 INFO:tasks.workunit.client.0.smithi118.stdout:3/725: unlink d5/d1d/d1b/d4c/d91/lc5 0 2024-09-21T11:39:40.738 INFO:tasks.workunit.client.0.smithi118.stdout:7/832: dwrite d0/d3/d14/d41/d66/d6d/fd6 [0,4194304] 0 2024-09-21T11:39:40.740 INFO:tasks.workunit.client.0.smithi118.stdout:6/661: dwrite d8/d48/d5f/f73 [0,4194304] 0 2024-09-21T11:39:40.741 INFO:tasks.workunit.client.0.smithi118.stdout:6/662: fdatasync d8/d46/fa9 0 2024-09-21T11:39:40.742 INFO:tasks.workunit.client.0.smithi118.stdout:7/833: creat d0/d3/d1d/f116 x:0 0 0 2024-09-21T11:39:40.746 INFO:tasks.workunit.client.0.smithi118.stdout:9/770: creat d0/de2/f114 x:0 0 0 2024-09-21T11:39:40.747 INFO:tasks.workunit.client.0.smithi118.stdout:9/771: readlink d0/d4/l6 0 2024-09-21T11:39:40.755 INFO:tasks.workunit.client.0.smithi118.stdout:9/772: mkdir d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/db2/d115 0 2024-09-21T11:39:40.758 INFO:tasks.workunit.client.0.smithi118.stdout:7/834: rename d0/d3/d14/d41/d66/d6d/f112 to d0/d3/d1d/d35/d70/d10e/d110/f117 0 2024-09-21T11:39:40.758 INFO:tasks.workunit.client.0.smithi118.stdout:9/773: rmdir d0/d20/d71 39 2024-09-21T11:39:40.759 INFO:tasks.workunit.client.0.smithi118.stdout:2/756: sync 2024-09-21T11:39:40.760 INFO:tasks.workunit.client.0.smithi118.stdout:0/986: sync 2024-09-21T11:39:40.760 INFO:tasks.workunit.client.0.smithi118.stdout:3/726: dwrite d5/d28/f3b [0,4194304] 0 2024-09-21T11:39:40.760 INFO:tasks.workunit.client.0.smithi118.stdout:9/774: chown d0/d4/d45/cb6 21977484 1 2024-09-21T11:39:40.761 INFO:tasks.workunit.client.0.smithi118.stdout:7/835: creat d0/d3/d1d/f118 x:0 0 0 2024-09-21T11:39:40.761 INFO:tasks.workunit.client.0.smithi118.stdout:3/727: write d5/d1d/d1b/d24/f38 [2622243,80720] 0 2024-09-21T11:39:40.767 INFO:tasks.workunit.client.0.smithi118.stdout:6/663: write d8/d48/d5f/da3/fa7 [203077,130528] 0 2024-09-21T11:39:40.769 INFO:tasks.workunit.client.0.smithi118.stdout:6/664: truncate d8/d48/d6c/fc3 55596 0 2024-09-21T11:39:40.771 INFO:tasks.workunit.client.0.smithi118.stdout:9/775: link d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/fde d0/d4/d45/da5/f116 0 2024-09-21T11:39:40.777 INFO:tasks.workunit.client.0.smithi118.stdout:2/757: getdents de/d53/dc2 0 2024-09-21T11:39:40.781 INFO:tasks.workunit.client.0.smithi118.stdout:7/836: mkdir d0/d3/d1d/d35/d70/d10e/d110/d119 0 2024-09-21T11:39:40.781 INFO:tasks.workunit.client.0.smithi118.stdout:3/728: dwrite d5/d28/d33/fab [0,4194304] 0 2024-09-21T11:39:40.782 INFO:tasks.workunit.client.0.smithi118.stdout:7/837: read d0/d3/d13/f2f [8456424,45440] 0 2024-09-21T11:39:40.783 INFO:tasks.workunit.client.0.smithi118.stdout:9/776: mknod d0/d4/d38/df6/c117 0 2024-09-21T11:39:40.785 INFO:tasks.workunit.client.0.smithi118.stdout:0/987: getdents d5/d10/d1e/d3d/d93 0 2024-09-21T11:39:40.785 INFO:tasks.workunit.client.0.smithi118.stdout:4/886: sync 2024-09-21T11:39:40.785 INFO:tasks.workunit.client.0.smithi118.stdout:5/746: sync 2024-09-21T11:39:40.785 INFO:tasks.workunit.client.0.smithi118.stdout:1/723: sync 2024-09-21T11:39:40.787 INFO:tasks.workunit.client.0.smithi118.stdout:6/665: write d8/f22 [3129937,84445] 0 2024-09-21T11:39:40.789 INFO:tasks.workunit.client.0.smithi118.stdout:2/758: rename de/d50/d85/cb6 to de/d16/d31/dce/d4f/c102 0 2024-09-21T11:39:40.790 INFO:tasks.workunit.client.0.smithi118.stdout:2/759: write de/d1f/d20/d67/d8a/d6d/d70/f91 [3486188,107189] 0 2024-09-21T11:39:40.790 INFO:tasks.workunit.client.0.smithi118.stdout:3/729: symlink d5/d28/d3e/d5d/d8d/l101 0 2024-09-21T11:39:40.793 INFO:tasks.workunit.client.0.smithi118.stdout:7/838: creat d0/d3/d1d/d35/f11a x:0 0 0 2024-09-21T11:39:40.794 INFO:tasks.workunit.client.0.smithi118.stdout:1/724: dread - d6/d2a/fac zero size 2024-09-21T11:39:40.795 INFO:tasks.workunit.client.0.smithi118.stdout:1/725: chown d6/d33/f70 7634935 1 2024-09-21T11:39:40.796 INFO:tasks.workunit.client.0.smithi118.stdout:5/747: mkdir d0/db/d35/d30/d66/d100 0 2024-09-21T11:39:40.796 INFO:tasks.workunit.client.0.smithi118.stdout:6/666: symlink d8/d48/d5f/ld0 0 2024-09-21T11:39:40.798 INFO:tasks.workunit.client.0.smithi118.stdout:2/760: mkdir de/d16/d31/dce/d65/da2/d103 0 2024-09-21T11:39:40.798 INFO:tasks.workunit.client.0.smithi118.stdout:5/748: read d0/d6c/d25/d50/f55 [522400,105865] 0 2024-09-21T11:39:40.800 INFO:tasks.workunit.client.0.smithi118.stdout:7/839: creat d0/d3/d14/d41/d7f/f11b x:0 0 0 2024-09-21T11:39:40.802 INFO:tasks.workunit.client.0.smithi118.stdout:7/840: chown d0/d3/d1d/d35/d57/d7e/f97 142255 1 2024-09-21T11:39:40.802 INFO:tasks.workunit.client.0.smithi118.stdout:6/667: unlink d8/d48/d72/d7e/l90 0 2024-09-21T11:39:40.803 INFO:tasks.workunit.client.0.smithi118.stdout:7/841: rename d0/d3/d1d/d35/d57/d7e to d0/d3/d1d/d35/d57/d7e/d82/d11c 22 2024-09-21T11:39:40.804 INFO:tasks.workunit.client.0.smithi118.stdout:9/777: link d0/d4/d38/db8/fef d0/d20/d4c/d5f/f118 0 2024-09-21T11:39:40.816 INFO:tasks.workunit.client.0.smithi118.stdout:9/778: mkdir d0/d4/d38/df6/d119 0 2024-09-21T11:39:40.816 INFO:tasks.workunit.client.0.smithi118.stdout:0/988: dwrite d5/d10/d1e/d20/f11b [0,4194304] 0 2024-09-21T11:39:40.821 INFO:tasks.workunit.client.0.smithi118.stdout:5/749: mkdir d0/db/d35/d30/d101 0 2024-09-21T11:39:40.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:40 smithi118 ceph-mon[28757]: pgmap v35: 65 pgs: 65 active+clean; 2.9 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 35 MiB/s rd, 89 MiB/s wr, 257 op/s 2024-09-21T11:39:40.825 INFO:tasks.workunit.client.0.smithi118.stdout:3/730: getdents d5/d28/d33/d4a/dc8 0 2024-09-21T11:39:40.827 INFO:tasks.workunit.client.0.smithi118.stdout:1/726: dwrite d6/d2a/dc2/fcd [0,4194304] 0 2024-09-21T11:39:40.833 INFO:tasks.workunit.client.0.smithi118.stdout:9/779: write d0/d20/d4c/d5f/d6c/dd0/f107 [1311545,16976] 0 2024-09-21T11:39:40.833 INFO:tasks.workunit.client.0.smithi118.stdout:7/842: write d0/f16 [6387674,5586] 0 2024-09-21T11:39:40.837 INFO:tasks.workunit.client.0.smithi118.stdout:7/843: dread - d0/d3/fea zero size 2024-09-21T11:39:40.839 INFO:tasks.workunit.client.0.smithi118.stdout:6/668: dwrite d8/fa [0,4194304] 0 2024-09-21T11:39:40.841 INFO:tasks.workunit.client.0.smithi118.stdout:5/750: dread d0/d89/daa/fce [0,4194304] 0 2024-09-21T11:39:40.841 INFO:tasks.workunit.client.0.smithi118.stdout:2/761: link de/d16/d31/f3d de/d16/d31/dce/f104 0 2024-09-21T11:39:40.843 INFO:tasks.workunit.client.0.smithi118.stdout:6/669: dread - d8/d14/d33/d92/fc0 zero size 2024-09-21T11:39:40.845 INFO:tasks.workunit.client.0.smithi118.stdout:9/780: dread d0/d113/f94 [0,4194304] 0 2024-09-21T11:39:40.845 INFO:tasks.workunit.client.0.smithi118.stdout:1/727: mknod d6/d2a/d3d/cdf 0 2024-09-21T11:39:40.846 INFO:tasks.workunit.client.0.smithi118.stdout:2/762: symlink de/d16/d31/dce/d66/d9a/l105 0 2024-09-21T11:39:40.852 INFO:tasks.workunit.client.0.smithi118.stdout:7/844: truncate d0/d3/d14/d41/d8b/da4/db2/fd7 414558 0 2024-09-21T11:39:40.853 INFO:tasks.workunit.client.0.smithi118.stdout:7/845: stat d0/d3/d14/d41/fbf 0 2024-09-21T11:39:40.859 INFO:tasks.workunit.client.0.smithi118.stdout:6/670: unlink d8/c2e 0 2024-09-21T11:39:40.860 INFO:tasks.workunit.client.0.smithi118.stdout:6/671: chown d8/d46/d53/dbf/dcb/d66/fad 0 1 2024-09-21T11:39:40.860 INFO:tasks.workunit.client.0.smithi118.stdout:6/672: chown d8/f4b 344184998 1 2024-09-21T11:39:40.863 INFO:tasks.workunit.client.0.smithi118.stdout:3/731: creat d5/d1d/d1b/d4c/d91/f102 x:0 0 0 2024-09-21T11:39:40.863 INFO:tasks.workunit.client.0.smithi118.stdout:0/989: dread d5/d10/d1e/f4c [0,4194304] 0 2024-09-21T11:39:40.864 INFO:tasks.workunit.client.0.smithi118.stdout:0/990: write d5/d34/d44/d87/d129/f142 [654068,119823] 0 2024-09-21T11:39:40.866 INFO:tasks.workunit.client.0.smithi118.stdout:7/846: rmdir d0/d3/d1d/d35/d70/d10e 39 2024-09-21T11:39:40.870 INFO:tasks.workunit.client.0.smithi118.stdout:1/728: rename d6/de/d16/d3f/d50/d54/c2d to d6/d2a/d3d/db9/ce0 0 2024-09-21T11:39:40.871 INFO:tasks.workunit.client.0.smithi118.stdout:2/763: creat de/d1f/d20/d67/d99/f106 x:0 0 0 2024-09-21T11:39:40.874 INFO:tasks.workunit.client.0.smithi118.stdout:9/781: dwrite d0/d20/d4c/d5f/d66/fcc [0,4194304] 0 2024-09-21T11:39:40.875 INFO:tasks.workunit.client.0.smithi118.stdout:0/991: read d5/d10/d1e/d23/d3a/d4e/dcb/ff2 [747121,45053] 0 2024-09-21T11:39:40.877 INFO:tasks.workunit.client.0.smithi118.stdout:5/751: getdents d0/db/d35/def/d92/dc8 0 2024-09-21T11:39:40.881 INFO:tasks.workunit.client.0.smithi118.stdout:9/782: fdatasync d0/d4/f27 0 2024-09-21T11:39:40.885 INFO:tasks.workunit.client.0.smithi118.stdout:6/673: write d8/d14/d33/f55 [735660,101544] 0 2024-09-21T11:39:40.885 INFO:tasks.workunit.client.0.smithi118.stdout:3/732: write d5/d28/d3e/d5d/d5f/f8b [606613,105597] 0 2024-09-21T11:39:40.888 INFO:tasks.workunit.client.0.smithi118.stdout:6/674: truncate d8/d48/d5f/d6b/fc9 371322 0 2024-09-21T11:39:40.888 INFO:tasks.workunit.client.0.smithi118.stdout:0/992: truncate d5/d34/d44/d87/de7/fee 754877 0 2024-09-21T11:39:40.888 INFO:tasks.workunit.client.0.smithi118.stdout:3/733: dread - d5/d28/d3e/d5d/d5f/fb2 zero size 2024-09-21T11:39:40.890 INFO:tasks.workunit.client.0.smithi118.stdout:9/783: rmdir d0 39 2024-09-21T11:39:40.890 INFO:tasks.workunit.client.0.smithi118.stdout:1/729: dread d6/de/d16/d3f/d50/d54/d32/f48 [0,4194304] 0 2024-09-21T11:39:40.891 INFO:tasks.workunit.client.0.smithi118.stdout:0/993: read d5/d10/d1e/d20/dc7/f126 [3860965,28209] 0 2024-09-21T11:39:40.891 INFO:tasks.workunit.client.0.smithi118.stdout:0/994: stat d5/d10/d1e/f6e 0 2024-09-21T11:39:40.892 INFO:tasks.workunit.client.0.smithi118.stdout:6/675: dread - d8/d14/d33/fa6 zero size 2024-09-21T11:39:40.895 INFO:tasks.workunit.client.0.smithi118.stdout:2/764: write de/d1f/d20/f27 [1353550,63136] 0 2024-09-21T11:39:40.895 INFO:tasks.workunit.client.0.smithi118.stdout:3/734: rmdir d5/d28/d3e/d5d/d5f/d88 39 2024-09-21T11:39:40.897 INFO:tasks.workunit.client.0.smithi118.stdout:5/752: write d0/db/d35/def/d92/f9c [909806,7173] 0 2024-09-21T11:39:40.900 INFO:tasks.workunit.client.0.smithi118.stdout:6/676: creat d8/d14/dc4/fd1 x:0 0 0 2024-09-21T11:39:40.904 INFO:tasks.workunit.client.0.smithi118.stdout:1/730: getdents d6/de/d16/ddd 0 2024-09-21T11:39:40.904 INFO:tasks.workunit.client.0.smithi118.stdout:1/731: truncate d6/d3b/fde 977310 0 2024-09-21T11:39:40.911 INFO:tasks.workunit.client.0.smithi118.stdout:3/735: mknod d5/d1d/d1b/d24/dcd/dc1/c103 0 2024-09-21T11:39:40.913 INFO:tasks.workunit.client.0.smithi118.stdout:1/732: fsync d6/de/d16/d3f/f4d 0 2024-09-21T11:39:40.915 INFO:tasks.workunit.client.0.smithi118.stdout:9/784: write d0/d20/d71/f95 [370332,125061] 0 2024-09-21T11:39:40.917 INFO:tasks.workunit.client.0.smithi118.stdout:2/765: dread de/f14 [4194304,4194304] 0 2024-09-21T11:39:40.918 INFO:tasks.workunit.client.0.smithi118.stdout:6/677: dread d8/f4b [0,4194304] 0 2024-09-21T11:39:40.919 INFO:tasks.workunit.client.0.smithi118.stdout:0/995: getdents d5/d29/d68/d7b/db7/d48 0 2024-09-21T11:39:40.919 INFO:tasks.workunit.client.0.smithi118.stdout:2/766: truncate de/d50/f81 1373703 0 2024-09-21T11:39:40.921 INFO:tasks.workunit.client.0.smithi118.stdout:5/753: truncate d0/db/d35/da/f4e 2463003 0 2024-09-21T11:39:40.922 INFO:tasks.workunit.client.0.smithi118.stdout:5/754: fdatasync d0/d89/daa/fb4 0 2024-09-21T11:39:40.922 INFO:tasks.workunit.client.0.smithi118.stdout:3/736: mkdir d5/d1d/d1b/d4c/d104 0 2024-09-21T11:39:40.923 INFO:tasks.workunit.client.0.smithi118.stdout:3/737: fsync d5/d28/f3b 0 2024-09-21T11:39:40.923 INFO:tasks.workunit.client.0.smithi118.stdout:6/678: mkdir d8/d46/dd2 0 2024-09-21T11:39:40.925 INFO:tasks.workunit.client.0.smithi118.stdout:2/767: fsync de/d1f/d20/d67/d8a/d6d/d70/f90 0 2024-09-21T11:39:40.926 INFO:tasks.workunit.client.0.smithi118.stdout:0/996: rename d5/d34 to d5/d10/d1e/d23/d3a/d4e/dfd/d113/d147 0 2024-09-21T11:39:40.930 INFO:tasks.workunit.client.0.smithi118.stdout:9/785: mkdir d0/d11a 0 2024-09-21T11:39:40.932 INFO:tasks.workunit.client.0.smithi118.stdout:5/755: truncate d0/db/d35/def/f81 4890193 0 2024-09-21T11:39:40.937 INFO:tasks.workunit.client.0.smithi118.stdout:2/768: creat de/d22/d3c/f107 x:0 0 0 2024-09-21T11:39:40.939 INFO:tasks.workunit.client.0.smithi118.stdout:9/786: unlink d0/d4/d38/f46 0 2024-09-21T11:39:40.939 INFO:tasks.workunit.client.0.smithi118.stdout:2/769: truncate de/d16/d31/dce/d66/d9a/fa3 993284 0 2024-09-21T11:39:40.941 INFO:tasks.workunit.client.0.smithi118.stdout:5/756: unlink d0/db/d35/d30/d1a/db3/ld8 0 2024-09-21T11:39:40.946 INFO:tasks.workunit.client.0.smithi118.stdout:1/733: getdents d6/d2a 0 2024-09-21T11:39:40.947 INFO:tasks.workunit.client.0.smithi118.stdout:9/787: fdatasync d0/d4/f27 0 2024-09-21T11:39:40.948 INFO:tasks.workunit.client.0.smithi118.stdout:2/770: creat de/d16/d25/dba/db5/f108 x:0 0 0 2024-09-21T11:39:40.955 INFO:tasks.workunit.client.0.smithi118.stdout:0/997: rename d5/d10/d1e/d23/d3a/d4e/dfd/d113/d147/f65 to d5/d29/f148 0 2024-09-21T11:39:40.958 INFO:tasks.workunit.client.0.smithi118.stdout:1/734: rmdir d6 39 2024-09-21T11:39:40.965 INFO:tasks.workunit.client.0.smithi118.stdout:9/788: dread d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/f92 [0,4194304] 0 2024-09-21T11:39:40.967 INFO:tasks.workunit.client.0.smithi118.stdout:3/738: link d5/f17 d5/d1d/d1b/f105 0 2024-09-21T11:39:40.970 INFO:tasks.workunit.client.0.smithi118.stdout:6/679: link d8/d14/c4e d8/cd3 0 2024-09-21T11:39:40.973 INFO:tasks.workunit.client.0.smithi118.stdout:0/998: symlink d5/d29/d68/d7b/db7/d48/l149 0 2024-09-21T11:39:40.975 INFO:tasks.workunit.client.0.smithi118.stdout:9/789: dread d0/fa1 [0,4194304] 0 2024-09-21T11:39:40.978 INFO:tasks.workunit.client.0.smithi118.stdout:5/757: creat d0/f102 x:0 0 0 2024-09-21T11:39:40.979 INFO:tasks.workunit.client.0.smithi118.stdout:5/758: chown d0/db/d35/da/l7a 60295465 1 2024-09-21T11:39:40.979 INFO:tasks.workunit.client.0.smithi118.stdout:6/680: mknod d8/d14/d33/cd4 0 2024-09-21T11:39:40.990 INFO:tasks.workunit.client.0.smithi118.stdout:0/999: rename d5/d29/d68/d7b/db7/f4a to d5/d81/f14a 0 2024-09-21T11:39:40.991 INFO:tasks.workunit.client.0.smithi118.stdout:5/759: dwrite d0/f1b [0,4194304] 0 2024-09-21T11:39:40.994 INFO:tasks.workunit.client.0.smithi118.stdout:9/790: creat d0/d20/d4c/d5f/d6c/d88/d4d/dc2/f11b x:0 0 0 2024-09-21T11:39:40.995 INFO:tasks.workunit.client.0.smithi118.stdout:2/771: truncate de/d16/f32 3025244 0 2024-09-21T11:39:40.998 INFO:tasks.workunit.client.0.smithi118.stdout:2/772: symlink de/d1f/d20/d67/d8a/l109 0 2024-09-21T11:39:40.999 INFO:tasks.workunit.client.0.smithi118.stdout:9/791: truncate d0/d4/d38/db8/fe1 526686 0 2024-09-21T11:39:41.002 INFO:tasks.workunit.client.0.smithi118.stdout:1/735: truncate d6/d2a/dc2/d9e/fb4 28666 0 2024-09-21T11:39:41.004 INFO:tasks.workunit.client.0.smithi118.stdout:3/739: dwrite d5/d1d/d1b/d24/dcd/f95 [0,4194304] 0 2024-09-21T11:39:41.007 INFO:tasks.workunit.client.0.smithi118.stdout:6/681: dwrite d8/d14/f8e [0,4194304] 0 2024-09-21T11:39:41.014 INFO:tasks.workunit.client.0.smithi118.stdout:6/682: write d8/d48/d5f/f73 [4685768,2486] 0 2024-09-21T11:39:41.017 INFO:tasks.workunit.client.0.smithi118.stdout:9/792: creat d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/f11c x:0 0 0 2024-09-21T11:39:41.018 INFO:tasks.workunit.client.0.smithi118.stdout:9/793: readlink d0/d20/d71/lb3 0 2024-09-21T11:39:41.018 INFO:tasks.workunit.client.0.smithi118.stdout:5/760: dwrite d0/d63/f9b [0,4194304] 0 2024-09-21T11:39:41.028 INFO:tasks.workunit.client.0.smithi118.stdout:5/761: dwrite d0/db/d26/d65/fe0 [0,4194304] 0 2024-09-21T11:39:41.032 INFO:tasks.workunit.client.0.smithi118.stdout:5/762: write d0/db/d35/d95/f98 [1143753,82749] 0 2024-09-21T11:39:41.034 INFO:tasks.workunit.client.0.smithi118.stdout:9/794: creat d0/d4/d45/da5/f11d x:0 0 0 2024-09-21T11:39:41.036 INFO:tasks.workunit.client.0.smithi118.stdout:5/763: dread - d0/db/d35/fda zero size 2024-09-21T11:39:41.038 INFO:tasks.workunit.client.0.smithi118.stdout:2/773: getdents de/d1f/d20/d67/d99 0 2024-09-21T11:39:41.040 INFO:tasks.workunit.client.0.smithi118.stdout:9/795: truncate d0/d4/d45/db5/d86/ffe 4681321 0 2024-09-21T11:39:41.040 INFO:tasks.workunit.client.0.smithi118.stdout:3/740: creat d5/d28/f106 x:0 0 0 2024-09-21T11:39:41.040 INFO:tasks.workunit.client.0.smithi118.stdout:1/736: dwrite d6/d2a/f93 [0,4194304] 0 2024-09-21T11:39:41.043 INFO:tasks.workunit.client.0.smithi118.stdout:1/737: chown d6/de/d16/d3f/d50/d72/f80 2837 1 2024-09-21T11:39:41.044 INFO:tasks.workunit.client.0.smithi118.stdout:5/764: symlink d0/db/d35/l103 0 2024-09-21T11:39:41.044 INFO:tasks.workunit.client.0.smithi118.stdout:4/887: sync 2024-09-21T11:39:41.047 INFO:tasks.workunit.client.0.smithi118.stdout:4/888: fsync d2/d6/de/d1c/d23/d26/dd6/dcb/db0/dcd/fe2 0 2024-09-21T11:39:41.051 INFO:tasks.workunit.client.0.smithi118.stdout:1/738: mknod d6/de/d16/d3f/d86/ce1 0 2024-09-21T11:39:41.052 INFO:tasks.workunit.client.0.smithi118.stdout:2/774: creat de/d16/d31/dce/d65/da2/d103/f10a x:0 0 0 2024-09-21T11:39:41.055 INFO:tasks.workunit.client.0.smithi118.stdout:5/765: truncate d0/db/d35/def/f70 1284405 0 2024-09-21T11:39:41.059 INFO:tasks.workunit.client.0.smithi118.stdout:2/775: dread de/d53/fb3 [0,4194304] 0 2024-09-21T11:39:41.059 INFO:tasks.workunit.client.0.smithi118.stdout:9/796: creat d0/d20/d4c/d5f/d6c/d88/f11e x:0 0 0 2024-09-21T11:39:41.060 INFO:tasks.workunit.client.0.smithi118.stdout:6/683: dread d8/d46/d53/dbf/dcb/d66/f86 [0,4194304] 0 2024-09-21T11:39:41.064 INFO:tasks.workunit.client.0.smithi118.stdout:1/739: rename d6/d3b/f57 to d6/d2a/d3d/db5/fe2 0 2024-09-21T11:39:41.067 INFO:tasks.workunit.client.0.smithi118.stdout:5/766: creat d0/db/d35/def/d92/f104 x:0 0 0 2024-09-21T11:39:41.068 INFO:tasks.workunit.client.0.smithi118.stdout:3/741: link d5/d1d/d1b/lc2 d5/d1d/d1b/d24/l107 0 2024-09-21T11:39:41.070 INFO:tasks.workunit.client.0.smithi118.stdout:3/742: write d5/d28/d3e/d5d/d8d/fd7 [464361,103735] 0 2024-09-21T11:39:41.072 INFO:tasks.workunit.client.0.smithi118.stdout:2/776: rmdir de/d53 39 2024-09-21T11:39:41.073 INFO:tasks.workunit.client.0.smithi118.stdout:9/797: fdatasync d0/d4/d38/db8/de9/fee 0 2024-09-21T11:39:41.075 INFO:tasks.workunit.client.0.smithi118.stdout:9/798: dread - d0/d20/d4c/d5f/d6c/d88/f11e zero size 2024-09-21T11:39:41.076 INFO:tasks.workunit.client.0.smithi118.stdout:5/767: dwrite d0/d89/daa/fb4 [0,4194304] 0 2024-09-21T11:39:41.078 INFO:tasks.workunit.client.0.smithi118.stdout:9/799: write d0/d4/d45/db5/d86/ffe [4787975,71310] 0 2024-09-21T11:39:41.081 INFO:tasks.workunit.client.0.smithi118.stdout:1/740: creat d6/d2a/d3d/db9/fe3 x:0 0 0 2024-09-21T11:39:41.082 INFO:tasks.workunit.client.0.smithi118.stdout:1/741: fdatasync d6/d33/f5b 0 2024-09-21T11:39:41.084 INFO:tasks.workunit.client.0.smithi118.stdout:4/889: creat d2/d6/de/d1c/d4d/d52/f12d x:0 0 0 2024-09-21T11:39:41.087 INFO:tasks.workunit.client.0.smithi118.stdout:4/890: dread d2/d6/de/d1c/d87/da9/d97/d9b/fc0 [0,4194304] 0 2024-09-21T11:39:41.088 INFO:tasks.workunit.client.0.smithi118.stdout:3/743: rename d5/d1d/f87 to d5/d1d/d8c/f108 0 2024-09-21T11:39:41.089 INFO:tasks.workunit.client.0.smithi118.stdout:3/744: read d5/d28/d3e/fbc [331681,41006] 0 2024-09-21T11:39:41.100 INFO:tasks.workunit.client.0.smithi118.stdout:2/777: dread de/d1f/d20/fe2 [0,4194304] 0 2024-09-21T11:39:41.101 INFO:tasks.workunit.client.0.smithi118.stdout:2/778: write de/d16/d31/dce/d65/da2/f74 [2739592,62423] 0 2024-09-21T11:39:41.101 INFO:tasks.workunit.client.0.smithi118.stdout:4/891: creat d2/d6/de/d1c/d4d/dba/f12e x:0 0 0 2024-09-21T11:39:41.101 INFO:tasks.workunit.client.0.smithi118.stdout:7/847: sync 2024-09-21T11:39:41.102 INFO:tasks.workunit.client.0.smithi118.stdout:7/848: chown d0/f2a 1652183 1 2024-09-21T11:39:41.104 INFO:tasks.workunit.client.0.smithi118.stdout:7/849: stat d0/d3/d13/fe9 0 2024-09-21T11:39:41.106 INFO:tasks.workunit.client.0.smithi118.stdout:9/800: mknod d0/d11a/c11f 0 2024-09-21T11:39:41.106 INFO:tasks.workunit.client.0.smithi118.stdout:4/892: dread d2/d6/de/d1c/d23/d26/d74/ff0 [0,4194304] 0 2024-09-21T11:39:41.106 INFO:tasks.workunit.client.0.smithi118.stdout:1/742: truncate d6/de/f25 5757115 0 2024-09-21T11:39:41.113 INFO:tasks.workunit.client.0.smithi118.stdout:6/684: getdents d8/d48/d6c/d64 0 2024-09-21T11:39:41.116 INFO:tasks.workunit.client.0.smithi118.stdout:5/768: creat d0/db/d35/d30/d1a/f105 x:0 0 0 2024-09-21T11:39:41.118 INFO:tasks.workunit.client.0.smithi118.stdout:7/850: truncate d0/d3/d14/f65 941136 0 2024-09-21T11:39:41.119 INFO:tasks.workunit.client.0.smithi118.stdout:5/769: write d0/db/d35/d95/f98 [5140544,55562] 0 2024-09-21T11:39:41.120 INFO:tasks.workunit.client.0.smithi118.stdout:6/685: dwrite d8/d46/f81 [0,4194304] 0 2024-09-21T11:39:41.126 INFO:tasks.workunit.client.0.smithi118.stdout:3/745: creat d5/d28/d3e/d5d/d5f/f109 x:0 0 0 2024-09-21T11:39:41.130 INFO:tasks.workunit.client.0.smithi118.stdout:4/893: dwrite d2/d6/dd/d35/f3f [4194304,4194304] 0 2024-09-21T11:39:41.130 INFO:tasks.workunit.client.0.smithi118.stdout:2/779: rename de/d1f/d20/d67/fd2 to de/d16/d31/dce/d66/f10b 0 2024-09-21T11:39:41.132 INFO:tasks.workunit.client.0.smithi118.stdout:2/780: dread de/f1e [0,4194304] 0 2024-09-21T11:39:41.138 INFO:tasks.workunit.client.0.smithi118.stdout:6/686: creat d8/d14/d44/fd5 x:0 0 0 2024-09-21T11:39:41.140 INFO:tasks.workunit.client.0.smithi118.stdout:5/770: mknod d0/db/d35/d30/d1a/d8f/d99/db9/c106 0 2024-09-21T11:39:41.141 INFO:tasks.workunit.client.0.smithi118.stdout:5/771: chown d0/d6c 1969465 1 2024-09-21T11:39:41.142 INFO:tasks.workunit.client.0.smithi118.stdout:7/851: dwrite d0/d3/d14/f4c [0,4194304] 0 2024-09-21T11:39:41.145 INFO:tasks.workunit.client.0.smithi118.stdout:5/772: write d0/db/d35/d30/d1a/fe1 [714966,78339] 0 2024-09-21T11:39:41.151 INFO:tasks.workunit.client.0.smithi118.stdout:1/743: rename d6/d2a/d53/c5e to d6/d33/d3c/ce4 0 2024-09-21T11:39:41.151 INFO:tasks.workunit.client.0.smithi118.stdout:9/801: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/f58 [0,4194304] 0 2024-09-21T11:39:41.151 INFO:tasks.workunit.client.0.smithi118.stdout:4/894: chown d2/d6/dd/c2a 1 1 2024-09-21T11:39:41.156 INFO:tasks.workunit.client.0.smithi118.stdout:2/781: chown de/d16/d31/dce/d4f/d5b/lc4 1596 1 2024-09-21T11:39:41.156 INFO:tasks.workunit.client.0.smithi118.stdout:2/782: fsync de/d51/ff3 0 2024-09-21T11:39:41.161 INFO:tasks.workunit.client.0.smithi118.stdout:1/744: dwrite d6/de/d13/f1c [0,4194304] 0 2024-09-21T11:39:41.161 INFO:tasks.workunit.client.0.smithi118.stdout:5/773: symlink d0/db/d35/def/d92/l107 0 2024-09-21T11:39:41.164 INFO:tasks.workunit.client.0.smithi118.stdout:4/895: creat d2/d6/d12a/df3/f12f x:0 0 0 2024-09-21T11:39:41.167 INFO:tasks.workunit.client.0.smithi118.stdout:6/687: mkdir d8/d48/dd6 0 2024-09-21T11:39:41.169 INFO:tasks.workunit.client.0.smithi118.stdout:6/688: write d8/d48/d45/f4d [7366112,73153] 0 2024-09-21T11:39:41.169 INFO:tasks.workunit.client.0.smithi118.stdout:2/783: symlink de/d16/d31/dce/d65/da2/d9b/l10c 0 2024-09-21T11:39:41.169 INFO:tasks.workunit.client.0.smithi118.stdout:7/852: symlink d0/d3/d1d/d35/d70/l11d 0 2024-09-21T11:39:41.171 INFO:tasks.workunit.client.0.smithi118.stdout:5/774: unlink d0/d89/d9d/lf1 0 2024-09-21T11:39:41.171 INFO:tasks.workunit.client.0.smithi118.stdout:7/853: write d0/d3/d1d/f118 [235532,51826] 0 2024-09-21T11:39:41.172 INFO:tasks.workunit.client.0.smithi118.stdout:4/896: fsync d2/d6/de/d1c/d23/f2c 0 2024-09-21T11:39:41.173 INFO:tasks.workunit.client.0.smithi118.stdout:7/854: chown d0/d3/d13/fe9 1868391 1 2024-09-21T11:39:41.175 INFO:tasks.workunit.client.0.smithi118.stdout:4/897: truncate d2/d6/de/d1c/d4d/fca 253049 0 2024-09-21T11:39:41.176 INFO:tasks.workunit.client.0.smithi118.stdout:3/746: rename d5/d28/d33/d4a/l7c to d5/d28/d3e/d5d/l10a 0 2024-09-21T11:39:41.179 INFO:tasks.workunit.client.0.smithi118.stdout:2/784: creat de/d50/f10d x:0 0 0 2024-09-21T11:39:41.180 INFO:tasks.workunit.client.0.smithi118.stdout:6/689: fdatasync d8/d46/d53/dbf/dcb/d70/d7d/f8c 0 2024-09-21T11:39:41.183 INFO:tasks.workunit.client.0.smithi118.stdout:7/855: rmdir d0 39 2024-09-21T11:39:41.185 INFO:tasks.workunit.client.0.smithi118.stdout:4/898: mknod d2/d6/dd/d35/c130 0 2024-09-21T11:39:41.186 INFO:tasks.workunit.client.0.smithi118.stdout:2/785: dwrite de/f19 [0,4194304] 0 2024-09-21T11:39:41.188 INFO:tasks.workunit.client.0.smithi118.stdout:5/775: rename d0/db/d35/d30/d1a/d8f/d99/fe6 to d0/dbf/f108 0 2024-09-21T11:39:41.190 INFO:tasks.workunit.client.0.smithi118.stdout:5/776: chown d0/db/d35/d30/cae 1449475 1 2024-09-21T11:39:41.192 INFO:tasks.workunit.client.0.smithi118.stdout:3/747: truncate d5/f10 3255926 0 2024-09-21T11:39:41.196 INFO:tasks.workunit.client.0.smithi118.stdout:7/856: chown d0/d3/d1d/d35/d57/d96/lf8 0 1 2024-09-21T11:39:41.198 INFO:tasks.workunit.client.0.smithi118.stdout:7/857: write d0/d3/d13/ff4 [180863,55569] 0 2024-09-21T11:39:41.201 INFO:tasks.workunit.client.0.smithi118.stdout:3/748: creat d5/d28/d3e/d5d/dfd/dc9/f10b x:0 0 0 2024-09-21T11:39:41.201 INFO:tasks.workunit.client.0.smithi118.stdout:5/777: dread d0/db/d35/d30/f52 [4194304,4194304] 0 2024-09-21T11:39:41.202 INFO:tasks.workunit.client.0.smithi118.stdout:3/749: chown d5/d28/d3e/d5d/d5f/f8b 120818 1 2024-09-21T11:39:41.203 INFO:tasks.workunit.client.0.smithi118.stdout:3/750: write d5/d1d/d1b/d4c/ff7 [951737,19326] 0 2024-09-21T11:39:41.205 INFO:tasks.workunit.client.0.smithi118.stdout:4/899: mkdir d2/d131 0 2024-09-21T11:39:41.206 INFO:tasks.workunit.client.0.smithi118.stdout:4/900: chown d2/d6/dd/d35/f6c 11 1 2024-09-21T11:39:41.208 INFO:tasks.workunit.client.0.smithi118.stdout:7/858: mkdir d0/d3/d14/d41/da0/d11e 0 2024-09-21T11:39:41.210 INFO:tasks.workunit.client.0.smithi118.stdout:6/690: link d8/d14/d33/cd4 d8/d46/d53/dbf/dcb/d70/d7d/cd7 0 2024-09-21T11:39:41.214 INFO:tasks.workunit.client.0.smithi118.stdout:4/901: rmdir d2/d6/dd/d35/d10d 39 2024-09-21T11:39:41.215 INFO:tasks.workunit.client.0.smithi118.stdout:4/902: stat d2/d6/de/d1c/d87/d105/c112 0 2024-09-21T11:39:41.215 INFO:tasks.workunit.client.0.smithi118.stdout:2/786: creat de/d16/d31/dce/f10e x:0 0 0 2024-09-21T11:39:41.222 INFO:tasks.workunit.client.0.smithi118.stdout:5/778: creat d0/d89/f109 x:0 0 0 2024-09-21T11:39:41.225 INFO:tasks.workunit.client.0.smithi118.stdout:3/751: dwrite d5/d1d/d1b/d4c/d73/d9b/f97 [0,4194304] 0 2024-09-21T11:39:41.226 INFO:tasks.workunit.client.0.smithi118.stdout:2/787: unlink de/d16/d25/dba/fe0 0 2024-09-21T11:39:41.228 INFO:tasks.workunit.client.0.smithi118.stdout:6/691: creat d8/d46/dca/fd8 x:0 0 0 2024-09-21T11:39:41.229 INFO:tasks.workunit.client.0.smithi118.stdout:7/859: truncate d0/d3/d13/f55 3335463 0 2024-09-21T11:39:41.230 INFO:tasks.workunit.client.0.smithi118.stdout:4/903: symlink d2/d6/de/d1c/d4d/d52/l132 0 2024-09-21T11:39:41.235 INFO:tasks.workunit.client.0.smithi118.stdout:3/752: creat d5/d1d/d1b/d4c/d73/dc4/f10c x:0 0 0 2024-09-21T11:39:41.242 INFO:tasks.workunit.client.0.smithi118.stdout:5/779: getdents d0/d6c/d25/d50/dfd 0 2024-09-21T11:39:41.321 INFO:tasks.workunit.client.0.smithi118.stdout:4/904: symlink d2/d6/dd/d35/d10d/d11d/l133 0 2024-09-21T11:39:41.323 INFO:tasks.workunit.client.0.smithi118.stdout:3/753: mknod d5/d28/d3e/d5d/d5f/d88/c10d 0 2024-09-21T11:39:41.324 INFO:tasks.workunit.client.0.smithi118.stdout:6/692: creat d8/fd9 x:0 0 0 2024-09-21T11:39:41.328 INFO:tasks.workunit.client.0.smithi118.stdout:7/860: rename d0/d3/f11 to d0/d3/d14/d41/d66/f11f 0 2024-09-21T11:39:41.328 INFO:tasks.workunit.client.0.smithi118.stdout:2/788: write de/d16/f32 [1601577,3378] 0 2024-09-21T11:39:41.330 INFO:tasks.workunit.client.0.smithi118.stdout:5/780: write d0/f83 [893358,13083] 0 2024-09-21T11:39:41.331 INFO:tasks.workunit.client.0.smithi118.stdout:4/905: creat d2/d6/de/d1c/d87/da9/d97/f134 x:0 0 0 2024-09-21T11:39:41.332 INFO:tasks.workunit.client.0.smithi118.stdout:3/754: mknod d5/d28/d33/d4a/c10e 0 2024-09-21T11:39:41.334 INFO:tasks.workunit.client.0.smithi118.stdout:2/789: dread de/d1f/d20/d78/d98/fdd [0,4194304] 0 2024-09-21T11:39:41.336 INFO:tasks.workunit.client.0.smithi118.stdout:7/861: write d0/d3/d1d/d35/d70/d10e/d110/f6b [273977,15077] 0 2024-09-21T11:39:41.338 INFO:tasks.workunit.client.0.smithi118.stdout:4/906: mkdir d2/d6/de/d1c/d4d/dba/d135 0 2024-09-21T11:39:41.339 INFO:tasks.workunit.client.0.smithi118.stdout:6/693: dwrite d8/d48/d5f/fb1 [0,4194304] 0 2024-09-21T11:39:41.339 INFO:tasks.workunit.client.0.smithi118.stdout:3/755: unlink d5/d1d/d1b/d50/dc6/ff0 0 2024-09-21T11:39:41.342 INFO:tasks.workunit.client.0.smithi118.stdout:2/790: creat de/d22/d3c/d83/f10f x:0 0 0 2024-09-21T11:39:41.349 INFO:tasks.workunit.client.0.smithi118.stdout:7/862: chown d0/d3/d1d/d35/d70/d10e/d110/d5f/fe8 107836 1 2024-09-21T11:39:41.350 INFO:tasks.workunit.client.0.smithi118.stdout:4/907: mkdir d2/d6/de/d1c/d23/d26/dd6/d136 0 2024-09-21T11:39:41.351 INFO:tasks.workunit.client.0.smithi118.stdout:7/863: read d0/d3/d1d/d35/d70/d10e/d110/f8d [111183,35162] 0 2024-09-21T11:39:41.351 INFO:tasks.workunit.client.0.smithi118.stdout:4/908: write d2/d6/d12a/fa2 [3241864,75951] 0 2024-09-21T11:39:41.352 INFO:tasks.workunit.client.0.smithi118.stdout:6/694: mknod d8/d48/d5f/cda 0 2024-09-21T11:39:41.354 INFO:tasks.workunit.client.0.smithi118.stdout:3/756: creat d5/d1d/d1b/d4c/d73/dc4/f10f x:0 0 0 2024-09-21T11:39:41.357 INFO:tasks.workunit.client.0.smithi118.stdout:2/791: creat de/d16/d31/dce/d66/d9a/f110 x:0 0 0 2024-09-21T11:39:41.359 INFO:tasks.workunit.client.0.smithi118.stdout:5/781: truncate d0/f36 3471194 0 2024-09-21T11:39:41.360 INFO:tasks.workunit.client.0.smithi118.stdout:4/909: write d2/f13 [621682,7474] 0 2024-09-21T11:39:41.361 INFO:tasks.workunit.client.0.smithi118.stdout:7/864: creat d0/d3/d14/d41/d7f/da2/f120 x:0 0 0 2024-09-21T11:39:41.362 INFO:tasks.workunit.client.0.smithi118.stdout:6/695: fsync d8/d14/d33/fa6 0 2024-09-21T11:39:41.363 INFO:tasks.workunit.client.0.smithi118.stdout:3/757: unlink d5/d1d/d1b/d4c/d73/fb6 0 2024-09-21T11:39:41.365 INFO:tasks.workunit.client.0.smithi118.stdout:2/792: write de/d16/d31/dce/d66/f10b [2663164,60084] 0 2024-09-21T11:39:41.376 INFO:tasks.workunit.client.0.smithi118.stdout:5/782: write d0/db/d35/da/f51 [1552426,45843] 0 2024-09-21T11:39:41.378 INFO:tasks.workunit.client.0.smithi118.stdout:2/793: rename de/d1f/f4c to de/d50/d85/f111 0 2024-09-21T11:39:41.379 INFO:tasks.workunit.client.0.smithi118.stdout:2/794: chown de/d16/d25/dba/fc0 1808614326 1 2024-09-21T11:39:41.379 INFO:tasks.workunit.client.0.smithi118.stdout:2/795: dread - de/d50/d85/fab zero size 2024-09-21T11:39:41.380 INFO:tasks.workunit.client.0.smithi118.stdout:6/696: write d8/d14/f24 [1603012,20319] 0 2024-09-21T11:39:41.381 INFO:tasks.workunit.client.0.smithi118.stdout:2/796: read de/d1f/d20/fb0 [3328789,96649] 0 2024-09-21T11:39:41.384 INFO:tasks.workunit.client.0.smithi118.stdout:7/865: write d0/d3/d13/f55 [1226543,68111] 0 2024-09-21T11:39:41.386 INFO:tasks.workunit.client.0.smithi118.stdout:5/783: unlink d0/db/d35/da/l7a 0 2024-09-21T11:39:41.386 INFO:tasks.workunit.client.0.smithi118.stdout:7/866: fdatasync d0/d3/d1d/d35/f59 0 2024-09-21T11:39:41.388 INFO:tasks.workunit.client.0.smithi118.stdout:3/758: dwrite d5/f7e [0,4194304] 0 2024-09-21T11:39:41.388 INFO:tasks.workunit.client.0.smithi118.stdout:7/867: chown d0/ffa 23 1 2024-09-21T11:39:41.390 INFO:tasks.workunit.client.0.smithi118.stdout:3/759: dread - d5/d28/d3e/d5d/d5f/f109 zero size 2024-09-21T11:39:41.390 INFO:tasks.workunit.client.0.smithi118.stdout:6/697: creat d8/d14/dba/fdb x:0 0 0 2024-09-21T11:39:41.390 INFO:tasks.workunit.client.0.smithi118.stdout:7/868: chown d0/d3/d14/d41/d7f/f11b 279 1 2024-09-21T11:39:41.394 INFO:tasks.workunit.client.0.smithi118.stdout:5/784: dwrite d0/db/d35/da/f6e [0,4194304] 0 2024-09-21T11:39:41.396 INFO:tasks.workunit.client.0.smithi118.stdout:6/698: chown d8/lf 1912517 1 2024-09-21T11:39:41.397 INFO:tasks.workunit.client.0.smithi118.stdout:6/699: dread - d8/d46/dca/fd8 zero size 2024-09-21T11:39:41.397 INFO:tasks.workunit.client.0.smithi118.stdout:3/760: fdatasync d5/d1d/d1b/d4c/f6e 0 2024-09-21T11:39:41.401 INFO:tasks.workunit.client.0.smithi118.stdout:2/797: write de/d50/d85/ff5 [99313,43673] 0 2024-09-21T11:39:41.401 INFO:tasks.workunit.client.0.smithi118.stdout:2/798: dread - de/d16/d31/dce/d66/fd5 zero size 2024-09-21T11:39:41.406 INFO:tasks.workunit.client.0.smithi118.stdout:5/785: mkdir d0/dd1/df5/d10a 0 2024-09-21T11:39:41.409 INFO:tasks.workunit.client.0.smithi118.stdout:2/799: dwrite de/d16/d25/dba/fc1 [0,4194304] 0 2024-09-21T11:39:41.411 INFO:tasks.workunit.client.0.smithi118.stdout:7/869: getdents d0/d3/d14/d41/d8b/da4 0 2024-09-21T11:39:41.412 INFO:tasks.workunit.client.0.smithi118.stdout:2/800: chown de/d16/d31/dce/d4f/f7f 5 1 2024-09-21T11:39:41.413 INFO:tasks.workunit.client.0.smithi118.stdout:7/870: chown d0/d3/d1d/d35/f60 12484 1 2024-09-21T11:39:41.414 INFO:tasks.workunit.client.0.smithi118.stdout:5/786: dwrite d0/db/d35/fda [0,4194304] 0 2024-09-21T11:39:41.415 INFO:tasks.workunit.client.0.smithi118.stdout:7/871: write d0/d3/d1d/f116 [925873,125908] 0 2024-09-21T11:39:41.420 INFO:tasks.workunit.client.0.smithi118.stdout:5/787: mkdir d0/db/d26/d65/d10b 0 2024-09-21T11:39:41.423 INFO:tasks.workunit.client.0.smithi118.stdout:7/872: mknod d0/d3/d1d/d35/d70/d10e/d110/d5f/d71/c121 0 2024-09-21T11:39:41.425 INFO:tasks.workunit.client.0.smithi118.stdout:5/788: mknod d0/dbf/c10c 0 2024-09-21T11:39:41.428 INFO:tasks.workunit.client.0.smithi118.stdout:3/761: dwrite d5/d1d/f32 [0,4194304] 0 2024-09-21T11:39:41.429 INFO:tasks.workunit.client.0.smithi118.stdout:5/789: creat d0/db/d26/d65/f10d x:0 0 0 2024-09-21T11:39:41.432 INFO:tasks.workunit.client.0.smithi118.stdout:5/790: dread - d0/db/d35/d30/d1a/db3/fe7 zero size 2024-09-21T11:39:41.432 INFO:tasks.workunit.client.0.smithi118.stdout:5/791: chown d0/d6c/d25/d50/c5d 15025513 1 2024-09-21T11:39:41.432 INFO:tasks.workunit.client.0.smithi118.stdout:3/762: mknod d5/d28/d33/d4a/dc8/c110 0 2024-09-21T11:39:41.433 INFO:tasks.workunit.client.0.smithi118.stdout:5/792: chown d0/db/d35/d30/d1a 100837463 1 2024-09-21T11:39:41.437 INFO:tasks.workunit.client.0.smithi118.stdout:2/801: truncate de/d22/d3c/f3f 4025914 0 2024-09-21T11:39:41.441 INFO:tasks.workunit.client.0.smithi118.stdout:6/700: dread d8/d46/d53/dbf/dcb/d70/d7d/f8c [0,4194304] 0 2024-09-21T11:39:41.441 INFO:tasks.workunit.client.0.smithi118.stdout:5/793: dwrite d0/db/f87 [0,4194304] 0 2024-09-21T11:39:41.443 INFO:tasks.workunit.client.0.smithi118.stdout:2/802: mkdir de/d53/dc2/d112 0 2024-09-21T11:39:41.444 INFO:tasks.workunit.client.0.smithi118.stdout:6/701: symlink d8/d48/d5f/da3/ldc 0 2024-09-21T11:39:41.445 INFO:tasks.workunit.client.0.smithi118.stdout:7/873: dread d0/d3/d14/d41/d66/f8e [0,4194304] 0 2024-09-21T11:39:41.447 INFO:tasks.workunit.client.0.smithi118.stdout:7/874: dread - d0/d3/d1d/f10b zero size 2024-09-21T11:39:41.447 INFO:tasks.workunit.client.0.smithi118.stdout:2/803: creat de/d16/d31/dce/d66/d9a/f113 x:0 0 0 2024-09-21T11:39:41.448 INFO:tasks.workunit.client.0.smithi118.stdout:6/702: creat d8/d46/dca/fdd x:0 0 0 2024-09-21T11:39:41.449 INFO:tasks.workunit.client.0.smithi118.stdout:2/804: chown de/l13 28035 1 2024-09-21T11:39:41.451 INFO:tasks.workunit.client.0.smithi118.stdout:6/703: read d8/f15 [2415928,58436] 0 2024-09-21T11:39:41.454 INFO:tasks.workunit.client.0.smithi118.stdout:7/875: mknod d0/d3/d1d/d35/d70/d10e/d110/d5f/d71/dda/c122 0 2024-09-21T11:39:41.458 INFO:tasks.workunit.client.0.smithi118.stdout:5/794: dread d0/db/d35/d30/d66/f71 [0,4194304] 0 2024-09-21T11:39:41.459 INFO:tasks.workunit.client.0.smithi118.stdout:7/876: unlink d0/d3/d1d/d35/d70/d10e/d110/c99 0 2024-09-21T11:39:41.463 INFO:tasks.workunit.client.0.smithi118.stdout:5/795: creat d0/d63/f10e x:0 0 0 2024-09-21T11:39:41.466 INFO:tasks.workunit.client.0.smithi118.stdout:6/704: dread d8/d48/d72/f9c [0,4194304] 0 2024-09-21T11:39:41.467 INFO:tasks.workunit.client.0.smithi118.stdout:7/877: dwrite d0/d3/d1d/d35/d57/d7e/d82/ff7 [0,4194304] 0 2024-09-21T11:39:41.473 INFO:tasks.workunit.client.0.smithi118.stdout:5/796: dwrite d0/db/d35/d30/d1a/d8f/d99/fbd [0,4194304] 0 2024-09-21T11:39:41.474 INFO:tasks.workunit.client.0.smithi118.stdout:6/705: rename d8/f1a to d8/d46/d53/dbf/dcb/d66/fde 0 2024-09-21T11:39:41.476 INFO:tasks.workunit.client.0.smithi118.stdout:7/878: truncate d0/d3/d14/d41/d66/f67 700355 0 2024-09-21T11:39:41.481 INFO:tasks.workunit.client.0.smithi118.stdout:5/797: rmdir d0/dbf 39 2024-09-21T11:39:41.481 INFO:tasks.workunit.client.0.smithi118.stdout:2/805: write de/d1f/d20/f77 [2941301,60256] 0 2024-09-21T11:39:41.484 INFO:tasks.workunit.client.0.smithi118.stdout:2/806: stat de/d22/d3c/d83 0 2024-09-21T11:39:41.489 INFO:tasks.workunit.client.0.smithi118.stdout:2/807: dwrite de/d51/fa9 [4194304,4194304] 0 2024-09-21T11:39:41.521 INFO:tasks.workunit.client.0.smithi118.stdout:6/706: link d8/d14/d33/f55 d8/d48/d5f/d6b/fdf 0 2024-09-21T11:39:41.522 INFO:tasks.workunit.client.0.smithi118.stdout:5/798: creat d0/dd1/df5/f10f x:0 0 0 2024-09-21T11:39:41.523 INFO:tasks.workunit.client.0.smithi118.stdout:7/879: readlink d0/d3/d1d/d35/d57/d96/d9e/lee 0 2024-09-21T11:39:41.525 INFO:tasks.workunit.client.0.smithi118.stdout:2/808: symlink de/d51/l114 0 2024-09-21T11:39:41.526 INFO:tasks.workunit.client.0.smithi118.stdout:2/809: truncate de/d22/d3c/d83/fe5 879796 0 2024-09-21T11:39:41.534 INFO:tasks.workunit.client.0.smithi118.stdout:7/880: link d0/d3/d14/d41/d8b/da4/leb d0/d3/d13/d102/l123 0 2024-09-21T11:39:41.534 INFO:tasks.workunit.client.0.smithi118.stdout:6/707: link d8/d14/d33/f88 d8/d48/fe0 0 2024-09-21T11:39:41.535 INFO:tasks.workunit.client.0.smithi118.stdout:6/708: fdatasync d8/f8b 0 2024-09-21T11:39:41.538 INFO:tasks.workunit.client.0.smithi118.stdout:2/810: dread de/d53/f8d [0,4194304] 0 2024-09-21T11:39:41.541 INFO:tasks.workunit.client.0.smithi118.stdout:6/709: rename d8/d46/d53 to d8/d48/d45/de1 0 2024-09-21T11:39:41.542 INFO:tasks.workunit.client.0.smithi118.stdout:2/811: symlink de/d53/dc2/d112/l115 0 2024-09-21T11:39:41.545 INFO:tasks.workunit.client.0.smithi118.stdout:2/812: symlink de/d1f/l116 0 2024-09-21T11:39:41.547 INFO:tasks.workunit.client.0.smithi118.stdout:6/710: creat d8/d14/d3a/fe2 x:0 0 0 2024-09-21T11:39:41.548 INFO:tasks.workunit.client.0.smithi118.stdout:2/813: mknod de/d16/d31/dce/d4f/d5b/c117 0 2024-09-21T11:39:41.548 INFO:tasks.workunit.client.0.smithi118.stdout:7/881: dread d0/d3/d1d/d35/f58 [0,4194304] 0 2024-09-21T11:39:41.549 INFO:tasks.workunit.client.0.smithi118.stdout:2/814: chown de/f2a 1046 1 2024-09-21T11:39:41.550 INFO:tasks.workunit.client.0.smithi118.stdout:2/815: chown de/d50/d85/ff5 0 1 2024-09-21T11:39:41.550 INFO:tasks.workunit.client.0.smithi118.stdout:6/711: creat d8/d48/d45/de1/dbf/dcb/d70/fe3 x:0 0 0 2024-09-21T11:39:41.552 INFO:tasks.workunit.client.0.smithi118.stdout:7/882: symlink d0/d3/d1d/d35/d70/l124 0 2024-09-21T11:39:41.553 INFO:tasks.workunit.client.0.smithi118.stdout:6/712: mknod d8/d48/d72/d7e/ce4 0 2024-09-21T11:39:41.554 INFO:tasks.workunit.client.0.smithi118.stdout:2/816: readlink de/d1f/d20/d67/d8a/lee 0 2024-09-21T11:39:41.556 INFO:tasks.workunit.client.0.smithi118.stdout:6/713: unlink d8/d14/d3a/fe2 0 2024-09-21T11:39:41.560 INFO:tasks.workunit.client.0.smithi118.stdout:7/883: dwrite d0/d3/d14/d41/d7f/d3e/f42 [4194304,4194304] 0 2024-09-21T11:39:41.560 INFO:tasks.workunit.client.0.smithi118.stdout:6/714: truncate d8/d46/dca/fd8 41110 0 2024-09-21T11:39:41.564 INFO:tasks.workunit.client.0.smithi118.stdout:7/884: unlink d0/d3/d14/d41/d8b/da4/db2/fd7 0 2024-09-21T11:39:41.568 INFO:tasks.workunit.client.0.smithi118.stdout:2/817: dread de/d1f/d20/f55 [0,4194304] 0 2024-09-21T11:39:41.569 INFO:tasks.workunit.client.0.smithi118.stdout:7/885: unlink d0/d3/d1d/d35/d57/cac 0 2024-09-21T11:39:41.570 INFO:tasks.workunit.client.0.smithi118.stdout:7/886: readlink d0/l5c 0 2024-09-21T11:39:41.570 INFO:tasks.workunit.client.0.smithi118.stdout:2/818: truncate de/d16/d31/dce/d65/ff0 985056 0 2024-09-21T11:39:41.571 INFO:tasks.workunit.client.0.smithi118.stdout:7/887: stat d0/d3/dd9/lf9 0 2024-09-21T11:39:41.571 INFO:tasks.workunit.client.0.smithi118.stdout:2/819: chown de/d16/d31/dce/d4f 24127924 1 2024-09-21T11:39:41.577 INFO:tasks.workunit.client.0.smithi118.stdout:7/888: dwrite d0/f104 [0,4194304] 0 2024-09-21T11:39:41.579 INFO:tasks.workunit.client.0.smithi118.stdout:7/889: mknod d0/d3/d13/c125 0 2024-09-21T11:39:41.581 INFO:tasks.workunit.client.0.smithi118.stdout:7/890: symlink d0/d3/d1d/d35/d57/l126 0 2024-09-21T11:39:41.588 INFO:tasks.workunit.client.0.smithi118.stdout:5/799: truncate d0/d6c/fcb 1539867 0 2024-09-21T11:39:41.595 INFO:tasks.workunit.client.0.smithi118.stdout:5/800: dwrite d0/db/d35/d2c/f77 [0,4194304] 0 2024-09-21T11:39:41.600 INFO:tasks.workunit.client.0.smithi118.stdout:5/801: mkdir d0/db/d35/da/dd7/d110 0 2024-09-21T11:39:41.600 INFO:tasks.workunit.client.0.smithi118.stdout:9/802: sync 2024-09-21T11:39:41.605 INFO:tasks.workunit.client.0.smithi118.stdout:5/802: symlink d0/db/d26/d65/l111 0 2024-09-21T11:39:41.608 INFO:tasks.workunit.client.0.smithi118.stdout:9/803: fdatasync d0/d4/d38/f60 0 2024-09-21T11:39:41.611 INFO:tasks.workunit.client.0.smithi118.stdout:5/803: fsync d0/d6c/d25/d50/f91 0 2024-09-21T11:39:41.612 INFO:tasks.workunit.client.0.smithi118.stdout:5/804: write d0/db/d35/d30/d1a/d8f/d99/fbd [1650859,59853] 0 2024-09-21T11:39:41.614 INFO:tasks.workunit.client.0.smithi118.stdout:9/804: dread d0/d20/d4c/d5f/d89/fe7 [0,4194304] 0 2024-09-21T11:39:41.615 INFO:tasks.workunit.client.0.smithi118.stdout:6/715: fsync d8/d48/d45/de1/dbf/dcb/d70/fe3 0 2024-09-21T11:39:41.616 INFO:tasks.workunit.client.0.smithi118.stdout:6/716: read d8/d48/d5f/fb1 [2339841,1387] 0 2024-09-21T11:39:41.622 INFO:tasks.workunit.client.0.smithi118.stdout:6/717: creat d8/d14/dba/fe5 x:0 0 0 2024-09-21T11:39:41.626 INFO:tasks.workunit.client.0.smithi118.stdout:6/718: creat d8/d46/fe6 x:0 0 0 2024-09-21T11:39:41.627 INFO:tasks.workunit.client.0.smithi118.stdout:6/719: readlink d8/d48/d45/de1/lcf 0 2024-09-21T11:39:41.628 INFO:tasks.workunit.client.0.smithi118.stdout:9/805: creat d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/f120 x:0 0 0 2024-09-21T11:39:41.631 INFO:tasks.workunit.client.0.smithi118.stdout:9/806: symlink d0/d4/d45/l121 0 2024-09-21T11:39:41.632 INFO:tasks.workunit.client.0.smithi118.stdout:6/720: symlink d8/d14/d33/d92/le7 0 2024-09-21T11:39:41.638 INFO:tasks.workunit.client.0.smithi118.stdout:6/721: creat d8/d48/dd6/fe8 x:0 0 0 2024-09-21T11:39:41.641 INFO:tasks.workunit.client.0.smithi118.stdout:6/722: symlink d8/d14/d3a/le9 0 2024-09-21T11:39:41.643 INFO:tasks.workunit.client.0.smithi118.stdout:6/723: truncate d8/d48/d45/de1/dbf/dcb/d70/fe3 776194 0 2024-09-21T11:39:41.644 INFO:tasks.workunit.client.0.smithi118.stdout:6/724: stat d8/d48/d45/de1/l75 0 2024-09-21T11:39:41.648 INFO:tasks.workunit.client.0.smithi118.stdout:2/820: write de/d16/d31/dce/d65/da2/d9b/f92 [549806,33809] 0 2024-09-21T11:39:41.653 INFO:tasks.workunit.client.0.smithi118.stdout:7/891: write d0/d3/d1d/d35/d57/d7e/d82/fd8 [1006704,81147] 0 2024-09-21T11:39:41.656 INFO:tasks.workunit.client.0.smithi118.stdout:2/821: rename de/d16/d31/dce/d66/fd5 to de/d1f/d20/d67/f118 0 2024-09-21T11:39:41.657 INFO:tasks.workunit.client.0.smithi118.stdout:7/892: symlink d0/d3/d1d/d35/d70/d10e/d110/d47/l127 0 2024-09-21T11:39:41.660 INFO:tasks.workunit.client.0.smithi118.stdout:2/822: rename de/d50/f81 to de/d51/f119 0 2024-09-21T11:39:41.662 INFO:tasks.workunit.client.0.smithi118.stdout:2/823: write de/d22/d3c/d83/f10f [672763,73846] 0 2024-09-21T11:39:41.669 INFO:tasks.workunit.client.0.smithi118.stdout:2/824: getdents de/d16/d25/dba 0 2024-09-21T11:39:41.671 INFO:tasks.workunit.client.0.smithi118.stdout:5/805: write d0/d6c/d25/d50/f91 [1134114,95019] 0 2024-09-21T11:39:41.679 INFO:tasks.workunit.client.0.smithi118.stdout:2/825: dwrite de/d16/ffc [0,4194304] 0 2024-09-21T11:39:41.683 INFO:tasks.workunit.client.0.smithi118.stdout:2/826: creat de/d1f/f11a x:0 0 0 2024-09-21T11:39:41.685 INFO:tasks.workunit.client.0.smithi118.stdout:9/807: truncate d0/f26 1504092 0 2024-09-21T11:39:41.686 INFO:tasks.workunit.client.0.smithi118.stdout:9/808: readlink d0/d20/d4c/d5f/d66/d98/leb 0 2024-09-21T11:39:41.686 INFO:tasks.workunit.client.0.smithi118.stdout:2/827: symlink de/d16/d31/dce/d66/l11b 0 2024-09-21T11:39:41.688 INFO:tasks.workunit.client.0.smithi118.stdout:2/828: write de/d16/d31/dce/d66/d9a/fa3 [635460,62475] 0 2024-09-21T11:39:41.691 INFO:tasks.workunit.client.0.smithi118.stdout:9/809: mkdir d0/d20/d4c/d5f/d6c/d88/d4d/de0/d122 0 2024-09-21T11:39:41.694 INFO:tasks.workunit.client.0.smithi118.stdout:6/725: dwrite d8/d14/d33/f88 [0,4194304] 0 2024-09-21T11:39:41.695 INFO:tasks.workunit.client.0.smithi118.stdout:2/829: rename de/d1f/d20/d67/d8a/d6d/d70/f90 to de/d16/d31/dce/d66/d9a/f11c 0 2024-09-21T11:39:41.700 INFO:tasks.workunit.client.0.smithi118.stdout:6/726: mkdir d8/d48/d45/de1/dbf/dcb/d70/dea 0 2024-09-21T11:39:41.703 INFO:tasks.workunit.client.0.smithi118.stdout:6/727: fdatasync d8/d48/d5f/da3/fa7 0 2024-09-21T11:39:41.704 INFO:tasks.workunit.client.0.smithi118.stdout:5/806: dwrite d0/db/d35/def/f70 [0,4194304] 0 2024-09-21T11:39:41.705 INFO:tasks.workunit.client.0.smithi118.stdout:5/807: stat d0/db/deb 0 2024-09-21T11:39:41.707 INFO:tasks.workunit.client.0.smithi118.stdout:5/808: chown d0/d6c/dba/cf7 205523 1 2024-09-21T11:39:41.709 INFO:tasks.workunit.client.0.smithi118.stdout:2/830: dwrite de/d51/f119 [0,4194304] 0 2024-09-21T11:39:41.711 INFO:tasks.workunit.client.0.smithi118.stdout:2/831: truncate de/d51/fad 4357739 0 2024-09-21T11:39:41.712 INFO:tasks.workunit.client.0.smithi118.stdout:9/810: creat d0/d20/d4c/d5f/d6c/f123 x:0 0 0 2024-09-21T11:39:41.712 INFO:tasks.workunit.client.0.smithi118.stdout:9/811: stat d0/f5c 0 2024-09-21T11:39:41.714 INFO:tasks.workunit.client.0.smithi118.stdout:6/728: truncate d8/d14/d33/fa6 738274 0 2024-09-21T11:39:41.719 INFO:tasks.workunit.client.0.smithi118.stdout:2/832: symlink de/d51/l11d 0 2024-09-21T11:39:41.723 INFO:tasks.workunit.client.0.smithi118.stdout:6/729: mkdir d8/d48/d5f/da3/deb 0 2024-09-21T11:39:41.724 INFO:tasks.workunit.client.0.smithi118.stdout:9/812: dread d0/d20/d4c/d5f/d6c/fa2 [0,4194304] 0 2024-09-21T11:39:41.724 INFO:tasks.workunit.client.0.smithi118.stdout:6/730: readlink d8/d48/d45/de1/dbf/dcb/l6f 0 2024-09-21T11:39:41.725 INFO:tasks.workunit.client.0.smithi118.stdout:6/731: truncate d8/f93 958350 0 2024-09-21T11:39:41.726 INFO:tasks.workunit.client.0.smithi118.stdout:9/813: read - d0/d20/d4c/d5f/d6c/d88/db4/f109 zero size 2024-09-21T11:39:41.728 INFO:tasks.workunit.client.0.smithi118.stdout:2/833: unlink de/d16/d31/dce/d65/da2/f6e 0 2024-09-21T11:39:41.731 INFO:tasks.workunit.client.0.smithi118.stdout:5/809: write d0/db/d35/d30/d1a/db3/fdb [749253,119819] 0 2024-09-21T11:39:41.732 INFO:tasks.workunit.client.0.smithi118.stdout:2/834: rename de/d16/d31/dce/l36 to de/d1f/d20/d67/d8a/d6d/d70/l11e 0 2024-09-21T11:39:41.733 INFO:tasks.workunit.client.0.smithi118.stdout:2/835: read - de/d53/dc2/fef zero size 2024-09-21T11:39:41.735 INFO:tasks.workunit.client.0.smithi118.stdout:5/810: symlink d0/db/d35/d30/d66/d100/l112 0 2024-09-21T11:39:41.738 INFO:tasks.workunit.client.0.smithi118.stdout:5/811: unlink d0/db/d35/d2c/d40/c6d 0 2024-09-21T11:39:41.739 INFO:tasks.workunit.client.0.smithi118.stdout:9/814: dread d0/d4/d45/f48 [0,4194304] 0 2024-09-21T11:39:41.742 INFO:tasks.workunit.client.0.smithi118.stdout:9/815: truncate d0/d20/d4c/d5f/d6c/d88/db4/f109 344946 0 2024-09-21T11:39:41.747 INFO:tasks.workunit.client.0.smithi118.stdout:2/836: dread de/d16/d31/f7c [0,4194304] 0 2024-09-21T11:39:41.748 INFO:tasks.workunit.client.0.smithi118.stdout:9/816: dread d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/fcd [0,4194304] 0 2024-09-21T11:39:41.751 INFO:tasks.workunit.client.0.smithi118.stdout:9/817: getdents d0/d4/d38/db8/dd2 0 2024-09-21T11:39:41.751 INFO:tasks.workunit.client.0.smithi118.stdout:5/812: dwrite d0/db/d35/d30/f52 [0,4194304] 0 2024-09-21T11:39:41.753 INFO:tasks.workunit.client.0.smithi118.stdout:9/818: rmdir d0/d4/d45/db5/d86 39 2024-09-21T11:39:41.756 INFO:tasks.workunit.client.0.smithi118.stdout:9/819: truncate d0/d20/d4c/d5f/d89/f9e 1223120 0 2024-09-21T11:39:41.759 INFO:tasks.workunit.client.0.smithi118.stdout:9/820: mknod d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/c124 0 2024-09-21T11:39:41.761 INFO:tasks.workunit.client.0.smithi118.stdout:9/821: chown d0/d20/d4c/d5f/d66/d98/fa9 303 1 2024-09-21T11:39:41.763 INFO:tasks.workunit.client.0.smithi118.stdout:5/813: dread d0/d6c/f5a [0,4194304] 0 2024-09-21T11:39:41.764 INFO:tasks.workunit.client.0.smithi118.stdout:5/814: stat d0/db/d35/d30/c2f 0 2024-09-21T11:39:41.764 INFO:tasks.workunit.client.0.smithi118.stdout:9/822: mkdir d0/d20/d4c/d5f/d66/d98/d125 0 2024-09-21T11:39:41.765 INFO:tasks.workunit.client.0.smithi118.stdout:5/815: chown d0/db/d35/da/cde 0 1 2024-09-21T11:39:41.767 INFO:tasks.workunit.client.0.smithi118.stdout:9/823: fdatasync d0/d20/d4c/d5f/d6c/d88/d4d/f82 0 2024-09-21T11:39:41.769 INFO:tasks.workunit.client.0.smithi118.stdout:5/816: creat d0/db/d35/d95/f113 x:0 0 0 2024-09-21T11:39:41.773 INFO:tasks.workunit.client.0.smithi118.stdout:9/824: truncate d0/d113/f94 1743738 0 2024-09-21T11:39:41.775 INFO:tasks.workunit.client.0.smithi118.stdout:5/817: write d0/db/d35/d30/d1a/f76 [2748640,49888] 0 2024-09-21T11:39:41.780 INFO:tasks.workunit.client.0.smithi118.stdout:5/818: write d0/f31 [3114247,124856] 0 2024-09-21T11:39:41.782 INFO:tasks.workunit.client.0.smithi118.stdout:5/819: write d0/d6c/d25/d50/fad [452317,863] 0 2024-09-21T11:39:41.784 INFO:tasks.workunit.client.0.smithi118.stdout:9/825: rename d0/d20/d4c/d5f/d6c/d88/d4d/c52 to d0/d20/d4c/d5f/d6c/c126 0 2024-09-21T11:39:41.794 INFO:tasks.workunit.client.0.smithi118.stdout:5/820: dread d0/db/d35/def/f62 [0,4194304] 0 2024-09-21T11:39:41.800 INFO:tasks.workunit.client.0.smithi118.stdout:5/821: dread d0/dbf/f108 [0,4194304] 0 2024-09-21T11:39:41.801 INFO:tasks.workunit.client.0.smithi118.stdout:9/826: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/fde [0,4194304] 0 2024-09-21T11:39:41.804 INFO:tasks.workunit.client.0.smithi118.stdout:5/822: creat d0/db/d35/d30/d1a/db3/f114 x:0 0 0 2024-09-21T11:39:41.804 INFO:tasks.workunit.client.0.smithi118.stdout:5/823: readlink d0/l88 0 2024-09-21T11:39:41.805 INFO:tasks.workunit.client.0.smithi118.stdout:9/827: read d0/d20/d71/f95 [401244,98248] 0 2024-09-21T11:39:41.807 INFO:tasks.workunit.client.0.smithi118.stdout:5/824: stat d0/db/d35/d2c/c9a 0 2024-09-21T11:39:41.811 INFO:tasks.workunit.client.0.smithi118.stdout:9/828: unlink d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/db2/lc4 0 2024-09-21T11:39:41.811 INFO:tasks.workunit.client.0.smithi118.stdout:5/825: dread d0/db/d35/d95/f98 [0,4194304] 0 2024-09-21T11:39:41.812 INFO:tasks.workunit.client.0.smithi118.stdout:9/829: readlink d0/d20/d4c/d5f/d66/la3 0 2024-09-21T11:39:41.813 INFO:tasks.workunit.client.0.smithi118.stdout:5/826: write d0/d89/f109 [257159,127641] 0 2024-09-21T11:39:41.815 INFO:tasks.workunit.client.0.smithi118.stdout:9/830: fsync d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/f83 0 2024-09-21T11:39:41.816 INFO:tasks.workunit.client.0.smithi118.stdout:5/827: rmdir d0/d6c/d25/d50 39 2024-09-21T11:39:41.818 INFO:tasks.workunit.client.0.smithi118.stdout:9/831: fsync d0/d20/d4c/d5f/d89/fd9 0 2024-09-21T11:39:41.819 INFO:tasks.workunit.client.0.smithi118.stdout:5/828: rename d0/dd1/df5 to d0/db/deb/d115 0 2024-09-21T11:39:41.823 INFO:tasks.workunit.client.0.smithi118.stdout:9/832: creat d0/d20/d4c/d5f/d89/f127 x:0 0 0 2024-09-21T11:39:41.829 INFO:tasks.workunit.client.0.smithi118.stdout:9/833: dwrite d0/de2/f114 [0,4194304] 0 2024-09-21T11:39:41.832 INFO:tasks.workunit.client.0.smithi118.stdout:9/834: rmdir d0/d113/de4/df4 39 2024-09-21T11:39:41.834 INFO:tasks.workunit.client.0.smithi118.stdout:5/829: truncate d0/d89/d9f/fa6 534437 0 2024-09-21T11:39:41.835 INFO:tasks.workunit.client.0.smithi118.stdout:9/835: creat d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/f128 x:0 0 0 2024-09-21T11:39:41.839 INFO:tasks.workunit.client.0.smithi118.stdout:5/830: creat d0/db/d35/d30/d1a/d8f/d99/f116 x:0 0 0 2024-09-21T11:39:41.855 INFO:tasks.workunit.client.0.smithi118.stdout:9/836: write d0/d20/d4c/d5f/f118 [2976778,7462] 0 2024-09-21T11:39:41.862 INFO:tasks.workunit.client.0.smithi118.stdout:9/837: creat d0/d4/d45/db5/d86/dd6/ddc/f129 x:0 0 0 2024-09-21T11:39:41.869 INFO:tasks.workunit.client.0.smithi118.stdout:9/838: rename d0/f1c to d0/d4/f12a 0 2024-09-21T11:39:41.874 INFO:tasks.workunit.client.0.smithi118.stdout:9/839: write d0/d20/d4c/d5f/d6c/d88/d4d/f82 [1059040,123172] 0 2024-09-21T11:39:41.881 INFO:tasks.workunit.client.0.smithi118.stdout:9/840: dwrite d0/d20/d4c/d5f/d66/d98/ffb [0,4194304] 0 2024-09-21T11:39:41.883 INFO:tasks.workunit.client.0.smithi118.stdout:9/841: symlink d0/d4/d38/db8/dd2/l12b 0 2024-09-21T11:39:41.884 INFO:tasks.workunit.client.0.smithi118.stdout:9/842: stat d0/fa1 0 2024-09-21T11:39:41.886 INFO:tasks.workunit.client.0.smithi118.stdout:9/843: mknod d0/d20/d4c/d5f/d6c/d88/d10d/c12c 0 2024-09-21T11:39:41.886 INFO:tasks.workunit.client.0.smithi118.stdout:9/844: chown d0/d20/d4c/d5f/d66/d98 1898957660 1 2024-09-21T11:39:41.888 INFO:tasks.workunit.client.0.smithi118.stdout:9/845: fsync d0/d4/d45/f48 0 2024-09-21T11:39:41.895 INFO:tasks.workunit.client.0.smithi118.stdout:9/846: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/f11c [0,4194304] 0 2024-09-21T11:39:41.905 INFO:tasks.workunit.client.0.smithi118.stdout:9/847: dwrite d0/d20/fc3 [0,4194304] 0 2024-09-21T11:39:41.923 INFO:tasks.workunit.client.0.smithi118.stdout:9/848: dwrite d0/fc [0,4194304] 0 2024-09-21T11:39:41.927 INFO:tasks.workunit.client.0.smithi118.stdout:9/849: chown d0/d20/d4c/d5f/d6c/d88/d4d/dca/cce 24792534 1 2024-09-21T11:39:41.930 INFO:tasks.workunit.client.0.smithi118.stdout:9/850: unlink d0/d20/d4c/d5f/c63 0 2024-09-21T11:39:41.932 INFO:tasks.workunit.client.0.smithi118.stdout:9/851: mknod d0/d4/d45/db5/c12d 0 2024-09-21T11:39:41.936 INFO:tasks.workunit.client.0.smithi118.stdout:9/852: symlink d0/d4/d45/da5/l12e 0 2024-09-21T11:39:41.943 INFO:tasks.workunit.client.0.smithi118.stdout:9/853: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/f58 [0,4194304] 0 2024-09-21T11:39:41.947 INFO:tasks.workunit.client.0.smithi118.stdout:9/854: mkdir d0/d20/d4c/d5f/d6c/d88/d4d/d12f 0 2024-09-21T11:39:41.954 INFO:tasks.workunit.client.0.smithi118.stdout:9/855: write d0/d20/d4c/d5f/d6c/d88/d4d/dca/fdd [938205,93956] 0 2024-09-21T11:39:41.961 INFO:tasks.workunit.client.0.smithi118.stdout:9/856: getdents d0/d20/d71 0 2024-09-21T11:39:41.961 INFO:tasks.workunit.client.0.smithi118.stdout:9/857: readlink d0/d20/d4c/d5f/l79 0 2024-09-21T11:39:41.967 INFO:tasks.workunit.client.0.smithi118.stdout:9/858: rmdir d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/db2/d115 0 2024-09-21T11:39:41.967 INFO:tasks.workunit.client.0.smithi118.stdout:9/859: stat d0 0 2024-09-21T11:39:41.974 INFO:tasks.workunit.client.0.smithi118.stdout:9/860: write d0/d113/f94 [2593579,37268] 0 2024-09-21T11:39:41.979 INFO:tasks.workunit.client.0.smithi118.stdout:9/861: unlink d0/d20/d4c/d5f/d6c/d88/d4d/dca/fdd 0 2024-09-21T11:39:41.989 INFO:tasks.workunit.client.0.smithi118.stdout:9/862: write d0/d4/d38/f60 [602392,23398] 0 2024-09-21T11:39:41.990 INFO:tasks.workunit.client.0.smithi118.stdout:9/863: dread - d0/d4/d38/f10c zero size 2024-09-21T11:39:41.991 INFO:tasks.workunit.client.0.smithi118.stdout:9/864: truncate d0/fb1 1110368 0 2024-09-21T11:39:42.006 INFO:tasks.workunit.client.0.smithi118.stdout:9/865: dread d0/d4/d45/db5/d86/ffe [0,4194304] 0 2024-09-21T11:39:42.009 INFO:tasks.workunit.client.0.smithi118.stdout:9/866: unlink d0/f13 0 2024-09-21T11:39:42.010 INFO:tasks.workunit.client.0.smithi118.stdout:9/867: fsync d0/d20/d4c/d5f/d6c/dd0/ffa 0 2024-09-21T11:39:42.012 INFO:tasks.workunit.client.0.smithi118.stdout:9/868: creat d0/d4/d45/db5/d86/dd6/f130 x:0 0 0 2024-09-21T11:39:42.014 INFO:tasks.workunit.client.0.smithi118.stdout:9/869: symlink d0/l131 0 2024-09-21T11:39:42.016 INFO:tasks.workunit.client.0.smithi118.stdout:9/870: unlink d0/d4/d45/db5/c51 0 2024-09-21T11:39:42.018 INFO:tasks.workunit.client.0.smithi118.stdout:9/871: unlink d0/d20/d4c/d5f/d6c/d88/d4d/dca/c10a 0 2024-09-21T11:39:42.021 INFO:tasks.workunit.client.0.smithi118.stdout:9/872: creat d0/d20/d4c/d5f/d6c/d88/d10d/f132 x:0 0 0 2024-09-21T11:39:42.023 INFO:tasks.workunit.client.0.smithi118.stdout:9/873: mknod d0/d20/d4c/d5f/d6c/dd0/c133 0 2024-09-21T11:39:42.025 INFO:tasks.workunit.client.0.smithi118.stdout:9/874: dread d0/d20/d4c/d5f/d6c/d88/db4/f109 [0,4194304] 0 2024-09-21T11:39:42.032 INFO:tasks.workunit.client.0.smithi118.stdout:9/875: link d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/f92 d0/d20/d4c/d5f/d6c/d88/f134 0 2024-09-21T11:39:42.032 INFO:tasks.workunit.client.0.smithi118.stdout:9/876: fsync d0/d20/d4c/d5f/f118 0 2024-09-21T11:39:42.036 INFO:tasks.workunit.client.0.smithi118.stdout:9/877: symlink d0/d4/d45/db5/l135 0 2024-09-21T11:39:42.038 INFO:tasks.workunit.client.0.smithi118.stdout:9/878: mknod d0/d4/d45/db5/d86/dd6/ddc/c136 0 2024-09-21T11:39:42.042 INFO:tasks.workunit.client.0.smithi118.stdout:9/879: dread - d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/f96 zero size 2024-09-21T11:39:42.042 INFO:tasks.workunit.client.0.smithi118.stdout:9/880: chown d0/d20/d4c/d5f/d6c/d88/d4d/f8a 1483976 1 2024-09-21T11:39:42.044 INFO:tasks.workunit.client.0.smithi118.stdout:9/881: rename d0/d20/d4c/d5f/d6c/d88/d4d/d12f to d0/d20/d4c/d5f/d6c/d88/d10d/d137 0 2024-09-21T11:39:42.066 INFO:tasks.workunit.client.0.smithi118.stdout:9/882: write d0/d20/d4c/d5f/d89/fd9 [725966,120762] 0 2024-09-21T11:39:42.067 INFO:tasks.workunit.client.0.smithi118.stdout:3/763: sync 2024-09-21T11:39:42.067 INFO:tasks.workunit.client.0.smithi118.stdout:4/910: sync 2024-09-21T11:39:42.067 INFO:tasks.workunit.client.0.smithi118.stdout:1/745: sync 2024-09-21T11:39:42.070 INFO:tasks.workunit.client.0.smithi118.stdout:1/746: mkdir d6/d2a/d3d/de5 0 2024-09-21T11:39:42.075 INFO:tasks.workunit.client.0.smithi118.stdout:3/764: dread d5/d1d/d1b/d50/fe0 [0,4194304] 0 2024-09-21T11:39:42.077 INFO:tasks.workunit.client.0.smithi118.stdout:4/911: dwrite d2/d6/de/d1c/d4d/dba/f12e [0,4194304] 0 2024-09-21T11:39:42.080 INFO:tasks.workunit.client.0.smithi118.stdout:1/747: getdents d6/d2a/dc2/d9e 0 2024-09-21T11:39:42.083 INFO:tasks.workunit.client.0.smithi118.stdout:9/883: dread d0/d4/f8 [0,4194304] 0 2024-09-21T11:39:42.088 INFO:tasks.workunit.client.0.smithi118.stdout:3/765: fdatasync d5/d1d/d1b/d4c/d73/d9b/f92 0 2024-09-21T11:39:42.088 INFO:tasks.workunit.client.0.smithi118.stdout:9/884: rmdir d0/d4/d45/db5/d86/dd6 39 2024-09-21T11:39:42.089 INFO:tasks.workunit.client.0.smithi118.stdout:3/766: readlink d5/d28/d3e/d5d/l64 0 2024-09-21T11:39:42.096 INFO:tasks.workunit.client.0.smithi118.stdout:1/748: creat d6/de/d16/d3f/d50/d54/fe6 x:0 0 0 2024-09-21T11:39:42.098 INFO:tasks.workunit.client.0.smithi118.stdout:9/885: creat d0/d20/d4c/d5f/d89/f138 x:0 0 0 2024-09-21T11:39:42.100 INFO:tasks.workunit.client.0.smithi118.stdout:4/912: link d2/d6/de/d1c/c2f d2/d6/de/d1c/d87/c137 0 2024-09-21T11:39:42.105 INFO:tasks.workunit.client.0.smithi118.stdout:1/749: link d6/d3b/fa9 d6/d33/fe7 0 2024-09-21T11:39:42.160 INFO:tasks.workunit.client.0.smithi118.stdout:4/913: link d2/d6/de/d1c/d4d/c8b d2/d6/de/d1c/d23/d26/d74/c138 0 2024-09-21T11:39:42.167 INFO:tasks.workunit.client.0.smithi118.stdout:4/914: dwrite d2/d6/de/d1c/d23/d26/f95 [0,4194304] 0 2024-09-21T11:39:42.174 INFO:tasks.workunit.client.0.smithi118.stdout:4/915: creat d2/d6/de/d1c/d87/da9/d97/d9b/f139 x:0 0 0 2024-09-21T11:39:42.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:41 smithi149 ceph-mon[36123]: pgmap v36: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 128 MiB/s wr, 372 op/s 2024-09-21T11:39:42.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:41 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:42.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:41 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:42.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:41 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:39:42.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:41 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:39:42.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:41 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:39:42.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:41 smithi149 ceph-mon[36123]: Upgrade: Need to upgrade myself (mgr.smithi149.xjglai) 2024-09-21T11:39:42.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:41 smithi149 ceph-mon[36123]: Upgrade: Need to upgrade myself (mgr.smithi149.xjglai) 2024-09-21T11:39:42.211 INFO:tasks.workunit.client.0.smithi118.stdout:1/750: write d6/d33/d3c/f42 [264649,82741] 0 2024-09-21T11:39:42.216 INFO:tasks.workunit.client.0.smithi118.stdout:1/751: creat d6/d3b/fe8 x:0 0 0 2024-09-21T11:39:42.221 INFO:tasks.workunit.client.0.smithi118.stdout:9/886: symlink d0/l139 0 2024-09-21T11:39:42.225 INFO:tasks.workunit.client.0.smithi118.stdout:9/887: mkdir d0/d20/d4c/d5f/d6c/d88/d10d/d13a 0 2024-09-21T11:39:42.232 INFO:tasks.workunit.client.0.smithi118.stdout:9/888: dwrite d0/d4/f29 [0,4194304] 0 2024-09-21T11:39:42.238 INFO:tasks.workunit.client.0.smithi118.stdout:9/889: rename d0/fbc to d0/d20/d4c/d5f/d6c/d88/d4d/dc2/f13b 0 2024-09-21T11:39:42.243 INFO:tasks.workunit.client.0.smithi118.stdout:9/890: creat d0/d20/d4c/d5f/d6c/d88/d10d/f13c x:0 0 0 2024-09-21T11:39:42.246 INFO:tasks.workunit.client.0.smithi118.stdout:9/891: creat d0/d20/d4c/d5f/d6c/d88/d4d/dc2/f13d x:0 0 0 2024-09-21T11:39:42.250 INFO:tasks.workunit.client.0.smithi118.stdout:3/767: creat d5/d1d/d1b/d4c/f111 x:0 0 0 2024-09-21T11:39:42.253 INFO:tasks.workunit.client.0.smithi118.stdout:3/768: creat d5/d1d/d1b/d24/dcd/f112 x:0 0 0 2024-09-21T11:39:42.256 INFO:tasks.workunit.client.0.smithi118.stdout:3/769: symlink d5/d28/d3e/d5d/dfd/l113 0 2024-09-21T11:39:42.259 INFO:tasks.workunit.client.0.smithi118.stdout:3/770: unlink d5/d28/d3e/d5d/dfd/ld1 0 2024-09-21T11:39:42.261 INFO:tasks.workunit.client.0.smithi118.stdout:4/916: creat d2/d6/de/d1c/d87/da9/d97/f13a x:0 0 0 2024-09-21T11:39:42.262 INFO:tasks.workunit.client.0.smithi118.stdout:3/771: mknod d5/d1d/d1b/d4c/d73/dc4/ded/c114 0 2024-09-21T11:39:42.262 INFO:tasks.workunit.client.0.smithi118.stdout:4/917: stat d2/d6/de/d1c/d4d/fca 0 2024-09-21T11:39:42.266 INFO:tasks.workunit.client.0.smithi118.stdout:1/752: write d6/de/d16/d3f/d50/fa6 [966034,50965] 0 2024-09-21T11:39:42.269 INFO:tasks.workunit.client.0.smithi118.stdout:4/918: dread d2/d6/de/d1c/f9c [0,4194304] 0 2024-09-21T11:39:42.272 INFO:tasks.workunit.client.0.smithi118.stdout:4/919: unlink d2/d6/de/d1c/d4d/d52/lf1 0 2024-09-21T11:39:42.273 INFO:tasks.workunit.client.0.smithi118.stdout:4/920: write d2/d6/de/d1c/ff6 [640421,124393] 0 2024-09-21T11:39:42.276 INFO:tasks.workunit.client.0.smithi118.stdout:9/892: write d0/fb1 [732458,102678] 0 2024-09-21T11:39:42.279 INFO:tasks.workunit.client.0.smithi118.stdout:9/893: dread d0/f5c [0,4194304] 0 2024-09-21T11:39:42.281 INFO:tasks.workunit.client.0.smithi118.stdout:9/894: write d0/d20/d4c/d5f/d66/d98/fba [5526030,69164] 0 2024-09-21T11:39:42.283 INFO:tasks.workunit.client.0.smithi118.stdout:1/753: dread d6/f15 [0,4194304] 0 2024-09-21T11:39:42.286 INFO:tasks.workunit.client.0.smithi118.stdout:1/754: readlink d6/de/d16/l63 0 2024-09-21T11:39:42.286 INFO:tasks.workunit.client.0.smithi118.stdout:3/772: write d5/d28/f65 [1370569,79666] 0 2024-09-21T11:39:42.290 INFO:tasks.workunit.client.0.smithi118.stdout:1/755: mknod d6/d33/d3c/ce9 0 2024-09-21T11:39:42.290 INFO:tasks.workunit.client.0.smithi118.stdout:1/756: dread - d6/d2a/d5c/fd5 zero size 2024-09-21T11:39:42.293 INFO:tasks.workunit.client.0.smithi118.stdout:1/757: creat d6/d2a/fea x:0 0 0 2024-09-21T11:39:42.298 INFO:tasks.workunit.client.0.smithi118.stdout:3/773: link d5/d1d/d1b/d4c/d91/f102 d5/d1d/d1b/d4c/f115 0 2024-09-21T11:39:42.299 INFO:tasks.workunit.client.0.smithi118.stdout:3/774: stat d5/d1d/d1b/d24/f60 0 2024-09-21T11:39:42.300 INFO:tasks.workunit.client.0.smithi118.stdout:1/758: getdents d6/d33 0 2024-09-21T11:39:42.301 INFO:tasks.workunit.client.0.smithi118.stdout:9/895: dwrite d0/d20/d4c/d5f/d89/f9e [0,4194304] 0 2024-09-21T11:39:42.303 INFO:tasks.workunit.client.0.smithi118.stdout:3/775: fdatasync d5/d1d/d1b/d24/f5b 0 2024-09-21T11:39:42.304 INFO:tasks.workunit.client.0.smithi118.stdout:1/759: fsync d6/de/d16/d3f/d50/d72/f80 0 2024-09-21T11:39:42.310 INFO:tasks.workunit.client.0.smithi118.stdout:1/760: stat d6/d3b/d45/c49 0 2024-09-21T11:39:42.310 INFO:tasks.workunit.client.0.smithi118.stdout:9/896: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/dca/ff2 [0,4194304] 0 2024-09-21T11:39:42.311 INFO:tasks.workunit.client.0.smithi118.stdout:9/897: readlink d0/d4/l9b 0 2024-09-21T11:39:42.314 INFO:tasks.workunit.client.0.smithi118.stdout:1/761: mknod d6/d3b/d45/ceb 0 2024-09-21T11:39:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:41 smithi118 ceph-mon[28757]: pgmap v36: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 128 MiB/s wr, 372 op/s 2024-09-21T11:39:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:41 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:41 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:41 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:39:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:41 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:39:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:41 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:39:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:41 smithi118 ceph-mon[28757]: Upgrade: Need to upgrade myself (mgr.smithi149.xjglai) 2024-09-21T11:39:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:41 smithi118 ceph-mon[28757]: Upgrade: Need to upgrade myself (mgr.smithi149.xjglai) 2024-09-21T11:39:42.424 INFO:tasks.workunit.client.0.smithi118.stdout:1/762: chown d6/de/d16/d3f/d50/d54/d32 1123481574 1 2024-09-21T11:39:42.425 INFO:tasks.workunit.client.0.smithi118.stdout:3/776: dread d5/d1d/d1b/d24/f36 [0,4194304] 0 2024-09-21T11:39:42.426 INFO:tasks.workunit.client.0.smithi118.stdout:1/763: write d6/de/f11 [3445128,90743] 0 2024-09-21T11:39:42.427 INFO:tasks.workunit.client.0.smithi118.stdout:9/898: dwrite d0/d4/d38/df6/f106 [0,4194304] 0 2024-09-21T11:39:42.438 INFO:tasks.workunit.client.0.smithi118.stdout:9/899: unlink d0/f26 0 2024-09-21T11:39:42.440 INFO:tasks.workunit.client.0.smithi118.stdout:3/777: link d5/d28/d3e/daa/fe1 d5/d28/d33/d4a/dc8/f116 0 2024-09-21T11:39:42.444 INFO:tasks.workunit.client.0.smithi118.stdout:3/778: mknod d5/d1d/d1b/d24/dcd/c117 0 2024-09-21T11:39:42.446 INFO:tasks.workunit.client.0.smithi118.stdout:1/764: dwrite d6/d33/d3c/f73 [0,4194304] 0 2024-09-21T11:39:42.455 INFO:tasks.workunit.client.0.smithi118.stdout:9/900: write d0/d20/d4c/d5f/d6c/fd8 [447968,96043] 0 2024-09-21T11:39:42.459 INFO:tasks.workunit.client.0.smithi118.stdout:9/901: rename d0/d20/d4c/d5f/d6c/d88/d4d/f105 to d0/d20/d4c/d5f/d66/d98/d125/f13e 0 2024-09-21T11:39:42.460 INFO:tasks.workunit.client.0.smithi118.stdout:9/902: chown d0/d4/d45/da5 172171080 1 2024-09-21T11:39:42.466 INFO:tasks.workunit.client.0.smithi118.stdout:1/765: dwrite d6/de/f1a [0,4194304] 0 2024-09-21T11:39:42.466 INFO:tasks.workunit.client.0.smithi118.stdout:3/779: dwrite d5/d28/f2b [0,4194304] 0 2024-09-21T11:39:42.467 INFO:tasks.workunit.client.0.smithi118.stdout:3/780: chown d5/d28/d33 33177 1 2024-09-21T11:39:42.471 INFO:tasks.workunit.client.0.smithi118.stdout:1/766: write d6/de/d16/d3f/d50/d72/f75 [3146529,85248] 0 2024-09-21T11:39:42.478 INFO:tasks.workunit.client.0.smithi118.stdout:3/781: creat d5/d28/d3e/d5d/dfd/daf/f118 x:0 0 0 2024-09-21T11:39:42.481 INFO:tasks.workunit.client.0.smithi118.stdout:1/767: unlink d6/d3b/d45/l61 0 2024-09-21T11:39:42.485 INFO:tasks.workunit.client.0.smithi118.stdout:9/903: dwrite d0/fb [4194304,4194304] 0 2024-09-21T11:39:42.489 INFO:tasks.workunit.client.0.smithi118.stdout:1/768: mkdir d6/d33/d3c/dec 0 2024-09-21T11:39:42.503 INFO:tasks.workunit.client.0.smithi118.stdout:1/769: link d6/d2a/d5c/d85/f9c d6/d2a/d5c/d85/fed 0 2024-09-21T11:39:42.516 INFO:tasks.workunit.client.0.smithi118.stdout:1/770: dread d6/d2a/f94 [0,4194304] 0 2024-09-21T11:39:42.536 INFO:tasks.workunit.client.0.smithi118.stdout:1/771: write d6/de/d13/f41 [1154047,97891] 0 2024-09-21T11:39:42.538 INFO:tasks.workunit.client.0.smithi118.stdout:1/772: mknod d6/d2a/cee 0 2024-09-21T11:39:42.541 INFO:tasks.workunit.client.0.smithi118.stdout:1/773: symlink d6/d33/d3c/dec/lef 0 2024-09-21T11:39:42.543 INFO:tasks.workunit.client.0.smithi118.stdout:1/774: fdatasync d6/d2a/d3d/db5/fe2 0 2024-09-21T11:39:42.565 INFO:tasks.workunit.client.0.smithi118.stdout:1/775: dwrite d6/f91 [0,4194304] 0 2024-09-21T11:39:43.232 INFO:tasks.workunit.client.0.smithi118.stdout:6/732: sync 2024-09-21T11:39:43.232 INFO:tasks.workunit.client.0.smithi118.stdout:7/893: sync 2024-09-21T11:39:43.235 INFO:tasks.workunit.client.0.smithi118.stdout:6/733: rmdir d8/d46/dca 39 2024-09-21T11:39:43.237 INFO:tasks.workunit.client.0.smithi118.stdout:7/894: dread d0/d3/d14/d41/f6f [4194304,4194304] 0 2024-09-21T11:39:43.239 INFO:tasks.workunit.client.0.smithi118.stdout:7/895: creat d0/d3/d14/d41/da0/f128 x:0 0 0 2024-09-21T11:39:43.240 INFO:tasks.workunit.client.0.smithi118.stdout:7/896: chown d0/d3/d14/d41/d7f/ce3 50363710 1 2024-09-21T11:39:43.244 INFO:tasks.workunit.client.0.smithi118.stdout:7/897: getdents d0/d3/d14/d41/d66/d6d 0 2024-09-21T11:39:43.248 INFO:tasks.workunit.client.0.smithi118.stdout:7/898: dread d0/d3/d1d/d35/f58 [0,4194304] 0 2024-09-21T11:39:43.254 INFO:tasks.workunit.client.0.smithi118.stdout:7/899: dwrite d0/d3/d14/d41/d66/d9d/fa6 [0,4194304] 0 2024-09-21T11:39:43.257 INFO:tasks.workunit.client.0.smithi118.stdout:7/900: rmdir d0/d3/d1d/d35/d70/d10e/d110/d5f 39 2024-09-21T11:39:43.258 INFO:tasks.workunit.client.0.smithi118.stdout:7/901: write d0/d3/d1d/d35/d70/fd4 [4386777,114997] 0 2024-09-21T11:39:43.260 INFO:tasks.workunit.client.0.smithi118.stdout:7/902: write d0/d3/d1d/d35/d70/fd4 [2735504,47192] 0 2024-09-21T11:39:43.263 INFO:tasks.workunit.client.0.smithi118.stdout:7/903: truncate d0/d3/d1d/f79 973252 0 2024-09-21T11:39:43.270 INFO:tasks.workunit.client.0.smithi118.stdout:7/904: dwrite d0/d3/d13/ff4 [0,4194304] 0 2024-09-21T11:39:43.281 INFO:tasks.workunit.client.0.smithi118.stdout:7/905: dread d0/d3/d14/d41/fbf [0,4194304] 0 2024-09-21T11:39:43.281 INFO:tasks.workunit.client.0.smithi118.stdout:7/906: stat d0/d3/d1d/l33 0 2024-09-21T11:39:43.284 INFO:tasks.workunit.client.0.smithi118.stdout:7/907: creat d0/d3/d14/d41/d66/f129 x:0 0 0 2024-09-21T11:39:43.285 INFO:tasks.workunit.client.0.smithi118.stdout:7/908: creat d0/d3/d13/dd5/f12a x:0 0 0 2024-09-21T11:39:43.287 INFO:tasks.workunit.client.0.smithi118.stdout:7/909: creat d0/d3/d14/d41/d7f/f12b x:0 0 0 2024-09-21T11:39:43.288 INFO:tasks.workunit.client.0.smithi118.stdout:7/910: rmdir d0/d3 39 2024-09-21T11:39:43.293 INFO:tasks.workunit.client.0.smithi118.stdout:7/911: rename d0/d3/d1d/l33 to d0/d3/d14/d41/d7f/l12c 0 2024-09-21T11:39:43.299 INFO:tasks.workunit.client.0.smithi118.stdout:7/912: link d0/d3/d1d/d35/d70/d10e/d110/d5f/d71/c121 d0/d3/d14/d41/d8b/da4/db2/d100/c12d 0 2024-09-21T11:39:43.301 INFO:tasks.workunit.client.0.smithi118.stdout:7/913: creat d0/d3/d1d/d35/d70/d10e/f12e x:0 0 0 2024-09-21T11:39:43.305 INFO:tasks.workunit.client.0.smithi118.stdout:7/914: link d0/d3/d1d/d35/f11a d0/d3/d1d/d35/d57/d7e/d82/f12f 0 2024-09-21T11:39:43.508 INFO:tasks.workunit.client.0.smithi118.stdout:5/831: sync 2024-09-21T11:39:43.509 INFO:tasks.workunit.client.0.smithi118.stdout:3/782: sync 2024-09-21T11:39:43.509 INFO:tasks.workunit.client.0.smithi118.stdout:2/837: sync 2024-09-21T11:39:43.509 INFO:tasks.workunit.client.0.smithi118.stdout:1/776: sync 2024-09-21T11:39:43.509 INFO:tasks.workunit.client.0.smithi118.stdout:4/921: sync 2024-09-21T11:39:43.509 INFO:tasks.workunit.client.0.smithi118.stdout:9/904: sync 2024-09-21T11:39:43.512 INFO:tasks.workunit.client.0.smithi118.stdout:9/905: dread - d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/f120 zero size 2024-09-21T11:39:43.515 INFO:tasks.workunit.client.0.smithi118.stdout:5/832: dwrite d0/d89/d9d/fc2 [0,4194304] 0 2024-09-21T11:39:43.536 INFO:tasks.workunit.client.0.smithi118.stdout:6/734: sync 2024-09-21T11:39:43.539 INFO:tasks.workunit.client.0.smithi118.stdout:2/838: read de/d1f/d20/d67/f9e [923748,25082] 0 2024-09-21T11:39:43.540 INFO:tasks.workunit.client.0.smithi118.stdout:4/922: symlink d2/d6/de/d1c/d4d/dba/l13b 0 2024-09-21T11:39:43.542 INFO:tasks.workunit.client.0.smithi118.stdout:1/777: rename d6/de/f11 to d6/d2a/d5c/db8/ff0 0 2024-09-21T11:39:43.543 INFO:tasks.workunit.client.0.smithi118.stdout:1/778: write d6/de/f1a [5974864,37105] 0 2024-09-21T11:39:43.543 INFO:tasks.workunit.client.0.smithi118.stdout:9/906: creat d0/d4/d38/db8/de9/f13f x:0 0 0 2024-09-21T11:39:43.547 INFO:tasks.workunit.client.0.smithi118.stdout:5/833: unlink d0/d6c/f8 0 2024-09-21T11:39:43.548 INFO:tasks.workunit.client.0.smithi118.stdout:6/735: truncate d8/f25 1812252 0 2024-09-21T11:39:43.552 INFO:tasks.workunit.client.0.smithi118.stdout:2/839: rmdir de/d16/d31/dce/d65/da2/d9b 39 2024-09-21T11:39:43.552 INFO:tasks.workunit.client.0.smithi118.stdout:2/840: chown de/d53 799482 1 2024-09-21T11:39:43.556 INFO:tasks.workunit.client.0.smithi118.stdout:4/923: dread d2/d6/de/d1c/f85 [0,4194304] 0 2024-09-21T11:39:43.567 INFO:tasks.workunit.client.0.smithi118.stdout:4/924: dread d2/d6/f18 [0,4194304] 0 2024-09-21T11:39:43.572 INFO:tasks.workunit.client.0.smithi118.stdout:3/783: creat d5/d1d/d1b/d4c/d73/f119 x:0 0 0 2024-09-21T11:39:43.573 INFO:tasks.workunit.client.0.smithi118.stdout:9/907: truncate d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/fd1 2562509 0 2024-09-21T11:39:43.575 INFO:tasks.workunit.client.0.smithi118.stdout:2/841: write de/d1f/d20/d67/d8a/d6d/d70/f93 [311553,24787] 0 2024-09-21T11:39:43.587 INFO:tasks.workunit.client.0.smithi118.stdout:6/736: mknod d8/d14/dc4/dcc/cec 0 2024-09-21T11:39:43.587 INFO:tasks.workunit.client.0.smithi118.stdout:3/784: symlink d5/d1d/d8c/l11a 0 2024-09-21T11:39:43.590 INFO:tasks.workunit.client.0.smithi118.stdout:7/915: sync 2024-09-21T11:39:43.591 INFO:tasks.workunit.client.0.smithi118.stdout:9/908: write d0/d4/d45/db5/d86/ffe [5825282,48760] 0 2024-09-21T11:39:43.594 INFO:tasks.workunit.client.0.smithi118.stdout:2/842: rename de/d1f/d20/d78/fb4 to de/d16/d31/dce/d66/f11f 0 2024-09-21T11:39:43.597 INFO:tasks.workunit.client.0.smithi118.stdout:3/785: dwrite d5/f7e [0,4194304] 0 2024-09-21T11:39:43.598 INFO:tasks.workunit.client.0.smithi118.stdout:2/843: chown de/d50/d85/faf 2076253 1 2024-09-21T11:39:43.599 INFO:tasks.workunit.client.0.smithi118.stdout:3/786: read d5/d1d/d1b/d24/f36 [417029,80184] 0 2024-09-21T11:39:43.601 INFO:tasks.workunit.client.0.smithi118.stdout:4/925: symlink d2/d6/de/d1c/l13c 0 2024-09-21T11:39:43.605 INFO:tasks.workunit.client.0.smithi118.stdout:7/916: dread d0/d3/d14/d41/d7f/d3e/f42 [4194304,4194304] 0 2024-09-21T11:39:43.610 INFO:tasks.workunit.client.0.smithi118.stdout:1/779: link d6/d2a/d3d/db9/fc9 d6/de/d16/d3f/d50/d54/ff1 0 2024-09-21T11:39:43.613 INFO:tasks.workunit.client.0.smithi118.stdout:2/844: symlink de/d16/d31/dce/d66/l120 0 2024-09-21T11:39:43.616 INFO:tasks.workunit.client.0.smithi118.stdout:4/926: creat d2/d6/de/d1c/d23/d26/dd6/dcb/db0/dcd/f13d x:0 0 0 2024-09-21T11:39:43.616 INFO:tasks.workunit.client.0.smithi118.stdout:5/834: getdents d0/db/d35/d30/d66/d100 0 2024-09-21T11:39:43.629 INFO:tasks.workunit.client.0.smithi118.stdout:6/737: link d8/d48/fe0 d8/d46/dca/fed 0 2024-09-21T11:39:43.630 INFO:tasks.workunit.client.0.smithi118.stdout:7/917: dread d0/d3/d1d/d35/d70/d10e/d110/f75 [0,4194304] 0 2024-09-21T11:39:43.631 INFO:tasks.workunit.client.0.smithi118.stdout:7/918: dread - d0/d3/fea zero size 2024-09-21T11:39:43.633 INFO:tasks.workunit.client.0.smithi118.stdout:9/909: dread d0/d20/d4c/d5f/d6c/d88/d4d/f82 [0,4194304] 0 2024-09-21T11:39:43.634 INFO:tasks.workunit.client.0.smithi118.stdout:2/845: symlink de/d16/l121 0 2024-09-21T11:39:43.634 INFO:tasks.workunit.client.0.smithi118.stdout:5/835: mkdir d0/d117 0 2024-09-21T11:39:43.636 INFO:tasks.workunit.client.0.smithi118.stdout:9/910: chown d0/d20/d4c/d5f/d6c/d88/d4d/f90 0 1 2024-09-21T11:39:43.639 INFO:tasks.workunit.client.0.smithi118.stdout:1/780: rmdir d6/de/dc7 0 2024-09-21T11:39:43.646 INFO:tasks.workunit.client.0.smithi118.stdout:2/846: mknod de/d16/d25/dba/c122 0 2024-09-21T11:39:43.648 INFO:tasks.workunit.client.0.smithi118.stdout:5/836: mkdir d0/db/d35/def/d92/d118 0 2024-09-21T11:39:43.649 INFO:tasks.workunit.client.0.smithi118.stdout:2/847: write de/d22/d3c/f107 [613288,119948] 0 2024-09-21T11:39:43.652 INFO:tasks.workunit.client.0.smithi118.stdout:4/927: dread d2/d6/de/d1c/d4d/d52/d69/f81 [0,4194304] 0 2024-09-21T11:39:43.653 INFO:tasks.workunit.client.0.smithi118.stdout:9/911: creat d0/d20/d4c/d5f/d6c/d88/d4d/de0/f140 x:0 0 0 2024-09-21T11:39:43.656 INFO:tasks.workunit.client.0.smithi118.stdout:7/919: dwrite d0/d3/d14/d41/d7f/d3e/f42 [4194304,4194304] 0 2024-09-21T11:39:43.656 INFO:tasks.workunit.client.0.smithi118.stdout:2/848: mknod de/d53/dc2/c123 0 2024-09-21T11:39:43.658 INFO:tasks.workunit.client.0.smithi118.stdout:1/781: read d6/de/d16/d3f/d50/d54/f39 [751838,123553] 0 2024-09-21T11:39:43.664 INFO:tasks.workunit.client.0.smithi118.stdout:2/849: creat de/d16/d31/dce/d65/f124 x:0 0 0 2024-09-21T11:39:43.664 INFO:tasks.workunit.client.0.smithi118.stdout:1/782: creat d6/d2a/d3d/ff2 x:0 0 0 2024-09-21T11:39:43.664 INFO:tasks.workunit.client.0.smithi118.stdout:9/912: read d0/d4/d45/db5/f80 [3261757,66593] 0 2024-09-21T11:39:43.664 INFO:tasks.workunit.client.0.smithi118.stdout:5/837: dwrite d0/db/d35/d30/d1a/db3/f114 [0,4194304] 0 2024-09-21T11:39:43.666 INFO:tasks.workunit.client.0.smithi118.stdout:1/783: fdatasync d6/de/f34 0 2024-09-21T11:39:43.671 INFO:tasks.workunit.client.0.smithi118.stdout:4/928: rename d2/d6/de/d1c/d87/da9/da8/deb/f104 to d2/d6/de/d1c/d87/da9/da8/f13e 0 2024-09-21T11:39:43.672 INFO:tasks.workunit.client.0.smithi118.stdout:9/913: dread - d0/d20/d4c/d5f/d6c/d88/d4d/dc2/f11b zero size 2024-09-21T11:39:43.673 INFO:tasks.workunit.client.0.smithi118.stdout:7/920: creat d0/d3/d14/d41/d8b/da4/db2/d100/f130 x:0 0 0 2024-09-21T11:39:43.676 INFO:tasks.workunit.client.0.smithi118.stdout:5/838: symlink d0/db/d35/dd5/l119 0 2024-09-21T11:39:43.678 INFO:tasks.workunit.client.0.smithi118.stdout:1/784: rename d6/de/d16/d3f/d50/d54/d32 to d6/d33/d3c/dec/df3 0 2024-09-21T11:39:43.678 INFO:tasks.workunit.client.0.smithi118.stdout:2/850: dwrite de/d16/d31/dce/d66/f10b [0,4194304] 0 2024-09-21T11:39:43.682 INFO:tasks.workunit.client.0.smithi118.stdout:4/929: rmdir d2/d6/de/d1c/d4d 39 2024-09-21T11:39:43.682 INFO:tasks.workunit.client.0.smithi118.stdout:9/914: creat d0/d4/d45/da5/f141 x:0 0 0 2024-09-21T11:39:43.683 INFO:tasks.workunit.client.0.smithi118.stdout:7/921: mknod d0/d3/d1d/c131 0 2024-09-21T11:39:43.695 INFO:tasks.workunit.client.0.smithi118.stdout:4/930: symlink d2/d6/de/d1c/d4d/l13f 0 2024-09-21T11:39:43.697 INFO:tasks.workunit.client.0.smithi118.stdout:5/839: link d0/db/d35/d2c/l7f d0/db/d35/da/dd7/d110/l11a 0 2024-09-21T11:39:43.700 INFO:tasks.workunit.client.0.smithi118.stdout:4/931: mkdir d2/d6/de/d1c/d23/d26/dd6/d5e/dfd/d140 0 2024-09-21T11:39:43.701 INFO:tasks.workunit.client.0.smithi118.stdout:5/840: creat d0/db/d35/dd5/f11b x:0 0 0 2024-09-21T11:39:43.703 INFO:tasks.workunit.client.0.smithi118.stdout:4/932: creat d2/d6/de/d1c/d87/da9/da8/f141 x:0 0 0 2024-09-21T11:39:43.704 INFO:tasks.workunit.client.0.smithi118.stdout:5/841: mknod d0/db/d35/d30/d1a/d8f/c11c 0 2024-09-21T11:39:43.706 INFO:tasks.workunit.client.0.smithi118.stdout:5/842: unlink d0/db/d35/d95/f98 0 2024-09-21T11:39:43.707 INFO:tasks.workunit.client.0.smithi118.stdout:4/933: truncate d2/d65/fa3 4023087 0 2024-09-21T11:39:43.708 INFO:tasks.workunit.client.0.smithi118.stdout:5/843: readlink d0/db/d35/d30/d1a/l1d 0 2024-09-21T11:39:43.719 INFO:tasks.workunit.client.0.smithi118.stdout:3/787: write d5/d1d/d1b/d24/dcd/fb3 [736168,82594] 0 2024-09-21T11:39:43.721 INFO:tasks.workunit.client.0.smithi118.stdout:3/788: creat d5/d28/d3e/d5d/dfd/dc9/f11b x:0 0 0 2024-09-21T11:39:43.723 INFO:tasks.workunit.client.0.smithi118.stdout:3/789: symlink d5/d1d/d1b/d4c/d73/d9b/l11c 0 2024-09-21T11:39:43.725 INFO:tasks.workunit.client.0.smithi118.stdout:3/790: creat d5/d28/f11d x:0 0 0 2024-09-21T11:39:43.726 INFO:tasks.workunit.client.0.smithi118.stdout:3/791: fsync d5/d28/d3e/d5d/d8d/fd7 0 2024-09-21T11:39:43.729 INFO:tasks.workunit.client.0.smithi118.stdout:6/738: write d8/d48/d5f/f80 [3127251,104089] 0 2024-09-21T11:39:43.732 INFO:tasks.workunit.client.0.smithi118.stdout:6/739: rename d8/f60 to d8/d48/d45/de1/dbf/dcb/d66/fee 0 2024-09-21T11:39:43.733 INFO:tasks.workunit.client.0.smithi118.stdout:6/740: dread - d8/d48/d5f/fce zero size 2024-09-21T11:39:43.734 INFO:tasks.workunit.client.0.smithi118.stdout:6/741: write d8/d14/d33/f3e [4309766,20008] 0 2024-09-21T11:39:43.736 INFO:tasks.workunit.client.0.smithi118.stdout:6/742: write d8/d48/d6c/d64/fa0 [601124,6856] 0 2024-09-21T11:39:43.743 INFO:tasks.workunit.client.0.smithi118.stdout:6/743: mkdir d8/d48/def 0 2024-09-21T11:39:43.745 INFO:tasks.workunit.client.0.smithi118.stdout:6/744: getdents d8/d46/dd2 0 2024-09-21T11:39:43.746 INFO:tasks.workunit.client.0.smithi118.stdout:6/745: dread - d8/d14/dba/fe5 zero size 2024-09-21T11:39:43.749 INFO:tasks.workunit.client.0.smithi118.stdout:7/922: write d0/d3/d1d/d35/f105 [1038579,58041] 0 2024-09-21T11:39:43.751 INFO:tasks.workunit.client.0.smithi118.stdout:2/851: truncate de/d16/d25/dba/fc1 1714039 0 2024-09-21T11:39:43.752 INFO:tasks.workunit.client.0.smithi118.stdout:7/923: fdatasync d0/d3/d14/d41/d66/dcf/ff2 0 2024-09-21T11:39:43.753 INFO:tasks.workunit.client.0.smithi118.stdout:9/915: truncate d0/d20/fc3 2419566 0 2024-09-21T11:39:43.754 INFO:tasks.workunit.client.0.smithi118.stdout:4/934: fdatasync d2/d6/de/d1c/d4d/d52/fb8 0 2024-09-21T11:39:43.755 INFO:tasks.workunit.client.0.smithi118.stdout:2/852: creat de/d1f/d20/d78/f125 x:0 0 0 2024-09-21T11:39:43.762 INFO:tasks.workunit.client.0.smithi118.stdout:2/853: symlink de/d16/d25/dba/db5/l126 0 2024-09-21T11:39:43.762 INFO:tasks.workunit.client.0.smithi118.stdout:5/844: write d0/db/d35/f3d [5616926,9684] 0 2024-09-21T11:39:43.763 INFO:tasks.workunit.client.0.smithi118.stdout:2/854: dread - de/d53/dc2/fef zero size 2024-09-21T11:39:43.763 INFO:tasks.workunit.client.0.smithi118.stdout:5/845: stat d0/db/d35/d30/d1a/d8f/la7 0 2024-09-21T11:39:43.763 INFO:tasks.workunit.client.0.smithi118.stdout:9/916: mkdir d0/d20/d4c/d5f/d89/df9/d142 0 2024-09-21T11:39:43.765 INFO:tasks.workunit.client.0.smithi118.stdout:2/855: write de/d50/d85/ff5 [2535944,14293] 0 2024-09-21T11:39:43.768 INFO:tasks.workunit.client.0.smithi118.stdout:3/792: write d5/d1d/d1b/d24/f36 [1912531,68769] 0 2024-09-21T11:39:43.769 INFO:tasks.workunit.client.0.smithi118.stdout:3/793: readlink d5/d28/d3e/l52 0 2024-09-21T11:39:43.772 INFO:tasks.workunit.client.0.smithi118.stdout:3/794: write d5/d1d/d1b/d4c/f111 [92177,121421] 0 2024-09-21T11:39:43.772 INFO:tasks.workunit.client.0.smithi118.stdout:2/856: symlink de/d22/d3c/d83/l127 0 2024-09-21T11:39:43.772 INFO:tasks.workunit.client.0.smithi118.stdout:5/846: dwrite d0/db/d35/def/d92/f9c [0,4194304] 0 2024-09-21T11:39:43.774 INFO:tasks.workunit.client.0.smithi118.stdout:9/917: truncate d0/d4/f12a 2042609 0 2024-09-21T11:39:43.774 INFO:tasks.workunit.client.0.smithi118.stdout:2/857: read - de/d1f/d20/d78/d98/fff zero size 2024-09-21T11:39:43.779 INFO:tasks.workunit.client.0.smithi118.stdout:2/858: unlink de/d53/dc2/c123 0 2024-09-21T11:39:43.787 INFO:tasks.workunit.client.0.smithi118.stdout:6/746: dwrite d8/d48/d6c/f9e [0,4194304] 0 2024-09-21T11:39:43.787 INFO:tasks.workunit.client.0.smithi118.stdout:3/795: rename d5/d28/d33/d4a/dc8/cf6 to d5/d28/d33/d4a/dc8/c11e 0 2024-09-21T11:39:43.794 INFO:tasks.workunit.client.0.smithi118.stdout:2/859: creat de/d16/d31/dce/d66/d9a/f128 x:0 0 0 2024-09-21T11:39:43.798 INFO:tasks.workunit.client.0.smithi118.stdout:4/935: write d2/d6/de/d1c/fcf [3331433,96989] 0 2024-09-21T11:39:43.798 INFO:tasks.workunit.client.0.smithi118.stdout:6/747: fsync d8/d14/f1d 0 2024-09-21T11:39:43.800 INFO:tasks.workunit.client.0.smithi118.stdout:7/924: dwrite d0/d3/d1d/f46 [0,4194304] 0 2024-09-21T11:39:43.814 INFO:tasks.workunit.client.0.smithi118.stdout:5/847: write d0/d6c/d25/f4f [5095770,3909] 0 2024-09-21T11:39:43.816 INFO:tasks.workunit.client.0.smithi118.stdout:9/918: write d0/d20/d71/faf [189039,26698] 0 2024-09-21T11:39:43.819 INFO:tasks.workunit.client.0.smithi118.stdout:6/748: dread d8/d14/f82 [0,4194304] 0 2024-09-21T11:39:43.821 INFO:tasks.workunit.client.0.smithi118.stdout:2/860: link de/d16/d31/lbb de/d1f/d20/d78/d98/l129 0 2024-09-21T11:39:43.823 INFO:tasks.workunit.client.0.smithi118.stdout:5/848: dwrite d0/db/d26/d65/fe0 [0,4194304] 0 2024-09-21T11:39:43.826 INFO:tasks.workunit.client.0.smithi118.stdout:6/749: read d8/d48/d45/de1/dbf/dcb/d70/fe3 [564973,106925] 0 2024-09-21T11:39:43.827 INFO:tasks.workunit.client.0.smithi118.stdout:9/919: dread d0/d20/d4c/d5f/d6c/d88/d4d/f82 [0,4194304] 0 2024-09-21T11:39:43.827 INFO:tasks.workunit.client.0.smithi118.stdout:7/925: dread d0/d3/d1d/d35/d57/f91 [0,4194304] 0 2024-09-21T11:39:43.828 INFO:tasks.workunit.client.0.smithi118.stdout:3/796: getdents d5/d28/d3e/d5d 0 2024-09-21T11:39:43.832 INFO:tasks.workunit.client.0.smithi118.stdout:6/750: dread d8/d48/d45/de1/dbf/dcb/d70/f84 [0,4194304] 0 2024-09-21T11:39:43.838 INFO:tasks.workunit.client.0.smithi118.stdout:2/861: rename de/d1f/l2e to de/d1f/d20/d67/d8a/d6d/d70/l12a 0 2024-09-21T11:39:43.842 INFO:tasks.workunit.client.0.smithi118.stdout:7/926: dread - d0/d3/d1d/d35/d57/d7e/d82/ff5 zero size 2024-09-21T11:39:43.843 INFO:tasks.workunit.client.0.smithi118.stdout:4/936: dwrite d2/f2d [0,4194304] 0 2024-09-21T11:39:43.847 INFO:tasks.workunit.client.0.smithi118.stdout:5/849: write d0/fd [2612473,29642] 0 2024-09-21T11:39:43.849 INFO:tasks.workunit.client.0.smithi118.stdout:2/862: mknod de/d16/d25/dba/db5/c12b 0 2024-09-21T11:39:43.853 INFO:tasks.workunit.client.0.smithi118.stdout:4/937: mkdir d2/d6/de/d1c/d87/da9/da8/deb/d142 0 2024-09-21T11:39:43.855 INFO:tasks.workunit.client.0.smithi118.stdout:6/751: link d8/d48/d45/de1/dbf/dcb/d70/d7d/fae d8/d48/d5f/da3/deb/ff0 0 2024-09-21T11:39:43.860 INFO:tasks.workunit.client.0.smithi118.stdout:3/797: truncate d5/d1d/d1b/d4c/d73/dc4/ded/ffb 3867474 0 2024-09-21T11:39:43.862 INFO:tasks.workunit.client.0.smithi118.stdout:3/798: dread d5/d1d/d1b/d50/fe0 [0,4194304] 0 2024-09-21T11:39:43.865 INFO:tasks.workunit.client.0.smithi118.stdout:2/863: mknod de/d53/dfa/c12c 0 2024-09-21T11:39:43.865 INFO:tasks.workunit.client.0.smithi118.stdout:9/920: link d0/d113/l112 d0/d20/d4c/d5f/l143 0 2024-09-21T11:39:43.867 INFO:tasks.workunit.client.0.smithi118.stdout:7/927: creat d0/d3/d1d/d35/d57/d96/d9e/f132 x:0 0 0 2024-09-21T11:39:43.869 INFO:tasks.workunit.client.0.smithi118.stdout:3/799: fsync d5/d1d/d1b/d4c/f56 0 2024-09-21T11:39:43.871 INFO:tasks.workunit.client.0.smithi118.stdout:5/850: dread d0/d89/d9d/fec [0,4194304] 0 2024-09-21T11:39:43.872 INFO:tasks.workunit.client.0.smithi118.stdout:2/864: dread de/d1f/d20/d67/d8a/d6d/d70/f93 [0,4194304] 0 2024-09-21T11:39:43.873 INFO:tasks.workunit.client.0.smithi118.stdout:4/938: dread d2/d6/de/d1c/d87/da9/f98 [0,4194304] 0 2024-09-21T11:39:43.875 INFO:tasks.workunit.client.0.smithi118.stdout:4/939: stat d2/d6/d12a/fb9 0 2024-09-21T11:39:43.877 INFO:tasks.workunit.client.0.smithi118.stdout:6/752: write d8/d46/f91 [2573577,103032] 0 2024-09-21T11:39:43.878 INFO:tasks.workunit.client.0.smithi118.stdout:7/928: mknod d0/d3/d13/dd5/c133 0 2024-09-21T11:39:43.882 INFO:tasks.workunit.client.0.smithi118.stdout:3/800: chown d5/d28/l2d 24313980 1 2024-09-21T11:39:43.882 INFO:tasks.workunit.client.0.smithi118.stdout:2/865: dwrite de/d51/fad [0,4194304] 0 2024-09-21T11:39:43.882 INFO:tasks.workunit.client.0.smithi118.stdout:7/929: write d0/d3/d14/d41/d7f/f11b [521692,92309] 0 2024-09-21T11:39:43.885 INFO:tasks.workunit.client.0.smithi118.stdout:5/851: mkdir d0/db/d35/d30/d66/d100/d11d 0 2024-09-21T11:39:43.885 INFO:tasks.workunit.client.0.smithi118.stdout:9/921: write d0/d113/f87 [652227,128189] 0 2024-09-21T11:39:43.887 INFO:tasks.workunit.client.0.smithi118.stdout:5/852: stat d0/db/d35/d30/d1a/db3/fe7 0 2024-09-21T11:39:43.997 INFO:tasks.workunit.client.0.smithi118.stdout:2/866: dread de/d51/fad [0,4194304] 0 2024-09-21T11:39:43.997 INFO:tasks.workunit.client.0.smithi118.stdout:3/801: rename d5/d28/d3e/d5d/d5f/f109 to d5/d1d/d1b/d24/dcd/dc1/f11f 0 2024-09-21T11:39:43.998 INFO:tasks.workunit.client.0.smithi118.stdout:6/753: write d8/f5c [2662971,49226] 0 2024-09-21T11:39:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:43 smithi118 ceph-mon[28757]: pgmap v37: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 37 MiB/s rd, 108 MiB/s wr, 319 op/s 2024-09-21T11:39:44.128 INFO:tasks.workunit.client.0.smithi118.stdout:2/867: fdatasync de/d16/d31/dce/d65/da2/d103/f10a 0 2024-09-21T11:39:44.128 INFO:tasks.workunit.client.0.smithi118.stdout:9/922: fdatasync d0/d4/d38/db8/de9/ff1 0 2024-09-21T11:39:44.130 INFO:tasks.workunit.client.0.smithi118.stdout:3/802: mkdir d5/d28/d3e/d5d/d5f/d88/d120 0 2024-09-21T11:39:44.131 INFO:tasks.workunit.client.0.smithi118.stdout:5/853: dwrite d0/f102 [0,4194304] 0 2024-09-21T11:39:44.132 INFO:tasks.workunit.client.0.smithi118.stdout:7/930: dread d0/d3/d1d/d35/d57/d7e/d82/ff7 [0,4194304] 0 2024-09-21T11:39:44.134 INFO:tasks.workunit.client.0.smithi118.stdout:7/931: chown d0/d3/d14/d41/d66/d6d/fd6 100 1 2024-09-21T11:39:44.135 INFO:tasks.workunit.client.0.smithi118.stdout:7/932: chown d0/d3/d14/d41/d7f/da2/f120 706981500 1 2024-09-21T11:39:44.141 INFO:tasks.workunit.client.0.smithi118.stdout:7/933: symlink d0/d3/d1d/d35/d57/d7e/l134 0 2024-09-21T11:39:44.143 INFO:tasks.workunit.client.0.smithi118.stdout:5/854: mknod d0/db/d35/d30/d66/dfc/c11e 0 2024-09-21T11:39:44.144 INFO:tasks.workunit.client.0.smithi118.stdout:2/868: getdents de/d16/d31/dce 0 2024-09-21T11:39:44.147 INFO:tasks.workunit.client.0.smithi118.stdout:6/754: dread d8/d46/dca/fed [0,4194304] 0 2024-09-21T11:39:44.147 INFO:tasks.workunit.client.0.smithi118.stdout:5/855: dread d0/d89/f109 [0,4194304] 0 2024-09-21T11:39:44.147 INFO:tasks.workunit.client.0.smithi118.stdout:5/856: stat d0/f83 0 2024-09-21T11:39:44.149 INFO:tasks.workunit.client.0.smithi118.stdout:7/934: mknod d0/d3/d1d/d35/d70/d10e/d110/d5f/de0/c135 0 2024-09-21T11:39:44.150 INFO:tasks.workunit.client.0.smithi118.stdout:2/869: rename de/d1f/d20/d67/f9e to de/d1f/d20/d67/d8a/f12d 0 2024-09-21T11:39:44.153 INFO:tasks.workunit.client.0.smithi118.stdout:5/857: mknod d0/db/d35/d30/d66/c11f 0 2024-09-21T11:39:44.155 INFO:tasks.workunit.client.0.smithi118.stdout:2/870: symlink de/d16/d25/dba/l12e 0 2024-09-21T11:39:44.158 INFO:tasks.workunit.client.0.smithi118.stdout:2/871: chown de/d50/d85/fab 760693011 1 2024-09-21T11:39:44.158 INFO:tasks.workunit.client.0.smithi118.stdout:9/923: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/f8a [0,4194304] 0 2024-09-21T11:39:44.160 INFO:tasks.workunit.client.0.smithi118.stdout:3/803: dwrite d5/d1d/d1b/d4c/d91/d69/ff2 [0,4194304] 0 2024-09-21T11:39:44.165 INFO:tasks.workunit.client.0.smithi118.stdout:2/872: dread - de/d16/d31/dce/d4f/d5b/fcf zero size 2024-09-21T11:39:44.169 INFO:tasks.workunit.client.0.smithi118.stdout:5/858: link d0/d6c/c2b d0/db/deb/c120 0 2024-09-21T11:39:44.169 INFO:tasks.workunit.client.0.smithi118.stdout:3/804: mknod d5/d1d/d1b/d4c/d104/c121 0 2024-09-21T11:39:44.173 INFO:tasks.workunit.client.0.smithi118.stdout:2/873: dwrite de/d16/d31/dce/d65/f124 [0,4194304] 0 2024-09-21T11:39:44.174 INFO:tasks.workunit.client.0.smithi118.stdout:5/859: creat d0/dd1/f121 x:0 0 0 2024-09-21T11:39:44.179 INFO:tasks.workunit.client.0.smithi118.stdout:2/874: mkdir de/d53/dfa/d12f 0 2024-09-21T11:39:44.182 INFO:tasks.workunit.client.0.smithi118.stdout:5/860: creat d0/d63/f122 x:0 0 0 2024-09-21T11:39:44.183 INFO:tasks.workunit.client.0.smithi118.stdout:2/875: creat de/d16/d31/dce/d4f/d5b/f130 x:0 0 0 2024-09-21T11:39:44.184 INFO:tasks.workunit.client.0.smithi118.stdout:3/805: creat d5/d1d/d1b/f122 x:0 0 0 2024-09-21T11:39:44.187 INFO:tasks.workunit.client.0.smithi118.stdout:2/876: creat de/d22/f131 x:0 0 0 2024-09-21T11:39:44.188 INFO:tasks.workunit.client.0.smithi118.stdout:5/861: mknod d0/db/d35/d2c/c123 0 2024-09-21T11:39:44.189 INFO:tasks.workunit.client.0.smithi118.stdout:3/806: unlink d5/f10 0 2024-09-21T11:39:44.190 INFO:tasks.workunit.client.0.smithi118.stdout:3/807: chown d5/f7e 680612609 1 2024-09-21T11:39:44.197 INFO:tasks.workunit.client.0.smithi118.stdout:2/877: dwrite de/d16/d31/dce/d65/da2/d103/f10a [0,4194304] 0 2024-09-21T11:39:44.198 INFO:tasks.workunit.client.0.smithi118.stdout:9/924: dread d0/d20/d4c/d5f/f118 [0,4194304] 0 2024-09-21T11:39:44.198 INFO:tasks.workunit.client.0.smithi118.stdout:5/862: dwrite d0/db/d35/def/d92/f104 [0,4194304] 0 2024-09-21T11:39:44.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:43 smithi149 ceph-mon[36123]: pgmap v37: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 37 MiB/s rd, 108 MiB/s wr, 319 op/s 2024-09-21T11:39:44.201 INFO:tasks.workunit.client.0.smithi118.stdout:9/925: read d0/d4/f29 [2522184,95117] 0 2024-09-21T11:39:44.208 INFO:tasks.workunit.client.0.smithi118.stdout:9/926: truncate d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/f11c 4371944 0 2024-09-21T11:39:44.210 INFO:tasks.workunit.client.0.smithi118.stdout:5/863: creat d0/db/deb/d115/f124 x:0 0 0 2024-09-21T11:39:44.214 INFO:tasks.workunit.client.0.smithi118.stdout:2/878: rename de/d53/dfa/c12c to de/d22/d3c/d83/c132 0 2024-09-21T11:39:44.215 INFO:tasks.workunit.client.0.smithi118.stdout:3/808: rename d5/d1d/d1b/d4c/l5e to d5/d1d/d1b/d4c/l123 0 2024-09-21T11:39:44.218 INFO:tasks.workunit.client.0.smithi118.stdout:5/864: truncate d0/d6c/f6a 2250846 0 2024-09-21T11:39:44.219 INFO:tasks.workunit.client.0.smithi118.stdout:5/865: fsync d0/db/d35/f4d 0 2024-09-21T11:39:44.220 INFO:tasks.workunit.client.0.smithi118.stdout:5/866: read - d0/d63/fed zero size 2024-09-21T11:39:44.222 INFO:tasks.workunit.client.0.smithi118.stdout:3/809: creat d5/d1d/d1b/d4c/d91/d69/f124 x:0 0 0 2024-09-21T11:39:44.229 INFO:tasks.workunit.client.0.smithi118.stdout:3/810: unlink d5/d28/d3e/fe5 0 2024-09-21T11:39:44.230 INFO:tasks.workunit.client.0.smithi118.stdout:3/811: readlink d5/d28/d3e/d5d/l64 0 2024-09-21T11:39:44.233 INFO:tasks.workunit.client.0.smithi118.stdout:9/927: write d0/d4/d45/f48 [1207407,27451] 0 2024-09-21T11:39:44.236 INFO:tasks.workunit.client.0.smithi118.stdout:9/928: chown d0/l1b 356592717 1 2024-09-21T11:39:44.240 INFO:tasks.workunit.client.0.smithi118.stdout:2/879: dwrite de/f12 [0,4194304] 0 2024-09-21T11:39:44.241 INFO:tasks.workunit.client.0.smithi118.stdout:5/867: truncate d0/dbf/f108 61431 0 2024-09-21T11:39:44.244 INFO:tasks.workunit.client.0.smithi118.stdout:9/929: rename d0/de2/cf0 to d0/d20/d4c/d5f/d6c/d88/d10d/d111/c144 0 2024-09-21T11:39:44.249 INFO:tasks.workunit.client.0.smithi118.stdout:3/812: dwrite d5/d1d/d1b/d4c/d91/f102 [0,4194304] 0 2024-09-21T11:39:44.251 INFO:tasks.workunit.client.0.smithi118.stdout:9/930: rename d0/d113/f94 to d0/d113/f145 0 2024-09-21T11:39:44.255 INFO:tasks.workunit.client.0.smithi118.stdout:5/868: creat d0/db/d35/def/d92/d118/f125 x:0 0 0 2024-09-21T11:39:44.257 INFO:tasks.workunit.client.0.smithi118.stdout:3/813: dwrite d5/d28/d3e/d5d/dfd/dc9/f10b [0,4194304] 0 2024-09-21T11:39:44.262 INFO:tasks.workunit.client.0.smithi118.stdout:5/869: mknod d0/dd1/c126 0 2024-09-21T11:39:44.264 INFO:tasks.workunit.client.0.smithi118.stdout:5/870: truncate d0/db/d35/def/d92/f9c 4368314 0 2024-09-21T11:39:44.265 INFO:tasks.workunit.client.0.smithi118.stdout:2/880: link de/d16/d25/cbc de/d1f/d20/d67/c133 0 2024-09-21T11:39:44.265 INFO:tasks.workunit.client.0.smithi118.stdout:5/871: write d0/db/d35/f4d [2435988,110508] 0 2024-09-21T11:39:44.266 INFO:tasks.workunit.client.0.smithi118.stdout:9/931: symlink d0/d20/d4c/d5f/d6c/d88/d10d/d13a/l146 0 2024-09-21T11:39:44.268 INFO:tasks.workunit.client.0.smithi118.stdout:9/932: mkdir d0/d4/d38/db8/dd2/d147 0 2024-09-21T11:39:44.269 INFO:tasks.workunit.client.0.smithi118.stdout:2/881: truncate de/d1f/d20/d67/d8a/fac 1201503 0 2024-09-21T11:39:44.270 INFO:tasks.workunit.client.0.smithi118.stdout:9/933: truncate d0/d20/d4c/d5f/d6c/d88/d4d/dc2/f13d 584861 0 2024-09-21T11:39:44.272 INFO:tasks.workunit.client.0.smithi118.stdout:2/882: creat de/d22/d3c/d83/f134 x:0 0 0 2024-09-21T11:39:44.274 INFO:tasks.workunit.client.0.smithi118.stdout:2/883: rename de/d51/f5c to de/d53/dfa/d12f/f135 0 2024-09-21T11:39:44.275 INFO:tasks.workunit.client.0.smithi118.stdout:9/934: creat d0/d4/d38/f148 x:0 0 0 2024-09-21T11:39:44.277 INFO:tasks.workunit.client.0.smithi118.stdout:2/884: creat de/d53/dfa/f136 x:0 0 0 2024-09-21T11:39:44.279 INFO:tasks.workunit.client.0.smithi118.stdout:9/935: getdents d0/d20/d4c/d5f/d89/df9/d142 0 2024-09-21T11:39:44.280 INFO:tasks.workunit.client.0.smithi118.stdout:2/885: write de/d16/d31/f7c [808734,10331] 0 2024-09-21T11:39:44.294 INFO:tasks.workunit.client.0.smithi118.stdout:2/886: dread de/d16/ffc [0,4194304] 0 2024-09-21T11:39:44.297 INFO:tasks.workunit.client.0.smithi118.stdout:2/887: rename de/d16/d31/dce/d4f/d5b/fcf to de/d16/d31/dce/d4f/d5b/f137 0 2024-09-21T11:39:44.304 INFO:tasks.workunit.client.0.smithi118.stdout:2/888: dread f8 [0,4194304] 0 2024-09-21T11:39:44.310 INFO:tasks.workunit.client.0.smithi118.stdout:2/889: link de/d16/d25/c29 de/d1f/d20/d67/d8a/c138 0 2024-09-21T11:39:44.313 INFO:tasks.workunit.client.0.smithi118.stdout:2/890: dread de/f12 [0,4194304] 0 2024-09-21T11:39:44.315 INFO:tasks.workunit.client.0.smithi118.stdout:2/891: creat de/d22/d3c/f139 x:0 0 0 2024-09-21T11:39:44.320 INFO:tasks.workunit.client.0.smithi118.stdout:2/892: dwrite de/f1e [0,4194304] 0 2024-09-21T11:39:44.334 INFO:tasks.workunit.client.0.smithi118.stdout:9/936: dread d0/d20/d71/f95 [0,4194304] 0 2024-09-21T11:39:44.433 INFO:tasks.workunit.client.0.smithi118.stdout:3/814: write d5/d1d/d1b/d24/f60 [2916041,75798] 0 2024-09-21T11:39:44.433 INFO:tasks.workunit.client.0.smithi118.stdout:3/815: chown f2 953379287 1 2024-09-21T11:39:44.436 INFO:tasks.workunit.client.0.smithi118.stdout:3/816: fsync d5/d1d/d1b/d24/dcd/fbb 0 2024-09-21T11:39:44.437 INFO:tasks.workunit.client.0.smithi118.stdout:3/817: fdatasync d5/d28/d3e/d5d/d8d/fd7 0 2024-09-21T11:39:44.441 INFO:tasks.workunit.client.0.smithi118.stdout:3/818: truncate d5/d1d/d1b/d4c/f6e 496217 0 2024-09-21T11:39:44.446 INFO:tasks.workunit.client.0.smithi118.stdout:3/819: getdents d5/d1d/d1b/d4c/d91/d69 0 2024-09-21T11:39:44.448 INFO:tasks.workunit.client.0.smithi118.stdout:3/820: symlink d5/d1d/d1b/d24/dcd/l125 0 2024-09-21T11:39:44.454 INFO:tasks.workunit.client.0.smithi118.stdout:3/821: dwrite d5/d28/d3e/daa/f100 [0,4194304] 0 2024-09-21T11:39:44.455 INFO:tasks.workunit.client.0.smithi118.stdout:3/822: rmdir d5/d1d/d1b/d4c/d73/d9b 39 2024-09-21T11:39:44.462 INFO:tasks.workunit.client.0.smithi118.stdout:3/823: link d5/d1d/c1e d5/d1d/d1b/d50/c126 0 2024-09-21T11:39:44.463 INFO:tasks.workunit.client.0.smithi118.stdout:2/893: write de/d1f/f96 [667976,127322] 0 2024-09-21T11:39:44.465 INFO:tasks.workunit.client.0.smithi118.stdout:2/894: write de/d16/fe8 [305481,77331] 0 2024-09-21T11:39:44.466 INFO:tasks.workunit.client.0.smithi118.stdout:2/895: chown de/d16/d31/dce/l9f 2 1 2024-09-21T11:39:44.467 INFO:tasks.workunit.client.0.smithi118.stdout:2/896: chown de/d16/d31/dce/ce3 0 1 2024-09-21T11:39:44.467 INFO:tasks.workunit.client.0.smithi118.stdout:3/824: rename d5/d1d/d1b/d24/dcd/f112 to d5/d28/d3e/d5d/dfd/f127 0 2024-09-21T11:39:44.468 INFO:tasks.workunit.client.0.smithi118.stdout:2/897: dread - de/d50/d85/fab zero size 2024-09-21T11:39:44.470 INFO:tasks.workunit.client.0.smithi118.stdout:3/825: write d5/d1d/d1b/d4c/d73/d9b/fda [569986,118626] 0 2024-09-21T11:39:44.473 INFO:tasks.workunit.client.0.smithi118.stdout:9/937: dwrite d0/f4a [0,4194304] 0 2024-09-21T11:39:44.479 INFO:tasks.workunit.client.0.smithi118.stdout:9/938: creat d0/d20/d4c/f149 x:0 0 0 2024-09-21T11:39:44.483 INFO:tasks.workunit.client.0.smithi118.stdout:3/826: getdents d5/d28/d3e/d5d/d5f 0 2024-09-21T11:39:44.486 INFO:tasks.workunit.client.0.smithi118.stdout:9/939: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/dc2/f13d [0,4194304] 0 2024-09-21T11:39:44.494 INFO:tasks.workunit.client.0.smithi118.stdout:3/827: fdatasync d5/d1d/d1b/d50/dc6/ffa 0 2024-09-21T11:39:44.495 INFO:tasks.workunit.client.0.smithi118.stdout:9/940: creat d0/d20/d4c/d5f/d66/f14a x:0 0 0 2024-09-21T11:39:44.543 INFO:tasks.workunit.client.0.smithi118.stdout:3/828: stat d5/d28/f47 0 2024-09-21T11:39:44.546 INFO:tasks.workunit.client.0.smithi118.stdout:3/829: write d5/d1d/fd5 [2358928,51831] 0 2024-09-21T11:39:44.548 INFO:tasks.workunit.client.0.smithi118.stdout:3/830: dread d5/d1d/d1b/d4c/d91/fdb [0,4194304] 0 2024-09-21T11:39:44.549 INFO:tasks.workunit.client.0.smithi118.stdout:3/831: readlink d5/d1d/d1b/d4c/d73/d9b/l86 0 2024-09-21T11:39:44.549 INFO:tasks.workunit.client.0.smithi118.stdout:3/832: readlink d5/d1d/d1b/d4c/d91/d69/lff 0 2024-09-21T11:39:44.552 INFO:tasks.workunit.client.0.smithi118.stdout:3/833: creat d5/d28/d33/d4a/dc8/f128 x:0 0 0 2024-09-21T11:39:44.557 INFO:tasks.workunit.client.0.smithi118.stdout:3/834: link d5/d28/d33/d4a/f79 d5/d28/d33/f129 0 2024-09-21T11:39:44.559 INFO:tasks.workunit.client.0.smithi118.stdout:3/835: symlink d5/d1d/l12a 0 2024-09-21T11:39:44.562 INFO:tasks.workunit.client.0.smithi118.stdout:3/836: creat d5/d1d/d1b/d4c/d73/d9b/f12b x:0 0 0 2024-09-21T11:39:44.565 INFO:tasks.workunit.client.0.smithi118.stdout:3/837: dread d5/d1d/d1b/d4c/f9e [0,4194304] 0 2024-09-21T11:39:44.568 INFO:tasks.workunit.client.0.smithi118.stdout:3/838: unlink d5/d28/d33/l7a 0 2024-09-21T11:39:44.570 INFO:tasks.workunit.client.0.smithi118.stdout:3/839: creat d5/d1d/f12c x:0 0 0 2024-09-21T11:39:44.571 INFO:tasks.workunit.client.0.smithi118.stdout:3/840: write d5/d1d/d1b/d4c/d73/f119 [57238,14305] 0 2024-09-21T11:39:44.572 INFO:tasks.workunit.client.0.smithi118.stdout:3/841: fdatasync d5/d1d/f32 0 2024-09-21T11:39:44.584 INFO:tasks.workunit.client.0.smithi118.stdout:9/941: dwrite d0/d20/f93 [0,4194304] 0 2024-09-21T11:39:44.593 INFO:tasks.workunit.client.0.smithi118.stdout:9/942: dwrite d0/d113/f87 [0,4194304] 0 2024-09-21T11:39:44.602 INFO:tasks.workunit.client.0.smithi118.stdout:9/943: dwrite d0/d20/d4c/d5f/d89/f127 [0,4194304] 0 2024-09-21T11:39:44.610 INFO:tasks.workunit.client.0.smithi118.stdout:9/944: creat d0/d4/f14b x:0 0 0 2024-09-21T11:39:44.611 INFO:tasks.workunit.client.0.smithi118.stdout:9/945: dread - d0/f7e zero size 2024-09-21T11:39:44.615 INFO:tasks.workunit.client.0.smithi118.stdout:9/946: fsync d0/d20/d4c/d5f/d6c/d88/d4d/dca/fec 0 2024-09-21T11:39:44.619 INFO:tasks.workunit.client.0.smithi118.stdout:3/842: dwrite d5/f57 [0,4194304] 0 2024-09-21T11:39:44.621 INFO:tasks.workunit.client.0.smithi118.stdout:9/947: symlink d0/d20/d4c/d5f/d6c/d88/d4d/l14c 0 2024-09-21T11:39:44.622 INFO:tasks.workunit.client.0.smithi118.stdout:3/843: mknod d5/d1d/c12d 0 2024-09-21T11:39:44.623 INFO:tasks.workunit.client.0.smithi118.stdout:9/948: chown d0/l1b 733826530 1 2024-09-21T11:39:44.625 INFO:tasks.workunit.client.0.smithi118.stdout:9/949: mkdir d0/d4/d38/d14d 0 2024-09-21T11:39:44.629 INFO:tasks.workunit.client.0.smithi118.stdout:3/844: link d5/d1d/d1b/d24/f36 d5/d28/d33/d4a/f12e 0 2024-09-21T11:39:44.634 INFO:tasks.workunit.client.0.smithi118.stdout:3/845: dread d5/d28/d3e/d5d/d8d/fd7 [0,4194304] 0 2024-09-21T11:39:44.659 INFO:tasks.workunit.client.0.smithi118.stdout:9/950: dread d0/d4/d38/f60 [0,4194304] 0 2024-09-21T11:39:44.661 INFO:tasks.workunit.client.0.smithi118.stdout:9/951: chown d0/c6a 0 1 2024-09-21T11:39:44.666 INFO:tasks.workunit.client.0.smithi118.stdout:3/846: dwrite d5/d1d/d1b/d4c/f6e [0,4194304] 0 2024-09-21T11:39:44.672 INFO:tasks.workunit.client.0.smithi118.stdout:9/952: creat d0/d4/d38/df6/d119/f14e x:0 0 0 2024-09-21T11:39:44.673 INFO:tasks.workunit.client.0.smithi118.stdout:3/847: rmdir d5/d28/d33 39 2024-09-21T11:39:44.674 INFO:tasks.workunit.client.0.smithi118.stdout:9/953: write d0/d20/d4c/d5f/d66/d98/ffb [2574413,22822] 0 2024-09-21T11:39:44.676 INFO:tasks.workunit.client.0.smithi118.stdout:9/954: read d0/d4/d38/db8/de9/ff1 [34894,54088] 0 2024-09-21T11:39:44.679 INFO:tasks.workunit.client.0.smithi118.stdout:3/848: rmdir d5/d1d/d1b/d4c/d73/d9b 39 2024-09-21T11:39:44.685 INFO:tasks.workunit.client.0.smithi118.stdout:9/955: fdatasync d0/d4/f3d 0 2024-09-21T11:39:44.687 INFO:tasks.workunit.client.0.smithi118.stdout:3/849: unlink d5/d28/d33/d4a/f12e 0 2024-09-21T11:39:44.695 INFO:tasks.workunit.client.0.smithi118.stdout:3/850: write d5/d28/d3e/daa/fd8 [35176,29203] 0 2024-09-21T11:39:44.698 INFO:tasks.workunit.client.0.smithi118.stdout:3/851: dread - d5/d28/d3e/d5d/dfd/dc9/ff9 zero size 2024-09-21T11:39:44.698 INFO:tasks.workunit.client.0.smithi118.stdout:3/852: symlink d5/d28/d3e/d5d/l12f 0 2024-09-21T11:39:44.700 INFO:tasks.workunit.client.0.smithi118.stdout:3/853: chown d5/d28/d33/d4a/dc8/c11e 576 1 2024-09-21T11:39:44.703 INFO:tasks.workunit.client.0.smithi118.stdout:3/854: getdents d5/d1d/d1b/d4c 0 2024-09-21T11:39:44.707 INFO:tasks.workunit.client.0.smithi118.stdout:3/855: dread d5/d1d/d1b/d24/f6c [0,4194304] 0 2024-09-21T11:39:44.843 INFO:tasks.workunit.client.0.smithi118.stdout:1/785: sync 2024-09-21T11:39:44.856 INFO:tasks.workunit.client.0.smithi118.stdout:1/786: dread d6/d2a/dc2/fcd [0,4194304] 0 2024-09-21T11:39:44.859 INFO:tasks.workunit.client.0.smithi118.stdout:1/787: creat d6/d3b/ff4 x:0 0 0 2024-09-21T11:39:44.870 INFO:tasks.workunit.client.0.smithi118.stdout:1/788: dread d6/d2a/d3d/db5/fe2 [0,4194304] 0 2024-09-21T11:39:44.870 INFO:tasks.workunit.client.0.smithi118.stdout:1/789: readlink d6/l2b 0 2024-09-21T11:39:44.881 INFO:tasks.workunit.client.0.smithi118.stdout:1/790: dread d6/d2a/dc2/d9e/faa [0,4194304] 0 2024-09-21T11:39:44.884 INFO:tasks.workunit.client.0.smithi118.stdout:1/791: link d6/d3b/f43 d6/ff5 0 2024-09-21T11:39:44.902 INFO:tasks.workunit.client.0.smithi118.stdout:1/792: dread d6/d2a/f28 [0,4194304] 0 2024-09-21T11:39:44.902 INFO:tasks.workunit.client.0.smithi118.stdout:1/793: mkdir d6/de/d16/d3f/d50/df6 0 2024-09-21T11:39:44.903 INFO:tasks.workunit.client.0.smithi118.stdout:1/794: fsync d6/de/d16/fd6 0 2024-09-21T11:39:44.908 INFO:tasks.workunit.client.0.smithi118.stdout:1/795: fdatasync d6/d2a/fbb 0 2024-09-21T11:39:44.910 INFO:tasks.workunit.client.0.smithi118.stdout:1/796: readlink d6/de/d16/d3f/d50/d54/l4e 0 2024-09-21T11:39:44.913 INFO:tasks.workunit.client.0.smithi118.stdout:1/797: mknod d6/d2a/d3d/db9/cf7 0 2024-09-21T11:39:44.913 INFO:tasks.workunit.client.0.smithi118.stdout:1/798: stat d6/de/d16/d3f/d50/fb7 0 2024-09-21T11:39:44.914 INFO:tasks.workunit.client.0.smithi118.stdout:1/799: chown d6/de/d16/d3f/d50/df6 2 1 2024-09-21T11:39:44.921 INFO:tasks.workunit.client.0.smithi118.stdout:1/800: write d6/d2a/f3a [526297,118138] 0 2024-09-21T11:39:44.925 INFO:tasks.workunit.client.0.smithi118.stdout:1/801: mkdir d6/de/d16/ddd/df8 0 2024-09-21T11:39:44.935 INFO:tasks.workunit.client.0.smithi118.stdout:1/802: dread d6/de/d13/f1c [0,4194304] 0 2024-09-21T11:39:44.937 INFO:tasks.workunit.client.0.smithi118.stdout:1/803: write d6/d2a/f93 [2305659,122958] 0 2024-09-21T11:39:44.938 INFO:tasks.workunit.client.0.smithi118.stdout:1/804: mknod d6/d33/d7a/cf9 0 2024-09-21T11:39:44.942 INFO:tasks.workunit.client.0.smithi118.stdout:1/805: mkdir d6/d3b/dfa 0 2024-09-21T11:39:44.952 INFO:tasks.workunit.client.0.smithi118.stdout:1/806: dwrite d6/de/f58 [0,4194304] 0 2024-09-21T11:39:44.964 INFO:tasks.workunit.client.0.smithi118.stdout:1/807: dwrite d6/fdc [0,4194304] 0 2024-09-21T11:39:44.965 INFO:tasks.workunit.client.0.smithi118.stdout:1/808: chown d6/d2a/d3d/cdf 781189423 1 2024-09-21T11:39:44.967 INFO:tasks.workunit.client.0.smithi118.stdout:1/809: mkdir d6/d2a/d5c/dfb 0 2024-09-21T11:39:44.969 INFO:tasks.workunit.client.0.smithi118.stdout:1/810: dread d6/d33/d3c/f40 [0,4194304] 0 2024-09-21T11:39:44.978 INFO:tasks.workunit.client.0.smithi118.stdout:1/811: write d6/d33/f44 [2800262,128892] 0 2024-09-21T11:39:44.988 INFO:tasks.workunit.client.0.smithi118.stdout:1/812: dwrite d6/f7f [0,4194304] 0 2024-09-21T11:39:44.999 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T11:39:44.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-21T11:39:45.001 INFO:tasks.workunit.client.0.smithi118.stdout:1/813: dread d6/d3b/f66 [0,4194304] 0 2024-09-21T11:39:45.005 INFO:tasks.workunit.client.0.smithi118.stdout:1/814: dwrite d6/d33/f5b [4194304,4194304] 0 2024-09-21T11:39:45.008 INFO:tasks.workunit.client.0.smithi118.stdout:1/815: write d6/d33/d3c/dec/df3/f48 [3292120,121440] 0 2024-09-21T11:39:45.009 INFO:tasks.workunit.client.0.smithi118.stdout:1/816: readlink d6/de/d16/d3f/d50/d54/l38 0 2024-09-21T11:39:45.016 INFO:tasks.workunit.client.0.smithi118.stdout:1/817: truncate d6/de/f34 1101255 0 2024-09-21T11:39:45.016 INFO:tasks.workunit.client.0.smithi118.stdout:1/818: stat d6/de/d16/d3f/d50/df6 0 2024-09-21T11:39:45.019 INFO:tasks.workunit.client.0.smithi118.stdout:1/819: rename d6/de/d13 to d6/d33/dfc 0 2024-09-21T11:39:45.020 INFO:tasks.workunit.client.0.smithi118.stdout:1/820: rmdir d6/d33/d3c/dec 39 2024-09-21T11:39:45.032 INFO:tasks.workunit.client.0.smithi118.stdout:1/821: dwrite d6/d33/dfc/fd9 [0,4194304] 0 2024-09-21T11:39:45.036 INFO:tasks.workunit.client.0.smithi118.stdout:1/822: link d6/de/f58 d6/d2a/d5c/db8/ffd 0 2024-09-21T11:39:45.040 INFO:tasks.workunit.client.0.smithi118.stdout:1/823: link d6/de/c7d d6/de/d16/d3f/cfe 0 2024-09-21T11:39:45.043 INFO:tasks.workunit.client.0.smithi118.stdout:1/824: dread d6/de/d16/d3f/d50/d72/f75 [0,4194304] 0 2024-09-21T11:39:45.045 INFO:tasks.workunit.client.0.smithi118.stdout:4/940: sync 2024-09-21T11:39:45.050 INFO:tasks.workunit.client.0.smithi118.stdout:4/941: rename d2/d6/de/d1c/d23/d26/dd6/dcb/fab to d2/d6/de/d1c/d23/d26/dd6/d5e/dfd/d120/f143 0 2024-09-21T11:39:45.052 INFO:tasks.workunit.client.0.smithi118.stdout:4/942: creat d2/d131/f144 x:0 0 0 2024-09-21T11:39:45.053 INFO:tasks.workunit.client.0.smithi118.stdout:4/943: fsync d2/d6/de/d1c/d4d/d52/f12d 0 2024-09-21T11:39:45.066 INFO:tasks.workunit.client.0.smithi118.stdout:4/944: dwrite d2/d6/de/d1c/d23/d26/d74/ff5 [0,4194304] 0 2024-09-21T11:39:45.069 INFO:tasks.workunit.client.0.smithi118.stdout:4/945: mknod d2/d6/dd/d116/c145 0 2024-09-21T11:39:45.073 INFO:tasks.workunit.client.0.smithi118.stdout:4/946: symlink d2/d6/de/d1c/d87/da9/d11a/d122/l146 0 2024-09-21T11:39:45.076 INFO:tasks.workunit.client.0.smithi118.stdout:4/947: mknod d2/d6/de/d1c/d87/c147 0 2024-09-21T11:39:45.218 INFO:tasks.workunit.client.0.smithi118.stdout:6/755: sync 2024-09-21T11:39:45.219 INFO:tasks.workunit.client.0.smithi118.stdout:6/756: fdatasync d8/d48/d45/de1/dbf/dcb/d66/fad 0 2024-09-21T11:39:45.222 INFO:tasks.workunit.client.0.smithi118.stdout:6/757: truncate d8/d48/d45/de1/dbf/dcb/d70/f83 1171614 0 2024-09-21T11:39:45.230 INFO:tasks.workunit.client.0.smithi118.stdout:6/758: write d8/d48/d6c/f69 [1858558,29702] 0 2024-09-21T11:39:45.230 INFO:tasks.workunit.client.0.smithi118.stdout:6/759: chown d8/l3b 26650025 1 2024-09-21T11:39:45.233 INFO:tasks.workunit.client.0.smithi118.stdout:6/760: mknod d8/d46/cf1 0 2024-09-21T11:39:45.237 INFO:tasks.workunit.client.0.smithi118.stdout:6/761: link d8/d48/d5f/da3/ldc d8/d14/d33/lf2 0 2024-09-21T11:39:45.241 INFO:tasks.workunit.client.0.smithi118.stdout:6/762: dread d8/d14/d33/f62 [0,4194304] 0 2024-09-21T11:39:45.248 INFO:tasks.workunit.client.0.smithi118.stdout:6/763: write d8/d14/d3a/f5a [1079896,12395] 0 2024-09-21T11:39:45.302 INFO:tasks.workunit.client.0.smithi118.stdout:6/764: rename d8/d46/dca/fed to d8/d48/d5f/ff3 0 2024-09-21T11:39:45.305 INFO:tasks.workunit.client.0.smithi118.stdout:6/765: link d8/f4b d8/d48/d72/d7e/ff4 0 2024-09-21T11:39:45.315 INFO:tasks.workunit.client.0.smithi118.stdout:6/766: dwrite d8/d48/d45/de1/dbf/dcb/d66/fee [4194304,4194304] 0 2024-09-21T11:39:45.316 INFO:tasks.workunit.client.0.smithi118.stdout:6/767: readlink d8/d48/d6c/d64/lbc 0 2024-09-21T11:39:45.374 INFO:tasks.workunit.client.0.smithi118.stdout:7/935: sync 2024-09-21T11:39:45.375 INFO:tasks.workunit.client.0.smithi118.stdout:7/936: stat d0/d3/d1d/d35/d57/d7e/d82/fa3 0 2024-09-21T11:39:45.375 INFO:tasks.workunit.client.0.smithi118.stdout:7/937: fdatasync d0/d3/d1d/f10b 0 2024-09-21T11:39:45.376 INFO:tasks.workunit.client.0.smithi118.stdout:7/938: write d0/d3/d14/d41/d66/d6d/fd6 [4050892,41577] 0 2024-09-21T11:39:45.380 INFO:tasks.workunit.client.0.smithi118.stdout:7/939: symlink d0/d3/d1d/d35/d70/d10e/d110/d5f/d71/l136 0 2024-09-21T11:39:45.381 INFO:tasks.workunit.client.0.smithi118.stdout:7/940: write d0/d3/d1d/f118 [359986,103785] 0 2024-09-21T11:39:45.382 INFO:tasks.workunit.client.0.smithi118.stdout:7/941: dread - d0/d3/d14/d41/d7f/f12b zero size 2024-09-21T11:39:45.382 INFO:tasks.workunit.client.0.smithi118.stdout:7/942: readlink d0/d3/d1d/d35/d70/d10e/d110/l10c 0 2024-09-21T11:39:45.397 INFO:tasks.workunit.client.0.smithi118.stdout:7/943: dwrite d0/d3/d14/fc9 [0,4194304] 0 2024-09-21T11:39:45.399 INFO:tasks.workunit.client.0.smithi118.stdout:7/944: symlink d0/d3/d13/dd5/l137 0 2024-09-21T11:39:45.402 INFO:tasks.workunit.client.0.smithi118.stdout:7/945: mknod d0/d3/dd9/c138 0 2024-09-21T11:39:45.403 INFO:tasks.workunit.client.0.smithi118.stdout:7/946: symlink d0/d3/d13/dd5/l139 0 2024-09-21T11:39:45.408 INFO:tasks.workunit.client.0.smithi118.stdout:7/947: rename d0/d3/f4d to d0/d3/d1d/d35/d70/f13a 0 2024-09-21T11:39:45.411 INFO:tasks.workunit.client.0.smithi118.stdout:7/948: dread d0/d3/d1d/d35/d70/d10e/d110/f8d [0,4194304] 0 2024-09-21T11:39:45.417 INFO:tasks.workunit.client.0.smithi118.stdout:7/949: dwrite d0/d3/d1d/d35/d70/d10e/d110/f6b [0,4194304] 0 2024-09-21T11:39:45.422 INFO:tasks.workunit.client.0.smithi118.stdout:7/950: creat d0/d3/d1d/d35/d70/f13b x:0 0 0 2024-09-21T11:39:45.426 INFO:tasks.workunit.client.0.smithi118.stdout:7/951: symlink d0/d3/d1d/d35/d57/d96/l13c 0 2024-09-21T11:39:45.426 INFO:tasks.workunit.client.0.smithi118.stdout:7/952: creat d0/d3/d1d/d35/d70/d10e/f13d x:0 0 0 2024-09-21T11:39:45.429 INFO:tasks.workunit.client.0.smithi118.stdout:7/953: mknod d0/d3/d14/d41/d7f/d3e/d81/db6/d10f/c13e 0 2024-09-21T11:39:45.431 INFO:tasks.workunit.client.0.smithi118.stdout:7/954: creat d0/d3/dd9/f13f x:0 0 0 2024-09-21T11:39:45.443 INFO:tasks.workunit.client.0.smithi118.stdout:7/955: dwrite d0/d3/d1d/d35/d70/d10e/d110/f8d [0,4194304] 0 2024-09-21T11:39:45.449 INFO:tasks.workunit.client.0.smithi118.stdout:7/956: getdents d0/d3/d1d/d35/d70/d10e/d110/d119 0 2024-09-21T11:39:45.450 INFO:tasks.workunit.client.0.smithi118.stdout:7/957: readlink d0/d3/d14/d41/d7f/lfd 0 2024-09-21T11:39:45.453 INFO:tasks.workunit.client.0.smithi118.stdout:7/958: creat d0/d3/d13/d102/f140 x:0 0 0 2024-09-21T11:39:45.454 INFO:tasks.workunit.client.0.smithi118.stdout:7/959: read - d0/d3/d14/d41/da0/ff0 zero size 2024-09-21T11:39:45.466 INFO:tasks.workunit.client.0.smithi118.stdout:7/960: dwrite d0/d3/d1d/d35/d70/f13a [4194304,4194304] 0 2024-09-21T11:39:45.469 INFO:tasks.workunit.client.0.smithi118.stdout:7/961: rename d0/d3/d13/d8f/f94 to d0/d3/d1d/f141 0 2024-09-21T11:39:45.476 INFO:tasks.workunit.client.0.smithi118.stdout:7/962: creat d0/d3/d1d/d35/d70/f142 x:0 0 0 2024-09-21T11:39:45.476 INFO:tasks.workunit.client.0.smithi118.stdout:7/963: chown d0/d3/d13/f55 112596 1 2024-09-21T11:39:45.479 INFO:tasks.workunit.client.0.smithi118.stdout:7/964: mkdir d0/d3/d14/d41/d7f/d3e/d81/db6/d10f/d143 0 2024-09-21T11:39:45.482 INFO:tasks.workunit.client.0.smithi118.stdout:7/965: mknod d0/d3/d14/d41/d7f/da2/c144 0 2024-09-21T11:39:45.483 INFO:tasks.workunit.client.0.smithi118.stdout:7/966: read d0/d3/d1d/d35/d57/d7e/d82/fd8 [15724,25069] 0 2024-09-21T11:39:45.493 INFO:tasks.workunit.client.0.smithi118.stdout:7/967: dread d0/d3/d1d/d35/d70/f80 [4194304,4194304] 0 2024-09-21T11:39:45.499 INFO:tasks.workunit.client.0.smithi118.stdout:7/968: creat d0/d3/d14/d41/da0/f145 x:0 0 0 2024-09-21T11:39:45.500 INFO:tasks.workunit.client.0.smithi118.stdout:7/969: chown d0/d3/d1d/d35/d57/d7e/fa5 104841979 1 2024-09-21T11:39:45.593 INFO:tasks.workunit.client.0.smithi118.stdout:1/825: sync 2024-09-21T11:39:45.593 INFO:tasks.workunit.client.0.smithi118.stdout:3/856: sync 2024-09-21T11:39:45.593 INFO:tasks.workunit.client.0.smithi118.stdout:9/956: sync 2024-09-21T11:39:45.593 INFO:tasks.workunit.client.0.smithi118.stdout:5/872: sync 2024-09-21T11:39:45.594 INFO:tasks.workunit.client.0.smithi118.stdout:2/898: sync 2024-09-21T11:39:45.597 INFO:tasks.workunit.client.0.smithi118.stdout:2/899: mknod de/d53/c13a 0 2024-09-21T11:39:45.598 INFO:tasks.workunit.client.0.smithi118.stdout:3/857: symlink d5/d28/d33/d4a/dc8/l130 0 2024-09-21T11:39:45.603 INFO:tasks.workunit.client.0.smithi118.stdout:3/858: rename d5/d1d/d1b/d4c/d73/l9d to d5/d28/d3e/l131 0 2024-09-21T11:39:45.605 INFO:tasks.workunit.client.0.smithi118.stdout:5/873: link d0/db/d35/d2c/c9a d0/db/d35/d30/d1a/df6/c127 0 2024-09-21T11:39:45.607 INFO:tasks.workunit.client.0.smithi118.stdout:2/900: creat de/f13b x:0 0 0 2024-09-21T11:39:45.609 INFO:tasks.workunit.client.0.smithi118.stdout:3/859: mknod d5/d1d/d1b/d4c/d91/c132 0 2024-09-21T11:39:45.611 INFO:tasks.workunit.client.0.smithi118.stdout:1/826: dread d6/d3b/f43 [0,4194304] 0 2024-09-21T11:39:45.612 INFO:tasks.workunit.client.0.smithi118.stdout:2/901: mknod de/d16/d25/dba/db5/c13c 0 2024-09-21T11:39:45.614 INFO:tasks.workunit.client.0.smithi118.stdout:3/860: mkdir d5/d1d/d1b/d4c/d104/d133 0 2024-09-21T11:39:45.620 INFO:tasks.workunit.client.0.smithi118.stdout:3/861: dwrite d5/d1d/d1b/ffe [0,4194304] 0 2024-09-21T11:39:45.621 INFO:tasks.workunit.client.0.smithi118.stdout:5/874: rename d0/db/d35/def/c9e to d0/d6c/c128 0 2024-09-21T11:39:45.623 INFO:tasks.workunit.client.0.smithi118.stdout:5/875: truncate d0/db/d35/dd5/f11b 928016 0 2024-09-21T11:39:45.625 INFO:tasks.workunit.client.0.smithi118.stdout:1/827: creat d6/d2a/d3d/de5/fff x:0 0 0 2024-09-21T11:39:45.629 INFO:tasks.workunit.client.0.smithi118.stdout:5/876: dwrite d0/d63/f122 [0,4194304] 0 2024-09-21T11:39:45.631 INFO:tasks.workunit.client.0.smithi118.stdout:2/902: fsync de/d16/d31/dce/d66/d9a/f11c 0 2024-09-21T11:39:45.634 INFO:tasks.workunit.client.0.smithi118.stdout:3/862: creat d5/d1d/d1b/d4c/d73/dc4/ded/f134 x:0 0 0 2024-09-21T11:39:45.642 INFO:tasks.workunit.client.0.smithi118.stdout:1/828: dwrite d6/d2a/d5c/db8/ff0 [0,4194304] 0 2024-09-21T11:39:45.644 INFO:tasks.workunit.client.0.smithi118.stdout:5/877: fsync d0/d6c/f5a 0 2024-09-21T11:39:45.645 INFO:tasks.workunit.client.0.smithi118.stdout:5/878: read - d0/db/d35/d30/d1a/db3/fe7 zero size 2024-09-21T11:39:45.647 INFO:tasks.workunit.client.0.smithi118.stdout:5/879: dread - d0/d63/fb7 zero size 2024-09-21T11:39:45.655 INFO:tasks.workunit.client.0.smithi118.stdout:7/970: dwrite d0/d3/d13/fca [0,4194304] 0 2024-09-21T11:39:45.661 INFO:tasks.workunit.client.0.smithi118.stdout:7/971: rename d0/d3/d1d/d35/d57/d7e/d82/ce4 to d0/d3/d14/d41/d7f/d3e/d81/db6/c146 0 2024-09-21T11:39:45.663 INFO:tasks.workunit.client.0.smithi118.stdout:9/957: dwrite d0/d4/f8 [0,4194304] 0 2024-09-21T11:39:45.672 INFO:tasks.workunit.client.0.smithi118.stdout:9/958: mkdir d0/d20/d4c/d5f/d6c/d88/d10d/d13a/d14f 0 2024-09-21T11:39:45.674 INFO:tasks.workunit.client.0.smithi118.stdout:7/972: unlink d0/d3/d14/d41/d66/f67 0 2024-09-21T11:39:45.676 INFO:tasks.workunit.client.0.smithi118.stdout:9/959: symlink d0/d20/d4c/d5f/l150 0 2024-09-21T11:39:45.677 INFO:tasks.workunit.client.0.smithi118.stdout:7/973: fdatasync d0/d3/fc1 0 2024-09-21T11:39:45.678 INFO:tasks.workunit.client.0.smithi118.stdout:7/974: stat d0/d3/d13/dd5/f12a 0 2024-09-21T11:39:45.679 INFO:tasks.workunit.client.0.smithi118.stdout:9/960: mkdir d0/d20/d4c/d5f/d6c/d88/d4d/de0/d151 0 2024-09-21T11:39:45.683 INFO:tasks.workunit.client.0.smithi118.stdout:9/961: mknod d0/d20/d4c/d5f/d66/d98/c152 0 2024-09-21T11:39:45.685 INFO:tasks.workunit.client.0.smithi118.stdout:9/962: truncate d0/d20/d4c/d5f/d6c/d88/d4d/dc2/f11b 965859 0 2024-09-21T11:39:45.687 INFO:tasks.workunit.client.0.smithi118.stdout:9/963: fsync d0/d20/d4c/d5f/d6c/d88/d4d/f58 0 2024-09-21T11:39:45.704 INFO:tasks.workunit.client.0.smithi118.stdout:2/903: truncate de/f12 2752618 0 2024-09-21T11:39:45.704 INFO:tasks.workunit.client.0.smithi118.stdout:3/863: write d5/d1d/d1b/d50/dc6/ffa [979507,70156] 0 2024-09-21T11:39:45.712 INFO:tasks.workunit.client.0.smithi118.stdout:3/864: fsync d5/d1d/d8c/f108 0 2024-09-21T11:39:45.720 INFO:tasks.workunit.client.0.smithi118.stdout:3/865: creat d5/d1d/d1b/d4c/d73/dc4/f135 x:0 0 0 2024-09-21T11:39:45.721 INFO:tasks.workunit.client.0.smithi118.stdout:7/975: write d0/d3/d1d/d35/d70/d10e/d110/f56 [1363584,121063] 0 2024-09-21T11:39:45.722 INFO:tasks.workunit.client.0.smithi118.stdout:7/976: chown d0/d3/d1d/d35/d57/d96 1270413097 1 2024-09-21T11:39:45.726 INFO:tasks.workunit.client.0.smithi118.stdout:9/964: truncate d0/fc 682811 0 2024-09-21T11:39:45.726 INFO:tasks.workunit.client.0.smithi118.stdout:9/965: chown d0/d20/d4c/d5f/d6c/d88/d4d/l14c 6372994 1 2024-09-21T11:39:45.735 INFO:tasks.workunit.client.0.smithi118.stdout:2/904: dwrite de/d53/dfa/d12f/f135 [0,4194304] 0 2024-09-21T11:39:45.739 INFO:tasks.workunit.client.0.smithi118.stdout:3/866: write d5/d1d/d1b/d4c/d73/fb5 [1535708,97934] 0 2024-09-21T11:39:45.744 INFO:tasks.workunit.client.0.smithi118.stdout:3/867: mknod d5/d1d/c136 0 2024-09-21T11:39:45.749 INFO:tasks.workunit.client.0.smithi118.stdout:9/966: dread d0/d4/d38/df6/f106 [0,4194304] 0 2024-09-21T11:39:45.750 INFO:tasks.workunit.client.0.smithi118.stdout:3/868: rename d5/d1d/d1b/d50/lc7 to d5/d28/d3e/d5d/d5f/d88/d120/l137 0 2024-09-21T11:39:45.755 INFO:tasks.workunit.client.0.smithi118.stdout:9/967: getdents d0/d20/d4c/d5f/d6c/d88/d4d/de0 0 2024-09-21T11:39:45.758 INFO:tasks.workunit.client.0.smithi118.stdout:3/869: dwrite d5/d1d/d1b/d4c/f111 [0,4194304] 0 2024-09-21T11:39:45.758 INFO:tasks.workunit.client.0.smithi118.stdout:2/905: dwrite de/d50/d85/ff8 [0,4194304] 0 2024-09-21T11:39:45.760 INFO:tasks.workunit.client.0.smithi118.stdout:9/968: creat d0/de2/f153 x:0 0 0 2024-09-21T11:39:45.761 INFO:tasks.workunit.client.0.smithi118.stdout:9/969: chown d0/d4/d38/db8/de9/ff1 0 1 2024-09-21T11:39:45.769 INFO:tasks.workunit.client.0.smithi118.stdout:9/970: creat d0/d20/f154 x:0 0 0 2024-09-21T11:39:45.770 INFO:tasks.workunit.client.0.smithi118.stdout:3/870: link d5/d1d/d1b/lc2 d5/d1d/d1b/d50/dc6/l138 0 2024-09-21T11:39:45.772 INFO:tasks.workunit.client.0.smithi118.stdout:4/948: sync 2024-09-21T11:39:45.775 INFO:tasks.workunit.client.0.smithi118.stdout:3/871: symlink d5/d1d/d1b/d24/l139 0 2024-09-21T11:39:45.776 INFO:tasks.workunit.client.0.smithi118.stdout:3/872: fdatasync d5/d28/d3e/d5d/d5f/f8b 0 2024-09-21T11:39:45.784 INFO:tasks.workunit.client.0.smithi118.stdout:2/906: dwrite de/d16/d25/dba/fc0 [4194304,4194304] 0 2024-09-21T11:39:45.784 INFO:tasks.workunit.client.0.smithi118.stdout:3/873: rename d5/d1d/d1b/d4c/d73/dc4/ldc to d5/d1d/d1b/d4c/d91/d69/l13a 0 2024-09-21T11:39:45.787 INFO:tasks.workunit.client.0.smithi118.stdout:9/971: dread d0/d20/d4c/d5f/d6c/d88/f32 [0,4194304] 0 2024-09-21T11:39:45.791 INFO:tasks.workunit.client.0.smithi118.stdout:2/907: dread - de/d16/fb2 zero size 2024-09-21T11:39:45.793 INFO:tasks.workunit.client.0.smithi118.stdout:3/874: rename d5/d1d/f43 to d5/d1d/d1b/d24/f13b 0 2024-09-21T11:39:45.796 INFO:tasks.workunit.client.0.smithi118.stdout:9/972: creat d0/d20/d4c/d5f/d6c/d88/d4d/f155 x:0 0 0 2024-09-21T11:39:45.797 INFO:tasks.workunit.client.0.smithi118.stdout:2/908: mkdir de/d16/d31/d13d 0 2024-09-21T11:39:45.797 INFO:tasks.workunit.client.0.smithi118.stdout:4/949: write d2/d6/de/d1c/d23/d26/d74/ff0 [844627,51710] 0 2024-09-21T11:39:45.798 INFO:tasks.workunit.client.0.smithi118.stdout:2/909: dread - de/d53/dc2/fef zero size 2024-09-21T11:39:45.799 INFO:tasks.workunit.client.0.smithi118.stdout:3/875: truncate d5/d1d/d1b/d4c/d91/f93 1166535 0 2024-09-21T11:39:45.799 INFO:tasks.workunit.client.0.smithi118.stdout:2/910: fdatasync de/d22/d3c/f139 0 2024-09-21T11:39:45.800 INFO:tasks.workunit.client.0.smithi118.stdout:2/911: chown de/d50/d85/fd8 2086 1 2024-09-21T11:39:45.801 INFO:tasks.workunit.client.0.smithi118.stdout:2/912: chown de/d16/d31/dce/l43 0 1 2024-09-21T11:39:45.804 INFO:tasks.workunit.client.0.smithi118.stdout:3/876: rename d5/d28/d3e/d5d/d5f/fb8 to d5/d1d/d8c/f13c 0 2024-09-21T11:39:45.808 INFO:tasks.workunit.client.0.smithi118.stdout:2/913: dwrite de/d50/f5a [0,4194304] 0 2024-09-21T11:39:45.816 INFO:tasks.workunit.client.0.smithi118.stdout:9/973: dwrite d0/d20/d71/f8d [0,4194304] 0 2024-09-21T11:39:45.820 INFO:tasks.workunit.client.0.smithi118.stdout:4/950: dread d2/d6/de/d1c/d23/d26/dd6/dcb/fe0 [0,4194304] 0 2024-09-21T11:39:45.820 INFO:tasks.workunit.client.0.smithi118.stdout:3/877: write d5/d28/f94 [1681895,25781] 0 2024-09-21T11:39:45.824 INFO:tasks.workunit.client.0.smithi118.stdout:4/951: stat d2/d65 0 2024-09-21T11:39:45.825 INFO:tasks.workunit.client.0.smithi118.stdout:9/974: dwrite d0/d4/d38/db8/de9/ff1 [0,4194304] 0 2024-09-21T11:39:45.826 INFO:tasks.workunit.client.0.smithi118.stdout:2/914: write de/d22/d3c/f3f [1701389,57923] 0 2024-09-21T11:39:45.828 INFO:tasks.workunit.client.0.smithi118.stdout:2/915: fsync de/d22/d3c/d83/f10f 0 2024-09-21T11:39:45.831 INFO:tasks.workunit.client.0.smithi118.stdout:4/952: dread d2/d6/de/d1c/d4d/d52/f6a [0,4194304] 0 2024-09-21T11:39:45.831 INFO:tasks.workunit.client.0.smithi118.stdout:3/878: truncate d5/d28/d3e/d5d/f8a 606721 0 2024-09-21T11:39:45.834 INFO:tasks.workunit.client.0.smithi118.stdout:9/975: creat d0/d4/d45/db5/d86/dd6/ddc/f156 x:0 0 0 2024-09-21T11:39:45.836 INFO:tasks.workunit.client.0.smithi118.stdout:2/916: symlink de/d1f/d20/d67/d99/l13e 0 2024-09-21T11:39:45.837 INFO:tasks.workunit.client.0.smithi118.stdout:2/917: stat de/d50/f10d 0 2024-09-21T11:39:45.838 INFO:tasks.workunit.client.0.smithi118.stdout:9/976: mkdir d0/d20/d4c/d5f/d6c/d88/d10d/d137/d157 0 2024-09-21T11:39:45.851 INFO:tasks.workunit.client.0.smithi118.stdout:4/953: write d2/d6/de/d1c/d87/d105/f114 [824903,78459] 0 2024-09-21T11:39:45.853 INFO:tasks.workunit.client.0.smithi118.stdout:3/879: write d5/d1d/d1b/d24/f2c [116215,105886] 0 2024-09-21T11:39:45.857 INFO:tasks.workunit.client.0.smithi118.stdout:3/880: mkdir d5/d28/d33/d4a/dc8/d13d 0 2024-09-21T11:39:45.860 INFO:tasks.workunit.client.0.smithi118.stdout:4/954: link d2/d6/d12a/df3/l10b d2/l148 0 2024-09-21T11:39:45.861 INFO:tasks.workunit.client.0.smithi118.stdout:9/977: dwrite d0/d4/fe3 [0,4194304] 0 2024-09-21T11:39:45.864 INFO:tasks.workunit.client.0.smithi118.stdout:9/978: stat d0/d20/d4c/d5f/d6c/d88/d4d/dca/l101 0 2024-09-21T11:39:45.866 INFO:tasks.workunit.client.0.smithi118.stdout:3/881: dwrite d5/d28/d3e/d5d/dfd/daf/f118 [0,4194304] 0 2024-09-21T11:39:45.867 INFO:tasks.workunit.client.0.smithi118.stdout:3/882: readlink d5/d28/d3e/d5d/dfd/dc9/ld4 0 2024-09-21T11:39:45.868 INFO:tasks.workunit.client.0.smithi118.stdout:4/955: symlink d2/d6/de/d1c/d23/d26/dd6/d5e/dfd/d140/l149 0 2024-09-21T11:39:45.870 INFO:tasks.workunit.client.0.smithi118.stdout:9/979: creat d0/d20/d4c/d5f/d6c/d88/d4d/dca/f158 x:0 0 0 2024-09-21T11:39:45.871 INFO:tasks.workunit.client.0.smithi118.stdout:3/883: mkdir d5/d28/d3e/daa/d13e 0 2024-09-21T11:39:45.872 INFO:tasks.workunit.client.0.smithi118.stdout:3/884: chown d5/d28/d3e/d5d/l9a 3967 1 2024-09-21T11:39:45.880 INFO:tasks.workunit.client.0.smithi118.stdout:9/980: rename d0/d20/d4c/d5f/d6c/d88/f5e to d0/d4/d45/db5/f159 0 2024-09-21T11:39:45.881 INFO:tasks.workunit.client.0.smithi118.stdout:3/885: truncate d5/d28/d3e/d5d/d5f/f67 2745291 0 2024-09-21T11:39:45.882 INFO:tasks.workunit.client.0.smithi118.stdout:9/981: chown d0/d20/d4c/d5f/d6c/d88/d10d/d111 53091655 1 2024-09-21T11:39:45.882 INFO:tasks.workunit.client.0.smithi118.stdout:9/982: chown d0/d20/c77 418870953 1 2024-09-21T11:39:45.883 INFO:tasks.workunit.client.0.smithi118.stdout:9/983: fdatasync d0/d20/d71/faf 0 2024-09-21T11:39:45.885 INFO:tasks.workunit.client.0.smithi118.stdout:3/886: mknod d5/d28/d3e/d5d/dfd/ddf/c13f 0 2024-09-21T11:39:45.890 INFO:tasks.workunit.client.0.smithi118.stdout:4/956: rename d2/d6/de to d2/d6/d14a 0 2024-09-21T11:39:45.891 INFO:tasks.workunit.client.0.smithi118.stdout:9/984: fdatasync d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/fcd 0 2024-09-21T11:39:45.896 INFO:tasks.workunit.client.0.smithi118.stdout:4/957: mknod d2/d8e/c14b 0 2024-09-21T11:39:45.897 INFO:tasks.workunit.client.0.smithi118.stdout:4/958: chown d2/d6/d14a/d1c/d87/da9/da8/f141 65074008 1 2024-09-21T11:39:45.901 INFO:tasks.workunit.client.0.smithi118.stdout:9/985: unlink d0/d20/f93 0 2024-09-21T11:39:45.902 INFO:tasks.workunit.client.0.smithi118.stdout:9/986: chown d0/d20/d4c/d5f/d6c/ff3 9 1 2024-09-21T11:39:45.902 INFO:tasks.workunit.client.0.smithi118.stdout:9/987: write d0/fb1 [1005140,28520] 0 2024-09-21T11:39:45.906 INFO:tasks.workunit.client.0.smithi118.stdout:4/959: truncate d2/d6/d14a/d1c/fd4 991604 0 2024-09-21T11:39:45.907 INFO:tasks.workunit.client.0.smithi118.stdout:3/887: dread d5/d1d/ff1 [0,4194304] 0 2024-09-21T11:39:45.907 INFO:tasks.workunit.client.0.smithi118.stdout:4/960: chown d2/d6/d14a/d1c/d87/ld1 7 1 2024-09-21T11:39:45.909 INFO:tasks.workunit.client.0.smithi118.stdout:9/988: read d0/d20/d4c/d5f/d89/fe7 [80198,61749] 0 2024-09-21T11:39:45.909 INFO:tasks.workunit.client.0.smithi118.stdout:4/961: write d2/d6/d14a/d1c/d4d/dba/f12e [3279712,126437] 0 2024-09-21T11:39:45.911 INFO:tasks.workunit.client.0.smithi118.stdout:3/888: symlink d5/d1d/d1b/d4c/d104/d133/l140 0 2024-09-21T11:39:45.914 INFO:tasks.workunit.client.0.smithi118.stdout:4/962: creat d2/d6/d14a/d1c/d87/da9/d97/de7/f14c x:0 0 0 2024-09-21T11:39:45.917 INFO:tasks.workunit.client.0.smithi118.stdout:4/963: fsync d2/d6/d14a/d1c/d87/da9/d97/d9b/fc0 0 2024-09-21T11:39:45.918 INFO:tasks.workunit.client.0.smithi118.stdout:3/889: dwrite d5/d1d/d1b/d4c/d91/d69/ff2 [0,4194304] 0 2024-09-21T11:39:45.918 INFO:tasks.workunit.client.0.smithi118.stdout:4/964: stat d2/d6/d14a/d1c 0 2024-09-21T11:39:45.924 INFO:tasks.workunit.client.0.smithi118.stdout:4/965: creat d2/d6/dd/d35/d10d/f14d x:0 0 0 2024-09-21T11:39:45.926 INFO:tasks.workunit.client.0.smithi118.stdout:3/890: creat d5/f141 x:0 0 0 2024-09-21T11:39:45.927 INFO:tasks.workunit.client.0.smithi118.stdout:3/891: chown d5/d28/d3e/d5d/l9a 0 1 2024-09-21T11:39:45.927 INFO:tasks.workunit.client.0.smithi118.stdout:3/892: dread - d5/d28/f106 zero size 2024-09-21T11:39:45.930 INFO:tasks.workunit.client.0.smithi118.stdout:4/966: creat d2/d6/dd/d35/f14e x:0 0 0 2024-09-21T11:39:45.930 INFO:tasks.workunit.client.0.smithi118.stdout:3/893: dread - d5/d1d/d1b/d4c/d73/d9b/f12b zero size 2024-09-21T11:39:45.936 INFO:tasks.workunit.client.0.smithi118.stdout:3/894: getdents d5/d28/d3e/d5d/dfd/daf 0 2024-09-21T11:39:45.947 INFO:tasks.workunit.client.0.smithi118.stdout:3/895: write d5/d1d/d8c/f108 [1000964,74753] 0 2024-09-21T11:39:45.950 INFO:tasks.workunit.client.0.smithi118.stdout:3/896: link d5/d28/d3e/daa/fd8 d5/d1d/d1b/d4c/d73/dc4/ded/f142 0 2024-09-21T11:39:45.951 INFO:tasks.workunit.client.0.smithi118.stdout:3/897: chown d5/d1d/d1b/d4c/ff7 220 1 2024-09-21T11:39:45.958 INFO:tasks.workunit.client.0.smithi118.stdout:3/898: write d5/d28/d3e/d5d/d5f/f68 [546821,8806] 0 2024-09-21T11:39:45.960 INFO:tasks.workunit.client.0.smithi118.stdout:3/899: creat d5/d28/d33/d4a/dc8/f143 x:0 0 0 2024-09-21T11:39:45.970 INFO:tasks.workunit.client.0.smithi118.stdout:3/900: dwrite d5/d1d/d1b/d24/dcd/f90 [0,4194304] 0 2024-09-21T11:39:45.971 INFO:tasks.workunit.client.0.smithi118.stdout:3/901: dread - d5/d28/f11d zero size 2024-09-21T11:39:45.974 INFO:tasks.workunit.client.0.smithi118.stdout:3/902: readlink d5/l1f 0 2024-09-21T11:39:45.980 INFO:tasks.workunit.client.0.smithi118.stdout:3/903: dread d5/d28/d3e/fa8 [0,4194304] 0 2024-09-21T11:39:45.981 INFO:tasks.workunit.client.0.smithi118.stdout:3/904: rename d5/d1d/d1b/d4c/d91 to d5/d1d/d1b/d4c/d91/d144 22 2024-09-21T11:39:45.984 INFO:tasks.workunit.client.0.smithi118.stdout:3/905: creat d5/d28/d33/d4a/dc8/d13d/f145 x:0 0 0 2024-09-21T11:39:45.985 INFO:tasks.workunit.client.0.smithi118.stdout:3/906: mkdir d5/d28/d33/d4a/dc8/d146 0 2024-09-21T11:39:45.992 INFO:tasks.workunit.client.0.smithi118.stdout:3/907: truncate d5/d1d/d1b/d24/dcd/f90 1869787 0 2024-09-21T11:39:45.996 INFO:tasks.workunit.client.0.smithi118.stdout:3/908: rmdir d5/d28/d3e/d5d/dfd/dc9/df4 0 2024-09-21T11:39:45.998 INFO:tasks.workunit.client.0.smithi118.stdout:3/909: dread d5/d28/d3e/d5d/f8a [0,4194304] 0 2024-09-21T11:39:45.999 INFO:tasks.workunit.client.0.smithi118.stdout:3/910: read - d5/d1d/d1b/d4c/d91/d69/f124 zero size 2024-09-21T11:39:46.002 INFO:tasks.workunit.client.0.smithi118.stdout:3/911: mknod d5/d1d/d1b/d4c/d91/d69/c147 0 2024-09-21T11:39:46.003 INFO:tasks.workunit.client.0.smithi118.stdout:3/912: mkdir d5/d1d/d1b/d24/dcd/d148 0 2024-09-21T11:39:46.005 INFO:tasks.workunit.client.0.smithi118.stdout:3/913: mknod d5/c149 0 2024-09-21T11:39:46.010 INFO:tasks.workunit.client.0.smithi118.stdout:3/914: rename d5/d28/d3e/d5d/dfd/dc9 to d5/d1d/d1b/d24/d14a 0 2024-09-21T11:39:46.012 INFO:tasks.workunit.client.0.smithi118.stdout:3/915: mknod d5/d28/d3e/d5d/dfd/ddf/c14b 0 2024-09-21T11:39:46.012 INFO:tasks.workunit.client.0.smithi118.stdout:3/916: fdatasync d5/d1d/d1b/d4c/d73/dc4/f10c 0 2024-09-21T11:39:46.018 INFO:tasks.workunit.client.0.smithi118.stdout:3/917: dwrite d5/d1d/d1b/d50/f5a [0,4194304] 0 2024-09-21T11:39:46.022 INFO:tasks.workunit.client.0.smithi118.stdout:3/918: write d5/d28/d3e/d5d/d5f/f8b [623629,69913] 0 2024-09-21T11:39:46.033 INFO:tasks.workunit.client.0.smithi118.stdout:3/919: dwrite d5/d28/d33/d4a/dc8/f116 [0,4194304] 0 2024-09-21T11:39:46.034 INFO:tasks.workunit.client.0.smithi118.stdout:3/920: chown d5/d1d/d1b/d4c/d73/dc4/f10c 2539 1 2024-09-21T11:39:46.077 INFO:tasks.workunit.client.0.smithi118.stdout:6/768: sync 2024-09-21T11:39:46.084 INFO:tasks.workunit.client.0.smithi118.stdout:3/921: link d5/d28/d3e/d5d/l12f d5/d1d/d1b/d24/l14c 0 2024-09-21T11:39:46.084 INFO:tasks.workunit.client.0.smithi118.stdout:3/922: stat d5/d1d/d8c/cbd 0 2024-09-21T11:39:46.085 INFO:tasks.workunit.client.0.smithi118.stdout:6/769: getdents d8/d48/d45/de1 0 2024-09-21T11:39:46.086 INFO:tasks.workunit.client.0.smithi118.stdout:6/770: write d8/d14/dc4/fd1 [897202,98702] 0 2024-09-21T11:39:46.088 INFO:tasks.workunit.client.0.smithi118.stdout:6/771: read d8/d14/d33/f3e [2470818,69532] 0 2024-09-21T11:39:46.089 INFO:tasks.workunit.client.0.smithi118.stdout:3/923: rename d5/d28/d33/d4a/dc8/d13d to d5/d28/d3e/daa/d13e/d14d 0 2024-09-21T11:39:46.092 INFO:tasks.workunit.client.0.smithi118.stdout:6/772: mkdir d8/d48/df5 0 2024-09-21T11:39:46.095 INFO:tasks.workunit.client.0.smithi118.stdout:3/924: write d5/d1d/d1b/d4c/d91/fca [466008,36458] 0 2024-09-21T11:39:46.096 INFO:tasks.workunit.client.0.smithi118.stdout:3/925: dread - d5/d1d/d1b/f122 zero size 2024-09-21T11:39:46.097 INFO:tasks.workunit.client.0.smithi118.stdout:6/773: link d8/d46/c5d d8/d48/d5f/da3/deb/cf6 0 2024-09-21T11:39:46.100 INFO:tasks.workunit.client.0.smithi118.stdout:3/926: fdatasync d5/d1d/d1b/d4c/d73/dc4/fa0 0 2024-09-21T11:39:46.101 INFO:tasks.workunit.client.0.smithi118.stdout:6/774: creat d8/d46/dd2/ff7 x:0 0 0 2024-09-21T11:39:46.101 INFO:tasks.workunit.client.0.smithi118.stdout:3/927: fsync d5/d1d/d1b/d24/dcd/fb3 0 2024-09-21T11:39:46.106 INFO:tasks.workunit.client.0.smithi118.stdout:3/928: fsync d5/d28/d3e/daa/fd8 0 2024-09-21T11:39:46.107 INFO:tasks.workunit.client.0.smithi118.stdout:3/929: readlink d5/d28/d3e/d5d/dfd/l113 0 2024-09-21T11:39:46.108 INFO:tasks.workunit.client.0.smithi118.stdout:3/930: readlink d5/d1d/l29 0 2024-09-21T11:39:46.108 INFO:tasks.workunit.client.0.smithi118.stdout:3/931: stat d5/d1d/d1b/d24/d14a/f10b 0 2024-09-21T11:39:46.109 INFO:tasks.workunit.client.0.smithi118.stdout:6/775: creat d8/d14/d3a/ff8 x:0 0 0 2024-09-21T11:39:46.110 INFO:tasks.workunit.client.0.smithi118.stdout:3/932: read - d5/d28/d3e/d5d/d5f/fb2 zero size 2024-09-21T11:39:46.110 INFO:tasks.workunit.client.0.smithi118.stdout:6/776: fsync d8/f38 0 2024-09-21T11:39:46.114 INFO:tasks.workunit.client.0.smithi118.stdout:6/777: symlink d8/d14/lf9 0 2024-09-21T11:39:46.117 INFO:tasks.workunit.client.0.smithi118.stdout:3/933: getdents d5/d28/d3e/d5d/d5f/d88/d120 0 2024-09-21T11:39:46.120 INFO:tasks.workunit.client.0.smithi118.stdout:6/778: dwrite d8/d48/d5f/d6b/fc9 [0,4194304] 0 2024-09-21T11:39:46.121 INFO:tasks.workunit.client.0.smithi118.stdout:3/934: mkdir d5/d1d/d1b/d14e 0 2024-09-21T11:39:46.121 INFO:tasks.workunit.client.0.smithi118.stdout:6/779: fdatasync d8/d48/d45/de1/dbf/dcb/d66/fee 0 2024-09-21T11:39:46.123 INFO:tasks.workunit.client.0.smithi118.stdout:6/780: fsync d8/d48/d45/de1/dbf/dcb/d66/fad 0 2024-09-21T11:39:46.129 INFO:tasks.workunit.client.0.smithi118.stdout:3/935: write d5/d1d/d1b/d4c/f7d [5012759,91878] 0 2024-09-21T11:39:46.132 INFO:tasks.workunit.client.0.smithi118.stdout:3/936: rmdir d5/d1d/d1b/d4c/d104/d133 39 2024-09-21T11:39:46.133 INFO:tasks.workunit.client.0.smithi118.stdout:6/781: dwrite d8/d48/d5f/ff3 [4194304,4194304] 0 2024-09-21T11:39:46.136 INFO:tasks.workunit.client.0.smithi118.stdout:6/782: rename d8/d48/d5f/cda to d8/d48/d5f/cfa 0 2024-09-21T11:39:46.137 INFO:tasks.workunit.client.0.smithi118.stdout:3/937: unlink d5/d1d/d1b/d50/c126 0 2024-09-21T11:39:46.139 INFO:tasks.workunit.client.0.smithi118.stdout:6/783: creat d8/d48/d5f/dbd/ffb x:0 0 0 2024-09-21T11:39:46.139 INFO:tasks.workunit.client.0.smithi118.stdout:6/784: stat d8/d48/d6c/l58 0 2024-09-21T11:39:46.145 INFO:tasks.workunit.client.0.smithi118.stdout:6/785: dwrite d8/d48/d45/f4d [0,4194304] 0 2024-09-21T11:39:46.155 INFO:tasks.workunit.client.0.smithi118.stdout:3/938: write d5/d1d/f81 [3785893,116328] 0 2024-09-21T11:39:46.158 INFO:tasks.workunit.client.0.smithi118.stdout:3/939: mkdir d5/d1d/d1b/d24/dcd/dc1/d14f 0 2024-09-21T11:39:46.158 INFO:tasks.workunit.client.0.smithi118.stdout:6/786: dread d8/d14/f24 [0,4194304] 0 2024-09-21T11:39:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:45 smithi149 ceph-mon[36123]: pgmap v38: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 32 MiB/s rd, 92 MiB/s wr, 257 op/s 2024-09-21T11:39:46.206 INFO:tasks.workunit.client.0.smithi118.stdout:1/829: sync 2024-09-21T11:39:46.206 INFO:tasks.workunit.client.0.smithi118.stdout:7/977: sync 2024-09-21T11:39:46.206 INFO:tasks.workunit.client.0.smithi118.stdout:5/880: sync 2024-09-21T11:39:46.207 INFO:tasks.workunit.client.0.smithi118.stdout:3/940: mkdir d5/d28/d3e/daa/d13e/d150 0 2024-09-21T11:39:46.208 INFO:tasks.workunit.client.0.smithi118.stdout:6/787: creat d8/d48/d6c/ffc x:0 0 0 2024-09-21T11:39:46.211 INFO:tasks.workunit.client.0.smithi118.stdout:3/941: symlink d5/d28/d3e/d5d/dfd/l151 0 2024-09-21T11:39:46.214 INFO:tasks.workunit.client.0.smithi118.stdout:7/978: rename d0/d3/d1d/d35/d70/d10e to d0/d3/d14/d41/d66/d6d/d147 0 2024-09-21T11:39:46.215 INFO:tasks.workunit.client.0.smithi118.stdout:6/788: dwrite d8/d14/f8e [0,4194304] 0 2024-09-21T11:39:46.216 INFO:tasks.workunit.client.0.smithi118.stdout:6/789: chown d8/d14/d44/fd5 346343 1 2024-09-21T11:39:46.217 INFO:tasks.workunit.client.0.smithi118.stdout:7/979: write d0/d3/d14/d41/d66/d6d/d147/d110/f8d [3262311,29402] 0 2024-09-21T11:39:46.217 INFO:tasks.workunit.client.0.smithi118.stdout:5/881: mknod d0/db/d35/d2c/d40/dca/c129 0 2024-09-21T11:39:46.218 INFO:tasks.workunit.client.0.smithi118.stdout:6/790: stat d8/d48/d5f/d6b 0 2024-09-21T11:39:46.219 INFO:tasks.workunit.client.0.smithi118.stdout:3/942: creat d5/d1d/d1b/d50/dc6/f152 x:0 0 0 2024-09-21T11:39:46.223 INFO:tasks.workunit.client.0.smithi118.stdout:1/830: dread d6/f79 [0,4194304] 0 2024-09-21T11:39:46.224 INFO:tasks.workunit.client.0.smithi118.stdout:1/831: readlink d6/de/d16/d3f/d50/d54/l38 0 2024-09-21T11:39:46.232 INFO:tasks.workunit.client.0.smithi118.stdout:6/791: mkdir d8/d14/d3a/dfd 0 2024-09-21T11:39:46.232 INFO:tasks.workunit.client.0.smithi118.stdout:6/792: stat d8/d14 0 2024-09-21T11:39:46.233 INFO:tasks.workunit.client.0.smithi118.stdout:6/793: write d8/d46/dca/fdd [266116,28179] 0 2024-09-21T11:39:46.235 INFO:tasks.workunit.client.0.smithi118.stdout:6/794: chown d8/d14/dc4/fd1 338800 1 2024-09-21T11:39:46.236 INFO:tasks.workunit.client.0.smithi118.stdout:5/882: creat d0/d89/f12a x:0 0 0 2024-09-21T11:39:46.236 INFO:tasks.workunit.client.0.smithi118.stdout:3/943: truncate d5/d1d/d1b/d24/f13b 938038 0 2024-09-21T11:39:46.236 INFO:tasks.workunit.client.0.smithi118.stdout:6/795: chown d8/d46/dca/fd8 37270713 1 2024-09-21T11:39:46.236 INFO:tasks.workunit.client.0.smithi118.stdout:5/883: chown d0/dbf/lc6 390 1 2024-09-21T11:39:46.237 INFO:tasks.workunit.client.0.smithi118.stdout:1/832: write d6/f15 [1517065,5558] 0 2024-09-21T11:39:46.238 INFO:tasks.workunit.client.0.smithi118.stdout:3/944: readlink d5/d1d/d1b/d4c/d91/lb4 0 2024-09-21T11:39:46.240 INFO:tasks.workunit.client.0.smithi118.stdout:7/980: dread d0/d3/d1d/d35/f60 [0,4194304] 0 2024-09-21T11:39:46.243 INFO:tasks.workunit.client.0.smithi118.stdout:7/981: dread - d0/d3/d14/f108 zero size 2024-09-21T11:39:46.246 INFO:tasks.workunit.client.0.smithi118.stdout:6/796: getdents d8/d14/d3a 0 2024-09-21T11:39:46.247 INFO:tasks.workunit.client.0.smithi118.stdout:3/945: dwrite d5/d28/f2b [0,4194304] 0 2024-09-21T11:39:46.248 INFO:tasks.workunit.client.0.smithi118.stdout:1/833: dread d6/de/f34 [0,4194304] 0 2024-09-21T11:39:46.256 INFO:tasks.workunit.client.0.smithi118.stdout:7/982: mkdir d0/d3/d14/d41/d7f/d3e/d81/db6/d10f/d143/d148 0 2024-09-21T11:39:46.256 INFO:tasks.workunit.client.0.smithi118.stdout:5/884: dread d0/db/d35/d30/d1a/db3/f114 [0,4194304] 0 2024-09-21T11:39:46.258 INFO:tasks.workunit.client.0.smithi118.stdout:5/885: write d0/d63/fed [772041,85273] 0 2024-09-21T11:39:46.260 INFO:tasks.workunit.client.0.smithi118.stdout:1/834: rename d6/d33/d7a to d6/d2a/dc2/dd7/d100 0 2024-09-21T11:39:46.261 INFO:tasks.workunit.client.0.smithi118.stdout:1/835: read d6/de/d16/d3f/d50/d72/f75 [640663,33788] 0 2024-09-21T11:39:46.263 INFO:tasks.workunit.client.0.smithi118.stdout:7/983: unlink d0/d3/d14/f108 0 2024-09-21T11:39:46.265 INFO:tasks.workunit.client.0.smithi118.stdout:3/946: mknod d5/d1d/d1b/d24/dcd/dc1/d14f/c153 0 2024-09-21T11:39:46.268 INFO:tasks.workunit.client.0.smithi118.stdout:1/836: dwrite d6/d3b/ff4 [0,4194304] 0 2024-09-21T11:39:46.269 INFO:tasks.workunit.client.0.smithi118.stdout:1/837: chown d6/de/d16/d3f/d86/ce1 765799125 1 2024-09-21T11:39:46.269 INFO:tasks.workunit.client.0.smithi118.stdout:6/797: creat d8/d48/d45/de1/dbf/dcb/ffe x:0 0 0 2024-09-21T11:39:46.271 INFO:tasks.workunit.client.0.smithi118.stdout:1/838: chown d6/d2a/d5c/f9f 36758 1 2024-09-21T11:39:46.271 INFO:tasks.workunit.client.0.smithi118.stdout:6/798: read d8/f5c [1517186,94805] 0 2024-09-21T11:39:46.272 INFO:tasks.workunit.client.0.smithi118.stdout:6/799: chown d8/d14/d3a/le9 167 1 2024-09-21T11:39:46.275 INFO:tasks.workunit.client.0.smithi118.stdout:3/947: truncate d5/d1d/d1b/d4c/d91/f7b 3596626 0 2024-09-21T11:39:46.278 INFO:tasks.workunit.client.0.smithi118.stdout:1/839: creat d6/d2a/d3d/f101 x:0 0 0 2024-09-21T11:39:46.279 INFO:tasks.workunit.client.0.smithi118.stdout:5/886: dwrite d0/d6c/d25/f43 [4194304,4194304] 0 2024-09-21T11:39:46.284 INFO:tasks.workunit.client.0.smithi118.stdout:3/948: mknod d5/d28/d33/d4a/c154 0 2024-09-21T11:39:46.285 INFO:tasks.workunit.client.0.smithi118.stdout:3/949: readlink d5/d1d/d1b/d24/dcd/lad 0 2024-09-21T11:39:46.287 INFO:tasks.workunit.client.0.smithi118.stdout:7/984: rmdir d0/d3/d14/d41/d66/def 0 2024-09-21T11:39:46.291 INFO:tasks.workunit.client.0.smithi118.stdout:6/800: rmdir d8/d14/d3a/dfd 0 2024-09-21T11:39:46.293 INFO:tasks.workunit.client.0.smithi118.stdout:6/801: read d8/d14/f1d [338949,128873] 0 2024-09-21T11:39:46.295 INFO:tasks.workunit.client.0.smithi118.stdout:1/840: creat d6/d2a/f102 x:0 0 0 2024-09-21T11:39:46.299 INFO:tasks.workunit.client.0.smithi118.stdout:5/887: rmdir d0/d89/dfa 0 2024-09-21T11:39:46.301 INFO:tasks.workunit.client.0.smithi118.stdout:6/802: mkdir d8/d48/d9f/dff 0 2024-09-21T11:39:46.305 INFO:tasks.workunit.client.0.smithi118.stdout:5/888: dwrite d0/db/d26/d65/fe0 [0,4194304] 0 2024-09-21T11:39:46.305 INFO:tasks.workunit.client.0.smithi118.stdout:5/889: chown d0/dbf 3415 1 2024-09-21T11:39:46.308 INFO:tasks.workunit.client.0.smithi118.stdout:1/841: truncate d6/d2a/fac 939843 0 2024-09-21T11:39:46.310 INFO:tasks.workunit.client.0.smithi118.stdout:7/985: dwrite d0/f2a [0,4194304] 0 2024-09-21T11:39:46.312 INFO:tasks.workunit.client.0.smithi118.stdout:7/986: chown d0/d3/d14/d41/d66/d9d/cfc 254758 1 2024-09-21T11:39:46.314 INFO:tasks.workunit.client.0.smithi118.stdout:3/950: write d5/d28/f71 [985900,54438] 0 2024-09-21T11:39:46.315 INFO:tasks.workunit.client.0.smithi118.stdout:3/951: chown d5/d28/d33/d4a/dc8/cf5 33729964 1 2024-09-21T11:39:46.316 INFO:tasks.workunit.client.0.smithi118.stdout:6/803: getdents d8/d14/d33 0 2024-09-21T11:39:46.317 INFO:tasks.workunit.client.0.smithi118.stdout:3/952: read - d5/d1d/d1b/d4c/d73/dc4/f10f zero size 2024-09-21T11:39:46.322 INFO:tasks.workunit.client.0.smithi118.stdout:5/890: write d0/db/d35/d2c/d40/fdc [1526687,110768] 0 2024-09-21T11:39:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:45 smithi118 ceph-mon[28757]: pgmap v38: 65 pgs: 65 active+clean; 2.6 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 32 MiB/s rd, 92 MiB/s wr, 257 op/s 2024-09-21T11:39:46.324 INFO:tasks.workunit.client.0.smithi118.stdout:1/842: creat d6/de/d16/f103 x:0 0 0 2024-09-21T11:39:46.325 INFO:tasks.workunit.client.0.smithi118.stdout:6/804: dwrite d8/d48/d45/de1/dbf/dcb/ffe [0,4194304] 0 2024-09-21T11:39:46.327 INFO:tasks.workunit.client.0.smithi118.stdout:6/805: dread - d8/d14/dba/fdb zero size 2024-09-21T11:39:46.331 INFO:tasks.workunit.client.0.smithi118.stdout:5/891: dread d0/db/d35/d30/d1a/f76 [4194304,4194304] 0 2024-09-21T11:39:46.334 INFO:tasks.workunit.client.0.smithi118.stdout:1/843: dread d6/d2a/fbb [0,4194304] 0 2024-09-21T11:39:46.336 INFO:tasks.workunit.client.0.smithi118.stdout:3/953: dwrite d5/d1d/d1b/d24/dcd/f96 [0,4194304] 0 2024-09-21T11:39:46.338 INFO:tasks.workunit.client.0.smithi118.stdout:6/806: dread d8/d14/f63 [0,4194304] 0 2024-09-21T11:39:46.340 INFO:tasks.workunit.client.0.smithi118.stdout:1/844: mknod d6/d2a/d5c/d85/c104 0 2024-09-21T11:39:46.343 INFO:tasks.workunit.client.0.smithi118.stdout:5/892: getdents d0/db/d35/def/d92/d118 0 2024-09-21T11:39:46.343 INFO:tasks.workunit.client.0.smithi118.stdout:3/954: dwrite d5/d28/f106 [0,4194304] 0 2024-09-21T11:39:46.345 INFO:tasks.workunit.client.0.smithi118.stdout:6/807: mkdir d8/d14/d33/d92/d100 0 2024-09-21T11:39:46.346 INFO:tasks.workunit.client.0.smithi118.stdout:3/955: read d5/d1d/d1b/d4c/f115 [146552,15504] 0 2024-09-21T11:39:46.347 INFO:tasks.workunit.client.0.smithi118.stdout:3/956: readlink d5/d28/d33/l3d 0 2024-09-21T11:39:46.351 INFO:tasks.workunit.client.0.smithi118.stdout:6/808: creat d8/d48/f101 x:0 0 0 2024-09-21T11:39:46.352 INFO:tasks.workunit.client.0.smithi118.stdout:5/893: getdents d0/db/d35/d30/d1a/df6 0 2024-09-21T11:39:46.352 INFO:tasks.workunit.client.0.smithi118.stdout:7/987: dread d0/d3/d14/d41/f6f [0,4194304] 0 2024-09-21T11:39:46.354 INFO:tasks.workunit.client.0.smithi118.stdout:5/894: fdatasync d0/f5 0 2024-09-21T11:39:46.355 INFO:tasks.workunit.client.0.smithi118.stdout:5/895: stat d0/db/d35/d95/f113 0 2024-09-21T11:39:46.356 INFO:tasks.workunit.client.0.smithi118.stdout:7/988: chown d0/d3/d14/d41/d66/d6d/d147/d110/c23 1205 1 2024-09-21T11:39:46.359 INFO:tasks.workunit.client.0.smithi118.stdout:5/896: symlink d0/db/d35/da/dd7/l12b 0 2024-09-21T11:39:46.360 INFO:tasks.workunit.client.0.smithi118.stdout:5/897: write d0/db/d35/def/f81 [242592,88783] 0 2024-09-21T11:39:46.362 INFO:tasks.workunit.client.0.smithi118.stdout:6/809: creat d8/d48/d45/de1/dbf/dcb/f102 x:0 0 0 2024-09-21T11:39:46.368 INFO:tasks.workunit.client.0.smithi118.stdout:5/898: rename d0/d6c/f6a to d0/d117/f12c 0 2024-09-21T11:39:46.369 INFO:tasks.workunit.client.0.smithi118.stdout:6/810: creat d8/d48/df5/f103 x:0 0 0 2024-09-21T11:39:46.369 INFO:tasks.workunit.client.0.smithi118.stdout:5/899: chown d0/d63/fed 1129260260 1 2024-09-21T11:39:46.371 INFO:tasks.workunit.client.0.smithi118.stdout:7/989: dread d0/d3/d14/d41/da0/fad [0,4194304] 0 2024-09-21T11:39:46.372 INFO:tasks.workunit.client.0.smithi118.stdout:7/990: chown d0/d3/d14/l1a 0 1 2024-09-21T11:39:46.372 INFO:tasks.workunit.client.0.smithi118.stdout:6/811: mknod d8/d46/db3/c104 0 2024-09-21T11:39:46.373 INFO:tasks.workunit.client.0.smithi118.stdout:5/900: symlink d0/l12d 0 2024-09-21T11:39:46.374 INFO:tasks.workunit.client.0.smithi118.stdout:1/845: dread d6/d33/d3c/f9b [0,4194304] 0 2024-09-21T11:39:46.374 INFO:tasks.workunit.client.0.smithi118.stdout:5/901: chown d0/d89/daa/fb4 65333 1 2024-09-21T11:39:46.375 INFO:tasks.workunit.client.0.smithi118.stdout:1/846: fdatasync d6/d2a/d3d/f101 0 2024-09-21T11:39:46.375 INFO:tasks.workunit.client.0.smithi118.stdout:7/991: mkdir d0/d149 0 2024-09-21T11:39:46.378 INFO:tasks.workunit.client.0.smithi118.stdout:7/992: creat d0/d3/d13/dd5/f14a x:0 0 0 2024-09-21T11:39:46.381 INFO:tasks.workunit.client.0.smithi118.stdout:5/902: creat d0/db/d35/d30/d66/d100/d11d/f12e x:0 0 0 2024-09-21T11:39:46.381 INFO:tasks.workunit.client.0.smithi118.stdout:7/993: symlink d0/d3/d13/dd5/l14b 0 2024-09-21T11:39:46.382 INFO:tasks.workunit.client.0.smithi118.stdout:6/812: dread d8/f22 [0,4194304] 0 2024-09-21T11:39:46.384 INFO:tasks.workunit.client.0.smithi118.stdout:7/994: symlink d0/d3/d14/d41/d66/d6d/d147/l14c 0 2024-09-21T11:39:46.386 INFO:tasks.workunit.client.0.smithi118.stdout:5/903: mknod d0/db/d35/d2c/c12f 0 2024-09-21T11:39:46.386 INFO:tasks.workunit.client.0.smithi118.stdout:6/813: symlink d8/d48/d6c/d64/l105 0 2024-09-21T11:39:46.387 INFO:tasks.workunit.client.0.smithi118.stdout:6/814: stat d8/d48/d45/de1/dbf/dcb/d70/d7d/fae 0 2024-09-21T11:39:46.390 INFO:tasks.workunit.client.0.smithi118.stdout:1/847: getdents d6/d2a 0 2024-09-21T11:39:46.393 INFO:tasks.workunit.client.0.smithi118.stdout:5/904: getdents d0/db/deb/d115/d10a 0 2024-09-21T11:39:46.395 INFO:tasks.workunit.client.0.smithi118.stdout:1/848: creat d6/d2a/d53/f105 x:0 0 0 2024-09-21T11:39:46.396 INFO:tasks.workunit.client.0.smithi118.stdout:6/815: dwrite d8/d46/dca/fdd [0,4194304] 0 2024-09-21T11:39:46.398 INFO:tasks.workunit.client.0.smithi118.stdout:7/995: dwrite d0/d3/d14/f107 [0,4194304] 0 2024-09-21T11:39:46.398 INFO:tasks.workunit.client.0.smithi118.stdout:5/905: symlink d0/db/d35/d30/d1a/d8f/d99/l130 0 2024-09-21T11:39:46.399 INFO:tasks.workunit.client.0.smithi118.stdout:6/816: write d8/d48/d6c/f69 [2239477,63121] 0 2024-09-21T11:39:46.403 INFO:tasks.workunit.client.0.smithi118.stdout:7/996: fdatasync d0/d3/fc1 0 2024-09-21T11:39:46.405 INFO:tasks.workunit.client.0.smithi118.stdout:5/906: mkdir d0/db/d35/d2c/d40/d131 0 2024-09-21T11:39:46.411 INFO:tasks.workunit.client.0.smithi118.stdout:7/997: chown d0/d3/d14/f65 63032 1 2024-09-21T11:39:46.411 INFO:tasks.workunit.client.0.smithi118.stdout:1/849: read d6/d2a/dc2/d9e/faa [7816579,52691] 0 2024-09-21T11:39:46.413 INFO:tasks.workunit.client.0.smithi118.stdout:1/850: write d6/d2a/d53/f105 [206545,83050] 0 2024-09-21T11:39:46.415 INFO:tasks.workunit.client.0.smithi118.stdout:1/851: truncate d6/de/d16/f103 112328 0 2024-09-21T11:39:46.416 INFO:tasks.workunit.client.0.smithi118.stdout:6/817: rename d8/d14/d3a/cb9 to d8/d48/d5f/d6b/c106 0 2024-09-21T11:39:46.417 INFO:tasks.workunit.client.0.smithi118.stdout:1/852: dread - d6/d2a/d3d/db9/fe3 zero size 2024-09-21T11:39:46.419 INFO:tasks.workunit.client.0.smithi118.stdout:5/907: getdents d0/d89/d9f 0 2024-09-21T11:39:46.424 INFO:tasks.workunit.client.0.smithi118.stdout:1/853: chown d6/d33/d3c/dec 1 1 2024-09-21T11:39:46.433 INFO:tasks.workunit.client.0.smithi118.stdout:7/998: link d0/d3/d1d/f7d d0/d3/d14/d41/d66/d6d/d147/d110/d5f/d71/f14d 0 2024-09-21T11:39:46.437 INFO:tasks.workunit.client.0.smithi118.stdout:6/818: getdents d8/d14/d44 0 2024-09-21T11:39:46.437 INFO:tasks.workunit.client.0.smithi118.stdout:1/854: link d6/de/d16/d3f/l6b d6/dd8/l106 0 2024-09-21T11:39:46.439 INFO:tasks.workunit.client.0.smithi118.stdout:7/999: dwrite d0/d3/d1d/f10b [0,4194304] 0 2024-09-21T11:39:46.441 INFO:tasks.workunit.client.0.smithi118.stdout:6/819: creat d8/d48/dd6/f107 x:0 0 0 2024-09-21T11:39:46.444 INFO:tasks.workunit.client.0.smithi118.stdout:6/820: rename d8/d46/db3 to d8/d14/d33/d92/dc1/d108 0 2024-09-21T11:39:46.447 INFO:tasks.workunit.client.0.smithi118.stdout:6/821: dread - d8/d14/d33/d92/dc1/d108/fc2 zero size 2024-09-21T11:39:46.447 INFO:tasks.workunit.client.0.smithi118.stdout:6/822: chown d8/d14/d44/fd5 25 1 2024-09-21T11:39:46.450 INFO:tasks.workunit.client.0.smithi118.stdout:5/908: write d0/d6c/fcb [2278660,65493] 0 2024-09-21T11:39:46.455 INFO:tasks.workunit.client.0.smithi118.stdout:5/909: rename d0/db/c20 to d0/db/d35/def/d92/c132 0 2024-09-21T11:39:46.455 INFO:tasks.workunit.client.0.smithi118.stdout:1/855: write d6/d2a/d5c/d85/f9c [1249609,57097] 0 2024-09-21T11:39:46.457 INFO:tasks.workunit.client.0.smithi118.stdout:6/823: write d8/d48/d45/de1/dbf/dcb/d70/d7d/fae [3305401,97645] 0 2024-09-21T11:39:46.459 INFO:tasks.workunit.client.0.smithi118.stdout:1/856: mkdir d6/d2a/dc2/dd7/d107 0 2024-09-21T11:39:46.463 INFO:tasks.workunit.client.0.smithi118.stdout:1/857: dread d6/de/d16/d3f/d50/d54/f39 [0,4194304] 0 2024-09-21T11:39:46.464 INFO:tasks.workunit.client.0.smithi118.stdout:6/824: rename d8/d48/d72/d7e to d8/d46/dca/d109 0 2024-09-21T11:39:46.466 INFO:tasks.workunit.client.0.smithi118.stdout:1/858: creat d6/de/d16/d3f/d50/f108 x:0 0 0 2024-09-21T11:39:46.468 INFO:tasks.workunit.client.0.smithi118.stdout:1/859: creat d6/d2a/d5c/db8/f109 x:0 0 0 2024-09-21T11:39:46.469 INFO:tasks.workunit.client.0.smithi118.stdout:5/910: creat d0/db/f133 x:0 0 0 2024-09-21T11:39:46.469 INFO:tasks.workunit.client.0.smithi118.stdout:1/860: chown d6/de/d16/d3f/d50/d72 133501 1 2024-09-21T11:39:46.471 INFO:tasks.workunit.client.0.smithi118.stdout:5/911: mknod d0/d6c/dba/c134 0 2024-09-21T11:39:46.476 INFO:tasks.workunit.client.0.smithi118.stdout:5/912: mknod d0/dbf/c135 0 2024-09-21T11:39:46.481 INFO:tasks.workunit.client.0.smithi118.stdout:6/825: truncate d8/d48/d45/de1/dbf/dcb/d66/fde 546083 0 2024-09-21T11:39:46.482 INFO:tasks.workunit.client.0.smithi118.stdout:6/826: write d8/d48/d6c/f69 [3523224,87412] 0 2024-09-21T11:39:46.484 INFO:tasks.workunit.client.0.smithi118.stdout:5/913: mknod d0/db/d35/def/de8/c136 0 2024-09-21T11:39:46.484 INFO:tasks.workunit.client.0.smithi118.stdout:1/861: write d6/de/d16/d3f/d50/d54/fcf [607280,88479] 0 2024-09-21T11:39:46.486 INFO:tasks.workunit.client.0.smithi118.stdout:6/827: unlink d8/d14/d33/l85 0 2024-09-21T11:39:46.489 INFO:tasks.workunit.client.0.smithi118.stdout:1/862: creat d6/d2a/d5c/db8/f10a x:0 0 0 2024-09-21T11:39:46.494 INFO:tasks.workunit.client.0.smithi118.stdout:6/828: creat d8/d48/d9f/da1/f10a x:0 0 0 2024-09-21T11:39:46.494 INFO:tasks.workunit.client.0.smithi118.stdout:6/829: chown d8/f15 57233589 1 2024-09-21T11:39:46.494 INFO:tasks.workunit.client.0.smithi118.stdout:5/914: rmdir d0/db/d35/d30/d101 0 2024-09-21T11:39:46.496 INFO:tasks.workunit.client.0.smithi118.stdout:1/863: getdents d6/d2a/dc2/dd7/d107 0 2024-09-21T11:39:46.497 INFO:tasks.workunit.client.0.smithi118.stdout:1/864: truncate d6/de/d16/f103 618099 0 2024-09-21T11:39:46.505 INFO:tasks.workunit.client.0.smithi118.stdout:6/830: mkdir d8/d48/d45/de1/dbf/d10b 0 2024-09-21T11:39:46.505 INFO:tasks.workunit.client.0.smithi118.stdout:5/915: creat d0/db/deb/f137 x:0 0 0 2024-09-21T11:39:46.528 INFO:tasks.workunit.client.0.smithi118.stdout:2/918: sync 2024-09-21T11:39:46.528 INFO:tasks.workunit.client.0.smithi118.stdout:9/989: sync 2024-09-21T11:39:46.528 INFO:tasks.workunit.client.0.smithi118.stdout:4/967: sync 2024-09-21T11:39:46.529 INFO:tasks.workunit.client.0.smithi118.stdout:4/968: chown d2/d6/d14a/d1c/d87/da9/d97 1787883103 1 2024-09-21T11:39:46.555 INFO:tasks.workunit.client.0.smithi118.stdout:1/865: mknod d6/d33/d3c/c10b 0 2024-09-21T11:39:46.561 INFO:tasks.workunit.client.0.smithi118.stdout:1/866: creat d6/d2a/d3d/de5/f10c x:0 0 0 2024-09-21T11:39:46.563 INFO:tasks.workunit.client.0.smithi118.stdout:2/919: dwrite de/d53/f8d [4194304,4194304] 0 2024-09-21T11:39:46.565 INFO:tasks.workunit.client.0.smithi118.stdout:4/969: mkdir d2/d6/d14a/d1c/d4d/def/d14f 0 2024-09-21T11:39:46.566 INFO:tasks.workunit.client.0.smithi118.stdout:1/867: symlink d6/d2a/dc2/l10d 0 2024-09-21T11:39:46.568 INFO:tasks.workunit.client.0.smithi118.stdout:5/916: rmdir d0/db/d35/d2c/d40/d131 0 2024-09-21T11:39:46.572 INFO:tasks.workunit.client.0.smithi118.stdout:1/868: creat d6/d2a/dc2/dd7/f10e x:0 0 0 2024-09-21T11:39:46.574 INFO:tasks.workunit.client.0.smithi118.stdout:6/831: link d8/f4b d8/d14/f10c 0 2024-09-21T11:39:46.576 INFO:tasks.workunit.client.0.smithi118.stdout:5/917: mknod d0/c138 0 2024-09-21T11:39:46.579 INFO:tasks.workunit.client.0.smithi118.stdout:1/869: mknod d6/de/d16/d3f/d50/df6/c10f 0 2024-09-21T11:39:46.583 INFO:tasks.workunit.client.0.smithi118.stdout:5/918: truncate d0/d6c/d25/d50/f55 706006 0 2024-09-21T11:39:46.583 INFO:tasks.workunit.client.0.smithi118.stdout:3/957: sync 2024-09-21T11:39:46.583 INFO:tasks.workunit.client.0.smithi118.stdout:5/919: write d0/d89/f12a [368008,27711] 0 2024-09-21T11:39:46.586 INFO:tasks.workunit.client.0.smithi118.stdout:3/958: creat d5/d28/d3e/daa/d13e/d14d/f155 x:0 0 0 2024-09-21T11:39:46.587 INFO:tasks.workunit.client.0.smithi118.stdout:5/920: creat d0/d89/d9f/f139 x:0 0 0 2024-09-21T11:39:46.593 INFO:tasks.workunit.client.0.smithi118.stdout:5/921: dwrite d0/db/d35/d2c/d40/fdc [0,4194304] 0 2024-09-21T11:39:46.595 INFO:tasks.workunit.client.0.smithi118.stdout:3/959: creat d5/d28/f156 x:0 0 0 2024-09-21T11:39:46.600 INFO:tasks.workunit.client.0.smithi118.stdout:5/922: mkdir d0/db/d35/d30/d1a/d8f/d13a 0 2024-09-21T11:39:46.609 INFO:tasks.workunit.client.0.smithi118.stdout:5/923: link d0/db/d35/d30/d66/d100/l112 d0/db/d26/d65/d10b/l13b 0 2024-09-21T11:39:46.610 INFO:tasks.workunit.client.0.smithi118.stdout:5/924: chown d0/db/d35/def/d92/l107 2 1 2024-09-21T11:39:46.612 INFO:tasks.workunit.client.0.smithi118.stdout:5/925: creat d0/d63/f13c x:0 0 0 2024-09-21T11:39:46.613 INFO:tasks.workunit.client.0.smithi118.stdout:5/926: readlink d0/db/d35/d30/d1a/d8f/la7 0 2024-09-21T11:39:46.615 INFO:tasks.workunit.client.0.smithi118.stdout:5/927: mkdir d0/db/d26/d13d 0 2024-09-21T11:39:46.616 INFO:tasks.workunit.client.0.smithi118.stdout:5/928: chown d0/db/d35/def/d92/lb1 7336 1 2024-09-21T11:39:46.622 INFO:tasks.workunit.client.0.smithi118.stdout:5/929: dwrite d0/d6c/d25/f4f [4194304,4194304] 0 2024-09-21T11:39:46.622 INFO:tasks.workunit.client.0.smithi118.stdout:3/960: dread d5/d1d/d1b/d4c/d73/d9b/f97 [0,4194304] 0 2024-09-21T11:39:46.623 INFO:tasks.workunit.client.0.smithi118.stdout:3/961: readlink d5/d1d/le7 0 2024-09-21T11:39:46.624 INFO:tasks.workunit.client.0.smithi118.stdout:5/930: dread - d0/db/d35/d30/d1a/d8f/d99/f116 zero size 2024-09-21T11:39:46.631 INFO:tasks.workunit.client.0.smithi118.stdout:9/990: dwrite d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/f83 [0,4194304] 0 2024-09-21T11:39:46.633 INFO:tasks.workunit.client.0.smithi118.stdout:4/970: write d2/d6/d14a/d1c/d23/d26/fbe [948936,28386] 0 2024-09-21T11:39:46.634 INFO:tasks.workunit.client.0.smithi118.stdout:3/962: dread d5/d1d/d1b/d4c/d73/dc4/ded/f142 [0,4194304] 0 2024-09-21T11:39:46.635 INFO:tasks.workunit.client.0.smithi118.stdout:5/931: link d0/db/d35/d2c/c12f d0/c13e 0 2024-09-21T11:39:46.636 INFO:tasks.workunit.client.0.smithi118.stdout:3/963: readlink d5/d28/d3e/l52 0 2024-09-21T11:39:46.637 INFO:tasks.workunit.client.0.smithi118.stdout:6/832: write d8/d48/d45/de1/dbf/dcb/d70/fe3 [1267810,74358] 0 2024-09-21T11:39:46.639 INFO:tasks.workunit.client.0.smithi118.stdout:9/991: mknod d0/d4/d45/db5/c15a 0 2024-09-21T11:39:46.640 INFO:tasks.workunit.client.0.smithi118.stdout:1/870: truncate f1 3703818 0 2024-09-21T11:39:46.642 INFO:tasks.workunit.client.0.smithi118.stdout:5/932: unlink d0/dd1/ld2 0 2024-09-21T11:39:46.643 INFO:tasks.workunit.client.0.smithi118.stdout:3/964: fsync d5/d28/d3e/f44 0 2024-09-21T11:39:46.646 INFO:tasks.workunit.client.0.smithi118.stdout:2/920: dwrite de/d53/f86 [0,4194304] 0 2024-09-21T11:39:46.646 INFO:tasks.workunit.client.0.smithi118.stdout:4/971: truncate d2/d6/d14a/d1c/d4d/d52/d69/f81 4374438 0 2024-09-21T11:39:46.648 INFO:tasks.workunit.client.0.smithi118.stdout:4/972: fdatasync d2/d6/d14a/d1c/fcf 0 2024-09-21T11:39:46.649 INFO:tasks.workunit.client.0.smithi118.stdout:6/833: rename d8/d14/d44/f9d to d8/d14/d33/d92/f10d 0 2024-09-21T11:39:46.650 INFO:tasks.workunit.client.0.smithi118.stdout:6/834: chown d8/d14/f82 162498518 1 2024-09-21T11:39:46.652 INFO:tasks.workunit.client.0.smithi118.stdout:9/992: truncate d0/d20/d4c/d5f/d6c/dd0/f107 1729205 0 2024-09-21T11:39:46.655 INFO:tasks.workunit.client.0.smithi118.stdout:4/973: creat d2/d131/f150 x:0 0 0 2024-09-21T11:39:46.659 INFO:tasks.workunit.client.0.smithi118.stdout:6/835: mkdir d8/d46/dca/d10e 0 2024-09-21T11:39:46.661 INFO:tasks.workunit.client.0.smithi118.stdout:4/974: read - d2/d6/d12a/f129 zero size 2024-09-21T11:39:46.671 INFO:tasks.workunit.client.0.smithi118.stdout:5/933: getdents d0/db/d35/d30/d1a 0 2024-09-21T11:39:46.674 INFO:tasks.workunit.client.0.smithi118.stdout:3/965: rename d5/d28/l2d to d5/d28/d3e/d5d/d5f/l157 0 2024-09-21T11:39:46.675 INFO:tasks.workunit.client.0.smithi118.stdout:9/993: rmdir d0/d20/d4c/d5f/d89/df9/d142 0 2024-09-21T11:39:46.679 INFO:tasks.workunit.client.0.smithi118.stdout:2/921: getdents de/d1f/d20/d67/d8a/d6d/d70 0 2024-09-21T11:39:46.679 INFO:tasks.workunit.client.0.smithi118.stdout:6/836: symlink d8/d48/d5f/da3/deb/l10f 0 2024-09-21T11:39:46.683 INFO:tasks.workunit.client.0.smithi118.stdout:3/966: creat d5/d28/d3e/d5d/d5f/d88/f158 x:0 0 0 2024-09-21T11:39:46.684 INFO:tasks.workunit.client.0.smithi118.stdout:9/994: rmdir d0/d4/d38/df6/d119 39 2024-09-21T11:39:46.688 INFO:tasks.workunit.client.0.smithi118.stdout:6/837: creat d8/d48/d5f/f110 x:0 0 0 2024-09-21T11:39:46.689 INFO:tasks.workunit.client.0.smithi118.stdout:6/838: dread - d8/d48/d5f/f110 zero size 2024-09-21T11:39:46.690 INFO:tasks.workunit.client.0.smithi118.stdout:3/967: creat d5/d1d/d1b/d24/f159 x:0 0 0 2024-09-21T11:39:46.690 INFO:tasks.workunit.client.0.smithi118.stdout:6/839: stat d8/d46/dca/d109/ce4 0 2024-09-21T11:39:46.698 INFO:tasks.workunit.client.0.smithi118.stdout:2/922: mknod de/c13f 0 2024-09-21T11:39:46.700 INFO:tasks.workunit.client.0.smithi118.stdout:6/840: mkdir d8/d14/d44/d111 0 2024-09-21T11:39:46.702 INFO:tasks.workunit.client.0.smithi118.stdout:3/968: rename d5/d1d/d1b/d24/lba to d5/d1d/d1b/d50/dc6/l15a 0 2024-09-21T11:39:46.709 INFO:tasks.workunit.client.0.smithi118.stdout:6/841: dwrite d8/f93 [0,4194304] 0 2024-09-21T11:39:46.709 INFO:tasks.workunit.client.0.smithi118.stdout:3/969: rename d5/d1d/d1b/f122 to d5/d1d/d1b/d4c/d73/dc4/ded/f15b 0 2024-09-21T11:39:46.711 INFO:tasks.workunit.client.0.smithi118.stdout:6/842: write d8/d48/d5f/d6b/fc9 [3467685,67574] 0 2024-09-21T11:39:46.716 INFO:tasks.workunit.client.0.smithi118.stdout:6/843: mkdir d8/d48/d45/de1/dbf/dcb/d70/d112 0 2024-09-21T11:39:46.722 INFO:tasks.workunit.client.0.smithi118.stdout:5/934: getdents d0 0 2024-09-21T11:39:46.723 INFO:tasks.workunit.client.0.smithi118.stdout:5/935: write d0/d63/fed [646762,122270] 0 2024-09-21T11:39:46.726 INFO:tasks.workunit.client.0.smithi118.stdout:3/970: getdents d5/d28/d3e/d5d/d8d 0 2024-09-21T11:39:46.726 INFO:tasks.workunit.client.0.smithi118.stdout:3/971: fsync d5/d1d/f12c 0 2024-09-21T11:39:46.727 INFO:tasks.workunit.client.0.smithi118.stdout:6/844: link d8/d48/d72/f9c d8/d48/d5f/d6b/f113 0 2024-09-21T11:39:46.729 INFO:tasks.workunit.client.0.smithi118.stdout:5/936: creat d0/db/deb/f13f x:0 0 0 2024-09-21T11:39:46.731 INFO:tasks.workunit.client.0.smithi118.stdout:5/937: chown d0/db/d35/def/de8/c136 18 1 2024-09-21T11:39:46.731 INFO:tasks.workunit.client.0.smithi118.stdout:6/845: rmdir d8/d48/d5f/d6b 39 2024-09-21T11:39:46.734 INFO:tasks.workunit.client.0.smithi118.stdout:1/871: dwrite d6/d2a/fbb [0,4194304] 0 2024-09-21T11:39:46.735 INFO:tasks.workunit.client.0.smithi118.stdout:3/972: rename d5/d28/d33/d4a/l6a to d5/l15c 0 2024-09-21T11:39:46.737 INFO:tasks.workunit.client.0.smithi118.stdout:6/846: fsync d8/d14/d33/d92/fc0 0 2024-09-21T11:39:46.740 INFO:tasks.workunit.client.0.smithi118.stdout:1/872: fdatasync d6/d33/dfc/d84/f9a 0 2024-09-21T11:39:46.743 INFO:tasks.workunit.client.0.smithi118.stdout:6/847: symlink d8/d46/dd2/l114 0 2024-09-21T11:39:46.745 INFO:tasks.workunit.client.0.smithi118.stdout:3/973: dwrite d5/d1d/d1b/d4c/d73/d9b/f12b [0,4194304] 0 2024-09-21T11:39:46.746 INFO:tasks.workunit.client.0.smithi118.stdout:4/975: dwrite d2/d6/d14a/fa5 [0,4194304] 0 2024-09-21T11:39:46.750 INFO:tasks.workunit.client.0.smithi118.stdout:6/848: mkdir d8/d46/dca/d109/d115 0 2024-09-21T11:39:46.753 INFO:tasks.workunit.client.0.smithi118.stdout:4/976: symlink d2/d8e/l151 0 2024-09-21T11:39:46.754 INFO:tasks.workunit.client.0.smithi118.stdout:3/974: chown d5/d28/d3e/d5d/l12f 97748 1 2024-09-21T11:39:46.756 INFO:tasks.workunit.client.0.smithi118.stdout:9/995: dwrite d0/d20/d4c/d5f/d6c/ff3 [0,4194304] 0 2024-09-21T11:39:46.756 INFO:tasks.workunit.client.0.smithi118.stdout:3/975: chown d5/d28/d3e/d5d/d8d 134 1 2024-09-21T11:39:46.757 INFO:tasks.workunit.client.0.smithi118.stdout:2/923: truncate de/d53/f8d 2768460 0 2024-09-21T11:39:46.764 INFO:tasks.workunit.client.0.smithi118.stdout:3/976: creat d5/d1d/d8c/f15d x:0 0 0 2024-09-21T11:39:46.764 INFO:tasks.workunit.client.0.smithi118.stdout:4/977: dwrite d2/d6/d14a/d1c/d87/da9/d97/de7/f14c [0,4194304] 0 2024-09-21T11:39:46.766 INFO:tasks.workunit.client.0.smithi118.stdout:3/977: truncate d5/d1d/d8c/f15d 414921 0 2024-09-21T11:39:46.769 INFO:tasks.workunit.client.0.smithi118.stdout:3/978: dread d5/d1d/d1b/d4c/d73/f119 [0,4194304] 0 2024-09-21T11:39:46.769 INFO:tasks.workunit.client.0.smithi118.stdout:3/979: stat d5/d28/d3e/d5d/l12f 0 2024-09-21T11:39:46.770 INFO:tasks.workunit.client.0.smithi118.stdout:3/980: dread - d5/d1d/d1b/d4c/d73/dc4/ded/f15b zero size 2024-09-21T11:39:46.771 INFO:tasks.workunit.client.0.smithi118.stdout:4/978: creat d2/d6/d14a/d1c/d4d/d52/d69/f152 x:0 0 0 2024-09-21T11:39:46.773 INFO:tasks.workunit.client.0.smithi118.stdout:4/979: truncate d2/d6/d14a/d1c/d4d/d52/f12d 267633 0 2024-09-21T11:39:46.777 INFO:tasks.workunit.client.0.smithi118.stdout:1/873: write d6/d33/fda [1011326,30798] 0 2024-09-21T11:39:46.780 INFO:tasks.workunit.client.0.smithi118.stdout:2/924: link de/d16/d31/dce/d65/da2/le9 de/d16/d31/dce/d65/da2/d103/l140 0 2024-09-21T11:39:46.784 INFO:tasks.workunit.client.0.smithi118.stdout:9/996: write d0/d20/d4c/d5f/d6c/d88/f11e [907957,65456] 0 2024-09-21T11:39:46.784 INFO:tasks.workunit.client.0.smithi118.stdout:1/874: symlink d6/d3b/dfa/l110 0 2024-09-21T11:39:46.785 INFO:tasks.workunit.client.0.smithi118.stdout:9/997: chown d0/d4/d38/ldf 5 1 2024-09-21T11:39:46.786 INFO:tasks.workunit.client.0.smithi118.stdout:6/849: dread d8/f25 [0,4194304] 0 2024-09-21T11:39:46.787 INFO:tasks.workunit.client.0.smithi118.stdout:9/998: chown d0/d20/d4c/d5f/d6c/d88/d4d/de0/d10f/d7c/fad 13 1 2024-09-21T11:39:46.788 INFO:tasks.workunit.client.0.smithi118.stdout:6/850: write d8/d48/d5f/da3/fa7 [336571,44534] 0 2024-09-21T11:39:46.791 INFO:tasks.workunit.client.0.smithi118.stdout:1/875: truncate d6/d33/fe7 1974316 0 2024-09-21T11:39:46.794 INFO:tasks.workunit.client.0.smithi118.stdout:6/851: mkdir d8/d48/d45/de1/dbf/dcb/d70/d112/d116 0 2024-09-21T11:39:46.797 INFO:tasks.workunit.client.0.smithi118.stdout:9/999: link d0/d20/d4c/d5f/d6c/d88/d4d/le5 d0/de2/l15b 0 2024-09-21T11:39:46.798 INFO:tasks.workunit.client.0.smithi118.stdout:6/852: mknod d8/d48/d5f/da3/c117 0 2024-09-21T11:39:46.798 INFO:tasks.workunit.client.0.smithi118.stdout:6/853: readlink d8/d14/l6e 0 2024-09-21T11:39:46.798 INFO:tasks.workunit.client.0.smithi118.stdout:4/980: write d2/d6/d14a/d1c/d87/da9/d97/f121 [604387,39881] 0 2024-09-21T11:39:46.801 INFO:tasks.workunit.client.0.smithi118.stdout:1/876: rename d6/d33/dfc to d6/de/d111 0 2024-09-21T11:39:46.802 INFO:tasks.workunit.client.0.smithi118.stdout:1/877: read - d6/d2a/d5c/db8/f10a zero size 2024-09-21T11:39:46.805 INFO:tasks.workunit.client.0.smithi118.stdout:1/878: mkdir d6/de/d111/d84/d112 0 2024-09-21T11:39:46.806 INFO:tasks.workunit.client.0.smithi118.stdout:4/981: symlink d2/d6/d14a/d1c/d23/l153 0 2024-09-21T11:39:46.809 INFO:tasks.workunit.client.0.smithi118.stdout:4/982: truncate d2/d6/d14a/d1c/d4d/d52/d69/f152 52029 0 2024-09-21T11:39:46.810 INFO:tasks.workunit.client.0.smithi118.stdout:6/854: link d8/d48/d5f/d6b/c77 d8/d14/d33/d92/d100/c118 0 2024-09-21T11:39:46.811 INFO:tasks.workunit.client.0.smithi118.stdout:4/983: stat d2/d6/d14a/d1c/d87/da9/da8/l117 0 2024-09-21T11:39:46.811 INFO:tasks.workunit.client.0.smithi118.stdout:3/981: dread d5/d1d/d1b/d4c/d73/fb5 [0,4194304] 0 2024-09-21T11:39:46.813 INFO:tasks.workunit.client.0.smithi118.stdout:3/982: stat d5/d1d/d1b/d4c/d73/cf8 0 2024-09-21T11:39:46.816 INFO:tasks.workunit.client.0.smithi118.stdout:6/855: rename d8/d48/d72/c7a to d8/d14/dc4/dcc/c119 0 2024-09-21T11:39:46.817 INFO:tasks.workunit.client.0.smithi118.stdout:1/879: dread d6/d33/d3c/f68 [4194304,4194304] 0 2024-09-21T11:39:46.819 INFO:tasks.workunit.client.0.smithi118.stdout:1/880: read d6/d2a/f51 [3439431,71844] 0 2024-09-21T11:39:46.822 INFO:tasks.workunit.client.0.smithi118.stdout:3/983: dwrite d5/d1d/f23 [0,4194304] 0 2024-09-21T11:39:46.824 INFO:tasks.workunit.client.0.smithi118.stdout:1/881: chown d6/d2a/f97 34 1 2024-09-21T11:39:46.827 INFO:tasks.workunit.client.0.smithi118.stdout:1/882: chown d6/d3b/la1 7059 1 2024-09-21T11:39:46.827 INFO:tasks.workunit.client.0.smithi118.stdout:3/984: unlink d5/d28/d3e/d5d/dfd/l113 0 2024-09-21T11:39:46.829 INFO:tasks.workunit.client.0.smithi118.stdout:6/856: dwrite d8/d14/dc4/fd1 [0,4194304] 0 2024-09-21T11:39:46.830 INFO:tasks.workunit.client.0.smithi118.stdout:2/925: dread de/d53/f8d [0,4194304] 0 2024-09-21T11:39:46.830 INFO:tasks.workunit.client.0.smithi118.stdout:1/883: mknod d6/d33/c113 0 2024-09-21T11:39:46.835 INFO:tasks.workunit.client.0.smithi118.stdout:3/985: read d5/d1d/d1b/d4c/d73/d9b/f97 [2139688,38584] 0 2024-09-21T11:39:46.837 INFO:tasks.workunit.client.0.smithi118.stdout:2/926: fsync de/d1f/d20/fcc 0 2024-09-21T11:39:46.837 INFO:tasks.workunit.client.0.smithi118.stdout:4/984: dwrite d2/d6/d12a/df3/f12f [0,4194304] 0 2024-09-21T11:39:46.837 INFO:tasks.workunit.client.0.smithi118.stdout:1/884: read - d6/d2a/d3d/db9/fc9 zero size 2024-09-21T11:39:46.841 INFO:tasks.workunit.client.0.smithi118.stdout:2/927: write de/d50/d85/f111 [13116338,80946] 0 2024-09-21T11:39:46.844 INFO:tasks.workunit.client.0.smithi118.stdout:3/986: creat d5/d1d/d1b/d14e/f15e x:0 0 0 2024-09-21T11:39:46.844 INFO:tasks.workunit.client.0.smithi118.stdout:1/885: mknod d6/de/d16/c114 0 2024-09-21T11:39:46.845 INFO:tasks.workunit.client.0.smithi118.stdout:1/886: chown d6/d3b/fc1 831451052 1 2024-09-21T11:39:46.845 INFO:tasks.workunit.client.0.smithi118.stdout:2/928: mkdir de/d53/d141 0 2024-09-21T11:39:46.847 INFO:tasks.workunit.client.0.smithi118.stdout:6/857: rename d8/d14/f63 to d8/d14/d3a/f11a 0 2024-09-21T11:39:46.848 INFO:tasks.workunit.client.0.smithi118.stdout:2/929: mknod de/d50/c142 0 2024-09-21T11:39:46.848 INFO:tasks.workunit.client.0.smithi118.stdout:6/858: fsync d8/d48/d45/de1/dbf/dcb/d70/fe3 0 2024-09-21T11:39:46.849 INFO:tasks.workunit.client.0.smithi118.stdout:3/987: fdatasync d5/d1d/d1b/d4c/d91/f93 0 2024-09-21T11:39:46.851 INFO:tasks.workunit.client.0.smithi118.stdout:2/930: fsync de/d16/f32 0 2024-09-21T11:39:46.853 INFO:tasks.workunit.client.0.smithi118.stdout:2/931: truncate de/d1f/d20/fe7 2173435 0 2024-09-21T11:39:46.855 INFO:tasks.workunit.client.0.smithi118.stdout:6/859: rename d8/d48/d45/de1/dbf/dcb/d66/fde to d8/d48/d5f/da3/f11b 0 2024-09-21T11:39:46.857 INFO:tasks.workunit.client.0.smithi118.stdout:3/988: rename d5/d28/f156 to d5/d28/d3e/d5d/d5f/d88/d120/f15f 0 2024-09-21T11:39:46.858 INFO:tasks.workunit.client.0.smithi118.stdout:6/860: chown d8/d48/d5f/da3/deb/cf6 30 1 2024-09-21T11:39:46.860 INFO:tasks.workunit.client.0.smithi118.stdout:2/932: dread de/fcb [0,4194304] 0 2024-09-21T11:39:46.860 INFO:tasks.workunit.client.0.smithi118.stdout:6/861: read d8/d48/d5f/fb1 [1318593,19108] 0 2024-09-21T11:39:46.860 INFO:tasks.workunit.client.0.smithi118.stdout:3/989: getdents d5/d1d/d1b/d50 0 2024-09-21T11:39:46.861 INFO:tasks.workunit.client.0.smithi118.stdout:2/933: read - de/d1f/d20/d67/f118 zero size 2024-09-21T11:39:46.863 INFO:tasks.workunit.client.0.smithi118.stdout:2/934: write de/d22/d3c/d83/fe5 [344138,114422] 0 2024-09-21T11:39:46.865 INFO:tasks.workunit.client.0.smithi118.stdout:2/935: stat de/d16/d31/dce/d4f/d5b/l5f 0 2024-09-21T11:39:46.866 INFO:tasks.workunit.client.0.smithi118.stdout:2/936: fsync de/d53/f86 0 2024-09-21T11:39:46.867 INFO:tasks.workunit.client.0.smithi118.stdout:3/990: dwrite d5/d28/d33/d4a/dc8/f116 [0,4194304] 0 2024-09-21T11:39:46.871 INFO:tasks.workunit.client.0.smithi118.stdout:3/991: symlink d5/d28/d3e/d5d/dfd/l160 0 2024-09-21T11:39:46.875 INFO:tasks.workunit.client.0.smithi118.stdout:4/985: dwrite d2/d6/dd/d35/f3f [4194304,4194304] 0 2024-09-21T11:39:46.877 INFO:tasks.workunit.client.0.smithi118.stdout:3/992: mkdir d5/d28/d3e/d5d/d161 0 2024-09-21T11:39:46.880 INFO:tasks.workunit.client.0.smithi118.stdout:6/862: read d8/d14/d3a/f11a [1759690,103560] 0 2024-09-21T11:39:46.882 INFO:tasks.workunit.client.0.smithi118.stdout:1/887: truncate d6/de/d111/f1c 3340717 0 2024-09-21T11:39:46.884 INFO:tasks.workunit.client.0.smithi118.stdout:3/993: truncate d5/d28/d3e/d5d/f8a 1573531 0 2024-09-21T11:39:46.885 INFO:tasks.workunit.client.0.smithi118.stdout:2/937: getdents de/d16/d31/dce 0 2024-09-21T11:39:46.886 INFO:tasks.workunit.client.0.smithi118.stdout:2/938: chown de/d16/d31/dce/d65/ff0 7 1 2024-09-21T11:39:46.888 INFO:tasks.workunit.client.0.smithi118.stdout:6/863: mkdir d8/d46/dca/d109/d11c 0 2024-09-21T11:39:46.889 INFO:tasks.workunit.client.0.smithi118.stdout:6/864: write d8/d48/df5/f103 [598221,64818] 0 2024-09-21T11:39:46.895 INFO:tasks.workunit.client.0.smithi118.stdout:2/939: symlink de/d16/d31/dce/l143 0 2024-09-21T11:39:46.901 INFO:tasks.workunit.client.0.smithi118.stdout:6/865: symlink d8/d46/dca/d109/d115/l11d 0 2024-09-21T11:39:46.903 INFO:tasks.workunit.client.0.smithi118.stdout:2/940: creat de/d1f/d20/d67/d8a/f144 x:0 0 0 2024-09-21T11:39:46.904 INFO:tasks.workunit.client.0.smithi118.stdout:2/941: readlink de/d16/l121 0 2024-09-21T11:39:46.907 INFO:tasks.workunit.client.0.smithi118.stdout:1/888: dwrite d6/d33/d3c/fcc [0,4194304] 0 2024-09-21T11:39:46.908 INFO:tasks.workunit.client.0.smithi118.stdout:3/994: truncate d5/d28/d3e/daa/f100 459701 0 2024-09-21T11:39:46.909 INFO:tasks.workunit.client.0.smithi118.stdout:1/889: stat d6/d2a/d5c/d85/c104 0 2024-09-21T11:39:46.909 INFO:tasks.workunit.client.0.smithi118.stdout:3/995: chown d5/d28/d33/l62 19376605 1 2024-09-21T11:39:46.910 INFO:tasks.workunit.client.0.smithi118.stdout:2/942: mknod de/d53/dfa/c145 0 2024-09-21T11:39:46.915 INFO:tasks.workunit.client.0.smithi118.stdout:3/996: mknod d5/d28/d3e/daa/d13e/c162 0 2024-09-21T11:39:46.919 INFO:tasks.workunit.client.0.smithi118.stdout:3/997: read d5/d1d/d1b/d50/dc6/ffa [41478,67182] 0 2024-09-21T11:39:46.921 INFO:tasks.workunit.client.0.smithi118.stdout:6/866: dwrite d8/d48/d45/de1/dbf/dcb/d66/f86 [4194304,4194304] 0 2024-09-21T11:39:46.922 INFO:tasks.workunit.client.0.smithi118.stdout:1/890: getdents d6/d2a/d3d/db5 0 2024-09-21T11:39:46.922 INFO:tasks.workunit.client.0.smithi118.stdout:1/891: fdatasync d6/d3b/ff4 0 2024-09-21T11:39:46.923 INFO:tasks.workunit.client.0.smithi118.stdout:2/943: write de/d1f/d20/d78/d98/fdd [875905,84916] 0 2024-09-21T11:39:46.926 INFO:tasks.workunit.client.0.smithi118.stdout:1/892: write d6/d2a/d5c/d85/f9c [7254202,94808] 0 2024-09-21T11:39:46.932 INFO:tasks.workunit.client.0.smithi118.stdout:2/944: symlink de/d16/d25/dba/l146 0 2024-09-21T11:39:46.934 INFO:tasks.workunit.client.0.smithi118.stdout:2/945: write de/d22/d3c/d83/fe5 [128598,75967] 0 2024-09-21T11:39:46.934 INFO:tasks.workunit.client.0.smithi118.stdout:3/998: dread d5/d28/d33/d4a/f79 [0,4194304] 0 2024-09-21T11:39:46.935 INFO:tasks.workunit.client.0.smithi118.stdout:6/867: dwrite d8/d14/d3a/ff8 [0,4194304] 0 2024-09-21T11:39:46.937 INFO:tasks.workunit.client.0.smithi118.stdout:6/868: chown d8/d48/d45/de1/dbf/dcb/d70/d7d/f8c 133532918 1 2024-09-21T11:39:46.940 INFO:tasks.workunit.client.0.smithi118.stdout:3/999: creat d5/d1d/d1b/d4c/d73/dc4/f163 x:0 0 0 2024-09-21T11:39:46.942 INFO:tasks.workunit.client.0.smithi118.stdout:2/946: getdents de/d1f/d20/d78/d98 0 2024-09-21T11:39:46.950 INFO:tasks.workunit.client.0.smithi118.stdout:6/869: dread d8/d48/d6c/f9e [0,4194304] 0 2024-09-21T11:39:46.951 INFO:tasks.workunit.client.0.smithi118.stdout:6/870: chown d8/d48/d45/de1/dbf 119143322 1 2024-09-21T11:39:46.953 INFO:tasks.workunit.client.0.smithi118.stdout:6/871: readlink d8/d48/d5f/da3/ldc 0 2024-09-21T11:39:46.956 INFO:tasks.workunit.client.0.smithi118.stdout:1/893: dread d6/d2a/f23 [0,4194304] 0 2024-09-21T11:39:46.958 INFO:tasks.workunit.client.0.smithi118.stdout:6/872: rmdir d8/d48/d45/de1/dbf/d10b 0 2024-09-21T11:39:46.962 INFO:tasks.workunit.client.0.smithi118.stdout:1/894: read d6/de/d111/f1c [754929,4923] 0 2024-09-21T11:39:46.962 INFO:tasks.workunit.client.0.smithi118.stdout:6/873: readlink d8/d14/l35 0 2024-09-21T11:39:46.963 INFO:tasks.workunit.client.0.smithi118.stdout:6/874: readlink d8/d14/l35 0 2024-09-21T11:39:46.965 INFO:tasks.workunit.client.0.smithi118.stdout:2/947: dwrite de/d1f/d20/fd0 [0,4194304] 0 2024-09-21T11:39:46.966 INFO:tasks.workunit.client.0.smithi118.stdout:6/875: symlink d8/d48/d5f/da3/l11e 0 2024-09-21T11:39:46.967 INFO:tasks.workunit.client.0.smithi118.stdout:6/876: readlink d8/d48/d5f/ld0 0 2024-09-21T11:39:46.969 INFO:tasks.workunit.client.0.smithi118.stdout:6/877: write d8/d48/d5f/dbd/ffb [307205,1640] 0 2024-09-21T11:39:46.973 INFO:tasks.workunit.client.0.smithi118.stdout:2/948: dwrite de/d16/d31/dce/d65/f124 [0,4194304] 0 2024-09-21T11:39:46.978 INFO:tasks.workunit.client.0.smithi118.stdout:2/949: symlink de/d53/dfa/d12f/l147 0 2024-09-21T11:39:46.982 INFO:tasks.workunit.client.0.smithi118.stdout:1/895: dwrite d6/d3b/fde [0,4194304] 0 2024-09-21T11:39:46.986 INFO:tasks.workunit.client.0.smithi118.stdout:1/896: fsync d6/d33/d3c/f68 0 2024-09-21T11:39:46.993 INFO:tasks.workunit.client.0.smithi118.stdout:1/897: write d6/de/d16/d3f/d50/d54/f39 [1714962,70126] 0 2024-09-21T11:39:47.003 INFO:tasks.workunit.client.0.smithi118.stdout:2/950: dread de/d16/f32 [0,4194304] 0 2024-09-21T11:39:47.007 INFO:tasks.workunit.client.0.smithi118.stdout:2/951: symlink de/d16/d31/dce/d65/da2/d9b/l148 0 2024-09-21T11:39:47.009 INFO:tasks.workunit.client.0.smithi118.stdout:2/952: dread - de/d16/d31/dce/f10e zero size 2024-09-21T11:39:47.060 INFO:tasks.workunit.client.0.smithi118.stdout:1/898: dwrite d6/d33/d3c/f73 [0,4194304] 0 2024-09-21T11:39:47.065 INFO:tasks.workunit.client.0.smithi118.stdout:2/953: mknod de/d16/d31/c149 0 2024-09-21T11:39:47.068 INFO:tasks.workunit.client.0.smithi118.stdout:1/899: dwrite d6/f7f [0,4194304] 0 2024-09-21T11:39:47.069 INFO:tasks.workunit.client.0.smithi118.stdout:1/900: chown d6/d33/d3c/dec 2781 1 2024-09-21T11:39:47.074 INFO:tasks.workunit.client.0.smithi118.stdout:1/901: symlink d6/de/d16/ddd/df8/l115 0 2024-09-21T11:39:47.074 INFO:tasks.workunit.client.0.smithi118.stdout:2/954: dwrite de/d1f/d20/d78/d98/fdd [0,4194304] 0 2024-09-21T11:39:47.077 INFO:tasks.workunit.client.0.smithi118.stdout:2/955: unlink de/d16/d25/dba/lc9 0 2024-09-21T11:39:47.079 INFO:tasks.workunit.client.0.smithi118.stdout:2/956: chown de/d53/dfa/f136 5 1 2024-09-21T11:39:47.084 INFO:tasks.workunit.client.0.smithi118.stdout:2/957: dwrite de/d53/dfa/d12f/f135 [0,4194304] 0 2024-09-21T11:39:47.090 INFO:tasks.workunit.client.0.smithi118.stdout:2/958: dread de/d1f/d20/fd0 [0,4194304] 0 2024-09-21T11:39:47.092 INFO:tasks.workunit.client.0.smithi118.stdout:1/902: write d6/de/d16/d3f/d50/d54/ff1 [584630,88941] 0 2024-09-21T11:39:47.094 INFO:tasks.workunit.client.0.smithi118.stdout:1/903: creat d6/d3b/d45/f116 x:0 0 0 2024-09-21T11:39:47.105 INFO:tasks.workunit.client.0.smithi118.stdout:2/959: dwrite de/d1f/d20/d67/d8a/d6d/d70/f93 [0,4194304] 0 2024-09-21T11:39:47.107 INFO:tasks.workunit.client.0.smithi118.stdout:2/960: truncate de/f2a 794669 0 2024-09-21T11:39:47.112 INFO:tasks.workunit.client.0.smithi118.stdout:2/961: dread de/d16/d31/dce/d65/f124 [0,4194304] 0 2024-09-21T11:39:47.122 INFO:tasks.workunit.client.0.smithi118.stdout:1/904: dread d6/de/f2e [0,4194304] 0 2024-09-21T11:39:47.138 INFO:tasks.workunit.client.0.smithi118.stdout:2/962: mknod de/d16/d31/dce/d4f/c14a 0 2024-09-21T11:39:47.189 INFO:tasks.workunit.client.0.smithi118.stdout:2/963: write de/fcb [151734,59860] 0 2024-09-21T11:39:47.191 INFO:tasks.workunit.client.0.smithi118.stdout:1/905: dwrite d6/d2a/dc2/dd7/d100/f95 [0,4194304] 0 2024-09-21T11:39:47.192 INFO:tasks.workunit.client.0.smithi118.stdout:1/906: readlink d6/de/d16/d3f/lb3 0 2024-09-21T11:39:47.193 INFO:tasks.workunit.client.0.smithi118.stdout:2/964: fsync de/d1f/d20/fb0 0 2024-09-21T11:39:47.193 INFO:tasks.workunit.client.0.smithi118.stdout:1/907: write d6/d33/f5b [3878267,64544] 0 2024-09-21T11:39:47.198 INFO:tasks.workunit.client.0.smithi118.stdout:2/965: readlink de/d1f/d20/d67/d8a/d6d/d70/l11e 0 2024-09-21T11:39:47.199 INFO:tasks.workunit.client.0.smithi118.stdout:2/966: chown de/d1f/d20/f55 82 1 2024-09-21T11:39:47.203 INFO:tasks.workunit.client.0.smithi118.stdout:2/967: dread de/d1f/d20/fd0 [0,4194304] 0 2024-09-21T11:39:47.205 INFO:tasks.workunit.client.0.smithi118.stdout:2/968: unlink de/d51/ff3 0 2024-09-21T11:39:47.208 INFO:tasks.workunit.client.0.smithi118.stdout:2/969: mkdir de/d16/d31/dce/d4f/d5b/d14b 0 2024-09-21T11:39:47.209 INFO:tasks.workunit.client.0.smithi118.stdout:2/970: write de/d50/d85/ff5 [983130,53192] 0 2024-09-21T11:39:47.212 INFO:tasks.workunit.client.0.smithi118.stdout:1/908: dread d6/de/d16/d3f/f4d [0,4194304] 0 2024-09-21T11:39:47.212 INFO:tasks.workunit.client.0.smithi118.stdout:2/971: stat de/d1f/d20/d67/d8a/fac 0 2024-09-21T11:39:47.221 INFO:tasks.workunit.client.0.smithi118.stdout:2/972: creat de/d1f/d20/f14c x:0 0 0 2024-09-21T11:39:47.224 INFO:tasks.workunit.client.0.smithi118.stdout:1/909: dread d6/de/d16/d3f/d50/d72/f80 [0,4194304] 0 2024-09-21T11:39:47.229 INFO:tasks.workunit.client.0.smithi118.stdout:1/910: getdents d6/d2a/d5c/d85 0 2024-09-21T11:39:47.230 INFO:tasks.workunit.client.0.smithi118.stdout:1/911: write d6/de/d16/f103 [175481,112438] 0 2024-09-21T11:39:47.233 INFO:tasks.workunit.client.0.smithi118.stdout:1/912: symlink d6/d2a/dc2/l117 0 2024-09-21T11:39:47.242 INFO:tasks.workunit.client.0.smithi118.stdout:2/973: write de/d51/fad [4161953,94241] 0 2024-09-21T11:39:47.243 INFO:tasks.workunit.client.0.smithi118.stdout:2/974: readlink de/d16/d31/dce/d65/da2/d9b/l148 0 2024-09-21T11:39:47.245 INFO:tasks.workunit.client.0.smithi118.stdout:2/975: write de/d16/d31/f7c [1803976,108163] 0 2024-09-21T11:39:47.251 INFO:tasks.workunit.client.0.smithi118.stdout:2/976: truncate de/d16/d31/f7c 4303682 0 2024-09-21T11:39:47.254 INFO:tasks.workunit.client.0.smithi118.stdout:2/977: rename de/d1f/d20/d67/d8a/d6d/l72 to de/d1f/d20/d67/d8a/d6d/l14d 0 2024-09-21T11:39:47.258 INFO:tasks.workunit.client.0.smithi118.stdout:2/978: link de/f1e de/d16/d25/dba/f14e 0 2024-09-21T11:39:47.259 INFO:tasks.workunit.client.0.smithi118.stdout:2/979: fsync de/d1f/d20/f27 0 2024-09-21T11:39:47.263 INFO:tasks.workunit.client.0.smithi118.stdout:2/980: rmdir de/d22/d3c 39 2024-09-21T11:39:47.266 INFO:tasks.workunit.client.0.smithi118.stdout:2/981: mknod de/d50/d85/c14f 0 2024-09-21T11:39:47.272 INFO:tasks.workunit.client.0.smithi118.stdout:2/982: dwrite de/d22/f131 [0,4194304] 0 2024-09-21T11:39:47.282 INFO:tasks.workunit.client.0.smithi118.stdout:2/983: getdents de/d16/d31/dce/d4f/d5b 0 2024-09-21T11:39:47.284 INFO:tasks.workunit.client.0.smithi118.stdout:2/984: symlink de/d53/dc2/l150 0 2024-09-21T11:39:47.286 INFO:tasks.workunit.client.0.smithi118.stdout:2/985: rename de/d16/fb2 to de/d16/d25/dba/db5/f151 0 2024-09-21T11:39:47.289 INFO:tasks.workunit.client.0.smithi118.stdout:2/986: creat de/d22/f152 x:0 0 0 2024-09-21T11:39:47.293 INFO:tasks.workunit.client.0.smithi118.stdout:2/987: getdents de/d16/d31/dce/d65 0 2024-09-21T11:39:47.295 INFO:tasks.workunit.client.0.smithi118.stdout:2/988: read de/f12 [710201,68651] 0 2024-09-21T11:39:47.297 INFO:tasks.workunit.client.0.smithi118.stdout:2/989: mknod de/d53/dfa/c153 0 2024-09-21T11:39:47.298 INFO:tasks.workunit.client.0.smithi118.stdout:2/990: chown de/d16/d31/dce/d66/fbd 10398441 1 2024-09-21T11:39:47.300 INFO:tasks.workunit.client.0.smithi118.stdout:2/991: write de/d16/d31/dce/d66/f10b [198571,130306] 0 2024-09-21T11:39:47.301 INFO:tasks.workunit.client.0.smithi118.stdout:2/992: truncate de/d1f/d20/fd0 5052742 0 2024-09-21T11:39:47.307 INFO:tasks.workunit.client.0.smithi118.stdout:2/993: dwrite de/d53/dc2/fef [0,4194304] 0 2024-09-21T11:39:47.317 INFO:tasks.workunit.client.0.smithi118.stdout:2/994: write de/d16/d31/dce/d66/d9a/f11c [2644374,14881] 0 2024-09-21T11:39:47.319 INFO:tasks.workunit.client.0.smithi118.stdout:2/995: symlink de/d16/d31/dce/d4f/d5b/l154 0 2024-09-21T11:39:47.321 INFO:tasks.workunit.client.0.smithi118.stdout:2/996: truncate de/d22/d3c/f3f 4977845 0 2024-09-21T11:39:47.326 INFO:tasks.workunit.client.0.smithi118.stdout:2/997: dwrite de/d1f/d20/d78/d98/fdd [0,4194304] 0 2024-09-21T11:39:47.329 INFO:tasks.workunit.client.0.smithi118.stdout:2/998: dread - de/d16/d31/dce/d66/d9a/f110 zero size 2024-09-21T11:39:47.333 INFO:tasks.workunit.client.0.smithi118.stdout:2/999: creat de/d53/dfa/f155 x:0 0 0 2024-09-21T11:39:47.728 INFO:tasks.workunit.client.0.smithi118.stdout:1/913: sync 2024-09-21T11:39:47.729 INFO:tasks.workunit.client.0.smithi118.stdout:4/986: sync 2024-09-21T11:39:47.729 INFO:tasks.workunit.client.0.smithi118.stdout:5/938: sync 2024-09-21T11:39:47.729 INFO:tasks.workunit.client.0.smithi118.stdout:6/878: sync 2024-09-21T11:39:47.729 INFO:tasks.workunit.client.0.smithi118.stdout:4/987: fdatasync d2/d131/f150 0 2024-09-21T11:39:47.730 INFO:tasks.workunit.client.0.smithi118.stdout:6/879: chown d8/f22 6846223 1 2024-09-21T11:39:47.730 INFO:tasks.workunit.client.0.smithi118.stdout:4/988: stat d2/d6/f22 0 2024-09-21T11:39:47.732 INFO:tasks.workunit.client.0.smithi118.stdout:6/880: mkdir d8/d48/d45/de1/d11f 0 2024-09-21T11:39:47.735 INFO:tasks.workunit.client.0.smithi118.stdout:4/989: symlink d2/d6/d14a/d1c/d23/d26/dd6/dcb/db0/l154 0 2024-09-21T11:39:47.735 INFO:tasks.workunit.client.0.smithi118.stdout:5/939: dwrite d0/dd1/f121 [0,4194304] 0 2024-09-21T11:39:47.739 INFO:tasks.workunit.client.0.smithi118.stdout:1/914: link d6/d33/d3c/f73 d6/de/f118 0 2024-09-21T11:39:47.741 INFO:tasks.workunit.client.0.smithi118.stdout:6/881: rename d8/d14/d33/d92/le7 to d8/d14/d44/l120 0 2024-09-21T11:39:47.742 INFO:tasks.workunit.client.0.smithi118.stdout:1/915: truncate d6/d2a/d3d/f101 706249 0 2024-09-21T11:39:47.744 INFO:tasks.workunit.client.0.smithi118.stdout:5/940: dwrite d0/db/d35/def/d92/f9c [0,4194304] 0 2024-09-21T11:39:47.749 INFO:tasks.workunit.client.0.smithi118.stdout:6/882: mknod d8/d48/d45/de1/dbf/dcb/d70/c121 0 2024-09-21T11:39:47.749 INFO:tasks.workunit.client.0.smithi118.stdout:1/916: dwrite d6/f15 [0,4194304] 0 2024-09-21T11:39:47.750 INFO:tasks.workunit.client.0.smithi118.stdout:1/917: chown d6/l9 232 1 2024-09-21T11:39:47.751 INFO:tasks.workunit.client.0.smithi118.stdout:6/883: chown d8/d48/d45/de1/dbf/dcb/d70/f84 51811152 1 2024-09-21T11:39:47.752 INFO:tasks.workunit.client.0.smithi118.stdout:1/918: dread d6/d2a/fac [0,4194304] 0 2024-09-21T11:39:47.754 INFO:tasks.workunit.client.0.smithi118.stdout:1/919: read d6/de/d16/d3f/f4d [1069534,121085] 0 2024-09-21T11:39:47.754 INFO:tasks.workunit.client.0.smithi118.stdout:5/941: creat d0/d6c/d25/d50/dfd/f140 x:0 0 0 2024-09-21T11:39:47.754 INFO:tasks.workunit.client.0.smithi118.stdout:6/884: dread d8/f25 [0,4194304] 0 2024-09-21T11:39:47.756 INFO:tasks.workunit.client.0.smithi118.stdout:6/885: write d8/d48/d9f/da1/f10a [616423,13855] 0 2024-09-21T11:39:47.757 INFO:tasks.workunit.client.0.smithi118.stdout:1/920: creat d6/de/d16/ddd/df8/f119 x:0 0 0 2024-09-21T11:39:47.760 INFO:tasks.workunit.client.0.smithi118.stdout:6/886: unlink d8/d48/d9f/da1/f10a 0 2024-09-21T11:39:47.762 INFO:tasks.workunit.client.0.smithi118.stdout:5/942: creat d0/d6c/f141 x:0 0 0 2024-09-21T11:39:47.762 INFO:tasks.workunit.client.0.smithi118.stdout:4/990: write d2/d6/d14a/d1c/d4d/dba/f108 [39524,18317] 0 2024-09-21T11:39:47.764 INFO:tasks.workunit.client.0.smithi118.stdout:1/921: rename d6/de/d16/ddd/df8/f119 to d6/d33/f11a 0 2024-09-21T11:39:47.769 INFO:tasks.workunit.client.0.smithi118.stdout:1/922: truncate d6/d2a/f51 1220818 0 2024-09-21T11:39:47.769 INFO:tasks.workunit.client.0.smithi118.stdout:1/923: chown d6/de/lb6 259 1 2024-09-21T11:39:47.770 INFO:tasks.workunit.client.0.smithi118.stdout:1/924: truncate d6/d2a/d3d/ff2 722300 0 2024-09-21T11:39:47.771 INFO:tasks.workunit.client.0.smithi118.stdout:6/887: link d8/d48/dd6/f107 d8/d48/d72/f122 0 2024-09-21T11:39:47.774 INFO:tasks.workunit.client.0.smithi118.stdout:5/943: creat d0/db/d35/def/f142 x:0 0 0 2024-09-21T11:39:47.776 INFO:tasks.workunit.client.0.smithi118.stdout:6/888: mkdir d8/d48/d45/de1/dbf/dcb/d70/d112/d116/d123 0 2024-09-21T11:39:47.777 INFO:tasks.workunit.client.0.smithi118.stdout:6/889: write d8/d14/dba/fe5 [719141,129837] 0 2024-09-21T11:39:47.778 INFO:tasks.workunit.client.0.smithi118.stdout:6/890: dread - d8/d48/f101 zero size 2024-09-21T11:39:47.785 INFO:tasks.workunit.client.0.smithi118.stdout:4/991: dwrite d2/d65/f12c [0,4194304] 0 2024-09-21T11:39:47.786 INFO:tasks.workunit.client.0.smithi118.stdout:1/925: write d6/d33/d3c/f64 [865062,61895] 0 2024-09-21T11:39:47.792 INFO:tasks.workunit.client.0.smithi118.stdout:5/944: write d0/d89/daa/ffe [1031535,113986] 0 2024-09-21T11:39:47.794 INFO:tasks.workunit.client.0.smithi118.stdout:1/926: fsync d6/de/f58 0 2024-09-21T11:39:47.795 INFO:tasks.workunit.client.0.smithi118.stdout:6/891: write d8/fa [1176149,98497] 0 2024-09-21T11:39:47.795 INFO:tasks.workunit.client.0.smithi118.stdout:4/992: mkdir d2/d6/d14a/d1c/d4d/dba/d135/d155 0 2024-09-21T11:39:47.797 INFO:tasks.workunit.client.0.smithi118.stdout:5/945: creat d0/db/deb/d115/f143 x:0 0 0 2024-09-21T11:39:47.797 INFO:tasks.workunit.client.0.smithi118.stdout:4/993: truncate d2/d131/f150 760463 0 2024-09-21T11:39:47.798 INFO:tasks.workunit.client.0.smithi118.stdout:4/994: chown d2/d6/dd/d35/cee 8661039 1 2024-09-21T11:39:47.801 INFO:tasks.workunit.client.0.smithi118.stdout:5/946: creat d0/f144 x:0 0 0 2024-09-21T11:39:47.803 INFO:tasks.workunit.client.0.smithi118.stdout:1/927: symlink d6/de/l11b 0 2024-09-21T11:39:47.804 INFO:tasks.workunit.client.0.smithi118.stdout:1/928: fdatasync d6/de/d111/f41 0 2024-09-21T11:39:47.804 INFO:tasks.workunit.client.0.smithi118.stdout:6/892: mknod d8/d48/d9f/dc5/c124 0 2024-09-21T11:39:47.807 INFO:tasks.workunit.client.0.smithi118.stdout:6/893: dread - d8/d46/fe6 zero size 2024-09-21T11:39:47.812 INFO:tasks.workunit.client.0.smithi118.stdout:6/894: readlink d8/d14/d44/l120 0 2024-09-21T11:39:47.814 INFO:tasks.workunit.client.0.smithi118.stdout:4/995: write d2/d6/d14a/d1c/d4d/d52/d69/fc4 [672722,15274] 0 2024-09-21T11:39:47.815 INFO:tasks.workunit.client.0.smithi118.stdout:6/895: rmdir d8/d48/d6c 39 2024-09-21T11:39:47.816 INFO:tasks.workunit.client.0.smithi118.stdout:4/996: read d2/d6/d14a/d1c/d4d/d52/f6a [35772,19671] 0 2024-09-21T11:39:47.819 INFO:tasks.workunit.client.0.smithi118.stdout:4/997: creat d2/d131/f156 x:0 0 0 2024-09-21T11:39:47.822 INFO:tasks.workunit.client.0.smithi118.stdout:1/929: dwrite d6/d33/d3c/f73 [0,4194304] 0 2024-09-21T11:39:47.826 INFO:tasks.workunit.client.0.smithi118.stdout:5/947: dwrite d0/db/d26/d65/f69 [0,4194304] 0 2024-09-21T11:39:47.829 INFO:tasks.workunit.client.0.smithi118.stdout:1/930: truncate d6/de/d111/f8b 632408 0 2024-09-21T11:39:47.830 INFO:tasks.workunit.client.0.smithi118.stdout:6/896: dwrite d8/d14/d3a/f5a [0,4194304] 0 2024-09-21T11:39:47.833 INFO:tasks.workunit.client.0.smithi118.stdout:1/931: stat d6/d3b/fca 0 2024-09-21T11:39:47.835 INFO:tasks.workunit.client.0.smithi118.stdout:6/897: write d8/d48/d5f/dbd/ffb [366249,104978] 0 2024-09-21T11:39:47.837 INFO:tasks.workunit.client.0.smithi118.stdout:4/998: dwrite d2/d6/d14a/d1c/d23/d26/dd6/dcb/db0/dcd/f13d [0,4194304] 0 2024-09-21T11:39:47.840 INFO:tasks.workunit.client.0.smithi118.stdout:1/932: fsync d6/de/d16/d3f/d50/fcb 0 2024-09-21T11:39:47.843 INFO:tasks.workunit.client.0.smithi118.stdout:6/898: rename d8/d14/f99 to d8/d46/dca/d109/d115/f125 0 2024-09-21T11:39:47.845 INFO:tasks.workunit.client.0.smithi118.stdout:4/999: dread - d2/d6/d14a/d1c/d23/d26/dd6/dcb/db0/fde zero size 2024-09-21T11:39:47.848 INFO:tasks.workunit.client.0.smithi118.stdout:1/933: link d6/d33/f5b d6/de/d111/d84/f11c 0 2024-09-21T11:39:47.849 INFO:tasks.workunit.client.0.smithi118.stdout:1/934: stat d6/de 0 2024-09-21T11:39:47.849 INFO:tasks.workunit.client.0.smithi118.stdout:6/899: mkdir d8/d48/d45/d126 0 2024-09-21T11:39:47.850 INFO:tasks.workunit.client.0.smithi118.stdout:1/935: stat d6/de/d16/d3f/d50/d54/l38 0 2024-09-21T11:39:47.851 INFO:tasks.workunit.client.0.smithi118.stdout:1/936: fdatasync d6/d33/d3c/f64 0 2024-09-21T11:39:47.851 INFO:tasks.workunit.client.0.smithi118.stdout:6/900: chown d8/d48/d45/de1/dbf/dcb/d66/l9b 117720080 1 2024-09-21T11:39:47.852 INFO:tasks.workunit.client.0.smithi118.stdout:1/937: readlink d6/d2a/d3d/db9/lc4 0 2024-09-21T11:39:47.855 INFO:tasks.workunit.client.0.smithi118.stdout:6/901: creat d8/d14/d33/d92/dc1/d108/f127 x:0 0 0 2024-09-21T11:39:47.858 INFO:tasks.workunit.client.0.smithi118.stdout:1/938: dwrite d6/d2a/d5c/db8/f109 [0,4194304] 0 2024-09-21T11:39:47.859 INFO:tasks.workunit.client.0.smithi118.stdout:1/939: readlink d6/de/d111/lc6 0 2024-09-21T11:39:47.863 INFO:tasks.workunit.client.0.smithi118.stdout:5/948: dread d0/db/d26/d65/fe0 [0,4194304] 0 2024-09-21T11:39:47.866 INFO:tasks.workunit.client.0.smithi118.stdout:6/902: rename d8/d46/dd2/l114 to d8/d14/d3a/l128 0 2024-09-21T11:39:47.870 INFO:tasks.workunit.client.0.smithi118.stdout:5/949: fsync d0/db/d35/d30/d1a/d8f/d99/db9/fc3 0 2024-09-21T11:39:47.873 INFO:tasks.workunit.client.0.smithi118.stdout:6/903: dwrite d8/f8b [12582912,4194304] 0 2024-09-21T11:39:47.875 INFO:tasks.workunit.client.0.smithi118.stdout:5/950: write d0/db/d35/d30/d1a/db3/f114 [3140665,108602] 0 2024-09-21T11:39:47.876 INFO:tasks.workunit.client.0.smithi118.stdout:5/951: fdatasync d0/db/d35/d2c/f3e 0 2024-09-21T11:39:47.879 INFO:tasks.workunit.client.0.smithi118.stdout:1/940: getdents d6/d33/d3c/dec 0 2024-09-21T11:39:47.880 INFO:tasks.workunit.client.0.smithi118.stdout:1/941: chown d6/d33/d3c/dec/df3/f48 1548017 1 2024-09-21T11:39:47.881 INFO:tasks.workunit.client.0.smithi118.stdout:1/942: fsync d6/de/d16/d3f/d50/d54/fcf 0 2024-09-21T11:39:47.882 INFO:tasks.workunit.client.0.smithi118.stdout:5/952: chown d0/d6c/c8a 30991905 1 2024-09-21T11:39:47.883 INFO:tasks.workunit.client.0.smithi118.stdout:6/904: creat d8/d48/d6c/d64/f129 x:0 0 0 2024-09-21T11:39:47.884 INFO:tasks.workunit.client.0.smithi118.stdout:6/905: chown d8/l17 1200 1 2024-09-21T11:39:47.895 INFO:tasks.workunit.client.0.smithi118.stdout:1/943: write d6/d2a/f97 [155315,90549] 0 2024-09-21T11:39:47.895 INFO:tasks.workunit.client.0.smithi118.stdout:6/906: write d8/d48/d45/f67 [312220,38621] 0 2024-09-21T11:39:47.895 INFO:tasks.workunit.client.0.smithi118.stdout:5/953: truncate d0/fd 3381732 0 2024-09-21T11:39:47.897 INFO:tasks.workunit.client.0.smithi118.stdout:6/907: stat d8/d14/d33/fa6 0 2024-09-21T11:39:47.897 INFO:tasks.workunit.client.0.smithi118.stdout:1/944: dread - d6/d2a/d5c/fd5 zero size 2024-09-21T11:39:47.898 INFO:tasks.workunit.client.0.smithi118.stdout:6/908: write d8/d48/d5f/da3/fa7 [357298,44904] 0 2024-09-21T11:39:47.898 INFO:tasks.workunit.client.0.smithi118.stdout:1/945: write d6/de/d111/f41 [184649,85293] 0 2024-09-21T11:39:47.900 INFO:tasks.workunit.client.0.smithi118.stdout:1/946: write d6/d2a/f102 [361343,69894] 0 2024-09-21T11:39:47.901 INFO:tasks.workunit.client.0.smithi118.stdout:1/947: rmdir d6/d2a/d5c/db8 39 2024-09-21T11:39:47.905 INFO:tasks.workunit.client.0.smithi118.stdout:1/948: fsync d6/de/d16/d3f/d50/fa6 0 2024-09-21T11:39:47.905 INFO:tasks.workunit.client.0.smithi118.stdout:6/909: dread d8/d14/f2d [0,4194304] 0 2024-09-21T11:39:47.906 INFO:tasks.workunit.client.0.smithi118.stdout:6/910: chown d8/d14/d33/d92/d100 0 1 2024-09-21T11:39:47.916 INFO:tasks.workunit.client.0.smithi118.stdout:1/949: write d6/d33/d3c/f98 [48519,82258] 0 2024-09-21T11:39:47.917 INFO:tasks.workunit.client.0.smithi118.stdout:6/911: truncate d8/d14/d3a/f5a 2824511 0 2024-09-21T11:39:47.920 INFO:tasks.workunit.client.0.smithi118.stdout:1/950: truncate d6/de/d16/d3f/f37 5968798 0 2024-09-21T11:39:47.924 INFO:tasks.workunit.client.0.smithi118.stdout:6/912: creat d8/d46/dca/d109/d11c/f12a x:0 0 0 2024-09-21T11:39:47.925 INFO:tasks.workunit.client.0.smithi118.stdout:6/913: readlink d8/d14/lf9 0 2024-09-21T11:39:47.926 INFO:tasks.workunit.client.0.smithi118.stdout:1/951: dwrite d6/d2a/fbb [0,4194304] 0 2024-09-21T11:39:47.930 INFO:tasks.workunit.client.0.smithi118.stdout:6/914: unlink d8/d48/d45/f4d 0 2024-09-21T11:39:47.937 INFO:tasks.workunit.client.0.smithi118.stdout:6/915: getdents d8/d48/d45/de1/d11f 0 2024-09-21T11:39:47.938 INFO:tasks.workunit.client.0.smithi118.stdout:1/952: dread d6/de/d16/d3f/d50/d72/f75 [0,4194304] 0 2024-09-21T11:39:47.939 INFO:tasks.workunit.client.0.smithi118.stdout:6/916: fdatasync d8/d14/f24 0 2024-09-21T11:39:47.952 INFO:tasks.workunit.client.0.smithi118.stdout:6/917: dread d8/d14/f24 [0,4194304] 0 2024-09-21T11:39:47.962 INFO:tasks.workunit.client.0.smithi118.stdout:1/953: dwrite d6/d33/d3c/dec/df3/f5a [0,4194304] 0 2024-09-21T11:39:47.963 INFO:tasks.workunit.client.0.smithi118.stdout:6/918: write d8/d48/d6c/d64/fa0 [1338375,14197] 0 2024-09-21T11:39:47.965 INFO:tasks.workunit.client.0.smithi118.stdout:1/954: symlink d6/d2a/d5c/d85/l11d 0 2024-09-21T11:39:47.972 INFO:tasks.workunit.client.0.smithi118.stdout:1/955: link d6/de/d16/d3f/d50/l67 d6/d2a/dc2/dd7/l11e 0 2024-09-21T11:39:47.973 INFO:tasks.workunit.client.0.smithi118.stdout:1/956: chown d6/d2a/d5c/d85/f9c 7862552 1 2024-09-21T11:39:47.976 INFO:tasks.workunit.client.0.smithi118.stdout:1/957: link d6/d3b/fa9 d6/d2a/d3d/db5/f11f 0 2024-09-21T11:39:47.979 INFO:tasks.workunit.client.0.smithi118.stdout:1/958: creat d6/d2a/d53/f120 x:0 0 0 2024-09-21T11:39:47.979 INFO:tasks.workunit.client.0.smithi118.stdout:1/959: chown d6/f79 501 1 2024-09-21T11:39:47.980 INFO:tasks.workunit.client.0.smithi118.stdout:1/960: chown d6/d2a/d53/c6d 3 1 2024-09-21T11:39:47.980 INFO:tasks.workunit.client.0.smithi118.stdout:1/961: dread - d6/d2a/d3d/de5/f10c zero size 2024-09-21T11:39:47.982 INFO:tasks.workunit.client.0.smithi118.stdout:1/962: mknod d6/d2a/d3d/db5/c121 0 2024-09-21T11:39:47.985 INFO:tasks.workunit.client.0.smithi118.stdout:1/963: symlink d6/d2a/d3d/de5/l122 0 2024-09-21T11:39:47.986 INFO:tasks.workunit.client.0.smithi118.stdout:6/919: dread d8/f38 [0,4194304] 0 2024-09-21T11:39:47.986 INFO:tasks.workunit.client.0.smithi118.stdout:1/964: write d6/fdc [2162847,93345] 0 2024-09-21T11:39:47.991 INFO:tasks.workunit.client.0.smithi118.stdout:6/920: rename d8/d48/d45/de1/dbf/dcb/d66/fee to d8/d48/d45/de1/db5/f12b 0 2024-09-21T11:39:47.993 INFO:tasks.workunit.client.0.smithi118.stdout:6/921: read d8/d48/d45/de1/dbf/dcb/ffe [1123476,101913] 0 2024-09-21T11:39:48.001 INFO:tasks.workunit.client.0.smithi118.stdout:1/965: getdents d6/d2a/d5c/db8 0 2024-09-21T11:39:48.002 INFO:tasks.workunit.client.0.smithi118.stdout:6/922: dwrite d8/d14/f24 [0,4194304] 0 2024-09-21T11:39:48.006 INFO:tasks.workunit.client.0.smithi118.stdout:6/923: chown d8/f8b 427330 1 2024-09-21T11:39:48.007 INFO:tasks.workunit.client.0.smithi118.stdout:6/924: readlink d8/d48/d5f/da3/lac 0 2024-09-21T11:39:48.007 INFO:tasks.workunit.client.0.smithi118.stdout:6/925: chown d8/d48/d45/de1/dbf/dcb/d70/d112/d116 5667 1 2024-09-21T11:39:48.011 INFO:tasks.workunit.client.0.smithi118.stdout:6/926: unlink d8/d14/f78 0 2024-09-21T11:39:48.014 INFO:tasks.workunit.client.0.smithi118.stdout:6/927: dread d8/f96 [0,4194304] 0 2024-09-21T11:39:48.015 INFO:tasks.workunit.client.0.smithi118.stdout:1/966: truncate d6/d2a/d5c/d85/f9c 5632279 0 2024-09-21T11:39:48.016 INFO:tasks.workunit.client.0.smithi118.stdout:6/928: stat d8/c4c 0 2024-09-21T11:39:48.017 INFO:tasks.workunit.client.0.smithi118.stdout:6/929: readlink d8/d48/d5f/da3/ldc 0 2024-09-21T11:39:48.017 INFO:tasks.workunit.client.0.smithi118.stdout:1/967: creat d6/d2a/f123 x:0 0 0 2024-09-21T11:39:48.018 INFO:tasks.workunit.client.0.smithi118.stdout:1/968: write d6/d33/d3c/fcc [4905041,45639] 0 2024-09-21T11:39:48.019 INFO:tasks.workunit.client.0.smithi118.stdout:1/969: fdatasync d6/de/d16/d3f/d50/f108 0 2024-09-21T11:39:48.020 INFO:tasks.workunit.client.0.smithi118.stdout:6/930: fsync d8/d14/d33/d92/f10d 0 2024-09-21T11:39:48.021 INFO:tasks.workunit.client.0.smithi118.stdout:6/931: readlink d8/d48/d45/de1/l75 0 2024-09-21T11:39:48.023 INFO:tasks.workunit.client.0.smithi118.stdout:6/932: readlink d8/d14/d3a/le9 0 2024-09-21T11:39:48.024 INFO:tasks.workunit.client.0.smithi118.stdout:6/933: symlink d8/d14/d44/d111/l12c 0 2024-09-21T11:39:48.029 INFO:tasks.workunit.client.0.smithi118.stdout:6/934: creat d8/d14/d3a/f12d x:0 0 0 2024-09-21T11:39:48.034 INFO:tasks.workunit.client.0.smithi118.stdout:6/935: mknod d8/d46/c12e 0 2024-09-21T11:39:48.034 INFO:tasks.workunit.client.0.smithi118.stdout:1/970: creat d6/d2a/d5c/f124 x:0 0 0 2024-09-21T11:39:48.035 INFO:tasks.workunit.client.0.smithi118.stdout:6/936: fsync d8/d14/d33/d92/dc1/d108/f127 0 2024-09-21T11:39:48.036 INFO:tasks.workunit.client.0.smithi118.stdout:1/971: write d6/d33/fda [1795748,16521] 0 2024-09-21T11:39:48.036 INFO:tasks.workunit.client.0.smithi118.stdout:1/972: read d6/f15 [1182521,52963] 0 2024-09-21T11:39:48.041 INFO:tasks.workunit.client.0.smithi118.stdout:1/973: link d6/d2a/f97 d6/d2a/dc2/dd7/f125 0 2024-09-21T11:39:48.046 INFO:tasks.workunit.client.0.smithi118.stdout:1/974: dwrite d6/de/d111/fd9 [0,4194304] 0 2024-09-21T11:39:48.051 INFO:tasks.workunit.client.0.smithi118.stdout:1/975: rename f1 to d6/d2a/d3d/f126 0 2024-09-21T11:39:48.061 INFO:tasks.workunit.client.0.smithi118.stdout:1/976: write d6/de/d16/d3f/d86/f8c [144951,53660] 0 2024-09-21T11:39:48.065 INFO:tasks.workunit.client.0.smithi118.stdout:1/977: creat d6/d2a/f127 x:0 0 0 2024-09-21T11:39:48.067 INFO:tasks.workunit.client.0.smithi118.stdout:1/978: dread d6/de/d16/d3f/f4d [0,4194304] 0 2024-09-21T11:39:48.072 INFO:tasks.workunit.client.0.smithi118.stdout:1/979: truncate d6/d2a/d3d/db5/fe2 2126723 0 2024-09-21T11:39:48.077 INFO:tasks.workunit.client.0.smithi118.stdout:1/980: dread d6/de/d16/d3f/d50/d54/f39 [0,4194304] 0 2024-09-21T11:39:48.082 INFO:tasks.workunit.client.0.smithi118.stdout:1/981: creat d6/d2a/d5c/d85/f128 x:0 0 0 2024-09-21T11:39:48.089 INFO:tasks.workunit.client.0.smithi118.stdout:1/982: dwrite d6/d2a/d53/f120 [0,4194304] 0 2024-09-21T11:39:48.092 INFO:tasks.workunit.client.0.smithi118.stdout:1/983: getdents d6/d33/d3c/dec 0 2024-09-21T11:39:48.096 INFO:tasks.workunit.client.0.smithi118.stdout:1/984: rename d6/de/d16/d3f/l6b to d6/d33/d3c/dec/l129 0 2024-09-21T11:39:48.097 INFO:tasks.workunit.client.0.smithi118.stdout:1/985: rmdir d6/d2a/d5c/db8 39 2024-09-21T11:39:48.102 INFO:tasks.workunit.client.0.smithi118.stdout:1/986: rename d6/d3b/fca to d6/de/d16/ddd/f12a 0 2024-09-21T11:39:48.103 INFO:tasks.workunit.client.0.smithi118.stdout:1/987: read d6/de/f118 [1628370,41734] 0 2024-09-21T11:39:48.113 INFO:tasks.workunit.client.0.smithi118.stdout:1/988: getdents d6/d3b 0 2024-09-21T11:39:48.115 INFO:tasks.workunit.client.0.smithi118.stdout:1/989: mknod d6/de/d111/c12b 0 2024-09-21T11:39:48.115 INFO:tasks.workunit.client.0.smithi118.stdout:1/990: dread - d6/d3b/fc1 zero size 2024-09-21T11:39:48.117 INFO:tasks.workunit.client.0.smithi118.stdout:1/991: fsync d6/de/d111/f1c 0 2024-09-21T11:39:48.120 INFO:tasks.workunit.client.0.smithi118.stdout:1/992: unlink d6/d33/d3c/ce9 0 2024-09-21T11:39:48.123 INFO:tasks.workunit.client.0.smithi118.stdout:1/993: mknod d6/de/d16/d3f/d50/d54/c12c 0 2024-09-21T11:39:48.125 INFO:tasks.workunit.client.0.smithi118.stdout:1/994: rename d6/de/d16/d3f/d86/ce1 to d6/de/d111/d84/c12d 0 2024-09-21T11:39:48.128 INFO:tasks.workunit.client.0.smithi118.stdout:1/995: creat d6/d3b/f12e x:0 0 0 2024-09-21T11:39:48.128 INFO:tasks.workunit.client.0.smithi118.stdout:1/996: stat d6/de/l11b 0 2024-09-21T11:39:48.141 INFO:tasks.workunit.client.0.smithi118.stdout:1/997: dwrite d6/d2a/f23 [0,4194304] 0 2024-09-21T11:39:48.147 INFO:tasks.workunit.client.0.smithi118.stdout:1/998: getdents d6/d2a/d5c 0 2024-09-21T11:39:48.151 INFO:tasks.workunit.client.0.smithi118.stdout:1/999: rename d6/de/d16/d3f/d50/d54/c4a to d6/d2a/d3d/c12f 0 2024-09-21T11:39:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:47 smithi149 ceph-mon[36123]: pgmap v39: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 50 MiB/s rd, 127 MiB/s wr, 381 op/s 2024-09-21T11:39:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:47 smithi118 ceph-mon[28757]: pgmap v39: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 50 MiB/s rd, 127 MiB/s wr, 381 op/s 2024-09-21T11:39:48.718 INFO:tasks.workunit.client.0.smithi118.stdout:5/954: sync 2024-09-21T11:39:48.719 INFO:tasks.workunit.client.0.smithi118.stdout:5/955: chown d0/db/d35/l82 3940484 1 2024-09-21T11:39:48.724 INFO:tasks.workunit.client.0.smithi118.stdout:5/956: dwrite d0/db/deb/d115/f124 [0,4194304] 0 2024-09-21T11:39:48.726 INFO:tasks.workunit.client.0.smithi118.stdout:5/957: stat d0/db/d35/d30/d1a/d8f/d99/df4 0 2024-09-21T11:39:48.733 INFO:tasks.workunit.client.0.smithi118.stdout:5/958: creat d0/d89/d9d/f145 x:0 0 0 2024-09-21T11:39:48.736 INFO:tasks.workunit.client.0.smithi118.stdout:5/959: creat d0/db/d35/d30/d66/f146 x:0 0 0 2024-09-21T11:39:48.742 INFO:tasks.workunit.client.0.smithi118.stdout:6/937: sync 2024-09-21T11:39:48.744 INFO:tasks.workunit.client.0.smithi118.stdout:6/938: chown d8/d48/dd6/fe8 21096 1 2024-09-21T11:39:48.744 INFO:tasks.workunit.client.0.smithi118.stdout:5/960: dwrite d0/d63/f13c [0,4194304] 0 2024-09-21T11:39:48.751 INFO:tasks.workunit.client.0.smithi118.stdout:5/961: creat d0/db/deb/f147 x:0 0 0 2024-09-21T11:39:48.752 INFO:tasks.workunit.client.0.smithi118.stdout:6/939: dwrite d8/f38 [4194304,4194304] 0 2024-09-21T11:39:48.759 INFO:tasks.workunit.client.0.smithi118.stdout:6/940: fdatasync d8/f22 0 2024-09-21T11:39:48.760 INFO:tasks.workunit.client.0.smithi118.stdout:6/941: chown d8/d48/d45/de1/dbf/dcb/d70/d7d 1812360 1 2024-09-21T11:39:48.763 INFO:tasks.workunit.client.0.smithi118.stdout:5/962: link d0/db/d35/def/c84 d0/db/d35/d2c/d40/c148 0 2024-09-21T11:39:48.764 INFO:tasks.workunit.client.0.smithi118.stdout:5/963: chown d0/db/d35/def/f142 11839 1 2024-09-21T11:39:48.766 INFO:tasks.workunit.client.0.smithi118.stdout:5/964: truncate d0/db/d26/d65/fe0 4957213 0 2024-09-21T11:39:48.767 INFO:tasks.workunit.client.0.smithi118.stdout:6/942: dwrite d8/d48/d5f/d6b/fc9 [4194304,4194304] 0 2024-09-21T11:39:48.769 INFO:tasks.workunit.client.0.smithi118.stdout:5/965: creat d0/db/d35/d30/d66/d100/d11d/f149 x:0 0 0 2024-09-21T11:39:48.773 INFO:tasks.workunit.client.0.smithi118.stdout:6/943: getdents d8/d48/d6c 0 2024-09-21T11:39:48.774 INFO:tasks.workunit.client.0.smithi118.stdout:5/966: mknod d0/c14a 0 2024-09-21T11:39:48.777 INFO:tasks.workunit.client.0.smithi118.stdout:6/944: truncate d8/d14/d33/d92/fc0 553687 0 2024-09-21T11:39:48.780 INFO:tasks.workunit.client.0.smithi118.stdout:6/945: dread d8/d48/d5f/dbd/ffb [0,4194304] 0 2024-09-21T11:39:48.781 INFO:tasks.workunit.client.0.smithi118.stdout:6/946: chown d8/d14/d3a/ff8 460 1 2024-09-21T11:39:48.781 INFO:tasks.workunit.client.0.smithi118.stdout:5/967: rename d0/db/d26/lbc to d0/db/l14b 0 2024-09-21T11:39:48.781 INFO:tasks.workunit.client.0.smithi118.stdout:5/968: fdatasync d0/db/f133 0 2024-09-21T11:39:48.784 INFO:tasks.workunit.client.0.smithi118.stdout:5/969: creat d0/db/d35/d30/d66/dfc/f14c x:0 0 0 2024-09-21T11:39:48.786 INFO:tasks.workunit.client.0.smithi118.stdout:5/970: symlink d0/db/d35/def/de8/l14d 0 2024-09-21T11:39:48.791 INFO:tasks.workunit.client.0.smithi118.stdout:5/971: dwrite d0/db/d26/d65/f69 [0,4194304] 0 2024-09-21T11:39:48.796 INFO:tasks.workunit.client.0.smithi118.stdout:5/972: chown d0/db/deb/c120 803 1 2024-09-21T11:39:48.802 INFO:tasks.workunit.client.0.smithi118.stdout:6/947: dwrite d8/d14/d44/fd5 [0,4194304] 0 2024-09-21T11:39:48.802 INFO:tasks.workunit.client.0.smithi118.stdout:5/973: dread d0/d89/daa/ffe [0,4194304] 0 2024-09-21T11:39:48.803 INFO:tasks.workunit.client.0.smithi118.stdout:6/948: fdatasync d8/d48/f31 0 2024-09-21T11:39:48.805 INFO:tasks.workunit.client.0.smithi118.stdout:5/974: truncate d0/d89/f12a 965102 0 2024-09-21T11:39:48.812 INFO:tasks.workunit.client.0.smithi118.stdout:6/949: creat d8/d14/d3a/f12f x:0 0 0 2024-09-21T11:39:48.816 INFO:tasks.workunit.client.0.smithi118.stdout:5/975: write d0/db/d26/d65/f10d [1002407,75239] 0 2024-09-21T11:39:48.817 INFO:tasks.workunit.client.0.smithi118.stdout:6/950: dread d8/d46/dca/d109/f95 [0,4194304] 0 2024-09-21T11:39:48.818 INFO:tasks.workunit.client.0.smithi118.stdout:5/976: chown d0/db/d35/def/l39 7105837 1 2024-09-21T11:39:48.820 INFO:tasks.workunit.client.0.smithi118.stdout:6/951: mknod d8/d14/d33/d92/c130 0 2024-09-21T11:39:48.821 INFO:tasks.workunit.client.0.smithi118.stdout:6/952: chown d8/d48/d45/de1/dbf/dcb/f102 10987 1 2024-09-21T11:39:48.822 INFO:tasks.workunit.client.0.smithi118.stdout:5/977: write d0/d6c/d25/f7d [927227,45527] 0 2024-09-21T11:39:48.823 INFO:tasks.workunit.client.0.smithi118.stdout:5/978: stat d0/db/d35/d30/d1a/d8f/d99/l130 0 2024-09-21T11:39:48.826 INFO:tasks.workunit.client.0.smithi118.stdout:5/979: creat d0/db/d35/d30/d1a/f14e x:0 0 0 2024-09-21T11:39:48.826 INFO:tasks.workunit.client.0.smithi118.stdout:6/953: link d8/d48/d45/c4f d8/d46/dca/c131 0 2024-09-21T11:39:48.828 INFO:tasks.workunit.client.0.smithi118.stdout:5/980: rmdir d0/db/d35/d2c/d40 39 2024-09-21T11:39:48.830 INFO:tasks.workunit.client.0.smithi118.stdout:5/981: fsync d0/db/d35/d30/d66/d100/d11d/f149 0 2024-09-21T11:39:48.832 INFO:tasks.workunit.client.0.smithi118.stdout:6/954: dwrite d8/d14/f1d [0,4194304] 0 2024-09-21T11:39:48.833 INFO:tasks.workunit.client.0.smithi118.stdout:5/982: read d0/db/d26/d65/f10d [695540,51367] 0 2024-09-21T11:39:48.836 INFO:tasks.workunit.client.0.smithi118.stdout:6/955: truncate d8/d14/d33/f62 2013603 0 2024-09-21T11:39:48.840 INFO:tasks.workunit.client.0.smithi118.stdout:5/983: rename d0/db/d35/d2c/f77 to d0/d89/d9d/f14f 0 2024-09-21T11:39:48.842 INFO:tasks.workunit.client.0.smithi118.stdout:5/984: read d0/d6c/d25/f4f [5457995,13901] 0 2024-09-21T11:39:48.843 INFO:tasks.workunit.client.0.smithi118.stdout:6/956: rmdir d8/d48/d45/de1/db5 39 2024-09-21T11:39:48.847 INFO:tasks.workunit.client.0.smithi118.stdout:6/957: creat d8/d48/d5f/da3/deb/f132 x:0 0 0 2024-09-21T11:39:48.848 INFO:tasks.workunit.client.0.smithi118.stdout:5/985: mkdir d0/d89/d150 0 2024-09-21T11:39:48.848 INFO:tasks.workunit.client.0.smithi118.stdout:6/958: dread - d8/d48/f101 zero size 2024-09-21T11:39:48.866 INFO:tasks.workunit.client.0.smithi118.stdout:6/959: write d8/d14/d33/d92/f94 [646051,116896] 0 2024-09-21T11:39:48.868 INFO:tasks.workunit.client.0.smithi118.stdout:6/960: read d8/d14/f8e [80507,111272] 0 2024-09-21T11:39:48.869 INFO:tasks.workunit.client.0.smithi118.stdout:5/986: write d0/db/d35/def/f62 [3342282,104909] 0 2024-09-21T11:39:48.870 INFO:tasks.workunit.client.0.smithi118.stdout:6/961: dread d8/d46/dca/fd8 [0,4194304] 0 2024-09-21T11:39:48.874 INFO:tasks.workunit.client.0.smithi118.stdout:5/987: chown d0/db/d35/d30/d1a/f105 192826274 1 2024-09-21T11:39:48.877 INFO:tasks.workunit.client.0.smithi118.stdout:6/962: rename d8/d46/dca/d109/ff4 to d8/d48/d45/de1/db5/f133 0 2024-09-21T11:39:48.878 INFO:tasks.workunit.client.0.smithi118.stdout:6/963: fdatasync d8/d46/dd2/ff7 0 2024-09-21T11:39:48.879 INFO:tasks.workunit.client.0.smithi118.stdout:6/964: chown d8/d14/d33/d92/d100 57 1 2024-09-21T11:39:48.881 INFO:tasks.workunit.client.0.smithi118.stdout:5/988: rename d0/db/deb/d115 to d0/db/d35/d151 0 2024-09-21T11:39:48.882 INFO:tasks.workunit.client.0.smithi118.stdout:6/965: unlink d8/d48/d6c/d64/fa0 0 2024-09-21T11:39:48.895 INFO:tasks.workunit.client.0.smithi118.stdout:6/966: write d8/d48/d6c/f8f [209245,23433] 0 2024-09-21T11:39:48.899 INFO:tasks.workunit.client.0.smithi118.stdout:5/989: dwrite d0/f37 [0,4194304] 0 2024-09-21T11:39:48.915 INFO:tasks.workunit.client.0.smithi118.stdout:5/990: write d0/dbf/f108 [563056,129870] 0 2024-09-21T11:39:48.918 INFO:tasks.workunit.client.0.smithi118.stdout:5/991: unlink d0/d6c/d25/d50/cf8 0 2024-09-21T11:39:48.922 INFO:tasks.workunit.client.0.smithi118.stdout:5/992: symlink d0/db/d35/d30/d1a/d8f/d99/db9/l152 0 2024-09-21T11:39:48.924 INFO:tasks.workunit.client.0.smithi118.stdout:5/993: creat d0/db/d35/d30/d66/d100/d11d/f153 x:0 0 0 2024-09-21T11:39:48.926 INFO:tasks.workunit.client.0.smithi118.stdout:5/994: read d0/db/faf [3499877,128147] 0 2024-09-21T11:39:48.929 INFO:tasks.workunit.client.0.smithi118.stdout:5/995: stat d0/db/d35/d30/d1a/db3/f114 0 2024-09-21T11:39:48.953 INFO:tasks.workunit.client.0.smithi118.stdout:5/996: dwrite d0/d6c/d25/d50/f55 [0,4194304] 0 2024-09-21T11:39:48.963 INFO:tasks.workunit.client.0.smithi118.stdout:5/997: write d0/db/d35/def/d92/f9c [465100,99338] 0 2024-09-21T11:39:48.967 INFO:tasks.workunit.client.0.smithi118.stdout:5/998: unlink d0/db/d35/d30/d1a/d8f/la7 0 2024-09-21T11:39:48.970 INFO:tasks.workunit.client.0.smithi118.stdout:5/999: mknod d0/db/d35/d30/d1a/d8f/c154 0 2024-09-21T11:39:49.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.366+0000 7f2f085c0640 1 -- 172.21.15.118:0/1611043853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f00102430 msgr2=0x7f2f00104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:49.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.366+0000 7f2f085c0640 1 --2- 172.21.15.118:0/1611043853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f00102430 0x7f2f00104820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009880 tx=0x7f2efc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.366+0000 7f2f085c0640 1 -- 172.21.15.118:0/1611043853 shutdown_connections 2024-09-21T11:39:49.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.366+0000 7f2f085c0640 1 --2- 172.21.15.118:0/1611043853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f00104d60 0x7f2f00107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.366+0000 7f2f085c0640 1 --2- 172.21.15.118:0/1611043853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f00102430 0x7f2f00104820 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.366+0000 7f2f085c0640 1 -- 172.21.15.118:0/1611043853 >> 172.21.15.118:0/1611043853 conn(0x7f2f000fbff0 msgr2=0x7f2f000fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:49.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.366+0000 7f2f085c0640 1 -- 172.21.15.118:0/1611043853 shutdown_connections 2024-09-21T11:39:49.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.366+0000 7f2f085c0640 1 -- 172.21.15.118:0/1611043853 wait complete. 2024-09-21T11:39:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f085c0640 1 Processor -- start 2024-09-21T11:39:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f085c0640 1 -- start start 2024-09-21T11:39:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f085c0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f00102430 0x7f2f00197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f085c0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f00104d60 0x7f2f001979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f085c0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0010a750 con 0x7f2f00102430 2024-09-21T11:39:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f085c0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0010a5d0 con 0x7f2f00104d60 2024-09-21T11:39:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f0635c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f00102430 0x7f2f00197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f05b5b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f00104d60 0x7f2f001979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f0635c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f00102430 0x7f2f00197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53294/0 (socket says 172.21.15.118:53294) 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f0635c640 1 -- 172.21.15.118:0/654411729 learned_addr learned my addr 172.21.15.118:0/654411729 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f05b5b640 1 -- 172.21.15.118:0/654411729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f00102430 msgr2=0x7f2f00197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.367+0000 7f2f05b5b640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f00102430 0x7f2f00197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.368+0000 7f2f05b5b640 1 -- 172.21.15.118:0/654411729 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f00198030 con 0x7f2f00104d60 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.368+0000 7f2f05b5b640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f00104d60 0x7f2f001979b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000e940 tx=0x7f2ef000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.368+0000 7f2ef77fe640 1 -- 172.21.15.118:0/654411729 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ef000cac0 con 0x7f2f00104d60 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.368+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0019ca70 con 0x7f2f00104d60 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.368+0000 7f2ef77fe640 1 -- 172.21.15.118:0/654411729 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ef000cc60 con 0x7f2f00104d60 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.368+0000 7f2ef77fe640 1 -- 172.21.15.118:0/654411729 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ef00047a0 con 0x7f2f00104d60 2024-09-21T11:39:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.368+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0019d000 con 0x7f2f00104d60 2024-09-21T11:39:49.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.369+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f00102810 con 0x7f2f00104d60 2024-09-21T11:39:49.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.370+0000 7f2ef77fe640 1 -- 172.21.15.118:0/654411729 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f2ef0004a10 con 0x7f2f00104d60 2024-09-21T11:39:49.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.370+0000 7f2ef77fe640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2eec074a30 0x7f2eec076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.370+0000 7f2ef77fe640 1 -- 172.21.15.118:0/654411729 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f2ef0096800 con 0x7f2f00104d60 2024-09-21T11:39:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.370+0000 7f2f0635c640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2eec074a30 0x7f2eec076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.371+0000 7f2f0635c640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2eec074a30 0x7f2eec076ef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0096c0 tx=0x7f2efc005a20 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:49.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.375+0000 7f2ef77fe640 1 -- 172.21.15.118:0/654411729 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2ef0061c90 con 0x7f2f00104d60 2024-09-21T11:39:49.476 INFO:tasks.workunit.client.0.smithi118.stdout:6/967: sync 2024-09-21T11:39:49.478 INFO:tasks.workunit.client.0.smithi118.stdout:6/968: write d8/fa [1957630,31276] 0 2024-09-21T11:39:49.481 INFO:tasks.workunit.client.0.smithi118.stdout:6/969: read d8/d48/d5f/fb1 [1006380,64907] 0 2024-09-21T11:39:49.481 INFO:tasks.workunit.client.0.smithi118.stdout:6/970: chown d8/d48/d6c/f8f 179 1 2024-09-21T11:39:49.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.641+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2f00105700 con 0x7f2eec074a30 2024-09-21T11:39:49.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.643+0000 7f2ef77fe640 1 -- 172.21.15.118:0/654411729 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f2f00105700 con 0x7f2eec074a30 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.647+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2eec074a30 msgr2=0x7f2eec076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.647+0000 7f2f085c0640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2eec074a30 0x7f2eec076ef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0096c0 tx=0x7f2efc005a20 comp rx=0 tx=0).stop 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.647+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f00104d60 msgr2=0x7f2f001979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.647+0000 7f2f085c0640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f00104d60 0x7f2f001979b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000e940 tx=0x7f2ef000ee00 comp rx=0 tx=0).stop 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.647+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 shutdown_connections 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.647+0000 7f2f085c0640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f2eec074a30 0x7f2eec076ef0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.647+0000 7f2f085c0640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f00104d60 0x7f2f001979b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.647+0000 7f2f085c0640 1 --2- 172.21.15.118:0/654411729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f00102430 0x7f2f00197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.647+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 >> 172.21.15.118:0/654411729 conn(0x7f2f000fbff0 msgr2=0x7f2f000fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.648+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 shutdown_connections 2024-09-21T11:39:49.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.648+0000 7f2f085c0640 1 -- 172.21.15.118:0/654411729 wait complete. 2024-09-21T11:39:49.665 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:39:49.738 INFO:tasks.workunit.client.0.smithi118.stdout:6/971: sync 2024-09-21T11:39:49.738 INFO:tasks.workunit.client.0.smithi118.stdout:6/972: chown d8/d48/d6c/d64/f98 3518 1 2024-09-21T11:39:49.739 INFO:tasks.workunit.client.0.smithi118.stdout:6/973: readlink d8/d46/dca/d109/d115/l11d 0 2024-09-21T11:39:49.741 INFO:tasks.workunit.client.0.smithi118.stdout:6/974: mknod d8/d46/dca/c134 0 2024-09-21T11:39:49.745 INFO:tasks.workunit.client.0.smithi118.stdout:6/975: rename d8/c36 to d8/d14/dc4/dcc/c135 0 2024-09-21T11:39:49.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.758+0000 7f96777bf640 1 -- 172.21.15.118:0/1448615482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96701023d0 msgr2=0x7f96701047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:49.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.758+0000 7f96777bf640 1 --2- 172.21.15.118:0/1448615482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96701023d0 0x7f96701047c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f966c0098b0 tx=0x7f966c02a4d0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.758+0000 7f96777bf640 1 -- 172.21.15.118:0/1448615482 shutdown_connections 2024-09-21T11:39:49.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.758+0000 7f96777bf640 1 --2- 172.21.15.118:0/1448615482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9670104d00 0x7f96701070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.758+0000 7f96777bf640 1 --2- 172.21.15.118:0/1448615482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96701023d0 0x7f96701047c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.758+0000 7f96777bf640 1 -- 172.21.15.118:0/1448615482 >> 172.21.15.118:0/1448615482 conn(0x7f96700fbff0 msgr2=0x7f96700fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:49.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.759+0000 7f96777bf640 1 -- 172.21.15.118:0/1448615482 shutdown_connections 2024-09-21T11:39:49.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.759+0000 7f96777bf640 1 -- 172.21.15.118:0/1448615482 wait complete. 2024-09-21T11:39:49.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.759+0000 7f96777bf640 1 Processor -- start 2024-09-21T11:39:49.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.759+0000 7f96777bf640 1 -- start start 2024-09-21T11:39:49.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.759+0000 7f96777bf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96701023d0 0x7f9670197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:49.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.759+0000 7f96777bf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9670104d00 0x7f9670197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:49.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f96777bf640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f967010a7c0 con 0x7f9670104d00 2024-09-21T11:39:49.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f96777bf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f967010a640 con 0x7f96701023d0 2024-09-21T11:39:49.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f9674d5a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9670104d00 0x7f9670197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:49.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f967555b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96701023d0 0x7f9670197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:49.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f9674d5a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9670104d00 0x7f9670197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53304/0 (socket says 172.21.15.118:53304) 2024-09-21T11:39:49.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f9674d5a640 1 -- 172.21.15.118:0/3225762493 learned_addr learned my addr 172.21.15.118:0/3225762493 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:49.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f9674d5a640 1 -- 172.21.15.118:0/3225762493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96701023d0 msgr2=0x7f9670197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:49.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f9674d5a640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96701023d0 0x7f9670197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:49.763 INFO:tasks.workunit.client.0.smithi118.stdout:6/976: mkdir d8/d48/d9f/da1/d136 0 2024-09-21T11:39:49.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f9674d5a640 1 -- 172.21.15.118:0/3225762493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96701980e0 con 0x7f9670104d00 2024-09-21T11:39:49.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f9674d5a640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9670104d00 0x7f9670197a60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f966000d6c0 tx=0x7f966000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:49.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.760+0000 7f96667fc640 1 -- 172.21.15.118:0/3225762493 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9660017070 con 0x7f9670104d00 2024-09-21T11:39:49.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.761+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9670100220 con 0x7f9670104d00 2024-09-21T11:39:49.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.761+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96701007b0 con 0x7f9670104d00 2024-09-21T11:39:49.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.761+0000 7f96667fc640 1 -- 172.21.15.118:0/3225762493 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96600054e0 con 0x7f9670104d00 2024-09-21T11:39:49.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.761+0000 7f96667fc640 1 -- 172.21.15.118:0/3225762493 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9660004b70 con 0x7f9670104d00 2024-09-21T11:39:49.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.762+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96540052c0 con 0x7f9670104d00 2024-09-21T11:39:49.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.763+0000 7f96667fc640 1 -- 172.21.15.118:0/3225762493 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f9660010460 con 0x7f9670104d00 2024-09-21T11:39:49.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.764+0000 7f96667fc640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f965c074a80 0x7f965c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:49.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.764+0000 7f96667fc640 1 -- 172.21.15.118:0/3225762493 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f9660095da0 con 0x7f9670104d00 2024-09-21T11:39:49.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.764+0000 7f967555b640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f965c074a80 0x7f965c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:49.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.765+0000 7f967555b640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f965c074a80 0x7f965c076f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f966c006010 tx=0x7f966c005a20 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:49.771 INFO:tasks.workunit.client.0.smithi118.stdout:6/977: write d8/d14/f2b [1259346,37350] 0 2024-09-21T11:39:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:49.771+0000 7f96667fc640 1 -- 172.21.15.118:0/3225762493 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9660061350 con 0x7f9670104d00 2024-09-21T11:39:49.780 INFO:tasks.workunit.client.0.smithi118.stdout:6/978: write d8/d48/dd6/fe8 [327396,50876] 0 2024-09-21T11:39:49.784 INFO:tasks.workunit.client.0.smithi118.stdout:6/979: creat d8/d14/d33/d92/d100/f137 x:0 0 0 2024-09-21T11:39:49.785 INFO:tasks.workunit.client.0.smithi118.stdout:6/980: readlink d8/d14/d3a/le9 0 2024-09-21T11:39:49.797 INFO:tasks.workunit.client.0.smithi118.stdout:6/981: dread d8/f5c [0,4194304] 0 2024-09-21T11:39:49.825 INFO:tasks.workunit.client.0.smithi118.stdout:6/982: dwrite d8/f5c [0,4194304] 0 2024-09-21T11:39:49.826 INFO:tasks.workunit.client.0.smithi118.stdout:6/983: chown d8/d48/d6c/ffc 5907863 1 2024-09-21T11:39:49.832 INFO:tasks.workunit.client.0.smithi118.stdout:6/984: unlink d8/d48/d45/de1/dbf/dcb/ffe 0 2024-09-21T11:39:49.838 INFO:tasks.workunit.client.0.smithi118.stdout:6/985: creat d8/d46/f138 x:0 0 0 2024-09-21T11:39:49.856 INFO:tasks.workunit.client.0.smithi118.stdout:6/986: dread d8/d14/d33/d92/f10d [0,4194304] 0 2024-09-21T11:39:49.858 INFO:tasks.workunit.client.0.smithi118.stdout:6/987: dread - d8/d46/fa9 zero size 2024-09-21T11:39:49.860 INFO:tasks.workunit.client.0.smithi118.stdout:6/988: write d8/d48/dd6/fe8 [1057405,101208] 0 2024-09-21T11:39:49.861 INFO:tasks.workunit.client.0.smithi118.stdout:6/989: fsync d8/d14/d33/f55 0 2024-09-21T11:39:49.871 INFO:tasks.workunit.client.0.smithi118.stdout:6/990: rename d8/f15 to d8/d14/d44/d111/f139 0 2024-09-21T11:39:49.889 INFO:tasks.workunit.client.0.smithi118.stdout:6/991: fsync d8/f93 0 2024-09-21T11:39:49.898 INFO:tasks.workunit.client.0.smithi118.stdout:6/992: dread d8/d48/d45/de1/dbf/dcb/d70/f84 [0,4194304] 0 2024-09-21T11:39:49.912 INFO:tasks.workunit.client.0.smithi118.stdout:6/993: dwrite d8/d48/d5f/f80 [0,4194304] 0 2024-09-21T11:39:49.914 INFO:tasks.workunit.client.0.smithi118.stdout:6/994: rmdir d8/d48/d72 39 2024-09-21T11:39:49.921 INFO:tasks.workunit.client.0.smithi118.stdout:6/995: dwrite d8/f5c [0,4194304] 0 2024-09-21T11:39:49.930 INFO:tasks.workunit.client.0.smithi118.stdout:6/996: rename d8/d14/d3a/lbe to d8/l13a 0 2024-09-21T11:39:49.934 INFO:tasks.workunit.client.0.smithi118.stdout:6/997: dread - d8/d48/d72/f122 zero size 2024-09-21T11:39:49.937 INFO:tasks.workunit.client.0.smithi118.stdout:6/998: write d8/d14/d33/d92/dc1/d108/f127 [385936,126547] 0 2024-09-21T11:39:49.943 INFO:tasks.workunit.client.0.smithi118.stdout:6/999: rmdir d8/d46 39 2024-09-21T11:39:49.946 INFO:tasks.workunit.client.0.smithi118.stderr:+ rm -rf -- ./tmp.epEnj0Ip6N 2024-09-21T11:39:50.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.075+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9654000bf0 con 0x7f965c074a80 2024-09-21T11:39:50.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.076+0000 7f96667fc640 1 -- 172.21.15.118:0/3225762493 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f9654000bf0 con 0x7f965c074a80 2024-09-21T11:39:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.078+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f965c074a80 msgr2=0x7f965c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.078+0000 7f96777bf640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f965c074a80 0x7f965c076f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f966c006010 tx=0x7f966c005a20 comp rx=0 tx=0).stop 2024-09-21T11:39:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.078+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9670104d00 msgr2=0x7f9670197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.078+0000 7f96777bf640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9670104d00 0x7f9670197a60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f966000d6c0 tx=0x7f966000db80 comp rx=0 tx=0).stop 2024-09-21T11:39:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.078+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 shutdown_connections 2024-09-21T11:39:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.078+0000 7f96777bf640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f965c074a80 0x7f965c076f40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.078+0000 7f96777bf640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9670104d00 0x7f9670197a60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.078+0000 7f96777bf640 1 --2- 172.21.15.118:0/3225762493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96701023d0 0x7f9670197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.078+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 >> 172.21.15.118:0/3225762493 conn(0x7f96700fbff0 msgr2=0x7f96700fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:50.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.079+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 shutdown_connections 2024-09-21T11:39:50.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.079+0000 7f96777bf640 1 -- 172.21.15.118:0/3225762493 wait complete. 2024-09-21T11:39:50.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.193+0000 7f1f798b1640 1 -- 172.21.15.118:0/372035340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f74104da0 msgr2=0x7f1f74107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:50.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.193+0000 7f1f798b1640 1 --2- 172.21.15.118:0/372035340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f74104da0 0x7f1f74107190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009880 tx=0x7f1f6802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.193+0000 7f1f798b1640 1 -- 172.21.15.118:0/372035340 shutdown_connections 2024-09-21T11:39:50.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.193+0000 7f1f798b1640 1 --2- 172.21.15.118:0/372035340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f74104da0 0x7f1f74107190 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.193+0000 7f1f798b1640 1 --2- 172.21.15.118:0/372035340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f74102470 0x7f1f74104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.193+0000 7f1f798b1640 1 -- 172.21.15.118:0/372035340 >> 172.21.15.118:0/372035340 conn(0x7f1f740fc010 msgr2=0x7f1f740fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:50.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.193+0000 7f1f798b1640 1 -- 172.21.15.118:0/372035340 shutdown_connections 2024-09-21T11:39:50.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.193+0000 7f1f798b1640 1 -- 172.21.15.118:0/372035340 wait complete. 2024-09-21T11:39:50.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f798b1640 1 Processor -- start 2024-09-21T11:39:50.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f798b1640 1 -- start start 2024-09-21T11:39:50.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f798b1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f74102470 0x7f1f74101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:50.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f798b1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f74104da0 0x7f1f74100420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f798b1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7410a740 con 0x7f1f74104da0 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f798b1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7410a5c0 con 0x7f1f74102470 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f727fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f74104da0 0x7f1f74100420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f727fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f74104da0 0x7f1f74100420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53328/0 (socket says 172.21.15.118:53328) 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f72ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f74102470 0x7f1f74101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f727fc640 1 -- 172.21.15.118:0/843070980 learned_addr learned my addr 172.21.15.118:0/843070980 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f72ffd640 1 -- 172.21.15.118:0/843070980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f74104da0 msgr2=0x7f1f74100420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.194+0000 7f1f72ffd640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f74104da0 0x7f1f74100420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.195+0000 7f1f72ffd640 1 -- 172.21.15.118:0/843070980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f74100960 con 0x7f1f74102470 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.195+0000 7f1f72ffd640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f74102470 0x7f1f74101d60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400e970 tx=0x7f1f6400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.195+0000 7f1f788af640 1 -- 172.21.15.118:0/843070980 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f6400cac0 con 0x7f1f74102470 2024-09-21T11:39:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.195+0000 7f1f788af640 1 -- 172.21.15.118:0/843070980 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1f6400cc60 con 0x7f1f74102470 2024-09-21T11:39:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.196+0000 7f1f788af640 1 -- 172.21.15.118:0/843070980 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f64018720 con 0x7f1f74102470 2024-09-21T11:39:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.196+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f74100c50 con 0x7f1f74102470 2024-09-21T11:39:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.196+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f741011e0 con 0x7f1f74102470 2024-09-21T11:39:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.197+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f74102850 con 0x7f1f74102470 2024-09-21T11:39:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.197+0000 7f1f788af640 1 -- 172.21.15.118:0/843070980 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f1f64010430 con 0x7f1f74102470 2024-09-21T11:39:50.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.198+0000 7f1f788af640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1f5c074a30 0x7f1f5c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:50.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.198+0000 7f1f727fc640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1f5c074a30 0x7f1f5c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:50.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.199+0000 7f1f788af640 1 -- 172.21.15.118:0/843070980 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f1f64096810 con 0x7f1f74102470 2024-09-21T11:39:50.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.199+0000 7f1f727fc640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1f5c074a30 0x7f1f5c076ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f74101ae0 tx=0x7f1f680058d0 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:50.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.203+0000 7f1f788af640 1 -- 172.21.15.118:0/843070980 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1f64061d40 con 0x7f1f74102470 2024-09-21T11:39:50.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.504+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1f74105640 con 0x7f1f5c074a30 2024-09-21T11:39:50.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.514+0000 7f1f788af640 1 -- 172.21.15.118:0/843070980 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1f74105640 con 0x7f1f5c074a30 2024-09-21T11:39:50.516 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:39:50.516 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (7m) 61s ago 8m 23.6M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:39:50.516 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 starting - - - - 2024-09-21T11:39:50.516 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 starting - - - - 2024-09-21T11:39:50.516 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (8m) 61s ago 8m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:39:50.516 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (8m) 65s ago 7m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:39:50.516 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (7m) 61s ago 8m 79.0M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:39:50.516 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (3m) 61s ago 3m 149M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (3m) 61s ago 3m 22.7M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (3m) 65s ago 3m 18.4M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (3m) 65s ago 3m 12.3M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:9283,8765,8443 running (10m) 61s ago 10m 298M - 19.1.1-373-g4e45e6b4 164465d2334a 74626178eaa8 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (87s) 65s ago 7m 496M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f2f99ac4e912 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (10m) 61s ago 10m 54.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (7m) 65s ago 7m 43.8M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (8m) 61s ago 8m 16.1M - 1.5.0 0da6a335fe13 92cdb77bc8bc 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (7m) 65s ago 7m 15.5M - 1.5.0 0da6a335fe13 1a6e8f960a5b 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (6m) 61s ago 6m 74.6M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (6m) 61s ago 6m 82.3M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:39:50.517 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (5m) 61s ago 5m 74.6M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:39:50.518 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (5m) 65s ago 5m 87.9M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:39:50.518 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (4m) 65s ago 4m 73.9M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:39:50.518 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (4m) 65s ago 4m 80.1M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:39:50.518 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 starting - - - - 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1f5c074a30 msgr2=0x7f1f5c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1f5c074a30 0x7f1f5c076ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f74101ae0 tx=0x7f1f680058d0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f74102470 msgr2=0x7f1f74101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f74102470 0x7f1f74101d60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400e970 tx=0x7f1f6400ee30 comp rx=0 tx=0).stop 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 shutdown_connections 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1f5c074a30 0x7f1f5c076ef0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f74104da0 0x7f1f74100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 --2- 172.21.15.118:0/843070980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f74102470 0x7f1f74101d60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 >> 172.21.15.118:0/843070980 conn(0x7f1f740fc010 msgr2=0x7f1f740fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 shutdown_connections 2024-09-21T11:39:50.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.518+0000 7f1f798b1640 1 -- 172.21.15.118:0/843070980 wait complete. 2024-09-21T11:39:50.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.624+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/594407788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c4104d00 msgr2=0x7ff3c41070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:50.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.624+0000 7ff3c9c1e640 1 --2- 172.21.15.118:0/594407788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c4104d00 0x7ff3c41070f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80098b0 tx=0x7ff3b802a4d0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.624+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/594407788 shutdown_connections 2024-09-21T11:39:50.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.624+0000 7ff3c9c1e640 1 --2- 172.21.15.118:0/594407788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c4104d00 0x7ff3c41070f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.624+0000 7ff3c9c1e640 1 --2- 172.21.15.118:0/594407788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3c41023d0 0x7ff3c41047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.624+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/594407788 >> 172.21.15.118:0/594407788 conn(0x7ff3c40fbff0 msgr2=0x7ff3c40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:50.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.624+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/594407788 shutdown_connections 2024-09-21T11:39:50.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.624+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/594407788 wait complete. 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.625+0000 7ff3c9c1e640 1 Processor -- start 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.625+0000 7ff3c9c1e640 1 -- start start 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c9c1e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c41023d0 0x7ff3c4197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c9c1e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3c4104d00 0x7ff3c4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c9c1e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c410a790 con 0x7ff3c41023d0 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c9c1e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c410a610 con 0x7ff3c4104d00 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c41023d0 0x7ff3c4197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c41023d0 0x7ff3c4197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53344/0 (socket says 172.21.15.118:53344) 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c37fe640 1 -- 172.21.15.118:0/883413964 learned_addr learned my addr 172.21.15.118:0/883413964 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:50.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c2ffd640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3c4104d00 0x7ff3c4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:50.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c37fe640 1 -- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3c4104d00 msgr2=0x7ff3c4197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:50.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c37fe640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3c4104d00 0x7ff3c4197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:50.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c37fe640 1 -- 172.21.15.118:0/883413964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c41980e0 con 0x7ff3c41023d0 2024-09-21T11:39:50.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c2ffd640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3c4104d00 0x7ff3c4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:39:50.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.626+0000 7ff3c37fe640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c41023d0 0x7ff3c4197520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e970 tx=0x7ff3b400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:50.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.627+0000 7ff3c0ff9640 1 -- 172.21.15.118:0/883413964 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3b400cac0 con 0x7ff3c41023d0 2024-09-21T11:39:50.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.627+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c419cb20 con 0x7ff3c41023d0 2024-09-21T11:39:50.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.627+0000 7ff3c0ff9640 1 -- 172.21.15.118:0/883413964 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3b40054e0 con 0x7ff3c41023d0 2024-09-21T11:39:50.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.627+0000 7ff3c0ff9640 1 -- 172.21.15.118:0/883413964 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3b4010430 con 0x7ff3c41023d0 2024-09-21T11:39:50.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.627+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c419d080 con 0x7ff3c41023d0 2024-09-21T11:39:50.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.628+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c410af70 con 0x7ff3c41023d0 2024-09-21T11:39:50.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.629+0000 7ff3c0ff9640 1 -- 172.21.15.118:0/883413964 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff3b4004f00 con 0x7ff3c41023d0 2024-09-21T11:39:50.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.629+0000 7ff3c0ff9640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff3ac074a80 0x7ff3ac076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:50.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.629+0000 7ff3c0ff9640 1 -- 172.21.15.118:0/883413964 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7ff3b4096a90 con 0x7ff3c41023d0 2024-09-21T11:39:50.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.629+0000 7ff3c2ffd640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff3ac074a80 0x7ff3ac076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:50.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.630+0000 7ff3c2ffd640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff3ac074a80 0x7ff3ac076f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8006010 tx=0x7ff3b8009640 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:50.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:50.634+0000 7ff3c0ff9640 1 -- 172.21.15.118:0/883413964 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff3b4061fa0 con 0x7ff3c41023d0 2024-09-21T11:39:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:50 smithi118 ceph-mon[28757]: pgmap v40: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 33 MiB/s rd, 88 MiB/s wr, 263 op/s 2024-09-21T11:39:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:50 smithi118 ceph-mon[28757]: Upgrade: Updating mgr.smithi118.djbwyn 2024-09-21T11:39:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:50 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:50 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi118.djbwyn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:39:50.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:50 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:39:50.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:50 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:39:50.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:50 smithi118 ceph-mon[28757]: Deploying daemon mgr.smithi118.djbwyn on smithi118 2024-09-21T11:39:50.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:50 smithi118 ceph-mon[28757]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:50.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:50 smithi149 ceph-mon[36123]: pgmap v40: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 33 MiB/s rd, 88 MiB/s wr, 263 op/s 2024-09-21T11:39:50.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:50 smithi149 ceph-mon[36123]: Upgrade: Updating mgr.smithi118.djbwyn 2024-09-21T11:39:50.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:50 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:50.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:50 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi118.djbwyn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:39:50.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:50 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:39:50.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:50 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:39:50.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:50 smithi149 ceph-mon[36123]: Deploying daemon mgr.smithi118.djbwyn on smithi118 2024-09-21T11:39:50.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:50 smithi149 ceph-mon[36123]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:51.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.042+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff3c419d3f0 con 0x7ff3c41023d0 2024-09-21T11:39:51.044 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:39:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:39:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:39:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:39:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:39:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:39:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T11:39:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:39:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:39:51.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.043+0000 7ff3c0ff9640 1 -- 172.21.15.118:0/883413964 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7ff3b4066e50 con 0x7ff3c41023d0 2024-09-21T11:39:51.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff3ac074a80 msgr2=0x7ff3ac076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:51.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff3ac074a80 0x7ff3ac076f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8006010 tx=0x7ff3b8009640 comp rx=0 tx=0).stop 2024-09-21T11:39:51.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c41023d0 msgr2=0x7ff3c4197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:51.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c41023d0 0x7ff3c4197520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e970 tx=0x7ff3b400ed70 comp rx=0 tx=0).stop 2024-09-21T11:39:51.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 shutdown_connections 2024-09-21T11:39:51.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7ff3ac074a80 0x7ff3ac076f40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3c4104d00 0x7ff3c4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 --2- 172.21.15.118:0/883413964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c41023d0 0x7ff3c4197520 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 >> 172.21.15.118:0/883413964 conn(0x7ff3c40fbff0 msgr2=0x7ff3c40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:51.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 shutdown_connections 2024-09-21T11:39:51.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.046+0000 7ff3c9c1e640 1 -- 172.21.15.118:0/883413964 wait complete. 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.146+0000 7f196f752640 1 -- 172.21.15.118:0/2769609817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 msgr2=0x7f1968100eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.146+0000 7f196f752640 1 --2- 172.21.15.118:0/2769609817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 0x7f1968100eb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1958009880 tx=0x7f195802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.146+0000 7f196f752640 1 -- 172.21.15.118:0/2769609817 shutdown_connections 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.146+0000 7f196f752640 1 --2- 172.21.15.118:0/2769609817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 0x7f1968100eb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.146+0000 7f196f752640 1 --2- 172.21.15.118:0/2769609817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1968101df0 0x7f19681021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.146+0000 7f196f752640 1 -- 172.21.15.118:0/2769609817 >> 172.21.15.118:0/2769609817 conn(0x7f19680fb750 msgr2=0x7f19680fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.146+0000 7f196f752640 1 -- 172.21.15.118:0/2769609817 shutdown_connections 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.146+0000 7f196f752640 1 -- 172.21.15.118:0/2769609817 wait complete. 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196f752640 1 Processor -- start 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196f752640 1 -- start start 2024-09-21T11:39:51.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196f752640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 0x7f1968104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196f752640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1968101df0 0x7f1968102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196f752640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1968109650 con 0x7f1968100a50 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196f752640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f19681094d0 con 0x7f1968101df0 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196d4ee640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 0x7f1968104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196d4ee640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 0x7f1968104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53374/0 (socket says 172.21.15.118:53374) 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196d4ee640 1 -- 172.21.15.118:0/1706674371 learned_addr learned my addr 172.21.15.118:0/1706674371 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196cced640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1968101df0 0x7f1968102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196d4ee640 1 -- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1968101df0 msgr2=0x7f1968102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196d4ee640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1968101df0 0x7f1968102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196d4ee640 1 -- 172.21.15.118:0/1706674371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1968103380 con 0x7f1968100a50 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.147+0000 7f196cced640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1968101df0 0x7f1968102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:39:51.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.148+0000 7f196d4ee640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 0x7f1968104780 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f196400c810 tx=0x7f196400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:51.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.148+0000 7f195e7fc640 1 -- 172.21.15.118:0/1706674371 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1964004020 con 0x7f1968100a50 2024-09-21T11:39:51.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.148+0000 7f195e7fc640 1 -- 172.21.15.118:0/1706674371 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19640041c0 con 0x7f1968100a50 2024-09-21T11:39:51.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.148+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1968103670 con 0x7f1968100a50 2024-09-21T11:39:51.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.148+0000 7f195e7fc640 1 -- 172.21.15.118:0/1706674371 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19640047a0 con 0x7f1968100a50 2024-09-21T11:39:51.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.148+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1968103c00 con 0x7f1968100a50 2024-09-21T11:39:51.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.149+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1968100eb0 con 0x7f1968100a50 2024-09-21T11:39:51.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.150+0000 7f195e7fc640 1 -- 172.21.15.118:0/1706674371 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f19640079b0 con 0x7f1968100a50 2024-09-21T11:39:51.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.150+0000 7f195e7fc640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1954074a80 0x7f1954076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:39:51.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.151+0000 7f195e7fc640 1 -- 172.21.15.118:0/1706674371 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f19640965c0 con 0x7f1968100a50 2024-09-21T11:39:51.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.151+0000 7f196cced640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1954074a80 0x7f1954076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:39:51.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.151+0000 7f196cced640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1954074a80 0x7f1954076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f19580096c0 tx=0x7f1958009650 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:39:51.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.156+0000 7f195e7fc640 1 -- 172.21.15.118:0/1706674371 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1964014030 con 0x7f1968100a50 2024-09-21T11:39:51.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.472+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 --> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f196819f580 con 0x7f1954074a80 2024-09-21T11:39:51.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.473+0000 7f195e7fc640 1 -- 172.21.15.118:0/1706674371 <== mgr.24379 v2:172.21.15.149:6828/3420416133 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f196819f580 con 0x7f1954074a80 2024-09-21T11:39:51.475 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:39:51.475 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:39:51.475 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:39:51.475 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:39:51.475 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [], 2024-09-21T11:39:51.475 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T11:39:51.475 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T11:39:51.475 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:39:51.475 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:39:51.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1954074a80 msgr2=0x7f1954076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:51.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1954074a80 0x7f1954076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f19580096c0 tx=0x7f1958009650 comp rx=0 tx=0).stop 2024-09-21T11:39:51.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 msgr2=0x7f1968104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:39:51.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 0x7f1968104780 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f196400c810 tx=0x7f196400ccd0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 shutdown_connections 2024-09-21T11:39:51.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:6828/3420416133,v1:172.21.15.149:6829/3420416133] conn(0x7f1954074a80 0x7f1954076f40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1968101df0 0x7f1968102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 --2- 172.21.15.118:0/1706674371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968100a50 0x7f1968104780 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:39:51.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 >> 172.21.15.118:0/1706674371 conn(0x7f19680fb750 msgr2=0x7f19680ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:39:51.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 shutdown_connections 2024-09-21T11:39:51.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:39:51.476+0000 7f196f752640 1 -- 172.21.15.118:0/1706674371 wait complete. 2024-09-21T11:39:51.767 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:51 smithi118 ceph-mon[28757]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:51.767 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:51 smithi118 ceph-mon[28757]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:51.767 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:51 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/883413964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:39:51.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:51 smithi149 ceph-mon[36123]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:51.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:51 smithi149 ceph-mon[36123]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:51.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:51 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/883413964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:39:52.721 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:52 smithi118 ceph-mon[28757]: pgmap v41: 65 pgs: 65 active+clean; 2.3 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 41 MiB/s rd, 113 MiB/s wr, 348 op/s 2024-09-21T11:39:52.853 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:52 smithi118 ceph-mon[28757]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:52.853 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:52 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:39:52.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:52 smithi149 ceph-mon[36123]: pgmap v41: 65 pgs: 65 active+clean; 2.3 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 41 MiB/s rd, 113 MiB/s wr, 348 op/s 2024-09-21T11:39:52.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:52 smithi149 ceph-mon[36123]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:39:52.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:52 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:39:54.608 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:54 smithi149 ceph-mon[36123]: pgmap v42: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 33 MiB/s rd, 78 MiB/s wr, 243 op/s 2024-09-21T11:39:54.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:54 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:54.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:54 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:54.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:54 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:39:54.821 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:54 smithi118 ceph-mon[28757]: pgmap v42: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 33 MiB/s rd, 78 MiB/s wr, 243 op/s 2024-09-21T11:39:54.821 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:54 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:54.821 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:54 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:54.821 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:54 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:39:56.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:56 smithi149 ceph-mon[36123]: pgmap v43: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 28 MiB/s rd, 65 MiB/s wr, 220 op/s 2024-09-21T11:39:56.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:56 smithi118 ceph-mon[28757]: pgmap v43: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 28 MiB/s rd, 65 MiB/s wr, 220 op/s 2024-09-21T11:39:58.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:57 smithi118 ceph-mon[28757]: pgmap v44: 65 pgs: 65 active+clean; 1.9 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 66 MiB/s wr, 276 op/s 2024-09-21T11:39:58.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:57 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:58.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:57 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:58.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:57 smithi149 ceph-mon[36123]: pgmap v44: 65 pgs: 65 active+clean; 1.9 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 66 MiB/s wr, 276 op/s 2024-09-21T11:39:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:57 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:39:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:57 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:00.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:59 smithi118 ceph-mon[28757]: pgmap v45: 65 pgs: 65 active+clean; 1.9 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 10 MiB/s rd, 30 MiB/s wr, 151 op/s 2024-09-21T11:40:00.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:59 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:00.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:39:59 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:00.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:59 smithi149 ceph-mon[36123]: pgmap v45: 65 pgs: 65 active+clean; 1.9 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 10 MiB/s rd, 30 MiB/s wr, 151 op/s 2024-09-21T11:40:00.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:59 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:00.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:39:59 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:00 smithi118 ceph-mon[28757]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:40:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:00 smithi118 ceph-mon[28757]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:40:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:00 smithi118 ceph-mon[28757]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:40:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:00 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:01.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:00 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:01.095 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:00 smithi149 ceph-mon[36123]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:40:01.095 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:00 smithi149 ceph-mon[36123]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:40:01.095 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:00 smithi149 ceph-mon[36123]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:40:01.096 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:00 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:01.096 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:00 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:01 smithi118 ceph-mon[28757]: pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 10 MiB/s rd, 31 MiB/s wr, 195 op/s 2024-09-21T11:40:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:01 smithi118 ceph-mon[28757]: Standby manager daemon smithi118.djbwyn restarted 2024-09-21T11:40:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:01 smithi118 ceph-mon[28757]: Standby manager daemon smithi118.djbwyn started 2024-09-21T11:40:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:01 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi118.djbwyn/crt"}]: dispatch 2024-09-21T11:40:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:01 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:40:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:01 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi118.djbwyn/key"}]: dispatch 2024-09-21T11:40:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:01 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:40:02.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:01 smithi149 ceph-mon[36123]: pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 10 MiB/s rd, 31 MiB/s wr, 195 op/s 2024-09-21T11:40:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:01 smithi149 ceph-mon[36123]: Standby manager daemon smithi118.djbwyn restarted 2024-09-21T11:40:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:01 smithi149 ceph-mon[36123]: Standby manager daemon smithi118.djbwyn started 2024-09-21T11:40:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:01 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi118.djbwyn/crt"}]: dispatch 2024-09-21T11:40:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:01 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:40:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:01 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi118.djbwyn/key"}]: dispatch 2024-09-21T11:40:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:01 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:40:03.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:02 smithi149 ceph-mon[36123]: mgrmap e26: smithi149.xjglai(active, since 87s), standbys: smithi118.djbwyn 2024-09-21T11:40:03.237 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:02 smithi118 ceph-mon[28757]: mgrmap e26: smithi149.xjglai(active, since 87s), standbys: smithi118.djbwyn 2024-09-21T11:40:03.915 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:03 smithi118 ceph-mon[28757]: pgmap v47: 65 pgs: 65 active+clean; 1.4 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 114 op/s 2024-09-21T11:40:04.104 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:03 smithi149 ceph-mon[36123]: pgmap v47: 65 pgs: 65 active+clean; 1.4 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 114 op/s 2024-09-21T11:40:05.251 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:05.251 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:05.251 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:40:05.251 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:40:05.251 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mgr fail", "who": "smithi149.xjglai"}]: dispatch 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: Activating manager daemon smithi118.djbwyn 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd='[{"prefix": "mgr fail", "who": "smithi149.xjglai"}]': finished 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: mgrmap e27: smithi118.djbwyn(active, starting, since 0.00688333s) 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"}]: dispatch 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"}]: dispatch 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"}]: dispatch 2024-09-21T11:40:05.252 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi118.djbwyn", "id": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: Manager daemon smithi118.djbwyn is now available 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:40:05.253 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:40:05.254 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:04 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/mirror_snapshot_schedule"}]: dispatch 2024-09-21T11:40:05.280 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "mgr fail", "who": "smithi149.xjglai"}]: dispatch 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: Activating manager daemon smithi118.djbwyn 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.24379 172.21.15.149:0/3105298043' entity='mgr.smithi149.xjglai' cmd='[{"prefix": "mgr fail", "who": "smithi149.xjglai"}]': finished 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: mgrmap e27: smithi118.djbwyn(active, starting, since 0.00688333s) 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:40:05.281 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi118.djbwyn", "id": "smithi118.djbwyn"}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: Manager daemon smithi118.djbwyn is now available 2024-09-21T11:40:05.282 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:40:05.283 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:40:05.283 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:40:05.283 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:04 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/mirror_snapshot_schedule"}]: dispatch 2024-09-21T11:40:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:05 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/trash_purge_schedule"}]: dispatch 2024-09-21T11:40:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:05 smithi118 ceph-mon[28757]: mgrmap e28: smithi118.djbwyn(active, since 1.01511s) 2024-09-21T11:40:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:05 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:40:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:05 smithi118 ceph-mon[28757]: pgmap v3: 65 pgs: 65 active+clean; 1002 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail 2024-09-21T11:40:06.327 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:05 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi118.djbwyn/trash_purge_schedule"}]: dispatch 2024-09-21T11:40:06.327 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:05 smithi149 ceph-mon[36123]: mgrmap e28: smithi118.djbwyn(active, since 1.01511s) 2024-09-21T11:40:06.327 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:05 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:40:06.327 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:05 smithi149 ceph-mon[36123]: pgmap v3: 65 pgs: 65 active+clean; 1002 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail 2024-09-21T11:40:07.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:07 smithi118 ceph-mon[28757]: [21/Sep/2024:11:40:05] ENGINE Bus STARTING 2024-09-21T11:40:07.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:07 smithi118 ceph-mon[28757]: pgmap v4: 65 pgs: 65 active+clean; 1002 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail 2024-09-21T11:40:07.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:07 smithi118 ceph-mon[28757]: [21/Sep/2024:11:40:06] ENGINE Serving on https://172.21.15.118:7150 2024-09-21T11:40:07.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:07 smithi118 ceph-mon[28757]: [21/Sep/2024:11:40:06] ENGINE Error in HTTPServer.serve 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Traceback (most recent call last): 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._connections.run(self.expiration_interval) 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._run(expiration_interval) 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: s = self.context.wrap_socket( 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: return self.sslsocket_class._create( 2024-09-21T11:40:07.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T11:40:07.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self.do_handshake() 2024-09-21T11:40:07.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T11:40:07.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: self._sslobj.do_handshake() 2024-09-21T11:40:07.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T11:40:07.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:07 smithi118 ceph-mon[28757]: [21/Sep/2024:11:40:06] ENGINE Serving on http://172.21.15.118:8765 2024-09-21T11:40:07.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:07 smithi118 ceph-mon[28757]: [21/Sep/2024:11:40:06] ENGINE Bus STARTED 2024-09-21T11:40:07.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:07 smithi149 ceph-mon[36123]: [21/Sep/2024:11:40:05] ENGINE Bus STARTING 2024-09-21T11:40:07.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:07 smithi149 ceph-mon[36123]: pgmap v4: 65 pgs: 65 active+clean; 1002 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail 2024-09-21T11:40:07.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:07 smithi149 ceph-mon[36123]: [21/Sep/2024:11:40:06] ENGINE Serving on https://172.21.15.118:7150 2024-09-21T11:40:07.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:07 smithi149 ceph-mon[36123]: [21/Sep/2024:11:40:06] ENGINE Error in HTTPServer.serve 2024-09-21T11:40:07.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Traceback (most recent call last): 2024-09-21T11:40:07.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._connections.run(self.expiration_interval) 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._run(expiration_interval) 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: s = self.context.wrap_socket( 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: return self.sslsocket_class._create( 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self.do_handshake() 2024-09-21T11:40:07.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T11:40:07.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._sslobj.do_handshake() 2024-09-21T11:40:07.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T11:40:07.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:07 smithi149 ceph-mon[36123]: [21/Sep/2024:11:40:06] ENGINE Serving on http://172.21.15.118:8765 2024-09-21T11:40:07.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:07 smithi149 ceph-mon[36123]: [21/Sep/2024:11:40:06] ENGINE Bus STARTED 2024-09-21T11:40:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:08 smithi118 ceph-mon[28757]: mgrmap e29: smithi118.djbwyn(active, since 3s) 2024-09-21T11:40:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:08 smithi149 ceph-mon[36123]: mgrmap e29: smithi118.djbwyn(active, since 3s) 2024-09-21T11:40:09.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:09 smithi118 ceph-mon[28757]: pgmap v5: 65 pgs: 65 active+clean; 1002 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail 2024-09-21T11:40:09.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:09 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:09.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:09 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:09.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:09 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:09.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:09 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:09.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:09 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:40:09.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:09 smithi149 ceph-mon[36123]: pgmap v5: 65 pgs: 65 active+clean; 1002 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail 2024-09-21T11:40:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:09 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:09 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:09 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:09 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:09 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-21T11:40:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:10 smithi118 ceph-mon[28757]: mgrmap e30: smithi118.djbwyn(active, since 5s) 2024-09-21T11:40:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:10 smithi118 ceph-mon[28757]: Standby manager daemon smithi149.xjglai started 2024-09-21T11:40:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:10 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/2687777563' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/crt"}]: dispatch 2024-09-21T11:40:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:10 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/2687777563' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:40:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:10 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/2687777563' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/key"}]: dispatch 2024-09-21T11:40:10.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:10 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/2687777563' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:40:10.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:10 smithi149 ceph-mon[36123]: mgrmap e30: smithi118.djbwyn(active, since 5s) 2024-09-21T11:40:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:10 smithi149 ceph-mon[36123]: Standby manager daemon smithi149.xjglai started 2024-09-21T11:40:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:10 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/2687777563' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/crt"}]: dispatch 2024-09-21T11:40:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:10 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/2687777563' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:40:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:10 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/2687777563' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/key"}]: dispatch 2024-09-21T11:40:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:10 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/2687777563' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:40:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:11 smithi118 ceph-mon[28757]: pgmap v6: 65 pgs: 65 active+clean; 1002 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail 2024-09-21T11:40:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:11 smithi118 ceph-mon[28757]: mgrmap e31: smithi118.djbwyn(active, since 6s), standbys: smithi149.xjglai 2024-09-21T11:40:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:11 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi149.xjglai", "id": "smithi149.xjglai"}]: dispatch 2024-09-21T11:40:11.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:11 smithi149 ceph-mon[36123]: pgmap v6: 65 pgs: 65 active+clean; 1002 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail 2024-09-21T11:40:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:11 smithi149 ceph-mon[36123]: mgrmap e31: smithi118.djbwyn(active, since 6s), standbys: smithi149.xjglai 2024-09-21T11:40:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:11 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr metadata", "who": "smithi149.xjglai", "id": "smithi149.xjglai"}]: dispatch 2024-09-21T11:40:12.778 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T11:40:12.779 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T11:40:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:13 smithi118 ceph-mon[28757]: pgmap v7: 65 pgs: 65 active+clean; 511 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 1.3 MiB/s wr, 106 op/s 2024-09-21T11:40:13.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:13 smithi149 ceph-mon[36123]: pgmap v7: 65 pgs: 65 active+clean; 511 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 1.3 MiB/s wr, 106 op/s 2024-09-21T11:40:15.324 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:15 smithi149 ceph-mon[36123]: pgmap v8: 65 pgs: 65 active+clean; 511 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1004 KiB/s wr, 82 op/s 2024-09-21T11:40:15.324 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:15 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:15.324 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:15 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:15.324 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:15 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:15.324 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:15 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:15.386 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:15 smithi118 ceph-mon[28757]: pgmap v8: 65 pgs: 65 active+clean; 511 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1004 KiB/s wr, 82 op/s 2024-09-21T11:40:15.386 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:15 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:15.386 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:15 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:15.386 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:15 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:15.386 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:15 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:17.187 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:17 smithi118 ceph-mon[28757]: pgmap v9: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.6 MiB/s wr, 109 op/s 2024-09-21T11:40:17.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:17 smithi149 ceph-mon[36123]: pgmap v9: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.6 MiB/s wr, 109 op/s 2024-09-21T11:40:19.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:19 smithi149 ceph-mon[36123]: pgmap v10: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.5 MiB/s wr, 100 op/s 2024-09-21T11:40:19.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:19 smithi118 ceph-mon[28757]: pgmap v10: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.5 MiB/s wr, 100 op/s 2024-09-21T11:40:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:20 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:40:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:20 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:40:21.418 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:21 smithi149 ceph-mon[36123]: pgmap v11: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.8 MiB/s wr, 113 op/s 2024-09-21T11:40:21.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:21 smithi118 ceph-mon[28757]: pgmap v11: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.8 MiB/s wr, 113 op/s 2024-09-21T11:40:21.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.571+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3693628799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 msgr2=0x7fe2b8100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:21.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.571+0000 7fe2bcde0640 1 --2- 172.21.15.118:0/3693628799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 0x7fe2b8100050 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009880 tx=0x7fe2a802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.572+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3693628799 shutdown_connections 2024-09-21T11:40:21.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.572+0000 7fe2bcde0640 1 --2- 172.21.15.118:0/3693628799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2b8102c30 0x7fe2b81030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.572+0000 7fe2bcde0640 1 --2- 172.21.15.118:0/3693628799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 0x7fe2b8100050 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.572+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3693628799 >> 172.21.15.118:0/3693628799 conn(0x7fe2b80fb7a0 msgr2=0x7fe2b80fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:21.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.572+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3693628799 shutdown_connections 2024-09-21T11:40:21.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.572+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3693628799 wait complete. 2024-09-21T11:40:21.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2bcde0640 1 Processor -- start 2024-09-21T11:40:21.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2bcde0640 1 -- start start 2024-09-21T11:40:21.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2bcde0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 0x7fe2b8102520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:21.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2bcde0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2b8102c30 0x7fe2b8100be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:21.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2bcde0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b810a7b0 con 0x7fe2b80ffc50 2024-09-21T11:40:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2bcde0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b810a630 con 0x7fe2b8102c30 2024-09-21T11:40:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2b659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 0x7fe2b8102520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2b659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 0x7fe2b8102520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38056/0 (socket says 172.21.15.118:38056) 2024-09-21T11:40:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2b659c640 1 -- 172.21.15.118:0/3109580738 learned_addr learned my addr 172.21.15.118:0/3109580738 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.573+0000 7fe2b5d9b640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2b8102c30 0x7fe2b8100be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2b659c640 1 -- 172.21.15.118:0/3109580738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2b8102c30 msgr2=0x7fe2b8100be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2b659c640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2b8102c30 0x7fe2b8100be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2b659c640 1 -- 172.21.15.118:0/3109580738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b8101120 con 0x7fe2b80ffc50 2024-09-21T11:40:21.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2b5d9b640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2b8102c30 0x7fe2b8100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T11:40:21.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2b659c640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 0x7fe2b8102520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8006010 tx=0x7fe2a80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:21.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2a77fe640 1 -- 172.21.15.118:0/3109580738 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2a803f070 con 0x7fe2b80ffc50 2024-09-21T11:40:21.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2a77fe640 1 -- 172.21.15.118:0/3109580738 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2a80044d0 con 0x7fe2b80ffc50 2024-09-21T11:40:21.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b81013b0 con 0x7fe2b80ffc50 2024-09-21T11:40:21.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2a77fe640 1 -- 172.21.15.118:0/3109580738 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2a8035030 con 0x7fe2b80ffc50 2024-09-21T11:40:21.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.574+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b81018e0 con 0x7fe2b80ffc50 2024-09-21T11:40:21.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.575+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b810af90 con 0x7fe2b80ffc50 2024-09-21T11:40:21.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.576+0000 7fe2a77fe640 1 -- 172.21.15.118:0/3109580738 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7fe2a8042070 con 0x7fe2b80ffc50 2024-09-21T11:40:21.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.577+0000 7fe2a77fe640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2a007b050 0x7fe2a007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:21.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.577+0000 7fe2a77fe640 1 -- 172.21.15.118:0/3109580738 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fe2a80beef0 con 0x7fe2b80ffc50 2024-09-21T11:40:21.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.577+0000 7fe2b5d9b640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2a007b050 0x7fe2a007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:21.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.577+0000 7fe2b5d9b640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2a007b050 0x7fe2a007d510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe2b81022a0 tx=0x7fe2ac00a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:21.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.583+0000 7fe2a77fe640 1 -- 172.21.15.118:0/3109580738 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe2a808a2d0 con 0x7fe2b80ffc50 2024-09-21T11:40:21.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.857+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe2b802db20 con 0x7fe2a007b050 2024-09-21T11:40:21.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.858+0000 7fe2a77fe640 1 -- 172.21.15.118:0/3109580738 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fe2b802db20 con 0x7fe2a007b050 2024-09-21T11:40:21.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2a007b050 msgr2=0x7fe2a007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:21.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2a007b050 0x7fe2a007d510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe2b81022a0 tx=0x7fe2ac00a2d0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 msgr2=0x7fe2b8102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:21.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 0x7fe2b8102520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8006010 tx=0x7fe2a80048f0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 shutdown_connections 2024-09-21T11:40:21.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2b8102c30 0x7fe2b8100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2a007b050 0x7fe2a007d510 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 --2- 172.21.15.118:0/3109580738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b80ffc50 0x7fe2b8102520 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 >> 172.21.15.118:0/3109580738 conn(0x7fe2b80fb7a0 msgr2=0x7fe2b8106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:21.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 shutdown_connections 2024-09-21T11:40:21.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.861+0000 7fe2bcde0640 1 -- 172.21.15.118:0/3109580738 wait complete. 2024-09-21T11:40:21.874 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:40:21.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.968+0000 7efd341c5640 1 -- 172.21.15.118:0/1196534101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 msgr2=0x7efd2c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:21.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.968+0000 7efd341c5640 1 --2- 172.21.15.118:0/1196534101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 0x7efd2c100c40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efd28009880 tx=0x7efd2802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.968+0000 7efd341c5640 1 -- 172.21.15.118:0/1196534101 shutdown_connections 2024-09-21T11:40:21.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.968+0000 7efd341c5640 1 --2- 172.21.15.118:0/1196534101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd2c101a40 0x7efd2c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.968+0000 7efd341c5640 1 --2- 172.21.15.118:0/1196534101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 0x7efd2c100c40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.968+0000 7efd341c5640 1 -- 172.21.15.118:0/1196534101 >> 172.21.15.118:0/1196534101 conn(0x7efd2c0fbff0 msgr2=0x7efd2c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:21.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.968+0000 7efd341c5640 1 -- 172.21.15.118:0/1196534101 shutdown_connections 2024-09-21T11:40:21.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.968+0000 7efd341c5640 1 -- 172.21.15.118:0/1196534101 wait complete. 2024-09-21T11:40:21.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd341c5640 1 Processor -- start 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd341c5640 1 -- start start 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd341c5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 0x7efd2c06a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd341c5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd2c101a40 0x7efd2c19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd341c5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c109680 con 0x7efd2c100840 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd341c5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c109500 con 0x7efd2c101a40 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd31f61640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 0x7efd2c06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd31f61640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 0x7efd2c06a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38068/0 (socket says 172.21.15.118:38068) 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd31f61640 1 -- 172.21.15.118:0/746027679 learned_addr learned my addr 172.21.15.118:0/746027679 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd31760640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd2c101a40 0x7efd2c19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd31f61640 1 -- 172.21.15.118:0/746027679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd2c101a40 msgr2=0x7efd2c19c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd31f61640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd2c101a40 0x7efd2c19c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.969+0000 7efd31f61640 1 -- 172.21.15.118:0/746027679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c19c7e0 con 0x7efd2c100840 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.970+0000 7efd31f61640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 0x7efd2c06a620 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efd28009230 tx=0x7efd280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.970+0000 7efd22ffd640 1 -- 172.21.15.118:0/746027679 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd2803f070 con 0x7efd2c100840 2024-09-21T11:40:21.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.970+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c19ca70 con 0x7efd2c100840 2024-09-21T11:40:21.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.970+0000 7efd22ffd640 1 -- 172.21.15.118:0/746027679 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd280044d0 con 0x7efd2c100840 2024-09-21T11:40:21.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.970+0000 7efd22ffd640 1 -- 172.21.15.118:0/746027679 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd28035030 con 0x7efd2c100840 2024-09-21T11:40:21.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.970+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c19cfa0 con 0x7efd2c100840 2024-09-21T11:40:21.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.971+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2c100c40 con 0x7efd2c100840 2024-09-21T11:40:21.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.972+0000 7efd22ffd640 1 -- 172.21.15.118:0/746027679 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7efd28042070 con 0x7efd2c100840 2024-09-21T11:40:21.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.972+0000 7efd22ffd640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efd1807b050 0x7efd1807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:21.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.973+0000 7efd22ffd640 1 -- 172.21.15.118:0/746027679 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7efd280bef00 con 0x7efd2c100840 2024-09-21T11:40:21.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.973+0000 7efd31760640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efd1807b050 0x7efd1807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:21.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.973+0000 7efd31760640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efd1807b050 0x7efd1807d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efd2c06a3a0 tx=0x7efd1c00a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:21.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:21.979+0000 7efd22ffd640 1 -- 172.21.15.118:0/746027679 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7efd2808a250 con 0x7efd2c100840 2024-09-21T11:40:22.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.257+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efd2c062630 con 0x7efd1807b050 2024-09-21T11:40:22.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.258+0000 7efd22ffd640 1 -- 172.21.15.118:0/746027679 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7efd2c062630 con 0x7efd1807b050 2024-09-21T11:40:22.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efd1807b050 msgr2=0x7efd1807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:22.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efd1807b050 0x7efd1807d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efd2c06a3a0 tx=0x7efd1c00a250 comp rx=0 tx=0).stop 2024-09-21T11:40:22.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 msgr2=0x7efd2c06a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:22.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 0x7efd2c06a620 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efd28009230 tx=0x7efd280048f0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 shutdown_connections 2024-09-21T11:40:22.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd2c101a40 0x7efd2c19c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efd1807b050 0x7efd1807d510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 --2- 172.21.15.118:0/746027679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd2c100840 0x7efd2c06a620 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 >> 172.21.15.118:0/746027679 conn(0x7efd2c0fbff0 msgr2=0x7efd2c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:22.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 shutdown_connections 2024-09-21T11:40:22.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.260+0000 7efd341c5640 1 -- 172.21.15.118:0/746027679 wait complete. 2024-09-21T11:40:22.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.350+0000 7f15df84e640 1 -- 172.21.15.118:0/3577146230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8104d60 msgr2=0x7f15d8107150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:22.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.350+0000 7f15df84e640 1 --2- 172.21.15.118:0/3577146230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8104d60 0x7f15d8107150 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009880 tx=0x7f15c802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.350+0000 7f15df84e640 1 -- 172.21.15.118:0/3577146230 shutdown_connections 2024-09-21T11:40:22.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.350+0000 7f15df84e640 1 --2- 172.21.15.118:0/3577146230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8104d60 0x7f15d8107150 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.350+0000 7f15df84e640 1 --2- 172.21.15.118:0/3577146230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15d8102430 0x7f15d8104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.350+0000 7f15df84e640 1 -- 172.21.15.118:0/3577146230 >> 172.21.15.118:0/3577146230 conn(0x7f15d80fbff0 msgr2=0x7f15d80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:22.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.350+0000 7f15df84e640 1 -- 172.21.15.118:0/3577146230 shutdown_connections 2024-09-21T11:40:22.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.350+0000 7f15df84e640 1 -- 172.21.15.118:0/3577146230 wait complete. 2024-09-21T11:40:22.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15df84e640 1 Processor -- start 2024-09-21T11:40:22.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15df84e640 1 -- start start 2024-09-21T11:40:22.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15df84e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8102430 0x7f15d8101d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:22.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15df84e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15d8104d60 0x7f15d81003e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:22.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15df84e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f15d810a700 con 0x7f15d8102430 2024-09-21T11:40:22.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15df84e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f15d810a580 con 0x7f15d8104d60 2024-09-21T11:40:22.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15dd5ea640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8102430 0x7f15d8101d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15dd5ea640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8102430 0x7f15d8101d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38100/0 (socket says 172.21.15.118:38100) 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15dd5ea640 1 -- 172.21.15.118:0/2891028161 learned_addr learned my addr 172.21.15.118:0/2891028161 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.351+0000 7f15dcde9640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15d8104d60 0x7f15d81003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.352+0000 7f15dd5ea640 1 -- 172.21.15.118:0/2891028161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15d8104d60 msgr2=0x7f15d81003e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.352+0000 7f15dd5ea640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15d8104d60 0x7f15d81003e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.352+0000 7f15dd5ea640 1 -- 172.21.15.118:0/2891028161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d8100920 con 0x7f15d8102430 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.352+0000 7f15dd5ea640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8102430 0x7f15d8101d20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15d400e970 tx=0x7f15d400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.352+0000 7f15ce7fc640 1 -- 172.21.15.118:0/2891028161 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15d400cac0 con 0x7f15d8102430 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.352+0000 7f15ce7fc640 1 -- 172.21.15.118:0/2891028161 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15d400cc60 con 0x7f15d8102430 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.352+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d8100c10 con 0x7f15d8102430 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.352+0000 7f15ce7fc640 1 -- 172.21.15.118:0/2891028161 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15d4018720 con 0x7f15d8102430 2024-09-21T11:40:22.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.352+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d8101170 con 0x7f15d8102430 2024-09-21T11:40:22.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.353+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc005290 con 0x7f15d8102430 2024-09-21T11:40:22.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.355+0000 7f15ce7fc640 1 -- 172.21.15.118:0/2891028161 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f15d4010a80 con 0x7f15d8102430 2024-09-21T11:40:22.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.355+0000 7f15ce7fc640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15c407b0b0 0x7f15c407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.356+0000 7f15ce7fc640 1 -- 172.21.15.118:0/2891028161 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f15d409e640 con 0x7f15d8102430 2024-09-21T11:40:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.356+0000 7f15dcde9640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15c407b0b0 0x7f15c407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.356+0000 7f15dcde9640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15c407b0b0 0x7f15c407d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009230 tx=0x7f15c80058d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:22.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.363+0000 7f15ce7fc640 1 -- 172.21.15.118:0/2891028161 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f15d4069aa0 con 0x7f15d8102430 2024-09-21T11:40:22.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.612+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f15bc000bc0 con 0x7f15c407b0b0 2024-09-21T11:40:22.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.626+0000 7f15ce7fc640 1 -- 172.21.15.118:0/2891028161 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f15bc000bc0 con 0x7f15c407b0b0 2024-09-21T11:40:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:40:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (7m) 8s ago 9m 22.8M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:40:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (82s) 8s ago 9m 8404k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:40:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (42s) 14s ago 8m 7964k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:40:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (9m) 8s ago 9m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:40:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (8m) 14s ago 8m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:40:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (7m) 8s ago 9m 80.0M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:40:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (3m) 8s ago 3m 244M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:40:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (3m) 8s ago 3m 26.2M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (3m) 14s ago 3m 20.2M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (3m) 14s ago 3m 14.0M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (29s) 8s ago 10m 490M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (119s) 14s ago 8m 145M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f2f99ac4e912 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (10m) 8s ago 10m 55.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (8m) 14s ago 8m 43.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (9m) 8s ago 9m 15.8M - 1.5.0 0da6a335fe13 92cdb77bc8bc 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (8m) 14s ago 8m 15.6M - 1.5.0 0da6a335fe13 1a6e8f960a5b 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (7m) 8s ago 7m 174M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (6m) 8s ago 6m 178M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (6m) 8s ago 6m 157M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:40:22.630 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (5m) 14s ago 5m 222M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:40:22.631 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (5m) 14s ago 5m 186M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:40:22.631 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (4m) 14s ago 4m 197M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:40:22.631 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (51s) 8s ago 8m 52.4M - 2.43.0 a07b618ecd1d 190ec8e9b22e 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.629+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15c407b0b0 msgr2=0x7f15c407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.629+0000 7f15df84e640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15c407b0b0 0x7f15c407d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009230 tx=0x7f15c80058d0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.629+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8102430 msgr2=0x7f15d8101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.629+0000 7f15df84e640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8102430 0x7f15d8101d20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15d400e970 tx=0x7f15d400ee30 comp rx=0 tx=0).stop 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.630+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 shutdown_connections 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.630+0000 7f15df84e640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15d8104d60 0x7f15d81003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.630+0000 7f15df84e640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15c407b0b0 0x7f15c407d570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.630+0000 7f15df84e640 1 --2- 172.21.15.118:0/2891028161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15d8102430 0x7f15d8101d20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.630+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 >> 172.21.15.118:0/2891028161 conn(0x7f15d80fbff0 msgr2=0x7f15d80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.630+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 shutdown_connections 2024-09-21T11:40:22.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.630+0000 7f15df84e640 1 -- 172.21.15.118:0/2891028161 wait complete. 2024-09-21T11:40:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.734+0000 7fde3e78f640 1 -- 172.21.15.118:0/3973005634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde381011e0 msgr2=0x7fde38101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.734+0000 7fde3e78f640 1 --2- 172.21.15.118:0/3973005634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde381011e0 0x7fde38101660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fde2000a990 tx=0x7fde2002b7d0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.734+0000 7fde3e78f640 1 -- 172.21.15.118:0/3973005634 shutdown_connections 2024-09-21T11:40:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.734+0000 7fde3e78f640 1 --2- 172.21.15.118:0/3973005634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde381011e0 0x7fde38101660 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.734+0000 7fde3e78f640 1 --2- 172.21.15.118:0/3973005634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde380fffe0 0x7fde381003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.734+0000 7fde3e78f640 1 -- 172.21.15.118:0/3973005634 >> 172.21.15.118:0/3973005634 conn(0x7fde380fb770 msgr2=0x7fde380fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.734+0000 7fde3e78f640 1 -- 172.21.15.118:0/3973005634 shutdown_connections 2024-09-21T11:40:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.734+0000 7fde3e78f640 1 -- 172.21.15.118:0/3973005634 wait complete. 2024-09-21T11:40:22.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde3e78f640 1 Processor -- start 2024-09-21T11:40:22.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde3e78f640 1 -- start start 2024-09-21T11:40:22.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde3e78f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde380fffe0 0x7fde38197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:22.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde3e78f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde381011e0 0x7fde38197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:22.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde3e78f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fde38108520 con 0x7fde380fffe0 2024-09-21T11:40:22.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde3e78f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fde381083a0 con 0x7fde381011e0 2024-09-21T11:40:22.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde37fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde380fffe0 0x7fde38197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:22.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde37fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde380fffe0 0x7fde38197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38120/0 (socket says 172.21.15.118:38120) 2024-09-21T11:40:22.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde37fff640 1 -- 172.21.15.118:0/3923822912 learned_addr learned my addr 172.21.15.118:0/3923822912 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:22.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.735+0000 7fde2ffff640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde381011e0 0x7fde38197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.736+0000 7fde37fff640 1 -- 172.21.15.118:0/3923822912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde381011e0 msgr2=0x7fde38197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.736+0000 7fde37fff640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde381011e0 0x7fde38197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.736+0000 7fde37fff640 1 -- 172.21.15.118:0/3923822912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde38197fd0 con 0x7fde380fffe0 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.736+0000 7fde37fff640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde380fffe0 0x7fde38197410 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fde2800c8f0 tx=0x7fde2800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.736+0000 7fde35ffb640 1 -- 172.21.15.118:0/3923822912 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde280079b0 con 0x7fde380fffe0 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.736+0000 7fde35ffb640 1 -- 172.21.15.118:0/3923822912 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde28007b50 con 0x7fde380fffe0 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.736+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3819ca10 con 0x7fde380fffe0 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.736+0000 7fde35ffb640 1 -- 172.21.15.118:0/3923822912 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde28018610 con 0x7fde380fffe0 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.736+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3819cff0 con 0x7fde380fffe0 2024-09-21T11:40:22.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.737+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde381003e0 con 0x7fde380fffe0 2024-09-21T11:40:22.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.738+0000 7fde35ffb640 1 -- 172.21.15.118:0/3923822912 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7fde28007d00 con 0x7fde380fffe0 2024-09-21T11:40:22.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.739+0000 7fde35ffb640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde2407b050 0x7fde2407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:22.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.739+0000 7fde35ffb640 1 -- 172.21.15.118:0/3923822912 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fde2809e4a0 con 0x7fde380fffe0 2024-09-21T11:40:22.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.739+0000 7fde2ffff640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde2407b050 0x7fde2407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:22.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.740+0000 7fde2ffff640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde2407b050 0x7fde2407d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde20006010 tx=0x7fde20008230 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:22.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:22.744+0000 7fde35ffb640 1 -- 172.21.15.118:0/3923822912 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fde28014030 con 0x7fde380fffe0 2024-09-21T11:40:23.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.130+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fde3802d7c0 con 0x7fde380fffe0 2024-09-21T11:40:23.134 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:40:23.134 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:40:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:40:23.136 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:40:23.136 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T11:40:23.136 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:40:23.136 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:40:23.136 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:40:23.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.132+0000 7fde35ffb640 1 -- 172.21.15.118:0/3923822912 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fde28069880 con 0x7fde380fffe0 2024-09-21T11:40:23.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.135+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde2407b050 msgr2=0x7fde2407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:23.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.135+0000 7fde3e78f640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde2407b050 0x7fde2407d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde20006010 tx=0x7fde20008230 comp rx=0 tx=0).stop 2024-09-21T11:40:23.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.135+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde380fffe0 msgr2=0x7fde38197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:23.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.135+0000 7fde3e78f640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde380fffe0 0x7fde38197410 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fde2800c8f0 tx=0x7fde2800cdb0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.136+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 shutdown_connections 2024-09-21T11:40:23.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.136+0000 7fde3e78f640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde381011e0 0x7fde38197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.136+0000 7fde3e78f640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde2407b050 0x7fde2407d510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.136+0000 7fde3e78f640 1 --2- 172.21.15.118:0/3923822912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde380fffe0 0x7fde38197410 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.136+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 >> 172.21.15.118:0/3923822912 conn(0x7fde380fb770 msgr2=0x7fde381046f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:23.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.137+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 shutdown_connections 2024-09-21T11:40:23.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.137+0000 7fde3e78f640 1 -- 172.21.15.118:0/3923822912 wait complete. 2024-09-21T11:40:23.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.259+0000 7f8645591640 1 -- 172.21.15.118:0/356368154 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f863c031740 con 0x7f8640100840 2024-09-21T11:40:23.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.259+0000 7f86487f7640 1 -- 172.21.15.118:0/356368154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640100840 msgr2=0x7f8640100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:23.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.259+0000 7f86487f7640 1 --2- 172.21.15.118:0/356368154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640100840 0x7f8640100c40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f863c009880 tx=0x7f863c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.260+0000 7f86487f7640 1 -- 172.21.15.118:0/356368154 shutdown_connections 2024-09-21T11:40:23.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.260+0000 7f86487f7640 1 --2- 172.21.15.118:0/356368154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8640101a40 0x7f8640101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.260+0000 7f86487f7640 1 --2- 172.21.15.118:0/356368154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640100840 0x7f8640100c40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.260+0000 7f86487f7640 1 -- 172.21.15.118:0/356368154 >> 172.21.15.118:0/356368154 conn(0x7f86400fbff0 msgr2=0x7f86400fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:23.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.260+0000 7f86487f7640 1 -- 172.21.15.118:0/356368154 shutdown_connections 2024-09-21T11:40:23.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.260+0000 7f86487f7640 1 -- 172.21.15.118:0/356368154 wait complete. 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f86487f7640 1 Processor -- start 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f86487f7640 1 -- start start 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f86487f7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8640100840 0x7f8640197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f86487f7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640101a40 0x7f86401979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f86487f7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f864010a780 con 0x7f8640101a40 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f86487f7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f864010a600 con 0x7f8640100840 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f8645d92640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640101a40 0x7f86401979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f8646593640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8640100840 0x7f8640197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f8645d92640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640101a40 0x7f86401979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38146/0 (socket says 172.21.15.118:38146) 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f8645d92640 1 -- 172.21.15.118:0/3112805815 learned_addr learned my addr 172.21.15.118:0/3112805815 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f8645d92640 1 -- 172.21.15.118:0/3112805815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8640100840 msgr2=0x7f8640197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:23.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f8645d92640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8640100840 0x7f8640197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.261+0000 7f8645d92640 1 -- 172.21.15.118:0/3112805815 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8640198020 con 0x7f8640101a40 2024-09-21T11:40:23.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.262+0000 7f8645d92640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640101a40 0x7f86401979a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f863000e970 tx=0x7f863000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:23.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.262+0000 7f86377fe640 1 -- 172.21.15.118:0/3112805815 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f863000cac0 con 0x7f8640101a40 2024-09-21T11:40:23.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.262+0000 7f86377fe640 1 -- 172.21.15.118:0/3112805815 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86300054e0 con 0x7f8640101a40 2024-09-21T11:40:23.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.262+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864019ca60 con 0x7f8640101a40 2024-09-21T11:40:23.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.262+0000 7f86377fe640 1 -- 172.21.15.118:0/3112805815 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8630010430 con 0x7f8640101a40 2024-09-21T11:40:23.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.262+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864019cff0 con 0x7f8640101a40 2024-09-21T11:40:23.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.264+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8640100c40 con 0x7f8640101a40 2024-09-21T11:40:23.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.265+0000 7f86377fe640 1 -- 172.21.15.118:0/3112805815 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f8630004ec0 con 0x7f8640101a40 2024-09-21T11:40:23.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.265+0000 7f86377fe640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862c07b100 0x7f862c07d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:23.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.265+0000 7f86377fe640 1 -- 172.21.15.118:0/3112805815 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f863009e7f0 con 0x7f8640101a40 2024-09-21T11:40:23.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.266+0000 7f8646593640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862c07b100 0x7f862c07d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:23.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.266+0000 7f8646593640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862c07b100 0x7f862c07d5c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f863c006010 tx=0x7f863c005b50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:23.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.270+0000 7f86377fe640 1 -- 172.21.15.118:0/3112805815 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8630069c30 con 0x7f8640101a40 2024-09-21T11:40:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:23 smithi149 ceph-mon[36123]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:23.564 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:23 smithi149 ceph-mon[36123]: pgmap v12: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-09-21T11:40:23.564 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:23 smithi149 ceph-mon[36123]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:23.564 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:23 smithi149 ceph-mon[36123]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:23.564 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:23 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3923822912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:40:23.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.530+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8640062630 con 0x7f862c07b100 2024-09-21T11:40:23.565 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:23 smithi118 ceph-mon[28757]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:23.565 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:23 smithi118 ceph-mon[28757]: pgmap v12: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-09-21T11:40:23.565 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:23 smithi118 ceph-mon[28757]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:23.565 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:23 smithi118 ceph-mon[28757]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:23.565 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:23 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3923822912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:40:23.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.532+0000 7f86377fe640 1 -- 172.21.15.118:0/3112805815 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f8640062630 con 0x7f862c07b100 2024-09-21T11:40:23.566 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:40:23.566 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:40:23.566 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:40:23.566 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:40:23.566 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:40:23.566 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:40:23.566 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:40:23.566 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "", 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862c07b100 msgr2=0x7f862c07d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862c07b100 0x7f862c07d5c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f863c006010 tx=0x7f863c005b50 comp rx=0 tx=0).stop 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640101a40 msgr2=0x7f86401979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640101a40 0x7f86401979a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f863000e970 tx=0x7f863000ed70 comp rx=0 tx=0).stop 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 shutdown_connections 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862c07b100 0x7f862c07d5c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8640101a40 0x7f86401979a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 --2- 172.21.15.118:0/3112805815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8640100840 0x7f8640197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:23.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 >> 172.21.15.118:0/3112805815 conn(0x7f86400fbff0 msgr2=0x7f8640104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:23.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 shutdown_connections 2024-09-21T11:40:23.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:23.534+0000 7f86487f7640 1 -- 172.21.15.118:0/3112805815 wait complete. 2024-09-21T11:40:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:24 smithi118 ceph-mon[28757]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:24 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:24 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:24 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:40:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:24 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:40:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:24 smithi149 ceph-mon[36123]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:24 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:24 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:24 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:40:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:24 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:40:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-21T11:40:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-21T11:40:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: pgmap v13: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 87 op/s 2024-09-21T11:40:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:40:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:40:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:40:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:40:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:40:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:40:25.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:25.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:25.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:25.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:25.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:25 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: pgmap v13: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 87 op/s 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: Updating smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: Updating smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:25.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:25.525 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:25.525 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:25.525 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:25 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:26 smithi149 ceph-mon[36123]: Reconfiguring prometheus.smithi118 (dependencies changed)... 2024-09-21T11:40:26.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:26 smithi149 ceph-mon[36123]: Reconfiguring daemon prometheus.smithi118 on smithi118 2024-09-21T11:40:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:26 smithi118 ceph-mon[28757]: Reconfiguring prometheus.smithi118 (dependencies changed)... 2024-09-21T11:40:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:26 smithi118 ceph-mon[28757]: Reconfiguring daemon prometheus.smithi118 on smithi118 2024-09-21T11:40:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:27 smithi118 ceph-mon[28757]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.2 MiB/s wr, 126 op/s 2024-09-21T11:40:27.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:27 smithi149 ceph-mon[36123]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.2 MiB/s wr, 126 op/s 2024-09-21T11:40:29.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:29 smithi149 ceph-mon[36123]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-09-21T11:40:29.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:29 smithi118 ceph-mon[28757]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-09-21T11:40:31.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:31 smithi149 ceph-mon[36123]: pgmap v16: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.7 MiB/s wr, 106 op/s 2024-09-21T11:40:31.564 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:31 smithi118 ceph-mon[28757]: pgmap v16: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.7 MiB/s wr, 106 op/s 2024-09-21T11:40:33.409 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:33 smithi118 ceph-mon[28757]: pgmap v17: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.8 MiB/s wr, 116 op/s 2024-09-21T11:40:33.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:33 smithi149 ceph-mon[36123]: pgmap v17: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.8 MiB/s wr, 116 op/s 2024-09-21T11:40:35.437 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:35 smithi118 ceph-mon[28757]: pgmap v18: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-09-21T11:40:35.437 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:35 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:40:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:35 smithi149 ceph-mon[36123]: pgmap v18: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-09-21T11:40:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:35 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:40:37.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:37 smithi149 ceph-mon[36123]: pgmap v19: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 361 op/s 2024-09-21T11:40:37.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:37 smithi118 ceph-mon[28757]: pgmap v19: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 361 op/s 2024-09-21T11:40:39.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:39 smithi149 ceph-mon[36123]: pgmap v20: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 322 op/s 2024-09-21T11:40:39.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:39 smithi118 ceph-mon[28757]: pgmap v20: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 322 op/s 2024-09-21T11:40:41.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:41 smithi149 ceph-mon[36123]: pgmap v21: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 409 op/s 2024-09-21T11:40:41.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:41 smithi118 ceph-mon[28757]: pgmap v21: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 409 op/s 2024-09-21T11:40:43.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:43 smithi149 ceph-mon[36123]: pgmap v22: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 2.1 MiB/s wr, 575 op/s 2024-09-21T11:40:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:43 smithi118 ceph-mon[28757]: pgmap v22: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 2.1 MiB/s wr, 575 op/s 2024-09-21T11:40:45.423 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:45 smithi118 ceph-mon[28757]: pgmap v23: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 551 op/s 2024-09-21T11:40:45.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:45 smithi149 ceph-mon[36123]: pgmap v23: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 551 op/s 2024-09-21T11:40:47.564 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:47 smithi149 ceph-mon[36123]: pgmap v24: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 628 op/s 2024-09-21T11:40:47.564 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:47 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:47.565 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:47 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:47.565 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:47 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:40:47.565 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:47 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:40:47.565 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:47 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:40:47.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:47 smithi118 ceph-mon[28757]: pgmap v24: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 628 op/s 2024-09-21T11:40:47.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:47 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:47.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:47 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:47.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:47 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:40:47.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:47 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:40:47.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:47 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:40:49.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:49 smithi118 ceph-mon[28757]: pgmap v25: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.8 MiB/s wr, 347 op/s 2024-09-21T11:40:49.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:49 smithi118 ceph-mon[28757]: Upgrade: Updating mgr.smithi149.xjglai 2024-09-21T11:40:49.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:49 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.xjglai", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:40:49.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:49 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:40:49.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:49 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:40:49.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:49 smithi118 ceph-mon[28757]: Deploying daemon mgr.smithi149.xjglai on smithi149 2024-09-21T11:40:49.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:49 smithi149 ceph-mon[36123]: pgmap v25: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.8 MiB/s wr, 347 op/s 2024-09-21T11:40:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:49 smithi149 ceph-mon[36123]: Upgrade: Updating mgr.smithi149.xjglai 2024-09-21T11:40:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:49 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.xjglai", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T11:40:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:49 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T11:40:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:49 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:40:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:49 smithi149 ceph-mon[36123]: Deploying daemon mgr.smithi149.xjglai on smithi149 2024-09-21T11:40:50.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:50 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:40:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:50 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:40:51.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:51 smithi149 ceph-mon[36123]: pgmap v26: 65 pgs: 65 active+clean; 298 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.9 MiB/s wr, 391 op/s 2024-09-21T11:40:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:51 smithi118 ceph-mon[28757]: pgmap v26: 65 pgs: 65 active+clean; 298 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.9 MiB/s wr, 391 op/s 2024-09-21T11:40:53.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:53 smithi149 ceph-mon[36123]: pgmap v27: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 2.0 MiB/s wr, 408 op/s 2024-09-21T11:40:53.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:53 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:53.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:53 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:53.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:53 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:40:53.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:53 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:53.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:53 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:53.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:53 smithi118 ceph-mon[28757]: pgmap v27: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 2.0 MiB/s wr, 408 op/s 2024-09-21T11:40:53.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:53 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:53.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:53 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:53.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:53 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:40:53.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:53 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:53.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:53 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.629+0000 7fc568d10640 1 -- 172.21.15.118:0/908000124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564102b90 msgr2=0x7fc564103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.629+0000 7fc568d10640 1 --2- 172.21.15.118:0/908000124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564102b90 0x7fc564103010 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009880 tx=0x7fc54c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:40:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.629+0000 7fc568d10640 1 -- 172.21.15.118:0/908000124 shutdown_connections 2024-09-21T11:40:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.629+0000 7fc568d10640 1 --2- 172.21.15.118:0/908000124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564102b90 0x7fc564103010 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.629+0000 7fc568d10640 1 --2- 172.21.15.118:0/908000124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc564101990 0x7fc564101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.629+0000 7fc568d10640 1 -- 172.21.15.118:0/908000124 >> 172.21.15.118:0/908000124 conn(0x7fc5640fd140 msgr2=0x7fc5640ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.629+0000 7fc568d10640 1 -- 172.21.15.118:0/908000124 shutdown_connections 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.629+0000 7fc568d10640 1 -- 172.21.15.118:0/908000124 wait complete. 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.630+0000 7fc568d10640 1 Processor -- start 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.630+0000 7fc568d10640 1 -- start start 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.630+0000 7fc568d10640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564101990 0x7fc5641974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.630+0000 7fc568d10640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc564102b90 0x7fc564197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.630+0000 7fc568d10640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc56410a7d0 con 0x7fc564101990 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.630+0000 7fc568d10640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc56410a650 con 0x7fc564102b90 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.630+0000 7fc56259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564101990 0x7fc5641974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.630+0000 7fc56259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564101990 0x7fc5641974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43874/0 (socket says 172.21.15.118:43874) 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.630+0000 7fc56259c640 1 -- 172.21.15.118:0/3585601087 learned_addr learned my addr 172.21.15.118:0/3585601087 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc561d9b640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc564102b90 0x7fc564197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc56259c640 1 -- 172.21.15.118:0/3585601087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc564102b90 msgr2=0x7fc564197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc56259c640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc564102b90 0x7fc564197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc56259c640 1 -- 172.21.15.118:0/3585601087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc564198080 con 0x7fc564101990 2024-09-21T11:40:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc56259c640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564101990 0x7fc5641974c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc55400d8d0 tx=0x7fc55400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc55b7fe640 1 -- 172.21.15.118:0/3585601087 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc554017070 con 0x7fc564101990 2024-09-21T11:40:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc55b7fe640 1 -- 172.21.15.118:0/3585601087 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc55400be10 con 0x7fc564101990 2024-09-21T11:40:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56419cac0 con 0x7fc564101990 2024-09-21T11:40:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc55b7fe640 1 -- 172.21.15.118:0/3585601087 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc55400f3c0 con 0x7fc564101990 2024-09-21T11:40:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.631+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56419d020 con 0x7fc564101990 2024-09-21T11:40:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.632+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc564101d90 con 0x7fc564101990 2024-09-21T11:40:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.633+0000 7fc55b7fe640 1 -- 172.21.15.118:0/3585601087 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7fc55401a070 con 0x7fc564101990 2024-09-21T11:40:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.633+0000 7fc55b7fe640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc55007b050 0x7fc55007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.633+0000 7fc55b7fe640 1 -- 172.21.15.118:0/3585601087 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fc55409de20 con 0x7fc564101990 2024-09-21T11:40:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.633+0000 7fc561d9b640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc55007b050 0x7fc55007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.634+0000 7fc561d9b640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc55007b050 0x7fc55007d510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc54c000c00 tx=0x7fc54c0058d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:53.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.638+0000 7fc55b7fe640 1 -- 172.21.15.118:0/3585601087 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc554069200 con 0x7fc564101990 2024-09-21T11:40:53.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.954+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc5640626f0 con 0x7fc55007b050 2024-09-21T11:40:53.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.955+0000 7fc55b7fe640 1 -- 172.21.15.118:0/3585601087 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7fc5640626f0 con 0x7fc55007b050 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc55007b050 msgr2=0x7fc55007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc55007b050 0x7fc55007d510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc54c000c00 tx=0x7fc54c0058d0 comp rx=0 tx=0).stop 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564101990 msgr2=0x7fc5641974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564101990 0x7fc5641974c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc55400d8d0 tx=0x7fc55400dd90 comp rx=0 tx=0).stop 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 shutdown_connections 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc564102b90 0x7fc564197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc55007b050 0x7fc55007d510 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 --2- 172.21.15.118:0/3585601087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564101990 0x7fc5641974c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 >> 172.21.15.118:0/3585601087 conn(0x7fc5640fd140 msgr2=0x7fc564106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 shutdown_connections 2024-09-21T11:40:53.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:53.957+0000 7fc568d10640 1 -- 172.21.15.118:0/3585601087 wait complete. 2024-09-21T11:40:53.968 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:40:54.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.067+0000 7fc1c58b1640 1 -- 172.21.15.118:0/2110915853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 msgr2=0x7fc1c0103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.067+0000 7fc1c58b1640 1 --2- 172.21.15.118:0/2110915853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 0x7fc1c0103060 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009880 tx=0x7fc1b402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.067+0000 7fc1c58b1640 1 -- 172.21.15.118:0/2110915853 shutdown_connections 2024-09-21T11:40:54.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.067+0000 7fc1c58b1640 1 --2- 172.21.15.118:0/2110915853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 0x7fc1c0103060 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.067+0000 7fc1c58b1640 1 --2- 172.21.15.118:0/2110915853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1c00ffc00 0x7fc1c0100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.067+0000 7fc1c58b1640 1 -- 172.21.15.118:0/2110915853 >> 172.21.15.118:0/2110915853 conn(0x7fc1c00fb750 msgr2=0x7fc1c00fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:54.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.067+0000 7fc1c58b1640 1 -- 172.21.15.118:0/2110915853 shutdown_connections 2024-09-21T11:40:54.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.067+0000 7fc1c58b1640 1 -- 172.21.15.118:0/2110915853 wait complete. 2024-09-21T11:40:54.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.068+0000 7fc1c58b1640 1 Processor -- start 2024-09-21T11:40:54.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.068+0000 7fc1c58b1640 1 -- start start 2024-09-21T11:40:54.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.068+0000 7fc1c58b1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1c00ffc00 0x7fc1c01974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:54.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.068+0000 7fc1c58b1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 0x7fc1c01979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:54.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.068+0000 7fc1c58b1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c010a760 con 0x7fc1c0102be0 2024-09-21T11:40:54.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.068+0000 7fc1c58b1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c010a5e0 con 0x7fc1c00ffc00 2024-09-21T11:40:54.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.068+0000 7fc1be7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 0x7fc1c01979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:54.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1be7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 0x7fc1c01979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43892/0 (socket says 172.21.15.118:43892) 2024-09-21T11:40:54.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1be7fc640 1 -- 172.21.15.118:0/928186464 learned_addr learned my addr 172.21.15.118:0/928186464 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:54.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1beffd640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1c00ffc00 0x7fc1c01974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:54.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1be7fc640 1 -- 172.21.15.118:0/928186464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1c00ffc00 msgr2=0x7fc1c01974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1be7fc640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1c00ffc00 0x7fc1c01974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1be7fc640 1 -- 172.21.15.118:0/928186464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c0198060 con 0x7fc1c0102be0 2024-09-21T11:40:54.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1be7fc640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 0x7fc1c01979e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4006010 tx=0x7fc1b4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:54.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1c48af640 1 -- 172.21.15.118:0/928186464 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1b403f070 con 0x7fc1c0102be0 2024-09-21T11:40:54.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1c48af640 1 -- 172.21.15.118:0/928186464 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1b40049d0 con 0x7fc1c0102be0 2024-09-21T11:40:54.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.069+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c019ca40 con 0x7fc1c0102be0 2024-09-21T11:40:54.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.070+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c019cf10 con 0x7fc1c0102be0 2024-09-21T11:40:54.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.070+0000 7fc1c48af640 1 -- 172.21.15.118:0/928186464 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1b4035030 con 0x7fc1c0102be0 2024-09-21T11:40:54.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.071+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c0100000 con 0x7fc1c0102be0 2024-09-21T11:40:54.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.072+0000 7fc1c48af640 1 -- 172.21.15.118:0/928186464 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7fc1b4042070 con 0x7fc1c0102be0 2024-09-21T11:40:54.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.072+0000 7fc1c48af640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc1a807b050 0x7fc1a807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:54.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.072+0000 7fc1c48af640 1 -- 172.21.15.118:0/928186464 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fc1b40bee50 con 0x7fc1c0102be0 2024-09-21T11:40:54.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.072+0000 7fc1beffd640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc1a807b050 0x7fc1a807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:54.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.073+0000 7fc1beffd640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc1a807b050 0x7fc1a807d510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0069930 tx=0x7fc1b0005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:54.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.077+0000 7fc1c48af640 1 -- 172.21.15.118:0/928186464 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc1b408a1d0 con 0x7fc1c0102be0 2024-09-21T11:40:54.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.325+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc1c0062630 con 0x7fc1a807b050 2024-09-21T11:40:54.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.327+0000 7fc1c48af640 1 -- 172.21.15.118:0/928186464 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7fc1c0062630 con 0x7fc1a807b050 2024-09-21T11:40:54.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.329+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc1a807b050 msgr2=0x7fc1a807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.329+0000 7fc1c58b1640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc1a807b050 0x7fc1a807d510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0069930 tx=0x7fc1b0005f90 comp rx=0 tx=0).stop 2024-09-21T11:40:54.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.329+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 msgr2=0x7fc1c01979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.329+0000 7fc1c58b1640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 0x7fc1c01979e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4006010 tx=0x7fc1b4004570 comp rx=0 tx=0).stop 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.329+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 shutdown_connections 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.329+0000 7fc1c58b1640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc1a807b050 0x7fc1a807d510 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.329+0000 7fc1c58b1640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1c0102be0 0x7fc1c01979e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.329+0000 7fc1c58b1640 1 --2- 172.21.15.118:0/928186464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1c00ffc00 0x7fc1c01974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.329+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 >> 172.21.15.118:0/928186464 conn(0x7fc1c00fb750 msgr2=0x7fc1c0106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.330+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 shutdown_connections 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.330+0000 7fc1c58b1640 1 -- 172.21.15.118:0/928186464 wait complete. 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.426+0000 7fca774d8640 1 -- 172.21.15.118:0/1959304764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 msgr2=0x7fca70075050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.426+0000 7fca774d8640 1 --2- 172.21.15.118:0/1959304764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 0x7fca70075050 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009880 tx=0x7fca6c02a530 comp rx=0 tx=0).stop 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.426+0000 7fca774d8640 1 -- 172.21.15.118:0/1959304764 shutdown_connections 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.426+0000 7fca774d8640 1 --2- 172.21.15.118:0/1959304764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 0x7fca70075050 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.426+0000 7fca774d8640 1 --2- 172.21.15.118:0/1959304764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca700761c0 0x7fca70074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.426+0000 7fca774d8640 1 -- 172.21.15.118:0/1959304764 >> 172.21.15.118:0/1959304764 conn(0x7fca700fd140 msgr2=0x7fca700ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:54.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.426+0000 7fca774d8640 1 -- 172.21.15.118:0/1959304764 shutdown_connections 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.426+0000 7fca774d8640 1 -- 172.21.15.118:0/1959304764 wait complete. 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.426+0000 7fca774d8640 1 Processor -- start 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca774d8640 1 -- start start 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca774d8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 0x7fca70199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca774d8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca700761c0 0x7fca70199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca774d8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fca7010c990 con 0x7fca70074bf0 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca774d8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fca7010c810 con 0x7fca700761c0 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca75274640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 0x7fca70199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca75274640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 0x7fca70199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43912/0 (socket says 172.21.15.118:43912) 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca75274640 1 -- 172.21.15.118:0/458847628 learned_addr learned my addr 172.21.15.118:0/458847628 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca74a73640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca700761c0 0x7fca70199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca75274640 1 -- 172.21.15.118:0/458847628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca700761c0 msgr2=0x7fca70199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca75274640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca700761c0 0x7fca70199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca75274640 1 -- 172.21.15.118:0/458847628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7019a240 con 0x7fca70074bf0 2024-09-21T11:40:54.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca75274640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 0x7fca70199680 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca6000d8d0 tx=0x7fca6000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca667fc640 1 -- 172.21.15.118:0/458847628 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca60017030 con 0x7fca70074bf0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca667fc640 1 -- 172.21.15.118:0/458847628 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca60004020 con 0x7fca70074bf0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca667fc640 1 -- 172.21.15.118:0/458847628 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca600047a0 con 0x7fca70074bf0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7019ec80 con 0x7fca70074bf0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.427+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7019f190 con 0x7fca70074bf0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.428+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7010d170 con 0x7fca70074bf0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.429+0000 7fca667fc640 1 -- 172.21.15.118:0/458847628 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7fca600041d0 con 0x7fca70074bf0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.429+0000 7fca667fc640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca5c07b050 0x7fca5c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.430+0000 7fca667fc640 1 -- 172.21.15.118:0/458847628 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fca60018070 con 0x7fca70074bf0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.430+0000 7fca74a73640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca5c07b050 0x7fca5c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.430+0000 7fca74a73640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca5c07b050 0x7fca5c07d510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca6c000c00 tx=0x7fca6c0058d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:54.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.434+0000 7fca667fc640 1 -- 172.21.15.118:0/458847628 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fca600694a0 con 0x7fca70074bf0 2024-09-21T11:40:54.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.710+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fca70062630 con 0x7fca5c07b050 2024-09-21T11:40:54.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.729+0000 7fca667fc640 1 -- 172.21.15.118:0/458847628 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fca70062630 con 0x7fca5c07b050 2024-09-21T11:40:54.731 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:40:54.731 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (8m) 40s ago 9m 22.8M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:40:54.731 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (114s) 40s ago 10m 8404k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:40:54.731 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (74s) 46s ago 9m 7964k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (9m) 40s ago 9m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (9m) 46s ago 9m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (8m) 40s ago 9m 80.0M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (4m) 40s ago 4m 244M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (4m) 40s ago 4m 26.2M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (4m) 46s ago 4m 20.2M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (4m) 46s ago 4m 14.0M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (61s) 40s ago 11m 490M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 starting - - - - 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (11m) 40s ago 11m 55.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (8m) 46s ago 8m 43.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (9m) 40s ago 9m 15.8M - 1.5.0 0da6a335fe13 92cdb77bc8bc 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (9m) 46s ago 8m 15.6M - 1.5.0 0da6a335fe13 1a6e8f960a5b 2024-09-21T11:40:54.732 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (7m) 40s ago 7m 174M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:40:54.733 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (7m) 40s ago 7m 178M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:40:54.733 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (6m) 40s ago 6m 157M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:40:54.733 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (6m) 46s ago 6m 222M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:40:54.733 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (5m) 46s ago 5m 186M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:40:54.733 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (5m) 46s ago 5m 197M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:40:54.733 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 starting - - - - 2024-09-21T11:40:54.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.732+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca5c07b050 msgr2=0x7fca5c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.732+0000 7fca774d8640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca5c07b050 0x7fca5c07d510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca6c000c00 tx=0x7fca6c0058d0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.732+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 msgr2=0x7fca70199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.732+0000 7fca774d8640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 0x7fca70199680 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca6000d8d0 tx=0x7fca6000dd90 comp rx=0 tx=0).stop 2024-09-21T11:40:54.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.732+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 shutdown_connections 2024-09-21T11:40:54.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.732+0000 7fca774d8640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca700761c0 0x7fca70199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.732+0000 7fca774d8640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca5c07b050 0x7fca5c07d510 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.732+0000 7fca774d8640 1 --2- 172.21.15.118:0/458847628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca70074bf0 0x7fca70199680 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.732+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 >> 172.21.15.118:0/458847628 conn(0x7fca700fd140 msgr2=0x7fca70107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:54.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.733+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 shutdown_connections 2024-09-21T11:40:54.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.733+0000 7fca774d8640 1 -- 172.21.15.118:0/458847628 wait complete. 2024-09-21T11:40:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.846+0000 7f7a0ad76640 1 -- 172.21.15.118:0/95142131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 msgr2=0x7f7a041047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.846+0000 7f7a0ad76640 1 --2- 172.21.15.118:0/95142131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 0x7f7a041047c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f79f80098b0 tx=0x7f79f802a4d0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.846+0000 7f7a0ad76640 1 -- 172.21.15.118:0/95142131 shutdown_connections 2024-09-21T11:40:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.846+0000 7f7a0ad76640 1 --2- 172.21.15.118:0/95142131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a04104d00 0x7f7a041070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.846+0000 7f7a0ad76640 1 --2- 172.21.15.118:0/95142131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 0x7f7a041047c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.846+0000 7f7a0ad76640 1 -- 172.21.15.118:0/95142131 >> 172.21.15.118:0/95142131 conn(0x7f7a040fbff0 msgr2=0x7f7a040fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.846+0000 7f7a0ad76640 1 -- 172.21.15.118:0/95142131 shutdown_connections 2024-09-21T11:40:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.846+0000 7f7a0ad76640 1 -- 172.21.15.118:0/95142131 wait complete. 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a0ad76640 1 Processor -- start 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a0ad76640 1 -- start start 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a0ad76640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 0x7f7a04197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a0ad76640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a04104d00 0x7f7a04197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a0ad76640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0410a7a0 con 0x7f7a041023d0 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a0ad76640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0410a620 con 0x7f7a04104d00 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a08b12640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 0x7f7a04197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a08b12640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 0x7f7a04197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43934/0 (socket says 172.21.15.118:43934) 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a08b12640 1 -- 172.21.15.118:0/1654744497 learned_addr learned my addr 172.21.15.118:0/1654744497 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.847+0000 7f7a03fff640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a04104d00 0x7f7a04197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.848+0000 7f7a08b12640 1 -- 172.21.15.118:0/1654744497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a04104d00 msgr2=0x7f7a04197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.848+0000 7f7a08b12640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a04104d00 0x7f7a04197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.848+0000 7f7a08b12640 1 -- 172.21.15.118:0/1654744497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a041980c0 con 0x7f7a041023d0 2024-09-21T11:40:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.848+0000 7f7a08b12640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 0x7f7a04197500 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009880 tx=0x7f79f80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:54.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.848+0000 7f7a01ffb640 1 -- 172.21.15.118:0/1654744497 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79f803f070 con 0x7f7a041023d0 2024-09-21T11:40:54.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.848+0000 7f7a01ffb640 1 -- 172.21.15.118:0/1654744497 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79f8004a50 con 0x7f7a041023d0 2024-09-21T11:40:54.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.848+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0419caa0 con 0x7f7a041023d0 2024-09-21T11:40:54.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.848+0000 7f7a01ffb640 1 -- 172.21.15.118:0/1654744497 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79f8035030 con 0x7f7a041023d0 2024-09-21T11:40:54.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.848+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0419d030 con 0x7f7a041023d0 2024-09-21T11:40:54.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.849+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a041027b0 con 0x7f7a041023d0 2024-09-21T11:40:54.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.850+0000 7f7a01ffb640 1 -- 172.21.15.118:0/1654744497 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f79f8042070 con 0x7f7a041023d0 2024-09-21T11:40:54.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.851+0000 7f7a01ffb640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79f407b050 0x7f79f407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:54.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.851+0000 7f7a01ffb640 1 -- 172.21.15.118:0/1654744497 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f79f80bee10 con 0x7f7a041023d0 2024-09-21T11:40:54.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.851+0000 7f7a03fff640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79f407b050 0x7f79f407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:54.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.852+0000 7f7a03fff640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79f407b050 0x7f79f407d510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7a041989b0 tx=0x7f79f000b410 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:54.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:54.859+0000 7f7a01ffb640 1 -- 172.21.15.118:0/1654744497 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f79f808a1f0 con 0x7f7a041023d0 2024-09-21T11:40:55.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.163+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7a0419d490 con 0x7f7a041023d0 2024-09-21T11:40:55.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.163+0000 7f7a01ffb640 1 -- 172.21.15.118:0/1654744497 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f79f808f0a0 con 0x7f7a041023d0 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:40:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:40:55.167 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:40:55.167 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:40:55.167 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T11:40:55.167 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:40:55.167 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:40:55.167 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:40:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79f407b050 msgr2=0x7f79f407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79f407b050 0x7f79f407d510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7a041989b0 tx=0x7f79f000b410 comp rx=0 tx=0).stop 2024-09-21T11:40:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 msgr2=0x7f7a04197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 0x7f7a04197500 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009880 tx=0x7f79f80045c0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 shutdown_connections 2024-09-21T11:40:55.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a04104d00 0x7f7a04197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79f407b050 0x7f79f407d510 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 --2- 172.21.15.118:0/1654744497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a041023d0 0x7f7a04197500 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 >> 172.21.15.118:0/1654744497 conn(0x7f7a040fbff0 msgr2=0x7f7a040fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:55.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 shutdown_connections 2024-09-21T11:40:55.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.166+0000 7f7a0ad76640 1 -- 172.21.15.118:0/1654744497 wait complete. 2024-09-21T11:40:55.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.258+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3550420818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90101790 msgr2=0x7f8e90101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:55.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.258+0000 7f8e95b9f640 1 --2- 172.21.15.118:0/3550420818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90101790 0x7f8e90101b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009880 tx=0x7f8e8402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.259+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3550420818 shutdown_connections 2024-09-21T11:40:55.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.259+0000 7f8e95b9f640 1 --2- 172.21.15.118:0/3550420818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e90102990 0x7f8e90102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.259+0000 7f8e95b9f640 1 --2- 172.21.15.118:0/3550420818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90101790 0x7f8e90101b90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.259+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3550420818 >> 172.21.15.118:0/3550420818 conn(0x7f8e900fcf20 msgr2=0x7f8e900ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:55.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.259+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3550420818 shutdown_connections 2024-09-21T11:40:55.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.259+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3550420818 wait complete. 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e95b9f640 1 Processor -- start 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e95b9f640 1 -- start start 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e95b9f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e90101790 0x7f8e901972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e95b9f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90102990 0x7f8e90197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e95b9f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9010a5b0 con 0x7f8e90102990 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e95b9f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9010a430 con 0x7f8e90101790 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e8ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90102990 0x7f8e90197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e94b9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e90101790 0x7f8e901972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e8ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90102990 0x7f8e90197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43948/0 (socket says 172.21.15.118:43948) 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e8ffff640 1 -- 172.21.15.118:0/3564630920 learned_addr learned my addr 172.21.15.118:0/3564630920 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:40:55.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e94b9d640 1 -- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90102990 msgr2=0x7f8e90197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:55.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e94b9d640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90102990 0x7f8e90197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e94b9d640 1 -- 172.21.15.118:0/3564630920 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e90197e90 con 0x7f8e90101790 2024-09-21T11:40:55.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.260+0000 7f8e8ffff640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90102990 0x7f8e90197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T11:40:55.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.261+0000 7f8e94b9d640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e90101790 0x7f8e901972d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009230 tx=0x7f8e840045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:55.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.261+0000 7f8e8dffb640 1 -- 172.21.15.118:0/3564630920 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e8403f070 con 0x7f8e90101790 2024-09-21T11:40:55.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.261+0000 7f8e8dffb640 1 -- 172.21.15.118:0/3564630920 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e840049d0 con 0x7f8e90101790 2024-09-21T11:40:55.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.261+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9019c870 con 0x7f8e90101790 2024-09-21T11:40:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.261+0000 7f8e8dffb640 1 -- 172.21.15.118:0/3564630920 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e84035030 con 0x7f8e90101790 2024-09-21T11:40:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.261+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e9019ce00 con 0x7f8e90101790 2024-09-21T11:40:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.262+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e90101b90 con 0x7f8e90101790 2024-09-21T11:40:55.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.264+0000 7f8e8dffb640 1 -- 172.21.15.118:0/3564630920 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f8e84042070 con 0x7f8e90101790 2024-09-21T11:40:55.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.264+0000 7f8e8dffb640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e8007b050 0x7f8e8007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:40:55.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.264+0000 7f8e8dffb640 1 -- 172.21.15.118:0/3564630920 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f8e840bebc0 con 0x7f8e90101790 2024-09-21T11:40:55.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.264+0000 7f8e8ffff640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e8007b050 0x7f8e8007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:40:55.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.265+0000 7f8e8ffff640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e8007b050 0x7f8e8007d510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8e90198780 tx=0x7f8e7c005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:40:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.269+0000 7f8e8dffb640 1 -- 172.21.15.118:0/3564630920 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8e84089fa0 con 0x7f8e90101790 2024-09-21T11:40:55.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:55 smithi118 ceph-mon[28757]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:55.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:55 smithi118 ceph-mon[28757]: pgmap v28: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 224 op/s 2024-09-21T11:40:55.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:55 smithi118 ceph-mon[28757]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:55.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:55.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:55.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:55 smithi149 ceph-mon[36123]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:55 smithi149 ceph-mon[36123]: pgmap v28: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 224 op/s 2024-09-21T11:40:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:55 smithi149 ceph-mon[36123]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:55.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.524+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8e900626f0 con 0x7f8e8007b050 2024-09-21T11:40:55.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.525+0000 7f8e8dffb640 1 -- 172.21.15.118:0/3564630920 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f8e900626f0 con 0x7f8e8007b050 2024-09-21T11:40:55.527 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:40:55.527 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:40:55.528 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:40:55.528 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:40:55.528 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:40:55.528 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:40:55.528 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:40:55.528 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T11:40:55.528 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T11:40:55.528 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:40:55.528 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:40:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e8007b050 msgr2=0x7f8e8007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e8007b050 0x7f8e8007d510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8e90198780 tx=0x7f8e7c005f90 comp rx=0 tx=0).stop 2024-09-21T11:40:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e90101790 msgr2=0x7f8e901972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:40:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e90101790 0x7f8e901972d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009230 tx=0x7f8e840045e0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 shutdown_connections 2024-09-21T11:40:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e8007b050 0x7f8e8007d510 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e90102990 0x7f8e90197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 --2- 172.21.15.118:0/3564630920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e90101790 0x7f8e901972d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:40:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 >> 172.21.15.118:0/3564630920 conn(0x7f8e900fcf20 msgr2=0x7f8e90105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:40:55.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 shutdown_connections 2024-09-21T11:40:55.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:40:55.529+0000 7f8e95b9f640 1 -- 172.21.15.118:0/3564630920 wait complete. 2024-09-21T11:40:56.113 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-21T11:40:56.113 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-21T11:40:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:56 smithi118 ceph-mon[28757]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:56 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1654744497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:40:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:56 smithi118 ceph-mon[28757]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:56 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:56 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:56.376 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:56 smithi149 ceph-mon[36123]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:56.377 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:56 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1654744497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:40:56.377 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:56 smithi149 ceph-mon[36123]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:40:56.377 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:56 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:56.377 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:56 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:56.423 DEBUG:teuthology.parallel:result is None 2024-09-21T11:40:57.337 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:57 smithi149 ceph-mon[36123]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 340 op/s 2024-09-21T11:40:57.564 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:57 smithi118 ceph-mon[28757]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 340 op/s 2024-09-21T11:40:58.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:58 smithi149 ceph-mon[36123]: Standby manager daemon smithi149.xjglai restarted 2024-09-21T11:40:58.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:58 smithi149 ceph-mon[36123]: Standby manager daemon smithi149.xjglai started 2024-09-21T11:40:58.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:58 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/1107783219' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/crt"}]: dispatch 2024-09-21T11:40:58.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:58 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/1107783219' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:40:58.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:58 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/1107783219' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/key"}]: dispatch 2024-09-21T11:40:58.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:58 smithi149 ceph-mon[36123]: from='mgr.? 172.21.15.149:0/1107783219' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:40:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:58 smithi118 ceph-mon[28757]: Standby manager daemon smithi149.xjglai restarted 2024-09-21T11:40:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:58 smithi118 ceph-mon[28757]: Standby manager daemon smithi149.xjglai started 2024-09-21T11:40:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:58 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/1107783219' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/crt"}]: dispatch 2024-09-21T11:40:58.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:58 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/1107783219' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T11:40:58.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:58 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/1107783219' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.xjglai/key"}]: dispatch 2024-09-21T11:40:58.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:58 smithi118 ceph-mon[28757]: from='mgr.? 172.21.15.149:0/1107783219' entity='mgr.smithi149.xjglai' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T11:40:59.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:59 smithi149 ceph-mon[36123]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 263 op/s 2024-09-21T11:40:59.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:59 smithi149 ceph-mon[36123]: mgrmap e32: smithi118.djbwyn(active, since 54s), standbys: smithi149.xjglai 2024-09-21T11:40:59.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:59 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:59.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:40:59 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:59.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:59 smithi118 ceph-mon[28757]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 263 op/s 2024-09-21T11:40:59.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:59 smithi118 ceph-mon[28757]: mgrmap e32: smithi118.djbwyn(active, since 54s), standbys: smithi149.xjglai 2024-09-21T11:40:59.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:59 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:40:59.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:40:59 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:01.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:01 smithi149 ceph-mon[36123]: pgmap v31: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.6 MiB/s wr, 283 op/s 2024-09-21T11:41:01.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:01 smithi118 ceph-mon[28757]: pgmap v31: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.6 MiB/s wr, 283 op/s 2024-09-21T11:41:03.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:03 smithi149 ceph-mon[36123]: pgmap v32: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.7 MiB/s wr, 271 op/s 2024-09-21T11:41:03.547 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:03 smithi118 ceph-mon[28757]: pgmap v32: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.7 MiB/s wr, 271 op/s 2024-09-21T11:41:05.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:05 smithi149 ceph-mon[36123]: pgmap v33: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 167 op/s 2024-09-21T11:41:05.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:05 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:41:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:05 smithi118 ceph-mon[28757]: pgmap v33: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 167 op/s 2024-09-21T11:41:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:05 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:41:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: pgmap v34: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 230 op/s 2024-09-21T11:41:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:41:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:41:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi118.djbwyn"}]: dispatch 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi118.djbwyn"}]': finished 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.xjglai"}]: dispatch 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.xjglai"}]': finished 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:07.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:07.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:07.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:07 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: pgmap v34: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 230 op/s 2024-09-21T11:41:08.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:41:08.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:41:08.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi118.djbwyn"}]: dispatch 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi118.djbwyn"}]': finished 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.xjglai"}]: dispatch 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.xjglai"}]': finished 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:08.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:08.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:08.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:07 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:08 smithi149 ceph-mon[36123]: Upgrade: Setting container_image for all mgr 2024-09-21T11:41:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:08 smithi149 ceph-mon[36123]: Upgrade: Setting container_image for all rgw 2024-09-21T11:41:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:08 smithi149 ceph-mon[36123]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T11:41:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:08 smithi149 ceph-mon[36123]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T11:41:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:08 smithi149 ceph-mon[36123]: Upgrade: Setting container_image for all iscsi 2024-09-21T11:41:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:08 smithi149 ceph-mon[36123]: Upgrade: Setting container_image for all nfs 2024-09-21T11:41:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:08 smithi149 ceph-mon[36123]: Upgrade: Setting container_image for all nvmeof 2024-09-21T11:41:09.041 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:08 smithi118 ceph-mon[28757]: Upgrade: Setting container_image for all mgr 2024-09-21T11:41:09.041 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:08 smithi118 ceph-mon[28757]: Upgrade: Setting container_image for all rgw 2024-09-21T11:41:09.041 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:08 smithi118 ceph-mon[28757]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T11:41:09.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:08 smithi118 ceph-mon[28757]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T11:41:09.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:08 smithi118 ceph-mon[28757]: Upgrade: Setting container_image for all iscsi 2024-09-21T11:41:09.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:08 smithi118 ceph-mon[28757]: Upgrade: Setting container_image for all nfs 2024-09-21T11:41:09.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:08 smithi118 ceph-mon[28757]: Upgrade: Setting container_image for all nvmeof 2024-09-21T11:41:09.043 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-21T11:41:09.043 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T11:41:09.362 DEBUG:teuthology.parallel:result is None 2024-09-21T11:41:09.363 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T11:41:09.397 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T11:41:09.397 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T11:41:09.433 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T11:41:09.434 DEBUG:teuthology.parallel:result is None 2024-09-21T11:41:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:09 smithi149 ceph-mon[36123]: pgmap v35: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 980 KiB/s wr, 114 op/s 2024-09-21T11:41:09.979 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:09 smithi118 ceph-mon[28757]: pgmap v35: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 980 KiB/s wr, 114 op/s 2024-09-21T11:41:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:10 smithi118 ceph-mon[28757]: Upgrade: Updating node-exporter.smithi118 (1/2) 2024-09-21T11:41:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:10 smithi118 ceph-mon[28757]: Deploying daemon node-exporter.smithi118 on smithi118 2024-09-21T11:41:10.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:10 smithi149 ceph-mon[36123]: Upgrade: Updating node-exporter.smithi118 (1/2) 2024-09-21T11:41:10.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:10 smithi149 ceph-mon[36123]: Deploying daemon node-exporter.smithi118 on smithi118 2024-09-21T11:41:11.921 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:11 smithi118 ceph-mon[28757]: pgmap v36: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-21T11:41:11.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:11 smithi149 ceph-mon[36123]: pgmap v36: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-21T11:41:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:13 smithi118 ceph-mon[28757]: pgmap v37: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 165 op/s 2024-09-21T11:41:13.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:13 smithi149 ceph-mon[36123]: pgmap v37: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 165 op/s 2024-09-21T11:41:15.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:15 smithi149 ceph-mon[36123]: pgmap v38: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 879 KiB/s wr, 134 op/s 2024-09-21T11:41:15.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:15 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:15.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:15 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:15 smithi118 ceph-mon[28757]: pgmap v38: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 879 KiB/s wr, 134 op/s 2024-09-21T11:41:15.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:15 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:15.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:15 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:17.646 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:17 smithi149 ceph-mon[36123]: Upgrade: Updating node-exporter.smithi149 (2/2) 2024-09-21T11:41:17.646 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:17 smithi149 ceph-mon[36123]: Deploying daemon node-exporter.smithi149 on smithi149 2024-09-21T11:41:17.647 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:17 smithi149 ceph-mon[36123]: pgmap v39: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 917 KiB/s wr, 151 op/s 2024-09-21T11:41:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:17 smithi118 ceph-mon[28757]: Upgrade: Updating node-exporter.smithi149 (2/2) 2024-09-21T11:41:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:17 smithi118 ceph-mon[28757]: Deploying daemon node-exporter.smithi149 on smithi149 2024-09-21T11:41:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:17 smithi118 ceph-mon[28757]: pgmap v39: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 917 KiB/s wr, 151 op/s 2024-09-21T11:41:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:19 smithi149 ceph-mon[36123]: pgmap v40: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 476 KiB/s wr, 88 op/s 2024-09-21T11:41:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:19 smithi118 ceph-mon[28757]: pgmap v40: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 476 KiB/s wr, 88 op/s 2024-09-21T11:41:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:20 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:41:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:20 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:20 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:20 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:20 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:41:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:20 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:20 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:20 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:21.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:21 smithi149 ceph-mon[36123]: pgmap v41: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 476 KiB/s wr, 88 op/s 2024-09-21T11:41:21.751 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:21 smithi118 ceph-mon[28757]: pgmap v41: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 476 KiB/s wr, 88 op/s 2024-09-21T11:41:23.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:23 smithi149 ceph-mon[36123]: pgmap v42: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 103 KiB/s wr, 55 op/s 2024-09-21T11:41:23.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:23 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:23.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:23 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:23 smithi118 ceph-mon[28757]: pgmap v42: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 103 KiB/s wr, 55 op/s 2024-09-21T11:41:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:23 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:23 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:24.798 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:24 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:24.799 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:24 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:24.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:24 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:24.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:24 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.630+0000 7f941fba8640 1 -- 172.21.15.118:0/2432368948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 msgr2=0x7f94181030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.630+0000 7f941fba8640 1 --2- 172.21.15.118:0/2432368948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 0x7f94181030a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9408009880 tx=0x7f940802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.630+0000 7f941fba8640 1 -- 172.21.15.118:0/2432368948 shutdown_connections 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.630+0000 7f941fba8640 1 --2- 172.21.15.118:0/2432368948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 0x7f94181030a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.630+0000 7f941fba8640 1 --2- 172.21.15.118:0/2432368948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180ffc40 0x7f9418100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.630+0000 7f941fba8640 1 -- 172.21.15.118:0/2432368948 >> 172.21.15.118:0/2432368948 conn(0x7f94180fb7b0 msgr2=0x7f94180fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.630+0000 7f941fba8640 1 -- 172.21.15.118:0/2432368948 shutdown_connections 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.630+0000 7f941fba8640 1 -- 172.21.15.118:0/2432368948 wait complete. 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941fba8640 1 Processor -- start 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941fba8640 1 -- start start 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941fba8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180ffc40 0x7f9418102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:25.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941fba8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 0x7f9418100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941fba8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f941810a7a0 con 0x7f9418102c20 2024-09-21T11:41:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941fba8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f941810a620 con 0x7f94180ffc40 2024-09-21T11:41:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941d143640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 0x7f9418100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941d143640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 0x7f9418100bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36180/0 (socket says 172.21.15.118:36180) 2024-09-21T11:41:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941d143640 1 -- 172.21.15.118:0/4150365803 learned_addr learned my addr 172.21.15.118:0/4150365803 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.631+0000 7f941d944640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180ffc40 0x7f9418102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.632+0000 7f941d143640 1 -- 172.21.15.118:0/4150365803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180ffc40 msgr2=0x7f9418102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.632+0000 7f941d143640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180ffc40 0x7f9418102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.632+0000 7f941d143640 1 -- 172.21.15.118:0/4150365803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9418101110 con 0x7f9418102c20 2024-09-21T11:41:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.632+0000 7f941d143640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 0x7f9418100bd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9408006010 tx=0x7f94080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.632+0000 7f940effd640 1 -- 172.21.15.118:0/4150365803 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f940803f070 con 0x7f9418102c20 2024-09-21T11:41:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.632+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94181013a0 con 0x7f9418102c20 2024-09-21T11:41:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.632+0000 7f940effd640 1 -- 172.21.15.118:0/4150365803 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9408004ac0 con 0x7f9418102c20 2024-09-21T11:41:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.632+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94181018d0 con 0x7f9418102c20 2024-09-21T11:41:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.632+0000 7f940effd640 1 -- 172.21.15.118:0/4150365803 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9408035030 con 0x7f9418102c20 2024-09-21T11:41:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.633+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9418100040 con 0x7f9418102c20 2024-09-21T11:41:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.634+0000 7f940effd640 1 -- 172.21.15.118:0/4150365803 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7f9408042070 con 0x7f9418102c20 2024-09-21T11:41:25.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.634+0000 7f940effd640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f940407b0b0 0x7f940407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:25.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.635+0000 7f940effd640 1 -- 172.21.15.118:0/4150365803 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f94080beca0 con 0x7f9418102c20 2024-09-21T11:41:25.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.635+0000 7f941d944640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f940407b0b0 0x7f940407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:25.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.635+0000 7f941d944640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f940407b0b0 0x7f940407d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9414005fd0 tx=0x7f941400b410 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:25.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.639+0000 7f940effd640 1 -- 172.21.15.118:0/4150365803 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f94080c3070 con 0x7f9418102c20 2024-09-21T11:41:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:25 smithi118 ceph-mon[28757]: pgmap v43: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-21T11:41:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:25 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:25 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:25.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.840+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9418062630 con 0x7f940407b0b0 2024-09-21T11:41:25.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.842+0000 7f940effd640 1 -- 172.21.15.118:0/4150365803 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f9418062630 con 0x7f940407b0b0 2024-09-21T11:41:25.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f940407b0b0 msgr2=0x7f940407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:25.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f940407b0b0 0x7f940407d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9414005fd0 tx=0x7f941400b410 comp rx=0 tx=0).stop 2024-09-21T11:41:25.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 msgr2=0x7f9418100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:25.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 0x7f9418100bd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9408006010 tx=0x7f94080046c0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 shutdown_connections 2024-09-21T11:41:25.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f940407b0b0 0x7f940407d570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9418102c20 0x7f9418100bd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 --2- 172.21.15.118:0/4150365803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94180ffc40 0x7f9418102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 >> 172.21.15.118:0/4150365803 conn(0x7f94180fb7b0 msgr2=0x7f9418106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:25.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 shutdown_connections 2024-09-21T11:41:25.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.844+0000 7f941fba8640 1 -- 172.21.15.118:0/4150365803 wait complete. 2024-09-21T11:41:25.854 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:41:25.914 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:25 smithi149 ceph-mon[36123]: pgmap v43: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-21T11:41:25.915 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:25 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:25.915 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:25 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:25.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.931+0000 7f461f84b640 1 -- 172.21.15.118:0/3531948075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 msgr2=0x7f4618100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:25.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.931+0000 7f461f84b640 1 --2- 172.21.15.118:0/3531948075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 0x7f4618100c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4608009880 tx=0x7f460802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.931+0000 7f461f84b640 1 -- 172.21.15.118:0/3531948075 shutdown_connections 2024-09-21T11:41:25.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.931+0000 7f461f84b640 1 --2- 172.21.15.118:0/3531948075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4618101a40 0x7f4618101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.931+0000 7f461f84b640 1 --2- 172.21.15.118:0/3531948075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 0x7f4618100c40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.931+0000 7f461f84b640 1 -- 172.21.15.118:0/3531948075 >> 172.21.15.118:0/3531948075 conn(0x7f46180fbff0 msgr2=0x7f46180fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:25.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.931+0000 7f461f84b640 1 -- 172.21.15.118:0/3531948075 shutdown_connections 2024-09-21T11:41:25.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.931+0000 7f461f84b640 1 -- 172.21.15.118:0/3531948075 wait complete. 2024-09-21T11:41:25.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461f84b640 1 Processor -- start 2024-09-21T11:41:25.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461f84b640 1 -- start start 2024-09-21T11:41:25.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461f84b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 0x7f46181963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:25.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461f84b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4618101a40 0x7f4618196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461f84b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4618109680 con 0x7f4618100840 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461f84b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4618109500 con 0x7f4618101a40 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461d5e7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 0x7f46181963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461d5e7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 0x7f46181963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36204/0 (socket says 172.21.15.118:36204) 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461d5e7640 1 -- 172.21.15.118:0/3501362910 learned_addr learned my addr 172.21.15.118:0/3501362910 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461cde6640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4618101a40 0x7f4618196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461d5e7640 1 -- 172.21.15.118:0/3501362910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4618101a40 msgr2=0x7f4618196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461d5e7640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4618101a40 0x7f4618196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.932+0000 7f461d5e7640 1 -- 172.21.15.118:0/3501362910 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4618196f80 con 0x7f4618100840 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.933+0000 7f461d5e7640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 0x7f46181963c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4608009230 tx=0x7f46080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.933+0000 7f460e7fc640 1 -- 172.21.15.118:0/3501362910 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4608035070 con 0x7f4618100840 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.933+0000 7f460e7fc640 1 -- 172.21.15.118:0/3501362910 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46080035f0 con 0x7f4618100840 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.933+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4618069b30 con 0x7f4618100840 2024-09-21T11:41:25.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.933+0000 7f460e7fc640 1 -- 172.21.15.118:0/3501362910 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46080318c0 con 0x7f4618100840 2024-09-21T11:41:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.933+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461806a0c0 con 0x7f4618100840 2024-09-21T11:41:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.934+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4618100c40 con 0x7f4618100840 2024-09-21T11:41:25.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.935+0000 7f460e7fc640 1 -- 172.21.15.118:0/3501362910 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7f4608031b70 con 0x7f4618100840 2024-09-21T11:41:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.935+0000 7f460e7fc640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f460407b050 0x7f460407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.935+0000 7f460e7fc640 1 -- 172.21.15.118:0/3501362910 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f460803e070 con 0x7f4618100840 2024-09-21T11:41:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.935+0000 7f461cde6640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f460407b050 0x7f460407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:25.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.936+0000 7f461cde6640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f460407b050 0x7f460407d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4618197870 tx=0x7f4614005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:25.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:25.940+0000 7f460e7fc640 1 -- 172.21.15.118:0/3501362910 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f460808bb20 con 0x7f4618100840 2024-09-21T11:41:26.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.141+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f461806a3d0 con 0x7f460407b050 2024-09-21T11:41:26.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.143+0000 7f460e7fc640 1 -- 172.21.15.118:0/3501362910 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f461806a3d0 con 0x7f460407b050 2024-09-21T11:41:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f460407b050 msgr2=0x7f460407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f460407b050 0x7f460407d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4618197870 tx=0x7f4614005f90 comp rx=0 tx=0).stop 2024-09-21T11:41:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 msgr2=0x7f46181963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 0x7f46181963c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4608009230 tx=0x7f46080045e0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 shutdown_connections 2024-09-21T11:41:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4618101a40 0x7f4618196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f460407b050 0x7f460407d510 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 --2- 172.21.15.118:0/3501362910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4618100840 0x7f46181963c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 >> 172.21.15.118:0/3501362910 conn(0x7f46180fbff0 msgr2=0x7f4618104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 shutdown_connections 2024-09-21T11:41:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.145+0000 7f461f84b640 1 -- 172.21.15.118:0/3501362910 wait complete. 2024-09-21T11:41:26.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.235+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/713039976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 msgr2=0x7fda9c1047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.235+0000 7fdaa2cb0640 1 --2- 172.21.15.118:0/713039976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 0x7fda9c1047c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fda900098b0 tx=0x7fda9002a4d0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.235+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/713039976 shutdown_connections 2024-09-21T11:41:26.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.235+0000 7fdaa2cb0640 1 --2- 172.21.15.118:0/713039976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda9c104d00 0x7fda9c1070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.235+0000 7fdaa2cb0640 1 --2- 172.21.15.118:0/713039976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 0x7fda9c1047c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.235+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/713039976 >> 172.21.15.118:0/713039976 conn(0x7fda9c0fbff0 msgr2=0x7fda9c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:26.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.235+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/713039976 shutdown_connections 2024-09-21T11:41:26.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.235+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/713039976 wait complete. 2024-09-21T11:41:26.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa2cb0640 1 Processor -- start 2024-09-21T11:41:26.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa2cb0640 1 -- start start 2024-09-21T11:41:26.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa2cb0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 0x7fda9c197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:26.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa2cb0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda9c104d00 0x7fda9c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa2cb0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c10a7c0 con 0x7fda9c1023d0 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa2cb0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c10a640 con 0x7fda9c104d00 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa0a4c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 0x7fda9c197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa0a4c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 0x7fda9c197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36218/0 (socket says 172.21.15.118:36218) 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa0a4c640 1 -- 172.21.15.118:0/2678697109 learned_addr learned my addr 172.21.15.118:0/2678697109 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fda9bfff640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda9c104d00 0x7fda9c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa0a4c640 1 -- 172.21.15.118:0/2678697109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda9c104d00 msgr2=0x7fda9c197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa0a4c640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda9c104d00 0x7fda9c197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fdaa0a4c640 1 -- 172.21.15.118:0/2678697109 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c1980e0 con 0x7fda9c1023d0 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.236+0000 7fda9bfff640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda9c104d00 0x7fda9c197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.237+0000 7fdaa0a4c640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 0x7fda9c197520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fda90009880 tx=0x7fda900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.237+0000 7fda99ffb640 1 -- 172.21.15.118:0/2678697109 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda9003f070 con 0x7fda9c1023d0 2024-09-21T11:41:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.237+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9c19cac0 con 0x7fda9c1023d0 2024-09-21T11:41:26.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.237+0000 7fda99ffb640 1 -- 172.21.15.118:0/2678697109 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda900049d0 con 0x7fda9c1023d0 2024-09-21T11:41:26.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.237+0000 7fda99ffb640 1 -- 172.21.15.118:0/2678697109 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda90035030 con 0x7fda9c1023d0 2024-09-21T11:41:26.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.237+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9c19d050 con 0x7fda9c1023d0 2024-09-21T11:41:26.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.238+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9c1027b0 con 0x7fda9c1023d0 2024-09-21T11:41:26.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.239+0000 7fda99ffb640 1 -- 172.21.15.118:0/2678697109 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7fda90042070 con 0x7fda9c1023d0 2024-09-21T11:41:26.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.240+0000 7fda99ffb640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fda8c07b050 0x7fda8c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:26.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.240+0000 7fda99ffb640 1 -- 172.21.15.118:0/2678697109 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fda900bee00 con 0x7fda9c1023d0 2024-09-21T11:41:26.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.240+0000 7fda9bfff640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fda8c07b050 0x7fda8c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:26.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.240+0000 7fda9bfff640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fda8c07b050 0x7fda8c07d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda9c1989d0 tx=0x7fda88005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:26.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.245+0000 7fda99ffb640 1 -- 172.21.15.118:0/2678697109 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fda9008a1e0 con 0x7fda9c1023d0 2024-09-21T11:41:26.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.432+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fda9c105740 con 0x7fda8c07b050 2024-09-21T11:41:26.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.442+0000 7fda99ffb640 1 -- 172.21.15.118:0/2678697109 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fda9c105740 con 0x7fda8c07b050 2024-09-21T11:41:26.443 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:41:26.443 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (8m) 1s ago 10m 22.4M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:41:26.443 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (2m) 1s ago 10m 8577k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:41:26.443 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (106s) 3s ago 9m 8094k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:41:26.443 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (10m) 1s ago 10m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (9m) 3s ago 9m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (8m) 1s ago 10m 79.6M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (5m) 1s ago 4m 149M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (4m) 1s ago 4m 27.2M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (4m) 3s ago 4m 20.9M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (4m) 3s ago 4m 14.7M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (93s) 1s ago 11m 509M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (34s) 3s ago 9m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (11m) 1s ago 11m 60.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (9m) 3s ago 9m 46.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (12s) 1s ago 10m 7814k - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (6s) 3s ago 9m 3506k - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (8m) 1s ago 8m 203M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:41:26.444 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (7m) 1s ago 7m 227M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:41:26.445 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (7m) 1s ago 7m 183M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:41:26.445 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (6m) 3s ago 6m 258M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:41:26.445 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (6m) 3s ago 6m 210M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:41:26.445 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (6m) 3s ago 6m 205M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:41:26.445 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (40s) 1s ago 9m 53.2M - 2.43.0 a07b618ecd1d 81058b9ab52b 2024-09-21T11:41:26.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.444+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fda8c07b050 msgr2=0x7fda8c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.444+0000 7fdaa2cb0640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fda8c07b050 0x7fda8c07d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda9c1989d0 tx=0x7fda88005f90 comp rx=0 tx=0).stop 2024-09-21T11:41:26.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.444+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 msgr2=0x7fda9c197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.444+0000 7fdaa2cb0640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 0x7fda9c197520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fda90009880 tx=0x7fda900045e0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.445+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 shutdown_connections 2024-09-21T11:41:26.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.445+0000 7fdaa2cb0640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda9c104d00 0x7fda9c197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.445+0000 7fdaa2cb0640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fda8c07b050 0x7fda8c07d510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.445+0000 7fdaa2cb0640 1 --2- 172.21.15.118:0/2678697109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda9c1023d0 0x7fda9c197520 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.445+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 >> 172.21.15.118:0/2678697109 conn(0x7fda9c0fbff0 msgr2=0x7fda9c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:26.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.445+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 shutdown_connections 2024-09-21T11:41:26.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.445+0000 7fdaa2cb0640 1 -- 172.21.15.118:0/2678697109 wait complete. 2024-09-21T11:41:26.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.529+0000 7f3a380cd640 1 -- 172.21.15.118:0/2583554362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30101a40 msgr2=0x7f3a30101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.529+0000 7f3a380cd640 1 --2- 172.21.15.118:0/2583554362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30101a40 0x7f3a30101ec0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009880 tx=0x7f3a2402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.529+0000 7f3a380cd640 1 -- 172.21.15.118:0/2583554362 shutdown_connections 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.529+0000 7f3a380cd640 1 --2- 172.21.15.118:0/2583554362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30101a40 0x7f3a30101ec0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 --2- 172.21.15.118:0/2583554362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30100840 0x7f3a30100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 -- 172.21.15.118:0/2583554362 >> 172.21.15.118:0/2583554362 conn(0x7f3a300fbff0 msgr2=0x7f3a300fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 -- 172.21.15.118:0/2583554362 shutdown_connections 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 -- 172.21.15.118:0/2583554362 wait complete. 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 Processor -- start 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 -- start start 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100840 0x7f3a301974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30101a40 0x7f3a301979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3a30109660 con 0x7f3a30100840 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a380cd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3a301094e0 con 0x7f3a30101a40 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a35e69640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100840 0x7f3a301974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:26.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a35e69640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100840 0x7f3a301974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36236/0 (socket says 172.21.15.118:36236) 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.530+0000 7f3a35e69640 1 -- 172.21.15.118:0/1135844901 learned_addr learned my addr 172.21.15.118:0/1135844901 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a35668640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30101a40 0x7f3a301979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a35e69640 1 -- 172.21.15.118:0/1135844901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30101a40 msgr2=0x7f3a301979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a35e69640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30101a40 0x7f3a301979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a35e69640 1 -- 172.21.15.118:0/1135844901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a30198070 con 0x7f3a30100840 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a35e69640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100840 0x7f3a301974b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00d6f0 tx=0x7f3a2c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a22ffd640 1 -- 172.21.15.118:0/1135844901 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a2c017070 con 0x7f3a30100840 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a22ffd640 1 -- 172.21.15.118:0/1135844901 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a2c00de00 con 0x7f3a30100840 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3019cab0 con 0x7f3a30100840 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a22ffd640 1 -- 172.21.15.118:0/1135844901 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a2c003bc0 con 0x7f3a30100840 2024-09-21T11:41:26.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.531+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3019d010 con 0x7f3a30100840 2024-09-21T11:41:26.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.532+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a30100c40 con 0x7f3a30100840 2024-09-21T11:41:26.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.533+0000 7f3a22ffd640 1 -- 172.21.15.118:0/1135844901 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7f3a2c009a30 con 0x7f3a30100840 2024-09-21T11:41:26.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.533+0000 7f3a22ffd640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1c07b0b0 0x7f3a1c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:26.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.533+0000 7f3a22ffd640 1 -- 172.21.15.118:0/1135844901 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f3a2c09dc90 con 0x7f3a30100840 2024-09-21T11:41:26.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.533+0000 7f3a35668640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1c07b0b0 0x7f3a1c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:26.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.534+0000 7f3a35668640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1c07b0b0 0x7f3a1c07d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3a24000c00 tx=0x7f3a240058d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:26.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.538+0000 7f3a22ffd640 1 -- 172.21.15.118:0/1135844901 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3a2c0690f0 con 0x7f3a30100840 2024-09-21T11:41:26.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.794+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3a3019d460 con 0x7f3a30100840 2024-09-21T11:41:26.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.794+0000 7f3a22ffd640 1 -- 172.21.15.118:0/1135844901 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f3a2c06dfa0 con 0x7f3a30100840 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:41:26.796 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:41:26.797 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T11:41:26.797 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:41:26.797 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:41:26.797 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1c07b0b0 msgr2=0x7f3a1c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1c07b0b0 0x7f3a1c07d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3a24000c00 tx=0x7f3a240058d0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100840 msgr2=0x7f3a301974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100840 0x7f3a301974b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00d6f0 tx=0x7f3a2c00dbb0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 shutdown_connections 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30101a40 0x7f3a301979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1c07b0b0 0x7f3a1c07d570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 --2- 172.21.15.118:0/1135844901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100840 0x7f3a301974b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 >> 172.21.15.118:0/1135844901 conn(0x7f3a300fbff0 msgr2=0x7f3a30069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 shutdown_connections 2024-09-21T11:41:26.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.796+0000 7f3a380cd640 1 -- 172.21.15.118:0/1135844901 wait complete. 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.879+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3290380644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 msgr2=0x7fd374100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.879+0000 7fd37ab1b640 1 --2- 172.21.15.118:0/3290380644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 0x7fd374100c80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd368009880 tx=0x7fd36802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.879+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3290380644 shutdown_connections 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.879+0000 7fd37ab1b640 1 --2- 172.21.15.118:0/3290380644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd374101a80 0x7fd374101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.879+0000 7fd37ab1b640 1 --2- 172.21.15.118:0/3290380644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 0x7fd374100c80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.879+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3290380644 >> 172.21.15.118:0/3290380644 conn(0x7fd3740fc010 msgr2=0x7fd3740fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.879+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3290380644 shutdown_connections 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.879+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3290380644 wait complete. 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.879+0000 7fd37ab1b640 1 Processor -- start 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd37ab1b640 1 -- start start 2024-09-21T11:41:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd37ab1b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 0x7fd374197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd37ab1b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd374101a80 0x7fd374197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd37ab1b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd3741096c0 con 0x7fd374100880 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd37ab1b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd374109540 con 0x7fd374101a80 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd3788b7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 0x7fd374197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd3788b7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 0x7fd374197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36244/0 (socket says 172.21.15.118:36244) 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd3788b7640 1 -- 172.21.15.118:0/3751322574 learned_addr learned my addr 172.21.15.118:0/3751322574 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd373fff640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd374101a80 0x7fd374197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd3788b7640 1 -- 172.21.15.118:0/3751322574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd374101a80 msgr2=0x7fd374197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd3788b7640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd374101a80 0x7fd374197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd3788b7640 1 -- 172.21.15.118:0/3751322574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd374198150 con 0x7fd374100880 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd373fff640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd374101a80 0x7fd374197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd3788b7640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 0x7fd374197590 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd368004650 tx=0x7fd3680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd371ffb640 1 -- 172.21.15.118:0/3751322574 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd36803f070 con 0x7fd374100880 2024-09-21T11:41:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd371ffb640 1 -- 172.21.15.118:0/3751322574 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd368004a70 con 0x7fd374100880 2024-09-21T11:41:26.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37419cb30 con 0x7fd374100880 2024-09-21T11:41:26.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.880+0000 7fd371ffb640 1 -- 172.21.15.118:0/3751322574 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd368035030 con 0x7fd374100880 2024-09-21T11:41:26.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.881+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37419d0c0 con 0x7fd374100880 2024-09-21T11:41:26.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.882+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd374100c80 con 0x7fd374100880 2024-09-21T11:41:26.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.883+0000 7fd371ffb640 1 -- 172.21.15.118:0/3751322574 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7fd368042070 con 0x7fd374100880 2024-09-21T11:41:26.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.883+0000 7fd371ffb640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd36407b0b0 0x7fd36407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:26.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.883+0000 7fd371ffb640 1 -- 172.21.15.118:0/3751322574 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fd3680bed00 con 0x7fd374100880 2024-09-21T11:41:26.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.883+0000 7fd373fff640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd36407b0b0 0x7fd36407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:26.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.883+0000 7fd373fff640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd36407b0b0 0x7fd36407d570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd3600058c0 tx=0x7fd360005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:26.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:26.887+0000 7fd371ffb640 1 -- 172.21.15.118:0/3751322574 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fd3680c2030 con 0x7fd374100880 2024-09-21T11:41:27.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.085+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd37406aaa0 con 0x7fd36407b0b0 2024-09-21T11:41:27.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.086+0000 7fd371ffb640 1 -- 172.21.15.118:0/3751322574 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7fd37406aaa0 con 0x7fd36407b0b0 2024-09-21T11:41:27.087 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:41:27.088 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:41:27.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.088+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd36407b0b0 msgr2=0x7fd36407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:27.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.088+0000 7fd37ab1b640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd36407b0b0 0x7fd36407d570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd3600058c0 tx=0x7fd360005850 comp rx=0 tx=0).stop 2024-09-21T11:41:27.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.088+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 msgr2=0x7fd374197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:27.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.088+0000 7fd37ab1b640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 0x7fd374197590 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd368004650 tx=0x7fd3680046c0 comp rx=0 tx=0).stop 2024-09-21T11:41:27.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.088+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 shutdown_connections 2024-09-21T11:41:27.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.088+0000 7fd37ab1b640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd374101a80 0x7fd374197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:27.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.088+0000 7fd37ab1b640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd36407b0b0 0x7fd36407d570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:27.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.088+0000 7fd37ab1b640 1 --2- 172.21.15.118:0/3751322574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd374100880 0x7fd374197590 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:27.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.088+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 >> 172.21.15.118:0/3751322574 conn(0x7fd3740fc010 msgr2=0x7fd37406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:27.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.089+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 shutdown_connections 2024-09-21T11:41:27.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:27.089+0000 7fd37ab1b640 1 -- 172.21.15.118:0/3751322574 wait complete. 2024-09-21T11:41:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:26 smithi149 ceph-mon[36123]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:26 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:26 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:26 smithi149 ceph-mon[36123]: pgmap v44: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-21T11:41:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:26 smithi149 ceph-mon[36123]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:26 smithi149 ceph-mon[36123]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:26 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:26 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:27.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:26 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1135844901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:26 smithi118 ceph-mon[28757]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:26 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:26 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:26 smithi118 ceph-mon[28757]: pgmap v44: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-21T11:41:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:26 smithi118 ceph-mon[28757]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:27.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:26 smithi118 ceph-mon[28757]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:27.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:26 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:27.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:26 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:27.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:26 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1135844901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:28.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:27 smithi118 ceph-mon[28757]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:28.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:27 smithi149 ceph-mon[36123]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:29.292 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:28 smithi118 ceph-mon[28757]: pgmap v45: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:29.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:28 smithi149 ceph-mon[36123]: pgmap v45: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:30 smithi118 ceph-mon[28757]: pgmap v46: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:31.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:31.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:30 smithi149 ceph-mon[36123]: pgmap v46: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:31 smithi118 ceph-mon[28757]: Upgrade: Updating prometheus.smithi118 2024-09-21T11:41:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:31 smithi118 ceph-mon[28757]: Deploying daemon prometheus.smithi118 on smithi118 2024-09-21T11:41:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:31 smithi149 ceph-mon[36123]: Upgrade: Updating prometheus.smithi118 2024-09-21T11:41:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:31 smithi149 ceph-mon[36123]: Deploying daemon prometheus.smithi118 on smithi118 2024-09-21T11:41:32.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:32 smithi149 ceph-mon[36123]: pgmap v47: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:33.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:32 smithi118 ceph-mon[28757]: pgmap v47: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:35.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:35 smithi149 ceph-mon[36123]: pgmap v48: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:35.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:35 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:41:35.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:35 smithi118 ceph-mon[28757]: pgmap v48: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:35.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:35 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:41:37.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:37 smithi149 ceph-mon[36123]: pgmap v49: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:37.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:37 smithi118 ceph-mon[28757]: pgmap v49: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:38 smithi149 ceph-mon[36123]: mgrmap e33: smithi118.djbwyn(active, since 93s), standbys: smithi149.xjglai 2024-09-21T11:41:38.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:38 smithi118 ceph-mon[28757]: mgrmap e33: smithi118.djbwyn(active, since 93s), standbys: smithi149.xjglai 2024-09-21T11:41:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:39 smithi118 ceph-mon[28757]: pgmap v50: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:39.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:39 smithi149 ceph-mon[36123]: pgmap v50: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:41 smithi118 ceph-mon[28757]: pgmap v51: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:41 smithi149 ceph-mon[36123]: pgmap v51: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:43 smithi118 ceph-mon[28757]: pgmap v52: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:43.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:43 smithi149 ceph-mon[36123]: pgmap v52: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:45.684 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:45 smithi118 ceph-mon[28757]: pgmap v53: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:45.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:45 smithi149 ceph-mon[36123]: pgmap v53: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:46 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:46 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:46 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:46 smithi149 ceph-mon[36123]: pgmap v54: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:46 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:46 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:47.225 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:46 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:47.225 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:46 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:47.225 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:46 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:47.225 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:46 smithi118 ceph-mon[28757]: pgmap v54: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T11:41:47.226 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:46 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:47.226 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:46 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:49.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:49 smithi149 ceph-mon[36123]: pgmap v55: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:49.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:49 smithi118 ceph-mon[28757]: pgmap v55: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:50.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:50 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:41:50.465 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:50 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:41:51.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:51 smithi149 ceph-mon[36123]: pgmap v56: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:51.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:51 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:51.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:51 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:51 smithi118 ceph-mon[28757]: pgmap v56: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:51 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:51 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:52.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:52 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:52.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:52 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:52.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:52 smithi149 ceph-mon[36123]: pgmap v57: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:53.063 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:52 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:53.064 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:52 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:53.064 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:52 smithi118 ceph-mon[28757]: pgmap v57: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:55.427 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: pgmap v58: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.429 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.429 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.429 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.429 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:55 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: pgmap v58: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:55.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:55 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:56.431 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:56 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:41:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:56 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T11:41:57.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.174+0000 7f1a80bd4640 1 -- 172.21.15.118:0/133247360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 msgr2=0x7f1a7c100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.174+0000 7f1a80bd4640 1 --2- 172.21.15.118:0/133247360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 0x7f1a7c100400 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009880 tx=0x7f1a6c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.174+0000 7f1a80bd4640 1 -- 172.21.15.118:0/133247360 shutdown_connections 2024-09-21T11:41:57.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.174+0000 7f1a80bd4640 1 --2- 172.21.15.118:0/133247360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a7c101200 0x7f1a7c101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.174+0000 7f1a80bd4640 1 --2- 172.21.15.118:0/133247360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 0x7f1a7c100400 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.174+0000 7f1a80bd4640 1 -- 172.21.15.118:0/133247360 >> 172.21.15.118:0/133247360 conn(0x7f1a7c0fb790 msgr2=0x7f1a7c0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:57.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.174+0000 7f1a80bd4640 1 -- 172.21.15.118:0/133247360 shutdown_connections 2024-09-21T11:41:57.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.174+0000 7f1a80bd4640 1 -- 172.21.15.118:0/133247360 wait complete. 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a80bd4640 1 Processor -- start 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a80bd4640 1 -- start start 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a80bd4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 0x7f1a7c1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a80bd4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a7c101200 0x7f1a7c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a80bd4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c108590 con 0x7f1a7c100000 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a80bd4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c108410 con 0x7f1a7c101200 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 0x7f1a7c1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 0x7f1a7c1974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37442/0 (socket says 172.21.15.118:37442) 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a7a59c640 1 -- 172.21.15.118:0/1350407002 learned_addr learned my addr 172.21.15.118:0/1350407002 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a73fff640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a7c101200 0x7f1a7c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a7a59c640 1 -- 172.21.15.118:0/1350407002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a7c101200 msgr2=0x7f1a7c1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a7a59c640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a7c101200 0x7f1a7c1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a7a59c640 1 -- 172.21.15.118:0/1350407002 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c198070 con 0x7f1a7c100000 2024-09-21T11:41:57.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.175+0000 7f1a7a59c640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 0x7f1a7c1974b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c006010 tx=0x7f1a6c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:57.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.176+0000 7f1a737fe640 1 -- 172.21.15.118:0/1350407002 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a6c03f070 con 0x7f1a7c100000 2024-09-21T11:41:57.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.176+0000 7f1a737fe640 1 -- 172.21.15.118:0/1350407002 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a6c004a50 con 0x7f1a7c100000 2024-09-21T11:41:57.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.176+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7c19ca50 con 0x7f1a7c100000 2024-09-21T11:41:57.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.176+0000 7f1a737fe640 1 -- 172.21.15.118:0/1350407002 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a6c035030 con 0x7f1a7c100000 2024-09-21T11:41:57.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.176+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a7c19cfe0 con 0x7f1a7c100000 2024-09-21T11:41:57.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.177+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7c100400 con 0x7f1a7c100000 2024-09-21T11:41:57.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.178+0000 7f1a737fe640 1 -- 172.21.15.118:0/1350407002 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1a6c042070 con 0x7f1a7c100000 2024-09-21T11:41:57.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.178+0000 7f1a737fe640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a6807af30 0x7f1a6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:57.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.178+0000 7f1a737fe640 1 -- 172.21.15.118:0/1350407002 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1a6c0beba0 con 0x7f1a7c100000 2024-09-21T11:41:57.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.178+0000 7f1a73fff640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a6807af30 0x7f1a6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:57.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.179+0000 7f1a73fff640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a6807af30 0x7f1a6807d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a64005d00 tx=0x7f1a64005c50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:57.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.183+0000 7f1a737fe640 1 -- 172.21.15.118:0/1350407002 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1a6c004c00 con 0x7f1a7c100000 2024-09-21T11:41:57.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.376+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1a7c062630 con 0x7f1a6807af30 2024-09-21T11:41:57.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.377+0000 7f1a737fe640 1 -- 172.21.15.118:0/1350407002 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f1a7c062630 con 0x7f1a6807af30 2024-09-21T11:41:57.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.379+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a6807af30 msgr2=0x7f1a6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.379+0000 7f1a80bd4640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a6807af30 0x7f1a6807d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a64005d00 tx=0x7f1a64005c50 comp rx=0 tx=0).stop 2024-09-21T11:41:57.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.379+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 msgr2=0x7f1a7c1974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.379+0000 7f1a80bd4640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 0x7f1a7c1974b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c006010 tx=0x7f1a6c0045e0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.380+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 shutdown_connections 2024-09-21T11:41:57.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.380+0000 7f1a80bd4640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a7c101200 0x7f1a7c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.380+0000 7f1a80bd4640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a6807af30 0x7f1a6807d3f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.380+0000 7f1a80bd4640 1 --2- 172.21.15.118:0/1350407002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a7c100000 0x7f1a7c1974b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.380+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 >> 172.21.15.118:0/1350407002 conn(0x7f1a7c0fb790 msgr2=0x7f1a7c1048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:57.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.380+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 shutdown_connections 2024-09-21T11:41:57.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.380+0000 7f1a80bd4640 1 -- 172.21.15.118:0/1350407002 wait complete. 2024-09-21T11:41:57.391 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:41:57.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:57 smithi149 ceph-mon[36123]: pgmap v59: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:57.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:57 smithi149 ceph-mon[36123]: Upgrade: Updating alertmanager.smithi118 2024-09-21T11:41:57.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:57 smithi149 ceph-mon[36123]: Deploying daemon alertmanager.smithi118 on smithi118 2024-09-21T11:41:57.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.462+0000 7f1fe991f640 1 -- 172.21.15.118:0/4179097101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 msgr2=0x7f1fe4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.462+0000 7f1fe991f640 1 --2- 172.21.15.118:0/4179097101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 0x7f1fe4100c80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009880 tx=0x7f1fdc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.462+0000 7f1fe991f640 1 -- 172.21.15.118:0/4179097101 shutdown_connections 2024-09-21T11:41:57.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.462+0000 7f1fe991f640 1 --2- 172.21.15.118:0/4179097101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fe4101a80 0x7f1fe4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.462+0000 7f1fe991f640 1 --2- 172.21.15.118:0/4179097101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 0x7f1fe4100c80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.462+0000 7f1fe991f640 1 -- 172.21.15.118:0/4179097101 >> 172.21.15.118:0/4179097101 conn(0x7f1fe40fc010 msgr2=0x7f1fe40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:57.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.462+0000 7f1fe991f640 1 -- 172.21.15.118:0/4179097101 shutdown_connections 2024-09-21T11:41:57.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.462+0000 7f1fe991f640 1 -- 172.21.15.118:0/4179097101 wait complete. 2024-09-21T11:41:57.465 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:57 smithi118 ceph-mon[28757]: pgmap v59: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:57.466 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:57 smithi118 ceph-mon[28757]: Upgrade: Updating alertmanager.smithi118 2024-09-21T11:41:57.466 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:57 smithi118 ceph-mon[28757]: Deploying daemon alertmanager.smithi118 on smithi118 2024-09-21T11:41:57.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.463+0000 7f1fe991f640 1 Processor -- start 2024-09-21T11:41:57.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.463+0000 7f1fe991f640 1 -- start start 2024-09-21T11:41:57.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.463+0000 7f1fe991f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 0x7f1fe406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:57.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.463+0000 7f1fe991f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fe4101a80 0x7f1fe419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:57.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.463+0000 7f1fe991f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe4109720 con 0x7f1fe4100880 2024-09-21T11:41:57.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.463+0000 7f1fe991f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe41095a0 con 0x7f1fe4101a80 2024-09-21T11:41:57.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.463+0000 7f1fe2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 0x7f1fe406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:57.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.463+0000 7f1fe2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 0x7f1fe406adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37450/0 (socket says 172.21.15.118:37450) 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.463+0000 7f1fe2ffd640 1 -- 172.21.15.118:0/246611080 learned_addr learned my addr 172.21.15.118:0/246611080 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe2ffd640 1 -- 172.21.15.118:0/246611080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fe4101a80 msgr2=0x7f1fe419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe27fc640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fe4101a80 0x7f1fe419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe2ffd640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fe4101a80 0x7f1fe419c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe2ffd640 1 -- 172.21.15.118:0/246611080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe419c830 con 0x7f1fe4100880 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe2ffd640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 0x7f1fe406adf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc006010 tx=0x7f1fdc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe891d640 1 -- 172.21.15.118:0/246611080 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1fdc03f070 con 0x7f1fe4100880 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe419cac0 con 0x7f1fe4100880 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe891d640 1 -- 172.21.15.118:0/246611080 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1fdc0044d0 con 0x7f1fe4100880 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe891d640 1 -- 172.21.15.118:0/246611080 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1fdc035030 con 0x7f1fe4100880 2024-09-21T11:41:57.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.464+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe419d070 con 0x7f1fe4100880 2024-09-21T11:41:57.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.465+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe4100c80 con 0x7f1fe4100880 2024-09-21T11:41:57.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.466+0000 7f1fe891d640 1 -- 172.21.15.118:0/246611080 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1fdc042070 con 0x7f1fe4100880 2024-09-21T11:41:57.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.466+0000 7f1fe891d640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1fd007af30 0x7f1fd007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:57.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.467+0000 7f1fe891d640 1 -- 172.21.15.118:0/246611080 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1fdc0bed70 con 0x7f1fe4100880 2024-09-21T11:41:57.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.467+0000 7f1fe27fc640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1fd007af30 0x7f1fd007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:57.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.467+0000 7f1fe27fc640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1fd007af30 0x7f1fd007d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fe406ab70 tx=0x7f1fcc008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:57.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.471+0000 7f1fe891d640 1 -- 172.21.15.118:0/246611080 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1fdc08a2e0 con 0x7f1fe4100880 2024-09-21T11:41:57.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.668+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1fe4062630 con 0x7f1fd007af30 2024-09-21T11:41:57.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.669+0000 7f1fe891d640 1 -- 172.21.15.118:0/246611080 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f1fe4062630 con 0x7f1fd007af30 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1fd007af30 msgr2=0x7f1fd007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1fd007af30 0x7f1fd007d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fe406ab70 tx=0x7f1fcc008040 comp rx=0 tx=0).stop 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 msgr2=0x7f1fe406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 0x7f1fe406adf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc006010 tx=0x7f1fdc0048f0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 shutdown_connections 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fe4101a80 0x7f1fe419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1fd007af30 0x7f1fd007d3f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 --2- 172.21.15.118:0/246611080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe4100880 0x7f1fe406adf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 >> 172.21.15.118:0/246611080 conn(0x7f1fe40fc010 msgr2=0x7f1fe4104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 shutdown_connections 2024-09-21T11:41:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.671+0000 7f1fe991f640 1 -- 172.21.15.118:0/246611080 wait complete. 2024-09-21T11:41:57.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.752+0000 7f1e28eff640 1 -- 172.21.15.118:0/2090925878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 msgr2=0x7f1e24101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.752+0000 7f1e28eff640 1 --2- 172.21.15.118:0/2090925878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 0x7f1e24101d60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009c20 tx=0x7f1e1402a970 comp rx=0 tx=0).stop 2024-09-21T11:41:57.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.753+0000 7f1e28eff640 1 -- 172.21.15.118:0/2090925878 shutdown_connections 2024-09-21T11:41:57.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.753+0000 7f1e28eff640 1 --2- 172.21.15.118:0/2090925878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e24102b60 0x7f1e24102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.753+0000 7f1e28eff640 1 --2- 172.21.15.118:0/2090925878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 0x7f1e24101d60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.753+0000 7f1e28eff640 1 -- 172.21.15.118:0/2090925878 >> 172.21.15.118:0/2090925878 conn(0x7f1e240fd0f0 msgr2=0x7f1e240ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:57.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.753+0000 7f1e28eff640 1 -- 172.21.15.118:0/2090925878 shutdown_connections 2024-09-21T11:41:57.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.753+0000 7f1e28eff640 1 -- 172.21.15.118:0/2090925878 wait complete. 2024-09-21T11:41:57.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.753+0000 7f1e28eff640 1 Processor -- start 2024-09-21T11:41:57.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.753+0000 7f1e28eff640 1 -- start start 2024-09-21T11:41:57.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e28eff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 0x7f1e24197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:57.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e28eff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e24102b60 0x7f1e24197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e28eff640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2410a800 con 0x7f1e24101960 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e28eff640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2410a680 con 0x7f1e24102b60 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e2259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 0x7f1e24197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e2259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 0x7f1e24197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37456/0 (socket says 172.21.15.118:37456) 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e2259c640 1 -- 172.21.15.118:0/426255772 learned_addr learned my addr 172.21.15.118:0/426255772 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e21d9b640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e24102b60 0x7f1e24197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e2259c640 1 -- 172.21.15.118:0/426255772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e24102b60 msgr2=0x7f1e24197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e2259c640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e24102b60 0x7f1e24197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.754+0000 7f1e2259c640 1 -- 172.21.15.118:0/426255772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e24198150 con 0x7f1e24101960 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.755+0000 7f1e2259c640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 0x7f1e24197590 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1e14006010 tx=0x7f1e1402f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.755+0000 7f1e1b7fe640 1 -- 172.21.15.118:0/426255772 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e14047070 con 0x7f1e24101960 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.755+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2419cb30 con 0x7f1e24101960 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.755+0000 7f1e1b7fe640 1 -- 172.21.15.118:0/426255772 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e14003e30 con 0x7f1e24101960 2024-09-21T11:41:57.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.755+0000 7f1e1b7fe640 1 -- 172.21.15.118:0/426255772 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e14034070 con 0x7f1e24101960 2024-09-21T11:41:57.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.755+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e2419d0c0 con 0x7f1e24101960 2024-09-21T11:41:57.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.756+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e24101de0 con 0x7f1e24101960 2024-09-21T11:41:57.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.757+0000 7f1e1b7fe640 1 -- 172.21.15.118:0/426255772 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1e1404a070 con 0x7f1e24101960 2024-09-21T11:41:57.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.757+0000 7f1e1b7fe640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e1007af30 0x7f1e1007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:57.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.758+0000 7f1e1b7fe640 1 -- 172.21.15.118:0/426255772 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1e140bee50 con 0x7f1e24101960 2024-09-21T11:41:57.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.758+0000 7f1e21d9b640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e1007af30 0x7f1e1007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:57.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.758+0000 7f1e21d9b640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e1007af30 0x7f1e1007d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e24198a40 tx=0x7f1e0c009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:57.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.762+0000 7f1e1b7fe640 1 -- 172.21.15.118:0/426255772 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1e1403f070 con 0x7f1e24101960 2024-09-21T11:41:57.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.952+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1e240626f0 con 0x7f1e1007af30 2024-09-21T11:41:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.963+0000 7f1e1b7fe640 1 -- 172.21.15.118:0/426255772 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1e240626f0 con 0x7f1e1007af30 2024-09-21T11:41:57.965 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:41:57.965 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (9m) 6s ago 10m 22.4M - 0.25.0 c8568f914cd2 c99d4b7557e4 2024-09-21T11:41:57.965 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (2m) 6s ago 11m 8614k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:41:57.965 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (2m) 34s ago 10m 8094k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:41:57.965 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (11m) 6s ago 11m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (10m) 34s ago 10m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (9m) 6s ago 10m 79.9M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (5m) 6s ago 5m 149M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (5m) 6s ago 5m 27.3M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (5m) 34s ago 5m 20.9M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (5m) 34s ago 5m 14.7M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (2m) 6s ago 12m 511M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (66s) 34s ago 10m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (12m) 6s ago 12m 58.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (9m) 34s ago 9m 46.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (44s) 6s ago 10m 9554k - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (38s) 34s ago 10m 3506k - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:41:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (8m) 6s ago 8m 204M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:41:57.967 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (8m) 6s ago 8m 227M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:41:57.967 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (7m) 6s ago 7m 183M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:41:57.967 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (7m) 34s ago 7m 258M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:41:57.967 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (6m) 34s ago 6m 210M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:41:57.967 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (6m) 34s ago 6m 205M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:41:57.967 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (12s) 6s ago 10m 41.4M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:41:57.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e1007af30 msgr2=0x7f1e1007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e1007af30 0x7f1e1007d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e24198a40 tx=0x7f1e0c009110 comp rx=0 tx=0).stop 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 msgr2=0x7f1e24197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 0x7f1e24197590 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1e14006010 tx=0x7f1e1402f730 comp rx=0 tx=0).stop 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 shutdown_connections 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e24102b60 0x7f1e24197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e1007af30 0x7f1e1007d3f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 --2- 172.21.15.118:0/426255772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e24101960 0x7f1e24197590 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 >> 172.21.15.118:0/426255772 conn(0x7f1e240fd0f0 msgr2=0x7f1e24106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 shutdown_connections 2024-09-21T11:41:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:57.965+0000 7f1e28eff640 1 -- 172.21.15.118:0/426255772 wait complete. 2024-09-21T11:41:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.048+0000 7f5c412c9640 1 -- 172.21.15.118:0/2264605779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 msgr2=0x7f5c3c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.048+0000 7f5c412c9640 1 --2- 172.21.15.118:0/2264605779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 0x7f5c3c107130 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5c300098b0 tx=0x7f5c3002a4d0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.048+0000 7f5c412c9640 1 -- 172.21.15.118:0/2264605779 shutdown_connections 2024-09-21T11:41:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.048+0000 7f5c412c9640 1 --2- 172.21.15.118:0/2264605779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 0x7f5c3c107130 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.048+0000 7f5c412c9640 1 --2- 172.21.15.118:0/2264605779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c3c102410 0x7f5c3c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.048+0000 7f5c412c9640 1 -- 172.21.15.118:0/2264605779 >> 172.21.15.118:0/2264605779 conn(0x7f5c3c0fc010 msgr2=0x7f5c3c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.048+0000 7f5c412c9640 1 -- 172.21.15.118:0/2264605779 shutdown_connections 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.048+0000 7f5c412c9640 1 -- 172.21.15.118:0/2264605779 wait complete. 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.048+0000 7f5c412c9640 1 Processor -- start 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c412c9640 1 -- start start 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c412c9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c3c102410 0x7f5c3c101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c412c9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 0x7f5c3c1003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c412c9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c10a7d0 con 0x7f5c3c104d40 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c412c9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c10a650 con 0x7f5c3c102410 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c3a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 0x7f5c3c1003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c3a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 0x7f5c3c1003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37468/0 (socket says 172.21.15.118:37468) 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c3a7fc640 1 -- 172.21.15.118:0/41260131 learned_addr learned my addr 172.21.15.118:0/41260131 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c3affd640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c3c102410 0x7f5c3c101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.049+0000 7f5c3a7fc640 1 -- 172.21.15.118:0/41260131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c3c102410 msgr2=0x7f5c3c101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.050+0000 7f5c3a7fc640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c3c102410 0x7f5c3c101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.050+0000 7f5c3a7fc640 1 -- 172.21.15.118:0/41260131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c100900 con 0x7f5c3c104d40 2024-09-21T11:41:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.050+0000 7f5c3affd640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c3c102410 0x7f5c3c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T11:41:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.050+0000 7f5c3a7fc640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 0x7f5c3c1003c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009230 tx=0x7f5c300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.050+0000 7f5c23fff640 1 -- 172.21.15.118:0/41260131 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c3003f070 con 0x7f5c3c104d40 2024-09-21T11:41:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.050+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c100b90 con 0x7f5c3c104d40 2024-09-21T11:41:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.050+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c1010c0 con 0x7f5c3c104d40 2024-09-21T11:41:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.050+0000 7f5c23fff640 1 -- 172.21.15.118:0/41260131 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c30004a50 con 0x7f5c3c104d40 2024-09-21T11:41:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.050+0000 7f5c23fff640 1 -- 172.21.15.118:0/41260131 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c30035030 con 0x7f5c3c104d40 2024-09-21T11:41:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.051+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c280052c0 con 0x7f5c3c104d40 2024-09-21T11:41:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.052+0000 7f5c23fff640 1 -- 172.21.15.118:0/41260131 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5c30042070 con 0x7f5c3c104d40 2024-09-21T11:41:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.052+0000 7f5c23fff640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5c2407af80 0x7f5c2407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.053+0000 7f5c23fff640 1 -- 172.21.15.118:0/41260131 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f5c300be980 con 0x7f5c3c104d40 2024-09-21T11:41:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.053+0000 7f5c3affd640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5c2407af80 0x7f5c2407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.053+0000 7f5c3affd640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5c2407af80 0x7f5c2407d440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c005fd0 tx=0x7f5c2c00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:58.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.057+0000 7f5c23fff640 1 -- 172.21.15.118:0/41260131 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5c3008a000 con 0x7f5c3c104d40 2024-09-21T11:41:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:58 smithi118 ceph-mon[28757]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:58.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.346+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5c28005dc0 con 0x7f5c3c104d40 2024-09-21T11:41:58.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.346+0000 7f5c23fff640 1 -- 172.21.15.118:0/41260131 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f5c3008eeb0 con 0x7f5c3c104d40 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:41:58.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:41:58.350 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:41:58.350 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T11:41:58.350 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:41:58.350 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:41:58.350 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5c2407af80 msgr2=0x7f5c2407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5c2407af80 0x7f5c2407d440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c005fd0 tx=0x7f5c2c00b390 comp rx=0 tx=0).stop 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 msgr2=0x7f5c3c1003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 0x7f5c3c1003c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009230 tx=0x7f5c300045e0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 shutdown_connections 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5c2407af80 0x7f5c2407d440 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c3c104d40 0x7f5c3c1003c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 --2- 172.21.15.118:0/41260131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c3c102410 0x7f5c3c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 >> 172.21.15.118:0/41260131 conn(0x7f5c3c0fc010 msgr2=0x7f5c3c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 shutdown_connections 2024-09-21T11:41:58.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.348+0000 7f5c412c9640 1 -- 172.21.15.118:0/41260131 wait complete. 2024-09-21T11:41:58.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.444+0000 7f2c2d29c640 1 -- 172.21.15.118:0/82633382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 msgr2=0x7f2c28101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:58.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.444+0000 7f2c2d29c640 1 --2- 172.21.15.118:0/82633382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 0x7f2c28101ec0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009880 tx=0x7f2c1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.444+0000 7f2c2d29c640 1 -- 172.21.15.118:0/82633382 shutdown_connections 2024-09-21T11:41:58.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.444+0000 7f2c2d29c640 1 --2- 172.21.15.118:0/82633382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 0x7f2c28101ec0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.444+0000 7f2c2d29c640 1 --2- 172.21.15.118:0/82633382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c28100840 0x7f2c28100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.444+0000 7f2c2d29c640 1 -- 172.21.15.118:0/82633382 >> 172.21.15.118:0/82633382 conn(0x7f2c280fbff0 msgr2=0x7f2c280fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:58.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.445+0000 7f2c2d29c640 1 -- 172.21.15.118:0/82633382 shutdown_connections 2024-09-21T11:41:58.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.445+0000 7f2c2d29c640 1 -- 172.21.15.118:0/82633382 wait complete. 2024-09-21T11:41:58.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.445+0000 7f2c2d29c640 1 Processor -- start 2024-09-21T11:41:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.445+0000 7f2c2d29c640 1 -- start start 2024-09-21T11:41:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c2d29c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c28100840 0x7f2c28197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c2d29c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 0x7f2c28197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c2d29c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2c28109700 con 0x7f2c28101a40 2024-09-21T11:41:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c2d29c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2c28109580 con 0x7f2c28100840 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c267fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 0x7f2c28197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c267fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 0x7f2c28197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37476/0 (socket says 172.21.15.118:37476) 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c267fc640 1 -- 172.21.15.118:0/2549971800 learned_addr learned my addr 172.21.15.118:0/2549971800 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c26ffd640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c28100840 0x7f2c28197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c267fc640 1 -- 172.21.15.118:0/2549971800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c28100840 msgr2=0x7f2c28197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c267fc640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c28100840 0x7f2c28197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c267fc640 1 -- 172.21.15.118:0/2549971800 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c28198130 con 0x7f2c28101a40 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c267fc640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 0x7f2c28197ab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c006010 tx=0x7f2c1c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c0ffff640 1 -- 172.21.15.118:0/2549971800 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c1c03f070 con 0x7f2c28101a40 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.446+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2819cb10 con 0x7f2c28101a40 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.447+0000 7f2c0ffff640 1 -- 172.21.15.118:0/2549971800 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c1c0044d0 con 0x7f2c28101a40 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.447+0000 7f2c0ffff640 1 -- 172.21.15.118:0/2549971800 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c1c035030 con 0x7f2c28101a40 2024-09-21T11:41:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.447+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2819d120 con 0x7f2c28101a40 2024-09-21T11:41:58.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:58 smithi149 ceph-mon[36123]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:58.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.448+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c28100c20 con 0x7f2c28101a40 2024-09-21T11:41:58.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.448+0000 7f2c0ffff640 1 -- 172.21.15.118:0/2549971800 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2c1c042070 con 0x7f2c28101a40 2024-09-21T11:41:58.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.449+0000 7f2c0ffff640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c1007af30 0x7f2c1007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:41:58.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.449+0000 7f2c0ffff640 1 -- 172.21.15.118:0/2549971800 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f2c1c0bed70 con 0x7f2c28101a40 2024-09-21T11:41:58.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.449+0000 7f2c26ffd640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c1007af30 0x7f2c1007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:41:58.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.449+0000 7f2c26ffd640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c1007af30 0x7f2c1007d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c281018a0 tx=0x7f2c18008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:41:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.454+0000 7f2c0ffff640 1 -- 172.21.15.118:0/2549971800 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2c1c08a370 con 0x7f2c28101a40 2024-09-21T11:41:58.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.664+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2c2806a330 con 0x7f2c1007af30 2024-09-21T11:41:58.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.665+0000 7f2c0ffff640 1 -- 172.21.15.118:0/2549971800 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f2c2806a330 con 0x7f2c1007af30 2024-09-21T11:41:58.668 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:41:58.668 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:41:58.668 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:41:58.668 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:41:58.668 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:41:58.668 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:41:58.668 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:41:58.668 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T11:41:58.669 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-21T11:41:58.669 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:41:58.669 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:41:58.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c1007af30 msgr2=0x7f2c1007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:58.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c1007af30 0x7f2c1007d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c281018a0 tx=0x7f2c18008040 comp rx=0 tx=0).stop 2024-09-21T11:41:58.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 msgr2=0x7f2c28197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:41:58.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 0x7f2c28197ab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c006010 tx=0x7f2c1c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 shutdown_connections 2024-09-21T11:41:58.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c1007af30 0x7f2c1007d3f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c28101a40 0x7f2c28197ab0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 --2- 172.21.15.118:0/2549971800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c28100840 0x7f2c28197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:41:58.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 >> 172.21.15.118:0/2549971800 conn(0x7f2c280fbff0 msgr2=0x7f2c28069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:41:58.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 shutdown_connections 2024-09-21T11:41:58.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:41:58.668+0000 7f2c2d29c640 1 -- 172.21.15.118:0/2549971800 wait complete. 2024-09-21T11:41:59.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:59 smithi149 ceph-mon[36123]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:59.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:59 smithi149 ceph-mon[36123]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:59.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:59 smithi149 ceph-mon[36123]: pgmap v60: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:59.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:41:59 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/41260131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:41:59.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:59 smithi118 ceph-mon[28757]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:59.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:59 smithi118 ceph-mon[28757]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:41:59.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:59 smithi118 ceph-mon[28757]: pgmap v60: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:41:59.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:41:59 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/41260131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:00 smithi149 ceph-mon[36123]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:00 smithi118 ceph-mon[28757]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:01.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:01 smithi149 ceph-mon[36123]: pgmap v61: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:01.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:01 smithi118 ceph-mon[28757]: pgmap v61: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:03.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:03 smithi149 ceph-mon[36123]: pgmap v62: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:03.518 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:03 smithi118 ceph-mon[28757]: pgmap v62: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:05.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:05 smithi149 ceph-mon[36123]: pgmap v63: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:05.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:05 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:42:05.466 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:05 smithi118 ceph-mon[28757]: pgmap v63: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:05.466 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:05 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:42:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:06 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:06 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:06 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:06 smithi118 ceph-mon[28757]: pgmap v64: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:06 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:06 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:06 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:06 smithi149 ceph-mon[36123]: pgmap v64: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:09.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:09 smithi149 ceph-mon[36123]: pgmap v65: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:09.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:09 smithi118 ceph-mon[28757]: pgmap v65: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:11.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:11 smithi149 ceph-mon[36123]: pgmap v66: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:11.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:11 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:11.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:11 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:11 smithi118 ceph-mon[28757]: pgmap v66: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:11 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:11 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:12.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:12 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:12.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:12 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:12.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:12 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:12.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:12 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:13.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:13 smithi149 ceph-mon[36123]: pgmap v67: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:13.504 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:13 smithi118 ceph-mon[28757]: pgmap v67: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:15.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:15 smithi118 ceph-mon[28757]: pgmap v68: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:15 smithi149 ceph-mon[36123]: pgmap v68: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: pgmap v69: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:42:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:42:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T11:42:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:17.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:17 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: pgmap v69: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.045 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.046 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.046 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.046 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.046 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.046 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:18.046 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:17 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:19 smithi149 ceph-mon[36123]: pgmap v70: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:19 smithi149 ceph-mon[36123]: Upgrade: Updating grafana.smithi118 2024-09-21T11:42:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:19 smithi149 ceph-mon[36123]: Deploying daemon grafana.smithi118 on smithi118 2024-09-21T11:42:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:19 smithi118 ceph-mon[28757]: pgmap v70: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:19 smithi118 ceph-mon[28757]: Upgrade: Updating grafana.smithi118 2024-09-21T11:42:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:19 smithi118 ceph-mon[28757]: Deploying daemon grafana.smithi118 on smithi118 2024-09-21T11:42:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:20 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:42:21.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:20 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:42:21.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:21 smithi149 ceph-mon[36123]: pgmap v71: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:22.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:21 smithi118 ceph-mon[28757]: pgmap v71: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:23 smithi149 ceph-mon[36123]: pgmap v72: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:24.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:23 smithi118 ceph-mon[28757]: pgmap v72: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:25.913 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:25 smithi118 ceph-mon[28757]: pgmap v73: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:25.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:25 smithi149 ceph-mon[36123]: pgmap v73: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:27 smithi118 ceph-mon[28757]: pgmap v74: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:27 smithi149 ceph-mon[36123]: pgmap v74: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:28.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.754+0000 7f279f1cf640 1 -- 172.21.15.118:0/1897389900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 msgr2=0x7f2798101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:28.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.754+0000 7f279f1cf640 1 --2- 172.21.15.118:0/1897389900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 0x7f2798101d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f278c009880 tx=0x7f278c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:42:28.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.754+0000 7f279f1cf640 1 -- 172.21.15.118:0/1897389900 shutdown_connections 2024-09-21T11:42:28.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.754+0000 7f279f1cf640 1 --2- 172.21.15.118:0/1897389900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2798102b90 0x7f2798103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:28.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.754+0000 7f279f1cf640 1 --2- 172.21.15.118:0/1897389900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 0x7f2798101d90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:28.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.754+0000 7f279f1cf640 1 -- 172.21.15.118:0/1897389900 >> 172.21.15.118:0/1897389900 conn(0x7f27980fd140 msgr2=0x7f27980ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:28.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.754+0000 7f279f1cf640 1 -- 172.21.15.118:0/1897389900 shutdown_connections 2024-09-21T11:42:28.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.754+0000 7f279f1cf640 1 -- 172.21.15.118:0/1897389900 wait complete. 2024-09-21T11:42:28.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f279f1cf640 1 Processor -- start 2024-09-21T11:42:28.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f279f1cf640 1 -- start start 2024-09-21T11:42:28.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f279f1cf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 0x7f27981974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:28.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f279f1cf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2798102b90 0x7f27981979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:28.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f279f1cf640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f279810a7b0 con 0x7f2798101990 2024-09-21T11:42:28.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f279f1cf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f279810a630 con 0x7f2798102b90 2024-09-21T11:42:28.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f279cf6b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 0x7f27981974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:28.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f279cf6b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 0x7f27981974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46760/0 (socket says 172.21.15.118:46760) 2024-09-21T11:42:28.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f279cf6b640 1 -- 172.21.15.118:0/446443024 learned_addr learned my addr 172.21.15.118:0/446443024 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:42:28.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.755+0000 7f2797fff640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2798102b90 0x7f27981979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:28.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.756+0000 7f279cf6b640 1 -- 172.21.15.118:0/446443024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2798102b90 msgr2=0x7f27981979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:28.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.756+0000 7f279cf6b640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2798102b90 0x7f27981979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:28.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.756+0000 7f279cf6b640 1 -- 172.21.15.118:0/446443024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2798197fe0 con 0x7f2798101990 2024-09-21T11:42:28.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.756+0000 7f279cf6b640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 0x7f27981974b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f278c006010 tx=0x7f278c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:28.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.756+0000 7f2795ffb640 1 -- 172.21.15.118:0/446443024 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f278c03f070 con 0x7f2798101990 2024-09-21T11:42:28.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.756+0000 7f2795ffb640 1 -- 172.21.15.118:0/446443024 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f278c0044d0 con 0x7f2798101990 2024-09-21T11:42:28.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.756+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279819c9f0 con 0x7f2798101990 2024-09-21T11:42:28.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.756+0000 7f2795ffb640 1 -- 172.21.15.118:0/446443024 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f278c035030 con 0x7f2798101990 2024-09-21T11:42:28.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.756+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279819cef0 con 0x7f2798101990 2024-09-21T11:42:28.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.757+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2798101d90 con 0x7f2798101990 2024-09-21T11:42:28.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.758+0000 7f2795ffb640 1 -- 172.21.15.118:0/446443024 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f278c042070 con 0x7f2798101990 2024-09-21T11:42:28.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.758+0000 7f2795ffb640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f278807af30 0x7f278807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:28.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.758+0000 7f2795ffb640 1 -- 172.21.15.118:0/446443024 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f278c0bece0 con 0x7f2798101990 2024-09-21T11:42:28.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.758+0000 7f2797fff640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f278807af30 0x7f278807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:28.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.759+0000 7f2797fff640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f278807af30 0x7f278807d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2784005e10 tx=0x7f2784005da0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:28.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.763+0000 7f2795ffb640 1 -- 172.21.15.118:0/446443024 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f278c08a2e0 con 0x7f2798101990 2024-09-21T11:42:28.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.965+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2798107100 con 0x7f278807af30 2024-09-21T11:42:28.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.966+0000 7f2795ffb640 1 -- 172.21.15.118:0/446443024 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f2798107100 con 0x7f278807af30 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.968+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f278807af30 msgr2=0x7f278807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.968+0000 7f279f1cf640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f278807af30 0x7f278807d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2784005e10 tx=0x7f2784005da0 comp rx=0 tx=0).stop 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.968+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 msgr2=0x7f27981974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.968+0000 7f279f1cf640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 0x7f27981974b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f278c006010 tx=0x7f278c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.968+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 shutdown_connections 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.968+0000 7f279f1cf640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2798102b90 0x7f27981979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.968+0000 7f279f1cf640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f278807af30 0x7f278807d3f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.968+0000 7f279f1cf640 1 --2- 172.21.15.118:0/446443024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2798101990 0x7f27981974b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.968+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 >> 172.21.15.118:0/446443024 conn(0x7f27980fd140 msgr2=0x7f27980ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.969+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 shutdown_connections 2024-09-21T11:42:28.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:28.969+0000 7f279f1cf640 1 -- 172.21.15.118:0/446443024 wait complete. 2024-09-21T11:42:28.980 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:42:29.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.052+0000 7ff7f943b640 1 -- 172.21.15.118:0/1179685340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 msgr2=0x7ff7f4103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.052+0000 7ff7f943b640 1 --2- 172.21.15.118:0/1179685340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 0x7ff7f4103010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009880 tx=0x7ff7dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.052+0000 7ff7f943b640 1 -- 172.21.15.118:0/1179685340 shutdown_connections 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.052+0000 7ff7f943b640 1 --2- 172.21.15.118:0/1179685340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 0x7ff7f4103010 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.052+0000 7ff7f943b640 1 --2- 172.21.15.118:0/1179685340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f4101990 0x7ff7f4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.052+0000 7ff7f943b640 1 -- 172.21.15.118:0/1179685340 >> 172.21.15.118:0/1179685340 conn(0x7ff7f40fd140 msgr2=0x7ff7f40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.053+0000 7ff7f943b640 1 -- 172.21.15.118:0/1179685340 shutdown_connections 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.053+0000 7ff7f943b640 1 -- 172.21.15.118:0/1179685340 wait complete. 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.053+0000 7ff7f943b640 1 Processor -- start 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.053+0000 7ff7f943b640 1 -- start start 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f943b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f4101990 0x7ff7f41974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f943b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 0x7ff7f4197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:29.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f943b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f410a7d0 con 0x7ff7f4102b90 2024-09-21T11:42:29.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f943b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f410a650 con 0x7ff7f4101990 2024-09-21T11:42:29.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f27fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 0x7ff7f4197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:29.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f27fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 0x7ff7f4197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46784/0 (socket says 172.21.15.118:46784) 2024-09-21T11:42:29.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f27fc640 1 -- 172.21.15.118:0/2427129119 learned_addr learned my addr 172.21.15.118:0/2427129119 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:42:29.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f2ffd640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f4101990 0x7ff7f41974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:29.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f27fc640 1 -- 172.21.15.118:0/2427129119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f4101990 msgr2=0x7ff7f41974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f27fc640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f4101990 0x7ff7f41974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f27fc640 1 -- 172.21.15.118:0/2427129119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f4198080 con 0x7ff7f4102b90 2024-09-21T11:42:29.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f27fc640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 0x7ff7f4197a00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc006010 tx=0x7ff7dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:29.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7ebfff640 1 -- 172.21.15.118:0/2427129119 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7dc03f070 con 0x7ff7f4102b90 2024-09-21T11:42:29.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7ebfff640 1 -- 172.21.15.118:0/2427129119 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7dc004ac0 con 0x7ff7f4102b90 2024-09-21T11:42:29.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.054+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f419ca60 con 0x7ff7f4102b90 2024-09-21T11:42:29.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.055+0000 7ff7ebfff640 1 -- 172.21.15.118:0/2427129119 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7dc035030 con 0x7ff7f4102b90 2024-09-21T11:42:29.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.055+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f419cff0 con 0x7ff7f4102b90 2024-09-21T11:42:29.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.056+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f4101d90 con 0x7ff7f4102b90 2024-09-21T11:42:29.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.056+0000 7ff7ebfff640 1 -- 172.21.15.118:0/2427129119 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff7dc042070 con 0x7ff7f4102b90 2024-09-21T11:42:29.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.057+0000 7ff7ebfff640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff7e007af30 0x7ff7e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:29.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.057+0000 7ff7f2ffd640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff7e007af30 0x7ff7e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:29.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.057+0000 7ff7ebfff640 1 -- 172.21.15.118:0/2427129119 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7ff7dc0bebc0 con 0x7ff7f4102b90 2024-09-21T11:42:29.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.057+0000 7ff7f2ffd640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff7e007af30 0x7ff7e007d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7f41029f0 tx=0x7ff7e4009680 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:29.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.062+0000 7ff7ebfff640 1 -- 172.21.15.118:0/2427129119 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff7dc08a1c0 con 0x7ff7f4102b90 2024-09-21T11:42:29.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.264+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff7f4062630 con 0x7ff7e007af30 2024-09-21T11:42:29.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.265+0000 7ff7ebfff640 1 -- 172.21.15.118:0/2427129119 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7ff7f4062630 con 0x7ff7e007af30 2024-09-21T11:42:29.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff7e007af30 msgr2=0x7ff7e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff7e007af30 0x7ff7e007d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7f41029f0 tx=0x7ff7e4009680 comp rx=0 tx=0).stop 2024-09-21T11:42:29.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 msgr2=0x7ff7f4197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 0x7ff7f4197a00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc006010 tx=0x7ff7dc0046c0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 shutdown_connections 2024-09-21T11:42:29.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff7e007af30 0x7ff7e007d3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7f4102b90 0x7ff7f4197a00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 --2- 172.21.15.118:0/2427129119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f4101990 0x7ff7f41974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 >> 172.21.15.118:0/2427129119 conn(0x7ff7f40fd140 msgr2=0x7ff7f4106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:29.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 shutdown_connections 2024-09-21T11:42:29.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.268+0000 7ff7f943b640 1 -- 172.21.15.118:0/2427129119 wait complete. 2024-09-21T11:42:29.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 -- 172.21.15.118:0/370283193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c104d40 msgr2=0x7fa87c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 --2- 172.21.15.118:0/370283193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c104d40 0x7fa87c107130 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0098b0 tx=0x7fa86c02a4d0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 -- 172.21.15.118:0/370283193 shutdown_connections 2024-09-21T11:42:29.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 --2- 172.21.15.118:0/370283193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c104d40 0x7fa87c107130 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 --2- 172.21.15.118:0/370283193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa87c102410 0x7fa87c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 -- 172.21.15.118:0/370283193 >> 172.21.15.118:0/370283193 conn(0x7fa87c0fc010 msgr2=0x7fa87c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:29.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 -- 172.21.15.118:0/370283193 shutdown_connections 2024-09-21T11:42:29.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 -- 172.21.15.118:0/370283193 wait complete. 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 Processor -- start 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.351+0000 7fa8835e2640 1 -- start start 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa8835e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c102410 0x7fa87c101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa8835e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa87c104d40 0x7fa87c1003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa8835e2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c10a7d0 con 0x7fa87c102410 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa8835e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c10a650 con 0x7fa87c104d40 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa88137e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c102410 0x7fa87c101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa88137e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c102410 0x7fa87c101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46804/0 (socket says 172.21.15.118:46804) 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa88137e640 1 -- 172.21.15.118:0/1132371328 learned_addr learned my addr 172.21.15.118:0/1132371328 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa880b7d640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa87c104d40 0x7fa87c1003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa88137e640 1 -- 172.21.15.118:0/1132371328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa87c104d40 msgr2=0x7fa87c1003c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa88137e640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa87c104d40 0x7fa87c1003c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa88137e640 1 -- 172.21.15.118:0/1132371328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c100900 con 0x7fa87c102410 2024-09-21T11:42:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa88137e640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c102410 0x7fa87c101d00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa87800c8f0 tx=0x7fa87800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa8727fc640 1 -- 172.21.15.118:0/1132371328 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa8780079b0 con 0x7fa87c102410 2024-09-21T11:42:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87c100bf0 con 0x7fa87c102410 2024-09-21T11:42:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa8727fc640 1 -- 172.21.15.118:0/1132371328 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8780054e0 con 0x7fa87c102410 2024-09-21T11:42:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.352+0000 7fa8727fc640 1 -- 172.21.15.118:0/1132371328 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa878004dd0 con 0x7fa87c102410 2024-09-21T11:42:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.353+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87c101150 con 0x7fa87c102410 2024-09-21T11:42:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.353+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87c1027f0 con 0x7fa87c102410 2024-09-21T11:42:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.354+0000 7fa8727fc640 1 -- 172.21.15.118:0/1132371328 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa878005020 con 0x7fa87c102410 2024-09-21T11:42:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.355+0000 7fa8727fc640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa86807aed0 0x7fa86807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.355+0000 7fa880b7d640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa86807aed0 0x7fa86807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.355+0000 7fa8727fc640 1 -- 172.21.15.118:0/1132371328 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fa87809dfe0 con 0x7fa87c102410 2024-09-21T11:42:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.355+0000 7fa880b7d640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa86807aed0 0x7fa86807d390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa86c006010 tx=0x7fa86c009580 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:29.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.360+0000 7fa8727fc640 1 -- 172.21.15.118:0/1132371328 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa878014030 con 0x7fa87c102410 2024-09-21T11:42:29.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.569+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa87c19f5b0 con 0x7fa86807aed0 2024-09-21T11:42:29.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.579+0000 7fa8727fc640 1 -- 172.21.15.118:0/1132371328 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa87c19f5b0 con 0x7fa86807aed0 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (24s) 18s ago 11m 16.8M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (3m) 18s ago 11m 8644k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (2m) 66s ago 10m 8094k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (11m) 18s ago 11m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (10m) 66s ago 10m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (9m) 18s ago 11m 78.8M - 9.4.12 2bacad6d85d8 59cdffe8b090 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (6m) 18s ago 6m 149M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (5m) 18s ago 5m 27.3M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (5m) 66s ago 5m 20.9M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (5m) 66s ago 5m 14.7M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (2m) 18s ago 12m 512M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:42:29.582 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (97s) 66s ago 10m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (12m) 18s ago 12m 59.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (10m) 66s ago 10m 46.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (75s) 18s ago 11m 9311k - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (69s) 66s ago 10m 3506k - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (9m) 18s ago 9m 204M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (8m) 18s ago 8m 228M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (8m) 18s ago 8m 184M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (7m) 66s ago 7m 258M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (7m) 66s ago 7m 210M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (7m) 66s ago 7m 205M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:42:29.583 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (44s) 18s ago 10m 44.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:42:29.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.581+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa86807aed0 msgr2=0x7fa86807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.581+0000 7fa8835e2640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa86807aed0 0x7fa86807d390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa86c006010 tx=0x7fa86c009580 comp rx=0 tx=0).stop 2024-09-21T11:42:29.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.581+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c102410 msgr2=0x7fa87c101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.581+0000 7fa8835e2640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c102410 0x7fa87c101d00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa87800c8f0 tx=0x7fa87800cdb0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.581+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 shutdown_connections 2024-09-21T11:42:29.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.581+0000 7fa8835e2640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa87c104d40 0x7fa87c1003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.581+0000 7fa8835e2640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa86807aed0 0x7fa86807d390 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.581+0000 7fa8835e2640 1 --2- 172.21.15.118:0/1132371328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa87c102410 0x7fa87c101d00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.582+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 >> 172.21.15.118:0/1132371328 conn(0x7fa87c0fc010 msgr2=0x7fa87c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:29.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.582+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 shutdown_connections 2024-09-21T11:42:29.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.582+0000 7fa8835e2640 1 -- 172.21.15.118:0/1132371328 wait complete. 2024-09-21T11:42:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.665+0000 7f9794198640 1 -- 172.21.15.118:0/3913482734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c102450 msgr2=0x7f978c104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.665+0000 7f9794198640 1 --2- 172.21.15.118:0/3913482734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c102450 0x7f978c104840 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f977c009880 tx=0x7f977c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.665+0000 7f9794198640 1 -- 172.21.15.118:0/3913482734 shutdown_connections 2024-09-21T11:42:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.665+0000 7f9794198640 1 --2- 172.21.15.118:0/3913482734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f978c104d80 0x7f978c107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.665+0000 7f9794198640 1 --2- 172.21.15.118:0/3913482734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c102450 0x7f978c104840 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.665+0000 7f9794198640 1 -- 172.21.15.118:0/3913482734 >> 172.21.15.118:0/3913482734 conn(0x7f978c0fbff0 msgr2=0x7f978c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.666+0000 7f9794198640 1 -- 172.21.15.118:0/3913482734 shutdown_connections 2024-09-21T11:42:29.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.666+0000 7f9794198640 1 -- 172.21.15.118:0/3913482734 wait complete. 2024-09-21T11:42:29.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.666+0000 7f9794198640 1 Processor -- start 2024-09-21T11:42:29.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.666+0000 7f9794198640 1 -- start start 2024-09-21T11:42:29.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9794198640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f978c102450 0x7f978c197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9794198640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c104d80 0x7f978c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9794198640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f978c10a800 con 0x7f978c104d80 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9794198640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f978c10a680 con 0x7f978c102450 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9791733640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c104d80 0x7f978c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9791733640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c104d80 0x7f978c197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46816/0 (socket says 172.21.15.118:46816) 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9791733640 1 -- 172.21.15.118:0/83933026 learned_addr learned my addr 172.21.15.118:0/83933026 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9791f34640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f978c102450 0x7f978c197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9791733640 1 -- 172.21.15.118:0/83933026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f978c102450 msgr2=0x7f978c197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9791733640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f978c102450 0x7f978c197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9791733640 1 -- 172.21.15.118:0/83933026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c1980e0 con 0x7f978c104d80 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9791f34640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f978c102450 0x7f978c197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9791733640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c104d80 0x7f978c197a60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f978800b3d0 tx=0x7f978800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.667+0000 7f9782ffd640 1 -- 172.21.15.118:0/83933026 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9788015020 con 0x7f978c104d80 2024-09-21T11:42:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.668+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978c19cb20 con 0x7f978c104d80 2024-09-21T11:42:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.668+0000 7f9782ffd640 1 -- 172.21.15.118:0/83933026 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9788011af0 con 0x7f978c104d80 2024-09-21T11:42:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.668+0000 7f9782ffd640 1 -- 172.21.15.118:0/83933026 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9788010d30 con 0x7f978c104d80 2024-09-21T11:42:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.668+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978c19d130 con 0x7f978c104d80 2024-09-21T11:42:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.669+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978c102830 con 0x7f978c104d80 2024-09-21T11:42:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.669+0000 7f9782ffd640 1 -- 172.21.15.118:0/83933026 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9788018020 con 0x7f978c104d80 2024-09-21T11:42:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.670+0000 7f9782ffd640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f977807af30 0x7f977807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.670+0000 7f9782ffd640 1 -- 172.21.15.118:0/83933026 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f978809da00 con 0x7f978c104d80 2024-09-21T11:42:29.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.670+0000 7f9791f34640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f977807af30 0x7f977807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:29.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.670+0000 7f9791f34640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f977807af30 0x7f977807d3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f977c005ab0 tx=0x7f977c005a20 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:29.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.674+0000 7f9782ffd640 1 -- 172.21.15.118:0/83933026 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f978801f020 con 0x7f978c104d80 2024-09-21T11:42:29.866 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:29 smithi118 ceph-mon[28757]: pgmap v75: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:29.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:29 smithi149 ceph-mon[36123]: pgmap v75: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:29.959 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:42:29.959 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:42:29.959 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:42:29.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:42:29.960 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:42:29.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.956+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f978c100a30 con 0x7f978c104d80 2024-09-21T11:42:29.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.957+0000 7f9782ffd640 1 -- 172.21.15.118:0/83933026 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f9788069000 con 0x7f978c104d80 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f977807af30 msgr2=0x7f977807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f977807af30 0x7f977807d3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f977c005ab0 tx=0x7f977c005a20 comp rx=0 tx=0).stop 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c104d80 msgr2=0x7f978c197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c104d80 0x7f978c197a60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f978800b3d0 tx=0x7f978800b890 comp rx=0 tx=0).stop 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 shutdown_connections 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f977807af30 0x7f977807d3f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f978c104d80 0x7f978c197a60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 --2- 172.21.15.118:0/83933026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f978c102450 0x7f978c197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 >> 172.21.15.118:0/83933026 conn(0x7f978c0fbff0 msgr2=0x7f978c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 shutdown_connections 2024-09-21T11:42:29.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:29.959+0000 7f9794198640 1 -- 172.21.15.118:0/83933026 wait complete. 2024-09-21T11:42:30.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.046+0000 7f1e266e2640 1 -- 172.21.15.118:0/3793644915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 msgr2=0x7f1e20101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:30.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.046+0000 7f1e266e2640 1 --2- 172.21.15.118:0/3793644915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 0x7f1e20101d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009880 tx=0x7f1e1002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:42:30.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.046+0000 7f1e266e2640 1 -- 172.21.15.118:0/3793644915 shutdown_connections 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.046+0000 7f1e266e2640 1 --2- 172.21.15.118:0/3793644915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e20102b90 0x7f1e20103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.046+0000 7f1e266e2640 1 --2- 172.21.15.118:0/3793644915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 0x7f1e20101d90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.046+0000 7f1e266e2640 1 -- 172.21.15.118:0/3793644915 >> 172.21.15.118:0/3793644915 conn(0x7f1e200fd140 msgr2=0x7f1e200ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.046+0000 7f1e266e2640 1 -- 172.21.15.118:0/3793644915 shutdown_connections 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.046+0000 7f1e266e2640 1 -- 172.21.15.118:0/3793644915 wait complete. 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e266e2640 1 Processor -- start 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e266e2640 1 -- start start 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e266e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 0x7f1e20197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e266e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e20102b90 0x7f1e20197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e266e2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2010a830 con 0x7f1e20101990 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e266e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2010a6b0 con 0x7f1e20102b90 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e1ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 0x7f1e20197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e1ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 0x7f1e20197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46840/0 (socket says 172.21.15.118:46840) 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e1ffff640 1 -- 172.21.15.118:0/482884415 learned_addr learned my addr 172.21.15.118:0/482884415 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:42:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e17fff640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e20102b90 0x7f1e20197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:30.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e1ffff640 1 -- 172.21.15.118:0/482884415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e20102b90 msgr2=0x7f1e20197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:30.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e1ffff640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e20102b90 0x7f1e20197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:30.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.047+0000 7f1e1ffff640 1 -- 172.21.15.118:0/482884415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e201980f0 con 0x7f1e20101990 2024-09-21T11:42:30.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.048+0000 7f1e1ffff640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 0x7f1e20197530 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1e10006010 tx=0x7f1e100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:30.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.048+0000 7f1e1dffb640 1 -- 172.21.15.118:0/482884415 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e1003f070 con 0x7f1e20101990 2024-09-21T11:42:30.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.048+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2019cad0 con 0x7f1e20101990 2024-09-21T11:42:30.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.048+0000 7f1e1dffb640 1 -- 172.21.15.118:0/482884415 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e100044d0 con 0x7f1e20101990 2024-09-21T11:42:30.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.048+0000 7f1e1dffb640 1 -- 172.21.15.118:0/482884415 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e10035030 con 0x7f1e20101990 2024-09-21T11:42:30.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.048+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e2019d060 con 0x7f1e20101990 2024-09-21T11:42:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.049+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e20101d90 con 0x7f1e20101990 2024-09-21T11:42:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.049+0000 7f1e1dffb640 1 -- 172.21.15.118:0/482884415 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1e10042070 con 0x7f1e20101990 2024-09-21T11:42:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.050+0000 7f1e1dffb640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e0c07af80 0x7f1e0c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:42:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.050+0000 7f1e1dffb640 1 -- 172.21.15.118:0/482884415 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1e100beba0 con 0x7f1e20101990 2024-09-21T11:42:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.050+0000 7f1e17fff640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e0c07af80 0x7f1e0c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:42:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.050+0000 7f1e17fff640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e0c07af80 0x7f1e0c07d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e201989e0 tx=0x7f1e08008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:42:30.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.055+0000 7f1e1dffb640 1 -- 172.21.15.118:0/482884415 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1e1008a220 con 0x7f1e20101990 2024-09-21T11:42:30.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.254+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1e200626f0 con 0x7f1e0c07af80 2024-09-21T11:42:30.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.256+0000 7f1e1dffb640 1 -- 172.21.15.118:0/482884415 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f1e200626f0 con 0x7f1e0c07af80 2024-09-21T11:42:30.258 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:42:30.258 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:42:30.258 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:42:30.258 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T11:42:30.258 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:42:30.258 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:42:30.258 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:42:30.258 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T11:42:30.259 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading grafana daemons", 2024-09-21T11:42:30.259 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:42:30.259 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:42:30.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.257+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e0c07af80 msgr2=0x7f1e0c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:30.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.257+0000 7f1e266e2640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e0c07af80 0x7f1e0c07d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e201989e0 tx=0x7f1e08008040 comp rx=0 tx=0).stop 2024-09-21T11:42:30.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.258+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 msgr2=0x7f1e20197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:42:30.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.258+0000 7f1e266e2640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 0x7f1e20197530 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1e10006010 tx=0x7f1e100048f0 comp rx=0 tx=0).stop 2024-09-21T11:42:30.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.258+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 shutdown_connections 2024-09-21T11:42:30.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.258+0000 7f1e266e2640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e20102b90 0x7f1e20197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:30.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.258+0000 7f1e266e2640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e0c07af80 0x7f1e0c07d440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:30.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.258+0000 7f1e266e2640 1 --2- 172.21.15.118:0/482884415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e20101990 0x7f1e20197530 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:42:30.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.258+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 >> 172.21.15.118:0/482884415 conn(0x7f1e200fd140 msgr2=0x7f1e201060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:42:30.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.258+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 shutdown_connections 2024-09-21T11:42:30.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:42:30.258+0000 7f1e266e2640 1 -- 172.21.15.118:0/482884415 wait complete. 2024-09-21T11:42:30.756 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:30 smithi118 ceph-mon[28757]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:30.756 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:30 smithi118 ceph-mon[28757]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:30.756 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:30 smithi118 ceph-mon[28757]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:30.756 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:30 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/83933026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:30.756 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:30.756 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:30.756 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:30 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:30 smithi149 ceph-mon[36123]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:30 smithi149 ceph-mon[36123]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:30 smithi149 ceph-mon[36123]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:30 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/83933026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:30 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:31 smithi118 ceph-mon[28757]: pgmap v76: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:31 smithi118 ceph-mon[28757]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:31 smithi149 ceph-mon[36123]: pgmap v76: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:31 smithi149 ceph-mon[36123]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:42:33.891 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:33 smithi118 ceph-mon[28757]: pgmap v77: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:33.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:33 smithi149 ceph-mon[36123]: pgmap v77: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:35 smithi149 ceph-mon[36123]: pgmap v78: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:35 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:42:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:35 smithi118 ceph-mon[28757]: pgmap v78: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:35 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:42:36.963 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:36 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:36.963 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:36 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:36.963 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:36 smithi118 ceph-mon[28757]: pgmap v79: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:36.963 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:36 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:36.963 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:36 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:37.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:36 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:37.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:36 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:37.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:36 smithi149 ceph-mon[36123]: pgmap v79: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:37.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:36 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:37.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:36 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:39.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:39 smithi149 ceph-mon[36123]: pgmap v80: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:39.494 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:39 smithi118 ceph-mon[28757]: pgmap v80: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: Upgrade: Finalizing container_image settings 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T11:42:40.827 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T11:42:40.827 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.827 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T11:42:40.827 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T11:42:40.827 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T11:42:40.827 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T11:42:40.827 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T11:42:40.827 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.828 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.829 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:40 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: Upgrade: Finalizing container_image settings 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T11:42:40.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:40.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:42:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:41 smithi118 ceph-mon[28757]: Upgrade: Complete! 2024-09-21T11:42:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:41 smithi118 ceph-mon[28757]: pgmap v81: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:41 smithi149 ceph-mon[36123]: Upgrade: Complete! 2024-09-21T11:42:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:41 smithi149 ceph-mon[36123]: pgmap v81: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:43 smithi118 ceph-mon[28757]: pgmap v82: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:43.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:43 smithi149 ceph-mon[36123]: pgmap v82: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:45 smithi118 ceph-mon[28757]: pgmap v83: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:45 smithi149 ceph-mon[36123]: pgmap v83: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:47 smithi118 ceph-mon[28757]: pgmap v84: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:47 smithi149 ceph-mon[36123]: pgmap v84: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:49 smithi118 ceph-mon[28757]: pgmap v85: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:49 smithi149 ceph-mon[36123]: pgmap v85: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:50 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:42:50.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:50 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:42:51.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:51 smithi118 ceph-mon[28757]: pgmap v86: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:51.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:51 smithi149 ceph-mon[36123]: pgmap v86: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:53 smithi118 ceph-mon[28757]: pgmap v87: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:53.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:53 smithi149 ceph-mon[36123]: pgmap v87: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:55.602 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:55 smithi118 ceph-mon[28757]: pgmap v88: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:55.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:55 smithi149 ceph-mon[36123]: pgmap v88: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:57 smithi118 ceph-mon[28757]: pgmap v89: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:57.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:57 smithi149 ceph-mon[36123]: pgmap v89: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:42:59 smithi118 ceph-mon[28757]: pgmap v90: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:42:59.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:42:59 smithi149 ceph-mon[36123]: pgmap v90: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:00.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.354+0000 7f20a24ab640 1 -- 172.21.15.118:0/4179313336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c104d40 msgr2=0x7f209c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:00.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.354+0000 7f20a24ab640 1 --2- 172.21.15.118:0/4179313336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c104d40 0x7f209c107130 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f20900098b0 tx=0x7f209002a4d0 comp rx=0 tx=0).stop 2024-09-21T11:43:00.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.354+0000 7f20a24ab640 1 -- 172.21.15.118:0/4179313336 shutdown_connections 2024-09-21T11:43:00.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.354+0000 7f20a24ab640 1 --2- 172.21.15.118:0/4179313336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c104d40 0x7f209c107130 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:00.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.354+0000 7f20a24ab640 1 --2- 172.21.15.118:0/4179313336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f209c102410 0x7f209c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.354+0000 7f20a24ab640 1 -- 172.21.15.118:0/4179313336 >> 172.21.15.118:0/4179313336 conn(0x7f209c0fc010 msgr2=0x7f209c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.355+0000 7f20a24ab640 1 -- 172.21.15.118:0/4179313336 shutdown_connections 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.355+0000 7f20a24ab640 1 -- 172.21.15.118:0/4179313336 wait complete. 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.355+0000 7f20a24ab640 1 Processor -- start 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.355+0000 7f20a24ab640 1 -- start start 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f20a24ab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c102410 0x7f209c1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f20a24ab640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f209c104d40 0x7f209c197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f20a24ab640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10a7d0 con 0x7f209c102410 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f20a24ab640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10a650 con 0x7f209c104d40 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f209bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c102410 0x7f209c1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f209bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c102410 0x7f209c1974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56320/0 (socket says 172.21.15.118:56320) 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f209bfff640 1 -- 172.21.15.118:0/3822215686 learned_addr learned my addr 172.21.15.118:0/3822215686 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f209b7fe640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f209c104d40 0x7f209c197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:00.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f209bfff640 1 -- 172.21.15.118:0/3822215686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f209c104d40 msgr2=0x7f209c197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:00.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f209bfff640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f209c104d40 0x7f209c197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:00.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f209bfff640 1 -- 172.21.15.118:0/3822215686 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c1980b0 con 0x7f209c102410 2024-09-21T11:43:00.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f209bfff640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c102410 0x7f209c1974f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c8f0 tx=0x7f208c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:00.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.356+0000 7f20997fa640 1 -- 172.21.15.118:0/3822215686 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f208c0079b0 con 0x7f209c102410 2024-09-21T11:43:00.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.357+0000 7f20997fa640 1 -- 172.21.15.118:0/3822215686 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f208c0054e0 con 0x7f209c102410 2024-09-21T11:43:00.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.357+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c19caf0 con 0x7f209c102410 2024-09-21T11:43:00.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.357+0000 7f20997fa640 1 -- 172.21.15.118:0/3822215686 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f208c004dd0 con 0x7f209c102410 2024-09-21T11:43:00.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.357+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c19d050 con 0x7f209c102410 2024-09-21T11:43:00.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.358+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c10afb0 con 0x7f209c102410 2024-09-21T11:43:00.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.358+0000 7f20997fa640 1 -- 172.21.15.118:0/3822215686 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f208c005020 con 0x7f209c102410 2024-09-21T11:43:00.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.359+0000 7f20997fa640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f208407aed0 0x7f208407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:00.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.359+0000 7f20997fa640 1 -- 172.21.15.118:0/3822215686 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f208c09dfc0 con 0x7f209c102410 2024-09-21T11:43:00.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.359+0000 7f209b7fe640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f208407aed0 0x7f208407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:00.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.360+0000 7f209b7fe640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f208407aed0 0x7f208407d390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2090009880 tx=0x7f20900058d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:00.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.364+0000 7f20997fa640 1 -- 172.21.15.118:0/3822215686 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f208c014030 con 0x7f209c102410 2024-09-21T11:43:00.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.556+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f209c105600 con 0x7f208407aed0 2024-09-21T11:43:00.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.557+0000 7f20997fa640 1 -- 172.21.15.118:0/3822215686 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f209c105600 con 0x7f208407aed0 2024-09-21T11:43:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f208407aed0 msgr2=0x7f208407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f208407aed0 0x7f208407d390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2090009880 tx=0x7f20900058d0 comp rx=0 tx=0).stop 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c102410 msgr2=0x7f209c1974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c102410 0x7f209c1974f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c8f0 tx=0x7f208c00cdb0 comp rx=0 tx=0).stop 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 shutdown_connections 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f209c104d40 0x7f209c197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f208407aed0 0x7f208407d390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 --2- 172.21.15.118:0/3822215686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f209c102410 0x7f209c1974f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 >> 172.21.15.118:0/3822215686 conn(0x7f209c0fc010 msgr2=0x7f209c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 shutdown_connections 2024-09-21T11:43:00.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:00.559+0000 7f20a24ab640 1 -- 172.21.15.118:0/3822215686 wait complete. 2024-09-21T11:43:01.773 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:01 smithi118 ceph-mon[28757]: pgmap v91: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:01.774 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:01 smithi118 ceph-mon[28757]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:01.800 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-21T11:43:01.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:01 smithi149 ceph-mon[36123]: pgmap v91: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:01.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:01 smithi149 ceph-mon[36123]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:02.052 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:02.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.539+0000 7f32a1b90640 1 -- 172.21.15.118:0/3039408421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c102aa0 msgr2=0x7f329c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:02.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.539+0000 7f32a1b90640 1 --2- 172.21.15.118:0/3039408421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c102aa0 0x7f329c102e80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3294009c20 tx=0x7f329402aa00 comp rx=0 tx=0).stop 2024-09-21T11:43:02.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.539+0000 7f32a1b90640 1 -- 172.21.15.118:0/3039408421 shutdown_connections 2024-09-21T11:43:02.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.539+0000 7f32a1b90640 1 --2- 172.21.15.118:0/3039408421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c1033c0 0x7f329c10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:02.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.539+0000 7f32a1b90640 1 --2- 172.21.15.118:0/3039408421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c102aa0 0x7f329c102e80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:02.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.539+0000 7f32a1b90640 1 -- 172.21.15.118:0/3039408421 >> 172.21.15.118:0/3039408421 conn(0x7f329c0fc4c0 msgr2=0x7f329c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:02.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.539+0000 7f32a1b90640 1 -- 172.21.15.118:0/3039408421 shutdown_connections 2024-09-21T11:43:02.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.539+0000 7f32a1b90640 1 -- 172.21.15.118:0/3039408421 wait complete. 2024-09-21T11:43:02.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.539+0000 7f32a1b90640 1 Processor -- start 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f32a1b90640 1 -- start start 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f32a1b90640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c102aa0 0x7f329c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f32a1b90640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c1033c0 0x7f329c19dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f32a1b90640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f329c10ee30 con 0x7f329c1033c0 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f32a1b90640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f329c10ecb0 con 0x7f329c102aa0 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f329affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c1033c0 0x7f329c19dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f329affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c1033c0 0x7f329c19dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56342/0 (socket says 172.21.15.118:56342) 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f329affd640 1 -- 172.21.15.118:0/3550923670 learned_addr learned my addr 172.21.15.118:0/3550923670 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f329b7fe640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c102aa0 0x7f329c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f329affd640 1 -- 172.21.15.118:0/3550923670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c102aa0 msgr2=0x7f329c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f329affd640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c102aa0 0x7f329c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f329affd640 1 -- 172.21.15.118:0/3550923670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329c1978c0 con 0x7f329c1033c0 2024-09-21T11:43:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f329b7fe640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c102aa0 0x7f329c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.540+0000 7f329affd640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c1033c0 0x7f329c19dc40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f328400b370 tx=0x7f328400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.541+0000 7f3298ff9640 1 -- 172.21.15.118:0/3550923670 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3284015020 con 0x7f329c1033c0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.541+0000 7f3298ff9640 1 -- 172.21.15.118:0/3550923670 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3284011af0 con 0x7f329c1033c0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.541+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329c197bb0 con 0x7f329c1033c0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.541+0000 7f3298ff9640 1 -- 172.21.15.118:0/3550923670 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3284010d60 con 0x7f329c1033c0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.541+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f329c198140 con 0x7f329c1033c0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.542+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329c06a410 con 0x7f329c1033c0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.542+0000 7f3298ff9640 1 -- 172.21.15.118:0/3550923670 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3284018020 con 0x7f329c1033c0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.543+0000 7f3298ff9640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f328807af90 0x7f328807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.543+0000 7f3298ff9640 1 -- 172.21.15.118:0/3550923670 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f328409d8c0 con 0x7f329c1033c0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.543+0000 7f329b7fe640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f328807af90 0x7f328807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.544+0000 7f329b7fe640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f328807af90 0x7f328807d450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3294006010 tx=0x7f329402e9b0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:02.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.547+0000 7f3298ff9640 1 -- 172.21.15.118:0/3550923670 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f328401f020 con 0x7f329c1033c0 2024-09-21T11:43:02.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.798+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f329c105fd0 con 0x7f329c1033c0 2024-09-21T11:43:02.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.798+0000 7f3298ff9640 1 -- 172.21.15.118:0/3550923670 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f3284068f40 con 0x7f329c1033c0 2024-09-21T11:43:02.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f328807af90 msgr2=0x7f328807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f328807af90 0x7f328807d450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3294006010 tx=0x7f329402e9b0 comp rx=0 tx=0).stop 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c1033c0 msgr2=0x7f329c19dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c1033c0 0x7f329c19dc40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f328400b370 tx=0x7f328400b830 comp rx=0 tx=0).stop 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 shutdown_connections 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f328807af90 0x7f328807d450 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f329c1033c0 0x7f329c19dc40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 --2- 172.21.15.118:0/3550923670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c102aa0 0x7f329c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 >> 172.21.15.118:0/3550923670 conn(0x7f329c0fc4c0 msgr2=0x7f329c108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 shutdown_connections 2024-09-21T11:43:02.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:02.801+0000 7f32a1b90640 1 -- 172.21.15.118:0/3550923670 wait complete. 2024-09-21T11:43:02.811 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:43:03.496 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-21T11:43:03.750 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:03 smithi118 ceph-mon[28757]: pgmap v92: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:03 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3550923670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:03 smithi149 ceph-mon[36123]: pgmap v92: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:03 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3550923670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:04.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.231+0000 7fdefdc55640 1 -- 172.21.15.118:0/3420723358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8103400 msgr2=0x7fdef810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:04.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.231+0000 7fdefdc55640 1 --2- 172.21.15.118:0/3420723358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8103400 0x7fdef810b8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009880 tx=0x7fdeec02a540 comp rx=0 tx=0).stop 2024-09-21T11:43:04.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.231+0000 7fdefdc55640 1 -- 172.21.15.118:0/3420723358 shutdown_connections 2024-09-21T11:43:04.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.231+0000 7fdefdc55640 1 --2- 172.21.15.118:0/3420723358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8103400 0x7fdef810b8f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:04.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.231+0000 7fdefdc55640 1 --2- 172.21.15.118:0/3420723358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdef8102ae0 0x7fdef8102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:04.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.231+0000 7fdefdc55640 1 -- 172.21.15.118:0/3420723358 >> 172.21.15.118:0/3420723358 conn(0x7fdef80fc520 msgr2=0x7fdef80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.231+0000 7fdefdc55640 1 -- 172.21.15.118:0/3420723358 shutdown_connections 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.231+0000 7fdefdc55640 1 -- 172.21.15.118:0/3420723358 wait complete. 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.232+0000 7fdefdc55640 1 Processor -- start 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.232+0000 7fdefdc55640 1 -- start start 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.232+0000 7fdefdc55640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8102ae0 0x7fdef819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.232+0000 7fdefdc55640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdef8103400 0x7fdef819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.232+0000 7fdefdc55640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdef810ee70 con 0x7fdef8102ae0 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.232+0000 7fdefdc55640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdef810ecf0 con 0x7fdef8103400 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8102ae0 0x7fdef819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8102ae0 0x7fdef819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56356/0 (socket says 172.21.15.118:56356) 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef77fe640 1 -- 172.21.15.118:0/2087312954 learned_addr learned my addr 172.21.15.118:0/2087312954 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef77fe640 1 -- 172.21.15.118:0/2087312954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdef8103400 msgr2=0x7fdef819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef77fe640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdef8103400 0x7fdef819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef77fe640 1 -- 172.21.15.118:0/2087312954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef8197880 con 0x7fdef8102ae0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef77fe640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8102ae0 0x7fdef819d6c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdee800b420 tx=0x7fdee800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef4ff9640 1 -- 172.21.15.118:0/2087312954 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdee8011630 con 0x7fdef8102ae0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef8197b70 con 0x7fdef8102ae0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef4ff9640 1 -- 172.21.15.118:0/2087312954 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdee8016070 con 0x7fdef8102ae0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdef4ff9640 1 -- 172.21.15.118:0/2087312954 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdee8010d40 con 0x7fdef8102ae0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.233+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef8198100 con 0x7fdef8102ae0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.234+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef806abe0 con 0x7fdef8102ae0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.235+0000 7fdef4ff9640 1 -- 172.21.15.118:0/2087312954 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fdee801b460 con 0x7fdef8102ae0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.235+0000 7fdef4ff9640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdee007af30 0x7fdee007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.235+0000 7fdef4ff9640 1 -- 172.21.15.118:0/2087312954 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fdee809d740 con 0x7fdef8102ae0 2024-09-21T11:43:04.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.235+0000 7fdef6ffd640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdee007af30 0x7fdee007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.236+0000 7fdef6ffd640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdee007af30 0x7fdee007d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0096c0 tx=0x7fdeec000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.240+0000 7fdef4ff9640 1 -- 172.21.15.118:0/2087312954 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fdee8021250 con 0x7fdef8102ae0 2024-09-21T11:43:04.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.486+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fdef8198db0 con 0x7fdef8102ae0 2024-09-21T11:43:04.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.486+0000 7fdef4ff9640 1 -- 172.21.15.118:0/2087312954 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fdee8068d40 con 0x7fdef8102ae0 2024-09-21T11:43:04.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdee007af30 msgr2=0x7fdee007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:04.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdee007af30 0x7fdee007d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0096c0 tx=0x7fdeec000bc0 comp rx=0 tx=0).stop 2024-09-21T11:43:04.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8102ae0 msgr2=0x7fdef819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:04.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8102ae0 0x7fdef819d6c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdee800b420 tx=0x7fdee800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:43:04.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 shutdown_connections 2024-09-21T11:43:04.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdef8103400 0x7fdef819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:04.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdee007af30 0x7fdee007d3f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:04.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 --2- 172.21.15.118:0/2087312954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef8102ae0 0x7fdef819d6c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:04.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 >> 172.21.15.118:0/2087312954 conn(0x7fdef80fc520 msgr2=0x7fdef8108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:04.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.488+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 shutdown_connections 2024-09-21T11:43:04.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:04.489+0000 7fdefdc55640 1 -- 172.21.15.118:0/2087312954 wait complete. 2024-09-21T11:43:04.498 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)" 2024-09-21T11:43:04.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:04 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/2087312954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:04.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:04 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/2087312954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:05.121 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-21T11:43:05.370 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:05.801 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:05 smithi118 ceph-mon[28757]: pgmap v93: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:05.801 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:05 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.799+0000 7f1d6971a640 1 -- 172.21.15.118:0/584777598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d64102aa0 msgr2=0x7f1d64102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.799+0000 7f1d6971a640 1 --2- 172.21.15.118:0/584777598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d64102aa0 0x7f1d64102e80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009880 tx=0x7f1d5402a530 comp rx=0 tx=0).stop 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.799+0000 7f1d6971a640 1 -- 172.21.15.118:0/584777598 shutdown_connections 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.799+0000 7f1d6971a640 1 --2- 172.21.15.118:0/584777598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d641033c0 0x7f1d6410b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.799+0000 7f1d6971a640 1 --2- 172.21.15.118:0/584777598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d64102aa0 0x7f1d64102e80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.799+0000 7f1d6971a640 1 -- 172.21.15.118:0/584777598 >> 172.21.15.118:0/584777598 conn(0x7f1d640fc4c0 msgr2=0x7f1d640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.799+0000 7f1d6971a640 1 -- 172.21.15.118:0/584777598 shutdown_connections 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.799+0000 7f1d6971a640 1 -- 172.21.15.118:0/584777598 wait complete. 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.800+0000 7f1d6971a640 1 Processor -- start 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.800+0000 7f1d6971a640 1 -- start start 2024-09-21T11:43:05.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.800+0000 7f1d6971a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d64102aa0 0x7f1d6419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d6971a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d641033c0 0x7f1d6419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d6971a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6410edb0 con 0x7f1d641033c0 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d6971a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6410ec30 con 0x7f1d64102aa0 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d627fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d641033c0 0x7f1d6419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d627fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d641033c0 0x7f1d6419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32990/0 (socket says 172.21.15.118:32990) 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d627fc640 1 -- 172.21.15.118:0/408839296 learned_addr learned my addr 172.21.15.118:0/408839296 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d62ffd640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d64102aa0 0x7f1d6419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d627fc640 1 -- 172.21.15.118:0/408839296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d64102aa0 msgr2=0x7f1d6419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d627fc640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d64102aa0 0x7f1d6419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d627fc640 1 -- 172.21.15.118:0/408839296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d641977a0 con 0x7f1d641033c0 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d627fc640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d641033c0 0x7f1d6419db60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800c8c0 tx=0x7f1d5800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d4bfff640 1 -- 172.21.15.118:0/408839296 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d58004020 con 0x7f1d641033c0 2024-09-21T11:43:05.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d4bfff640 1 -- 172.21.15.118:0/408839296 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d580041c0 con 0x7f1d641033c0 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d4bfff640 1 -- 172.21.15.118:0/408839296 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d580047a0 con 0x7f1d641033c0 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d64197a90 con 0x7f1d641033c0 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.801+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d64198020 con 0x7f1d641033c0 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.802+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6406a410 con 0x7f1d641033c0 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.803+0000 7f1d4bfff640 1 -- 172.21.15.118:0/408839296 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1d580079b0 con 0x7f1d641033c0 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.804+0000 7f1d4bfff640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d4c07af80 0x7f1d4c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.804+0000 7f1d62ffd640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d4c07af80 0x7f1d4c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.804+0000 7f1d4bfff640 1 -- 172.21.15.118:0/408839296 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1d5809ddd0 con 0x7f1d641033c0 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.804+0000 7f1d62ffd640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d4c07af80 0x7f1d4c07d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d54031460 tx=0x7f1d54005bd0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:05.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:05.808+0000 7f1d4bfff640 1 -- 172.21.15.118:0/408839296 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1d58014030 con 0x7f1d641033c0 2024-09-21T11:43:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:05 smithi149 ceph-mon[36123]: pgmap v93: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:05 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:43:06.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.055+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1d64105f70 con 0x7f1d641033c0 2024-09-21T11:43:06.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.056+0000 7f1d4bfff640 1 -- 172.21.15.118:0/408839296 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f1d58069450 con 0x7f1d641033c0 2024-09-21T11:43:06.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d4c07af80 msgr2=0x7f1d4c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:06.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d4c07af80 0x7f1d4c07d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d54031460 tx=0x7f1d54005bd0 comp rx=0 tx=0).stop 2024-09-21T11:43:06.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d641033c0 msgr2=0x7f1d6419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:06.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d641033c0 0x7f1d6419db60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800c8c0 tx=0x7f1d5800cd80 comp rx=0 tx=0).stop 2024-09-21T11:43:06.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 shutdown_connections 2024-09-21T11:43:06.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d4c07af80 0x7f1d4c07d440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:06.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d641033c0 0x7f1d6419db60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:06.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 --2- 172.21.15.118:0/408839296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d64102aa0 0x7f1d6419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:06.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 >> 172.21.15.118:0/408839296 conn(0x7f1d640fc4c0 msgr2=0x7f1d64108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:06.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 shutdown_connections 2024-09-21T11:43:06.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:06.058+0000 7f1d6971a640 1 -- 172.21.15.118:0/408839296 wait complete. 2024-09-21T11:43:06.068 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:43:06.645 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:06 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/408839296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:06.646 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-21T11:43:06.905 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:06.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:06 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/408839296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:07.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.394+0000 7fe6deaac640 1 -- 172.21.15.118:0/15252640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 msgr2=0x7fe6d8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:07.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.394+0000 7fe6deaac640 1 --2- 172.21.15.118:0/15252640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 0x7fe6d8100c80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009880 tx=0x7fe6c402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.394+0000 7fe6deaac640 1 -- 172.21.15.118:0/15252640 shutdown_connections 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.394+0000 7fe6deaac640 1 --2- 172.21.15.118:0/15252640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 0x7fe6d8100c80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.394+0000 7fe6deaac640 1 --2- 172.21.15.118:0/15252640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8106820 0x7fe6d8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.394+0000 7fe6deaac640 1 -- 172.21.15.118:0/15252640 >> 172.21.15.118:0/15252640 conn(0x7fe6d80fc520 msgr2=0x7fe6d80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.394+0000 7fe6deaac640 1 -- 172.21.15.118:0/15252640 shutdown_connections 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.394+0000 7fe6deaac640 1 -- 172.21.15.118:0/15252640 wait complete. 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6deaac640 1 Processor -- start 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6deaac640 1 -- start start 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6deaac640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 0x7fe6d8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6deaac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8106820 0x7fe6d8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6deaac640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d810dcf0 con 0x7fe6d8100820 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6deaac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d810db70 con 0x7fe6d8106820 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6dc848640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 0x7fe6d8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:07.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6dc848640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 0x7fe6d8198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33014/0 (socket says 172.21.15.118:33014) 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6dc848640 1 -- 172.21.15.118:0/2884661346 learned_addr learned my addr 172.21.15.118:0/2884661346 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6dc848640 1 -- 172.21.15.118:0/2884661346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8106820 msgr2=0x7fe6d8198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6dc848640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8106820 0x7fe6d8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6dc848640 1 -- 172.21.15.118:0/2884661346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d8199340 con 0x7fe6d8100820 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6dc848640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 0x7fe6d8198800 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00d6f0 tx=0x7fe6cc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.395+0000 7fe6d5ffb640 1 -- 172.21.15.118:0/2884661346 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6cc017070 con 0x7fe6d8100820 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.396+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d8199630 con 0x7fe6d8100820 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.396+0000 7fe6d5ffb640 1 -- 172.21.15.118:0/2884661346 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6cc00de00 con 0x7fe6d8100820 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.396+0000 7fe6d5ffb640 1 -- 172.21.15.118:0/2884661346 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6cc004bb0 con 0x7fe6d8100820 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.396+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d81a1c30 con 0x7fe6d8100820 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.397+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d8101f60 con 0x7fe6d8100820 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.397+0000 7fe6d5ffb640 1 -- 172.21.15.118:0/2884661346 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe6cc004e60 con 0x7fe6d8100820 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.398+0000 7fe6d5ffb640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c807af30 0x7fe6c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.398+0000 7fe6d5ffb640 1 -- 172.21.15.118:0/2884661346 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fe6cc09dc50 con 0x7fe6d8100820 2024-09-21T11:43:07.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.398+0000 7fe6d7fff640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c807af30 0x7fe6c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:07.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.398+0000 7fe6d7fff640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c807af30 0x7fe6c807d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40096c0 tx=0x7fe6c4000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:07.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.402+0000 7fe6d5ffb640 1 -- 172.21.15.118:0/2884661346 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe6d8199630 con 0x7fe6d8100820 2024-09-21T11:43:07.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:07.595+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}) -- 0x7fe6d8062630 con 0x7fe6c807af30 2024-09-21T11:43:07.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:07 smithi149 ceph-mon[36123]: pgmap v94: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:08.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:07 smithi118 ceph-mon[28757]: pgmap v94: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:08.594 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:08 smithi118 ceph-mon[28757]: from='client.14912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:08 smithi149 ceph-mon[36123]: from='client.14912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:09.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.411+0000 7fe6d5ffb640 1 -- 172.21.15.118:0/2884661346 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7fe6d8062630 con 0x7fe6c807af30 2024-09-21T11:43:09.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c807af30 msgr2=0x7fe6c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c807af30 0x7fe6c807d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40096c0 tx=0x7fe6c4000bc0 comp rx=0 tx=0).stop 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 msgr2=0x7fe6d8198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 0x7fe6d8198800 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00d6f0 tx=0x7fe6cc00dbb0 comp rx=0 tx=0).stop 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 shutdown_connections 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8106820 0x7fe6d8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c807af30 0x7fe6c807d3f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 --2- 172.21.15.118:0/2884661346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d8100820 0x7fe6d8198800 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 >> 172.21.15.118:0/2884661346 conn(0x7fe6d80fc520 msgr2=0x7fe6d80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 shutdown_connections 2024-09-21T11:43:09.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:09.413+0000 7fe6deaac640 1 -- 172.21.15.118:0/2884661346 wait complete. 2024-09-21T11:43:09.424 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:43:09.712 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:09 smithi118 ceph-mon[28757]: pgmap v95: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:09 smithi149 ceph-mon[36123]: pgmap v95: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:10.023 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch ps' 2024-09-21T11:43:10.273 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:10.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.787+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/683868570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0100820 msgr2=0x7ff2a0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:10.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.787+0000 7ff2a4fd2640 1 --2- 172.21.15.118:0/683868570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0100820 0x7ff2a0100c80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff288009880 tx=0x7ff28802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:10.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.787+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/683868570 shutdown_connections 2024-09-21T11:43:10.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.787+0000 7ff2a4fd2640 1 --2- 172.21.15.118:0/683868570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0100820 0x7ff2a0100c80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.787+0000 7ff2a4fd2640 1 --2- 172.21.15.118:0/683868570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2a0106820 0x7ff2a0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.787+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/683868570 >> 172.21.15.118:0/683868570 conn(0x7ff2a00fc520 msgr2=0x7ff2a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.787+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/683868570 shutdown_connections 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.787+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/683868570 wait complete. 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff2a4fd2640 1 Processor -- start 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff2a4fd2640 1 -- start start 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff2a4fd2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2a0100820 0x7ff2a019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff2a4fd2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0106820 0x7ff2a019cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff2a4fd2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a010dcf0 con 0x7ff2a0106820 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff2a4fd2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a010db70 con 0x7ff2a0100820 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff29dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0106820 0x7ff2a019cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff29dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0106820 0x7ff2a019cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33034/0 (socket says 172.21.15.118:33034) 2024-09-21T11:43:10.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff29dd9b640 1 -- 172.21.15.118:0/898295233 learned_addr learned my addr 172.21.15.118:0/898295233 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff29e59c640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2a0100820 0x7ff2a019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff29dd9b640 1 -- 172.21.15.118:0/898295233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2a0100820 msgr2=0x7ff2a019c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff29dd9b640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2a0100820 0x7ff2a019c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff29dd9b640 1 -- 172.21.15.118:0/898295233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a01966c0 con 0x7ff2a0106820 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.788+0000 7ff29dd9b640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0106820 0x7ff2a019cb30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff288031460 tx=0x7ff2880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.789+0000 7ff2977fe640 1 -- 172.21.15.118:0/898295233 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff28803f070 con 0x7ff2a0106820 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.789+0000 7ff2977fe640 1 -- 172.21.15.118:0/898295233 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2880035f0 con 0x7ff2a0106820 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.789+0000 7ff2977fe640 1 -- 172.21.15.118:0/898295233 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff288035030 con 0x7ff2a0106820 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.789+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a0196950 con 0x7ff2a0106820 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.789+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a0196e50 con 0x7ff2a0106820 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.790+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a0101f60 con 0x7ff2a0106820 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.790+0000 7ff2977fe640 1 -- 172.21.15.118:0/898295233 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff288042070 con 0x7ff2a0106820 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.791+0000 7ff2977fe640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff28c07af30 0x7ff28c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:10.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.791+0000 7ff2977fe640 1 -- 172.21.15.118:0/898295233 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7ff2880bea20 con 0x7ff2a0106820 2024-09-21T11:43:10.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.791+0000 7ff29e59c640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff28c07af30 0x7ff28c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:10.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.791+0000 7ff29e59c640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff28c07af30 0x7ff28c07d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff298005fd0 tx=0x7ff298009870 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:10.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.795+0000 7ff2977fe640 1 -- 172.21.15.118:0/898295233 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff28808a020 con 0x7ff2a0106820 2024-09-21T11:43:10.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.980+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff2a0197100 con 0x7ff28c07af30 2024-09-21T11:43:10.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.990+0000 7ff2977fe640 1 -- 172.21.15.118:0/898295233 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7ff2a0197100 con 0x7ff28c07af30 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (65s) 35s ago 12m 19.9M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (4m) 35s ago 12m 8669k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (3m) 108s ago 11m 8094k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (12m) 35s ago 12m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (11m) 108s ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (40s) 35s ago 11m 46.6M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (6m) 35s ago 6m 149M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (6m) 35s ago 6m 27.0M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (6m) 108s ago 6m 20.9M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:43:10.993 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (6m) 108s ago 6m 14.7M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (3m) 35s ago 13m 520M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (2m) 108s ago 11m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (13m) 35s ago 13m 60.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (11m) 108s ago 11m 46.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (117s) 35s ago 12m 9042k - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (111s) 108s ago 11m 3506k - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (10m) 35s ago 10m 204M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (9m) 35s ago 9m 228M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (9m) 35s ago 9m 183M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (8m) 108s ago 8m 258M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (8m) 108s ago 8m 210M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (7m) 108s ago 7m 205M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:43:10.994 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (85s) 35s ago 11m 45.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:43:10.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.992+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff28c07af30 msgr2=0x7ff28c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:10.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.992+0000 7ff2a4fd2640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff28c07af30 0x7ff28c07d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff298005fd0 tx=0x7ff298009870 comp rx=0 tx=0).stop 2024-09-21T11:43:10.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.992+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0106820 msgr2=0x7ff2a019cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:10.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.992+0000 7ff2a4fd2640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0106820 0x7ff2a019cb30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff288031460 tx=0x7ff2880045e0 comp rx=0 tx=0).stop 2024-09-21T11:43:10.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.992+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 shutdown_connections 2024-09-21T11:43:10.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.992+0000 7ff2a4fd2640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff28c07af30 0x7ff28c07d3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:10.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.992+0000 7ff2a4fd2640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2a0106820 0x7ff2a019cb30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:10.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.992+0000 7ff2a4fd2640 1 --2- 172.21.15.118:0/898295233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2a0100820 0x7ff2a019c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:10.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.992+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 >> 172.21.15.118:0/898295233 conn(0x7ff2a00fc520 msgr2=0x7ff2a00fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:10.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.993+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 shutdown_connections 2024-09-21T11:43:10.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:10.993+0000 7ff2a4fd2640 1 -- 172.21.15.118:0/898295233 wait complete. 2024-09-21T11:43:11.608 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T11:43:11.609 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:43:11.609 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-21T11:43:11.871 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:11 smithi149 ceph-mon[36123]: pgmap v96: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:11.992 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:11 smithi118 ceph-mon[28757]: pgmap v96: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.342+0000 7f84c18bc640 1 -- 172.21.15.118:0/985995645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1007e0 msgr2=0x7f84bc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.342+0000 7f84c18bc640 1 --2- 172.21.15.118:0/985995645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1007e0 0x7f84bc100c40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009880 tx=0x7f84a402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.342+0000 7f84c18bc640 1 -- 172.21.15.118:0/985995645 shutdown_connections 2024-09-21T11:43:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.342+0000 7f84c18bc640 1 --2- 172.21.15.118:0/985995645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1007e0 0x7f84bc100c40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.342+0000 7f84c18bc640 1 --2- 172.21.15.118:0/985995645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc1067e0 0x7f84bc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.342+0000 7f84c18bc640 1 -- 172.21.15.118:0/985995645 >> 172.21.15.118:0/985995645 conn(0x7f84bc0fc4c0 msgr2=0x7f84bc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.342+0000 7f84c18bc640 1 -- 172.21.15.118:0/985995645 shutdown_connections 2024-09-21T11:43:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.342+0000 7f84c18bc640 1 -- 172.21.15.118:0/985995645 wait complete. 2024-09-21T11:43:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.343+0000 7f84c18bc640 1 Processor -- start 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.343+0000 7f84c18bc640 1 -- start start 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.343+0000 7f84c18bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc1007e0 0x7f84bc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.343+0000 7f84c18bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1067e0 0x7f84bc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.343+0000 7f84c18bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc10dd10 con 0x7f84bc1067e0 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.343+0000 7f84c18bc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc10db90 con 0x7f84bc1007e0 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.343+0000 7f84ba7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1067e0 0x7f84bc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.343+0000 7f84ba7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1067e0 0x7f84bc19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33050/0 (socket says 172.21.15.118:33050) 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.343+0000 7f84ba7fc640 1 -- 172.21.15.118:0/3198661161 learned_addr learned my addr 172.21.15.118:0/3198661161 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84baffd640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc1007e0 0x7f84bc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84ba7fc640 1 -- 172.21.15.118:0/3198661161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc1007e0 msgr2=0x7f84bc19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84ba7fc640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc1007e0 0x7f84bc19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84ba7fc640 1 -- 172.21.15.118:0/3198661161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc197820 con 0x7f84bc1067e0 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84ba7fc640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1067e0 0x7f84bc19dbe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f84a4031460 tx=0x7f84a40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84c08ba640 1 -- 172.21.15.118:0/3198661161 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a403f070 con 0x7f84bc1067e0 2024-09-21T11:43:12.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84c08ba640 1 -- 172.21.15.118:0/3198661161 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84a4004cf0 con 0x7f84bc1067e0 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc197ab0 con 0x7f84bc1067e0 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84c08ba640 1 -- 172.21.15.118:0/3198661161 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a4035030 con 0x7f84bc1067e0 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.344+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc197fe0 con 0x7f84bc1067e0 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.345+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84bc101f20 con 0x7f84bc1067e0 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.346+0000 7f84c08ba640 1 -- 172.21.15.118:0/3198661161 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f84a4042070 con 0x7f84bc1067e0 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.347+0000 7f84c08ba640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84a807af30 0x7f84a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.347+0000 7f84baffd640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84a807af30 0x7f84a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.347+0000 7f84c08ba640 1 -- 172.21.15.118:0/3198661161 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f84a40beb00 con 0x7f84bc1067e0 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.347+0000 7f84baffd640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84a807af30 0x7f84a807d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009f20 tx=0x7f84ac0094f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.351+0000 7f84c08ba640 1 -- 172.21.15.118:0/3198661161 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f84a408a100 con 0x7f84bc1067e0 2024-09-21T11:43:12.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.526+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f84bc109d80 con 0x7f84bc1067e0 2024-09-21T11:43:12.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.530+0000 7f84c08ba640 1 -- 172.21.15.118:0/3198661161 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v64)=0 v64) ==== 125+0+0 (secure 0 0 0) 0x7f84a408efb0 con 0x7f84bc1067e0 2024-09-21T11:43:12.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84a807af30 msgr2=0x7f84a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:12.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84a807af30 0x7f84a807d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009f20 tx=0x7f84ac0094f0 comp rx=0 tx=0).stop 2024-09-21T11:43:12.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1067e0 msgr2=0x7f84bc19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:12.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1067e0 0x7f84bc19dbe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f84a4031460 tx=0x7f84a40048f0 comp rx=0 tx=0).stop 2024-09-21T11:43:12.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 shutdown_connections 2024-09-21T11:43:12.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84a807af30 0x7f84a807d3f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:12.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84bc1067e0 0x7f84bc19dbe0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:12.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 --2- 172.21.15.118:0/3198661161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc1007e0 0x7f84bc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:12.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 >> 172.21.15.118:0/3198661161 conn(0x7f84bc0fc4c0 msgr2=0x7f84bc069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:12.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 shutdown_connections 2024-09-21T11:43:12.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:12.532+0000 7f84c18bc640 1 -- 172.21.15.118:0/3198661161 wait complete. 2024-09-21T11:43:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:12 smithi118 ceph-mon[28757]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:12 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3198661161' entity='client.admin' 2024-09-21T11:43:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:12 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:12 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:12.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:12 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:43:12.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:12 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:12.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:12 smithi149 ceph-mon[36123]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:12.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:12 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3198661161' entity='client.admin' 2024-09-21T11:43:12.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:12 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:12.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:12 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:12.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:12 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:43:12.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:12 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:13.209 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T11:43:13.210 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:43:13.210 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T11:43:13.456 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:13.845 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:13 smithi118 ceph-mon[28757]: pgmap v97: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:13.845 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:13 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:13.851 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:13 smithi149 ceph-mon[36123]: pgmap v97: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:13.851 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:13 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.927+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/1489594914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c101930 msgr2=0x7f0b9c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.927+0000 7f0ba2dd6640 1 --2- 172.21.15.118:0/1489594914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c101930 0x7f0b9c101d90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009880 tx=0x7f0b8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.927+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/1489594914 shutdown_connections 2024-09-21T11:43:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.927+0000 7f0ba2dd6640 1 --2- 172.21.15.118:0/1489594914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c101930 0x7f0b9c101d90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.927+0000 7f0ba2dd6640 1 --2- 172.21.15.118:0/1489594914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b9c107930 0x7f0b9c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.927+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/1489594914 >> 172.21.15.118:0/1489594914 conn(0x7f0b9c0fd630 msgr2=0x7f0b9c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.927+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/1489594914 shutdown_connections 2024-09-21T11:43:13.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.927+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/1489594914 wait complete. 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.928+0000 7f0ba2dd6640 1 Processor -- start 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.928+0000 7f0ba2dd6640 1 -- start start 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.928+0000 7f0ba2dd6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b9c101930 0x7f0b9c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.928+0000 7f0ba2dd6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c107930 0x7f0b9c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.928+0000 7f0ba2dd6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c10ee60 con 0x7f0b9c107930 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.928+0000 7f0ba2dd6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c10ece0 con 0x7f0b9c101930 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.928+0000 7f0b93fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c107930 0x7f0b9c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.928+0000 7f0b93fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c107930 0x7f0b9c19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33064/0 (socket says 172.21.15.118:33064) 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.928+0000 7f0b93fff640 1 -- 172.21.15.118:0/2528549238 learned_addr learned my addr 172.21.15.118:0/2528549238 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0ba0b72640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b9c101930 0x7f0b9c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0b93fff640 1 -- 172.21.15.118:0/2528549238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b9c101930 msgr2=0x7f0b9c19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0b93fff640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b9c101930 0x7f0b9c19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:13.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0b93fff640 1 -- 172.21.15.118:0/2528549238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c197870 con 0x7f0b9c107930 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0b93fff640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c107930 0x7f0b9c19dbf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c031460 tx=0x7f0b8c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0b91ffb640 1 -- 172.21.15.118:0/2528549238 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b8c03f070 con 0x7f0b9c107930 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9c197b00 con 0x7f0b9c107930 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0b91ffb640 1 -- 172.21.15.118:0/2528549238 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b8c004cf0 con 0x7f0b9c107930 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0b91ffb640 1 -- 172.21.15.118:0/2528549238 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b8c035030 con 0x7f0b9c107930 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.929+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9c198030 con 0x7f0b9c107930 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.930+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9c103070 con 0x7f0b9c107930 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.931+0000 7f0b91ffb640 1 -- 172.21.15.118:0/2528549238 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0b8c042070 con 0x7f0b9c107930 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.931+0000 7f0b91ffb640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b8407af30 0x7f0b8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.932+0000 7f0b91ffb640 1 -- 172.21.15.118:0/2528549238 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f0b8c0beb00 con 0x7f0b9c107930 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.932+0000 7f0ba0b72640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b8407af30 0x7f0b8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.932+0000 7f0ba0b72640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b8407af30 0x7f0b8407d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c1989b0 tx=0x7f0b98008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:13.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:13.936+0000 7f0b91ffb640 1 -- 172.21.15.118:0/2528549238 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0b8c08a100 con 0x7f0b9c107930 2024-09-21T11:43:14.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.113+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f0b9c198da0 con 0x7f0b9c107930 2024-09-21T11:43:14.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.113+0000 7f0b91ffb640 1 -- 172.21.15.118:0/2528549238 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v64)=0 v64) ==== 155+0+0 (secure 0 0 0) 0x7f0b8c08efb0 con 0x7f0b9c107930 2024-09-21T11:43:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b8407af30 msgr2=0x7f0b8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b8407af30 0x7f0b8407d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c1989b0 tx=0x7f0b98008040 comp rx=0 tx=0).stop 2024-09-21T11:43:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c107930 msgr2=0x7f0b9c19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c107930 0x7f0b9c19dbf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c031460 tx=0x7f0b8c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:43:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 shutdown_connections 2024-09-21T11:43:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b8407af30 0x7f0b8407d3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b9c107930 0x7f0b9c19dbf0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 --2- 172.21.15.118:0/2528549238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b9c101930 0x7f0b9c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 >> 172.21.15.118:0/2528549238 conn(0x7f0b9c0fd630 msgr2=0x7f0b9c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:14.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 shutdown_connections 2024-09-21T11:43:14.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:14.115+0000 7f0ba2dd6640 1 -- 172.21.15.118:0/2528549238 wait complete. 2024-09-21T11:43:14.726 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:14 smithi118 ceph-mon[28757]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:14.756 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T11:43:14.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:14 smithi149 ceph-mon[36123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:15.006 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.486+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/3309370776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8106820 msgr2=0x7fe7e8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.486+0000 7fe7ef1cb640 1 --2- 172.21.15.118:0/3309370776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8106820 0x7fe7e8106c00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009880 tx=0x7fe7dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.486+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/3309370776 shutdown_connections 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.486+0000 7fe7ef1cb640 1 --2- 172.21.15.118:0/3309370776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e8100820 0x7fe7e8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.486+0000 7fe7ef1cb640 1 --2- 172.21.15.118:0/3309370776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8106820 0x7fe7e8106c00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.486+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/3309370776 >> 172.21.15.118:0/3309370776 conn(0x7fe7e80fc520 msgr2=0x7fe7e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.486+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/3309370776 shutdown_connections 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.486+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/3309370776 wait complete. 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ef1cb640 1 Processor -- start 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ef1cb640 1 -- start start 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ef1cb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8100820 0x7fe7e81987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ef1cb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e8106820 0x7fe7e8198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ef1cb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e810dcd0 con 0x7fe7e8100820 2024-09-21T11:43:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ef1cb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e810db50 con 0x7fe7e8106820 2024-09-21T11:43:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ecf67640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8100820 0x7fe7e81987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ecf67640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8100820 0x7fe7e81987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56806/0 (socket says 172.21.15.118:56806) 2024-09-21T11:43:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ecf67640 1 -- 172.21.15.118:0/4045499761 learned_addr learned my addr 172.21.15.118:0/4045499761 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ecf67640 1 -- 172.21.15.118:0/4045499761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e8106820 msgr2=0x7fe7e8198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ecf67640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e8106820 0x7fe7e8198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ecf67640 1 -- 172.21.15.118:0/4045499761 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e8199320 con 0x7fe7e8100820 2024-09-21T11:43:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.487+0000 7fe7ecf67640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8100820 0x7fe7e81987e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc031460 tx=0x7fe7dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:15.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.488+0000 7fe7e5ffb640 1 -- 172.21.15.118:0/4045499761 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe7dc03f070 con 0x7fe7e8100820 2024-09-21T11:43:15.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.488+0000 7fe7e5ffb640 1 -- 172.21.15.118:0/4045499761 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7dc004cf0 con 0x7fe7e8100820 2024-09-21T11:43:15.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.488+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e81995b0 con 0x7fe7e8100820 2024-09-21T11:43:15.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.488+0000 7fe7e5ffb640 1 -- 172.21.15.118:0/4045499761 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe7dc035030 con 0x7fe7e8100820 2024-09-21T11:43:15.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.488+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e81a1b60 con 0x7fe7e8100820 2024-09-21T11:43:15.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.489+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e8101f60 con 0x7fe7e8100820 2024-09-21T11:43:15.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.489+0000 7fe7e5ffb640 1 -- 172.21.15.118:0/4045499761 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe7dc042070 con 0x7fe7e8100820 2024-09-21T11:43:15.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.490+0000 7fe7e5ffb640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe7d807af30 0x7fe7d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:15.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.490+0000 7fe7e5ffb640 1 -- 172.21.15.118:0/4045499761 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fe7dc0beb20 con 0x7fe7e8100820 2024-09-21T11:43:15.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.490+0000 7fe7e7fff640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe7d807af30 0x7fe7d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:15.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.490+0000 7fe7e7fff640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe7d807af30 0x7fe7d807d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe7e806ae50 tx=0x7fe7d4005bf0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:15.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.494+0000 7fe7e5ffb640 1 -- 172.21.15.118:0/4045499761 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe7dc08a0c0 con 0x7fe7e8100820 2024-09-21T11:43:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.671+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fe7e8103a30 con 0x7fe7e8100820 2024-09-21T11:43:15.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:15 smithi118 ceph-mon[28757]: pgmap v98: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.671+0000 7fe7e5ffb640 1 -- 172.21.15.118:0/4045499761 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v64)=0 v64) ==== 163+0+0 (secure 0 0 0) 0x7fe7dc08ef70 con 0x7fe7e8100820 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe7d807af30 msgr2=0x7fe7d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe7d807af30 0x7fe7d807d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe7e806ae50 tx=0x7fe7d4005bf0 comp rx=0 tx=0).stop 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8100820 msgr2=0x7fe7e81987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8100820 0x7fe7e81987e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc031460 tx=0x7fe7dc0048f0 comp rx=0 tx=0).stop 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 shutdown_connections 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e8106820 0x7fe7e8198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe7d807af30 0x7fe7d807d3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 --2- 172.21.15.118:0/4045499761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7e8100820 0x7fe7e81987e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 >> 172.21.15.118:0/4045499761 conn(0x7fe7e80fc520 msgr2=0x7fe7e80fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 shutdown_connections 2024-09-21T11:43:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:15.673+0000 7fe7ef1cb640 1 -- 172.21.15.118:0/4045499761 wait complete. 2024-09-21T11:43:15.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:15 smithi149 ceph-mon[36123]: pgmap v98: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:16.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T11:43:16.543 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.045+0000 7f1a67754640 1 -- 172.21.15.118:0/802634253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 msgr2=0x7f1a60107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.045+0000 7f1a67754640 1 --2- 172.21.15.118:0/802634253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 0x7f1a60107d10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009880 tx=0x7f1a5002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.045+0000 7f1a67754640 1 -- 172.21.15.118:0/802634253 shutdown_connections 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.045+0000 7f1a67754640 1 --2- 172.21.15.118:0/802634253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101930 0x7f1a60101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.045+0000 7f1a67754640 1 --2- 172.21.15.118:0/802634253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 0x7f1a60107d10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.045+0000 7f1a67754640 1 -- 172.21.15.118:0/802634253 >> 172.21.15.118:0/802634253 conn(0x7f1a600fd630 msgr2=0x7f1a600ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.045+0000 7f1a67754640 1 -- 172.21.15.118:0/802634253 shutdown_connections 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.045+0000 7f1a67754640 1 -- 172.21.15.118:0/802634253 wait complete. 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a67754640 1 Processor -- start 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a67754640 1 -- start start 2024-09-21T11:43:17.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a67754640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101930 0x7f1a6019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a67754640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 0x7f1a6019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a67754640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6010ee60 con 0x7f1a60107930 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a67754640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6010ece0 con 0x7f1a60101930 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a64cef640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 0x7f1a6019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a64cef640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 0x7f1a6019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56814/0 (socket says 172.21.15.118:56814) 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a64cef640 1 -- 172.21.15.118:0/1778728410 learned_addr learned my addr 172.21.15.118:0/1778728410 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a654f0640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101930 0x7f1a6019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a64cef640 1 -- 172.21.15.118:0/1778728410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101930 msgr2=0x7f1a6019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a64cef640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101930 0x7f1a6019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.046+0000 7f1a64cef640 1 -- 172.21.15.118:0/1778728410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a60197870 con 0x7f1a60107930 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.047+0000 7f1a64cef640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 0x7f1a6019dbf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00b420 tx=0x7f1a5c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.047+0000 7f1a567fc640 1 -- 172.21.15.118:0/1778728410 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c011630 con 0x7f1a60107930 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.047+0000 7f1a567fc640 1 -- 172.21.15.118:0/1778728410 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a5c016070 con 0x7f1a60107930 2024-09-21T11:43:17.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.047+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a60197b60 con 0x7f1a60107930 2024-09-21T11:43:17.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.047+0000 7f1a567fc640 1 -- 172.21.15.118:0/1778728410 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c010d40 con 0x7f1a60107930 2024-09-21T11:43:17.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.047+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a601980f0 con 0x7f1a60107930 2024-09-21T11:43:17.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.048+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a60103070 con 0x7f1a60107930 2024-09-21T11:43:17.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.049+0000 7f1a567fc640 1 -- 172.21.15.118:0/1778728410 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1a5c01b460 con 0x7f1a60107930 2024-09-21T11:43:17.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.049+0000 7f1a567fc640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a4c07af80 0x7f1a4c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:17.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.049+0000 7f1a567fc640 1 -- 172.21.15.118:0/1778728410 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1a5c09d6f0 con 0x7f1a60107930 2024-09-21T11:43:17.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.049+0000 7f1a654f0640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a4c07af80 0x7f1a4c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:17.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.050+0000 7f1a654f0640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a4c07af80 0x7f1a4c07d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a50031460 tx=0x7f1a50009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:17.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.054+0000 7f1a567fc640 1 -- 172.21.15.118:0/1778728410 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1a5c021250 con 0x7f1a60107930 2024-09-21T11:43:17.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.230+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f1a60101d90 con 0x7f1a60107930 2024-09-21T11:43:17.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.230+0000 7f1a567fc640 1 -- 172.21.15.118:0/1778728410 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v64)=0 v64) ==== 135+0+0 (secure 0 0 0) 0x7f1a5c068d70 con 0x7f1a60107930 2024-09-21T11:43:17.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a4c07af80 msgr2=0x7f1a4c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:17.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a4c07af80 0x7f1a4c07d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a50031460 tx=0x7f1a50009560 comp rx=0 tx=0).stop 2024-09-21T11:43:17.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 msgr2=0x7f1a6019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:17.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 0x7f1a6019dbf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00b420 tx=0x7f1a5c00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:43:17.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 shutdown_connections 2024-09-21T11:43:17.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a4c07af80 0x7f1a4c07d440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:17.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a60107930 0x7f1a6019dbf0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:17.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 --2- 172.21.15.118:0/1778728410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101930 0x7f1a6019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:17.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 >> 172.21.15.118:0/1778728410 conn(0x7f1a600fd630 msgr2=0x7f1a600fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:17.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 shutdown_connections 2024-09-21T11:43:17.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:17.233+0000 7f1a67754640 1 -- 172.21.15.118:0/1778728410 wait complete. 2024-09-21T11:43:17.875 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:17 smithi118 ceph-mon[28757]: pgmap v99: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:17.906 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-21T11:43:17.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:17 smithi149 ceph-mon[36123]: pgmap v99: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:18.152 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:18.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.569+0000 7f1b9885d640 1 -- 172.21.15.118:0/1817081835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 msgr2=0x7f1b94107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:18.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.569+0000 7f1b9885d640 1 --2- 172.21.15.118:0/1817081835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 0x7f1b94107d10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009c20 tx=0x7f1b8402a970 comp rx=0 tx=0).stop 2024-09-21T11:43:18.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.569+0000 7f1b9885d640 1 -- 172.21.15.118:0/1817081835 shutdown_connections 2024-09-21T11:43:18.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.569+0000 7f1b9885d640 1 --2- 172.21.15.118:0/1817081835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b94101930 0x7f1b94101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:18.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.569+0000 7f1b9885d640 1 --2- 172.21.15.118:0/1817081835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 0x7f1b94107d10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:18.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.569+0000 7f1b9885d640 1 -- 172.21.15.118:0/1817081835 >> 172.21.15.118:0/1817081835 conn(0x7f1b940fd630 msgr2=0x7f1b940ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:18.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.569+0000 7f1b9885d640 1 -- 172.21.15.118:0/1817081835 shutdown_connections 2024-09-21T11:43:18.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.569+0000 7f1b9885d640 1 -- 172.21.15.118:0/1817081835 wait complete. 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b9885d640 1 Processor -- start 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b9885d640 1 -- start start 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b9885d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b94101930 0x7f1b9419d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b9885d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 0x7f1b9419dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b9885d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9410ee60 con 0x7f1b94107930 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b9885d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9410ece0 con 0x7f1b94101930 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b91d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 0x7f1b9419dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b91d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 0x7f1b9419dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56818/0 (socket says 172.21.15.118:56818) 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b91d9b640 1 -- 172.21.15.118:0/3890043576 learned_addr learned my addr 172.21.15.118:0/3890043576 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b9259c640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b94101930 0x7f1b9419d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b91d9b640 1 -- 172.21.15.118:0/3890043576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b94101930 msgr2=0x7f1b9419d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:18.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b91d9b640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b94101930 0x7f1b9419d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:18.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.570+0000 7f1b91d9b640 1 -- 172.21.15.118:0/3890043576 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b941978d0 con 0x7f1b94107930 2024-09-21T11:43:18.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.571+0000 7f1b91d9b640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 0x7f1b9419dc50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800b420 tx=0x7f1b8800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:18.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.571+0000 7f1b837fe640 1 -- 172.21.15.118:0/3890043576 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b88011630 con 0x7f1b94107930 2024-09-21T11:43:18.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.571+0000 7f1b837fe640 1 -- 172.21.15.118:0/3890043576 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b88016070 con 0x7f1b94107930 2024-09-21T11:43:18.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.571+0000 7f1b837fe640 1 -- 172.21.15.118:0/3890043576 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b88010d40 con 0x7f1b94107930 2024-09-21T11:43:18.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.571+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b94197bc0 con 0x7f1b94107930 2024-09-21T11:43:18.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.571+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b94198150 con 0x7f1b94107930 2024-09-21T11:43:18.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.572+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b94103070 con 0x7f1b94107930 2024-09-21T11:43:18.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.573+0000 7f1b837fe640 1 -- 172.21.15.118:0/3890043576 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1b8801b460 con 0x7f1b94107930 2024-09-21T11:43:18.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.573+0000 7f1b837fe640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7c07af30 0x7f1b7c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:18.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.573+0000 7f1b9259c640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7c07af30 0x7f1b7c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:18.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.573+0000 7f1b837fe640 1 -- 172.21.15.118:0/3890043576 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1b8809d6c0 con 0x7f1b94107930 2024-09-21T11:43:18.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.574+0000 7f1b9259c640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7c07af30 0x7f1b7c07d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009430 tx=0x7f1b8403c040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:18.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.578+0000 7f1b837fe640 1 -- 172.21.15.118:0/3890043576 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1b88068cc0 con 0x7f1b94107930 2024-09-21T11:43:18.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.771+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}) -- 0x7f1b94198e00 con 0x7f1b7c07af30 2024-09-21T11:43:18.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.776+0000 7f1b837fe640 1 -- 172.21.15.118:0/3890043576 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f1b94198e00 con 0x7f1b7c07af30 2024-09-21T11:43:18.779 INFO:teuthology.orchestra.run.smithi118.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:43:18.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7c07af30 msgr2=0x7f1b7c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:18.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7c07af30 0x7f1b7c07d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009430 tx=0x7f1b8403c040 comp rx=0 tx=0).stop 2024-09-21T11:43:18.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 msgr2=0x7f1b9419dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:18.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 0x7f1b9419dc50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800b420 tx=0x7f1b8800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:43:18.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 shutdown_connections 2024-09-21T11:43:18.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7c07af30 0x7f1b7c07d3f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:18.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b94107930 0x7f1b9419dc50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:18.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 --2- 172.21.15.118:0/3890043576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b94101930 0x7f1b9419d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:18.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 >> 172.21.15.118:0/3890043576 conn(0x7f1b940fd630 msgr2=0x7f1b940fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:18.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 shutdown_connections 2024-09-21T11:43:18.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:18.779+0000 7f1b9885d640 1 -- 172.21.15.118:0/3890043576 wait complete. 2024-09-21T11:43:19.494 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T11:43:19.495 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T11:43:19.495 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-21T11:43:19.759 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T11:43:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:19 smithi118 ceph-mon[28757]: pgmap v100: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:19 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:19 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:19 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:19 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:43:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:19 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:19 smithi149 ceph-mon[36123]: pgmap v100: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:19 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:19 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:19 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:19 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:43:19.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:19 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.371+0000 7f3d5976a640 1 -- 172.21.15.118:0/3124799676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 msgr2=0x7f3d54106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.371+0000 7f3d5976a640 1 --2- 172.21.15.118:0/3124799676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 0x7f3d54106bc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009880 tx=0x7f3d4402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.371+0000 7f3d5976a640 1 -- 172.21.15.118:0/3124799676 shutdown_connections 2024-09-21T11:43:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.371+0000 7f3d5976a640 1 --2- 172.21.15.118:0/3124799676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d541007e0 0x7f3d54100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.371+0000 7f3d5976a640 1 --2- 172.21.15.118:0/3124799676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 0x7f3d54106bc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.371+0000 7f3d5976a640 1 -- 172.21.15.118:0/3124799676 >> 172.21.15.118:0/3124799676 conn(0x7f3d540fc4c0 msgr2=0x7f3d540fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.371+0000 7f3d5976a640 1 -- 172.21.15.118:0/3124799676 shutdown_connections 2024-09-21T11:43:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.371+0000 7f3d5976a640 1 -- 172.21.15.118:0/3124799676 wait complete. 2024-09-21T11:43:20.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d5976a640 1 Processor -- start 2024-09-21T11:43:20.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d5976a640 1 -- start start 2024-09-21T11:43:20.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d5976a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d541007e0 0x7f3d5419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d5976a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 0x7f3d5419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d5976a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410dcb0 con 0x7f3d541067e0 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d5976a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410db30 con 0x7f3d541007e0 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d4bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 0x7f3d5419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d4bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 0x7f3d5419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56834/0 (socket says 172.21.15.118:56834) 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d4bfff640 1 -- 172.21.15.118:0/1957756855 learned_addr learned my addr 172.21.15.118:0/1957756855 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d52ffd640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d541007e0 0x7f3d5419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d4bfff640 1 -- 172.21.15.118:0/1957756855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d541007e0 msgr2=0x7f3d5419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d4bfff640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d541007e0 0x7f3d5419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.372+0000 7f3d4bfff640 1 -- 172.21.15.118:0/1957756855 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d54197790 con 0x7f3d541067e0 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.373+0000 7f3d4bfff640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 0x7f3d5419db50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00c8f0 tx=0x7f3d3c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.373+0000 7f3d50ff9640 1 -- 172.21.15.118:0/1957756855 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d3c0079b0 con 0x7f3d541067e0 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.373+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d54197a80 con 0x7f3d541067e0 2024-09-21T11:43:20.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.373+0000 7f3d50ff9640 1 -- 172.21.15.118:0/1957756855 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d3c0054e0 con 0x7f3d541067e0 2024-09-21T11:43:20.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.373+0000 7f3d50ff9640 1 -- 172.21.15.118:0/1957756855 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d3c004dd0 con 0x7f3d541067e0 2024-09-21T11:43:20.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.373+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d54198010 con 0x7f3d541067e0 2024-09-21T11:43:20.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.374+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d54101f20 con 0x7f3d541067e0 2024-09-21T11:43:20.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.375+0000 7f3d50ff9640 1 -- 172.21.15.118:0/1957756855 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3d3c00f4a0 con 0x7f3d541067e0 2024-09-21T11:43:20.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.375+0000 7f3d50ff9640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d4007aed0 0x7f3d4007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:20.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.375+0000 7f3d50ff9640 1 -- 172.21.15.118:0/1957756855 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f3d3c09df30 con 0x7f3d541067e0 2024-09-21T11:43:20.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.375+0000 7f3d52ffd640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d4007aed0 0x7f3d4007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:20.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.376+0000 7f3d52ffd640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d4007aed0 0x7f3d4007d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d44000c00 tx=0x7f3d44031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:20.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.381+0000 7f3d50ff9640 1 -- 172.21.15.118:0/1957756855 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3d3c014030 con 0x7f3d541067e0 2024-09-21T11:43:20.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.583+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3d54198380 con 0x7f3d4007aed0 2024-09-21T11:43:20.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.584+0000 7f3d50ff9640 1 -- 172.21.15.118:0/1957756855 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f3d54198380 con 0x7f3d4007aed0 2024-09-21T11:43:20.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d4007aed0 msgr2=0x7f3d4007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d4007aed0 0x7f3d4007d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d44000c00 tx=0x7f3d44031400 comp rx=0 tx=0).stop 2024-09-21T11:43:20.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 msgr2=0x7f3d5419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 0x7f3d5419db50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00c8f0 tx=0x7f3d3c00cdb0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 shutdown_connections 2024-09-21T11:43:20.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d4007aed0 0x7f3d4007d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d541067e0 0x7f3d5419db50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 --2- 172.21.15.118:0/1957756855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d541007e0 0x7f3d5419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 >> 172.21.15.118:0/1957756855 conn(0x7f3d540fc4c0 msgr2=0x7f3d54069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:20.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 shutdown_connections 2024-09-21T11:43:20.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.586+0000 7f3d5976a640 1 -- 172.21.15.118:0/1957756855 wait complete. 2024-09-21T11:43:20.597 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.673+0000 7f90bbf45640 1 -- 172.21.15.118:0/445118864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 msgr2=0x7f90b4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.673+0000 7f90bbf45640 1 --2- 172.21.15.118:0/445118864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 0x7f90b4100c40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009880 tx=0x7f90a402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.673+0000 7f90bbf45640 1 -- 172.21.15.118:0/445118864 shutdown_connections 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.673+0000 7f90bbf45640 1 --2- 172.21.15.118:0/445118864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 0x7f90b4100c40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.673+0000 7f90bbf45640 1 --2- 172.21.15.118:0/445118864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b41067e0 0x7f90b4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.673+0000 7f90bbf45640 1 -- 172.21.15.118:0/445118864 >> 172.21.15.118:0/445118864 conn(0x7f90b40fc4c0 msgr2=0x7f90b40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.673+0000 7f90bbf45640 1 -- 172.21.15.118:0/445118864 shutdown_connections 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.673+0000 7f90bbf45640 1 -- 172.21.15.118:0/445118864 wait complete. 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.673+0000 7f90bbf45640 1 Processor -- start 2024-09-21T11:43:20.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90bbf45640 1 -- start start 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90bbf45640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 0x7f90b40fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90bbf45640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b41067e0 0x7f90b40fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90bbf45640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f90b410dd10 con 0x7f90b41007e0 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90bbf45640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f90b410db90 con 0x7f90b41067e0 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90b9ce1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 0x7f90b40fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90b9ce1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 0x7f90b40fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56856/0 (socket says 172.21.15.118:56856) 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90b9ce1640 1 -- 172.21.15.118:0/4015323198 learned_addr learned my addr 172.21.15.118:0/4015323198 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90b94e0640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b41067e0 0x7f90b40fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90b9ce1640 1 -- 172.21.15.118:0/4015323198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b41067e0 msgr2=0x7f90b40fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90b9ce1640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b41067e0 0x7f90b40fd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90b9ce1640 1 -- 172.21.15.118:0/4015323198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b40fd6c0 con 0x7f90b41007e0 2024-09-21T11:43:20.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90b94e0640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b41067e0 0x7f90b40fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:43:20.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90b9ce1640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 0x7f90b40fcc40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f90b000b420 tx=0x7f90b000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:20.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90aaffd640 1 -- 172.21.15.118:0/4015323198 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90b0011630 con 0x7f90b41007e0 2024-09-21T11:43:20.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90aaffd640 1 -- 172.21.15.118:0/4015323198 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90b0016070 con 0x7f90b41007e0 2024-09-21T11:43:20.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.674+0000 7f90aaffd640 1 -- 172.21.15.118:0/4015323198 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90b0010d40 con 0x7f90b41007e0 2024-09-21T11:43:20.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.675+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b40fd9b0 con 0x7f90b41007e0 2024-09-21T11:43:20.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.675+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b41a3ea0 con 0x7f90b41007e0 2024-09-21T11:43:20.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.676+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b4101f20 con 0x7f90b41007e0 2024-09-21T11:43:20.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.676+0000 7f90aaffd640 1 -- 172.21.15.118:0/4015323198 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f90b001b460 con 0x7f90b41007e0 2024-09-21T11:43:20.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.677+0000 7f90aaffd640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90a007af80 0x7f90a007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:20.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.677+0000 7f90aaffd640 1 -- 172.21.15.118:0/4015323198 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f90b009d6a0 con 0x7f90b41007e0 2024-09-21T11:43:20.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.677+0000 7f90b94e0640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90a007af80 0x7f90a007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:20.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.677+0000 7f90b94e0640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90a007af80 0x7f90a007d440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90a4006010 tx=0x7f90a40095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:20.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.681+0000 7f90aaffd640 1 -- 172.21.15.118:0/4015323198 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f90b0021250 con 0x7f90b41007e0 2024-09-21T11:43:20.769 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:20 smithi118 ceph-mon[28757]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:20.770 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:20 smithi118 ceph-mon[28757]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:43:20.770 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:20 smithi118 ceph-mon[28757]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:43:20.770 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:20 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:43:20.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.880+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f90b4062630 con 0x7f90a007af80 2024-09-21T11:43:20.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.881+0000 7f90aaffd640 1 -- 172.21.15.118:0/4015323198 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f90b4062630 con 0x7f90a007af80 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90a007af80 msgr2=0x7f90a007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90a007af80 0x7f90a007d440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90a4006010 tx=0x7f90a40095f0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 msgr2=0x7f90b40fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 0x7f90b40fcc40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f90b000b420 tx=0x7f90b000b8e0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 shutdown_connections 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b41067e0 0x7f90b40fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90a007af80 0x7f90a007d440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 --2- 172.21.15.118:0/4015323198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b41007e0 0x7f90b40fcc40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 >> 172.21.15.118:0/4015323198 conn(0x7f90b40fc4c0 msgr2=0x7f90b4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 shutdown_connections 2024-09-21T11:43:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.883+0000 7f90bbf45640 1 -- 172.21.15.118:0/4015323198 wait complete. 2024-09-21T11:43:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:20 smithi149 ceph-mon[36123]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:20 smithi149 ceph-mon[36123]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:43:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:20 smithi149 ceph-mon[36123]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T11:43:20.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:20 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:43:20.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.966+0000 7f2812454640 1 -- 172.21.15.118:0/1458701004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c106820 msgr2=0x7f280c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.966+0000 7f2812454640 1 --2- 172.21.15.118:0/1458701004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c106820 0x7f280c106c00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009880 tx=0x7f27fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.966+0000 7f2812454640 1 -- 172.21.15.118:0/1458701004 shutdown_connections 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.966+0000 7f2812454640 1 --2- 172.21.15.118:0/1458701004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f280c100820 0x7f280c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.966+0000 7f2812454640 1 --2- 172.21.15.118:0/1458701004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c106820 0x7f280c106c00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.966+0000 7f2812454640 1 -- 172.21.15.118:0/1458701004 >> 172.21.15.118:0/1458701004 conn(0x7f280c0fc520 msgr2=0x7f280c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.966+0000 7f2812454640 1 -- 172.21.15.118:0/1458701004 shutdown_connections 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.966+0000 7f2812454640 1 -- 172.21.15.118:0/1458701004 wait complete. 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f2812454640 1 Processor -- start 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f2812454640 1 -- start start 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f2812454640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c100820 0x7f280c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f2812454640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f280c106820 0x7f280c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f2812454640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f280c10dcf0 con 0x7f280c100820 2024-09-21T11:43:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f2812454640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f280c10db70 con 0x7f280c106820 2024-09-21T11:43:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f280bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c100820 0x7f280c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f280bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c100820 0x7f280c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56872/0 (socket says 172.21.15.118:56872) 2024-09-21T11:43:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f280bfff640 1 -- 172.21.15.118:0/3821573038 learned_addr learned my addr 172.21.15.118:0/3821573038 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.967+0000 7f280b7fe640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f280c106820 0x7f280c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.968+0000 7f280bfff640 1 -- 172.21.15.118:0/3821573038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f280c106820 msgr2=0x7f280c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.968+0000 7f280bfff640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f280c106820 0x7f280c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.968+0000 7f280bfff640 1 -- 172.21.15.118:0/3821573038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280c199380 con 0x7f280c100820 2024-09-21T11:43:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.968+0000 7f280bfff640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c100820 0x7f280c198840 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f27fc031460 tx=0x7f27fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.968+0000 7f28097fa640 1 -- 172.21.15.118:0/3821573038 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f27fc03f070 con 0x7f280c100820 2024-09-21T11:43:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.968+0000 7f28097fa640 1 -- 172.21.15.118:0/3821573038 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27fc004cf0 con 0x7f280c100820 2024-09-21T11:43:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.968+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f280c199610 con 0x7f280c100820 2024-09-21T11:43:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.968+0000 7f28097fa640 1 -- 172.21.15.118:0/3821573038 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f27fc035030 con 0x7f280c100820 2024-09-21T11:43:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.968+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280c1a1bc0 con 0x7f280c100820 2024-09-21T11:43:20.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.969+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f280c101f60 con 0x7f280c100820 2024-09-21T11:43:20.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.970+0000 7f28097fa640 1 -- 172.21.15.118:0/3821573038 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f27fc042070 con 0x7f280c100820 2024-09-21T11:43:20.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.970+0000 7f28097fa640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f27f807af30 0x7f27f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:20.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.970+0000 7f28097fa640 1 -- 172.21.15.118:0/3821573038 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f27fc0beac0 con 0x7f280c100820 2024-09-21T11:43:20.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.970+0000 7f280b7fe640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f27f807af30 0x7f27f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:20.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.971+0000 7f280b7fe640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f27f807af30 0x7f27f807d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f27f4005fd0 tx=0x7f27f4005e20 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:20.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:20.975+0000 7f28097fa640 1 -- 172.21.15.118:0/3821573038 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f27fc08a0c0 con 0x7f280c100820 2024-09-21T11:43:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.160+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f280c062630 con 0x7f27f807af30 2024-09-21T11:43:21.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.170+0000 7f28097fa640 1 -- 172.21.15.118:0/3821573038 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f280c062630 con 0x7f27f807af30 2024-09-21T11:43:21.172 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:43:21.173 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (76s) 45s ago 12m 19.9M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:43:21.173 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (4m) 45s ago 12m 8669k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:43:21.173 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (3m) 118s ago 11m 8094k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:43:21.173 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (12m) 45s ago 12m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:43:21.173 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (11m) 118s ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:43:21.173 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (51s) 45s ago 12m 46.6M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:43:21.173 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (6m) 45s ago 6m 149M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:43:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (6m) 45s ago 6m 27.0M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:43:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (6m) 118s ago 6m 20.9M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:43:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (6m) 118s ago 6m 14.7M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:43:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (3m) 45s ago 13m 520M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:43:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (2m) 118s ago 11m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:43:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (13m) 45s ago 13m 60.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7d891b231687 2024-09-21T11:43:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (11m) 118s ago 11m 46.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 7ac141b6ade1 2024-09-21T11:43:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (2m) 45s ago 12m 9042k - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:43:21.175 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (2m) 118s ago 11m 3506k - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:43:21.175 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (10m) 45s ago 10m 204M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:43:21.175 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (9m) 45s ago 9m 228M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:43:21.175 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (9m) 45s ago 9m 183M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:43:21.175 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (8m) 118s ago 8m 258M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:43:21.175 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (8m) 118s ago 8m 210M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:43:21.175 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (7m) 118s ago 7m 205M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:43:21.175 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (95s) 45s ago 11m 45.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:43:21.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f27f807af30 msgr2=0x7f27f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f27f807af30 0x7f27f807d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f27f4005fd0 tx=0x7f27f4005e20 comp rx=0 tx=0).stop 2024-09-21T11:43:21.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c100820 msgr2=0x7f280c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c100820 0x7f280c198840 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f27fc031460 tx=0x7f27fc0048f0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 shutdown_connections 2024-09-21T11:43:21.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f280c106820 0x7f280c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f27f807af30 0x7f27f807d3f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 --2- 172.21.15.118:0/3821573038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f280c100820 0x7f280c198840 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 >> 172.21.15.118:0/3821573038 conn(0x7f280c0fc520 msgr2=0x7f280c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:21.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 shutdown_connections 2024-09-21T11:43:21.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.172+0000 7f2812454640 1 -- 172.21.15.118:0/3821573038 wait complete. 2024-09-21T11:43:21.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 -- 172.21.15.118:0/1074225454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1067e0 msgr2=0x7f5f2c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 --2- 172.21.15.118:0/1074225454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1067e0 0x7f5f2c106bc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009880 tx=0x7f5f2402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 -- 172.21.15.118:0/1074225454 shutdown_connections 2024-09-21T11:43:21.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 --2- 172.21.15.118:0/1074225454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f2c1007e0 0x7f5f2c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 --2- 172.21.15.118:0/1074225454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1067e0 0x7f5f2c106bc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 -- 172.21.15.118:0/1074225454 >> 172.21.15.118:0/1074225454 conn(0x7f5f2c0fc4c0 msgr2=0x7f5f2c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:21.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 -- 172.21.15.118:0/1074225454 shutdown_connections 2024-09-21T11:43:21.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 -- 172.21.15.118:0/1074225454 wait complete. 2024-09-21T11:43:21.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 Processor -- start 2024-09-21T11:43:21.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.252+0000 7f5f335fb640 1 -- start start 2024-09-21T11:43:21.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f335fb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1007e0 0x7f5f2c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:21.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f335fb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f2c1067e0 0x7f5f2c198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:21.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f335fb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c10dcb0 con 0x7f5f2c1007e0 2024-09-21T11:43:21.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f335fb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c10db30 con 0x7f5f2c1067e0 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f31397640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1007e0 0x7f5f2c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f31397640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1007e0 0x7f5f2c198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56880/0 (socket says 172.21.15.118:56880) 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f31397640 1 -- 172.21.15.118:0/3128683226 learned_addr learned my addr 172.21.15.118:0/3128683226 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f30b96640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f2c1067e0 0x7f5f2c198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f31397640 1 -- 172.21.15.118:0/3128683226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f2c1067e0 msgr2=0x7f5f2c198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f31397640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f2c1067e0 0x7f5f2c198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f31397640 1 -- 172.21.15.118:0/3128683226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c199360 con 0x7f5f2c1007e0 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f31397640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1007e0 0x7f5f2c198820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5f24031460 tx=0x7f5f240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f2a7fc640 1 -- 172.21.15.118:0/3128683226 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f2403f070 con 0x7f5f2c1007e0 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f2a7fc640 1 -- 172.21.15.118:0/3128683226 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f24004cf0 con 0x7f5f2c1007e0 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c1995f0 con 0x7f5f2c1007e0 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.253+0000 7f5f2a7fc640 1 -- 172.21.15.118:0/3128683226 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f24035030 con 0x7f5f2c1007e0 2024-09-21T11:43:21.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.254+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c1a1ba0 con 0x7f5f2c1007e0 2024-09-21T11:43:21.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.254+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2c101f20 con 0x7f5f2c1007e0 2024-09-21T11:43:21.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.255+0000 7f5f2a7fc640 1 -- 172.21.15.118:0/3128683226 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5f24042070 con 0x7f5f2c1007e0 2024-09-21T11:43:21.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.256+0000 7f5f2a7fc640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5f1407af30 0x7f5f1407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:21.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.256+0000 7f5f2a7fc640 1 -- 172.21.15.118:0/3128683226 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f5f240beb60 con 0x7f5f2c1007e0 2024-09-21T11:43:21.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.256+0000 7f5f30b96640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5f1407af30 0x7f5f1407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:21.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.256+0000 7f5f30b96640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5f1407af30 0x7f5f1407d3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c06a680 tx=0x7f5f2000c4a0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:21.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.260+0000 7f5f2a7fc640 1 -- 172.21.15.118:0/3128683226 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5f2408a0c0 con 0x7f5f2c1007e0 2024-09-21T11:43:21.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.517+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5f2c108d50 con 0x7f5f2c1007e0 2024-09-21T11:43:21.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.517+0000 7f5f2a7fc640 1 -- 172.21.15.118:0/3128683226 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f5f2408ef70 con 0x7f5f2c1007e0 2024-09-21T11:43:21.520 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:43:21.520 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:43:21.520 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T11:43:21.520 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:43:21.520 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:43:21.520 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:43:21.520 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:43:21.521 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:43:21.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5f1407af30 msgr2=0x7f5f1407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5f1407af30 0x7f5f1407d3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c06a680 tx=0x7f5f2000c4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1007e0 msgr2=0x7f5f2c198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1007e0 0x7f5f2c198820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5f24031460 tx=0x7f5f240048f0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 shutdown_connections 2024-09-21T11:43:21.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f2c1067e0 0x7f5f2c198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5f1407af30 0x7f5f1407d3f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 --2- 172.21.15.118:0/3128683226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c1007e0 0x7f5f2c198820 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 >> 172.21.15.118:0/3128683226 conn(0x7f5f2c0fc4c0 msgr2=0x7f5f2c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:21.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 shutdown_connections 2024-09-21T11:43:21.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.520+0000 7f5f335fb640 1 -- 172.21.15.118:0/3128683226 wait complete. 2024-09-21T11:43:21.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.602+0000 7f213f3b5640 1 -- 172.21.15.118:0/2736273424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138100820 msgr2=0x7f2138100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.602+0000 7f213f3b5640 1 --2- 172.21.15.118:0/2736273424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138100820 0x7f2138100c80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2128009880 tx=0x7f212802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.602+0000 7f213f3b5640 1 -- 172.21.15.118:0/2736273424 shutdown_connections 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.602+0000 7f213f3b5640 1 --2- 172.21.15.118:0/2736273424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138100820 0x7f2138100c80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.602+0000 7f213f3b5640 1 --2- 172.21.15.118:0/2736273424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2138106820 0x7f2138106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.602+0000 7f213f3b5640 1 -- 172.21.15.118:0/2736273424 >> 172.21.15.118:0/2736273424 conn(0x7f21380fc520 msgr2=0x7f21380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.602+0000 7f213f3b5640 1 -- 172.21.15.118:0/2736273424 shutdown_connections 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.602+0000 7f213f3b5640 1 -- 172.21.15.118:0/2736273424 wait complete. 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213f3b5640 1 Processor -- start 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213f3b5640 1 -- start start 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213f3b5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2138100820 0x7f21380fcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213f3b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138106820 0x7f21380fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213f3b5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f213810dcd0 con 0x7f2138106820 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213f3b5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f213810db50 con 0x7f2138100820 2024-09-21T11:43:21.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213c950640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138106820 0x7f21380fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213c950640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138106820 0x7f21380fd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56904/0 (socket says 172.21.15.118:56904) 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213c950640 1 -- 172.21.15.118:0/3959032608 learned_addr learned my addr 172.21.15.118:0/3959032608 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213d151640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2138100820 0x7f21380fcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213c950640 1 -- 172.21.15.118:0/3959032608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2138100820 msgr2=0x7f21380fcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.603+0000 7f213c950640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2138100820 0x7f21380fcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.604+0000 7f213c950640 1 -- 172.21.15.118:0/3959032608 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21380fd620 con 0x7f2138106820 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.604+0000 7f213d151640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2138100820 0x7f21380fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.604+0000 7f213c950640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138106820 0x7f21380fd0e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2128031460 tx=0x7f21280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.604+0000 7f212e7fc640 1 -- 172.21.15.118:0/3959032608 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f212803f070 con 0x7f2138106820 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.604+0000 7f212e7fc640 1 -- 172.21.15.118:0/3959032608 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21280035f0 con 0x7f2138106820 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.604+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21380fd8b0 con 0x7f2138106820 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.604+0000 7f212e7fc640 1 -- 172.21.15.118:0/3959032608 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2128035030 con 0x7f2138106820 2024-09-21T11:43:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.604+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21381a3d80 con 0x7f2138106820 2024-09-21T11:43:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.605+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2138101f60 con 0x7f2138106820 2024-09-21T11:43:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.606+0000 7f212e7fc640 1 -- 172.21.15.118:0/3959032608 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2128042070 con 0x7f2138106820 2024-09-21T11:43:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.606+0000 7f212e7fc640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f212407af30 0x7f212407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.606+0000 7f212e7fc640 1 -- 172.21.15.118:0/3959032608 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f21280bea20 con 0x7f2138106820 2024-09-21T11:43:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.606+0000 7f213d151640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f212407af30 0x7f212407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.607+0000 7f213d151640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f212407af30 0x7f212407d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2134009b40 tx=0x7f2134005e50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:21.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.611+0000 7f212e7fc640 1 -- 172.21.15.118:0/3959032608 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f212808a020 con 0x7f2138106820 2024-09-21T11:43:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:21 smithi118 ceph-mon[28757]: pgmap v101: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:21 smithi118 ceph-mon[28757]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:21 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3128683226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:21.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.831+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f213802d7c0 con 0x7f2138106820 2024-09-21T11:43:21.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.832+0000 7f212e7fc640 1 -- 172.21.15.118:0/3959032608 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2032 (secure 0 0 0) 0x7f21280be800 con 0x7f2138106820 2024-09-21T11:43:21.834 INFO:teuthology.orchestra.run.smithi118.stdout:e16 2024-09-21T11:43:21.834 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 16 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:43:21.835 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 45 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=14556,1=14572} 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:43:21.836 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:21.837 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:21.838 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T11:43:21.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f212407af30 msgr2=0x7f212407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f212407af30 0x7f212407d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2134009b40 tx=0x7f2134005e50 comp rx=0 tx=0).stop 2024-09-21T11:43:21.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138106820 msgr2=0x7f21380fd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138106820 0x7f21380fd0e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2128031460 tx=0x7f21280045e0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 shutdown_connections 2024-09-21T11:43:21.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f212407af30 0x7f212407d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2138106820 0x7f21380fd0e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 --2- 172.21.15.118:0/3959032608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2138100820 0x7f21380fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 >> 172.21.15.118:0/3959032608 conn(0x7f21380fc520 msgr2=0x7f213806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:21.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 shutdown_connections 2024-09-21T11:43:21.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.834+0000 7f213f3b5640 1 -- 172.21.15.118:0/3959032608 wait complete. 2024-09-21T11:43:21.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.920+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/3956938581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641067f0 msgr2=0x7f5d64106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.920+0000 7f5d6c5d0640 1 --2- 172.21.15.118:0/3956938581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641067f0 0x7f5d64106bd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009880 tx=0x7f5d6002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.920+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/3956938581 shutdown_connections 2024-09-21T11:43:21.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.920+0000 7f5d6c5d0640 1 --2- 172.21.15.118:0/3956938581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d641007f0 0x7f5d64100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.920+0000 7f5d6c5d0640 1 --2- 172.21.15.118:0/3956938581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641067f0 0x7f5d64106bd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.920+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/3956938581 >> 172.21.15.118:0/3956938581 conn(0x7f5d640fc4d0 msgr2=0x7f5d640fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:21.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.920+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/3956938581 shutdown_connections 2024-09-21T11:43:21.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.920+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/3956938581 wait complete. 2024-09-21T11:43:21.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d6c5d0640 1 Processor -- start 2024-09-21T11:43:21.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d6c5d0640 1 -- start start 2024-09-21T11:43:21.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d6c5d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641007f0 0x7f5d64198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:21.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d6c5d0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d641067f0 0x7f5d64198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:21.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d6c5d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6410dcc0 con 0x7f5d641007f0 2024-09-21T11:43:21.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d6c5d0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6410db40 con 0x7f5d641067f0 2024-09-21T11:43:21.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d6a36c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641007f0 0x7f5d64198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d6a36c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641007f0 0x7f5d64198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56930/0 (socket says 172.21.15.118:56930) 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d6a36c640 1 -- 172.21.15.118:0/2342483843 learned_addr learned my addr 172.21.15.118:0/2342483843 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.921+0000 7f5d69b6b640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d641067f0 0x7f5d64198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.922+0000 7f5d6a36c640 1 -- 172.21.15.118:0/2342483843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d641067f0 msgr2=0x7f5d64198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.922+0000 7f5d6a36c640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d641067f0 0x7f5d64198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.922+0000 7f5d6a36c640 1 -- 172.21.15.118:0/2342483843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d641993b0 con 0x7f5d641007f0 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.922+0000 7f5d6a36c640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641007f0 0x7f5d64198870 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5d60031460 tx=0x7f5d600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.922+0000 7f5d5b7fe640 1 -- 172.21.15.118:0/2342483843 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d6003f070 con 0x7f5d641007f0 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.922+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d64199640 con 0x7f5d641007f0 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.922+0000 7f5d5b7fe640 1 -- 172.21.15.118:0/2342483843 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d600035f0 con 0x7f5d641007f0 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.922+0000 7f5d5b7fe640 1 -- 172.21.15.118:0/2342483843 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d60035030 con 0x7f5d641007f0 2024-09-21T11:43:21.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.922+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d641a1bf0 con 0x7f5d641007f0 2024-09-21T11:43:21.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.923+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d64101f30 con 0x7f5d641007f0 2024-09-21T11:43:21.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.924+0000 7f5d5b7fe640 1 -- 172.21.15.118:0/2342483843 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5d60042070 con 0x7f5d641007f0 2024-09-21T11:43:21.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.925+0000 7f5d5b7fe640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5d5007af80 0x7f5d5007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:21.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.925+0000 7f5d5b7fe640 1 -- 172.21.15.118:0/2342483843 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f5d600bef80 con 0x7f5d641007f0 2024-09-21T11:43:21.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.925+0000 7f5d69b6b640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5d5007af80 0x7f5d5007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:21.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.926+0000 7f5d69b6b640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5d5007af80 0x7f5d5007d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d6406aea0 tx=0x7f5d5400b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:21.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:21.929+0000 7f5d5b7fe640 1 -- 172.21.15.118:0/2342483843 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5d6008a5e0 con 0x7f5d641007f0 2024-09-21T11:43:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:21 smithi149 ceph-mon[36123]: pgmap v101: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:21.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:21 smithi149 ceph-mon[36123]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:21.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:21 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3128683226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:22.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.138+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5d64062630 con 0x7f5d5007af80 2024-09-21T11:43:22.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.139+0000 7f5d5b7fe640 1 -- 172.21.15.118:0/2342483843 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f5d64062630 con 0x7f5d5007af80 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "2/23 daemons upgraded", 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:43:22.142 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:43:22.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5d5007af80 msgr2=0x7f5d5007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:22.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5d5007af80 0x7f5d5007d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d6406aea0 tx=0x7f5d5400b390 comp rx=0 tx=0).stop 2024-09-21T11:43:22.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641007f0 msgr2=0x7f5d64198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:22.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641007f0 0x7f5d64198870 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5d60031460 tx=0x7f5d600045e0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 shutdown_connections 2024-09-21T11:43:22.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d641067f0 0x7f5d64198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5d5007af80 0x7f5d5007d440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 --2- 172.21.15.118:0/2342483843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d641007f0 0x7f5d64198870 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 >> 172.21.15.118:0/2342483843 conn(0x7f5d640fc4d0 msgr2=0x7f5d640fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:22.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 shutdown_connections 2024-09-21T11:43:22.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.141+0000 7f5d6c5d0640 1 -- 172.21.15.118:0/2342483843 wait complete. 2024-09-21T11:43:22.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.237+0000 7fea8fec7640 1 -- 172.21.15.118:0/460012618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 msgr2=0x7fea88106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.237+0000 7fea8fec7640 1 --2- 172.21.15.118:0/460012618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 0x7fea88106c00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fea84009880 tx=0x7fea8402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.237+0000 7fea8fec7640 1 -- 172.21.15.118:0/460012618 shutdown_connections 2024-09-21T11:43:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.237+0000 7fea8fec7640 1 --2- 172.21.15.118:0/460012618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea88100820 0x7fea88100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.237+0000 7fea8fec7640 1 --2- 172.21.15.118:0/460012618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 0x7fea88106c00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.237+0000 7fea8fec7640 1 -- 172.21.15.118:0/460012618 >> 172.21.15.118:0/460012618 conn(0x7fea880fc520 msgr2=0x7fea880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.237+0000 7fea8fec7640 1 -- 172.21.15.118:0/460012618 shutdown_connections 2024-09-21T11:43:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.237+0000 7fea8fec7640 1 -- 172.21.15.118:0/460012618 wait complete. 2024-09-21T11:43:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8fec7640 1 Processor -- start 2024-09-21T11:43:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8fec7640 1 -- start start 2024-09-21T11:43:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8fec7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea88100820 0x7fea8819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8fec7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 0x7fea8819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8fec7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fea8810dd50 con 0x7fea88106820 2024-09-21T11:43:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8fec7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea8810dbd0 con 0x7fea88100820 2024-09-21T11:43:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8d462640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 0x7fea8819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8d462640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 0x7fea8819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56952/0 (socket says 172.21.15.118:56952) 2024-09-21T11:43:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8d462640 1 -- 172.21.15.118:0/1290777344 learned_addr learned my addr 172.21.15.118:0/1290777344 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:22.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8d462640 1 -- 172.21.15.118:0/1290777344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea88100820 msgr2=0x7fea8819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:22.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8dc63640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea88100820 0x7fea8819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:22.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8d462640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea88100820 0x7fea8819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.238+0000 7fea8d462640 1 -- 172.21.15.118:0/1290777344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea88197820 con 0x7fea88106820 2024-09-21T11:43:22.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.239+0000 7fea8d462640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 0x7fea8819dbe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fea7800b420 tx=0x7fea7800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.239+0000 7fea7effd640 1 -- 172.21.15.118:0/1290777344 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea78011630 con 0x7fea88106820 2024-09-21T11:43:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.239+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea88197b10 con 0x7fea88106820 2024-09-21T11:43:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.239+0000 7fea7effd640 1 -- 172.21.15.118:0/1290777344 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea78016070 con 0x7fea88106820 2024-09-21T11:43:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.239+0000 7fea7effd640 1 -- 172.21.15.118:0/1290777344 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea78010d40 con 0x7fea88106820 2024-09-21T11:43:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.239+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea881980a0 con 0x7fea88106820 2024-09-21T11:43:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.240+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea88101f60 con 0x7fea88106820 2024-09-21T11:43:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.240+0000 7fea7effd640 1 -- 172.21.15.118:0/1290777344 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fea7801b460 con 0x7fea88106820 2024-09-21T11:43:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.241+0000 7fea7effd640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea7407af80 0x7fea7407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.241+0000 7fea7effd640 1 -- 172.21.15.118:0/1290777344 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fea7809d740 con 0x7fea88106820 2024-09-21T11:43:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.241+0000 7fea8dc63640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea7407af80 0x7fea7407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.242+0000 7fea8dc63640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea7407af80 0x7fea7407d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea84031460 tx=0x7fea84009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.245+0000 7fea7effd640 1 -- 172.21.15.118:0/1290777344 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fea78068d20 con 0x7fea88106820 2024-09-21T11:43:22.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.502+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fea88198350 con 0x7fea88106820 2024-09-21T11:43:22.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.502+0000 7fea7effd640 1 -- 172.21.15.118:0/1290777344 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fea7806dbd0 con 0x7fea88106820 2024-09-21T11:43:22.505 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:22.505 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:22.505 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea7407af80 msgr2=0x7fea7407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea7407af80 0x7fea7407d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea84031460 tx=0x7fea84009560 comp rx=0 tx=0).stop 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 msgr2=0x7fea8819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 0x7fea8819dbe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fea7800b420 tx=0x7fea7800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 shutdown_connections 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea7407af80 0x7fea7407d440 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea88106820 0x7fea8819dbe0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 --2- 172.21.15.118:0/1290777344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea88100820 0x7fea8819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 >> 172.21.15.118:0/1290777344 conn(0x7fea880fc520 msgr2=0x7fea881045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:22.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.504+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 shutdown_connections 2024-09-21T11:43:22.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:22.505+0000 7fea8fec7640 1 -- 172.21.15.118:0/1290777344 wait complete. 2024-09-21T11:43:22.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:22 smithi118 ceph-mon[28757]: from='client.14944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:22.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:22 smithi118 ceph-mon[28757]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:22.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:22 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/3959032608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T11:43:22.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:22 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:22.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:22 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:22.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:22 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:22.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:22 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:22.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:22 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T11:43:22.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:22 smithi118 ceph-mon[28757]: from='client.? 172.21.15.118:0/1290777344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T11:43:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:22 smithi149 ceph-mon[36123]: from='client.14944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:22 smithi149 ceph-mon[36123]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:22 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/3959032608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T11:43:22.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:22 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:22.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:22 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:22.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:22 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:22.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:22 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:22.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:22 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T11:43:22.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:22 smithi149 ceph-mon[36123]: from='client.? 172.21.15.118:0/1290777344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T11:43:23.859 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:23 smithi118 ceph-mon[28757]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (squid) 2024-09-21T11:43:23.859 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:23 smithi118 ceph-mon[28757]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T11:43:23.859 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:23 smithi118 ceph-mon[28757]: Upgrade: Setting container_image for all mgr 2024-09-21T11:43:23.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:23 smithi118 ceph-mon[28757]: pgmap v102: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:23.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:23 smithi118 ceph-mon[28757]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:23.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:23 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:23.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:23 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T11:43:23.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:23 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T11:43:23.860 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:23 smithi118 ceph-mon[28757]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:23 smithi149 ceph-mon[36123]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (squid) 2024-09-21T11:43:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:23 smithi149 ceph-mon[36123]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T11:43:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:23 smithi149 ceph-mon[36123]: Upgrade: Setting container_image for all mgr 2024-09-21T11:43:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:23 smithi149 ceph-mon[36123]: pgmap v102: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:23 smithi149 ceph-mon[36123]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:23.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:23 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:23.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:23 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T11:43:23.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:23 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T11:43:23.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:23 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:24.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:24 smithi118 ceph-mon[28757]: Upgrade: Updating mon.smithi118 2024-09-21T11:43:24.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:24 smithi118 ceph-mon[28757]: Deploying daemon mon.smithi118 on smithi118 2024-09-21T11:43:24.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:24 smithi149 ceph-mon[36123]: Upgrade: Updating mon.smithi118 2024-09-21T11:43:24.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:24 smithi149 ceph-mon[36123]: Deploying daemon mon.smithi118 on smithi118 2024-09-21T11:43:25.121 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:24 smithi118 systemd[1]: Stopping Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:43:25.121 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:25 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[28753]: 2024-09-21T11:43:25.106+0000 7f818b615640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi118 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T11:43:25.121 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:25 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[28753]: 2024-09-21T11:43:25.106+0000 7f818b615640 -1 mon.smithi118@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T11:43:25.427 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:25 smithi118 podman[111565]: 2024-09-21 11:43:25.138474135 +0000 UTC m=+0.122971795 container died 7d891b2316871fb41581637fdbc9af8fcb45389a8d5a56a99a8a7e4f7cf66f2e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T11:43:25.777 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:25 smithi118 podman[111565]: 2024-09-21 11:43:25.549781789 +0000 UTC m=+0.534279435 container cleanup 7d891b2316871fb41581637fdbc9af8fcb45389a8d5a56a99a8a7e4f7cf66f2e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, org.label-schema.vendor=CentOS, RELEASE=squid-4e45e6b, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T11:43:25.778 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:25 smithi118 bash[111565]: ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118 2024-09-21T11:43:26.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:25 smithi118 podman[111576]: 2024-09-21 11:43:25.776208955 +0000 UTC m=+0.640814479 container remove 7d891b2316871fb41581637fdbc9af8fcb45389a8d5a56a99a8a7e4f7cf66f2e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2) 2024-09-21T11:43:26.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:25 smithi118 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118.service: Deactivated successfully. 2024-09-21T11:43:26.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:25 smithi118 systemd[1]: Stopped Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:43:26.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:25 smithi118 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118.service: Consumed 13.175s CPU time. 2024-09-21T11:43:26.390 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 systemd[1]: Starting Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:43:26.390 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 podman[111716]: 2024-09-21 11:43:26.250825454 +0000 UTC m=+0.021907815 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:43:26.390 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 podman[111716]: 2024-09-21 11:43:26.360847456 +0000 UTC m=+0.131929798 container create 68b433ac89c1ace8c4c845401ae542bfef2881fa30bd6e1e165f1a887b952453 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T11:43:26.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 podman[111716]: 2024-09-21 11:43:26.571743984 +0000 UTC m=+0.342826334 container init 68b433ac89c1ace8c4c845401ae542bfef2881fa30bd6e1e165f1a887b952453 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T11:43:26.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 podman[111716]: 2024-09-21 11:43:26.57510501 +0000 UTC m=+0.346187361 container start 68b433ac89c1ace8c4c845401ae542bfef2881fa30bd6e1e165f1a887b952453 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T11:43:26.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T11:43:26.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev), process ceph-mon, pid 2 2024-09-21T11:43:26.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: pidfile_write: ignore empty --pid-file 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: load: jerasure load: lrc 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: RocksDB version: 7.9.2 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Git sha 0 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Compile date 2024-09-21 08:36:07 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: DB SUMMARY 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: DB Session ID: C6FEB2UHBMT9HHHIHEKL 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: CURRENT file: CURRENT 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1519 Bytes 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi118/store.db dir, Total Num: 1, files: 000032.sst 2024-09-21T11:43:26.649 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi118/store.db: 000030.log size: 2237061 ; 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.error_if_exists: 0 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.create_if_missing: 0 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.paranoid_checks: 1 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.env: 0x5643c184e120 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.info_log: 0x5643c29d38e0 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.statistics: (nil) 2024-09-21T11:43:26.650 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.use_fsync: 0 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_log_file_size: 0 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.allow_fallocate: 1 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.use_direct_reads: 0 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.db_log_dir: 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.wal_dir: 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T11:43:26.651 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.write_buffer_manager: 0x5643c29d7b80 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T11:43:26.652 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T11:43:26.653 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T11:43:26.653 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.unordered_write: 0 2024-09-21T11:43:26.653 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T11:43:26.653 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T11:43:26.653 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T11:43:26.653 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T11:43:26.653 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.row_cache: None 2024-09-21T11:43:26.654 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.wal_filter: None 2024-09-21T11:43:26.654 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T11:43:26.654 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T11:43:26.654 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.two_write_queues: 0 2024-09-21T11:43:26.654 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T11:43:26.654 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.wal_compression: 0 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.atomic_flush: 0 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.log_readahead_size: 0 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_background_jobs: 2 2024-09-21T11:43:26.655 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_background_compactions: -1 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_subcompactions: 1 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_open_files: -1 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_background_flushes: -1 2024-09-21T11:43:26.656 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Compression algorithms supported: 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: kZSTD supported: 0 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: kXpressCompression supported: 0 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: kBZip2Compression supported: 0 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: kLZ4Compression supported: 1 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: kZlibCompression supported: 1 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: kSnappyCompression supported: 1 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi118/store.db/MANIFEST-000015 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.merge_operator: 2024-09-21T11:43:26.657 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_filter: None 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5643c29d3540) 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: cache_index_and_filter_blocks: 1 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: pin_top_level_index_and_filter: 1 2024-09-21T11:43:26.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: index_type: 0 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: data_block_index_type: 0 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: index_shortening: 1 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: checksum: 4 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: no_block_cache: 0 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_cache: 0x5643c29c7610 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_cache_name: BinnedLRUCache 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_cache_options: 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: capacity : 536870912 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: num_shard_bits : 4 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: strict_capacity_limit : 0 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: high_pri_pool_ratio: 0.000 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_cache_compressed: (nil) 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: persistent_cache: (nil) 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_size: 4096 2024-09-21T11:43:26.659 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_size_deviation: 10 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_restart_interval: 16 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: index_block_restart_interval: 1 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: metadata_block_size: 4096 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: partition_filters: 0 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: use_delta_encoding: 1 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: filter_policy: bloomfilter 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: whole_key_filtering: 1 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: verify_compression: 0 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: read_amp_bytes_per_bit: 0 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: format_version: 5 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: enable_index_compression: 1 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: block_align: 0 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: max_auto_readahead_size: 262144 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: prepopulate_block_cache: 0 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: initial_auto_readahead_size: 8192 2024-09-21T11:43:26.660 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression: NoCompression 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.num_levels: 7 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T11:43:26.661 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T11:43:26.662 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T11:43:26.663 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T11:43:26.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.inplace_update_support: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.bloom_locality: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.max_successive_merges: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.ttl: 2592000 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T11:43:26.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.enable_blob_files: false 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.min_blob_size: 0 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi118/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12073, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-21T11:43:26.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fe08b315-1507-4d8a-a0db-5337a1c4d2fd 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726919006601869, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726919006609291, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 1969507, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12074, "largest_seqno": 13723, "table_properties": {"data_size": 1961747, "index_size": 4862, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1861, "raw_key_size": 17027, "raw_average_key_size": 23, "raw_value_size": 1946083, "raw_average_value_size": 2658, "num_data_blocks": 222, "num_entries": 732, "num_filter_entries": 732, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726919006, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fe08b315-1507-4d8a-a0db-5337a1c4d2fd", "db_session_id": "C6FEB2UHBMT9HHHIHEKL", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726919006609410, "job": 1, "event": "recovery_finished"} 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi118/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5643c29f6e00 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: DB pointer 0x5643c2af8000 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T11:43:26.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ** DB Stats ** 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ** Compaction Stats [default] ** 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: L0 1/0 1.88 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 476.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T11:43:26.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: L6 1/0 7.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Sum 2/0 9.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 476.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 476.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ** Compaction Stats [default] ** 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 476.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T11:43:26.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Cumulative compaction: 0.00 GB write, 192.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Interval compaction: 0.00 GB write, 192.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Block cache BinnedLRUCache@0x5643c29c7610#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: starting mon.smithi118 rank 0 at public addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] at bind addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi118 fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: mon.smithi118@-1(???) e2 preinit fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: mon.smithi118@-1(???).mds e16 new map 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: mon.smithi118@-1(???).mds e16 print_map 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: e16 2024-09-21T11:43:26.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: legacy client fscid: 1 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Filesystem 'cephfs' (1) 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: fs_name cephfs 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: epoch 16 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: tableserver 0 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: root 0 2024-09-21T11:43:26.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: session_timeout 60 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: session_autoclose 300 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: max_file_size 1099511627776 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: max_xattr_size 65536 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: required_client_features {} 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: last_failure 0 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: last_failure_osd_epoch 45 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: max_mds 2 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: in 0,1 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: up {0=14556,1=14572} 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: failed 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: damaged 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: stopped 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: data_pools [3] 2024-09-21T11:43:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: metadata_pool 2 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: inline_data enabled 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: balancer 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: bal_rank_mask -1 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: standby_count_wanted 1 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: [mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: [mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: Standby daemons: 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: [mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout: [mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:26.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: mon.smithi118@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T11:43:26.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: mon.smithi118@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T11:43:26.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: mon.smithi118@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T11:43:26.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: mon.smithi118@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T11:43:26.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 ceph-mon[111738]: mon.smithi118@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-21T11:43:26.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 bash[111716]: 68b433ac89c1ace8c4c845401ae542bfef2881fa30bd6e1e165f1a887b952453 2024-09-21T11:43:26.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:26 smithi118 systemd[1]: Started Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:43:29.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:43:29.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:43:29.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:29.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: pgmap v104: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: pgmap v105: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: mon.smithi118 calling monitor election 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: mon.smithi118 is new leader, mons smithi118,smithi149 in quorum (ranks 0,1) 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: monmap epoch 2 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: last_changed 2024-09-21T11:32:01.669801+0000 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: created 2024-09-21T11:29:30.783062+0000 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: min_mon_release 19 (squid) 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: election_strategy: 1 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: 0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.smithi118 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-09-21T11:43:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T11:43:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T11:43:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: mgrmap e33: smithi118.djbwyn(active, since 3m), standbys: smithi149.xjglai 2024-09-21T11:43:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:43:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='' 2024-09-21T11:43:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:29 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi118"}]: dispatch 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: pgmap v104: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: pgmap v105: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: mon.smithi118 calling monitor election 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: mon.smithi118 is new leader, mons smithi118,smithi149 in quorum (ranks 0,1) 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: monmap epoch 2 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:43:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: last_changed 2024-09-21T11:32:01.669801+0000 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: created 2024-09-21T11:29:30.783062+0000 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: min_mon_release 19 (squid) 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: election_strategy: 1 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: 0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.smithi118 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: mgrmap e33: smithi118.djbwyn(active, since 3m), standbys: smithi149.xjglai 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='' 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:31.021 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:30 smithi118 ceph-mon[111738]: pgmap v106: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:30 smithi149 ceph-mon[36123]: pgmap v106: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:33.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:33 smithi149 ceph-mon[36123]: pgmap v107: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:33.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:33 smithi118 ceph-mon[111738]: pgmap v107: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:35.758 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:35 smithi118 ceph-mon[111738]: pgmap v108: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:35.759 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:35 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:35.759 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:35 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:35.759 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:43:35.759 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:35 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:35.759 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:35 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:35 smithi149 ceph-mon[36123]: pgmap v108: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:35 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:35 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:35 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T11:43:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:35 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:35 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:37.746 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:37 smithi118 ceph-mon[111738]: pgmap v109: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:37 smithi149 ceph-mon[36123]: pgmap v109: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:39 smithi149 ceph-mon[36123]: pgmap v110: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:39 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:39 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:39 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:39 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:43:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:39 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:39 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:39.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:39 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:39.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:39 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T11:43:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:39 smithi118 ceph-mon[111738]: pgmap v110: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:39 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:39 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:39 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:39.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:39 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T11:43:39.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:39 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:39.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:39 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T11:43:39.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:39 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T11:43:39.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:39 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T11:43:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:40 smithi149 ceph-mon[36123]: Upgrade: Updating mon.smithi149 2024-09-21T11:43:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:40 smithi149 ceph-mon[36123]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T11:43:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T11:43:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:40 smithi149 ceph-mon[36123]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:40 smithi149 ceph-mon[36123]: Deploying daemon mon.smithi149 on smithi149 2024-09-21T11:43:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:40 smithi149 ceph-mon[36123]: pgmap v111: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:41.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:40 smithi118 ceph-mon[111738]: Upgrade: Updating mon.smithi149 2024-09-21T11:43:41.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:40 smithi118 ceph-mon[111738]: from='mgr.14762 ' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:41.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:40 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T11:43:41.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:40 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T11:43:41.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:40 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T11:43:41.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:40 smithi118 ceph-mon[111738]: Deploying daemon mon.smithi149 on smithi149 2024-09-21T11:43:41.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:40 smithi118 ceph-mon[111738]: pgmap v111: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:41.747 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:41 smithi149 systemd[1]: Stopping Ceph mon.smithi149 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:43:42.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:41 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149[36116]: 2024-09-21T11:43:41.743+0000 7fc45f205640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi149 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T11:43:42.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:41 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149[36116]: 2024-09-21T11:43:41.743+0000 7fc45f205640 -1 mon.smithi149@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T11:43:42.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:41 smithi149 podman[79613]: 2024-09-21 11:43:41.765923781 +0000 UTC m=+0.132974591 container died 7ac141b6ade13ad0c48cb7d7cc004e3408aae1ca7180535d08f4cc9e7f7bb197 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T11:43:42.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:42 smithi149 podman[79613]: 2024-09-21 11:43:42.10273832 +0000 UTC m=+0.469789130 container cleanup 7ac141b6ade13ad0c48cb7d7cc004e3408aae1ca7180535d08f4cc9e7f7bb197 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-4e45e6b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T11:43:42.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:42 smithi149 bash[79613]: ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149 2024-09-21T11:43:42.639 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:42 smithi149 podman[79626]: 2024-09-21 11:43:42.295755915 +0000 UTC m=+0.528118531 container remove 7ac141b6ade13ad0c48cb7d7cc004e3408aae1ca7180535d08f4cc9e7f7bb197 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T11:43:42.639 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:42 smithi149 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi149.service: Deactivated successfully. 2024-09-21T11:43:42.639 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:42 smithi149 systemd[1]: Stopped Ceph mon.smithi149 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:43:42.640 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:42 smithi149 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi149.service: Consumed 7.040s CPU time. 2024-09-21T11:43:42.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:42 smithi149 systemd[1]: Starting Ceph mon.smithi149 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:43:42.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:42 smithi149 podman[79751]: 2024-09-21 11:43:42.750829554 +0000 UTC m=+0.016310497 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:43:42.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:42 smithi149 podman[79751]: 2024-09-21 11:43:42.863633824 +0000 UTC m=+0.129114801 container create 8f06ed02d2f5ed2168554e20887580b2afc6b69ae6d5d5da834135eac2566050 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 podman[79751]: 2024-09-21 11:43:43.099431314 +0000 UTC m=+0.364912253 container init 8f06ed02d2f5ed2168554e20887580b2afc6b69ae6d5d5da834135eac2566050 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 podman[79751]: 2024-09-21 11:43:43.103016595 +0000 UTC m=+0.368497537 container start 8f06ed02d2f5ed2168554e20887580b2afc6b69ae6d5d5da834135eac2566050 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev), process ceph-mon, pid 2 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: pidfile_write: ignore empty --pid-file 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: load: jerasure load: lrc 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: RocksDB version: 7.9.2 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Git sha 0 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Compile date 2024-09-21 08:36:07 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: DB SUMMARY 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: DB Session ID: CLHTZOJ3G1064YBX7TY4 2024-09-21T11:43:43.296 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: CURRENT file: CURRENT 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1412 Bytes 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi149/store.db dir, Total Num: 1, files: 000027.sst 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi149/store.db: 000025.log size: 3934524 ; 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.error_if_exists: 0 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.create_if_missing: 0 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.paranoid_checks: 1 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.env: 0x563bee53b120 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.info_log: 0x563bef0818e0 2024-09-21T11:43:43.297 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.statistics: (nil) 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.use_fsync: 0 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_log_file_size: 0 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.allow_fallocate: 1 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T11:43:43.299 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.use_direct_reads: 0 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.db_log_dir: 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.wal_dir: 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.write_buffer_manager: 0x563bef085b80 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T11:43:43.300 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.unordered_write: 0 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.row_cache: None 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.wal_filter: None 2024-09-21T11:43:43.301 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.two_write_queues: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.wal_compression: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.atomic_flush: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.log_readahead_size: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T11:43:43.302 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_background_jobs: 2 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_background_compactions: -1 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_subcompactions: 1 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_open_files: -1 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T11:43:43.303 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_background_flushes: -1 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Compression algorithms supported: 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: kZSTD supported: 0 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: kXpressCompression supported: 0 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: kBZip2Compression supported: 0 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: kLZ4Compression supported: 1 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: kZlibCompression supported: 1 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: kSnappyCompression supported: 1 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T11:43:43.304 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000010 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.merge_operator: 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_filter: None 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563bef081540) 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks: 1 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_top_level_index_and_filter: 1 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_type: 0 2024-09-21T11:43:43.305 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_index_type: 0 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_shortening: 1 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: checksum: 4 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: no_block_cache: 0 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache: 0x563bef075610 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_name: BinnedLRUCache 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_options: 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: capacity : 536870912 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_shard_bits : 4 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: strict_capacity_limit : 0 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: high_pri_pool_ratio: 0.000 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_compressed: (nil) 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: persistent_cache: (nil) 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size: 4096 2024-09-21T11:43:43.306 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size_deviation: 10 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_restart_interval: 16 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_block_restart_interval: 1 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: metadata_block_size: 4096 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: partition_filters: 0 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: use_delta_encoding: 1 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: filter_policy: bloomfilter 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: whole_key_filtering: 1 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: verify_compression: 0 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: read_amp_bytes_per_bit: 0 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: format_version: 5 2024-09-21T11:43:43.307 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_index_compression: 1 2024-09-21T11:43:43.308 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_align: 0 2024-09-21T11:43:43.308 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_auto_readahead_size: 262144 2024-09-21T11:43:43.308 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: prepopulate_block_cache: 0 2024-09-21T11:43:43.308 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: initial_auto_readahead_size: 8192 2024-09-21T11:43:43.308 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression: NoCompression 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.num_levels: 7 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T11:43:43.309 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T11:43:43.310 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T11:43:43.311 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T11:43:43.312 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.inplace_update_support: 0 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.bloom_locality: 0 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.max_successive_merges: 0 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T11:43:43.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.ttl: 2592000 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.enable_blob_files: false 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.min_blob_size: 0 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T11:43:43.314 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12263, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4a35dee8-c9c8-4d1a-8ba3-681d36378c08 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726919023130487, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726919023140203, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2287703, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12268, "largest_seqno": 14372, "table_properties": {"data_size": 2278939, "index_size": 5606, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2117, "raw_key_size": 19621, "raw_average_key_size": 23, "raw_value_size": 2260975, "raw_average_value_size": 2688, "num_data_blocks": 256, "num_entries": 841, "num_filter_entries": 841, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726919023, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4a35dee8-c9c8-4d1a-8ba3-681d36378c08", "db_session_id": "CLHTZOJ3G1064YBX7TY4", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726919023140379, "job": 1, "event": "recovery_finished"} 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T11:43:43.315 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi149/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563bef0a4e00 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: DB pointer 0x563bef1a6000 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** DB Stats ** 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-21T11:43:43.316 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: L0 1/0 2.18 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 566.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: L6 1/0 7.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Sum 2/0 9.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 566.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 566.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 566.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-21T11:43:43.317 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative compaction: 0.00 GB write, 143.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval compaction: 0.00 GB write, 143.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache BinnedLRUCache@0x563bef075610#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: starting mon.smithi149 rank 1 at public addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] at bind addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi149 fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:43:43.318 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: mon.smithi149@-1(???) e2 preinit fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: mon.smithi149@-1(???).mds e16 new map 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: mon.smithi149@-1(???).mds e16 print_map 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: e16 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: legacy client fscid: 1 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Filesystem 'cephfs' (1) 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: fs_name cephfs 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: epoch 16 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:43:43.319 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: tableserver 0 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: root 0 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: session_timeout 60 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: session_autoclose 300 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_file_size 1099511627776 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_xattr_size 65536 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: required_client_features {} 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: last_failure 0 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: last_failure_osd_epoch 45 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_mds 2 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: in 0,1 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: up {0=14556,1=14572} 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: failed 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: damaged 2024-09-21T11:43:43.320 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: stopped 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_pools [3] 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: metadata_pool 2 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: inline_data enabled 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: balancer 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: bal_rank_mask -1 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: standby_count_wanted 1 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Standby daemons: 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:43.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:43.322 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: mon.smithi149@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T11:43:43.322 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: mon.smithi149@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T11:43:43.322 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: mon.smithi149@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T11:43:43.322 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: mon.smithi149@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T11:43:43.322 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: mon.smithi149@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-21T11:43:43.322 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 bash[79751]: 8f06ed02d2f5ed2168554e20887580b2afc6b69ae6d5d5da834135eac2566050 2024-09-21T11:43:43.322 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 systemd[1]: Started Ceph mon.smithi149 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:43:43.322 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mon metadata", "id": "smithi118"} : dispatch 2024-09-21T11:43:43.322 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mon metadata", "id": "smithi149"} : dispatch 2024-09-21T11:43:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mon metadata", "id": "smithi118"} : dispatch 2024-09-21T11:43:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mon metadata", "id": "smithi149"} : dispatch 2024-09-21T11:43:44.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: pgmap v112: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: mon.smithi149 calling monitor election 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: mon.smithi118 calling monitor election 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: mon.smithi118 is new leader, mons smithi118,smithi149 in quorum (ranks 0,1) 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: monmap epoch 2 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: last_changed 2024-09-21T11:32:01.669801+0000 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: created 2024-09-21T11:29:30.783062+0000 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: min_mon_release 19 (squid) 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: election_strategy: 1 2024-09-21T11:43:44.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: 0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.smithi118 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: mgrmap e33: smithi118.djbwyn(active, since 3m), standbys: smithi149.xjglai 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:44.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: pgmap v112: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: mon.smithi149 calling monitor election 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: mon.smithi118 calling monitor election 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: mon.smithi118 is new leader, mons smithi118,smithi149 in quorum (ranks 0,1) 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: monmap epoch 2 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: fsid ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: last_changed 2024-09-21T11:32:01.669801+0000 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: created 2024-09-21T11:29:30.783062+0000 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: min_mon_release 19 (squid) 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: election_strategy: 1 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: 0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.smithi118 2024-09-21T11:43:44.581 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-09-21T11:43:44.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T11:43:44.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T11:43:44.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: mgrmap e33: smithi118.djbwyn(active, since 3m), standbys: smithi149.xjglai 2024-09-21T11:43:44.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:44.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:44.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:43:44.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:44.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:44.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:43:45.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:45 smithi149 ceph-mon[79770]: pgmap v113: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:45.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:45 smithi118 ceph-mon[111738]: pgmap v113: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:47.415 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:47 smithi149 ceph-mon[79770]: pgmap v114: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:47.415 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:47.415 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:47.415 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:47.415 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:47.495 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:47 smithi118 ceph-mon[111738]: pgmap v114: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:47.495 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:47.495 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:47.495 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:47.495 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:49.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:49 smithi149 ceph-mon[79770]: pgmap v115: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:49.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:49 smithi118 ceph-mon[111738]: pgmap v115: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:43:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:43:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:43:50.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:50.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:43:50.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:43:50.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:43:50.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:50.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi118"} : dispatch 2024-09-21T11:43:50.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi118"}]': finished 2024-09-21T11:43:50.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"} : dispatch 2024-09-21T11:43:50.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]': finished 2024-09-21T11:43:50.417 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:43:50.417 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:50.417 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:50.417 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:43:50.417 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:43:50.417 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:50.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:43:50.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:43:50.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:43:50.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:50.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi118"} : dispatch 2024-09-21T11:43:50.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi118"}]': finished 2024-09-21T11:43:50.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"} : dispatch 2024-09-21T11:43:50.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]': finished 2024-09-21T11:43:51.411 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:51 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all mon 2024-09-21T11:43:51.411 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:51 smithi118 ceph-mon[111738]: pgmap v116: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:51.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:51 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all mon 2024-09-21T11:43:51.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:51 smithi149 ceph-mon[79770]: pgmap v116: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:52.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.592+0000 7ff0d854d640 1 -- 172.21.15.118:0/2101258038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 msgr2=0x7ff0d010b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:52.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.592+0000 7ff0d854d640 1 --2- 172.21.15.118:0/2101258038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 0x7ff0d010b8e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009880 tx=0x7ff0c002a530 comp rx=0 tx=0).stop 2024-09-21T11:43:52.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.592+0000 7ff0d854d640 1 -- 172.21.15.118:0/2101258038 shutdown_connections 2024-09-21T11:43:52.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.592+0000 7ff0d854d640 1 --2- 172.21.15.118:0/2101258038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 0x7ff0d010b8e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.592+0000 7ff0d854d640 1 --2- 172.21.15.118:0/2101258038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d0102ad0 0x7ff0d0102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.592+0000 7ff0d854d640 1 -- 172.21.15.118:0/2101258038 >> 172.21.15.118:0/2101258038 conn(0x7ff0d00fc510 msgr2=0x7ff0d00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:52.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.592+0000 7ff0d854d640 1 -- 172.21.15.118:0/2101258038 shutdown_connections 2024-09-21T11:43:52.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.592+0000 7ff0d854d640 1 -- 172.21.15.118:0/2101258038 wait complete. 2024-09-21T11:43:52.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.593+0000 7ff0d854d640 1 Processor -- start 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.593+0000 7ff0d854d640 1 -- start start 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.593+0000 7ff0d854d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d0102ad0 0x7ff0d019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.593+0000 7ff0d854d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 0x7ff0d019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.593+0000 7ff0d854d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d010ee00 con 0x7ff0d01033f0 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.593+0000 7ff0d854d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d010ec80 con 0x7ff0d0102ad0 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.593+0000 7ff0d5ae8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 0x7ff0d019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.593+0000 7ff0d5ae8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 0x7ff0d019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48736/0 (socket says 172.21.15.118:48736) 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.593+0000 7ff0d5ae8640 1 -- 172.21.15.118:0/1715348674 learned_addr learned my addr 172.21.15.118:0/1715348674 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0d62e9640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d0102ad0 0x7ff0d019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0d5ae8640 1 -- 172.21.15.118:0/1715348674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d0102ad0 msgr2=0x7ff0d019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0d5ae8640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d0102ad0 0x7ff0d019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0d5ae8640 1 -- 172.21.15.118:0/1715348674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d0197870 con 0x7ff0d01033f0 2024-09-21T11:43:52.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0d62e9640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d0102ad0 0x7ff0d019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:43:52.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0d5ae8640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 0x7ff0d019dbf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0031460 tx=0x7ff0c0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:52.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0c77fe640 1 -- 172.21.15.118:0/1715348674 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0c003f070 con 0x7ff0d01033f0 2024-09-21T11:43:52.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0c77fe640 1 -- 172.21.15.118:0/1715348674 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0c0004a90 con 0x7ff0d01033f0 2024-09-21T11:43:52.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d0197b00 con 0x7ff0d01033f0 2024-09-21T11:43:52.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0c77fe640 1 -- 172.21.15.118:0/1715348674 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0c0035030 con 0x7ff0d01033f0 2024-09-21T11:43:52.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.594+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d0198030 con 0x7ff0d01033f0 2024-09-21T11:43:52.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.595+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d006ac30 con 0x7ff0d01033f0 2024-09-21T11:43:52.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.596+0000 7ff0c77fe640 1 -- 172.21.15.118:0/1715348674 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff0c0042070 con 0x7ff0d01033f0 2024-09-21T11:43:52.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.596+0000 7ff0c77fe640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff0bc07af90 0x7ff0bc07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:52.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.597+0000 7ff0c77fe640 1 -- 172.21.15.118:0/1715348674 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7ff0c00bea80 con 0x7ff0d01033f0 2024-09-21T11:43:52.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.597+0000 7ff0d62e9640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff0bc07af90 0x7ff0bc07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:52.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.597+0000 7ff0d62e9640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff0bc07af90 0x7ff0bc07d450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff0d01989b0 tx=0x7ff0cc005e70 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:52.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.601+0000 7ff0c77fe640 1 -- 172.21.15.118:0/1715348674 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0c008a100 con 0x7ff0d01033f0 2024-09-21T11:43:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:52 smithi149 ceph-mon[79770]: Upgrade: Updating crash.smithi118 (1/2) 2024-09-21T11:43:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:52 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:52 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi118", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T11:43:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:52 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:43:52.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:52 smithi149 ceph-mon[79770]: Deploying daemon crash.smithi118 on smithi118 2024-09-21T11:43:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.801+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff0d0105fe0 con 0x7ff0bc07af90 2024-09-21T11:43:52.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:52 smithi118 ceph-mon[111738]: Upgrade: Updating crash.smithi118 (1/2) 2024-09-21T11:43:52.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:52 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:52.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:52 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi118", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T11:43:52.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:52 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:43:52.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:52 smithi118 ceph-mon[111738]: Deploying daemon crash.smithi118 on smithi118 2024-09-21T11:43:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.803+0000 7ff0c77fe640 1 -- 172.21.15.118:0/1715348674 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7ff0cc00ea90 con 0x7ff0bc07af90 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff0bc07af90 msgr2=0x7ff0bc07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff0bc07af90 0x7ff0bc07d450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff0d01989b0 tx=0x7ff0cc005e70 comp rx=0 tx=0).stop 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 msgr2=0x7ff0d019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 0x7ff0d019dbf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0031460 tx=0x7ff0c0004530 comp rx=0 tx=0).stop 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 shutdown_connections 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff0bc07af90 0x7ff0bc07d450 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0d01033f0 0x7ff0d019dbf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 --2- 172.21.15.118:0/1715348674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0d0102ad0 0x7ff0d019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 >> 172.21.15.118:0/1715348674 conn(0x7ff0d00fc510 msgr2=0x7ff0d0108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 shutdown_connections 2024-09-21T11:43:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.805+0000 7ff0d854d640 1 -- 172.21.15.118:0/1715348674 wait complete. 2024-09-21T11:43:52.817 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:43:52.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.892+0000 7f6198d7c640 1 -- 172.21.15.118:0/848088332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194101910 msgr2=0x7f6194101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.892+0000 7f6198d7c640 1 --2- 172.21.15.118:0/848088332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194101910 0x7f6194101d70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6188009880 tx=0x7f618802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.892+0000 7f6198d7c640 1 -- 172.21.15.118:0/848088332 shutdown_connections 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.892+0000 7f6198d7c640 1 --2- 172.21.15.118:0/848088332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194101910 0x7f6194101d70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.892+0000 7f6198d7c640 1 --2- 172.21.15.118:0/848088332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6194107910 0x7f6194107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.892+0000 7f6198d7c640 1 -- 172.21.15.118:0/848088332 >> 172.21.15.118:0/848088332 conn(0x7f61940fd5f0 msgr2=0x7f61940ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.892+0000 7f6198d7c640 1 -- 172.21.15.118:0/848088332 shutdown_connections 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.892+0000 7f6198d7c640 1 -- 172.21.15.118:0/848088332 wait complete. 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.892+0000 7f6198d7c640 1 Processor -- start 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6198d7c640 1 -- start start 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6198d7c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6194101910 0x7f61940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6198d7c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194107910 0x7f6194074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6198d7c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f619410ee40 con 0x7f6194107910 2024-09-21T11:43:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6198d7c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f619410ecc0 con 0x7f6194101910 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6191d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194107910 0x7f6194074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6191d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194107910 0x7f6194074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48754/0 (socket says 172.21.15.118:48754) 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6191d9b640 1 -- 172.21.15.118:0/1848328395 learned_addr learned my addr 172.21.15.118:0/1848328395 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f619259c640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6194101910 0x7f61940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6191d9b640 1 -- 172.21.15.118:0/1848328395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6194101910 msgr2=0x7f61940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6191d9b640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6194101910 0x7f61940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6191d9b640 1 -- 172.21.15.118:0/1848328395 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6194074f70 con 0x7f6194107910 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f619259c640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6194101910 0x7f61940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.893+0000 7f6191d9b640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194107910 0x7f6194074a30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6188031460 tx=0x7f61880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.894+0000 7f61837fe640 1 -- 172.21.15.118:0/1848328395 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f618803f070 con 0x7f6194107910 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.894+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6194075200 con 0x7f6194107910 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.894+0000 7f61837fe640 1 -- 172.21.15.118:0/1848328395 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6188004cf0 con 0x7f6194107910 2024-09-21T11:43:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.894+0000 7f61837fe640 1 -- 172.21.15.118:0/1848328395 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6188035030 con 0x7f6194107910 2024-09-21T11:43:52.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.894+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61941a3e10 con 0x7f6194107910 2024-09-21T11:43:52.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.895+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6194103050 con 0x7f6194107910 2024-09-21T11:43:52.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.895+0000 7f61837fe640 1 -- 172.21.15.118:0/1848328395 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6188042070 con 0x7f6194107910 2024-09-21T11:43:52.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.896+0000 7f61837fe640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f617c07af30 0x7f617c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:52.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.896+0000 7f61837fe640 1 -- 172.21.15.118:0/1848328395 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f61880beb00 con 0x7f6194107910 2024-09-21T11:43:52.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.896+0000 7f619259c640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f617c07af30 0x7f617c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:52.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.896+0000 7f619259c640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f617c07af30 0x7f617c07d3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6184006fd0 tx=0x7f6184008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:52.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:52.900+0000 7f61837fe640 1 -- 172.21.15.118:0/1848328395 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f618808a100 con 0x7f6194107910 2024-09-21T11:43:53.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.114+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6194062630 con 0x7f617c07af30 2024-09-21T11:43:53.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.115+0000 7f61837fe640 1 -- 172.21.15.118:0/1848328395 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f6194062630 con 0x7f617c07af30 2024-09-21T11:43:53.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.117+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f617c07af30 msgr2=0x7f617c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.117+0000 7f6198d7c640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f617c07af30 0x7f617c07d3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6184006fd0 tx=0x7f6184008040 comp rx=0 tx=0).stop 2024-09-21T11:43:53.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.117+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194107910 msgr2=0x7f6194074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.117+0000 7f6198d7c640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194107910 0x7f6194074a30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6188031460 tx=0x7f61880048f0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.117+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 shutdown_connections 2024-09-21T11:43:53.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.117+0000 7f6198d7c640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f617c07af30 0x7f617c07d3f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.117+0000 7f6198d7c640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6194107910 0x7f6194074a30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.117+0000 7f6198d7c640 1 --2- 172.21.15.118:0/1848328395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6194101910 0x7f61940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.117+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 >> 172.21.15.118:0/1848328395 conn(0x7f61940fd5f0 msgr2=0x7f61940fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:53.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.118+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 shutdown_connections 2024-09-21T11:43:53.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.118+0000 7f6198d7c640 1 -- 172.21.15.118:0/1848328395 wait complete. 2024-09-21T11:43:53.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.204+0000 7f3b04540640 1 -- 172.21.15.118:0/410531572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 msgr2=0x7f3afc10b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.204+0000 7f3b04540640 1 --2- 172.21.15.118:0/410531572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 0x7f3afc10b910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0098b0 tx=0x7f3aec02a560 comp rx=0 tx=0).stop 2024-09-21T11:43:53.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.204+0000 7f3b04540640 1 -- 172.21.15.118:0/410531572 shutdown_connections 2024-09-21T11:43:53.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.204+0000 7f3b04540640 1 --2- 172.21.15.118:0/410531572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 0x7f3afc10b910 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.204+0000 7f3b04540640 1 --2- 172.21.15.118:0/410531572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3afc102b00 0x7f3afc102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.204+0000 7f3b04540640 1 -- 172.21.15.118:0/410531572 >> 172.21.15.118:0/410531572 conn(0x7f3afc0fc4c0 msgr2=0x7f3afc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:53.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.204+0000 7f3b04540640 1 -- 172.21.15.118:0/410531572 shutdown_connections 2024-09-21T11:43:53.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.204+0000 7f3b04540640 1 -- 172.21.15.118:0/410531572 wait complete. 2024-09-21T11:43:53.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b04540640 1 Processor -- start 2024-09-21T11:43:53.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b04540640 1 -- start start 2024-09-21T11:43:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b04540640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3afc102b00 0x7f3afc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b04540640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 0x7f3afc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b04540640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc10edd0 con 0x7f3afc103420 2024-09-21T11:43:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b04540640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc10ec50 con 0x7f3afc102b00 2024-09-21T11:43:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b01adb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 0x7f3afc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b01adb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 0x7f3afc19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48774/0 (socket says 172.21.15.118:48774) 2024-09-21T11:43:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b022dc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3afc102b00 0x7f3afc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.205+0000 7f3b01adb640 1 -- 172.21.15.118:0/2485159712 learned_addr learned my addr 172.21.15.118:0/2485159712 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.206+0000 7f3b01adb640 1 -- 172.21.15.118:0/2485159712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3afc102b00 msgr2=0x7f3afc19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.206+0000 7f3b01adb640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3afc102b00 0x7f3afc19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.206+0000 7f3b01adb640 1 -- 172.21.15.118:0/2485159712 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc197800 con 0x7f3afc103420 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.206+0000 7f3b01adb640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 0x7f3afc19dbc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3aec031460 tx=0x7f3aec0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.206+0000 7f3af37fe640 1 -- 172.21.15.118:0/2485159712 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3aec03f070 con 0x7f3afc103420 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.206+0000 7f3af37fe640 1 -- 172.21.15.118:0/2485159712 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3aec0035f0 con 0x7f3afc103420 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.206+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc197a90 con 0x7f3afc103420 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.206+0000 7f3af37fe640 1 -- 172.21.15.118:0/2485159712 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3aec035030 con 0x7f3afc103420 2024-09-21T11:43:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.206+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc197fc0 con 0x7f3afc103420 2024-09-21T11:43:53.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.207+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc06a3b0 con 0x7f3afc103420 2024-09-21T11:43:53.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.208+0000 7f3af37fe640 1 -- 172.21.15.118:0/2485159712 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3aec042070 con 0x7f3afc103420 2024-09-21T11:43:53.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.209+0000 7f3af37fe640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ae807af30 0x7f3ae807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:53.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.209+0000 7f3b022dc640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ae807af30 0x7f3ae807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:53.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.209+0000 7f3af37fe640 1 -- 172.21.15.118:0/2485159712 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f3aec0be900 con 0x7f3afc103420 2024-09-21T11:43:53.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.209+0000 7f3b022dc640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ae807af30 0x7f3ae807d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3af8005fd0 tx=0x7f3af800b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:53.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.214+0000 7f3af37fe640 1 -- 172.21.15.118:0/2485159712 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3aec089f00 con 0x7f3afc103420 2024-09-21T11:43:53.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.414+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3afc198330 con 0x7f3ae807af30 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.423+0000 7f3af37fe640 1 -- 172.21.15.118:0/2485159712 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f3afc198330 con 0x7f3ae807af30 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (108s) 18s ago 12m 20.0M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (4m) 18s ago 12m 8753k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (4m) 7s ago 12m 8330k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (12m) 18s ago 12m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a 5d094ec0cdaa 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (12m) 7s ago 12m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a ff91537101f9 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (83s) 18s ago 12m 78.0M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (7m) 18s ago 7m 149M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (7m) 18s ago 7m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:43:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (7m) 7s ago 7m 22.0M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (7m) 7s ago 7m 15.9M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (4m) 18s ago 14m 522M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (3m) 7s ago 11m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (27s) 18s ago 14m 24.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (10s) 7s ago 11m 20.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (2m) 18s ago 12m 10.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (2m) 7s ago 11m 10.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (10m) 18s ago 10m 204M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 01359609206f 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (10m) 18s ago 10m 228M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (9m) 18s ago 9m 184M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (9m) 7s ago 9m 260M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:43:53.426 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (8m) 7s ago 8m 210M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:43:53.427 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (8m) 7s ago 8m 206M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:43:53.427 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (2m) 18s ago 12m 49.7M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:43:53.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ae807af30 msgr2=0x7f3ae807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ae807af30 0x7f3ae807d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3af8005fd0 tx=0x7f3af800b390 comp rx=0 tx=0).stop 2024-09-21T11:43:53.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 msgr2=0x7f3afc19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 0x7f3afc19dbc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3aec031460 tx=0x7f3aec0045c0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 shutdown_connections 2024-09-21T11:43:53.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ae807af30 0x7f3ae807d3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3afc103420 0x7f3afc19dbc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 --2- 172.21.15.118:0/2485159712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3afc102b00 0x7f3afc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 >> 172.21.15.118:0/2485159712 conn(0x7f3afc0fc4c0 msgr2=0x7f3afc103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:53.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 shutdown_connections 2024-09-21T11:43:53.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.426+0000 7f3b04540640 1 -- 172.21.15.118:0/2485159712 wait complete. 2024-09-21T11:43:53.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.507+0000 7ff854bcb640 1 -- 172.21.15.118:0/445270592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 msgr2=0x7ff85010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.507+0000 7ff854bcb640 1 --2- 172.21.15.118:0/445270592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 0x7ff85010b8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff838009880 tx=0x7ff83802a530 comp rx=0 tx=0).stop 2024-09-21T11:43:53.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.508+0000 7ff854bcb640 1 -- 172.21.15.118:0/445270592 shutdown_connections 2024-09-21T11:43:53.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.508+0000 7ff854bcb640 1 --2- 172.21.15.118:0/445270592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 0x7ff85010b8f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.508+0000 7ff854bcb640 1 --2- 172.21.15.118:0/445270592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850102ae0 0x7ff850102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.508+0000 7ff854bcb640 1 -- 172.21.15.118:0/445270592 >> 172.21.15.118:0/445270592 conn(0x7ff8500fc520 msgr2=0x7ff8500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.508+0000 7ff854bcb640 1 -- 172.21.15.118:0/445270592 shutdown_connections 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.508+0000 7ff854bcb640 1 -- 172.21.15.118:0/445270592 wait complete. 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.508+0000 7ff854bcb640 1 Processor -- start 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.508+0000 7ff854bcb640 1 -- start start 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff854bcb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850102ae0 0x7ff85019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff854bcb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 0x7ff85019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff854bcb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff85010ee10 con 0x7ff850103400 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff854bcb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff85010ec90 con 0x7ff850102ae0 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff84dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 0x7ff85019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff84dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 0x7ff85019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48802/0 (socket says 172.21.15.118:48802) 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff84dd9b640 1 -- 172.21.15.118:0/1012217442 learned_addr learned my addr 172.21.15.118:0/1012217442 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff84e59c640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850102ae0 0x7ff85019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff84dd9b640 1 -- 172.21.15.118:0/1012217442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850102ae0 msgr2=0x7ff85019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff84dd9b640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850102ae0 0x7ff85019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff84dd9b640 1 -- 172.21.15.118:0/1012217442 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff850197820 con 0x7ff850103400 2024-09-21T11:43:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff84dd9b640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 0x7ff85019dbe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff838031460 tx=0x7ff838004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff8477fe640 1 -- 172.21.15.118:0/1012217442 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff83803f070 con 0x7ff850103400 2024-09-21T11:43:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff8477fe640 1 -- 172.21.15.118:0/1012217442 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff838004a90 con 0x7ff850103400 2024-09-21T11:43:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff850197ab0 con 0x7ff850103400 2024-09-21T11:43:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff8477fe640 1 -- 172.21.15.118:0/1012217442 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff838035030 con 0x7ff850103400 2024-09-21T11:43:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.509+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff850197fe0 con 0x7ff850103400 2024-09-21T11:43:53.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.510+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff85006abe0 con 0x7ff850103400 2024-09-21T11:43:53.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.511+0000 7ff8477fe640 1 -- 172.21.15.118:0/1012217442 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff838042070 con 0x7ff850103400 2024-09-21T11:43:53.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.512+0000 7ff8477fe640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff83c07af40 0x7ff83c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:53.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.512+0000 7ff8477fe640 1 -- 172.21.15.118:0/1012217442 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7ff8380beb00 con 0x7ff850103400 2024-09-21T11:43:53.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.512+0000 7ff84e59c640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff83c07af40 0x7ff83c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:53.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.512+0000 7ff84e59c640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff83c07af40 0x7ff83c07d400 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff840005fd0 tx=0x7ff840009870 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:53.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.516+0000 7ff8477fe640 1 -- 172.21.15.118:0/1012217442 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff83808a100 con 0x7ff850103400 2024-09-21T11:43:53.723 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:53 smithi118 ceph-mon[111738]: pgmap v117: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:53.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.769+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff850105f80 con 0x7ff850103400 2024-09-21T11:43:53.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.769+0000 7ff8477fe640 1 -- 172.21.15.118:0/1012217442 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7ff83808efb0 con 0x7ff850103400 2024-09-21T11:43:53.771 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:43:53.771 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:43:53.771 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:43:53.771 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:43:53.771 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:43:53.771 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:43:53.771 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 10, 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:43:53.772 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:43:53.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff83c07af40 msgr2=0x7ff83c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff83c07af40 0x7ff83c07d400 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff840005fd0 tx=0x7ff840009870 comp rx=0 tx=0).stop 2024-09-21T11:43:53.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 msgr2=0x7ff85019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 0x7ff85019dbe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff838031460 tx=0x7ff838004530 comp rx=0 tx=0).stop 2024-09-21T11:43:53.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 shutdown_connections 2024-09-21T11:43:53.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff83c07af40 0x7ff83c07d400 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff850103400 0x7ff85019dbe0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 --2- 172.21.15.118:0/1012217442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff850102ae0 0x7ff85019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 >> 172.21.15.118:0/1012217442 conn(0x7ff8500fc520 msgr2=0x7ff850108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:53.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 shutdown_connections 2024-09-21T11:43:53.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.771+0000 7ff854bcb640 1 -- 172.21.15.118:0/1012217442 wait complete. 2024-09-21T11:43:53.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 -- 172.21.15.118:0/810127725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684106800 msgr2=0x7fb684106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 --2- 172.21.15.118:0/810127725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684106800 0x7fb684106be0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb674009880 tx=0x7fb67402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 -- 172.21.15.118:0/810127725 shutdown_connections 2024-09-21T11:43:53.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 --2- 172.21.15.118:0/810127725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb684100800 0x7fb684100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 --2- 172.21.15.118:0/810127725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684106800 0x7fb684106be0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 -- 172.21.15.118:0/810127725 >> 172.21.15.118:0/810127725 conn(0x7fb6840fc4e0 msgr2=0x7fb6840fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:53.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 -- 172.21.15.118:0/810127725 shutdown_connections 2024-09-21T11:43:53.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 -- 172.21.15.118:0/810127725 wait complete. 2024-09-21T11:43:53.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 Processor -- start 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.853+0000 7fb68a7bd640 1 -- start start 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb68a7bd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684100800 0x7fb6840fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb68a7bd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb684106800 0x7fb6840fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb68a7bd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb68410dcd0 con 0x7fb684100800 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb68a7bd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb68410db50 con 0x7fb684106800 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb683fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684100800 0x7fb6840fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb683fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684100800 0x7fb6840fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48820/0 (socket says 172.21.15.118:48820) 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb683fff640 1 -- 172.21.15.118:0/2912193408 learned_addr learned my addr 172.21.15.118:0/2912193408 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb6837fe640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb684106800 0x7fb6840fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb683fff640 1 -- 172.21.15.118:0/2912193408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb684106800 msgr2=0x7fb6840fd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb683fff640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb684106800 0x7fb6840fd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb683fff640 1 -- 172.21.15.118:0/2912193408 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6840fd710 con 0x7fb684100800 2024-09-21T11:43:53.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb683fff640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684100800 0x7fb6840fcc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb674031460 tx=0x7fb6740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:53.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb6817fa640 1 -- 172.21.15.118:0/2912193408 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb67403f070 con 0x7fb684100800 2024-09-21T11:43:53.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb6817fa640 1 -- 172.21.15.118:0/2912193408 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb674004b10 con 0x7fb684100800 2024-09-21T11:43:53.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.854+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6840fd9a0 con 0x7fb684100800 2024-09-21T11:43:53.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.855+0000 7fb6817fa640 1 -- 172.21.15.118:0/2912193408 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb674035030 con 0x7fb684100800 2024-09-21T11:43:53.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.855+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6841a3d20 con 0x7fb684100800 2024-09-21T11:43:53.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.856+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb684101f40 con 0x7fb684100800 2024-09-21T11:43:53.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.856+0000 7fb6817fa640 1 -- 172.21.15.118:0/2912193408 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb674042070 con 0x7fb684100800 2024-09-21T11:43:53.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.857+0000 7fb6817fa640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb67007af40 0x7fb67007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:53.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.857+0000 7fb6817fa640 1 -- 172.21.15.118:0/2912193408 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fb6740beaa0 con 0x7fb684100800 2024-09-21T11:43:53.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.857+0000 7fb6837fe640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb67007af40 0x7fb67007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:53.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.857+0000 7fb6837fe640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb67007af40 0x7fb67007d400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb6840fe720 tx=0x7fb66c00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:53.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:53.861+0000 7fb6817fa640 1 -- 172.21.15.118:0/2912193408 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb67408a0a0 con 0x7fb684100800 2024-09-21T11:43:53.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:53 smithi149 ceph-mon[79770]: pgmap v117: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:54.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.090+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb684109d80 con 0x7fb684100800 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.090+0000 7fb6817fa640 1 -- 172.21.15.118:0/2912193408 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2032 (secure 0 0 0) 0x7fb67408ef50 con 0x7fb684100800 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:e16 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 16 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:43:54.093 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 45 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:43:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=14556,1=14572} 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:54.095 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:54.096 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:43:54.096 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:43:54.096 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:43:54.096 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:43:54.096 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:54.096 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:43:54.096 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb67007af40 msgr2=0x7fb67007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb67007af40 0x7fb67007d400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb6840fe720 tx=0x7fb66c00b390 comp rx=0 tx=0).stop 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684100800 msgr2=0x7fb6840fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684100800 0x7fb6840fcc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb674031460 tx=0x7fb6740045e0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 shutdown_connections 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb684106800 0x7fb6840fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb67007af40 0x7fb67007d400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 --2- 172.21.15.118:0/2912193408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb684100800 0x7fb6840fcc90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 >> 172.21.15.118:0/2912193408 conn(0x7fb6840fc4e0 msgr2=0x7fb68406a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.092+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 shutdown_connections 2024-09-21T11:43:54.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.093+0000 7fb68a7bd640 1 -- 172.21.15.118:0/2912193408 wait complete. 2024-09-21T11:43:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.175+0000 7f77bcfef640 1 -- 172.21.15.118:0/913804282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 msgr2=0x7f77b8101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.175+0000 7f77bcfef640 1 --2- 172.21.15.118:0/913804282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 0x7f77b8101380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009880 tx=0x7f77ac02a530 comp rx=0 tx=0).stop 2024-09-21T11:43:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.175+0000 7f77bcfef640 1 -- 172.21.15.118:0/913804282 shutdown_connections 2024-09-21T11:43:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.175+0000 7f77bcfef640 1 --2- 172.21.15.118:0/913804282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 0x7f77b8101380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.175+0000 7f77bcfef640 1 --2- 172.21.15.118:0/913804282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b8106860 0x7f77b8106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.175+0000 7f77bcfef640 1 -- 172.21.15.118:0/913804282 >> 172.21.15.118:0/913804282 conn(0x7f77b80fbc60 msgr2=0x7f77b80fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.175+0000 7f77bcfef640 1 -- 172.21.15.118:0/913804282 shutdown_connections 2024-09-21T11:43:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.175+0000 7f77bcfef640 1 -- 172.21.15.118:0/913804282 wait complete. 2024-09-21T11:43:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77bcfef640 1 Processor -- start 2024-09-21T11:43:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77bcfef640 1 -- start start 2024-09-21T11:43:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77bcfef640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 0x7f77b8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77bcfef640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b8106860 0x7f77b8198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77bcfef640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f77b810dd20 con 0x7f77b8100f20 2024-09-21T11:43:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77bcfef640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f77b810dba0 con 0x7f77b8106860 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77b659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 0x7f77b8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77b659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 0x7f77b8198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48834/0 (socket says 172.21.15.118:48834) 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77b659c640 1 -- 172.21.15.118:0/3462071052 learned_addr learned my addr 172.21.15.118:0/3462071052 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77b5d9b640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b8106860 0x7f77b8198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77b659c640 1 -- 172.21.15.118:0/3462071052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b8106860 msgr2=0x7f77b8198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77b659c640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b8106860 0x7f77b8198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.176+0000 7f77b659c640 1 -- 172.21.15.118:0/3462071052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b8199390 con 0x7f77b8100f20 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.177+0000 7f77b5d9b640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b8106860 0x7f77b8198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.177+0000 7f77b659c640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 0x7f77b8198850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77a800d6f0 tx=0x7f77a800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.177+0000 7f77a77fe640 1 -- 172.21.15.118:0/3462071052 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77a8017070 con 0x7f77b8100f20 2024-09-21T11:43:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.177+0000 7f77a77fe640 1 -- 172.21.15.118:0/3462071052 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77a800de00 con 0x7f77b8100f20 2024-09-21T11:43:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.177+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b8199680 con 0x7f77b8100f20 2024-09-21T11:43:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.177+0000 7f77a77fe640 1 -- 172.21.15.118:0/3462071052 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77a8004bb0 con 0x7f77b8100f20 2024-09-21T11:43:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.177+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b81a1c80 con 0x7f77b8100f20 2024-09-21T11:43:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.178+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b8102140 con 0x7f77b8100f20 2024-09-21T11:43:54.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.179+0000 7f77a77fe640 1 -- 172.21.15.118:0/3462071052 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f77a8004e60 con 0x7f77b8100f20 2024-09-21T11:43:54.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.179+0000 7f77a77fe640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f77a007af30 0x7f77a007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:54.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.179+0000 7f77a77fe640 1 -- 172.21.15.118:0/3462071052 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f77a809dcf0 con 0x7f77b8100f20 2024-09-21T11:43:54.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.179+0000 7f77b5d9b640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f77a007af30 0x7f77a007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:54.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.180+0000 7f77b5d9b640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f77a007af30 0x7f77a007d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77b8100960 tx=0x7f77ac031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:54.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.183+0000 7f77a77fe640 1 -- 172.21.15.118:0/3462071052 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77b8199680 con 0x7f77b8100f20 2024-09-21T11:43:54.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.415+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f77b8062630 con 0x7f77a007af30 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.416+0000 7f77a77fe640 1 -- 172.21.15.118:0/3462071052 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f77b8062630 con 0x7f77a007af30 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "4/23 daemons upgraded", 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading crash daemons", 2024-09-21T11:43:54.419 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:43:54.420 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:43:54.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f77a007af30 msgr2=0x7f77a007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f77a007af30 0x7f77a007d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77b8100960 tx=0x7f77ac031400 comp rx=0 tx=0).stop 2024-09-21T11:43:54.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 msgr2=0x7f77b8198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 0x7f77b8198850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77a800d6f0 tx=0x7f77a800dbb0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 shutdown_connections 2024-09-21T11:43:54.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77b8106860 0x7f77b8198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f77a007af30 0x7f77a007d3f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 --2- 172.21.15.118:0/3462071052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77b8100f20 0x7f77b8198850 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 >> 172.21.15.118:0/3462071052 conn(0x7f77b80fbc60 msgr2=0x7f77b80fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:54.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 shutdown_connections 2024-09-21T11:43:54.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.419+0000 7f77bcfef640 1 -- 172.21.15.118:0/3462071052 wait complete. 2024-09-21T11:43:54.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.503+0000 7f008046b640 1 -- 172.21.15.118:0/3312112886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 msgr2=0x7f0078106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.503+0000 7f008046b640 1 --2- 172.21.15.118:0/3312112886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 0x7f0078106be0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0074009880 tx=0x7f007402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.503+0000 7f008046b640 1 -- 172.21.15.118:0/3312112886 shutdown_connections 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.503+0000 7f008046b640 1 --2- 172.21.15.118:0/3312112886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0078100800 0x7f0078100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.503+0000 7f008046b640 1 --2- 172.21.15.118:0/3312112886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 0x7f0078106be0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.503+0000 7f008046b640 1 -- 172.21.15.118:0/3312112886 >> 172.21.15.118:0/3312112886 conn(0x7f00780fc500 msgr2=0x7f00780fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.503+0000 7f008046b640 1 -- 172.21.15.118:0/3312112886 shutdown_connections 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.503+0000 7f008046b640 1 -- 172.21.15.118:0/3312112886 wait complete. 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f008046b640 1 Processor -- start 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f008046b640 1 -- start start 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f008046b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0078100800 0x7f0078198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f008046b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 0x7f0078198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f008046b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f007810dcd0 con 0x7f0078106800 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f008046b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f007810db50 con 0x7f0078100800 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f007da06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 0x7f0078198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:54.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f007da06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 0x7f0078198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48848/0 (socket says 172.21.15.118:48848) 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f007da06640 1 -- 172.21.15.118:0/751469101 learned_addr learned my addr 172.21.15.118:0/751469101 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.504+0000 7f007e207640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0078100800 0x7f0078198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.505+0000 7f007da06640 1 -- 172.21.15.118:0/751469101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0078100800 msgr2=0x7f0078198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.505+0000 7f007da06640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0078100800 0x7f0078198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.505+0000 7f007da06640 1 -- 172.21.15.118:0/751469101 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0078199360 con 0x7f0078106800 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.505+0000 7f007da06640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 0x7f0078198d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f006800d6f0 tx=0x7f006800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.505+0000 7f006f7fe640 1 -- 172.21.15.118:0/751469101 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0068017070 con 0x7f0078106800 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.505+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0078199650 con 0x7f0078106800 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.505+0000 7f006f7fe640 1 -- 172.21.15.118:0/751469101 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f006800de00 con 0x7f0078106800 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.505+0000 7f006f7fe640 1 -- 172.21.15.118:0/751469101 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0068004bb0 con 0x7f0078106800 2024-09-21T11:43:54.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.505+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00781a1c50 con 0x7f0078106800 2024-09-21T11:43:54.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.506+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0078101f40 con 0x7f0078106800 2024-09-21T11:43:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.507+0000 7f006f7fe640 1 -- 172.21.15.118:0/751469101 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0068004e60 con 0x7f0078106800 2024-09-21T11:43:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.508+0000 7f006f7fe640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f006407af30 0x7f006407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:43:54.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.508+0000 7f006f7fe640 1 -- 172.21.15.118:0/751469101 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f006809dba0 con 0x7f0078106800 2024-09-21T11:43:54.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.510+0000 7f007e207640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f006407af30 0x7f006407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:43:54.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.510+0000 7f007e207640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f006407af30 0x7f006407d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f00740096c0 tx=0x7f0074031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:43:54.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.518+0000 7f006f7fe640 1 -- 172.21.15.118:0/751469101 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0078199650 con 0x7f0078106800 2024-09-21T11:43:54.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:54 smithi118 ceph-mon[111738]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:54.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:54 smithi118 ceph-mon[111738]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:54.673 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:54 smithi118 ceph-mon[111738]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:54.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:54 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1012217442' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:43:54.674 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:54 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2912193408' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:43:54.742 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:54 smithi149 ceph-mon[79770]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:54.742 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:54 smithi149 ceph-mon[79770]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:54.742 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:54 smithi149 ceph-mon[79770]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:54.742 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:54 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1012217442' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:43:54.742 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:54 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2912193408' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:43:54.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.784+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0078108d70 con 0x7f0078106800 2024-09-21T11:43:54.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.785+0000 7f006f7fe640 1 -- 172.21.15.118:0/751469101 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f00680691a0 con 0x7f0078106800 2024-09-21T11:43:54.787 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:54.787 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:43:54.788 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:43:54.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.787+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f006407af30 msgr2=0x7f006407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.787+0000 7f008046b640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f006407af30 0x7f006407d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f00740096c0 tx=0x7f0074031400 comp rx=0 tx=0).stop 2024-09-21T11:43:54.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.787+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 msgr2=0x7f0078198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:43:54.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.787+0000 7f008046b640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 0x7f0078198d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f006800d6f0 tx=0x7f006800dbb0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.787+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 shutdown_connections 2024-09-21T11:43:54.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.788+0000 7f008046b640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f006407af30 0x7f006407d3f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.788+0000 7f008046b640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0078106800 0x7f0078198d60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.788+0000 7f008046b640 1 --2- 172.21.15.118:0/751469101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0078100800 0x7f0078198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:43:54.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.788+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 >> 172.21.15.118:0/751469101 conn(0x7f00780fc500 msgr2=0x7f00780fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:43:54.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.788+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 shutdown_connections 2024-09-21T11:43:54.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:43:54.788+0000 7f008046b640 1 -- 172.21.15.118:0/751469101 wait complete. 2024-09-21T11:43:55.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:55 smithi149 ceph-mon[79770]: pgmap v118: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:55.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:55 smithi149 ceph-mon[79770]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:55.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:55 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/751469101' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:43:55.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:55.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:55 smithi118 ceph-mon[111738]: pgmap v118: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:55 smithi118 ceph-mon[111738]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:43:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:55 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/751469101' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:43:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:57.807 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:57 smithi149 ceph-mon[79770]: pgmap v119: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:57.808 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:57 smithi149 ceph-mon[79770]: Upgrade: Updating crash.smithi149 (2/2) 2024-09-21T11:43:57.808 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:57 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:57.808 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:57 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T11:43:57.808 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:57 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:43:57.808 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:57 smithi149 ceph-mon[79770]: Deploying daemon crash.smithi149 on smithi149 2024-09-21T11:43:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:57 smithi118 ceph-mon[111738]: pgmap v119: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:57 smithi118 ceph-mon[111738]: Upgrade: Updating crash.smithi149 (2/2) 2024-09-21T11:43:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:57 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:43:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:57 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T11:43:57.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:57 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:43:57.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:57 smithi118 ceph-mon[111738]: Deploying daemon crash.smithi149 on smithi149 2024-09-21T11:43:59.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:43:59 smithi149 ceph-mon[79770]: pgmap v120: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:43:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:43:59 smithi118 ceph-mon[111738]: pgmap v120: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:01.261 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:00 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:01.261 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:00 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:01.261 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:00 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:44:01.261 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:00 smithi118 ceph-mon[111738]: pgmap v121: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:01.285 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:00 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:01.285 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:00 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:01.285 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:00 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:44:01.285 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:00 smithi149 ceph-mon[79770]: pgmap v121: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:03 smithi118 ceph-mon[111738]: pgmap v122: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:03.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:03.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:03.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:03.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:03.879 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:03 smithi149 ceph-mon[79770]: pgmap v122: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:03.879 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:03.879 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:03.879 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:03.880 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:05.915 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:05 smithi149 ceph-mon[79770]: pgmap v123: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:05.915 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:05.915 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:05.915 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:44:05.915 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:05.915 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:05.962 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:05 smithi118 ceph-mon[111738]: pgmap v123: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:05.962 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:05.962 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:05.963 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:44:05.963 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:05.963 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:07.548 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:07 smithi118 ceph-mon[111738]: pgmap v124: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:07.548 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:07 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:07.548 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:07 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:07.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:07 smithi149 ceph-mon[79770]: pgmap v124: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:07.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:07 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:07.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:07 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:09.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: pgmap v125: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi118"} : dispatch 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi118"}]': finished 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"} : dispatch 2024-09-21T11:44:09.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]': finished 2024-09-21T11:44:09.576 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: pgmap v125: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi118"} : dispatch 2024-09-21T11:44:09.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi118"}]': finished 2024-09-21T11:44:09.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"} : dispatch 2024-09-21T11:44:09.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]': finished 2024-09-21T11:44:09.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T11:44:10.483 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:10 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all crash 2024-09-21T11:44:10.483 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:10 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T11:44:10.484 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:10 smithi118 ceph-mon[111738]: Upgrade: osd.0 is safe to restart 2024-09-21T11:44:10.484 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:10 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:10.484 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:10 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T11:44:10.484 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:10 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:44:10.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:10 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all crash 2024-09-21T11:44:10.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:10 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T11:44:10.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:10 smithi149 ceph-mon[79770]: Upgrade: osd.0 is safe to restart 2024-09-21T11:44:10.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:10 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:10.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:10 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T11:44:10.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:10 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:44:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:11 smithi118 ceph-mon[111738]: pgmap v126: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:11 smithi118 ceph-mon[111738]: Upgrade: Updating osd.0 2024-09-21T11:44:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:11 smithi118 ceph-mon[111738]: Deploying daemon osd.0 on smithi118 2024-09-21T11:44:11.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:11 smithi149 ceph-mon[79770]: pgmap v126: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:11.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:11 smithi149 ceph-mon[79770]: Upgrade: Updating osd.0 2024-09-21T11:44:11.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:11 smithi149 ceph-mon[79770]: Deploying daemon osd.0 on smithi118 2024-09-21T11:44:13.243 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:13 smithi118 systemd[1]: Stopping Ceph osd.0 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:44:13.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:13 smithi149 ceph-mon[79770]: pgmap v127: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:13.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:13 smithi118 ceph-mon[111738]: pgmap v127: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:13.575 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:13 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[50380]: 2024-09-21T11:44:13.325+0000 7fe8a5577640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T11:44:13.575 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:13 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[50380]: 2024-09-21T11:44:13.325+0000 7fe8a5577640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-21T11:44:13.575 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:13 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[50380]: 2024-09-21T11:44:13.325+0000 7fe8a5577640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T11:44:14.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:14 smithi118 ceph-mon[111738]: osd.0 marked itself down and dead 2024-09-21T11:44:14.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:14 smithi149 ceph-mon[79770]: osd.0 marked itself down and dead 2024-09-21T11:44:15.008 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:14 smithi118 podman[120322]: 2024-09-21 11:44:14.665309212 +0000 UTC m=+1.432944400 container died 01359609206f39f10c388b9c394059c4e76e7dffcbe265749ff81d9748669c76 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0, RELEASE=squid-4e45e6b, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T11:44:15.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:15 smithi118 podman[120322]: 2024-09-21 11:44:15.201255367 +0000 UTC m=+1.968890544 container cleanup 01359609206f39f10c388b9c394059c4e76e7dffcbe265749ff81d9748669c76 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:44:15.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:15 smithi118 bash[120322]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0 2024-09-21T11:44:15.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:15 smithi118 ceph-mon[111738]: pgmap v128: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:15.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:15 smithi118 ceph-mon[111738]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:44:15.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:15 smithi118 ceph-mon[111738]: osdmap e48: 6 total, 5 up, 6 in 2024-09-21T11:44:15.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:15 smithi149 ceph-mon[79770]: pgmap v128: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:15.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:15 smithi149 ceph-mon[79770]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:44:15.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:15 smithi149 ceph-mon[79770]: osdmap e48: 6 total, 5 up, 6 in 2024-09-21T11:44:15.824 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:15 smithi118 podman[120337]: 2024-09-21 11:44:15.411678071 +0000 UTC m=+0.745112576 container remove 01359609206f39f10c388b9c394059c4e76e7dffcbe265749ff81d9748669c76 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0, org.label-schema.build-date=20240731, RELEASE=squid-4e45e6b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T11:44:16.100 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:15 smithi118 podman[120425]: 2024-09-21 11:44:15.728920125 +0000 UTC m=+0.017011751 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:44:16.100 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:15 smithi118 podman[120425]: 2024-09-21 11:44:15.854427943 +0000 UTC m=+0.142519567 container create 64be144c113ba88db9438f4604f29e550691c7edc2ab7b2c6edc3ba07277c95c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731) 2024-09-21T11:44:16.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:16 smithi118 ceph-mon[111738]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T11:44:16.575 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:16 smithi118 podman[120425]: 2024-09-21 11:44:16.098722672 +0000 UTC m=+0.386814303 container init 64be144c113ba88db9438f4604f29e550691c7edc2ab7b2c6edc3ba07277c95c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T11:44:16.575 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:16 smithi118 podman[120425]: 2024-09-21 11:44:16.103052554 +0000 UTC m=+0.391144176 container start 64be144c113ba88db9438f4604f29e550691c7edc2ab7b2c6edc3ba07277c95c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:44:16.575 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:16 smithi118 podman[120425]: 2024-09-21 11:44:16.173555676 +0000 UTC m=+0.461647324 container attach 64be144c113ba88db9438f4604f29e550691c7edc2ab7b2c6edc3ba07277c95c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T11:44:16.575 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:16 smithi118 podman[120425]: 2024-09-21 11:44:16.290992127 +0000 UTC m=+0.579083749 container died 64be144c113ba88db9438f4604f29e550691c7edc2ab7b2c6edc3ba07277c95c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T11:44:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:16 smithi149 ceph-mon[79770]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T11:44:17.262 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 podman[120448]: 2024-09-21 11:44:17.093891805 +0000 UTC m=+0.792845344 container remove 64be144c113ba88db9438f4604f29e550691c7edc2ab7b2c6edc3ba07277c95c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:44:17.262 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-21T11:44:17.263 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 systemd[1]: Stopped Ceph osd.0 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:44:17.263 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.0.service: Consumed 52.047s CPU time. 2024-09-21T11:44:17.556 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 systemd[1]: Starting Ceph osd.0 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:44:17.556 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:17 smithi118 ceph-mon[111738]: pgmap v131: 65 pgs: 34 peering, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:17.557 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:17 smithi118 ceph-mon[111738]: Health check failed: Reduced data availability: 24 pgs peering (PG_AVAILABILITY) 2024-09-21T11:44:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:17 smithi149 ceph-mon[79770]: pgmap v131: 65 pgs: 34 peering, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:17 smithi149 ceph-mon[79770]: Health check failed: Reduced data availability: 24 pgs peering (PG_AVAILABILITY) 2024-09-21T11:44:17.824 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 podman[120551]: 2024-09-21 11:44:17.458369264 +0000 UTC m=+0.016295328 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:44:17.824 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 podman[120551]: 2024-09-21 11:44:17.570247485 +0000 UTC m=+0.128173580 container create 7a205758e0d0120f4d2a921d81810fcecd001ba649a2fb78b35b345f308245f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T11:44:17.825 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 podman[120551]: 2024-09-21 11:44:17.781065764 +0000 UTC m=+0.338991819 container init 7a205758e0d0120f4d2a921d81810fcecd001ba649a2fb78b35b345f308245f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T11:44:17.825 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 podman[120551]: 2024-09-21 11:44:17.784828133 +0000 UTC m=+0.342754191 container start 7a205758e0d0120f4d2a921d81810fcecd001ba649a2fb78b35b345f308245f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:44:18.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 podman[120551]: 2024-09-21 11:44:17.881237414 +0000 UTC m=+0.439163471 container attach 7a205758e0d0120f4d2a921d81810fcecd001ba649a2fb78b35b345f308245f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T11:44:18.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:18.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 bash[120551]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:18.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:18.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:17 smithi118 bash[120551]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:19.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:19 smithi118 ceph-mon[111738]: pgmap v132: 65 pgs: 34 peering, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:19 smithi149 ceph-mon[79770]: pgmap v132: 65 pgs: 34 peering, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:20.940 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:44:20.941 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:20.941 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 bash[120551]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:44:20.941 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 bash[120551]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:20.941 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:20.941 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 bash[120551]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:20.941 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T11:44:20.941 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 bash[120551]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T11:44:20.941 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-21T11:44:20.941 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:20 smithi118 bash[120551]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-21T11:44:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:44:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:20 smithi149 ceph-mon[79770]: pgmap v133: 65 pgs: 10 active+undersized, 11 peering, 13 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 42/312 objects degraded (13.462%) 2024-09-21T11:44:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:44:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:20 smithi118 ceph-mon[111738]: pgmap v133: 65 pgs: 10 active+undersized, 11 peering, 13 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 42/312 objects degraded (13.462%) 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 bash[120551]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 bash[120551]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 bash[120551]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 bash[120551]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate[120566]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 bash[120551]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-21T11:44:21.325 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 podman[120551]: 2024-09-21 11:44:21.082946385 +0000 UTC m=+3.640872447 container died 7a205758e0d0120f4d2a921d81810fcecd001ba649a2fb78b35b345f308245f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T11:44:22.054 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:21 smithi118 ceph-mon[111738]: Health check failed: Degraded data redundancy: 42/312 objects degraded (13.462%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T11:44:22.054 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:21 smithi118 ceph-mon[111738]: Health check update: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-21T11:44:22.055 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 podman[120783]: 2024-09-21 11:44:21.718128399 +0000 UTC m=+0.624570601 container remove 7a205758e0d0120f4d2a921d81810fcecd001ba649a2fb78b35b345f308245f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-activate, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T11:44:22.055 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:21 smithi118 podman[120840]: 2024-09-21 11:44:21.835116528 +0000 UTC m=+0.016234443 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:44:22.055 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:22 smithi118 podman[120840]: 2024-09-21 11:44:22.052886626 +0000 UTC m=+0.234004573 container create cced3491d26011342f82eca04adf5b93902dbd2e7d525c6e3351a9ecbedcc235 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:44:22.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:21 smithi149 ceph-mon[79770]: Health check failed: Degraded data redundancy: 42/312 objects degraded (13.462%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T11:44:22.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:21 smithi149 ceph-mon[79770]: Health check update: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-21T11:44:22.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:22 smithi118 podman[120840]: 2024-09-21 11:44:22.29704907 +0000 UTC m=+0.478166984 container init cced3491d26011342f82eca04adf5b93902dbd2e7d525c6e3351a9ecbedcc235 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T11:44:22.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:22 smithi118 podman[120840]: 2024-09-21 11:44:22.300936196 +0000 UTC m=+0.482054102 container start cced3491d26011342f82eca04adf5b93902dbd2e7d525c6e3351a9ecbedcc235 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T11:44:22.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:22 smithi118 ceph-osd[120859]: -- 172.21.15.118:0/3219729553 <== mon.0 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56126ac1c1e0 con 0x56126abac000 2024-09-21T11:44:22.574 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:22 smithi118 bash[120840]: cced3491d26011342f82eca04adf5b93902dbd2e7d525c6e3351a9ecbedcc235 2024-09-21T11:44:22.574 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:22 smithi118 systemd[1]: Started Ceph osd.0 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:44:23.788 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:23 smithi118 ceph-mon[111738]: pgmap v134: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:23.788 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:23 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:23.788 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:23 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:23.788 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:23 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:44:23.789 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:23 smithi118 ceph-mon[111738]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-09-21T11:44:23.789 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:23 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[120855]: 2024-09-21T11:44:23.679+0000 7f91c214d640 -1 Falling back to public interface 2024-09-21T11:44:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:23 smithi149 ceph-mon[79770]: pgmap v134: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:23 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:23 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:23 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:44:23.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:23 smithi149 ceph-mon[79770]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-09-21T11:44:24.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.881+0000 7f8f11641640 1 -- 172.21.15.118:0/3540483596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c102aa0 msgr2=0x7f8f0c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:24.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.881+0000 7f8f11641640 1 --2- 172.21.15.118:0/3540483596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c102aa0 0x7f8f0c102e80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009c20 tx=0x7f8efc02aa00 comp rx=0 tx=0).stop 2024-09-21T11:44:24.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.881+0000 7f8f11641640 1 -- 172.21.15.118:0/3540483596 shutdown_connections 2024-09-21T11:44:24.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.881+0000 7f8f11641640 1 --2- 172.21.15.118:0/3540483596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0c1033c0 0x7f8f0c10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:24.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.881+0000 7f8f11641640 1 --2- 172.21.15.118:0/3540483596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c102aa0 0x7f8f0c102e80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:24.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.881+0000 7f8f11641640 1 -- 172.21.15.118:0/3540483596 >> 172.21.15.118:0/3540483596 conn(0x7f8f0c0fc4c0 msgr2=0x7f8f0c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:24.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.881+0000 7f8f11641640 1 -- 172.21.15.118:0/3540483596 shutdown_connections 2024-09-21T11:44:24.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.881+0000 7f8f11641640 1 -- 172.21.15.118:0/3540483596 wait complete. 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f11641640 1 Processor -- start 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f11641640 1 -- start start 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f11641640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0c102aa0 0x7f8f0c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f11641640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c1033c0 0x7f8f0c19dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f11641640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c10ee30 con 0x7f8f0c1033c0 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f11641640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c10ecb0 con 0x7f8f0c102aa0 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f0a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c1033c0 0x7f8f0c19dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f0a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c1033c0 0x7f8f0c19dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36738/0 (socket says 172.21.15.118:36738) 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f0a7fc640 1 -- 172.21.15.118:0/412584659 learned_addr learned my addr 172.21.15.118:0/412584659 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f0affd640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0c102aa0 0x7f8f0c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f0a7fc640 1 -- 172.21.15.118:0/412584659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0c102aa0 msgr2=0x7f8f0c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f0a7fc640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0c102aa0 0x7f8f0c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f0a7fc640 1 -- 172.21.15.118:0/412584659 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c1978c0 con 0x7f8f0c1033c0 2024-09-21T11:44:24.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.882+0000 7f8f0affd640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0c102aa0 0x7f8f0c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:44:24.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.883+0000 7f8f0a7fc640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c1033c0 0x7f8f0c19dc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b370 tx=0x7f8f0000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:24.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.883+0000 7f8ef3fff640 1 -- 172.21.15.118:0/412584659 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f00015020 con 0x7f8f0c1033c0 2024-09-21T11:44:24.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.883+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c197bb0 con 0x7f8f0c1033c0 2024-09-21T11:44:24.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.883+0000 7f8ef3fff640 1 -- 172.21.15.118:0/412584659 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f00011af0 con 0x7f8f0c1033c0 2024-09-21T11:44:24.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.883+0000 7f8ef3fff640 1 -- 172.21.15.118:0/412584659 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f00010d60 con 0x7f8f0c1033c0 2024-09-21T11:44:24.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.883+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0c198140 con 0x7f8f0c1033c0 2024-09-21T11:44:24.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.884+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0c06a410 con 0x7f8f0c1033c0 2024-09-21T11:44:24.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.884+0000 7f8ef3fff640 1 -- 172.21.15.118:0/412584659 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8f00018020 con 0x7f8f0c1033c0 2024-09-21T11:44:24.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.885+0000 7f8ef3fff640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ef407af40 0x7f8ef407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:24.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.885+0000 7f8ef3fff640 1 -- 172.21.15.118:0/412584659 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f8f0009d970 con 0x7f8f0c1033c0 2024-09-21T11:44:24.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.885+0000 7f8f0affd640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ef407af40 0x7f8ef407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:24.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.885+0000 7f8f0affd640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ef407af40 0x7f8ef407d400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8efc006010 tx=0x7f8efc02e9b0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:24.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:24.889+0000 7f8ef3fff640 1 -- 172.21.15.118:0/412584659 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f0009fe20 con 0x7f8f0c1033c0 2024-09-21T11:44:25.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.092+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8f0c198df0 con 0x7f8ef407af40 2024-09-21T11:44:25.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.094+0000 7f8ef3fff640 1 -- 172.21.15.118:0/412584659 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8f0c198df0 con 0x7f8ef407af40 2024-09-21T11:44:25.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ef407af40 msgr2=0x7f8ef407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ef407af40 0x7f8ef407d400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8efc006010 tx=0x7f8efc02e9b0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c1033c0 msgr2=0x7f8f0c19dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c1033c0 0x7f8f0c19dc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b370 tx=0x7f8f0000b830 comp rx=0 tx=0).stop 2024-09-21T11:44:25.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 shutdown_connections 2024-09-21T11:44:25.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ef407af40 0x7f8ef407d400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c1033c0 0x7f8f0c19dc40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 --2- 172.21.15.118:0/412584659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0c102aa0 0x7f8f0c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 >> 172.21.15.118:0/412584659 conn(0x7f8f0c0fc4c0 msgr2=0x7f8f0c103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:25.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 shutdown_connections 2024-09-21T11:44:25.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.097+0000 7f8f11641640 1 -- 172.21.15.118:0/412584659 wait complete. 2024-09-21T11:44:25.112 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:44:25.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.190+0000 7f7ead9f7640 1 -- 172.21.15.118:0/2547068273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81007f0 msgr2=0x7f7ea8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.190+0000 7f7ead9f7640 1 --2- 172.21.15.118:0/2547068273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81007f0 0x7f7ea8100c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009880 tx=0x7f7e9002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.190+0000 7f7ead9f7640 1 -- 172.21.15.118:0/2547068273 shutdown_connections 2024-09-21T11:44:25.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.190+0000 7f7ead9f7640 1 --2- 172.21.15.118:0/2547068273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81007f0 0x7f7ea8100c50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.190+0000 7f7ead9f7640 1 --2- 172.21.15.118:0/2547068273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ea81067f0 0x7f7ea8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.190+0000 7f7ead9f7640 1 -- 172.21.15.118:0/2547068273 >> 172.21.15.118:0/2547068273 conn(0x7f7ea80fc4f0 msgr2=0x7f7ea80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:25.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.190+0000 7f7ead9f7640 1 -- 172.21.15.118:0/2547068273 shutdown_connections 2024-09-21T11:44:25.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.190+0000 7f7ead9f7640 1 -- 172.21.15.118:0/2547068273 wait complete. 2024-09-21T11:44:25.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ead9f7640 1 Processor -- start 2024-09-21T11:44:25.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ead9f7640 1 -- start start 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ead9f7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ea81007f0 0x7f7ea81987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ead9f7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81067f0 0x7f7ea8198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ead9f7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea810dca0 con 0x7f7ea81067f0 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ead9f7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea810db20 con 0x7f7ea81007f0 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ea67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81067f0 0x7f7ea8198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ea67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81067f0 0x7f7ea8198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36760/0 (socket says 172.21.15.118:36760) 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ea67fc640 1 -- 172.21.15.118:0/235775283 learned_addr learned my addr 172.21.15.118:0/235775283 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.191+0000 7f7ea6ffd640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ea81007f0 0x7f7ea81987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.192+0000 7f7ea67fc640 1 -- 172.21.15.118:0/235775283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ea81007f0 msgr2=0x7f7ea81987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.192+0000 7f7ea67fc640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ea81007f0 0x7f7ea81987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.192+0000 7f7ea67fc640 1 -- 172.21.15.118:0/235775283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea8199310 con 0x7f7ea81067f0 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.192+0000 7f7ea67fc640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81067f0 0x7f7ea8198d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e90031460 tx=0x7f7e900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.192+0000 7f7eac9f5640 1 -- 172.21.15.118:0/235775283 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e9003f070 con 0x7f7ea81067f0 2024-09-21T11:44:25.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.192+0000 7f7eac9f5640 1 -- 172.21.15.118:0/235775283 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7e900035f0 con 0x7f7ea81067f0 2024-09-21T11:44:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.192+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea81995a0 con 0x7f7ea81067f0 2024-09-21T11:44:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.192+0000 7f7eac9f5640 1 -- 172.21.15.118:0/235775283 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e90035030 con 0x7f7ea81067f0 2024-09-21T11:44:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.192+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea81a1b50 con 0x7f7ea81067f0 2024-09-21T11:44:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.193+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea8101f30 con 0x7f7ea81067f0 2024-09-21T11:44:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.194+0000 7f7eac9f5640 1 -- 172.21.15.118:0/235775283 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7e90042070 con 0x7f7ea81067f0 2024-09-21T11:44:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.194+0000 7f7eac9f5640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7e9407af30 0x7f7e9407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.194+0000 7f7eac9f5640 1 -- 172.21.15.118:0/235775283 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f7e900be970 con 0x7f7ea81067f0 2024-09-21T11:44:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.194+0000 7f7ea6ffd640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7e9407af30 0x7f7e9407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.195+0000 7f7ea6ffd640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7e9407af30 0x7f7e9407d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0005fd0 tx=0x7f7ea0009760 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:25.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.199+0000 7f7eac9f5640 1 -- 172.21.15.118:0/235775283 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e900c0e20 con 0x7f7ea81067f0 2024-09-21T11:44:25.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.401+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7ea8062630 con 0x7f7e9407af30 2024-09-21T11:44:25.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.403+0000 7f7eac9f5640 1 -- 172.21.15.118:0/235775283 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f7ea8062630 con 0x7f7e9407af30 2024-09-21T11:44:25.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7e9407af30 msgr2=0x7f7e9407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7e9407af30 0x7f7e9407d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0005fd0 tx=0x7f7ea0009760 comp rx=0 tx=0).stop 2024-09-21T11:44:25.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81067f0 msgr2=0x7f7ea8198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81067f0 0x7f7ea8198d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e90031460 tx=0x7f7e900045e0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 shutdown_connections 2024-09-21T11:44:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7e9407af30 0x7f7e9407d3f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ea81067f0 0x7f7ea8198d10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 --2- 172.21.15.118:0/235775283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ea81007f0 0x7f7ea81987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 >> 172.21.15.118:0/235775283 conn(0x7f7ea80fc4f0 msgr2=0x7f7ea80fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 shutdown_connections 2024-09-21T11:44:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.405+0000 7f7ead9f7640 1 -- 172.21.15.118:0/235775283 wait complete. 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.487+0000 7f59f8719640 1 -- 172.21.15.118:0/3024414310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100bb0 msgr2=0x7f59f0104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.487+0000 7f59f8719640 1 --2- 172.21.15.118:0/3024414310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100bb0 0x7f59f0104c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59e000a990 tx=0x7f59e002b7d0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.487+0000 7f59f8719640 1 -- 172.21.15.118:0/3024414310 shutdown_connections 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.487+0000 7f59f8719640 1 --2- 172.21.15.118:0/3024414310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100bb0 0x7f59f0104c00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.487+0000 7f59f8719640 1 --2- 172.21.15.118:0/3024414310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59f0100200 0x7f59f01005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.487+0000 7f59f8719640 1 -- 172.21.15.118:0/3024414310 >> 172.21.15.118:0/3024414310 conn(0x7f59f00fbc60 msgr2=0x7f59f00fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.487+0000 7f59f8719640 1 -- 172.21.15.118:0/3024414310 shutdown_connections 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.487+0000 7f59f8719640 1 -- 172.21.15.118:0/3024414310 wait complete. 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f8719640 1 Processor -- start 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f8719640 1 -- start start 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f8719640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100200 0x7f59f0101ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f8719640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59f0100bb0 0x7f59f01021e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:25.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f8719640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f59f010cb60 con 0x7f59f0100200 2024-09-21T11:44:25.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f8719640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f59f010c9e0 con 0x7f59f0100bb0 2024-09-21T11:44:25.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f64b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100200 0x7f59f0101ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:25.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f64b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100200 0x7f59f0101ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48804/0 (socket says 172.21.15.118:48804) 2024-09-21T11:44:25.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f64b5640 1 -- 172.21.15.118:0/2392246388 learned_addr learned my addr 172.21.15.118:0/2392246388 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:25.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f5cb4640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59f0100bb0 0x7f59f01021e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:25.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f64b5640 1 -- 172.21.15.118:0/2392246388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59f0100bb0 msgr2=0x7f59f01021e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f64b5640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59f0100bb0 0x7f59f01021e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.488+0000 7f59f64b5640 1 -- 172.21.15.118:0/2392246388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f0102720 con 0x7f59f0100200 2024-09-21T11:44:25.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.489+0000 7f59f64b5640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100200 0x7f59f0101ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00d8d0 tx=0x7f59ec00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:25.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.489+0000 7f59e77fe640 1 -- 172.21.15.118:0/2392246388 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59ec017070 con 0x7f59f0100200 2024-09-21T11:44:25.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.489+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f0102a10 con 0x7f59f0100200 2024-09-21T11:44:25.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.489+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f01a3e60 con 0x7f59f0100200 2024-09-21T11:44:25.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.489+0000 7f59e77fe640 1 -- 172.21.15.118:0/2392246388 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59ec010460 con 0x7f59f0100200 2024-09-21T11:44:25.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.489+0000 7f59e77fe640 1 -- 172.21.15.118:0/2392246388 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59ec020060 con 0x7f59f0100200 2024-09-21T11:44:25.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.490+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d4005290 con 0x7f59f0100200 2024-09-21T11:44:25.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.490+0000 7f59e77fe640 1 -- 172.21.15.118:0/2392246388 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f59ec009a30 con 0x7f59f0100200 2024-09-21T11:44:25.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.491+0000 7f59e77fe640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f59dc07af40 0x7f59dc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:25.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.491+0000 7f59f5cb4640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f59dc07af40 0x7f59dc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:25.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.491+0000 7f59e77fe640 1 -- 172.21.15.118:0/2392246388 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f59ec09dad0 con 0x7f59f0100200 2024-09-21T11:44:25.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.492+0000 7f59f5cb4640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f59dc07af40 0x7f59dc07d400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59e000a340 tx=0x7f59e0005fd0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:25.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.495+0000 7f59e77fe640 1 -- 172.21.15.118:0/2392246388 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f59ec0690d0 con 0x7f59f0100200 2024-09-21T11:44:25.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.686+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f59d4000bc0 con 0x7f59dc07af40 2024-09-21T11:44:25.689 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:25 smithi118 ceph-mon[111738]: pgmap v135: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:25.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.696+0000 7f59e77fe640 1 -- 172.21.15.118:0/2392246388 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f59d4000bc0 con 0x7f59dc07af40 2024-09-21T11:44:25.698 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (2m) 20s ago 13m 20.0M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (5m) 20s ago 13m 8791k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (4m) 23s ago 12m 8358k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (30s) 20s ago 13m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (26s) 23s ago 12m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (115s) 20s ago 13m 81.0M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (7m) 20s ago 7m 147M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (7m) 20s ago 7m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (7m) 23s ago 7m 22.1M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (7m) 23s ago 7m 16.0M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (4m) 20s ago 14m 522M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (3m) 23s ago 12m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:44:25.699 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (59s) 20s ago 14m 38.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (42s) 23s ago 12m 25.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (3m) 20s ago 13m 10.0M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (3m) 23s ago 12m 10.7M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 starting - - - 1216M 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (10m) 20s ago 10m 228M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (10m) 20s ago 10m 184M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (9m) 23s ago 9m 260M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (9m) 23s ago 9m 212M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (9m) 23s ago 8m 207M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:44:25.700 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (2m) 20s ago 12m 49.8M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f59dc07af40 msgr2=0x7f59dc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f59dc07af40 0x7f59dc07d400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59e000a340 tx=0x7f59e0005fd0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100200 msgr2=0x7f59f0101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100200 0x7f59f0101ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00d8d0 tx=0x7f59ec00dd90 comp rx=0 tx=0).stop 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 shutdown_connections 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59f0100bb0 0x7f59f01021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f59dc07af40 0x7f59dc07d400 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 --2- 172.21.15.118:0/2392246388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59f0100200 0x7f59f0101ca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 >> 172.21.15.118:0/2392246388 conn(0x7f59f00fbc60 msgr2=0x7f59f00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 shutdown_connections 2024-09-21T11:44:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.698+0000 7f59f8719640 1 -- 172.21.15.118:0/2392246388 wait complete. 2024-09-21T11:44:25.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.780+0000 7f8fd27bd640 1 -- 172.21.15.118:0/2934089141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 msgr2=0x7f8fcc102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.780+0000 7f8fd27bd640 1 --2- 172.21.15.118:0/2934089141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 0x7f8fcc102ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009880 tx=0x7f8fbc02a530 comp rx=0 tx=0).stop 2024-09-21T11:44:25.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.780+0000 7f8fd27bd640 1 -- 172.21.15.118:0/2934089141 shutdown_connections 2024-09-21T11:44:25.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.780+0000 7f8fd27bd640 1 --2- 172.21.15.118:0/2934089141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fcc103400 0x7f8fcc10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.780+0000 7f8fd27bd640 1 --2- 172.21.15.118:0/2934089141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 0x7f8fcc102ec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.780+0000 7f8fd27bd640 1 -- 172.21.15.118:0/2934089141 >> 172.21.15.118:0/2934089141 conn(0x7f8fcc0fc520 msgr2=0x7f8fcc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:25.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.780+0000 7f8fd27bd640 1 -- 172.21.15.118:0/2934089141 shutdown_connections 2024-09-21T11:44:25.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.780+0000 7f8fd27bd640 1 -- 172.21.15.118:0/2934089141 wait complete. 2024-09-21T11:44:25.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fd27bd640 1 Processor -- start 2024-09-21T11:44:25.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fd27bd640 1 -- start start 2024-09-21T11:44:25.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fd27bd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 0x7f8fcc19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:25.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fd27bd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fcc103400 0x7f8fcc19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fd27bd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc10edf0 con 0x7f8fcc102ae0 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fd27bd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc10ec70 con 0x7f8fcc103400 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fcbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 0x7f8fcc19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fcbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 0x7f8fcc19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48824/0 (socket says 172.21.15.118:48824) 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fcbfff640 1 -- 172.21.15.118:0/532842144 learned_addr learned my addr 172.21.15.118:0/532842144 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fcb7fe640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fcc103400 0x7f8fcc19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fcbfff640 1 -- 172.21.15.118:0/532842144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fcc103400 msgr2=0x7f8fcc19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fcbfff640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fcc103400 0x7f8fcc19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.781+0000 7f8fcbfff640 1 -- 172.21.15.118:0/532842144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc1977e0 con 0x7f8fcc102ae0 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.782+0000 7f8fcbfff640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 0x7f8fcc19d660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc031460 tx=0x7f8fbc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:25.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.782+0000 7f8fc97fa640 1 -- 172.21.15.118:0/532842144 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fbc03f070 con 0x7f8fcc102ae0 2024-09-21T11:44:25.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.782+0000 7f8fc97fa640 1 -- 172.21.15.118:0/532842144 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fbc004cf0 con 0x7f8fcc102ae0 2024-09-21T11:44:25.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.782+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc197a70 con 0x7f8fcc102ae0 2024-09-21T11:44:25.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.782+0000 7f8fc97fa640 1 -- 172.21.15.118:0/532842144 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fbc035030 con 0x7f8fcc102ae0 2024-09-21T11:44:25.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.782+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc197fa0 con 0x7f8fcc102ae0 2024-09-21T11:44:25.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.783+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fcc06abe0 con 0x7f8fcc102ae0 2024-09-21T11:44:25.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.784+0000 7f8fc97fa640 1 -- 172.21.15.118:0/532842144 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8fbc042070 con 0x7f8fcc102ae0 2024-09-21T11:44:25.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.784+0000 7f8fc97fa640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fb407af30 0x7f8fb407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:25.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.784+0000 7f8fc97fa640 1 -- 172.21.15.118:0/532842144 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f8fbc0bea10 con 0x7f8fcc102ae0 2024-09-21T11:44:25.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.784+0000 7f8fcb7fe640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fb407af30 0x7f8fb407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:25.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.785+0000 7f8fcb7fe640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fb407af30 0x7f8fb407d3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0fe510 tx=0x7f8fc000a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:25.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:25.789+0000 7f8fc97fa640 1 -- 172.21.15.118:0/532842144 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fbc08a010 con 0x7f8fcc102ae0 2024-09-21T11:44:25.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:25 smithi149 ceph-mon[79770]: pgmap v135: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:26.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.052+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8fcc198d40 con 0x7f8fcc102ae0 2024-09-21T11:44:26.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.052+0000 7f8fc97fa640 1 -- 172.21.15.118:0/532842144 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7f8fcc198d40 con 0x7f8fcc102ae0 2024-09-21T11:44:26.055 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:44:26.055 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:44:26.055 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:44:26.055 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:44:26.055 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 9, 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:44:26.056 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:44:26.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fb407af30 msgr2=0x7f8fb407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fb407af30 0x7f8fb407d3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0fe510 tx=0x7f8fc000a250 comp rx=0 tx=0).stop 2024-09-21T11:44:26.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 msgr2=0x7f8fcc19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 0x7f8fcc19d660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc031460 tx=0x7f8fbc0048f0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 shutdown_connections 2024-09-21T11:44:26.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fcc103400 0x7f8fcc19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fb407af30 0x7f8fb407d3f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 --2- 172.21.15.118:0/532842144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc102ae0 0x7f8fcc19d660 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 >> 172.21.15.118:0/532842144 conn(0x7f8fcc0fc520 msgr2=0x7f8fcc108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:26.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 shutdown_connections 2024-09-21T11:44:26.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.055+0000 7f8fd27bd640 1 -- 172.21.15.118:0/532842144 wait complete. 2024-09-21T11:44:26.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.140+0000 7f246cbc9640 1 -- 172.21.15.118:0/2598253269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2468102aa0 msgr2=0x7f2468102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.140+0000 7f246cbc9640 1 --2- 172.21.15.118:0/2598253269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2468102aa0 0x7f2468102e80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2450009880 tx=0x7f245002a530 comp rx=0 tx=0).stop 2024-09-21T11:44:26.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.140+0000 7f246cbc9640 1 -- 172.21.15.118:0/2598253269 shutdown_connections 2024-09-21T11:44:26.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.140+0000 7f246cbc9640 1 --2- 172.21.15.118:0/2598253269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24681033c0 0x7f246810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.140+0000 7f246cbc9640 1 --2- 172.21.15.118:0/2598253269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2468102aa0 0x7f2468102e80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.140+0000 7f246cbc9640 1 -- 172.21.15.118:0/2598253269 >> 172.21.15.118:0/2598253269 conn(0x7f24680fc4c0 msgr2=0x7f24680fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:26.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.140+0000 7f246cbc9640 1 -- 172.21.15.118:0/2598253269 shutdown_connections 2024-09-21T11:44:26.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.140+0000 7f246cbc9640 1 -- 172.21.15.118:0/2598253269 wait complete. 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.141+0000 7f246cbc9640 1 Processor -- start 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.141+0000 7f246cbc9640 1 -- start start 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.141+0000 7f246cbc9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2468102aa0 0x7f2468100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.141+0000 7f246cbc9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24681033c0 0x7f2468100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.141+0000 7f246cbc9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f246810edb0 con 0x7f24681033c0 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.141+0000 7f246cbc9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f246810ec30 con 0x7f2468102aa0 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.141+0000 7f2465d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24681033c0 0x7f2468100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.141+0000 7f2465d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24681033c0 0x7f2468100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48836/0 (socket says 172.21.15.118:48836) 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.141+0000 7f2465d9b640 1 -- 172.21.15.118:0/381835662 learned_addr learned my addr 172.21.15.118:0/381835662 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.142+0000 7f2465d9b640 1 -- 172.21.15.118:0/381835662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2468102aa0 msgr2=0x7f2468100700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.142+0000 7f2465d9b640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2468102aa0 0x7f2468100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.142+0000 7f2465d9b640 1 -- 172.21.15.118:0/381835662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2468101180 con 0x7f24681033c0 2024-09-21T11:44:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.142+0000 7f2465d9b640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24681033c0 0x7f2468100c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f245800c8f0 tx=0x7f245800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.142+0000 7f245f7fe640 1 -- 172.21.15.118:0/381835662 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24580079b0 con 0x7f24681033c0 2024-09-21T11:44:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.142+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2468101470 con 0x7f24681033c0 2024-09-21T11:44:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.142+0000 7f245f7fe640 1 -- 172.21.15.118:0/381835662 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2458007b50 con 0x7f24681033c0 2024-09-21T11:44:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.142+0000 7f245f7fe640 1 -- 172.21.15.118:0/381835662 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2458018610 con 0x7f24681033c0 2024-09-21T11:44:26.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.142+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24681a3dc0 con 0x7f24681033c0 2024-09-21T11:44:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.143+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f246806a410 con 0x7f24681033c0 2024-09-21T11:44:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.144+0000 7f245f7fe640 1 -- 172.21.15.118:0/381835662 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2458007d00 con 0x7f24681033c0 2024-09-21T11:44:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.145+0000 7f245f7fe640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f245407af30 0x7f245407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.145+0000 7f245f7fe640 1 -- 172.21.15.118:0/381835662 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f245809e280 con 0x7f24681033c0 2024-09-21T11:44:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.145+0000 7f246659c640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f245407af30 0x7f245407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.145+0000 7f246659c640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f245407af30 0x7f245407d3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24500096c0 tx=0x7f2450000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:26.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.153+0000 7f245f7fe640 1 -- 172.21.15.118:0/381835662 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2458014030 con 0x7f24681033c0 2024-09-21T11:44:26.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.383+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f24681059e0 con 0x7f24681033c0 2024-09-21T11:44:26.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.384+0000 7f245f7fe640 1 -- 172.21.15.118:0/381835662 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2032 (secure 0 0 0) 0x7f2458069880 con 0x7f24681033c0 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:e16 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 16 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:44:26.387 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 45 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=14556,1=14572} 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:44:26.388 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:44:26.389 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:44:26.390 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:44:26.390 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T11:44:26.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f245407af30 msgr2=0x7f245407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f245407af30 0x7f245407d3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24500096c0 tx=0x7f2450000bc0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24681033c0 msgr2=0x7f2468100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24681033c0 0x7f2468100c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f245800c8f0 tx=0x7f245800cdb0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 shutdown_connections 2024-09-21T11:44:26.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f245407af30 0x7f245407d3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24681033c0 0x7f2468100c40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 --2- 172.21.15.118:0/381835662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2468102aa0 0x7f2468100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 >> 172.21.15.118:0/381835662 conn(0x7f24680fc4c0 msgr2=0x7f2468108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:26.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 shutdown_connections 2024-09-21T11:44:26.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.386+0000 7f246cbc9640 1 -- 172.21.15.118:0/381835662 wait complete. 2024-09-21T11:44:26.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.471+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2813993519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 msgr2=0x7fb2dc107cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.471+0000 7fb2e30ed640 1 --2- 172.21.15.118:0/2813993519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 0x7fb2dc107cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009880 tx=0x7fb2d002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.471+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2813993519 shutdown_connections 2024-09-21T11:44:26.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.471+0000 7fb2e30ed640 1 --2- 172.21.15.118:0/2813993519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2dc1018f0 0x7fb2dc101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.471+0000 7fb2e30ed640 1 --2- 172.21.15.118:0/2813993519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 0x7fb2dc107cd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.471+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2813993519 >> 172.21.15.118:0/2813993519 conn(0x7fb2dc0fd630 msgr2=0x7fb2dc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:26.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.471+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2813993519 shutdown_connections 2024-09-21T11:44:26.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.471+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2813993519 wait complete. 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2e30ed640 1 Processor -- start 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2e30ed640 1 -- start start 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2e30ed640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2dc1018f0 0x7fb2dc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2e30ed640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 0x7fb2dc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2e30ed640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc10eda0 con 0x7fb2dc1078f0 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2e30ed640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc10ec20 con 0x7fb2dc1018f0 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2dbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 0x7fb2dc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2dbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 0x7fb2dc19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48852/0 (socket says 172.21.15.118:48852) 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2dbfff640 1 -- 172.21.15.118:0/2817314707 learned_addr learned my addr 172.21.15.118:0/2817314707 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2e0e89640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2dc1018f0 0x7fb2dc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2dbfff640 1 -- 172.21.15.118:0/2817314707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2dc1018f0 msgr2=0x7fb2dc19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2dbfff640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2dc1018f0 0x7fb2dc19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.472+0000 7fb2dbfff640 1 -- 172.21.15.118:0/2817314707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc1977d0 con 0x7fb2dc1078f0 2024-09-21T11:44:26.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.473+0000 7fb2dbfff640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 0x7fb2dc19db90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d8d0 tx=0x7fb2c800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:26.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.473+0000 7fb2d9ffb640 1 -- 172.21.15.118:0/2817314707 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2c8017070 con 0x7fb2dc1078f0 2024-09-21T11:44:26.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.473+0000 7fb2d9ffb640 1 -- 172.21.15.118:0/2817314707 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2c8010460 con 0x7fb2dc1078f0 2024-09-21T11:44:26.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.473+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2dc197ac0 con 0x7fb2dc1078f0 2024-09-21T11:44:26.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.473+0000 7fb2d9ffb640 1 -- 172.21.15.118:0/2817314707 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2c800f5f0 con 0x7fb2dc1078f0 2024-09-21T11:44:26.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.473+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2dc198050 con 0x7fb2dc1078f0 2024-09-21T11:44:26.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.474+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2dc103030 con 0x7fb2dc1078f0 2024-09-21T11:44:26.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.474+0000 7fb2d9ffb640 1 -- 172.21.15.118:0/2817314707 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb2c8009a30 con 0x7fb2dc1078f0 2024-09-21T11:44:26.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.475+0000 7fb2d9ffb640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2cc07af90 0x7fb2cc07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:26.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.475+0000 7fb2d9ffb640 1 -- 172.21.15.118:0/2817314707 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fb2c809dd80 con 0x7fb2dc1078f0 2024-09-21T11:44:26.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.475+0000 7fb2e0e89640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2cc07af90 0x7fb2cc07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:26.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.476+0000 7fb2e0e89640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2cc07af90 0x7fb2cc07d450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00096c0 tx=0x7fb2d0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:26.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.479+0000 7fb2d9ffb640 1 -- 172.21.15.118:0/2817314707 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2c8069400 con 0x7fb2dc1078f0 2024-09-21T11:44:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:26 smithi118 ceph-mon[111738]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:26 smithi118 ceph-mon[111738]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:26 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/532842144' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:26 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/381835662' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:44:26.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.690+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb2dc198300 con 0x7fb2cc07af90 2024-09-21T11:44:26.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.692+0000 7fb2d9ffb640 1 -- 172.21.15.118:0/2817314707 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fb2dc198300 con 0x7fb2cc07af90 2024-09-21T11:44:26.694 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:44:26.694 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:44:26.694 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:44:26.694 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:44:26.695 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:44:26.695 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:44:26.695 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:44:26.695 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:44:26.695 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:44:26.695 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "6/23 daemons upgraded", 2024-09-21T11:44:26.695 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T11:44:26.695 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:44:26.695 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2cc07af90 msgr2=0x7fb2cc07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2cc07af90 0x7fb2cc07d450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00096c0 tx=0x7fb2d0031400 comp rx=0 tx=0).stop 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 msgr2=0x7fb2dc19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 0x7fb2dc19db90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d8d0 tx=0x7fb2c800dd90 comp rx=0 tx=0).stop 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 shutdown_connections 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2cc07af90 0x7fb2cc07d450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2dc1078f0 0x7fb2dc19db90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 --2- 172.21.15.118:0/2817314707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2dc1018f0 0x7fb2dc19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 >> 172.21.15.118:0/2817314707 conn(0x7fb2dc0fd630 msgr2=0x7fb2dc0fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 shutdown_connections 2024-09-21T11:44:26.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.694+0000 7fb2e30ed640 1 -- 172.21.15.118:0/2817314707 wait complete. 2024-09-21T11:44:26.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.783+0000 7f1833a4c640 1 -- 172.21.15.118:0/4252184604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1007e0 msgr2=0x7f182c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.783+0000 7f1833a4c640 1 --2- 172.21.15.118:0/4252184604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1007e0 0x7f182c100c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f181c009880 tx=0x7f181c02e8b0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.784+0000 7f1833a4c640 1 -- 172.21.15.118:0/4252184604 shutdown_connections 2024-09-21T11:44:26.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.784+0000 7f1833a4c640 1 --2- 172.21.15.118:0/4252184604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1007e0 0x7f182c100c40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.784+0000 7f1833a4c640 1 --2- 172.21.15.118:0/4252184604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f182c1067e0 0x7f182c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.784+0000 7f1833a4c640 1 -- 172.21.15.118:0/4252184604 >> 172.21.15.118:0/4252184604 conn(0x7f182c0fc4c0 msgr2=0x7f182c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:26.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.784+0000 7f1833a4c640 1 -- 172.21.15.118:0/4252184604 shutdown_connections 2024-09-21T11:44:26.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.784+0000 7f1833a4c640 1 -- 172.21.15.118:0/4252184604 wait complete. 2024-09-21T11:44:26.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.784+0000 7f1833a4c640 1 Processor -- start 2024-09-21T11:44:26.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.784+0000 7f1833a4c640 1 -- start start 2024-09-21T11:44:26.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1833a4c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f182c1007e0 0x7f182c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:26.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1833a4c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1067e0 0x7f182c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:26.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1833a4c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f182c10cba0 con 0x7f182c1067e0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1833a4c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f182c10ca20 con 0x7f182c1007e0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1830fe7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1067e0 0x7f182c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1830fe7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1067e0 0x7f182c19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48866/0 (socket says 172.21.15.118:48866) 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1830fe7640 1 -- 172.21.15.118:0/1488930306 learned_addr learned my addr 172.21.15.118:0/1488930306 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f18317e8640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f182c1007e0 0x7f182c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1830fe7640 1 -- 172.21.15.118:0/1488930306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f182c1007e0 msgr2=0x7f182c19b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1830fe7640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f182c1007e0 0x7f182c19b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1830fe7640 1 -- 172.21.15.118:0/1488930306 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182c195590 con 0x7f182c1067e0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.785+0000 7f1830fe7640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1067e0 0x7f182c19b910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f181c02edd0 tx=0x7f181c035a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.786+0000 7f18227fc640 1 -- 172.21.15.118:0/1488930306 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f181c044070 con 0x7f182c1067e0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.786+0000 7f18227fc640 1 -- 172.21.15.118:0/1488930306 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f181c004c60 con 0x7f182c1067e0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.786+0000 7f18227fc640 1 -- 172.21.15.118:0/1488930306 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f181c003820 con 0x7f182c1067e0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.786+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182c195820 con 0x7f182c1067e0 2024-09-21T11:44:26.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.786+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f182c195db0 con 0x7f182c1067e0 2024-09-21T11:44:26.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.787+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f182c101f20 con 0x7f182c1067e0 2024-09-21T11:44:26.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.787+0000 7f18227fc640 1 -- 172.21.15.118:0/1488930306 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f181c03c070 con 0x7f182c1067e0 2024-09-21T11:44:26.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.788+0000 7f18227fc640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f181807af30 0x7f181807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:26.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.788+0000 7f18227fc640 1 -- 172.21.15.118:0/1488930306 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f181c03a020 con 0x7f182c1067e0 2024-09-21T11:44:26.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.788+0000 7f18317e8640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f181807af30 0x7f181807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:26.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.788+0000 7f18317e8640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f181807af30 0x7f181807d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1828005fd0 tx=0x7f182800d040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:26.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:26.792+0000 7f18227fc640 1 -- 172.21.15.118:0/1488930306 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f181c08e6d0 con 0x7f182c1067e0 2024-09-21T11:44:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:26 smithi149 ceph-mon[79770]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:26 smithi149 ceph-mon[79770]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:26 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/532842144' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:26 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/381835662' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:44:27.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.065+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f182c196ac0 con 0x7f182c1067e0 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.065+0000 7f18227fc640 1 -- 172.21.15.118:0/1488930306 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1573 (secure 0 0 0) 0x7f181c093580 con 0x7f182c1067e0 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stdout: osd.0 (root=default,host=smithi118) is down 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-21T11:44:27.068 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-21T11:44:27.069 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-21T11:44:27.070 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-21T11:44:27.070 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-21T11:44:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f181807af30 msgr2=0x7f181807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f181807af30 0x7f181807d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1828005fd0 tx=0x7f182800d040 comp rx=0 tx=0).stop 2024-09-21T11:44:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1067e0 msgr2=0x7f182c19b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1067e0 0x7f182c19b910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f181c02edd0 tx=0x7f181c035a20 comp rx=0 tx=0).stop 2024-09-21T11:44:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 shutdown_connections 2024-09-21T11:44:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f181807af30 0x7f181807d3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f182c1067e0 0x7f182c19b910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 --2- 172.21.15.118:0/1488930306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f182c1007e0 0x7f182c19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 >> 172.21.15.118:0/1488930306 conn(0x7f182c0fc4c0 msgr2=0x7f182c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 shutdown_connections 2024-09-21T11:44:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:27.067+0000 7f1833a4c640 1 -- 172.21.15.118:0/1488930306 wait complete. 2024-09-21T11:44:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:27 smithi118 ceph-mon[111738]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:27 smithi118 ceph-mon[111738]: pgmap v136: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:27 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T11:44:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:27 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1488930306' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:44:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:27 smithi149 ceph-mon[79770]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:27 smithi149 ceph-mon[79770]: pgmap v136: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:27 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T11:44:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:27 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1488930306' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:44:28.732 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:28 smithi118 ceph-mon[111738]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:28.732 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:28 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:28.732 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:28 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:28.732 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:28 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:28.732 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:28 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:28.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:28 smithi149 ceph-mon[79770]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:28.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:28 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:28.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:28 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:28.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:28 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:28.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:28 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:29.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:29 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[120855]: 2024-09-21T11:44:29.071+0000 7f91c214d640 -1 osd.0 47 log_to_monitors true 2024-09-21T11:44:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:29 smithi118 ceph-mon[111738]: pgmap v137: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:29 smithi118 ceph-mon[111738]: from='osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T11:44:29.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:29 smithi149 ceph-mon[79770]: pgmap v137: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:29.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:29 smithi149 ceph-mon[79770]: from='osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T11:44:30.755 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 11:44:30 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[120855]: 2024-09-21T11:44:30.461+0000 7f91b5eef640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:44:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:30 smithi118 ceph-mon[111738]: from='osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T11:44:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:30 smithi118 ceph-mon[111738]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T11:44:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:30 smithi118 ceph-mon[111738]: from='osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi118", "root=default"]} : dispatch 2024-09-21T11:44:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:30 smithi118 ceph-mon[111738]: pgmap v139: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:31.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:30 smithi118 ceph-mon[111738]: from='osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638]' entity='osd.0' 2024-09-21T11:44:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:30 smithi149 ceph-mon[79770]: from='osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T11:44:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:30 smithi149 ceph-mon[79770]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T11:44:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:30 smithi149 ceph-mon[79770]: from='osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi118", "root=default"]} : dispatch 2024-09-21T11:44:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:30 smithi149 ceph-mon[79770]: pgmap v139: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:31.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:30 smithi149 ceph-mon[79770]: from='osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638]' entity='osd.0' 2024-09-21T11:44:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:44:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638] boot 2024-09-21T11:44:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: osdmap e51: 6 total, 6 up, 6 in 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:31.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T11:44:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:44:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: osd.0 [v2:172.21.15.118:6802/2363507638,v1:172.21.15.118:6803/2363507638] boot 2024-09-21T11:44:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: osdmap e51: 6 total, 6 up, 6 in 2024-09-21T11:44:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T11:44:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:32.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:44:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:44:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:44:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:32.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T11:44:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:33 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T11:44:33.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:33 smithi118 ceph-mon[111738]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T11:44:33.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:33 smithi118 ceph-mon[111738]: pgmap v141: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:33.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:33 smithi118 ceph-mon[111738]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T11:44:33.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:33 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T11:44:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:33 smithi149 ceph-mon[79770]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T11:44:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:33 smithi149 ceph-mon[79770]: pgmap v141: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:33.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:33 smithi149 ceph-mon[79770]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T11:44:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:35 smithi149 ceph-mon[79770]: pgmap v143: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:44:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:35 smithi118 ceph-mon[111738]: pgmap v143: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-21T11:44:35.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:35.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:44:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:36 smithi118 ceph-mon[111738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded) 2024-09-21T11:44:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:36 smithi149 ceph-mon[79770]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded) 2024-09-21T11:44:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:37 smithi118 ceph-mon[111738]: pgmap v144: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:37 smithi149 ceph-mon[79770]: pgmap v144: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:39 smithi118 ceph-mon[111738]: pgmap v145: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:39.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:39 smithi149 ceph-mon[79770]: pgmap v145: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:41 smithi118 ceph-mon[111738]: pgmap v146: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:41 smithi149 ceph-mon[79770]: pgmap v146: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:43 smithi118 ceph-mon[111738]: pgmap v147: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:43.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:43 smithi149 ceph-mon[79770]: pgmap v147: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:45 smithi118 ceph-mon[111738]: pgmap v148: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:45 smithi149 ceph-mon[79770]: pgmap v148: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:47 smithi118 ceph-mon[111738]: pgmap v149: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T11:44:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:47 smithi149 ceph-mon[79770]: pgmap v149: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T11:44:48.735 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:48 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T11:44:48.736 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:48 smithi118 ceph-mon[111738]: Upgrade: osd.1 is safe to restart 2024-09-21T11:44:48.736 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:48 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:48.736 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:48 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T11:44:48.736 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:48 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:44:48.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:48 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T11:44:48.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:48 smithi149 ceph-mon[79770]: Upgrade: osd.1 is safe to restart 2024-09-21T11:44:48.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:48 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:48.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:48 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T11:44:48.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:48 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:44:49.632 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:49 smithi118 ceph-mon[111738]: Upgrade: Updating osd.1 2024-09-21T11:44:49.632 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:49 smithi118 ceph-mon[111738]: Deploying daemon osd.1 on smithi118 2024-09-21T11:44:49.633 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:49 smithi118 ceph-mon[111738]: pgmap v150: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:49.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:49 smithi149 ceph-mon[79770]: Upgrade: Updating osd.1 2024-09-21T11:44:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:49 smithi149 ceph-mon[79770]: Deploying daemon osd.1 on smithi118 2024-09-21T11:44:49.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:49 smithi149 ceph-mon[79770]: pgmap v150: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:44:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:50 smithi149 ceph-mon[79770]: pgmap v151: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:51.297 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:51 smithi118 systemd[1]: Stopping Ceph osd.1 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:44:51.297 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:44:51.298 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:44:51.298 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:50 smithi118 ceph-mon[111738]: pgmap v151: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:51.574 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:51 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[58379]: 2024-09-21T11:44:51.317+0000 7f8d6b266640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T11:44:51.574 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:51 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[58379]: 2024-09-21T11:44:51.317+0000 7f8d6b266640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-21T11:44:51.574 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:51 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[58379]: 2024-09-21T11:44:51.317+0000 7f8d6b266640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T11:44:52.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:51 smithi149 ceph-mon[79770]: osd.1 marked itself down and dead 2024-09-21T11:44:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:51 smithi118 ceph-mon[111738]: osd.1 marked itself down and dead 2024-09-21T11:44:52.788 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:52 smithi118 podman[125548]: 2024-09-21 11:44:52.503315151 +0000 UTC m=+1.284250200 container died 7292f15d31a72990290a44954aa368dec7de36acb492c8da29cf606cd58cc5d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T11:44:53.074 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:52 smithi118 podman[125548]: 2024-09-21 11:44:52.977144523 +0000 UTC m=+1.758079612 container cleanup 7292f15d31a72990290a44954aa368dec7de36acb492c8da29cf606cd58cc5d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-4e45e6b) 2024-09-21T11:44:53.074 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:52 smithi118 bash[125548]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1 2024-09-21T11:44:53.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:52 smithi118 ceph-mon[111738]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:44:53.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:52 smithi118 ceph-mon[111738]: osdmap e53: 6 total, 5 up, 6 in 2024-09-21T11:44:53.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:52 smithi118 ceph-mon[111738]: pgmap v153: 65 pgs: 12 stale+active+clean, 53 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:52 smithi149 ceph-mon[79770]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:44:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:52 smithi149 ceph-mon[79770]: osdmap e53: 6 total, 5 up, 6 in 2024-09-21T11:44:53.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:52 smithi149 ceph-mon[79770]: pgmap v153: 65 pgs: 12 stale+active+clean, 53 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:53.574 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:53 smithi118 podman[125564]: 2024-09-21 11:44:53.287244965 +0000 UTC m=+0.782320569 container remove 7292f15d31a72990290a44954aa368dec7de36acb492c8da29cf606cd58cc5d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-4e45e6b, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T11:44:53.933 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:53 smithi118 podman[125657]: 2024-09-21 11:44:53.552798852 +0000 UTC m=+0.016037532 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:44:53.934 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:53 smithi118 podman[125657]: 2024-09-21 11:44:53.671656458 +0000 UTC m=+0.134895161 container create a3a8c601b76500af0b98245b44d0213e7abc75897cc68a273670e1c284ad85cb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T11:44:53.934 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:53 smithi118 podman[125657]: 2024-09-21 11:44:53.932362617 +0000 UTC m=+0.395601291 container init a3a8c601b76500af0b98245b44d0213e7abc75897cc68a273670e1c284ad85cb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T11:44:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:53 smithi118 ceph-mon[111738]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T11:44:54.325 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:53 smithi118 podman[125657]: 2024-09-21 11:44:53.936108147 +0000 UTC m=+0.399346813 container start a3a8c601b76500af0b98245b44d0213e7abc75897cc68a273670e1c284ad85cb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T11:44:54.325 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:54 smithi118 podman[125657]: 2024-09-21 11:44:54.032552014 +0000 UTC m=+0.495790674 container attach a3a8c601b76500af0b98245b44d0213e7abc75897cc68a273670e1c284ad85cb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T11:44:54.325 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:54 smithi118 podman[125657]: 2024-09-21 11:44:54.129773081 +0000 UTC m=+0.593011753 container died a3a8c601b76500af0b98245b44d0213e7abc75897cc68a273670e1c284ad85cb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T11:44:54.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:53 smithi149 ceph-mon[79770]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T11:44:55.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:54 smithi118 ceph-mon[111738]: pgmap v155: 65 pgs: 12 stale+active+clean, 53 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:55.075 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:54 smithi118 podman[125682]: 2024-09-21 11:44:54.711349644 +0000 UTC m=+0.571458882 container remove a3a8c601b76500af0b98245b44d0213e7abc75897cc68a273670e1c284ad85cb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T11:44:55.075 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:54 smithi118 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-21T11:44:55.075 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:54 smithi118 systemd[1]: Stopped Ceph osd.1 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:44:55.075 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:54 smithi118 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.1.service: Consumed 58.136s CPU time. 2024-09-21T11:44:55.075 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:54 smithi118 systemd[1]: Starting Ceph osd.1 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:44:55.327 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:55 smithi118 podman[125778]: 2024-09-21 11:44:55.063773641 +0000 UTC m=+0.016115592 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:44:55.327 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:55 smithi118 podman[125778]: 2024-09-21 11:44:55.196448521 +0000 UTC m=+0.148790465 container create 18f4b727f8f07e6fc18e2b4d497f66971e7b30d6bbd62b1523265cc2846fc39e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T11:44:55.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:54 smithi149 ceph-mon[79770]: pgmap v155: 65 pgs: 12 stale+active+clean, 53 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:44:55.588 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:55 smithi118 podman[125778]: 2024-09-21 11:44:55.441010438 +0000 UTC m=+0.393352393 container init 18f4b727f8f07e6fc18e2b4d497f66971e7b30d6bbd62b1523265cc2846fc39e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2) 2024-09-21T11:44:55.589 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:55 smithi118 podman[125778]: 2024-09-21 11:44:55.444771746 +0000 UTC m=+0.397113693 container start 18f4b727f8f07e6fc18e2b4d497f66971e7b30d6bbd62b1523265cc2846fc39e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T11:44:55.589 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:55 smithi118 podman[125778]: 2024-09-21 11:44:55.515558878 +0000 UTC m=+0.467900828 container attach 18f4b727f8f07e6fc18e2b4d497f66971e7b30d6bbd62b1523265cc2846fc39e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:44:55.589 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:55 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:55.589 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:55 smithi118 bash[125778]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:55.589 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:55 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:55.589 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:55 smithi118 bash[125778]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:56 smithi118 ceph-mon[111738]: Health check failed: Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T11:44:56.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:56 smithi149 ceph-mon[79770]: Health check failed: Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T11:44:57.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 -- 172.21.15.118:0/3672168435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841007e0 msgr2=0x7f1b84100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 --2- 172.21.15.118:0/3672168435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841007e0 0x7f1b84100c40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009880 tx=0x7f1b7402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 -- 172.21.15.118:0/3672168435 shutdown_connections 2024-09-21T11:44:57.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 --2- 172.21.15.118:0/3672168435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841007e0 0x7f1b84100c40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 --2- 172.21.15.118:0/3672168435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b841067e0 0x7f1b84106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 -- 172.21.15.118:0/3672168435 >> 172.21.15.118:0/3672168435 conn(0x7f1b840fc4c0 msgr2=0x7f1b840fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 -- 172.21.15.118:0/3672168435 shutdown_connections 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 -- 172.21.15.118:0/3672168435 wait complete. 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 Processor -- start 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.153+0000 7f1b8c162640 1 -- start start 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b8c162640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b841007e0 0x7f1b841987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b8c162640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841067e0 0x7f1b84198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b8c162640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8410dc90 con 0x7f1b841067e0 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b8c162640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8410db10 con 0x7f1b841007e0 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b896fd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841067e0 0x7f1b84198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b896fd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841067e0 0x7f1b84198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39322/0 (socket says 172.21.15.118:39322) 2024-09-21T11:44:57.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b896fd640 1 -- 172.21.15.118:0/1216934500 learned_addr learned my addr 172.21.15.118:0/1216934500 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b89efe640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b841007e0 0x7f1b841987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b896fd640 1 -- 172.21.15.118:0/1216934500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b841007e0 msgr2=0x7f1b841987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b896fd640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b841007e0 0x7f1b841987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b896fd640 1 -- 172.21.15.118:0/1216934500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b84199270 con 0x7f1b841067e0 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b896fd640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841067e0 0x7f1b84198d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b74031460 tx=0x7f1b740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b7affd640 1 -- 172.21.15.118:0/1216934500 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b7403f070 con 0x7f1b841067e0 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b7affd640 1 -- 172.21.15.118:0/1216934500 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b740044d0 con 0x7f1b841067e0 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b84199500 con 0x7f1b841067e0 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b7affd640 1 -- 172.21.15.118:0/1216934500 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b74035030 con 0x7f1b841067e0 2024-09-21T11:44:57.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.154+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841a1ab0 con 0x7f1b841067e0 2024-09-21T11:44:57.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.155+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b84101f20 con 0x7f1b841067e0 2024-09-21T11:44:57.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.156+0000 7f1b7affd640 1 -- 172.21.15.118:0/1216934500 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1b74042070 con 0x7f1b841067e0 2024-09-21T11:44:57.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.156+0000 7f1b7affd640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af90 0x7f1b7007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:57.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.157+0000 7f1b7affd640 1 -- 172.21.15.118:0/1216934500 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f1b740beae0 con 0x7f1b841067e0 2024-09-21T11:44:57.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.157+0000 7f1b89efe640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af90 0x7f1b7007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:57.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.157+0000 7f1b89efe640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af90 0x7f1b7007d450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b80007350 tx=0x7f1b800072e0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:57.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.161+0000 7f1b7affd640 1 -- 172.21.15.118:0/1216934500 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1b74004cf0 con 0x7f1b841067e0 2024-09-21T11:44:57.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.358+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1b84062630 con 0x7f1b7007af90 2024-09-21T11:44:57.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.359+0000 7f1b7affd640 1 -- 172.21.15.118:0/1216934500 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f1b84062630 con 0x7f1b7007af90 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af90 msgr2=0x7f1b7007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af90 0x7f1b7007d450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b80007350 tx=0x7f1b800072e0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841067e0 msgr2=0x7f1b84198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841067e0 0x7f1b84198d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b74031460 tx=0x7f1b740048f0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 shutdown_connections 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af90 0x7f1b7007d450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b841067e0 0x7f1b84198d00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 --2- 172.21.15.118:0/1216934500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b841007e0 0x7f1b841987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 >> 172.21.15.118:0/1216934500 conn(0x7f1b840fc4c0 msgr2=0x7f1b840fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 shutdown_connections 2024-09-21T11:44:57.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.361+0000 7f1b8c162640 1 -- 172.21.15.118:0/1216934500 wait complete. 2024-09-21T11:44:57.373 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:44:57.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.444+0000 7f0ab2414640 1 -- 172.21.15.118:0/4047062432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 msgr2=0x7f0aac106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.444+0000 7f0ab2414640 1 --2- 172.21.15.118:0/4047062432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 0x7f0aac106c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009880 tx=0x7f0a9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.444+0000 7f0ab2414640 1 -- 172.21.15.118:0/4047062432 shutdown_connections 2024-09-21T11:44:57.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.444+0000 7f0ab2414640 1 --2- 172.21.15.118:0/4047062432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aac100820 0x7f0aac100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.444+0000 7f0ab2414640 1 --2- 172.21.15.118:0/4047062432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 0x7f0aac106c00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.444+0000 7f0ab2414640 1 -- 172.21.15.118:0/4047062432 >> 172.21.15.118:0/4047062432 conn(0x7f0aac0fc520 msgr2=0x7f0aac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:57.447 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:57 smithi118 ceph-mon[111738]: pgmap v156: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:44:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.444+0000 7f0ab2414640 1 -- 172.21.15.118:0/4047062432 shutdown_connections 2024-09-21T11:44:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.444+0000 7f0ab2414640 1 -- 172.21.15.118:0/4047062432 wait complete. 2024-09-21T11:44:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.444+0000 7f0ab2414640 1 Processor -- start 2024-09-21T11:44:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.445+0000 7f0ab2414640 1 -- start start 2024-09-21T11:44:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.445+0000 7f0ab2414640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aac100820 0x7f0aac19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.445+0000 7f0ab2414640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 0x7f0aac19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.445+0000 7f0ab2414640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac10dcf0 con 0x7f0aac106820 2024-09-21T11:44:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.445+0000 7f0ab2414640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac10db70 con 0x7f0aac100820 2024-09-21T11:44:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.445+0000 7f0aab7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 0x7f0aac19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:57.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.445+0000 7f0aab7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 0x7f0aac19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39348/0 (socket says 172.21.15.118:39348) 2024-09-21T11:44:57.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.445+0000 7f0aab7fe640 1 -- 172.21.15.118:0/1209282847 learned_addr learned my addr 172.21.15.118:0/1209282847 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:57.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.445+0000 7f0aabfff640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aac100820 0x7f0aac19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:57.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.446+0000 7f0aab7fe640 1 -- 172.21.15.118:0/1209282847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aac100820 msgr2=0x7f0aac19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.446+0000 7f0aab7fe640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aac100820 0x7f0aac19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.446+0000 7f0aab7fe640 1 -- 172.21.15.118:0/1209282847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac1966e0 con 0x7f0aac106820 2024-09-21T11:44:57.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.446+0000 7f0aab7fe640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 0x7f0aac19cb50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d6f0 tx=0x7f0a9400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:57.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.446+0000 7f0aa97fa640 1 -- 172.21.15.118:0/1209282847 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a94017070 con 0x7f0aac106820 2024-09-21T11:44:57.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.446+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac1969d0 con 0x7f0aac106820 2024-09-21T11:44:57.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.446+0000 7f0aa97fa640 1 -- 172.21.15.118:0/1209282847 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a9400de00 con 0x7f0aac106820 2024-09-21T11:44:57.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.446+0000 7f0aa97fa640 1 -- 172.21.15.118:0/1209282847 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a94004bb0 con 0x7f0aac106820 2024-09-21T11:44:57.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.446+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac196f30 con 0x7f0aac106820 2024-09-21T11:44:57.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.447+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac101f60 con 0x7f0aac106820 2024-09-21T11:44:57.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.448+0000 7f0aa97fa640 1 -- 172.21.15.118:0/1209282847 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0a94009a30 con 0x7f0aac106820 2024-09-21T11:44:57.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.449+0000 7f0aa97fa640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a9807af30 0x7f0a9807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:57.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.449+0000 7f0aa97fa640 1 -- 172.21.15.118:0/1209282847 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f0a9409dbb0 con 0x7f0aac106820 2024-09-21T11:44:57.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.449+0000 7f0aabfff640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a9807af30 0x7f0a9807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:57.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.449+0000 7f0aabfff640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a9807af30 0x7f0a9807d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0096c0 tx=0x7f0a9c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:57.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.453+0000 7f0aa97fa640 1 -- 172.21.15.118:0/1209282847 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0a940a4080 con 0x7f0aac106820 2024-09-21T11:44:57.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.648+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0aac1972a0 con 0x7f0a9807af30 2024-09-21T11:44:57.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.650+0000 7f0aa97fa640 1 -- 172.21.15.118:0/1209282847 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f0aac1972a0 con 0x7f0a9807af30 2024-09-21T11:44:57.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a9807af30 msgr2=0x7f0a9807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a9807af30 0x7f0a9807d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0096c0 tx=0x7f0a9c031400 comp rx=0 tx=0).stop 2024-09-21T11:44:57.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 msgr2=0x7f0aac19cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 0x7f0aac19cb50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d6f0 tx=0x7f0a9400dbb0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 shutdown_connections 2024-09-21T11:44:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a9807af30 0x7f0a9807d3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0aac106820 0x7f0aac19cb50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 --2- 172.21.15.118:0/1209282847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aac100820 0x7f0aac19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 >> 172.21.15.118:0/1209282847 conn(0x7f0aac0fc520 msgr2=0x7f0aac0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 shutdown_connections 2024-09-21T11:44:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.652+0000 7f0ab2414640 1 -- 172.21.15.118:0/1209282847 wait complete. 2024-09-21T11:44:57.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:57 smithi149 ceph-mon[79770]: pgmap v156: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:44:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.734+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/304868969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd281033f0 msgr2=0x7fcd2810b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.734+0000 7fcd2e0f4640 1 --2- 172.21.15.118:0/304868969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd281033f0 0x7fcd2810b8e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009880 tx=0x7fcd1002a530 comp rx=0 tx=0).stop 2024-09-21T11:44:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.734+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/304868969 shutdown_connections 2024-09-21T11:44:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.734+0000 7fcd2e0f4640 1 --2- 172.21.15.118:0/304868969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd281033f0 0x7fcd2810b8e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.734+0000 7fcd2e0f4640 1 --2- 172.21.15.118:0/304868969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd28102ad0 0x7fcd28102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.734+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/304868969 >> 172.21.15.118:0/304868969 conn(0x7fcd280fc510 msgr2=0x7fcd280fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.734+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/304868969 shutdown_connections 2024-09-21T11:44:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.734+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/304868969 wait complete. 2024-09-21T11:44:57.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.735+0000 7fcd2e0f4640 1 Processor -- start 2024-09-21T11:44:57.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.735+0000 7fcd2e0f4640 1 -- start start 2024-09-21T11:44:57.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.735+0000 7fcd2e0f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd28102ad0 0x7fcd2819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:57.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.735+0000 7fcd2e0f4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd281033f0 0x7fcd2819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.735+0000 7fcd2e0f4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2810ede0 con 0x7fcd28102ad0 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.735+0000 7fcd2e0f4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2810ec60 con 0x7fcd281033f0 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd277fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd28102ad0 0x7fcd2819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd277fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd28102ad0 0x7fcd2819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39366/0 (socket says 172.21.15.118:39366) 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd277fe640 1 -- 172.21.15.118:0/2227588995 learned_addr learned my addr 172.21.15.118:0/2227588995 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd26ffd640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd281033f0 0x7fcd2819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd277fe640 1 -- 172.21.15.118:0/2227588995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd281033f0 msgr2=0x7fcd2819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd277fe640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd281033f0 0x7fcd2819db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd277fe640 1 -- 172.21.15.118:0/2227588995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd281977d0 con 0x7fcd28102ad0 2024-09-21T11:44:57.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd277fe640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd28102ad0 0x7fcd2819d650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c810 tx=0x7fcd1800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd24ff9640 1 -- 172.21.15.118:0/2227588995 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd18004020 con 0x7fcd28102ad0 2024-09-21T11:44:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd28197ac0 con 0x7fcd28102ad0 2024-09-21T11:44:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd24ff9640 1 -- 172.21.15.118:0/2227588995 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd180041c0 con 0x7fcd28102ad0 2024-09-21T11:44:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd24ff9640 1 -- 172.21.15.118:0/2227588995 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd180047a0 con 0x7fcd28102ad0 2024-09-21T11:44:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.736+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd28198020 con 0x7fcd28102ad0 2024-09-21T11:44:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.738+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2806abe0 con 0x7fcd28102ad0 2024-09-21T11:44:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.738+0000 7fcd24ff9640 1 -- 172.21.15.118:0/2227588995 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcd180079b0 con 0x7fcd28102ad0 2024-09-21T11:44:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.739+0000 7fcd24ff9640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcd1407af80 0x7fcd1407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.739+0000 7fcd24ff9640 1 -- 172.21.15.118:0/2227588995 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7fcd1809dd70 con 0x7fcd28102ad0 2024-09-21T11:44:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.739+0000 7fcd26ffd640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcd1407af80 0x7fcd1407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.739+0000 7fcd26ffd640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcd1407af80 0x7fcd1407d440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd28198b20 tx=0x7fcd10031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.743+0000 7fcd24ff9640 1 -- 172.21.15.118:0/2227588995 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd18014030 con 0x7fcd28102ad0 2024-09-21T11:44:57.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.947+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcd28198390 con 0x7fcd1407af80 2024-09-21T11:44:57.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.959+0000 7fcd24ff9640 1 -- 172.21.15.118:0/2227588995 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fcd28198390 con 0x7fcd1407af80 2024-09-21T11:44:57.961 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (2m) 30s ago 13m 20.0M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (5m) 30s ago 14m 8816k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (5m) 55s ago 13m 8358k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (63s) 30s ago 14m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (58s) 55s ago 13m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (2m) 30s ago 13m 79.6M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (8m) 30s ago 8m 147M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (8m) 30s ago 8m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (8m) 55s ago 8m 22.1M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (8m) 55s ago 8m 16.0M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (5m) 30s ago 15m 523M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (4m) 55s ago 13m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:44:57.962 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (91s) 30s ago 15m 38.9M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (75s) 55s ago 12m 25.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (3m) 30s ago 13m 10.3M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (3m) 55s ago 13m 10.7M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (36s) 30s ago 11m 14.4M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (11m) 30s ago 11m 227M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 7292f15d31a7 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (10m) 30s ago 10m 184M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (10m) 55s ago 10m 260M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (9m) 55s ago 9m 212M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (9m) 55s ago 9m 207M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:44:57.963 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (3m) 30s ago 13m 52.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:44:57.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcd1407af80 msgr2=0x7fcd1407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcd1407af80 0x7fcd1407d440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd28198b20 tx=0x7fcd10031400 comp rx=0 tx=0).stop 2024-09-21T11:44:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd28102ad0 msgr2=0x7fcd2819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd28102ad0 0x7fcd2819d650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c810 tx=0x7fcd1800ccd0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 shutdown_connections 2024-09-21T11:44:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd281033f0 0x7fcd2819db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcd1407af80 0x7fcd1407d440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 --2- 172.21.15.118:0/2227588995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd28102ad0 0x7fcd2819d650 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 >> 172.21.15.118:0/2227588995 conn(0x7fcd280fc510 msgr2=0x7fcd28106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 shutdown_connections 2024-09-21T11:44:57.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:57.962+0000 7fcd2e0f4640 1 -- 172.21.15.118:0/2227588995 wait complete. 2024-09-21T11:44:58.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.045+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/4067161062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 msgr2=0x7f6b58101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.045+0000 7f6b5f2ae640 1 --2- 172.21.15.118:0/4067161062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 0x7f6b58101d70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009880 tx=0x7f6b5402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.045+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/4067161062 shutdown_connections 2024-09-21T11:44:58.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.045+0000 7f6b5f2ae640 1 --2- 172.21.15.118:0/4067161062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 0x7f6b58101d70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.045+0000 7f6b5f2ae640 1 --2- 172.21.15.118:0/4067161062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b58107910 0x7f6b58107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.045+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/4067161062 >> 172.21.15.118:0/4067161062 conn(0x7f6b580fd5f0 msgr2=0x7f6b580ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:58.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.045+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/4067161062 shutdown_connections 2024-09-21T11:44:58.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.045+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/4067161062 wait complete. 2024-09-21T11:44:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.045+0000 7f6b5f2ae640 1 Processor -- start 2024-09-21T11:44:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5f2ae640 1 -- start start 2024-09-21T11:44:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5f2ae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 0x7f6b5819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5f2ae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b58107910 0x7f6b5819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5f2ae640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5810ede0 con 0x7f6b58101910 2024-09-21T11:44:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5f2ae640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5810ec60 con 0x7f6b58107910 2024-09-21T11:44:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5d04a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 0x7f6b5819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5d04a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 0x7f6b5819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39384/0 (socket says 172.21.15.118:39384) 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5d04a640 1 -- 172.21.15.118:0/2247448647 learned_addr learned my addr 172.21.15.118:0/2247448647 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5c849640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b58107910 0x7f6b5819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5d04a640 1 -- 172.21.15.118:0/2247448647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b58107910 msgr2=0x7f6b5819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5d04a640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b58107910 0x7f6b5819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5d04a640 1 -- 172.21.15.118:0/2247448647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b581977f0 con 0x7f6b58101910 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.046+0000 7f6b5d04a640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 0x7f6b5819d670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800d6f0 tx=0x7f6b4800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.047+0000 7f6b4e7fc640 1 -- 172.21.15.118:0/2247448647 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b48017070 con 0x7f6b58101910 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.047+0000 7f6b4e7fc640 1 -- 172.21.15.118:0/2247448647 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b4800de00 con 0x7f6b58101910 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.047+0000 7f6b4e7fc640 1 -- 172.21.15.118:0/2247448647 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b48004bb0 con 0x7f6b58101910 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.047+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b58197ae0 con 0x7f6b58101910 2024-09-21T11:44:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.047+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b58198040 con 0x7f6b58101910 2024-09-21T11:44:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.048+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b58103050 con 0x7f6b58101910 2024-09-21T11:44:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.049+0000 7f6b4e7fc640 1 -- 172.21.15.118:0/2247448647 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6b48009a30 con 0x7f6b58101910 2024-09-21T11:44:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.049+0000 7f6b4e7fc640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b4407af80 0x7f6b4407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.049+0000 7f6b4e7fc640 1 -- 172.21.15.118:0/2247448647 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f6b4809dac0 con 0x7f6b58101910 2024-09-21T11:44:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.049+0000 7f6b5c849640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b4407af80 0x7f6b4407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.050+0000 7f6b5c849640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b4407af80 0x7f6b4407d440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b58198b40 tx=0x7f6b54031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:58.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.053+0000 7f6b4e7fc640 1 -- 172.21.15.118:0/2247448647 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b48069140 con 0x7f6b58101910 2024-09-21T11:44:58.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.312+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6b58109e80 con 0x7f6b58101910 2024-09-21T11:44:58.315 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-mon[111738]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:58.315 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-mon[111738]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:58.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.312+0000 7f6b4e7fc640 1 -- 172.21.15.118:0/2247448647 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f6b4806dff0 con 0x7f6b58101910 2024-09-21T11:44:58.315 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:44:58.315 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:44:58.315 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:44:58.315 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4, 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8, 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 5 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:44:58.316 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:44:58.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b4407af80 msgr2=0x7f6b4407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b4407af80 0x7f6b4407d440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b58198b40 tx=0x7f6b54031400 comp rx=0 tx=0).stop 2024-09-21T11:44:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 msgr2=0x7f6b5819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 0x7f6b5819d670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800d6f0 tx=0x7f6b4800dbb0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 shutdown_connections 2024-09-21T11:44:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b58107910 0x7f6b5819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b4407af80 0x7f6b4407d440 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 --2- 172.21.15.118:0/2247448647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b58101910 0x7f6b5819d670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 >> 172.21.15.118:0/2247448647 conn(0x7f6b580fd5f0 msgr2=0x7f6b580fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 shutdown_connections 2024-09-21T11:44:58.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.315+0000 7f6b5f2ae640 1 -- 172.21.15.118:0/2247448647 wait complete. 2024-09-21T11:44:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.399+0000 7fa501906640 1 -- 172.21.15.118:0/3197770459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc107930 msgr2=0x7fa4fc107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.399+0000 7fa501906640 1 --2- 172.21.15.118:0/3197770459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc107930 0x7fa4fc107d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009880 tx=0x7fa4ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.399+0000 7fa501906640 1 -- 172.21.15.118:0/3197770459 shutdown_connections 2024-09-21T11:44:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.399+0000 7fa501906640 1 --2- 172.21.15.118:0/3197770459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc101930 0x7fa4fc101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.399+0000 7fa501906640 1 --2- 172.21.15.118:0/3197770459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc107930 0x7fa4fc107d10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.399+0000 7fa501906640 1 -- 172.21.15.118:0/3197770459 >> 172.21.15.118:0/3197770459 conn(0x7fa4fc0fd630 msgr2=0x7fa4fc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.399+0000 7fa501906640 1 -- 172.21.15.118:0/3197770459 shutdown_connections 2024-09-21T11:44:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.399+0000 7fa501906640 1 -- 172.21.15.118:0/3197770459 wait complete. 2024-09-21T11:44:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.400+0000 7fa501906640 1 Processor -- start 2024-09-21T11:44:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.400+0000 7fa501906640 1 -- start start 2024-09-21T11:44:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.400+0000 7fa501906640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc101930 0x7fa4fc19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.400+0000 7fa501906640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc107930 0x7fa4fc19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.400+0000 7fa501906640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc10ee00 con 0x7fa4fc101930 2024-09-21T11:44:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.400+0000 7fa501906640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc10ec80 con 0x7fa4fc107930 2024-09-21T11:44:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa4faffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc101930 0x7fa4fc19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa4faffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc101930 0x7fa4fc19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39408/0 (socket says 172.21.15.118:39408) 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa4faffd640 1 -- 172.21.15.118:0/3531267260 learned_addr learned my addr 172.21.15.118:0/3531267260 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa4fa7fc640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc107930 0x7fa4fc19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa4faffd640 1 -- 172.21.15.118:0/3531267260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc107930 msgr2=0x7fa4fc19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa4faffd640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc107930 0x7fa4fc19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa4faffd640 1 -- 172.21.15.118:0/3531267260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc1977f0 con 0x7fa4fc101930 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa4fa7fc640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc107930 0x7fa4fc19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa4faffd640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc101930 0x7fa4fc19d670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec031460 tx=0x7fa4ec004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa500904640 1 -- 172.21.15.118:0/3531267260 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4ec03f070 con 0x7fa4fc101930 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa500904640 1 -- 172.21.15.118:0/3531267260 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4ec0035f0 con 0x7fa4fc101930 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc197a80 con 0x7fa4fc101930 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa500904640 1 -- 172.21.15.118:0/3531267260 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4ec035030 con 0x7fa4fc101930 2024-09-21T11:44:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.401+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc197fb0 con 0x7fa4fc101930 2024-09-21T11:44:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.402+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4fc103070 con 0x7fa4fc101930 2024-09-21T11:44:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.403+0000 7fa500904640 1 -- 172.21.15.118:0/3531267260 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa4ec042070 con 0x7fa4fc101930 2024-09-21T11:44:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.404+0000 7fa500904640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa4e407af30 0x7fa4e407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.404+0000 7fa4fa7fc640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa4e407af30 0x7fa4e407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.404+0000 7fa500904640 1 -- 172.21.15.118:0/3531267260 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7fa4ec0be9b0 con 0x7fa4fc101930 2024-09-21T11:44:58.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.404+0000 7fa4fa7fc640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa4e407af30 0x7fa4e407d3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0ffc20 tx=0x7fa4f0005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:58.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.408+0000 7fa500904640 1 -- 172.21.15.118:0/3531267260 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4ec089fb0 con 0x7fa4fc101930 2024-09-21T11:44:58.574 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:44:58.574 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:58.575 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:44:58.575 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:58.575 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:58.575 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:44:58.575 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T11:44:58.575 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T11:44:58.575 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-21T11:44:58.575 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-21T11:44:58.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.630+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa4fc109ea0 con 0x7fa4fc101930 2024-09-21T11:44:58.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.631+0000 7fa500904640 1 -- 172.21.15.118:0/3531267260 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2032 (secure 0 0 0) 0x7fa4ec08ee60 con 0x7fa4fc101930 2024-09-21T11:44:58.633 INFO:teuthology.orchestra.run.smithi118.stdout:e16 2024-09-21T11:44:58.633 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:44:58.633 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:44:58.633 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 16 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:44:58.634 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 45 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=14556,1=14572} 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:44:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:44:58.636 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa4e407af30 msgr2=0x7fa4e407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa4e407af30 0x7fa4e407d3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0ffc20 tx=0x7fa4f0005f90 comp rx=0 tx=0).stop 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc101930 msgr2=0x7fa4fc19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc101930 0x7fa4fc19d670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec031460 tx=0x7fa4ec004530 comp rx=0 tx=0).stop 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 shutdown_connections 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc107930 0x7fa4fc19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa4e407af30 0x7fa4e407d3f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 --2- 172.21.15.118:0/3531267260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc101930 0x7fa4fc19d670 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 >> 172.21.15.118:0/3531267260 conn(0x7fa4fc0fd630 msgr2=0x7fa4fc0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 shutdown_connections 2024-09-21T11:44:58.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.633+0000 7fa501906640 1 -- 172.21.15.118:0/3531267260 wait complete. 2024-09-21T11:44:58.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:58 smithi149 ceph-mon[79770]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:58.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:58 smithi149 ceph-mon[79770]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:58.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.716+0000 7fc9a39d2640 1 -- 172.21.15.118:0/2260392026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c101930 msgr2=0x7fc99c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.716+0000 7fc9a39d2640 1 --2- 172.21.15.118:0/2260392026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c101930 0x7fc99c101d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc998009880 tx=0x7fc99802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.716+0000 7fc9a39d2640 1 -- 172.21.15.118:0/2260392026 shutdown_connections 2024-09-21T11:44:58.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.716+0000 7fc9a39d2640 1 --2- 172.21.15.118:0/2260392026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c101930 0x7fc99c101d90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.716+0000 7fc9a39d2640 1 --2- 172.21.15.118:0/2260392026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c107930 0x7fc99c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.716+0000 7fc9a39d2640 1 -- 172.21.15.118:0/2260392026 >> 172.21.15.118:0/2260392026 conn(0x7fc99c0fd630 msgr2=0x7fc99c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:58.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.716+0000 7fc9a39d2640 1 -- 172.21.15.118:0/2260392026 shutdown_connections 2024-09-21T11:44:58.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.716+0000 7fc9a39d2640 1 -- 172.21.15.118:0/2260392026 wait complete. 2024-09-21T11:44:58.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a39d2640 1 Processor -- start 2024-09-21T11:44:58.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a39d2640 1 -- start start 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a39d2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c101930 0x7fc99c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a39d2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c107930 0x7fc99c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a39d2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c10ee00 con 0x7fc99c107930 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a39d2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c10ec80 con 0x7fc99c101930 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a0f6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c107930 0x7fc99c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a0f6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c107930 0x7fc99c19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39424/0 (socket says 172.21.15.118:39424) 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a0f6d640 1 -- 172.21.15.118:0/1725667757 learned_addr learned my addr 172.21.15.118:0/1725667757 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a176e640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c101930 0x7fc99c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a0f6d640 1 -- 172.21.15.118:0/1725667757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c101930 msgr2=0x7fc99c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a0f6d640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c101930 0x7fc99c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a0f6d640 1 -- 172.21.15.118:0/1725667757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c197810 con 0x7fc99c107930 2024-09-21T11:44:58.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.717+0000 7fc9a0f6d640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c107930 0x7fc99c19dbd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc998031460 tx=0x7fc9980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:58.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.718+0000 7fc98e7fc640 1 -- 172.21.15.118:0/1725667757 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc99803f070 con 0x7fc99c107930 2024-09-21T11:44:58.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.718+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c197aa0 con 0x7fc99c107930 2024-09-21T11:44:58.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.718+0000 7fc98e7fc640 1 -- 172.21.15.118:0/1725667757 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9980035f0 con 0x7fc99c107930 2024-09-21T11:44:58.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.718+0000 7fc98e7fc640 1 -- 172.21.15.118:0/1725667757 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc998035030 con 0x7fc99c107930 2024-09-21T11:44:58.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.718+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99c197fd0 con 0x7fc99c107930 2024-09-21T11:44:58.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.719+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99c103070 con 0x7fc99c107930 2024-09-21T11:44:58.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.719+0000 7fc98e7fc640 1 -- 172.21.15.118:0/1725667757 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc998042070 con 0x7fc99c107930 2024-09-21T11:44:58.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.720+0000 7fc98e7fc640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc98807af30 0x7fc98807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:58.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.720+0000 7fc98e7fc640 1 -- 172.21.15.118:0/1725667757 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7fc9980be970 con 0x7fc99c107930 2024-09-21T11:44:58.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.720+0000 7fc9a176e640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc98807af30 0x7fc98807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:58.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.720+0000 7fc9a176e640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc98807af30 0x7fc98807d3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc990005fd0 tx=0x7fc99000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:58.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.725+0000 7fc98e7fc640 1 -- 172.21.15.118:0/1725667757 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9980c0e20 con 0x7fc99c107930 2024-09-21T11:44:58.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.944+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc99c198340 con 0x7fc98807af30 2024-09-21T11:44:58.947 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T11:44:58.947 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T11:44:58.947 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-21T11:44:58.947 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-21T11:44:58.947 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T11:44:58.947 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T11:44:58.947 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T11:44:58.947 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T11:44:58.947 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate[125792]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-21T11:44:58.948 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 bash[125778]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-21T11:44:58.948 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:58 smithi118 podman[125778]: 2024-09-21 11:44:58.760104442 +0000 UTC m=+3.712446398 container died 18f4b727f8f07e6fc18e2b4d497f66971e7b30d6bbd62b1523265cc2846fc39e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True) 2024-09-21T11:44:58.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.945+0000 7fc98e7fc640 1 -- 172.21.15.118:0/1725667757 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fc99c198340 con 0x7fc98807af30 2024-09-21T11:44:58.948 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:44:58.948 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:44:58.948 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:44:58.948 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:44:58.949 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:44:58.949 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:44:58.949 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:44:58.949 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:44:58.949 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:44:58.949 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "7/23 daemons upgraded", 2024-09-21T11:44:58.949 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T11:44:58.949 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:44:58.949 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:44:58.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc98807af30 msgr2=0x7fc98807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc98807af30 0x7fc98807d3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc990005fd0 tx=0x7fc99000b390 comp rx=0 tx=0).stop 2024-09-21T11:44:58.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c107930 msgr2=0x7fc99c19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:58.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c107930 0x7fc99c19dbd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc998031460 tx=0x7fc9980045e0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 shutdown_connections 2024-09-21T11:44:58.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc98807af30 0x7fc98807d3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc99c107930 0x7fc99c19dbd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 --2- 172.21.15.118:0/1725667757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc99c101930 0x7fc99c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:58.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 >> 172.21.15.118:0/1725667757 conn(0x7fc99c0fd630 msgr2=0x7fc99c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:58.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 shutdown_connections 2024-09-21T11:44:58.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:58.948+0000 7fc9a39d2640 1 -- 172.21.15.118:0/1725667757 wait complete. 2024-09-21T11:44:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.031+0000 7f0584637640 1 -- 172.21.15.118:0/3196303857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 msgr2=0x7f057c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.031+0000 7f0584637640 1 --2- 172.21.15.118:0/3196303857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 0x7f057c101d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f056c009880 tx=0x7f056c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:44:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.031+0000 7f0584637640 1 -- 172.21.15.118:0/3196303857 shutdown_connections 2024-09-21T11:44:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.031+0000 7f0584637640 1 --2- 172.21.15.118:0/3196303857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 0x7f057c101d90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.031+0000 7f0584637640 1 --2- 172.21.15.118:0/3196303857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f057c107930 0x7f057c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.031+0000 7f0584637640 1 -- 172.21.15.118:0/3196303857 >> 172.21.15.118:0/3196303857 conn(0x7f057c0fd630 msgr2=0x7f057c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.031+0000 7f0584637640 1 -- 172.21.15.118:0/3196303857 shutdown_connections 2024-09-21T11:44:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.031+0000 7f0584637640 1 -- 172.21.15.118:0/3196303857 wait complete. 2024-09-21T11:44:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f0584637640 1 Processor -- start 2024-09-21T11:44:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f0584637640 1 -- start start 2024-09-21T11:44:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f0584637640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 0x7f057c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f0584637640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f057c107930 0x7f057c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:59.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f0584637640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f057c10ee00 con 0x7f057c101930 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f0584637640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f057c10ec80 con 0x7f057c107930 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f05823d3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 0x7f057c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f05823d3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 0x7f057c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39454/0 (socket says 172.21.15.118:39454) 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f05823d3640 1 -- 172.21.15.118:0/484149044 learned_addr learned my addr 172.21.15.118:0/484149044 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f0581bd2640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f057c107930 0x7f057c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f05823d3640 1 -- 172.21.15.118:0/484149044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f057c107930 msgr2=0x7f057c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f05823d3640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f057c107930 0x7f057c19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.032+0000 7f05823d3640 1 -- 172.21.15.118:0/484149044 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c197810 con 0x7f057c101930 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.033+0000 7f05823d3640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 0x7f057c19d690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f057800c8f0 tx=0x7f057800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.033+0000 7f05737fe640 1 -- 172.21.15.118:0/484149044 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05780079b0 con 0x7f057c101930 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.033+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057c197b00 con 0x7f057c101930 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.033+0000 7f05737fe640 1 -- 172.21.15.118:0/484149044 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05780054e0 con 0x7f057c101930 2024-09-21T11:44:59.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.033+0000 7f05737fe640 1 -- 172.21.15.118:0/484149044 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0578004dd0 con 0x7f057c101930 2024-09-21T11:44:59.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.033+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057c198090 con 0x7f057c101930 2024-09-21T11:44:59.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.034+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057c103070 con 0x7f057c101930 2024-09-21T11:44:59.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.034+0000 7f05737fe640 1 -- 172.21.15.118:0/484149044 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0578005020 con 0x7f057c101930 2024-09-21T11:44:59.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.035+0000 7f05737fe640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f056807aed0 0x7f056807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:44:59.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.035+0000 7f0581bd2640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f056807aed0 0x7f056807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:44:59.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.035+0000 7f05737fe640 1 -- 172.21.15.118:0/484149044 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f057809dfd0 con 0x7f057c101930 2024-09-21T11:44:59.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.036+0000 7f0581bd2640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f056807aed0 0x7f056807d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f056c031460 tx=0x7f056c009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:44:59.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.039+0000 7f05737fe640 1 -- 172.21.15.118:0/484149044 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0578014030 con 0x7f057c101930 2024-09-21T11:44:59.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.296+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f057c109ea0 con 0x7f057c101930 2024-09-21T11:44:59.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.297+0000 7f05737fe640 1 -- 172.21.15.118:0/484149044 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1294 (secure 0 0 0) 0x7f05780880e0 con 0x7f057c101930 2024-09-21T11:44:59.299 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: osd.1 (root=default,host=smithi118) is down 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-21T11:44:59.300 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-21T11:44:59.301 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-21T11:44:59.301 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-21T11:44:59.301 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-21T11:44:59.301 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-21T11:44:59.301 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-21T11:44:59.301 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-21T11:44:59.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f056807aed0 msgr2=0x7f056807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:59.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f056807aed0 0x7f056807d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f056c031460 tx=0x7f056c009560 comp rx=0 tx=0).stop 2024-09-21T11:44:59.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 msgr2=0x7f057c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:44:59.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 0x7f057c19d690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f057800c8f0 tx=0x7f057800cdb0 comp rx=0 tx=0).stop 2024-09-21T11:44:59.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 shutdown_connections 2024-09-21T11:44:59.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f057c107930 0x7f057c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:59.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f056807aed0 0x7f056807d390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:59.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 --2- 172.21.15.118:0/484149044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f057c101930 0x7f057c19d690 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:44:59.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 >> 172.21.15.118:0/484149044 conn(0x7f057c0fd630 msgr2=0x7f057c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:44:59.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 shutdown_connections 2024-09-21T11:44:59.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:44:59.299+0000 7f0584637640 1 -- 172.21.15.118:0/484149044 wait complete. 2024-09-21T11:44:59.536 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:59 smithi118 podman[126140]: 2024-09-21 11:44:59.328354073 +0000 UTC m=+0.562156633 container remove 18f4b727f8f07e6fc18e2b4d497f66971e7b30d6bbd62b1523265cc2846fc39e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-activate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T11:44:59.537 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:59 smithi118 ceph-mon[111738]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:59.537 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:59 smithi118 ceph-mon[111738]: pgmap v157: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:44:59.537 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:59 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2247448647' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:59.537 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:44:59 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3531267260' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:44:59.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:59 smithi149 ceph-mon[79770]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:44:59.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:59 smithi149 ceph-mon[79770]: pgmap v157: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:44:59.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:59 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2247448647' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:44:59.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:44:59 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3531267260' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:44:59.800 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:59 smithi118 podman[126225]: 2024-09-21 11:44:59.438309309 +0000 UTC m=+0.016191603 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:44:59.800 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:59 smithi118 podman[126225]: 2024-09-21 11:44:59.567426621 +0000 UTC m=+0.145308900 container create 9548bc632e7c6dfd134f555869667824761c30b21426d8454460107036025a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T11:44:59.800 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:59 smithi118 podman[126225]: 2024-09-21 11:44:59.79867414 +0000 UTC m=+0.376556420 container init 9548bc632e7c6dfd134f555869667824761c30b21426d8454460107036025a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T11:45:00.074 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:59 smithi118 podman[126225]: 2024-09-21 11:44:59.802038055 +0000 UTC m=+0.379920338 container start 9548bc632e7c6dfd134f555869667824761c30b21426d8454460107036025a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T11:45:00.074 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:59 smithi118 ceph-osd[126245]: -- 172.21.15.118:0/3262855120 <== mon.0 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55efe1fca1e0 con 0x55efe1169c00 2024-09-21T11:45:00.075 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:59 smithi118 bash[126225]: 9548bc632e7c6dfd134f555869667824761c30b21426d8454460107036025a44 2024-09-21T11:45:00.075 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:44:59 smithi118 systemd[1]: Started Ceph osd.1 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:45:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:00 smithi118 ceph-mon[111738]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:00 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/484149044' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:45:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:00 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:00 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:00.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:00 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:45:00.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:00 smithi149 ceph-mon[79770]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:00.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:00 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/484149044' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:45:00.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:00 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:00.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:00 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:00.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:00 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:45:01.531 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:01 smithi118 ceph-mon[111738]: pgmap v158: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:01.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:01 smithi149 ceph-mon[79770]: pgmap v158: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:01.824 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:45:01 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[126241]: 2024-09-21T11:45:01.689+0000 7f099e8ef640 -1 Falling back to public interface 2024-09-21T11:45:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:03 smithi118 ceph-mon[111738]: pgmap v159: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:03.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:03 smithi149 ceph-mon[79770]: pgmap v159: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:05 smithi118 ceph-mon[111738]: pgmap v160: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:45:05.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:05.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:05 smithi149 ceph-mon[79770]: pgmap v160: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:45:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:06 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:06 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:06 smithi118 ceph-mon[111738]: pgmap v161: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:06 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:06 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:06 smithi149 ceph-mon[79770]: pgmap v161: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:07.721 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:45:07 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[126241]: 2024-09-21T11:45:07.645+0000 7f099e8ef640 -1 osd.1 52 log_to_monitors true 2024-09-21T11:45:08.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:07 smithi118 ceph-mon[111738]: from='osd.1 [v2:172.21.15.118:6810/1957764769,v1:172.21.15.118:6811/1957764769]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T11:45:08.074 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 11:45:07 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[126241]: 2024-09-21T11:45:07.741+0000 7f0996699640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:45:08.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:07 smithi149 ceph-mon[79770]: from='osd.1 [v2:172.21.15.118:6810/1957764769,v1:172.21.15.118:6811/1957764769]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T11:45:08.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:08 smithi118 ceph-mon[111738]: from='osd.1 [v2:172.21.15.118:6810/1957764769,v1:172.21.15.118:6811/1957764769]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T11:45:08.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:08 smithi118 ceph-mon[111738]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T11:45:08.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:08 smithi118 ceph-mon[111738]: from='osd.1 [v2:172.21.15.118:6810/1957764769,v1:172.21.15.118:6811/1957764769]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]} : dispatch 2024-09-21T11:45:08.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:08 smithi118 ceph-mon[111738]: pgmap v163: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:09.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:08 smithi149 ceph-mon[79770]: from='osd.1 [v2:172.21.15.118:6810/1957764769,v1:172.21.15.118:6811/1957764769]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T11:45:09.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:08 smithi149 ceph-mon[79770]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T11:45:09.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:08 smithi149 ceph-mon[79770]: from='osd.1 [v2:172.21.15.118:6810/1957764769,v1:172.21.15.118:6811/1957764769]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]} : dispatch 2024-09-21T11:45:09.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:08 smithi149 ceph-mon[79770]: pgmap v163: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: osd.1 [v2:172.21.15.118:6810/1957764769,v1:172.21.15.118:6811/1957764769] boot 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: osdmap e56: 6 total, 6 up, 6 in 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:10.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:10.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T11:45:10.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T11:45:10.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T11:45:10.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:09 smithi118 ceph-mon[111738]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: osd.1 [v2:172.21.15.118:6810/1957764769,v1:172.21.15.118:6811/1957764769] boot 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: osdmap e56: 6 total, 6 up, 6 in 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:45:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T11:45:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T11:45:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T11:45:10.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:09 smithi149 ceph-mon[79770]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T11:45:11.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:10 smithi118 ceph-mon[111738]: pgmap v166: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24/312 objects degraded (7.692%) 2024-09-21T11:45:11.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:10 smithi149 ceph-mon[79770]: pgmap v166: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24/312 objects degraded (7.692%) 2024-09-21T11:45:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:11 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 24/312 objects degraded (7.692%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T11:45:12.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:11 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 24/312 objects degraded (7.692%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T11:45:13.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:12 smithi118 ceph-mon[111738]: pgmap v167: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24/312 objects degraded (7.692%) 2024-09-21T11:45:13.101 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:12 smithi149 ceph-mon[79770]: pgmap v167: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24/312 objects degraded (7.692%) 2024-09-21T11:45:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:14 smithi118 ceph-mon[111738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/312 objects degraded (7.692%), 7 pgs degraded) 2024-09-21T11:45:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:14 smithi149 ceph-mon[79770]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/312 objects degraded (7.692%), 7 pgs degraded) 2024-09-21T11:45:15.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:15 smithi118 ceph-mon[111738]: pgmap v168: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:15 smithi149 ceph-mon[79770]: pgmap v168: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:17.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:17 smithi118 ceph-mon[111738]: pgmap v169: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:17.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:17 smithi149 ceph-mon[79770]: pgmap v169: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:19.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:19 smithi118 ceph-mon[111738]: pgmap v170: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:19 smithi149 ceph-mon[79770]: pgmap v170: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:45:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:20 smithi149 ceph-mon[79770]: pgmap v171: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:45:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:20 smithi118 ceph-mon[111738]: pgmap v171: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:23 smithi118 ceph-mon[111738]: pgmap v172: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:23.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:23 smithi149 ceph-mon[79770]: pgmap v172: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:24.471 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:24 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T11:45:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:24 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T11:45:25.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:25 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T11:45:25.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:25 smithi118 ceph-mon[111738]: Upgrade: osd.2 is safe to restart 2024-09-21T11:45:25.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:25 smithi118 ceph-mon[111738]: pgmap v173: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:25.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:25 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T11:45:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:25 smithi149 ceph-mon[79770]: Upgrade: osd.2 is safe to restart 2024-09-21T11:45:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:25 smithi149 ceph-mon[79770]: pgmap v173: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:26.694 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:26 smithi118 ceph-mon[111738]: Upgrade: Updating osd.2 2024-09-21T11:45:26.695 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:26 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:26.695 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:26 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T11:45:26.695 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:26 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:45:26.695 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:26 smithi118 ceph-mon[111738]: Deploying daemon osd.2 on smithi118 2024-09-21T11:45:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:26 smithi149 ceph-mon[79770]: Upgrade: Updating osd.2 2024-09-21T11:45:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:26 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:26.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:26 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T11:45:26.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:26 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:45:26.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:26 smithi149 ceph-mon[79770]: Deploying daemon osd.2 on smithi118 2024-09-21T11:45:27.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:27 smithi118 ceph-mon[111738]: pgmap v174: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:27.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:27 smithi149 ceph-mon[79770]: pgmap v174: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:28.633 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:28 smithi118 systemd[1]: Stopping Ceph osd.2 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:45:29.074 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:28 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[66197]: 2024-09-21T11:45:28.630+0000 7f5ce9a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T11:45:29.074 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:28 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[66197]: 2024-09-21T11:45:28.630+0000 7f5ce9a00640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-21T11:45:29.074 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:28 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[66197]: 2024-09-21T11:45:28.630+0000 7f5ce9a00640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T11:45:29.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.398+0000 7f05c140b640 1 -- 172.21.15.118:0/2106397880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05bc101050 msgr2=0x7f05bc10dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:29.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.398+0000 7f05c140b640 1 --2- 172.21.15.118:0/2106397880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05bc101050 0x7f05bc10dd10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009880 tx=0x7f05a402a490 comp rx=0 tx=0).stop 2024-09-21T11:45:29.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.398+0000 7f05c140b640 1 -- 172.21.15.118:0/2106397880 shutdown_connections 2024-09-21T11:45:29.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.398+0000 7f05c140b640 1 --2- 172.21.15.118:0/2106397880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05bc101050 0x7f05bc10dd10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.398+0000 7f05c140b640 1 --2- 172.21.15.118:0/2106397880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc1006a0 0x7f05bc100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.398+0000 7f05c140b640 1 -- 172.21.15.118:0/2106397880 >> 172.21.15.118:0/2106397880 conn(0x7f05bc0fc4d0 msgr2=0x7f05bc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:29.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.398+0000 7f05c140b640 1 -- 172.21.15.118:0/2106397880 shutdown_connections 2024-09-21T11:45:29.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.398+0000 7f05c140b640 1 -- 172.21.15.118:0/2106397880 wait complete. 2024-09-21T11:45:29.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.399+0000 7f05c140b640 1 Processor -- start 2024-09-21T11:45:29.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.399+0000 7f05c140b640 1 -- start start 2024-09-21T11:45:29.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.399+0000 7f05c140b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05bc1006a0 0x7f05bc102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:29.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.399+0000 7f05c140b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc101050 0x7f05bc102ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:29.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.399+0000 7f05c140b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc110f20 con 0x7f05bc1006a0 2024-09-21T11:45:29.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.399+0000 7f05c140b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc110da0 con 0x7f05bc101050 2024-09-21T11:45:29.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.399+0000 7f05b3fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc101050 0x7f05bc102ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:29.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.399+0000 7f05b3fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc101050 0x7f05bc102ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:45794/0 (socket says 172.21.15.118:45794) 2024-09-21T11:45:29.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.399+0000 7f05b3fff640 1 -- 172.21.15.118:0/546970541 learned_addr learned my addr 172.21.15.118:0/546970541 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:45:29.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.400+0000 7f05b3fff640 1 -- 172.21.15.118:0/546970541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05bc1006a0 msgr2=0x7f05bc102980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:29.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.400+0000 7f05b3fff640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05bc1006a0 0x7f05bc102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.400+0000 7f05b3fff640 1 -- 172.21.15.118:0/546970541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc103400 con 0x7f05bc101050 2024-09-21T11:45:29.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.400+0000 7f05b3fff640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc101050 0x7f05bc102ec0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f05a4031460 tx=0x7f05a4004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:29.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.401+0000 7f05b8ff9640 1 -- 172.21.15.118:0/546970541 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05a403f070 con 0x7f05bc101050 2024-09-21T11:45:29.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.401+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc1036f0 con 0x7f05bc101050 2024-09-21T11:45:29.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.401+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05bc1a82a0 con 0x7f05bc101050 2024-09-21T11:45:29.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.401+0000 7f05b8ff9640 1 -- 172.21.15.118:0/546970541 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05a4004a90 con 0x7f05bc101050 2024-09-21T11:45:29.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.401+0000 7f05b8ff9640 1 -- 172.21.15.118:0/546970541 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05a4035030 con 0x7f05bc101050 2024-09-21T11:45:29.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.404+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05bc06abd0 con 0x7f05bc101050 2024-09-21T11:45:29.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.407+0000 7f05b8ff9640 1 -- 172.21.15.118:0/546970541 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f05a4042070 con 0x7f05bc101050 2024-09-21T11:45:29.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.408+0000 7f05b8ff9640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05a807afe0 0x7f05a807d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:29.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.408+0000 7f05b8ff9640 1 -- 172.21.15.118:0/546970541 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7f05a40bead0 con 0x7f05bc101050 2024-09-21T11:45:29.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.408+0000 7f05baffd640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05a807afe0 0x7f05a807d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:29.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.409+0000 7f05baffd640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05a807afe0 0x7f05a807d4a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0058c0 tx=0x7f05ac005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:29.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.414+0000 7f05b8ff9640 1 -- 172.21.15.118:0/546970541 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05a408af90 con 0x7f05bc101050 2024-09-21T11:45:29.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.609+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f05bc10b460 con 0x7f05a807afe0 2024-09-21T11:45:29.612 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:29 smithi118 ceph-mon[111738]: pgmap v175: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:29.612 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:29 smithi118 ceph-mon[111738]: osd.2 marked itself down and dead 2024-09-21T11:45:29.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.610+0000 7f05b8ff9640 1 -- 172.21.15.118:0/546970541 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f05ac009750 con 0x7f05a807afe0 2024-09-21T11:45:29.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.612+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05a807afe0 msgr2=0x7f05a807d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:29.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.612+0000 7f05c140b640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05a807afe0 0x7f05a807d4a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0058c0 tx=0x7f05ac005850 comp rx=0 tx=0).stop 2024-09-21T11:45:29.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.612+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc101050 msgr2=0x7f05bc102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:29.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.612+0000 7f05c140b640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc101050 0x7f05bc102ec0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f05a4031460 tx=0x7f05a4004530 comp rx=0 tx=0).stop 2024-09-21T11:45:29.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.612+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 shutdown_connections 2024-09-21T11:45:29.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.612+0000 7f05c140b640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc101050 0x7f05bc102ec0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.612+0000 7f05c140b640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05a807afe0 0x7f05a807d4a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.613+0000 7f05c140b640 1 --2- 172.21.15.118:0/546970541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05bc1006a0 0x7f05bc102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.613+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 >> 172.21.15.118:0/546970541 conn(0x7f05bc0fc4d0 msgr2=0x7f05bc0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:29.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.613+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 shutdown_connections 2024-09-21T11:45:29.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.613+0000 7f05c140b640 1 -- 172.21.15.118:0/546970541 wait complete. 2024-09-21T11:45:29.624 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:45:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:29 smithi149 ceph-mon[79770]: pgmap v175: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:29 smithi149 ceph-mon[79770]: osd.2 marked itself down and dead 2024-09-21T11:45:29.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.697+0000 7fcc362b3640 1 -- 172.21.15.118:0/4287308534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 msgr2=0x7fcc30106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.697+0000 7fcc362b3640 1 --2- 172.21.15.118:0/4287308534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 0x7fcc30106bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009880 tx=0x7fcc2002a530 comp rx=0 tx=0).stop 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.697+0000 7fcc362b3640 1 -- 172.21.15.118:0/4287308534 shutdown_connections 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.697+0000 7fcc362b3640 1 --2- 172.21.15.118:0/4287308534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30100f30 0x7fcc30101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.697+0000 7fcc362b3640 1 --2- 172.21.15.118:0/4287308534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 0x7fcc30106bf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.697+0000 7fcc362b3640 1 -- 172.21.15.118:0/4287308534 >> 172.21.15.118:0/4287308534 conn(0x7fcc300fbc10 msgr2=0x7fcc300fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.697+0000 7fcc362b3640 1 -- 172.21.15.118:0/4287308534 shutdown_connections 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.697+0000 7fcc362b3640 1 -- 172.21.15.118:0/4287308534 wait complete. 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.698+0000 7fcc362b3640 1 Processor -- start 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.698+0000 7fcc362b3640 1 -- start start 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.698+0000 7fcc362b3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30100f30 0x7fcc3010b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.698+0000 7fcc362b3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 0x7fcc3010bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.698+0000 7fcc362b3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3010ede0 con 0x7fcc30106810 2024-09-21T11:45:29.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.698+0000 7fcc362b3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3010ec60 con 0x7fcc30100f30 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.698+0000 7fcc2f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 0x7fcc3010bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.698+0000 7fcc2f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 0x7fcc3010bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45142/0 (socket says 172.21.15.118:45142) 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.698+0000 7fcc2f7fe640 1 -- 172.21.15.118:0/3720209550 learned_addr learned my addr 172.21.15.118:0/3720209550 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc2ffff640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30100f30 0x7fcc3010b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc2f7fe640 1 -- 172.21.15.118:0/3720209550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30100f30 msgr2=0x7fcc3010b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc2f7fe640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30100f30 0x7fcc3010b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc2f7fe640 1 -- 172.21.15.118:0/3720209550 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3010c1b0 con 0x7fcc30106810 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc2f7fe640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 0x7fcc3010bc70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400e970 tx=0x7fcc2400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc2d7fa640 1 -- 172.21.15.118:0/3720209550 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc2400cac0 con 0x7fcc30106810 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3010c4a0 con 0x7fcc30106810 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc2d7fa640 1 -- 172.21.15.118:0/3720209550 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc240054e0 con 0x7fcc30106810 2024-09-21T11:45:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc2d7fa640 1 -- 172.21.15.118:0/3720209550 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc24010430 con 0x7fcc30106810 2024-09-21T11:45:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.699+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc301a3f70 con 0x7fcc30106810 2024-09-21T11:45:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.700+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc30101f40 con 0x7fcc30106810 2024-09-21T11:45:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.701+0000 7fcc2d7fa640 1 -- 172.21.15.118:0/3720209550 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcc24004f00 con 0x7fcc30106810 2024-09-21T11:45:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.702+0000 7fcc2d7fa640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc1807af30 0x7fcc1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.702+0000 7fcc2d7fa640 1 -- 172.21.15.118:0/3720209550 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7fcc2409e740 con 0x7fcc30106810 2024-09-21T11:45:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.702+0000 7fcc2ffff640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc1807af30 0x7fcc1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:29.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.702+0000 7fcc2ffff640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc1807af30 0x7fcc1807d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcc200096c0 tx=0x7fcc20031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:29.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.706+0000 7fcc2d7fa640 1 -- 172.21.15.118:0/3720209550 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc24069ce0 con 0x7fcc30106810 2024-09-21T11:45:29.921 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:29 smithi118 podman[130773]: 2024-09-21 11:45:29.813554321 +0000 UTC m=+1.291071333 container died a5fc3752bbb7f32f3e407080eb529471551380bc21f15769374c162faa035807 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T11:45:29.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.919+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcc30062630 con 0x7fcc1807af30 2024-09-21T11:45:29.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.920+0000 7fcc2d7fa640 1 -- 172.21.15.118:0/3720209550 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fcc30062630 con 0x7fcc1807af30 2024-09-21T11:45:29.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc1807af30 msgr2=0x7fcc1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc1807af30 0x7fcc1807d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcc200096c0 tx=0x7fcc20031400 comp rx=0 tx=0).stop 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 msgr2=0x7fcc3010bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 0x7fcc3010bc70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400e970 tx=0x7fcc2400ed70 comp rx=0 tx=0).stop 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 shutdown_connections 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc1807af30 0x7fcc1807d3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30106810 0x7fcc3010bc70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 --2- 172.21.15.118:0/3720209550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30100f30 0x7fcc3010b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 >> 172.21.15.118:0/3720209550 conn(0x7fcc300fbc10 msgr2=0x7fcc300fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 shutdown_connections 2024-09-21T11:45:29.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:29.922+0000 7fcc362b3640 1 -- 172.21.15.118:0/3720209550 wait complete. 2024-09-21T11:45:30.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 -- 172.21.15.118:0/2400406665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 msgr2=0x7fcb64100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 --2- 172.21.15.118:0/2400406665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 0x7fcb64100c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009880 tx=0x7fcb5402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 -- 172.21.15.118:0/2400406665 shutdown_connections 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 --2- 172.21.15.118:0/2400406665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 0x7fcb64100c80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 --2- 172.21.15.118:0/2400406665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb64106820 0x7fcb64106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 -- 172.21.15.118:0/2400406665 >> 172.21.15.118:0/2400406665 conn(0x7fcb640fc520 msgr2=0x7fcb640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 -- 172.21.15.118:0/2400406665 shutdown_connections 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 -- 172.21.15.118:0/2400406665 wait complete. 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 Processor -- start 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.006+0000 7fcb6c338640 1 -- start start 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6c338640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 0x7fcb64198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6c338640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb64106820 0x7fcb64198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6c338640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6410dcf0 con 0x7fcb64100820 2024-09-21T11:45:30.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6c338640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6410db70 con 0x7fcb64106820 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6a0d4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 0x7fcb64198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6a0d4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 0x7fcb64198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45158/0 (socket says 172.21.15.118:45158) 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6a0d4640 1 -- 172.21.15.118:0/4236552004 learned_addr learned my addr 172.21.15.118:0/4236552004 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb698d3640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb64106820 0x7fcb64198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6a0d4640 1 -- 172.21.15.118:0/4236552004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb64106820 msgr2=0x7fcb64198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6a0d4640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb64106820 0x7fcb64198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6a0d4640 1 -- 172.21.15.118:0/4236552004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb64199340 con 0x7fcb64100820 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb698d3640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb64106820 0x7fcb64198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6a0d4640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 0x7fcb64198800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000c8f0 tx=0x7fcb6000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb5b7fe640 1 -- 172.21.15.118:0/4236552004 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb600079b0 con 0x7fcb64100820 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb5b7fe640 1 -- 172.21.15.118:0/4236552004 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb600054e0 con 0x7fcb64100820 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.007+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb64199630 con 0x7fcb64100820 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.008+0000 7fcb5b7fe640 1 -- 172.21.15.118:0/4236552004 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb60004dd0 con 0x7fcb64100820 2024-09-21T11:45:30.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.008+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb641a1c30 con 0x7fcb64100820 2024-09-21T11:45:30.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.008+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb64101f60 con 0x7fcb64100820 2024-09-21T11:45:30.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.009+0000 7fcb5b7fe640 1 -- 172.21.15.118:0/4236552004 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcb60005020 con 0x7fcb64100820 2024-09-21T11:45:30.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.010+0000 7fcb5b7fe640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcb5007aed0 0x7fcb5007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:30.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.010+0000 7fcb5b7fe640 1 -- 172.21.15.118:0/4236552004 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7fcb6009dfe0 con 0x7fcb64100820 2024-09-21T11:45:30.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.010+0000 7fcb698d3640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcb5007aed0 0x7fcb5007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:30.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.010+0000 7fcb698d3640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcb5007aed0 0x7fcb5007d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb6406ae50 tx=0x7fcb54009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:30.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.014+0000 7fcb5b7fe640 1 -- 172.21.15.118:0/4236552004 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb64199630 con 0x7fcb64100820 2024-09-21T11:45:30.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.206+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcb64062630 con 0x7fcb5007aed0 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.215+0000 7fcb5b7fe640 1 -- 172.21.15.118:0/4236552004 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fcb64062630 con 0x7fcb5007aed0 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (3m) 25s ago 14m 20.0M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (6m) 25s ago 14m 8925k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (5m) 87s ago 13m 8358k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (95s) 25s ago 14m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (90s) 87s ago 13m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (3m) 25s ago 14m 81.5M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (9m) 25s ago 9m 147M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:45:30.218 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (8m) 25s ago 8m 27.5M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (8m) 87s ago 8m 22.1M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (9m) 87s ago 8m 16.0M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (5m) 25s ago 15m 524M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (4m) 87s ago 13m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (2m) 25s ago 15m 41.9M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (107s) 87s ago 13m 25.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (4m) 25s ago 14m 9.99M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (4m) 87s ago 13m 10.7M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (68s) 25s ago 12m 88.5M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (30s) 25s ago 11m 12.2M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (11m) 25s ago 11m 183M 1216M 19.1.1-373-g4e45e6b4 164465d2334a a5fc3752bbb7 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (10m) 87s ago 10m 260M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (10m) 87s ago 10m 212M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (10m) 87s ago 10m 207M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:45:30.219 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (3m) 25s ago 13m 52.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:45:30.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcb5007aed0 msgr2=0x7fcb5007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcb5007aed0 0x7fcb5007d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb6406ae50 tx=0x7fcb54009560 comp rx=0 tx=0).stop 2024-09-21T11:45:30.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 msgr2=0x7fcb64198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 0x7fcb64198800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000c8f0 tx=0x7fcb6000cdb0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 shutdown_connections 2024-09-21T11:45:30.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb64106820 0x7fcb64198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcb5007aed0 0x7fcb5007d390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 --2- 172.21.15.118:0/4236552004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb64100820 0x7fcb64198800 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 >> 172.21.15.118:0/4236552004 conn(0x7fcb640fc520 msgr2=0x7fcb640fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:30.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 shutdown_connections 2024-09-21T11:45:30.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.218+0000 7fcb6c338640 1 -- 172.21.15.118:0/4236552004 wait complete. 2024-09-21T11:45:30.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.302+0000 7f7c81efb640 1 -- 172.21.15.118:0/2379032127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 msgr2=0x7f7c7c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.302+0000 7f7c81efb640 1 --2- 172.21.15.118:0/2379032127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 0x7f7c7c100c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009880 tx=0x7f7c6c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.302+0000 7f7c81efb640 1 -- 172.21.15.118:0/2379032127 shutdown_connections 2024-09-21T11:45:30.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.302+0000 7f7c81efb640 1 --2- 172.21.15.118:0/2379032127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 0x7f7c7c100c40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.302+0000 7f7c81efb640 1 --2- 172.21.15.118:0/2379032127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c1067e0 0x7f7c7c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.302+0000 7f7c81efb640 1 -- 172.21.15.118:0/2379032127 >> 172.21.15.118:0/2379032127 conn(0x7f7c7c0fc4c0 msgr2=0x7f7c7c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:30.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.302+0000 7f7c81efb640 1 -- 172.21.15.118:0/2379032127 shutdown_connections 2024-09-21T11:45:30.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.302+0000 7f7c81efb640 1 -- 172.21.15.118:0/2379032127 wait complete. 2024-09-21T11:45:30.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.303+0000 7f7c81efb640 1 Processor -- start 2024-09-21T11:45:30.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.303+0000 7f7c81efb640 1 -- start start 2024-09-21T11:45:30.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.303+0000 7f7c81efb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 0x7f7c7c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:30.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.303+0000 7f7c81efb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c1067e0 0x7f7c7c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:30.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.303+0000 7f7c81efb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c10dd10 con 0x7f7c7c1007e0 2024-09-21T11:45:30.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.303+0000 7f7c81efb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c10db90 con 0x7f7c7c1067e0 2024-09-21T11:45:30.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.303+0000 7f7c7b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 0x7f7c7c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.303+0000 7f7c7b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 0x7f7c7c19f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45174/0 (socket says 172.21.15.118:45174) 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.303+0000 7f7c7b7fe640 1 -- 172.21.15.118:0/4189853225 learned_addr learned my addr 172.21.15.118:0/4189853225 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c7affd640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c1067e0 0x7f7c7c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c7b7fe640 1 -- 172.21.15.118:0/4189853225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c1067e0 msgr2=0x7f7c7c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c7b7fe640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c1067e0 0x7f7c7c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c7b7fe640 1 -- 172.21.15.118:0/4189853225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c199a20 con 0x7f7c7c1007e0 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c7b7fe640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 0x7f7c7c19f860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400b420 tx=0x7f7c6400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c78ff9640 1 -- 172.21.15.118:0/4189853225 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c64011630 con 0x7f7c7c1007e0 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c78ff9640 1 -- 172.21.15.118:0/4189853225 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c64016070 con 0x7f7c7c1007e0 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7c199d10 con 0x7f7c7c1007e0 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7c19a270 con 0x7f7c7c1007e0 2024-09-21T11:45:30.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.304+0000 7f7c78ff9640 1 -- 172.21.15.118:0/4189853225 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c64010d40 con 0x7f7c7c1007e0 2024-09-21T11:45:30.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.305+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7c101f20 con 0x7f7c7c1007e0 2024-09-21T11:45:30.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.306+0000 7f7c78ff9640 1 -- 172.21.15.118:0/4189853225 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7c6401b480 con 0x7f7c7c1007e0 2024-09-21T11:45:30.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.307+0000 7f7c78ff9640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6807af30 0x7f7c6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:30.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.307+0000 7f7c78ff9640 1 -- 172.21.15.118:0/4189853225 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7f7c6409d6b0 con 0x7f7c7c1007e0 2024-09-21T11:45:30.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.307+0000 7f7c7affd640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6807af30 0x7f7c6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:30.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.307+0000 7f7c7affd640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6807af30 0x7f7c6807d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c19b210 tx=0x7f7c6c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:30.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.312+0000 7f7c78ff9640 1 -- 172.21.15.118:0/4189853225 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c64068cb0 con 0x7f7c7c1007e0 2024-09-21T11:45:30.568 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:30 smithi118 ceph-mon[111738]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:45:30.568 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:30 smithi118 ceph-mon[111738]: osdmap e58: 6 total, 5 up, 6 in 2024-09-21T11:45:30.568 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:30 smithi118 ceph-mon[111738]: from='client.44163 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:30.568 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:30 smithi118 podman[130773]: 2024-09-21 11:45:30.256930968 +0000 UTC m=+1.734447981 container cleanup a5fc3752bbb7f32f3e407080eb529471551380bc21f15769374c162faa035807 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b) 2024-09-21T11:45:30.569 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:30 smithi118 bash[130773]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2 2024-09-21T11:45:30.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.580+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7c7c19a580 con 0x7f7c7c1007e0 2024-09-21T11:45:30.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.581+0000 7f7c78ff9640 1 -- 172.21.15.118:0/4189853225 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f7c6406db60 con 0x7f7c7c1007e0 2024-09-21T11:45:30.583 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:45:30.583 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:45:30.583 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:45:30.583 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:45:30.583 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:45:30.583 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:45:30.583 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 7, 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:45:30.584 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:45:30.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6807af30 msgr2=0x7f7c6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6807af30 0x7f7c6807d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c19b210 tx=0x7f7c6c031400 comp rx=0 tx=0).stop 2024-09-21T11:45:30.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 msgr2=0x7f7c7c19f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 0x7f7c7c19f860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400b420 tx=0x7f7c6400b8e0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 shutdown_connections 2024-09-21T11:45:30.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7c1067e0 0x7f7c7c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6807af30 0x7f7c6807d3f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 --2- 172.21.15.118:0/4189853225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7c1007e0 0x7f7c7c19f860 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 >> 172.21.15.118:0/4189853225 conn(0x7f7c7c0fc4c0 msgr2=0x7f7c7c069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:30.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 shutdown_connections 2024-09-21T11:45:30.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.583+0000 7f7c81efb640 1 -- 172.21.15.118:0/4189853225 wait complete. 2024-09-21T11:45:30.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.674+0000 7fa6197df640 1 -- 172.21.15.118:0/3709241131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 msgr2=0x7fa614106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.674+0000 7fa6197df640 1 --2- 172.21.15.118:0/3709241131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 0x7fa614106bc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009880 tx=0x7fa60c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.674+0000 7fa6197df640 1 -- 172.21.15.118:0/3709241131 shutdown_connections 2024-09-21T11:45:30.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.674+0000 7fa6197df640 1 --2- 172.21.15.118:0/3709241131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6141007e0 0x7fa614100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.674+0000 7fa6197df640 1 --2- 172.21.15.118:0/3709241131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 0x7fa614106bc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.674+0000 7fa6197df640 1 -- 172.21.15.118:0/3709241131 >> 172.21.15.118:0/3709241131 conn(0x7fa6140fc4c0 msgr2=0x7fa6140fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:30.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.675+0000 7fa6197df640 1 -- 172.21.15.118:0/3709241131 shutdown_connections 2024-09-21T11:45:30.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.675+0000 7fa6197df640 1 -- 172.21.15.118:0/3709241131 wait complete. 2024-09-21T11:45:30.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.675+0000 7fa6197df640 1 Processor -- start 2024-09-21T11:45:30.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.675+0000 7fa6197df640 1 -- start start 2024-09-21T11:45:30.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6197df640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6141007e0 0x7fa6140fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:30.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6197df640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 0x7fa6140fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:30.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6197df640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa61410dd10 con 0x7fa6141067e0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6197df640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa61410db90 con 0x7fa6141007e0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6127fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 0x7fa6140fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6127fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 0x7fa6140fd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45194/0 (socket says 172.21.15.118:45194) 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6127fc640 1 -- 172.21.15.118:0/3910697827 learned_addr learned my addr 172.21.15.118:0/3910697827 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa612ffd640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6141007e0 0x7fa6140fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6127fc640 1 -- 172.21.15.118:0/3910697827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6141007e0 msgr2=0x7fa6140fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6127fc640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6141007e0 0x7fa6140fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6127fc640 1 -- 172.21.15.118:0/3910697827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6140fd710 con 0x7fa6141067e0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa6127fc640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 0x7fa6140fd1d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa60800b420 tx=0x7fa60800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa5fbfff640 1 -- 172.21.15.118:0/3910697827 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa608011630 con 0x7fa6141067e0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa5fbfff640 1 -- 172.21.15.118:0/3910697827 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa608016070 con 0x7fa6141067e0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.676+0000 7fa5fbfff640 1 -- 172.21.15.118:0/3910697827 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa608010d40 con 0x7fa6141067e0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.677+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6140fda00 con 0x7fa6141067e0 2024-09-21T11:45:30.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.677+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6141a3eb0 con 0x7fa6141067e0 2024-09-21T11:45:30.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.678+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa614101f20 con 0x7fa6141067e0 2024-09-21T11:45:30.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.679+0000 7fa5fbfff640 1 -- 172.21.15.118:0/3910697827 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa6080117d0 con 0x7fa6141067e0 2024-09-21T11:45:30.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.679+0000 7fa5fbfff640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa5fc07af80 0x7fa5fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:30.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.679+0000 7fa5fbfff640 1 -- 172.21.15.118:0/3910697827 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7fa60809dd70 con 0x7fa6141067e0 2024-09-21T11:45:30.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.679+0000 7fa612ffd640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa5fc07af80 0x7fa5fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:30.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.680+0000 7fa612ffd640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa5fc07af80 0x7fa5fc07d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0096c0 tx=0x7fa60c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:30.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.684+0000 7fa5fbfff640 1 -- 172.21.15.118:0/3910697827 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa608069490 con 0x7fa6141067e0 2024-09-21T11:45:30.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:30 smithi149 ceph-mon[79770]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:45:30.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:30 smithi149 ceph-mon[79770]: osdmap e58: 6 total, 5 up, 6 in 2024-09-21T11:45:30.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:30 smithi149 ceph-mon[79770]: from='client.44163 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:30.824 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:30 smithi118 podman[130834]: 2024-09-21 11:45:30.566980499 +0000 UTC m=+0.752534296 container remove a5fc3752bbb7f32f3e407080eb529471551380bc21f15769374c162faa035807 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T11:45:30.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.919+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa614100c40 con 0x7fa6141067e0 2024-09-21T11:45:30.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.920+0000 7fa5fbfff640 1 -- 172.21.15.118:0/3910697827 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2032 (secure 0 0 0) 0x7fa614100c40 con 0x7fa6141067e0 2024-09-21T11:45:30.922 INFO:teuthology.orchestra.run.smithi118.stdout:e16 2024-09-21T11:45:30.922 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:45:30.922 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:45:30.922 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 16 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:45:30.923 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 45 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=14556,1=14572} 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:45:30.924 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:45:30.925 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:45:30.926 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T11:45:30.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa5fc07af80 msgr2=0x7fa5fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa5fc07af80 0x7fa5fc07d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0096c0 tx=0x7fa60c031400 comp rx=0 tx=0).stop 2024-09-21T11:45:30.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 msgr2=0x7fa6140fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:30.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 0x7fa6140fd1d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa60800b420 tx=0x7fa60800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 shutdown_connections 2024-09-21T11:45:30.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa5fc07af80 0x7fa5fc07d440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6141067e0 0x7fa6140fd1d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 --2- 172.21.15.118:0/3910697827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6141007e0 0x7fa6140fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:30.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 >> 172.21.15.118:0/3910697827 conn(0x7fa6140fc4c0 msgr2=0x7fa614069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:30.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 shutdown_connections 2024-09-21T11:45:30.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:30.922+0000 7fa6197df640 1 -- 172.21.15.118:0/3910697827 wait complete. 2024-09-21T11:45:31.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.005+0000 7f8bbd914640 1 -- 172.21.15.118:0/3754486109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 msgr2=0x7f8bb810b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:31.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.005+0000 7f8bbd914640 1 --2- 172.21.15.118:0/3754486109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 0x7f8bb810b8b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009880 tx=0x7f8ba002a530 comp rx=0 tx=0).stop 2024-09-21T11:45:31.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.005+0000 7f8bbd914640 1 -- 172.21.15.118:0/3754486109 shutdown_connections 2024-09-21T11:45:31.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.005+0000 7f8bbd914640 1 --2- 172.21.15.118:0/3754486109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 0x7f8bb810b8b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.005+0000 7f8bbd914640 1 --2- 172.21.15.118:0/3754486109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bb8102aa0 0x7f8bb8102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.005+0000 7f8bbd914640 1 -- 172.21.15.118:0/3754486109 >> 172.21.15.118:0/3754486109 conn(0x7f8bb80fc4c0 msgr2=0x7f8bb80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:31.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.005+0000 7f8bbd914640 1 -- 172.21.15.118:0/3754486109 shutdown_connections 2024-09-21T11:45:31.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.005+0000 7f8bbd914640 1 -- 172.21.15.118:0/3754486109 wait complete. 2024-09-21T11:45:31.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.006+0000 7f8bbd914640 1 Processor -- start 2024-09-21T11:45:31.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.006+0000 7f8bbd914640 1 -- start start 2024-09-21T11:45:31.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.006+0000 7f8bbd914640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bb8102aa0 0x7f8bb819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:31.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.006+0000 7f8bbd914640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 0x7f8bb819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:31.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.006+0000 7f8bbd914640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb810ee30 con 0x7f8bb81033c0 2024-09-21T11:45:31.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.006+0000 7f8bbd914640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb810ecb0 con 0x7f8bb8102aa0 2024-09-21T11:45:31.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.006+0000 7f8bb67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 0x7f8bb819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bb67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 0x7f8bb819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45220/0 (socket says 172.21.15.118:45220) 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bb67fc640 1 -- 172.21.15.118:0/3867415496 learned_addr learned my addr 172.21.15.118:0/3867415496 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bb6ffd640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bb8102aa0 0x7f8bb819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bb67fc640 1 -- 172.21.15.118:0/3867415496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bb8102aa0 msgr2=0x7f8bb819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bb67fc640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bb8102aa0 0x7f8bb819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bb67fc640 1 -- 172.21.15.118:0/3867415496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb8197860 con 0x7f8bb81033c0 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bb67fc640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 0x7f8bb819dbe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0031460 tx=0x7f8ba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bbc912640 1 -- 172.21.15.118:0/3867415496 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ba003f070 con 0x7f8bb81033c0 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bbc912640 1 -- 172.21.15.118:0/3867415496 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ba0004ac0 con 0x7f8bb81033c0 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb8197af0 con 0x7f8bb81033c0 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bbc912640 1 -- 172.21.15.118:0/3867415496 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ba0035030 con 0x7f8bb81033c0 2024-09-21T11:45:31.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.007+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb8198020 con 0x7f8bb81033c0 2024-09-21T11:45:31.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.008+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb806a410 con 0x7f8bb81033c0 2024-09-21T11:45:31.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.009+0000 7f8bbc912640 1 -- 172.21.15.118:0/3867415496 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8ba0042070 con 0x7f8bb81033c0 2024-09-21T11:45:31.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.009+0000 7f8bbc912640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ba407af30 0x7f8ba407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:31.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.010+0000 7f8bbc912640 1 -- 172.21.15.118:0/3867415496 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f8ba00beab0 con 0x7f8bb81033c0 2024-09-21T11:45:31.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.010+0000 7f8bb6ffd640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ba407af30 0x7f8ba407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:31.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.010+0000 7f8bb6ffd640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ba407af30 0x7f8ba407d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8bb81989a0 tx=0x7f8ba80094f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:31.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.014+0000 7f8bbc912640 1 -- 172.21.15.118:0/3867415496 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ba008a0b0 con 0x7f8bb81033c0 2024-09-21T11:45:31.163 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:30 smithi118 podman[130985]: 2024-09-21 11:45:30.837685612 +0000 UTC m=+0.017529689 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:45:31.164 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:30 smithi118 podman[130985]: 2024-09-21 11:45:30.943037509 +0000 UTC m=+0.122881588 container create 1abd301647a98ff2e1cfd28c650d0dd407f9b0a950999540d7ab527f23c15ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T11:45:31.164 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:31 smithi118 podman[130985]: 2024-09-21 11:45:31.162527456 +0000 UTC m=+0.342371541 container init 1abd301647a98ff2e1cfd28c650d0dd407f9b0a950999540d7ab527f23c15ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T11:45:31.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.224+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8bb8105fb0 con 0x7f8ba407af30 2024-09-21T11:45:31.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.225+0000 7f8bbc912640 1 -- 172.21.15.118:0/3867415496 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8ba80173f0 con 0x7f8ba407af30 2024-09-21T11:45:31.228 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:45:31.228 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:45:31.228 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:45:31.228 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:45:31.228 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:45:31.228 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:45:31.228 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:45:31.228 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:45:31.229 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:45:31.229 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "8/23 daemons upgraded", 2024-09-21T11:45:31.229 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T11:45:31.229 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:45:31.229 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:45:31.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.227+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ba407af30 msgr2=0x7f8ba407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:31.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.227+0000 7f8bbd914640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ba407af30 0x7f8ba407d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8bb81989a0 tx=0x7f8ba80094f0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.227+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 msgr2=0x7f8bb819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:31.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.227+0000 7f8bbd914640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 0x7f8bb819dbe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0031460 tx=0x7f8ba00046c0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.228+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 shutdown_connections 2024-09-21T11:45:31.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.228+0000 7f8bbd914640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ba407af30 0x7f8ba407d3f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.228+0000 7f8bbd914640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb81033c0 0x7f8bb819dbe0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.228+0000 7f8bbd914640 1 --2- 172.21.15.118:0/3867415496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bb8102aa0 0x7f8bb819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.228+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 >> 172.21.15.118:0/3867415496 conn(0x7f8bb80fc4c0 msgr2=0x7f8bb8108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:31.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.228+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 shutdown_connections 2024-09-21T11:45:31.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.228+0000 7f8bbd914640 1 -- 172.21.15.118:0/3867415496 wait complete. 2024-09-21T11:45:31.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.311+0000 7f9147a78640 1 -- 172.21.15.118:0/4290677531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401067e0 msgr2=0x7f9140106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:31.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.311+0000 7f9147a78640 1 --2- 172.21.15.118:0/4290677531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401067e0 0x7f9140106bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9138009880 tx=0x7f913802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.311+0000 7f9147a78640 1 -- 172.21.15.118:0/4290677531 shutdown_connections 2024-09-21T11:45:31.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.311+0000 7f9147a78640 1 --2- 172.21.15.118:0/4290677531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91401007e0 0x7f9140100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.311+0000 7f9147a78640 1 --2- 172.21.15.118:0/4290677531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401067e0 0x7f9140106bc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.311+0000 7f9147a78640 1 -- 172.21.15.118:0/4290677531 >> 172.21.15.118:0/4290677531 conn(0x7f91400fc4c0 msgr2=0x7f91400fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:31.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.311+0000 7f9147a78640 1 -- 172.21.15.118:0/4290677531 shutdown_connections 2024-09-21T11:45:31.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.311+0000 7f9147a78640 1 -- 172.21.15.118:0/4290677531 wait complete. 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9147a78640 1 Processor -- start 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9147a78640 1 -- start start 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9147a78640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401007e0 0x7f914019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9147a78640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91401067e0 0x7f914019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9147a78640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f914010dcb0 con 0x7f91401007e0 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9147a78640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f914010db30 con 0x7f91401067e0 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9145814640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401007e0 0x7f914019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9145814640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401007e0 0x7f914019c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45236/0 (socket says 172.21.15.118:45236) 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9145814640 1 -- 172.21.15.118:0/2055157775 learned_addr learned my addr 172.21.15.118:0/2055157775 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9145013640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91401067e0 0x7f914019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9145814640 1 -- 172.21.15.118:0/2055157775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91401067e0 msgr2=0x7f914019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:31.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9145814640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91401067e0 0x7f914019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.312+0000 7f9145814640 1 -- 172.21.15.118:0/2055157775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91401966e0 con 0x7f91401007e0 2024-09-21T11:45:31.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.313+0000 7f9145814640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401007e0 0x7f914019c610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9138031460 tx=0x7f91380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:31.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.313+0000 7f9136ffd640 1 -- 172.21.15.118:0/2055157775 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f913803f070 con 0x7f91401007e0 2024-09-21T11:45:31.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.313+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9140196970 con 0x7f91401007e0 2024-09-21T11:45:31.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.313+0000 7f9136ffd640 1 -- 172.21.15.118:0/2055157775 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f91380035f0 con 0x7f91401007e0 2024-09-21T11:45:31.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.313+0000 7f9136ffd640 1 -- 172.21.15.118:0/2055157775 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9138035030 con 0x7f91401007e0 2024-09-21T11:45:31.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.313+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9140196e70 con 0x7f91401007e0 2024-09-21T11:45:31.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.314+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9140101f20 con 0x7f91401007e0 2024-09-21T11:45:31.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.314+0000 7f9136ffd640 1 -- 172.21.15.118:0/2055157775 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9138042070 con 0x7f91401007e0 2024-09-21T11:45:31.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.315+0000 7f9136ffd640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f912c07af30 0x7f912c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:45:31.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.315+0000 7f9136ffd640 1 -- 172.21.15.118:0/2055157775 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f91380be950 con 0x7f91401007e0 2024-09-21T11:45:31.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.315+0000 7f9145013640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f912c07af30 0x7f912c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:45:31.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.316+0000 7f9145013640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f912c07af30 0x7f912c07d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9140197f30 tx=0x7f913000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:45:31.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.319+0000 7f9136ffd640 1 -- 172.21.15.118:0/2055157775 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9138089f50 con 0x7f91401007e0 2024-09-21T11:45:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:31 smithi149 ceph-mon[79770]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:31 smithi149 ceph-mon[79770]: pgmap v177: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:31 smithi149 ceph-mon[79770]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:31 smithi149 ceph-mon[79770]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-21T11:45:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:31 smithi149 ceph-mon[79770]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T11:45:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:31 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/4189853225' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:31 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3910697827' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:45:31.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:31 smithi118 ceph-mon[111738]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:31.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:31 smithi118 ceph-mon[111738]: pgmap v177: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:31.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:31 smithi118 ceph-mon[111738]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:31.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:31 smithi118 ceph-mon[111738]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-21T11:45:31.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:31 smithi118 ceph-mon[111738]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T11:45:31.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:31 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/4189853225' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:31.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:31 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3910697827' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:45:31.575 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:31 smithi118 podman[130985]: 2024-09-21 11:45:31.167173525 +0000 UTC m=+0.347017603 container start 1abd301647a98ff2e1cfd28c650d0dd407f9b0a950999540d7ab527f23c15ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T11:45:31.575 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:31 smithi118 podman[130985]: 2024-09-21 11:45:31.271260525 +0000 UTC m=+0.451104606 container attach 1abd301647a98ff2e1cfd28c650d0dd407f9b0a950999540d7ab527f23c15ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T11:45:31.575 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:31 smithi118 podman[130985]: 2024-09-21 11:45:31.37125688 +0000 UTC m=+0.551100958 container died 1abd301647a98ff2e1cfd28c650d0dd407f9b0a950999540d7ab527f23c15ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T11:45:31.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.592+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9140197120 con 0x7f91401007e0 2024-09-21T11:45:31.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.592+0000 7f9136ffd640 1 -- 172.21.15.118:0/2055157775 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+784 (secure 0 0 0) 0x7f913808ee00 con 0x7f91401007e0 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 5 pgs peering 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout: osd.2 (root=default,host=smithi118) is down 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 5 pgs peering 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.c is stuck peering for 4m, current state peering, last acting [3,0] 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.e is stuck peering for 4m, current state peering, last acting [0,3] 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout: pg 2.1e is stuck peering for 4m, current state peering, last acting [0,5] 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout: pg 3.18 is stuck peering for 4m, current state peering, last acting [0,1] 2024-09-21T11:45:31.595 INFO:teuthology.orchestra.run.smithi118.stdout: pg 3.1e is stuck peering for 4m, current state peering, last acting [3,1] 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f912c07af30 msgr2=0x7f912c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f912c07af30 0x7f912c07d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9140197f30 tx=0x7f913000b390 comp rx=0 tx=0).stop 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401007e0 msgr2=0x7f914019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401007e0 0x7f914019c610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9138031460 tx=0x7f91380045e0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 shutdown_connections 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91401067e0 0x7f914019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f912c07af30 0x7f912c07d3f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 --2- 172.21.15.118:0/2055157775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91401007e0 0x7f914019c610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 >> 172.21.15.118:0/2055157775 conn(0x7f91400fc4c0 msgr2=0x7f91400fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 shutdown_connections 2024-09-21T11:45:31.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:45:31.594+0000 7f9147a78640 1 -- 172.21.15.118:0/2055157775 wait complete. 2024-09-21T11:45:32.403 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 podman[131051]: 2024-09-21 11:45:32.092650175 +0000 UTC m=+0.711496847 container remove 1abd301647a98ff2e1cfd28c650d0dd407f9b0a950999540d7ab527f23c15ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T11:45:32.403 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-21T11:45:32.403 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 systemd[1]: Stopped Ceph osd.2 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:45:32.403 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.2.service: Consumed 49.866s CPU time. 2024-09-21T11:45:32.404 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 systemd[1]: Starting Ceph osd.2 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:45:32.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:32 smithi118 ceph-mon[111738]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:32.666 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:32 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2055157775' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:45:32.666 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 podman[131154]: 2024-09-21 11:45:32.439204365 +0000 UTC m=+0.016190910 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:45:32.666 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 podman[131154]: 2024-09-21 11:45:32.556432895 +0000 UTC m=+0.133419441 container create 3844b27454a13993b73437aed460d3f5d8e9c5e5971aace7f44ebff52d8fbe40 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T11:45:32.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:32 smithi149 ceph-mon[79770]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:45:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:32 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2055157775' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:45:32.929 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 podman[131154]: 2024-09-21 11:45:32.780347118 +0000 UTC m=+0.357333681 container init 3844b27454a13993b73437aed460d3f5d8e9c5e5971aace7f44ebff52d8fbe40 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T11:45:32.929 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 podman[131154]: 2024-09-21 11:45:32.783909495 +0000 UTC m=+0.360896049 container start 3844b27454a13993b73437aed460d3f5d8e9c5e5971aace7f44ebff52d8fbe40 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T11:45:32.929 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 podman[131154]: 2024-09-21 11:45:32.854757603 +0000 UTC m=+0.431744165 container attach 3844b27454a13993b73437aed460d3f5d8e9c5e5971aace7f44ebff52d8fbe40 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T11:45:32.929 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:45:32.929 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 bash[131154]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:45:32.929 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:45:32.930 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:32 smithi118 bash[131154]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:45:33.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:33 smithi149 ceph-mon[79770]: pgmap v179: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:33 smithi118 ceph-mon[111738]: pgmap v179: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:34.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:34 smithi118 ceph-mon[111738]: Health check failed: Degraded data redundancy: 15/312 objects degraded (4.808%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T11:45:34.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:34 smithi149 ceph-mon[79770]: Health check failed: Degraded data redundancy: 15/312 objects degraded (4.808%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T11:45:35.749 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:35 smithi118 ceph-mon[111738]: pgmap v180: 65 pgs: 4 active+undersized, 20 peering, 3 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15/312 objects degraded (4.808%) 2024-09-21T11:45:35.750 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:35.750 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:45:35.750 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:45:35.750 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:45:35.750 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 bash[131154]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:45:35.750 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 bash[131154]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:45:35.750 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:45:35.750 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 bash[131154]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:45:35.750 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T11:45:35.750 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 bash[131154]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T11:45:35.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:35 smithi149 ceph-mon[79770]: pgmap v180: 65 pgs: 4 active+undersized, 20 peering, 3 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15/312 objects degraded (4.808%) 2024-09-21T11:45:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:45:36.032 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-21T11:45:36.032 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:35 smithi118 bash[131154]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-21T11:45:36.033 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T11:45:36.033 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 bash[131154]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T11:45:36.324 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-21T11:45:36.324 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 bash[131154]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-21T11:45:36.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T11:45:36.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 bash[131154]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T11:45:36.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T11:45:36.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 bash[131154]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T11:45:36.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate[131169]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-21T11:45:36.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 bash[131154]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-21T11:45:36.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 podman[131154]: 2024-09-21 11:45:36.059193167 +0000 UTC m=+3.636179712 container died 3844b27454a13993b73437aed460d3f5d8e9c5e5971aace7f44ebff52d8fbe40 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T11:45:36.677 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:36 smithi118 ceph-mon[111738]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-21T11:45:36.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:36 smithi149 ceph-mon[79770]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-21T11:45:36.980 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 podman[131376]: 2024-09-21 11:45:36.675836254 +0000 UTC m=+0.606536789 container remove 3844b27454a13993b73437aed460d3f5d8e9c5e5971aace7f44ebff52d8fbe40 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-activate, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T11:45:36.980 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 podman[131436]: 2024-09-21 11:45:36.876881206 +0000 UTC m=+0.106800002 container create 41c161aa8867bc83a6af0514b1d843f9958ef4cb115e139df942b00f58593e6c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T11:45:36.980 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:36 smithi118 podman[131436]: 2024-09-21 11:45:36.78613414 +0000 UTC m=+0.016052945 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:45:37.324 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:37 smithi118 podman[131436]: 2024-09-21 11:45:37.079209879 +0000 UTC m=+0.309128685 container init 41c161aa8867bc83a6af0514b1d843f9958ef4cb115e139df942b00f58593e6c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T11:45:37.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:37 smithi118 podman[131436]: 2024-09-21 11:45:37.082470655 +0000 UTC m=+0.312389451 container start 41c161aa8867bc83a6af0514b1d843f9958ef4cb115e139df942b00f58593e6c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=) 2024-09-21T11:45:37.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:37 smithi118 ceph-osd[131454]: -- 172.21.15.118:0/797224965 <== mon.0 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558777a5e1e0 con 0x558776c69c00 2024-09-21T11:45:37.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:37 smithi118 bash[131436]: 41c161aa8867bc83a6af0514b1d843f9958ef4cb115e139df942b00f58593e6c 2024-09-21T11:45:37.325 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:37 smithi118 systemd[1]: Started Ceph osd.2 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:45:37.768 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:37 smithi118 ceph-mon[111738]: pgmap v181: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:37.768 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:37 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:37.768 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:37 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:37.769 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:37 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:45:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:37 smithi149 ceph-mon[79770]: pgmap v181: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:37 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:37 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:37 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:45:39.314 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:38 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[131450]: 2024-09-21T11:45:38.944+0000 7f086621f640 -1 Falling back to public interface 2024-09-21T11:45:39.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:39 smithi118 ceph-mon[111738]: pgmap v182: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:39.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:39 smithi149 ceph-mon[79770]: pgmap v182: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:41.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:41 smithi149 ceph-mon[79770]: pgmap v183: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:41 smithi118 ceph-mon[111738]: pgmap v183: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:42.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:42 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 41/312 objects degraded (13.141%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T11:45:42.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:42.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:42.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:42 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 41/312 objects degraded (13.141%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T11:45:42.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:42.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:43.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:43 smithi149 ceph-mon[79770]: pgmap v184: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:43.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:43.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:43.983 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:43 smithi118 ceph-mon[111738]: pgmap v184: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:43.983 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:43.983 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:44.324 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:43 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[131450]: 2024-09-21T11:45:43.980+0000 7f086621f640 -1 osd.2 57 log_to_monitors true 2024-09-21T11:45:44.914 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:44 smithi118 ceph-mon[111738]: from='osd.2 [v2:172.21.15.118:6818/1589784698,v1:172.21.15.118:6819/1589784698]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T11:45:44.915 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 11:45:44 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[131450]: 2024-09-21T11:45:44.662+0000 7f0859fc1640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:45:44.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:44 smithi149 ceph-mon[79770]: from='osd.2 [v2:172.21.15.118:6818/1589784698,v1:172.21.15.118:6819/1589784698]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T11:45:45.802 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:45 smithi118 ceph-mon[111738]: pgmap v185: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:45.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:45 smithi118 ceph-mon[111738]: from='osd.2 [v2:172.21.15.118:6818/1589784698,v1:172.21.15.118:6819/1589784698]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T11:45:45.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:45 smithi118 ceph-mon[111738]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T11:45:45.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:45 smithi118 ceph-mon[111738]: from='osd.2 [v2:172.21.15.118:6818/1589784698,v1:172.21.15.118:6819/1589784698]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]} : dispatch 2024-09-21T11:45:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:45 smithi149 ceph-mon[79770]: pgmap v185: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:45 smithi149 ceph-mon[79770]: from='osd.2 [v2:172.21.15.118:6818/1589784698,v1:172.21.15.118:6819/1589784698]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T11:45:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:45 smithi149 ceph-mon[79770]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T11:45:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:45 smithi149 ceph-mon[79770]: from='osd.2 [v2:172.21.15.118:6818/1589784698,v1:172.21.15.118:6819/1589784698]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]} : dispatch 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: osd.2 [v2:172.21.15.118:6818/1589784698,v1:172.21.15.118:6819/1589784698] boot 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: osdmap e61: 6 total, 6 up, 6 in 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:46.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:46.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:46.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T11:45:46.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:46 smithi149 ceph-mon[79770]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T11:45:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:45:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: osd.2 [v2:172.21.15.118:6818/1589784698,v1:172.21.15.118:6819/1589784698] boot 2024-09-21T11:45:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: osdmap e61: 6 total, 6 up, 6 in 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T11:45:47.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:46 smithi118 ceph-mon[111738]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T11:45:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:47 smithi149 ceph-mon[79770]: pgmap v188: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:47 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T11:45:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:47 smithi149 ceph-mon[79770]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T11:45:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:47 smithi118 ceph-mon[111738]: pgmap v188: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-21T11:45:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:47 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T11:45:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:47 smithi118 ceph-mon[111738]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T11:45:49.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:48 smithi118 ceph-mon[111738]: pgmap v190: 65 pgs: 12 active+undersized, 12 active+undersized+degraded, 41 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 37/312 objects degraded (11.859%) 2024-09-21T11:45:49.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:48 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 37/312 objects degraded (11.859%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T11:45:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:48 smithi149 ceph-mon[79770]: pgmap v190: 65 pgs: 12 active+undersized, 12 active+undersized+degraded, 41 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 37/312 objects degraded (11.859%) 2024-09-21T11:45:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:48 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 37/312 objects degraded (11.859%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T11:45:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:45:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:50 smithi149 ceph-mon[79770]: pgmap v191: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:45:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:45:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:50 smithi118 ceph-mon[111738]: pgmap v191: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:52.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:51 smithi149 ceph-mon[79770]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/312 objects degraded (11.859%), 12 pgs degraded) 2024-09-21T11:45:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:51 smithi118 ceph-mon[111738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/312 objects degraded (11.859%), 12 pgs degraded) 2024-09-21T11:45:53.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:52 smithi118 ceph-mon[111738]: pgmap v192: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:53.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:52 smithi149 ceph-mon[79770]: pgmap v192: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:55.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:55 smithi118 ceph-mon[111738]: pgmap v193: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:55.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:55 smithi149 ceph-mon[79770]: pgmap v193: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:57.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:57 smithi118 ceph-mon[111738]: pgmap v194: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:57.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:57 smithi149 ceph-mon[79770]: pgmap v194: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:59.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:45:59 smithi118 ceph-mon[111738]: pgmap v195: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:45:59.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:45:59 smithi149 ceph-mon[79770]: pgmap v195: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:01.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:00 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:01.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:00 smithi118 ceph-mon[111738]: pgmap v196: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:01.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:00 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:01.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:00 smithi149 ceph-mon[79770]: pgmap v196: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:01.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.690+0000 7f511f0a3640 1 -- 172.21.15.118:0/3804180151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 msgr2=0x7f5118106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.690+0000 7f511f0a3640 1 --2- 172.21.15.118:0/3804180151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 0x7f5118106c00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5114009880 tx=0x7f511402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.690+0000 7f511f0a3640 1 -- 172.21.15.118:0/3804180151 shutdown_connections 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.690+0000 7f511f0a3640 1 --2- 172.21.15.118:0/3804180151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5118100820 0x7f5118100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.690+0000 7f511f0a3640 1 --2- 172.21.15.118:0/3804180151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 0x7f5118106c00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.690+0000 7f511f0a3640 1 -- 172.21.15.118:0/3804180151 >> 172.21.15.118:0/3804180151 conn(0x7f51180fc520 msgr2=0x7f51180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.690+0000 7f511f0a3640 1 -- 172.21.15.118:0/3804180151 shutdown_connections 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.690+0000 7f511f0a3640 1 -- 172.21.15.118:0/3804180151 wait complete. 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f511f0a3640 1 Processor -- start 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f511f0a3640 1 -- start start 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f511f0a3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5118100820 0x7f5118198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f511f0a3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 0x7f5118198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f511f0a3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f511810dcf0 con 0x7f5118106820 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f511f0a3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f511810db70 con 0x7f5118100820 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f510ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 0x7f5118198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f510ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 0x7f5118198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47114/0 (socket says 172.21.15.118:47114) 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f511ce3f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5118100820 0x7f5118198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.691+0000 7f510ffff640 1 -- 172.21.15.118:0/3472569729 learned_addr learned my addr 172.21.15.118:0/3472569729 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.692+0000 7f510ffff640 1 -- 172.21.15.118:0/3472569729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5118100820 msgr2=0x7f5118198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.692+0000 7f510ffff640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5118100820 0x7f5118198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.692+0000 7f510ffff640 1 -- 172.21.15.118:0/3472569729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5118199360 con 0x7f5118106820 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.692+0000 7f510ffff640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 0x7f5118198d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f510800e970 tx=0x7f510800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.692+0000 7f510dffb640 1 -- 172.21.15.118:0/3472569729 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f510800cac0 con 0x7f5118106820 2024-09-21T11:46:01.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.692+0000 7f510dffb640 1 -- 172.21.15.118:0/3472569729 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51080054e0 con 0x7f5118106820 2024-09-21T11:46:01.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.692+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5118199650 con 0x7f5118106820 2024-09-21T11:46:01.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.692+0000 7f510dffb640 1 -- 172.21.15.118:0/3472569729 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5108010430 con 0x7f5118106820 2024-09-21T11:46:01.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.692+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51181a1c50 con 0x7f5118106820 2024-09-21T11:46:01.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.693+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5118101f60 con 0x7f5118106820 2024-09-21T11:46:01.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.694+0000 7f510dffb640 1 -- 172.21.15.118:0/3472569729 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5108004f00 con 0x7f5118106820 2024-09-21T11:46:01.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.694+0000 7f510dffb640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f510007af80 0x7f510007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:01.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.695+0000 7f510dffb640 1 -- 172.21.15.118:0/3472569729 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f510809e5a0 con 0x7f5118106820 2024-09-21T11:46:01.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.695+0000 7f511ce3f640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f510007af80 0x7f510007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:01.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.695+0000 7f511ce3f640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f510007af80 0x7f510007d440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f51140096c0 tx=0x7f5114031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:01.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.699+0000 7f510dffb640 1 -- 172.21.15.118:0/3472569729 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5118199650 con 0x7f5118106820 2024-09-21T11:46:01.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.892+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5118062630 con 0x7f510007af80 2024-09-21T11:46:01.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.893+0000 7f510dffb640 1 -- 172.21.15.118:0/3472569729 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f5118062630 con 0x7f510007af80 2024-09-21T11:46:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.895+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f510007af80 msgr2=0x7f510007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f510007af80 0x7f510007d440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f51140096c0 tx=0x7f5114031400 comp rx=0 tx=0).stop 2024-09-21T11:46:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 msgr2=0x7f5118198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 0x7f5118198d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f510800e970 tx=0x7f510800ed70 comp rx=0 tx=0).stop 2024-09-21T11:46:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 shutdown_connections 2024-09-21T11:46:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f510007af80 0x7f510007d440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5118106820 0x7f5118198d60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 --2- 172.21.15.118:0/3472569729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5118100820 0x7f5118198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 >> 172.21.15.118:0/3472569729 conn(0x7f51180fc520 msgr2=0x7f51180fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:01.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 shutdown_connections 2024-09-21T11:46:01.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.896+0000 7f511f0a3640 1 -- 172.21.15.118:0/3472569729 wait complete. 2024-09-21T11:46:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:46:01.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.978+0000 7fb387153640 1 -- 172.21.15.118:0/2895680623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801007f0 msgr2=0x7fb380100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.978+0000 7fb387153640 1 --2- 172.21.15.118:0/2895680623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801007f0 0x7fb380100c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb370009880 tx=0x7fb37002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.978+0000 7fb387153640 1 -- 172.21.15.118:0/2895680623 shutdown_connections 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.978+0000 7fb387153640 1 --2- 172.21.15.118:0/2895680623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801007f0 0x7fb380100c50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.978+0000 7fb387153640 1 --2- 172.21.15.118:0/2895680623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3801067f0 0x7fb380106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.978+0000 7fb387153640 1 -- 172.21.15.118:0/2895680623 >> 172.21.15.118:0/2895680623 conn(0x7fb3800fc4d0 msgr2=0x7fb3800fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb387153640 1 -- 172.21.15.118:0/2895680623 shutdown_connections 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb387153640 1 -- 172.21.15.118:0/2895680623 wait complete. 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb387153640 1 Processor -- start 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb387153640 1 -- start start 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb387153640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3801007f0 0x7fb38019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:01.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb387153640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801067f0 0x7fb38019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb387153640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb38010dcc0 con 0x7fb3801067f0 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb387153640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb38010db40 con 0x7fb3801007f0 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb377fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801067f0 0x7fb38019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb377fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801067f0 0x7fb38019cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47132/0 (socket says 172.21.15.118:47132) 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.979+0000 7fb377fff640 1 -- 172.21.15.118:0/460180868 learned_addr learned my addr 172.21.15.118:0/460180868 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb384eef640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3801007f0 0x7fb38019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb377fff640 1 -- 172.21.15.118:0/460180868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3801007f0 msgr2=0x7fb38019c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb377fff640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3801007f0 0x7fb38019c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb377fff640 1 -- 172.21.15.118:0/460180868 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3801966d0 con 0x7fb3801067f0 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb377fff640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801067f0 0x7fb38019cb40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb370031460 tx=0x7fb370004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb375ffb640 1 -- 172.21.15.118:0/460180868 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb37003f070 con 0x7fb3801067f0 2024-09-21T11:46:01.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb375ffb640 1 -- 172.21.15.118:0/460180868 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3700035f0 con 0x7fb3801067f0 2024-09-21T11:46:01.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb380196960 con 0x7fb3801067f0 2024-09-21T11:46:01.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb375ffb640 1 -- 172.21.15.118:0/460180868 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb370035030 con 0x7fb3801067f0 2024-09-21T11:46:01.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.980+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb380196e90 con 0x7fb3801067f0 2024-09-21T11:46:01.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.981+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb380101f30 con 0x7fb3801067f0 2024-09-21T11:46:01.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.982+0000 7fb375ffb640 1 -- 172.21.15.118:0/460180868 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb370042070 con 0x7fb3801067f0 2024-09-21T11:46:01.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.982+0000 7fb375ffb640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb36807af80 0x7fb36807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:01.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.983+0000 7fb375ffb640 1 -- 172.21.15.118:0/460180868 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fb3700be830 con 0x7fb3801067f0 2024-09-21T11:46:01.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.983+0000 7fb384eef640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb36807af80 0x7fb36807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:01.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.983+0000 7fb384eef640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb36807af80 0x7fb36807d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009bd0 tx=0x7fb37c005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:01.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:01.987+0000 7fb375ffb640 1 -- 172.21.15.118:0/460180868 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb370089eb0 con 0x7fb3801067f0 2024-09-21T11:46:02.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.180+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb380197200 con 0x7fb36807af80 2024-09-21T11:46:02.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.181+0000 7fb375ffb640 1 -- 172.21.15.118:0/460180868 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fb380197200 con 0x7fb36807af80 2024-09-21T11:46:02.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb36807af80 msgr2=0x7fb36807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb36807af80 0x7fb36807d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009bd0 tx=0x7fb37c005f90 comp rx=0 tx=0).stop 2024-09-21T11:46:02.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801067f0 msgr2=0x7fb38019cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801067f0 0x7fb38019cb40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb370031460 tx=0x7fb370004530 comp rx=0 tx=0).stop 2024-09-21T11:46:02.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 shutdown_connections 2024-09-21T11:46:02.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb36807af80 0x7fb36807d440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3801067f0 0x7fb38019cb40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 --2- 172.21.15.118:0/460180868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3801007f0 0x7fb38019c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 >> 172.21.15.118:0/460180868 conn(0x7fb3800fc4d0 msgr2=0x7fb3800fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:02.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 shutdown_connections 2024-09-21T11:46:02.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.184+0000 7fb387153640 1 -- 172.21.15.118:0/460180868 wait complete. 2024-09-21T11:46:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:01 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T11:46:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:01 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T11:46:02.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:01 smithi149 ceph-mon[79770]: Upgrade: osd.3 is safe to restart 2024-09-21T11:46:02.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.266+0000 7fd3eb539640 1 -- 172.21.15.118:0/3018482346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 msgr2=0x7fd3e4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.266+0000 7fd3eb539640 1 --2- 172.21.15.118:0/3018482346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 0x7fd3e4100c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009880 tx=0x7fd3e002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.266+0000 7fd3eb539640 1 -- 172.21.15.118:0/3018482346 shutdown_connections 2024-09-21T11:46:02.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.266+0000 7fd3eb539640 1 --2- 172.21.15.118:0/3018482346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 0x7fd3e4100c80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.266+0000 7fd3eb539640 1 --2- 172.21.15.118:0/3018482346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3e4106820 0x7fd3e4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.266+0000 7fd3eb539640 1 -- 172.21.15.118:0/3018482346 >> 172.21.15.118:0/3018482346 conn(0x7fd3e40fc520 msgr2=0x7fd3e40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:02.268 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:01 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T11:46:02.268 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:01 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T11:46:02.268 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:01 smithi118 ceph-mon[111738]: Upgrade: osd.3 is safe to restart 2024-09-21T11:46:02.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.266+0000 7fd3eb539640 1 -- 172.21.15.118:0/3018482346 shutdown_connections 2024-09-21T11:46:02.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.266+0000 7fd3eb539640 1 -- 172.21.15.118:0/3018482346 wait complete. 2024-09-21T11:46:02.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3eb539640 1 Processor -- start 2024-09-21T11:46:02.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3eb539640 1 -- start start 2024-09-21T11:46:02.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3eb539640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 0x7fd3e419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:02.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3eb539640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3e4106820 0x7fd3e419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:02.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3eb539640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e410dcf0 con 0x7fd3e4100820 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3eb539640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e410db70 con 0x7fd3e4106820 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3e92d5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 0x7fd3e419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3e92d5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 0x7fd3e419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47156/0 (socket says 172.21.15.118:47156) 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3e92d5640 1 -- 172.21.15.118:0/2315286145 learned_addr learned my addr 172.21.15.118:0/2315286145 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3e8ad4640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3e4106820 0x7fd3e419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3e92d5640 1 -- 172.21.15.118:0/2315286145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3e4106820 msgr2=0x7fd3e419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3e92d5640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3e4106820 0x7fd3e419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.267+0000 7fd3e92d5640 1 -- 172.21.15.118:0/2315286145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e41977e0 con 0x7fd3e4100820 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.268+0000 7fd3e92d5640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 0x7fd3e419d660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400d6f0 tx=0x7fd3d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.268+0000 7fd3da7fc640 1 -- 172.21.15.118:0/2315286145 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3d4017070 con 0x7fd3e4100820 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.268+0000 7fd3da7fc640 1 -- 172.21.15.118:0/2315286145 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3d400de00 con 0x7fd3e4100820 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.268+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e4197ad0 con 0x7fd3e4100820 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.268+0000 7fd3da7fc640 1 -- 172.21.15.118:0/2315286145 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3d4004bb0 con 0x7fd3e4100820 2024-09-21T11:46:02.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.268+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e4198030 con 0x7fd3e4100820 2024-09-21T11:46:02.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.269+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e4101f60 con 0x7fd3e4100820 2024-09-21T11:46:02.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.270+0000 7fd3da7fc640 1 -- 172.21.15.118:0/2315286145 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd3d4004e60 con 0x7fd3e4100820 2024-09-21T11:46:02.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.270+0000 7fd3da7fc640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd3d007af30 0x7fd3d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:02.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.270+0000 7fd3da7fc640 1 -- 172.21.15.118:0/2315286145 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fd3d409d8b0 con 0x7fd3e4100820 2024-09-21T11:46:02.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.270+0000 7fd3e8ad4640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd3d007af30 0x7fd3d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:02.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.271+0000 7fd3e8ad4640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd3d007af30 0x7fd3d007d3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4198b30 tx=0x7fd3e0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:02.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.275+0000 7fd3da7fc640 1 -- 172.21.15.118:0/2315286145 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd3d4068f30 con 0x7fd3e4100820 2024-09-21T11:46:02.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.462+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd3e41983a0 con 0x7fd3d007af30 2024-09-21T11:46:02.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.472+0000 7fd3da7fc640 1 -- 172.21.15.118:0/2315286145 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fd3e41983a0 con 0x7fd3d007af30 2024-09-21T11:46:02.473 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:46:02.473 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (3m) 20s ago 14m 20.0M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (7m) 20s ago 15m 8971k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (6m) 119s ago 14m 8358k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (2m) 20s ago 15m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (2m) 119s ago 14m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (3m) 20s ago 14m 81.6M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (9m) 20s ago 9m 147M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (9m) 20s ago 9m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (9m) 119s ago 9m 22.1M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (9m) 119s ago 9m 16.0M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (6m) 20s ago 16m 525M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (5m) 119s ago 14m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (2m) 20s ago 16m 43.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:46:02.474 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (2m) 119s ago 14m 25.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:46:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (4m) 20s ago 15m 9.92M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:46:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (4m) 119s ago 14m 10.7M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:46:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (100s) 20s ago 12m 90.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:46:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (63s) 20s ago 12m 91.0M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:46:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (25s) 20s ago 11m 11.7M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:46:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (11m) 119s ago 11m 260M 4096M 19.1.1-373-g4e45e6b4 164465d2334a ef02e30965bf 2024-09-21T11:46:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (11m) 119s ago 11m 212M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:46:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (10m) 119s ago 10m 207M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:46:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (4m) 20s ago 14m 54.2M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:46:02.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.474+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd3d007af30 msgr2=0x7fd3d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.474+0000 7fd3eb539640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd3d007af30 0x7fd3d007d3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4198b30 tx=0x7fd3e0031400 comp rx=0 tx=0).stop 2024-09-21T11:46:02.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.474+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 msgr2=0x7fd3e419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.474+0000 7fd3eb539640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 0x7fd3e419d660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400d6f0 tx=0x7fd3d400dbb0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.474+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 shutdown_connections 2024-09-21T11:46:02.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.474+0000 7fd3eb539640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3e4106820 0x7fd3e419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.474+0000 7fd3eb539640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd3d007af30 0x7fd3d007d3f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.474+0000 7fd3eb539640 1 --2- 172.21.15.118:0/2315286145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4100820 0x7fd3e419d660 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.474+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 >> 172.21.15.118:0/2315286145 conn(0x7fd3e40fc520 msgr2=0x7fd3e406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:02.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.475+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 shutdown_connections 2024-09-21T11:46:02.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.475+0000 7fd3eb539640 1 -- 172.21.15.118:0/2315286145 wait complete. 2024-09-21T11:46:02.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.554+0000 7fe5eb959640 1 -- 172.21.15.118:0/663774065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 msgr2=0x7fe5e410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.554+0000 7fe5eb959640 1 --2- 172.21.15.118:0/663774065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 0x7fe5e410b8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009880 tx=0x7fe5e002a530 comp rx=0 tx=0).stop 2024-09-21T11:46:02.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.554+0000 7fe5eb959640 1 -- 172.21.15.118:0/663774065 shutdown_connections 2024-09-21T11:46:02.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.554+0000 7fe5eb959640 1 --2- 172.21.15.118:0/663774065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 0x7fe5e410b8f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.554+0000 7fe5eb959640 1 --2- 172.21.15.118:0/663774065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5e4102ae0 0x7fe5e4102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.554+0000 7fe5eb959640 1 -- 172.21.15.118:0/663774065 >> 172.21.15.118:0/663774065 conn(0x7fe5e40fc520 msgr2=0x7fe5e40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:02.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.554+0000 7fe5eb959640 1 -- 172.21.15.118:0/663774065 shutdown_connections 2024-09-21T11:46:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.554+0000 7fe5eb959640 1 -- 172.21.15.118:0/663774065 wait complete. 2024-09-21T11:46:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5eb959640 1 Processor -- start 2024-09-21T11:46:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5eb959640 1 -- start start 2024-09-21T11:46:02.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5eb959640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5e4102ae0 0x7fe5e419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:02.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5eb959640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 0x7fe5e419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:02.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5eb959640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e410edf0 con 0x7fe5e4103400 2024-09-21T11:46:02.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5eb959640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e410ec70 con 0x7fe5e4102ae0 2024-09-21T11:46:02.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5e8ef4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 0x7fe5e419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:02.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5e8ef4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 0x7fe5e419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47178/0 (socket says 172.21.15.118:47178) 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5e8ef4640 1 -- 172.21.15.118:0/3158959875 learned_addr learned my addr 172.21.15.118:0/3158959875 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.555+0000 7fe5e96f5640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5e4102ae0 0x7fe5e419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.556+0000 7fe5e8ef4640 1 -- 172.21.15.118:0/3158959875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5e4102ae0 msgr2=0x7fe5e419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.556+0000 7fe5e8ef4640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5e4102ae0 0x7fe5e419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.556+0000 7fe5e8ef4640 1 -- 172.21.15.118:0/3158959875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e4197800 con 0x7fe5e4103400 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.556+0000 7fe5e8ef4640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 0x7fe5e419dbc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0031460 tx=0x7fe5e0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.556+0000 7fe5da7fc640 1 -- 172.21.15.118:0/3158959875 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe5e003f070 con 0x7fe5e4103400 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.556+0000 7fe5da7fc640 1 -- 172.21.15.118:0/3158959875 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5e0004a90 con 0x7fe5e4103400 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.556+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e4197a90 con 0x7fe5e4103400 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.556+0000 7fe5da7fc640 1 -- 172.21.15.118:0/3158959875 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe5e0035030 con 0x7fe5e4103400 2024-09-21T11:46:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.556+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e4197fc0 con 0x7fe5e4103400 2024-09-21T11:46:02.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.557+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e406abe0 con 0x7fe5e4103400 2024-09-21T11:46:02.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.558+0000 7fe5da7fc640 1 -- 172.21.15.118:0/3158959875 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe5e0042070 con 0x7fe5e4103400 2024-09-21T11:46:02.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.559+0000 7fe5da7fc640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe5d007af90 0x7fe5d007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:02.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.559+0000 7fe5e96f5640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe5d007af90 0x7fe5d007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:02.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.559+0000 7fe5da7fc640 1 -- 172.21.15.118:0/3158959875 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fe5e00be9d0 con 0x7fe5e4103400 2024-09-21T11:46:02.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.559+0000 7fe5e96f5640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe5d007af90 0x7fe5d007d450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400bbe0 tx=0x7fe5d400b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:02.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.563+0000 7fe5da7fc640 1 -- 172.21.15.118:0/3158959875 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5e008a050 con 0x7fe5e4103400 2024-09-21T11:46:02.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.817+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe5e4198d30 con 0x7fe5e4103400 2024-09-21T11:46:02.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.818+0000 7fe5da7fc640 1 -- 172.21.15.118:0/3158959875 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fe5e008c570 con 0x7fe5e4103400 2024-09-21T11:46:02.819 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:46:02.820 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:46:02.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:46:02.821 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:46:02.821 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 7, 2024-09-21T11:46:02.821 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 7 2024-09-21T11:46:02.821 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:46:02.821 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:46:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe5d007af90 msgr2=0x7fe5d007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe5d007af90 0x7fe5d007d450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400bbe0 tx=0x7fe5d400b390 comp rx=0 tx=0).stop 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 msgr2=0x7fe5e419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 0x7fe5e419dbc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0031460 tx=0x7fe5e0004530 comp rx=0 tx=0).stop 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 shutdown_connections 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe5d007af90 0x7fe5d007d450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e4103400 0x7fe5e419dbc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 --2- 172.21.15.118:0/3158959875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5e4102ae0 0x7fe5e419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 >> 172.21.15.118:0/3158959875 conn(0x7fe5e40fc520 msgr2=0x7fe5e4108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 shutdown_connections 2024-09-21T11:46:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.820+0000 7fe5eb959640 1 -- 172.21.15.118:0/3158959875 wait complete. 2024-09-21T11:46:02.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.901+0000 7fb2db1ea640 1 -- 172.21.15.118:0/3520770274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4102b40 msgr2=0x7fb2d4102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.901+0000 7fb2db1ea640 1 --2- 172.21.15.118:0/3520770274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4102b40 0x7fb2d4102f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0098b0 tx=0x7fb2bc02a560 comp rx=0 tx=0).stop 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.901+0000 7fb2db1ea640 1 -- 172.21.15.118:0/3520770274 shutdown_connections 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.901+0000 7fb2db1ea640 1 --2- 172.21.15.118:0/3520770274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d4103460 0x7fb2d410b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.901+0000 7fb2db1ea640 1 --2- 172.21.15.118:0/3520770274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4102b40 0x7fb2d4102f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.901+0000 7fb2db1ea640 1 -- 172.21.15.118:0/3520770274 >> 172.21.15.118:0/3520770274 conn(0x7fb2d40fc520 msgr2=0x7fb2d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2db1ea640 1 -- 172.21.15.118:0/3520770274 shutdown_connections 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2db1ea640 1 -- 172.21.15.118:0/3520770274 wait complete. 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2db1ea640 1 Processor -- start 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2db1ea640 1 -- start start 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2db1ea640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d4102b40 0x7fb2d419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2db1ea640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4103460 0x7fb2d419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2db1ea640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d410ee10 con 0x7fb2d4103460 2024-09-21T11:46:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2db1ea640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d410ec90 con 0x7fb2d4102b40 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2d3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4103460 0x7fb2d419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2d3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4103460 0x7fb2d419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47196/0 (socket says 172.21.15.118:47196) 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2d3fff640 1 -- 172.21.15.118:0/4136881555 learned_addr learned my addr 172.21.15.118:0/4136881555 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.902+0000 7fb2d8f86640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d4102b40 0x7fb2d419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.903+0000 7fb2d3fff640 1 -- 172.21.15.118:0/4136881555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d4102b40 msgr2=0x7fb2d419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.903+0000 7fb2d3fff640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d4102b40 0x7fb2d419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.903+0000 7fb2d3fff640 1 -- 172.21.15.118:0/4136881555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d4197840 con 0x7fb2d4103460 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.903+0000 7fb2d3fff640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4103460 0x7fb2d419dc00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400ea00 tx=0x7fb2c400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.903+0000 7fb2d1ffb640 1 -- 172.21.15.118:0/4136881555 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2c400cb80 con 0x7fb2d4103460 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.903+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d4197b30 con 0x7fb2d4103460 2024-09-21T11:46:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.903+0000 7fb2d1ffb640 1 -- 172.21.15.118:0/4136881555 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2c400cd20 con 0x7fb2d4103460 2024-09-21T11:46:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.903+0000 7fb2d1ffb640 1 -- 172.21.15.118:0/4136881555 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2c4011470 con 0x7fb2d4103460 2024-09-21T11:46:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.903+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d41980c0 con 0x7fb2d4103460 2024-09-21T11:46:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.904+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d406ab80 con 0x7fb2d4103460 2024-09-21T11:46:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.905+0000 7fb2d1ffb640 1 -- 172.21.15.118:0/4136881555 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb2c4005020 con 0x7fb2d4103460 2024-09-21T11:46:02.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.905+0000 7fb2d1ffb640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2c007af30 0x7fb2c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:02.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.905+0000 7fb2d1ffb640 1 -- 172.21.15.118:0/4136881555 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fb2c409e410 con 0x7fb2d4103460 2024-09-21T11:46:02.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.905+0000 7fb2d8f86640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2c007af30 0x7fb2c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:02.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.906+0000 7fb2d8f86640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2c007af30 0x7fb2c007d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc000c00 tx=0x7fb2bc031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:02.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:02.909+0000 7fb2d1ffb640 1 -- 172.21.15.118:0/4136881555 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2c4016030 con 0x7fb2d4103460 2024-09-21T11:46:03.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.123+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb2d4106010 con 0x7fb2d4103460 2024-09-21T11:46:03.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.124+0000 7fb2d1ffb640 1 -- 172.21.15.118:0/4136881555 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2032 (secure 0 0 0) 0x7fb2c4069a10 con 0x7fb2d4103460 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:e16 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 16 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:46:03.126 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 45 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=14556,1=14572} 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:46:03.127 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:46:03.128 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:46:03.129 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:46:03.129 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:46:03.129 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T11:46:03.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2c007af30 msgr2=0x7fb2c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2c007af30 0x7fb2c007d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc000c00 tx=0x7fb2bc031400 comp rx=0 tx=0).stop 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4103460 msgr2=0x7fb2d419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4103460 0x7fb2d419dc00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400ea00 tx=0x7fb2c400eec0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 shutdown_connections 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb2c007af30 0x7fb2c007d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2d4103460 0x7fb2d419dc00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 --2- 172.21.15.118:0/4136881555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d4102b40 0x7fb2d419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 >> 172.21.15.118:0/4136881555 conn(0x7fb2d40fc520 msgr2=0x7fb2d4103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 shutdown_connections 2024-09-21T11:46:03.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.126+0000 7fb2db1ea640 1 -- 172.21.15.118:0/4136881555 wait complete. 2024-09-21T11:46:03.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.208+0000 7f8026cba640 1 -- 172.21.15.118:0/1860128640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 msgr2=0x7f8020102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.208+0000 7f8026cba640 1 --2- 172.21.15.118:0/1860128640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 0x7f8020102ec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8014009880 tx=0x7f801402a530 comp rx=0 tx=0).stop 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.208+0000 7f8026cba640 1 -- 172.21.15.118:0/1860128640 shutdown_connections 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.208+0000 7f8026cba640 1 --2- 172.21.15.118:0/1860128640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8020103400 0x7f802010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.208+0000 7f8026cba640 1 --2- 172.21.15.118:0/1860128640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 0x7f8020102ec0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.208+0000 7f8026cba640 1 -- 172.21.15.118:0/1860128640 >> 172.21.15.118:0/1860128640 conn(0x7f80200fc520 msgr2=0x7f80200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.208+0000 7f8026cba640 1 -- 172.21.15.118:0/1860128640 shutdown_connections 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.208+0000 7f8026cba640 1 -- 172.21.15.118:0/1860128640 wait complete. 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f8026cba640 1 Processor -- start 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f8026cba640 1 -- start start 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f8026cba640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 0x7f802019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f8026cba640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8020103400 0x7f802019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f8026cba640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f802010edf0 con 0x7f8020102ae0 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f8026cba640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f802010ec70 con 0x7f8020103400 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f8024a56640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 0x7f802019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f8024a56640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 0x7f802019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47212/0 (socket says 172.21.15.118:47212) 2024-09-21T11:46:03.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f8024a56640 1 -- 172.21.15.118:0/3807347765 learned_addr learned my addr 172.21.15.118:0/3807347765 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.209+0000 7f801ffff640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8020103400 0x7f802019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.210+0000 7f8024a56640 1 -- 172.21.15.118:0/3807347765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8020103400 msgr2=0x7f802019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.210+0000 7f8024a56640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8020103400 0x7f802019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.210+0000 7f8024a56640 1 -- 172.21.15.118:0/3807347765 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80201977e0 con 0x7f8020102ae0 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.210+0000 7f8024a56640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 0x7f802019d660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8014031460 tx=0x7f80140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.210+0000 7f801dffb640 1 -- 172.21.15.118:0/3807347765 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f801403f070 con 0x7f8020102ae0 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.210+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8020197a70 con 0x7f8020102ae0 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.210+0000 7f801dffb640 1 -- 172.21.15.118:0/3807347765 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80140035f0 con 0x7f8020102ae0 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.210+0000 7f801dffb640 1 -- 172.21.15.118:0/3807347765 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8014035030 con 0x7f8020102ae0 2024-09-21T11:46:03.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.210+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8020197fa0 con 0x7f8020102ae0 2024-09-21T11:46:03.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.211+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802006abe0 con 0x7f8020102ae0 2024-09-21T11:46:03.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.212+0000 7f801dffb640 1 -- 172.21.15.118:0/3807347765 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8014042070 con 0x7f8020102ae0 2024-09-21T11:46:03.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.212+0000 7f801dffb640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f801007af30 0x7f801007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:03.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.212+0000 7f801dffb640 1 -- 172.21.15.118:0/3807347765 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f80140be970 con 0x7f8020102ae0 2024-09-21T11:46:03.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.212+0000 7f801ffff640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f801007af30 0x7f801007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:03.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.213+0000 7f801ffff640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f801007af30 0x7f801007d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8020108920 tx=0x7f800c00b2e0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:03.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.217+0000 7f801dffb640 1 -- 172.21.15.118:0/3807347765 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80140c0e20 con 0x7f8020102ae0 2024-09-21T11:46:03.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.407+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8020198250 con 0x7f801007af30 2024-09-21T11:46:03.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.409+0000 7f801dffb640 1 -- 172.21.15.118:0/3807347765 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8020198250 con 0x7f801007af30 2024-09-21T11:46:03.410 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:46:03.410 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:46:03.410 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:46:03.410 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:46:03.411 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:46:03.411 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:46:03.411 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:46:03.411 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:46:03.411 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:46:03.411 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "9/23 daemons upgraded", 2024-09-21T11:46:03.411 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T11:46:03.411 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:46:03.411 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:46:03.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f801007af30 msgr2=0x7f801007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f801007af30 0x7f801007d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8020108920 tx=0x7f800c00b2e0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 msgr2=0x7f802019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 0x7f802019d660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8014031460 tx=0x7f80140045e0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 shutdown_connections 2024-09-21T11:46:03.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8020103400 0x7f802019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f801007af30 0x7f801007d3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 --2- 172.21.15.118:0/3807347765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020102ae0 0x7f802019d660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 >> 172.21.15.118:0/3807347765 conn(0x7f80200fc520 msgr2=0x7f8020108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:03.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 shutdown_connections 2024-09-21T11:46:03.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.411+0000 7f8026cba640 1 -- 172.21.15.118:0/3807347765 wait complete. 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 -- 172.21.15.118:0/3118364165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 msgr2=0x7fc390106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 --2- 172.21.15.118:0/3118364165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 0x7fc390106c00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009880 tx=0x7fc38c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 -- 172.21.15.118:0/3118364165 shutdown_connections 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 --2- 172.21.15.118:0/3118364165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc390100820 0x7fc390100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 --2- 172.21.15.118:0/3118364165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 0x7fc390106c00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 -- 172.21.15.118:0/3118364165 >> 172.21.15.118:0/3118364165 conn(0x7fc3900fc520 msgr2=0x7fc3900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 -- 172.21.15.118:0/3118364165 shutdown_connections 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 -- 172.21.15.118:0/3118364165 wait complete. 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 Processor -- start 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.492+0000 7fc39772c640 1 -- start start 2024-09-21T11:46:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc39772c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc390100820 0x7fc3901965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc39772c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 0x7fc390196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc39772c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010dcd0 con 0x7fc390106820 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc39772c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010db50 con 0x7fc390100820 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc394cc7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 0x7fc390196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc394cc7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 0x7fc390196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47230/0 (socket says 172.21.15.118:47230) 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc394cc7640 1 -- 172.21.15.118:0/4056565114 learned_addr learned my addr 172.21.15.118:0/4056565114 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc3954c8640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc390100820 0x7fc3901965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc394cc7640 1 -- 172.21.15.118:0/4056565114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc390100820 msgr2=0x7fc3901965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc394cc7640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc390100820 0x7fc3901965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc394cc7640 1 -- 172.21.15.118:0/4056565114 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc390197050 con 0x7fc390106820 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc3954c8640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc390100820 0x7fc3901965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc394cc7640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 0x7fc390196b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc38000d8d0 tx=0x7fc38000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:03.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc3867fc640 1 -- 172.21.15.118:0/4056565114 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc380017070 con 0x7fc390106820 2024-09-21T11:46:03.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc3867fc640 1 -- 172.21.15.118:0/4056565114 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc380010460 con 0x7fc390106820 2024-09-21T11:46:03.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc390197340 con 0x7fc390106820 2024-09-21T11:46:03.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc3867fc640 1 -- 172.21.15.118:0/4056565114 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc38000f5f0 con 0x7fc390106820 2024-09-21T11:46:03.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.493+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3901a3e10 con 0x7fc390106820 2024-09-21T11:46:03.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.494+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc390101f60 con 0x7fc390106820 2024-09-21T11:46:03.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.495+0000 7fc3867fc640 1 -- 172.21.15.118:0/4056565114 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc380009a30 con 0x7fc390106820 2024-09-21T11:46:03.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.495+0000 7fc3867fc640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc37c07af30 0x7fc37c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:03.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.496+0000 7fc3954c8640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc37c07af30 0x7fc37c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:03.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.496+0000 7fc3867fc640 1 -- 172.21.15.118:0/4056565114 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fc38009ded0 con 0x7fc390106820 2024-09-21T11:46:03.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.496+0000 7fc3954c8640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc37c07af30 0x7fc37c07d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc38c000c00 tx=0x7fc38c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:03.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.500+0000 7fc3867fc640 1 -- 172.21.15.118:0/4056565114 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3800694d0 con 0x7fc390106820 2024-09-21T11:46:03.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.746+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc390103a30 con 0x7fc390106820 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: pgmap v197: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: Upgrade: Updating osd.3 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: Deploying daemon osd.3 on smithi149 2024-09-21T11:46:03.748 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3158959875' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:03.749 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:03 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/4136881555' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:46:03.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.746+0000 7fc3867fc640 1 -- 172.21.15.118:0/4056565114 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fc38006e380 con 0x7fc390106820 2024-09-21T11:46:03.749 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:46:03.749 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:46:03.749 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:46:03.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc37c07af30 msgr2=0x7fc37c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc37c07af30 0x7fc37c07d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc38c000c00 tx=0x7fc38c031400 comp rx=0 tx=0).stop 2024-09-21T11:46:03.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 msgr2=0x7fc390196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:03.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 0x7fc390196b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc38000d8d0 tx=0x7fc38000dd90 comp rx=0 tx=0).stop 2024-09-21T11:46:03.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 shutdown_connections 2024-09-21T11:46:03.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc37c07af30 0x7fc37c07d3f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc390106820 0x7fc390196b10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 --2- 172.21.15.118:0/4056565114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc390100820 0x7fc3901965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:03.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 >> 172.21.15.118:0/4056565114 conn(0x7fc3900fc520 msgr2=0x7fc3900fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:03.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 shutdown_connections 2024-09-21T11:46:03.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:03.749+0000 7fc39772c640 1 -- 172.21.15.118:0/4056565114 wait complete. 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: pgmap v197: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: Upgrade: Updating osd.3 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: Deploying daemon osd.3 on smithi149 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3158959875' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:03.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:03 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/4136881555' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:46:04.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:04 smithi118 ceph-mon[111738]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:04.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:04 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/4056565114' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:46:04.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:04 smithi149 ceph-mon[79770]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:04.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:04 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/4056565114' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:46:05.602 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:05 smithi149 systemd[1]: Stopping Ceph osd.3 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:46:05.602 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:05 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[42055]: 2024-09-21T11:46:05.570+0000 7f8ef3b72640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T11:46:05.602 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:05 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[42055]: 2024-09-21T11:46:05.570+0000 7f8ef3b72640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-21T11:46:05.602 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:05 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[42055]: 2024-09-21T11:46:05.570+0000 7f8ef3b72640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T11:46:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:05 smithi149 ceph-mon[79770]: pgmap v198: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:46:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:05 smithi149 ceph-mon[79770]: osd.3 marked itself down and dead 2024-09-21T11:46:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:05 smithi118 ceph-mon[111738]: pgmap v198: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:46:06.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:05 smithi118 ceph-mon[111738]: osd.3 marked itself down and dead 2024-09-21T11:46:06.623 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:06 smithi149 ceph-mon[79770]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:46:06.623 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:06 smithi149 ceph-mon[79770]: osdmap e63: 6 total, 5 up, 6 in 2024-09-21T11:46:06.623 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:06 smithi149 podman[87632]: 2024-09-21 11:46:06.356355705 +0000 UTC m=+0.878664232 container died ef02e30965bf24d7083b104b83b397f0ca3de730bd962245236268391eccd6eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b) 2024-09-21T11:46:06.856 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:06 smithi118 ceph-mon[111738]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:46:06.856 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:06 smithi118 ceph-mon[111738]: osdmap e63: 6 total, 5 up, 6 in 2024-09-21T11:46:06.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:06 smithi149 podman[87632]: 2024-09-21 11:46:06.83780054 +0000 UTC m=+1.360109056 container cleanup ef02e30965bf24d7083b104b83b397f0ca3de730bd962245236268391eccd6eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-4e45e6b) 2024-09-21T11:46:06.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:06 smithi149 bash[87632]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3 2024-09-21T11:46:07.450 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:07 smithi149 podman[87650]: 2024-09-21 11:46:07.105636086 +0000 UTC m=+0.746349728 container remove ef02e30965bf24d7083b104b83b397f0ca3de730bd962245236268391eccd6eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T11:46:07.787 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:07 smithi149 ceph-mon[79770]: pgmap v200: 65 pgs: 16 stale+active+clean, 49 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:07.787 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:07 smithi149 ceph-mon[79770]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T11:46:07.787 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:07 smithi149 podman[87741]: 2024-09-21 11:46:07.45699521 +0000 UTC m=+0.112936658 container create 308765c8ec23081f49d28d74c3f9066c59252b8428cf360d68adf8d402990e46 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T11:46:07.787 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:07 smithi149 podman[87741]: 2024-09-21 11:46:07.360043011 +0000 UTC m=+0.015984474 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:46:07.787 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:07 smithi149 podman[87741]: 2024-09-21 11:46:07.70268199 +0000 UTC m=+0.358623445 container init 308765c8ec23081f49d28d74c3f9066c59252b8428cf360d68adf8d402990e46 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T11:46:07.787 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:07 smithi149 podman[87741]: 2024-09-21 11:46:07.70636991 +0000 UTC m=+0.362311358 container start 308765c8ec23081f49d28d74c3f9066c59252b8428cf360d68adf8d402990e46 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T11:46:07.787 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:07 smithi149 podman[87741]: 2024-09-21 11:46:07.785789169 +0000 UTC m=+0.441730633 container attach 308765c8ec23081f49d28d74c3f9066c59252b8428cf360d68adf8d402990e46 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T11:46:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:07 smithi118 ceph-mon[111738]: pgmap v200: 65 pgs: 16 stale+active+clean, 49 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:07 smithi118 ceph-mon[111738]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T11:46:08.199 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:07 smithi149 podman[87741]: 2024-09-21 11:46:07.906463771 +0000 UTC m=+0.562405231 container died 308765c8ec23081f49d28d74c3f9066c59252b8428cf360d68adf8d402990e46 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T11:46:08.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:08 smithi149 ceph-mon[79770]: Health check failed: Degraded data redundancy: 18/312 objects degraded (5.769%), 6 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:08.944 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:08 smithi149 podman[87764]: 2024-09-21 11:46:08.490364201 +0000 UTC m=+0.573685825 container remove 308765c8ec23081f49d28d74c3f9066c59252b8428cf360d68adf8d402990e46 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T11:46:08.944 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:08 smithi149 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-21T11:46:08.945 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:08 smithi149 systemd[1]: Stopped Ceph osd.3 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:46:08.945 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:08 smithi149 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.3.service: Consumed 1min 9.882s CPU time. 2024-09-21T11:46:08.945 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:08 smithi149 systemd[1]: Starting Ceph osd.3 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:46:09.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:08 smithi118 ceph-mon[111738]: Health check failed: Degraded data redundancy: 18/312 objects degraded (5.769%), 6 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:09.199 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:08 smithi149 podman[87864]: 2024-09-21 11:46:08.845398161 +0000 UTC m=+0.016070781 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:46:09.200 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:08 smithi149 podman[87864]: 2024-09-21 11:46:08.969817327 +0000 UTC m=+0.140489943 container create b69d89921f6891e4ef3d1889f090acd2996d4d91176988a152afdd5eca5cd903 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T11:46:09.657 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:09 smithi149 podman[87864]: 2024-09-21 11:46:09.210902745 +0000 UTC m=+0.381575373 container init b69d89921f6891e4ef3d1889f090acd2996d4d91176988a152afdd5eca5cd903 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T11:46:09.657 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:09 smithi149 podman[87864]: 2024-09-21 11:46:09.214443696 +0000 UTC m=+0.385116318 container start b69d89921f6891e4ef3d1889f090acd2996d4d91176988a152afdd5eca5cd903 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T11:46:09.658 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:09 smithi149 podman[87864]: 2024-09-21 11:46:09.302546525 +0000 UTC m=+0.473219144 container attach b69d89921f6891e4ef3d1889f090acd2996d4d91176988a152afdd5eca5cd903 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T11:46:09.658 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:09 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:09.658 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:09 smithi149 bash[87864]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:09.658 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:09 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:09.658 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:09 smithi149 bash[87864]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:09 smithi149 ceph-mon[79770]: pgmap v202: 65 pgs: 3 active+undersized, 14 stale+active+clean, 6 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 18/312 objects degraded (5.769%) 2024-09-21T11:46:10.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:09 smithi118 ceph-mon[111738]: pgmap v202: 65 pgs: 3 active+undersized, 14 stale+active+clean, 6 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 18/312 objects degraded (5.769%) 2024-09-21T11:46:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:11 smithi149 ceph-mon[79770]: pgmap v203: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:11 smithi118 ceph-mon[111738]: pgmap v203: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:12.446 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:46:12.446 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:12.446 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:46:12.446 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:12.446 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:12.446 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:12.446 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T11:46:12.446 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T11:46:12.447 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-21T11:46:12.447 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-21T11:46:12.447 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T11:46:12.447 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T11:46:12.700 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-21T11:46:12.700 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-21T11:46:12.700 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T11:46:12.700 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T11:46:12.700 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T11:46:12.700 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T11:46:12.700 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate[87879]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-21T11:46:12.700 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 bash[87864]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-21T11:46:12.700 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:12 smithi149 podman[87864]: 2024-09-21 11:46:12.474042404 +0000 UTC m=+3.644715022 container died b69d89921f6891e4ef3d1889f090acd2996d4d91176988a152afdd5eca5cd903 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T11:46:13.449 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:13 smithi149 podman[88087]: 2024-09-21 11:46:13.114730832 +0000 UTC m=+0.630587222 container remove b69d89921f6891e4ef3d1889f090acd2996d4d91176988a152afdd5eca5cd903 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T11:46:13.449 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:13 smithi149 podman[88148]: 2024-09-21 11:46:13.234247835 +0000 UTC m=+0.016217204 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:46:13.449 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:13 smithi149 podman[88148]: 2024-09-21 11:46:13.340570428 +0000 UTC m=+0.122539782 container create fce4c8099aefa27e7d0a4cf91a85d23ddb9b543e38f78345bace0ea5bb7eaaac (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T11:46:13.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:13 smithi149 ceph-mon[79770]: pgmap v204: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:13.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:13 smithi149 podman[88148]: 2024-09-21 11:46:13.560004273 +0000 UTC m=+0.341973633 container init fce4c8099aefa27e7d0a4cf91a85d23ddb9b543e38f78345bace0ea5bb7eaaac (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T11:46:13.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:13 smithi149 podman[88148]: 2024-09-21 11:46:13.563672727 +0000 UTC m=+0.345642083 container start fce4c8099aefa27e7d0a4cf91a85d23ddb9b543e38f78345bace0ea5bb7eaaac (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T11:46:13.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:13 smithi149 ceph-osd[88166]: -- 172.21.15.149:0/950698974 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d87bd4e1e0 con 0x55d87af43c00 2024-09-21T11:46:13.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:13 smithi149 bash[88148]: fce4c8099aefa27e7d0a4cf91a85d23ddb9b543e38f78345bace0ea5bb7eaaac 2024-09-21T11:46:13.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:13 smithi149 systemd[1]: Started Ceph osd.3 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:46:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:13 smithi118 ceph-mon[111738]: pgmap v204: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:14.999 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:14 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:14.999 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:14 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:14.999 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:14 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:46:14.999 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:14 smithi149 ceph-mon[79770]: pgmap v205: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:14 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:14 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:14 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:46:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:14 smithi118 ceph-mon[111738]: pgmap v205: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:15.450 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:15 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[88162]: 2024-09-21T11:46:15.195+0000 7f03a0289640 -1 Falling back to public interface 2024-09-21T11:46:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:17 smithi149 ceph-mon[79770]: pgmap v206: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:17 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:17 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:17 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 66/312 objects degraded (21.154%), 19 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:17 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:17 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:17 smithi118 ceph-mon[111738]: pgmap v206: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:17 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:17 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:17.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:17 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 66/312 objects degraded (21.154%), 19 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:17.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:17 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:17.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:17 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:19 smithi118 ceph-mon[111738]: pgmap v207: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:19.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:19 smithi149 ceph-mon[79770]: pgmap v207: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:21.199 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[88162]: 2024-09-21T11:46:20.997+0000 7f03a0289640 -1 osd.3 62 log_to_monitors true 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: pgmap v208: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:46:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:21.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:21.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:21.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T11:46:21.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T11:46:21.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:20 smithi149 ceph-mon[79770]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T11:46:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:46:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: pgmap v208: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T11:46:21.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:20 smithi118 ceph-mon[111738]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T11:46:22.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:21 smithi149 ceph-mon[79770]: from='osd.3 [v2:172.21.15.149:6800/2680272140,v1:172.21.15.149:6801/2680272140]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T11:46:22.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:21 smithi149 ceph-mon[79770]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T11:46:22.200 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 11:46:21 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[88162]: 2024-09-21T11:46:21.965+0000 7f039402b640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:46:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:21 smithi118 ceph-mon[111738]: from='osd.3 [v2:172.21.15.149:6800/2680272140,v1:172.21.15.149:6801/2680272140]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T11:46:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:21 smithi118 ceph-mon[111738]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T11:46:23.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:22 smithi118 ceph-mon[111738]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T11:46:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:22 smithi118 ceph-mon[111738]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T11:46:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:22 smithi118 ceph-mon[111738]: from='osd.3 [v2:172.21.15.149:6800/2680272140,v1:172.21.15.149:6801/2680272140]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:46:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:22 smithi118 ceph-mon[111738]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:46:23.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:22 smithi118 ceph-mon[111738]: pgmap v210: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:22 smithi149 ceph-mon[79770]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T11:46:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:22 smithi149 ceph-mon[79770]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T11:46:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:22 smithi149 ceph-mon[79770]: from='osd.3 [v2:172.21.15.149:6800/2680272140,v1:172.21.15.149:6801/2680272140]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:46:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:22 smithi149 ceph-mon[79770]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:46:23.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:22 smithi149 ceph-mon[79770]: pgmap v210: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:23 smithi118 ceph-mon[111738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:46:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:23 smithi118 ceph-mon[111738]: osd.3 [v2:172.21.15.149:6800/2680272140,v1:172.21.15.149:6801/2680272140] boot 2024-09-21T11:46:24.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:23 smithi118 ceph-mon[111738]: osdmap e66: 6 total, 6 up, 6 in 2024-09-21T11:46:24.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:23 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T11:46:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:23 smithi149 ceph-mon[79770]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:46:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:23 smithi149 ceph-mon[79770]: osd.3 [v2:172.21.15.149:6800/2680272140,v1:172.21.15.149:6801/2680272140] boot 2024-09-21T11:46:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:23 smithi149 ceph-mon[79770]: osdmap e66: 6 total, 6 up, 6 in 2024-09-21T11:46:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:23 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T11:46:25.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:24 smithi118 ceph-mon[111738]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T11:46:25.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:24 smithi118 ceph-mon[111738]: pgmap v213: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:25.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:24 smithi149 ceph-mon[79770]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T11:46:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:24 smithi149 ceph-mon[79770]: pgmap v213: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-21T11:46:26.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:26 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 50/312 objects degraded (16.026%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:26 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 50/312 objects degraded (16.026%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:27.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:27 smithi149 ceph-mon[79770]: pgmap v214: 65 pgs: 9 active+undersized, 14 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 50/312 objects degraded (16.026%) 2024-09-21T11:46:27.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:27 smithi118 ceph-mon[111738]: pgmap v214: 65 pgs: 9 active+undersized, 14 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 50/312 objects degraded (16.026%) 2024-09-21T11:46:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:28 smithi149 ceph-mon[79770]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/312 objects degraded (16.026%), 14 pgs degraded) 2024-09-21T11:46:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:28 smithi118 ceph-mon[111738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/312 objects degraded (16.026%), 14 pgs degraded) 2024-09-21T11:46:29.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:29 smithi149 ceph-mon[79770]: pgmap v215: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:29 smithi118 ceph-mon[111738]: pgmap v215: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:31.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:31 smithi149 ceph-mon[79770]: pgmap v216: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:31 smithi118 ceph-mon[111738]: pgmap v216: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:33.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:33 smithi149 ceph-mon[79770]: pgmap v217: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:33 smithi118 ceph-mon[111738]: pgmap v217: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.840+0000 7f0b5896e640 1 -- 172.21.15.118:0/2961427352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54103460 msgr2=0x7f0b5410b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.840+0000 7f0b5896e640 1 --2- 172.21.15.118:0/2961427352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54103460 0x7f0b5410b950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0098b0 tx=0x7f0b3c02a560 comp rx=0 tx=0).stop 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.840+0000 7f0b5896e640 1 -- 172.21.15.118:0/2961427352 shutdown_connections 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.840+0000 7f0b5896e640 1 --2- 172.21.15.118:0/2961427352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54103460 0x7f0b5410b950 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.840+0000 7f0b5896e640 1 --2- 172.21.15.118:0/2961427352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b54102b40 0x7f0b54102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.840+0000 7f0b5896e640 1 -- 172.21.15.118:0/2961427352 >> 172.21.15.118:0/2961427352 conn(0x7f0b540fc520 msgr2=0x7f0b540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.840+0000 7f0b5896e640 1 -- 172.21.15.118:0/2961427352 shutdown_connections 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.840+0000 7f0b5896e640 1 -- 172.21.15.118:0/2961427352 wait complete. 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.841+0000 7f0b5896e640 1 Processor -- start 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.841+0000 7f0b5896e640 1 -- start start 2024-09-21T11:46:33.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.841+0000 7f0b5896e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54102b40 0x7f0b541007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:33.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.841+0000 7f0b5896e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b54103460 0x7f0b54100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:33.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b5896e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410ee10 con 0x7f0b54102b40 2024-09-21T11:46:33.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b5896e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410ec90 con 0x7f0b54103460 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b5259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54102b40 0x7f0b541007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b5259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54102b40 0x7f0b541007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52224/0 (socket says 172.21.15.118:52224) 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b5259c640 1 -- 172.21.15.118:0/854441253 learned_addr learned my addr 172.21.15.118:0/854441253 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b49d9b640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b54103460 0x7f0b54100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b5259c640 1 -- 172.21.15.118:0/854441253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b54103460 msgr2=0x7f0b54100ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b5259c640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b54103460 0x7f0b54100ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b5259c640 1 -- 172.21.15.118:0/854441253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b54101220 con 0x7f0b54102b40 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.842+0000 7f0b5259c640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54102b40 0x7f0b541007a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400c8f0 tx=0x7f0b4400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.843+0000 7f0b4bfff640 1 -- 172.21.15.118:0/854441253 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b440079b0 con 0x7f0b54102b40 2024-09-21T11:46:33.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.843+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b54101510 con 0x7f0b54102b40 2024-09-21T11:46:33.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.843+0000 7f0b4bfff640 1 -- 172.21.15.118:0/854441253 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b440054e0 con 0x7f0b54102b40 2024-09-21T11:46:33.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.843+0000 7f0b4bfff640 1 -- 172.21.15.118:0/854441253 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b44004dd0 con 0x7f0b54102b40 2024-09-21T11:46:33.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.843+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b541a3f20 con 0x7f0b54102b40 2024-09-21T11:46:33.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.844+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5406ab80 con 0x7f0b54102b40 2024-09-21T11:46:33.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.845+0000 7f0b4bfff640 1 -- 172.21.15.118:0/854441253 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0b44005020 con 0x7f0b54102b40 2024-09-21T11:46:33.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.845+0000 7f0b4bfff640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b4007aed0 0x7f0b4007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:33.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.845+0000 7f0b4bfff640 1 -- 172.21.15.118:0/854441253 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f0b4409df20 con 0x7f0b54102b40 2024-09-21T11:46:33.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.845+0000 7f0b49d9b640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b4007aed0 0x7f0b4007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:33.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.846+0000 7f0b49d9b640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b4007aed0 0x7f0b4007d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c000c00 tx=0x7f0b3c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:33.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:33.850+0000 7f0b4bfff640 1 -- 172.21.15.118:0/854441253 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b44014030 con 0x7f0b54102b40 2024-09-21T11:46:34.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.042+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0b54062630 con 0x7f0b4007aed0 2024-09-21T11:46:34.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.044+0000 7f0b4bfff640 1 -- 172.21.15.118:0/854441253 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f0b54062630 con 0x7f0b4007aed0 2024-09-21T11:46:34.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b4007aed0 msgr2=0x7f0b4007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b4007aed0 0x7f0b4007d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c000c00 tx=0x7f0b3c031400 comp rx=0 tx=0).stop 2024-09-21T11:46:34.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54102b40 msgr2=0x7f0b541007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54102b40 0x7f0b541007a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400c8f0 tx=0x7f0b4400cdb0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 shutdown_connections 2024-09-21T11:46:34.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b54103460 0x7f0b54100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b4007aed0 0x7f0b4007d390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 --2- 172.21.15.118:0/854441253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b54102b40 0x7f0b541007a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 >> 172.21.15.118:0/854441253 conn(0x7f0b540fc520 msgr2=0x7f0b54103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:34.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 shutdown_connections 2024-09-21T11:46:34.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.046+0000 7f0b5896e640 1 -- 172.21.15.118:0/854441253 wait complete. 2024-09-21T11:46:34.057 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:46:34.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.128+0000 7f308bc84640 1 -- 172.21.15.118:0/1385110078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 msgr2=0x7f308410b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.128+0000 7f308bc84640 1 --2- 172.21.15.118:0/1385110078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 0x7f308410b950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f30800098b0 tx=0x7f308002a560 comp rx=0 tx=0).stop 2024-09-21T11:46:34.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.128+0000 7f308bc84640 1 -- 172.21.15.118:0/1385110078 shutdown_connections 2024-09-21T11:46:34.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.128+0000 7f308bc84640 1 --2- 172.21.15.118:0/1385110078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 0x7f308410b950 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.128+0000 7f308bc84640 1 --2- 172.21.15.118:0/1385110078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3084102b40 0x7f3084102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.128+0000 7f308bc84640 1 -- 172.21.15.118:0/1385110078 >> 172.21.15.118:0/1385110078 conn(0x7f30840fc520 msgr2=0x7f30840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:34.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.128+0000 7f308bc84640 1 -- 172.21.15.118:0/1385110078 shutdown_connections 2024-09-21T11:46:34.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.128+0000 7f308bc84640 1 -- 172.21.15.118:0/1385110078 wait complete. 2024-09-21T11:46:34.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308bc84640 1 Processor -- start 2024-09-21T11:46:34.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308bc84640 1 -- start start 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308bc84640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3084102b40 0x7f308419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308bc84640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 0x7f308419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308bc84640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f308410ee10 con 0x7f3084103460 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308bc84640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f308410ec90 con 0x7f3084102b40 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308921f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 0x7f308419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308921f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 0x7f308419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52244/0 (socket says 172.21.15.118:52244) 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308921f640 1 -- 172.21.15.118:0/2066587307 learned_addr learned my addr 172.21.15.118:0/2066587307 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f3089a20640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3084102b40 0x7f308419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308921f640 1 -- 172.21.15.118:0/2066587307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3084102b40 msgr2=0x7f308419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308921f640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3084102b40 0x7f308419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f308921f640 1 -- 172.21.15.118:0/2066587307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3084197880 con 0x7f3084103460 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.129+0000 7f3089a20640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3084102b40 0x7f308419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.130+0000 7f308921f640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 0x7f308419dc00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3080031460 tx=0x7f30800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.130+0000 7f307affd640 1 -- 172.21.15.118:0/2066587307 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f308003f070 con 0x7f3084103460 2024-09-21T11:46:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.130+0000 7f307affd640 1 -- 172.21.15.118:0/2066587307 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f30800044d0 con 0x7f3084103460 2024-09-21T11:46:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.130+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3084197b10 con 0x7f3084103460 2024-09-21T11:46:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.130+0000 7f307affd640 1 -- 172.21.15.118:0/2066587307 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3080035030 con 0x7f3084103460 2024-09-21T11:46:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.130+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3084198040 con 0x7f3084103460 2024-09-21T11:46:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.131+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f308406ab80 con 0x7f3084103460 2024-09-21T11:46:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.132+0000 7f307affd640 1 -- 172.21.15.118:0/2066587307 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3080042070 con 0x7f3084103460 2024-09-21T11:46:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.132+0000 7f307affd640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f307007af30 0x7f307007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.132+0000 7f3089a20640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f307007af30 0x7f307007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.132+0000 7f307affd640 1 -- 172.21.15.118:0/2066587307 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f30800bea70 con 0x7f3084103460 2024-09-21T11:46:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.133+0000 7f3089a20640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f307007af30 0x7f307007d3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3074005fd0 tx=0x7f3074005ea0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.137+0000 7f307affd640 1 -- 172.21.15.118:0/2066587307 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3080004cf0 con 0x7f3084103460 2024-09-21T11:46:34.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.333+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3084106040 con 0x7f307007af30 2024-09-21T11:46:34.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.334+0000 7f307affd640 1 -- 172.21.15.118:0/2066587307 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f307400eb20 con 0x7f307007af30 2024-09-21T11:46:34.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.336+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f307007af30 msgr2=0x7f307007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.336+0000 7f308bc84640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f307007af30 0x7f307007d3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3074005fd0 tx=0x7f3074005ea0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.336+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 msgr2=0x7f308419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.336+0000 7f308bc84640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 0x7f308419dc00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3080031460 tx=0x7f30800048f0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.337+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 shutdown_connections 2024-09-21T11:46:34.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.337+0000 7f308bc84640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f307007af30 0x7f307007d3f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.337+0000 7f308bc84640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3084103460 0x7f308419dc00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.337+0000 7f308bc84640 1 --2- 172.21.15.118:0/2066587307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3084102b40 0x7f308419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.337+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 >> 172.21.15.118:0/2066587307 conn(0x7f30840fc520 msgr2=0x7f3084103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:34.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.337+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 shutdown_connections 2024-09-21T11:46:34.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.337+0000 7f308bc84640 1 -- 172.21.15.118:0/2066587307 wait complete. 2024-09-21T11:46:34.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.420+0000 7fe1b0aad640 1 -- 172.21.15.118:0/1393472421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 msgr2=0x7fe1ac107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.420+0000 7fe1b0aad640 1 --2- 172.21.15.118:0/1393472421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 0x7fe1ac107d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009880 tx=0x7fe19c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.420+0000 7fe1b0aad640 1 -- 172.21.15.118:0/1393472421 shutdown_connections 2024-09-21T11:46:34.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.420+0000 7fe1b0aad640 1 --2- 172.21.15.118:0/1393472421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac101930 0x7fe1ac101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.420+0000 7fe1b0aad640 1 --2- 172.21.15.118:0/1393472421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 0x7fe1ac107d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.420+0000 7fe1b0aad640 1 -- 172.21.15.118:0/1393472421 >> 172.21.15.118:0/1393472421 conn(0x7fe1ac0fd630 msgr2=0x7fe1ac0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:34.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.420+0000 7fe1b0aad640 1 -- 172.21.15.118:0/1393472421 shutdown_connections 2024-09-21T11:46:34.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.420+0000 7fe1b0aad640 1 -- 172.21.15.118:0/1393472421 wait complete. 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.421+0000 7fe1b0aad640 1 Processor -- start 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.421+0000 7fe1b0aad640 1 -- start start 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.421+0000 7fe1b0aad640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac101930 0x7fe1ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.421+0000 7fe1b0aad640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 0x7fe1ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.421+0000 7fe1b0aad640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac10ede0 con 0x7fe1ac107930 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.421+0000 7fe1b0aad640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac10ec60 con 0x7fe1ac101930 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.421+0000 7fe1a9d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 0x7fe1ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.421+0000 7fe1a9d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 0x7fe1ac074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52252/0 (socket says 172.21.15.118:52252) 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.421+0000 7fe1a9d9b640 1 -- 172.21.15.118:0/800543299 learned_addr learned my addr 172.21.15.118:0/800543299 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe1aa59c640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac101930 0x7fe1ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:34.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe1a9d9b640 1 -- 172.21.15.118:0/800543299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac101930 msgr2=0x7fe1ac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe1a9d9b640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac101930 0x7fe1ac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe1a9d9b640 1 -- 172.21.15.118:0/800543299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac074f70 con 0x7fe1ac107930 2024-09-21T11:46:34.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe1a9d9b640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 0x7fe1ac074a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c8a0 tx=0x7fe1a000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:34.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe19b7fe640 1 -- 172.21.15.118:0/800543299 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1a00079b0 con 0x7fe1ac107930 2024-09-21T11:46:34.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe19b7fe640 1 -- 172.21.15.118:0/800543299 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1a0007b50 con 0x7fe1ac107930 2024-09-21T11:46:34.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ac075260 con 0x7fe1ac107930 2024-09-21T11:46:34.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe19b7fe640 1 -- 172.21.15.118:0/800543299 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1a0018700 con 0x7fe1ac107930 2024-09-21T11:46:34.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.422+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ac1a3df0 con 0x7fe1ac107930 2024-09-21T11:46:34.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.423+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ac103070 con 0x7fe1ac107930 2024-09-21T11:46:34.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.424+0000 7fe19b7fe640 1 -- 172.21.15.118:0/800543299 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe1a0007d00 con 0x7fe1ac107930 2024-09-21T11:46:34.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.424+0000 7fe19b7fe640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe19407af30 0x7fe19407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:34.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.425+0000 7fe1aa59c640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe19407af30 0x7fe19407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:34.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.425+0000 7fe19b7fe640 1 -- 172.21.15.118:0/800543299 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fe1a009e310 con 0x7fe1ac107930 2024-09-21T11:46:34.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.425+0000 7fe1aa59c640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe19407af30 0x7fe19407d3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe19c031460 tx=0x7fe19c005bd0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:34.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.429+0000 7fe19b7fe640 1 -- 172.21.15.118:0/800543299 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1a0014030 con 0x7fe1ac107930 2024-09-21T11:46:34.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.612+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe1ac104bb0 con 0x7fe19407af30 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.621+0000 7fe19b7fe640 1 -- 172.21.15.118:0/800543299 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe19c004340 con 0x7fe19407af30 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (4m) 52s ago 15m 20.0M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (7m) 52s ago 15m 8971k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (6m) 18s ago 14m 8535k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (2m) 52s ago 15m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (2m) 18s ago 14m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (4m) 52s ago 15m 81.6M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (10m) 52s ago 10m 147M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (10m) 52s ago 10m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:46:34.624 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (9m) 18s ago 9m 23.0M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (10m) 18s ago 10m 16.9M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (6m) 52s ago 16m 525M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (5m) 18s ago 14m 458M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (3m) 52s ago 17m 43.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (2m) 18s ago 14m 36.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (5m) 52s ago 15m 9.92M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (5m) 18s ago 14m 11.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (2m) 52s ago 13m 90.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (95s) 52s ago 12m 91.0M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (57s) 52s ago 12m 11.7M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (21s) 18s ago 12m 12.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (11m) 18s ago 11m 212M 4096M 19.1.1-373-g4e45e6b4 164465d2334a c8bc0c620dcc 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (11m) 18s ago 11m 208M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:46:34.625 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (4m) 52s ago 15m 54.2M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:46:34.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe19407af30 msgr2=0x7fe19407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe19407af30 0x7fe19407d3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe19c031460 tx=0x7fe19c005bd0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 msgr2=0x7fe1ac074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 0x7fe1ac074a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c8a0 tx=0x7fe1a000cd60 comp rx=0 tx=0).stop 2024-09-21T11:46:34.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 shutdown_connections 2024-09-21T11:46:34.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe19407af30 0x7fe19407d3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac107930 0x7fe1ac074a30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 --2- 172.21.15.118:0/800543299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1ac101930 0x7fe1ac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 >> 172.21.15.118:0/800543299 conn(0x7fe1ac0fd630 msgr2=0x7fe1ac0fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:34.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 shutdown_connections 2024-09-21T11:46:34.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.624+0000 7fe1b0aad640 1 -- 172.21.15.118:0/800543299 wait complete. 2024-09-21T11:46:34.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.705+0000 7fb9b5936640 1 -- 172.21.15.118:0/1073749812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 msgr2=0x7fb9b0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.705+0000 7fb9b5936640 1 --2- 172.21.15.118:0/1073749812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 0x7fb9b0106bc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009880 tx=0x7fb9a002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.705+0000 7fb9b5936640 1 -- 172.21.15.118:0/1073749812 shutdown_connections 2024-09-21T11:46:34.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.705+0000 7fb9b5936640 1 --2- 172.21.15.118:0/1073749812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9b01007e0 0x7fb9b0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.705+0000 7fb9b5936640 1 --2- 172.21.15.118:0/1073749812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 0x7fb9b0106bc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.705+0000 7fb9b5936640 1 -- 172.21.15.118:0/1073749812 >> 172.21.15.118:0/1073749812 conn(0x7fb9b00fc4c0 msgr2=0x7fb9b00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:34.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.706+0000 7fb9b5936640 1 -- 172.21.15.118:0/1073749812 shutdown_connections 2024-09-21T11:46:34.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.706+0000 7fb9b5936640 1 -- 172.21.15.118:0/1073749812 wait complete. 2024-09-21T11:46:34.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.706+0000 7fb9b5936640 1 Processor -- start 2024-09-21T11:46:34.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9b5936640 1 -- start start 2024-09-21T11:46:34.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9b5936640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9b01007e0 0x7fb9b019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:34.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9b5936640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 0x7fb9b019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:34.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9b5936640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b010dd10 con 0x7fb9b01067e0 2024-09-21T11:46:34.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9b5936640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b010db90 con 0x7fb9b01007e0 2024-09-21T11:46:34.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9a67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 0x7fb9b019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:34.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9a67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 0x7fb9b019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52262/0 (socket says 172.21.15.118:52262) 2024-09-21T11:46:34.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9a67fc640 1 -- 172.21.15.118:0/2189504561 learned_addr learned my addr 172.21.15.118:0/2189504561 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:34.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9aeffd640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9b01007e0 0x7fb9b019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:34.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9a67fc640 1 -- 172.21.15.118:0/2189504561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9b01007e0 msgr2=0x7fb9b019f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9a67fc640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9b01007e0 0x7fb9b019f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.707+0000 7fb9a67fc640 1 -- 172.21.15.118:0/2189504561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b0199a00 con 0x7fb9b01067e0 2024-09-21T11:46:34.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.708+0000 7fb9a67fc640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 0x7fb9b019fd80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb99800b420 tx=0x7fb99800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:34.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.708+0000 7fb9b4934640 1 -- 172.21.15.118:0/2189504561 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb998011630 con 0x7fb9b01067e0 2024-09-21T11:46:34.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.708+0000 7fb9b4934640 1 -- 172.21.15.118:0/2189504561 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb998016070 con 0x7fb9b01067e0 2024-09-21T11:46:34.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.708+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b0199cf0 con 0x7fb9b01067e0 2024-09-21T11:46:34.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.708+0000 7fb9b4934640 1 -- 172.21.15.118:0/2189504561 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb998010d40 con 0x7fb9b01067e0 2024-09-21T11:46:34.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.708+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b019a280 con 0x7fb9b01067e0 2024-09-21T11:46:34.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.709+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b0101f20 con 0x7fb9b01067e0 2024-09-21T11:46:34.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.710+0000 7fb9b4934640 1 -- 172.21.15.118:0/2189504561 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb99801b460 con 0x7fb9b01067e0 2024-09-21T11:46:34.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.710+0000 7fb9b4934640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99c07af30 0x7fb99c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:34.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.711+0000 7fb9b4934640 1 -- 172.21.15.118:0/2189504561 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fb99809d6c0 con 0x7fb9b01067e0 2024-09-21T11:46:34.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.711+0000 7fb9aeffd640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99c07af30 0x7fb99c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:34.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.711+0000 7fb9aeffd640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99c07af30 0x7fb99c07d3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0000c00 tx=0x7fb9a0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:34.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.714+0000 7fb9b4934640 1 -- 172.21.15.118:0/2189504561 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb998068cc0 con 0x7fb9b01067e0 2024-09-21T11:46:34.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.962+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb9b019b000 con 0x7fb9b01067e0 2024-09-21T11:46:34.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.963+0000 7fb9b4934640 1 -- 172.21.15.118:0/2189504561 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fb99806db70 con 0x7fb9b01067e0 2024-09-21T11:46:34.965 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:46:34.966 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:46:34.967 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6, 2024-09-21T11:46:34.967 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 8 2024-09-21T11:46:34.967 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:46:34.967 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:46:34.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99c07af30 msgr2=0x7fb99c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99c07af30 0x7fb99c07d3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0000c00 tx=0x7fb9a0031400 comp rx=0 tx=0).stop 2024-09-21T11:46:34.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 msgr2=0x7fb9b019fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:34.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 0x7fb9b019fd80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb99800b420 tx=0x7fb99800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 shutdown_connections 2024-09-21T11:46:34.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99c07af30 0x7fb99c07d3f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9b01067e0 0x7fb9b019fd80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 --2- 172.21.15.118:0/2189504561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9b01007e0 0x7fb9b019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:34.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 >> 172.21.15.118:0/2189504561 conn(0x7fb9b00fc4c0 msgr2=0x7fb9b0069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:34.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 shutdown_connections 2024-09-21T11:46:34.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:34.965+0000 7fb9b5936640 1 -- 172.21.15.118:0/2189504561 wait complete. 2024-09-21T11:46:35.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.047+0000 7fb91020d640 1 -- 172.21.15.118:0/3542383536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908100820 msgr2=0x7fb908100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.047+0000 7fb91020d640 1 --2- 172.21.15.118:0/3542383536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908100820 0x7fb908100c80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb904009880 tx=0x7fb90402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.047+0000 7fb91020d640 1 -- 172.21.15.118:0/3542383536 shutdown_connections 2024-09-21T11:46:35.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.047+0000 7fb91020d640 1 --2- 172.21.15.118:0/3542383536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908100820 0x7fb908100c80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.047+0000 7fb91020d640 1 --2- 172.21.15.118:0/3542383536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908106820 0x7fb908106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.047+0000 7fb91020d640 1 -- 172.21.15.118:0/3542383536 >> 172.21.15.118:0/3542383536 conn(0x7fb9080fc520 msgr2=0x7fb9080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:35.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.047+0000 7fb91020d640 1 -- 172.21.15.118:0/3542383536 shutdown_connections 2024-09-21T11:46:35.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.047+0000 7fb91020d640 1 -- 172.21.15.118:0/3542383536 wait complete. 2024-09-21T11:46:35.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb91020d640 1 Processor -- start 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb91020d640 1 -- start start 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb91020d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908100820 0x7fb9080fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb91020d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908106820 0x7fb9080fd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb91020d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb90810dd50 con 0x7fb908106820 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb91020d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb90810dbd0 con 0x7fb908100820 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb90d7a8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908106820 0x7fb9080fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb90d7a8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908106820 0x7fb9080fd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52288/0 (socket says 172.21.15.118:52288) 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb90d7a8640 1 -- 172.21.15.118:0/3749511911 learned_addr learned my addr 172.21.15.118:0/3749511911 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb90dfa9640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908100820 0x7fb9080fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb90d7a8640 1 -- 172.21.15.118:0/3749511911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908100820 msgr2=0x7fb9080fcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb90d7a8640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908100820 0x7fb9080fcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb90d7a8640 1 -- 172.21.15.118:0/3749511911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9080fd6a0 con 0x7fb908106820 2024-09-21T11:46:35.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.048+0000 7fb90dfa9640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908100820 0x7fb9080fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:46:35.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.049+0000 7fb90d7a8640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908106820 0x7fb9080fd160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb904031460 tx=0x7fb9040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:35.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.049+0000 7fb8faffd640 1 -- 172.21.15.118:0/3749511911 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb90403f070 con 0x7fb908106820 2024-09-21T11:46:35.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.049+0000 7fb8faffd640 1 -- 172.21.15.118:0/3749511911 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb904004cf0 con 0x7fb908106820 2024-09-21T11:46:35.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.049+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9080fd930 con 0x7fb908106820 2024-09-21T11:46:35.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.049+0000 7fb8faffd640 1 -- 172.21.15.118:0/3749511911 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb904035030 con 0x7fb908106820 2024-09-21T11:46:35.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.049+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9081a3e00 con 0x7fb908106820 2024-09-21T11:46:35.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.050+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb908101f60 con 0x7fb908106820 2024-09-21T11:46:35.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.051+0000 7fb8faffd640 1 -- 172.21.15.118:0/3749511911 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb904042070 con 0x7fb908106820 2024-09-21T11:46:35.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.051+0000 7fb8faffd640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb8f407af80 0x7fb8f407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:35.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.051+0000 7fb8faffd640 1 -- 172.21.15.118:0/3749511911 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fb9040be9e0 con 0x7fb908106820 2024-09-21T11:46:35.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.051+0000 7fb90dfa9640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb8f407af80 0x7fb8f407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:35.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.052+0000 7fb90dfa9640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb8f407af80 0x7fb8f407d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009930 tx=0x7fb8fc008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:35.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.055+0000 7fb8faffd640 1 -- 172.21.15.118:0/3749511911 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb90408a060 con 0x7fb908106820 2024-09-21T11:46:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.269+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb908109dc0 con 0x7fb908106820 2024-09-21T11:46:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.269+0000 7fb8faffd640 1 -- 172.21.15.118:0/3749511911 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2032 (secure 0 0 0) 0x7fb90408ef10 con 0x7fb908106820 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:e16 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 16 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:46:35.272 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 45 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=14556,1=14572} 2024-09-21T11:46:35.273 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:46:35.274 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:46:35.275 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:46:35.275 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:46:35.275 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:46:35.275 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:46:35.275 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb8f407af80 msgr2=0x7fb8f407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb8f407af80 0x7fb8f407d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009930 tx=0x7fb8fc008040 comp rx=0 tx=0).stop 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908106820 msgr2=0x7fb9080fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908106820 0x7fb9080fd160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb904031460 tx=0x7fb9040048f0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 shutdown_connections 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb8f407af80 0x7fb8f407d440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb908106820 0x7fb9080fd160 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 --2- 172.21.15.118:0/3749511911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908100820 0x7fb9080fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 >> 172.21.15.118:0/3749511911 conn(0x7fb9080fc520 msgr2=0x7fb90806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 shutdown_connections 2024-09-21T11:46:35.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.271+0000 7fb91020d640 1 -- 172.21.15.118:0/3749511911 wait complete. 2024-09-21T11:46:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.354+0000 7f8203c6f640 1 -- 172.21.15.118:0/865480778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 msgr2=0x7f81fc101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.354+0000 7f8203c6f640 1 --2- 172.21.15.118:0/865480778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 0x7f81fc101d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009880 tx=0x7f81f802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.354+0000 7f8203c6f640 1 -- 172.21.15.118:0/865480778 shutdown_connections 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.354+0000 7f8203c6f640 1 --2- 172.21.15.118:0/865480778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 0x7f81fc101d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.354+0000 7f8203c6f640 1 --2- 172.21.15.118:0/865480778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81fc107930 0x7f81fc107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.354+0000 7f8203c6f640 1 -- 172.21.15.118:0/865480778 >> 172.21.15.118:0/865480778 conn(0x7f81fc0fd630 msgr2=0x7f81fc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.354+0000 7f8203c6f640 1 -- 172.21.15.118:0/865480778 shutdown_connections 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.354+0000 7f8203c6f640 1 -- 172.21.15.118:0/865480778 wait complete. 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.354+0000 7f8203c6f640 1 Processor -- start 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8203c6f640 1 -- start start 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8203c6f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 0x7f81fc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8203c6f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81fc107930 0x7f81fc19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8203c6f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc10ede0 con 0x7f81fc101930 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8203c6f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc10ec60 con 0x7f81fc107930 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8201a0b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 0x7f81fc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8201a0b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 0x7f81fc19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52302/0 (socket says 172.21.15.118:52302) 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8201a0b640 1 -- 172.21.15.118:0/3346305245 learned_addr learned my addr 172.21.15.118:0/3346305245 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f820120a640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81fc107930 0x7f81fc19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8201a0b640 1 -- 172.21.15.118:0/3346305245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81fc107930 msgr2=0x7f81fc19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8201a0b640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81fc107930 0x7f81fc19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8201a0b640 1 -- 172.21.15.118:0/3346305245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc197850 con 0x7f81fc101930 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f820120a640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81fc107930 0x7f81fc19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8201a0b640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 0x7f81fc19d6d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c810 tx=0x7f81f000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f81eeffd640 1 -- 172.21.15.118:0/3346305245 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81f0004020 con 0x7f81fc101930 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f81eeffd640 1 -- 172.21.15.118:0/3346305245 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f81f00041c0 con 0x7f81fc101930 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc197b40 con 0x7f81fc101930 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.355+0000 7f81eeffd640 1 -- 172.21.15.118:0/3346305245 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81f00047a0 con 0x7f81fc101930 2024-09-21T11:46:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.356+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc1980d0 con 0x7f81fc101930 2024-09-21T11:46:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.357+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81fc103070 con 0x7f81fc101930 2024-09-21T11:46:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.357+0000 7f81eeffd640 1 -- 172.21.15.118:0/3346305245 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f81f00079b0 con 0x7f81fc101930 2024-09-21T11:46:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.358+0000 7f81eeffd640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81e807af30 0x7f81e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.358+0000 7f81eeffd640 1 -- 172.21.15.118:0/3346305245 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f81f009df00 con 0x7f81fc101930 2024-09-21T11:46:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.358+0000 7f820120a640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81e807af30 0x7f81e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.358+0000 7f820120a640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81e807af30 0x7f81e807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81f8031460 tx=0x7f81f80095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:35.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.362+0000 7f81eeffd640 1 -- 172.21.15.118:0/3346305245 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81f0014030 con 0x7f81fc101930 2024-09-21T11:46:35.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.556+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f81fc1983e0 con 0x7f81e807af30 2024-09-21T11:46:35.559 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:35 smithi118 ceph-mon[111738]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:35.559 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:35 smithi118 ceph-mon[111738]: pgmap v218: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:35.559 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:35 smithi118 ceph-mon[111738]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:35.559 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:35 smithi118 ceph-mon[111738]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:35.560 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:35.560 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:46:35.560 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:35 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2189504561' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:35.560 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:35.560 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:35 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3749511911' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:46:35.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.558+0000 7f81eeffd640 1 -- 172.21.15.118:0/3346305245 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f81fc1983e0 con 0x7f81e807af30 2024-09-21T11:46:35.560 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:46:35.560 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "10/23 daemons upgraded", 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:46:35.561 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:46:35.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81e807af30 msgr2=0x7f81e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81e807af30 0x7f81e807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81f8031460 tx=0x7f81f80095f0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 msgr2=0x7f81fc19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 0x7f81fc19d6d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c810 tx=0x7f81f000ccd0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 shutdown_connections 2024-09-21T11:46:35.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81fc107930 0x7f81fc19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81e807af30 0x7f81e807d3f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 --2- 172.21.15.118:0/3346305245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81fc101930 0x7f81fc19d6d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 >> 172.21.15.118:0/3346305245 conn(0x7f81fc0fd630 msgr2=0x7f81fc0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:35.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 shutdown_connections 2024-09-21T11:46:35.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.560+0000 7f8203c6f640 1 -- 172.21.15.118:0/3346305245 wait complete. 2024-09-21T11:46:35.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.644+0000 7f44c17cd640 1 -- 172.21.15.118:0/3824189484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc103420 msgr2=0x7f44bc10b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.644+0000 7f44c17cd640 1 --2- 172.21.15.118:0/3824189484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc103420 0x7f44bc10b910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f44b00098b0 tx=0x7f44b002a560 comp rx=0 tx=0).stop 2024-09-21T11:46:35.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.644+0000 7f44c17cd640 1 -- 172.21.15.118:0/3824189484 shutdown_connections 2024-09-21T11:46:35.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.644+0000 7f44c17cd640 1 --2- 172.21.15.118:0/3824189484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc103420 0x7f44bc10b910 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.644+0000 7f44c17cd640 1 --2- 172.21.15.118:0/3824189484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc102b00 0x7f44bc102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.644+0000 7f44c17cd640 1 -- 172.21.15.118:0/3824189484 >> 172.21.15.118:0/3824189484 conn(0x7f44bc0fc4c0 msgr2=0x7f44bc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:35.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.644+0000 7f44c17cd640 1 -- 172.21.15.118:0/3824189484 shutdown_connections 2024-09-21T11:46:35.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.644+0000 7f44c17cd640 1 -- 172.21.15.118:0/3824189484 wait complete. 2024-09-21T11:46:35.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.644+0000 7f44c17cd640 1 Processor -- start 2024-09-21T11:46:35.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44c17cd640 1 -- start start 2024-09-21T11:46:35.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44c17cd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc102b00 0x7f44bc19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:35.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44c17cd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc103420 0x7f44bc19dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44c17cd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc10ee30 con 0x7f44bc102b00 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44c17cd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc10ecb0 con 0x7f44bc103420 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44baffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc102b00 0x7f44bc19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44baffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc102b00 0x7f44bc19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37946/0 (socket says 172.21.15.118:37946) 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44baffd640 1 -- 172.21.15.118:0/317473875 learned_addr learned my addr 172.21.15.118:0/317473875 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44ba7fc640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc103420 0x7f44bc19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44baffd640 1 -- 172.21.15.118:0/317473875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc103420 msgr2=0x7f44bc19dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44baffd640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc103420 0x7f44bc19dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.645+0000 7f44baffd640 1 -- 172.21.15.118:0/317473875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc1978a0 con 0x7f44bc102b00 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.646+0000 7f44baffd640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc102b00 0x7f44bc19d6e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00b420 tx=0x7f44ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.646+0000 7f44a3fff640 1 -- 172.21.15.118:0/317473875 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44ac011630 con 0x7f44bc102b00 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.646+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44bc197b90 con 0x7f44bc102b00 2024-09-21T11:46:35.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.646+0000 7f44a3fff640 1 -- 172.21.15.118:0/317473875 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f44ac016070 con 0x7f44bc102b00 2024-09-21T11:46:35.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.646+0000 7f44a3fff640 1 -- 172.21.15.118:0/317473875 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44ac010d40 con 0x7f44bc102b00 2024-09-21T11:46:35.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.646+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44bc1980f0 con 0x7f44bc102b00 2024-09-21T11:46:35.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.647+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44bc06a3b0 con 0x7f44bc102b00 2024-09-21T11:46:35.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.648+0000 7f44a3fff640 1 -- 172.21.15.118:0/317473875 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f44ac01b460 con 0x7f44bc102b00 2024-09-21T11:46:35.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.649+0000 7f44a3fff640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f44a407af80 0x7f44a407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:46:35.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.649+0000 7f44a3fff640 1 -- 172.21.15.118:0/317473875 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f44ac09d610 con 0x7f44bc102b00 2024-09-21T11:46:35.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.649+0000 7f44ba7fc640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f44a407af80 0x7f44a407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:46:35.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.649+0000 7f44ba7fc640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f44a407af80 0x7f44a407d440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44b0000c00 tx=0x7f44b0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:46:35.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.653+0000 7f44a3fff640 1 -- 172.21.15.118:0/317473875 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44ac068c90 con 0x7f44bc102b00 2024-09-21T11:46:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:35 smithi149 ceph-mon[79770]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:35 smithi149 ceph-mon[79770]: pgmap v218: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:35 smithi149 ceph-mon[79770]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:35 smithi149 ceph-mon[79770]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:46:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:35 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2189504561' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:35 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3749511911' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:46:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.904+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f44bc198dd0 con 0x7f44bc102b00 2024-09-21T11:46:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.905+0000 7f44a3fff640 1 -- 172.21.15.118:0/317473875 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f44ac069e20 con 0x7f44bc102b00 2024-09-21T11:46:35.907 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:46:35.907 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:46:35.907 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:46:35.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f44a407af80 msgr2=0x7f44a407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f44a407af80 0x7f44a407d440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44b0000c00 tx=0x7f44b0031400 comp rx=0 tx=0).stop 2024-09-21T11:46:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc102b00 msgr2=0x7f44bc19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:46:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc102b00 0x7f44bc19d6e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00b420 tx=0x7f44ac00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 shutdown_connections 2024-09-21T11:46:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc103420 0x7f44bc19dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f44a407af80 0x7f44a407d440 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 --2- 172.21.15.118:0/317473875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44bc102b00 0x7f44bc19d6e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:46:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 >> 172.21.15.118:0/317473875 conn(0x7f44bc0fc4c0 msgr2=0x7f44bc103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:46:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 shutdown_connections 2024-09-21T11:46:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:46:35.907+0000 7f44c17cd640 1 -- 172.21.15.118:0/317473875 wait complete. 2024-09-21T11:46:36.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:36 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T11:46:36.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:36 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T11:46:36.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:36 smithi118 ceph-mon[111738]: Upgrade: osd.4 is safe to restart 2024-09-21T11:46:36.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:36 smithi118 ceph-mon[111738]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:36.648 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:36 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/317473875' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:46:36.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:36 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T11:46:36.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:36 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T11:46:36.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:36 smithi149 ceph-mon[79770]: Upgrade: osd.4 is safe to restart 2024-09-21T11:46:36.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:36 smithi149 ceph-mon[79770]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:46:36.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:36 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/317473875' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:46:37.447 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:37 smithi149 ceph-mon[79770]: pgmap v219: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:37.447 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:37 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:37.447 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:37 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T11:46:37.447 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:37 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:46:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:37 smithi118 ceph-mon[111738]: pgmap v219: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:37 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:37 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T11:46:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:37 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:46:38.570 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:38 smithi149 ceph-mon[79770]: Upgrade: Updating osd.4 2024-09-21T11:46:38.570 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:38 smithi149 ceph-mon[79770]: Deploying daemon osd.4 on smithi149 2024-09-21T11:46:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:38 smithi118 ceph-mon[111738]: Upgrade: Updating osd.4 2024-09-21T11:46:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:38 smithi118 ceph-mon[111738]: Deploying daemon osd.4 on smithi149 2024-09-21T11:46:39.639 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:39 smithi149 ceph-mon[79770]: pgmap v220: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:39 smithi118 ceph-mon[111738]: pgmap v220: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:39.892 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:39 smithi149 systemd[1]: Stopping Ceph osd.4 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:46:40.199 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:39 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[48492]: 2024-09-21T11:46:39.921+0000 7fb1be374640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T11:46:40.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:39 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[48492]: 2024-09-21T11:46:39.921+0000 7fb1be374640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-21T11:46:40.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:39 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[48492]: 2024-09-21T11:46:39.921+0000 7fb1be374640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T11:46:40.668 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:40 smithi118 ceph-mon[111738]: osd.4 marked itself down and dead 2024-09-21T11:46:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:40 smithi149 ceph-mon[79770]: osd.4 marked itself down and dead 2024-09-21T11:46:41.026 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:40 smithi149 podman[92491]: 2024-09-21 11:46:40.735888997 +0000 UTC m=+0.945116998 container died c8bc0c620dccaf1b1a88c7de62101a9c342c57ea24ebd3b7fe8552be10303df5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-4e45e6b) 2024-09-21T11:46:41.348 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:41 smithi149 podman[92491]: 2024-09-21 11:46:41.120969001 +0000 UTC m=+1.330196988 container cleanup c8bc0c620dccaf1b1a88c7de62101a9c342c57ea24ebd3b7fe8552be10303df5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T11:46:41.348 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:41 smithi149 bash[92491]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4 2024-09-21T11:46:41.687 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:41 smithi149 podman[92517]: 2024-09-21 11:46:41.347129582 +0000 UTC m=+0.614136676 container remove c8bc0c620dccaf1b1a88c7de62101a9c342c57ea24ebd3b7fe8552be10303df5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-4e45e6b) 2024-09-21T11:46:41.688 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:41 smithi149 ceph-mon[79770]: pgmap v221: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:41.688 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:41 smithi149 ceph-mon[79770]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:46:41.688 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:41 smithi149 ceph-mon[79770]: osdmap e68: 6 total, 5 up, 6 in 2024-09-21T11:46:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:41 smithi118 ceph-mon[111738]: pgmap v221: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:46:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:41 smithi118 ceph-mon[111738]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:46:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:41 smithi118 ceph-mon[111738]: osdmap e68: 6 total, 5 up, 6 in 2024-09-21T11:46:41.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:41 smithi149 podman[92608]: 2024-09-21 11:46:41.589073498 +0000 UTC m=+0.016144133 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:46:41.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:41 smithi149 podman[92608]: 2024-09-21 11:46:41.732497541 +0000 UTC m=+0.159568156 container create 71c94e7004f5c05a4f4d8e170fb3c40e84c9a2a6539df5b97351bb64e8b1fcda (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T11:46:42.270 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:41 smithi149 podman[92608]: 2024-09-21 11:46:41.950672543 +0000 UTC m=+0.377743170 container init 71c94e7004f5c05a4f4d8e170fb3c40e84c9a2a6539df5b97351bb64e8b1fcda (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-21T11:46:42.270 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:41 smithi149 podman[92608]: 2024-09-21 11:46:41.954028421 +0000 UTC m=+0.381099036 container start 71c94e7004f5c05a4f4d8e170fb3c40e84c9a2a6539df5b97351bb64e8b1fcda (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T11:46:42.270 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:42 smithi149 podman[92608]: 2024-09-21 11:46:42.050562272 +0000 UTC m=+0.477632906 container attach 71c94e7004f5c05a4f4d8e170fb3c40e84c9a2a6539df5b97351bb64e8b1fcda (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T11:46:42.270 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:42 smithi149 podman[92608]: 2024-09-21 11:46:42.140613899 +0000 UTC m=+0.567684534 container died 71c94e7004f5c05a4f4d8e170fb3c40e84c9a2a6539df5b97351bb64e8b1fcda (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T11:46:42.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:42 smithi149 ceph-mon[79770]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T11:46:42.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:42 smithi118 ceph-mon[111738]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T11:46:43.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:42 smithi149 podman[92631]: 2024-09-21 11:46:42.754065635 +0000 UTC m=+0.604498240 container remove 71c94e7004f5c05a4f4d8e170fb3c40e84c9a2a6539df5b97351bb64e8b1fcda (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T11:46:43.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:42 smithi149 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-21T11:46:43.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:42 smithi149 systemd[1]: Stopped Ceph osd.4 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:46:43.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:42 smithi149 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.4.service: Consumed 56.607s CPU time. 2024-09-21T11:46:43.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:42 smithi149 systemd[1]: Starting Ceph osd.4 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:46:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:43 smithi149 ceph-mon[79770]: pgmap v224: 65 pgs: 6 active+undersized, 5 stale+active+clean, 5 active+undersized+degraded, 49 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/312 objects degraded (8.333%) 2024-09-21T11:46:43.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:43 smithi149 ceph-mon[79770]: Health check failed: Degraded data redundancy: 26/312 objects degraded (8.333%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:43.451 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:43 smithi149 podman[92733]: 2024-09-21 11:46:43.104439532 +0000 UTC m=+0.016333211 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:46:43.451 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:43 smithi149 podman[92733]: 2024-09-21 11:46:43.241687811 +0000 UTC m=+0.153581477 container create 2fd5d5c2c096e00db21653c7afad8ef93889ebeca4713710eadcb43b32398aa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T11:46:43.451 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:43 smithi149 podman[92733]: 2024-09-21 11:46:43.449466352 +0000 UTC m=+0.361360018 container init 2fd5d5c2c096e00db21653c7afad8ef93889ebeca4713710eadcb43b32398aa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T11:46:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:43 smithi118 ceph-mon[111738]: pgmap v224: 65 pgs: 6 active+undersized, 5 stale+active+clean, 5 active+undersized+degraded, 49 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/312 objects degraded (8.333%) 2024-09-21T11:46:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:43 smithi118 ceph-mon[111738]: Health check failed: Degraded data redundancy: 26/312 objects degraded (8.333%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:43.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:43 smithi149 podman[92733]: 2024-09-21 11:46:43.452967677 +0000 UTC m=+0.364861352 container start 2fd5d5c2c096e00db21653c7afad8ef93889ebeca4713710eadcb43b32398aa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T11:46:43.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:43 smithi149 podman[92733]: 2024-09-21 11:46:43.532540938 +0000 UTC m=+0.444434613 container attach 2fd5d5c2c096e00db21653c7afad8ef93889ebeca4713710eadcb43b32398aa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T11:46:43.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:43 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:43.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:43 smithi149 bash[92733]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:43.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:43 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:43.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:43 smithi149 bash[92733]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:45.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:45 smithi149 ceph-mon[79770]: pgmap v225: 65 pgs: 10 active+undersized, 4 stale+active+clean, 9 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/312 objects degraded (11.538%) 2024-09-21T11:46:45.763 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:45 smithi118 ceph-mon[111738]: pgmap v225: 65 pgs: 10 active+undersized, 4 stale+active+clean, 9 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/312 objects degraded (11.538%) 2024-09-21T11:46:46.700 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:46:46.700 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:46.700 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:46:46.700 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:46.700 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:46.700 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:46:46.701 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T11:46:46.701 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T11:46:46.701 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-21T11:46:46.701 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate[92748]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 bash[92733]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-21T11:46:47.037 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:46 smithi149 podman[92733]: 2024-09-21 11:46:46.76070322 +0000 UTC m=+3.672596897 container died 2fd5d5c2c096e00db21653c7afad8ef93889ebeca4713710eadcb43b32398aa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T11:46:47.674 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:47 smithi149 ceph-mon[79770]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:47.674 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:47 smithi149 podman[92967]: 2024-09-21 11:46:47.461469403 +0000 UTC m=+0.694285064 container remove 2fd5d5c2c096e00db21653c7afad8ef93889ebeca4713710eadcb43b32398aa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T11:46:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:47 smithi118 ceph-mon[111738]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:47.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:47 smithi149 podman[93027]: 2024-09-21 11:46:47.575497431 +0000 UTC m=+0.016957051 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:46:47.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:47 smithi149 podman[93027]: 2024-09-21 11:46:47.695427823 +0000 UTC m=+0.136887427 container create 27363cb204c114cd0bb1d7af3953faca460b141d06da5a8535e9da39339c8efc (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T11:46:47.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:47 smithi149 podman[93027]: 2024-09-21 11:46:47.889396832 +0000 UTC m=+0.330856442 container init 27363cb204c114cd0bb1d7af3953faca460b141d06da5a8535e9da39339c8efc (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:46:47.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:47 smithi149 podman[93027]: 2024-09-21 11:46:47.892497697 +0000 UTC m=+0.333957302 container start 27363cb204c114cd0bb1d7af3953faca460b141d06da5a8535e9da39339c8efc (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T11:46:47.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:47 smithi149 ceph-osd[93046]: -- 172.21.15.149:0/3534054199 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b2e30a81e0 con 0x55b2e2245c00 2024-09-21T11:46:48.449 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:47 smithi149 bash[93027]: 27363cb204c114cd0bb1d7af3953faca460b141d06da5a8535e9da39339c8efc 2024-09-21T11:46:48.450 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:47 smithi149 systemd[1]: Started Ceph osd.4 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:46:49.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:49 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:49.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:49 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:49.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:49 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:46:49.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:49 smithi118 ceph-mon[111738]: pgmap v227: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:49.329 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:49 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:49.329 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:49 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:49.329 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:49 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:46:49.329 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:49 smithi149 ceph-mon[79770]: pgmap v227: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:49.699 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:49 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T11:46:49.516+0000 7fdafb715640 -1 Falling back to public interface 2024-09-21T11:46:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:46:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:50 smithi149 ceph-mon[79770]: pgmap v228: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:46:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:50 smithi118 ceph-mon[111738]: pgmap v228: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:52.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:52 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:52.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:52 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:52.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:52 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 52/312 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:52.607 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:52 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:52.607 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:52 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:52.608 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:52 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 52/312 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:53.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:53 smithi118 ceph-mon[111738]: pgmap v229: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:53.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:53 smithi149 ceph-mon[79770]: pgmap v229: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:55.523 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T11:46:55.240+0000 7fdafb715640 -1 osd.4 67 log_to_monitors true 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: pgmap v230: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T11:46:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T11:46:55.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='osd.4 [v2:172.21.15.149:6808/2483507168,v1:172.21.15.149:6809/2483507168]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T11:46:55.826 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:55 smithi118 ceph-mon[111738]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T11:46:55.949 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T11:46:55.550+0000 7fdaf34bf640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:46:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: pgmap v230: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:46:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:46:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:46:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:46:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:55.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:55.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:46:55.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T11:46:55.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T11:46:55.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T11:46:55.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='osd.4 [v2:172.21.15.149:6808/2483507168,v1:172.21.15.149:6809/2483507168]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T11:46:55.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:55 smithi149 ceph-mon[79770]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T11:46:56.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:56 smithi118 ceph-mon[111738]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T11:46:56.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:56 smithi118 ceph-mon[111738]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T11:46:56.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:56 smithi118 ceph-mon[111738]: from='osd.4 [v2:172.21.15.149:6808/2483507168,v1:172.21.15.149:6809/2483507168]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:46:56.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:56 smithi118 ceph-mon[111738]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:46:56.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:56 smithi149 ceph-mon[79770]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T11:46:56.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:56 smithi149 ceph-mon[79770]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T11:46:56.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:56 smithi149 ceph-mon[79770]: from='osd.4 [v2:172.21.15.149:6808/2483507168,v1:172.21.15.149:6809/2483507168]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:46:56.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:56 smithi149 ceph-mon[79770]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:46:57.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:57 smithi149 ceph-mon[79770]: pgmap v232: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:57.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:57 smithi149 ceph-mon[79770]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:46:57.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:57 smithi149 ceph-mon[79770]: osd.4 [v2:172.21.15.149:6808/2483507168,v1:172.21.15.149:6809/2483507168] boot 2024-09-21T11:46:57.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:57 smithi149 ceph-mon[79770]: osdmap e71: 6 total, 6 up, 6 in 2024-09-21T11:46:57.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:57 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T11:46:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:57 smithi118 ceph-mon[111738]: pgmap v232: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-21T11:46:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:57 smithi118 ceph-mon[111738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:46:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:57 smithi118 ceph-mon[111738]: osd.4 [v2:172.21.15.149:6808/2483507168,v1:172.21.15.149:6809/2483507168] boot 2024-09-21T11:46:57.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:57 smithi118 ceph-mon[111738]: osdmap e71: 6 total, 6 up, 6 in 2024-09-21T11:46:57.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:57 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T11:46:58.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:58 smithi118 ceph-mon[111738]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T11:46:58.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:58 smithi149 ceph-mon[79770]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T11:46:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:59 smithi118 ceph-mon[111738]: pgmap v235: 65 pgs: 10 peering, 11 active+undersized, 6 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16/312 objects degraded (5.128%) 2024-09-21T11:46:59.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:46:59 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 16/312 objects degraded (5.128%), 6 pgs degraded (PG_DEGRADED) 2024-09-21T11:46:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:59 smithi149 ceph-mon[79770]: pgmap v235: 65 pgs: 10 peering, 11 active+undersized, 6 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16/312 objects degraded (5.128%) 2024-09-21T11:46:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:46:59 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 16/312 objects degraded (5.128%), 6 pgs degraded (PG_DEGRADED) 2024-09-21T11:47:01.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:01 smithi118 ceph-mon[111738]: pgmap v236: 65 pgs: 10 peering, 4 active+undersized, 2 active+undersized+degraded, 49 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/312 objects degraded (1.603%) 2024-09-21T11:47:01.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:01 smithi149 ceph-mon[79770]: pgmap v236: 65 pgs: 10 peering, 4 active+undersized, 2 active+undersized+degraded, 49 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/312 objects degraded (1.603%) 2024-09-21T11:47:02.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:02 smithi149 ceph-mon[79770]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/312 objects degraded (1.603%), 2 pgs degraded) 2024-09-21T11:47:03.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:02 smithi118 ceph-mon[111738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/312 objects degraded (1.603%), 2 pgs degraded) 2024-09-21T11:47:03.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:03 smithi149 ceph-mon[79770]: pgmap v237: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:03 smithi118 ceph-mon[111738]: pgmap v237: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:05 smithi149 ceph-mon[79770]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:47:06.002 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:05 smithi118 ceph-mon[111738]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:06.002 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:06.003 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:47:06.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.000+0000 7f75f3c81640 1 -- 172.21.15.118:0/4279396935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec101910 msgr2=0x7f75ec101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.000+0000 7f75f3c81640 1 --2- 172.21.15.118:0/4279396935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec101910 0x7f75ec101d70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009880 tx=0x7f75dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.000+0000 7f75f3c81640 1 -- 172.21.15.118:0/4279396935 shutdown_connections 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.000+0000 7f75f3c81640 1 --2- 172.21.15.118:0/4279396935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec101910 0x7f75ec101d70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.000+0000 7f75f3c81640 1 --2- 172.21.15.118:0/4279396935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ec107910 0x7f75ec107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.000+0000 7f75f3c81640 1 -- 172.21.15.118:0/4279396935 >> 172.21.15.118:0/4279396935 conn(0x7f75ec0fd5f0 msgr2=0x7f75ec0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.000+0000 7f75f3c81640 1 -- 172.21.15.118:0/4279396935 shutdown_connections 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.000+0000 7f75f3c81640 1 -- 172.21.15.118:0/4279396935 wait complete. 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f3c81640 1 Processor -- start 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f3c81640 1 -- start start 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f3c81640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ec101910 0x7f75ec19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f3c81640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec107910 0x7f75ec19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f3c81640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec10edc0 con 0x7f75ec107910 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f3c81640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec10ec40 con 0x7f75ec101910 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f121c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec107910 0x7f75ec19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f121c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec107910 0x7f75ec19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50284/0 (socket says 172.21.15.118:50284) 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f121c640 1 -- 172.21.15.118:0/1249567928 learned_addr learned my addr 172.21.15.118:0/1249567928 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:06.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f1a1d640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ec101910 0x7f75ec19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f121c640 1 -- 172.21.15.118:0/1249567928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ec101910 msgr2=0x7f75ec19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f121c640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ec101910 0x7f75ec19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f121c640 1 -- 172.21.15.118:0/1249567928 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec1977d0 con 0x7f75ec107910 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.001+0000 7f75f1a1d640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ec101910 0x7f75ec19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.002+0000 7f75f121c640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec107910 0x7f75ec19db90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75dc031460 tx=0x7f75dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.002+0000 7f75e2ffd640 1 -- 172.21.15.118:0/1249567928 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75dc03f070 con 0x7f75ec107910 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.002+0000 7f75e2ffd640 1 -- 172.21.15.118:0/1249567928 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75dc004cf0 con 0x7f75ec107910 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.002+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec197a60 con 0x7f75ec107910 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.002+0000 7f75e2ffd640 1 -- 172.21.15.118:0/1249567928 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75dc035030 con 0x7f75ec107910 2024-09-21T11:47:06.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.002+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec197f90 con 0x7f75ec107910 2024-09-21T11:47:06.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.003+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec103050 con 0x7f75ec107910 2024-09-21T11:47:06.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.004+0000 7f75e2ffd640 1 -- 172.21.15.118:0/1249567928 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f75dc042070 con 0x7f75ec107910 2024-09-21T11:47:06.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.004+0000 7f75e2ffd640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f75d807af30 0x7f75d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.004+0000 7f75e2ffd640 1 -- 172.21.15.118:0/1249567928 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f75dc0beac0 con 0x7f75ec107910 2024-09-21T11:47:06.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.004+0000 7f75f1a1d640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f75d807af30 0x7f75d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.005+0000 7f75f1a1d640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f75d807af30 0x7f75d807d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f75e800abe0 tx=0x7f75e800a5c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:06.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.009+0000 7f75e2ffd640 1 -- 172.21.15.118:0/1249567928 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75dc08a0c0 con 0x7f75ec107910 2024-09-21T11:47:06.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.226+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f75ec198300 con 0x7f75d807af30 2024-09-21T11:47:06.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.227+0000 7f75e2ffd640 1 -- 172.21.15.118:0/1249567928 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f75ec198300 con 0x7f75d807af30 2024-09-21T11:47:06.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.229+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f75d807af30 msgr2=0x7f75d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.229+0000 7f75f3c81640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f75d807af30 0x7f75d807d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f75e800abe0 tx=0x7f75e800a5c0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.229+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec107910 msgr2=0x7f75ec19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.229+0000 7f75f3c81640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec107910 0x7f75ec19db90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75dc031460 tx=0x7f75dc0048f0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.229+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 shutdown_connections 2024-09-21T11:47:06.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.229+0000 7f75f3c81640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f75d807af30 0x7f75d807d3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.229+0000 7f75f3c81640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ec107910 0x7f75ec19db90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.229+0000 7f75f3c81640 1 --2- 172.21.15.118:0/1249567928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ec101910 0x7f75ec19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.229+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 >> 172.21.15.118:0/1249567928 conn(0x7f75ec0fd5f0 msgr2=0x7f75ec0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:06.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.230+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 shutdown_connections 2024-09-21T11:47:06.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.230+0000 7f75f3c81640 1 -- 172.21.15.118:0/1249567928 wait complete. 2024-09-21T11:47:06.241 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:47:06.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/1256175921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d14102ab0 msgr2=0x7f7d14102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 --2- 172.21.15.118:0/1256175921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d14102ab0 0x7f7d14102e90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009880 tx=0x7f7d0c02a530 comp rx=0 tx=0).stop 2024-09-21T11:47:06.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/1256175921 shutdown_connections 2024-09-21T11:47:06.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 --2- 172.21.15.118:0/1256175921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d141033d0 0x7f7d1410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 --2- 172.21.15.118:0/1256175921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d14102ab0 0x7f7d14102e90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/1256175921 >> 172.21.15.118:0/1256175921 conn(0x7f7d140fc4f0 msgr2=0x7f7d140fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:06.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/1256175921 shutdown_connections 2024-09-21T11:47:06.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/1256175921 wait complete. 2024-09-21T11:47:06.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 Processor -- start 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.314+0000 7f7d1b8f7640 1 -- start start 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d1b8f7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14102ab0 0x7f7d14100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d1b8f7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d141033d0 0x7f7d14100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d1b8f7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1410edc0 con 0x7f7d141033d0 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d1b8f7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1410ec40 con 0x7f7d14102ab0 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d18e92640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d141033d0 0x7f7d14100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d18e92640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d141033d0 0x7f7d14100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50296/0 (socket says 172.21.15.118:50296) 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d18e92640 1 -- 172.21.15.118:0/4267513171 learned_addr learned my addr 172.21.15.118:0/4267513171 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d19693640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14102ab0 0x7f7d14100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d18e92640 1 -- 172.21.15.118:0/4267513171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14102ab0 msgr2=0x7f7d14100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d18e92640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14102ab0 0x7f7d14100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d18e92640 1 -- 172.21.15.118:0/4267513171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d14101190 con 0x7f7d141033d0 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.315+0000 7f7d18e92640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d141033d0 0x7f7d14100c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800d6c0 tx=0x7f7d0800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:06.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.316+0000 7f7d127fc640 1 -- 172.21.15.118:0/4267513171 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d08017070 con 0x7f7d141033d0 2024-09-21T11:47:06.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.316+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d14101480 con 0x7f7d141033d0 2024-09-21T11:47:06.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.316+0000 7f7d127fc640 1 -- 172.21.15.118:0/4267513171 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d08009ce0 con 0x7f7d141033d0 2024-09-21T11:47:06.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.316+0000 7f7d127fc640 1 -- 172.21.15.118:0/4267513171 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d0800f3c0 con 0x7f7d141033d0 2024-09-21T11:47:06.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.316+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d141a3e10 con 0x7f7d141033d0 2024-09-21T11:47:06.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.317+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1406ac30 con 0x7f7d141033d0 2024-09-21T11:47:06.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.317+0000 7f7d127fc640 1 -- 172.21.15.118:0/4267513171 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7d08010460 con 0x7f7d141033d0 2024-09-21T11:47:06.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.318+0000 7f7d127fc640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7cfc07af30 0x7f7cfc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.318+0000 7f7d19693640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7cfc07af30 0x7f7cfc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.318+0000 7f7d127fc640 1 -- 172.21.15.118:0/4267513171 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f7d0809dde0 con 0x7f7d141033d0 2024-09-21T11:47:06.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.319+0000 7f7d19693640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7cfc07af30 0x7f7cfc07d3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0096c0 tx=0x7f7d0c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:06.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.323+0000 7f7d127fc640 1 -- 172.21.15.118:0/4267513171 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d080693e0 con 0x7f7d141033d0 2024-09-21T11:47:06.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.515+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7d14062630 con 0x7f7cfc07af30 2024-09-21T11:47:06.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.517+0000 7f7d127fc640 1 -- 172.21.15.118:0/4267513171 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f7d14062630 con 0x7f7cfc07af30 2024-09-21T11:47:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7cfc07af30 msgr2=0x7f7cfc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7cfc07af30 0x7f7cfc07d3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0096c0 tx=0x7f7d0c031400 comp rx=0 tx=0).stop 2024-09-21T11:47:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d141033d0 msgr2=0x7f7d14100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d141033d0 0x7f7d14100c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800d6c0 tx=0x7f7d0800db80 comp rx=0 tx=0).stop 2024-09-21T11:47:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 shutdown_connections 2024-09-21T11:47:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7cfc07af30 0x7f7cfc07d3f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d141033d0 0x7f7d14100c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 --2- 172.21.15.118:0/4267513171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14102ab0 0x7f7d14100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 >> 172.21.15.118:0/4267513171 conn(0x7f7d140fc4f0 msgr2=0x7f7d14108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:06.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 shutdown_connections 2024-09-21T11:47:06.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.519+0000 7f7d1b8f7640 1 -- 172.21.15.118:0/4267513171 wait complete. 2024-09-21T11:47:06.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.601+0000 7f967220e640 1 -- 172.21.15.118:0/2775836986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 msgr2=0x7f966c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.601+0000 7f967220e640 1 --2- 172.21.15.118:0/2775836986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 0x7f966c107d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f965c009880 tx=0x7f965c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.601+0000 7f967220e640 1 -- 172.21.15.118:0/2775836986 shutdown_connections 2024-09-21T11:47:06.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.601+0000 7f967220e640 1 --2- 172.21.15.118:0/2775836986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f966c101930 0x7f966c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.601+0000 7f967220e640 1 --2- 172.21.15.118:0/2775836986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 0x7f966c107d10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.601+0000 7f967220e640 1 -- 172.21.15.118:0/2775836986 >> 172.21.15.118:0/2775836986 conn(0x7f966c0fd630 msgr2=0x7f966c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:06.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.601+0000 7f967220e640 1 -- 172.21.15.118:0/2775836986 shutdown_connections 2024-09-21T11:47:06.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.601+0000 7f967220e640 1 -- 172.21.15.118:0/2775836986 wait complete. 2024-09-21T11:47:06.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f967220e640 1 Processor -- start 2024-09-21T11:47:06.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f967220e640 1 -- start start 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f967220e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f966c101930 0x7f966c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f967220e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 0x7f966c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f967220e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f966c10ee60 con 0x7f966c107930 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f967220e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f966c10ece0 con 0x7f966c101930 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f966affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 0x7f966c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f966affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 0x7f966c19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50312/0 (socket says 172.21.15.118:50312) 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f966affd640 1 -- 172.21.15.118:0/1837733609 learned_addr learned my addr 172.21.15.118:0/1837733609 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f966b7fe640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f966c101930 0x7f966c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f966affd640 1 -- 172.21.15.118:0/1837733609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f966c101930 msgr2=0x7f966c19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f966affd640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f966c101930 0x7f966c19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.602+0000 7f966affd640 1 -- 172.21.15.118:0/1837733609 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c197870 con 0x7f966c107930 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.603+0000 7f966affd640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 0x7f966c19dbf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f966000b420 tx=0x7f966000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:06.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.603+0000 7f9668ff9640 1 -- 172.21.15.118:0/1837733609 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9660011630 con 0x7f966c107930 2024-09-21T11:47:06.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.603+0000 7f9668ff9640 1 -- 172.21.15.118:0/1837733609 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9660016070 con 0x7f966c107930 2024-09-21T11:47:06.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.603+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966c197b60 con 0x7f966c107930 2024-09-21T11:47:06.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.603+0000 7f9668ff9640 1 -- 172.21.15.118:0/1837733609 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9660010d40 con 0x7f966c107930 2024-09-21T11:47:06.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.603+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f966c1980f0 con 0x7f966c107930 2024-09-21T11:47:06.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.604+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f966c103070 con 0x7f966c107930 2024-09-21T11:47:06.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.605+0000 7f9668ff9640 1 -- 172.21.15.118:0/1837733609 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f966001b460 con 0x7f966c107930 2024-09-21T11:47:06.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.605+0000 7f9668ff9640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f965407af30 0x7f965407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.605+0000 7f966b7fe640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f965407af30 0x7f965407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.605+0000 7f9668ff9640 1 -- 172.21.15.118:0/1837733609 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f966009d730 con 0x7f966c107930 2024-09-21T11:47:06.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.606+0000 7f966b7fe640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f965407af30 0x7f965407d3f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f965c000c00 tx=0x7f965c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:06.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.610+0000 7f9668ff9640 1 -- 172.21.15.118:0/1837733609 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9660068c90 con 0x7f966c107930 2024-09-21T11:47:06.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.803+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f966c198da0 con 0x7f965407af30 2024-09-21T11:47:06.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.813+0000 7f9668ff9640 1 -- 172.21.15.118:0/1837733609 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f966c198da0 con 0x7f965407af30 2024-09-21T11:47:06.815 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (5m) 84s ago 15m 20.0M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (8m) 84s ago 16m 8971k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (7m) 16s ago 15m 8586k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (3m) 84s ago 16m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (3m) 16s ago 15m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (4m) 84s ago 15m 81.6M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (10m) 84s ago 10m 147M - 19.1.1-373-g4e45e6b4 164465d2334a 8145bd55bba9 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (10m) 84s ago 10m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (10m) 16s ago 10m 23.3M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (10m) 16s ago 10m 17.2M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (7m) 84s ago 17m 525M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (6m) 16s ago 15m 458M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:47:06.816 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (3m) 84s ago 17m 43.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (3m) 16s ago 15m 36.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (5m) 84s ago 16m 9.92M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (5m) 16s ago 15m 12.1M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (2m) 84s ago 13m 90.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (2m) 84s ago 13m 91.0M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (90s) 84s ago 12m 11.7M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (53s) 16s ago 12m 98.3M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (19s) 16s ago 12m 11.9M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (11m) 16s ago 11m 208M 4096M 19.1.1-373-g4e45e6b4 164465d2334a 704aba355e6b 2024-09-21T11:47:06.817 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (5m) 84s ago 15m 54.2M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:47:06.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f965407af30 msgr2=0x7f965407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f965407af30 0x7f965407d3f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f965c000c00 tx=0x7f965c031400 comp rx=0 tx=0).stop 2024-09-21T11:47:06.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 msgr2=0x7f966c19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 0x7f966c19dbf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f966000b420 tx=0x7f966000b8e0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 shutdown_connections 2024-09-21T11:47:06.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f965407af30 0x7f965407d3f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f966c107930 0x7f966c19dbf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 --2- 172.21.15.118:0/1837733609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f966c101930 0x7f966c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 >> 172.21.15.118:0/1837733609 conn(0x7f966c0fd630 msgr2=0x7f966c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:06.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 shutdown_connections 2024-09-21T11:47:06.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.815+0000 7f967220e640 1 -- 172.21.15.118:0/1837733609 wait complete. 2024-09-21T11:47:06.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.903+0000 7f80c386b640 1 -- 172.21.15.118:0/2497676694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc102aa0 msgr2=0x7f80bc102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.904+0000 7f80c386b640 1 --2- 172.21.15.118:0/2497676694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc102aa0 0x7f80bc102e80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009c20 tx=0x7f80ac02aa00 comp rx=0 tx=0).stop 2024-09-21T11:47:06.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.904+0000 7f80c386b640 1 -- 172.21.15.118:0/2497676694 shutdown_connections 2024-09-21T11:47:06.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.904+0000 7f80c386b640 1 --2- 172.21.15.118:0/2497676694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc1033c0 0x7f80bc10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.904+0000 7f80c386b640 1 --2- 172.21.15.118:0/2497676694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc102aa0 0x7f80bc102e80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.904+0000 7f80c386b640 1 -- 172.21.15.118:0/2497676694 >> 172.21.15.118:0/2497676694 conn(0x7f80bc0fc4c0 msgr2=0x7f80bc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.904+0000 7f80c386b640 1 -- 172.21.15.118:0/2497676694 shutdown_connections 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.904+0000 7f80c386b640 1 -- 172.21.15.118:0/2497676694 wait complete. 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.904+0000 7f80c386b640 1 Processor -- start 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.904+0000 7f80c386b640 1 -- start start 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c386b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc102aa0 0x7f80bc19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c386b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc1033c0 0x7f80bc19dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c386b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc10ee30 con 0x7f80bc1033c0 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c386b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc10ecb0 con 0x7f80bc102aa0 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c0e06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc1033c0 0x7f80bc19dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c0e06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc1033c0 0x7f80bc19dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50330/0 (socket says 172.21.15.118:50330) 2024-09-21T11:47:06.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c0e06640 1 -- 172.21.15.118:0/1663903801 learned_addr learned my addr 172.21.15.118:0/1663903801 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:06.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c0e06640 1 -- 172.21.15.118:0/1663903801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc102aa0 msgr2=0x7f80bc19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:06.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c0e06640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc102aa0 0x7f80bc19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:06.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c0e06640 1 -- 172.21.15.118:0/1663903801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc1978c0 con 0x7f80bc1033c0 2024-09-21T11:47:06.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c0e06640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc1033c0 0x7f80bc19dc40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f80b000b370 tx=0x7f80b000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:06.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80ba7fc640 1 -- 172.21.15.118:0/1663903801 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80b0015020 con 0x7f80bc1033c0 2024-09-21T11:47:06.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80ba7fc640 1 -- 172.21.15.118:0/1663903801 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80b0011af0 con 0x7f80bc1033c0 2024-09-21T11:47:06.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc197bb0 con 0x7f80bc1033c0 2024-09-21T11:47:06.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80ba7fc640 1 -- 172.21.15.118:0/1663903801 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80b0010d60 con 0x7f80bc1033c0 2024-09-21T11:47:06.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.905+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc198140 con 0x7f80bc1033c0 2024-09-21T11:47:06.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.907+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc06a410 con 0x7f80bc1033c0 2024-09-21T11:47:06.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.907+0000 7f80ba7fc640 1 -- 172.21.15.118:0/1663903801 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f80b0018020 con 0x7f80bc1033c0 2024-09-21T11:47:06.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.908+0000 7f80ba7fc640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80a407af90 0x7f80a407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:06.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.908+0000 7f80ba7fc640 1 -- 172.21.15.118:0/1663903801 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f80b009d920 con 0x7f80bc1033c0 2024-09-21T11:47:06.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.908+0000 7f80c1607640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80a407af90 0x7f80a407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:06.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.908+0000 7f80c1607640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80a407af90 0x7f80a407d450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009430 tx=0x7f80ac0093a0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:06.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:06.912+0000 7f80ba7fc640 1 -- 172.21.15.118:0/1663903801 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80b001f020 con 0x7f80bc1033c0 2024-09-21T11:47:07.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.160+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f80bc198df0 con 0x7f80bc1033c0 2024-09-21T11:47:07.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.161+0000 7f80ba7fc640 1 -- 172.21.15.118:0/1663903801 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f80b0068f40 con 0x7f80bc1033c0 2024-09-21T11:47:07.163 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:47:07.163 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:47:07.163 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:47:07.163 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:47:07.163 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 5 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5, 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 9 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:47:07.164 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:47:07.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80a407af90 msgr2=0x7f80a407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80a407af90 0x7f80a407d450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009430 tx=0x7f80ac0093a0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc1033c0 msgr2=0x7f80bc19dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc1033c0 0x7f80bc19dc40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f80b000b370 tx=0x7f80b000b830 comp rx=0 tx=0).stop 2024-09-21T11:47:07.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 shutdown_connections 2024-09-21T11:47:07.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80a407af90 0x7f80a407d450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80bc1033c0 0x7f80bc19dc40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 --2- 172.21.15.118:0/1663903801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc102aa0 0x7f80bc19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 >> 172.21.15.118:0/1663903801 conn(0x7f80bc0fc4c0 msgr2=0x7f80bc108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:07.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 shutdown_connections 2024-09-21T11:47:07.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.163+0000 7f80c386b640 1 -- 172.21.15.118:0/1663903801 wait complete. 2024-09-21T11:47:07.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.243+0000 7f43a24ce640 1 -- 172.21.15.118:0/1322564962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c106820 msgr2=0x7f439c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.243+0000 7f43a24ce640 1 --2- 172.21.15.118:0/1322564962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c106820 0x7f439c106c00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f438c009880 tx=0x7f438c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.244+0000 7f43a24ce640 1 -- 172.21.15.118:0/1322564962 shutdown_connections 2024-09-21T11:47:07.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.244+0000 7f43a24ce640 1 --2- 172.21.15.118:0/1322564962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f439c100820 0x7f439c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.244+0000 7f43a24ce640 1 --2- 172.21.15.118:0/1322564962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c106820 0x7f439c106c00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.244+0000 7f43a24ce640 1 -- 172.21.15.118:0/1322564962 >> 172.21.15.118:0/1322564962 conn(0x7f439c0fc520 msgr2=0x7f439c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:07.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.244+0000 7f43a24ce640 1 -- 172.21.15.118:0/1322564962 shutdown_connections 2024-09-21T11:47:07.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.244+0000 7f43a24ce640 1 -- 172.21.15.118:0/1322564962 wait complete. 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.244+0000 7f43a24ce640 1 Processor -- start 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.244+0000 7f43a24ce640 1 -- start start 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f43a24ce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c100820 0x7f439c19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f43a24ce640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f439c106820 0x7f439c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f43a24ce640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f439c10dcf0 con 0x7f439c100820 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f43a24ce640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f439c10db70 con 0x7f439c106820 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f439bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c100820 0x7f439c19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f439bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c100820 0x7f439c19f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50354/0 (socket says 172.21.15.118:50354) 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f439bfff640 1 -- 172.21.15.118:0/1508048809 learned_addr learned my addr 172.21.15.118:0/1508048809 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f439bfff640 1 -- 172.21.15.118:0/1508048809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f439c106820 msgr2=0x7f439c19fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f439bfff640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f439c106820 0x7f439c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f439bfff640 1 -- 172.21.15.118:0/1508048809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439c199a40 con 0x7f439c100820 2024-09-21T11:47:07.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f439bfff640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c100820 0x7f439c19f880 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f438c031460 tx=0x7f438c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:07.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f43997fa640 1 -- 172.21.15.118:0/1508048809 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f438c03f070 con 0x7f439c100820 2024-09-21T11:47:07.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439c199cd0 con 0x7f439c100820 2024-09-21T11:47:07.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f43997fa640 1 -- 172.21.15.118:0/1508048809 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f438c004cf0 con 0x7f439c100820 2024-09-21T11:47:07.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f43997fa640 1 -- 172.21.15.118:0/1508048809 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f438c035030 con 0x7f439c100820 2024-09-21T11:47:07.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.245+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f439c19a200 con 0x7f439c100820 2024-09-21T11:47:07.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.246+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439c101f60 con 0x7f439c100820 2024-09-21T11:47:07.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.247+0000 7f43997fa640 1 -- 172.21.15.118:0/1508048809 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f438c042070 con 0x7f439c100820 2024-09-21T11:47:07.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.247+0000 7f43997fa640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f438807af30 0x7f438807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:07.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.247+0000 7f43997fa640 1 -- 172.21.15.118:0/1508048809 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f438c0beb20 con 0x7f439c100820 2024-09-21T11:47:07.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.247+0000 7f439b7fe640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f438807af30 0x7f438807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:07.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.248+0000 7f439b7fe640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f438807af30 0x7f438807d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f439c0fe400 tx=0x7f4384005bf0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:07.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.252+0000 7f43997fa640 1 -- 172.21.15.118:0/1508048809 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f438c08a120 con 0x7f439c100820 2024-09-21T11:47:07.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.470+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f439c19b040 con 0x7f439c100820 2024-09-21T11:47:07.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.470+0000 7f43997fa640 1 -- 172.21.15.118:0/1508048809 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2032 (secure 0 0 0) 0x7f438c08efd0 con 0x7f439c100820 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:e16 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:36:41:162720+0000 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 16 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:47:07.473 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:36:41.162717+0000 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 45 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=14556,1=14572} 2024-09-21T11:47:07.474 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 14556 members: 14556,14572 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:14556} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.118:6826/395212393,v1:172.21.15.118:6827/395212393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{1:14572} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.118:6828/98130516,v1:172.21.15.118:6829/98130516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:47:07.475 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:47:07.476 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:47:07.476 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:47:07.476 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T11:47:07.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f438807af30 msgr2=0x7f438807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f438807af30 0x7f438807d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f439c0fe400 tx=0x7f4384005bf0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c100820 msgr2=0x7f439c19f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c100820 0x7f439c19f880 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f438c031460 tx=0x7f438c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 shutdown_connections 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f439c106820 0x7f439c19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f438807af30 0x7f438807d3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 --2- 172.21.15.118:0/1508048809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c100820 0x7f439c19f880 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 >> 172.21.15.118:0/1508048809 conn(0x7f439c0fc520 msgr2=0x7f439c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.473+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 shutdown_connections 2024-09-21T11:47:07.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.474+0000 7f43a24ce640 1 -- 172.21.15.118:0/1508048809 wait complete. 2024-09-21T11:47:07.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.558+0000 7f030dfc1640 1 -- 172.21.15.118:0/995430458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0308102aa0 msgr2=0x7f0308102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.558+0000 7f030dfc1640 1 --2- 172.21.15.118:0/995430458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0308102aa0 0x7f0308102e80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009880 tx=0x7f02f802a530 comp rx=0 tx=0).stop 2024-09-21T11:47:07.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.559+0000 7f030dfc1640 1 -- 172.21.15.118:0/995430458 shutdown_connections 2024-09-21T11:47:07.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.559+0000 7f030dfc1640 1 --2- 172.21.15.118:0/995430458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03081033c0 0x7f030810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.559+0000 7f030dfc1640 1 --2- 172.21.15.118:0/995430458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0308102aa0 0x7f0308102e80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.559+0000 7f030dfc1640 1 -- 172.21.15.118:0/995430458 >> 172.21.15.118:0/995430458 conn(0x7f03080fc4c0 msgr2=0x7f03080fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:07.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.559+0000 7f030dfc1640 1 -- 172.21.15.118:0/995430458 shutdown_connections 2024-09-21T11:47:07.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.559+0000 7f030dfc1640 1 -- 172.21.15.118:0/995430458 wait complete. 2024-09-21T11:47:07.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.559+0000 7f030dfc1640 1 Processor -- start 2024-09-21T11:47:07.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.559+0000 7f030dfc1640 1 -- start start 2024-09-21T11:47:07.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f030dfc1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0308102aa0 0x7f030819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:07.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f030dfc1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03081033c0 0x7f030819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:07.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f030dfc1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f030810edb0 con 0x7f03081033c0 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f030dfc1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f030810ec30 con 0x7f0308102aa0 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0306ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03081033c0 0x7f030819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0306ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03081033c0 0x7f030819db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50366/0 (socket says 172.21.15.118:50366) 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0306ffd640 1 -- 172.21.15.118:0/776025386 learned_addr learned my addr 172.21.15.118:0/776025386 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f03077fe640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0308102aa0 0x7f030819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0306ffd640 1 -- 172.21.15.118:0/776025386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0308102aa0 msgr2=0x7f030819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0306ffd640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0308102aa0 0x7f030819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0306ffd640 1 -- 172.21.15.118:0/776025386 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0308197780 con 0x7f03081033c0 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f03077fe640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0308102aa0 0x7f030819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0306ffd640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03081033c0 0x7f030819db40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f02f000d6c0 tx=0x7f02f000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0304ff9640 1 -- 172.21.15.118:0/776025386 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f02f0017070 con 0x7f03081033c0 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0304ff9640 1 -- 172.21.15.118:0/776025386 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02f0009ce0 con 0x7f03081033c0 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0308197a70 con 0x7f03081033c0 2024-09-21T11:47:07.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f0304ff9640 1 -- 172.21.15.118:0/776025386 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f02f000f3c0 con 0x7f03081033c0 2024-09-21T11:47:07.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.560+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0308198000 con 0x7f03081033c0 2024-09-21T11:47:07.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.562+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030806a410 con 0x7f03081033c0 2024-09-21T11:47:07.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.562+0000 7f0304ff9640 1 -- 172.21.15.118:0/776025386 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f02f0009820 con 0x7f03081033c0 2024-09-21T11:47:07.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.563+0000 7f0304ff9640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02f407af80 0x7f02f407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:07.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.563+0000 7f0304ff9640 1 -- 172.21.15.118:0/776025386 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f02f009dcd0 con 0x7f03081033c0 2024-09-21T11:47:07.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.563+0000 7f03077fe640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02f407af80 0x7f02f407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:07.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.563+0000 7f03077fe640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02f407af80 0x7f02f407d440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f02f8000c00 tx=0x7f02f8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:07.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.567+0000 7f0304ff9640 1 -- 172.21.15.118:0/776025386 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02f0069350 con 0x7f03081033c0 2024-09-21T11:47:07.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.761+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f03081982b0 con 0x7f02f407af80 2024-09-21T11:47:07.764 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:07 smithi118 ceph-mon[111738]: pgmap v239: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:07.764 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:07 smithi118 ceph-mon[111738]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:07.764 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:07 smithi118 ceph-mon[111738]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:07.764 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:07 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1663903801' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:07.764 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:07 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1508048809' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:47:07.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.762+0000 7f0304ff9640 1 -- 172.21.15.118:0/776025386 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f03081982b0 con 0x7f02f407af80 2024-09-21T11:47:07.765 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:47:07.765 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:47:07.765 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:47:07.765 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:47:07.765 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:47:07.765 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:47:07.765 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:47:07.765 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:47:07.766 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:47:07.766 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "11/23 daemons upgraded", 2024-09-21T11:47:07.766 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T11:47:07.766 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:47:07.766 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:47:07.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02f407af80 msgr2=0x7f02f407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02f407af80 0x7f02f407d440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f02f8000c00 tx=0x7f02f8031400 comp rx=0 tx=0).stop 2024-09-21T11:47:07.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03081033c0 msgr2=0x7f030819db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03081033c0 0x7f030819db40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f02f000d6c0 tx=0x7f02f000db80 comp rx=0 tx=0).stop 2024-09-21T11:47:07.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 shutdown_connections 2024-09-21T11:47:07.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02f407af80 0x7f02f407d440 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03081033c0 0x7f030819db40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 --2- 172.21.15.118:0/776025386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0308102aa0 0x7f030819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 >> 172.21.15.118:0/776025386 conn(0x7f03080fc4c0 msgr2=0x7f0308108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:07.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 shutdown_connections 2024-09-21T11:47:07.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.765+0000 7f030dfc1640 1 -- 172.21.15.118:0/776025386 wait complete. 2024-09-21T11:47:07.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.847+0000 7f22f3249640 1 -- 172.21.15.118:0/632942564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1067e0 msgr2=0x7f22ec106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.847+0000 7f22f3249640 1 --2- 172.21.15.118:0/632942564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1067e0 0x7f22ec106bc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009880 tx=0x7f22e002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 -- 172.21.15.118:0/632942564 shutdown_connections 2024-09-21T11:47:07.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 --2- 172.21.15.118:0/632942564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22ec1007e0 0x7f22ec100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 --2- 172.21.15.118:0/632942564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1067e0 0x7f22ec106bc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 -- 172.21.15.118:0/632942564 >> 172.21.15.118:0/632942564 conn(0x7f22ec0fc4c0 msgr2=0x7f22ec0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:07.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 -- 172.21.15.118:0/632942564 shutdown_connections 2024-09-21T11:47:07.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 -- 172.21.15.118:0/632942564 wait complete. 2024-09-21T11:47:07.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 Processor -- start 2024-09-21T11:47:07.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 -- start start 2024-09-21T11:47:07.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1007e0 0x7f22ec19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:07.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22ec1067e0 0x7f22ec19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:07.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec10ee30 con 0x7f22ec1007e0 2024-09-21T11:47:07.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.848+0000 7f22f3249640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec10ecb0 con 0x7f22ec1067e0 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22f0fe5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1007e0 0x7f22ec19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22f0fe5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1007e0 0x7f22ec19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50386/0 (socket says 172.21.15.118:50386) 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22f0fe5640 1 -- 172.21.15.118:0/3153662441 learned_addr learned my addr 172.21.15.118:0/3153662441 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22ebfff640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22ec1067e0 0x7f22ec19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22f0fe5640 1 -- 172.21.15.118:0/3153662441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22ec1067e0 msgr2=0x7f22ec19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22f0fe5640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22ec1067e0 0x7f22ec19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22f0fe5640 1 -- 172.21.15.118:0/3153662441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec197840 con 0x7f22ec1007e0 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22ebfff640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22ec1067e0 0x7f22ec19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22f0fe5640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1007e0 0x7f22ec19d6c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f22e0031460 tx=0x7f22e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22e9ffb640 1 -- 172.21.15.118:0/3153662441 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22e003f070 con 0x7f22ec1007e0 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec197ad0 con 0x7f22ec1007e0 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22e9ffb640 1 -- 172.21.15.118:0/3153662441 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22e0004cf0 con 0x7f22ec1007e0 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22e9ffb640 1 -- 172.21.15.118:0/3153662441 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22e0035030 con 0x7f22ec1007e0 2024-09-21T11:47:07.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.849+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec198000 con 0x7f22ec1007e0 2024-09-21T11:47:07.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.850+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ec101f20 con 0x7f22ec1007e0 2024-09-21T11:47:07.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.851+0000 7f22e9ffb640 1 -- 172.21.15.118:0/3153662441 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f22e0042070 con 0x7f22ec1007e0 2024-09-21T11:47:07.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.852+0000 7f22e9ffb640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f22dc07af30 0x7f22dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:07.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.852+0000 7f22e9ffb640 1 -- 172.21.15.118:0/3153662441 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f22e00beb00 con 0x7f22ec1007e0 2024-09-21T11:47:07.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.852+0000 7f22ebfff640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f22dc07af30 0x7f22dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:07.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.852+0000 7f22ebfff640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f22dc07af30 0x7f22dc07d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22d8006fd0 tx=0x7f22d8008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:07.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:07.856+0000 7f22e9ffb640 1 -- 172.21.15.118:0/3153662441 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22e008a100 con 0x7f22ec1007e0 2024-09-21T11:47:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:07 smithi149 ceph-mon[79770]: pgmap v239: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:07 smithi149 ceph-mon[79770]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:07 smithi149 ceph-mon[79770]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:07 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1663903801' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:07 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1508048809' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:47:08.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.102+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f22ec108d50 con 0x7f22ec1007e0 2024-09-21T11:47:08.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.103+0000 7f22e9ffb640 1 -- 172.21.15.118:0/3153662441 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f22e008efb0 con 0x7f22ec1007e0 2024-09-21T11:47:08.105 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T11:47:08.105 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:47:08.105 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f22dc07af30 msgr2=0x7f22dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f22dc07af30 0x7f22dc07d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22d8006fd0 tx=0x7f22d8008040 comp rx=0 tx=0).stop 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1007e0 msgr2=0x7f22ec19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1007e0 0x7f22ec19d6c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f22e0031460 tx=0x7f22e00048f0 comp rx=0 tx=0).stop 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 shutdown_connections 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22ec1067e0 0x7f22ec19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f22dc07af30 0x7f22dc07d3f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 --2- 172.21.15.118:0/3153662441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ec1007e0 0x7f22ec19d6c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 >> 172.21.15.118:0/3153662441 conn(0x7f22ec0fc4c0 msgr2=0x7f22ec0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:08.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 shutdown_connections 2024-09-21T11:47:08.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:08.105+0000 7f22f3249640 1 -- 172.21.15.118:0/3153662441 wait complete. 2024-09-21T11:47:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:08 smithi149 ceph-mon[79770]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:08 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3153662441' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:47:09.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:08 smithi118 ceph-mon[111738]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:09.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:08 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3153662441' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:47:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:09 smithi149 ceph-mon[79770]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:09 smithi149 ceph-mon[79770]: pgmap v240: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:09 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T11:47:10.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:09 smithi118 ceph-mon[111738]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:10.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:09 smithi118 ceph-mon[111738]: pgmap v240: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:10.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:09 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T11:47:10.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:10 smithi149 ceph-mon[79770]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T11:47:10.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:10 smithi149 ceph-mon[79770]: Upgrade: osd.5 is safe to restart 2024-09-21T11:47:10.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:10 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:11.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:10 smithi118 ceph-mon[111738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T11:47:11.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:10 smithi118 ceph-mon[111738]: Upgrade: osd.5 is safe to restart 2024-09-21T11:47:11.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:10 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:11.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:11 smithi149 ceph-mon[79770]: pgmap v241: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:11.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T11:47:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:11 smithi118 ceph-mon[111738]: pgmap v241: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T11:47:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:12.842 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:12 smithi149 ceph-mon[79770]: Upgrade: Updating osd.5 2024-09-21T11:47:12.842 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:12 smithi149 ceph-mon[79770]: Deploying daemon osd.5 on smithi149 2024-09-21T11:47:13.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:12 smithi118 ceph-mon[111738]: Upgrade: Updating osd.5 2024-09-21T11:47:13.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:12 smithi118 ceph-mon[111738]: Deploying daemon osd.5 on smithi149 2024-09-21T11:47:13.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:13 smithi149 ceph-mon[79770]: pgmap v242: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:14.057 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:13 smithi149 systemd[1]: Stopping Ceph osd.5 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:47:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:13 smithi118 ceph-mon[111738]: pgmap v242: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:14.450 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:14 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[54966]: 2024-09-21T11:47:14.053+0000 7f8a2abdd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T11:47:14.450 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:14 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[54966]: 2024-09-21T11:47:14.053+0000 7f8a2abdd640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-21T11:47:14.450 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:14 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[54966]: 2024-09-21T11:47:14.053+0000 7f8a2abdd640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T11:47:14.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:14 smithi149 ceph-mon[79770]: osd.5 marked itself down and dead 2024-09-21T11:47:15.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:14 smithi118 ceph-mon[111738]: osd.5 marked itself down and dead 2024-09-21T11:47:15.368 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:15 smithi149 podman[97370]: 2024-09-21 11:47:15.060949659 +0000 UTC m=+1.099875305 container died 704aba355e6bb9028e3c6634513a94042bf7f92056eff16a2080839fac8a139b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5, RELEASE=squid-4e45e6b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T11:47:15.681 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:15 smithi149 podman[97370]: 2024-09-21 11:47:15.536164508 +0000 UTC m=+1.575090147 container cleanup 704aba355e6bb9028e3c6634513a94042bf7f92056eff16a2080839fac8a139b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T11:47:15.681 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:15 smithi149 bash[97370]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5 2024-09-21T11:47:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:15 smithi149 ceph-mon[79770]: pgmap v243: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:15 smithi149 ceph-mon[79770]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:47:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:15 smithi149 ceph-mon[79770]: osdmap e73: 6 total, 5 up, 6 in 2024-09-21T11:47:15.950 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:15 smithi149 podman[97395]: 2024-09-21 11:47:15.838112392 +0000 UTC m=+0.773563922 container remove 704aba355e6bb9028e3c6634513a94042bf7f92056eff16a2080839fac8a139b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD) 2024-09-21T11:47:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:15 smithi118 ceph-mon[111738]: pgmap v243: 65 pgs: 65 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:15 smithi118 ceph-mon[111738]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T11:47:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:15 smithi118 ceph-mon[111738]: osdmap e73: 6 total, 5 up, 6 in 2024-09-21T11:47:16.401 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:16 smithi149 podman[97482]: 2024-09-21 11:47:16.14702293 +0000 UTC m=+0.108098847 container create 4d39496353dbbda81385a05fdf532c3ab0850716cf28aaae235c1d422bd6f999 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T11:47:16.401 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:16 smithi149 podman[97482]: 2024-09-21 11:47:16.055210506 +0000 UTC m=+0.016286436 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:47:16.401 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:16 smithi149 podman[97482]: 2024-09-21 11:47:16.399670237 +0000 UTC m=+0.360746161 container init 4d39496353dbbda81385a05fdf532c3ab0850716cf28aaae235c1d422bd6f999 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T11:47:16.689 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:16 smithi149 podman[97482]: 2024-09-21 11:47:16.403849456 +0000 UTC m=+0.364925383 container start 4d39496353dbbda81385a05fdf532c3ab0850716cf28aaae235c1d422bd6f999 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T11:47:16.690 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:16 smithi149 podman[97482]: 2024-09-21 11:47:16.507587453 +0000 UTC m=+0.468663386 container attach 4d39496353dbbda81385a05fdf532c3ab0850716cf28aaae235c1d422bd6f999 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD) 2024-09-21T11:47:16.690 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:16 smithi149 podman[97482]: 2024-09-21 11:47:16.592007877 +0000 UTC m=+0.553083808 container died 4d39496353dbbda81385a05fdf532c3ab0850716cf28aaae235c1d422bd6f999 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T11:47:16.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:16 smithi149 ceph-mon[79770]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T11:47:17.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:16 smithi118 ceph-mon[111738]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T11:47:17.678 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:17 smithi149 podman[97505]: 2024-09-21 11:47:17.244331736 +0000 UTC m=+0.646515333 container remove 4d39496353dbbda81385a05fdf532c3ab0850716cf28aaae235c1d422bd6f999 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T11:47:17.678 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:17 smithi149 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-21T11:47:17.678 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:17 smithi149 systemd[1]: Stopped Ceph osd.5 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:47:17.678 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:17 smithi149 systemd[1]: ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.5.service: Consumed 57.888s CPU time. 2024-09-21T11:47:17.678 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:17 smithi149 systemd[1]: Starting Ceph osd.5 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T11:47:17.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:17 smithi149 ceph-mon[79770]: pgmap v246: 65 pgs: 10 peering, 7 stale+active+clean, 48 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:17.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:17 smithi149 ceph-mon[79770]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-09-21T11:47:17.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:17 smithi149 podman[97603]: 2024-09-21 11:47:17.579268058 +0000 UTC m=+0.016096909 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:47:17.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:17 smithi149 podman[97603]: 2024-09-21 11:47:17.687073011 +0000 UTC m=+0.123901859 container create cc87f06d9ac62772769d67c60d2e39312385cabc3cc0d8d06f06cb11934911fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T11:47:17.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:17 smithi149 podman[97603]: 2024-09-21 11:47:17.939622952 +0000 UTC m=+0.376451804 container init cc87f06d9ac62772769d67c60d2e39312385cabc3cc0d8d06f06cb11934911fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:47:18.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:17 smithi118 ceph-mon[111738]: pgmap v246: 65 pgs: 10 peering, 7 stale+active+clean, 48 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:18.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:17 smithi118 ceph-mon[111738]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-09-21T11:47:18.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:17 smithi149 podman[97603]: 2024-09-21 11:47:17.943365046 +0000 UTC m=+0.380193890 container start cc87f06d9ac62772769d67c60d2e39312385cabc3cc0d8d06f06cb11934911fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T11:47:18.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:18 smithi149 podman[97603]: 2024-09-21 11:47:18.039825707 +0000 UTC m=+0.476654563 container attach cc87f06d9ac62772769d67c60d2e39312385cabc3cc0d8d06f06cb11934911fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T11:47:18.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:18 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:47:18.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:18 smithi149 bash[97603]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:47:18.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:18 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:47:18.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:18 smithi149 bash[97603]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:47:19.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:18 smithi118 ceph-mon[111738]: pgmap v247: 65 pgs: 5 active+undersized, 10 peering, 3 stale+active+clean, 8 active+undersized+degraded, 39 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/312 objects degraded (10.256%) 2024-09-21T11:47:19.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:18 smithi118 ceph-mon[111738]: Health check failed: Degraded data redundancy: 32/312 objects degraded (10.256%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T11:47:19.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:18 smithi149 ceph-mon[79770]: pgmap v247: 65 pgs: 5 active+undersized, 10 peering, 3 stale+active+clean, 8 active+undersized+degraded, 39 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/312 objects degraded (10.256%) 2024-09-21T11:47:19.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:18 smithi149 ceph-mon[79770]: Health check failed: Degraded data redundancy: 32/312 objects degraded (10.256%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T11:47:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:47:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:20 smithi149 ceph-mon[79770]: pgmap v248: 65 pgs: 10 active+undersized, 7 peering, 11 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/312 objects degraded (12.821%) 2024-09-21T11:47:21.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:47:21.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:47:21.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 bash[97603]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T11:47:21.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 bash[97603]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:47:21.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:47:21.201 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 bash[97603]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T11:47:21.201 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T11:47:21.201 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 bash[97603]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T11:47:21.201 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-21T11:47:21.201 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:20 smithi149 bash[97603]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-21T11:47:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:47:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:20 smithi118 ceph-mon[111738]: pgmap v248: 65 pgs: 10 active+undersized, 7 peering, 11 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/312 objects degraded (12.821%) 2024-09-21T11:47:21.535 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 bash[97603]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 bash[97603]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 bash[97603]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 bash[97603]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate[97618]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 bash[97603]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-21T11:47:21.536 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 podman[97603]: 2024-09-21 11:47:21.245441084 +0000 UTC m=+3.682269935 container died cc87f06d9ac62772769d67c60d2e39312385cabc3cc0d8d06f06cb11934911fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T11:47:22.135 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:21 smithi149 podman[97816]: 2024-09-21 11:47:21.801475655 +0000 UTC m=+0.548862061 container remove cc87f06d9ac62772769d67c60d2e39312385cabc3cc0d8d06f06cb11934911fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-activate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T11:47:22.135 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:22 smithi149 podman[97876]: 2024-09-21 11:47:21.911568676 +0000 UTC m=+0.015890994 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T11:47:22.135 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:22 smithi149 podman[97876]: 2024-09-21 11:47:22.010480743 +0000 UTC m=+0.114803091 container create e7036b24824bf2c1405eb2ab1b64709263f5a3cb5320477d28b859bcf11e87d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T11:47:22.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:22 smithi118 ceph-mon[111738]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-21T11:47:22.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:22 smithi149 ceph-mon[79770]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-21T11:47:22.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:22 smithi149 podman[97876]: 2024-09-21 11:47:22.26295698 +0000 UTC m=+0.367279301 container init e7036b24824bf2c1405eb2ab1b64709263f5a3cb5320477d28b859bcf11e87d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T11:47:22.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:22 smithi149 podman[97876]: 2024-09-21 11:47:22.266380544 +0000 UTC m=+0.370702850 container start e7036b24824bf2c1405eb2ab1b64709263f5a3cb5320477d28b859bcf11e87d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T11:47:22.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:22 smithi149 ceph-osd[97895]: -- 172.21.15.149:0/4252422182 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5606a51341e0 con 0x5606a50c4000 2024-09-21T11:47:22.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:22 smithi149 bash[97876]: e7036b24824bf2c1405eb2ab1b64709263f5a3cb5320477d28b859bcf11e87d2 2024-09-21T11:47:22.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:22 smithi149 systemd[1]: Started Ceph osd.5 for ae037950-780c-11ef-baf6-efdc52797490. 2024-09-21T11:47:23.678 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:23 smithi149 ceph-mon[79770]: pgmap v249: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:23.678 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:23 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:23.678 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:23 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:23.678 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:23 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:23 smithi118 ceph-mon[111738]: pgmap v249: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:23 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:23 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:23 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:23.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:23 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T11:47:23.902+0000 7f20b034a640 -1 Falling back to public interface 2024-09-21T11:47:25.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:25 smithi149 ceph-mon[79770]: pgmap v250: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:25 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:25 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:25 smithi118 ceph-mon[111738]: pgmap v250: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:25 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:25 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:26 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:26 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:26 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:26.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:26 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:27 smithi149 ceph-mon[79770]: pgmap v251: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:27 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 49/312 objects degraded (15.705%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T11:47:28.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:27 smithi118 ceph-mon[111738]: pgmap v251: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:28.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:27 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 49/312 objects degraded (15.705%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T11:47:29.289 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:28 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T11:47:28.937+0000 7fc62c296640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T11:47:29.449 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T11:47:29.184+0000 7f20b034a640 -1 osd.5 72 log_to_monitors true 2024-09-21T11:47:29.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: pgmap v252: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:29.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T11:47:29.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='osd.5 [v2:172.21.15.149:6816/3972267237,v1:172.21.15.149:6817/3972267237]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T11:47:29.952 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-mon[79770]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: pgmap v252: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:30.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T11:47:30.076 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T11:47:30.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T11:47:30.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T11:47:30.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T11:47:30.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-21T11:47:30.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='osd.5 [v2:172.21.15.149:6816/3972267237,v1:172.21.15.149:6817/3972267237]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T11:47:30.077 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:29 smithi118 ceph-mon[111738]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T11:47:30.450 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 11:47:29 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T11:47:29.967+0000 7f20a80f4640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T11:47:30.902 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all osd 2024-09-21T11:47:30.902 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-21T11:47:30.902 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6826/1975444019,v1:172.21.15.118:6827/1975444019] up:boot 2024-09-21T11:47:30.902 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6828/533954515,v1:172.21.15.118:6829/533954515] up:boot 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"} : dispatch 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"} : dispatch 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: from='osd.5 [v2:172.21.15.149:6816/3972267237,v1:172.21.15.149:6817/3972267237]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.ciljqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T11:47:30.903 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:30 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all osd 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6826/1975444019,v1:172.21.15.118:6827/1975444019] up:boot 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6828/533954515,v1:172.21.15.118:6829/533954515] up:boot 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"} : dispatch 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"} : dispatch 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: from='osd.5 [v2:172.21.15.149:6816/3972267237,v1:172.21.15.149:6817/3972267237]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:30.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.ciljqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T11:47:30.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:30 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:31 smithi149 ceph-mon[79770]: pgmap v255: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:31 smithi149 ceph-mon[79770]: Upgrade: Updating mds.cephfs.smithi118.ciljqr 2024-09-21T11:47:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:31 smithi149 ceph-mon[79770]: Deploying daemon mds.cephfs.smithi118.ciljqr on smithi118 2024-09-21T11:47:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:31 smithi149 ceph-mon[79770]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:47:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:31 smithi149 ceph-mon[79770]: osd.5 [v2:172.21.15.149:6816/3972267237,v1:172.21.15.149:6817/3972267237] boot 2024-09-21T11:47:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:31 smithi149 ceph-mon[79770]: osdmap e77: 6 total, 6 up, 6 in 2024-09-21T11:47:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:31 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T11:47:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:31 smithi118 ceph-mon[111738]: pgmap v255: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-21T11:47:32.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:31 smithi118 ceph-mon[111738]: Upgrade: Updating mds.cephfs.smithi118.ciljqr 2024-09-21T11:47:32.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:31 smithi118 ceph-mon[111738]: Deploying daemon mds.cephfs.smithi118.ciljqr on smithi118 2024-09-21T11:47:32.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:31 smithi118 ceph-mon[111738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T11:47:32.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:31 smithi118 ceph-mon[111738]: osd.5 [v2:172.21.15.149:6816/3972267237,v1:172.21.15.149:6817/3972267237] boot 2024-09-21T11:47:32.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:31 smithi118 ceph-mon[111738]: osdmap e77: 6 total, 6 up, 6 in 2024-09-21T11:47:32.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:31 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T11:47:33.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:32 smithi118 ceph-mon[111738]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T11:47:33.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:32 smithi118 ceph-mon[111738]: pgmap v258: 65 pgs: 1 active, 12 active+undersized, 9 active+undersized+degraded, 43 active+clean; 245 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 27/312 objects degraded (8.654%) 2024-09-21T11:47:33.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:32 smithi149 ceph-mon[79770]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T11:47:33.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:32 smithi149 ceph-mon[79770]: pgmap v258: 65 pgs: 1 active, 12 active+undersized, 9 active+undersized+degraded, 43 active+clean; 245 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 27/312 objects degraded (8.654%) 2024-09-21T11:47:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:33 smithi118 ceph-mon[111738]: Health check update: Degraded data redundancy: 27/312 objects degraded (8.654%), 9 pgs degraded (PG_DEGRADED) 2024-09-21T11:47:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:33 smithi118 ceph-mon[111738]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T11:47:34.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:33 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T11:47:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:33 smithi149 ceph-mon[79770]: Health check update: Degraded data redundancy: 27/312 objects degraded (8.654%), 9 pgs degraded (PG_DEGRADED) 2024-09-21T11:47:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:33 smithi149 ceph-mon[79770]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T11:47:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:33 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T11:47:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:34 smithi118 ceph-mon[111738]: pgmap v260: 65 pgs: 1 active, 11 active+undersized, 8 active+undersized+degraded, 45 active+clean; 245 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 24/312 objects degraded (7.692%) 2024-09-21T11:47:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:34 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:34 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:47:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:34 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"} : dispatch 2024-09-21T11:47:35.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:34 smithi149 ceph-mon[79770]: pgmap v260: 65 pgs: 1 active, 11 active+undersized, 8 active+undersized+degraded, 45 active+clean; 245 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 24/312 objects degraded (7.692%) 2024-09-21T11:47:35.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:34 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:35.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:34 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:47:35.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:34 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"} : dispatch 2024-09-21T11:47:36.436 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:36 smithi118 ceph-mon[111738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/312 objects degraded (7.692%), 8 pgs degraded) 2024-09-21T11:47:36.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:36 smithi149 ceph-mon[79770]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/312 objects degraded (7.692%), 8 pgs degraded) 2024-09-21T11:47:37.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:37 smithi118 ceph-mon[111738]: pgmap v261: 65 pgs: 1 active, 64 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:37.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:37 smithi149 ceph-mon[79770]: pgmap v261: 65 pgs: 1 active, 64 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:38.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.197+0000 7f53985c5640 1 -- 172.21.15.118:0/1246731187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901006f0 msgr2=0x7f5390100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.197+0000 7f53985c5640 1 --2- 172.21.15.118:0/1246731187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901006f0 0x7f5390100ad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f538c009880 tx=0x7f538c02a490 comp rx=0 tx=0).stop 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.197+0000 7f53985c5640 1 -- 172.21.15.118:0/1246731187 shutdown_connections 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.197+0000 7f53985c5640 1 --2- 172.21.15.118:0/1246731187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53901010a0 0x7f539010dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.197+0000 7f53985c5640 1 --2- 172.21.15.118:0/1246731187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901006f0 0x7f5390100ad0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.197+0000 7f53985c5640 1 -- 172.21.15.118:0/1246731187 >> 172.21.15.118:0/1246731187 conn(0x7f53900fc520 msgr2=0x7f53900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.197+0000 7f53985c5640 1 -- 172.21.15.118:0/1246731187 shutdown_connections 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.197+0000 7f53985c5640 1 -- 172.21.15.118:0/1246731187 wait complete. 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f53985c5640 1 Processor -- start 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f53985c5640 1 -- start start 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f53985c5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53901006f0 0x7f539019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f53985c5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901010a0 0x7f539019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f53985c5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5390110fd0 con 0x7f53901010a0 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f53985c5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5390110e50 con 0x7f53901006f0 2024-09-21T11:47:38.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f5395b60640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901010a0 0x7f539019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f5395b60640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901010a0 0x7f539019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54404/0 (socket says 172.21.15.118:54404) 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f5395b60640 1 -- 172.21.15.118:0/2001610838 learned_addr learned my addr 172.21.15.118:0/2001610838 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f5396361640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53901006f0 0x7f539019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f5395b60640 1 -- 172.21.15.118:0/2001610838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53901006f0 msgr2=0x7f539019f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f5395b60640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53901006f0 0x7f539019f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.198+0000 7f5395b60640 1 -- 172.21.15.118:0/2001610838 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5390199a00 con 0x7f53901010a0 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.199+0000 7f5395b60640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901010a0 0x7f539019fd80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f538000c8f0 tx=0x7f538000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.199+0000 7f53877fe640 1 -- 172.21.15.118:0/2001610838 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53800079b0 con 0x7f53901010a0 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.199+0000 7f53877fe640 1 -- 172.21.15.118:0/2001610838 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53800054e0 con 0x7f53901010a0 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.199+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5390199cf0 con 0x7f53901010a0 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.199+0000 7f53877fe640 1 -- 172.21.15.118:0/2001610838 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5380004dd0 con 0x7f53901010a0 2024-09-21T11:47:38.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.199+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539019a280 con 0x7f53901010a0 2024-09-21T11:47:38.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.200+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f539006ab60 con 0x7f53901010a0 2024-09-21T11:47:38.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.201+0000 7f53877fe640 1 -- 172.21.15.118:0/2001610838 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5380005020 con 0x7f53901010a0 2024-09-21T11:47:38.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.201+0000 7f53877fe640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f537c07aed0 0x7f537c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:38.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.201+0000 7f53877fe640 1 -- 172.21.15.118:0/2001610838 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f538009e080 con 0x7f53901010a0 2024-09-21T11:47:38.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.201+0000 7f5396361640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f537c07aed0 0x7f537c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:38.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.202+0000 7f5396361640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f537c07aed0 0x7f537c07d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f538c000c00 tx=0x7f538c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:38.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.206+0000 7f53877fe640 1 -- 172.21.15.118:0/2001610838 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5380014030 con 0x7f53901010a0 2024-09-21T11:47:38.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.406+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f539019af30 con 0x7f537c07aed0 2024-09-21T11:47:38.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.407+0000 7f53877fe640 1 -- 172.21.15.118:0/2001610838 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f539019af30 con 0x7f537c07aed0 2024-09-21T11:47:38.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.409+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f537c07aed0 msgr2=0x7f537c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.409+0000 7f53985c5640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f537c07aed0 0x7f537c07d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f538c000c00 tx=0x7f538c031400 comp rx=0 tx=0).stop 2024-09-21T11:47:38.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.409+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901010a0 msgr2=0x7f539019fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.409+0000 7f53985c5640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901010a0 0x7f539019fd80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f538000c8f0 tx=0x7f538000cdb0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.410+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 shutdown_connections 2024-09-21T11:47:38.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.410+0000 7f53985c5640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f537c07aed0 0x7f537c07d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.410+0000 7f53985c5640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53901010a0 0x7f539019fd80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.410+0000 7f53985c5640 1 --2- 172.21.15.118:0/2001610838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53901006f0 0x7f539019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.410+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 >> 172.21.15.118:0/2001610838 conn(0x7f53900fc520 msgr2=0x7f53900fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:38.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.410+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 shutdown_connections 2024-09-21T11:47:38.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.410+0000 7f53985c5640 1 -- 172.21.15.118:0/2001610838 wait complete. 2024-09-21T11:47:38.420 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:47:38.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.494+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/432666023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 msgr2=0x7fe2d4074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.494+0000 7fe2dbb5d640 1 --2- 172.21.15.118:0/432666023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 0x7fe2d4074970 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009880 tx=0x7fe2d002a530 comp rx=0 tx=0).stop 2024-09-21T11:47:38.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.494+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/432666023 shutdown_connections 2024-09-21T11:47:38.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.494+0000 7fe2dbb5d640 1 --2- 172.21.15.118:0/432666023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d4074eb0 0x7fe2d41123e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.494+0000 7fe2dbb5d640 1 --2- 172.21.15.118:0/432666023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 0x7fe2d4074970 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.494+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/432666023 >> 172.21.15.118:0/432666023 conn(0x7fe2d40fd630 msgr2=0x7fe2d40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:38.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.494+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/432666023 shutdown_connections 2024-09-21T11:47:38.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.494+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/432666023 wait complete. 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.495+0000 7fe2dbb5d640 1 Processor -- start 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.495+0000 7fe2dbb5d640 1 -- start start 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.495+0000 7fe2dbb5d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 0x7fe2d419dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.495+0000 7fe2dbb5d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d4074eb0 0x7fe2d419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.495+0000 7fe2dbb5d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d41153e0 con 0x7fe2d4074590 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.495+0000 7fe2dbb5d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d4115260 con 0x7fe2d4074eb0 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2d98f9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 0x7fe2d419dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2d98f9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 0x7fe2d419dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54418/0 (socket says 172.21.15.118:54418) 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2d98f9640 1 -- 172.21.15.118:0/4104508599 learned_addr learned my addr 172.21.15.118:0/4104508599 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:38.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2d98f9640 1 -- 172.21.15.118:0/4104508599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d4074eb0 msgr2=0x7fe2d419e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2d98f9640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d4074eb0 0x7fe2d419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2d98f9640 1 -- 172.21.15.118:0/4104508599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d41a2870 con 0x7fe2d4074590 2024-09-21T11:47:38.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2d98f9640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 0x7fe2d419dfa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0031460 tx=0x7fe2d00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:38.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2caffd640 1 -- 172.21.15.118:0/4104508599 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2d003f070 con 0x7fe2d4074590 2024-09-21T11:47:38.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2caffd640 1 -- 172.21.15.118:0/4104508599 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2d00035f0 con 0x7fe2d4074590 2024-09-21T11:47:38.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d41a2b00 con 0x7fe2d4074590 2024-09-21T11:47:38.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2caffd640 1 -- 172.21.15.118:0/4104508599 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2d0035030 con 0x7fe2d4074590 2024-09-21T11:47:38.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.496+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d41a3030 con 0x7fe2d4074590 2024-09-21T11:47:38.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.497+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d4075cd0 con 0x7fe2d4074590 2024-09-21T11:47:38.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.498+0000 7fe2caffd640 1 -- 172.21.15.118:0/4104508599 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe2d0042070 con 0x7fe2d4074590 2024-09-21T11:47:38.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.498+0000 7fe2caffd640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2c007af80 0x7fe2c007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:38.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.498+0000 7fe2caffd640 1 -- 172.21.15.118:0/4104508599 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fe2d00be9c0 con 0x7fe2d4074590 2024-09-21T11:47:38.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.498+0000 7fe2d90f8640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2c007af80 0x7fe2c007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:38.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.499+0000 7fe2d90f8640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2c007af80 0x7fe2c007d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4005fd0 tx=0x7fe2c4005c70 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:38.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.503+0000 7fe2caffd640 1 -- 172.21.15.118:0/4104508599 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2d0089f90 con 0x7fe2d4074590 2024-09-21T11:47:38.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.702+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe2d41a32e0 con 0x7fe2c007af80 2024-09-21T11:47:38.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.703+0000 7fe2caffd640 1 -- 172.21.15.118:0/4104508599 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fe2d41a32e0 con 0x7fe2c007af80 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2c007af80 msgr2=0x7fe2c007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2c007af80 0x7fe2c007d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4005fd0 tx=0x7fe2c4005c70 comp rx=0 tx=0).stop 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 msgr2=0x7fe2d419dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 0x7fe2d419dfa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0031460 tx=0x7fe2d00045e0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 shutdown_connections 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2d4074eb0 0x7fe2d419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe2c007af80 0x7fe2c007d440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 --2- 172.21.15.118:0/4104508599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d4074590 0x7fe2d419dfa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 >> 172.21.15.118:0/4104508599 conn(0x7fe2d40fd630 msgr2=0x7fe2d4104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 shutdown_connections 2024-09-21T11:47:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.705+0000 7fe2dbb5d640 1 -- 172.21.15.118:0/4104508599 wait complete. 2024-09-21T11:47:38.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.792+0000 7fa2b20db640 1 -- 172.21.15.118:0/660039409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 msgr2=0x7fa2ac101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.792+0000 7fa2b20db640 1 --2- 172.21.15.118:0/660039409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 0x7fa2ac101d50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009880 tx=0x7fa2a002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.792+0000 7fa2b20db640 1 -- 172.21.15.118:0/660039409 shutdown_connections 2024-09-21T11:47:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.792+0000 7fa2b20db640 1 --2- 172.21.15.118:0/660039409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 0x7fa2ac101d50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.792+0000 7fa2b20db640 1 --2- 172.21.15.118:0/660039409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2ac1078f0 0x7fa2ac107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.792+0000 7fa2b20db640 1 -- 172.21.15.118:0/660039409 >> 172.21.15.118:0/660039409 conn(0x7fa2ac0fd630 msgr2=0x7fa2ac0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.792+0000 7fa2b20db640 1 -- 172.21.15.118:0/660039409 shutdown_connections 2024-09-21T11:47:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.792+0000 7fa2b20db640 1 -- 172.21.15.118:0/660039409 wait complete. 2024-09-21T11:47:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.792+0000 7fa2b20db640 1 Processor -- start 2024-09-21T11:47:38.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.793+0000 7fa2b20db640 1 -- start start 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.793+0000 7fa2b20db640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 0x7fa2ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.793+0000 7fa2b20db640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2ac1078f0 0x7fa2ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.793+0000 7fa2b20db640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ac10edc0 con 0x7fa2ac1018f0 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.793+0000 7fa2b20db640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ac10ec40 con 0x7fa2ac1078f0 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.793+0000 7fa2ab7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 0x7fa2ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.793+0000 7fa2ab7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 0x7fa2ac0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54434/0 (socket says 172.21.15.118:54434) 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.793+0000 7fa2ab7fe640 1 -- 172.21.15.118:0/2552109278 learned_addr learned my addr 172.21.15.118:0/2552109278 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.793+0000 7fa2aaffd640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2ac1078f0 0x7fa2ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.794+0000 7fa2ab7fe640 1 -- 172.21.15.118:0/2552109278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2ac1078f0 msgr2=0x7fa2ac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.794+0000 7fa2ab7fe640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2ac1078f0 0x7fa2ac074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.794+0000 7fa2ab7fe640 1 -- 172.21.15.118:0/2552109278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ac074f70 con 0x7fa2ac1018f0 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.794+0000 7fa2ab7fe640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 0x7fa2ac0744f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00c8f0 tx=0x7fa29c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.794+0000 7fa2a8ff9640 1 -- 172.21.15.118:0/2552109278 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa29c0079b0 con 0x7fa2ac1018f0 2024-09-21T11:47:38.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.794+0000 7fa2a8ff9640 1 -- 172.21.15.118:0/2552109278 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa29c0054e0 con 0x7fa2ac1018f0 2024-09-21T11:47:38.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.794+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2ac075260 con 0x7fa2ac1018f0 2024-09-21T11:47:38.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.794+0000 7fa2a8ff9640 1 -- 172.21.15.118:0/2552109278 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa29c004dd0 con 0x7fa2ac1018f0 2024-09-21T11:47:38.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.794+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2ac1a3e50 con 0x7fa2ac1018f0 2024-09-21T11:47:38.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.795+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2ac103030 con 0x7fa2ac1018f0 2024-09-21T11:47:38.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.796+0000 7fa2a8ff9640 1 -- 172.21.15.118:0/2552109278 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa29c005020 con 0x7fa2ac1018f0 2024-09-21T11:47:38.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.796+0000 7fa2a8ff9640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa29407aed0 0x7fa29407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:38.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.796+0000 7fa2a8ff9640 1 -- 172.21.15.118:0/2552109278 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fa29c09e090 con 0x7fa2ac1018f0 2024-09-21T11:47:38.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.797+0000 7fa2aaffd640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa29407aed0 0x7fa29407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:38.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.797+0000 7fa2aaffd640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa29407aed0 0x7fa29407d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac075f80 tx=0x7fa2a0031420 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:38.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:38.804+0000 7fa2a8ff9640 1 -- 172.21.15.118:0/2552109278 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa29c014030 con 0x7fa2ac1018f0 2024-09-21T11:47:39.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.007+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa2ac062630 con 0x7fa29407aed0 2024-09-21T11:47:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.016+0000 7fa2a8ff9640 1 -- 172.21.15.118:0/2552109278 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa2ac062630 con 0x7fa29407aed0 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (5m) 116s ago 16m 20.0M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (8m) 116s ago 16m 8971k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (7m) 13s ago 15m 8632k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (3m) 116s ago 16m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (3m) 13s ago 15m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (5m) 116s ago 16m 81.6M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 starting - - - - 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (11m) 116s ago 11m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a fec76b75c832 2024-09-21T11:47:39.018 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (11m) 13s ago 11m 23.5M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (11m) 13s ago 11m 17.4M - 19.1.1-373-g4e45e6b4 164465d2334a 88a5cd3e6193 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (7m) 116s ago 17m 525M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (6m) 13s ago 15m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (4m) 116s ago 18m 43.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (3m) 13s ago 15m 37.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (6m) 116s ago 16m 9.92M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (6m) 13s ago 15m 11.9M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (3m) 116s ago 14m 90.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (2m) 116s ago 13m 91.0M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (2m) 116s ago 13m 11.7M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (85s) 13s ago 13m 99.9M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (51s) 13s ago 12m 86.7M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (17s) 13s ago 12m 11.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:47:39.019 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (5m) 116s ago 16m 54.2M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:47:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.018+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa29407aed0 msgr2=0x7fa29407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.018+0000 7fa2b20db640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa29407aed0 0x7fa29407d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac075f80 tx=0x7fa2a0031420 comp rx=0 tx=0).stop 2024-09-21T11:47:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.019+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 msgr2=0x7fa2ac0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.019+0000 7fa2b20db640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 0x7fa2ac0744f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00c8f0 tx=0x7fa29c00cdb0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.019+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 shutdown_connections 2024-09-21T11:47:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.019+0000 7fa2b20db640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2ac1078f0 0x7fa2ac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.019+0000 7fa2b20db640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa29407aed0 0x7fa29407d390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.019+0000 7fa2b20db640 1 --2- 172.21.15.118:0/2552109278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2ac1018f0 0x7fa2ac0744f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.019+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 >> 172.21.15.118:0/2552109278 conn(0x7fa2ac0fd630 msgr2=0x7fa2ac0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.019+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 shutdown_connections 2024-09-21T11:47:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.019+0000 7fa2b20db640 1 -- 172.21.15.118:0/2552109278 wait complete. 2024-09-21T11:47:39.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:38 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:39.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:38 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:39.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:38 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:39.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:38 smithi118 ceph-mon[111738]: pgmap v262: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:39.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:38 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:boot 2024-09-21T11:47:39.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:38 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T11:47:39.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:38 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"} : dispatch 2024-09-21T11:47:39.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:38 smithi118 ceph-mon[111738]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:39.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:38 smithi118 ceph-mon[111738]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:39.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.101+0000 7fca91ba2640 1 -- 172.21.15.118:0/194531485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 msgr2=0x7fca8c106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.101+0000 7fca91ba2640 1 --2- 172.21.15.118:0/194531485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 0x7fca8c106a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fca80009880 tx=0x7fca8002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.101+0000 7fca91ba2640 1 -- 172.21.15.118:0/194531485 shutdown_connections 2024-09-21T11:47:39.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.101+0000 7fca91ba2640 1 --2- 172.21.15.118:0/194531485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8c100620 0x7fca8c100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.101+0000 7fca91ba2640 1 --2- 172.21.15.118:0/194531485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 0x7fca8c106a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.101+0000 7fca91ba2640 1 -- 172.21.15.118:0/194531485 >> 172.21.15.118:0/194531485 conn(0x7fca8c0fc360 msgr2=0x7fca8c0fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:39.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.101+0000 7fca91ba2640 1 -- 172.21.15.118:0/194531485 shutdown_connections 2024-09-21T11:47:39.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.101+0000 7fca91ba2640 1 -- 172.21.15.118:0/194531485 wait complete. 2024-09-21T11:47:39.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca91ba2640 1 Processor -- start 2024-09-21T11:47:39.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca91ba2640 1 -- start start 2024-09-21T11:47:39.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca91ba2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8c100620 0x7fca8c196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:39.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca91ba2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 0x7fca8c196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:39.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca91ba2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c10daf0 con 0x7fca8c106620 2024-09-21T11:47:39.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca91ba2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c10d970 con 0x7fca8c100620 2024-09-21T11:47:39.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 0x7fca8c196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:39.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 0x7fca8c196bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54456/0 (socket says 172.21.15.118:54456) 2024-09-21T11:47:39.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca8bfff640 1 -- 172.21.15.118:0/1909741380 learned_addr learned my addr 172.21.15.118:0/1909741380 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:39.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca90ba0640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8c100620 0x7fca8c196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:39.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca8bfff640 1 -- 172.21.15.118:0/1909741380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8c100620 msgr2=0x7fca8c196690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca8bfff640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8c100620 0x7fca8c196690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.102+0000 7fca8bfff640 1 -- 172.21.15.118:0/1909741380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c19af60 con 0x7fca8c106620 2024-09-21T11:47:39.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.103+0000 7fca8bfff640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 0x7fca8c196bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c8f0 tx=0x7fca7800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:39.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.103+0000 7fca89ffb640 1 -- 172.21.15.118:0/1909741380 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca780079b0 con 0x7fca8c106620 2024-09-21T11:47:39.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.103+0000 7fca89ffb640 1 -- 172.21.15.118:0/1909741380 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca780054e0 con 0x7fca8c106620 2024-09-21T11:47:39.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.103+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8c19b250 con 0x7fca8c106620 2024-09-21T11:47:39.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.103+0000 7fca89ffb640 1 -- 172.21.15.118:0/1909741380 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca78004dd0 con 0x7fca8c106620 2024-09-21T11:47:39.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.103+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8c19b7e0 con 0x7fca8c106620 2024-09-21T11:47:39.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.104+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca8c101d60 con 0x7fca8c106620 2024-09-21T11:47:39.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.104+0000 7fca89ffb640 1 -- 172.21.15.118:0/1909741380 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fca78005020 con 0x7fca8c106620 2024-09-21T11:47:39.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.105+0000 7fca89ffb640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca7c07af30 0x7fca7c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:39.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.105+0000 7fca90ba0640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca7c07af30 0x7fca7c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:39.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.105+0000 7fca89ffb640 1 -- 172.21.15.118:0/1909741380 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fca7809df50 con 0x7fca8c106620 2024-09-21T11:47:39.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.106+0000 7fca90ba0640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca7c07af30 0x7fca7c07d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fca80031460 tx=0x7fca80009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:39.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.110+0000 7fca89ffb640 1 -- 172.21.15.118:0/1909741380 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca78014030 con 0x7fca8c106620 2024-09-21T11:47:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:38 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:38 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:38 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:38 smithi149 ceph-mon[79770]: pgmap v262: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:38 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:boot 2024-09-21T11:47:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:38 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T11:47:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:38 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.ciljqr"} : dispatch 2024-09-21T11:47:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:38 smithi149 ceph-mon[79770]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:39.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:38 smithi149 ceph-mon[79770]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:39.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.365+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fca8c108b90 con 0x7fca8c106620 2024-09-21T11:47:39.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.365+0000 7fca89ffb640 1 -- 172.21.15.118:0/1909741380 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fca78069520 con 0x7fca8c106620 2024-09-21T11:47:39.367 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:47:39.367 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:47:39.368 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:47:39.368 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:47:39.368 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:47:39.368 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:47:39.368 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:47:39.368 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:47:39.369 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:47:39.369 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:47:39.369 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:47:39.369 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T11:47:39.369 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T11:47:39.369 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:47:39.369 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:47:39.370 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T11:47:39.370 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 11 2024-09-21T11:47:39.370 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:47:39.370 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:47:39.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca7c07af30 msgr2=0x7fca7c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca7c07af30 0x7fca7c07d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fca80031460 tx=0x7fca80009560 comp rx=0 tx=0).stop 2024-09-21T11:47:39.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 msgr2=0x7fca8c196bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 0x7fca8c196bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c8f0 tx=0x7fca7800cdb0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 shutdown_connections 2024-09-21T11:47:39.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca7c07af30 0x7fca7c07d3f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8c106620 0x7fca8c196bd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 --2- 172.21.15.118:0/1909741380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8c100620 0x7fca8c196690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 >> 172.21.15.118:0/1909741380 conn(0x7fca8c0fc360 msgr2=0x7fca8c0fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:39.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 shutdown_connections 2024-09-21T11:47:39.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.368+0000 7fca91ba2640 1 -- 172.21.15.118:0/1909741380 wait complete. 2024-09-21T11:47:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/3140073469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 msgr2=0x7f7fcc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 --2- 172.21.15.118:0/3140073469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 0x7f7fcc106c00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009880 tx=0x7f7fbc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/3140073469 shutdown_connections 2024-09-21T11:47:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 --2- 172.21.15.118:0/3140073469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fcc100820 0x7f7fcc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 --2- 172.21.15.118:0/3140073469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 0x7f7fcc106c00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/3140073469 >> 172.21.15.118:0/3140073469 conn(0x7f7fcc0fc520 msgr2=0x7f7fcc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/3140073469 shutdown_connections 2024-09-21T11:47:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/3140073469 wait complete. 2024-09-21T11:47:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 Processor -- start 2024-09-21T11:47:39.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.450+0000 7f7fd3eb1640 1 -- start start 2024-09-21T11:47:39.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd3eb1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fcc100820 0x7f7fcc1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:39.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd3eb1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 0x7f7fcc198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:39.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd3eb1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc10dcd0 con 0x7f7fcc106820 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd3eb1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc10db50 con 0x7f7fcc100820 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd144c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 0x7f7fcc198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd144c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 0x7f7fcc198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54466/0 (socket says 172.21.15.118:54466) 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd144c640 1 -- 172.21.15.118:0/1511329123 learned_addr learned my addr 172.21.15.118:0/1511329123 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd1c4d640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fcc100820 0x7f7fcc1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd144c640 1 -- 172.21.15.118:0/1511329123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fcc100820 msgr2=0x7f7fcc1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd144c640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fcc100820 0x7f7fcc1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd144c640 1 -- 172.21.15.118:0/1511329123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc199290 con 0x7f7fcc106820 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd1c4d640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fcc100820 0x7f7fcc1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd144c640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 0x7f7fcc198d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c8a0 tx=0x7f7fc800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:39.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fc2ffd640 1 -- 172.21.15.118:0/1511329123 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fc80079b0 con 0x7f7fcc106820 2024-09-21T11:47:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fc2ffd640 1 -- 172.21.15.118:0/1511329123 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fc8007b50 con 0x7f7fcc106820 2024-09-21T11:47:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc199580 con 0x7f7fcc106820 2024-09-21T11:47:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.451+0000 7f7fc2ffd640 1 -- 172.21.15.118:0/1511329123 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fc8018700 con 0x7f7fcc106820 2024-09-21T11:47:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.452+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc1a1b80 con 0x7f7fcc106820 2024-09-21T11:47:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.452+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fcc101f60 con 0x7f7fcc106820 2024-09-21T11:47:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.453+0000 7f7fc2ffd640 1 -- 172.21.15.118:0/1511329123 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7fc8007d00 con 0x7f7fcc106820 2024-09-21T11:47:39.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.453+0000 7f7fc2ffd640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7fb807af30 0x7f7fb807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:39.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.454+0000 7f7fc2ffd640 1 -- 172.21.15.118:0/1511329123 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f7fc809e3a0 con 0x7f7fcc106820 2024-09-21T11:47:39.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.454+0000 7f7fd1c4d640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7fb807af30 0x7f7fb807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:39.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.454+0000 7f7fd1c4d640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7fb807af30 0x7f7fb807d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc006010 tx=0x7f7fbc0095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:39.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.458+0000 7f7fc2ffd640 1 -- 172.21.15.118:0/1511329123 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fc8014030 con 0x7f7fcc106820 2024-09-21T11:47:39.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.691+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7fcc103a80 con 0x7f7fcc106820 2024-09-21T11:47:39.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.692+0000 7f7fc2ffd640 1 -- 172.21.15.118:0/1511329123 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2006 (secure 0 0 0) 0x7f7fcc103a80 con 0x7f7fcc106820 2024-09-21T11:47:39.693 INFO:teuthology.orchestra.run.smithi118.stdout:e20 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:47:38:291128+0000 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:47:39.694 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:47:39.695 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:47:39.696 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:47:39.697 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:47:39.697 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:47:39.697 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:24305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/2469878089,v1:172.21.15.149:6825/2469878089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:47:39.697 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34310} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/1975444019,v1:172.21.15.118:6827/1975444019] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:47:39.697 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:47:39.697 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 20 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7fb807af30 msgr2=0x7f7fb807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7fb807af30 0x7f7fb807d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc006010 tx=0x7f7fbc0095f0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 msgr2=0x7f7fcc198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 0x7f7fcc198d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c8a0 tx=0x7f7fc800cd60 comp rx=0 tx=0).stop 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 shutdown_connections 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7fb807af30 0x7f7fb807d3f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fcc106820 0x7f7fcc198d20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 --2- 172.21.15.118:0/1511329123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fcc100820 0x7f7fcc1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 >> 172.21.15.118:0/1511329123 conn(0x7f7fcc0fc520 msgr2=0x7f7fcc0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 shutdown_connections 2024-09-21T11:47:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.694+0000 7f7fd3eb1640 1 -- 172.21.15.118:0/1511329123 wait complete. 2024-09-21T11:47:39.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.779+0000 7fe0aa37c640 1 -- 172.21.15.118:0/3995518633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 msgr2=0x7fe0a4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.779+0000 7fe0aa37c640 1 --2- 172.21.15.118:0/3995518633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 0x7fe0a4100c40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe098009880 tx=0x7fe09802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.779+0000 7fe0aa37c640 1 -- 172.21.15.118:0/3995518633 shutdown_connections 2024-09-21T11:47:39.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.779+0000 7fe0aa37c640 1 --2- 172.21.15.118:0/3995518633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 0x7fe0a4100c40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.779+0000 7fe0aa37c640 1 --2- 172.21.15.118:0/3995518633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a41067e0 0x7fe0a4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.779+0000 7fe0aa37c640 1 -- 172.21.15.118:0/3995518633 >> 172.21.15.118:0/3995518633 conn(0x7fe0a40fc4c0 msgr2=0x7fe0a40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:39.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.779+0000 7fe0aa37c640 1 -- 172.21.15.118:0/3995518633 shutdown_connections 2024-09-21T11:47:39.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.779+0000 7fe0aa37c640 1 -- 172.21.15.118:0/3995518633 wait complete. 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.780+0000 7fe0aa37c640 1 Processor -- start 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.780+0000 7fe0aa37c640 1 -- start start 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.780+0000 7fe0aa37c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 0x7fe0a41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.780+0000 7fe0aa37c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a41067e0 0x7fe0a4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.780+0000 7fe0aa37c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a410dcb0 con 0x7fe0a41007e0 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.780+0000 7fe0aa37c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a410db30 con 0x7fe0a41067e0 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.780+0000 7fe0a3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 0x7fe0a41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.780+0000 7fe0a3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 0x7fe0a41987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54488/0 (socket says 172.21.15.118:54488) 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.780+0000 7fe0a3fff640 1 -- 172.21.15.118:0/1530222063 learned_addr learned my addr 172.21.15.118:0/1530222063 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:39.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0a37fe640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a41067e0 0x7fe0a4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0a3fff640 1 -- 172.21.15.118:0/1530222063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a41067e0 msgr2=0x7fe0a4198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0a3fff640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a41067e0 0x7fe0a4198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0a3fff640 1 -- 172.21.15.118:0/1530222063 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a4199320 con 0x7fe0a41007e0 2024-09-21T11:47:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0a3fff640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 0x7fe0a41987e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe09400d6f0 tx=0x7fe09400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0a17fa640 1 -- 172.21.15.118:0/1530222063 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe094017070 con 0x7fe0a41007e0 2024-09-21T11:47:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0a17fa640 1 -- 172.21.15.118:0/1530222063 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe09400de00 con 0x7fe0a41007e0 2024-09-21T11:47:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0a17fa640 1 -- 172.21.15.118:0/1530222063 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe094004bb0 con 0x7fe0a41007e0 2024-09-21T11:47:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a4199610 con 0x7fe0a41007e0 2024-09-21T11:47:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.781+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a41a1c10 con 0x7fe0a41007e0 2024-09-21T11:47:39.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.782+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a4101f20 con 0x7fe0a41007e0 2024-09-21T11:47:39.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.783+0000 7fe0a17fa640 1 -- 172.21.15.118:0/1530222063 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe094010460 con 0x7fe0a41007e0 2024-09-21T11:47:39.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.783+0000 7fe0a17fa640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe08c07af90 0x7fe08c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:39.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.783+0000 7fe0a17fa640 1 -- 172.21.15.118:0/1530222063 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fe09409dba0 con 0x7fe0a41007e0 2024-09-21T11:47:39.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.783+0000 7fe0a37fe640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe08c07af90 0x7fe08c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:39.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.784+0000 7fe0a37fe640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe08c07af90 0x7fe08c07d450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0a406a680 tx=0x7fe098031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:39.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:39.788+0000 7fe0a17fa640 1 -- 172.21.15.118:0/1530222063 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0a4199610 con 0x7fe0a41007e0 2024-09-21T11:47:40.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.002+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe0a4062630 con 0x7fe08c07af90 2024-09-21T11:47:40.004 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:39 smithi118 ceph-mon[111738]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:40.004 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:39 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1909741380' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:40.004 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:39 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1511329123' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:47:40.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.004+0000 7fe0a17fa640 1 -- 172.21.15.118:0/1530222063 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fe0a4062630 con 0x7fe08c07af90 2024-09-21T11:47:40.005 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:47:40.005 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:47:40.005 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:47:40.005 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:47:40.005 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:47:40.005 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:47:40.005 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:47:40.006 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:47:40.006 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:47:40.006 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:47:40.006 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "12/23 daemons upgraded", 2024-09-21T11:47:40.006 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:47:40.006 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:47:40.006 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:47:40.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe08c07af90 msgr2=0x7fe08c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe08c07af90 0x7fe08c07d450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0a406a680 tx=0x7fe098031400 comp rx=0 tx=0).stop 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 msgr2=0x7fe0a41987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 0x7fe0a41987e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe09400d6f0 tx=0x7fe09400dbb0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 shutdown_connections 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a41067e0 0x7fe0a4198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe08c07af90 0x7fe08c07d450 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 --2- 172.21.15.118:0/1530222063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a41007e0 0x7fe0a41987e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 >> 172.21.15.118:0/1530222063 conn(0x7fe0a40fc4c0 msgr2=0x7fe0a40fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 shutdown_connections 2024-09-21T11:47:40.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.006+0000 7fe0aa37c640 1 -- 172.21.15.118:0/1530222063 wait complete. 2024-09-21T11:47:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.091+0000 7fb6347f5640 1 -- 172.21.15.118:0/1072998651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1067f0 msgr2=0x7fb62c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.091+0000 7fb6347f5640 1 --2- 172.21.15.118:0/1072998651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1067f0 0x7fb62c106bd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb628009880 tx=0x7fb62802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.091+0000 7fb6347f5640 1 -- 172.21.15.118:0/1072998651 shutdown_connections 2024-09-21T11:47:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.091+0000 7fb6347f5640 1 --2- 172.21.15.118:0/1072998651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb62c1007f0 0x7fb62c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.091+0000 7fb6347f5640 1 --2- 172.21.15.118:0/1072998651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1067f0 0x7fb62c106bd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.091+0000 7fb6347f5640 1 -- 172.21.15.118:0/1072998651 >> 172.21.15.118:0/1072998651 conn(0x7fb62c0fc4f0 msgr2=0x7fb62c0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.091+0000 7fb6347f5640 1 -- 172.21.15.118:0/1072998651 shutdown_connections 2024-09-21T11:47:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.091+0000 7fb6347f5640 1 -- 172.21.15.118:0/1072998651 wait complete. 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb6347f5640 1 Processor -- start 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb6347f5640 1 -- start start 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb6347f5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1007f0 0x7fb62c0fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb6347f5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb62c1067f0 0x7fb62c0fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb6347f5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c10dcc0 con 0x7fb62c1007f0 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb6347f5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c10db40 con 0x7fb62c1067f0 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb632591640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1007f0 0x7fb62c0fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb632591640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1007f0 0x7fb62c0fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54504/0 (socket says 172.21.15.118:54504) 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb632591640 1 -- 172.21.15.118:0/3491087723 learned_addr learned my addr 172.21.15.118:0/3491087723 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:47:40.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb631d90640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb62c1067f0 0x7fb62c0fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb632591640 1 -- 172.21.15.118:0/3491087723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb62c1067f0 msgr2=0x7fb62c0fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb632591640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb62c1067f0 0x7fb62c0fd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb632591640 1 -- 172.21.15.118:0/3491087723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c0fd690 con 0x7fb62c1007f0 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.092+0000 7fb631d90640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb62c1067f0 0x7fb62c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.093+0000 7fb632591640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1007f0 0x7fb62c0fcc10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb628031460 tx=0x7fb6280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.093+0000 7fb6237fe640 1 -- 172.21.15.118:0/3491087723 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb62803f070 con 0x7fb62c1007f0 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.093+0000 7fb6237fe640 1 -- 172.21.15.118:0/3491087723 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb6280035f0 con 0x7fb62c1007f0 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.093+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62c0fd920 con 0x7fb62c1007f0 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.093+0000 7fb6237fe640 1 -- 172.21.15.118:0/3491087723 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb628035030 con 0x7fb62c1007f0 2024-09-21T11:47:40.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.093+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb62c1a3d60 con 0x7fb62c1007f0 2024-09-21T11:47:40.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.094+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62c101f30 con 0x7fb62c1007f0 2024-09-21T11:47:40.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.095+0000 7fb6237fe640 1 -- 172.21.15.118:0/3491087723 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb628042070 con 0x7fb62c1007f0 2024-09-21T11:47:40.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.096+0000 7fb6237fe640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb61807af80 0x7fb61807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:47:40.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.096+0000 7fb631d90640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb61807af80 0x7fb61807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:47:40.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.096+0000 7fb6237fe640 1 -- 172.21.15.118:0/3491087723 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fb6280be9c0 con 0x7fb62c1007f0 2024-09-21T11:47:40.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.096+0000 7fb631d90640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb61807af80 0x7fb61807d440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0058c0 tx=0x7fb61c005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:47:40.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.100+0000 7fb6237fe640 1 -- 172.21.15.118:0/3491087723 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb628089f90 con 0x7fb62c1007f0 2024-09-21T11:47:40.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:39 smithi149 ceph-mon[79770]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:40.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:39 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1909741380' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:40.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:39 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1511329123' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:47:40.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.360+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb62c109d70 con 0x7fb62c1007f0 2024-09-21T11:47:40.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.360+0000 7fb6237fe640 1 -- 172.21.15.118:0/3491087723 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fb62808ee40 con 0x7fb62c1007f0 2024-09-21T11:47:40.362 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:47:40.363 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:47:40.363 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:47:40.363 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:47:40.363 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:47:40.363 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:47:40.363 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:47:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.362+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb61807af80 msgr2=0x7fb61807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.362+0000 7fb6347f5640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb61807af80 0x7fb61807d440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0058c0 tx=0x7fb61c005850 comp rx=0 tx=0).stop 2024-09-21T11:47:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.362+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1007f0 msgr2=0x7fb62c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:47:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.362+0000 7fb6347f5640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1007f0 0x7fb62c0fcc10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb628031460 tx=0x7fb6280045e0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.363+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 shutdown_connections 2024-09-21T11:47:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.363+0000 7fb6347f5640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb62c1067f0 0x7fb62c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.363+0000 7fb6347f5640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb61807af80 0x7fb61807d440 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.363+0000 7fb6347f5640 1 --2- 172.21.15.118:0/3491087723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c1007f0 0x7fb62c0fcc10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:47:40.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.363+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 >> 172.21.15.118:0/3491087723 conn(0x7fb62c0fc4f0 msgr2=0x7fb62c06a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:47:40.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.363+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 shutdown_connections 2024-09-21T11:47:40.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:47:40.363+0000 7fb6347f5640 1 -- 172.21.15.118:0/3491087723 wait complete. 2024-09-21T11:47:41.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:40 smithi118 ceph-mon[111738]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:41.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:40 smithi118 ceph-mon[111738]: pgmap v263: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:41.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:40 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3491087723' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:47:41.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:40 smithi149 ceph-mon[79770]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:47:41.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:40 smithi149 ceph-mon[79770]: pgmap v263: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:41.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:40 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3491087723' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:47:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:43 smithi149 ceph-mon[79770]: pgmap v264: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:43 smithi118 ceph-mon[111738]: pgmap v264: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:44.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:44.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:44.782 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:44.782 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:45.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:45 smithi149 ceph-mon[79770]: pgmap v265: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:45.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:45.820 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:45 smithi118 ceph-mon[111738]: pgmap v265: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:45.820 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: pgmap v266: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:47.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:47 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: pgmap v266: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:47:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:47.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:47.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:47.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:47 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:47:49.182 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:48 smithi118 ceph-mon[111738]: Upgrade: Updating mds.cephfs.smithi118.macjke 2024-09-21T11:47:49.182 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:48 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:49.182 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:48 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.macjke", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T11:47:49.182 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:48 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:49.182 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:48 smithi118 ceph-mon[111738]: Deploying daemon mds.cephfs.smithi118.macjke on smithi118 2024-09-21T11:47:49.182 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:48 smithi118 ceph-mon[111738]: pgmap v267: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:49.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:48 smithi149 ceph-mon[79770]: Upgrade: Updating mds.cephfs.smithi118.macjke 2024-09-21T11:47:49.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:48 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:48 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi118.macjke", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T11:47:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:48 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:47:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:48 smithi149 ceph-mon[79770]: Deploying daemon mds.cephfs.smithi118.macjke on smithi118 2024-09-21T11:47:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:48 smithi149 ceph-mon[79770]: pgmap v267: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:51.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:47:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:50 smithi149 ceph-mon[79770]: pgmap v268: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:47:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:50 smithi118 ceph-mon[111738]: pgmap v268: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:52.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:51 smithi149 ceph-mon[79770]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T11:47:52.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:51 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T11:47:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:51 smithi118 ceph-mon[111738]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T11:47:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:51 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T11:47:53.254 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:52 smithi118 ceph-mon[111738]: pgmap v270: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:53.260 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:52 smithi149 ceph-mon[79770]: pgmap v270: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:55 smithi118 ceph-mon[111738]: pgmap v271: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:55 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:boot 2024-09-21T11:47:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:55 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T11:47:55.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:55 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"} : dispatch 2024-09-21T11:47:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:55 smithi149 ceph-mon[79770]: pgmap v271: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:47:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:55 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:boot 2024-09-21T11:47:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:55 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T11:47:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:55 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi118.macjke"} : dispatch 2024-09-21T11:47:57.541 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:57 smithi118 ceph-mon[111738]: pgmap v272: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:57.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:57 smithi149 ceph-mon[79770]: pgmap v272: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:59 smithi118 ceph-mon[111738]: pgmap v273: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:59 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:47:59 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:59 smithi149 ceph-mon[79770]: pgmap v273: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:47:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:59 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:47:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:47:59 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:01.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:00 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:01.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:00 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:01.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:00 smithi149 ceph-mon[79770]: pgmap v274: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:01.265 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:00 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:01.265 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:00 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:01.265 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:00 smithi118 ceph-mon[111738]: pgmap v274: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: pgmap v275: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:48:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:48:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:48:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:03.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:03 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: pgmap v275: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:03.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:03 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:05.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:05 smithi118 ceph-mon[111738]: pgmap v276: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:05.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:05 smithi118 ceph-mon[111738]: Upgrade: Updating mds.cephfs.smithi149.zgoqsi 2024-09-21T11:48:05.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:05.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zgoqsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T11:48:05.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:48:05.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:05 smithi118 ceph-mon[111738]: Deploying daemon mds.cephfs.smithi149.zgoqsi on smithi149 2024-09-21T11:48:05.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:48:05.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:05 smithi149 ceph-mon[79770]: pgmap v276: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:05.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:05 smithi149 ceph-mon[79770]: Upgrade: Updating mds.cephfs.smithi149.zgoqsi 2024-09-21T11:48:05.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:05.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zgoqsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T11:48:05.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T11:48:05.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:05 smithi149 ceph-mon[79770]: Deploying daemon mds.cephfs.smithi149.zgoqsi on smithi149 2024-09-21T11:48:05.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:48:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:07 smithi118 ceph-mon[111738]: pgmap v277: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:07 smithi118 ceph-mon[111738]: osdmap e81: 6 total, 6 up, 6 in 2024-09-21T11:48:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:07 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T11:48:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:07 smithi149 ceph-mon[79770]: pgmap v277: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:07 smithi149 ceph-mon[79770]: osdmap e81: 6 total, 6 up, 6 in 2024-09-21T11:48:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:07 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T11:48:09.852 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:09 smithi118 ceph-mon[111738]: pgmap v279: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:09 smithi149 ceph-mon[79770]: pgmap v279: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:10.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.456+0000 7f83a0885640 1 -- 172.21.15.118:0/1291552961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 msgr2=0x7f839c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:10.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.456+0000 7f83a0885640 1 --2- 172.21.15.118:0/1291552961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 0x7f839c102ec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f838c009c20 tx=0x7f838c02aa00 comp rx=0 tx=0).stop 2024-09-21T11:48:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.456+0000 7f83a0885640 1 -- 172.21.15.118:0/1291552961 shutdown_connections 2024-09-21T11:48:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.456+0000 7f83a0885640 1 --2- 172.21.15.118:0/1291552961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c103400 0x7f839c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.456+0000 7f83a0885640 1 --2- 172.21.15.118:0/1291552961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 0x7f839c102ec0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.456+0000 7f83a0885640 1 -- 172.21.15.118:0/1291552961 >> 172.21.15.118:0/1291552961 conn(0x7f839c0fc520 msgr2=0x7f839c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.456+0000 7f83a0885640 1 -- 172.21.15.118:0/1291552961 shutdown_connections 2024-09-21T11:48:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.456+0000 7f83a0885640 1 -- 172.21.15.118:0/1291552961 wait complete. 2024-09-21T11:48:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f83a0885640 1 Processor -- start 2024-09-21T11:48:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f83a0885640 1 -- start start 2024-09-21T11:48:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f83a0885640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 0x7f839c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f83a0885640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c103400 0x7f839c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f83a0885640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f839c10edf0 con 0x7f839c102ae0 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f83a0885640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f839c10ec70 con 0x7f839c103400 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f839a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 0x7f839c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f839a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 0x7f839c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44730/0 (socket says 172.21.15.118:44730) 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f839a59c640 1 -- 172.21.15.118:0/2064887604 learned_addr learned my addr 172.21.15.118:0/2064887604 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f8399d9b640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c103400 0x7f839c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f839a59c640 1 -- 172.21.15.118:0/2064887604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c103400 msgr2=0x7f839c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f839a59c640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c103400 0x7f839c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.457+0000 7f839a59c640 1 -- 172.21.15.118:0/2064887604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c1977e0 con 0x7f839c102ae0 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.458+0000 7f839a59c640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 0x7f839c19d660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f838c02af20 tx=0x7f838c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.458+0000 7f838b7fe640 1 -- 172.21.15.118:0/2064887604 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f838c047070 con 0x7f839c102ae0 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.458+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c197a70 con 0x7f839c102ae0 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.458+0000 7f838b7fe640 1 -- 172.21.15.118:0/2064887604 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f838c003e30 con 0x7f839c102ae0 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.458+0000 7f838b7fe640 1 -- 172.21.15.118:0/2064887604 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f838c033050 con 0x7f839c102ae0 2024-09-21T11:48:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.458+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c197fa0 con 0x7f839c102ae0 2024-09-21T11:48:10.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.459+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c06abe0 con 0x7f839c102ae0 2024-09-21T11:48:10.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.460+0000 7f838b7fe640 1 -- 172.21.15.118:0/2064887604 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f838c04a070 con 0x7f839c102ae0 2024-09-21T11:48:10.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.460+0000 7f838b7fe640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f838407af40 0x7f838407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:10.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.460+0000 7f8399d9b640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f838407af40 0x7f838407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:10.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.460+0000 7f838b7fe640 1 -- 172.21.15.118:0/2064887604 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f838c03e030 con 0x7f839c102ae0 2024-09-21T11:48:10.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.461+0000 7f8399d9b640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f838407af40 0x7f838407d400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f839c108920 tx=0x7f839000b360 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:10.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.465+0000 7f838b7fe640 1 -- 172.21.15.118:0/2064887604 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f838c08a5f0 con 0x7f839c102ae0 2024-09-21T11:48:10.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.659+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f839c198310 con 0x7f838407af40 2024-09-21T11:48:10.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.661+0000 7f838b7fe640 1 -- 172.21.15.118:0/2064887604 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f839c198310 con 0x7f838407af40 2024-09-21T11:48:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f838407af40 msgr2=0x7f838407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f838407af40 0x7f838407d400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f839c108920 tx=0x7f839000b360 comp rx=0 tx=0).stop 2024-09-21T11:48:10.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 msgr2=0x7f839c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:10.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 0x7f839c19d660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f838c02af20 tx=0x7f838c02ee60 comp rx=0 tx=0).stop 2024-09-21T11:48:10.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 shutdown_connections 2024-09-21T11:48:10.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c103400 0x7f839c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f838407af40 0x7f838407d400 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 --2- 172.21.15.118:0/2064887604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c102ae0 0x7f839c19d660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 >> 172.21.15.118:0/2064887604 conn(0x7f839c0fc520 msgr2=0x7f839c108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:10.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 shutdown_connections 2024-09-21T11:48:10.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.663+0000 7f83a0885640 1 -- 172.21.15.118:0/2064887604 wait complete. 2024-09-21T11:48:10.675 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:48:10.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.746+0000 7f567d95a640 1 -- 172.21.15.118:0/571739696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781007e0 msgr2=0x7f5678100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:10.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.746+0000 7f567d95a640 1 --2- 172.21.15.118:0/571739696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781007e0 0x7f5678100c40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5660009880 tx=0x7f566002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.746+0000 7f567d95a640 1 -- 172.21.15.118:0/571739696 shutdown_connections 2024-09-21T11:48:10.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.746+0000 7f567d95a640 1 --2- 172.21.15.118:0/571739696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781007e0 0x7f5678100c40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.746+0000 7f567d95a640 1 --2- 172.21.15.118:0/571739696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56781067e0 0x7f5678106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.746+0000 7f567d95a640 1 -- 172.21.15.118:0/571739696 >> 172.21.15.118:0/571739696 conn(0x7f56780fc4c0 msgr2=0x7f56780fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:10.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.746+0000 7f567d95a640 1 -- 172.21.15.118:0/571739696 shutdown_connections 2024-09-21T11:48:10.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.746+0000 7f567d95a640 1 -- 172.21.15.118:0/571739696 wait complete. 2024-09-21T11:48:10.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.746+0000 7f567d95a640 1 Processor -- start 2024-09-21T11:48:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f567d95a640 1 -- start start 2024-09-21T11:48:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f567d95a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56781007e0 0x7f56780fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f567d95a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781067e0 0x7f56780fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f567d95a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f567810dcb0 con 0x7f56781067e0 2024-09-21T11:48:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f567d95a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f567810db30 con 0x7f56781007e0 2024-09-21T11:48:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f56767fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781067e0 0x7f56780fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f56767fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781067e0 0x7f56780fd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44748/0 (socket says 172.21.15.118:44748) 2024-09-21T11:48:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f56767fc640 1 -- 172.21.15.118:0/922867662 learned_addr learned my addr 172.21.15.118:0/922867662 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f5676ffd640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56781007e0 0x7f56780fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f56767fc640 1 -- 172.21.15.118:0/922867662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56781007e0 msgr2=0x7f56780fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f56767fc640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56781007e0 0x7f56780fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.747+0000 7f56767fc640 1 -- 172.21.15.118:0/922867662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56780fd710 con 0x7f56781067e0 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.748+0000 7f56767fc640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781067e0 0x7f56780fd1d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5660031460 tx=0x7f56600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.748+0000 7f567c958640 1 -- 172.21.15.118:0/922867662 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f566003f070 con 0x7f56781067e0 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.748+0000 7f567c958640 1 -- 172.21.15.118:0/922867662 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56600035f0 con 0x7f56781067e0 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.748+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56780fd9a0 con 0x7f56781067e0 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.748+0000 7f567c958640 1 -- 172.21.15.118:0/922867662 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5660035030 con 0x7f56781067e0 2024-09-21T11:48:10.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.748+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56781a3df0 con 0x7f56781067e0 2024-09-21T11:48:10.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.749+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5678101f20 con 0x7f56781067e0 2024-09-21T11:48:10.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.750+0000 7f567c958640 1 -- 172.21.15.118:0/922867662 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5660042070 con 0x7f56781067e0 2024-09-21T11:48:10.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.750+0000 7f567c958640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f566407af30 0x7f566407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:10.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.750+0000 7f567c958640 1 -- 172.21.15.118:0/922867662 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f56600bea20 con 0x7f56781067e0 2024-09-21T11:48:10.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.750+0000 7f5676ffd640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f566407af30 0x7f566407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:10.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.751+0000 7f5676ffd640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f566407af30 0x7f566407d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5670005fd0 tx=0x7f5670009680 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:10.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.754+0000 7f567c958640 1 -- 172.21.15.118:0/922867662 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5660089f70 con 0x7f56781067e0 2024-09-21T11:48:10.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.956+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5678062630 con 0x7f566407af30 2024-09-21T11:48:10.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.958+0000 7f567c958640 1 -- 172.21.15.118:0/922867662 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5678062630 con 0x7f566407af30 2024-09-21T11:48:10.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f566407af30 msgr2=0x7f566407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:10.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f566407af30 0x7f566407d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5670005fd0 tx=0x7f5670009680 comp rx=0 tx=0).stop 2024-09-21T11:48:10.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781067e0 msgr2=0x7f56780fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:10.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781067e0 0x7f56780fd1d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5660031460 tx=0x7f56600045e0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 shutdown_connections 2024-09-21T11:48:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f566407af30 0x7f566407d3f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56781067e0 0x7f56780fd1d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 --2- 172.21.15.118:0/922867662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56781007e0 0x7f56780fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 >> 172.21.15.118:0/922867662 conn(0x7f56780fc4c0 msgr2=0x7f5678069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 shutdown_connections 2024-09-21T11:48:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:10.960+0000 7f567d95a640 1 -- 172.21.15.118:0/922867662 wait complete. 2024-09-21T11:48:11.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.042+0000 7efc80b57640 1 -- 172.21.15.118:0/3456609364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c100820 msgr2=0x7efc7c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.042+0000 7efc80b57640 1 --2- 172.21.15.118:0/3456609364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c100820 0x7efc7c100c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc64009880 tx=0x7efc6402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.042+0000 7efc80b57640 1 -- 172.21.15.118:0/3456609364 shutdown_connections 2024-09-21T11:48:11.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.042+0000 7efc80b57640 1 --2- 172.21.15.118:0/3456609364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c100820 0x7efc7c100c80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.042+0000 7efc80b57640 1 --2- 172.21.15.118:0/3456609364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc7c106820 0x7efc7c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.042+0000 7efc80b57640 1 -- 172.21.15.118:0/3456609364 >> 172.21.15.118:0/3456609364 conn(0x7efc7c0fc520 msgr2=0x7efc7c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:11.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.042+0000 7efc80b57640 1 -- 172.21.15.118:0/3456609364 shutdown_connections 2024-09-21T11:48:11.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.042+0000 7efc80b57640 1 -- 172.21.15.118:0/3456609364 wait complete. 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.043+0000 7efc80b57640 1 Processor -- start 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.043+0000 7efc80b57640 1 -- start start 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.043+0000 7efc80b57640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc7c100820 0x7efc7c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.043+0000 7efc80b57640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c106820 0x7efc7c19cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.043+0000 7efc80b57640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c10dcd0 con 0x7efc7c106820 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.043+0000 7efc80b57640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c10db50 con 0x7efc7c100820 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc73fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c106820 0x7efc7c19cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc73fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c106820 0x7efc7c19cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44756/0 (socket says 172.21.15.118:44756) 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc73fff640 1 -- 172.21.15.118:0/354694727 learned_addr learned my addr 172.21.15.118:0/354694727 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc7a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc7c100820 0x7efc7c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc73fff640 1 -- 172.21.15.118:0/354694727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc7c100820 msgr2=0x7efc7c19c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc73fff640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc7c100820 0x7efc7c19c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc73fff640 1 -- 172.21.15.118:0/354694727 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7c1966b0 con 0x7efc7c106820 2024-09-21T11:48:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc73fff640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c106820 0x7efc7c19cb20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efc64031460 tx=0x7efc640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:11.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc737fe640 1 -- 172.21.15.118:0/354694727 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc6403f070 con 0x7efc7c106820 2024-09-21T11:48:11.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7c196940 con 0x7efc7c106820 2024-09-21T11:48:11.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc737fe640 1 -- 172.21.15.118:0/354694727 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efc640035f0 con 0x7efc7c106820 2024-09-21T11:48:11.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.044+0000 7efc737fe640 1 -- 172.21.15.118:0/354694727 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc64035030 con 0x7efc7c106820 2024-09-21T11:48:11.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.045+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7c196e40 con 0x7efc7c106820 2024-09-21T11:48:11.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.046+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7c101f60 con 0x7efc7c106820 2024-09-21T11:48:11.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.046+0000 7efc737fe640 1 -- 172.21.15.118:0/354694727 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7efc64042070 con 0x7efc7c106820 2024-09-21T11:48:11.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.047+0000 7efc737fe640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc6807af30 0x7efc6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.047+0000 7efc737fe640 1 -- 172.21.15.118:0/354694727 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7efc640bea20 con 0x7efc7c106820 2024-09-21T11:48:11.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.047+0000 7efc7a59c640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc6807af30 0x7efc6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.047+0000 7efc7a59c640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc6807af30 0x7efc6807d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efc6c005d00 tx=0x7efc6c00b410 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:11.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.051+0000 7efc737fe640 1 -- 172.21.15.118:0/354694727 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc64089f70 con 0x7efc7c106820 2024-09-21T11:48:11.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.235+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7efc7c197070 con 0x7efc6807af30 2024-09-21T11:48:11.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.245+0000 7efc737fe640 1 -- 172.21.15.118:0/354694727 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7efc7c197070 con 0x7efc6807af30 2024-09-21T11:48:11.247 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (6m) 11s ago 17m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (9m) 11s ago 17m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (8m) 46s ago 16m 8632k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (4m) 11s ago 17m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (4m) 46s ago 16m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (5m) 11s ago 16m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (33s) 11s ago 11m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (17s) 11s ago 11m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (11m) 46s ago 11m 23.5M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 starting - - - - 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (8m) 11s ago 18m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (7m) 46s ago 16m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (4m) 11s ago 18m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:48:11.248 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (4m) 46s ago 16m 37.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:48:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (6m) 11s ago 17m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:48:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (6m) 46s ago 16m 11.9M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:48:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (3m) 11s ago 15m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:48:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (3m) 11s ago 14m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:48:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (2m) 11s ago 14m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:48:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (118s) 46s ago 13m 99.9M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:48:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (83s) 46s ago 13m 86.7M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:48:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (49s) 46s ago 12m 11.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:48:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (6m) 11s ago 16m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:48:11.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc6807af30 msgr2=0x7efc6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc6807af30 0x7efc6807d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efc6c005d00 tx=0x7efc6c00b410 comp rx=0 tx=0).stop 2024-09-21T11:48:11.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c106820 msgr2=0x7efc7c19cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c106820 0x7efc7c19cb20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efc64031460 tx=0x7efc640045e0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 shutdown_connections 2024-09-21T11:48:11.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc6807af30 0x7efc6807d3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc7c106820 0x7efc7c19cb20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 --2- 172.21.15.118:0/354694727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc7c100820 0x7efc7c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 >> 172.21.15.118:0/354694727 conn(0x7efc7c0fc520 msgr2=0x7efc7c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:11.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 shutdown_connections 2024-09-21T11:48:11.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.248+0000 7efc80b57640 1 -- 172.21.15.118:0/354694727 wait complete. 2024-09-21T11:48:11.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.328+0000 7f3a361ef640 1 -- 172.21.15.118:0/2559813016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30106820 msgr2=0x7f3a30106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.328+0000 7f3a361ef640 1 --2- 172.21.15.118:0/2559813016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30106820 0x7f3a30106c00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009880 tx=0x7f3a2002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.328+0000 7f3a361ef640 1 -- 172.21.15.118:0/2559813016 shutdown_connections 2024-09-21T11:48:11.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.328+0000 7f3a361ef640 1 --2- 172.21.15.118:0/2559813016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30100820 0x7f3a30100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.328+0000 7f3a361ef640 1 --2- 172.21.15.118:0/2559813016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30106820 0x7f3a30106c00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.328+0000 7f3a361ef640 1 -- 172.21.15.118:0/2559813016 >> 172.21.15.118:0/2559813016 conn(0x7f3a300fc520 msgr2=0x7f3a300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:11.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.328+0000 7f3a361ef640 1 -- 172.21.15.118:0/2559813016 shutdown_connections 2024-09-21T11:48:11.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.328+0000 7f3a361ef640 1 -- 172.21.15.118:0/2559813016 wait complete. 2024-09-21T11:48:11.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.329+0000 7f3a361ef640 1 Processor -- start 2024-09-21T11:48:11.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.329+0000 7f3a361ef640 1 -- start start 2024-09-21T11:48:11.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.329+0000 7f3a361ef640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100820 0x7f3a301987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.329+0000 7f3a361ef640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30106820 0x7f3a30198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.329+0000 7f3a361ef640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3010dcd0 con 0x7f3a30100820 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.329+0000 7f3a361ef640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3010db50 con 0x7f3a30106820 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.329+0000 7f3a2f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100820 0x7f3a301987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100820 0x7f3a301987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44776/0 (socket says 172.21.15.118:44776) 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2f7fe640 1 -- 172.21.15.118:0/2486069942 learned_addr learned my addr 172.21.15.118:0/2486069942 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2effd640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30106820 0x7f3a30198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2f7fe640 1 -- 172.21.15.118:0/2486069942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30106820 msgr2=0x7f3a30198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2f7fe640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30106820 0x7f3a30198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2f7fe640 1 -- 172.21.15.118:0/2486069942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a30199320 con 0x7f3a30100820 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2f7fe640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100820 0x7f3a301987e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a20031460 tx=0x7f3a200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2cff9640 1 -- 172.21.15.118:0/2486069942 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a2003f070 con 0x7f3a30100820 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a301995b0 con 0x7f3a30100820 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2cff9640 1 -- 172.21.15.118:0/2486069942 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a200035f0 con 0x7f3a30100820 2024-09-21T11:48:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a2cff9640 1 -- 172.21.15.118:0/2486069942 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a20035030 con 0x7f3a30100820 2024-09-21T11:48:11.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.330+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a301a1b60 con 0x7f3a30100820 2024-09-21T11:48:11.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.331+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a30101f60 con 0x7f3a30100820 2024-09-21T11:48:11.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.332+0000 7f3a2cff9640 1 -- 172.21.15.118:0/2486069942 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3a20042070 con 0x7f3a30100820 2024-09-21T11:48:11.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.332+0000 7f3a2cff9640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1807af30 0x7f3a1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.332+0000 7f3a2cff9640 1 -- 172.21.15.118:0/2486069942 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f3a200bea20 con 0x7f3a30100820 2024-09-21T11:48:11.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.332+0000 7f3a2effd640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1807af30 0x7f3a1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.333+0000 7f3a2effd640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1807af30 0x7f3a1807d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3a3006ae50 tx=0x7f3a2400b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.337+0000 7f3a2cff9640 1 -- 172.21.15.118:0/2486069942 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a20089f70 con 0x7f3a30100820 2024-09-21T11:48:11.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.587+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3a30103a30 con 0x7f3a30100820 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.587+0000 7f3a2cff9640 1 -- 172.21.15.118:0/2486069942 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f3a2008c490 con 0x7f3a30100820 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:48:11.590 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:48:11.591 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.589+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1807af30 msgr2=0x7f3a1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.589+0000 7f3a361ef640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1807af30 0x7f3a1807d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3a3006ae50 tx=0x7f3a2400b390 comp rx=0 tx=0).stop 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.589+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100820 msgr2=0x7f3a301987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.589+0000 7f3a361ef640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100820 0x7f3a301987e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a20031460 tx=0x7f3a200045e0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.590+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 shutdown_connections 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.590+0000 7f3a361ef640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a30106820 0x7f3a30198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.590+0000 7f3a361ef640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a1807af30 0x7f3a1807d3f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.590+0000 7f3a361ef640 1 --2- 172.21.15.118:0/2486069942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a30100820 0x7f3a301987e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.590+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 >> 172.21.15.118:0/2486069942 conn(0x7f3a300fc520 msgr2=0x7f3a300fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:11.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.590+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 shutdown_connections 2024-09-21T11:48:11.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.590+0000 7f3a361ef640 1 -- 172.21.15.118:0/2486069942 wait complete. 2024-09-21T11:48:11.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.672+0000 7fc8e2024640 1 -- 172.21.15.118:0/381285271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 msgr2=0x7fc8dc106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.672+0000 7fc8e2024640 1 --2- 172.21.15.118:0/381285271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 0x7fc8dc106bc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009880 tx=0x7fc8cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.672+0000 7fc8e2024640 1 -- 172.21.15.118:0/381285271 shutdown_connections 2024-09-21T11:48:11.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.672+0000 7fc8e2024640 1 --2- 172.21.15.118:0/381285271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8dc1007e0 0x7fc8dc100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.672+0000 7fc8e2024640 1 --2- 172.21.15.118:0/381285271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 0x7fc8dc106bc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.672+0000 7fc8e2024640 1 -- 172.21.15.118:0/381285271 >> 172.21.15.118:0/381285271 conn(0x7fc8dc0fc4c0 msgr2=0x7fc8dc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:11.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.672+0000 7fc8e2024640 1 -- 172.21.15.118:0/381285271 shutdown_connections 2024-09-21T11:48:11.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.672+0000 7fc8e2024640 1 -- 172.21.15.118:0/381285271 wait complete. 2024-09-21T11:48:11.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8e2024640 1 Processor -- start 2024-09-21T11:48:11.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8e2024640 1 -- start start 2024-09-21T11:48:11.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8e2024640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8dc1007e0 0x7fc8dc198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8e2024640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 0x7fc8dc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8e2024640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10dcb0 con 0x7fc8dc1067e0 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8e2024640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10db30 con 0x7fc8dc1007e0 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8daffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 0x7fc8dc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8daffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 0x7fc8dc198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44786/0 (socket says 172.21.15.118:44786) 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8daffd640 1 -- 172.21.15.118:0/470956854 learned_addr learned my addr 172.21.15.118:0/470956854 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8db7fe640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8dc1007e0 0x7fc8dc198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8daffd640 1 -- 172.21.15.118:0/470956854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8dc1007e0 msgr2=0x7fc8dc198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8daffd640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8dc1007e0 0x7fc8dc198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.673+0000 7fc8daffd640 1 -- 172.21.15.118:0/470956854 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc199360 con 0x7fc8dc1067e0 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.674+0000 7fc8daffd640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 0x7fc8dc198d60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000e970 tx=0x7fc8d000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.674+0000 7fc8d8ff9640 1 -- 172.21.15.118:0/470956854 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8d000cac0 con 0x7fc8dc1067e0 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.674+0000 7fc8d8ff9640 1 -- 172.21.15.118:0/470956854 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc8d00054e0 con 0x7fc8dc1067e0 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.674+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc199650 con 0x7fc8dc1067e0 2024-09-21T11:48:11.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.674+0000 7fc8d8ff9640 1 -- 172.21.15.118:0/470956854 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8d0010430 con 0x7fc8dc1067e0 2024-09-21T11:48:11.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.674+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8dc1a1c50 con 0x7fc8dc1067e0 2024-09-21T11:48:11.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.676+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8dc101f20 con 0x7fc8dc1067e0 2024-09-21T11:48:11.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.676+0000 7fc8d8ff9640 1 -- 172.21.15.118:0/470956854 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc8d0004ec0 con 0x7fc8dc1067e0 2024-09-21T11:48:11.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.676+0000 7fc8d8ff9640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc8c407af30 0x7fc8c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.676+0000 7fc8d8ff9640 1 -- 172.21.15.118:0/470956854 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fc8d009e7d0 con 0x7fc8dc1067e0 2024-09-21T11:48:11.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.676+0000 7fc8db7fe640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc8c407af30 0x7fc8c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.677+0000 7fc8db7fe640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc8c407af30 0x7fc8c407d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0096c0 tx=0x7fc8cc031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:11.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.681+0000 7fc8d8ff9640 1 -- 172.21.15.118:0/470956854 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8dc199650 con 0x7fc8dc1067e0 2024-09-21T11:48:11.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.899+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc8dc108d50 con 0x7fc8dc1067e0 2024-09-21T11:48:11.901 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:11 smithi118 ceph-mon[111738]: pgmap v280: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:11.901 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:11 smithi118 ceph-mon[111738]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:11.901 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:11.901 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:11.902 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:48:11.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.899+0000 7fc8d8ff9640 1 -- 172.21.15.118:0/470956854 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7fc8d0069cc0 con 0x7fc8dc1067e0 2024-09-21T11:48:11.902 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:48:11.902 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:48:11.902 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:48:11.902 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:48:11.902 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:48:11.902 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:48:11.903 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:48:11.904 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:48:11.905 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc8c407af30 msgr2=0x7fc8c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc8c407af30 0x7fc8c407d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0096c0 tx=0x7fc8cc031400 comp rx=0 tx=0).stop 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 msgr2=0x7fc8dc198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 0x7fc8dc198d60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000e970 tx=0x7fc8d000ed70 comp rx=0 tx=0).stop 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 shutdown_connections 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc8c407af30 0x7fc8c407d3f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8dc1067e0 0x7fc8dc198d60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 --2- 172.21.15.118:0/470956854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8dc1007e0 0x7fc8dc198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 >> 172.21.15.118:0/470956854 conn(0x7fc8dc0fc4c0 msgr2=0x7fc8dc0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:11.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 shutdown_connections 2024-09-21T11:48:11.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.901+0000 7fc8e2024640 1 -- 172.21.15.118:0/470956854 wait complete. 2024-09-21T11:48:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:11 smithi149 ceph-mon[79770]: pgmap v280: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:11 smithi149 ceph-mon[79770]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:11.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T11:48:11.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/2176141603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0100820 msgr2=0x7f1ce0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 --2- 172.21.15.118:0/2176141603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0100820 0x7f1ce0100c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009880 tx=0x7f1cdc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/2176141603 shutdown_connections 2024-09-21T11:48:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 --2- 172.21.15.118:0/2176141603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0100820 0x7f1ce0100c80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 --2- 172.21.15.118:0/2176141603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce0106820 0x7f1ce0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/2176141603 >> 172.21.15.118:0/2176141603 conn(0x7f1ce00fc520 msgr2=0x7f1ce00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/2176141603 shutdown_connections 2024-09-21T11:48:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/2176141603 wait complete. 2024-09-21T11:48:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 Processor -- start 2024-09-21T11:48:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.986+0000 7f1ce7dfd640 1 -- start start 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce7dfd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce0100820 0x7f1ce00fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce7dfd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0106820 0x7f1ce00fd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce7dfd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce010dcf0 con 0x7f1ce0106820 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce7dfd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce010db70 con 0x7f1ce0100820 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce5398640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0106820 0x7f1ce00fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce5398640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0106820 0x7f1ce00fd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44800/0 (socket says 172.21.15.118:44800) 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce5398640 1 -- 172.21.15.118:0/684250220 learned_addr learned my addr 172.21.15.118:0/684250220 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce5b99640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce0100820 0x7f1ce00fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce5398640 1 -- 172.21.15.118:0/684250220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce0100820 msgr2=0x7f1ce00fcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce5398640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce0100820 0x7f1ce00fcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce5398640 1 -- 172.21.15.118:0/684250220 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce00fd6a0 con 0x7f1ce0106820 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce5398640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0106820 0x7f1ce00fd160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc031460 tx=0x7f1cdc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1cd2ffd640 1 -- 172.21.15.118:0/684250220 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc03f070 con 0x7f1ce0106820 2024-09-21T11:48:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1cd2ffd640 1 -- 172.21.15.118:0/684250220 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cdc004a90 con 0x7f1ce0106820 2024-09-21T11:48:11.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce00fd930 con 0x7f1ce0106820 2024-09-21T11:48:11.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.987+0000 7f1cd2ffd640 1 -- 172.21.15.118:0/684250220 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc035030 con 0x7f1ce0106820 2024-09-21T11:48:11.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.988+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce01a3dd0 con 0x7f1ce0106820 2024-09-21T11:48:11.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.989+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce0101f60 con 0x7f1ce0106820 2024-09-21T11:48:11.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.989+0000 7f1cd2ffd640 1 -- 172.21.15.118:0/684250220 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1cdc042070 con 0x7f1ce0106820 2024-09-21T11:48:11.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.990+0000 7f1cd2ffd640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1ccc07af40 0x7f1ccc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:11.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.990+0000 7f1cd2ffd640 1 -- 172.21.15.118:0/684250220 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f1cdc0beb00 con 0x7f1ce0106820 2024-09-21T11:48:11.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.990+0000 7f1ce5b99640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1ccc07af40 0x7f1ccc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:11.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.990+0000 7f1ce5b99640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1ccc07af40 0x7f1ccc07d400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009bd0 tx=0x7f1cd4005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:11.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:11.994+0000 7f1cd2ffd640 1 -- 172.21.15.118:0/684250220 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1cdc08a050 con 0x7f1ce0106820 2024-09-21T11:48:12.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.185+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1ce0062630 con 0x7f1ccc07af40 2024-09-21T11:48:12.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.186+0000 7f1cd2ffd640 1 -- 172.21.15.118:0/684250220 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1ce0062630 con 0x7f1ccc07af40 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "14/23 daemons upgraded", 2024-09-21T11:48:12.189 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:48:12.190 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:48:12.190 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:48:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1ccc07af40 msgr2=0x7f1ccc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1ccc07af40 0x7f1ccc07d400 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009bd0 tx=0x7f1cd4005f90 comp rx=0 tx=0).stop 2024-09-21T11:48:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0106820 msgr2=0x7f1ce00fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0106820 0x7f1ce00fd160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc031460 tx=0x7f1cdc004530 comp rx=0 tx=0).stop 2024-09-21T11:48:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 shutdown_connections 2024-09-21T11:48:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1ccc07af40 0x7f1ccc07d400 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:12.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce0106820 0x7f1ce00fd160 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:12.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 --2- 172.21.15.118:0/684250220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce0100820 0x7f1ce00fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:12.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 >> 172.21.15.118:0/684250220 conn(0x7f1ce00fc520 msgr2=0x7f1ce006a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:12.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 shutdown_connections 2024-09-21T11:48:12.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.189+0000 7f1ce7dfd640 1 -- 172.21.15.118:0/684250220 wait complete. 2024-09-21T11:48:12.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.271+0000 7f02de9f4640 1 -- 172.21.15.118:0/87265722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d8102aa0 msgr2=0x7f02d8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:12.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.271+0000 7f02de9f4640 1 --2- 172.21.15.118:0/87265722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d8102aa0 0x7f02d8102e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009880 tx=0x7f02c802a530 comp rx=0 tx=0).stop 2024-09-21T11:48:12.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.271+0000 7f02de9f4640 1 -- 172.21.15.118:0/87265722 shutdown_connections 2024-09-21T11:48:12.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.271+0000 7f02de9f4640 1 --2- 172.21.15.118:0/87265722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d81033c0 0x7f02d810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:12.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.271+0000 7f02de9f4640 1 --2- 172.21.15.118:0/87265722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d8102aa0 0x7f02d8102e80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:12.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.271+0000 7f02de9f4640 1 -- 172.21.15.118:0/87265722 >> 172.21.15.118:0/87265722 conn(0x7f02d80fc4c0 msgr2=0x7f02d80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:12.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.271+0000 7f02de9f4640 1 -- 172.21.15.118:0/87265722 shutdown_connections 2024-09-21T11:48:12.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.271+0000 7f02de9f4640 1 -- 172.21.15.118:0/87265722 wait complete. 2024-09-21T11:48:12.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.272+0000 7f02de9f4640 1 Processor -- start 2024-09-21T11:48:12.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.272+0000 7f02de9f4640 1 -- start start 2024-09-21T11:48:12.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.272+0000 7f02de9f4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d8102aa0 0x7f02d819d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:12.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.272+0000 7f02de9f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d81033c0 0x7f02d819dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:12.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.272+0000 7f02de9f4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f02d810edd0 con 0x7f02d81033c0 2024-09-21T11:48:12.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.272+0000 7f02de9f4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02d810ec50 con 0x7f02d8102aa0 2024-09-21T11:48:12.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d81033c0 0x7f02d819dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:12.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d81033c0 0x7f02d819dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44816/0 (socket says 172.21.15.118:44816) 2024-09-21T11:48:12.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d77fe640 1 -- 172.21.15.118:0/3075924535 learned_addr learned my addr 172.21.15.118:0/3075924535 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d7fff640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d8102aa0 0x7f02d819d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d77fe640 1 -- 172.21.15.118:0/3075924535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d8102aa0 msgr2=0x7f02d819d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d77fe640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d8102aa0 0x7f02d819d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d77fe640 1 -- 172.21.15.118:0/3075924535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d8197900 con 0x7f02d81033c0 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d77fe640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d81033c0 0x7f02d819dc80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00d6d0 tx=0x7f02cc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d57fa640 1 -- 172.21.15.118:0/3075924535 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f02cc017070 con 0x7f02d81033c0 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02d57fa640 1 -- 172.21.15.118:0/3075924535 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02cc0054e0 con 0x7f02d81033c0 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.273+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d8197bf0 con 0x7f02d81033c0 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.274+0000 7f02d57fa640 1 -- 172.21.15.118:0/3075924535 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f02cc004ae0 con 0x7f02d81033c0 2024-09-21T11:48:12.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.274+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d8198180 con 0x7f02d81033c0 2024-09-21T11:48:12.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.275+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d806a410 con 0x7f02d81033c0 2024-09-21T11:48:12.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.276+0000 7f02d57fa640 1 -- 172.21.15.118:0/3075924535 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f02cc004de0 con 0x7f02d81033c0 2024-09-21T11:48:12.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.276+0000 7f02d57fa640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02c007af30 0x7f02c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:12.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.276+0000 7f02d57fa640 1 -- 172.21.15.118:0/3075924535 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f02cc09dc10 con 0x7f02d81033c0 2024-09-21T11:48:12.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.276+0000 7f02d7fff640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02c007af30 0x7f02c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:12.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.277+0000 7f02d7fff640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02c007af30 0x7f02c007d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000c00 tx=0x7f02c8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:12.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.283+0000 7f02d57fa640 1 -- 172.21.15.118:0/3075924535 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02cc069160 con 0x7f02d81033c0 2024-09-21T11:48:12.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.540+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f02d8105f70 con 0x7f02d81033c0 2024-09-21T11:48:12.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.540+0000 7f02d57fa640 1 -- 172.21.15.118:0/3075924535 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f02cc06e010 con 0x7f02d81033c0 2024-09-21T11:48:12.543 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:48:12.543 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:48:12.543 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:48:12.543 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:48:12.543 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:48:12.543 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:48:12.543 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:48:12.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.542+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02c007af30 msgr2=0x7f02c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:12.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.542+0000 7f02de9f4640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02c007af30 0x7f02c007d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000c00 tx=0x7f02c8031400 comp rx=0 tx=0).stop 2024-09-21T11:48:12.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.542+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d81033c0 msgr2=0x7f02d819dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:12.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.542+0000 7f02de9f4640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d81033c0 0x7f02d819dc80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00d6d0 tx=0x7f02cc00db90 comp rx=0 tx=0).stop 2024-09-21T11:48:12.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.543+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 shutdown_connections 2024-09-21T11:48:12.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.543+0000 7f02de9f4640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02c007af30 0x7f02c007d3f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:12.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.543+0000 7f02de9f4640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d81033c0 0x7f02d819dc80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:12.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.543+0000 7f02de9f4640 1 --2- 172.21.15.118:0/3075924535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d8102aa0 0x7f02d819d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:12.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.543+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 >> 172.21.15.118:0/3075924535 conn(0x7f02d80fc4c0 msgr2=0x7f02d8108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:12.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.543+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 shutdown_connections 2024-09-21T11:48:12.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:12.543+0000 7f02de9f4640 1 -- 172.21.15.118:0/3075924535 wait complete. 2024-09-21T11:48:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:12 smithi118 ceph-mon[111738]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:12 smithi118 ceph-mon[111738]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:12 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] up:boot 2024-09-21T11:48:12.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:12 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T11:48:12.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:12 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"} : dispatch 2024-09-21T11:48:12.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:12 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2486069942' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:12.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:12 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/470956854' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:48:12.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:12 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3075924535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:48:12.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:12 smithi149 ceph-mon[79770]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:12.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:12 smithi149 ceph-mon[79770]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:12.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:12 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] up:boot 2024-09-21T11:48:12.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:12 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T11:48:12.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:12 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi149.zgoqsi"} : dispatch 2024-09-21T11:48:12.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:12 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2486069942' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:12.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:12 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/470956854' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:48:12.849 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:12 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3075924535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:48:13.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:13 smithi149 ceph-mon[79770]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:13.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:13 smithi149 ceph-mon[79770]: pgmap v281: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:13.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:13 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:13.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:13 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:13 smithi118 ceph-mon[111738]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:13 smithi118 ceph-mon[111738]: pgmap v281: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:13 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:13 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:15.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:15 smithi118 ceph-mon[111738]: pgmap v282: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:15.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:15 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:15.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:15 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:15.639 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:15 smithi149 ceph-mon[79770]: pgmap v282: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:15.639 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:15 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:15.639 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:15 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T11:48:17.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:17 smithi149 ceph-mon[79770]: pgmap v283: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:17.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:17 smithi118 ceph-mon[111738]: pgmap v283: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:19.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:19 smithi118 ceph-mon[111738]: pgmap v284: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:19 smithi149 ceph-mon[79770]: pgmap v284: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:48:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:48:21.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:21 smithi118 ceph-mon[111738]: pgmap v285: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:21.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:21 smithi149 ceph-mon[79770]: pgmap v285: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:23 smithi118 ceph-mon[111738]: pgmap v286: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:23.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:23 smithi149 ceph-mon[79770]: pgmap v286: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:25.542 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:25 smithi118 ceph-mon[111738]: pgmap v287: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:25 smithi149 ceph-mon[79770]: pgmap v287: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:27.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:27 smithi118 ceph-mon[111738]: pgmap v288: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:27 smithi149 ceph-mon[79770]: pgmap v288: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:29.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:29 smithi118 ceph-mon[111738]: pgmap v289: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:29.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:29 smithi149 ceph-mon[79770]: pgmap v289: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:31.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:31 smithi118 ceph-mon[111738]: pgmap v290: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:31.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:31 smithi149 ceph-mon[79770]: pgmap v290: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:33.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:33 smithi118 ceph-mon[111738]: pgmap v291: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:33 smithi149 ceph-mon[79770]: pgmap v291: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:35.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:35 smithi118 ceph-mon[111738]: pgmap v292: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:35.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:48:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:35 smithi149 ceph-mon[79770]: pgmap v292: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:48:37.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:37 smithi118 ceph-mon[111738]: pgmap v293: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:37.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:37 smithi149 ceph-mon[79770]: pgmap v293: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:39.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:39 smithi118 ceph-mon[111738]: pgmap v294: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:39.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:39 smithi149 ceph-mon[79770]: pgmap v294: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:41.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:41 smithi118 ceph-mon[111738]: pgmap v295: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:41.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:41 smithi149 ceph-mon[79770]: pgmap v295: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.636+0000 7fec35123640 1 -- 172.21.15.118:0/1872987626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 msgr2=0x7fec30106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.636+0000 7fec35123640 1 --2- 172.21.15.118:0/1872987626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 0x7fec30106c00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fec20009880 tx=0x7fec2002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.636+0000 7fec35123640 1 -- 172.21.15.118:0/1872987626 shutdown_connections 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.636+0000 7fec35123640 1 --2- 172.21.15.118:0/1872987626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec30100820 0x7fec30100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.636+0000 7fec35123640 1 --2- 172.21.15.118:0/1872987626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 0x7fec30106c00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.636+0000 7fec35123640 1 -- 172.21.15.118:0/1872987626 >> 172.21.15.118:0/1872987626 conn(0x7fec300fc520 msgr2=0x7fec300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.636+0000 7fec35123640 1 -- 172.21.15.118:0/1872987626 shutdown_connections 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.636+0000 7fec35123640 1 -- 172.21.15.118:0/1872987626 wait complete. 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec35123640 1 Processor -- start 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec35123640 1 -- start start 2024-09-21T11:48:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec35123640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec30100820 0x7fec301023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec35123640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 0x7fec30102930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec35123640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fec3010dd50 con 0x7fec30106820 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec35123640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec3010dbd0 con 0x7fec30100820 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec2e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 0x7fec30102930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec2e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 0x7fec30102930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43510/0 (socket says 172.21.15.118:43510) 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec2e59c640 1 -- 172.21.15.118:0/594768279 learned_addr learned my addr 172.21.15.118:0/594768279 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.637+0000 7fec2ed9d640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec30100820 0x7fec301023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.638+0000 7fec2e59c640 1 -- 172.21.15.118:0/594768279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec30100820 msgr2=0x7fec301023f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.638+0000 7fec2e59c640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec30100820 0x7fec301023f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.638+0000 7fec2e59c640 1 -- 172.21.15.118:0/594768279 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec30102e70 con 0x7fec30106820 2024-09-21T11:48:42.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.638+0000 7fec2e59c640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 0x7fec30102930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec2400b420 tx=0x7fec2400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:42.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.638+0000 7fec17fff640 1 -- 172.21.15.118:0/594768279 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec24011630 con 0x7fec30106820 2024-09-21T11:48:42.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.638+0000 7fec17fff640 1 -- 172.21.15.118:0/594768279 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec24016070 con 0x7fec30106820 2024-09-21T11:48:42.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.638+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec30103160 con 0x7fec30106820 2024-09-21T11:48:42.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.638+0000 7fec17fff640 1 -- 172.21.15.118:0/594768279 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec24010d40 con 0x7fec30106820 2024-09-21T11:48:42.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.638+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec301a3e80 con 0x7fec30106820 2024-09-21T11:48:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.639+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec30101f60 con 0x7fec30106820 2024-09-21T11:48:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.640+0000 7fec17fff640 1 -- 172.21.15.118:0/594768279 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fec2401b460 con 0x7fec30106820 2024-09-21T11:48:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.641+0000 7fec17fff640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec1807af30 0x7fec1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.641+0000 7fec2ed9d640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec1807af30 0x7fec1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.641+0000 7fec17fff640 1 -- 172.21.15.118:0/594768279 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fec2409d780 con 0x7fec30106820 2024-09-21T11:48:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.641+0000 7fec2ed9d640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec1807af30 0x7fec1807d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fec200096c0 tx=0x7fec20031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:42.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.645+0000 7fec17fff640 1 -- 172.21.15.118:0/594768279 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec24068cd0 con 0x7fec30106820 2024-09-21T11:48:42.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.844+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fec3006a300 con 0x7fec1807af30 2024-09-21T11:48:42.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.845+0000 7fec17fff640 1 -- 172.21.15.118:0/594768279 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fec3006a300 con 0x7fec1807af30 2024-09-21T11:48:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.847+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec1807af30 msgr2=0x7fec1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.847+0000 7fec35123640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec1807af30 0x7fec1807d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fec200096c0 tx=0x7fec20031400 comp rx=0 tx=0).stop 2024-09-21T11:48:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.847+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 msgr2=0x7fec30102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.847+0000 7fec35123640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 0x7fec30102930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec2400b420 tx=0x7fec2400b8e0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.850+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 shutdown_connections 2024-09-21T11:48:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.850+0000 7fec35123640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec1807af30 0x7fec1807d3f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.850+0000 7fec35123640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec30106820 0x7fec30102930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.850+0000 7fec35123640 1 --2- 172.21.15.118:0/594768279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec30100820 0x7fec301023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.850+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 >> 172.21.15.118:0/594768279 conn(0x7fec300fc520 msgr2=0x7fec301045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.850+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 shutdown_connections 2024-09-21T11:48:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.850+0000 7fec35123640 1 -- 172.21.15.118:0/594768279 wait complete. 2024-09-21T11:48:42.863 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:48:42.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.935+0000 7fc339a10640 1 -- 172.21.15.118:0/561835456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3341000d0 msgr2=0x7fc3341004b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:42.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.935+0000 7fc339a10640 1 --2- 172.21.15.118:0/561835456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3341000d0 0x7fc3341004b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc324009880 tx=0x7fc32402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.935+0000 7fc339a10640 1 -- 172.21.15.118:0/561835456 shutdown_connections 2024-09-21T11:48:42.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.935+0000 7fc339a10640 1 --2- 172.21.15.118:0/561835456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc334100a80 0x7fc3341065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.935+0000 7fc339a10640 1 --2- 172.21.15.118:0/561835456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3341000d0 0x7fc3341004b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.935+0000 7fc339a10640 1 -- 172.21.15.118:0/561835456 >> 172.21.15.118:0/561835456 conn(0x7fc3340fbc40 msgr2=0x7fc3340fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:42.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.935+0000 7fc339a10640 1 -- 172.21.15.118:0/561835456 shutdown_connections 2024-09-21T11:48:42.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.935+0000 7fc339a10640 1 -- 172.21.15.118:0/561835456 wait complete. 2024-09-21T11:48:42.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc339a10640 1 Processor -- start 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc339a10640 1 -- start start 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc339a10640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3341000d0 0x7fc334101050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc339a10640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc334100a80 0x7fc334101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc339a10640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc33410edf0 con 0x7fc334100a80 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc339a10640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc33410ec70 con 0x7fc3341000d0 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc334100a80 0x7fc334101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc334100a80 0x7fc334101590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43526/0 (socket says 172.21.15.118:43526) 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc32bfff640 1 -- 172.21.15.118:0/419661677 learned_addr learned my addr 172.21.15.118:0/419661677 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.936+0000 7fc332ffd640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3341000d0 0x7fc334101050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.937+0000 7fc32bfff640 1 -- 172.21.15.118:0/419661677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3341000d0 msgr2=0x7fc334101050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.937+0000 7fc32bfff640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3341000d0 0x7fc334101050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:42.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.937+0000 7fc32bfff640 1 -- 172.21.15.118:0/419661677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc334101ad0 con 0x7fc334100a80 2024-09-21T11:48:42.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.937+0000 7fc32bfff640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc334100a80 0x7fc334101590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c8f0 tx=0x7fc31c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:42.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.937+0000 7fc338a0e640 1 -- 172.21.15.118:0/419661677 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc31c0079b0 con 0x7fc334100a80 2024-09-21T11:48:42.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.937+0000 7fc338a0e640 1 -- 172.21.15.118:0/419661677 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc31c007b50 con 0x7fc334100a80 2024-09-21T11:48:42.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.937+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc334101dc0 con 0x7fc334100a80 2024-09-21T11:48:42.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.938+0000 7fc338a0e640 1 -- 172.21.15.118:0/419661677 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc31c018630 con 0x7fc334100a80 2024-09-21T11:48:42.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.938+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3341a3e20 con 0x7fc334100a80 2024-09-21T11:48:42.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.938+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc334103190 con 0x7fc334100a80 2024-09-21T11:48:42.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.939+0000 7fc338a0e640 1 -- 172.21.15.118:0/419661677 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc31c00f9a0 con 0x7fc334100a80 2024-09-21T11:48:42.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.940+0000 7fc338a0e640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc32007af80 0x7fc32007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:42.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.940+0000 7fc338a0e640 1 -- 172.21.15.118:0/419661677 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fc31c09e240 con 0x7fc334100a80 2024-09-21T11:48:42.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.940+0000 7fc332ffd640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc32007af80 0x7fc32007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:42.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.940+0000 7fc332ffd640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc32007af80 0x7fc32007d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc324031460 tx=0x7fc324005bd0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:42.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:42.944+0000 7fc338a0e640 1 -- 172.21.15.118:0/419661677 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc31c014030 con 0x7fc334100a80 2024-09-21T11:48:43.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.139+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc334062630 con 0x7fc32007af80 2024-09-21T11:48:43.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.140+0000 7fc338a0e640 1 -- 172.21.15.118:0/419661677 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fc334062630 con 0x7fc32007af80 2024-09-21T11:48:43.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc32007af80 msgr2=0x7fc32007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc32007af80 0x7fc32007d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc324031460 tx=0x7fc324005bd0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc334100a80 msgr2=0x7fc334101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc334100a80 0x7fc334101590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c8f0 tx=0x7fc31c00cdb0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 shutdown_connections 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc32007af80 0x7fc32007d440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc334100a80 0x7fc334101590 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 --2- 172.21.15.118:0/419661677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3341000d0 0x7fc334101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 >> 172.21.15.118:0/419661677 conn(0x7fc3340fbc40 msgr2=0x7fc334105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 shutdown_connections 2024-09-21T11:48:43.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.142+0000 7fc339a10640 1 -- 172.21.15.118:0/419661677 wait complete. 2024-09-21T11:48:43.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.224+0000 7fa3b23f8640 1 -- 172.21.15.118:0/2512475034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 msgr2=0x7fa3ac100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.224+0000 7fa3b23f8640 1 --2- 172.21.15.118:0/2512475034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 0x7fa3ac100c60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa394009880 tx=0x7fa39402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.224+0000 7fa3b23f8640 1 -- 172.21.15.118:0/2512475034 shutdown_connections 2024-09-21T11:48:43.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.224+0000 7fa3b23f8640 1 --2- 172.21.15.118:0/2512475034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 0x7fa3ac100c60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.224+0000 7fa3b23f8640 1 --2- 172.21.15.118:0/2512475034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3ac106800 0x7fa3ac106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.224+0000 7fa3b23f8640 1 -- 172.21.15.118:0/2512475034 >> 172.21.15.118:0/2512475034 conn(0x7fa3ac0fc500 msgr2=0x7fa3ac0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.224+0000 7fa3b23f8640 1 -- 172.21.15.118:0/2512475034 shutdown_connections 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.224+0000 7fa3b23f8640 1 -- 172.21.15.118:0/2512475034 wait complete. 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3b23f8640 1 Processor -- start 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3b23f8640 1 -- start start 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3b23f8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 0x7fa3ac198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3b23f8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3ac106800 0x7fa3ac198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3b23f8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac10dd30 con 0x7fa3ac100800 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3b23f8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac10dbb0 con 0x7fa3ac106800 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3abfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 0x7fa3ac198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3abfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 0x7fa3ac198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43536/0 (socket says 172.21.15.118:43536) 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3abfff640 1 -- 172.21.15.118:0/560253828 learned_addr learned my addr 172.21.15.118:0/560253828 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:43.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.225+0000 7fa3a3fff640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3ac106800 0x7fa3ac198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.226+0000 7fa3abfff640 1 -- 172.21.15.118:0/560253828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3ac106800 msgr2=0x7fa3ac198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.226+0000 7fa3abfff640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3ac106800 0x7fa3ac198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.226+0000 7fa3abfff640 1 -- 172.21.15.118:0/560253828 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ac1993a0 con 0x7fa3ac100800 2024-09-21T11:48:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.226+0000 7fa3abfff640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 0x7fa3ac198860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00b420 tx=0x7fa39c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.226+0000 7fa3a9ffb640 1 -- 172.21.15.118:0/560253828 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa39c011630 con 0x7fa3ac100800 2024-09-21T11:48:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.226+0000 7fa3a9ffb640 1 -- 172.21.15.118:0/560253828 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa39c016070 con 0x7fa3ac100800 2024-09-21T11:48:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.226+0000 7fa3a9ffb640 1 -- 172.21.15.118:0/560253828 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa39c010d40 con 0x7fa3ac100800 2024-09-21T11:48:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.226+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ac199690 con 0x7fa3ac100800 2024-09-21T11:48:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.226+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ac1a1c90 con 0x7fa3ac100800 2024-09-21T11:48:43.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.227+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ac101f40 con 0x7fa3ac100800 2024-09-21T11:48:43.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.228+0000 7fa3a9ffb640 1 -- 172.21.15.118:0/560253828 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa39c01b460 con 0x7fa3ac100800 2024-09-21T11:48:43.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.228+0000 7fa3a9ffb640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa39807af80 0x7fa39807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:43.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.228+0000 7fa3a3fff640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa39807af80 0x7fa39807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:43.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.228+0000 7fa3a9ffb640 1 -- 172.21.15.118:0/560253828 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fa39c09d6a0 con 0x7fa3ac100800 2024-09-21T11:48:43.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.229+0000 7fa3a3fff640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa39807af80 0x7fa39807d440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac06ae50 tx=0x7fa394031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:43.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.233+0000 7fa3a9ffb640 1 -- 172.21.15.118:0/560253828 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3ac199690 con 0x7fa3ac100800 2024-09-21T11:48:43.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.420+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa3ac062630 con 0x7fa39807af80 2024-09-21T11:48:43.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.430+0000 7fa3a9ffb640 1 -- 172.21.15.118:0/560253828 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa3ac062630 con 0x7fa39807af80 2024-09-21T11:48:43.432 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (6m) 44s ago 17m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (9m) 44s ago 17m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (9m) 29s ago 16m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (4m) 44s ago 17m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (4m) 29s ago 16m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (6m) 44s ago 17m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (66s) 44s ago 12m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (49s) 44s ago 12m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (12m) 29s ago 12m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (32s) 29s ago 12m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (8m) 44s ago 19m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:48:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (7m) 29s ago 16m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (5m) 44s ago 19m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (5m) 29s ago 16m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (7m) 44s ago 17m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (7m) 29s ago 16m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (4m) 44s ago 15m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (3m) 44s ago 15m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (3m) 44s ago 14m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (2m) 29s ago 14m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (115s) 29s ago 13m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (81s) 29s ago 13m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:48:43.434 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (6m) 44s ago 17m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:48:43.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.432+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa39807af80 msgr2=0x7fa39807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.432+0000 7fa3b23f8640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa39807af80 0x7fa39807d440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac06ae50 tx=0x7fa394031400 comp rx=0 tx=0).stop 2024-09-21T11:48:43.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.432+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 msgr2=0x7fa3ac198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.432+0000 7fa3b23f8640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 0x7fa3ac198860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00b420 tx=0x7fa39c00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.433+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 shutdown_connections 2024-09-21T11:48:43.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.433+0000 7fa3b23f8640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3ac106800 0x7fa3ac198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.433+0000 7fa3b23f8640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa39807af80 0x7fa39807d440 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.433+0000 7fa3b23f8640 1 --2- 172.21.15.118:0/560253828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3ac100800 0x7fa3ac198860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.433+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 >> 172.21.15.118:0/560253828 conn(0x7fa3ac0fc500 msgr2=0x7fa3ac0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:43.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.433+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 shutdown_connections 2024-09-21T11:48:43.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.433+0000 7fa3b23f8640 1 -- 172.21.15.118:0/560253828 wait complete. 2024-09-21T11:48:43.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.513+0000 7f0f91532640 1 -- 172.21.15.118:0/4007073531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 msgr2=0x7f0f8c100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.513+0000 7f0f91532640 1 --2- 172.21.15.118:0/4007073531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 0x7f0f8c100c70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009880 tx=0x7f0f7402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.515 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:43 smithi118 ceph-mon[111738]: pgmap v296: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:43.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.513+0000 7f0f91532640 1 -- 172.21.15.118:0/4007073531 shutdown_connections 2024-09-21T11:48:43.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.513+0000 7f0f91532640 1 --2- 172.21.15.118:0/4007073531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 0x7f0f8c100c70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.513+0000 7f0f91532640 1 --2- 172.21.15.118:0/4007073531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f8c106810 0x7f0f8c106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.513+0000 7f0f91532640 1 -- 172.21.15.118:0/4007073531 >> 172.21.15.118:0/4007073531 conn(0x7f0f8c0fc510 msgr2=0x7f0f8c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.513+0000 7f0f91532640 1 -- 172.21.15.118:0/4007073531 shutdown_connections 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.513+0000 7f0f91532640 1 -- 172.21.15.118:0/4007073531 wait complete. 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.513+0000 7f0f91532640 1 Processor -- start 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f91532640 1 -- start start 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f91532640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 0x7f0f8c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f91532640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f8c106810 0x7f0f8c198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f91532640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c10dcc0 con 0x7f0f8c100810 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f91532640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c10db40 con 0x7f0f8c106810 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f8affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 0x7f0f8c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f8affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 0x7f0f8c1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43554/0 (socket says 172.21.15.118:43554) 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f8affd640 1 -- 172.21.15.118:0/298040507 learned_addr learned my addr 172.21.15.118:0/298040507 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f8a7fc640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f8c106810 0x7f0f8c198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:43.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f8affd640 1 -- 172.21.15.118:0/298040507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f8c106810 msgr2=0x7f0f8c198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f8affd640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f8c106810 0x7f0f8c198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.514+0000 7f0f8affd640 1 -- 172.21.15.118:0/298040507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c1992a0 con 0x7f0f8c100810 2024-09-21T11:48:43.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.515+0000 7f0f8affd640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 0x7f0f8c1987f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00c8a0 tx=0x7f0f7c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:43.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.515+0000 7f0f83fff640 1 -- 172.21.15.118:0/298040507 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f7c0079b0 con 0x7f0f8c100810 2024-09-21T11:48:43.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.515+0000 7f0f83fff640 1 -- 172.21.15.118:0/298040507 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f7c007b50 con 0x7f0f8c100810 2024-09-21T11:48:43.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.515+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8c199590 con 0x7f0f8c100810 2024-09-21T11:48:43.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.515+0000 7f0f83fff640 1 -- 172.21.15.118:0/298040507 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f7c018700 con 0x7f0f8c100810 2024-09-21T11:48:43.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.515+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8c1a1b90 con 0x7f0f8c100810 2024-09-21T11:48:43.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.516+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8c101f50 con 0x7f0f8c100810 2024-09-21T11:48:43.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.517+0000 7f0f83fff640 1 -- 172.21.15.118:0/298040507 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0f7c007d00 con 0x7f0f8c100810 2024-09-21T11:48:43.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.517+0000 7f0f83fff640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f7807af80 0x7f0f7807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:43.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.517+0000 7f0f83fff640 1 -- 172.21.15.118:0/298040507 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0f7c09e200 con 0x7f0f8c100810 2024-09-21T11:48:43.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.517+0000 7f0f8a7fc640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f7807af80 0x7f0f7807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:43.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.518+0000 7f0f8a7fc640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f7807af80 0x7f0f7807d440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c06ae50 tx=0x7f0f74031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:43.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.522+0000 7f0f83fff640 1 -- 172.21.15.118:0/298040507 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f7c014030 con 0x7f0f8c100810 2024-09-21T11:48:43.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:43 smithi149 ceph-mon[79770]: pgmap v296: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:43.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.770+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0f8c108df0 con 0x7f0f8c100810 2024-09-21T11:48:43.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.771+0000 7f0f83fff640 1 -- 172.21.15.118:0/298040507 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f0f8c108df0 con 0x7f0f8c100810 2024-09-21T11:48:43.773 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:48:43.773 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:48:43.773 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:48:43.773 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:48:43.773 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:48:43.773 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:48:43.773 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:48:43.773 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:48:43.774 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.773+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f7807af80 msgr2=0x7f0f7807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.773+0000 7f0f91532640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f7807af80 0x7f0f7807d440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c06ae50 tx=0x7f0f74031400 comp rx=0 tx=0).stop 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.773+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 msgr2=0x7f0f8c1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.773+0000 7f0f91532640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 0x7f0f8c1987f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00c8a0 tx=0x7f0f7c00cd60 comp rx=0 tx=0).stop 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.773+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 shutdown_connections 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.773+0000 7f0f91532640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f8c106810 0x7f0f8c198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.773+0000 7f0f91532640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f7807af80 0x7f0f7807d440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.773+0000 7f0f91532640 1 --2- 172.21.15.118:0/298040507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f8c100810 0x7f0f8c1987f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.773+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 >> 172.21.15.118:0/298040507 conn(0x7f0f8c0fc510 msgr2=0x7f0f8c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:43.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.774+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 shutdown_connections 2024-09-21T11:48:43.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.774+0000 7f0f91532640 1 -- 172.21.15.118:0/298040507 wait complete. 2024-09-21T11:48:43.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 -- 172.21.15.118:0/950738345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 msgr2=0x7f2168106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 --2- 172.21.15.118:0/950738345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 0x7f2168106bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2158009880 tx=0x7f215802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 -- 172.21.15.118:0/950738345 shutdown_connections 2024-09-21T11:48:43.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 --2- 172.21.15.118:0/950738345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2168100810 0x7f2168100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 --2- 172.21.15.118:0/950738345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 0x7f2168106bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 -- 172.21.15.118:0/950738345 >> 172.21.15.118:0/950738345 conn(0x7f21680fc510 msgr2=0x7f21680fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 -- 172.21.15.118:0/950738345 shutdown_connections 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 -- 172.21.15.118:0/950738345 wait complete. 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 Processor -- start 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.854+0000 7f2170275640 1 -- start start 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f2170275640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2168100810 0x7f216819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f2170275640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 0x7f216819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f2170275640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f216810dcc0 con 0x7f2168106810 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f2170275640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f216810db40 con 0x7f2168100810 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f216d810640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 0x7f216819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f216d810640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 0x7f216819db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43578/0 (socket says 172.21.15.118:43578) 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f216d810640 1 -- 172.21.15.118:0/1940534228 learned_addr learned my addr 172.21.15.118:0/1940534228 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:43.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f216e011640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2168100810 0x7f216819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:43.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f216d810640 1 -- 172.21.15.118:0/1940534228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2168100810 msgr2=0x7f216819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:43.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f216d810640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2168100810 0x7f216819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:43.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f216d810640 1 -- 172.21.15.118:0/1940534228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2168197780 con 0x7f2168106810 2024-09-21T11:48:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f216d810640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 0x7f216819db40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f216400d8d0 tx=0x7f216400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f215f7fe640 1 -- 172.21.15.118:0/1940534228 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2164017070 con 0x7f2168106810 2024-09-21T11:48:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f215f7fe640 1 -- 172.21.15.118:0/1940534228 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2164010460 con 0x7f2168106810 2024-09-21T11:48:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2168197a70 con 0x7f2168106810 2024-09-21T11:48:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.855+0000 7f215f7fe640 1 -- 172.21.15.118:0/1940534228 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f216400f5f0 con 0x7f2168106810 2024-09-21T11:48:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.856+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2168198000 con 0x7f2168106810 2024-09-21T11:48:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.857+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2168101f50 con 0x7f2168106810 2024-09-21T11:48:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.857+0000 7f215f7fe640 1 -- 172.21.15.118:0/1940534228 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2164009a30 con 0x7f2168106810 2024-09-21T11:48:43.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.858+0000 7f215f7fe640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f215407af80 0x7f215407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:43.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.858+0000 7f215f7fe640 1 -- 172.21.15.118:0/1940534228 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f216409ddf0 con 0x7f2168106810 2024-09-21T11:48:43.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.858+0000 7f216e011640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f215407af80 0x7f215407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:43.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.858+0000 7f216e011640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f215407af80 0x7f215407d440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f21580096c0 tx=0x7f2158031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:43.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:43.862+0000 7f215f7fe640 1 -- 172.21.15.118:0/1940534228 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21640693c0 con 0x7f2168106810 2024-09-21T11:48:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.078+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f21681982b0 con 0x7f2168106810 2024-09-21T11:48:44.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.078+0000 7f215f7fe640 1 -- 172.21.15.118:0/1940534228 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f216406e270 con 0x7f2168106810 2024-09-21T11:48:44.081 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:48:44.081 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:48:44.081 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:48:44.081 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:48:44.081 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:48:44.081 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:48:44.082 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:48:44.083 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:48:44.084 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.080+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f215407af80 msgr2=0x7f215407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.080+0000 7f2170275640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f215407af80 0x7f215407d440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f21580096c0 tx=0x7f2158031400 comp rx=0 tx=0).stop 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.080+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 msgr2=0x7f216819db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.080+0000 7f2170275640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 0x7f216819db40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f216400d8d0 tx=0x7f216400dd90 comp rx=0 tx=0).stop 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.081+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 shutdown_connections 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.081+0000 7f2170275640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f215407af80 0x7f215407d440 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.081+0000 7f2170275640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2168106810 0x7f216819db40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.081+0000 7f2170275640 1 --2- 172.21.15.118:0/1940534228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2168100810 0x7f216819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.081+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 >> 172.21.15.118:0/1940534228 conn(0x7f21680fc510 msgr2=0x7f2168109e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:44.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.081+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 shutdown_connections 2024-09-21T11:48:44.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.081+0000 7f2170275640 1 -- 172.21.15.118:0/1940534228 wait complete. 2024-09-21T11:48:44.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.163+0000 7fb36149c640 1 -- 172.21.15.118:0/3584488697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 msgr2=0x7fb35c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.163+0000 7fb36149c640 1 --2- 172.21.15.118:0/3584488697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 0x7fb35c101d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb344009880 tx=0x7fb34402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.163+0000 7fb36149c640 1 -- 172.21.15.118:0/3584488697 shutdown_connections 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.163+0000 7fb36149c640 1 --2- 172.21.15.118:0/3584488697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 0x7fb35c101d90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.163+0000 7fb36149c640 1 --2- 172.21.15.118:0/3584488697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb35c107930 0x7fb35c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.163+0000 7fb36149c640 1 -- 172.21.15.118:0/3584488697 >> 172.21.15.118:0/3584488697 conn(0x7fb35c0fd630 msgr2=0x7fb35c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.163+0000 7fb36149c640 1 -- 172.21.15.118:0/3584488697 shutdown_connections 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.163+0000 7fb36149c640 1 -- 172.21.15.118:0/3584488697 wait complete. 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb36149c640 1 Processor -- start 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb36149c640 1 -- start start 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb36149c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 0x7fb35c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb36149c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb35c107930 0x7fb35c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb36149c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c10ee00 con 0x7fb35c101930 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb36149c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c10ec80 con 0x7fb35c107930 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb35affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 0x7fb35c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:44.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb35affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 0x7fb35c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43592/0 (socket says 172.21.15.118:43592) 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb35affd640 1 -- 172.21.15.118:0/1672285348 learned_addr learned my addr 172.21.15.118:0/1672285348 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.164+0000 7fb353fff640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb35c107930 0x7fb35c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.165+0000 7fb35affd640 1 -- 172.21.15.118:0/1672285348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb35c107930 msgr2=0x7fb35c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.165+0000 7fb35affd640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb35c107930 0x7fb35c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.165+0000 7fb35affd640 1 -- 172.21.15.118:0/1672285348 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c197810 con 0x7fb35c101930 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.165+0000 7fb35affd640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 0x7fb35c19d690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00d6f0 tx=0x7fb34c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.165+0000 7fb358ff9640 1 -- 172.21.15.118:0/1672285348 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb34c017070 con 0x7fb35c101930 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.165+0000 7fb358ff9640 1 -- 172.21.15.118:0/1672285348 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb34c00de00 con 0x7fb35c101930 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.165+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb35c197b00 con 0x7fb35c101930 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.165+0000 7fb358ff9640 1 -- 172.21.15.118:0/1672285348 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb34c004bb0 con 0x7fb35c101930 2024-09-21T11:48:44.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.165+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb35c198060 con 0x7fb35c101930 2024-09-21T11:48:44.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.166+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb35c103070 con 0x7fb35c101930 2024-09-21T11:48:44.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.166+0000 7fb358ff9640 1 -- 172.21.15.118:0/1672285348 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb34c004e60 con 0x7fb35c101930 2024-09-21T11:48:44.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.167+0000 7fb358ff9640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb34807af40 0x7fb34807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:44.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.167+0000 7fb358ff9640 1 -- 172.21.15.118:0/1672285348 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb34c09dc50 con 0x7fb35c101930 2024-09-21T11:48:44.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.167+0000 7fb353fff640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb34807af40 0x7fb34807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:44.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.167+0000 7fb353fff640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb34807af40 0x7fb34807d400 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb35c198b60 tx=0x7fb344031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:44.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.171+0000 7fb358ff9640 1 -- 172.21.15.118:0/1672285348 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb34c0691a0 con 0x7fb35c101930 2024-09-21T11:48:44.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.365+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb35c1983d0 con 0x7fb34807af40 2024-09-21T11:48:44.367 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:44 smithi118 ceph-mon[111738]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:44.368 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:44 smithi118 ceph-mon[111738]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:44.368 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:44 smithi118 ceph-mon[111738]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:44.368 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:44 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/298040507' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:44.368 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:44 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1940534228' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:48:44.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.366+0000 7fb358ff9640 1 -- 172.21.15.118:0/1672285348 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fb35c1983d0 con 0x7fb34807af40 2024-09-21T11:48:44.368 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:48:44.369 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:48:44.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb34807af40 msgr2=0x7fb34807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb34807af40 0x7fb34807d400 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb35c198b60 tx=0x7fb344031400 comp rx=0 tx=0).stop 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 msgr2=0x7fb35c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 0x7fb35c19d690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00d6f0 tx=0x7fb34c00dbb0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 shutdown_connections 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb35c107930 0x7fb35c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb34807af40 0x7fb34807d400 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 --2- 172.21.15.118:0/1672285348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c101930 0x7fb35c19d690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 >> 172.21.15.118:0/1672285348 conn(0x7fb35c0fd630 msgr2=0x7fb35c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 shutdown_connections 2024-09-21T11:48:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.368+0000 7fb36149c640 1 -- 172.21.15.118:0/1672285348 wait complete. 2024-09-21T11:48:44.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.450+0000 7f531f715640 1 -- 172.21.15.118:0/3563139118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 msgr2=0x7f5318106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.450+0000 7f531f715640 1 --2- 172.21.15.118:0/3563139118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 0x7f5318106bc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f530c009880 tx=0x7f530c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 -- 172.21.15.118:0/3563139118 shutdown_connections 2024-09-21T11:48:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 --2- 172.21.15.118:0/3563139118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53181007e0 0x7f5318100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 --2- 172.21.15.118:0/3563139118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 0x7f5318106bc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 -- 172.21.15.118:0/3563139118 >> 172.21.15.118:0/3563139118 conn(0x7f53180fc4c0 msgr2=0x7f53180fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 -- 172.21.15.118:0/3563139118 shutdown_connections 2024-09-21T11:48:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 -- 172.21.15.118:0/3563139118 wait complete. 2024-09-21T11:48:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 Processor -- start 2024-09-21T11:48:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 -- start start 2024-09-21T11:48:44.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53181007e0 0x7f531819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 0x7f531819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f531810dc90 con 0x7f53181067e0 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.451+0000 7f531f715640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f531810db10 con 0x7f53181007e0 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531ccb0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 0x7f531819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531ccb0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 0x7f531819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43604/0 (socket says 172.21.15.118:43604) 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531ccb0640 1 -- 172.21.15.118:0/903198728 learned_addr learned my addr 172.21.15.118:0/903198728 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531d4b1640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53181007e0 0x7f531819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531ccb0640 1 -- 172.21.15.118:0/903198728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53181007e0 msgr2=0x7f531819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531ccb0640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53181007e0 0x7f531819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531ccb0640 1 -- 172.21.15.118:0/903198728 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5318197750 con 0x7f53181067e0 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531ccb0640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 0x7f531819dbc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f531400d8d0 tx=0x7f531400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f530a7fc640 1 -- 172.21.15.118:0/903198728 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5314017070 con 0x7f53181067e0 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5318197a40 con 0x7f53181067e0 2024-09-21T11:48:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f530a7fc640 1 -- 172.21.15.118:0/903198728 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5314010460 con 0x7f53181067e0 2024-09-21T11:48:44.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f530a7fc640 1 -- 172.21.15.118:0/903198728 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f531400f5f0 con 0x7f53181067e0 2024-09-21T11:48:44.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.452+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5318197fa0 con 0x7f53181067e0 2024-09-21T11:48:44.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.453+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5318101f20 con 0x7f53181067e0 2024-09-21T11:48:44.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.454+0000 7f530a7fc640 1 -- 172.21.15.118:0/903198728 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5314009a30 con 0x7f53181067e0 2024-09-21T11:48:44.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.454+0000 7f530a7fc640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f530407af80 0x7f530407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:48:44.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.455+0000 7f530a7fc640 1 -- 172.21.15.118:0/903198728 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f531409de10 con 0x7f53181067e0 2024-09-21T11:48:44.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.455+0000 7f531d4b1640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f530407af80 0x7f530407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:48:44.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.455+0000 7f531d4b1640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f530407af80 0x7f530407d440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f530c0096c0 tx=0x7f530c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:48:44.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.459+0000 7f530a7fc640 1 -- 172.21.15.118:0/903198728 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53140693e0 con 0x7f53181067e0 2024-09-21T11:48:44.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:44 smithi149 ceph-mon[79770]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:44.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:44 smithi149 ceph-mon[79770]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:44.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:44 smithi149 ceph-mon[79770]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:44.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:44 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/298040507' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:48:44.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:44 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1940534228' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:48:44.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.704+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5318198250 con 0x7f53181067e0 2024-09-21T11:48:44.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.705+0000 7f530a7fc640 1 -- 172.21.15.118:0/903198728 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f531406e290 con 0x7f53181067e0 2024-09-21T11:48:44.707 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:48:44.707 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:48:44.707 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:48:44.707 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:48:44.707 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:48:44.707 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:48:44.708 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:48:44.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f530407af80 msgr2=0x7f530407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f530407af80 0x7f530407d440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f530c0096c0 tx=0x7f530c031400 comp rx=0 tx=0).stop 2024-09-21T11:48:44.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 msgr2=0x7f531819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:48:44.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 0x7f531819dbc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f531400d8d0 tx=0x7f531400dd90 comp rx=0 tx=0).stop 2024-09-21T11:48:44.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 shutdown_connections 2024-09-21T11:48:44.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f530407af80 0x7f530407d440 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181067e0 0x7f531819dbc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 --2- 172.21.15.118:0/903198728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53181007e0 0x7f531819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:48:44.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 >> 172.21.15.118:0/903198728 conn(0x7f53180fc4c0 msgr2=0x7f5318069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:48:44.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 shutdown_connections 2024-09-21T11:48:44.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:48:44.707+0000 7f531f715640 1 -- 172.21.15.118:0/903198728 wait complete. 2024-09-21T11:48:45.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:45 smithi118 ceph-mon[111738]: pgmap v297: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:45.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:45 smithi118 ceph-mon[111738]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:45.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:45 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/903198728' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:48:45.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:45 smithi149 ceph-mon[79770]: pgmap v297: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:45.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:45 smithi149 ceph-mon[79770]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:48:45.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:45 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/903198728' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:48:47.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:47 smithi118 ceph-mon[111738]: pgmap v298: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:47.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:47 smithi149 ceph-mon[79770]: pgmap v298: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:49.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:49 smithi149 ceph-mon[79770]: pgmap v299: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:49.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:49 smithi118 ceph-mon[111738]: pgmap v299: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:48:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:48:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:51 smithi118 ceph-mon[111738]: pgmap v300: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:51.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:51 smithi149 ceph-mon[79770]: pgmap v300: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:53.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:53 smithi118 ceph-mon[111738]: pgmap v301: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:53.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:53 smithi149 ceph-mon[79770]: pgmap v301: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:55.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:55 smithi118 ceph-mon[111738]: pgmap v302: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:55.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:55 smithi149 ceph-mon[79770]: pgmap v302: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:57.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:57 smithi149 ceph-mon[79770]: pgmap v303: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:57 smithi118 ceph-mon[111738]: pgmap v303: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:59.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:48:59 smithi149 ceph-mon[79770]: pgmap v304: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:48:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:48:59 smithi118 ceph-mon[111738]: pgmap v304: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:01.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:01 smithi149 ceph-mon[79770]: pgmap v305: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:01.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:01 smithi118 ceph-mon[111738]: pgmap v305: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:03.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:03 smithi149 ceph-mon[79770]: pgmap v306: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:03 smithi118 ceph-mon[111738]: pgmap v306: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:05 smithi149 ceph-mon[79770]: pgmap v307: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:49:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:05 smithi118 ceph-mon[111738]: pgmap v307: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:49:07.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:07 smithi149 ceph-mon[79770]: pgmap v308: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:07 smithi118 ceph-mon[111738]: pgmap v308: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:09 smithi149 ceph-mon[79770]: pgmap v309: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:09.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:09 smithi118 ceph-mon[111738]: pgmap v309: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:11.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:11 smithi149 ceph-mon[79770]: pgmap v310: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:11.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:11 smithi118 ceph-mon[111738]: pgmap v310: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:13.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:13 smithi118 ceph-mon[111738]: pgmap v311: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:13 smithi149 ceph-mon[79770]: pgmap v311: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:14.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.805+0000 7f04bc792640 1 -- 172.21.15.118:0/428781460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 msgr2=0x7f04b4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:14.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.805+0000 7f04bc792640 1 --2- 172.21.15.118:0/428781460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 0x7f04b4102e80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009880 tx=0x7f04b002a530 comp rx=0 tx=0).stop 2024-09-21T11:49:14.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.806+0000 7f04bc792640 1 -- 172.21.15.118:0/428781460 shutdown_connections 2024-09-21T11:49:14.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.806+0000 7f04bc792640 1 --2- 172.21.15.118:0/428781460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04b41033c0 0x7f04b410b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:14.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.806+0000 7f04bc792640 1 --2- 172.21.15.118:0/428781460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 0x7f04b4102e80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:14.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.806+0000 7f04bc792640 1 -- 172.21.15.118:0/428781460 >> 172.21.15.118:0/428781460 conn(0x7f04b40fc4c0 msgr2=0x7f04b40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:14.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.806+0000 7f04bc792640 1 -- 172.21.15.118:0/428781460 shutdown_connections 2024-09-21T11:49:14.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.806+0000 7f04bc792640 1 -- 172.21.15.118:0/428781460 wait complete. 2024-09-21T11:49:14.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.806+0000 7f04bc792640 1 Processor -- start 2024-09-21T11:49:14.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.806+0000 7f04bc792640 1 -- start start 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04bc792640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 0x7f04b419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04bc792640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04b41033c0 0x7f04b419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04bc792640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f04b410edd0 con 0x7f04b4102aa0 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04bc792640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f04b410ec50 con 0x7f04b41033c0 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04ba52e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 0x7f04b419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04ba52e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 0x7f04b419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38778/0 (socket says 172.21.15.118:38778) 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04ba52e640 1 -- 172.21.15.118:0/1457075245 learned_addr learned my addr 172.21.15.118:0/1457075245 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04b9d2d640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04b41033c0 0x7f04b419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04ba52e640 1 -- 172.21.15.118:0/1457075245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04b41033c0 msgr2=0x7f04b419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04ba52e640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04b41033c0 0x7f04b419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04ba52e640 1 -- 172.21.15.118:0/1457075245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b4197800 con 0x7f04b4102aa0 2024-09-21T11:49:14.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04ba52e640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 0x7f04b419d680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04b0031460 tx=0x7f04b00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:14.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04ab7fe640 1 -- 172.21.15.118:0/1457075245 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f04b003f070 con 0x7f04b4102aa0 2024-09-21T11:49:14.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.807+0000 7f04ab7fe640 1 -- 172.21.15.118:0/1457075245 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04b00035f0 con 0x7f04b4102aa0 2024-09-21T11:49:14.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.808+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b4197a90 con 0x7f04b4102aa0 2024-09-21T11:49:14.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.808+0000 7f04ab7fe640 1 -- 172.21.15.118:0/1457075245 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f04b0035030 con 0x7f04b4102aa0 2024-09-21T11:49:14.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.808+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b4197fc0 con 0x7f04b4102aa0 2024-09-21T11:49:14.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.809+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b406a410 con 0x7f04b4102aa0 2024-09-21T11:49:14.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.810+0000 7f04ab7fe640 1 -- 172.21.15.118:0/1457075245 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f04b0042070 con 0x7f04b4102aa0 2024-09-21T11:49:14.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.810+0000 7f04ab7fe640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f04a007af30 0x7f04a007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:14.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.810+0000 7f04ab7fe640 1 -- 172.21.15.118:0/1457075245 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f04b00bea20 con 0x7f04b4102aa0 2024-09-21T11:49:14.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.810+0000 7f04b9d2d640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f04a007af30 0x7f04a007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:14.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.811+0000 7f04b9d2d640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f04a007af30 0x7f04a007d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04b41088e0 tx=0x7f04a400b2e0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:14.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:14.815+0000 7f04ab7fe640 1 -- 172.21.15.118:0/1457075245 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f04b0089f70 con 0x7f04b4102aa0 2024-09-21T11:49:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.009+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f04b4198270 con 0x7f04a007af30 2024-09-21T11:49:15.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.010+0000 7f04ab7fe640 1 -- 172.21.15.118:0/1457075245 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f04b4198270 con 0x7f04a007af30 2024-09-21T11:49:15.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f04a007af30 msgr2=0x7f04a007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f04a007af30 0x7f04a007d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04b41088e0 tx=0x7f04a400b2e0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 msgr2=0x7f04b419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 0x7f04b419d680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04b0031460 tx=0x7f04b00045e0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 shutdown_connections 2024-09-21T11:49:15.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04b41033c0 0x7f04b419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f04a007af30 0x7f04a007d3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 --2- 172.21.15.118:0/1457075245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04b4102aa0 0x7f04b419d680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 >> 172.21.15.118:0/1457075245 conn(0x7f04b40fc4c0 msgr2=0x7f04b4108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:15.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 shutdown_connections 2024-09-21T11:49:15.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.013+0000 7f04bc792640 1 -- 172.21.15.118:0/1457075245 wait complete. 2024-09-21T11:49:15.023 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:49:15.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.096+0000 7f6002047640 1 -- 172.21.15.118:0/1697288931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 msgr2=0x7f5ffc10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.096+0000 7f6002047640 1 --2- 172.21.15.118:0/1697288931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 0x7f5ffc10b8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009880 tx=0x7f5ff002a530 comp rx=0 tx=0).stop 2024-09-21T11:49:15.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.096+0000 7f6002047640 1 -- 172.21.15.118:0/1697288931 shutdown_connections 2024-09-21T11:49:15.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.096+0000 7f6002047640 1 --2- 172.21.15.118:0/1697288931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 0x7f5ffc10b8f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.096+0000 7f6002047640 1 --2- 172.21.15.118:0/1697288931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ffc102ae0 0x7f5ffc102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.096+0000 7f6002047640 1 -- 172.21.15.118:0/1697288931 >> 172.21.15.118:0/1697288931 conn(0x7f5ffc0fc520 msgr2=0x7f5ffc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:15.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.096+0000 7f6002047640 1 -- 172.21.15.118:0/1697288931 shutdown_connections 2024-09-21T11:49:15.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.096+0000 7f6002047640 1 -- 172.21.15.118:0/1697288931 wait complete. 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.097+0000 7f6002047640 1 Processor -- start 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.097+0000 7f6002047640 1 -- start start 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.097+0000 7f6002047640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ffc102ae0 0x7f5ffc19f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.097+0000 7f6002047640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 0x7f5ffc19fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.097+0000 7f6002047640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc10ee10 con 0x7f5ffc103400 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.097+0000 7f6002047640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc10ec90 con 0x7f5ffc102ae0 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.097+0000 7f5ffaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 0x7f5ffc19fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.097+0000 7f5ffaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 0x7f5ffc19fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38790/0 (socket says 172.21.15.118:38790) 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.097+0000 7f5ffaffd640 1 -- 172.21.15.118:0/2169528213 learned_addr learned my addr 172.21.15.118:0/2169528213 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f5ffb7fe640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ffc102ae0 0x7f5ffc19f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:15.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f5ffaffd640 1 -- 172.21.15.118:0/2169528213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ffc102ae0 msgr2=0x7f5ffc19f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f5ffaffd640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ffc102ae0 0x7f5ffc19f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f5ffaffd640 1 -- 172.21.15.118:0/2169528213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ffc199ad0 con 0x7f5ffc103400 2024-09-21T11:49:15.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f5ffaffd640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 0x7f5ffc19fe50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0031460 tx=0x7f5ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:15.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f5ff8ff9640 1 -- 172.21.15.118:0/2169528213 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ff003f070 con 0x7f5ffc103400 2024-09-21T11:49:15.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ffc199d60 con 0x7f5ffc103400 2024-09-21T11:49:15.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f5ff8ff9640 1 -- 172.21.15.118:0/2169528213 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ff0004ac0 con 0x7f5ffc103400 2024-09-21T11:49:15.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f5ff8ff9640 1 -- 172.21.15.118:0/2169528213 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ff0035030 con 0x7f5ffc103400 2024-09-21T11:49:15.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.098+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ffc19a290 con 0x7f5ffc103400 2024-09-21T11:49:15.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.099+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ffc06abe0 con 0x7f5ffc103400 2024-09-21T11:49:15.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.100+0000 7f5ff8ff9640 1 -- 172.21.15.118:0/2169528213 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5ff0042070 con 0x7f5ffc103400 2024-09-21T11:49:15.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.100+0000 7f5ff8ff9640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fe407af30 0x7f5fe407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:15.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.101+0000 7f5ffb7fe640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fe407af30 0x7f5fe407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:15.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.101+0000 7f5ff8ff9640 1 -- 172.21.15.118:0/2169528213 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f5ff00bea60 con 0x7f5ffc103400 2024-09-21T11:49:15.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.101+0000 7f5ffb7fe640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fe407af30 0x7f5fe407d3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0058c0 tx=0x7f5fec00a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:15.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.105+0000 7f5ff8ff9640 1 -- 172.21.15.118:0/2169528213 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ff0089fb0 con 0x7f5ffc103400 2024-09-21T11:49:15.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.297+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5ffc10b400 con 0x7f5fe407af30 2024-09-21T11:49:15.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.299+0000 7f5ff8ff9640 1 -- 172.21.15.118:0/2169528213 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5fec00fb60 con 0x7f5fe407af30 2024-09-21T11:49:15.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fe407af30 msgr2=0x7f5fe407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fe407af30 0x7f5fe407d3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0058c0 tx=0x7f5fec00a250 comp rx=0 tx=0).stop 2024-09-21T11:49:15.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 msgr2=0x7f5ffc19fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 0x7f5ffc19fe50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0031460 tx=0x7f5ff00046c0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 shutdown_connections 2024-09-21T11:49:15.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fe407af30 0x7f5fe407d3f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc103400 0x7f5ffc19fe50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 --2- 172.21.15.118:0/2169528213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ffc102ae0 0x7f5ffc19f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 >> 172.21.15.118:0/2169528213 conn(0x7f5ffc0fc520 msgr2=0x7f5ffc100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:15.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 shutdown_connections 2024-09-21T11:49:15.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.301+0000 7f6002047640 1 -- 172.21.15.118:0/2169528213 wait complete. 2024-09-21T11:49:15.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.383+0000 7fe65b0aa640 1 -- 172.21.15.118:0/1151381007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654103420 msgr2=0x7fe65410b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.383+0000 7fe65b0aa640 1 --2- 172.21.15.118:0/1151381007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654103420 0x7fe65410b910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe644009c50 tx=0x7fe64402aa30 comp rx=0 tx=0).stop 2024-09-21T11:49:15.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 -- 172.21.15.118:0/1151381007 shutdown_connections 2024-09-21T11:49:15.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 --2- 172.21.15.118:0/1151381007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654103420 0x7fe65410b910 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 --2- 172.21.15.118:0/1151381007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe654102b00 0x7fe654102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 -- 172.21.15.118:0/1151381007 >> 172.21.15.118:0/1151381007 conn(0x7fe6540fc4c0 msgr2=0x7fe6540fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:15.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 -- 172.21.15.118:0/1151381007 shutdown_connections 2024-09-21T11:49:15.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 -- 172.21.15.118:0/1151381007 wait complete. 2024-09-21T11:49:15.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 Processor -- start 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 -- start start 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654102b00 0x7fe654100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe654103420 0x7fe654100ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.384+0000 7fe65b0aa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe65410edd0 con 0x7fe654102b00 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe65b0aa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe65410ec50 con 0x7fe654103420 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe658e46640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654102b00 0x7fe654100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe658e46640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654102b00 0x7fe654100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38802/0 (socket says 172.21.15.118:38802) 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe658e46640 1 -- 172.21.15.118:0/2689221110 learned_addr learned my addr 172.21.15.118:0/2689221110 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe658e46640 1 -- 172.21.15.118:0/2689221110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe654103420 msgr2=0x7fe654100ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe658e46640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe654103420 0x7fe654100ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe658e46640 1 -- 172.21.15.118:0/2689221110 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6541011e0 con 0x7fe654102b00 2024-09-21T11:49:15.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe658e46640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654102b00 0x7fe654100760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00d6f0 tx=0x7fe64c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:15.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe651ffb640 1 -- 172.21.15.118:0/2689221110 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe64c017070 con 0x7fe654102b00 2024-09-21T11:49:15.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe651ffb640 1 -- 172.21.15.118:0/2689221110 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe64c00de00 con 0x7fe654102b00 2024-09-21T11:49:15.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe651ffb640 1 -- 172.21.15.118:0/2689221110 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe64c004bb0 con 0x7fe654102b00 2024-09-21T11:49:15.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6541014d0 con 0x7fe654102b00 2024-09-21T11:49:15.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.385+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6541a3e80 con 0x7fe654102b00 2024-09-21T11:49:15.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.387+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65406a3b0 con 0x7fe654102b00 2024-09-21T11:49:15.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.387+0000 7fe651ffb640 1 -- 172.21.15.118:0/2689221110 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe64c004e60 con 0x7fe654102b00 2024-09-21T11:49:15.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.388+0000 7fe651ffb640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe64007af30 0x7fe64007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:15.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.388+0000 7fe651ffb640 1 -- 172.21.15.118:0/2689221110 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fe64c09dce0 con 0x7fe654102b00 2024-09-21T11:49:15.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.388+0000 7fe653fff640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe64007af30 0x7fe64007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:15.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.388+0000 7fe653fff640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe64007af30 0x7fe64007d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe644009430 tx=0x7fe644009380 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:15.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.392+0000 7fe651ffb640 1 -- 172.21.15.118:0/2689221110 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe64c069230 con 0x7fe654102b00 2024-09-21T11:49:15.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.577+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe654062630 con 0x7fe64007af30 2024-09-21T11:49:15.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.586+0000 7fe651ffb640 1 -- 172.21.15.118:0/2689221110 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fe654062630 con 0x7fe64007af30 2024-09-21T11:49:15.587 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (7m) 76s ago 18m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (10m) 76s ago 18m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (9m) 61s ago 17m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (5m) 76s ago 18m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (5m) 61s ago 17m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (6m) 76s ago 17m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (98s) 76s ago 12m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (81s) 76s ago 12m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (12m) 61s ago 12m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (65s) 61s ago 12m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (9m) 76s ago 19m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (8m) 61s ago 17m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (5m) 76s ago 19m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (5m) 61s ago 17m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:49:15.588 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (8m) 76s ago 18m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:49:15.589 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (7m) 61s ago 17m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:49:15.589 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (4m) 76s ago 16m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:49:15.589 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (4m) 76s ago 15m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:49:15.589 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (3m) 76s ago 15m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:49:15.589 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (3m) 61s ago 14m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:49:15.589 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (2m) 61s ago 14m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:49:15.589 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (113s) 61s ago 13m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:49:15.589 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (7m) 76s ago 17m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:49:15.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe64007af30 msgr2=0x7fe64007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe64007af30 0x7fe64007d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe644009430 tx=0x7fe644009380 comp rx=0 tx=0).stop 2024-09-21T11:49:15.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654102b00 msgr2=0x7fe654100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654102b00 0x7fe654100760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00d6f0 tx=0x7fe64c00dbb0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 shutdown_connections 2024-09-21T11:49:15.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe654103420 0x7fe654100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe64007af30 0x7fe64007d3f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 --2- 172.21.15.118:0/2689221110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe654102b00 0x7fe654100760 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 >> 172.21.15.118:0/2689221110 conn(0x7fe6540fc4c0 msgr2=0x7fe654103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:15.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 shutdown_connections 2024-09-21T11:49:15.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.588+0000 7fe65b0aa640 1 -- 172.21.15.118:0/2689221110 wait complete. 2024-09-21T11:49:15.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.669+0000 7ff126327640 1 -- 172.21.15.118:0/3551781772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 msgr2=0x7ff12010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.669+0000 7ff126327640 1 --2- 172.21.15.118:0/3551781772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 0x7ff12010b8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff114009880 tx=0x7ff11402a530 comp rx=0 tx=0).stop 2024-09-21T11:49:15.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.669+0000 7ff126327640 1 -- 172.21.15.118:0/3551781772 shutdown_connections 2024-09-21T11:49:15.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.669+0000 7ff126327640 1 --2- 172.21.15.118:0/3551781772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 0x7ff12010b8f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.669+0000 7ff126327640 1 --2- 172.21.15.118:0/3551781772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120102ae0 0x7ff120102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.669+0000 7ff126327640 1 -- 172.21.15.118:0/3551781772 >> 172.21.15.118:0/3551781772 conn(0x7ff1200fc520 msgr2=0x7ff1200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:15.671 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:15 smithi118 ceph-mon[111738]: pgmap v312: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.669+0000 7ff126327640 1 -- 172.21.15.118:0/3551781772 shutdown_connections 2024-09-21T11:49:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.669+0000 7ff126327640 1 -- 172.21.15.118:0/3551781772 wait complete. 2024-09-21T11:49:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.670+0000 7ff126327640 1 Processor -- start 2024-09-21T11:49:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.670+0000 7ff126327640 1 -- start start 2024-09-21T11:49:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.670+0000 7ff126327640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120102ae0 0x7ff120100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.670+0000 7ff126327640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 0x7ff120100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.670+0000 7ff126327640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff12010edf0 con 0x7ff120103400 2024-09-21T11:49:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.670+0000 7ff126327640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff12010ec70 con 0x7ff120102ae0 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 0x7ff120100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 0x7ff120100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35388/0 (socket says 172.21.15.118:35388) 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11f7fe640 1 -- 172.21.15.118:0/2504249929 learned_addr learned my addr 172.21.15.118:0/2504249929 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11ffff640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120102ae0 0x7ff120100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11f7fe640 1 -- 172.21.15.118:0/2504249929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120102ae0 msgr2=0x7ff120100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11f7fe640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120102ae0 0x7ff120100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11f7fe640 1 -- 172.21.15.118:0/2504249929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1201011c0 con 0x7ff120103400 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11f7fe640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 0x7ff120100c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff114031460 tx=0x7ff114004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11d7fa640 1 -- 172.21.15.118:0/2504249929 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff11403f070 con 0x7ff120103400 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11d7fa640 1 -- 172.21.15.118:0/2504249929 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff114004a90 con 0x7ff120103400 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff120101450 con 0x7ff120103400 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff11d7fa640 1 -- 172.21.15.118:0/2504249929 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff114035030 con 0x7ff120103400 2024-09-21T11:49:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.671+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1201a3dc0 con 0x7ff120103400 2024-09-21T11:49:15.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.672+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12006abe0 con 0x7ff120103400 2024-09-21T11:49:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.673+0000 7ff11d7fa640 1 -- 172.21.15.118:0/2504249929 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff114042070 con 0x7ff120103400 2024-09-21T11:49:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.674+0000 7ff11d7fa640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff10807af90 0x7ff10807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.674+0000 7ff11d7fa640 1 -- 172.21.15.118:0/2504249929 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff1140bea80 con 0x7ff120103400 2024-09-21T11:49:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.674+0000 7ff11ffff640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff10807af90 0x7ff10807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.674+0000 7ff11ffff640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff10807af90 0x7ff10807d450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff11000bbe0 tx=0x7ff11000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:15.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.678+0000 7ff11d7fa640 1 -- 172.21.15.118:0/2504249929 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff11408a050 con 0x7ff120103400 2024-09-21T11:49:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:15 smithi149 ceph-mon[79770]: pgmap v312: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:15.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.928+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff120105f80 con 0x7ff120103400 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.928+0000 7ff11d7fa640 1 -- 172.21.15.118:0/2504249929 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7ff11408c570 con 0x7ff120103400 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:49:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:49:15.931 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.930+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff10807af90 msgr2=0x7ff10807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.930+0000 7ff126327640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff10807af90 0x7ff10807d450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff11000bbe0 tx=0x7ff11000b390 comp rx=0 tx=0).stop 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.930+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 msgr2=0x7ff120100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.930+0000 7ff126327640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 0x7ff120100c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff114031460 tx=0x7ff114004530 comp rx=0 tx=0).stop 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.930+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 shutdown_connections 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.930+0000 7ff126327640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff10807af90 0x7ff10807d450 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.930+0000 7ff126327640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff120103400 0x7ff120100c80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.930+0000 7ff126327640 1 --2- 172.21.15.118:0/2504249929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120102ae0 0x7ff120100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.930+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 >> 172.21.15.118:0/2504249929 conn(0x7ff1200fc520 msgr2=0x7ff120108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:15.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.931+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 shutdown_connections 2024-09-21T11:49:15.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:15.931+0000 7ff126327640 1 -- 172.21.15.118:0/2504249929 wait complete. 2024-09-21T11:49:16.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.013+0000 7fbee399a640 1 -- 172.21.15.118:0/2139893726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 msgr2=0x7fbedc107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.013+0000 7fbee399a640 1 --2- 172.21.15.118:0/2139893726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 0x7fbedc107d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009880 tx=0x7fbed002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.013+0000 7fbee399a640 1 -- 172.21.15.118:0/2139893726 shutdown_connections 2024-09-21T11:49:16.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.013+0000 7fbee399a640 1 --2- 172.21.15.118:0/2139893726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc101930 0x7fbedc101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.013+0000 7fbee399a640 1 --2- 172.21.15.118:0/2139893726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 0x7fbedc107d10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.013+0000 7fbee399a640 1 -- 172.21.15.118:0/2139893726 >> 172.21.15.118:0/2139893726 conn(0x7fbedc0fd630 msgr2=0x7fbedc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:16.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.013+0000 7fbee399a640 1 -- 172.21.15.118:0/2139893726 shutdown_connections 2024-09-21T11:49:16.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.013+0000 7fbee399a640 1 -- 172.21.15.118:0/2139893726 wait complete. 2024-09-21T11:49:16.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee399a640 1 Processor -- start 2024-09-21T11:49:16.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee399a640 1 -- start start 2024-09-21T11:49:16.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee399a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc101930 0x7fbedc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:16.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee399a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 0x7fbedc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:16.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee399a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc10ede0 con 0x7fbedc107930 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee399a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc10ec60 con 0x7fbedc101930 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee0f35640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 0x7fbedc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee0f35640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 0x7fbedc19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35404/0 (socket says 172.21.15.118:35404) 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee0f35640 1 -- 172.21.15.118:0/2164927436 learned_addr learned my addr 172.21.15.118:0/2164927436 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee1736640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc101930 0x7fbedc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee0f35640 1 -- 172.21.15.118:0/2164927436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc101930 msgr2=0x7fbedc19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee0f35640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc101930 0x7fbedc19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee0f35640 1 -- 172.21.15.118:0/2164927436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc1977d0 con 0x7fbedc107930 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.014+0000 7fbee0f35640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 0x7fbedc19db90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbed800d8d0 tx=0x7fbed800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.015+0000 7fbece7fc640 1 -- 172.21.15.118:0/2164927436 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbed8017070 con 0x7fbedc107930 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.015+0000 7fbece7fc640 1 -- 172.21.15.118:0/2164927436 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbed8010460 con 0x7fbedc107930 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.015+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc197ac0 con 0x7fbedc107930 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.015+0000 7fbece7fc640 1 -- 172.21.15.118:0/2164927436 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbed800f5f0 con 0x7fbedc107930 2024-09-21T11:49:16.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.015+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc198050 con 0x7fbedc107930 2024-09-21T11:49:16.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.016+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbedc103070 con 0x7fbedc107930 2024-09-21T11:49:16.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.016+0000 7fbece7fc640 1 -- 172.21.15.118:0/2164927436 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbed8009a30 con 0x7fbedc107930 2024-09-21T11:49:16.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.017+0000 7fbece7fc640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbec807af40 0x7fbec807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:16.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.017+0000 7fbece7fc640 1 -- 172.21.15.118:0/2164927436 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fbed809dee0 con 0x7fbedc107930 2024-09-21T11:49:16.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.017+0000 7fbee1736640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbec807af40 0x7fbec807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:16.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.017+0000 7fbee1736640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbec807af40 0x7fbec807d400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbed00096c0 tx=0x7fbed0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:16.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.021+0000 7fbece7fc640 1 -- 172.21.15.118:0/2164927436 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbed8069430 con 0x7fbedc107930 2024-09-21T11:49:16.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.233+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbedc198d00 con 0x7fbedc107930 2024-09-21T11:49:16.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.234+0000 7fbece7fc640 1 -- 172.21.15.118:0/2164927436 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7fbed806e2e0 con 0x7fbedc107930 2024-09-21T11:49:16.235 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:49:16.235 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:49:16.236 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:49:16.237 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:49:16.238 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:49:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:49:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbec807af40 msgr2=0x7fbec807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbec807af40 0x7fbec807d400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbed00096c0 tx=0x7fbed0031400 comp rx=0 tx=0).stop 2024-09-21T11:49:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 msgr2=0x7fbedc19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 0x7fbedc19db90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbed800d8d0 tx=0x7fbed800dd90 comp rx=0 tx=0).stop 2024-09-21T11:49:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 shutdown_connections 2024-09-21T11:49:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbec807af40 0x7fbec807d400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbedc107930 0x7fbedc19db90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 --2- 172.21.15.118:0/2164927436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc101930 0x7fbedc19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 >> 172.21.15.118:0/2164927436 conn(0x7fbedc0fd630 msgr2=0x7fbedc0fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:16.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 shutdown_connections 2024-09-21T11:49:16.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.236+0000 7fbee399a640 1 -- 172.21.15.118:0/2164927436 wait complete. 2024-09-21T11:49:16.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.318+0000 7f0f3da82640 1 -- 172.21.15.118:0/2443851160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 msgr2=0x7f0f38106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.318+0000 7f0f3da82640 1 --2- 172.21.15.118:0/2443851160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 0x7f0f38106d30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009880 tx=0x7f0f2802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.318+0000 7f0f3da82640 1 -- 172.21.15.118:0/2443851160 shutdown_connections 2024-09-21T11:49:16.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.318+0000 7f0f3da82640 1 --2- 172.21.15.118:0/2443851160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f380ffd70 0x7f0f381001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.318+0000 7f0f3da82640 1 --2- 172.21.15.118:0/2443851160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 0x7f0f38106d30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.318+0000 7f0f3da82640 1 -- 172.21.15.118:0/2443851160 >> 172.21.15.118:0/2443851160 conn(0x7f0f380fbc60 msgr2=0x7f0f380fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:16.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.318+0000 7f0f3da82640 1 -- 172.21.15.118:0/2443851160 shutdown_connections 2024-09-21T11:49:16.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.318+0000 7f0f3da82640 1 -- 172.21.15.118:0/2443851160 wait complete. 2024-09-21T11:49:16.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.319+0000 7f0f3da82640 1 Processor -- start 2024-09-21T11:49:16.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.319+0000 7f0f3da82640 1 -- start start 2024-09-21T11:49:16.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.319+0000 7f0f3da82640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f380ffd70 0x7f0f3819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.319+0000 7f0f3da82640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 0x7f0f3819fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.319+0000 7f0f3da82640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3810ef50 con 0x7f0f38106950 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.319+0000 7f0f3da82640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3810edd0 con 0x7f0f380ffd70 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f36ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 0x7f0f3819fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f36ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 0x7f0f3819fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35412/0 (socket says 172.21.15.118:35412) 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f36ffd640 1 -- 172.21.15.118:0/270764222 learned_addr learned my addr 172.21.15.118:0/270764222 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f36ffd640 1 -- 172.21.15.118:0/270764222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f380ffd70 msgr2=0x7f0f3819f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f36ffd640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f380ffd70 0x7f0f3819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f36ffd640 1 -- 172.21.15.118:0/270764222 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f38199af0 con 0x7f0f38106950 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f36ffd640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 0x7f0f3819fe70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00b420 tx=0x7f0f2c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f34ff9640 1 -- 172.21.15.118:0/270764222 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f2c011630 con 0x7f0f38106950 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f38199de0 con 0x7f0f38106950 2024-09-21T11:49:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f34ff9640 1 -- 172.21.15.118:0/270764222 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f2c016070 con 0x7f0f38106950 2024-09-21T11:49:16.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f34ff9640 1 -- 172.21.15.118:0/270764222 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f2c010d40 con 0x7f0f38106950 2024-09-21T11:49:16.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.320+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3819a370 con 0x7f0f38106950 2024-09-21T11:49:16.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.321+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f38103090 con 0x7f0f38106950 2024-09-21T11:49:16.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.322+0000 7f0f34ff9640 1 -- 172.21.15.118:0/270764222 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0f2c01b460 con 0x7f0f38106950 2024-09-21T11:49:16.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.322+0000 7f0f34ff9640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f2007af30 0x7f0f2007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:16.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.322+0000 7f0f377fe640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f2007af30 0x7f0f2007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:16.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.322+0000 7f0f34ff9640 1 -- 172.21.15.118:0/270764222 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0f2c09d7f0 con 0x7f0f38106950 2024-09-21T11:49:16.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.323+0000 7f0f377fe640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f2007af30 0x7f0f2007d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f280096c0 tx=0x7f0f28000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:16.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.327+0000 7f0f34ff9640 1 -- 172.21.15.118:0/270764222 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f2c021250 con 0x7f0f38106950 2024-09-21T11:49:16.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.520+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0f3819a680 con 0x7f0f2007af30 2024-09-21T11:49:16.522 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:16 smithi118 ceph-mon[111738]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:16.522 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:16 smithi118 ceph-mon[111738]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:16.522 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:16 smithi118 ceph-mon[111738]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:16.522 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:16 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2504249929' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:49:16.522 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:16 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2164927436' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.522+0000 7f0f34ff9640 1 -- 172.21.15.118:0/270764222 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0f3819a680 con 0x7f0f2007af30 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:49:16.523 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:49:16.524 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:49:16.524 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:49:16.524 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:49:16.524 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:49:16.524 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:49:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f2007af30 msgr2=0x7f0f2007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f2007af30 0x7f0f2007d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f280096c0 tx=0x7f0f28000bc0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 msgr2=0x7f0f3819fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 0x7f0f3819fe70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00b420 tx=0x7f0f2c00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 shutdown_connections 2024-09-21T11:49:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f2007af30 0x7f0f2007d3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f38106950 0x7f0f3819fe70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 --2- 172.21.15.118:0/270764222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f380ffd70 0x7f0f3819f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 >> 172.21.15.118:0/270764222 conn(0x7f0f380fbc60 msgr2=0x7f0f38100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:16.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 shutdown_connections 2024-09-21T11:49:16.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.524+0000 7f0f3da82640 1 -- 172.21.15.118:0/270764222 wait complete. 2024-09-21T11:49:16.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 -- 172.21.15.118:0/3329256009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341018f0 msgr2=0x7f4934101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 --2- 172.21.15.118:0/3329256009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341018f0 0x7f4934101d50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f491c009880 tx=0x7f491c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 -- 172.21.15.118:0/3329256009 shutdown_connections 2024-09-21T11:49:16.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 --2- 172.21.15.118:0/3329256009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341018f0 0x7f4934101d50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 --2- 172.21.15.118:0/3329256009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49341078f0 0x7f4934107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 -- 172.21.15.118:0/3329256009 >> 172.21.15.118:0/3329256009 conn(0x7f49340fd630 msgr2=0x7f49340ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:16.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 -- 172.21.15.118:0/3329256009 shutdown_connections 2024-09-21T11:49:16.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 -- 172.21.15.118:0/3329256009 wait complete. 2024-09-21T11:49:16.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 Processor -- start 2024-09-21T11:49:16.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.605+0000 7f49397a1640 1 -- start start 2024-09-21T11:49:16.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f49397a1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49341018f0 0x7f493419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:16.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f49397a1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341078f0 0x7f493419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f49397a1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f493410eda0 con 0x7f49341078f0 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f49397a1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f493410ec20 con 0x7f49341018f0 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f492a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341078f0 0x7f493419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f492a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341078f0 0x7f493419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35440/0 (socket says 172.21.15.118:35440) 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f492a7fc640 1 -- 172.21.15.118:0/3662932780 learned_addr learned my addr 172.21.15.118:0/3662932780 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f492a7fc640 1 -- 172.21.15.118:0/3662932780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49341018f0 msgr2=0x7f493419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f492a7fc640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49341018f0 0x7f493419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f492a7fc640 1 -- 172.21.15.118:0/3662932780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49341977b0 con 0x7f49341078f0 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f492a7fc640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341078f0 0x7f493419db70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f491c031460 tx=0x7f491c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f4930ff9640 1 -- 172.21.15.118:0/3662932780 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f491c03f070 con 0x7f49341078f0 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4934197a40 con 0x7f49341078f0 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.606+0000 7f4930ff9640 1 -- 172.21.15.118:0/3662932780 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f491c0035f0 con 0x7f49341078f0 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.607+0000 7f4930ff9640 1 -- 172.21.15.118:0/3662932780 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f491c035030 con 0x7f49341078f0 2024-09-21T11:49:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.607+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4934197f70 con 0x7f49341078f0 2024-09-21T11:49:16.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.608+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4934103030 con 0x7f49341078f0 2024-09-21T11:49:16.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.608+0000 7f4930ff9640 1 -- 172.21.15.118:0/3662932780 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f491c042070 con 0x7f49341078f0 2024-09-21T11:49:16.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.609+0000 7f4930ff9640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f492007af30 0x7f492007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:16.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.609+0000 7f4932ffd640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f492007af30 0x7f492007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:16.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.609+0000 7f4930ff9640 1 -- 172.21.15.118:0/3662932780 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f491c0beab0 con 0x7f49341078f0 2024-09-21T11:49:16.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.609+0000 7f4932ffd640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f492007af30 0x7f492007d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4924005fd0 tx=0x7f4924005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:16.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.613+0000 7f4930ff9640 1 -- 172.21.15.118:0/3662932780 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f491c08a000 con 0x7f49341078f0 2024-09-21T11:49:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:16 smithi149 ceph-mon[79770]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:16.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:16 smithi149 ceph-mon[79770]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:16.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:16 smithi149 ceph-mon[79770]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:16.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:16 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2504249929' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:49:16.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:16 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2164927436' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:49:16.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.863+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4934109e80 con 0x7f49341078f0 2024-09-21T11:49:16.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.863+0000 7f4930ff9640 1 -- 172.21.15.118:0/3662932780 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f491c08eeb0 con 0x7f49341078f0 2024-09-21T11:49:16.865 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:49:16.865 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:49:16.865 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:49:16.865 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:49:16.865 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:49:16.865 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:49:16.865 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.865+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f492007af30 msgr2=0x7f492007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.865+0000 7f49397a1640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f492007af30 0x7f492007d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4924005fd0 tx=0x7f4924005850 comp rx=0 tx=0).stop 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.865+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341078f0 msgr2=0x7f493419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.865+0000 7f49397a1640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341078f0 0x7f493419db70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f491c031460 tx=0x7f491c0045e0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.865+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 shutdown_connections 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.865+0000 7f49397a1640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f492007af30 0x7f492007d3f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.865+0000 7f49397a1640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49341078f0 0x7f493419db70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.865+0000 7f49397a1640 1 --2- 172.21.15.118:0/3662932780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49341018f0 0x7f493419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.865+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 >> 172.21.15.118:0/3662932780 conn(0x7f49340fd630 msgr2=0x7f49340fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.866+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 shutdown_connections 2024-09-21T11:49:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:16.866+0000 7f49397a1640 1 -- 172.21.15.118:0/3662932780 wait complete. 2024-09-21T11:49:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:17 smithi149 ceph-mon[79770]: pgmap v313: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:17 smithi149 ceph-mon[79770]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:17 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3662932780' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:49:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:17 smithi118 ceph-mon[111738]: pgmap v313: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:17 smithi118 ceph-mon[111738]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:17.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:17 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3662932780' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:49:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:19 smithi149 ceph-mon[79770]: pgmap v314: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:19 smithi118 ceph-mon[111738]: pgmap v314: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:49:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:49:21.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:21 smithi149 ceph-mon[79770]: pgmap v315: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:21 smithi118 ceph-mon[111738]: pgmap v315: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:23.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:23 smithi149 ceph-mon[79770]: pgmap v316: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:23 smithi118 ceph-mon[111738]: pgmap v316: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:25 smithi149 ceph-mon[79770]: pgmap v317: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:25 smithi118 ceph-mon[111738]: pgmap v317: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:27 smithi149 ceph-mon[79770]: pgmap v318: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:27 smithi118 ceph-mon[111738]: pgmap v318: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:29.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:29 smithi149 ceph-mon[79770]: pgmap v319: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:29 smithi118 ceph-mon[111738]: pgmap v319: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:31.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:31 smithi149 ceph-mon[79770]: pgmap v320: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:31 smithi118 ceph-mon[111738]: pgmap v320: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:33 smithi149 ceph-mon[79770]: pgmap v321: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:33 smithi118 ceph-mon[111738]: pgmap v321: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:35 smithi149 ceph-mon[79770]: pgmap v322: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:49:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:35 smithi118 ceph-mon[111738]: pgmap v322: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:49:37.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:37 smithi149 ceph-mon[79770]: pgmap v323: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:37 smithi118 ceph-mon[111738]: pgmap v323: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:39 smithi149 ceph-mon[79770]: pgmap v324: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:39 smithi118 ceph-mon[111738]: pgmap v324: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:41.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:41 smithi149 ceph-mon[79770]: pgmap v325: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:41 smithi118 ceph-mon[111738]: pgmap v325: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:43.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:43 smithi149 ceph-mon[79770]: pgmap v326: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:43 smithi118 ceph-mon[111738]: pgmap v326: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:45.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:45 smithi149 ceph-mon[79770]: pgmap v327: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:46.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:45 smithi118 ceph-mon[111738]: pgmap v327: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:46.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 -- 172.21.15.118:0/825183339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 msgr2=0x7f1768102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:46.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 --2- 172.21.15.118:0/825183339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 0x7f1768102ec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1758009880 tx=0x7f175802a530 comp rx=0 tx=0).stop 2024-09-21T11:49:46.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 -- 172.21.15.118:0/825183339 shutdown_connections 2024-09-21T11:49:46.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 --2- 172.21.15.118:0/825183339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1768103400 0x7f176810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:46.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 --2- 172.21.15.118:0/825183339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 0x7f1768102ec0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:46.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 -- 172.21.15.118:0/825183339 >> 172.21.15.118:0/825183339 conn(0x7f17680fc520 msgr2=0x7f17680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:46.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 -- 172.21.15.118:0/825183339 shutdown_connections 2024-09-21T11:49:46.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 -- 172.21.15.118:0/825183339 wait complete. 2024-09-21T11:49:46.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 Processor -- start 2024-09-21T11:49:46.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.959+0000 7f176e4c6640 1 -- start start 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f176e4c6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 0x7f176819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f176e4c6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1768103400 0x7f176819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f176e4c6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f176810ee70 con 0x7f1768102ae0 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f176e4c6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f176810ecf0 con 0x7f1768103400 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f1767fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 0x7f176819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f1767fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 0x7f176819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48904/0 (socket says 172.21.15.118:48904) 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f1767fff640 1 -- 172.21.15.118:0/4250864437 learned_addr learned my addr 172.21.15.118:0/4250864437 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f17677fe640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1768103400 0x7f176819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f1767fff640 1 -- 172.21.15.118:0/4250864437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1768103400 msgr2=0x7f176819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f1767fff640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1768103400 0x7f176819dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.960+0000 7f1767fff640 1 -- 172.21.15.118:0/4250864437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1768197860 con 0x7f1768102ae0 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.961+0000 7f1767fff640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 0x7f176819d6a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1758031460 tx=0x7f17580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.961+0000 7f17657fa640 1 -- 172.21.15.118:0/4250864437 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f175803f070 con 0x7f1768102ae0 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.961+0000 7f17657fa640 1 -- 172.21.15.118:0/4250864437 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17580044d0 con 0x7f1768102ae0 2024-09-21T11:49:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.961+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1768197af0 con 0x7f1768102ae0 2024-09-21T11:49:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.961+0000 7f17657fa640 1 -- 172.21.15.118:0/4250864437 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1758035030 con 0x7f1768102ae0 2024-09-21T11:49:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.961+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1768198020 con 0x7f1768102ae0 2024-09-21T11:49:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.962+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176806abe0 con 0x7f1768102ae0 2024-09-21T11:49:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.963+0000 7f17657fa640 1 -- 172.21.15.118:0/4250864437 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1758042070 con 0x7f1768102ae0 2024-09-21T11:49:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.963+0000 7f17657fa640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f175007af40 0x7f175007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.963+0000 7f17657fa640 1 -- 172.21.15.118:0/4250864437 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f17580bec00 con 0x7f1768102ae0 2024-09-21T11:49:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.963+0000 7f17677fe640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f175007af40 0x7f175007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.964+0000 7f17677fe640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f175007af40 0x7f175007d400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f17680fe510 tx=0x7f175c008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:46.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:46.968+0000 7f17657fa640 1 -- 172.21.15.118:0/4250864437 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17580c4020 con 0x7f1768102ae0 2024-09-21T11:49:47.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.161+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1768198d90 con 0x7f175007af40 2024-09-21T11:49:47.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.163+0000 7f17657fa640 1 -- 172.21.15.118:0/4250864437 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1768198d90 con 0x7f175007af40 2024-09-21T11:49:47.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f175007af40 msgr2=0x7f175007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f175007af40 0x7f175007d400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f17680fe510 tx=0x7f175c008040 comp rx=0 tx=0).stop 2024-09-21T11:49:47.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 msgr2=0x7f176819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 0x7f176819d6a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1758031460 tx=0x7f17580048f0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 shutdown_connections 2024-09-21T11:49:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1768103400 0x7f176819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f175007af40 0x7f175007d400 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 --2- 172.21.15.118:0/4250864437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1768102ae0 0x7f176819d6a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 >> 172.21.15.118:0/4250864437 conn(0x7f17680fc520 msgr2=0x7f1768108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 shutdown_connections 2024-09-21T11:49:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.165+0000 7f176e4c6640 1 -- 172.21.15.118:0/4250864437 wait complete. 2024-09-21T11:49:47.176 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:49:47.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.248+0000 7fbf9d684640 1 -- 172.21.15.118:0/3143659678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98100800 msgr2=0x7fbf98100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.248+0000 7fbf9d684640 1 --2- 172.21.15.118:0/3143659678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98100800 0x7fbf98100c60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009880 tx=0x7fbf8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.248+0000 7fbf9d684640 1 -- 172.21.15.118:0/3143659678 shutdown_connections 2024-09-21T11:49:47.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.248+0000 7fbf9d684640 1 --2- 172.21.15.118:0/3143659678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98100800 0x7fbf98100c60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.248+0000 7fbf9d684640 1 --2- 172.21.15.118:0/3143659678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf98106800 0x7fbf98106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.248+0000 7fbf9d684640 1 -- 172.21.15.118:0/3143659678 >> 172.21.15.118:0/3143659678 conn(0x7fbf980fc4e0 msgr2=0x7fbf980fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:47.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.248+0000 7fbf9d684640 1 -- 172.21.15.118:0/3143659678 shutdown_connections 2024-09-21T11:49:47.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.248+0000 7fbf9d684640 1 -- 172.21.15.118:0/3143659678 wait complete. 2024-09-21T11:49:47.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.248+0000 7fbf9d684640 1 Processor -- start 2024-09-21T11:49:47.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf9d684640 1 -- start start 2024-09-21T11:49:47.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf9d684640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf98100800 0x7fbf980fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf9d684640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98106800 0x7fbf980fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf9d684640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810dcd0 con 0x7fbf98106800 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf9d684640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810db50 con 0x7fbf98100800 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf967fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98106800 0x7fbf980fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf967fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98106800 0x7fbf980fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48914/0 (socket says 172.21.15.118:48914) 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf967fc640 1 -- 172.21.15.118:0/3291329164 learned_addr learned my addr 172.21.15.118:0/3291329164 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf96ffd640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf98100800 0x7fbf980fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf967fc640 1 -- 172.21.15.118:0/3291329164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf98100800 msgr2=0x7fbf980fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf967fc640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf98100800 0x7fbf980fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf967fc640 1 -- 172.21.15.118:0/3291329164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf980fd690 con 0x7fbf98106800 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.249+0000 7fbf967fc640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98106800 0x7fbf980fd150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c031460 tx=0x7fbf8c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.250+0000 7fbf7ffff640 1 -- 172.21.15.118:0/3291329164 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf8c03f070 con 0x7fbf98106800 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.250+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf980fd920 con 0x7fbf98106800 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.250+0000 7fbf7ffff640 1 -- 172.21.15.118:0/3291329164 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbf8c0035f0 con 0x7fbf98106800 2024-09-21T11:49:47.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.250+0000 7fbf7ffff640 1 -- 172.21.15.118:0/3291329164 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf8c035030 con 0x7fbf98106800 2024-09-21T11:49:47.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.250+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981a3d80 con 0x7fbf98106800 2024-09-21T11:49:47.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.251+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf98101f40 con 0x7fbf98106800 2024-09-21T11:49:47.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.251+0000 7fbf7ffff640 1 -- 172.21.15.118:0/3291329164 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbf8c042070 con 0x7fbf98106800 2024-09-21T11:49:47.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.252+0000 7fbf7ffff640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbf8007af30 0x7fbf8007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:47.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.252+0000 7fbf7ffff640 1 -- 172.21.15.118:0/3291329164 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fbf8c0bea20 con 0x7fbf98106800 2024-09-21T11:49:47.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.252+0000 7fbf96ffd640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbf8007af30 0x7fbf8007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:47.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.252+0000 7fbf96ffd640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbf8007af30 0x7fbf8007d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005fd0 tx=0x7fbf8800b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:47.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.256+0000 7fbf7ffff640 1 -- 172.21.15.118:0/3291329164 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf8c089f70 con 0x7fbf98106800 2024-09-21T11:49:47.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.448+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbf98062630 con 0x7fbf8007af30 2024-09-21T11:49:47.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.450+0000 7fbf7ffff640 1 -- 172.21.15.118:0/3291329164 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fbf98062630 con 0x7fbf8007af30 2024-09-21T11:49:47.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbf8007af30 msgr2=0x7fbf8007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbf8007af30 0x7fbf8007d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005fd0 tx=0x7fbf8800b390 comp rx=0 tx=0).stop 2024-09-21T11:49:47.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98106800 msgr2=0x7fbf980fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98106800 0x7fbf980fd150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c031460 tx=0x7fbf8c0045e0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 shutdown_connections 2024-09-21T11:49:47.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbf8007af30 0x7fbf8007d3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf98106800 0x7fbf980fd150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 --2- 172.21.15.118:0/3291329164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf98100800 0x7fbf980fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 >> 172.21.15.118:0/3291329164 conn(0x7fbf980fc4e0 msgr2=0x7fbf9806a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:47.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 shutdown_connections 2024-09-21T11:49:47.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.452+0000 7fbf9d684640 1 -- 172.21.15.118:0/3291329164 wait complete. 2024-09-21T11:49:47.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.534+0000 7f6728b72640 1 -- 172.21.15.118:0/997029584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 msgr2=0x7f6724101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.534+0000 7f6728b72640 1 --2- 172.21.15.118:0/997029584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 0x7f6724101d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6714009880 tx=0x7f671402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.534+0000 7f6728b72640 1 -- 172.21.15.118:0/997029584 shutdown_connections 2024-09-21T11:49:47.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.534+0000 7f6728b72640 1 --2- 172.21.15.118:0/997029584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 0x7f6724101d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.534+0000 7f6728b72640 1 --2- 172.21.15.118:0/997029584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6724107930 0x7f6724107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.534+0000 7f6728b72640 1 -- 172.21.15.118:0/997029584 >> 172.21.15.118:0/997029584 conn(0x7f67240fd630 msgr2=0x7f67240ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:47.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.534+0000 7f6728b72640 1 -- 172.21.15.118:0/997029584 shutdown_connections 2024-09-21T11:49:47.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.534+0000 7f6728b72640 1 -- 172.21.15.118:0/997029584 wait complete. 2024-09-21T11:49:47.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f6728b72640 1 Processor -- start 2024-09-21T11:49:47.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f6728b72640 1 -- start start 2024-09-21T11:49:47.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f6728b72640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 0x7f67240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:47.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f6728b72640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6724107930 0x7f6724074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:47.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f6728b72640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f672410ee60 con 0x7f6724101930 2024-09-21T11:49:47.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f6728b72640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f672410ece0 con 0x7f6724107930 2024-09-21T11:49:47.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f672259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 0x7f67240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f672259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 0x7f67240744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48924/0 (socket says 172.21.15.118:48924) 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f672259c640 1 -- 172.21.15.118:0/202670401 learned_addr learned my addr 172.21.15.118:0/202670401 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f6721d9b640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6724107930 0x7f6724074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f672259c640 1 -- 172.21.15.118:0/202670401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6724107930 msgr2=0x7f6724074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f672259c640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6724107930 0x7f6724074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f672259c640 1 -- 172.21.15.118:0/202670401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6724074f70 con 0x7f6724101930 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.535+0000 7f672259c640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 0x7f67240744f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f670c00b420 tx=0x7f670c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.536+0000 7f671b7fe640 1 -- 172.21.15.118:0/202670401 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f670c011630 con 0x7f6724101930 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.536+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6724075260 con 0x7f6724101930 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.536+0000 7f671b7fe640 1 -- 172.21.15.118:0/202670401 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f670c016070 con 0x7f6724101930 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.536+0000 7f671b7fe640 1 -- 172.21.15.118:0/202670401 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f670c010d40 con 0x7f6724101930 2024-09-21T11:49:47.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.536+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67241a3ef0 con 0x7f6724101930 2024-09-21T11:49:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.537+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6724103070 con 0x7f6724101930 2024-09-21T11:49:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.538+0000 7f671b7fe640 1 -- 172.21.15.118:0/202670401 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f670c0117d0 con 0x7f6724101930 2024-09-21T11:49:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.538+0000 7f671b7fe640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f671007af30 0x7f671007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.538+0000 7f6721d9b640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f671007af30 0x7f671007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.538+0000 7f671b7fe640 1 -- 172.21.15.118:0/202670401 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f670c09d8a0 con 0x7f6724101930 2024-09-21T11:49:47.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.539+0000 7f6721d9b640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f671007af30 0x7f671007d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6714031460 tx=0x7f6714009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:47.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.542+0000 7f671b7fe640 1 -- 172.21.15.118:0/202670401 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f670c068df0 con 0x7f6724101930 2024-09-21T11:49:47.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.728+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6724062630 con 0x7f671007af30 2024-09-21T11:49:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.737+0000 7f671b7fe640 1 -- 172.21.15.118:0/202670401 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f6724062630 con 0x7f671007af30 2024-09-21T11:49:47.740 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:49:47.740 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (7m) 108s ago 18m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:49:47.740 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (10m) 108s ago 18m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:49:47.740 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (10m) 94s ago 17m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:49:47.740 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (5m) 108s ago 18m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:49:47.740 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (5m) 94s ago 17m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:49:47.740 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (7m) 108s ago 18m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:49:47.740 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (2m) 108s ago 13m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (113s) 108s ago 13m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (13m) 94s ago 13m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (97s) 94s ago 13m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (9m) 108s ago 20m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (8m) 94s ago 17m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (6m) 108s ago 20m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (6m) 94s ago 17m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (8m) 108s ago 18m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (8m) 94s ago 17m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:49:47.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (5m) 108s ago 16m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:49:47.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (4m) 108s ago 16m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:49:47.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (4m) 108s ago 15m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:49:47.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (3m) 94s ago 15m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:49:47.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (3m) 94s ago 14m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:49:47.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (2m) 94s ago 14m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:49:47.742 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (8m) 108s ago 18m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:49:47.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f671007af30 msgr2=0x7f671007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f671007af30 0x7f671007d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6714031460 tx=0x7f6714009560 comp rx=0 tx=0).stop 2024-09-21T11:49:47.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 msgr2=0x7f67240744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 0x7f67240744f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f670c00b420 tx=0x7f670c00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 shutdown_connections 2024-09-21T11:49:47.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6724107930 0x7f6724074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f671007af30 0x7f671007d3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 --2- 172.21.15.118:0/202670401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6724101930 0x7f67240744f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 >> 172.21.15.118:0/202670401 conn(0x7f67240fd630 msgr2=0x7f67240fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:47.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 shutdown_connections 2024-09-21T11:49:47.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.740+0000 7f6728b72640 1 -- 172.21.15.118:0/202670401 wait complete. 2024-09-21T11:49:47.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.820+0000 7f2ee299f640 1 -- 172.21.15.118:0/3544738771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 msgr2=0x7f2edc102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.820+0000 7f2ee299f640 1 --2- 172.21.15.118:0/3544738771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 0x7f2edc102f10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0098b0 tx=0x7f2ecc02a560 comp rx=0 tx=0).stop 2024-09-21T11:49:47.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.820+0000 7f2ee299f640 1 -- 172.21.15.118:0/3544738771 shutdown_connections 2024-09-21T11:49:47.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.820+0000 7f2ee299f640 1 --2- 172.21.15.118:0/3544738771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2edc103450 0x7f2edc10b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.820+0000 7f2ee299f640 1 --2- 172.21.15.118:0/3544738771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 0x7f2edc102f10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.820+0000 7f2ee299f640 1 -- 172.21.15.118:0/3544738771 >> 172.21.15.118:0/3544738771 conn(0x7f2edc0fc510 msgr2=0x7f2edc0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:47.823 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:47 smithi118 ceph-mon[111738]: pgmap v328: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.820+0000 7f2ee299f640 1 -- 172.21.15.118:0/3544738771 shutdown_connections 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.820+0000 7f2ee299f640 1 -- 172.21.15.118:0/3544738771 wait complete. 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2ee299f640 1 Processor -- start 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2ee299f640 1 -- start start 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2ee299f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 0x7f2edc100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2ee299f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2edc103450 0x7f2edc100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2ee299f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc10ede0 con 0x7f2edc102b30 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2ee299f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2edc10ec60 con 0x7f2edc103450 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2edbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 0x7f2edc100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2edbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 0x7f2edc100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48952/0 (socket says 172.21.15.118:48952) 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2edbfff640 1 -- 172.21.15.118:0/2967756664 learned_addr learned my addr 172.21.15.118:0/2967756664 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.821+0000 7f2edb7fe640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2edc103450 0x7f2edc100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:47.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2edbfff640 1 -- 172.21.15.118:0/2967756664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2edc103450 msgr2=0x7f2edc100cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:47.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2edbfff640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2edc103450 0x7f2edc100cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:47.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2edbfff640 1 -- 172.21.15.118:0/2967756664 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2edc101210 con 0x7f2edc102b30 2024-09-21T11:49:47.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2edb7fe640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2edc103450 0x7f2edc100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:49:47.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2edbfff640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 0x7f2edc100790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc031460 tx=0x7f2ecc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:47.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2ed97fa640 1 -- 172.21.15.118:0/2967756664 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ecc03f070 con 0x7f2edc102b30 2024-09-21T11:49:47.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2edc1014a0 con 0x7f2edc102b30 2024-09-21T11:49:47.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2ed97fa640 1 -- 172.21.15.118:0/2967756664 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ecc0044d0 con 0x7f2edc102b30 2024-09-21T11:49:47.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2ed97fa640 1 -- 172.21.15.118:0/2967756664 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ecc035030 con 0x7f2edc102b30 2024-09-21T11:49:47.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.822+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2edc1a3da0 con 0x7f2edc102b30 2024-09-21T11:49:47.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.823+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2edc06ab80 con 0x7f2edc102b30 2024-09-21T11:49:47.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.824+0000 7f2ed97fa640 1 -- 172.21.15.118:0/2967756664 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2ecc042070 con 0x7f2edc102b30 2024-09-21T11:49:47.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.825+0000 7f2ed97fa640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ec407af80 0x7f2ec407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:47.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.825+0000 7f2edb7fe640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ec407af80 0x7f2ec407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:47.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.825+0000 7f2ed97fa640 1 -- 172.21.15.118:0/2967756664 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f2ecc0bea60 con 0x7f2edc102b30 2024-09-21T11:49:47.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.825+0000 7f2edb7fe640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ec407af80 0x7f2ec407d440 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2edc102220 tx=0x7f2ed000a5c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:47.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:47.829+0000 7f2ed97fa640 1 -- 172.21.15.118:0/2967756664 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ecc004cf0 con 0x7f2edc102b30 2024-09-21T11:49:47.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:47 smithi149 ceph-mon[79770]: pgmap v328: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:48.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.079+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2edc105f90 con 0x7f2edc102b30 2024-09-21T11:49:48.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.080+0000 7f2ed97fa640 1 -- 172.21.15.118:0/2967756664 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f2ecc08a030 con 0x7f2edc102b30 2024-09-21T11:49:48.082 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:49:48.082 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:49:48.083 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:49:48.084 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:49:48.084 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:49:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ec407af80 msgr2=0x7f2ec407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ec407af80 0x7f2ec407d440 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2edc102220 tx=0x7f2ed000a5c0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 msgr2=0x7f2edc100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 0x7f2edc100790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc031460 tx=0x7f2ecc0048f0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 shutdown_connections 2024-09-21T11:49:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2edc103450 0x7f2edc100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ec407af80 0x7f2ec407d440 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 --2- 172.21.15.118:0/2967756664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2edc102b30 0x7f2edc100790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 >> 172.21.15.118:0/2967756664 conn(0x7f2edc0fc510 msgr2=0x7f2edc108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 shutdown_connections 2024-09-21T11:49:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.082+0000 7f2ee299f640 1 -- 172.21.15.118:0/2967756664 wait complete. 2024-09-21T11:49:48.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.163+0000 7f8a9cedf640 1 -- 172.21.15.118:0/4101381365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98100820 msgr2=0x7f8a98100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.163+0000 7f8a9cedf640 1 --2- 172.21.15.118:0/4101381365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98100820 0x7f8a98100c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009880 tx=0x7f8a8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.163+0000 7f8a9cedf640 1 -- 172.21.15.118:0/4101381365 shutdown_connections 2024-09-21T11:49:48.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.163+0000 7f8a9cedf640 1 --2- 172.21.15.118:0/4101381365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98100820 0x7f8a98100c80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.163+0000 7f8a9cedf640 1 --2- 172.21.15.118:0/4101381365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a98106820 0x7f8a98106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.163+0000 7f8a9cedf640 1 -- 172.21.15.118:0/4101381365 >> 172.21.15.118:0/4101381365 conn(0x7f8a980fc520 msgr2=0x7f8a980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:48.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.163+0000 7f8a9cedf640 1 -- 172.21.15.118:0/4101381365 shutdown_connections 2024-09-21T11:49:48.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.163+0000 7f8a9cedf640 1 -- 172.21.15.118:0/4101381365 wait complete. 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.164+0000 7f8a9cedf640 1 Processor -- start 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.164+0000 7f8a9cedf640 1 -- start start 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a9cedf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a98100820 0x7f8a9819f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a9cedf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98106820 0x7f8a9819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a9cedf640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9810dd50 con 0x7f8a98106820 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a9cedf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9810dbd0 con 0x7f8a98100820 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a95d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98106820 0x7f8a9819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a95d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98106820 0x7f8a9819fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48960/0 (socket says 172.21.15.118:48960) 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a95d9b640 1 -- 172.21.15.118:0/1028030946 learned_addr learned my addr 172.21.15.118:0/1028030946 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a9659c640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a98100820 0x7f8a9819f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a95d9b640 1 -- 172.21.15.118:0/1028030946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a98100820 msgr2=0x7f8a9819f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a95d9b640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a98100820 0x7f8a9819f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a95d9b640 1 -- 172.21.15.118:0/1028030946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a98199a40 con 0x7f8a98106820 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a95d9b640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98106820 0x7f8a9819fdc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c031460 tx=0x7f8a8c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:48.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a877fe640 1 -- 172.21.15.118:0/1028030946 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a8c03f070 con 0x7f8a98106820 2024-09-21T11:49:48.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a877fe640 1 -- 172.21.15.118:0/1028030946 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a8c004cf0 con 0x7f8a98106820 2024-09-21T11:49:48.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a98199cd0 con 0x7f8a98106820 2024-09-21T11:49:48.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a877fe640 1 -- 172.21.15.118:0/1028030946 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a8c035030 con 0x7f8a98106820 2024-09-21T11:49:48.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.165+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9819a200 con 0x7f8a98106820 2024-09-21T11:49:48.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.167+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a98101f60 con 0x7f8a98106820 2024-09-21T11:49:48.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.167+0000 7f8a877fe640 1 -- 172.21.15.118:0/1028030946 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8a8c042070 con 0x7f8a98106820 2024-09-21T11:49:48.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.168+0000 7f8a877fe640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8a8007af30 0x7f8a8007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:48.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.168+0000 7f8a9659c640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8a8007af30 0x7f8a8007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:48.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.168+0000 7f8a877fe640 1 -- 172.21.15.118:0/1028030946 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f8a8c0bebb0 con 0x7f8a98106820 2024-09-21T11:49:48.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.168+0000 7f8a9659c640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8a8007af30 0x7f8a8007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a9819ab80 tx=0x7f8a88008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:48.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.172+0000 7f8a877fe640 1 -- 172.21.15.118:0/1028030946 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a8c0c5080 con 0x7f8a98106820 2024-09-21T11:49:48.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.386+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8a9819b040 con 0x7f8a98106820 2024-09-21T11:49:48.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.387+0000 7f8a877fe640 1 -- 172.21.15.118:0/1028030946 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f8a8c08a100 con 0x7f8a98106820 2024-09-21T11:49:48.389 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:49:48.390 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:49:48.391 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:49:48.392 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:49:48.393 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:49:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:49:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8a8007af30 msgr2=0x7f8a8007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8a8007af30 0x7f8a8007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a9819ab80 tx=0x7f8a88008040 comp rx=0 tx=0).stop 2024-09-21T11:49:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98106820 msgr2=0x7f8a9819fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98106820 0x7f8a9819fdc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c031460 tx=0x7f8a8c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 shutdown_connections 2024-09-21T11:49:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8a8007af30 0x7f8a8007d3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a98106820 0x7f8a9819fdc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 --2- 172.21.15.118:0/1028030946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a98100820 0x7f8a9819f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 >> 172.21.15.118:0/1028030946 conn(0x7f8a980fc520 msgr2=0x7f8a9806a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.390+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 shutdown_connections 2024-09-21T11:49:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.391+0000 7f8a9cedf640 1 -- 172.21.15.118:0/1028030946 wait complete. 2024-09-21T11:49:48.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.475+0000 7f82bc1db640 1 -- 172.21.15.118:0/1011129336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 msgr2=0x7f82b4104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.475+0000 7f82bc1db640 1 --2- 172.21.15.118:0/1011129336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 0x7f82b4104be0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009880 tx=0x7f82a402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.475+0000 7f82bc1db640 1 -- 172.21.15.118:0/1011129336 shutdown_connections 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.475+0000 7f82bc1db640 1 --2- 172.21.15.118:0/1011129336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 0x7f82b4104be0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.475+0000 7f82bc1db640 1 --2- 172.21.15.118:0/1011129336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b41001e0 0x7f82b41005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.475+0000 7f82bc1db640 1 -- 172.21.15.118:0/1011129336 >> 172.21.15.118:0/1011129336 conn(0x7f82b40fbc40 msgr2=0x7f82b40fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.475+0000 7f82bc1db640 1 -- 172.21.15.118:0/1011129336 shutdown_connections 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.475+0000 7f82bc1db640 1 -- 172.21.15.118:0/1011129336 wait complete. 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.476+0000 7f82bc1db640 1 Processor -- start 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.476+0000 7f82bc1db640 1 -- start start 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.476+0000 7f82bc1db640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b41001e0 0x7f82b419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.476+0000 7f82bc1db640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 0x7f82b419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.476+0000 7f82bc1db640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f82b410d440 con 0x7f82b4100b90 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.476+0000 7f82bc1db640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82b410d2c0 con 0x7f82b41001e0 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.476+0000 7f82b9776640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 0x7f82b419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:48.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.476+0000 7f82b9776640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 0x7f82b419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48980/0 (socket says 172.21.15.118:48980) 2024-09-21T11:49:48.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.476+0000 7f82b9776640 1 -- 172.21.15.118:0/425028609 learned_addr learned my addr 172.21.15.118:0/425028609 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82b9f77640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b41001e0 0x7f82b419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82b9776640 1 -- 172.21.15.118:0/425028609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b41001e0 msgr2=0x7f82b419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82b9776640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b41001e0 0x7f82b419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82b9776640 1 -- 172.21.15.118:0/425028609 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b4197840 con 0x7f82b4100b90 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82b9f77640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b41001e0 0x7f82b419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82b9776640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 0x7f82b419dbb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f82a4031460 tx=0x7f82a40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82aaffd640 1 -- 172.21.15.118:0/425028609 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82a403f070 con 0x7f82b4100b90 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82aaffd640 1 -- 172.21.15.118:0/425028609 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82a4004cf0 con 0x7f82b4100b90 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b4197ad0 con 0x7f82b4100b90 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82aaffd640 1 -- 172.21.15.118:0/425028609 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82a4035030 con 0x7f82b4100b90 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.477+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b4198000 con 0x7f82b4100b90 2024-09-21T11:49:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.478+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b41016c0 con 0x7f82b4100b90 2024-09-21T11:49:48.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.479+0000 7f82aaffd640 1 -- 172.21.15.118:0/425028609 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f82a4042070 con 0x7f82b4100b90 2024-09-21T11:49:48.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.479+0000 7f82aaffd640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82a007af30 0x7f82a007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:48.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.479+0000 7f82aaffd640 1 -- 172.21.15.118:0/425028609 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f82a40beb70 con 0x7f82b4100b90 2024-09-21T11:49:48.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.479+0000 7f82b9f77640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82a007af30 0x7f82a007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:48.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.480+0000 7f82b9f77640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82a007af30 0x7f82a007d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f82b000baa0 tx=0x7f82b0005d90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:48.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.483+0000 7f82aaffd640 1 -- 172.21.15.118:0/425028609 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82a408a0c0 con 0x7f82b4100b90 2024-09-21T11:49:48.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.676+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f82b4198d20 con 0x7f82a007af30 2024-09-21T11:49:48.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.677+0000 7f82aaffd640 1 -- 172.21.15.118:0/425028609 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f82b4198d20 con 0x7f82a007af30 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:49:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:49:48.681 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:49:48.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82a007af30 msgr2=0x7f82a007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82a007af30 0x7f82a007d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f82b000baa0 tx=0x7f82b0005d90 comp rx=0 tx=0).stop 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 msgr2=0x7f82b419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 0x7f82b419dbb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f82a4031460 tx=0x7f82a40048f0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 shutdown_connections 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82a007af30 0x7f82a007d3f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82b4100b90 0x7f82b419dbb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 --2- 172.21.15.118:0/425028609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b41001e0 0x7f82b419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 >> 172.21.15.118:0/425028609 conn(0x7f82b40fbc40 msgr2=0x7f82b40fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 shutdown_connections 2024-09-21T11:49:48.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.680+0000 7f82bc1db640 1 -- 172.21.15.118:0/425028609 wait complete. 2024-09-21T11:49:48.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.764+0000 7f430ebfe640 1 -- 172.21.15.118:0/1842343987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 msgr2=0x7f4308106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.764+0000 7f430ebfe640 1 --2- 172.21.15.118:0/1842343987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 0x7f4308106bc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009880 tx=0x7f42fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.764+0000 7f430ebfe640 1 -- 172.21.15.118:0/1842343987 shutdown_connections 2024-09-21T11:49:48.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.764+0000 7f430ebfe640 1 --2- 172.21.15.118:0/1842343987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43081007e0 0x7f4308100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.764+0000 7f430ebfe640 1 --2- 172.21.15.118:0/1842343987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 0x7f4308106bc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.764+0000 7f430ebfe640 1 -- 172.21.15.118:0/1842343987 >> 172.21.15.118:0/1842343987 conn(0x7f43080fc4c0 msgr2=0x7f43080fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:48.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.765+0000 7f430ebfe640 1 -- 172.21.15.118:0/1842343987 shutdown_connections 2024-09-21T11:49:48.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.765+0000 7f430ebfe640 1 -- 172.21.15.118:0/1842343987 wait complete. 2024-09-21T11:49:48.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.765+0000 7f430ebfe640 1 Processor -- start 2024-09-21T11:49:48.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.765+0000 7f430ebfe640 1 -- start start 2024-09-21T11:49:48.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.765+0000 7f430ebfe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43081007e0 0x7f430819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:48.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.765+0000 7f430ebfe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 0x7f430819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:48.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f430ebfe640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f430810dcb0 con 0x7f43081067e0 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f430ebfe640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f430810db30 con 0x7f43081007e0 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4307fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 0x7f430819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4307fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 0x7f430819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49002/0 (socket says 172.21.15.118:49002) 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4307fff640 1 -- 172.21.15.118:0/2819093274 learned_addr learned my addr 172.21.15.118:0/2819093274 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f430c99a640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43081007e0 0x7f430819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4307fff640 1 -- 172.21.15.118:0/2819093274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43081007e0 msgr2=0x7f430819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4307fff640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43081007e0 0x7f430819d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4307fff640 1 -- 172.21.15.118:0/2819093274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43081977d0 con 0x7f43081067e0 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4307fff640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 0x7f430819db90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f42f400d6f0 tx=0x7f42f400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4305ffb640 1 -- 172.21.15.118:0/2819093274 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42f4017070 con 0x7f43081067e0 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4308197ac0 con 0x7f43081067e0 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4305ffb640 1 -- 172.21.15.118:0/2819093274 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42f400de00 con 0x7f43081067e0 2024-09-21T11:49:48.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.766+0000 7f4305ffb640 1 -- 172.21.15.118:0/2819093274 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42f4004bb0 con 0x7f43081067e0 2024-09-21T11:49:48.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.767+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4308198050 con 0x7f43081067e0 2024-09-21T11:49:48.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.768+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4308101f20 con 0x7f43081067e0 2024-09-21T11:49:48.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.768+0000 7f4305ffb640 1 -- 172.21.15.118:0/2819093274 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f42f4004e60 con 0x7f43081067e0 2024-09-21T11:49:48.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.768+0000 7f4305ffb640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42f807f350 0x7f42f8081810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:49:48.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.769+0000 7f4305ffb640 1 -- 172.21.15.118:0/2819093274 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f42f409dc50 con 0x7f43081067e0 2024-09-21T11:49:48.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.769+0000 7f430c99a640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42f807f350 0x7f42f8081810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:49:48.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.769+0000 7f430c99a640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42f807f350 0x7f42f8081810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0096c0 tx=0x7f42fc031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:49:48.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:48.774+0000 7f4305ffb640 1 -- 172.21.15.118:0/2819093274 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42f40691a0 con 0x7f43081067e0 2024-09-21T11:49:49.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.039+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4308109d60 con 0x7f43081067e0 2024-09-21T11:49:49.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:48 smithi118 ceph-mon[111738]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:49.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:48 smithi118 ceph-mon[111738]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:49.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:48 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2967756664' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:49:49.042 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:48 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1028030946' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:49:49.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.039+0000 7f4305ffb640 1 -- 172.21.15.118:0/2819093274 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f42f406e050 con 0x7f43081067e0 2024-09-21T11:49:49.043 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:49:49.043 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:49:49.043 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:49:49.043 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:49:49.043 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:49:49.043 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:49:49.043 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:49:49.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42f807f350 msgr2=0x7f42f8081810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:49.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42f807f350 0x7f42f8081810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0096c0 tx=0x7f42fc031400 comp rx=0 tx=0).stop 2024-09-21T11:49:49.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 msgr2=0x7f430819db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:49:49.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 0x7f430819db90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f42f400d6f0 tx=0x7f42f400dbb0 comp rx=0 tx=0).stop 2024-09-21T11:49:49.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 shutdown_connections 2024-09-21T11:49:49.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42f807f350 0x7f42f8081810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:49.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43081067e0 0x7f430819db90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:49.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 --2- 172.21.15.118:0/2819093274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43081007e0 0x7f430819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:49:49.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 >> 172.21.15.118:0/2819093274 conn(0x7f43080fc4c0 msgr2=0x7f4308069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:49:49.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 shutdown_connections 2024-09-21T11:49:49.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:49:49.042+0000 7f430ebfe640 1 -- 172.21.15.118:0/2819093274 wait complete. 2024-09-21T11:49:49.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:48 smithi149 ceph-mon[79770]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:48 smithi149 ceph-mon[79770]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:48 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2967756664' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:49:49.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:48 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1028030946' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:49:50.024 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:49 smithi149 ceph-mon[79770]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:50.024 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:49 smithi149 ceph-mon[79770]: pgmap v329: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:50.024 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:49 smithi149 ceph-mon[79770]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:50.024 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:49 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2819093274' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:49:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:49 smithi118 ceph-mon[111738]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:49 smithi118 ceph-mon[111738]: pgmap v329: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:49 smithi118 ceph-mon[111738]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:49:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:49 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2819093274' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:49:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:49:51.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:49:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:51 smithi118 ceph-mon[111738]: pgmap v330: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:52.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:51 smithi149 ceph-mon[79770]: pgmap v330: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:53 smithi118 ceph-mon[111738]: pgmap v331: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:54.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:53 smithi149 ceph-mon[79770]: pgmap v331: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:56.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:55 smithi118 ceph-mon[111738]: pgmap v332: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:56.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:55 smithi149 ceph-mon[79770]: pgmap v332: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:57 smithi118 ceph-mon[111738]: pgmap v333: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:49:58.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:57 smithi149 ceph-mon[79770]: pgmap v333: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:00.001 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:49:59 smithi118 ceph-mon[111738]: pgmap v334: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:00.175 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:49:59 smithi149 ceph-mon[79770]: pgmap v334: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T11:49:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:50:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T11:49:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:50:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T11:49:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-21T11:50:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T11:49:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:50:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T11:49:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:50:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T11:49:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:50:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T11:49:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-21T11:50:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-mon[111738]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:50:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-mon[111738]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:50:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-mon[111738]: fs cephfs is degraded 2024-09-21T11:50:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-mon[111738]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:50:01.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-mon[111738]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:50:01.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-mon[111738]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:50:01.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:00 smithi118 ceph-mon[111738]: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:50:01.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:00 smithi149 ceph-mon[79770]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:50:01.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:00 smithi149 ceph-mon[79770]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:50:01.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:00 smithi149 ceph-mon[79770]: fs cephfs is degraded 2024-09-21T11:50:01.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:00 smithi149 ceph-mon[79770]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:50:01.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:00 smithi149 ceph-mon[79770]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:50:01.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:00 smithi149 ceph-mon[79770]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:50:01.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:00 smithi149 ceph-mon[79770]: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:50:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:01 smithi118 ceph-mon[111738]: pgmap v335: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:02.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:01 smithi149 ceph-mon[79770]: pgmap v335: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:03 smithi118 ceph-mon[111738]: pgmap v336: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:04.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:03 smithi149 ceph-mon[79770]: pgmap v336: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:05.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:04 smithi118 ceph-mon[111738]: pgmap v337: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:05.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:04 smithi149 ceph-mon[79770]: pgmap v337: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:50:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:50:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:06 smithi118 ceph-mon[111738]: pgmap v338: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:07.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:06 smithi149 ceph-mon[79770]: pgmap v338: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:09 smithi118 ceph-mon[111738]: pgmap v339: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:09 smithi149 ceph-mon[79770]: pgmap v339: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:11 smithi118 ceph-mon[111738]: pgmap v340: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:11.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:11 smithi149 ceph-mon[79770]: pgmap v340: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:13.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:13 smithi118 ceph-mon[111738]: pgmap v341: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:13 smithi149 ceph-mon[79770]: pgmap v341: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:15.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:15 smithi118 ceph-mon[111738]: pgmap v342: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:15 smithi149 ceph-mon[79770]: pgmap v342: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:17.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:17 smithi118 ceph-mon[111738]: pgmap v343: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:17.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:17 smithi149 ceph-mon[79770]: pgmap v343: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:19.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.132+0000 7f893b30d640 1 -- 172.21.15.118:0/2036487562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934100820 msgr2=0x7f8934100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.132+0000 7f893b30d640 1 --2- 172.21.15.118:0/2036487562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934100820 0x7f8934100c80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8930009880 tx=0x7f893002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.132+0000 7f893b30d640 1 -- 172.21.15.118:0/2036487562 shutdown_connections 2024-09-21T11:50:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.132+0000 7f893b30d640 1 --2- 172.21.15.118:0/2036487562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934100820 0x7f8934100c80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.132+0000 7f893b30d640 1 --2- 172.21.15.118:0/2036487562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8934106820 0x7f8934106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.132+0000 7f893b30d640 1 -- 172.21.15.118:0/2036487562 >> 172.21.15.118:0/2036487562 conn(0x7f89340fc520 msgr2=0x7f89340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.132+0000 7f893b30d640 1 -- 172.21.15.118:0/2036487562 shutdown_connections 2024-09-21T11:50:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.132+0000 7f893b30d640 1 -- 172.21.15.118:0/2036487562 wait complete. 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f893b30d640 1 Processor -- start 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f893b30d640 1 -- start start 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f893b30d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8934100820 0x7f893419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f893b30d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934106820 0x7f893419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f893b30d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f893410dcd0 con 0x7f8934106820 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f893b30d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f893410db50 con 0x7f8934100820 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f89388a8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934106820 0x7f893419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f89388a8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934106820 0x7f893419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52694/0 (socket says 172.21.15.118:52694) 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f89388a8640 1 -- 172.21.15.118:0/1831187644 learned_addr learned my addr 172.21.15.118:0/1831187644 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.133+0000 7f89390a9640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8934100820 0x7f893419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:19.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.134+0000 7f89388a8640 1 -- 172.21.15.118:0/1831187644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8934100820 msgr2=0x7f893419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.134+0000 7f89388a8640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8934100820 0x7f893419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.134+0000 7f89388a8640 1 -- 172.21.15.118:0/1831187644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89341977f0 con 0x7f8934106820 2024-09-21T11:50:19.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.134+0000 7f89388a8640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934106820 0x7f893419dbb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8930031460 tx=0x7f89300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:19.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.134+0000 7f89267fc640 1 -- 172.21.15.118:0/1831187644 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f893003f070 con 0x7f8934106820 2024-09-21T11:50:19.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.134+0000 7f89267fc640 1 -- 172.21.15.118:0/1831187644 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8930004cf0 con 0x7f8934106820 2024-09-21T11:50:19.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.134+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8934197a80 con 0x7f8934106820 2024-09-21T11:50:19.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.134+0000 7f89267fc640 1 -- 172.21.15.118:0/1831187644 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8930035030 con 0x7f8934106820 2024-09-21T11:50:19.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.134+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8934197fb0 con 0x7f8934106820 2024-09-21T11:50:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.135+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8934101f60 con 0x7f8934106820 2024-09-21T11:50:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.136+0000 7f89267fc640 1 -- 172.21.15.118:0/1831187644 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8930042070 con 0x7f8934106820 2024-09-21T11:50:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.136+0000 7f89267fc640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f892007af30 0x7f892007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.136+0000 7f89267fc640 1 -- 172.21.15.118:0/1831187644 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f89300beac0 con 0x7f8934106820 2024-09-21T11:50:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.136+0000 7f89390a9640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f892007af30 0x7f892007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.137+0000 7f89390a9640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f892007af30 0x7f892007d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89280058c0 tx=0x7f892800a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:19.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.141+0000 7f89267fc640 1 -- 172.21.15.118:0/1831187644 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f893008a010 con 0x7f8934106820 2024-09-21T11:50:19.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.339+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8934198260 con 0x7f892007af30 2024-09-21T11:50:19.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.341+0000 7f89267fc640 1 -- 172.21.15.118:0/1831187644 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f8934198260 con 0x7f892007af30 2024-09-21T11:50:19.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f892007af30 msgr2=0x7f892007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f892007af30 0x7f892007d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89280058c0 tx=0x7f892800a2d0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934106820 msgr2=0x7f893419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934106820 0x7f893419dbb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8930031460 tx=0x7f89300048f0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 shutdown_connections 2024-09-21T11:50:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f892007af30 0x7f892007d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8934106820 0x7f893419dbb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 --2- 172.21.15.118:0/1831187644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8934100820 0x7f893419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 >> 172.21.15.118:0/1831187644 conn(0x7f89340fc520 msgr2=0x7f893406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:19.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 shutdown_connections 2024-09-21T11:50:19.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.343+0000 7f893b30d640 1 -- 172.21.15.118:0/1831187644 wait complete. 2024-09-21T11:50:19.354 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:50:19.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.425+0000 7f0f62b39640 1 -- 172.21.15.118:0/1743442232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c0ffd70 msgr2=0x7f0f5c1001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.425+0000 7f0f62b39640 1 --2- 172.21.15.118:0/1743442232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c0ffd70 0x7f0f5c1001d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009880 tx=0x7f0f4802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.428 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:19 smithi118 ceph-mon[111738]: pgmap v344: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:19.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.425+0000 7f0f62b39640 1 -- 172.21.15.118:0/1743442232 shutdown_connections 2024-09-21T11:50:19.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.425+0000 7f0f62b39640 1 --2- 172.21.15.118:0/1743442232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c0ffd70 0x7f0f5c1001d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.425+0000 7f0f62b39640 1 --2- 172.21.15.118:0/1743442232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c106950 0x7f0f5c106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.425+0000 7f0f62b39640 1 -- 172.21.15.118:0/1743442232 >> 172.21.15.118:0/1743442232 conn(0x7f0f5c0fbc60 msgr2=0x7f0f5c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.425+0000 7f0f62b39640 1 -- 172.21.15.118:0/1743442232 shutdown_connections 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.425+0000 7f0f62b39640 1 -- 172.21.15.118:0/1743442232 wait complete. 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f62b39640 1 Processor -- start 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f62b39640 1 -- start start 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f62b39640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c0ffd70 0x7f0f5c19d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f62b39640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c106950 0x7f0f5c19dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f62b39640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10ef50 con 0x7f0f5c106950 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f62b39640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10edd0 con 0x7f0f5c0ffd70 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f5bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c106950 0x7f0f5c19dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f5bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c106950 0x7f0f5c19dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52706/0 (socket says 172.21.15.118:52706) 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f5bfff640 1 -- 172.21.15.118:0/273008151 learned_addr learned my addr 172.21.15.118:0/273008151 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.426+0000 7f0f608d5640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c0ffd70 0x7f0f5c19d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.427+0000 7f0f5bfff640 1 -- 172.21.15.118:0/273008151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c0ffd70 msgr2=0x7f0f5c19d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.427+0000 7f0f5bfff640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c0ffd70 0x7f0f5c19d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.427+0000 7f0f5bfff640 1 -- 172.21.15.118:0/273008151 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c1978e0 con 0x7f0f5c106950 2024-09-21T11:50:19.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.427+0000 7f0f5bfff640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c106950 0x7f0f5c19dc60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0f48031460 tx=0x7f0f480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:19.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.427+0000 7f0f59ffb640 1 -- 172.21.15.118:0/273008151 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f4803f070 con 0x7f0f5c106950 2024-09-21T11:50:19.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.427+0000 7f0f59ffb640 1 -- 172.21.15.118:0/273008151 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f48004cf0 con 0x7f0f5c106950 2024-09-21T11:50:19.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.427+0000 7f0f59ffb640 1 -- 172.21.15.118:0/273008151 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f48035030 con 0x7f0f5c106950 2024-09-21T11:50:19.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.427+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c197b70 con 0x7f0f5c106950 2024-09-21T11:50:19.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.427+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c1980a0 con 0x7f0f5c106950 2024-09-21T11:50:19.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.429+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c103090 con 0x7f0f5c106950 2024-09-21T11:50:19.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.429+0000 7f0f59ffb640 1 -- 172.21.15.118:0/273008151 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0f48042070 con 0x7f0f5c106950 2024-09-21T11:50:19.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.430+0000 7f0f59ffb640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f4c07af30 0x7f0f4c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:19.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.430+0000 7f0f608d5640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f4c07af30 0x7f0f4c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:19.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.430+0000 7f0f59ffb640 1 -- 172.21.15.118:0/273008151 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0f480beb40 con 0x7f0f5c106950 2024-09-21T11:50:19.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.430+0000 7f0f608d5640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f4c07af30 0x7f0f4c07d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c198a20 tx=0x7f0f50009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:19.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.434+0000 7f0f59ffb640 1 -- 172.21.15.118:0/273008151 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f4808a090 con 0x7f0f5c106950 2024-09-21T11:50:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.628+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0f5c198ee0 con 0x7f0f4c07af30 2024-09-21T11:50:19.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.629+0000 7f0f59ffb640 1 -- 172.21.15.118:0/273008151 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0f5c198ee0 con 0x7f0f4c07af30 2024-09-21T11:50:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f4c07af30 msgr2=0x7f0f4c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f4c07af30 0x7f0f4c07d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c198a20 tx=0x7f0f50009110 comp rx=0 tx=0).stop 2024-09-21T11:50:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c106950 msgr2=0x7f0f5c19dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c106950 0x7f0f5c19dc60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0f48031460 tx=0x7f0f480048f0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 shutdown_connections 2024-09-21T11:50:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0f4c07af30 0x7f0f4c07d3f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f5c106950 0x7f0f5c19dc60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 --2- 172.21.15.118:0/273008151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f5c0ffd70 0x7f0f5c19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 >> 172.21.15.118:0/273008151 conn(0x7f0f5c0fbc60 msgr2=0x7f0f5c0fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 shutdown_connections 2024-09-21T11:50:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.632+0000 7f0f62b39640 1 -- 172.21.15.118:0/273008151 wait complete. 2024-09-21T11:50:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:19 smithi149 ceph-mon[79770]: pgmap v344: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:19.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.715+0000 7fb1e4eca640 1 -- 172.21.15.118:0/2267890938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 msgr2=0x7fb1e0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.715+0000 7fb1e4eca640 1 --2- 172.21.15.118:0/2267890938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 0x7fb1e0100c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009880 tx=0x7fb1c802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.715+0000 7fb1e4eca640 1 -- 172.21.15.118:0/2267890938 shutdown_connections 2024-09-21T11:50:19.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.715+0000 7fb1e4eca640 1 --2- 172.21.15.118:0/2267890938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 0x7fb1e0100c80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.715+0000 7fb1e4eca640 1 --2- 172.21.15.118:0/2267890938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e0106820 0x7fb1e0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.715+0000 7fb1e4eca640 1 -- 172.21.15.118:0/2267890938 >> 172.21.15.118:0/2267890938 conn(0x7fb1e00fc520 msgr2=0x7fb1e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:19.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.716+0000 7fb1e4eca640 1 -- 172.21.15.118:0/2267890938 shutdown_connections 2024-09-21T11:50:19.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.716+0000 7fb1e4eca640 1 -- 172.21.15.118:0/2267890938 wait complete. 2024-09-21T11:50:19.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.716+0000 7fb1e4eca640 1 Processor -- start 2024-09-21T11:50:19.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1e4eca640 1 -- start start 2024-09-21T11:50:19.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1e4eca640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 0x7fb1e0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:19.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1e4eca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e0106820 0x7fb1e0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:19.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1e4eca640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010dd50 con 0x7fb1e0100820 2024-09-21T11:50:19.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1e4eca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010dbd0 con 0x7fb1e0106820 2024-09-21T11:50:19.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1de59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 0x7fb1e0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:19.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1de59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 0x7fb1e0198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52722/0 (socket says 172.21.15.118:52722) 2024-09-21T11:50:19.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1de59c640 1 -- 172.21.15.118:0/3482034943 learned_addr learned my addr 172.21.15.118:0/3482034943 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:19.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1de59c640 1 -- 172.21.15.118:0/3482034943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e0106820 msgr2=0x7fb1e0198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1de59c640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e0106820 0x7fb1e0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1de59c640 1 -- 172.21.15.118:0/3482034943 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e01993b0 con 0x7fb1e0100820 2024-09-21T11:50:19.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.717+0000 7fb1de59c640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 0x7fb1e0198870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b420 tx=0x7fb1d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:19.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.718+0000 7fb1d7fff640 1 -- 172.21.15.118:0/3482034943 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1d0011630 con 0x7fb1e0100820 2024-09-21T11:50:19.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.718+0000 7fb1d7fff640 1 -- 172.21.15.118:0/3482034943 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1d0016070 con 0x7fb1e0100820 2024-09-21T11:50:19.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.718+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e01996a0 con 0x7fb1e0100820 2024-09-21T11:50:19.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.718+0000 7fb1d7fff640 1 -- 172.21.15.118:0/3482034943 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1d0010d40 con 0x7fb1e0100820 2024-09-21T11:50:19.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.718+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e01a1ca0 con 0x7fb1e0100820 2024-09-21T11:50:19.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.719+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e0101f60 con 0x7fb1e0100820 2024-09-21T11:50:19.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.719+0000 7fb1d7fff640 1 -- 172.21.15.118:0/3482034943 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb1d001b460 con 0x7fb1e0100820 2024-09-21T11:50:19.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.720+0000 7fb1d7fff640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb1cc07af30 0x7fb1cc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:19.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.720+0000 7fb1d7fff640 1 -- 172.21.15.118:0/3482034943 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb1d009d7f0 con 0x7fb1e0100820 2024-09-21T11:50:19.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.720+0000 7fb1d5d9b640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb1cc07af30 0x7fb1cc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:19.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.720+0000 7fb1d5d9b640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb1cc07af30 0x7fb1cc07d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80096c0 tx=0x7fb1c8000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:19.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.724+0000 7fb1d7fff640 1 -- 172.21.15.118:0/3482034943 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb1e01996a0 con 0x7fb1e0100820 2024-09-21T11:50:19.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.909+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb1e0108e20 con 0x7fb1cc07af30 2024-09-21T11:50:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.918+0000 7fb1d7fff640 1 -- 172.21.15.118:0/3482034943 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb1c8004340 con 0x7fb1cc07af30 2024-09-21T11:50:19.920 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:50:19.920 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (8m) 2m ago 19m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:50:19.920 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (11m) 2m ago 19m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:50:19.920 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (10m) 2m ago 18m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (6m) 2m ago 19m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (6m) 2m ago 18m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (7m) 2m ago 19m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (2m) 2m ago 13m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (2m) 2m ago 13m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (13m) 2m ago 13m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (2m) 2m ago 13m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (10m) 2m ago 20m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (9m) 2m ago 18m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (6m) 2m ago 20m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (6m) 2m ago 18m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (9m) 2m ago 19m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (9m) 2m ago 18m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (5m) 2m ago 17m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:50:19.921 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (5m) 2m ago 16m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:50:19.922 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (4m) 2m ago 16m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:50:19.922 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (4m) 2m ago 15m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:50:19.922 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (3m) 2m ago 15m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:50:19.922 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (2m) 2m ago 14m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:50:19.922 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (8m) 2m ago 18m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:50:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb1cc07af30 msgr2=0x7fb1cc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb1cc07af30 0x7fb1cc07d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80096c0 tx=0x7fb1c8000bc0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 msgr2=0x7fb1e0198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 0x7fb1e0198870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b420 tx=0x7fb1d000b8e0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 shutdown_connections 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1e0106820 0x7fb1e0198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb1cc07af30 0x7fb1cc07d3f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 --2- 172.21.15.118:0/3482034943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e0100820 0x7fb1e0198870 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 >> 172.21.15.118:0/3482034943 conn(0x7fb1e00fc520 msgr2=0x7fb1e00fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 shutdown_connections 2024-09-21T11:50:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:19.920+0000 7fb1e4eca640 1 -- 172.21.15.118:0/3482034943 wait complete. 2024-09-21T11:50:20.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.003+0000 7ff0b5be9640 1 -- 172.21.15.118:0/3449263325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 msgr2=0x7ff0b0100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.003+0000 7ff0b5be9640 1 --2- 172.21.15.118:0/3449263325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 0x7ff0b0100c40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff098009880 tx=0x7ff09802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.003+0000 7ff0b5be9640 1 -- 172.21.15.118:0/3449263325 shutdown_connections 2024-09-21T11:50:20.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.003+0000 7ff0b5be9640 1 --2- 172.21.15.118:0/3449263325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 0x7ff0b0100c40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.003+0000 7ff0b5be9640 1 --2- 172.21.15.118:0/3449263325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b01067e0 0x7ff0b0106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.003+0000 7ff0b5be9640 1 -- 172.21.15.118:0/3449263325 >> 172.21.15.118:0/3449263325 conn(0x7ff0b00fc4c0 msgr2=0x7ff0b00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:20.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.003+0000 7ff0b5be9640 1 -- 172.21.15.118:0/3449263325 shutdown_connections 2024-09-21T11:50:20.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.003+0000 7ff0b5be9640 1 -- 172.21.15.118:0/3449263325 wait complete. 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0b5be9640 1 Processor -- start 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0b5be9640 1 -- start start 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0b5be9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 0x7ff0b019c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0b5be9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b01067e0 0x7ff0b019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0b5be9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b010dcb0 con 0x7ff0b01007e0 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0b5be9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b010db30 con 0x7ff0b01067e0 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 0x7ff0b019c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 0x7ff0b019c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52740/0 (socket says 172.21.15.118:52740) 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0af7fe640 1 -- 172.21.15.118:0/2002424256 learned_addr learned my addr 172.21.15.118:0/2002424256 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.004+0000 7ff0aeffd640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b01067e0 0x7ff0b019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.005+0000 7ff0af7fe640 1 -- 172.21.15.118:0/2002424256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b01067e0 msgr2=0x7ff0b019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.005+0000 7ff0af7fe640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b01067e0 0x7ff0b019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.005+0000 7ff0af7fe640 1 -- 172.21.15.118:0/2002424256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b01966a0 con 0x7ff0b01007e0 2024-09-21T11:50:20.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.005+0000 7ff0af7fe640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 0x7ff0b019c5d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000ea00 tx=0x7ff0a000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:20.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.005+0000 7ff0acff9640 1 -- 172.21.15.118:0/2002424256 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0a000cb80 con 0x7ff0b01007e0 2024-09-21T11:50:20.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.005+0000 7ff0acff9640 1 -- 172.21.15.118:0/2002424256 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0a000cd20 con 0x7ff0b01007e0 2024-09-21T11:50:20.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.005+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b0196990 con 0x7ff0b01007e0 2024-09-21T11:50:20.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.005+0000 7ff0acff9640 1 -- 172.21.15.118:0/2002424256 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0a0011470 con 0x7ff0b01007e0 2024-09-21T11:50:20.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.005+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b0196ef0 con 0x7ff0b01007e0 2024-09-21T11:50:20.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.006+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b0101f20 con 0x7ff0b01007e0 2024-09-21T11:50:20.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.008+0000 7ff0acff9640 1 -- 172.21.15.118:0/2002424256 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff0a0005020 con 0x7ff0b01007e0 2024-09-21T11:50:20.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.008+0000 7ff0acff9640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af80 0x7ff09c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.008+0000 7ff0acff9640 1 -- 172.21.15.118:0/2002424256 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff0a009e3a0 con 0x7ff0b01007e0 2024-09-21T11:50:20.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.008+0000 7ff0aeffd640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af80 0x7ff09c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.009+0000 7ff0aeffd640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af80 0x7ff09c07d440 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0197ef0 tx=0x7ff098031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:20.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.012+0000 7ff0acff9640 1 -- 172.21.15.118:0/2002424256 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0a0016030 con 0x7ff0b01007e0 2024-09-21T11:50:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.261+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff0b0108d50 con 0x7ff0b01007e0 2024-09-21T11:50:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.262+0000 7ff0acff9640 1 -- 172.21.15.118:0/2002424256 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7ff0a0069970 con 0x7ff0b01007e0 2024-09-21T11:50:20.264 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:50:20.264 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:50:20.265 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:50:20.266 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:50:20.266 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:50:20.266 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af80 msgr2=0x7ff09c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af80 0x7ff09c07d440 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0197ef0 tx=0x7ff098031400 comp rx=0 tx=0).stop 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 msgr2=0x7ff0b019c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 0x7ff0b019c5d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000ea00 tx=0x7ff0a000eec0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 shutdown_connections 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b01067e0 0x7ff0b019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af80 0x7ff09c07d440 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 --2- 172.21.15.118:0/2002424256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b01007e0 0x7ff0b019c5d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 >> 172.21.15.118:0/2002424256 conn(0x7ff0b00fc4c0 msgr2=0x7ff0b00fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 shutdown_connections 2024-09-21T11:50:20.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.264+0000 7ff0b5be9640 1 -- 172.21.15.118:0/2002424256 wait complete. 2024-09-21T11:50:20.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.349+0000 7f042707d640 1 -- 172.21.15.118:0/521820685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201067e0 msgr2=0x7f0420106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.349+0000 7f042707d640 1 --2- 172.21.15.118:0/521820685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201067e0 0x7f0420106bc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0414009880 tx=0x7f041402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 -- 172.21.15.118:0/521820685 shutdown_connections 2024-09-21T11:50:20.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 --2- 172.21.15.118:0/521820685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04201007e0 0x7f0420100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 --2- 172.21.15.118:0/521820685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201067e0 0x7f0420106bc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 -- 172.21.15.118:0/521820685 >> 172.21.15.118:0/521820685 conn(0x7f04200fc4c0 msgr2=0x7f04200fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:20.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 -- 172.21.15.118:0/521820685 shutdown_connections 2024-09-21T11:50:20.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 -- 172.21.15.118:0/521820685 wait complete. 2024-09-21T11:50:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 Processor -- start 2024-09-21T11:50:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 -- start start 2024-09-21T11:50:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201007e0 0x7f0420198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04201067e0 0x7f0420198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f042010dd10 con 0x7f04201007e0 2024-09-21T11:50:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.350+0000 7f042707d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f042010db90 con 0x7f04201067e0 2024-09-21T11:50:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f0424e19640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201007e0 0x7f0420198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f0424e19640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201007e0 0x7f0420198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52746/0 (socket says 172.21.15.118:52746) 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f0424e19640 1 -- 172.21.15.118:0/1086195943 learned_addr learned my addr 172.21.15.118:0/1086195943 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f0424e19640 1 -- 172.21.15.118:0/1086195943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04201067e0 msgr2=0x7f0420198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f0424e19640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04201067e0 0x7f0420198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f0424e19640 1 -- 172.21.15.118:0/1086195943 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04201993d0 con 0x7f04201007e0 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f0424e19640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201007e0 0x7f0420198840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0414031460 tx=0x7f04140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f041dffb640 1 -- 172.21.15.118:0/1086195943 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f041403f070 con 0x7f04201007e0 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f041dffb640 1 -- 172.21.15.118:0/1086195943 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0414004cf0 con 0x7f04201007e0 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0420199660 con 0x7f04201007e0 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f041dffb640 1 -- 172.21.15.118:0/1086195943 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0414035030 con 0x7f04201007e0 2024-09-21T11:50:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.351+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04201a1c10 con 0x7f04201007e0 2024-09-21T11:50:20.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.352+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0420101f20 con 0x7f04201007e0 2024-09-21T11:50:20.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.353+0000 7f041dffb640 1 -- 172.21.15.118:0/1086195943 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0414042070 con 0x7f04201007e0 2024-09-21T11:50:20.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.353+0000 7f041dffb640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f041007af30 0x7f041007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.354+0000 7f041dffb640 1 -- 172.21.15.118:0/1086195943 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f04140bebb0 con 0x7f04201007e0 2024-09-21T11:50:20.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.354+0000 7f041ffff640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f041007af30 0x7f041007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.354+0000 7f041ffff640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f041007af30 0x7f041007d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f042006a6c0 tx=0x7f040c006c90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:20.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.358+0000 7f041dffb640 1 -- 172.21.15.118:0/1086195943 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f04140c5080 con 0x7f04201007e0 2024-09-21T11:50:20.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.569+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0420108d50 con 0x7f04201007e0 2024-09-21T11:50:20.572 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:20 smithi118 ceph-mon[111738]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:20.572 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:20 smithi118 ceph-mon[111738]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:20.572 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:50:20.572 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:20 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2002424256' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:50:20.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.569+0000 7f041dffb640 1 -- 172.21.15.118:0/1086195943 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f041408a100 con 0x7f04201007e0 2024-09-21T11:50:20.572 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:50:20.573 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:50:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:50:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:50:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:50:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f041007af30 msgr2=0x7f041007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f041007af30 0x7f041007d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f042006a6c0 tx=0x7f040c006c90 comp rx=0 tx=0).stop 2024-09-21T11:50:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201007e0 msgr2=0x7f0420198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201007e0 0x7f0420198840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0414031460 tx=0x7f04140048f0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 shutdown_connections 2024-09-21T11:50:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04201067e0 0x7f0420198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f041007af30 0x7f041007d3f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 --2- 172.21.15.118:0/1086195943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04201007e0 0x7f0420198840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 >> 172.21.15.118:0/1086195943 conn(0x7f04200fc4c0 msgr2=0x7f04200fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 shutdown_connections 2024-09-21T11:50:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.572+0000 7f042707d640 1 -- 172.21.15.118:0/1086195943 wait complete. 2024-09-21T11:50:20.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.654+0000 7ff640d73640 1 -- 172.21.15.118:0/3926267864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 msgr2=0x7ff63c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.654+0000 7ff640d73640 1 --2- 172.21.15.118:0/3926267864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 0x7ff63c102ec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009880 tx=0x7ff62c02a530 comp rx=0 tx=0).stop 2024-09-21T11:50:20.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.654+0000 7ff640d73640 1 -- 172.21.15.118:0/3926267864 shutdown_connections 2024-09-21T11:50:20.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.654+0000 7ff640d73640 1 --2- 172.21.15.118:0/3926267864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c103400 0x7ff63c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.654+0000 7ff640d73640 1 --2- 172.21.15.118:0/3926267864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 0x7ff63c102ec0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.654+0000 7ff640d73640 1 -- 172.21.15.118:0/3926267864 >> 172.21.15.118:0/3926267864 conn(0x7ff63c0fc520 msgr2=0x7ff63c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:20.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.654+0000 7ff640d73640 1 -- 172.21.15.118:0/3926267864 shutdown_connections 2024-09-21T11:50:20.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.654+0000 7ff640d73640 1 -- 172.21.15.118:0/3926267864 wait complete. 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff640d73640 1 Processor -- start 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff640d73640 1 -- start start 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff640d73640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 0x7ff63c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff640d73640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c103400 0x7ff63c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff640d73640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c10ee70 con 0x7ff63c102ae0 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff640d73640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c10ecf0 con 0x7ff63c103400 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff63a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 0x7ff63c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff63a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 0x7ff63c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52774/0 (socket says 172.21.15.118:52774) 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff63a59c640 1 -- 172.21.15.118:0/766398966 learned_addr learned my addr 172.21.15.118:0/766398966 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.655+0000 7ff633fff640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c103400 0x7ff63c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.656+0000 7ff63a59c640 1 -- 172.21.15.118:0/766398966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c103400 msgr2=0x7ff63c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.656+0000 7ff63a59c640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c103400 0x7ff63c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.656+0000 7ff63a59c640 1 -- 172.21.15.118:0/766398966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c197860 con 0x7ff63c102ae0 2024-09-21T11:50:20.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.656+0000 7ff63a59c640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 0x7ff63c19d6a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff62c031460 tx=0x7ff62c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:20.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.656+0000 7ff6337fe640 1 -- 172.21.15.118:0/766398966 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff62c03f070 con 0x7ff63c102ae0 2024-09-21T11:50:20.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.656+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63c197af0 con 0x7ff63c102ae0 2024-09-21T11:50:20.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.656+0000 7ff6337fe640 1 -- 172.21.15.118:0/766398966 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff62c004cf0 con 0x7ff63c102ae0 2024-09-21T11:50:20.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.656+0000 7ff6337fe640 1 -- 172.21.15.118:0/766398966 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff62c035030 con 0x7ff63c102ae0 2024-09-21T11:50:20.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.656+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63c198020 con 0x7ff63c102ae0 2024-09-21T11:50:20.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.657+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63c06abe0 con 0x7ff63c102ae0 2024-09-21T11:50:20.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.658+0000 7ff6337fe640 1 -- 172.21.15.118:0/766398966 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff62c042070 con 0x7ff63c102ae0 2024-09-21T11:50:20.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.658+0000 7ff6337fe640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62807af80 0x7ff62807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.658+0000 7ff6337fe640 1 -- 172.21.15.118:0/766398966 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff62c0bea80 con 0x7ff63c102ae0 2024-09-21T11:50:20.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.658+0000 7ff633fff640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62807af80 0x7ff62807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.659+0000 7ff633fff640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62807af80 0x7ff62807d440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0fe510 tx=0x7ff624009060 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:20.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.663+0000 7ff6337fe640 1 -- 172.21.15.118:0/766398966 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff62c089fb0 con 0x7ff63c102ae0 2024-09-21T11:50:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:20 smithi149 ceph-mon[79770]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:20 smithi149 ceph-mon[79770]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:50:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:20 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2002424256' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:50:20.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.855+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff63c198d90 con 0x7ff62807af80 2024-09-21T11:50:20.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.856+0000 7ff6337fe640 1 -- 172.21.15.118:0/766398966 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ff63c198d90 con 0x7ff62807af80 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:50:20.859 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.858+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62807af80 msgr2=0x7ff62807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.858+0000 7ff640d73640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62807af80 0x7ff62807d440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0fe510 tx=0x7ff624009060 comp rx=0 tx=0).stop 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.858+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 msgr2=0x7ff63c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.858+0000 7ff640d73640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 0x7ff63c19d6a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff62c031460 tx=0x7ff62c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.858+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 shutdown_connections 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.859+0000 7ff640d73640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c103400 0x7ff63c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.859+0000 7ff640d73640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62807af80 0x7ff62807d440 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.859+0000 7ff640d73640 1 --2- 172.21.15.118:0/766398966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c102ae0 0x7ff63c19d6a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.859+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 >> 172.21.15.118:0/766398966 conn(0x7ff63c0fc520 msgr2=0x7ff63c108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.859+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 shutdown_connections 2024-09-21T11:50:20.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.859+0000 7ff640d73640 1 -- 172.21.15.118:0/766398966 wait complete. 2024-09-21T11:50:20.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.940+0000 7f41a494e640 1 -- 172.21.15.118:0/1935580027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0100800 msgr2=0x7f41a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.940+0000 7f41a494e640 1 --2- 172.21.15.118:0/1935580027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0100800 0x7f41a0100c60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4188009880 tx=0x7f418802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.940+0000 7f41a494e640 1 -- 172.21.15.118:0/1935580027 shutdown_connections 2024-09-21T11:50:20.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.940+0000 7f41a494e640 1 --2- 172.21.15.118:0/1935580027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0100800 0x7f41a0100c60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.940+0000 7f41a494e640 1 --2- 172.21.15.118:0/1935580027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0106800 0x7f41a0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.940+0000 7f41a494e640 1 -- 172.21.15.118:0/1935580027 >> 172.21.15.118:0/1935580027 conn(0x7f41a00fc4e0 msgr2=0x7f41a00fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:20.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.940+0000 7f41a494e640 1 -- 172.21.15.118:0/1935580027 shutdown_connections 2024-09-21T11:50:20.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.940+0000 7f41a494e640 1 -- 172.21.15.118:0/1935580027 wait complete. 2024-09-21T11:50:20.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.940+0000 7f41a494e640 1 Processor -- start 2024-09-21T11:50:20.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f41a494e640 1 -- start start 2024-09-21T11:50:20.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f41a494e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0100800 0x7f41a0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f41a494e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0106800 0x7f41a0198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f41a494e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f41a010dd30 con 0x7f41a0106800 2024-09-21T11:50:20.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f41a494e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f41a010dbb0 con 0x7f41a0100800 2024-09-21T11:50:20.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f419dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0106800 0x7f41a0198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f419dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0106800 0x7f41a0198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52778/0 (socket says 172.21.15.118:52778) 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f419dd9b640 1 -- 172.21.15.118:0/1339917210 learned_addr learned my addr 172.21.15.118:0/1339917210 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f419e59c640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0100800 0x7f41a0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f419dd9b640 1 -- 172.21.15.118:0/1339917210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0100800 msgr2=0x7f41a0198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f419dd9b640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0100800 0x7f41a0198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f419dd9b640 1 -- 172.21.15.118:0/1339917210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a01993e0 con 0x7f41a0106800 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.941+0000 7f419dd9b640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0106800 0x7f41a0198d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4188031460 tx=0x7f41880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.942+0000 7f41977fe640 1 -- 172.21.15.118:0/1339917210 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f418803f070 con 0x7f41a0106800 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.942+0000 7f41977fe640 1 -- 172.21.15.118:0/1339917210 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4188004cf0 con 0x7f41a0106800 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.942+0000 7f41977fe640 1 -- 172.21.15.118:0/1339917210 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4188035030 con 0x7f41a0106800 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.942+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a0199670 con 0x7f41a0106800 2024-09-21T11:50:20.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.942+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a01a1c20 con 0x7f41a0106800 2024-09-21T11:50:20.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.943+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a0101f40 con 0x7f41a0106800 2024-09-21T11:50:20.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.943+0000 7f41977fe640 1 -- 172.21.15.118:0/1339917210 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4188042070 con 0x7f41a0106800 2024-09-21T11:50:20.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.944+0000 7f41977fe640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f418c07af30 0x7f418c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:20.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.944+0000 7f41977fe640 1 -- 172.21.15.118:0/1339917210 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f41880beb40 con 0x7f41a0106800 2024-09-21T11:50:20.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.944+0000 7f419e59c640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f418c07af30 0x7f418c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:20.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.944+0000 7f419e59c640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f418c07af30 0x7f418c07d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4190009990 tx=0x7f4190009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:20.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:20.948+0000 7f41977fe640 1 -- 172.21.15.118:0/1339917210 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f418808a090 con 0x7f41a0106800 2024-09-21T11:50:21.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.193+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f41a0108d90 con 0x7f41a0106800 2024-09-21T11:50:21.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.193+0000 7f41977fe640 1 -- 172.21.15.118:0/1339917210 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f418808ef40 con 0x7f41a0106800 2024-09-21T11:50:21.196 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:50:21.196 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:50:21.196 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:50:21.196 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:50:21.196 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:50:21.196 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:50:21.196 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:50:21.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.195+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f418c07af30 msgr2=0x7f418c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:21.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.195+0000 7f41a494e640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f418c07af30 0x7f418c07d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4190009990 tx=0x7f4190009110 comp rx=0 tx=0).stop 2024-09-21T11:50:21.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.195+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0106800 msgr2=0x7f41a0198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:21.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.195+0000 7f41a494e640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0106800 0x7f41a0198d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4188031460 tx=0x7f41880048f0 comp rx=0 tx=0).stop 2024-09-21T11:50:21.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.196+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 shutdown_connections 2024-09-21T11:50:21.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.196+0000 7f41a494e640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f418c07af30 0x7f418c07d3f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:21.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.196+0000 7f41a494e640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a0106800 0x7f41a0198d90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:21.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.196+0000 7f41a494e640 1 --2- 172.21.15.118:0/1339917210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0100800 0x7f41a0198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:21.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.196+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 >> 172.21.15.118:0/1339917210 conn(0x7f41a00fc4e0 msgr2=0x7f41a00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:21.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.196+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 shutdown_connections 2024-09-21T11:50:21.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:21.196+0000 7f41a494e640 1 -- 172.21.15.118:0/1339917210 wait complete. 2024-09-21T11:50:21.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:21 smithi118 ceph-mon[111738]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:21.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:21 smithi118 ceph-mon[111738]: pgmap v345: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:21.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:21 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1086195943' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:50:21.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:21 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1339917210' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:50:21.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:21 smithi149 ceph-mon[79770]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:21.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:21 smithi149 ceph-mon[79770]: pgmap v345: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:21.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:21 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1086195943' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:50:21.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:21 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1339917210' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:50:22.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:22 smithi118 ceph-mon[111738]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:22.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:22 smithi149 ceph-mon[79770]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:23 smithi118 ceph-mon[111738]: pgmap v346: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:23.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:23 smithi149 ceph-mon[79770]: pgmap v346: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:25.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:25 smithi118 ceph-mon[111738]: pgmap v347: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:25.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:25 smithi149 ceph-mon[79770]: pgmap v347: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:27.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:27 smithi118 ceph-mon[111738]: pgmap v348: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:27 smithi149 ceph-mon[79770]: pgmap v348: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:29.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:29 smithi118 ceph-mon[111738]: pgmap v349: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:29 smithi149 ceph-mon[79770]: pgmap v349: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:31.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:31 smithi118 ceph-mon[111738]: pgmap v350: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:31.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:31 smithi149 ceph-mon[79770]: pgmap v350: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:33.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:33 smithi118 ceph-mon[111738]: pgmap v351: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:33 smithi149 ceph-mon[79770]: pgmap v351: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:35 smithi149 ceph-mon[79770]: pgmap v352: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:50:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:35 smithi118 ceph-mon[111738]: pgmap v352: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:50:37.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:37 smithi149 ceph-mon[79770]: pgmap v353: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:37 smithi118 ceph-mon[111738]: pgmap v353: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:39.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:39 smithi149 ceph-mon[79770]: pgmap v354: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:39 smithi118 ceph-mon[111738]: pgmap v354: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:41.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:41 smithi149 ceph-mon[79770]: pgmap v355: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:41 smithi118 ceph-mon[111738]: pgmap v355: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:43.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:43 smithi149 ceph-mon[79770]: pgmap v356: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:43 smithi118 ceph-mon[111738]: pgmap v356: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:45.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:45 smithi149 ceph-mon[79770]: pgmap v357: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:45 smithi118 ceph-mon[111738]: pgmap v357: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:47.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:47 smithi149 ceph-mon[79770]: pgmap v358: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:47 smithi118 ceph-mon[111738]: pgmap v358: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:49.638 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:49 smithi118 ceph-mon[111738]: pgmap v359: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:49 smithi149 ceph-mon[79770]: pgmap v359: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:50:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:50:51.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.291+0000 7f0560a3c640 1 -- 172.21.15.118:0/3052965383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1067e0 msgr2=0x7f055c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.291+0000 7f0560a3c640 1 --2- 172.21.15.118:0/3052965383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1067e0 0x7f055c106bc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f054c009c20 tx=0x7f054c02a970 comp rx=0 tx=0).stop 2024-09-21T11:50:51.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.291+0000 7f0560a3c640 1 -- 172.21.15.118:0/3052965383 shutdown_connections 2024-09-21T11:50:51.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.291+0000 7f0560a3c640 1 --2- 172.21.15.118:0/3052965383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f055c1007e0 0x7f055c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.291+0000 7f0560a3c640 1 --2- 172.21.15.118:0/3052965383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1067e0 0x7f055c106bc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.291+0000 7f0560a3c640 1 -- 172.21.15.118:0/3052965383 >> 172.21.15.118:0/3052965383 conn(0x7f055c0fc4c0 msgr2=0x7f055c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:51.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.291+0000 7f0560a3c640 1 -- 172.21.15.118:0/3052965383 shutdown_connections 2024-09-21T11:50:51.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.291+0000 7f0560a3c640 1 -- 172.21.15.118:0/3052965383 wait complete. 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.292+0000 7f0560a3c640 1 Processor -- start 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.292+0000 7f0560a3c640 1 -- start start 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.292+0000 7f0560a3c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1007e0 0x7f055c1023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.292+0000 7f0560a3c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f055c1067e0 0x7f055c1028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.292+0000 7f0560a3c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f055c10dd10 con 0x7f055c1007e0 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.292+0000 7f0560a3c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f055c10db90 con 0x7f055c1067e0 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.292+0000 7f055a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1007e0 0x7f055c1023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.292+0000 7f055a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1007e0 0x7f055c1023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44438/0 (socket says 172.21.15.118:44438) 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.292+0000 7f055a59c640 1 -- 172.21.15.118:0/3350803517 learned_addr learned my addr 172.21.15.118:0/3350803517 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f0559d9b640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f055c1067e0 0x7f055c1028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f055a59c640 1 -- 172.21.15.118:0/3350803517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f055c1067e0 msgr2=0x7f055c1028f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f055a59c640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f055c1067e0 0x7f055c1028f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f055a59c640 1 -- 172.21.15.118:0/3350803517 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c102e30 con 0x7f055c1007e0 2024-09-21T11:50:51.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f0559d9b640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f055c1067e0 0x7f055c1028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:50:51.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f055a59c640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1007e0 0x7f055c1023b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f054c005cc0 tx=0x7f054c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:51.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f05537fe640 1 -- 172.21.15.118:0/3350803517 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f054c047070 con 0x7f055c1007e0 2024-09-21T11:50:51.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055c1030c0 con 0x7f055c1007e0 2024-09-21T11:50:51.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f05537fe640 1 -- 172.21.15.118:0/3350803517 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f054c02f7e0 con 0x7f055c1007e0 2024-09-21T11:50:51.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f05537fe640 1 -- 172.21.15.118:0/3350803517 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f054c034070 con 0x7f055c1007e0 2024-09-21T11:50:51.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.293+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055c1a3ee0 con 0x7f055c1007e0 2024-09-21T11:50:51.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.294+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055c101f20 con 0x7f055c1007e0 2024-09-21T11:50:51.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.295+0000 7f05537fe640 1 -- 172.21.15.118:0/3350803517 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f054c04a070 con 0x7f055c1007e0 2024-09-21T11:50:51.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.295+0000 7f05537fe640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f054807af30 0x7f054807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:51.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.296+0000 7f0559d9b640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f054807af30 0x7f054807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:51.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.296+0000 7f05537fe640 1 -- 172.21.15.118:0/3350803517 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f054c0bef90 con 0x7f055c1007e0 2024-09-21T11:50:51.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.296+0000 7f0559d9b640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f054807af30 0x7f054807d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0544006fd0 tx=0x7f0544008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:51.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.300+0000 7f05537fe640 1 -- 172.21.15.118:0/3350803517 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f054c03f070 con 0x7f055c1007e0 2024-09-21T11:50:51.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.496+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f055c069b30 con 0x7f054807af30 2024-09-21T11:50:51.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.497+0000 7f05537fe640 1 -- 172.21.15.118:0/3350803517 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f055c069b30 con 0x7f054807af30 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f054807af30 msgr2=0x7f054807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f054807af30 0x7f054807d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0544006fd0 tx=0x7f0544008040 comp rx=0 tx=0).stop 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1007e0 msgr2=0x7f055c1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1007e0 0x7f055c1023b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f054c005cc0 tx=0x7f054c02f5f0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 shutdown_connections 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f055c1067e0 0x7f055c1028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f054807af30 0x7f054807d3f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 --2- 172.21.15.118:0/3350803517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055c1007e0 0x7f055c1023b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 >> 172.21.15.118:0/3350803517 conn(0x7f055c0fc4c0 msgr2=0x7f055c1046d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 shutdown_connections 2024-09-21T11:50:51.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.499+0000 7f0560a3c640 1 -- 172.21.15.118:0/3350803517 wait complete. 2024-09-21T11:50:51.510 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:50:51.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:51 smithi118 ceph-mon[111738]: pgmap v360: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:51.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.584+0000 7f4927648640 1 -- 172.21.15.118:0/1672087267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 msgr2=0x7f4920107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.584+0000 7f4927648640 1 --2- 172.21.15.118:0/1672087267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 0x7f4920107cf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4910009c20 tx=0x7f491002a970 comp rx=0 tx=0).stop 2024-09-21T11:50:51.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.584+0000 7f4927648640 1 -- 172.21.15.118:0/1672087267 shutdown_connections 2024-09-21T11:50:51.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.584+0000 7f4927648640 1 --2- 172.21.15.118:0/1672087267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4920101910 0x7f4920101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.584+0000 7f4927648640 1 --2- 172.21.15.118:0/1672087267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 0x7f4920107cf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.584+0000 7f4927648640 1 -- 172.21.15.118:0/1672087267 >> 172.21.15.118:0/1672087267 conn(0x7f49200fd5f0 msgr2=0x7f49200ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:51.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.584+0000 7f4927648640 1 -- 172.21.15.118:0/1672087267 shutdown_connections 2024-09-21T11:50:51.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.584+0000 7f4927648640 1 -- 172.21.15.118:0/1672087267 wait complete. 2024-09-21T11:50:51.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.584+0000 7f4927648640 1 Processor -- start 2024-09-21T11:50:51.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4927648640 1 -- start start 2024-09-21T11:50:51.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4927648640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4920101910 0x7f492019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4927648640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 0x7f492019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4927648640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f492010ede0 con 0x7f4920107910 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4927648640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f492010ec60 con 0x7f4920101910 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4924be3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 0x7f492019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4924be3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 0x7f492019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44458/0 (socket says 172.21.15.118:44458) 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4924be3640 1 -- 172.21.15.118:0/2906302318 learned_addr learned my addr 172.21.15.118:0/2906302318 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f49253e4640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4920101910 0x7f492019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4924be3640 1 -- 172.21.15.118:0/2906302318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4920101910 msgr2=0x7f492019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4924be3640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4920101910 0x7f492019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4924be3640 1 -- 172.21.15.118:0/2906302318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49201977d0 con 0x7f4920107910 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f49253e4640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4920101910 0x7f492019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.585+0000 7f4924be3640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 0x7f492019db90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f491400d6f0 tx=0x7f491400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.586+0000 7f491e7fc640 1 -- 172.21.15.118:0/2906302318 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4914017070 con 0x7f4920107910 2024-09-21T11:50:51.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.586+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4920197ac0 con 0x7f4920107910 2024-09-21T11:50:51.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.586+0000 7f491e7fc640 1 -- 172.21.15.118:0/2906302318 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f491400de00 con 0x7f4920107910 2024-09-21T11:50:51.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.586+0000 7f491e7fc640 1 -- 172.21.15.118:0/2906302318 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4914004bb0 con 0x7f4920107910 2024-09-21T11:50:51.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.586+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4920198050 con 0x7f4920107910 2024-09-21T11:50:51.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.587+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4920103050 con 0x7f4920107910 2024-09-21T11:50:51.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.587+0000 7f491e7fc640 1 -- 172.21.15.118:0/2906302318 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4914009a30 con 0x7f4920107910 2024-09-21T11:50:51.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.588+0000 7f491e7fc640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f490807af40 0x7f490807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:51.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.588+0000 7f491e7fc640 1 -- 172.21.15.118:0/2906302318 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f491409dd10 con 0x7f4920107910 2024-09-21T11:50:51.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.588+0000 7f49253e4640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f490807af40 0x7f490807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:51.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.588+0000 7f49253e4640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f490807af40 0x7f490807d400 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4910006010 tx=0x7f491002fa60 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:51.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.592+0000 7f491e7fc640 1 -- 172.21.15.118:0/2906302318 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4914069260 con 0x7f4920107910 2024-09-21T11:50:51.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:51 smithi149 ceph-mon[79770]: pgmap v360: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:51.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.784+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4920198300 con 0x7f490807af40 2024-09-21T11:50:51.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.785+0000 7f491e7fc640 1 -- 172.21.15.118:0/2906302318 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4920198300 con 0x7f490807af40 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.787+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f490807af40 msgr2=0x7f490807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.787+0000 7f4927648640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f490807af40 0x7f490807d400 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4910006010 tx=0x7f491002fa60 comp rx=0 tx=0).stop 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.787+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 msgr2=0x7f492019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.787+0000 7f4927648640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 0x7f492019db90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f491400d6f0 tx=0x7f491400dbb0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.787+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 shutdown_connections 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.787+0000 7f4927648640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f490807af40 0x7f490807d400 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.787+0000 7f4927648640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4920107910 0x7f492019db90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.787+0000 7f4927648640 1 --2- 172.21.15.118:0/2906302318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4920101910 0x7f492019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.787+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 >> 172.21.15.118:0/2906302318 conn(0x7f49200fd5f0 msgr2=0x7f49200fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.788+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 shutdown_connections 2024-09-21T11:50:51.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.788+0000 7f4927648640 1 -- 172.21.15.118:0/2906302318 wait complete. 2024-09-21T11:50:51.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 -- 172.21.15.118:0/2572213370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341067e0 msgr2=0x7f8634106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 --2- 172.21.15.118:0/2572213370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341067e0 0x7f8634106bc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8624009880 tx=0x7f862402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 -- 172.21.15.118:0/2572213370 shutdown_connections 2024-09-21T11:50:51.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 --2- 172.21.15.118:0/2572213370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86341007e0 0x7f8634100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 --2- 172.21.15.118:0/2572213370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341067e0 0x7f8634106bc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 -- 172.21.15.118:0/2572213370 >> 172.21.15.118:0/2572213370 conn(0x7f86340fc4c0 msgr2=0x7f86340fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:51.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 -- 172.21.15.118:0/2572213370 shutdown_connections 2024-09-21T11:50:51.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 -- 172.21.15.118:0/2572213370 wait complete. 2024-09-21T11:50:51.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 Processor -- start 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.872+0000 7f863a3a2640 1 -- start start 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f863a3a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341007e0 0x7f86340fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f863a3a2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86341067e0 0x7f86340fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f863a3a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f863410dd10 con 0x7f86341007e0 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f863a3a2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f863410db90 con 0x7f86341067e0 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f8633fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341007e0 0x7f86340fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f8633fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341007e0 0x7f86340fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44474/0 (socket says 172.21.15.118:44474) 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f8633fff640 1 -- 172.21.15.118:0/4040627216 learned_addr learned my addr 172.21.15.118:0/4040627216 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f862bfff640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86341067e0 0x7f86340fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f8633fff640 1 -- 172.21.15.118:0/4040627216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86341067e0 msgr2=0x7f86340fd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f8633fff640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86341067e0 0x7f86340fd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f8633fff640 1 -- 172.21.15.118:0/4040627216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86340fd710 con 0x7f86341007e0 2024-09-21T11:50:51.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.873+0000 7f8633fff640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341007e0 0x7f86340fcc90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8624031460 tx=0x7f86240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:51.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.874+0000 7f8631ffb640 1 -- 172.21.15.118:0/4040627216 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f862403f070 con 0x7f86341007e0 2024-09-21T11:50:51.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.874+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86340fd9a0 con 0x7f86341007e0 2024-09-21T11:50:51.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.874+0000 7f8631ffb640 1 -- 172.21.15.118:0/4040627216 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8624004cf0 con 0x7f86341007e0 2024-09-21T11:50:51.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.874+0000 7f8631ffb640 1 -- 172.21.15.118:0/4040627216 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8624035030 con 0x7f86341007e0 2024-09-21T11:50:51.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.874+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86341a3df0 con 0x7f86341007e0 2024-09-21T11:50:51.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.875+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8634101f20 con 0x7f86341007e0 2024-09-21T11:50:51.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.875+0000 7f8631ffb640 1 -- 172.21.15.118:0/4040627216 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8624042070 con 0x7f86341007e0 2024-09-21T11:50:51.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.876+0000 7f8631ffb640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862007af30 0x7f862007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:51.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.876+0000 7f862bfff640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862007af30 0x7f862007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:51.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.876+0000 7f8631ffb640 1 -- 172.21.15.118:0/4040627216 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f86240beb40 con 0x7f86341007e0 2024-09-21T11:50:51.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.876+0000 7f862bfff640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862007af30 0x7f862007d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f86340fe720 tx=0x7f861c009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:51.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:51.880+0000 7f8631ffb640 1 -- 172.21.15.118:0/4040627216 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f862408a090 con 0x7f86341007e0 2024-09-21T11:50:52.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.066+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8634109dd0 con 0x7f862007af30 2024-09-21T11:50:52.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.076+0000 7f8631ffb640 1 -- 172.21.15.118:0/4040627216 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f861c0095e0 con 0x7f862007af30 2024-09-21T11:50:52.077 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:50:52.077 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (8m) 2m ago 19m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:50:52.077 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (11m) 2m ago 19m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:50:52.077 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (11m) 2m ago 19m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:50:52.077 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (6m) 2m ago 19m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:50:52.077 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (6m) 2m ago 19m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (8m) 2m ago 19m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (3m) 2m ago 14m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (2m) 2m ago 14m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (14m) 2m ago 14m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (2m) 2m ago 14m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (10m) 2m ago 21m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (10m) 2m ago 18m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (7m) 2m ago 21m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (7m) 2m ago 18m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (9m) 2m ago 19m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (9m) 2m ago 18m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (6m) 2m ago 17m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:50:52.078 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (5m) 2m ago 17m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:50:52.079 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (5m) 2m ago 16m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:50:52.079 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (4m) 2m ago 16m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:50:52.079 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (4m) 2m ago 15m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:50:52.079 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (3m) 2m ago 15m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:50:52.079 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (9m) 2m ago 19m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862007af30 msgr2=0x7f862007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862007af30 0x7f862007d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f86340fe720 tx=0x7f861c009110 comp rx=0 tx=0).stop 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341007e0 msgr2=0x7f86340fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341007e0 0x7f86340fcc90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8624031460 tx=0x7f86240048f0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 shutdown_connections 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86341067e0 0x7f86340fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f862007af30 0x7f862007d3f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 --2- 172.21.15.118:0/4040627216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86341007e0 0x7f86340fcc90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 >> 172.21.15.118:0/4040627216 conn(0x7f86340fc4c0 msgr2=0x7f8634069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 shutdown_connections 2024-09-21T11:50:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.078+0000 7f863a3a2640 1 -- 172.21.15.118:0/4040627216 wait complete. 2024-09-21T11:50:52.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.159+0000 7f821203d640 1 -- 172.21.15.118:0/2759773510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c100820 msgr2=0x7f820c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.159+0000 7f821203d640 1 --2- 172.21.15.118:0/2759773510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c100820 0x7f820c100c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8200009880 tx=0x7f820002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.159+0000 7f821203d640 1 -- 172.21.15.118:0/2759773510 shutdown_connections 2024-09-21T11:50:52.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.159+0000 7f821203d640 1 --2- 172.21.15.118:0/2759773510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c100820 0x7f820c100c80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.159+0000 7f821203d640 1 --2- 172.21.15.118:0/2759773510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f820c106820 0x7f820c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.159+0000 7f821203d640 1 -- 172.21.15.118:0/2759773510 >> 172.21.15.118:0/2759773510 conn(0x7f820c0fc520 msgr2=0x7f820c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:52.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.159+0000 7f821203d640 1 -- 172.21.15.118:0/2759773510 shutdown_connections 2024-09-21T11:50:52.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.159+0000 7f821203d640 1 -- 172.21.15.118:0/2759773510 wait complete. 2024-09-21T11:50:52.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.160+0000 7f821203d640 1 Processor -- start 2024-09-21T11:50:52.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.160+0000 7f821203d640 1 -- start start 2024-09-21T11:50:52.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.160+0000 7f821203d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f820c100820 0x7f820c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:52.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.160+0000 7f821203d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c106820 0x7f820c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.160+0000 7f821203d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f820c10dd50 con 0x7f820c106820 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.160+0000 7f821203d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f820c10dbd0 con 0x7f820c100820 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f820affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c106820 0x7f820c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f820affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c106820 0x7f820c198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44488/0 (socket says 172.21.15.118:44488) 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f820affd640 1 -- 172.21.15.118:0/1704739545 learned_addr learned my addr 172.21.15.118:0/1704739545 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f820b7fe640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f820c100820 0x7f820c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f820affd640 1 -- 172.21.15.118:0/1704739545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f820c100820 msgr2=0x7f820c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f820affd640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f820c100820 0x7f820c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f820affd640 1 -- 172.21.15.118:0/1704739545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c1993b0 con 0x7f820c106820 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f820b7fe640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f820c100820 0x7f820c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f820affd640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c106820 0x7f820c198db0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8200031460 tx=0x7f82000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f8208ff9640 1 -- 172.21.15.118:0/1704739545 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f820003f070 con 0x7f820c106820 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c199640 con 0x7f820c106820 2024-09-21T11:50:52.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f8208ff9640 1 -- 172.21.15.118:0/1704739545 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82000044d0 con 0x7f820c106820 2024-09-21T11:50:52.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.161+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c1a1bf0 con 0x7f820c106820 2024-09-21T11:50:52.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.162+0000 7f8208ff9640 1 -- 172.21.15.118:0/1704739545 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8200035030 con 0x7f820c106820 2024-09-21T11:50:52.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.162+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820c101f60 con 0x7f820c106820 2024-09-21T11:50:52.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.164+0000 7f8208ff9640 1 -- 172.21.15.118:0/1704739545 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8200042070 con 0x7f820c106820 2024-09-21T11:50:52.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.165+0000 7f8208ff9640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81f407af40 0x7f81f407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:52.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.165+0000 7f8208ff9640 1 -- 172.21.15.118:0/1704739545 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f82000bf2f0 con 0x7f820c106820 2024-09-21T11:50:52.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.165+0000 7f820b7fe640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81f407af40 0x7f81f407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:52.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.165+0000 7f820b7fe640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81f407af40 0x7f81f407d400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f81fc007eb0 tx=0x7f81fc0073c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:52.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.168+0000 7f8208ff9640 1 -- 172.21.15.118:0/1704739545 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8200004cf0 con 0x7f820c106820 2024-09-21T11:50:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.415+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f820c108db0 con 0x7f820c106820 2024-09-21T11:50:52.416 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:52 smithi118 ceph-mon[111738]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.415+0000 7f8208ff9640 1 -- 172.21.15.118:0/1704739545 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f820008a8c0 con 0x7f820c106820 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:50:52.417 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:50:52.418 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:50:52.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81f407af40 msgr2=0x7f81f407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81f407af40 0x7f81f407d400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f81fc007eb0 tx=0x7f81fc0073c0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c106820 msgr2=0x7f820c198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c106820 0x7f820c198db0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8200031460 tx=0x7f82000048f0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 shutdown_connections 2024-09-21T11:50:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f81f407af40 0x7f81f407d400 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820c106820 0x7f820c198db0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 --2- 172.21.15.118:0/1704739545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f820c100820 0x7f820c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 >> 172.21.15.118:0/1704739545 conn(0x7f820c0fc520 msgr2=0x7f820c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:52.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 shutdown_connections 2024-09-21T11:50:52.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.417+0000 7f821203d640 1 -- 172.21.15.118:0/1704739545 wait complete. 2024-09-21T11:50:52.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.498+0000 7fd8edb6e640 1 -- 172.21.15.118:0/3935572993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 msgr2=0x7fd8e8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.498+0000 7fd8edb6e640 1 --2- 172.21.15.118:0/3935572993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 0x7fd8e8101d90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc009880 tx=0x7fd8dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.499+0000 7fd8edb6e640 1 -- 172.21.15.118:0/3935572993 shutdown_connections 2024-09-21T11:50:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.499+0000 7fd8edb6e640 1 --2- 172.21.15.118:0/3935572993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 0x7fd8e8101d90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.499+0000 7fd8edb6e640 1 --2- 172.21.15.118:0/3935572993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e8107930 0x7fd8e8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.499+0000 7fd8edb6e640 1 -- 172.21.15.118:0/3935572993 >> 172.21.15.118:0/3935572993 conn(0x7fd8e80fd630 msgr2=0x7fd8e80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.499+0000 7fd8edb6e640 1 -- 172.21.15.118:0/3935572993 shutdown_connections 2024-09-21T11:50:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.499+0000 7fd8edb6e640 1 -- 172.21.15.118:0/3935572993 wait complete. 2024-09-21T11:50:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.499+0000 7fd8edb6e640 1 Processor -- start 2024-09-21T11:50:52.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.499+0000 7fd8edb6e640 1 -- start start 2024-09-21T11:50:52.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8edb6e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 0x7fd8e819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8edb6e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e8107930 0x7fd8e819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8edb6e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e810ede0 con 0x7fd8e8101930 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8edb6e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e810ec60 con 0x7fd8e8107930 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 0x7fd8e819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 0x7fd8e819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44510/0 (socket says 172.21.15.118:44510) 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e77fe640 1 -- 172.21.15.118:0/2809233082 learned_addr learned my addr 172.21.15.118:0/2809233082 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e77fe640 1 -- 172.21.15.118:0/2809233082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e8107930 msgr2=0x7fd8e819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e77fe640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e8107930 0x7fd8e819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e77fe640 1 -- 172.21.15.118:0/2809233082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e8197850 con 0x7fd8e8101930 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e77fe640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 0x7fd8e819d6d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800cc60 tx=0x7fd8d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e4ff9640 1 -- 172.21.15.118:0/2809233082 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8d800ce10 con 0x7fd8e8101930 2024-09-21T11:50:52.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e4ff9640 1 -- 172.21.15.118:0/2809233082 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8d800f910 con 0x7fd8e8101930 2024-09-21T11:50:52.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8e4ff9640 1 -- 172.21.15.118:0/2809233082 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8d8018ae0 con 0x7fd8e8101930 2024-09-21T11:50:52.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e8197b40 con 0x7fd8e8101930 2024-09-21T11:50:52.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.500+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e81980d0 con 0x7fd8e8101930 2024-09-21T11:50:52.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.501+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e8103070 con 0x7fd8e8101930 2024-09-21T11:50:52.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.502+0000 7fd8e4ff9640 1 -- 172.21.15.118:0/2809233082 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd8d8018ca0 con 0x7fd8e8101930 2024-09-21T11:50:52.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.502+0000 7fd8e4ff9640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd8d007af30 0x7fd8d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:52.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.502+0000 7fd8e4ff9640 1 -- 172.21.15.118:0/2809233082 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fd8d809e7b0 con 0x7fd8e8101930 2024-09-21T11:50:52.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.502+0000 7fd8e6ffd640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd8d007af30 0x7fd8d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:52.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.503+0000 7fd8e6ffd640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd8d007af30 0x7fd8d007d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0096c0 tx=0x7fd8dc000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.507+0000 7fd8e4ff9640 1 -- 172.21.15.118:0/2809233082 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8d8014030 con 0x7fd8e8101930 2024-09-21T11:50:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:52 smithi149 ceph-mon[79770]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:52.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.722+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd8e8198db0 con 0x7fd8e8101930 2024-09-21T11:50:52.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.723+0000 7fd8e4ff9640 1 -- 172.21.15.118:0/2809233082 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7fd8e8198db0 con 0x7fd8e8101930 2024-09-21T11:50:52.726 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:50:52.726 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:50:52.726 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:50:52.726 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:50:52.726 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:50:52.727 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:50:52.728 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:50:52.729 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:50:52.729 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:50:52.729 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:50:52.729 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:50:52.729 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:50:52.729 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:50:52.729 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:50:52.729 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:50:52.729 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd8d007af30 msgr2=0x7fd8d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd8d007af30 0x7fd8d007d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0096c0 tx=0x7fd8dc000bc0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 msgr2=0x7fd8e819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 0x7fd8e819d6d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800cc60 tx=0x7fd8d800a620 comp rx=0 tx=0).stop 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 shutdown_connections 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e8107930 0x7fd8e819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd8d007af30 0x7fd8d007d3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 --2- 172.21.15.118:0/2809233082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e8101930 0x7fd8e819d6d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 >> 172.21.15.118:0/2809233082 conn(0x7fd8e80fd630 msgr2=0x7fd8e80fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:52.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 shutdown_connections 2024-09-21T11:50:52.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.725+0000 7fd8edb6e640 1 -- 172.21.15.118:0/2809233082 wait complete. 2024-09-21T11:50:52.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.807+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1187908941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac106820 msgr2=0x7f2cac106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.807+0000 7f2cb2c98640 1 --2- 172.21.15.118:0/1187908941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac106820 0x7f2cac106c00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009880 tx=0x7f2ca002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.807+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1187908941 shutdown_connections 2024-09-21T11:50:52.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.807+0000 7f2cb2c98640 1 --2- 172.21.15.118:0/1187908941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac100820 0x7f2cac100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.807+0000 7f2cb2c98640 1 --2- 172.21.15.118:0/1187908941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac106820 0x7f2cac106c00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.807+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1187908941 >> 172.21.15.118:0/1187908941 conn(0x7f2cac0fc520 msgr2=0x7f2cac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.807+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1187908941 shutdown_connections 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.807+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1187908941 wait complete. 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb2c98640 1 Processor -- start 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb2c98640 1 -- start start 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb2c98640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100820 0x7f2cac198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb2c98640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106820 0x7f2cac198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb2c98640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac10dd50 con 0x7f2cac100820 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb2c98640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac10dbd0 con 0x7f2cac106820 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb0a34640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100820 0x7f2cac198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb0a34640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100820 0x7f2cac198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44530/0 (socket says 172.21.15.118:44530) 2024-09-21T11:50:52.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb0a34640 1 -- 172.21.15.118:0/1221990758 learned_addr learned my addr 172.21.15.118:0/1221990758 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:52.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cabfff640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106820 0x7f2cac198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:52.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb0a34640 1 -- 172.21.15.118:0/1221990758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106820 msgr2=0x7f2cac198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb0a34640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106820 0x7f2cac198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.808+0000 7f2cb0a34640 1 -- 172.21.15.118:0/1221990758 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac1993a0 con 0x7f2cac100820 2024-09-21T11:50:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.809+0000 7f2cb0a34640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100820 0x7f2cac198860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0031460 tx=0x7f2ca00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.809+0000 7f2ca9ffb640 1 -- 172.21.15.118:0/1221990758 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ca003f070 con 0x7f2cac100820 2024-09-21T11:50:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.809+0000 7f2ca9ffb640 1 -- 172.21.15.118:0/1221990758 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ca0004cf0 con 0x7f2cac100820 2024-09-21T11:50:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.809+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cac199630 con 0x7f2cac100820 2024-09-21T11:50:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.809+0000 7f2ca9ffb640 1 -- 172.21.15.118:0/1221990758 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ca0035030 con 0x7f2cac100820 2024-09-21T11:50:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.809+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cac1a1be0 con 0x7f2cac100820 2024-09-21T11:50:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.810+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cac101f60 con 0x7f2cac100820 2024-09-21T11:50:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.811+0000 7f2ca9ffb640 1 -- 172.21.15.118:0/1221990758 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2ca0042070 con 0x7f2cac100820 2024-09-21T11:50:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.811+0000 7f2ca9ffb640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9c07af30 0x7f2c9c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.811+0000 7f2ca9ffb640 1 -- 172.21.15.118:0/1221990758 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f2ca00bebb0 con 0x7f2cac100820 2024-09-21T11:50:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.811+0000 7f2cabfff640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9c07af30 0x7f2c9c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.812+0000 7f2cabfff640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9c07af30 0x7f2c9c07d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2cac06ae50 tx=0x7f2c98008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:52.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:52.815+0000 7f2ca9ffb640 1 -- 172.21.15.118:0/1221990758 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ca00c5080 con 0x7f2cac100820 2024-09-21T11:50:53.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.008+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2cac062630 con 0x7f2c9c07af30 2024-09-21T11:50:53.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.010+0000 7f2ca9ffb640 1 -- 172.21.15.118:0/1221990758 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f2cac062630 con 0x7f2c9c07af30 2024-09-21T11:50:53.011 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:50:53.011 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:50:53.011 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:50:53.011 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:50:53.011 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:50:53.011 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:50:53.012 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:50:53.012 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:50:53.012 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:50:53.012 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:50:53.012 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:50:53.012 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:50:53.012 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:50:53.012 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9c07af30 msgr2=0x7f2c9c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9c07af30 0x7f2c9c07d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2cac06ae50 tx=0x7f2c98008040 comp rx=0 tx=0).stop 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100820 msgr2=0x7f2cac198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100820 0x7f2cac198860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0031460 tx=0x7f2ca00048f0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 shutdown_connections 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106820 0x7f2cac198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9c07af30 0x7f2c9c07d3f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 --2- 172.21.15.118:0/1221990758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100820 0x7f2cac198860 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 >> 172.21.15.118:0/1221990758 conn(0x7f2cac0fc520 msgr2=0x7f2cac0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 shutdown_connections 2024-09-21T11:50:53.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.012+0000 7f2cb2c98640 1 -- 172.21.15.118:0/1221990758 wait complete. 2024-09-21T11:50:53.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.094+0000 7f801178b640 1 -- 172.21.15.118:0/427106870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c101930 msgr2=0x7f800c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:53.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.094+0000 7f801178b640 1 --2- 172.21.15.118:0/427106870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c101930 0x7f800c101d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009880 tx=0x7f7ff402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.094+0000 7f801178b640 1 -- 172.21.15.118:0/427106870 shutdown_connections 2024-09-21T11:50:53.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.094+0000 7f801178b640 1 --2- 172.21.15.118:0/427106870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c101930 0x7f800c101d90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.094+0000 7f801178b640 1 --2- 172.21.15.118:0/427106870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f800c107930 0x7f800c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.094+0000 7f801178b640 1 -- 172.21.15.118:0/427106870 >> 172.21.15.118:0/427106870 conn(0x7f800c0fd630 msgr2=0x7f800c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:53.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.094+0000 7f801178b640 1 -- 172.21.15.118:0/427106870 shutdown_connections 2024-09-21T11:50:53.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.094+0000 7f801178b640 1 -- 172.21.15.118:0/427106870 wait complete. 2024-09-21T11:50:53.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f801178b640 1 Processor -- start 2024-09-21T11:50:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f801178b640 1 -- start start 2024-09-21T11:50:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f801178b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f800c101930 0x7f800c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f801178b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c107930 0x7f800c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f801178b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f800c10ee60 con 0x7f800c107930 2024-09-21T11:50:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f801178b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f800c10ece0 con 0x7f800c101930 2024-09-21T11:50:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f80027fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c107930 0x7f800c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f80027fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c107930 0x7f800c19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44540/0 (socket says 172.21.15.118:44540) 2024-09-21T11:50:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f80027fc640 1 -- 172.21.15.118:0/778370169 learned_addr learned my addr 172.21.15.118:0/778370169 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:50:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f800affd640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f800c101930 0x7f800c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f80027fc640 1 -- 172.21.15.118:0/778370169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f800c101930 msgr2=0x7f800c19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f80027fc640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f800c101930 0x7f800c19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f80027fc640 1 -- 172.21.15.118:0/778370169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c197870 con 0x7f800c107930 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.095+0000 7f800affd640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f800c101930 0x7f800c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.096+0000 7f80027fc640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c107930 0x7f800c19dbf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4031460 tx=0x7f7ff40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.096+0000 7f8008ff9640 1 -- 172.21.15.118:0/778370169 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ff403f070 con 0x7f800c107930 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.096+0000 7f8008ff9640 1 -- 172.21.15.118:0/778370169 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ff4004cf0 con 0x7f800c107930 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.096+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c197b00 con 0x7f800c107930 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.096+0000 7f8008ff9640 1 -- 172.21.15.118:0/778370169 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ff4035030 con 0x7f800c107930 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.096+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c198030 con 0x7f800c107930 2024-09-21T11:50:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.097+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800c103070 con 0x7f800c107930 2024-09-21T11:50:53.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.098+0000 7f8008ff9640 1 -- 172.21.15.118:0/778370169 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7ff4042070 con 0x7f800c107930 2024-09-21T11:50:53.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.098+0000 7f8008ff9640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ff807af80 0x7f7ff807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:50:53.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.098+0000 7f8008ff9640 1 -- 172.21.15.118:0/778370169 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f7ff40bea90 con 0x7f800c107930 2024-09-21T11:50:53.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.098+0000 7f800affd640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ff807af80 0x7f7ff807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:50:53.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.099+0000 7f800affd640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ff807af80 0x7f7ff807d440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f800c1989b0 tx=0x7f7ffc008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:50:53.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.102+0000 7f8008ff9640 1 -- 172.21.15.118:0/778370169 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ff408a060 con 0x7f800c107930 2024-09-21T11:50:53.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.350+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f800c109ef0 con 0x7f800c107930 2024-09-21T11:50:53.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.350+0000 7f8008ff9640 1 -- 172.21.15.118:0/778370169 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f7ff408ef10 con 0x7f800c107930 2024-09-21T11:50:53.352 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:50:53.352 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:50:53.352 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:50:53.352 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:50:53.352 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:50:53.352 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:50:53.352 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ff807af80 msgr2=0x7f7ff807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ff807af80 0x7f7ff807d440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f800c1989b0 tx=0x7f7ffc008040 comp rx=0 tx=0).stop 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c107930 msgr2=0x7f800c19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c107930 0x7f800c19dbf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4031460 tx=0x7f7ff40048f0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 shutdown_connections 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ff807af80 0x7f7ff807d440 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f800c107930 0x7f800c19dbf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 --2- 172.21.15.118:0/778370169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f800c101930 0x7f800c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 >> 172.21.15.118:0/778370169 conn(0x7f800c0fd630 msgr2=0x7f800c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.352+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 shutdown_connections 2024-09-21T11:50:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:50:53.353+0000 7f801178b640 1 -- 172.21.15.118:0/778370169 wait complete. 2024-09-21T11:50:53.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:53 smithi149 ceph-mon[79770]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:53.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:53 smithi149 ceph-mon[79770]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:53.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:53 smithi149 ceph-mon[79770]: pgmap v361: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:53.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:53 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1704739545' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:50:53.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:53 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2809233082' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:50:53.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:53 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/778370169' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:50:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:53 smithi118 ceph-mon[111738]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:53 smithi118 ceph-mon[111738]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:53 smithi118 ceph-mon[111738]: pgmap v361: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:53.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:53 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1704739545' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:50:53.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:53 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2809233082' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:50:53.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:53 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/778370169' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:50:54.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:54 smithi149 ceph-mon[79770]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:54.724 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:54 smithi118 ceph-mon[111738]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:50:55.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:55 smithi149 ceph-mon[79770]: pgmap v362: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:55 smithi118 ceph-mon[111738]: pgmap v362: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:57.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:57 smithi149 ceph-mon[79770]: pgmap v363: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:57 smithi118 ceph-mon[111738]: pgmap v363: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:59.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:50:59 smithi149 ceph-mon[79770]: pgmap v364: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:50:59.801 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:50:59 smithi118 ceph-mon[111738]: pgmap v364: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:01.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:01 smithi149 ceph-mon[79770]: pgmap v365: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:01.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:01 smithi118 ceph-mon[111738]: pgmap v365: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:03.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:03 smithi149 ceph-mon[79770]: pgmap v366: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:03 smithi118 ceph-mon[111738]: pgmap v366: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:05 smithi149 ceph-mon[79770]: pgmap v367: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:51:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:05 smithi118 ceph-mon[111738]: pgmap v367: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:51:07.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:07 smithi149 ceph-mon[79770]: pgmap v368: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:07 smithi118 ceph-mon[111738]: pgmap v368: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:09 smithi149 ceph-mon[79770]: pgmap v369: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:09.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:09 smithi118 ceph-mon[111738]: pgmap v369: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:11.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:11 smithi149 ceph-mon[79770]: pgmap v370: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:11 smithi118 ceph-mon[111738]: pgmap v370: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:13.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:13 smithi149 ceph-mon[79770]: pgmap v371: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:13 smithi118 ceph-mon[111738]: pgmap v371: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:15 smithi149 ceph-mon[79770]: pgmap v372: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:15 smithi118 ceph-mon[111738]: pgmap v372: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:17 smithi149 ceph-mon[79770]: pgmap v373: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:17 smithi118 ceph-mon[111738]: pgmap v373: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:19 smithi149 ceph-mon[79770]: pgmap v374: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:19 smithi118 ceph-mon[111738]: pgmap v374: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:51:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:51:21.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:21 smithi149 ceph-mon[79770]: pgmap v375: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:21 smithi118 ceph-mon[111738]: pgmap v375: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:23.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.449+0000 7f174b7e8640 1 -- 172.21.15.118:0/613480299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 msgr2=0x7f1744102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:23.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.449+0000 7f174b7e8640 1 --2- 172.21.15.118:0/613480299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 0x7f1744102ec0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1734009c20 tx=0x7f173402aa00 comp rx=0 tx=0).stop 2024-09-21T11:51:23.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.449+0000 7f174b7e8640 1 -- 172.21.15.118:0/613480299 shutdown_connections 2024-09-21T11:51:23.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.449+0000 7f174b7e8640 1 --2- 172.21.15.118:0/613480299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1744103400 0x7f174410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.449+0000 7f174b7e8640 1 --2- 172.21.15.118:0/613480299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 0x7f1744102ec0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.449+0000 7f174b7e8640 1 -- 172.21.15.118:0/613480299 >> 172.21.15.118:0/613480299 conn(0x7f17440fc520 msgr2=0x7f17440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:23.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.449+0000 7f174b7e8640 1 -- 172.21.15.118:0/613480299 shutdown_connections 2024-09-21T11:51:23.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.449+0000 7f174b7e8640 1 -- 172.21.15.118:0/613480299 wait complete. 2024-09-21T11:51:23.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.449+0000 7f174b7e8640 1 Processor -- start 2024-09-21T11:51:23.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f174b7e8640 1 -- start start 2024-09-21T11:51:23.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f174b7e8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 0x7f174419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:23.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f174b7e8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1744103400 0x7f174419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:23.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f174b7e8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f174410ee10 con 0x7f1744102ae0 2024-09-21T11:51:23.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f174b7e8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f174410ec90 con 0x7f1744103400 2024-09-21T11:51:23.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f1749584640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 0x7f174419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f1749584640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 0x7f174419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47796/0 (socket says 172.21.15.118:47796) 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f1749584640 1 -- 172.21.15.118:0/495198998 learned_addr learned my addr 172.21.15.118:0/495198998 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f1748d83640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1744103400 0x7f174419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f1749584640 1 -- 172.21.15.118:0/495198998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1744103400 msgr2=0x7f174419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f1749584640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1744103400 0x7f174419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f1749584640 1 -- 172.21.15.118:0/495198998 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1744197800 con 0x7f1744102ae0 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.450+0000 7f1749584640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 0x7f174419d680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1734006010 tx=0x7f173402ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.451+0000 7f17427fc640 1 -- 172.21.15.118:0/495198998 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1734047070 con 0x7f1744102ae0 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.451+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1744197a90 con 0x7f1744102ae0 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.451+0000 7f17427fc640 1 -- 172.21.15.118:0/495198998 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1734003e30 con 0x7f1744102ae0 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.451+0000 7f17427fc640 1 -- 172.21.15.118:0/495198998 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1734033050 con 0x7f1744102ae0 2024-09-21T11:51:23.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.451+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1744197fc0 con 0x7f1744102ae0 2024-09-21T11:51:23.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.452+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174406abe0 con 0x7f1744102ae0 2024-09-21T11:51:23.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.452+0000 7f17427fc640 1 -- 172.21.15.118:0/495198998 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f173404a070 con 0x7f1744102ae0 2024-09-21T11:51:23.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.453+0000 7f17427fc640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f172c07af40 0x7f172c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:23.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.453+0000 7f17427fc640 1 -- 172.21.15.118:0/495198998 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f173403e030 con 0x7f1744102ae0 2024-09-21T11:51:23.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.453+0000 7f1748d83640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f172c07af40 0x7f172c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:23.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.453+0000 7f1748d83640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f172c07af40 0x7f172c07d400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17380058c0 tx=0x7f1738005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:23.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.457+0000 7f17427fc640 1 -- 172.21.15.118:0/495198998 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f173402ee90 con 0x7f1744102ae0 2024-09-21T11:51:23.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.652+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1744198330 con 0x7f172c07af40 2024-09-21T11:51:23.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.653+0000 7f17427fc640 1 -- 172.21.15.118:0/495198998 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1744198330 con 0x7f172c07af40 2024-09-21T11:51:23.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.655+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f172c07af40 msgr2=0x7f172c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:23.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.655+0000 7f174b7e8640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f172c07af40 0x7f172c07d400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17380058c0 tx=0x7f1738005850 comp rx=0 tx=0).stop 2024-09-21T11:51:23.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.656+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 msgr2=0x7f174419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:23.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.656+0000 7f174b7e8640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 0x7f174419d680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1734006010 tx=0x7f173402ed20 comp rx=0 tx=0).stop 2024-09-21T11:51:23.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.656+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 shutdown_connections 2024-09-21T11:51:23.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.656+0000 7f174b7e8640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1744103400 0x7f174419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.656+0000 7f174b7e8640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f172c07af40 0x7f172c07d400 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.656+0000 7f174b7e8640 1 --2- 172.21.15.118:0/495198998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1744102ae0 0x7f174419d680 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.656+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 >> 172.21.15.118:0/495198998 conn(0x7f17440fc520 msgr2=0x7f1744108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:23.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.656+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 shutdown_connections 2024-09-21T11:51:23.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.656+0000 7f174b7e8640 1 -- 172.21.15.118:0/495198998 wait complete. 2024-09-21T11:51:23.667 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:51:23.667 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:23 smithi118 ceph-mon[111738]: pgmap v376: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:23.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:23 smithi149 ceph-mon[79770]: pgmap v376: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:23.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.738+0000 7f37342ac640 1 -- 172.21.15.118:0/1476621686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c106820 msgr2=0x7f372c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.738+0000 7f37342ac640 1 --2- 172.21.15.118:0/1476621686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c106820 0x7f372c106c00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3728009880 tx=0x7f372802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.738+0000 7f37342ac640 1 -- 172.21.15.118:0/1476621686 shutdown_connections 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.738+0000 7f37342ac640 1 --2- 172.21.15.118:0/1476621686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f372c100820 0x7f372c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.738+0000 7f37342ac640 1 --2- 172.21.15.118:0/1476621686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c106820 0x7f372c106c00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.738+0000 7f37342ac640 1 -- 172.21.15.118:0/1476621686 >> 172.21.15.118:0/1476621686 conn(0x7f372c0fc520 msgr2=0x7f372c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.738+0000 7f37342ac640 1 -- 172.21.15.118:0/1476621686 shutdown_connections 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.738+0000 7f37342ac640 1 -- 172.21.15.118:0/1476621686 wait complete. 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f37342ac640 1 Processor -- start 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f37342ac640 1 -- start start 2024-09-21T11:51:23.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f37342ac640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c100820 0x7f372c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f37342ac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f372c106820 0x7f372c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f37342ac640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f372c10dcf0 con 0x7f372c100820 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f37342ac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f372c10db70 con 0x7f372c106820 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f3732048640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c100820 0x7f372c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f3732048640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c100820 0x7f372c19c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47806/0 (socket says 172.21.15.118:47806) 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f3732048640 1 -- 172.21.15.118:0/2264731674 learned_addr learned my addr 172.21.15.118:0/2264731674 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f3731847640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f372c106820 0x7f372c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f3732048640 1 -- 172.21.15.118:0/2264731674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f372c106820 msgr2=0x7f372c19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f3732048640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f372c106820 0x7f372c19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.739+0000 7f3732048640 1 -- 172.21.15.118:0/2264731674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c1966e0 con 0x7f372c100820 2024-09-21T11:51:23.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.740+0000 7f3732048640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c100820 0x7f372c19c610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3728031460 tx=0x7f37280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.740+0000 7f37237fe640 1 -- 172.21.15.118:0/2264731674 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f372803f070 con 0x7f372c100820 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.740+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372c196970 con 0x7f372c100820 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.740+0000 7f37237fe640 1 -- 172.21.15.118:0/2264731674 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3728004cf0 con 0x7f372c100820 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.740+0000 7f37237fe640 1 -- 172.21.15.118:0/2264731674 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3728035030 con 0x7f372c100820 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.740+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372c196e70 con 0x7f372c100820 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.741+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372c101f60 con 0x7f372c100820 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.742+0000 7f37237fe640 1 -- 172.21.15.118:0/2264731674 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3728042070 con 0x7f372c100820 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.742+0000 7f37237fe640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f371807af30 0x7f371807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.742+0000 7f37237fe640 1 -- 172.21.15.118:0/2264731674 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f37280beac0 con 0x7f372c100820 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.742+0000 7f3731847640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f371807af30 0x7f371807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:23.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.742+0000 7f3731847640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f371807af30 0x7f371807d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f372c197f30 tx=0x7f371c00a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:23.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.746+0000 7f37237fe640 1 -- 172.21.15.118:0/2264731674 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f372808a010 con 0x7f372c100820 2024-09-21T11:51:23.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.939+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f372c197120 con 0x7f371807af30 2024-09-21T11:51:23.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.940+0000 7f37237fe640 1 -- 172.21.15.118:0/2264731674 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f372c197120 con 0x7f371807af30 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.942+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f371807af30 msgr2=0x7f371807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.942+0000 7f37342ac640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f371807af30 0x7f371807d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f372c197f30 tx=0x7f371c00a250 comp rx=0 tx=0).stop 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.942+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c100820 msgr2=0x7f372c19c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.942+0000 7f37342ac640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c100820 0x7f372c19c610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3728031460 tx=0x7f37280048f0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.942+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 shutdown_connections 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.942+0000 7f37342ac640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f372c106820 0x7f372c19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.942+0000 7f37342ac640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f371807af30 0x7f371807d3f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.942+0000 7f37342ac640 1 --2- 172.21.15.118:0/2264731674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c100820 0x7f372c19c610 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.943+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 >> 172.21.15.118:0/2264731674 conn(0x7f372c0fc520 msgr2=0x7f372c0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.943+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 shutdown_connections 2024-09-21T11:51:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:23.943+0000 7f37342ac640 1 -- 172.21.15.118:0/2264731674 wait complete. 2024-09-21T11:51:24.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.025+0000 7f42cf494640 1 -- 172.21.15.118:0/2265515692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 msgr2=0x7f42c8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.025+0000 7f42cf494640 1 --2- 172.21.15.118:0/2265515692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 0x7f42c8100c80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009880 tx=0x7f42b802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.025+0000 7f42cf494640 1 -- 172.21.15.118:0/2265515692 shutdown_connections 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.025+0000 7f42cf494640 1 --2- 172.21.15.118:0/2265515692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 0x7f42c8100c80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.025+0000 7f42cf494640 1 --2- 172.21.15.118:0/2265515692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42c8106820 0x7f42c8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.025+0000 7f42cf494640 1 -- 172.21.15.118:0/2265515692 >> 172.21.15.118:0/2265515692 conn(0x7f42c80fc520 msgr2=0x7f42c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.025+0000 7f42cf494640 1 -- 172.21.15.118:0/2265515692 shutdown_connections 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.025+0000 7f42cf494640 1 -- 172.21.15.118:0/2265515692 wait complete. 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cf494640 1 Processor -- start 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cf494640 1 -- start start 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cf494640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 0x7f42c819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cf494640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42c8106820 0x7f42c819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cf494640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f42c810dcd0 con 0x7f42c8100820 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cf494640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f42c810db50 con 0x7f42c8106820 2024-09-21T11:51:24.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cd230640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 0x7f42c819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cd230640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 0x7f42c819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47830/0 (socket says 172.21.15.118:47830) 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cd230640 1 -- 172.21.15.118:0/648279168 learned_addr learned my addr 172.21.15.118:0/648279168 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.026+0000 7f42cca2f640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42c8106820 0x7f42c819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.027+0000 7f42cd230640 1 -- 172.21.15.118:0/648279168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42c8106820 msgr2=0x7f42c819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.027+0000 7f42cd230640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42c8106820 0x7f42c819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.027+0000 7f42cd230640 1 -- 172.21.15.118:0/648279168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c81977c0 con 0x7f42c8100820 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.027+0000 7f42cd230640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 0x7f42c819d640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f42c400e970 tx=0x7f42c400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.027+0000 7f42be7fc640 1 -- 172.21.15.118:0/648279168 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42c400cac0 con 0x7f42c8100820 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.027+0000 7f42be7fc640 1 -- 172.21.15.118:0/648279168 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42c400cc60 con 0x7f42c8100820 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.027+0000 7f42be7fc640 1 -- 172.21.15.118:0/648279168 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42c4018720 con 0x7f42c8100820 2024-09-21T11:51:24.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.027+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c8197ab0 con 0x7f42c8100820 2024-09-21T11:51:24.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.027+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c8198010 con 0x7f42c8100820 2024-09-21T11:51:24.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.028+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c8101f60 con 0x7f42c8100820 2024-09-21T11:51:24.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.029+0000 7f42be7fc640 1 -- 172.21.15.118:0/648279168 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f42c4010430 con 0x7f42c8100820 2024-09-21T11:51:24.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.029+0000 7f42be7fc640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b407af40 0x7f42b407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.029+0000 7f42cca2f640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b407af40 0x7f42b407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.029+0000 7f42be7fc640 1 -- 172.21.15.118:0/648279168 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f42c409e6d0 con 0x7f42c8100820 2024-09-21T11:51:24.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.030+0000 7f42cca2f640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b407af40 0x7f42b407d400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42c8198b10 tx=0x7f42b8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:24.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.033+0000 7f42be7fc640 1 -- 172.21.15.118:0/648279168 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42c4069c20 con 0x7f42c8100820 2024-09-21T11:51:24.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.219+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f42c8198380 con 0x7f42b407af40 2024-09-21T11:51:24.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.229+0000 7f42be7fc640 1 -- 172.21.15.118:0/648279168 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f42c8198380 con 0x7f42b407af40 2024-09-21T11:51:24.231 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:51:24.231 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (9m) 3m ago 20m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:51:24.231 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (12m) 3m ago 20m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:51:24.231 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (11m) 3m ago 19m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:51:24.231 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (7m) 3m ago 20m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (7m) 3m ago 19m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (8m) 3m ago 20m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (3m) 3m ago 14m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (3m) 3m ago 14m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (14m) 3m ago 14m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (3m) 3m ago 14m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (11m) 3m ago 21m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (10m) 3m ago 19m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (7m) 3m ago 21m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (7m) 3m ago 19m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (10m) 3m ago 20m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (10m) 3m ago 19m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (7m) 3m ago 18m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (6m) 3m ago 17m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:51:24.232 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (5m) 3m ago 17m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:51:24.233 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (5m) 3m ago 16m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:51:24.233 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (4m) 3m ago 16m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:51:24.233 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (4m) 3m ago 15m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:51:24.233 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (9m) 3m ago 19m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:51:24.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b407af40 msgr2=0x7f42b407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b407af40 0x7f42b407d400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42c8198b10 tx=0x7f42b8031400 comp rx=0 tx=0).stop 2024-09-21T11:51:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 msgr2=0x7f42c819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 0x7f42c819d640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f42c400e970 tx=0x7f42c400ee30 comp rx=0 tx=0).stop 2024-09-21T11:51:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 shutdown_connections 2024-09-21T11:51:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42c8106820 0x7f42c819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b407af40 0x7f42b407d400 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 --2- 172.21.15.118:0/648279168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42c8100820 0x7f42c819d640 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 >> 172.21.15.118:0/648279168 conn(0x7f42c80fc520 msgr2=0x7f42c806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 shutdown_connections 2024-09-21T11:51:24.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.231+0000 7f42cf494640 1 -- 172.21.15.118:0/648279168 wait complete. 2024-09-21T11:51:24.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.311+0000 7f3217884640 1 -- 172.21.15.118:0/3708321532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210100820 msgr2=0x7f3210100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.311+0000 7f3217884640 1 --2- 172.21.15.118:0/3708321532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210100820 0x7f3210100c80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3204009c20 tx=0x7f320402a970 comp rx=0 tx=0).stop 2024-09-21T11:51:24.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.311+0000 7f3217884640 1 -- 172.21.15.118:0/3708321532 shutdown_connections 2024-09-21T11:51:24.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.311+0000 7f3217884640 1 --2- 172.21.15.118:0/3708321532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210100820 0x7f3210100c80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.311+0000 7f3217884640 1 --2- 172.21.15.118:0/3708321532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3210106820 0x7f3210106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.311+0000 7f3217884640 1 -- 172.21.15.118:0/3708321532 >> 172.21.15.118:0/3708321532 conn(0x7f32100fc520 msgr2=0x7f32100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:24.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.311+0000 7f3217884640 1 -- 172.21.15.118:0/3708321532 shutdown_connections 2024-09-21T11:51:24.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.311+0000 7f3217884640 1 -- 172.21.15.118:0/3708321532 wait complete. 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3217884640 1 Processor -- start 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3217884640 1 -- start start 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3217884640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3210100820 0x7f32101987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3217884640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210106820 0x7f3210198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3217884640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f321010dcf0 con 0x7f3210106820 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3217884640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f321010db70 con 0x7f3210100820 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3214e1f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210106820 0x7f3210198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3214e1f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210106820 0x7f3210198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47848/0 (socket says 172.21.15.118:47848) 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3214e1f640 1 -- 172.21.15.118:0/1455952420 learned_addr learned my addr 172.21.15.118:0/1455952420 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3215620640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3210100820 0x7f32101987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3214e1f640 1 -- 172.21.15.118:0/1455952420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3210100820 msgr2=0x7f32101987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3214e1f640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3210100820 0x7f32101987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3214e1f640 1 -- 172.21.15.118:0/1455952420 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3210199350 con 0x7f3210106820 2024-09-21T11:51:24.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.312+0000 7f3214e1f640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210106820 0x7f3210198d00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f320402ae90 tx=0x7f320402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:24.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.313+0000 7f320e7fc640 1 -- 172.21.15.118:0/1455952420 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3204047070 con 0x7f3210106820 2024-09-21T11:51:24.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.313+0000 7f320e7fc640 1 -- 172.21.15.118:0/1455952420 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f320402f7e0 con 0x7f3210106820 2024-09-21T11:51:24.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.313+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32101995e0 con 0x7f3210106820 2024-09-21T11:51:24.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.313+0000 7f320e7fc640 1 -- 172.21.15.118:0/1455952420 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3204034070 con 0x7f3210106820 2024-09-21T11:51:24.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.313+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32101a1b90 con 0x7f3210106820 2024-09-21T11:51:24.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.314+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3210101f60 con 0x7f3210106820 2024-09-21T11:51:24.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.314+0000 7f320e7fc640 1 -- 172.21.15.118:0/1455952420 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f320404a070 con 0x7f3210106820 2024-09-21T11:51:24.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.315+0000 7f320e7fc640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f31f807af30 0x7f31f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.315+0000 7f3215620640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f31f807af30 0x7f31f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.315+0000 7f320e7fc640 1 -- 172.21.15.118:0/1455952420 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f32040bedc0 con 0x7f3210106820 2024-09-21T11:51:24.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.315+0000 7f3215620640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f31f807af30 0x7f31f807d3f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3208005fd0 tx=0x7f3208005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:24.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.319+0000 7f320e7fc640 1 -- 172.21.15.118:0/1455952420 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f320403f070 con 0x7f3210106820 2024-09-21T11:51:24.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.569+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f321006a930 con 0x7f3210106820 2024-09-21T11:51:24.572 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:24 smithi118 ceph-mon[111738]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:24.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.570+0000 7f320e7fc640 1 -- 172.21.15.118:0/1455952420 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f320408a310 con 0x7f3210106820 2024-09-21T11:51:24.572 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:51:24.572 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:51:24.572 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:51:24.572 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:51:24.572 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:51:24.573 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:51:24.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f31f807af30 msgr2=0x7f31f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f31f807af30 0x7f31f807d3f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3208005fd0 tx=0x7f3208005850 comp rx=0 tx=0).stop 2024-09-21T11:51:24.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210106820 msgr2=0x7f3210198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210106820 0x7f3210198d00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f320402ae90 tx=0x7f320402f5f0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 shutdown_connections 2024-09-21T11:51:24.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f31f807af30 0x7f31f807d3f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3210106820 0x7f3210198d00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 --2- 172.21.15.118:0/1455952420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3210100820 0x7f32101987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 >> 172.21.15.118:0/1455952420 conn(0x7f32100fc520 msgr2=0x7f32100fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:24.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 shutdown_connections 2024-09-21T11:51:24.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.572+0000 7f3217884640 1 -- 172.21.15.118:0/1455952420 wait complete. 2024-09-21T11:51:24.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.653+0000 7f20e12bc640 1 -- 172.21.15.118:0/3743052977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc106820 msgr2=0x7f20dc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.653+0000 7f20e12bc640 1 --2- 172.21.15.118:0/3743052977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc106820 0x7f20dc106c00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009880 tx=0x7f20cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.653+0000 7f20e12bc640 1 -- 172.21.15.118:0/3743052977 shutdown_connections 2024-09-21T11:51:24.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.653+0000 7f20e12bc640 1 --2- 172.21.15.118:0/3743052977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc100820 0x7f20dc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.653+0000 7f20e12bc640 1 --2- 172.21.15.118:0/3743052977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc106820 0x7f20dc106c00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.653+0000 7f20e12bc640 1 -- 172.21.15.118:0/3743052977 >> 172.21.15.118:0/3743052977 conn(0x7f20dc0fc520 msgr2=0x7f20dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:24.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.653+0000 7f20e12bc640 1 -- 172.21.15.118:0/3743052977 shutdown_connections 2024-09-21T11:51:24.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.653+0000 7f20e12bc640 1 -- 172.21.15.118:0/3743052977 wait complete. 2024-09-21T11:51:24.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20e12bc640 1 Processor -- start 2024-09-21T11:51:24.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20e12bc640 1 -- start start 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20e12bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc100820 0x7f20dc0fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20e12bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc106820 0x7f20dc0fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20e12bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10dcf0 con 0x7f20dc100820 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20e12bc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10db70 con 0x7f20dc106820 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20daffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc100820 0x7f20dc0fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20daffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc100820 0x7f20dc0fcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47870/0 (socket says 172.21.15.118:47870) 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20daffd640 1 -- 172.21.15.118:0/2888544746 learned_addr learned my addr 172.21.15.118:0/2888544746 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20d27fc640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc106820 0x7f20dc0fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20daffd640 1 -- 172.21.15.118:0/2888544746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc106820 msgr2=0x7f20dc0fd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20daffd640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc106820 0x7f20dc0fd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.654+0000 7f20daffd640 1 -- 172.21.15.118:0/2888544746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc0fd6e0 con 0x7f20dc100820 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.655+0000 7f20daffd640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc100820 0x7f20dc0fcc60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f20cc031460 tx=0x7f20cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:24.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.655+0000 7f20d8ff9640 1 -- 172.21.15.118:0/2888544746 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20cc03f070 con 0x7f20dc100820 2024-09-21T11:51:24.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.655+0000 7f20d8ff9640 1 -- 172.21.15.118:0/2888544746 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20cc0035f0 con 0x7f20dc100820 2024-09-21T11:51:24.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.655+0000 7f20d8ff9640 1 -- 172.21.15.118:0/2888544746 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20cc035030 con 0x7f20dc100820 2024-09-21T11:51:24.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.655+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc0fd970 con 0x7f20dc100820 2024-09-21T11:51:24.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.655+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc1a3dd0 con 0x7f20dc100820 2024-09-21T11:51:24.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.656+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc101f60 con 0x7f20dc100820 2024-09-21T11:51:24.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.656+0000 7f20d8ff9640 1 -- 172.21.15.118:0/2888544746 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f20cc042070 con 0x7f20dc100820 2024-09-21T11:51:24.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.657+0000 7f20d8ff9640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f20bc07af80 0x7f20bc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.657+0000 7f20d27fc640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f20bc07af80 0x7f20bc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.657+0000 7f20d8ff9640 1 -- 172.21.15.118:0/2888544746 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f20cc0be9c0 con 0x7f20dc100820 2024-09-21T11:51:24.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.657+0000 7f20d27fc640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f20bc07af80 0x7f20bc07d440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f20c4005fd0 tx=0x7f20c4005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:24.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.661+0000 7f20d8ff9640 1 -- 172.21.15.118:0/2888544746 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20cc089f90 con 0x7f20dc100820 2024-09-21T11:51:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:24 smithi149 ceph-mon[79770]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:24.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.879+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f20dc109da0 con 0x7f20dc100820 2024-09-21T11:51:24.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.880+0000 7f20d8ff9640 1 -- 172.21.15.118:0/2888544746 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f20cc08ee40 con 0x7f20dc100820 2024-09-21T11:51:24.882 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:51:24.882 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:51:24.882 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:51:24.882 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:51:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:51:24.884 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:51:24.885 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:51:24.885 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:51:24.885 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:51:24.885 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:51:24.885 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:51:24.885 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:51:24.885 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:51:24.885 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f20bc07af80 msgr2=0x7f20bc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f20bc07af80 0x7f20bc07d440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f20c4005fd0 tx=0x7f20c4005850 comp rx=0 tx=0).stop 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc100820 msgr2=0x7f20dc0fcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc100820 0x7f20dc0fcc60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f20cc031460 tx=0x7f20cc0045e0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 shutdown_connections 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc106820 0x7f20dc0fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f20bc07af80 0x7f20bc07d440 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 --2- 172.21.15.118:0/2888544746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc100820 0x7f20dc0fcc60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 >> 172.21.15.118:0/2888544746 conn(0x7f20dc0fc520 msgr2=0x7f20dc06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:24.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 shutdown_connections 2024-09-21T11:51:24.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.882+0000 7f20e12bc640 1 -- 172.21.15.118:0/2888544746 wait complete. 2024-09-21T11:51:24.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.964+0000 7f7487d03640 1 -- 172.21.15.118:0/662961300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 msgr2=0x7f7480107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.964+0000 7f7487d03640 1 --2- 172.21.15.118:0/662961300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 0x7f7480107d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f747c009880 tx=0x7f747c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.964+0000 7f7487d03640 1 -- 172.21.15.118:0/662961300 shutdown_connections 2024-09-21T11:51:24.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.964+0000 7f7487d03640 1 --2- 172.21.15.118:0/662961300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7480101930 0x7f7480101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.964+0000 7f7487d03640 1 --2- 172.21.15.118:0/662961300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 0x7f7480107d10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.964+0000 7f7487d03640 1 -- 172.21.15.118:0/662961300 >> 172.21.15.118:0/662961300 conn(0x7f74800fd630 msgr2=0x7f74800ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:24.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.964+0000 7f7487d03640 1 -- 172.21.15.118:0/662961300 shutdown_connections 2024-09-21T11:51:24.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.964+0000 7f7487d03640 1 -- 172.21.15.118:0/662961300 wait complete. 2024-09-21T11:51:24.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.965+0000 7f7487d03640 1 Processor -- start 2024-09-21T11:51:24.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.965+0000 7f7487d03640 1 -- start start 2024-09-21T11:51:24.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.965+0000 7f7487d03640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7480101930 0x7f748019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.965+0000 7f7487d03640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 0x7f748019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.965+0000 7f7487d03640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f748010ee00 con 0x7f7480107930 2024-09-21T11:51:24.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.965+0000 7f7487d03640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f748010ec80 con 0x7f7480101930 2024-09-21T11:51:24.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.965+0000 7f748529e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 0x7f748019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.965+0000 7f748529e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 0x7f748019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47890/0 (socket says 172.21.15.118:47890) 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.965+0000 7f748529e640 1 -- 172.21.15.118:0/3006693632 learned_addr learned my addr 172.21.15.118:0/3006693632 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f7485a9f640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7480101930 0x7f748019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f748529e640 1 -- 172.21.15.118:0/3006693632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7480101930 msgr2=0x7f748019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f748529e640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7480101930 0x7f748019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f748529e640 1 -- 172.21.15.118:0/3006693632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74801977f0 con 0x7f7480107930 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f7485a9f640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7480101930 0x7f748019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f748529e640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 0x7f748019dbb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f747000c8f0 tx=0x7f747000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f7476ffd640 1 -- 172.21.15.118:0/3006693632 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74700079b0 con 0x7f7480107930 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7480197ae0 con 0x7f7480107930 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f7476ffd640 1 -- 172.21.15.118:0/3006693632 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74700054e0 con 0x7f7480107930 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f7476ffd640 1 -- 172.21.15.118:0/3006693632 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7470004dd0 con 0x7f7480107930 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.966+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7480198070 con 0x7f7480107930 2024-09-21T11:51:24.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.967+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7480103070 con 0x7f7480107930 2024-09-21T11:51:24.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.968+0000 7f7476ffd640 1 -- 172.21.15.118:0/3006693632 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7470005020 con 0x7f7480107930 2024-09-21T11:51:24.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.968+0000 7f7476ffd640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f746c07aed0 0x7f746c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:24.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.968+0000 7f7485a9f640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f746c07aed0 0x7f746c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:24.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.968+0000 7f7476ffd640 1 -- 172.21.15.118:0/3006693632 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f747009e080 con 0x7f7480107930 2024-09-21T11:51:24.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.969+0000 7f7485a9f640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f746c07aed0 0x7f746c07d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f747c006010 tx=0x7f747c0095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:24.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:24.973+0000 7f7476ffd640 1 -- 172.21.15.118:0/3006693632 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7470014030 con 0x7f7480107930 2024-09-21T11:51:25.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.169+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7480198380 con 0x7f746c07aed0 2024-09-21T11:51:25.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.170+0000 7f7476ffd640 1 -- 172.21.15.118:0/3006693632 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f7480198380 con 0x7f746c07aed0 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:51:25.173 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:51:25.174 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:51:25.174 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.172+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f746c07aed0 msgr2=0x7f746c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.172+0000 7f7487d03640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f746c07aed0 0x7f746c07d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f747c006010 tx=0x7f747c0095f0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.173+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 msgr2=0x7f748019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.173+0000 7f7487d03640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 0x7f748019dbb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f747000c8f0 tx=0x7f747000cdb0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.173+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 shutdown_connections 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.173+0000 7f7487d03640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f746c07aed0 0x7f746c07d390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.173+0000 7f7487d03640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7480107930 0x7f748019dbb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.173+0000 7f7487d03640 1 --2- 172.21.15.118:0/3006693632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7480101930 0x7f748019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.173+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 >> 172.21.15.118:0/3006693632 conn(0x7f74800fd630 msgr2=0x7f74800fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.173+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 shutdown_connections 2024-09-21T11:51:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.173+0000 7f7487d03640 1 -- 172.21.15.118:0/3006693632 wait complete. 2024-09-21T11:51:25.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.259+0000 7f3b471ad640 1 -- 172.21.15.118:0/1692976405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 msgr2=0x7f3b40100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:25.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.259+0000 7f3b471ad640 1 --2- 172.21.15.118:0/1692976405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 0x7f3b40100c40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009880 tx=0x7f3b2c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.259+0000 7f3b471ad640 1 -- 172.21.15.118:0/1692976405 shutdown_connections 2024-09-21T11:51:25.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.259+0000 7f3b471ad640 1 --2- 172.21.15.118:0/1692976405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 0x7f3b40100c40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.259+0000 7f3b471ad640 1 --2- 172.21.15.118:0/1692976405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401067e0 0x7f3b40106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.259+0000 7f3b471ad640 1 -- 172.21.15.118:0/1692976405 >> 172.21.15.118:0/1692976405 conn(0x7f3b400fc4c0 msgr2=0x7f3b400fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:25.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.259+0000 7f3b471ad640 1 -- 172.21.15.118:0/1692976405 shutdown_connections 2024-09-21T11:51:25.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.259+0000 7f3b471ad640 1 -- 172.21.15.118:0/1692976405 wait complete. 2024-09-21T11:51:25.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.260+0000 7f3b471ad640 1 Processor -- start 2024-09-21T11:51:25.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.260+0000 7f3b471ad640 1 -- start start 2024-09-21T11:51:25.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.260+0000 7f3b471ad640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 0x7f3b40198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:25.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.260+0000 7f3b471ad640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401067e0 0x7f3b40198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.260+0000 7f3b471ad640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4010dd10 con 0x7f3b401007e0 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.260+0000 7f3b471ad640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4010db90 con 0x7f3b401067e0 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.260+0000 7f3b44f49640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 0x7f3b40198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.260+0000 7f3b44f49640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 0x7f3b40198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47914/0 (socket says 172.21.15.118:47914) 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.260+0000 7f3b44f49640 1 -- 172.21.15.118:0/3033451307 learned_addr learned my addr 172.21.15.118:0/3033451307 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b3ffff640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401067e0 0x7f3b40198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b44f49640 1 -- 172.21.15.118:0/3033451307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401067e0 msgr2=0x7f3b40198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b44f49640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401067e0 0x7f3b40198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b44f49640 1 -- 172.21.15.118:0/3033451307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b40199380 con 0x7f3b401007e0 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b44f49640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 0x7f3b40198840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400b420 tx=0x7f3b3400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b3dffb640 1 -- 172.21.15.118:0/3033451307 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b34011630 con 0x7f3b401007e0 2024-09-21T11:51:25.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b3dffb640 1 -- 172.21.15.118:0/3033451307 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b34016070 con 0x7f3b401007e0 2024-09-21T11:51:25.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b3dffb640 1 -- 172.21.15.118:0/3033451307 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b34010d40 con 0x7f3b401007e0 2024-09-21T11:51:25.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b40199670 con 0x7f3b401007e0 2024-09-21T11:51:25.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.261+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b401a1c70 con 0x7f3b401007e0 2024-09-21T11:51:25.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.262+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b40101f20 con 0x7f3b401007e0 2024-09-21T11:51:25.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.263+0000 7f3b3dffb640 1 -- 172.21.15.118:0/3033451307 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3b3401b460 con 0x7f3b401007e0 2024-09-21T11:51:25.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.263+0000 7f3b3dffb640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b3007af90 0x7f3b3007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:25.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.263+0000 7f3b3ffff640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b3007af90 0x7f3b3007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:25.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.263+0000 7f3b3dffb640 1 -- 172.21.15.118:0/3033451307 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f3b3409d6a0 con 0x7f3b401007e0 2024-09-21T11:51:25.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.264+0000 7f3b3ffff640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b3007af90 0x7f3b3007d450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b4006a680 tx=0x7f3b2c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:25.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.268+0000 7f3b3dffb640 1 -- 172.21.15.118:0/3033451307 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b40199670 con 0x7f3b401007e0 2024-09-21T11:51:25.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.511+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3b40108d70 con 0x7f3b401007e0 2024-09-21T11:51:25.514 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:25 smithi118 ceph-mon[111738]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:25.514 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:25 smithi118 ceph-mon[111738]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:25.514 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:25 smithi118 ceph-mon[111738]: pgmap v377: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:25.514 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:25 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1455952420' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:51:25.514 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:25 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2888544746' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:51:25.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.511+0000 7f3b3dffb640 1 -- 172.21.15.118:0/3033451307 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f3b34068c70 con 0x7f3b401007e0 2024-09-21T11:51:25.515 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:51:25.515 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:51:25.515 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:51:25.515 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:51:25.515 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:51:25.515 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:51:25.515 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.513+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b3007af90 msgr2=0x7f3b3007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.513+0000 7f3b471ad640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b3007af90 0x7f3b3007d450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b4006a680 tx=0x7f3b2c031400 comp rx=0 tx=0).stop 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.513+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 msgr2=0x7f3b40198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.513+0000 7f3b471ad640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 0x7f3b40198840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400b420 tx=0x7f3b3400b8e0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.514+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 shutdown_connections 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.514+0000 7f3b471ad640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401067e0 0x7f3b40198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.514+0000 7f3b471ad640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b3007af90 0x7f3b3007d450 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.514+0000 7f3b471ad640 1 --2- 172.21.15.118:0/3033451307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b401007e0 0x7f3b40198840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.514+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 >> 172.21.15.118:0/3033451307 conn(0x7f3b400fc4c0 msgr2=0x7f3b400fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:25.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.514+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 shutdown_connections 2024-09-21T11:51:25.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:25.514+0000 7f3b471ad640 1 -- 172.21.15.118:0/3033451307 wait complete. 2024-09-21T11:51:25.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:25 smithi149 ceph-mon[79770]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:25 smithi149 ceph-mon[79770]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:25 smithi149 ceph-mon[79770]: pgmap v377: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:25 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1455952420' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:51:25.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:25 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2888544746' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:51:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:26 smithi149 ceph-mon[79770]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:26 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3033451307' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:51:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:26 smithi118 ceph-mon[111738]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:26 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3033451307' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:51:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:27 smithi149 ceph-mon[79770]: pgmap v378: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:27 smithi118 ceph-mon[111738]: pgmap v378: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:29.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:29 smithi149 ceph-mon[79770]: pgmap v379: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:29 smithi118 ceph-mon[111738]: pgmap v379: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:31.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:31 smithi149 ceph-mon[79770]: pgmap v380: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:31 smithi118 ceph-mon[111738]: pgmap v380: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:33 smithi149 ceph-mon[79770]: pgmap v381: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:33 smithi118 ceph-mon[111738]: pgmap v381: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:35 smithi149 ceph-mon[79770]: pgmap v382: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:51:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:35 smithi118 ceph-mon[111738]: pgmap v382: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:51:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:37 smithi118 ceph-mon[111738]: pgmap v383: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:38.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:37 smithi149 ceph-mon[79770]: pgmap v383: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:40.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:39 smithi118 ceph-mon[111738]: pgmap v384: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:40.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:39 smithi149 ceph-mon[79770]: pgmap v384: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:41 smithi149 ceph-mon[79770]: pgmap v385: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:41 smithi118 ceph-mon[111738]: pgmap v385: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:43 smithi118 ceph-mon[111738]: pgmap v386: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:44.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:43 smithi149 ceph-mon[79770]: pgmap v386: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:45 smithi118 ceph-mon[111738]: pgmap v387: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:45 smithi149 ceph-mon[79770]: pgmap v387: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:47 smithi118 ceph-mon[111738]: pgmap v388: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:47 smithi149 ceph-mon[79770]: pgmap v388: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:49 smithi118 ceph-mon[111738]: pgmap v389: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:49 smithi149 ceph-mon[79770]: pgmap v389: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:51:51.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:51:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:51 smithi118 ceph-mon[111738]: pgmap v390: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:52.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:51 smithi149 ceph-mon[79770]: pgmap v390: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:53 smithi118 ceph-mon[111738]: pgmap v391: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:54.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:53 smithi149 ceph-mon[79770]: pgmap v391: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:55.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.608+0000 7f6c04389640 1 -- 172.21.15.118:0/4004025574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc100820 msgr2=0x7f6bfc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:55.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.608+0000 7f6c04389640 1 --2- 172.21.15.118:0/4004025574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc100820 0x7f6bfc100c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009880 tx=0x7f6bec02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.609+0000 7f6c04389640 1 -- 172.21.15.118:0/4004025574 shutdown_connections 2024-09-21T11:51:55.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.609+0000 7f6c04389640 1 --2- 172.21.15.118:0/4004025574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc100820 0x7f6bfc100c80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.609+0000 7f6c04389640 1 --2- 172.21.15.118:0/4004025574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bfc106820 0x7f6bfc106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.609+0000 7f6c04389640 1 -- 172.21.15.118:0/4004025574 >> 172.21.15.118:0/4004025574 conn(0x7f6bfc0fc520 msgr2=0x7f6bfc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:55.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.609+0000 7f6c04389640 1 -- 172.21.15.118:0/4004025574 shutdown_connections 2024-09-21T11:51:55.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.609+0000 7f6c04389640 1 -- 172.21.15.118:0/4004025574 wait complete. 2024-09-21T11:51:55.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.609+0000 7f6c04389640 1 Processor -- start 2024-09-21T11:51:55.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.609+0000 7f6c04389640 1 -- start start 2024-09-21T11:51:55.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c04389640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bfc100820 0x7f6bfc19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:55.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c04389640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc106820 0x7f6bfc19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:55.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c04389640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc10dcd0 con 0x7f6bfc106820 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c04389640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc10db50 con 0x7f6bfc100820 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c01924640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc106820 0x7f6bfc19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c01924640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc106820 0x7f6bfc19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45002/0 (socket says 172.21.15.118:45002) 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c01924640 1 -- 172.21.15.118:0/1829997500 learned_addr learned my addr 172.21.15.118:0/1829997500 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c02125640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bfc100820 0x7f6bfc19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c01924640 1 -- 172.21.15.118:0/1829997500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bfc100820 msgr2=0x7f6bfc19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c01924640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bfc100820 0x7f6bfc19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c01924640 1 -- 172.21.15.118:0/1829997500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bfc1977f0 con 0x7f6bfc106820 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.610+0000 7f6c01924640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc106820 0x7f6bfc19dbb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6bec031460 tx=0x7f6bec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.611+0000 7f6bf37fe640 1 -- 172.21.15.118:0/1829997500 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bec03f070 con 0x7f6bfc106820 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.611+0000 7f6bf37fe640 1 -- 172.21.15.118:0/1829997500 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bec0035f0 con 0x7f6bfc106820 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.611+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bfc197a80 con 0x7f6bfc106820 2024-09-21T11:51:55.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.611+0000 7f6bf37fe640 1 -- 172.21.15.118:0/1829997500 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bec035030 con 0x7f6bfc106820 2024-09-21T11:51:55.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.611+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bfc197fb0 con 0x7f6bfc106820 2024-09-21T11:51:55.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.612+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bfc101f60 con 0x7f6bfc106820 2024-09-21T11:51:55.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.612+0000 7f6bf37fe640 1 -- 172.21.15.118:0/1829997500 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6bec042070 con 0x7f6bfc106820 2024-09-21T11:51:55.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.613+0000 7f6bf37fe640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6be807af80 0x7f6be807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:55.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.613+0000 7f6c02125640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6be807af80 0x7f6be807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:55.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.613+0000 7f6bf37fe640 1 -- 172.21.15.118:0/1829997500 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f6bec0be910 con 0x7f6bfc106820 2024-09-21T11:51:55.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.614+0000 7f6c02125640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6be807af80 0x7f6be807d440 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8005d00 tx=0x7f6bf800b410 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:55.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.618+0000 7f6bf37fe640 1 -- 172.21.15.118:0/1829997500 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6bec089ee0 con 0x7f6bfc106820 2024-09-21T11:51:55.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.818+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6bfc198260 con 0x7f6be807af80 2024-09-21T11:51:55.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.819+0000 7f6bf37fe640 1 -- 172.21.15.118:0/1829997500 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6bfc198260 con 0x7f6be807af80 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6be807af80 msgr2=0x7f6be807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6be807af80 0x7f6be807d440 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8005d00 tx=0x7f6bf800b410 comp rx=0 tx=0).stop 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc106820 msgr2=0x7f6bfc19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc106820 0x7f6bfc19dbb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6bec031460 tx=0x7f6bec0045e0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 shutdown_connections 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6be807af80 0x7f6be807d440 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bfc106820 0x7f6bfc19dbb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 --2- 172.21.15.118:0/1829997500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bfc100820 0x7f6bfc19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 >> 172.21.15.118:0/1829997500 conn(0x7f6bfc0fc520 msgr2=0x7f6bfc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 shutdown_connections 2024-09-21T11:51:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.821+0000 7f6c04389640 1 -- 172.21.15.118:0/1829997500 wait complete. 2024-09-21T11:51:55.833 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:51:55.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.904+0000 7f3039dc1640 1 -- 172.21.15.118:0/1840906047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 msgr2=0x7f3034102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:55.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.904+0000 7f3039dc1640 1 --2- 172.21.15.118:0/1840906047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 0x7f3034102e80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3024009880 tx=0x7f302402a530 comp rx=0 tx=0).stop 2024-09-21T11:51:55.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.904+0000 7f3039dc1640 1 -- 172.21.15.118:0/1840906047 shutdown_connections 2024-09-21T11:51:55.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.904+0000 7f3039dc1640 1 --2- 172.21.15.118:0/1840906047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30341033c0 0x7f303410b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.904+0000 7f3039dc1640 1 --2- 172.21.15.118:0/1840906047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 0x7f3034102e80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.904+0000 7f3039dc1640 1 -- 172.21.15.118:0/1840906047 >> 172.21.15.118:0/1840906047 conn(0x7f30340fc4c0 msgr2=0x7f30340fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:55.908 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:55 smithi118 ceph-mon[111738]: pgmap v392: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:55.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.905+0000 7f3039dc1640 1 -- 172.21.15.118:0/1840906047 shutdown_connections 2024-09-21T11:51:55.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.905+0000 7f3039dc1640 1 -- 172.21.15.118:0/1840906047 wait complete. 2024-09-21T11:51:55.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.905+0000 7f3039dc1640 1 Processor -- start 2024-09-21T11:51:55.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.905+0000 7f3039dc1640 1 -- start start 2024-09-21T11:51:55.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f3039dc1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 0x7f303419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:55.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f3039dc1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30341033c0 0x7f303419dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:55.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f3039dc1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f303410ee30 con 0x7f3034102aa0 2024-09-21T11:51:55.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f3039dc1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f303410ecb0 con 0x7f30341033c0 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f30337fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 0x7f303419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f30337fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 0x7f303419d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45020/0 (socket says 172.21.15.118:45020) 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f30337fe640 1 -- 172.21.15.118:0/2664142548 learned_addr learned my addr 172.21.15.118:0/2664142548 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f302affd640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30341033c0 0x7f303419dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f30337fe640 1 -- 172.21.15.118:0/2664142548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30341033c0 msgr2=0x7f303419dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f30337fe640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30341033c0 0x7f303419dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f30337fe640 1 -- 172.21.15.118:0/2664142548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30341978c0 con 0x7f3034102aa0 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f302affd640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30341033c0 0x7f303419dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f30337fe640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 0x7f303419d700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3024031460 tx=0x7f30240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.906+0000 7f30317fa640 1 -- 172.21.15.118:0/2664142548 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f302403f070 con 0x7f3034102aa0 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.907+0000 7f30317fa640 1 -- 172.21.15.118:0/2664142548 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3024004cf0 con 0x7f3034102aa0 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.907+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3034197b50 con 0x7f3034102aa0 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.907+0000 7f30317fa640 1 -- 172.21.15.118:0/2664142548 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3024035030 con 0x7f3034102aa0 2024-09-21T11:51:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.907+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3034198080 con 0x7f3034102aa0 2024-09-21T11:51:55.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.908+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f303406a410 con 0x7f3034102aa0 2024-09-21T11:51:55.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.908+0000 7f30317fa640 1 -- 172.21.15.118:0/2664142548 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3024042070 con 0x7f3034102aa0 2024-09-21T11:51:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.909+0000 7f30317fa640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f302007af30 0x7f302007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.909+0000 7f302affd640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f302007af30 0x7f302007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.909+0000 7f30317fa640 1 -- 172.21.15.118:0/2664142548 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f30240bebb0 con 0x7f3034102aa0 2024-09-21T11:51:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.909+0000 7f302affd640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f302007af30 0x7f302007d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f301c006fd0 tx=0x7f301c008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:55.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:55.913+0000 7f30317fa640 1 -- 172.21.15.118:0/2664142548 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30240c5080 con 0x7f3034102aa0 2024-09-21T11:51:56.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.109+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3034105fe0 con 0x7f302007af30 2024-09-21T11:51:56.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.110+0000 7f30317fa640 1 -- 172.21.15.118:0/2664142548 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f301c00c7a0 con 0x7f302007af30 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f302007af30 msgr2=0x7f302007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f302007af30 0x7f302007d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f301c006fd0 tx=0x7f301c008040 comp rx=0 tx=0).stop 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 msgr2=0x7f303419d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 0x7f303419d700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3024031460 tx=0x7f30240048f0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 shutdown_connections 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30341033c0 0x7f303419dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f302007af30 0x7f302007d3f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 --2- 172.21.15.118:0/2664142548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3034102aa0 0x7f303419d700 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 >> 172.21.15.118:0/2664142548 conn(0x7f30340fc4c0 msgr2=0x7f3034108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 shutdown_connections 2024-09-21T11:51:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.112+0000 7f3039dc1640 1 -- 172.21.15.118:0/2664142548 wait complete. 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.194+0000 7f2020a1a640 1 -- 172.21.15.118:0/2831878700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1007e0 msgr2=0x7f201c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.194+0000 7f2020a1a640 1 --2- 172.21.15.118:0/2831878700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1007e0 0x7f201c100c40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2004009880 tx=0x7f200402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.194+0000 7f2020a1a640 1 -- 172.21.15.118:0/2831878700 shutdown_connections 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.194+0000 7f2020a1a640 1 --2- 172.21.15.118:0/2831878700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1007e0 0x7f201c100c40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.194+0000 7f2020a1a640 1 --2- 172.21.15.118:0/2831878700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f201c1067e0 0x7f201c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.194+0000 7f2020a1a640 1 -- 172.21.15.118:0/2831878700 >> 172.21.15.118:0/2831878700 conn(0x7f201c0fc4c0 msgr2=0x7f201c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.194+0000 7f2020a1a640 1 -- 172.21.15.118:0/2831878700 shutdown_connections 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.194+0000 7f2020a1a640 1 -- 172.21.15.118:0/2831878700 wait complete. 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2020a1a640 1 Processor -- start 2024-09-21T11:51:56.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2020a1a640 1 -- start start 2024-09-21T11:51:56.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2020a1a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f201c1007e0 0x7f201c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2020a1a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1067e0 0x7f201c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2020a1a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f201c10dcb0 con 0x7f201c1067e0 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2020a1a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f201c10db30 con 0x7f201c1007e0 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2019d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1067e0 0x7f201c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2019d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1067e0 0x7f201c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45034/0 (socket says 172.21.15.118:45034) 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2019d9b640 1 -- 172.21.15.118:0/2093149354 learned_addr learned my addr 172.21.15.118:0/2093149354 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f201a59c640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f201c1007e0 0x7f201c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2019d9b640 1 -- 172.21.15.118:0/2093149354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f201c1007e0 msgr2=0x7f201c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2019d9b640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f201c1007e0 0x7f201c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.195+0000 7f2019d9b640 1 -- 172.21.15.118:0/2093149354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c199320 con 0x7f201c1067e0 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.196+0000 7f2019d9b640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1067e0 0x7f201c198d20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2004031460 tx=0x7f20040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.196+0000 7f20137fe640 1 -- 172.21.15.118:0/2093149354 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f200403f070 con 0x7f201c1067e0 2024-09-21T11:51:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.196+0000 7f20137fe640 1 -- 172.21.15.118:0/2093149354 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20040035f0 con 0x7f201c1067e0 2024-09-21T11:51:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.196+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c1995b0 con 0x7f201c1067e0 2024-09-21T11:51:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.196+0000 7f20137fe640 1 -- 172.21.15.118:0/2093149354 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2004035030 con 0x7f201c1067e0 2024-09-21T11:51:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.196+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c1a1b60 con 0x7f201c1067e0 2024-09-21T11:51:56.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:55 smithi149 ceph-mon[79770]: pgmap v392: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.197+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201c101f20 con 0x7f201c1067e0 2024-09-21T11:51:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.198+0000 7f20137fe640 1 -- 172.21.15.118:0/2093149354 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2004042070 con 0x7f201c1067e0 2024-09-21T11:51:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.198+0000 7f20137fe640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f200807af30 0x7f200807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.199+0000 7f20137fe640 1 -- 172.21.15.118:0/2093149354 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f20040bf030 con 0x7f201c1067e0 2024-09-21T11:51:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.199+0000 7f201a59c640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f200807af30 0x7f200807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.199+0000 7f201a59c640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f200807af30 0x7f200807d3f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f200c005fd0 tx=0x7f200c00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:56.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.202+0000 7f20137fe640 1 -- 172.21.15.118:0/2093149354 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f200408a600 con 0x7f201c1067e0 2024-09-21T11:51:56.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.389+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f201c062630 con 0x7f200807af30 2024-09-21T11:51:56.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.398+0000 7f20137fe640 1 -- 172.21.15.118:0/2093149354 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f201c062630 con 0x7f200807af30 2024-09-21T11:51:56.400 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:51:56.400 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (9m) 3m ago 20m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:51:56.400 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (12m) 3m ago 21m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (12m) 3m ago 20m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (8m) 3m ago 20m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (7m) 3m ago 20m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (9m) 3m ago 20m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (4m) 3m ago 15m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (4m) 3m ago 15m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (15m) 3m ago 15m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (3m) 3m ago 15m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (12m) 3m ago 22m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (11m) 3m ago 19m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (8m) 3m ago 22m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (8m) 3m ago 19m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (10m) 3m ago 20m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (10m) 3m ago 20m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:51:56.401 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (7m) 3m ago 18m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:51:56.402 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (6m) 3m ago 18m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:51:56.402 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (6m) 3m ago 17m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:51:56.402 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (5m) 3m ago 17m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:51:56.402 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (5m) 3m ago 16m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:51:56.402 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (4m) 3m ago 16m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:51:56.402 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (10m) 3m ago 20m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f200807af30 msgr2=0x7f200807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f200807af30 0x7f200807d3f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f200c005fd0 tx=0x7f200c00b390 comp rx=0 tx=0).stop 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1067e0 msgr2=0x7f201c198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1067e0 0x7f201c198d20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2004031460 tx=0x7f20040045e0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 shutdown_connections 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f200807af30 0x7f200807d3f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201c1067e0 0x7f201c198d20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 --2- 172.21.15.118:0/2093149354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f201c1007e0 0x7f201c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 >> 172.21.15.118:0/2093149354 conn(0x7f201c0fc4c0 msgr2=0x7f201c0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 shutdown_connections 2024-09-21T11:51:56.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.400+0000 7f2020a1a640 1 -- 172.21.15.118:0/2093149354 wait complete. 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.481+0000 7f34a1a46640 1 -- 172.21.15.118:0/2562718535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 msgr2=0x7f349c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.481+0000 7f34a1a46640 1 --2- 172.21.15.118:0/2562718535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 0x7f349c102ec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f348c009880 tx=0x7f348c02a530 comp rx=0 tx=0).stop 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.481+0000 7f34a1a46640 1 -- 172.21.15.118:0/2562718535 shutdown_connections 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.481+0000 7f34a1a46640 1 --2- 172.21.15.118:0/2562718535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c103400 0x7f349c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.481+0000 7f34a1a46640 1 --2- 172.21.15.118:0/2562718535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 0x7f349c102ec0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.481+0000 7f34a1a46640 1 -- 172.21.15.118:0/2562718535 >> 172.21.15.118:0/2562718535 conn(0x7f349c0fc520 msgr2=0x7f349c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.481+0000 7f34a1a46640 1 -- 172.21.15.118:0/2562718535 shutdown_connections 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.481+0000 7f34a1a46640 1 -- 172.21.15.118:0/2562718535 wait complete. 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f34a1a46640 1 Processor -- start 2024-09-21T11:51:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f34a1a46640 1 -- start start 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f34a1a46640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 0x7f349c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f34a1a46640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c103400 0x7f349c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f34a1a46640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f349c10ee10 con 0x7f349c102ae0 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f34a1a46640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f349c10ec90 con 0x7f349c103400 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f349affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 0x7f349c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f349affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 0x7f349c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45040/0 (socket says 172.21.15.118:45040) 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f349affd640 1 -- 172.21.15.118:0/2291456476 learned_addr learned my addr 172.21.15.118:0/2291456476 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f34927fc640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c103400 0x7f349c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f349affd640 1 -- 172.21.15.118:0/2291456476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c103400 msgr2=0x7f349c100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f349affd640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c103400 0x7f349c100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f349affd640 1 -- 172.21.15.118:0/2291456476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c1011c0 con 0x7f349c102ae0 2024-09-21T11:51:56.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.482+0000 7f34927fc640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c103400 0x7f349c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:51:56.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.483+0000 7f349affd640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 0x7f349c100740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f348c031460 tx=0x7f348c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:56.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.483+0000 7f34a0a44640 1 -- 172.21.15.118:0/2291456476 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f348c03f070 con 0x7f349c102ae0 2024-09-21T11:51:56.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.483+0000 7f34a0a44640 1 -- 172.21.15.118:0/2291456476 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f348c004cf0 con 0x7f349c102ae0 2024-09-21T11:51:56.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.483+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349c101450 con 0x7f349c102ae0 2024-09-21T11:51:56.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.483+0000 7f34a0a44640 1 -- 172.21.15.118:0/2291456476 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f348c035030 con 0x7f349c102ae0 2024-09-21T11:51:56.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.483+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349c1a3ee0 con 0x7f349c102ae0 2024-09-21T11:51:56.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.484+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349c06abe0 con 0x7f349c102ae0 2024-09-21T11:51:56.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.485+0000 7f34a0a44640 1 -- 172.21.15.118:0/2291456476 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f348c042070 con 0x7f349c102ae0 2024-09-21T11:51:56.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.485+0000 7f34a0a44640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f348807af30 0x7f348807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:56.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.485+0000 7f34a0a44640 1 -- 172.21.15.118:0/2291456476 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f348c0beb70 con 0x7f349c102ae0 2024-09-21T11:51:56.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.486+0000 7f34927fc640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f348807af30 0x7f348807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:56.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.486+0000 7f34927fc640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f348807af30 0x7f348807d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f349c1021d0 tx=0x7f3484005dd0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:56.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.490+0000 7f34a0a44640 1 -- 172.21.15.118:0/2291456476 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f348c08a0c0 con 0x7f349c102ae0 2024-09-21T11:51:56.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.735+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f349c101c70 con 0x7f349c102ae0 2024-09-21T11:51:56.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.736+0000 7f34a0a44640 1 -- 172.21.15.118:0/2291456476 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f348c08ef70 con 0x7f349c102ae0 2024-09-21T11:51:56.738 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:51:56.738 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:51:56.738 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:51:56.738 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:51:56.738 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:51:56.738 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:51:56.738 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:51:56.738 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:51:56.739 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:51:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f348807af30 msgr2=0x7f348807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f348807af30 0x7f348807d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f349c1021d0 tx=0x7f3484005dd0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 msgr2=0x7f349c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 0x7f349c100740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f348c031460 tx=0x7f348c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 shutdown_connections 2024-09-21T11:51:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f349c103400 0x7f349c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f348807af30 0x7f348807d3f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 --2- 172.21.15.118:0/2291456476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f349c102ae0 0x7f349c100740 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 >> 172.21.15.118:0/2291456476 conn(0x7f349c0fc520 msgr2=0x7f349c108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:56.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 shutdown_connections 2024-09-21T11:51:56.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.738+0000 7f34a1a46640 1 -- 172.21.15.118:0/2291456476 wait complete. 2024-09-21T11:51:56.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.820+0000 7f4abe23b640 1 -- 172.21.15.118:0/4271352401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81007e0 msgr2=0x7f4ab8100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.820+0000 7f4abe23b640 1 --2- 172.21.15.118:0/4271352401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81007e0 0x7f4ab8100c40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009880 tx=0x7f4aac02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.820+0000 7f4abe23b640 1 -- 172.21.15.118:0/4271352401 shutdown_connections 2024-09-21T11:51:56.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.820+0000 7f4abe23b640 1 --2- 172.21.15.118:0/4271352401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81007e0 0x7f4ab8100c40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.820+0000 7f4abe23b640 1 --2- 172.21.15.118:0/4271352401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ab81067e0 0x7f4ab8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.820+0000 7f4abe23b640 1 -- 172.21.15.118:0/4271352401 >> 172.21.15.118:0/4271352401 conn(0x7f4ab80fc4c0 msgr2=0x7f4ab80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:56.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.820+0000 7f4abe23b640 1 -- 172.21.15.118:0/4271352401 shutdown_connections 2024-09-21T11:51:56.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.820+0000 7f4abe23b640 1 -- 172.21.15.118:0/4271352401 wait complete. 2024-09-21T11:51:56.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4abe23b640 1 Processor -- start 2024-09-21T11:51:56.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4abe23b640 1 -- start start 2024-09-21T11:51:56.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4abe23b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ab81007e0 0x7f4ab819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:56.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4abe23b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81067e0 0x7f4ab819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:56.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4abe23b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab810dcb0 con 0x7f4ab81067e0 2024-09-21T11:51:56.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4abe23b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab810db30 con 0x7f4ab81007e0 2024-09-21T11:51:56.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4ab6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81067e0 0x7f4ab819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:56.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4ab6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81067e0 0x7f4ab819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45056/0 (socket says 172.21.15.118:45056) 2024-09-21T11:51:56.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4ab6ffd640 1 -- 172.21.15.118:0/928718237 learned_addr learned my addr 172.21.15.118:0/928718237 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.821+0000 7f4ab77fe640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ab81007e0 0x7f4ab819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.822+0000 7f4ab6ffd640 1 -- 172.21.15.118:0/928718237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ab81007e0 msgr2=0x7f4ab819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.822+0000 7f4ab6ffd640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ab81007e0 0x7f4ab819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.822+0000 7f4ab6ffd640 1 -- 172.21.15.118:0/928718237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab8197830 con 0x7f4ab81067e0 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.822+0000 7f4ab6ffd640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81067e0 0x7f4ab819dbf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4aac031460 tx=0x7f4aac0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.822+0000 7f4ab4ff9640 1 -- 172.21.15.118:0/928718237 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4aac03f070 con 0x7f4ab81067e0 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.822+0000 7f4ab4ff9640 1 -- 172.21.15.118:0/928718237 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4aac0035f0 con 0x7f4ab81067e0 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.822+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab8197ac0 con 0x7f4ab81067e0 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.822+0000 7f4ab4ff9640 1 -- 172.21.15.118:0/928718237 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4aac035030 con 0x7f4ab81067e0 2024-09-21T11:51:56.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.822+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab8197ff0 con 0x7f4ab81067e0 2024-09-21T11:51:56.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.823+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab8101f20 con 0x7f4ab81067e0 2024-09-21T11:51:56.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.824+0000 7f4ab4ff9640 1 -- 172.21.15.118:0/928718237 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4aac042070 con 0x7f4ab81067e0 2024-09-21T11:51:56.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.825+0000 7f4ab4ff9640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4aa007af30 0x7f4aa007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:56.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.825+0000 7f4ab4ff9640 1 -- 172.21.15.118:0/928718237 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f4aac0bea20 con 0x7f4ab81067e0 2024-09-21T11:51:56.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.825+0000 7f4ab77fe640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4aa007af30 0x7f4aa007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:56.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.825+0000 7f4ab77fe640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4aa007af30 0x7f4aa007d3f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8005fd0 tx=0x7f4aa8009680 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:56.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:56.829+0000 7f4ab4ff9640 1 -- 172.21.15.118:0/928718237 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4aac089f70 con 0x7f4ab81067e0 2024-09-21T11:51:57.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.046+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4ab8109d60 con 0x7f4ab81067e0 2024-09-21T11:51:57.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:56 smithi118 ceph-mon[111738]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:57.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:56 smithi118 ceph-mon[111738]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:57.048 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:56 smithi118 ceph-mon[111738]: pgmap v393: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:57.049 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:56 smithi118 ceph-mon[111738]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:57.049 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:56 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2291456476' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:51:57.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.046+0000 7f4ab4ff9640 1 -- 172.21.15.118:0/928718237 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f4aac08ee20 con 0x7f4ab81067e0 2024-09-21T11:51:57.049 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:51:57.049 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:51:57.049 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:51:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:51:57.051 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:51:57.052 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:51:57.053 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:51:57.053 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:51:57.053 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:51:57.053 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:51:57.053 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.048+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4aa007af30 msgr2=0x7f4aa007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.048+0000 7f4abe23b640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4aa007af30 0x7f4aa007d3f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8005fd0 tx=0x7f4aa8009680 comp rx=0 tx=0).stop 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.048+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81067e0 msgr2=0x7f4ab819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.048+0000 7f4abe23b640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81067e0 0x7f4ab819dbf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4aac031460 tx=0x7f4aac0045e0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.049+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 shutdown_connections 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.049+0000 7f4abe23b640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4aa007af30 0x7f4aa007d3f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.049+0000 7f4abe23b640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ab81067e0 0x7f4ab819dbf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.049+0000 7f4abe23b640 1 --2- 172.21.15.118:0/928718237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ab81007e0 0x7f4ab819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.049+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 >> 172.21.15.118:0/928718237 conn(0x7f4ab80fc4c0 msgr2=0x7f4ab8069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.049+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 shutdown_connections 2024-09-21T11:51:57.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.049+0000 7f4abe23b640 1 -- 172.21.15.118:0/928718237 wait complete. 2024-09-21T11:51:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.131+0000 7f14ece0d640 1 -- 172.21.15.118:0/3645452161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 msgr2=0x7f14e8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.131+0000 7f14ece0d640 1 --2- 172.21.15.118:0/3645452161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 0x7f14e8101d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009880 tx=0x7f14d002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.132+0000 7f14ece0d640 1 -- 172.21.15.118:0/3645452161 shutdown_connections 2024-09-21T11:51:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.132+0000 7f14ece0d640 1 --2- 172.21.15.118:0/3645452161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 0x7f14e8101d90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.132+0000 7f14ece0d640 1 --2- 172.21.15.118:0/3645452161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14e8107930 0x7f14e8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.132+0000 7f14ece0d640 1 -- 172.21.15.118:0/3645452161 >> 172.21.15.118:0/3645452161 conn(0x7f14e80fd630 msgr2=0x7f14e80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:57.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.132+0000 7f14ece0d640 1 -- 172.21.15.118:0/3645452161 shutdown_connections 2024-09-21T11:51:57.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.132+0000 7f14ece0d640 1 -- 172.21.15.118:0/3645452161 wait complete. 2024-09-21T11:51:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.132+0000 7f14ece0d640 1 Processor -- start 2024-09-21T11:51:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14ece0d640 1 -- start start 2024-09-21T11:51:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14ece0d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 0x7f14e819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14ece0d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14e8107930 0x7f14e819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14ece0d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f14e810ede0 con 0x7f14e8101930 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14ece0d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f14e810ec60 con 0x7f14e8107930 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14e659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 0x7f14e819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14e659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 0x7f14e819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45072/0 (socket says 172.21.15.118:45072) 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14e659c640 1 -- 172.21.15.118:0/697728843 learned_addr learned my addr 172.21.15.118:0/697728843 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14e659c640 1 -- 172.21.15.118:0/697728843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14e8107930 msgr2=0x7f14e819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14dffff640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14e8107930 0x7f14e819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14e659c640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14e8107930 0x7f14e819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14e659c640 1 -- 172.21.15.118:0/697728843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e8197850 con 0x7f14e8101930 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14dffff640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14e8107930 0x7f14e819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:51:57.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14e659c640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 0x7f14e819d6d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c8a0 tx=0x7f14d800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.133+0000 7f14df7fe640 1 -- 172.21.15.118:0/697728843 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14d80079b0 con 0x7f14e8101930 2024-09-21T11:51:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.134+0000 7f14df7fe640 1 -- 172.21.15.118:0/697728843 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f14d8007b50 con 0x7f14e8101930 2024-09-21T11:51:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.134+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e8197b40 con 0x7f14e8101930 2024-09-21T11:51:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.134+0000 7f14df7fe640 1 -- 172.21.15.118:0/697728843 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14d8018700 con 0x7f14e8101930 2024-09-21T11:51:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.134+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e81980d0 con 0x7f14e8101930 2024-09-21T11:51:57.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.135+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e8103070 con 0x7f14e8101930 2024-09-21T11:51:57.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.135+0000 7f14df7fe640 1 -- 172.21.15.118:0/697728843 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f14d8007d00 con 0x7f14e8101930 2024-09-21T11:51:57.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.136+0000 7f14df7fe640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f14d407af90 0x7f14d407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:57.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.136+0000 7f14df7fe640 1 -- 172.21.15.118:0/697728843 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f14d809e300 con 0x7f14e8101930 2024-09-21T11:51:57.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.136+0000 7f14dffff640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f14d407af90 0x7f14d407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:57.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.136+0000 7f14dffff640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f14d407af90 0x7f14d407d450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14d0031460 tx=0x7f14d0004280 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.140+0000 7f14df7fe640 1 -- 172.21.15.118:0/697728843 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14d8014030 con 0x7f14e8101930 2024-09-21T11:51:57.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:56 smithi149 ceph-mon[79770]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:57.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:56 smithi149 ceph-mon[79770]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:57.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:56 smithi149 ceph-mon[79770]: pgmap v393: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:57.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:56 smithi149 ceph-mon[79770]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:57.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:56 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2291456476' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:51:57.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.333+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f14e81983e0 con 0x7f14d407af90 2024-09-21T11:51:57.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.335+0000 7f14df7fe640 1 -- 172.21.15.118:0/697728843 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f14e81983e0 con 0x7f14d407af90 2024-09-21T11:51:57.337 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:51:57.337 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:51:57.337 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:51:57.337 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:51:57.337 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:51:57.337 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:51:57.337 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:51:57.338 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:51:57.338 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:51:57.338 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:51:57.338 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:51:57.338 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:51:57.338 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:51:57.338 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:51:57.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f14d407af90 msgr2=0x7f14d407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f14d407af90 0x7f14d407d450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14d0031460 tx=0x7f14d0004280 comp rx=0 tx=0).stop 2024-09-21T11:51:57.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 msgr2=0x7f14e819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 0x7f14e819d6d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c8a0 tx=0x7f14d800cd60 comp rx=0 tx=0).stop 2024-09-21T11:51:57.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 shutdown_connections 2024-09-21T11:51:57.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14e8107930 0x7f14e819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f14d407af90 0x7f14d407d450 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 --2- 172.21.15.118:0/697728843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14e8101930 0x7f14e819d6d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 >> 172.21.15.118:0/697728843 conn(0x7f14e80fd630 msgr2=0x7f14e80fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:57.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 shutdown_connections 2024-09-21T11:51:57.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.337+0000 7f14ece0d640 1 -- 172.21.15.118:0/697728843 wait complete. 2024-09-21T11:51:57.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.418+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/417810289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 msgr2=0x7fe9f410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.418+0000 7fe9f9bcc640 1 --2- 172.21.15.118:0/417810289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 0x7fe9f410b8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009880 tx=0x7fe9e802a530 comp rx=0 tx=0).stop 2024-09-21T11:51:57.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.418+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/417810289 shutdown_connections 2024-09-21T11:51:57.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.418+0000 7fe9f9bcc640 1 --2- 172.21.15.118:0/417810289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 0x7fe9f410b8b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.418+0000 7fe9f9bcc640 1 --2- 172.21.15.118:0/417810289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9f4102aa0 0x7fe9f4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.418+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/417810289 >> 172.21.15.118:0/417810289 conn(0x7fe9f40fc4c0 msgr2=0x7fe9f40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:57.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.418+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/417810289 shutdown_connections 2024-09-21T11:51:57.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.418+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/417810289 wait complete. 2024-09-21T11:51:57.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.418+0000 7fe9f9bcc640 1 Processor -- start 2024-09-21T11:51:57.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f9bcc640 1 -- start start 2024-09-21T11:51:57.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f9bcc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9f4102aa0 0x7fe9f419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:57.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f9bcc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 0x7fe9f419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:57.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f9bcc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f410edd0 con 0x7fe9f41033c0 2024-09-21T11:51:57.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f9bcc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f410ec50 con 0x7fe9f4102aa0 2024-09-21T11:51:57.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 0x7fe9f419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 0x7fe9f419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45090/0 (socket says 172.21.15.118:45090) 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f2ffd640 1 -- 172.21.15.118:0/1031203891 learned_addr learned my addr 172.21.15.118:0/1031203891 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f37fe640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9f4102aa0 0x7fe9f419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f2ffd640 1 -- 172.21.15.118:0/1031203891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9f4102aa0 msgr2=0x7fe9f419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f2ffd640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9f4102aa0 0x7fe9f419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f2ffd640 1 -- 172.21.15.118:0/1031203891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f4197800 con 0x7fe9f41033c0 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.419+0000 7fe9f2ffd640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 0x7fe9f419dbc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8031460 tx=0x7fe9e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.420+0000 7fe9f0ff9640 1 -- 172.21.15.118:0/1031203891 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe9e803f070 con 0x7fe9f41033c0 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.420+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f4197a90 con 0x7fe9f41033c0 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.420+0000 7fe9f0ff9640 1 -- 172.21.15.118:0/1031203891 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9e8004ac0 con 0x7fe9f41033c0 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.420+0000 7fe9f0ff9640 1 -- 172.21.15.118:0/1031203891 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe9e8035030 con 0x7fe9f41033c0 2024-09-21T11:51:57.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.420+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f4197fc0 con 0x7fe9f41033c0 2024-09-21T11:51:57.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.421+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f406a410 con 0x7fe9f41033c0 2024-09-21T11:51:57.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.421+0000 7fe9f0ff9640 1 -- 172.21.15.118:0/1031203891 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe9e8042070 con 0x7fe9f41033c0 2024-09-21T11:51:57.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.422+0000 7fe9f0ff9640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe9dc07f350 0x7fe9dc081810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:51:57.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.422+0000 7fe9f37fe640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe9dc07f350 0x7fe9dc081810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:51:57.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.422+0000 7fe9f0ff9640 1 -- 172.21.15.118:0/1031203891 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fe9e80beb30 con 0x7fe9f41033c0 2024-09-21T11:51:57.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.422+0000 7fe9f37fe640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe9dc07f350 0x7fe9dc081810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4005c40 tx=0x7fe9e400a390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:51:57.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.426+0000 7fe9f0ff9640 1 -- 172.21.15.118:0/1031203891 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9e808a080 con 0x7fe9f41033c0 2024-09-21T11:51:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.674+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe9f4105f40 con 0x7fe9f41033c0 2024-09-21T11:51:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.675+0000 7fe9f0ff9640 1 -- 172.21.15.118:0/1031203891 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fe9e808ef30 con 0x7fe9f41033c0 2024-09-21T11:51:57.677 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:51:57.678 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:51:57.678 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:51:57.678 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:51:57.678 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:51:57.678 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:51:57.678 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:51:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe9dc07f350 msgr2=0x7fe9dc081810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe9dc07f350 0x7fe9dc081810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4005c40 tx=0x7fe9e400a390 comp rx=0 tx=0).stop 2024-09-21T11:51:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 msgr2=0x7fe9f419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:51:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 0x7fe9f419dbc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8031460 tx=0x7fe9e80046c0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 shutdown_connections 2024-09-21T11:51:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe9dc07f350 0x7fe9dc081810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9f41033c0 0x7fe9f419dbc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 --2- 172.21.15.118:0/1031203891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9f4102aa0 0x7fe9f419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:51:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 >> 172.21.15.118:0/1031203891 conn(0x7fe9f40fc4c0 msgr2=0x7fe9f4108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:51:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 shutdown_connections 2024-09-21T11:51:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:51:57.677+0000 7fe9f9bcc640 1 -- 172.21.15.118:0/1031203891 wait complete. 2024-09-21T11:51:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:57 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/928718237' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:51:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:57 smithi118 ceph-mon[111738]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:57 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1031203891' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:51:58.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:57 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/928718237' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:51:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:57 smithi149 ceph-mon[79770]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:51:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:57 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1031203891' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:51:59.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:51:58 smithi118 ceph-mon[111738]: pgmap v394: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:51:59.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:51:58 smithi149 ceph-mon[79770]: pgmap v394: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:01.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:01 smithi118 ceph-mon[111738]: pgmap v395: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:01.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:01 smithi149 ceph-mon[79770]: pgmap v395: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:03.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:03 smithi118 ceph-mon[111738]: pgmap v396: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:03.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:03 smithi149 ceph-mon[79770]: pgmap v396: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:05 smithi118 ceph-mon[111738]: pgmap v397: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:52:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:05 smithi149 ceph-mon[79770]: pgmap v397: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:52:07.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:07 smithi118 ceph-mon[111738]: pgmap v398: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:07.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:07 smithi149 ceph-mon[79770]: pgmap v398: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:09.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:09 smithi118 ceph-mon[111738]: pgmap v399: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:09 smithi149 ceph-mon[79770]: pgmap v399: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:11.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:11 smithi149 ceph-mon[79770]: pgmap v400: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:11 smithi118 ceph-mon[111738]: pgmap v400: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:13 smithi149 ceph-mon[79770]: pgmap v401: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:13 smithi118 ceph-mon[111738]: pgmap v401: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:15 smithi149 ceph-mon[79770]: pgmap v402: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:15 smithi118 ceph-mon[111738]: pgmap v402: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:17.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:17 smithi149 ceph-mon[79770]: pgmap v403: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:17 smithi118 ceph-mon[111738]: pgmap v403: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:19 smithi149 ceph-mon[79770]: pgmap v404: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:19 smithi118 ceph-mon[111738]: pgmap v404: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:52:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:52:21.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:21 smithi149 ceph-mon[79770]: pgmap v405: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:21 smithi118 ceph-mon[111738]: pgmap v405: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:23.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:23 smithi149 ceph-mon[79770]: pgmap v406: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:23 smithi118 ceph-mon[111738]: pgmap v406: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:25.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:25 smithi149 ceph-mon[79770]: pgmap v407: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:25 smithi118 ceph-mon[111738]: pgmap v407: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:27 smithi149 ceph-mon[79770]: pgmap v408: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:27.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.771+0000 7f4bbfa01640 1 -- 172.21.15.118:0/2863036175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8106820 msgr2=0x7f4bb8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:27.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.771+0000 7f4bbfa01640 1 --2- 172.21.15.118:0/2863036175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8106820 0x7f4bb8106c00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009880 tx=0x7f4bb402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:52:27.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.771+0000 7f4bbfa01640 1 -- 172.21.15.118:0/2863036175 shutdown_connections 2024-09-21T11:52:27.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.771+0000 7f4bbfa01640 1 --2- 172.21.15.118:0/2863036175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb8100820 0x7f4bb8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:27.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.771+0000 7f4bbfa01640 1 --2- 172.21.15.118:0/2863036175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8106820 0x7f4bb8106c00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:27.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.771+0000 7f4bbfa01640 1 -- 172.21.15.118:0/2863036175 >> 172.21.15.118:0/2863036175 conn(0x7f4bb80fc520 msgr2=0x7f4bb80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:27.774 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:27 smithi118 ceph-mon[111738]: pgmap v408: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.771+0000 7f4bbfa01640 1 -- 172.21.15.118:0/2863036175 shutdown_connections 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.771+0000 7f4bbfa01640 1 -- 172.21.15.118:0/2863036175 wait complete. 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.772+0000 7f4bbfa01640 1 Processor -- start 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.772+0000 7f4bbfa01640 1 -- start start 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.772+0000 7f4bbfa01640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8100820 0x7f4bb8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.772+0000 7f4bbfa01640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb8106820 0x7f4bb8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.772+0000 7f4bbfa01640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb810dcf0 con 0x7f4bb8100820 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.772+0000 7f4bbfa01640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb810db70 con 0x7f4bb8106820 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.772+0000 7f4bbd79d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8100820 0x7f4bb8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4bbd79d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8100820 0x7f4bb8198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41840/0 (socket says 172.21.15.118:41840) 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4bbd79d640 1 -- 172.21.15.118:0/1796333999 learned_addr learned my addr 172.21.15.118:0/1796333999 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:52:27.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4bbcf9c640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb8106820 0x7f4bb8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:27.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4bbd79d640 1 -- 172.21.15.118:0/1796333999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb8106820 msgr2=0x7f4bb8198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:27.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4bbd79d640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb8106820 0x7f4bb8198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:27.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4bbd79d640 1 -- 172.21.15.118:0/1796333999 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb8199360 con 0x7f4bb8100820 2024-09-21T11:52:27.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4bbd79d640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8100820 0x7f4bb8198820 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4031460 tx=0x7f4bb40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:27.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4baa7fc640 1 -- 172.21.15.118:0/1796333999 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bb403f070 con 0x7f4bb8100820 2024-09-21T11:52:27.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb81995f0 con 0x7f4bb8100820 2024-09-21T11:52:27.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4baa7fc640 1 -- 172.21.15.118:0/1796333999 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bb40035f0 con 0x7f4bb8100820 2024-09-21T11:52:27.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4baa7fc640 1 -- 172.21.15.118:0/1796333999 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bb4035030 con 0x7f4bb8100820 2024-09-21T11:52:27.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.773+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb81a1ba0 con 0x7f4bb8100820 2024-09-21T11:52:27.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.774+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb8101f60 con 0x7f4bb8100820 2024-09-21T11:52:27.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.775+0000 7f4baa7fc640 1 -- 172.21.15.118:0/1796333999 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4bb4042070 con 0x7f4bb8100820 2024-09-21T11:52:27.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.775+0000 7f4baa7fc640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ba407af30 0x7f4ba407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:27.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.776+0000 7f4baa7fc640 1 -- 172.21.15.118:0/1796333999 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f4bb40bea20 con 0x7f4bb8100820 2024-09-21T11:52:27.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.776+0000 7f4bbcf9c640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ba407af30 0x7f4ba407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:27.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.776+0000 7f4bbcf9c640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ba407af30 0x7f4ba407d3f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bb806ae50 tx=0x7f4bac00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:27.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.780+0000 7f4baa7fc640 1 -- 172.21.15.118:0/1796333999 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4bb4089f70 con 0x7f4bb8100820 2024-09-21T11:52:27.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.987+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4bb8062630 con 0x7f4ba407af30 2024-09-21T11:52:27.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.988+0000 7f4baa7fc640 1 -- 172.21.15.118:0/1796333999 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4bb8062630 con 0x7f4ba407af30 2024-09-21T11:52:27.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ba407af30 msgr2=0x7f4ba407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:27.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ba407af30 0x7f4ba407d3f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bb806ae50 tx=0x7f4bac00b390 comp rx=0 tx=0).stop 2024-09-21T11:52:27.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8100820 msgr2=0x7f4bb8198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:27.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8100820 0x7f4bb8198820 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4031460 tx=0x7f4bb40045e0 comp rx=0 tx=0).stop 2024-09-21T11:52:27.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 shutdown_connections 2024-09-21T11:52:27.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb8106820 0x7f4bb8198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:27.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ba407af30 0x7f4ba407d3f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:27.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 --2- 172.21.15.118:0/1796333999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb8100820 0x7f4bb8198820 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:27.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 >> 172.21.15.118:0/1796333999 conn(0x7f4bb80fc520 msgr2=0x7f4bb80fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:27.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 shutdown_connections 2024-09-21T11:52:27.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:27.991+0000 7f4bbfa01640 1 -- 172.21.15.118:0/1796333999 wait complete. 2024-09-21T11:52:28.002 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:52:28.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.074+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3454339133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d78106920 msgr2=0x7f7d78106d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.074+0000 7f7d7c8bc640 1 --2- 172.21.15.118:0/3454339133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d78106920 0x7f7d78106d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009880 tx=0x7f7d6802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.074+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3454339133 shutdown_connections 2024-09-21T11:52:28.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.074+0000 7f7d7c8bc640 1 --2- 172.21.15.118:0/3454339133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d780ffe50 0x7f7d781002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.074+0000 7f7d7c8bc640 1 --2- 172.21.15.118:0/3454339133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d78106920 0x7f7d78106d00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.074+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3454339133 >> 172.21.15.118:0/3454339133 conn(0x7f7d780fbc60 msgr2=0x7f7d780fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:28.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.074+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3454339133 shutdown_connections 2024-09-21T11:52:28.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.074+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3454339133 wait complete. 2024-09-21T11:52:28.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d7c8bc640 1 Processor -- start 2024-09-21T11:52:28.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d7c8bc640 1 -- start start 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d7c8bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780ffe50 0x7f7d78101030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d7c8bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d78106920 0x7f7d78101570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d7c8bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7810eee0 con 0x7f7d780ffe50 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d7c8bc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7810ed60 con 0x7f7d78106920 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d7659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780ffe50 0x7f7d78101030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d7659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780ffe50 0x7f7d78101030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41856/0 (socket says 172.21.15.118:41856) 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d7659c640 1 -- 172.21.15.118:0/3634780388 learned_addr learned my addr 172.21.15.118:0/3634780388 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.075+0000 7f7d6dd9b640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d78106920 0x7f7d78101570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.076+0000 7f7d7659c640 1 -- 172.21.15.118:0/3634780388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d78106920 msgr2=0x7f7d78101570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.076+0000 7f7d7659c640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d78106920 0x7f7d78101570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.076+0000 7f7d7659c640 1 -- 172.21.15.118:0/3634780388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d78101ab0 con 0x7f7d780ffe50 2024-09-21T11:52:28.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.076+0000 7f7d7659c640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780ffe50 0x7f7d78101030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7d68031460 tx=0x7f7d680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:28.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.076+0000 7f7d6ffff640 1 -- 172.21.15.118:0/3634780388 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d6803f070 con 0x7f7d780ffe50 2024-09-21T11:52:28.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.076+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d78101d40 con 0x7f7d780ffe50 2024-09-21T11:52:28.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.076+0000 7f7d6ffff640 1 -- 172.21.15.118:0/3634780388 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d68004cf0 con 0x7f7d780ffe50 2024-09-21T11:52:28.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.076+0000 7f7d6ffff640 1 -- 172.21.15.118:0/3634780388 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d68035030 con 0x7f7d780ffe50 2024-09-21T11:52:28.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.076+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d781a3de0 con 0x7f7d780ffe50 2024-09-21T11:52:28.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.077+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d781002b0 con 0x7f7d780ffe50 2024-09-21T11:52:28.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.078+0000 7f7d6ffff640 1 -- 172.21.15.118:0/3634780388 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7d68042070 con 0x7f7d780ffe50 2024-09-21T11:52:28.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.079+0000 7f7d6ffff640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d6407af80 0x7f7d6407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:28.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.079+0000 7f7d6dd9b640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d6407af80 0x7f7d6407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:28.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.079+0000 7f7d6ffff640 1 -- 172.21.15.118:0/3634780388 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f7d680be9e0 con 0x7f7d780ffe50 2024-09-21T11:52:28.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.079+0000 7f7d6dd9b640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d6407af80 0x7f7d6407d440 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7d78102ac0 tx=0x7f7d6000a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.083+0000 7f7d6ffff640 1 -- 172.21.15.118:0/3634780388 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d68089fb0 con 0x7f7d780ffe50 2024-09-21T11:52:28.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.279+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7d78103100 con 0x7f7d6407af80 2024-09-21T11:52:28.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.280+0000 7f7d6ffff640 1 -- 172.21.15.118:0/3634780388 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f7d78103100 con 0x7f7d6407af80 2024-09-21T11:52:28.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d6407af80 msgr2=0x7f7d6407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d6407af80 0x7f7d6407d440 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7d78102ac0 tx=0x7f7d6000a2d0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780ffe50 msgr2=0x7f7d78101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780ffe50 0x7f7d78101030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7d68031460 tx=0x7f7d680048f0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 shutdown_connections 2024-09-21T11:52:28.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d78106920 0x7f7d78101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d6407af80 0x7f7d6407d440 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 --2- 172.21.15.118:0/3634780388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780ffe50 0x7f7d78101030 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 >> 172.21.15.118:0/3634780388 conn(0x7f7d780fbc60 msgr2=0x7f7d780fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:28.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 shutdown_connections 2024-09-21T11:52:28.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.282+0000 7f7d7c8bc640 1 -- 172.21.15.118:0/3634780388 wait complete. 2024-09-21T11:52:28.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.364+0000 7fea5a4f1640 1 -- 172.21.15.118:0/1848030605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 msgr2=0x7fea54106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.364+0000 7fea5a4f1640 1 --2- 172.21.15.118:0/1848030605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 0x7fea54106c00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea44009880 tx=0x7fea4402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.364+0000 7fea5a4f1640 1 -- 172.21.15.118:0/1848030605 shutdown_connections 2024-09-21T11:52:28.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.364+0000 7fea5a4f1640 1 --2- 172.21.15.118:0/1848030605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea54100820 0x7fea54100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.364+0000 7fea5a4f1640 1 --2- 172.21.15.118:0/1848030605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 0x7fea54106c00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.364+0000 7fea5a4f1640 1 -- 172.21.15.118:0/1848030605 >> 172.21.15.118:0/1848030605 conn(0x7fea540fc520 msgr2=0x7fea540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:28.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.364+0000 7fea5a4f1640 1 -- 172.21.15.118:0/1848030605 shutdown_connections 2024-09-21T11:52:28.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.364+0000 7fea5a4f1640 1 -- 172.21.15.118:0/1848030605 wait complete. 2024-09-21T11:52:28.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.365+0000 7fea5a4f1640 1 Processor -- start 2024-09-21T11:52:28.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.365+0000 7fea5a4f1640 1 -- start start 2024-09-21T11:52:28.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.365+0000 7fea5a4f1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea54100820 0x7fea5419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:28.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.365+0000 7fea5a4f1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 0x7fea5419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:28.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.365+0000 7fea5a4f1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fea5410dd50 con 0x7fea54106820 2024-09-21T11:52:28.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.365+0000 7fea5a4f1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea5410dbd0 con 0x7fea54100820 2024-09-21T11:52:28.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea537fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 0x7fea5419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:28.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea537fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 0x7fea5419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41884/0 (socket says 172.21.15.118:41884) 2024-09-21T11:52:28.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea537fe640 1 -- 172.21.15.118:0/2445624543 learned_addr learned my addr 172.21.15.118:0/2445624543 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:52:28.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea53fff640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea54100820 0x7fea5419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:28.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea537fe640 1 -- 172.21.15.118:0/2445624543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea54100820 msgr2=0x7fea5419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea537fe640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea54100820 0x7fea5419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea537fe640 1 -- 172.21.15.118:0/2445624543 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea54197840 con 0x7fea54106820 2024-09-21T11:52:28.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea537fe640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 0x7fea5419dc00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fea4800b420 tx=0x7fea4800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:28.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea517fa640 1 -- 172.21.15.118:0/2445624543 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea48011630 con 0x7fea54106820 2024-09-21T11:52:28.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea54197b30 con 0x7fea54106820 2024-09-21T11:52:28.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea517fa640 1 -- 172.21.15.118:0/2445624543 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea48016070 con 0x7fea54106820 2024-09-21T11:52:28.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.366+0000 7fea517fa640 1 -- 172.21.15.118:0/2445624543 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea48010d40 con 0x7fea54106820 2024-09-21T11:52:28.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.367+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea541980c0 con 0x7fea54106820 2024-09-21T11:52:28.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.368+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea54101f60 con 0x7fea54106820 2024-09-21T11:52:28.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.368+0000 7fea517fa640 1 -- 172.21.15.118:0/2445624543 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fea4801b460 con 0x7fea54106820 2024-09-21T11:52:28.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.369+0000 7fea517fa640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea3c07af30 0x7fea3c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:28.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.369+0000 7fea517fa640 1 -- 172.21.15.118:0/2445624543 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fea4809d7f0 con 0x7fea54106820 2024-09-21T11:52:28.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.369+0000 7fea53fff640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea3c07af30 0x7fea3c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:28.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.369+0000 7fea53fff640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea3c07af30 0x7fea3c07d3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea440096c0 tx=0x7fea44031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:28.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.373+0000 7fea517fa640 1 -- 172.21.15.118:0/2445624543 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea48021250 con 0x7fea54106820 2024-09-21T11:52:28.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.560+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fea54198370 con 0x7fea3c07af30 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.569+0000 7fea517fa640 1 -- 172.21.15.118:0/2445624543 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fea54198370 con 0x7fea3c07af30 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (10m) 4m ago 21m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (13m) 4m ago 21m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (12m) 4m ago 20m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (8m) 4m ago 21m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (8m) 4m ago 20m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (9m) 4m ago 21m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (4m) 4m ago 16m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (4m) 4m ago 15m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (15m) 4m ago 15m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (4m) 4m ago 15m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:52:28.572 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (12m) 4m ago 22m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (11m) 4m ago 20m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (9m) 4m ago 22m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (8m) 4m ago 20m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (11m) 4m ago 21m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (11m) 4m ago 20m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (8m) 4m ago 19m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (7m) 4m ago 18m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (6m) 4m ago 18m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (6m) 4m ago 17m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (5m) 4m ago 17m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (5m) 4m ago 17m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:52:28.573 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (10m) 4m ago 20m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:52:28.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea3c07af30 msgr2=0x7fea3c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea3c07af30 0x7fea3c07d3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea440096c0 tx=0x7fea44031400 comp rx=0 tx=0).stop 2024-09-21T11:52:28.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 msgr2=0x7fea5419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 0x7fea5419dc00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fea4800b420 tx=0x7fea4800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 shutdown_connections 2024-09-21T11:52:28.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea3c07af30 0x7fea3c07d3f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea54106820 0x7fea5419dc00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 --2- 172.21.15.118:0/2445624543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea54100820 0x7fea5419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 >> 172.21.15.118:0/2445624543 conn(0x7fea540fc520 msgr2=0x7fea5406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:28.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 shutdown_connections 2024-09-21T11:52:28.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.572+0000 7fea5a4f1640 1 -- 172.21.15.118:0/2445624543 wait complete. 2024-09-21T11:52:28.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.651+0000 7f6d2e053640 1 -- 172.21.15.118:0/1914083271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28100820 msgr2=0x7f6d28100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.651+0000 7f6d2e053640 1 --2- 172.21.15.118:0/1914083271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28100820 0x7f6d28100c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009880 tx=0x7f6d1802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.651+0000 7f6d2e053640 1 -- 172.21.15.118:0/1914083271 shutdown_connections 2024-09-21T11:52:28.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.651+0000 7f6d2e053640 1 --2- 172.21.15.118:0/1914083271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28100820 0x7f6d28100c80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.651+0000 7f6d2e053640 1 --2- 172.21.15.118:0/1914083271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d28106820 0x7f6d28106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.651+0000 7f6d2e053640 1 -- 172.21.15.118:0/1914083271 >> 172.21.15.118:0/1914083271 conn(0x7f6d280fc520 msgr2=0x7f6d280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:28.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.651+0000 7f6d2e053640 1 -- 172.21.15.118:0/1914083271 shutdown_connections 2024-09-21T11:52:28.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.651+0000 7f6d2e053640 1 -- 172.21.15.118:0/1914083271 wait complete. 2024-09-21T11:52:28.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d2e053640 1 Processor -- start 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d2e053640 1 -- start start 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d2e053640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d28100820 0x7f6d2819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d2e053640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28106820 0x7f6d2819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d2e053640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2810dcd0 con 0x7f6d28106820 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d2e053640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2810db50 con 0x7f6d28100820 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d26ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28106820 0x7f6d2819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d26ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28106820 0x7f6d2819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41906/0 (socket says 172.21.15.118:41906) 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d26ffd640 1 -- 172.21.15.118:0/3012577783 learned_addr learned my addr 172.21.15.118:0/3012577783 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.652+0000 7f6d277fe640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d28100820 0x7f6d2819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.653+0000 7f6d26ffd640 1 -- 172.21.15.118:0/3012577783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d28100820 msgr2=0x7f6d2819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.653+0000 7f6d26ffd640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d28100820 0x7f6d2819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.653+0000 7f6d26ffd640 1 -- 172.21.15.118:0/3012577783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d281977c0 con 0x7f6d28106820 2024-09-21T11:52:28.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.653+0000 7f6d26ffd640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28106820 0x7f6d2819db80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6d18031460 tx=0x7f6d180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:28.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.653+0000 7f6d24ff9640 1 -- 172.21.15.118:0/3012577783 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d1803f070 con 0x7f6d28106820 2024-09-21T11:52:28.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.653+0000 7f6d24ff9640 1 -- 172.21.15.118:0/3012577783 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d18004cf0 con 0x7f6d28106820 2024-09-21T11:52:28.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.653+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d28197a50 con 0x7f6d28106820 2024-09-21T11:52:28.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.653+0000 7f6d24ff9640 1 -- 172.21.15.118:0/3012577783 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d18035030 con 0x7f6d28106820 2024-09-21T11:52:28.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.653+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d28197f80 con 0x7f6d28106820 2024-09-21T11:52:28.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.654+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d28101f60 con 0x7f6d28106820 2024-09-21T11:52:28.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.655+0000 7f6d24ff9640 1 -- 172.21.15.118:0/3012577783 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6d18042070 con 0x7f6d28106820 2024-09-21T11:52:28.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.656+0000 7f6d24ff9640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d1407af30 0x7f6d1407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:28.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.656+0000 7f6d24ff9640 1 -- 172.21.15.118:0/3012577783 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f6d180beae0 con 0x7f6d28106820 2024-09-21T11:52:28.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.656+0000 7f6d277fe640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d1407af30 0x7f6d1407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:28.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.656+0000 7f6d277fe640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d1407af30 0x7f6d1407d3f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000abe0 tx=0x7f6d1000a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:28.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.660+0000 7f6d24ff9640 1 -- 172.21.15.118:0/3012577783 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d18089fd0 con 0x7f6d28106820 2024-09-21T11:52:28.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.913+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6d28198cf0 con 0x7f6d28106820 2024-09-21T11:52:28.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.913+0000 7f6d24ff9640 1 -- 172.21.15.118:0/3012577783 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f6d1808ee80 con 0x7f6d28106820 2024-09-21T11:52:28.915 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:52:28.915 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:52:28.916 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:52:28.917 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:52:28.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.915+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d1407af30 msgr2=0x7f6d1407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.915+0000 7f6d2e053640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d1407af30 0x7f6d1407d3f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000abe0 tx=0x7f6d1000a2d0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.915+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28106820 msgr2=0x7f6d2819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.915+0000 7f6d2e053640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28106820 0x7f6d2819db80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6d18031460 tx=0x7f6d180048f0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.916+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 shutdown_connections 2024-09-21T11:52:28.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.916+0000 7f6d2e053640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d1407af30 0x7f6d1407d3f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.916+0000 7f6d2e053640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d28106820 0x7f6d2819db80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.916+0000 7f6d2e053640 1 --2- 172.21.15.118:0/3012577783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d28100820 0x7f6d2819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.916+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 >> 172.21.15.118:0/3012577783 conn(0x7f6d280fc520 msgr2=0x7f6d2806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:28.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.916+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 shutdown_connections 2024-09-21T11:52:28.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.916+0000 7f6d2e053640 1 -- 172.21.15.118:0/3012577783 wait complete. 2024-09-21T11:52:28.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 -- 172.21.15.118:0/1750262146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4106820 msgr2=0x7fabb4106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:28.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 --2- 172.21.15.118:0/1750262146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4106820 0x7fabb4106c00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faba4009880 tx=0x7faba402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 -- 172.21.15.118:0/1750262146 shutdown_connections 2024-09-21T11:52:28.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 --2- 172.21.15.118:0/1750262146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb4100820 0x7fabb4100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 --2- 172.21.15.118:0/1750262146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4106820 0x7fabb4106c00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:28.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 -- 172.21.15.118:0/1750262146 >> 172.21.15.118:0/1750262146 conn(0x7fabb40fc520 msgr2=0x7fabb40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:28.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 -- 172.21.15.118:0/1750262146 shutdown_connections 2024-09-21T11:52:28.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 -- 172.21.15.118:0/1750262146 wait complete. 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 Processor -- start 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.996+0000 7fabbbec7640 1 -- start start 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabbbec7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4100820 0x7fabb419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabbbec7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb4106820 0x7fabb419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabbbec7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fabb410dd50 con 0x7fabb4100820 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabbbec7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fabb410dbd0 con 0x7fabb4106820 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabb9c63640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4100820 0x7fabb419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabb9c63640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4100820 0x7fabb419f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41924/0 (socket says 172.21.15.118:41924) 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabb9c63640 1 -- 172.21.15.118:0/1745417723 learned_addr learned my addr 172.21.15.118:0/1745417723 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:52:29.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabb9462640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb4106820 0x7fabb419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:29.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabb9c63640 1 -- 172.21.15.118:0/1745417723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb4106820 msgr2=0x7fabb419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabb9c63640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb4106820 0x7fabb419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabb9c63640 1 -- 172.21.15.118:0/1745417723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb4199a40 con 0x7fabb4100820 2024-09-21T11:52:29.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabb9c63640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4100820 0x7fabb419f880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faba4031460 tx=0x7faba40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:29.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabaaffd640 1 -- 172.21.15.118:0/1745417723 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faba403f070 con 0x7fabb4100820 2024-09-21T11:52:29.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb4199cd0 con 0x7fabb4100820 2024-09-21T11:52:29.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabaaffd640 1 -- 172.21.15.118:0/1745417723 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faba4004cf0 con 0x7fabb4100820 2024-09-21T11:52:29.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.997+0000 7fabaaffd640 1 -- 172.21.15.118:0/1745417723 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faba4035030 con 0x7fabb4100820 2024-09-21T11:52:29.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.998+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb419a200 con 0x7fabb4100820 2024-09-21T11:52:29.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.999+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb4101f60 con 0x7fabb4100820 2024-09-21T11:52:29.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:28.999+0000 7fabaaffd640 1 -- 172.21.15.118:0/1745417723 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7faba4042070 con 0x7fabb4100820 2024-09-21T11:52:29.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.000+0000 7fabaaffd640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faba007af30 0x7faba007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:29.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.000+0000 7fabb9462640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faba007af30 0x7faba007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:29.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.000+0000 7fabaaffd640 1 -- 172.21.15.118:0/1745417723 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7faba40bebb0 con 0x7fabb4100820 2024-09-21T11:52:29.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.000+0000 7fabb9462640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faba007af30 0x7faba007d3f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabb40fea60 tx=0x7fabb0008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:29.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.004+0000 7fabaaffd640 1 -- 172.21.15.118:0/1745417723 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faba40c5080 con 0x7fabb4100820 2024-09-21T11:52:29.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.216+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fabb419b010 con 0x7fabb4100820 2024-09-21T11:52:29.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.217+0000 7fabaaffd640 1 -- 172.21.15.118:0/1745417723 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7faba408a100 con 0x7fabb4100820 2024-09-21T11:52:29.219 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:52:29.219 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:52:29.219 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:52:29.219 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:52:29.220 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:52:29.221 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:52:29.221 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:52:29.221 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:52:29.221 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:52:29.221 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:52:29.221 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:52:29.221 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:52:29.222 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:52:29.222 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:52:29.222 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:52:29.222 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:52:29.222 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:52:29.222 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:52:29.222 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:52:29.222 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:52:29.223 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:52:29.223 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:52:29.223 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:52:29.223 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:52:29.223 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:52:29.223 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:52:29.223 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:52:29.223 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:52:29.223 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:52:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:52:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faba007af30 msgr2=0x7faba007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faba007af30 0x7faba007d3f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabb40fea60 tx=0x7fabb0008040 comp rx=0 tx=0).stop 2024-09-21T11:52:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4100820 msgr2=0x7fabb419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4100820 0x7fabb419f880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faba4031460 tx=0x7faba40048f0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 shutdown_connections 2024-09-21T11:52:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb4106820 0x7fabb419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faba007af30 0x7faba007d3f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 --2- 172.21.15.118:0/1745417723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb4100820 0x7fabb419f880 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 >> 172.21.15.118:0/1745417723 conn(0x7fabb40fc520 msgr2=0x7fabb406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:29.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.219+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 shutdown_connections 2024-09-21T11:52:29.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.220+0000 7fabbbec7640 1 -- 172.21.15.118:0/1745417723 wait complete. 2024-09-21T11:52:29.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.303+0000 7f7445e95640 1 -- 172.21.15.118:0/2728268026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440101910 msgr2=0x7f7440101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.303+0000 7f7445e95640 1 --2- 172.21.15.118:0/2728268026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440101910 0x7f7440101d70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7428009880 tx=0x7f742802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.303+0000 7f7445e95640 1 -- 172.21.15.118:0/2728268026 shutdown_connections 2024-09-21T11:52:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.303+0000 7f7445e95640 1 --2- 172.21.15.118:0/2728268026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440101910 0x7f7440101d70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.303+0000 7f7445e95640 1 --2- 172.21.15.118:0/2728268026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7440107910 0x7f7440107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.303+0000 7f7445e95640 1 -- 172.21.15.118:0/2728268026 >> 172.21.15.118:0/2728268026 conn(0x7f74400fd5f0 msgr2=0x7f74400ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.304+0000 7f7445e95640 1 -- 172.21.15.118:0/2728268026 shutdown_connections 2024-09-21T11:52:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.304+0000 7f7445e95640 1 -- 172.21.15.118:0/2728268026 wait complete. 2024-09-21T11:52:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.304+0000 7f7445e95640 1 Processor -- start 2024-09-21T11:52:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.304+0000 7f7445e95640 1 -- start start 2024-09-21T11:52:29.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7445e95640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7440101910 0x7f744019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:29.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7445e95640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440107910 0x7f744019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:29.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7445e95640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f744010edc0 con 0x7f7440107910 2024-09-21T11:52:29.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7445e95640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f744010ec40 con 0x7f7440101910 2024-09-21T11:52:29.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7436ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440107910 0x7f744019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7436ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440107910 0x7f744019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41956/0 (socket says 172.21.15.118:41956) 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7436ffd640 1 -- 172.21.15.118:0/2714599872 learned_addr learned my addr 172.21.15.118:0/2714599872 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7436ffd640 1 -- 172.21.15.118:0/2714599872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7440101910 msgr2=0x7f744019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f743f7fe640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7440101910 0x7f744019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7436ffd640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7440101910 0x7f744019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7436ffd640 1 -- 172.21.15.118:0/2714599872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74401977b0 con 0x7f7440107910 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f743f7fe640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7440101910 0x7f744019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.305+0000 7f7436ffd640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440107910 0x7f744019db70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7428031460 tx=0x7f74280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.306+0000 7f743d7fa640 1 -- 172.21.15.118:0/2714599872 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f742803f070 con 0x7f7440107910 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.306+0000 7f743d7fa640 1 -- 172.21.15.118:0/2714599872 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7428004cf0 con 0x7f7440107910 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.306+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7440197a40 con 0x7f7440107910 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.306+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7440197f70 con 0x7f7440107910 2024-09-21T11:52:29.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.306+0000 7f743d7fa640 1 -- 172.21.15.118:0/2714599872 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7428035030 con 0x7f7440107910 2024-09-21T11:52:29.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.307+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7440103050 con 0x7f7440107910 2024-09-21T11:52:29.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.308+0000 7f743d7fa640 1 -- 172.21.15.118:0/2714599872 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7428042070 con 0x7f7440107910 2024-09-21T11:52:29.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.308+0000 7f743d7fa640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742c07af80 0x7f742c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:29.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.308+0000 7f743d7fa640 1 -- 172.21.15.118:0/2714599872 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f74280bea90 con 0x7f7440107910 2024-09-21T11:52:29.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.308+0000 7f743f7fe640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742c07af80 0x7f742c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:29.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.309+0000 7f743f7fe640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742c07af80 0x7f742c07d440 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f74300058c0 tx=0x7f7430005d30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.312+0000 7f743d7fa640 1 -- 172.21.15.118:0/2714599872 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f742808a060 con 0x7f7440107910 2024-09-21T11:52:29.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.506+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7440198220 con 0x7f742c07af80 2024-09-21T11:52:29.508 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:29 smithi118 ceph-mon[111738]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:52:29.508 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:29 smithi118 ceph-mon[111738]: pgmap v409: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:29.509 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:29 smithi118 ceph-mon[111738]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:52:29.509 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:29 smithi118 ceph-mon[111738]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:52:29.509 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:29 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3012577783' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:52:29.509 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:29 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1745417723' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:52:29.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.507+0000 7f743d7fa640 1 -- 172.21.15.118:0/2714599872 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f7440198220 con 0x7f742c07af80 2024-09-21T11:52:29.509 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:52:29.509 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:52:29.510 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:52:29.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742c07af80 msgr2=0x7f742c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742c07af80 0x7f742c07d440 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f74300058c0 tx=0x7f7430005d30 comp rx=0 tx=0).stop 2024-09-21T11:52:29.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440107910 msgr2=0x7f744019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440107910 0x7f744019db70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7428031460 tx=0x7f74280048f0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 shutdown_connections 2024-09-21T11:52:29.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742c07af80 0x7f742c07d440 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7440107910 0x7f744019db70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 --2- 172.21.15.118:0/2714599872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7440101910 0x7f744019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 >> 172.21.15.118:0/2714599872 conn(0x7f74400fd5f0 msgr2=0x7f74400fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:29.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 shutdown_connections 2024-09-21T11:52:29.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.509+0000 7f7445e95640 1 -- 172.21.15.118:0/2714599872 wait complete. 2024-09-21T11:52:29.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.590+0000 7fbb423dc640 1 -- 172.21.15.118:0/1844177901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c100820 msgr2=0x7fbb3c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.590+0000 7fbb423dc640 1 --2- 172.21.15.118:0/1844177901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c100820 0x7fbb3c100c80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009880 tx=0x7fbb3002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.590+0000 7fbb423dc640 1 -- 172.21.15.118:0/1844177901 shutdown_connections 2024-09-21T11:52:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.590+0000 7fbb423dc640 1 --2- 172.21.15.118:0/1844177901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c100820 0x7fbb3c100c80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.590+0000 7fbb423dc640 1 --2- 172.21.15.118:0/1844177901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c106820 0x7fbb3c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.590+0000 7fbb423dc640 1 -- 172.21.15.118:0/1844177901 >> 172.21.15.118:0/1844177901 conn(0x7fbb3c0fc520 msgr2=0x7fbb3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.590+0000 7fbb423dc640 1 -- 172.21.15.118:0/1844177901 shutdown_connections 2024-09-21T11:52:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.590+0000 7fbb423dc640 1 -- 172.21.15.118:0/1844177901 wait complete. 2024-09-21T11:52:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.591+0000 7fbb423dc640 1 Processor -- start 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.591+0000 7fbb423dc640 1 -- start start 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.591+0000 7fbb423dc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c100820 0x7fbb3c19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.591+0000 7fbb423dc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c106820 0x7fbb3c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.591+0000 7fbb423dc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c10dd50 con 0x7fbb3c106820 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.591+0000 7fbb423dc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c10dbd0 con 0x7fbb3c100820 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.591+0000 7fbb3b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c106820 0x7fbb3c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.591+0000 7fbb3b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c106820 0x7fbb3c19cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41966/0 (socket says 172.21.15.118:41966) 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.591+0000 7fbb3b7fe640 1 -- 172.21.15.118:0/611325324 learned_addr learned my addr 172.21.15.118:0/611325324 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb3bfff640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c100820 0x7fbb3c19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb3b7fe640 1 -- 172.21.15.118:0/611325324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c100820 msgr2=0x7fbb3c19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb3b7fe640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c100820 0x7fbb3c19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb3b7fe640 1 -- 172.21.15.118:0/611325324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c196730 con 0x7fbb3c106820 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb3b7fe640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c106820 0x7fbb3c19cba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbb30031460 tx=0x7fbb300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb397fa640 1 -- 172.21.15.118:0/611325324 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb3003f070 con 0x7fbb3c106820 2024-09-21T11:52:29.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3c1969c0 con 0x7fbb3c106820 2024-09-21T11:52:29.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb397fa640 1 -- 172.21.15.118:0/611325324 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb30004cf0 con 0x7fbb3c106820 2024-09-21T11:52:29.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb397fa640 1 -- 172.21.15.118:0/611325324 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb30035030 con 0x7fbb3c106820 2024-09-21T11:52:29.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.592+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3c196ec0 con 0x7fbb3c106820 2024-09-21T11:52:29.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.593+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3c101f60 con 0x7fbb3c106820 2024-09-21T11:52:29.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.594+0000 7fbb397fa640 1 -- 172.21.15.118:0/611325324 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbb30042070 con 0x7fbb3c106820 2024-09-21T11:52:29.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.594+0000 7fbb397fa640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb2407d140 0x7fbb2407f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:29.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.594+0000 7fbb397fa640 1 -- 172.21.15.118:0/611325324 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fbb300bebb0 con 0x7fbb3c106820 2024-09-21T11:52:29.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.594+0000 7fbb3bfff640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb2407d140 0x7fbb2407f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:29.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.595+0000 7fbb3bfff640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb2407d140 0x7fbb2407f600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009890 tx=0x7fbb2c008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:29.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.599+0000 7fbb397fa640 1 -- 172.21.15.118:0/611325324 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb300c5080 con 0x7fbb3c106820 2024-09-21T11:52:29.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:29 smithi149 ceph-mon[79770]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:52:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:29 smithi149 ceph-mon[79770]: pgmap v409: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:29 smithi149 ceph-mon[79770]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:52:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:29 smithi149 ceph-mon[79770]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:52:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:29 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3012577783' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:52:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:29 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1745417723' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:52:29.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.864+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fbb3c197c60 con 0x7fbb3c106820 2024-09-21T11:52:29.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.864+0000 7fbb397fa640 1 -- 172.21.15.118:0/611325324 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fbb3008a100 con 0x7fbb3c106820 2024-09-21T11:52:29.867 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:52:29.867 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:52:29.867 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:52:29.867 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:52:29.867 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:52:29.867 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:52:29.867 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:52:29.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb2407d140 msgr2=0x7fbb2407f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb2407d140 0x7fbb2407f600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009890 tx=0x7fbb2c008040 comp rx=0 tx=0).stop 2024-09-21T11:52:29.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c106820 msgr2=0x7fbb3c19cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:29.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c106820 0x7fbb3c19cba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbb30031460 tx=0x7fbb300048f0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 shutdown_connections 2024-09-21T11:52:29.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb2407d140 0x7fbb2407f600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb3c106820 0x7fbb3c19cba0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 --2- 172.21.15.118:0/611325324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c100820 0x7fbb3c19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:29.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 >> 172.21.15.118:0/611325324 conn(0x7fbb3c0fc520 msgr2=0x7fbb3c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:29.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 shutdown_connections 2024-09-21T11:52:29.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:29.867+0000 7fbb423dc640 1 -- 172.21.15.118:0/611325324 wait complete. 2024-09-21T11:52:30.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:30 smithi149 ceph-mon[79770]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:52:30.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:30 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/611325324' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:52:30.767 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:30 smithi118 ceph-mon[111738]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:52:30.767 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:30 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/611325324' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:52:31.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:31 smithi118 ceph-mon[111738]: pgmap v410: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:31.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:31 smithi149 ceph-mon[79770]: pgmap v410: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:33 smithi149 ceph-mon[79770]: pgmap v411: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:33 smithi118 ceph-mon[111738]: pgmap v411: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:35 smithi149 ceph-mon[79770]: pgmap v412: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:52:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:35 smithi118 ceph-mon[111738]: pgmap v412: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:52:37.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:37 smithi149 ceph-mon[79770]: pgmap v413: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:37 smithi118 ceph-mon[111738]: pgmap v413: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:39.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:39 smithi149 ceph-mon[79770]: pgmap v414: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:39 smithi118 ceph-mon[111738]: pgmap v414: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:41.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:41 smithi118 ceph-mon[111738]: pgmap v415: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:41.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:41 smithi149 ceph-mon[79770]: pgmap v415: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:43.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:43 smithi149 ceph-mon[79770]: pgmap v416: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:43 smithi118 ceph-mon[111738]: pgmap v416: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:45.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:45 smithi149 ceph-mon[79770]: pgmap v417: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:45 smithi118 ceph-mon[111738]: pgmap v417: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:47.649 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:47 smithi149 ceph-mon[79770]: pgmap v418: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:47 smithi118 ceph-mon[111738]: pgmap v418: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:49.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:49 smithi149 ceph-mon[79770]: pgmap v419: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:49 smithi118 ceph-mon[111738]: pgmap v419: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:52:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:52:51.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:51 smithi149 ceph-mon[79770]: pgmap v420: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:51.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:51 smithi118 ceph-mon[111738]: pgmap v420: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:53.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:53 smithi149 ceph-mon[79770]: pgmap v421: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:53 smithi118 ceph-mon[111738]: pgmap v421: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:55.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:55 smithi149 ceph-mon[79770]: pgmap v422: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:55 smithi118 ceph-mon[111738]: pgmap v422: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:57.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:57 smithi149 ceph-mon[79770]: pgmap v423: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:57 smithi118 ceph-mon[111738]: pgmap v423: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:59.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:52:59 smithi149 ceph-mon[79770]: pgmap v424: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:52:59 smithi118 ceph-mon[111738]: pgmap v424: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:52:59.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.958+0000 7f3621aa2640 1 -- 172.21.15.118:0/1072757095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c100670 msgr2=0x7f361c100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:59.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.958+0000 7f3621aa2640 1 --2- 172.21.15.118:0/1072757095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c100670 0x7f361c100a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f360c009880 tx=0x7f360c02a490 comp rx=0 tx=0).stop 2024-09-21T11:52:59.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.959+0000 7f3621aa2640 1 -- 172.21.15.118:0/1072757095 shutdown_connections 2024-09-21T11:52:59.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.959+0000 7f3621aa2640 1 --2- 172.21.15.118:0/1072757095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361c101020 0x7f361c10dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:59.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.959+0000 7f3621aa2640 1 --2- 172.21.15.118:0/1072757095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c100670 0x7f361c100a50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:59.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.959+0000 7f3621aa2640 1 -- 172.21.15.118:0/1072757095 >> 172.21.15.118:0/1072757095 conn(0x7f361c0fc520 msgr2=0x7f361c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:52:59.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.959+0000 7f3621aa2640 1 -- 172.21.15.118:0/1072757095 shutdown_connections 2024-09-21T11:52:59.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.959+0000 7f3621aa2640 1 -- 172.21.15.118:0/1072757095 wait complete. 2024-09-21T11:52:59.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.959+0000 7f3621aa2640 1 Processor -- start 2024-09-21T11:52:59.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.959+0000 7f3621aa2640 1 -- start start 2024-09-21T11:52:59.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f3621aa2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361c100670 0x7f361c19f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:59.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f3621aa2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c101020 0x7f361c19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:59.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f3621aa2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f361c111010 con 0x7f361c101020 2024-09-21T11:52:59.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f3621aa2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f361c110e90 con 0x7f361c100670 2024-09-21T11:52:59.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f361affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c101020 0x7f361c19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f361affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c101020 0x7f361c19fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47650/0 (socket says 172.21.15.118:47650) 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f361affd640 1 -- 172.21.15.118:0/4065771148 learned_addr learned my addr 172.21.15.118:0/4065771148 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f361b7fe640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361c100670 0x7f361c19f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f361affd640 1 -- 172.21.15.118:0/4065771148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361c100670 msgr2=0x7f361c19f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f361affd640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361c100670 0x7f361c19f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.960+0000 7f361affd640 1 -- 172.21.15.118:0/4065771148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361c199aa0 con 0x7f361c101020 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.961+0000 7f361affd640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c101020 0x7f361c19fe20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f361000b420 tx=0x7f361000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.961+0000 7f3618ff9640 1 -- 172.21.15.118:0/4065771148 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3610011630 con 0x7f361c101020 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.961+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361c199d90 con 0x7f361c101020 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.961+0000 7f3618ff9640 1 -- 172.21.15.118:0/4065771148 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3610016070 con 0x7f361c101020 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.961+0000 7f3618ff9640 1 -- 172.21.15.118:0/4065771148 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3610010d40 con 0x7f361c101020 2024-09-21T11:52:59.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.961+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361c19a320 con 0x7f361c101020 2024-09-21T11:52:59.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.962+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f361c06abe0 con 0x7f361c101020 2024-09-21T11:52:59.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.962+0000 7f3618ff9640 1 -- 172.21.15.118:0/4065771148 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f361001b460 con 0x7f361c101020 2024-09-21T11:52:59.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.963+0000 7f3618ff9640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f360407af30 0x7f360407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:52:59.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.963+0000 7f3618ff9640 1 -- 172.21.15.118:0/4065771148 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f361009d770 con 0x7f361c101020 2024-09-21T11:52:59.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.963+0000 7f361b7fe640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f360407af30 0x7f360407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:52:59.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.964+0000 7f361b7fe640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f360407af30 0x7f360407d3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f360c000c00 tx=0x7f360c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:52:59.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:52:59.968+0000 7f3618ff9640 1 -- 172.21.15.118:0/4065771148 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3610068cc0 con 0x7f361c101020 2024-09-21T11:53:00.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.162+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f361c19afd0 con 0x7f360407af30 2024-09-21T11:53:00.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.163+0000 7f3618ff9640 1 -- 172.21.15.118:0/4065771148 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f361c19afd0 con 0x7f360407af30 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.165+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f360407af30 msgr2=0x7f360407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.165+0000 7f3621aa2640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f360407af30 0x7f360407d3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f360c000c00 tx=0x7f360c031400 comp rx=0 tx=0).stop 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.165+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c101020 msgr2=0x7f361c19fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.165+0000 7f3621aa2640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c101020 0x7f361c19fe20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f361000b420 tx=0x7f361000b8e0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.165+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 shutdown_connections 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.165+0000 7f3621aa2640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f360407af30 0x7f360407d3f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.165+0000 7f3621aa2640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f361c101020 0x7f361c19fe20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.165+0000 7f3621aa2640 1 --2- 172.21.15.118:0/4065771148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361c100670 0x7f361c19f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.165+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 >> 172.21.15.118:0/4065771148 conn(0x7f361c0fc520 msgr2=0x7f361c0fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.166+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 shutdown_connections 2024-09-21T11:53:00.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.166+0000 7f3621aa2640 1 -- 172.21.15.118:0/4065771148 wait complete. 2024-09-21T11:53:00.176 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:53:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.249+0000 7f116f202640 1 -- 172.21.15.118:0/2569482535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 msgr2=0x7f1168101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.249+0000 7f116f202640 1 --2- 172.21.15.118:0/2569482535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f1168101d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1154009880 tx=0x7f115402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.249+0000 7f116f202640 1 -- 172.21.15.118:0/2569482535 shutdown_connections 2024-09-21T11:53:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.249+0000 7f116f202640 1 --2- 172.21.15.118:0/2569482535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f1168101d90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.249+0000 7f116f202640 1 --2- 172.21.15.118:0/2569482535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168107930 0x7f1168107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.249+0000 7f116f202640 1 -- 172.21.15.118:0/2569482535 >> 172.21.15.118:0/2569482535 conn(0x7f11680fd630 msgr2=0x7f11680ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.249+0000 7f116f202640 1 -- 172.21.15.118:0/2569482535 shutdown_connections 2024-09-21T11:53:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.249+0000 7f116f202640 1 -- 172.21.15.118:0/2569482535 wait complete. 2024-09-21T11:53:00.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f116f202640 1 Processor -- start 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f116f202640 1 -- start start 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f116f202640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168101930 0x7f116819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f116f202640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168107930 0x7f116819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f116f202640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f116810ede0 con 0x7f1168107930 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f116f202640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f116810ec60 con 0x7f1168101930 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f1167fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168107930 0x7f116819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f1167fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168107930 0x7f116819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47672/0 (socket says 172.21.15.118:47672) 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f1167fff640 1 -- 172.21.15.118:0/3577539987 learned_addr learned my addr 172.21.15.118:0/3577539987 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.250+0000 7f116cf9e640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168101930 0x7f116819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.251+0000 7f1167fff640 1 -- 172.21.15.118:0/3577539987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168101930 msgr2=0x7f116819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.251+0000 7f1167fff640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168101930 0x7f116819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.251+0000 7f1167fff640 1 -- 172.21.15.118:0/3577539987 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1168197850 con 0x7f1168107930 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.251+0000 7f1167fff640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168107930 0x7f116819dc10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1154031460 tx=0x7f11540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:00.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.251+0000 7f1165ffb640 1 -- 172.21.15.118:0/3577539987 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f115403f070 con 0x7f1168107930 2024-09-21T11:53:00.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.251+0000 7f1165ffb640 1 -- 172.21.15.118:0/3577539987 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1154004cf0 con 0x7f1168107930 2024-09-21T11:53:00.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.251+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1168197ae0 con 0x7f1168107930 2024-09-21T11:53:00.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.251+0000 7f1165ffb640 1 -- 172.21.15.118:0/3577539987 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1154035030 con 0x7f1168107930 2024-09-21T11:53:00.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.251+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1168198010 con 0x7f1168107930 2024-09-21T11:53:00.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.252+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1168103070 con 0x7f1168107930 2024-09-21T11:53:00.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.253+0000 7f1165ffb640 1 -- 172.21.15.118:0/3577539987 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1154042070 con 0x7f1168107930 2024-09-21T11:53:00.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.253+0000 7f1165ffb640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115807af30 0x7f115807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:00.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.254+0000 7f1165ffb640 1 -- 172.21.15.118:0/3577539987 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f11540beb20 con 0x7f1168107930 2024-09-21T11:53:00.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.254+0000 7f116cf9e640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115807af30 0x7f115807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:00.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.254+0000 7f116cf9e640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115807af30 0x7f115807d3f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f115c0058c0 tx=0x7f115c00a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:00.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.259+0000 7f1165ffb640 1 -- 172.21.15.118:0/3577539987 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f115408a010 con 0x7f1168107930 2024-09-21T11:53:00.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.453+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1168198380 con 0x7f115807af30 2024-09-21T11:53:00.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.454+0000 7f1165ffb640 1 -- 172.21.15.118:0/3577539987 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1168198380 con 0x7f115807af30 2024-09-21T11:53:00.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.456+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115807af30 msgr2=0x7f115807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.456+0000 7f116f202640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115807af30 0x7f115807d3f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f115c0058c0 tx=0x7f115c00a2d0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.457+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168107930 msgr2=0x7f116819dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.457+0000 7f116f202640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168107930 0x7f116819dc10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1154031460 tx=0x7f11540048f0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.457+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 shutdown_connections 2024-09-21T11:53:00.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.457+0000 7f116f202640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115807af30 0x7f115807d3f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.457+0000 7f116f202640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168107930 0x7f116819dc10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.457+0000 7f116f202640 1 --2- 172.21.15.118:0/3577539987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168101930 0x7f116819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.457+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 >> 172.21.15.118:0/3577539987 conn(0x7f11680fd630 msgr2=0x7f11680fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:00.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.457+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 shutdown_connections 2024-09-21T11:53:00.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.457+0000 7f116f202640 1 -- 172.21.15.118:0/3577539987 wait complete. 2024-09-21T11:53:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.537+0000 7f1eab357640 1 -- 172.21.15.118:0/2086555787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41007e0 msgr2=0x7f1ea4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.537+0000 7f1eab357640 1 --2- 172.21.15.118:0/2086555787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41007e0 0x7f1ea4100c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009880 tx=0x7f1ea002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.537+0000 7f1eab357640 1 -- 172.21.15.118:0/2086555787 shutdown_connections 2024-09-21T11:53:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.538+0000 7f1eab357640 1 --2- 172.21.15.118:0/2086555787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41007e0 0x7f1ea4100c40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.538+0000 7f1eab357640 1 --2- 172.21.15.118:0/2086555787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea41067e0 0x7f1ea4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.538+0000 7f1eab357640 1 -- 172.21.15.118:0/2086555787 >> 172.21.15.118:0/2086555787 conn(0x7f1ea40fc4c0 msgr2=0x7f1ea40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.538+0000 7f1eab357640 1 -- 172.21.15.118:0/2086555787 shutdown_connections 2024-09-21T11:53:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.538+0000 7f1eab357640 1 -- 172.21.15.118:0/2086555787 wait complete. 2024-09-21T11:53:00.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.538+0000 7f1eab357640 1 Processor -- start 2024-09-21T11:53:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.538+0000 7f1eab357640 1 -- start start 2024-09-21T11:53:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.538+0000 7f1eab357640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea41007e0 0x7f1ea40fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.538+0000 7f1eab357640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41067e0 0x7f1ea40fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1eab357640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea410dd10 con 0x7f1ea41067e0 2024-09-21T11:53:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1eab357640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea410db90 con 0x7f1ea41007e0 2024-09-21T11:53:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1ea88f2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41067e0 0x7f1ea40fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1ea88f2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41067e0 0x7f1ea40fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47678/0 (socket says 172.21.15.118:47678) 2024-09-21T11:53:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1ea88f2640 1 -- 172.21.15.118:0/864120755 learned_addr learned my addr 172.21.15.118:0/864120755 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1ea90f3640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea41007e0 0x7f1ea40fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:00.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1ea88f2640 1 -- 172.21.15.118:0/864120755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea41007e0 msgr2=0x7f1ea40fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1ea88f2640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea41007e0 0x7f1ea40fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1ea88f2640 1 -- 172.21.15.118:0/864120755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea40fd6c0 con 0x7f1ea41067e0 2024-09-21T11:53:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1ea90f3640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea41007e0 0x7f1ea40fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:53:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1ea88f2640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41067e0 0x7f1ea40fd180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0031460 tx=0x7f1ea00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1e9a7fc640 1 -- 172.21.15.118:0/864120755 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ea003f070 con 0x7f1ea41067e0 2024-09-21T11:53:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1e9a7fc640 1 -- 172.21.15.118:0/864120755 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ea00044d0 con 0x7f1ea41067e0 2024-09-21T11:53:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea40fd950 con 0x7f1ea41067e0 2024-09-21T11:53:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea41a3de0 con 0x7f1ea41067e0 2024-09-21T11:53:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.539+0000 7f1e9a7fc640 1 -- 172.21.15.118:0/864120755 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ea0035030 con 0x7f1ea41067e0 2024-09-21T11:53:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.541+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea4101f20 con 0x7f1ea41067e0 2024-09-21T11:53:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.541+0000 7f1e9a7fc640 1 -- 172.21.15.118:0/864120755 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1ea0042070 con 0x7f1ea41067e0 2024-09-21T11:53:00.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.542+0000 7f1e9a7fc640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e9007af40 0x7f1e9007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:00.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.542+0000 7f1e9a7fc640 1 -- 172.21.15.118:0/864120755 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f1ea00bed10 con 0x7f1ea41067e0 2024-09-21T11:53:00.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.542+0000 7f1ea90f3640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e9007af40 0x7f1e9007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:00.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.542+0000 7f1ea90f3640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e9007af40 0x7f1e9007d400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009930 tx=0x7f1e94008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:00.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.546+0000 7f1e9a7fc640 1 -- 172.21.15.118:0/864120755 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ea0004cf0 con 0x7f1ea41067e0 2024-09-21T11:53:00.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.730+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1ea4062630 con 0x7f1e9007af40 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.739+0000 7f1e9a7fc640 1 -- 172.21.15.118:0/864120755 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1ea4062630 con 0x7f1e9007af40 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (10m) 5m ago 21m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (14m) 5m ago 22m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (13m) 4m ago 21m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (9m) 5m ago 22m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (9m) 4m ago 21m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (10m) 5m ago 21m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (5m) 5m ago 16m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:53:00.741 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (5m) 5m ago 16m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (16m) 4m ago 16m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (4m) 4m ago 16m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (13m) 5m ago 23m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (12m) 4m ago 21m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (9m) 5m ago 23m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (9m) 4m ago 20m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (11m) 5m ago 21m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (11m) 4m ago 21m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (8m) 5m ago 19m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (8m) 5m ago 19m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (7m) 5m ago 18m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:53:00.742 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (6m) 4m ago 18m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:53:00.743 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (6m) 4m ago 18m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:53:00.743 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (5m) 4m ago 17m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:53:00.743 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (11m) 5m ago 21m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:53:00.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.741+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e9007af40 msgr2=0x7f1e9007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.741+0000 7f1eab357640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e9007af40 0x7f1e9007d400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009930 tx=0x7f1e94008040 comp rx=0 tx=0).stop 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.741+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41067e0 msgr2=0x7f1ea40fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.741+0000 7f1eab357640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41067e0 0x7f1ea40fd180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0031460 tx=0x7f1ea00048f0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.741+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 shutdown_connections 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.741+0000 7f1eab357640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1e9007af40 0x7f1e9007d400 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.741+0000 7f1eab357640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea41067e0 0x7f1ea40fd180 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.741+0000 7f1eab357640 1 --2- 172.21.15.118:0/864120755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ea41007e0 0x7f1ea40fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.741+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 >> 172.21.15.118:0/864120755 conn(0x7f1ea40fc4c0 msgr2=0x7f1ea4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.742+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 shutdown_connections 2024-09-21T11:53:00.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.742+0000 7f1eab357640 1 -- 172.21.15.118:0/864120755 wait complete. 2024-09-21T11:53:00.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.821+0000 7fe0cce9f640 1 -- 172.21.15.118:0/635884236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 msgr2=0x7fe0c8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.821+0000 7fe0cce9f640 1 --2- 172.21.15.118:0/635884236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 0x7fe0c8106c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009c20 tx=0x7fe0c002a970 comp rx=0 tx=0).stop 2024-09-21T11:53:00.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.821+0000 7fe0cce9f640 1 -- 172.21.15.118:0/635884236 shutdown_connections 2024-09-21T11:53:00.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.821+0000 7fe0cce9f640 1 --2- 172.21.15.118:0/635884236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100820 0x7fe0c8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.821+0000 7fe0cce9f640 1 --2- 172.21.15.118:0/635884236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 0x7fe0c8106c00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.821+0000 7fe0cce9f640 1 -- 172.21.15.118:0/635884236 >> 172.21.15.118:0/635884236 conn(0x7fe0c80fc520 msgr2=0x7fe0c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:00.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.821+0000 7fe0cce9f640 1 -- 172.21.15.118:0/635884236 shutdown_connections 2024-09-21T11:53:00.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.821+0000 7fe0cce9f640 1 -- 172.21.15.118:0/635884236 wait complete. 2024-09-21T11:53:00.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0cce9f640 1 Processor -- start 2024-09-21T11:53:00.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0cce9f640 1 -- start start 2024-09-21T11:53:00.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0cce9f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100820 0x7fe0c819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:00.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0cce9f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 0x7fe0c819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:00.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0cce9f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c810dcf0 con 0x7fe0c8106820 2024-09-21T11:53:00.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0cce9f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c810db70 con 0x7fe0c8100820 2024-09-21T11:53:00.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0c5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 0x7fe0c819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:00.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0c5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 0x7fe0c819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47700/0 (socket says 172.21.15.118:47700) 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0c5d9b640 1 -- 172.21.15.118:0/3748158891 learned_addr learned my addr 172.21.15.118:0/3748158891 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0c659c640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100820 0x7fe0c819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0c5d9b640 1 -- 172.21.15.118:0/3748158891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100820 msgr2=0x7fe0c819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0c5d9b640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100820 0x7fe0c819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.822+0000 7fe0c5d9b640 1 -- 172.21.15.118:0/3748158891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c8197810 con 0x7fe0c8106820 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.823+0000 7fe0c5d9b640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 0x7fe0c819dbd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000d6f0 tx=0x7fe0b000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.823+0000 7fe0bf7fe640 1 -- 172.21.15.118:0/3748158891 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0b0017070 con 0x7fe0c8106820 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.823+0000 7fe0bf7fe640 1 -- 172.21.15.118:0/3748158891 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0b000de00 con 0x7fe0c8106820 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.823+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c8197b00 con 0x7fe0c8106820 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.823+0000 7fe0bf7fe640 1 -- 172.21.15.118:0/3748158891 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0b0004bb0 con 0x7fe0c8106820 2024-09-21T11:53:00.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.823+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c8198090 con 0x7fe0c8106820 2024-09-21T11:53:00.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.824+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c8101f60 con 0x7fe0c8106820 2024-09-21T11:53:00.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.825+0000 7fe0bf7fe640 1 -- 172.21.15.118:0/3748158891 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe0b0009a30 con 0x7fe0c8106820 2024-09-21T11:53:00.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.825+0000 7fe0bf7fe640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0b407af80 0x7fe0b407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:00.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.825+0000 7fe0bf7fe640 1 -- 172.21.15.118:0/3748158891 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fe0b009dbd0 con 0x7fe0c8106820 2024-09-21T11:53:00.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.825+0000 7fe0c659c640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0b407af80 0x7fe0b407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:00.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.826+0000 7fe0c659c640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0b407af80 0x7fe0b407d440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009430 tx=0x7fe0c003c040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:00.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:00.830+0000 7fe0bf7fe640 1 -- 172.21.15.118:0/3748158891 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0b0069140 con 0x7fe0c8106820 2024-09-21T11:53:01.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.076+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe0c8198d40 con 0x7fe0c8106820 2024-09-21T11:53:01.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.077+0000 7fe0bf7fe640 1 -- 172.21.15.118:0/3748158891 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fe0b006dff0 con 0x7fe0c8106820 2024-09-21T11:53:01.078 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:53:01.079 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:53:01.080 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:53:01.080 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:53:01.080 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:53:01.080 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:53:01.080 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:53:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0b407af80 msgr2=0x7fe0b407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0b407af80 0x7fe0b407d440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009430 tx=0x7fe0c003c040 comp rx=0 tx=0).stop 2024-09-21T11:53:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 msgr2=0x7fe0c819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 0x7fe0c819dbd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000d6f0 tx=0x7fe0b000dbb0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 shutdown_connections 2024-09-21T11:53:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0b407af80 0x7fe0b407d440 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0c8106820 0x7fe0c819dbd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 --2- 172.21.15.118:0/3748158891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100820 0x7fe0c819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 >> 172.21.15.118:0/3748158891 conn(0x7fe0c80fc520 msgr2=0x7fe0c806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:01.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 shutdown_connections 2024-09-21T11:53:01.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.079+0000 7fe0cce9f640 1 -- 172.21.15.118:0/3748158891 wait complete. 2024-09-21T11:53:01.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1483587705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 msgr2=0x7f8c8810b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 --2- 172.21.15.118:0/1483587705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 0x7f8c8810b950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009880 tx=0x7f8c7802a530 comp rx=0 tx=0).stop 2024-09-21T11:53:01.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1483587705 shutdown_connections 2024-09-21T11:53:01.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 --2- 172.21.15.118:0/1483587705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 0x7f8c8810b950 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 --2- 172.21.15.118:0/1483587705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c88102b40 0x7f8c88102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1483587705 >> 172.21.15.118:0/1483587705 conn(0x7f8c880fc4c0 msgr2=0x7f8c880fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:01.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1483587705 shutdown_connections 2024-09-21T11:53:01.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1483587705 wait complete. 2024-09-21T11:53:01.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 Processor -- start 2024-09-21T11:53:01.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.162+0000 7f8c8f4df640 1 -- start start 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8f4df640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c88102b40 0x7f8c881007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8f4df640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 0x7f8c88100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8f4df640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8810edb0 con 0x7f8c88103460 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8f4df640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8810ec30 con 0x7f8c88102b40 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8ca7a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 0x7f8c88100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8ca7a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 0x7f8c88100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47722/0 (socket says 172.21.15.118:47722) 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8ca7a640 1 -- 172.21.15.118:0/1233297586 learned_addr learned my addr 172.21.15.118:0/1233297586 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8d27b640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c88102b40 0x7f8c881007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8ca7a640 1 -- 172.21.15.118:0/1233297586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c88102b40 msgr2=0x7f8c881007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8ca7a640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c88102b40 0x7f8c881007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8ca7a640 1 -- 172.21.15.118:0/1233297586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c88101220 con 0x7f8c88103460 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8ca7a640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 0x7f8c88100ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8c78004f90 tx=0x7f8c780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:01.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c7e7fc640 1 -- 172.21.15.118:0/1233297586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c7803f070 con 0x7f8c88103460 2024-09-21T11:53:01.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c7e7fc640 1 -- 172.21.15.118:0/1233297586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c78004c70 con 0x7f8c88103460 2024-09-21T11:53:01.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c881014b0 con 0x7f8c88103460 2024-09-21T11:53:01.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c7e7fc640 1 -- 172.21.15.118:0/1233297586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c78035030 con 0x7f8c88103460 2024-09-21T11:53:01.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.163+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c881a3d40 con 0x7f8c88103460 2024-09-21T11:53:01.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.164+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8806a370 con 0x7f8c88103460 2024-09-21T11:53:01.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.165+0000 7f8c7e7fc640 1 -- 172.21.15.118:0/1233297586 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8c78042070 con 0x7f8c88103460 2024-09-21T11:53:01.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.166+0000 7f8c7e7fc640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8c7407af80 0x7f8c7407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:01.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.166+0000 7f8c8d27b640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8c7407af80 0x7f8c7407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:01.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.166+0000 7f8c7e7fc640 1 -- 172.21.15.118:0/1233297586 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f8c780be9f0 con 0x7f8c88103460 2024-09-21T11:53:01.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.166+0000 7f8c8d27b640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8c7407af80 0x7f8c7407d440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c84005fd0 tx=0x7f8c84005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:01.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.170+0000 7f8c7e7fc640 1 -- 172.21.15.118:0/1233297586 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c78089fc0 con 0x7f8c88103460 2024-09-21T11:53:01.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.383+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8c88105fd0 con 0x7f8c88103460 2024-09-21T11:53:01.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.384+0000 7f8c7e7fc640 1 -- 172.21.15.118:0/1233297586 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f8c7808ee70 con 0x7f8c88103460 2024-09-21T11:53:01.385 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:53:01.385 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:53:01.385 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:53:01.386 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:53:01.387 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:53:01.388 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:53:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:53:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8c7407af80 msgr2=0x7f8c7407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8c7407af80 0x7f8c7407d440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c84005fd0 tx=0x7f8c84005850 comp rx=0 tx=0).stop 2024-09-21T11:53:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 msgr2=0x7f8c88100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 0x7f8c88100ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8c78004f90 tx=0x7f8c780048f0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 shutdown_connections 2024-09-21T11:53:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8c7407af80 0x7f8c7407d440 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c88103460 0x7f8c88100ce0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 --2- 172.21.15.118:0/1233297586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c88102b40 0x7f8c881007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 >> 172.21.15.118:0/1233297586 conn(0x7f8c880fc4c0 msgr2=0x7f8c88103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:01.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 shutdown_connections 2024-09-21T11:53:01.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.386+0000 7f8c8f4df640 1 -- 172.21.15.118:0/1233297586 wait complete. 2024-09-21T11:53:01.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.470+0000 7f90aa452640 1 -- 172.21.15.118:0/96884760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 msgr2=0x7f90a4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.470+0000 7f90aa452640 1 --2- 172.21.15.118:0/96884760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 0x7f90a4100c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9098009880 tx=0x7f909802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.471+0000 7f90aa452640 1 -- 172.21.15.118:0/96884760 shutdown_connections 2024-09-21T11:53:01.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.471+0000 7f90aa452640 1 --2- 172.21.15.118:0/96884760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 0x7f90a4100c80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.471+0000 7f90aa452640 1 --2- 172.21.15.118:0/96884760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90a4106820 0x7f90a4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.471+0000 7f90aa452640 1 -- 172.21.15.118:0/96884760 >> 172.21.15.118:0/96884760 conn(0x7f90a40fc520 msgr2=0x7f90a40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:01.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.471+0000 7f90aa452640 1 -- 172.21.15.118:0/96884760 shutdown_connections 2024-09-21T11:53:01.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.471+0000 7f90aa452640 1 -- 172.21.15.118:0/96884760 wait complete. 2024-09-21T11:53:01.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.471+0000 7f90aa452640 1 Processor -- start 2024-09-21T11:53:01.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.471+0000 7f90aa452640 1 -- start start 2024-09-21T11:53:01.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90aa452640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 0x7f90a419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:01.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90aa452640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90a4106820 0x7f90a419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:01.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90aa452640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f90a410dd50 con 0x7f90a4100820 2024-09-21T11:53:01.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90aa452640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f90a410dbd0 con 0x7f90a4106820 2024-09-21T11:53:01.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 0x7f90a419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:01.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 0x7f90a419c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47738/0 (socket says 172.21.15.118:47738) 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a3fff640 1 -- 172.21.15.118:0/4212307724 learned_addr learned my addr 172.21.15.118:0/4212307724 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a3fff640 1 -- 172.21.15.118:0/4212307724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90a4106820 msgr2=0x7f90a419cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a3fff640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90a4106820 0x7f90a419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a3fff640 1 -- 172.21.15.118:0/4212307724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a4196740 con 0x7f90a4100820 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a3fff640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 0x7f90a419c670 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f909400b420 tx=0x7f909400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a17fa640 1 -- 172.21.15.118:0/4212307724 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9094011630 con 0x7f90a4100820 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a4196a30 con 0x7f90a4100820 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a17fa640 1 -- 172.21.15.118:0/4212307724 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9094016070 con 0x7f90a4100820 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90a17fa640 1 -- 172.21.15.118:0/4212307724 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9094010d40 con 0x7f90a4100820 2024-09-21T11:53:01.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.472+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a4196f90 con 0x7f90a4100820 2024-09-21T11:53:01.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.473+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a4101f60 con 0x7f90a4100820 2024-09-21T11:53:01.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.474+0000 7f90a17fa640 1 -- 172.21.15.118:0/4212307724 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f90940117d0 con 0x7f90a4100820 2024-09-21T11:53:01.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.474+0000 7f90a17fa640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f908c07af30 0x7f908c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:01.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.474+0000 7f90a17fa640 1 -- 172.21.15.118:0/4212307724 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f909409d8b0 con 0x7f90a4100820 2024-09-21T11:53:01.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.474+0000 7f90a37fe640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f908c07af30 0x7f908c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:01.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.475+0000 7f90a37fe640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f908c07af30 0x7f908c07d3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f90980096c0 tx=0x7f9098000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:01.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.479+0000 7f90a17fa640 1 -- 172.21.15.118:0/4212307724 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9094068e00 con 0x7f90a4100820 2024-09-21T11:53:01.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:01 smithi149 ceph-mon[79770]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:01.736 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:01 smithi149 ceph-mon[79770]: pgmap v425: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:01.737 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:01 smithi149 ceph-mon[79770]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:01.737 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:01 smithi149 ceph-mon[79770]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:01.737 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:01 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3748158891' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:53:01.737 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:01 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1233297586' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:53:01.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.700+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f90a4197300 con 0x7f908c07af30 2024-09-21T11:53:01.738 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:01 smithi118 ceph-mon[111738]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:01.738 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:01 smithi118 ceph-mon[111738]: pgmap v425: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:01.738 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:01 smithi118 ceph-mon[111738]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:01.738 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:01 smithi118 ceph-mon[111738]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:01.738 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:01 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3748158891' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:53:01.738 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:01 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1233297586' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:53:01.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.701+0000 7f90a17fa640 1 -- 172.21.15.118:0/4212307724 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f90a4197300 con 0x7f908c07af30 2024-09-21T11:53:01.738 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:53:01.739 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:53:01.740 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:53:01.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f908c07af30 msgr2=0x7f908c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f908c07af30 0x7f908c07d3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f90980096c0 tx=0x7f9098000bc0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 msgr2=0x7f90a419c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 0x7f90a419c670 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f909400b420 tx=0x7f909400b8e0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 shutdown_connections 2024-09-21T11:53:01.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90a4106820 0x7f90a419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f908c07af30 0x7f908c07d3f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 --2- 172.21.15.118:0/4212307724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90a4100820 0x7f90a419c670 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 >> 172.21.15.118:0/4212307724 conn(0x7f90a40fc520 msgr2=0x7f90a40fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:01.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 shutdown_connections 2024-09-21T11:53:01.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.704+0000 7f90aa452640 1 -- 172.21.15.118:0/4212307724 wait complete. 2024-09-21T11:53:01.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.785+0000 7f02b9bda640 1 -- 172.21.15.118:0/1240074403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b40ffd20 msgr2=0x7f02b4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.785+0000 7f02b9bda640 1 --2- 172.21.15.118:0/1240074403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b40ffd20 0x7f02b4100180 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f029c009880 tx=0x7f029c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.786+0000 7f02b9bda640 1 -- 172.21.15.118:0/1240074403 shutdown_connections 2024-09-21T11:53:01.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.786+0000 7f02b9bda640 1 --2- 172.21.15.118:0/1240074403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b40ffd20 0x7f02b4100180 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.786+0000 7f02b9bda640 1 --2- 172.21.15.118:0/1240074403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02b4106900 0x7f02b4106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.786+0000 7f02b9bda640 1 -- 172.21.15.118:0/1240074403 >> 172.21.15.118:0/1240074403 conn(0x7f02b40fbc10 msgr2=0x7f02b40fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:01.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.786+0000 7f02b9bda640 1 -- 172.21.15.118:0/1240074403 shutdown_connections 2024-09-21T11:53:01.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.786+0000 7f02b9bda640 1 -- 172.21.15.118:0/1240074403 wait complete. 2024-09-21T11:53:01.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.786+0000 7f02b9bda640 1 Processor -- start 2024-09-21T11:53:01.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.786+0000 7f02b9bda640 1 -- start start 2024-09-21T11:53:01.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b9bda640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02b40ffd20 0x7f02b419d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:01.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b9bda640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b4106900 0x7f02b419dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:01.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b9bda640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f02b410ef00 con 0x7f02b4106900 2024-09-21T11:53:01.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b9bda640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02b410ed80 con 0x7f02b40ffd20 2024-09-21T11:53:01.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02aaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b4106900 0x7f02b419dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02aaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b4106900 0x7f02b419dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47762/0 (socket says 172.21.15.118:47762) 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02aaffd640 1 -- 172.21.15.118:0/2594200685 learned_addr learned my addr 172.21.15.118:0/2594200685 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b37fe640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02b40ffd20 0x7f02b419d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02aaffd640 1 -- 172.21.15.118:0/2594200685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02b40ffd20 msgr2=0x7f02b419d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02aaffd640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02b40ffd20 0x7f02b419d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02aaffd640 1 -- 172.21.15.118:0/2594200685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b41978d0 con 0x7f02b4106900 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02aaffd640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b4106900 0x7f02b419dc50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f029c031460 tx=0x7f029c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b17fa640 1 -- 172.21.15.118:0/2594200685 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f029c03f070 con 0x7f02b4106900 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b4197b60 con 0x7f02b4106900 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b17fa640 1 -- 172.21.15.118:0/2594200685 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f029c004cf0 con 0x7f02b4106900 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b17fa640 1 -- 172.21.15.118:0/2594200685 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f029c035030 con 0x7f02b4106900 2024-09-21T11:53:01.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.787+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b4198090 con 0x7f02b4106900 2024-09-21T11:53:01.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.789+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b4103040 con 0x7f02b4106900 2024-09-21T11:53:01.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.789+0000 7f02b17fa640 1 -- 172.21.15.118:0/2594200685 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f029c042070 con 0x7f02b4106900 2024-09-21T11:53:01.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.790+0000 7f02b17fa640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02a007af30 0x7f02a007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:01.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.790+0000 7f02b37fe640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02a007af30 0x7f02a007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:01.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.790+0000 7f02b17fa640 1 -- 172.21.15.118:0/2594200685 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f029c0bebb0 con 0x7f02b4106900 2024-09-21T11:53:01.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.791+0000 7f02b37fe640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02a007af30 0x7f02a007d3f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f02b4198a10 tx=0x7f02a4008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:01.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:01.794+0000 7f02b17fa640 1 -- 172.21.15.118:0/2594200685 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f029c0c5080 con 0x7f02b4106900 2024-09-21T11:53:02.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.040+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f02b4109ea0 con 0x7f02b4106900 2024-09-21T11:53:02.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.040+0000 7f02b17fa640 1 -- 172.21.15.118:0/2594200685 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f029c08a100 con 0x7f02b4106900 2024-09-21T11:53:02.041 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:53:02.042 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:53:02.042 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:53:02.042 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:53:02.042 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:53:02.042 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:53:02.042 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02a007af30 msgr2=0x7f02a007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02a007af30 0x7f02a007d3f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f02b4198a10 tx=0x7f02a4008040 comp rx=0 tx=0).stop 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b4106900 msgr2=0x7f02b419dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b4106900 0x7f02b419dc50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f029c031460 tx=0x7f029c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 shutdown_connections 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f02a007af30 0x7f02a007d3f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02b4106900 0x7f02b419dc50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 --2- 172.21.15.118:0/2594200685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02b40ffd20 0x7f02b419d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 >> 172.21.15.118:0/2594200685 conn(0x7f02b40fbc10 msgr2=0x7f02b40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:02.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 shutdown_connections 2024-09-21T11:53:02.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:02.042+0000 7f02b9bda640 1 -- 172.21.15.118:0/2594200685 wait complete. 2024-09-21T11:53:02.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:02 smithi149 ceph-mon[79770]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:02.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:02 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2594200685' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:53:02.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:02 smithi118 ceph-mon[111738]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:02.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:02 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2594200685' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:53:03.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:03 smithi149 ceph-mon[79770]: pgmap v426: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:03 smithi118 ceph-mon[111738]: pgmap v426: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:05 smithi149 ceph-mon[79770]: pgmap v427: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:53:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:05 smithi118 ceph-mon[111738]: pgmap v427: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:53:07.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:07 smithi149 ceph-mon[79770]: pgmap v428: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:07 smithi118 ceph-mon[111738]: pgmap v428: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:09 smithi149 ceph-mon[79770]: pgmap v429: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:09.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:09 smithi118 ceph-mon[111738]: pgmap v429: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:11.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:11 smithi149 ceph-mon[79770]: pgmap v430: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:11.785 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:11 smithi118 ceph-mon[111738]: pgmap v430: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:13 smithi149 ceph-mon[79770]: pgmap v431: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:13 smithi118 ceph-mon[111738]: pgmap v431: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:15 smithi149 ceph-mon[79770]: pgmap v432: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:15 smithi118 ceph-mon[111738]: pgmap v432: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:17.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:17 smithi149 ceph-mon[79770]: pgmap v433: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:17 smithi118 ceph-mon[111738]: pgmap v433: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:19 smithi149 ceph-mon[79770]: pgmap v434: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:19 smithi118 ceph-mon[111738]: pgmap v434: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:53:20.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:53:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:21 smithi118 ceph-mon[111738]: pgmap v435: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:21 smithi149 ceph-mon[79770]: pgmap v435: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:23 smithi118 ceph-mon[111738]: pgmap v436: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:23.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:23 smithi149 ceph-mon[79770]: pgmap v436: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:25 smithi118 ceph-mon[111738]: pgmap v437: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:25.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:25 smithi149 ceph-mon[79770]: pgmap v437: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:27 smithi118 ceph-mon[111738]: pgmap v438: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:27 smithi149 ceph-mon[79770]: pgmap v438: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:29 smithi118 ceph-mon[111738]: pgmap v439: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:29.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:29 smithi149 ceph-mon[79770]: pgmap v439: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:31 smithi118 ceph-mon[111738]: pgmap v440: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:31.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:31 smithi149 ceph-mon[79770]: pgmap v440: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:32.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.141+0000 7fb604aed640 1 -- 172.21.15.118:0/1378962923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 msgr2=0x7fb600100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.141+0000 7fb604aed640 1 --2- 172.21.15.118:0/1378962923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 0x7fb600100c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009880 tx=0x7fb5f402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.141+0000 7fb604aed640 1 -- 172.21.15.118:0/1378962923 shutdown_connections 2024-09-21T11:53:32.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.141+0000 7fb604aed640 1 --2- 172.21.15.118:0/1378962923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 0x7fb600100c40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.141+0000 7fb604aed640 1 --2- 172.21.15.118:0/1378962923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6001067e0 0x7fb600106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.141+0000 7fb604aed640 1 -- 172.21.15.118:0/1378962923 >> 172.21.15.118:0/1378962923 conn(0x7fb6000fc4c0 msgr2=0x7fb6000fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:32.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.141+0000 7fb604aed640 1 -- 172.21.15.118:0/1378962923 shutdown_connections 2024-09-21T11:53:32.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.141+0000 7fb604aed640 1 -- 172.21.15.118:0/1378962923 wait complete. 2024-09-21T11:53:32.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb604aed640 1 Processor -- start 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb604aed640 1 -- start start 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb604aed640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 0x7fb6001987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb604aed640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6001067e0 0x7fb600198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb604aed640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb60010dc90 con 0x7fb6001007e0 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb604aed640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb60010db10 con 0x7fb6001067e0 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb5fe59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 0x7fb6001987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb5fe59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 0x7fb6001987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47972/0 (socket says 172.21.15.118:47972) 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb5fe59c640 1 -- 172.21.15.118:0/2613936749 learned_addr learned my addr 172.21.15.118:0/2613936749 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.142+0000 7fb5fdd9b640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6001067e0 0x7fb600198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.143+0000 7fb5fe59c640 1 -- 172.21.15.118:0/2613936749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6001067e0 msgr2=0x7fb600198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.143+0000 7fb5fe59c640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6001067e0 0x7fb600198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.143+0000 7fb5fe59c640 1 -- 172.21.15.118:0/2613936749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb600199300 con 0x7fb6001007e0 2024-09-21T11:53:32.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.143+0000 7fb5fe59c640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 0x7fb6001987c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000d8d0 tx=0x7fb5f000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:32.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.143+0000 7fb5ef7fe640 1 -- 172.21.15.118:0/2613936749 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5f0017070 con 0x7fb6001007e0 2024-09-21T11:53:32.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.143+0000 7fb5ef7fe640 1 -- 172.21.15.118:0/2613936749 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb5f0010460 con 0x7fb6001007e0 2024-09-21T11:53:32.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.143+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6001995f0 con 0x7fb6001007e0 2024-09-21T11:53:32.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.143+0000 7fb5ef7fe640 1 -- 172.21.15.118:0/2613936749 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5f000f5f0 con 0x7fb6001007e0 2024-09-21T11:53:32.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.143+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6001a1bf0 con 0x7fb6001007e0 2024-09-21T11:53:32.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.144+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb600101f20 con 0x7fb6001007e0 2024-09-21T11:53:32.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.145+0000 7fb5ef7fe640 1 -- 172.21.15.118:0/2613936749 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb5f0009a30 con 0x7fb6001007e0 2024-09-21T11:53:32.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.146+0000 7fb5ef7fe640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb5e807af40 0x7fb5e807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:32.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.146+0000 7fb5fdd9b640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb5e807af40 0x7fb5e807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:32.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.146+0000 7fb5ef7fe640 1 -- 172.21.15.118:0/2613936749 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb5f009dea0 con 0x7fb6001007e0 2024-09-21T11:53:32.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.147+0000 7fb5fdd9b640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb5e807af40 0x7fb5e807d400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb60006a680 tx=0x7fb5f4031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:32.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.151+0000 7fb5ef7fe640 1 -- 172.21.15.118:0/2613936749 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6001995f0 con 0x7fb6001007e0 2024-09-21T11:53:32.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.347+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb600108de0 con 0x7fb5e807af40 2024-09-21T11:53:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.349+0000 7fb5ef7fe640 1 -- 172.21.15.118:0/2613936749 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fb5f4004260 con 0x7fb5e807af40 2024-09-21T11:53:32.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb5e807af40 msgr2=0x7fb5e807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb5e807af40 0x7fb5e807d400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb60006a680 tx=0x7fb5f4031400 comp rx=0 tx=0).stop 2024-09-21T11:53:32.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 msgr2=0x7fb6001987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 0x7fb6001987c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000d8d0 tx=0x7fb5f000dd90 comp rx=0 tx=0).stop 2024-09-21T11:53:32.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 shutdown_connections 2024-09-21T11:53:32.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6001067e0 0x7fb600198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb5e807af40 0x7fb5e807d400 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 --2- 172.21.15.118:0/2613936749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6001007e0 0x7fb6001987c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 >> 172.21.15.118:0/2613936749 conn(0x7fb6000fc4c0 msgr2=0x7fb6000fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:32.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 shutdown_connections 2024-09-21T11:53:32.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.351+0000 7fb604aed640 1 -- 172.21.15.118:0/2613936749 wait complete. 2024-09-21T11:53:32.362 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:53:32.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.434+0000 7f351ee20640 1 -- 172.21.15.118:0/574049512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 msgr2=0x7f3518101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.434+0000 7f351ee20640 1 --2- 172.21.15.118:0/574049512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 0x7f3518101d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3504009880 tx=0x7f350402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.434+0000 7f351ee20640 1 -- 172.21.15.118:0/574049512 shutdown_connections 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.434+0000 7f351ee20640 1 --2- 172.21.15.118:0/574049512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 0x7f3518101d90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.434+0000 7f351ee20640 1 --2- 172.21.15.118:0/574049512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3518107930 0x7f3518107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.434+0000 7f351ee20640 1 -- 172.21.15.118:0/574049512 >> 172.21.15.118:0/574049512 conn(0x7f35180fd630 msgr2=0x7f35180ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.434+0000 7f351ee20640 1 -- 172.21.15.118:0/574049512 shutdown_connections 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.434+0000 7f351ee20640 1 -- 172.21.15.118:0/574049512 wait complete. 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.434+0000 7f351ee20640 1 Processor -- start 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351ee20640 1 -- start start 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351ee20640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 0x7f35180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351ee20640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3518107930 0x7f3518074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351ee20640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f351810ee60 con 0x7f3518101930 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351ee20640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f351810ece0 con 0x7f3518107930 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351cbbc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 0x7f35180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351cbbc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 0x7f35180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47982/0 (socket says 172.21.15.118:47982) 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351cbbc640 1 -- 172.21.15.118:0/1902807564 learned_addr learned my addr 172.21.15.118:0/1902807564 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f3517fff640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3518107930 0x7f3518074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351cbbc640 1 -- 172.21.15.118:0/1902807564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3518107930 msgr2=0x7f3518074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351cbbc640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3518107930 0x7f3518074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351cbbc640 1 -- 172.21.15.118:0/1902807564 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3518074f70 con 0x7f3518101930 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f351cbbc640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 0x7f35180744f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f350c00b420 tx=0x7f350c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.435+0000 7f3515ffb640 1 -- 172.21.15.118:0/1902807564 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f350c011630 con 0x7f3518101930 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.436+0000 7f3515ffb640 1 -- 172.21.15.118:0/1902807564 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f350c016070 con 0x7f3518101930 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.436+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3518075260 con 0x7f3518101930 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.436+0000 7f3515ffb640 1 -- 172.21.15.118:0/1902807564 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f350c010d40 con 0x7f3518101930 2024-09-21T11:53:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.436+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35181a3ef0 con 0x7f3518101930 2024-09-21T11:53:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.437+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3518103070 con 0x7f3518101930 2024-09-21T11:53:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.437+0000 7f3515ffb640 1 -- 172.21.15.118:0/1902807564 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f350c01b460 con 0x7f3518101930 2024-09-21T11:53:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.438+0000 7f3515ffb640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f350807af80 0x7f350807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.438+0000 7f3515ffb640 1 -- 172.21.15.118:0/1902807564 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f350c09d6a0 con 0x7f3518101930 2024-09-21T11:53:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.438+0000 7f3517fff640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f350807af80 0x7f350807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.438+0000 7f3517fff640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f350807af80 0x7f350807d440 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3518075f80 tx=0x7f3504031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.442+0000 7f3515ffb640 1 -- 172.21.15.118:0/1902807564 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f350c068c70 con 0x7f3518101930 2024-09-21T11:53:32.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.637+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3518062630 con 0x7f350807af80 2024-09-21T11:53:32.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.639+0000 7f3515ffb640 1 -- 172.21.15.118:0/1902807564 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3518062630 con 0x7f350807af80 2024-09-21T11:53:32.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f350807af80 msgr2=0x7f350807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f350807af80 0x7f350807d440 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3518075f80 tx=0x7f3504031400 comp rx=0 tx=0).stop 2024-09-21T11:53:32.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 msgr2=0x7f35180744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 0x7f35180744f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f350c00b420 tx=0x7f350c00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 shutdown_connections 2024-09-21T11:53:32.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3518107930 0x7f3518074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f350807af80 0x7f350807d440 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 --2- 172.21.15.118:0/1902807564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3518101930 0x7f35180744f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 >> 172.21.15.118:0/1902807564 conn(0x7f35180fd630 msgr2=0x7f35180fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:32.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 shutdown_connections 2024-09-21T11:53:32.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.641+0000 7f351ee20640 1 -- 172.21.15.118:0/1902807564 wait complete. 2024-09-21T11:53:32.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.723+0000 7f6672179640 1 -- 172.21.15.118:0/4172820068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c103400 msgr2=0x7f666c10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.723+0000 7f6672179640 1 --2- 172.21.15.118:0/4172820068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c103400 0x7f666c10b8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f665c009880 tx=0x7f665c02a530 comp rx=0 tx=0).stop 2024-09-21T11:53:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.723+0000 7f6672179640 1 -- 172.21.15.118:0/4172820068 shutdown_connections 2024-09-21T11:53:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.723+0000 7f6672179640 1 --2- 172.21.15.118:0/4172820068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c103400 0x7f666c10b8f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.723+0000 7f6672179640 1 --2- 172.21.15.118:0/4172820068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f666c102ae0 0x7f666c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.723+0000 7f6672179640 1 -- 172.21.15.118:0/4172820068 >> 172.21.15.118:0/4172820068 conn(0x7f666c0fc520 msgr2=0x7f666c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.723+0000 7f6672179640 1 -- 172.21.15.118:0/4172820068 shutdown_connections 2024-09-21T11:53:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.723+0000 7f6672179640 1 -- 172.21.15.118:0/4172820068 wait complete. 2024-09-21T11:53:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f6672179640 1 Processor -- start 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f6672179640 1 -- start start 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f6672179640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c102ae0 0x7f666c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f6672179640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f666c103400 0x7f666c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f6672179640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f666c10edf0 con 0x7f666c102ae0 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f6672179640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f666c10ec70 con 0x7f666c103400 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f666b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c102ae0 0x7f666c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f666b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c102ae0 0x7f666c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47998/0 (socket says 172.21.15.118:47998) 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f666b7fe640 1 -- 172.21.15.118:0/3980050225 learned_addr learned my addr 172.21.15.118:0/3980050225 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f666affd640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f666c103400 0x7f666c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f666b7fe640 1 -- 172.21.15.118:0/3980050225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f666c103400 msgr2=0x7f666c100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f666b7fe640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f666c103400 0x7f666c100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.724+0000 7f666b7fe640 1 -- 172.21.15.118:0/3980050225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c1011c0 con 0x7f666c102ae0 2024-09-21T11:53:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.725+0000 7f666b7fe640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c102ae0 0x7f666c100740 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f666000d8d0 tx=0x7f666000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.725+0000 7f6668ff9640 1 -- 172.21.15.118:0/3980050225 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6660017070 con 0x7f666c102ae0 2024-09-21T11:53:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.725+0000 7f6668ff9640 1 -- 172.21.15.118:0/3980050225 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6660010460 con 0x7f666c102ae0 2024-09-21T11:53:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.725+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666c1014b0 con 0x7f666c102ae0 2024-09-21T11:53:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.725+0000 7f6668ff9640 1 -- 172.21.15.118:0/3980050225 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f666000f5f0 con 0x7f666c102ae0 2024-09-21T11:53:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.725+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666c1a3e80 con 0x7f666c102ae0 2024-09-21T11:53:32.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.726+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666c06abe0 con 0x7f666c102ae0 2024-09-21T11:53:32.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.727+0000 7f6668ff9640 1 -- 172.21.15.118:0/3980050225 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6660009a30 con 0x7f666c102ae0 2024-09-21T11:53:32.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.727+0000 7f6668ff9640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f665407af30 0x7f665407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:32.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.727+0000 7f6668ff9640 1 -- 172.21.15.118:0/3980050225 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f666009dec0 con 0x7f666c102ae0 2024-09-21T11:53:32.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.727+0000 7f666affd640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f665407af30 0x7f665407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:32.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.728+0000 7f666affd640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f665407af30 0x7f665407d3f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f666c1021d0 tx=0x7f665c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:32.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.731+0000 7f6668ff9640 1 -- 172.21.15.118:0/3980050225 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6660069410 con 0x7f666c102ae0 2024-09-21T11:53:32.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.915+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f666c062630 con 0x7f665407af30 2024-09-21T11:53:32.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.925+0000 7f6668ff9640 1 -- 172.21.15.118:0/3980050225 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f666c062630 con 0x7f665407af30 2024-09-21T11:53:32.927 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (11m) 5m ago 22m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (14m) 5m ago 22m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (13m) 5m ago 21m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (9m) 5m ago 22m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (9m) 5m ago 21m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (11m) 5m ago 22m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (5m) 5m ago 17m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (5m) 5m ago 16m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (16m) 5m ago 16m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (5m) 5m ago 17m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (13m) 5m ago 23m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (12m) 5m ago 21m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (10m) 5m ago 23m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:53:32.928 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (9m) 5m ago 21m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:53:32.929 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (12m) 5m ago 22m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:53:32.929 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (12m) 5m ago 21m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:53:32.929 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (9m) 5m ago 20m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:53:32.929 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (8m) 5m ago 19m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:53:32.929 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (7m) 5m ago 19m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:53:32.929 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (7m) 5m ago 19m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:53:32.929 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (6m) 5m ago 18m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:53:32.929 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (6m) 5m ago 18m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:53:32.929 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (11m) 5m ago 22m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.927+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f665407af30 msgr2=0x7f665407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.927+0000 7f6672179640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f665407af30 0x7f665407d3f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f666c1021d0 tx=0x7f665c031400 comp rx=0 tx=0).stop 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.927+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c102ae0 msgr2=0x7f666c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.927+0000 7f6672179640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c102ae0 0x7f666c100740 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f666000d8d0 tx=0x7f666000dd90 comp rx=0 tx=0).stop 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.927+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 shutdown_connections 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.927+0000 7f6672179640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f666c103400 0x7f666c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.927+0000 7f6672179640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f665407af30 0x7f665407d3f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.927+0000 7f6672179640 1 --2- 172.21.15.118:0/3980050225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f666c102ae0 0x7f666c100740 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.927+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 >> 172.21.15.118:0/3980050225 conn(0x7f666c0fc520 msgr2=0x7f666c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:32.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.928+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 shutdown_connections 2024-09-21T11:53:32.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:32.928+0000 7f6672179640 1 -- 172.21.15.118:0/3980050225 wait complete. 2024-09-21T11:53:33.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.008+0000 7fce4b28e640 1 -- 172.21.15.118:0/2237837694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074590 msgr2=0x7fce44074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.008+0000 7fce4b28e640 1 --2- 172.21.15.118:0/2237837694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074590 0x7fce44074970 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce40009880 tx=0x7fce4002a530 comp rx=0 tx=0).stop 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.008+0000 7fce4b28e640 1 -- 172.21.15.118:0/2237837694 shutdown_connections 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.008+0000 7fce4b28e640 1 --2- 172.21.15.118:0/2237837694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce44074eb0 0x7fce44112400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.008+0000 7fce4b28e640 1 --2- 172.21.15.118:0/2237837694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074590 0x7fce44074970 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.008+0000 7fce4b28e640 1 -- 172.21.15.118:0/2237837694 >> 172.21.15.118:0/2237837694 conn(0x7fce440fd630 msgr2=0x7fce440ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.008+0000 7fce4b28e640 1 -- 172.21.15.118:0/2237837694 shutdown_connections 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.008+0000 7fce4b28e640 1 -- 172.21.15.118:0/2237837694 wait complete. 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce4b28e640 1 Processor -- start 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce4b28e640 1 -- start start 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce4b28e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce44074590 0x7fce4419e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce4b28e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074eb0 0x7fce4419e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce4b28e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce44115400 con 0x7fce44074eb0 2024-09-21T11:53:33.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce4b28e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce44115280 con 0x7fce44074590 2024-09-21T11:53:33.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce48829640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074eb0 0x7fce4419e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce48829640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074eb0 0x7fce4419e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48018/0 (socket says 172.21.15.118:48018) 2024-09-21T11:53:33.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce48829640 1 -- 172.21.15.118:0/2538911821 learned_addr learned my addr 172.21.15.118:0/2538911821 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:33.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.009+0000 7fce4902a640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce44074590 0x7fce4419e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.010+0000 7fce48829640 1 -- 172.21.15.118:0/2538911821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce44074590 msgr2=0x7fce4419e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.010+0000 7fce48829640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce44074590 0x7fce4419e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.010+0000 7fce48829640 1 -- 172.21.15.118:0/2538911821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce441a28f0 con 0x7fce44074eb0 2024-09-21T11:53:33.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.010+0000 7fce48829640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074eb0 0x7fce4419e560 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce3400d8d0 tx=0x7fce3400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:33.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.010+0000 7fce3a7fc640 1 -- 172.21.15.118:0/2538911821 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce34017030 con 0x7fce44074eb0 2024-09-21T11:53:33.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.010+0000 7fce3a7fc640 1 -- 172.21.15.118:0/2538911821 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce34004020 con 0x7fce44074eb0 2024-09-21T11:53:33.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.010+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce441a2be0 con 0x7fce44074eb0 2024-09-21T11:53:33.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.010+0000 7fce3a7fc640 1 -- 172.21.15.118:0/2538911821 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce340047a0 con 0x7fce44074eb0 2024-09-21T11:53:33.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.010+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce441a3170 con 0x7fce44074eb0 2024-09-21T11:53:33.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.011+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce44075cd0 con 0x7fce44074eb0 2024-09-21T11:53:33.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.012+0000 7fce3a7fc640 1 -- 172.21.15.118:0/2538911821 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fce340041d0 con 0x7fce44074eb0 2024-09-21T11:53:33.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.012+0000 7fce3a7fc640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce3007af80 0x7fce3007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.012+0000 7fce4902a640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce3007af80 0x7fce3007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.012+0000 7fce3a7fc640 1 -- 172.21.15.118:0/2538911821 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fce34018070 con 0x7fce44074eb0 2024-09-21T11:53:33.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.013+0000 7fce4902a640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce3007af80 0x7fce3007d440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fce400096c0 tx=0x7fce40031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:33.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.017+0000 7fce3a7fc640 1 -- 172.21.15.118:0/2538911821 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce340692f0 con 0x7fce44074eb0 2024-09-21T11:53:33.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.264+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fce441a34e0 con 0x7fce44074eb0 2024-09-21T11:53:33.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.264+0000 7fce3a7fc640 1 -- 172.21.15.118:0/2538911821 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fce3406e1a0 con 0x7fce44074eb0 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:53:33.267 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:53:33.268 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:53:33.268 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:53:33.268 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:53:33.268 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:53:33.268 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:53:33.268 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:53:33.268 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.266+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce3007af80 msgr2=0x7fce3007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.266+0000 7fce4b28e640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce3007af80 0x7fce3007d440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fce400096c0 tx=0x7fce40031400 comp rx=0 tx=0).stop 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.266+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074eb0 msgr2=0x7fce4419e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.266+0000 7fce4b28e640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074eb0 0x7fce4419e560 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce3400d8d0 tx=0x7fce3400dd90 comp rx=0 tx=0).stop 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.266+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 shutdown_connections 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.266+0000 7fce4b28e640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce3007af80 0x7fce3007d440 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.266+0000 7fce4b28e640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce44074eb0 0x7fce4419e560 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.266+0000 7fce4b28e640 1 --2- 172.21.15.118:0/2538911821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce44074590 0x7fce4419e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.266+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 >> 172.21.15.118:0/2538911821 conn(0x7fce440fd630 msgr2=0x7fce44101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.267+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 shutdown_connections 2024-09-21T11:53:33.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.267+0000 7fce4b28e640 1 -- 172.21.15.118:0/2538911821 wait complete. 2024-09-21T11:53:33.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.347+0000 7efc73f36640 1 -- 172.21.15.118:0/3675954350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c106820 msgr2=0x7efc6c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.347+0000 7efc73f36640 1 --2- 172.21.15.118:0/3675954350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c106820 0x7efc6c106c00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efc68009880 tx=0x7efc6802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.347+0000 7efc73f36640 1 -- 172.21.15.118:0/3675954350 shutdown_connections 2024-09-21T11:53:33.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.347+0000 7efc73f36640 1 --2- 172.21.15.118:0/3675954350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc6c100820 0x7efc6c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.347+0000 7efc73f36640 1 --2- 172.21.15.118:0/3675954350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c106820 0x7efc6c106c00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.347+0000 7efc73f36640 1 -- 172.21.15.118:0/3675954350 >> 172.21.15.118:0/3675954350 conn(0x7efc6c0fc520 msgr2=0x7efc6c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:33.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.347+0000 7efc73f36640 1 -- 172.21.15.118:0/3675954350 shutdown_connections 2024-09-21T11:53:33.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.347+0000 7efc73f36640 1 -- 172.21.15.118:0/3675954350 wait complete. 2024-09-21T11:53:33.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc73f36640 1 Processor -- start 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc73f36640 1 -- start start 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc73f36640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c100820 0x7efc6c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc73f36640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc6c106820 0x7efc6c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc73f36640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c10dcf0 con 0x7efc6c100820 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc73f36640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c10db70 con 0x7efc6c106820 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc71cd2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c100820 0x7efc6c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc71cd2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c100820 0x7efc6c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48038/0 (socket says 172.21.15.118:48038) 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc71cd2640 1 -- 172.21.15.118:0/2015886014 learned_addr learned my addr 172.21.15.118:0/2015886014 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc714d1640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc6c106820 0x7efc6c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc71cd2640 1 -- 172.21.15.118:0/2015886014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc6c106820 msgr2=0x7efc6c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.348+0000 7efc71cd2640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc6c106820 0x7efc6c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.349+0000 7efc71cd2640 1 -- 172.21.15.118:0/2015886014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c199380 con 0x7efc6c100820 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.349+0000 7efc714d1640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc6c106820 0x7efc6c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:53:33.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.349+0000 7efc71cd2640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c100820 0x7efc6c198840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efc68031460 tx=0x7efc680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:33.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.349+0000 7efc62ffd640 1 -- 172.21.15.118:0/2015886014 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc6803f070 con 0x7efc6c100820 2024-09-21T11:53:33.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.349+0000 7efc62ffd640 1 -- 172.21.15.118:0/2015886014 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efc680035f0 con 0x7efc6c100820 2024-09-21T11:53:33.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.349+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c199610 con 0x7efc6c100820 2024-09-21T11:53:33.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.349+0000 7efc62ffd640 1 -- 172.21.15.118:0/2015886014 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc68035030 con 0x7efc6c100820 2024-09-21T11:53:33.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.349+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c1a1bc0 con 0x7efc6c100820 2024-09-21T11:53:33.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.350+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6c101f60 con 0x7efc6c100820 2024-09-21T11:53:33.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.350+0000 7efc62ffd640 1 -- 172.21.15.118:0/2015886014 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7efc68042070 con 0x7efc6c100820 2024-09-21T11:53:33.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.351+0000 7efc62ffd640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc5807af30 0x7efc5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.351+0000 7efc62ffd640 1 -- 172.21.15.118:0/2015886014 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7efc680bead0 con 0x7efc6c100820 2024-09-21T11:53:33.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.351+0000 7efc714d1640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc5807af30 0x7efc5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.351+0000 7efc714d1640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc5807af30 0x7efc5807d3f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0058c0 tx=0x7efc5c005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:33.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.355+0000 7efc62ffd640 1 -- 172.21.15.118:0/2015886014 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc6808a020 con 0x7efc6c100820 2024-09-21T11:53:33.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.569+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7efc6c108d90 con 0x7efc6c100820 2024-09-21T11:53:33.572 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:33 smithi118 ceph-mon[111738]: pgmap v441: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:33.572 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:33 smithi118 ceph-mon[111738]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:33.572 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:33 smithi118 ceph-mon[111738]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:33.572 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:33 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2538911821' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:53:33.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.570+0000 7efc62ffd640 1 -- 172.21.15.118:0/2015886014 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7efc6808c020 con 0x7efc6c100820 2024-09-21T11:53:33.573 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:53:33.573 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:53:33.573 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:53:33.573 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:53:33.573 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:53:33.573 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:53:33.573 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:53:33.573 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:53:33.574 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:53:33.575 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:53:33.576 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:53:33.576 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:53:33.576 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:53:33.576 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:53:33.576 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:53:33.576 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:53:33.576 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.572+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc5807af30 msgr2=0x7efc5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.572+0000 7efc73f36640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc5807af30 0x7efc5807d3f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0058c0 tx=0x7efc5c005850 comp rx=0 tx=0).stop 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.572+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c100820 msgr2=0x7efc6c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.572+0000 7efc73f36640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c100820 0x7efc6c198840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efc68031460 tx=0x7efc680045e0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.572+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 shutdown_connections 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.572+0000 7efc73f36640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc6c106820 0x7efc6c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.572+0000 7efc73f36640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efc5807af30 0x7efc5807d3f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.572+0000 7efc73f36640 1 --2- 172.21.15.118:0/2015886014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc6c100820 0x7efc6c198840 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.572+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 >> 172.21.15.118:0/2015886014 conn(0x7efc6c0fc520 msgr2=0x7efc6c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.573+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 shutdown_connections 2024-09-21T11:53:33.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.573+0000 7efc73f36640 1 -- 172.21.15.118:0/2015886014 wait complete. 2024-09-21T11:53:33.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.655+0000 7f6b37ea7640 1 -- 172.21.15.118:0/3796764274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 msgr2=0x7f6b30102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.655+0000 7f6b37ea7640 1 --2- 172.21.15.118:0/3796764274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 0x7f6b30102f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6b200098b0 tx=0x7f6b2002a560 comp rx=0 tx=0).stop 2024-09-21T11:53:33.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.655+0000 7f6b37ea7640 1 -- 172.21.15.118:0/3796764274 shutdown_connections 2024-09-21T11:53:33.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.655+0000 7f6b37ea7640 1 --2- 172.21.15.118:0/3796764274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b30103460 0x7f6b3010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.655+0000 7f6b37ea7640 1 --2- 172.21.15.118:0/3796764274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 0x7f6b30102f20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.655+0000 7f6b37ea7640 1 -- 172.21.15.118:0/3796764274 >> 172.21.15.118:0/3796764274 conn(0x7f6b300fc520 msgr2=0x7f6b300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:33.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.655+0000 7f6b37ea7640 1 -- 172.21.15.118:0/3796764274 shutdown_connections 2024-09-21T11:53:33.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.655+0000 7f6b37ea7640 1 -- 172.21.15.118:0/3796764274 wait complete. 2024-09-21T11:53:33.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b37ea7640 1 Processor -- start 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b37ea7640 1 -- start start 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b37ea7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 0x7f6b301007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b37ea7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b30103460 0x7f6b30100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b37ea7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3010ee10 con 0x7f6b30102b40 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b37ea7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3010ec90 con 0x7f6b30103460 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b35c43640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 0x7f6b301007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b35c43640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 0x7f6b301007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48056/0 (socket says 172.21.15.118:48056) 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b35c43640 1 -- 172.21.15.118:0/4291334187 learned_addr learned my addr 172.21.15.118:0/4291334187 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b35442640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b30103460 0x7f6b30100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b35c43640 1 -- 172.21.15.118:0/4291334187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b30103460 msgr2=0x7f6b30100ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b35c43640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b30103460 0x7f6b30100ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b35c43640 1 -- 172.21.15.118:0/4291334187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b30101220 con 0x7f6b30102b40 2024-09-21T11:53:33.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.656+0000 7f6b35442640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b30103460 0x7f6b30100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:53:33.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.657+0000 7f6b35c43640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 0x7f6b301007a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6b20031460 tx=0x7f6b200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:33.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.657+0000 7f6b26ffd640 1 -- 172.21.15.118:0/4291334187 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b2003f070 con 0x7f6b30102b40 2024-09-21T11:53:33.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.657+0000 7f6b26ffd640 1 -- 172.21.15.118:0/4291334187 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b200044d0 con 0x7f6b30102b40 2024-09-21T11:53:33.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.657+0000 7f6b26ffd640 1 -- 172.21.15.118:0/4291334187 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b20035030 con 0x7f6b30102b40 2024-09-21T11:53:33.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.657+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b301014b0 con 0x7f6b30102b40 2024-09-21T11:53:33.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.657+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b301a3e60 con 0x7f6b30102b40 2024-09-21T11:53:33.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.658+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b3006ab80 con 0x7f6b30102b40 2024-09-21T11:53:33.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.658+0000 7f6b26ffd640 1 -- 172.21.15.118:0/4291334187 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6b20042070 con 0x7f6b30102b40 2024-09-21T11:53:33.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.659+0000 7f6b26ffd640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b1c07af80 0x7f6b1c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.659+0000 7f6b26ffd640 1 -- 172.21.15.118:0/4291334187 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f6b200bea40 con 0x7f6b30102b40 2024-09-21T11:53:33.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.659+0000 7f6b35442640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b1c07af80 0x7f6b1c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.659+0000 7f6b35442640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b1c07af80 0x7f6b1c07d440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c005fd0 tx=0x7f6b2c005ea0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:33.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.663+0000 7f6b26ffd640 1 -- 172.21.15.118:0/4291334187 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b20004cf0 con 0x7f6b30102b40 2024-09-21T11:53:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:33 smithi149 ceph-mon[79770]: pgmap v441: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:33 smithi149 ceph-mon[79770]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:33.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:33 smithi149 ceph-mon[79770]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:33.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:33 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2538911821' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:53:33.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.858+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6b30062630 con 0x7f6b1c07af80 2024-09-21T11:53:33.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.859+0000 7f6b26ffd640 1 -- 172.21.15.118:0/4291334187 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6b30062630 con 0x7f6b1c07af80 2024-09-21T11:53:33.861 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:53:33.861 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:53:33.861 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:53:33.861 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:53:33.862 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b1c07af80 msgr2=0x7f6b1c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b1c07af80 0x7f6b1c07d440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c005fd0 tx=0x7f6b2c005ea0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 msgr2=0x7f6b301007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 0x7f6b301007a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6b20031460 tx=0x7f6b200048f0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 shutdown_connections 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b30103460 0x7f6b30100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b1c07af80 0x7f6b1c07d440 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 --2- 172.21.15.118:0/4291334187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b30102b40 0x7f6b301007a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 >> 172.21.15.118:0/4291334187 conn(0x7f6b300fc520 msgr2=0x7f6b30107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 shutdown_connections 2024-09-21T11:53:33.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.861+0000 7f6b37ea7640 1 -- 172.21.15.118:0/4291334187 wait complete. 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.943+0000 7fad3aa42640 1 -- 172.21.15.118:0/3539613034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 msgr2=0x7fad34100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.943+0000 7fad3aa42640 1 --2- 172.21.15.118:0/3539613034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 0x7fad34100c40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009880 tx=0x7fad1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.943+0000 7fad3aa42640 1 -- 172.21.15.118:0/3539613034 shutdown_connections 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.943+0000 7fad3aa42640 1 --2- 172.21.15.118:0/3539613034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 0x7fad34100c40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.943+0000 7fad3aa42640 1 --2- 172.21.15.118:0/3539613034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad341067e0 0x7fad34106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.943+0000 7fad3aa42640 1 -- 172.21.15.118:0/3539613034 >> 172.21.15.118:0/3539613034 conn(0x7fad340fc4c0 msgr2=0x7fad340fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.943+0000 7fad3aa42640 1 -- 172.21.15.118:0/3539613034 shutdown_connections 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.943+0000 7fad3aa42640 1 -- 172.21.15.118:0/3539613034 wait complete. 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.943+0000 7fad3aa42640 1 Processor -- start 2024-09-21T11:53:33.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad3aa42640 1 -- start start 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad3aa42640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 0x7fad341987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad3aa42640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad341067e0 0x7fad34198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad3aa42640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fad3410dc90 con 0x7fad341007e0 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad3aa42640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fad3410db10 con 0x7fad341067e0 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad33fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 0x7fad341987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad33fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 0x7fad341987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48082/0 (socket says 172.21.15.118:48082) 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad33fff640 1 -- 172.21.15.118:0/4251177901 learned_addr learned my addr 172.21.15.118:0/4251177901 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad2bfff640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad341067e0 0x7fad34198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad33fff640 1 -- 172.21.15.118:0/4251177901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad341067e0 msgr2=0x7fad34198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad33fff640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad341067e0 0x7fad34198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad33fff640 1 -- 172.21.15.118:0/4251177901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad34199270 con 0x7fad341007e0 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad33fff640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 0x7fad341987c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c8a0 tx=0x7fad2400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.944+0000 7fad31ffb640 1 -- 172.21.15.118:0/4251177901 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad240079b0 con 0x7fad341007e0 2024-09-21T11:53:33.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.945+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad34199560 con 0x7fad341007e0 2024-09-21T11:53:33.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.945+0000 7fad31ffb640 1 -- 172.21.15.118:0/4251177901 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad24007b50 con 0x7fad341007e0 2024-09-21T11:53:33.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.945+0000 7fad31ffb640 1 -- 172.21.15.118:0/4251177901 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad24018700 con 0x7fad341007e0 2024-09-21T11:53:33.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.945+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad341a1b60 con 0x7fad341007e0 2024-09-21T11:53:33.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.946+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad34101f20 con 0x7fad341007e0 2024-09-21T11:53:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.946+0000 7fad31ffb640 1 -- 172.21.15.118:0/4251177901 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fad24007d00 con 0x7fad341007e0 2024-09-21T11:53:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.947+0000 7fad31ffb640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fad2007af30 0x7fad2007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:53:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.947+0000 7fad2bfff640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fad2007af30 0x7fad2007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:53:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.947+0000 7fad31ffb640 1 -- 172.21.15.118:0/4251177901 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fad2409e350 con 0x7fad341007e0 2024-09-21T11:53:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.947+0000 7fad2bfff640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fad2007af30 0x7fad2007d3f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fad3406a680 tx=0x7fad1c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:53:33.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:33.951+0000 7fad31ffb640 1 -- 172.21.15.118:0/4251177901 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad24014030 con 0x7fad341007e0 2024-09-21T11:53:34.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.197+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fad34100c40 con 0x7fad341007e0 2024-09-21T11:53:34.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.197+0000 7fad31ffb640 1 -- 172.21.15.118:0/4251177901 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fad24069840 con 0x7fad341007e0 2024-09-21T11:53:34.200 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:53:34.200 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:53:34.200 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:53:34.200 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:53:34.200 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:53:34.200 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:53:34.200 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fad2007af30 msgr2=0x7fad2007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fad2007af30 0x7fad2007d3f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fad3406a680 tx=0x7fad1c031400 comp rx=0 tx=0).stop 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 msgr2=0x7fad341987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 0x7fad341987c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c8a0 tx=0x7fad2400cd60 comp rx=0 tx=0).stop 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 shutdown_connections 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad341067e0 0x7fad34198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fad2007af30 0x7fad2007d3f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 --2- 172.21.15.118:0/4251177901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad341007e0 0x7fad341987c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 >> 172.21.15.118:0/4251177901 conn(0x7fad340fc4c0 msgr2=0x7fad340fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 shutdown_connections 2024-09-21T11:53:34.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:53:34.199+0000 7fad3aa42640 1 -- 172.21.15.118:0/4251177901 wait complete. 2024-09-21T11:53:34.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:34 smithi118 ceph-mon[111738]: from='client.34648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:34.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:34 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2015886014' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:53:34.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:34 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/4251177901' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:53:34.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:34 smithi149 ceph-mon[79770]: from='client.34648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:34.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:34 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2015886014' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:53:34.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:34 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/4251177901' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:53:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:35 smithi118 ceph-mon[111738]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:35 smithi118 ceph-mon[111738]: pgmap v442: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:53:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:35 smithi149 ceph-mon[79770]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:53:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:35 smithi149 ceph-mon[79770]: pgmap v442: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:53:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:37 smithi118 ceph-mon[111738]: pgmap v443: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:37 smithi149 ceph-mon[79770]: pgmap v443: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:39 smithi118 ceph-mon[111738]: pgmap v444: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:39.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:39 smithi149 ceph-mon[79770]: pgmap v444: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:41 smithi118 ceph-mon[111738]: pgmap v445: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:41 smithi149 ceph-mon[79770]: pgmap v445: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:43.752 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:43 smithi149 ceph-mon[79770]: pgmap v446: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:43 smithi118 ceph-mon[111738]: pgmap v446: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:46.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:45 smithi118 ceph-mon[111738]: pgmap v447: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:45 smithi149 ceph-mon[79770]: pgmap v447: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:47 smithi118 ceph-mon[111738]: pgmap v448: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:47 smithi149 ceph-mon[79770]: pgmap v448: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:49 smithi118 ceph-mon[111738]: pgmap v449: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:49 smithi149 ceph-mon[79770]: pgmap v449: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:53:51.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:53:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:51 smithi118 ceph-mon[111738]: pgmap v450: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:52.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:51 smithi149 ceph-mon[79770]: pgmap v450: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:53.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:53 smithi149 ceph-mon[79770]: pgmap v451: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:53 smithi118 ceph-mon[111738]: pgmap v451: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:56.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:55 smithi118 ceph-mon[111738]: pgmap v452: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:56.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:55 smithi149 ceph-mon[79770]: pgmap v452: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:57 smithi118 ceph-mon[111738]: pgmap v453: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:53:58.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:57 smithi149 ceph-mon[79770]: pgmap v453: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:00.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:53:59 smithi118 ceph-mon[111738]: pgmap v454: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:00.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:53:59 smithi149 ceph-mon[79770]: pgmap v454: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:01 smithi118 ceph-mon[111738]: pgmap v455: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:02.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:01 smithi149 ceph-mon[79770]: pgmap v455: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:03 smithi118 ceph-mon[111738]: pgmap v456: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:04.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:03 smithi149 ceph-mon[79770]: pgmap v456: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.295+0000 7f06897c5640 1 -- 172.21.15.118:0/364647985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 msgr2=0x7f0684100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.295+0000 7f06897c5640 1 --2- 172.21.15.118:0/364647985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 0x7f0684100c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f066c009880 tx=0x7f066c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.295+0000 7f06897c5640 1 -- 172.21.15.118:0/364647985 shutdown_connections 2024-09-21T11:54:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.295+0000 7f06897c5640 1 --2- 172.21.15.118:0/364647985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 0x7f0684100c40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.295+0000 7f06897c5640 1 --2- 172.21.15.118:0/364647985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06841067e0 0x7f0684106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.295+0000 7f06897c5640 1 -- 172.21.15.118:0/364647985 >> 172.21.15.118:0/364647985 conn(0x7f06840fc4c0 msgr2=0x7f06840fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:04.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.295+0000 7f06897c5640 1 -- 172.21.15.118:0/364647985 shutdown_connections 2024-09-21T11:54:04.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.295+0000 7f06897c5640 1 -- 172.21.15.118:0/364647985 wait complete. 2024-09-21T11:54:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.295+0000 7f06897c5640 1 Processor -- start 2024-09-21T11:54:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f06897c5640 1 -- start start 2024-09-21T11:54:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f06897c5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 0x7f0684198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f06897c5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06841067e0 0x7f0684198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f06897c5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f068410dd10 con 0x7f06841007e0 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f06897c5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f068410db90 con 0x7f06841067e0 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f0682ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 0x7f0684198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f0682ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 0x7f0684198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47474/0 (socket says 172.21.15.118:47474) 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f0682ffd640 1 -- 172.21.15.118:0/940789660 learned_addr learned my addr 172.21.15.118:0/940789660 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f06827fc640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06841067e0 0x7f0684198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f0682ffd640 1 -- 172.21.15.118:0/940789660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06841067e0 msgr2=0x7f0684198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f0682ffd640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06841067e0 0x7f0684198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f0682ffd640 1 -- 172.21.15.118:0/940789660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0684199380 con 0x7f06841007e0 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.296+0000 7f0682ffd640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 0x7f0684198840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f067400ba50 tx=0x7f067400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.297+0000 7f067bfff640 1 -- 172.21.15.118:0/940789660 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0674019070 con 0x7f06841007e0 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.297+0000 7f067bfff640 1 -- 172.21.15.118:0/940789660 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f067400ce20 con 0x7f06841007e0 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.297+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0684199670 con 0x7f06841007e0 2024-09-21T11:54:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.297+0000 7f067bfff640 1 -- 172.21.15.118:0/940789660 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06740075a0 con 0x7f06841007e0 2024-09-21T11:54:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.297+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06841a1c70 con 0x7f06841007e0 2024-09-21T11:54:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.298+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0684101f20 con 0x7f06841007e0 2024-09-21T11:54:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.298+0000 7f067bfff640 1 -- 172.21.15.118:0/940789660 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f067401c070 con 0x7f06841007e0 2024-09-21T11:54:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.299+0000 7f067bfff640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f067007af80 0x7f067007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.299+0000 7f067bfff640 1 -- 172.21.15.118:0/940789660 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f067409d8b0 con 0x7f06841007e0 2024-09-21T11:54:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.299+0000 7f06827fc640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f067007af80 0x7f067007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.299+0000 7f06827fc640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f067007af80 0x7f067007d440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f066c0096c0 tx=0x7f066c004120 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.303+0000 7f067bfff640 1 -- 172.21.15.118:0/940789660 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0684199670 con 0x7f06841007e0 2024-09-21T11:54:04.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.497+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0684062630 con 0x7f067007af80 2024-09-21T11:54:04.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.499+0000 7f067bfff640 1 -- 172.21.15.118:0/940789660 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0684062630 con 0x7f067007af80 2024-09-21T11:54:04.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f067007af80 msgr2=0x7f067007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f067007af80 0x7f067007d440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f066c0096c0 tx=0x7f066c004120 comp rx=0 tx=0).stop 2024-09-21T11:54:04.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 msgr2=0x7f0684198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 0x7f0684198840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f067400ba50 tx=0x7f067400bf10 comp rx=0 tx=0).stop 2024-09-21T11:54:04.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 shutdown_connections 2024-09-21T11:54:04.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06841067e0 0x7f0684198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f067007af80 0x7f067007d440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 --2- 172.21.15.118:0/940789660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06841007e0 0x7f0684198840 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 >> 172.21.15.118:0/940789660 conn(0x7f06840fc4c0 msgr2=0x7f06840fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:04.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 shutdown_connections 2024-09-21T11:54:04.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.501+0000 7f06897c5640 1 -- 172.21.15.118:0/940789660 wait complete. 2024-09-21T11:54:04.512 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:54:04.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.583+0000 7f331f15f640 1 -- 172.21.15.118:0/4255744005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 msgr2=0x7f3318106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.583+0000 7f331f15f640 1 --2- 172.21.15.118:0/4255744005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 0x7f3318106bc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f330c009880 tx=0x7f330c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.583+0000 7f331f15f640 1 -- 172.21.15.118:0/4255744005 shutdown_connections 2024-09-21T11:54:04.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.583+0000 7f331f15f640 1 --2- 172.21.15.118:0/4255744005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33181007e0 0x7f3318100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.583+0000 7f331f15f640 1 --2- 172.21.15.118:0/4255744005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 0x7f3318106bc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.583+0000 7f331f15f640 1 -- 172.21.15.118:0/4255744005 >> 172.21.15.118:0/4255744005 conn(0x7f33180fc4c0 msgr2=0x7f33180fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:04.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.583+0000 7f331f15f640 1 -- 172.21.15.118:0/4255744005 shutdown_connections 2024-09-21T11:54:04.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.583+0000 7f331f15f640 1 -- 172.21.15.118:0/4255744005 wait complete. 2024-09-21T11:54:04.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f331f15f640 1 Processor -- start 2024-09-21T11:54:04.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f331f15f640 1 -- start start 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f331f15f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33181007e0 0x7f3318107710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f331f15f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 0x7f3318107c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f331f15f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f331810dc90 con 0x7f33181067e0 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f331f15f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f331810db10 con 0x7f33181007e0 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f3317fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 0x7f3318107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f3317fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 0x7f3318107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47486/0 (socket says 172.21.15.118:47486) 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f3317fff640 1 -- 172.21.15.118:0/502826133 learned_addr learned my addr 172.21.15.118:0/502826133 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.584+0000 7f331cefb640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33181007e0 0x7f3318107710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f3317fff640 1 -- 172.21.15.118:0/502826133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33181007e0 msgr2=0x7f3318107710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f3317fff640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33181007e0 0x7f3318107710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f3317fff640 1 -- 172.21.15.118:0/502826133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3318108190 con 0x7f33181067e0 2024-09-21T11:54:04.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f331cefb640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33181007e0 0x7f3318107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:54:04.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f3317fff640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 0x7f3318107c50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f330400d8d0 tx=0x7f330400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:04.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f3315ffb640 1 -- 172.21.15.118:0/502826133 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3304017070 con 0x7f33181067e0 2024-09-21T11:54:04.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f3315ffb640 1 -- 172.21.15.118:0/502826133 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3304010460 con 0x7f33181067e0 2024-09-21T11:54:04.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3318108480 con 0x7f33181067e0 2024-09-21T11:54:04.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f3315ffb640 1 -- 172.21.15.118:0/502826133 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f330400f5f0 con 0x7f33181067e0 2024-09-21T11:54:04.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.585+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33181a3de0 con 0x7f33181067e0 2024-09-21T11:54:04.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.586+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3318101f20 con 0x7f33181067e0 2024-09-21T11:54:04.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.586+0000 7f3315ffb640 1 -- 172.21.15.118:0/502826133 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3304009a30 con 0x7f33181067e0 2024-09-21T11:54:04.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.587+0000 7f3315ffb640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:04.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.587+0000 7f3315ffb640 1 -- 172.21.15.118:0/502826133 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f330409deb0 con 0x7f33181067e0 2024-09-21T11:54:04.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.587+0000 7f331cefb640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:04.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.588+0000 7f331cefb640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f330c006010 tx=0x7f330c0095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:04.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.591+0000 7f3315ffb640 1 -- 172.21.15.118:0/502826133 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3304069480 con 0x7f33181067e0 2024-09-21T11:54:04.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.788+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f331806a300 con 0x7f330807af80 2024-09-21T11:54:04.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.789+0000 7f3315ffb640 1 -- 172.21.15.118:0/502826133 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f331806a300 con 0x7f330807af80 2024-09-21T11:54:04.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 msgr2=0x7f330807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f330c006010 tx=0x7f330c0095f0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 msgr2=0x7f3318107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 0x7f3318107c50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f330400d8d0 tx=0x7f330400dd90 comp rx=0 tx=0).stop 2024-09-21T11:54:04.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 shutdown_connections 2024-09-21T11:54:04.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33181067e0 0x7f3318107c50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 --2- 172.21.15.118:0/502826133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33181007e0 0x7f3318107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 >> 172.21.15.118:0/502826133 conn(0x7f33180fc4c0 msgr2=0x7f3318069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:04.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 shutdown_connections 2024-09-21T11:54:04.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.791+0000 7f331f15f640 1 -- 172.21.15.118:0/502826133 wait complete. 2024-09-21T11:54:04.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.872+0000 7f1893c75640 1 -- 172.21.15.118:0/202438956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 msgr2=0x7f188c10b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.872+0000 7f1893c75640 1 --2- 172.21.15.118:0/202438956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 0x7f188c10b8b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1880009880 tx=0x7f188002a530 comp rx=0 tx=0).stop 2024-09-21T11:54:04.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.872+0000 7f1893c75640 1 -- 172.21.15.118:0/202438956 shutdown_connections 2024-09-21T11:54:04.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.872+0000 7f1893c75640 1 --2- 172.21.15.118:0/202438956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 0x7f188c10b8b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.872+0000 7f1893c75640 1 --2- 172.21.15.118:0/202438956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f188c102aa0 0x7f188c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.872+0000 7f1893c75640 1 -- 172.21.15.118:0/202438956 >> 172.21.15.118:0/202438956 conn(0x7f188c0fc4c0 msgr2=0x7f188c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:04.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.873+0000 7f1893c75640 1 -- 172.21.15.118:0/202438956 shutdown_connections 2024-09-21T11:54:04.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.873+0000 7f1893c75640 1 -- 172.21.15.118:0/202438956 wait complete. 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.873+0000 7f1893c75640 1 Processor -- start 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.873+0000 7f1893c75640 1 -- start start 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.873+0000 7f1893c75640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f188c102aa0 0x7f188c19d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1893c75640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 0x7f188c19dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1893c75640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f188c10ee30 con 0x7f188c1033c0 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1893c75640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f188c10ecb0 con 0x7f188c102aa0 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1891210640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 0x7f188c19dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1891210640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 0x7f188c19dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47504/0 (socket says 172.21.15.118:47504) 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1891210640 1 -- 172.21.15.118:0/2232468643 learned_addr learned my addr 172.21.15.118:0/2232468643 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1891a11640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f188c102aa0 0x7f188c19d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:04.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1891210640 1 -- 172.21.15.118:0/2232468643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f188c102aa0 msgr2=0x7f188c19d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:04.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1891210640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f188c102aa0 0x7f188c19d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:04.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1891210640 1 -- 172.21.15.118:0/2232468643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c1978e0 con 0x7f188c1033c0 2024-09-21T11:54:04.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1891210640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 0x7f188c19dc60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1880031460 tx=0x7f18800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:04.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f188affd640 1 -- 172.21.15.118:0/2232468643 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f188003f070 con 0x7f188c1033c0 2024-09-21T11:54:04.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f188affd640 1 -- 172.21.15.118:0/2232468643 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1880004ac0 con 0x7f188c1033c0 2024-09-21T11:54:04.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.874+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c197b70 con 0x7f188c1033c0 2024-09-21T11:54:04.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.875+0000 7f188affd640 1 -- 172.21.15.118:0/2232468643 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1880035030 con 0x7f188c1033c0 2024-09-21T11:54:04.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.875+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c1980a0 con 0x7f188c1033c0 2024-09-21T11:54:04.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.876+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188c06a410 con 0x7f188c1033c0 2024-09-21T11:54:04.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.876+0000 7f188affd640 1 -- 172.21.15.118:0/2232468643 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1880042070 con 0x7f188c1033c0 2024-09-21T11:54:04.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.877+0000 7f188affd640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f187407af90 0x7f187407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:04.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.877+0000 7f188affd640 1 -- 172.21.15.118:0/2232468643 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f18800bea70 con 0x7f188c1033c0 2024-09-21T11:54:04.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.877+0000 7f1891a11640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f187407af90 0x7f187407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:04.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.877+0000 7f1891a11640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f187407af90 0x7f187407d450 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f188c198a20 tx=0x7f187c00d040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:04.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:04.882+0000 7f188affd640 1 -- 172.21.15.118:0/2232468643 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f188008a040 con 0x7f188c1033c0 2024-09-21T11:54:05.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.069+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f188c198e10 con 0x7f187407af90 2024-09-21T11:54:05.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.078+0000 7f188affd640 1 -- 172.21.15.118:0/2232468643 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f188c198e10 con 0x7f187407af90 2024-09-21T11:54:05.080 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (12m) 6m ago 22m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (15m) 6m ago 23m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (14m) 5m ago 22m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (10m) 6m ago 23m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (10m) 5m ago 22m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (11m) 6m ago 22m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (6m) 6m ago 17m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (6m) 6m ago 17m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (17m) 5m ago 17m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (5m) 5m ago 17m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (14m) 6m ago 24m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (13m) 5m ago 22m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:54:05.081 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (10m) 6m ago 24m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (10m) 5m ago 22m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (12m) 6m ago 23m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (12m) 5m ago 22m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (9m) 6m ago 20m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (9m) 6m ago 20m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (8m) 6m ago 19m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (7m) 5m ago 19m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (7m) 5m ago 19m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (6m) 5m ago 18m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:54:05.082 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (12m) 6m ago 22m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:54:05.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.080+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f187407af90 msgr2=0x7f187407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.080+0000 7f1893c75640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f187407af90 0x7f187407d450 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f188c198a20 tx=0x7f187c00d040 comp rx=0 tx=0).stop 2024-09-21T11:54:05.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.080+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 msgr2=0x7f188c19dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.080+0000 7f1893c75640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 0x7f188c19dc60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1880031460 tx=0x7f18800046c0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.080+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 shutdown_connections 2024-09-21T11:54:05.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.080+0000 7f1893c75640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f187407af90 0x7f187407d450 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.080+0000 7f1893c75640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c1033c0 0x7f188c19dc60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.080+0000 7f1893c75640 1 --2- 172.21.15.118:0/2232468643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f188c102aa0 0x7f188c19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.080+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 >> 172.21.15.118:0/2232468643 conn(0x7f188c0fc4c0 msgr2=0x7f188c107e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:05.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.081+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 shutdown_connections 2024-09-21T11:54:05.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.081+0000 7f1893c75640 1 -- 172.21.15.118:0/2232468643 wait complete. 2024-09-21T11:54:05.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.161+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2960072851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c101930 msgr2=0x7f1f9c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.161+0000 7f1fa13bd640 1 --2- 172.21.15.118:0/2960072851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c101930 0x7f1f9c101d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009880 tx=0x7f1f8402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.161+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2960072851 shutdown_connections 2024-09-21T11:54:05.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.161+0000 7f1fa13bd640 1 --2- 172.21.15.118:0/2960072851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c101930 0x7f1f9c101d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.161+0000 7f1fa13bd640 1 --2- 172.21.15.118:0/2960072851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f9c107930 0x7f1f9c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.161+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2960072851 >> 172.21.15.118:0/2960072851 conn(0x7f1f9c0fd630 msgr2=0x7f1f9c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:05.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.161+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2960072851 shutdown_connections 2024-09-21T11:54:05.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.161+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2960072851 wait complete. 2024-09-21T11:54:05.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1fa13bd640 1 Processor -- start 2024-09-21T11:54:05.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1fa13bd640 1 -- start start 2024-09-21T11:54:05.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1fa13bd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f9c101930 0x7f1f9c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:05.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1fa13bd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c107930 0x7f1f9c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:05.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1fa13bd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c10ede0 con 0x7f1f9c107930 2024-09-21T11:54:05.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1fa13bd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c10ec60 con 0x7f1f9c101930 2024-09-21T11:54:05.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1f9a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c107930 0x7f1f9c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:05.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1f9a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c107930 0x7f1f9c19dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47516/0 (socket says 172.21.15.118:47516) 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1f9a7fc640 1 -- 172.21.15.118:0/2171939908 learned_addr learned my addr 172.21.15.118:0/2171939908 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1f9affd640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f9c101930 0x7f1f9c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1f9a7fc640 1 -- 172.21.15.118:0/2171939908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f9c101930 msgr2=0x7f1f9c19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1f9a7fc640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f9c101930 0x7f1f9c19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.162+0000 7f1f9a7fc640 1 -- 172.21.15.118:0/2171939908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c197850 con 0x7f1f9c107930 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.163+0000 7f1f9a7fc640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c107930 0x7f1f9c19dc10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f84031460 tx=0x7f1f840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.163+0000 7f1f93fff640 1 -- 172.21.15.118:0/2171939908 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f8403f070 con 0x7f1f9c107930 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.163+0000 7f1f93fff640 1 -- 172.21.15.118:0/2171939908 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1f840035f0 con 0x7f1f9c107930 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.163+0000 7f1f93fff640 1 -- 172.21.15.118:0/2171939908 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f84035030 con 0x7f1f9c107930 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.163+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c197ae0 con 0x7f1f9c107930 2024-09-21T11:54:05.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.163+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c198010 con 0x7f1f9c107930 2024-09-21T11:54:05.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.164+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c103070 con 0x7f1f9c107930 2024-09-21T11:54:05.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.164+0000 7f1f93fff640 1 -- 172.21.15.118:0/2171939908 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1f84042070 con 0x7f1f9c107930 2024-09-21T11:54:05.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.165+0000 7f1f93fff640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1f8807af80 0x7f1f8807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:05.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.165+0000 7f1f9affd640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1f8807af80 0x7f1f8807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:05.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.165+0000 7f1f93fff640 1 -- 172.21.15.118:0/2171939908 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f1f840be9c0 con 0x7f1f9c107930 2024-09-21T11:54:05.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.166+0000 7f1f9affd640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1f8807af80 0x7f1f8807d440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f94005fd0 tx=0x7f1f94009870 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:05.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.170+0000 7f1f93fff640 1 -- 172.21.15.118:0/2171939908 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f84089f90 con 0x7f1f9c107930 2024-09-21T11:54:05.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.413+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1f9c109ec0 con 0x7f1f9c107930 2024-09-21T11:54:05.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.413+0000 7f1f93fff640 1 -- 172.21.15.118:0/2171939908 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f1f8408ee40 con 0x7f1f9c107930 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:54:05.416 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:54:05.417 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:54:05.417 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:54:05.417 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:54:05.417 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:54:05.417 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:54:05.417 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:54:05.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1f8807af80 msgr2=0x7f1f8807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1f8807af80 0x7f1f8807d440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f94005fd0 tx=0x7f1f94009870 comp rx=0 tx=0).stop 2024-09-21T11:54:05.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c107930 msgr2=0x7f1f9c19dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c107930 0x7f1f9c19dc10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f84031460 tx=0x7f1f840045e0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 shutdown_connections 2024-09-21T11:54:05.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1f8807af80 0x7f1f8807d440 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f9c107930 0x7f1f9c19dc10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 --2- 172.21.15.118:0/2171939908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f9c101930 0x7f1f9c19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 >> 172.21.15.118:0/2171939908 conn(0x7f1f9c0fd630 msgr2=0x7f1f9c0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:05.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 shutdown_connections 2024-09-21T11:54:05.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.416+0000 7f1fa13bd640 1 -- 172.21.15.118:0/2171939908 wait complete. 2024-09-21T11:54:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 -- 172.21.15.118:0/119126069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 msgr2=0x7f94dc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 --2- 172.21.15.118:0/119126069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 0x7f94dc106c00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009880 tx=0x7f94cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 -- 172.21.15.118:0/119126069 shutdown_connections 2024-09-21T11:54:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 --2- 172.21.15.118:0/119126069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc100820 0x7f94dc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 --2- 172.21.15.118:0/119126069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 0x7f94dc106c00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 -- 172.21.15.118:0/119126069 >> 172.21.15.118:0/119126069 conn(0x7f94dc0fc520 msgr2=0x7f94dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 -- 172.21.15.118:0/119126069 shutdown_connections 2024-09-21T11:54:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 -- 172.21.15.118:0/119126069 wait complete. 2024-09-21T11:54:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 Processor -- start 2024-09-21T11:54:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.498+0000 7f94e43fa640 1 -- start start 2024-09-21T11:54:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e43fa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc100820 0x7f94dc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e43fa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 0x7f94dc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e43fa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc10dd50 con 0x7f94dc106820 2024-09-21T11:54:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e43fa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc10dbd0 con 0x7f94dc100820 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e1995640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 0x7f94dc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e1995640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 0x7f94dc19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38206/0 (socket says 172.21.15.118:38206) 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e1995640 1 -- 172.21.15.118:0/2132381340 learned_addr learned my addr 172.21.15.118:0/2132381340 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e1995640 1 -- 172.21.15.118:0/2132381340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc100820 msgr2=0x7f94dc19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e1995640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc100820 0x7f94dc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e1995640 1 -- 172.21.15.118:0/2132381340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc197820 con 0x7f94dc106820 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e1995640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 0x7f94dc19dbe0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f94d800b420 tx=0x7f94d800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94d37fe640 1 -- 172.21.15.118:0/2132381340 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94d8011630 con 0x7f94dc106820 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94dc197b10 con 0x7f94dc106820 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94d37fe640 1 -- 172.21.15.118:0/2132381340 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94d8016070 con 0x7f94dc106820 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94d37fe640 1 -- 172.21.15.118:0/2132381340 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94d8010d40 con 0x7f94dc106820 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.499+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94dc1980a0 con 0x7f94dc106820 2024-09-21T11:54:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.500+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94dc101f60 con 0x7f94dc106820 2024-09-21T11:54:05.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.501+0000 7f94d37fe640 1 -- 172.21.15.118:0/2132381340 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f94d801b460 con 0x7f94dc106820 2024-09-21T11:54:05.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.501+0000 7f94d37fe640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f94c807af30 0x7f94c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:05.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.501+0000 7f94d37fe640 1 -- 172.21.15.118:0/2132381340 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f94d809d7f0 con 0x7f94dc106820 2024-09-21T11:54:05.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.501+0000 7f94e2196640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f94c807af30 0x7f94c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:05.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.502+0000 7f94e2196640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f94c807af30 0x7f94c807d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0096c0 tx=0x7f94cc000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:05.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.506+0000 7f94d37fe640 1 -- 172.21.15.118:0/2132381340 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94d8021250 con 0x7f94dc106820 2024-09-21T11:54:05.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.717+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f94dc1983b0 con 0x7f94dc106820 2024-09-21T11:54:05.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.717+0000 7f94d37fe640 1 -- 172.21.15.118:0/2132381340 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f94d8068d40 con 0x7f94dc106820 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:54:05.720 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:54:05.721 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:54:05.722 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:54:05.723 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:54:05.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f94c807af30 msgr2=0x7f94c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f94c807af30 0x7f94c807d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0096c0 tx=0x7f94cc000bc0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 msgr2=0x7f94dc19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 0x7f94dc19dbe0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f94d800b420 tx=0x7f94d800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 shutdown_connections 2024-09-21T11:54:05.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f94c807af30 0x7f94c807d3f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94dc106820 0x7f94dc19dbe0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 --2- 172.21.15.118:0/2132381340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94dc100820 0x7f94dc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 >> 172.21.15.118:0/2132381340 conn(0x7f94dc0fc520 msgr2=0x7f94dc1045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:05.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 shutdown_connections 2024-09-21T11:54:05.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.720+0000 7f94e43fa640 1 -- 172.21.15.118:0/2132381340 wait complete. 2024-09-21T11:54:05.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.803+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1779021712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241067e0 msgr2=0x7f1d24106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.803+0000 7f1d2bafd640 1 --2- 172.21.15.118:0/1779021712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241067e0 0x7f1d24106bc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009880 tx=0x7f1d1402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.804+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1779021712 shutdown_connections 2024-09-21T11:54:05.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.804+0000 7f1d2bafd640 1 --2- 172.21.15.118:0/1779021712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d241007e0 0x7f1d24100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.804+0000 7f1d2bafd640 1 --2- 172.21.15.118:0/1779021712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241067e0 0x7f1d24106bc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.804+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1779021712 >> 172.21.15.118:0/1779021712 conn(0x7f1d240fc4c0 msgr2=0x7f1d240fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:05.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.804+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1779021712 shutdown_connections 2024-09-21T11:54:05.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.804+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1779021712 wait complete. 2024-09-21T11:54:05.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.804+0000 7f1d2bafd640 1 Processor -- start 2024-09-21T11:54:05.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.804+0000 7f1d2bafd640 1 -- start start 2024-09-21T11:54:05.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.804+0000 7f1d2bafd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241007e0 0x7f1d240fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:05.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d2bafd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d241067e0 0x7f1d240fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d2bafd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2410dcb0 con 0x7f1d241007e0 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d2bafd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2410db30 con 0x7f1d241067e0 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d29899640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241007e0 0x7f1d240fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d29899640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241007e0 0x7f1d240fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38226/0 (socket says 172.21.15.118:38226) 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d29899640 1 -- 172.21.15.118:0/1285231076 learned_addr learned my addr 172.21.15.118:0/1285231076 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d29098640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d241067e0 0x7f1d240fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d29899640 1 -- 172.21.15.118:0/1285231076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d241067e0 msgr2=0x7f1d240fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d29899640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d241067e0 0x7f1d240fd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d29899640 1 -- 172.21.15.118:0/1285231076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d240fd690 con 0x7f1d241007e0 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d29899640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241007e0 0x7f1d240fcc10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1d14031460 tx=0x7f1d140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d1affd640 1 -- 172.21.15.118:0/1285231076 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d1403f070 con 0x7f1d241007e0 2024-09-21T11:54:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d240fd920 con 0x7f1d241007e0 2024-09-21T11:54:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d1affd640 1 -- 172.21.15.118:0/1285231076 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d140035f0 con 0x7f1d241007e0 2024-09-21T11:54:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d1affd640 1 -- 172.21.15.118:0/1285231076 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d14035030 con 0x7f1d241007e0 2024-09-21T11:54:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.805+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d241a3d50 con 0x7f1d241007e0 2024-09-21T11:54:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.806+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d24101f20 con 0x7f1d241007e0 2024-09-21T11:54:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.807+0000 7f1d1affd640 1 -- 172.21.15.118:0/1285231076 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1d14042070 con 0x7f1d241007e0 2024-09-21T11:54:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.808+0000 7f1d1affd640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d1007af30 0x7f1d1007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.808+0000 7f1d1affd640 1 -- 172.21.15.118:0/1285231076 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f1d140bea20 con 0x7f1d241007e0 2024-09-21T11:54:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.808+0000 7f1d29098640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d1007af30 0x7f1d1007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.808+0000 7f1d29098640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d1007af30 0x7f1d1007d3f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1d240fe6a0 tx=0x7f1d2000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:05.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:05.812+0000 7f1d1affd640 1 -- 172.21.15.118:0/1285231076 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d14089f70 con 0x7f1d241007e0 2024-09-21T11:54:06.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.005+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1d24109dd0 con 0x7f1d1007af30 2024-09-21T11:54:06.008 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:05 smithi118 ceph-mon[111738]: pgmap v457: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:06.008 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:05 smithi118 ceph-mon[111738]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:06.008 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:54:06.008 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:05 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2171939908' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:54:06.008 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:05 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2132381340' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.007+0000 7f1d1affd640 1 -- 172.21.15.118:0/1285231076 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1d20003890 con 0x7f1d1007af30 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:54:06.009 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:54:06.010 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:54:06.010 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:54:06.010 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:54:06.010 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:54:06.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d1007af30 msgr2=0x7f1d1007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:06.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d1007af30 0x7f1d1007d3f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1d240fe6a0 tx=0x7f1d2000b390 comp rx=0 tx=0).stop 2024-09-21T11:54:06.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241007e0 msgr2=0x7f1d240fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:06.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241007e0 0x7f1d240fcc10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1d14031460 tx=0x7f1d140045e0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 shutdown_connections 2024-09-21T11:54:06.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d241067e0 0x7f1d240fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d1007af30 0x7f1d1007d3f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 --2- 172.21.15.118:0/1285231076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d241007e0 0x7f1d240fcc10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 >> 172.21.15.118:0/1285231076 conn(0x7f1d240fc4c0 msgr2=0x7f1d24069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:06.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 shutdown_connections 2024-09-21T11:54:06.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.009+0000 7f1d2bafd640 1 -- 172.21.15.118:0/1285231076 wait complete. 2024-09-21T11:54:06.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.090+0000 7f80ea81b640 1 -- 172.21.15.118:0/4236914972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41007e0 msgr2=0x7f80e4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:06.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.090+0000 7f80ea81b640 1 --2- 172.21.15.118:0/4236914972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41007e0 0x7f80e4100c40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009880 tx=0x7f80cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.090+0000 7f80ea81b640 1 -- 172.21.15.118:0/4236914972 shutdown_connections 2024-09-21T11:54:06.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.091+0000 7f80ea81b640 1 --2- 172.21.15.118:0/4236914972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41007e0 0x7f80e4100c40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.091+0000 7f80ea81b640 1 --2- 172.21.15.118:0/4236914972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e41067e0 0x7f80e4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.091+0000 7f80ea81b640 1 -- 172.21.15.118:0/4236914972 >> 172.21.15.118:0/4236914972 conn(0x7f80e40fc4c0 msgr2=0x7f80e40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:06.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.091+0000 7f80ea81b640 1 -- 172.21.15.118:0/4236914972 shutdown_connections 2024-09-21T11:54:06.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.091+0000 7f80ea81b640 1 -- 172.21.15.118:0/4236914972 wait complete. 2024-09-21T11:54:06.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.091+0000 7f80ea81b640 1 Processor -- start 2024-09-21T11:54:06.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.091+0000 7f80ea81b640 1 -- start start 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80ea81b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e41007e0 0x7f80e41965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80ea81b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41067e0 0x7f80e4196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80ea81b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f80e410dcb0 con 0x7f80e41067e0 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80ea81b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80e410db30 con 0x7f80e41007e0 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41067e0 0x7f80e4196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41067e0 0x7f80e4196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38250/0 (socket says 172.21.15.118:38250) 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e37fe640 1 -- 172.21.15.118:0/2666708535 learned_addr learned my addr 172.21.15.118:0/2666708535 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e3fff640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e41007e0 0x7f80e41965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e37fe640 1 -- 172.21.15.118:0/2666708535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e41007e0 msgr2=0x7f80e41965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:06.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e37fe640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e41007e0 0x7f80e41965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e37fe640 1 -- 172.21.15.118:0/2666708535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e4197050 con 0x7f80e41067e0 2024-09-21T11:54:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e37fe640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41067e0 0x7f80e4196b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f80cc031460 tx=0x7f80cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e17fa640 1 -- 172.21.15.118:0/2666708535 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80cc03f070 con 0x7f80e41067e0 2024-09-21T11:54:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e17fa640 1 -- 172.21.15.118:0/2666708535 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80cc0035f0 con 0x7f80e41067e0 2024-09-21T11:54:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e41972e0 con 0x7f80e41067e0 2024-09-21T11:54:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.092+0000 7f80e17fa640 1 -- 172.21.15.118:0/2666708535 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80cc035030 con 0x7f80e41067e0 2024-09-21T11:54:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.093+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e41a3e10 con 0x7f80e41067e0 2024-09-21T11:54:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.094+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e4101f20 con 0x7f80e41067e0 2024-09-21T11:54:06.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.094+0000 7f80e17fa640 1 -- 172.21.15.118:0/2666708535 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f80cc042070 con 0x7f80e41067e0 2024-09-21T11:54:06.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.095+0000 7f80e17fa640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80d007af30 0x7f80d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:06.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.095+0000 7f80e17fa640 1 -- 172.21.15.118:0/2666708535 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f80cc0bea20 con 0x7f80e41067e0 2024-09-21T11:54:06.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.095+0000 7f80e3fff640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80d007af30 0x7f80d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:06.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.095+0000 7f80e3fff640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80d007af30 0x7f80d007d3f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f80d4005fd0 tx=0x7f80d400b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:06.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.099+0000 7f80e17fa640 1 -- 172.21.15.118:0/2666708535 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80cc089f70 con 0x7f80e41067e0 2024-09-21T11:54:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:05 smithi149 ceph-mon[79770]: pgmap v457: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:06.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:05 smithi149 ceph-mon[79770]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:06.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:54:06.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:05 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2171939908' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:54:06.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:05 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2132381340' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:54:06.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.345+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f80e4108d50 con 0x7f80e41067e0 2024-09-21T11:54:06.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.346+0000 7f80e17fa640 1 -- 172.21.15.118:0/2666708535 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f80cc08ee20 con 0x7f80e41067e0 2024-09-21T11:54:06.348 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:54:06.348 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:54:06.348 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:54:06.348 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:54:06.348 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:54:06.349 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:54:06.349 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:54:06.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80d007af30 msgr2=0x7f80d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:06.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80d007af30 0x7f80d007d3f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f80d4005fd0 tx=0x7f80d400b390 comp rx=0 tx=0).stop 2024-09-21T11:54:06.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41067e0 msgr2=0x7f80e4196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:06.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41067e0 0x7f80e4196b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f80cc031460 tx=0x7f80cc0045e0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 shutdown_connections 2024-09-21T11:54:06.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80d007af30 0x7f80d007d3f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e41067e0 0x7f80e4196b10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 --2- 172.21.15.118:0/2666708535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e41007e0 0x7f80e41965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:06.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 >> 172.21.15.118:0/2666708535 conn(0x7f80e40fc4c0 msgr2=0x7f80e40fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:06.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 shutdown_connections 2024-09-21T11:54:06.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:06.348+0000 7f80ea81b640 1 -- 172.21.15.118:0/2666708535 wait complete. 2024-09-21T11:54:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:06 smithi118 ceph-mon[111738]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:06 smithi118 ceph-mon[111738]: from='client.34676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:07.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:06 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2666708535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:54:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:06 smithi149 ceph-mon[79770]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:06 smithi149 ceph-mon[79770]: from='client.34676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:07.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:06 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2666708535' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:54:08.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:07 smithi118 ceph-mon[111738]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:08.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:07 smithi118 ceph-mon[111738]: pgmap v458: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:08.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:07 smithi149 ceph-mon[79770]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:08.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:07 smithi149 ceph-mon[79770]: pgmap v458: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:09.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:08 smithi118 ceph-mon[111738]: pgmap v459: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:09.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:08 smithi149 ceph-mon[79770]: pgmap v459: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:11.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:11 smithi149 ceph-mon[79770]: pgmap v460: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:11 smithi118 ceph-mon[111738]: pgmap v460: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:13 smithi149 ceph-mon[79770]: pgmap v461: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:13 smithi118 ceph-mon[111738]: pgmap v461: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:15 smithi149 ceph-mon[79770]: pgmap v462: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:15 smithi118 ceph-mon[111738]: pgmap v462: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:17.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:17 smithi149 ceph-mon[79770]: pgmap v463: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:17.760 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:17 smithi118 ceph-mon[111738]: pgmap v463: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:19 smithi149 ceph-mon[79770]: pgmap v464: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:19 smithi118 ceph-mon[111738]: pgmap v464: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:54:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:54:21.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:21 smithi149 ceph-mon[79770]: pgmap v465: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:21 smithi118 ceph-mon[111738]: pgmap v465: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:23.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:23 smithi149 ceph-mon[79770]: pgmap v466: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:23 smithi118 ceph-mon[111738]: pgmap v466: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:25.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:25 smithi149 ceph-mon[79770]: pgmap v467: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:25 smithi118 ceph-mon[111738]: pgmap v467: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:27 smithi149 ceph-mon[79770]: pgmap v468: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:27 smithi118 ceph-mon[111738]: pgmap v468: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:29.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:29 smithi149 ceph-mon[79770]: pgmap v469: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:29 smithi118 ceph-mon[111738]: pgmap v469: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:31.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:31 smithi149 ceph-mon[79770]: pgmap v470: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:31 smithi118 ceph-mon[111738]: pgmap v470: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:33 smithi149 ceph-mon[79770]: pgmap v471: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:33 smithi118 ceph-mon[111738]: pgmap v471: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:35 smithi149 ceph-mon[79770]: pgmap v472: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:54:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:35 smithi118 ceph-mon[111738]: pgmap v472: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:54:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.443+0000 7f5ff064b640 1 -- 172.21.15.118:0/4218115138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8106820 msgr2=0x7f5fe8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.443+0000 7f5ff064b640 1 --2- 172.21.15.118:0/4218115138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8106820 0x7f5fe8106c00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009880 tx=0x7f5fe002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.443+0000 7f5ff064b640 1 -- 172.21.15.118:0/4218115138 shutdown_connections 2024-09-21T11:54:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.443+0000 7f5ff064b640 1 --2- 172.21.15.118:0/4218115138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fe8100820 0x7f5fe8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.443+0000 7f5ff064b640 1 --2- 172.21.15.118:0/4218115138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8106820 0x7f5fe8106c00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.443+0000 7f5ff064b640 1 -- 172.21.15.118:0/4218115138 >> 172.21.15.118:0/4218115138 conn(0x7f5fe80fc520 msgr2=0x7f5fe80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.443+0000 7f5ff064b640 1 -- 172.21.15.118:0/4218115138 shutdown_connections 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.443+0000 7f5ff064b640 1 -- 172.21.15.118:0/4218115138 wait complete. 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.444+0000 7f5ff064b640 1 Processor -- start 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.444+0000 7f5ff064b640 1 -- start start 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.444+0000 7f5ff064b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8100820 0x7f5fe80fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.444+0000 7f5ff064b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fe8106820 0x7f5fe80fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.444+0000 7f5ff064b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe810dcf0 con 0x7f5fe8100820 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.444+0000 7f5ff064b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe810db70 con 0x7f5fe8106820 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.444+0000 7f5fee3e7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8100820 0x7f5fe80fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fee3e7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8100820 0x7f5fe80fcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46936/0 (socket says 172.21.15.118:46936) 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fee3e7640 1 -- 172.21.15.118:0/1272552652 learned_addr learned my addr 172.21.15.118:0/1272552652 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fedbe6640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fe8106820 0x7f5fe80fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:36.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fee3e7640 1 -- 172.21.15.118:0/1272552652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fe8106820 msgr2=0x7f5fe80fd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:36.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fee3e7640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fe8106820 0x7f5fe80fd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fee3e7640 1 -- 172.21.15.118:0/1272552652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe80fd680 con 0x7f5fe8100820 2024-09-21T11:54:36.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fee3e7640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8100820 0x7f5fe80fcc00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0031460 tx=0x7f5fe00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fe77fe640 1 -- 172.21.15.118:0/1272552652 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fe003f070 con 0x7f5fe8100820 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe80fd910 con 0x7f5fe8100820 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fe77fe640 1 -- 172.21.15.118:0/1272552652 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fe0004cf0 con 0x7f5fe8100820 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5fe77fe640 1 -- 172.21.15.118:0/1272552652 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fe0035030 con 0x7f5fe8100820 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.445+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe81a3da0 con 0x7f5fe8100820 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.446+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe8101f60 con 0x7f5fe8100820 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.447+0000 7f5fe77fe640 1 -- 172.21.15.118:0/1272552652 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5fe0042070 con 0x7f5fe8100820 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.448+0000 7f5fe77fe640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fd007af30 0x7f5fd007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.448+0000 7f5fe77fe640 1 -- 172.21.15.118:0/1272552652 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f5fe00beac0 con 0x7f5fe8100820 2024-09-21T11:54:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.448+0000 7f5fedbe6640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fd007af30 0x7f5fd007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.448+0000 7f5fedbe6640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fd007af30 0x7f5fd007d3f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80fe690 tx=0x7f5fdc00a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.452+0000 7f5fe77fe640 1 -- 172.21.15.118:0/1272552652 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fe008a010 con 0x7f5fe8100820 2024-09-21T11:54:36.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.643+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5fe8109e10 con 0x7f5fd007af30 2024-09-21T11:54:36.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.645+0000 7f5fe77fe640 1 -- 172.21.15.118:0/1272552652 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5fdc00fb30 con 0x7f5fd007af30 2024-09-21T11:54:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fd007af30 msgr2=0x7f5fd007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fd007af30 0x7f5fd007d3f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80fe690 tx=0x7f5fdc00a250 comp rx=0 tx=0).stop 2024-09-21T11:54:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8100820 msgr2=0x7f5fe80fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8100820 0x7f5fe80fcc00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0031460 tx=0x7f5fe00048f0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 shutdown_connections 2024-09-21T11:54:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fe8106820 0x7f5fe80fd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fd007af30 0x7f5fd007d3f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 --2- 172.21.15.118:0/1272552652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe8100820 0x7f5fe80fcc00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 >> 172.21.15.118:0/1272552652 conn(0x7f5fe80fc520 msgr2=0x7f5fe806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 shutdown_connections 2024-09-21T11:54:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.647+0000 7f5ff064b640 1 -- 172.21.15.118:0/1272552652 wait complete. 2024-09-21T11:54:36.657 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:54:36.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.730+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/136583632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 msgr2=0x7fe6d810b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:36.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.730+0000 7fe6dd6fa640 1 --2- 172.21.15.118:0/136583632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 0x7fe6d810b8b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009880 tx=0x7fe6c002a530 comp rx=0 tx=0).stop 2024-09-21T11:54:36.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.730+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/136583632 shutdown_connections 2024-09-21T11:54:36.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.730+0000 7fe6dd6fa640 1 --2- 172.21.15.118:0/136583632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 0x7fe6d810b8b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.730+0000 7fe6dd6fa640 1 --2- 172.21.15.118:0/136583632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8102aa0 0x7fe6d8102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.730+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/136583632 >> 172.21.15.118:0/136583632 conn(0x7fe6d80fc4c0 msgr2=0x7fe6d80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:36.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.730+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/136583632 shutdown_connections 2024-09-21T11:54:36.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.730+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/136583632 wait complete. 2024-09-21T11:54:36.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.730+0000 7fe6dd6fa640 1 Processor -- start 2024-09-21T11:54:36.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6dd6fa640 1 -- start start 2024-09-21T11:54:36.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6dd6fa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8102aa0 0x7fe6d819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6dd6fa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 0x7fe6d819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6dd6fa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d810edb0 con 0x7fe6d81033c0 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6dd6fa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d810ec30 con 0x7fe6d8102aa0 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6ce7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 0x7fe6d819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6ce7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 0x7fe6d819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46952/0 (socket says 172.21.15.118:46952) 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6ce7fc640 1 -- 172.21.15.118:0/3094649923 learned_addr learned my addr 172.21.15.118:0/3094649923 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6d6ffd640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8102aa0 0x7fe6d819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6ce7fc640 1 -- 172.21.15.118:0/3094649923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8102aa0 msgr2=0x7fe6d819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6ce7fc640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8102aa0 0x7fe6d819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6ce7fc640 1 -- 172.21.15.118:0/3094649923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d8197820 con 0x7fe6d81033c0 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6d6ffd640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8102aa0 0x7fe6d819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.731+0000 7fe6ce7fc640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 0x7fe6d819dbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0031460 tx=0x7fe6c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.732+0000 7fe6d4ff9640 1 -- 172.21.15.118:0/3094649923 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6c003f070 con 0x7fe6d81033c0 2024-09-21T11:54:36.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.732+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d8197ab0 con 0x7fe6d81033c0 2024-09-21T11:54:36.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.732+0000 7fe6d4ff9640 1 -- 172.21.15.118:0/3094649923 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6c0004ac0 con 0x7fe6d81033c0 2024-09-21T11:54:36.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.732+0000 7fe6d4ff9640 1 -- 172.21.15.118:0/3094649923 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6c0035030 con 0x7fe6d81033c0 2024-09-21T11:54:36.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.732+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d8197fe0 con 0x7fe6d81033c0 2024-09-21T11:54:36.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.733+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d806a410 con 0x7fe6d81033c0 2024-09-21T11:54:36.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.733+0000 7fe6d4ff9640 1 -- 172.21.15.118:0/3094649923 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe6c0042070 con 0x7fe6d81033c0 2024-09-21T11:54:36.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.734+0000 7fe6d4ff9640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c407af40 0x7fe6c407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:36.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.734+0000 7fe6d6ffd640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c407af40 0x7fe6c407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:36.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.734+0000 7fe6d4ff9640 1 -- 172.21.15.118:0/3094649923 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fe6c00beb30 con 0x7fe6d81033c0 2024-09-21T11:54:36.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.734+0000 7fe6d6ffd640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c407af40 0x7fe6c407d400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800abe0 tx=0x7fe6c800a5c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:36.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.738+0000 7fe6d4ff9640 1 -- 172.21.15.118:0/3094649923 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6c008a080 con 0x7fe6d81033c0 2024-09-21T11:54:36.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.935+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe6d8198290 con 0x7fe6c407af40 2024-09-21T11:54:36.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.937+0000 7fe6d4ff9640 1 -- 172.21.15.118:0/3094649923 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fe6d8198290 con 0x7fe6c407af40 2024-09-21T11:54:36.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c407af40 msgr2=0x7fe6c407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:36.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c407af40 0x7fe6c407d400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800abe0 tx=0x7fe6c800a5c0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 msgr2=0x7fe6d819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:36.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 0x7fe6d819dbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0031460 tx=0x7fe6c00046c0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 shutdown_connections 2024-09-21T11:54:36.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe6c407af40 0x7fe6c407d400 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6d81033c0 0x7fe6d819dbe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 --2- 172.21.15.118:0/3094649923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6d8102aa0 0x7fe6d819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:36.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 >> 172.21.15.118:0/3094649923 conn(0x7fe6d80fc4c0 msgr2=0x7fe6d8108e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:36.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 shutdown_connections 2024-09-21T11:54:36.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:36.939+0000 7fe6dd6fa640 1 -- 172.21.15.118:0/3094649923 wait complete. 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.021+0000 7fce0bc8c640 1 -- 172.21.15.118:0/4056587838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04107930 msgr2=0x7fce04107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.021+0000 7fce0bc8c640 1 --2- 172.21.15.118:0/4056587838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04107930 0x7fce04107d10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fce00009880 tx=0x7fce0002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.021+0000 7fce0bc8c640 1 -- 172.21.15.118:0/4056587838 shutdown_connections 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.021+0000 7fce0bc8c640 1 --2- 172.21.15.118:0/4056587838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce04101930 0x7fce04101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.021+0000 7fce0bc8c640 1 --2- 172.21.15.118:0/4056587838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04107930 0x7fce04107d10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.021+0000 7fce0bc8c640 1 -- 172.21.15.118:0/4056587838 >> 172.21.15.118:0/4056587838 conn(0x7fce040fd630 msgr2=0x7fce040ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.021+0000 7fce0bc8c640 1 -- 172.21.15.118:0/4056587838 shutdown_connections 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.021+0000 7fce0bc8c640 1 -- 172.21.15.118:0/4056587838 wait complete. 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce0bc8c640 1 Processor -- start 2024-09-21T11:54:37.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce0bc8c640 1 -- start start 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce0bc8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04101930 0x7fce0419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce0bc8c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce04107930 0x7fce0419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce0bc8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce0410ee00 con 0x7fce04101930 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce0bc8c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce0410ec80 con 0x7fce04107930 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce09a28640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04101930 0x7fce0419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce09a28640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04101930 0x7fce0419d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46970/0 (socket says 172.21.15.118:46970) 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce09a28640 1 -- 172.21.15.118:0/643387567 learned_addr learned my addr 172.21.15.118:0/643387567 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce09227640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce04107930 0x7fce0419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce09a28640 1 -- 172.21.15.118:0/643387567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce04107930 msgr2=0x7fce0419db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce09a28640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce04107930 0x7fce0419db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.022+0000 7fce09a28640 1 -- 172.21.15.118:0/643387567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce041977d0 con 0x7fce04101930 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.023+0000 7fce09a28640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04101930 0x7fce0419d650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fce00031460 tx=0x7fce000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:37.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.023+0000 7fcdf6ffd640 1 -- 172.21.15.118:0/643387567 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce0003f070 con 0x7fce04101930 2024-09-21T11:54:37.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.023+0000 7fcdf6ffd640 1 -- 172.21.15.118:0/643387567 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce00004cf0 con 0x7fce04101930 2024-09-21T11:54:37.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.023+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce04197a60 con 0x7fce04101930 2024-09-21T11:54:37.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.023+0000 7fcdf6ffd640 1 -- 172.21.15.118:0/643387567 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce00035030 con 0x7fce04101930 2024-09-21T11:54:37.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.023+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce04197f90 con 0x7fce04101930 2024-09-21T11:54:37.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.024+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce04103070 con 0x7fce04101930 2024-09-21T11:54:37.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.025+0000 7fcdf6ffd640 1 -- 172.21.15.118:0/643387567 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fce00042070 con 0x7fce04101930 2024-09-21T11:54:37.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.025+0000 7fcdf6ffd640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcdf007af80 0x7fcdf007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.025+0000 7fce09227640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcdf007af80 0x7fcdf007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.025+0000 7fcdf6ffd640 1 -- 172.21.15.118:0/643387567 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fce000bea90 con 0x7fce04101930 2024-09-21T11:54:37.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.026+0000 7fce09227640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcdf007af80 0x7fcdf007d440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8005fd0 tx=0x7fcdf8005e20 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:37.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.030+0000 7fcdf6ffd640 1 -- 172.21.15.118:0/643387567 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce0008a060 con 0x7fce04101930 2024-09-21T11:54:37.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.216+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fce04198240 con 0x7fcdf007af80 2024-09-21T11:54:37.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.225+0000 7fcdf6ffd640 1 -- 172.21.15.118:0/643387567 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fce04198240 con 0x7fcdf007af80 2024-09-21T11:54:37.226 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:54:37.226 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (12m) 6m ago 23m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (15m) 6m ago 23m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (14m) 6m ago 22m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (10m) 6m ago 23m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (10m) 6m ago 22m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (12m) 6m ago 23m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (6m) 6m ago 18m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (6m) 6m ago 18m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (18m) 6m ago 18m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (6m) 6m ago 18m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (14m) 6m ago 24m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (13m) 6m ago 22m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (11m) 6m ago 25m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (10m) 6m ago 22m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:54:37.227 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (13m) 6m ago 23m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:54:37.228 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (13m) 6m ago 22m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:54:37.228 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (10m) 6m ago 21m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:54:37.228 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (9m) 6m ago 20m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:54:37.228 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (9m) 6m ago 20m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:54:37.228 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (8m) 6m ago 20m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:54:37.228 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (7m) 6m ago 19m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:54:37.228 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (7m) 6m ago 19m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:54:37.228 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (12m) 6m ago 23m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:54:37.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcdf007af80 msgr2=0x7fcdf007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcdf007af80 0x7fcdf007d440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8005fd0 tx=0x7fcdf8005e20 comp rx=0 tx=0).stop 2024-09-21T11:54:37.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04101930 msgr2=0x7fce0419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04101930 0x7fce0419d650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fce00031460 tx=0x7fce000048f0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 shutdown_connections 2024-09-21T11:54:37.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce04107930 0x7fce0419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcdf007af80 0x7fcdf007d440 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 --2- 172.21.15.118:0/643387567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce04101930 0x7fce0419d650 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 >> 172.21.15.118:0/643387567 conn(0x7fce040fd630 msgr2=0x7fce040fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:37.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 shutdown_connections 2024-09-21T11:54:37.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.227+0000 7fce0bc8c640 1 -- 172.21.15.118:0/643387567 wait complete. 2024-09-21T11:54:37.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.307+0000 7fcfc87ea640 1 -- 172.21.15.118:0/2538008871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0106820 msgr2=0x7fcfc0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.307+0000 7fcfc87ea640 1 --2- 172.21.15.118:0/2538008871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0106820 0x7fcfc0106c00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009880 tx=0x7fcfbc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.307+0000 7fcfc87ea640 1 -- 172.21.15.118:0/2538008871 shutdown_connections 2024-09-21T11:54:37.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.307+0000 7fcfc87ea640 1 --2- 172.21.15.118:0/2538008871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc0100820 0x7fcfc0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.307+0000 7fcfc87ea640 1 --2- 172.21.15.118:0/2538008871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0106820 0x7fcfc0106c00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.307+0000 7fcfc87ea640 1 -- 172.21.15.118:0/2538008871 >> 172.21.15.118:0/2538008871 conn(0x7fcfc00fc520 msgr2=0x7fcfc00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:37.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.307+0000 7fcfc87ea640 1 -- 172.21.15.118:0/2538008871 shutdown_connections 2024-09-21T11:54:37.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.307+0000 7fcfc87ea640 1 -- 172.21.15.118:0/2538008871 wait complete. 2024-09-21T11:54:37.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc87ea640 1 Processor -- start 2024-09-21T11:54:37.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc87ea640 1 -- start start 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc87ea640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0100820 0x7fcfc019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc87ea640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc0106820 0x7fcfc019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc87ea640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc010dcf0 con 0x7fcfc0100820 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc87ea640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc010db70 con 0x7fcfc0106820 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc6586640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0100820 0x7fcfc019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc6586640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0100820 0x7fcfc019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46990/0 (socket says 172.21.15.118:46990) 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc6586640 1 -- 172.21.15.118:0/942727189 learned_addr learned my addr 172.21.15.118:0/942727189 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.308+0000 7fcfc5d85640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc0106820 0x7fcfc019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.309+0000 7fcfc6586640 1 -- 172.21.15.118:0/942727189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc0106820 msgr2=0x7fcfc019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.309+0000 7fcfc6586640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc0106820 0x7fcfc019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.309+0000 7fcfc6586640 1 -- 172.21.15.118:0/942727189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc0197810 con 0x7fcfc0100820 2024-09-21T11:54:37.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.309+0000 7fcfc6586640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0100820 0x7fcfc019d690 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc031460 tx=0x7fcfbc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:37.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.309+0000 7fcfb77fe640 1 -- 172.21.15.118:0/942727189 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfbc03f070 con 0x7fcfc0100820 2024-09-21T11:54:37.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.309+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc0197aa0 con 0x7fcfc0100820 2024-09-21T11:54:37.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.309+0000 7fcfb77fe640 1 -- 172.21.15.118:0/942727189 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcfbc0035f0 con 0x7fcfc0100820 2024-09-21T11:54:37.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.309+0000 7fcfb77fe640 1 -- 172.21.15.118:0/942727189 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfbc035030 con 0x7fcfc0100820 2024-09-21T11:54:37.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.309+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc0197fd0 con 0x7fcfc0100820 2024-09-21T11:54:37.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.310+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc0101f60 con 0x7fcfc0100820 2024-09-21T11:54:37.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.311+0000 7fcfb77fe640 1 -- 172.21.15.118:0/942727189 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcfbc042070 con 0x7fcfc0100820 2024-09-21T11:54:37.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.311+0000 7fcfb77fe640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcfac07af80 0x7fcfac07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.311+0000 7fcfb77fe640 1 -- 172.21.15.118:0/942727189 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fcfbc0be920 con 0x7fcfc0100820 2024-09-21T11:54:37.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.311+0000 7fcfc5d85640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcfac07af80 0x7fcfac07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.312+0000 7fcfc5d85640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcfac07af80 0x7fcfac07d440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0105f90 tx=0x7fcfb000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:37.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.316+0000 7fcfb77fe640 1 -- 172.21.15.118:0/942727189 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcfbc089ef0 con 0x7fcfc0100820 2024-09-21T11:54:37.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.563+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcfc0109da0 con 0x7fcfc0100820 2024-09-21T11:54:37.564 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:37 smithi118 ceph-mon[111738]: pgmap v473: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:37.564 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:37 smithi118 ceph-mon[111738]: from='client.34696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.563+0000 7fcfb77fe640 1 -- 172.21.15.118:0/942727189 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fcfbc08c410 con 0x7fcfc0100820 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:54:37.565 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:54:37.566 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:54:37.566 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:54:37.566 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:54:37.566 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:54:37.566 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:54:37.566 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:54:37.566 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:54:37.566 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcfac07af80 msgr2=0x7fcfac07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcfac07af80 0x7fcfac07d440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0105f90 tx=0x7fcfb000b390 comp rx=0 tx=0).stop 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0100820 msgr2=0x7fcfc019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0100820 0x7fcfc019d690 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc031460 tx=0x7fcfbc0045e0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 shutdown_connections 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc0106820 0x7fcfc019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcfac07af80 0x7fcfac07d440 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 --2- 172.21.15.118:0/942727189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfc0100820 0x7fcfc019d690 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 >> 172.21.15.118:0/942727189 conn(0x7fcfc00fc520 msgr2=0x7fcfc006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 shutdown_connections 2024-09-21T11:54:37.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.565+0000 7fcfc87ea640 1 -- 172.21.15.118:0/942727189 wait complete. 2024-09-21T11:54:37.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.646+0000 7f7441ac4640 1 -- 172.21.15.118:0/1840048730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c106820 msgr2=0x7f743c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.646+0000 7f7441ac4640 1 --2- 172.21.15.118:0/1840048730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c106820 0x7f743c106c00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f742c009880 tx=0x7f742c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.646+0000 7f7441ac4640 1 -- 172.21.15.118:0/1840048730 shutdown_connections 2024-09-21T11:54:37.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.646+0000 7f7441ac4640 1 --2- 172.21.15.118:0/1840048730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c100820 0x7f743c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.646+0000 7f7441ac4640 1 --2- 172.21.15.118:0/1840048730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c106820 0x7f743c106c00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.646+0000 7f7441ac4640 1 -- 172.21.15.118:0/1840048730 >> 172.21.15.118:0/1840048730 conn(0x7f743c0fc520 msgr2=0x7f743c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:37.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.646+0000 7f7441ac4640 1 -- 172.21.15.118:0/1840048730 shutdown_connections 2024-09-21T11:54:37.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.646+0000 7f7441ac4640 1 -- 172.21.15.118:0/1840048730 wait complete. 2024-09-21T11:54:37.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.647+0000 7f7441ac4640 1 Processor -- start 2024-09-21T11:54:37.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.647+0000 7f7441ac4640 1 -- start start 2024-09-21T11:54:37.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.647+0000 7f7441ac4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c100820 0x7f743c196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.647+0000 7f7441ac4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c106820 0x7f743c196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.647+0000 7f7441ac4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f743c10dd50 con 0x7f743c100820 2024-09-21T11:54:37.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.647+0000 7f7441ac4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f743c10dbd0 con 0x7f743c106820 2024-09-21T11:54:37.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f743b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c100820 0x7f743c196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f743b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c100820 0x7f743c196650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47008/0 (socket says 172.21.15.118:47008) 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f743b7fe640 1 -- 172.21.15.118:0/422999409 learned_addr learned my addr 172.21.15.118:0/422999409 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f743affd640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c106820 0x7f743c196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f743b7fe640 1 -- 172.21.15.118:0/422999409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c106820 msgr2=0x7f743c196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f743b7fe640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c106820 0x7f743c196b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f743b7fe640 1 -- 172.21.15.118:0/422999409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c1970d0 con 0x7f743c100820 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f743b7fe640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c100820 0x7f743c196650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f742c031460 tx=0x7f742c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f7438ff9640 1 -- 172.21.15.118:0/422999409 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f742c03f070 con 0x7f743c100820 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743c197360 con 0x7f743c100820 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f7438ff9640 1 -- 172.21.15.118:0/422999409 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f742c004cf0 con 0x7f743c100820 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f7438ff9640 1 -- 172.21.15.118:0/422999409 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f742c035030 con 0x7f743c100820 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.648+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743c1a3e90 con 0x7f743c100820 2024-09-21T11:54:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.649+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743c101f60 con 0x7f743c100820 2024-09-21T11:54:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.650+0000 7f7438ff9640 1 -- 172.21.15.118:0/422999409 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f742c042070 con 0x7f743c100820 2024-09-21T11:54:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.650+0000 7f7438ff9640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af30 0x7f742407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.650+0000 7f7438ff9640 1 -- 172.21.15.118:0/422999409 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f742c0bebb0 con 0x7f743c100820 2024-09-21T11:54:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.651+0000 7f743affd640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af30 0x7f742407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.651+0000 7f743affd640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af30 0x7f742407d3f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f743c1987b0 tx=0x7f7430008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:37.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.655+0000 7f7438ff9640 1 -- 172.21.15.118:0/422999409 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f742c0c5080 con 0x7f743c100820 2024-09-21T11:54:37.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:37 smithi149 ceph-mon[79770]: pgmap v473: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:37.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:37 smithi149 ceph-mon[79770]: from='client.34696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:37.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.873+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f743c108df0 con 0x7f743c100820 2024-09-21T11:54:37.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.873+0000 7f7438ff9640 1 -- 172.21.15.118:0/422999409 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f742c08a100 con 0x7f743c100820 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:54:37.875 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:54:37.876 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:54:37.877 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:54:37.878 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:54:37.878 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:54:37.878 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af30 msgr2=0x7f742407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af30 0x7f742407d3f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f743c1987b0 tx=0x7f7430008040 comp rx=0 tx=0).stop 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c100820 msgr2=0x7f743c196650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c100820 0x7f743c196650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f742c031460 tx=0x7f742c0048f0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 shutdown_connections 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c106820 0x7f743c196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af30 0x7f742407d3f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 --2- 172.21.15.118:0/422999409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f743c100820 0x7f743c196650 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 >> 172.21.15.118:0/422999409 conn(0x7f743c0fc520 msgr2=0x7f743c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 shutdown_connections 2024-09-21T11:54:37.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.875+0000 7f7441ac4640 1 -- 172.21.15.118:0/422999409 wait complete. 2024-09-21T11:54:37.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.957+0000 7f5066bfc640 1 -- 172.21.15.118:0/196116226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 msgr2=0x7f5060112400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.957+0000 7f5066bfc640 1 --2- 172.21.15.118:0/196116226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 0x7f5060112400 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5054009880 tx=0x7f505402a530 comp rx=0 tx=0).stop 2024-09-21T11:54:37.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.957+0000 7f5066bfc640 1 -- 172.21.15.118:0/196116226 shutdown_connections 2024-09-21T11:54:37.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.957+0000 7f5066bfc640 1 --2- 172.21.15.118:0/196116226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 0x7f5060112400 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.957+0000 7f5066bfc640 1 --2- 172.21.15.118:0/196116226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5060074590 0x7f5060074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.957+0000 7f5066bfc640 1 -- 172.21.15.118:0/196116226 >> 172.21.15.118:0/196116226 conn(0x7f50600fd630 msgr2=0x7f50600ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:37.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.957+0000 7f5066bfc640 1 -- 172.21.15.118:0/196116226 shutdown_connections 2024-09-21T11:54:37.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.957+0000 7f5066bfc640 1 -- 172.21.15.118:0/196116226 wait complete. 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.958+0000 7f5066bfc640 1 Processor -- start 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.958+0000 7f5066bfc640 1 -- start start 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.958+0000 7f5066bfc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5060074590 0x7f506019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.958+0000 7f5066bfc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 0x7f506019e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.958+0000 7f5066bfc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f50601153f0 con 0x7f5060074eb0 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.958+0000 7f5066bfc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5060115270 con 0x7f5060074590 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.958+0000 7f505ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 0x7f506019e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.958+0000 7f505ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 0x7f506019e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47020/0 (socket says 172.21.15.118:47020) 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.958+0000 7f505ffff640 1 -- 172.21.15.118:0/3341333036 learned_addr learned my addr 172.21.15.118:0/3341333036 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f5064998640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5060074590 0x7f506019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f505ffff640 1 -- 172.21.15.118:0/3341333036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5060074590 msgr2=0x7f506019dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f505ffff640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5060074590 0x7f506019dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:37.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f505ffff640 1 -- 172.21.15.118:0/3341333036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50601a28c0 con 0x7f5060074eb0 2024-09-21T11:54:37.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f505ffff640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 0x7f506019e530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5054031460 tx=0x7f50540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:37.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f505dffb640 1 -- 172.21.15.118:0/3341333036 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f505403f070 con 0x7f5060074eb0 2024-09-21T11:54:37.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50601a2b50 con 0x7f5060074eb0 2024-09-21T11:54:37.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f505dffb640 1 -- 172.21.15.118:0/3341333036 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50540035f0 con 0x7f5060074eb0 2024-09-21T11:54:37.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f505dffb640 1 -- 172.21.15.118:0/3341333036 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5054035030 con 0x7f5060074eb0 2024-09-21T11:54:37.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.959+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50601a3080 con 0x7f5060074eb0 2024-09-21T11:54:37.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.960+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5060075cd0 con 0x7f5060074eb0 2024-09-21T11:54:37.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.961+0000 7f505dffb640 1 -- 172.21.15.118:0/3341333036 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5054042070 con 0x7f5060074eb0 2024-09-21T11:54:37.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.961+0000 7f505dffb640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f504807af30 0x7f504807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:37.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.962+0000 7f5064998640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f504807af30 0x7f504807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:37.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.962+0000 7f505dffb640 1 -- 172.21.15.118:0/3341333036 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f50540bead0 con 0x7f5060074eb0 2024-09-21T11:54:37.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.962+0000 7f5064998640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f504807af30 0x7f504807d3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5050005fd0 tx=0x7f5050005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:37.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:37.966+0000 7f505dffb640 1 -- 172.21.15.118:0/3341333036 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f505408a020 con 0x7f5060074eb0 2024-09-21T11:54:38.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.163+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f506019f3b0 con 0x7f504807af30 2024-09-21T11:54:38.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.164+0000 7f505dffb640 1 -- 172.21.15.118:0/3341333036 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f506019f3b0 con 0x7f504807af30 2024-09-21T11:54:38.165 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:54:38.165 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:54:38.165 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:54:38.165 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:54:38.166 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f504807af30 msgr2=0x7f504807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f504807af30 0x7f504807d3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5050005fd0 tx=0x7f5050005850 comp rx=0 tx=0).stop 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 msgr2=0x7f506019e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 0x7f506019e530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5054031460 tx=0x7f50540045e0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 shutdown_connections 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f504807af30 0x7f504807d3f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5060074eb0 0x7f506019e530 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 --2- 172.21.15.118:0/3341333036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5060074590 0x7f506019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 >> 172.21.15.118:0/3341333036 conn(0x7f50600fd630 msgr2=0x7f5060104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:38.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 shutdown_connections 2024-09-21T11:54:38.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.166+0000 7f5066bfc640 1 -- 172.21.15.118:0/3341333036 wait complete. 2024-09-21T11:54:38.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 -- 172.21.15.118:0/1111079527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4100820 msgr2=0x7ff8f4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:38.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 --2- 172.21.15.118:0/1111079527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4100820 0x7ff8f4100c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009c20 tx=0x7ff8e402a970 comp rx=0 tx=0).stop 2024-09-21T11:54:38.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 -- 172.21.15.118:0/1111079527 shutdown_connections 2024-09-21T11:54:38.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 --2- 172.21.15.118:0/1111079527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4100820 0x7ff8f4100c80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 --2- 172.21.15.118:0/1111079527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f4106820 0x7ff8f4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 -- 172.21.15.118:0/1111079527 >> 172.21.15.118:0/1111079527 conn(0x7ff8f40fc520 msgr2=0x7ff8f40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:38.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 -- 172.21.15.118:0/1111079527 shutdown_connections 2024-09-21T11:54:38.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 -- 172.21.15.118:0/1111079527 wait complete. 2024-09-21T11:54:38.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 Processor -- start 2024-09-21T11:54:38.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 -- start start 2024-09-21T11:54:38.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f4100820 0x7ff8f419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:38.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.248+0000 7ff8fac32640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4106820 0x7ff8f419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:38.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8fac32640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f410dcf0 con 0x7ff8f4106820 2024-09-21T11:54:38.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8fac32640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f410db70 con 0x7ff8f4100820 2024-09-21T11:54:38.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4106820 0x7ff8f419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:38.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4106820 0x7ff8f419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47036/0 (socket says 172.21.15.118:47036) 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f3fff640 1 -- 172.21.15.118:0/3016496429 learned_addr learned my addr 172.21.15.118:0/3016496429 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f89ce640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f4100820 0x7ff8f419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f3fff640 1 -- 172.21.15.118:0/3016496429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f4100820 msgr2=0x7ff8f419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f3fff640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f4100820 0x7ff8f419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f3fff640 1 -- 172.21.15.118:0/3016496429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f41977e0 con 0x7ff8f4106820 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f3fff640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4106820 0x7ff8f419dba0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8e402ae90 tx=0x7ff8e402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f1ffb640 1 -- 172.21.15.118:0/3016496429 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8e4047070 con 0x7ff8f4106820 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f4197a70 con 0x7ff8f4106820 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f1ffb640 1 -- 172.21.15.118:0/3016496429 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8e402f7e0 con 0x7ff8f4106820 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.249+0000 7ff8f1ffb640 1 -- 172.21.15.118:0/3016496429 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8e4034070 con 0x7ff8f4106820 2024-09-21T11:54:38.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.250+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f4197fa0 con 0x7ff8f4106820 2024-09-21T11:54:38.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.251+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f4101f60 con 0x7ff8f4106820 2024-09-21T11:54:38.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.251+0000 7ff8f1ffb640 1 -- 172.21.15.118:0/3016496429 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff8e404a070 con 0x7ff8f4106820 2024-09-21T11:54:38.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.252+0000 7ff8f1ffb640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff8e007af30 0x7ff8e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:54:38.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.252+0000 7ff8f1ffb640 1 -- 172.21.15.118:0/3016496429 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff8e40bee50 con 0x7ff8f4106820 2024-09-21T11:54:38.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.252+0000 7ff8f89ce640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff8e007af30 0x7ff8e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:54:38.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.252+0000 7ff8f89ce640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff8e007af30 0x7ff8e007d3f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc005fd0 tx=0x7ff8dc005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:54:38.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.256+0000 7ff8f1ffb640 1 -- 172.21.15.118:0/3016496429 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8e403f070 con 0x7ff8f4106820 2024-09-21T11:54:38.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.506+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff8f4198d10 con 0x7ff8f4106820 2024-09-21T11:54:38.508 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:38 smithi118 ceph-mon[111738]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:38.508 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:38 smithi118 ceph-mon[111738]: from='client.34704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:38.508 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:38 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/942727189' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:54:38.508 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:38 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/422999409' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:54:38.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.506+0000 7ff8f1ffb640 1 -- 172.21.15.118:0/3016496429 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7ff8e408a3a0 con 0x7ff8f4106820 2024-09-21T11:54:38.508 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:54:38.508 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:54:38.508 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:54:38.509 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:54:38.509 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:54:38.509 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:54:38.509 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:54:38.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff8e007af30 msgr2=0x7ff8e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:38.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff8e007af30 0x7ff8e007d3f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc005fd0 tx=0x7ff8dc005850 comp rx=0 tx=0).stop 2024-09-21T11:54:38.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4106820 msgr2=0x7ff8f419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:54:38.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4106820 0x7ff8f419dba0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8e402ae90 tx=0x7ff8e402f5f0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 shutdown_connections 2024-09-21T11:54:38.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff8e007af30 0x7ff8e007d3f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8f4106820 0x7ff8f419dba0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 --2- 172.21.15.118:0/3016496429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f4100820 0x7ff8f419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:54:38.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 >> 172.21.15.118:0/3016496429 conn(0x7ff8f40fc520 msgr2=0x7ff8f406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:54:38.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 shutdown_connections 2024-09-21T11:54:38.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:54:38.509+0000 7ff8fac32640 1 -- 172.21.15.118:0/3016496429 wait complete. 2024-09-21T11:54:38.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:38 smithi149 ceph-mon[79770]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:38.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:38 smithi149 ceph-mon[79770]: from='client.34704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:38.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:38 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/942727189' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:54:38.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:38 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/422999409' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:54:39.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:39 smithi149 ceph-mon[79770]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:39 smithi149 ceph-mon[79770]: pgmap v474: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:39.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:39 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3016496429' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:54:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:39 smithi118 ceph-mon[111738]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:54:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:39 smithi118 ceph-mon[111738]: pgmap v474: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:39 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3016496429' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:54:41.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:41 smithi149 ceph-mon[79770]: pgmap v475: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:41 smithi118 ceph-mon[111738]: pgmap v475: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:43.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:43 smithi149 ceph-mon[79770]: pgmap v476: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:43 smithi118 ceph-mon[111738]: pgmap v476: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:45.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:45 smithi149 ceph-mon[79770]: pgmap v477: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:45 smithi118 ceph-mon[111738]: pgmap v477: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:47.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:47 smithi149 ceph-mon[79770]: pgmap v478: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:47 smithi118 ceph-mon[111738]: pgmap v478: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:49.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:49 smithi149 ceph-mon[79770]: pgmap v479: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:49 smithi118 ceph-mon[111738]: pgmap v479: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:54:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:54:51.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:51 smithi149 ceph-mon[79770]: pgmap v480: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:51.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:51 smithi118 ceph-mon[111738]: pgmap v480: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:53.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:53 smithi118 ceph-mon[111738]: pgmap v481: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:53.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:53 smithi149 ceph-mon[79770]: pgmap v481: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:55.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:55 smithi149 ceph-mon[79770]: pgmap v482: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:55 smithi118 ceph-mon[111738]: pgmap v482: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:57.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:57 smithi149 ceph-mon[79770]: pgmap v483: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:57 smithi118 ceph-mon[111738]: pgmap v483: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:59.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:54:59 smithi149 ceph-mon[79770]: pgmap v484: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:54:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:54:59 smithi118 ceph-mon[111738]: pgmap v484: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:01.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:01 smithi149 ceph-mon[79770]: pgmap v485: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:01.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:01 smithi118 ceph-mon[111738]: pgmap v485: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:03 smithi118 ceph-mon[111738]: pgmap v486: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:04.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:03 smithi149 ceph-mon[79770]: pgmap v486: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:05 smithi118 ceph-mon[111738]: pgmap v487: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:55:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:05 smithi149 ceph-mon[79770]: pgmap v487: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:55:08.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:07 smithi118 ceph-mon[111738]: pgmap v488: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:08.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:07 smithi149 ceph-mon[79770]: pgmap v488: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.602+0000 7f24c34b8640 1 -- 172.21.15.118:0/865048269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc106950 msgr2=0x7f24bc106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.602+0000 7f24c34b8640 1 --2- 172.21.15.118:0/865048269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc106950 0x7f24bc106d30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009880 tx=0x7f24b802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.602+0000 7f24c34b8640 1 -- 172.21.15.118:0/865048269 shutdown_connections 2024-09-21T11:55:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.602+0000 7f24c34b8640 1 --2- 172.21.15.118:0/865048269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24bc0ffd70 0x7f24bc1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.602+0000 7f24c34b8640 1 --2- 172.21.15.118:0/865048269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc106950 0x7f24bc106d30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.602+0000 7f24c34b8640 1 -- 172.21.15.118:0/865048269 >> 172.21.15.118:0/865048269 conn(0x7f24bc0fbc60 msgr2=0x7f24bc0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.602+0000 7f24c34b8640 1 -- 172.21.15.118:0/865048269 shutdown_connections 2024-09-21T11:55:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.603+0000 7f24c34b8640 1 -- 172.21.15.118:0/865048269 wait complete. 2024-09-21T11:55:08.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.603+0000 7f24c34b8640 1 Processor -- start 2024-09-21T11:55:08.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.603+0000 7f24c34b8640 1 -- start start 2024-09-21T11:55:08.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.603+0000 7f24c34b8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc0ffd70 0x7f24bc100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:08.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.603+0000 7f24c34b8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24bc106950 0x7f24bc101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:08.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.603+0000 7f24c34b8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc10eef0 con 0x7f24bc0ffd70 2024-09-21T11:55:08.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.603+0000 7f24c34b8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc10ed70 con 0x7f24bc106950 2024-09-21T11:55:08.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c1254640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc0ffd70 0x7f24bc100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:08.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c1254640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc0ffd70 0x7f24bc100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57684/0 (socket says 172.21.15.118:57684) 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c1254640 1 -- 172.21.15.118:0/979139914 learned_addr learned my addr 172.21.15.118:0/979139914 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c0a53640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24bc106950 0x7f24bc101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c1254640 1 -- 172.21.15.118:0/979139914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24bc106950 msgr2=0x7f24bc101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c1254640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24bc106950 0x7f24bc101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c1254640 1 -- 172.21.15.118:0/979139914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc1019d0 con 0x7f24bc0ffd70 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c1254640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc0ffd70 0x7f24bc100f50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f24b8031460 tx=0x7f24b80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24b27fc640 1 -- 172.21.15.118:0/979139914 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24b803f070 con 0x7f24bc0ffd70 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc101c60 con 0x7f24bc0ffd70 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24b27fc640 1 -- 172.21.15.118:0/979139914 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24b80035f0 con 0x7f24bc0ffd70 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24b27fc640 1 -- 172.21.15.118:0/979139914 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24b8035030 con 0x7f24bc0ffd70 2024-09-21T11:55:08.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.604+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc1a3e00 con 0x7f24bc0ffd70 2024-09-21T11:55:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.606+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24bc103090 con 0x7f24bc0ffd70 2024-09-21T11:55:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.606+0000 7f24b27fc640 1 -- 172.21.15.118:0/979139914 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f24b8042070 con 0x7f24bc0ffd70 2024-09-21T11:55:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.607+0000 7f24b27fc640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f24a807af30 0x7f24a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.607+0000 7f24b27fc640 1 -- 172.21.15.118:0/979139914 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f24b80bea20 con 0x7f24bc0ffd70 2024-09-21T11:55:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.607+0000 7f24c0a53640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f24a807af30 0x7f24a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.607+0000 7f24c0a53640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f24a807af30 0x7f24a807d3f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24bc1029e0 tx=0x7f24ac00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:08.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.611+0000 7f24b27fc640 1 -- 172.21.15.118:0/979139914 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24b8089f70 con 0x7f24bc0ffd70 2024-09-21T11:55:08.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.809+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f24bc0fcc40 con 0x7f24a807af30 2024-09-21T11:55:08.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.810+0000 7f24b27fc640 1 -- 172.21.15.118:0/979139914 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f24bc0fcc40 con 0x7f24a807af30 2024-09-21T11:55:08.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f24a807af30 msgr2=0x7f24a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f24a807af30 0x7f24a807d3f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24bc1029e0 tx=0x7f24ac00b390 comp rx=0 tx=0).stop 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc0ffd70 msgr2=0x7f24bc100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc0ffd70 0x7f24bc100f50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f24b8031460 tx=0x7f24b80045e0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 shutdown_connections 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24bc106950 0x7f24bc101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f24a807af30 0x7f24a807d3f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 --2- 172.21.15.118:0/979139914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24bc0ffd70 0x7f24bc100f50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 >> 172.21.15.118:0/979139914 conn(0x7f24bc0fbc60 msgr2=0x7f24bc0fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 shutdown_connections 2024-09-21T11:55:08.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.812+0000 7f24c34b8640 1 -- 172.21.15.118:0/979139914 wait complete. 2024-09-21T11:55:08.823 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:55:08.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.894+0000 7f9ac079f640 1 -- 172.21.15.118:0/1496653424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 msgr2=0x7f9ab81001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:08.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.894+0000 7f9ac079f640 1 --2- 172.21.15.118:0/1496653424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 0x7f9ab81001d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009880 tx=0x7f9ab402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.895+0000 7f9ac079f640 1 -- 172.21.15.118:0/1496653424 shutdown_connections 2024-09-21T11:55:08.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.895+0000 7f9ac079f640 1 --2- 172.21.15.118:0/1496653424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 0x7f9ab81001d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.895+0000 7f9ac079f640 1 --2- 172.21.15.118:0/1496653424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8106950 0x7f9ab8106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.895+0000 7f9ac079f640 1 -- 172.21.15.118:0/1496653424 >> 172.21.15.118:0/1496653424 conn(0x7f9ab80fbc60 msgr2=0x7f9ab80fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:08.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.895+0000 7f9ac079f640 1 -- 172.21.15.118:0/1496653424 shutdown_connections 2024-09-21T11:55:08.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.895+0000 7f9ac079f640 1 -- 172.21.15.118:0/1496653424 wait complete. 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.895+0000 7f9ac079f640 1 Processor -- start 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.895+0000 7f9ac079f640 1 -- start start 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9ac079f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 0x7f9ab819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9ac079f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8106950 0x7f9ab819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9ac079f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab810eef0 con 0x7f9ab80ffd70 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9ac079f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab810ed70 con 0x7f9ab8106950 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9abe53b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 0x7f9ab819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9abe53b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 0x7f9ab819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57710/0 (socket says 172.21.15.118:57710) 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9abe53b640 1 -- 172.21.15.118:0/2458029187 learned_addr learned my addr 172.21.15.118:0/2458029187 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:08.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9abdd3a640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8106950 0x7f9ab819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9abe53b640 1 -- 172.21.15.118:0/2458029187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8106950 msgr2=0x7f9ab819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9abe53b640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8106950 0x7f9ab819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9abe53b640 1 -- 172.21.15.118:0/2458029187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab8197880 con 0x7f9ab80ffd70 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9abdd3a640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8106950 0x7f9ab819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9abe53b640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 0x7f9ab819d6c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00d6f0 tx=0x7f9aac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9aab7fe640 1 -- 172.21.15.118:0/2458029187 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9aac017070 con 0x7f9ab80ffd70 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab8197b70 con 0x7f9ab80ffd70 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9aab7fe640 1 -- 172.21.15.118:0/2458029187 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9aac00de00 con 0x7f9ab80ffd70 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9aab7fe640 1 -- 172.21.15.118:0/2458029187 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9aac004bb0 con 0x7f9ab80ffd70 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.896+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab8198100 con 0x7f9ab80ffd70 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.897+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab8103090 con 0x7f9ab80ffd70 2024-09-21T11:55:08.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.898+0000 7f9aab7fe640 1 -- 172.21.15.118:0/2458029187 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9aac009a30 con 0x7f9ab80ffd70 2024-09-21T11:55:08.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.898+0000 7f9aab7fe640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9aa407af30 0x7f9aa407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:08.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.898+0000 7f9aab7fe640 1 -- 172.21.15.118:0/2458029187 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f9aac09dd10 con 0x7f9ab80ffd70 2024-09-21T11:55:08.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.899+0000 7f9abdd3a640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9aa407af30 0x7f9aa407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:08.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.899+0000 7f9abdd3a640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9aa407af30 0x7f9aa407d3f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4031460 tx=0x7f9ab40095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:08.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:08.903+0000 7f9aab7fe640 1 -- 172.21.15.118:0/2458029187 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9aac069260 con 0x7f9ab80ffd70 2024-09-21T11:55:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.098+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9ab8198e50 con 0x7f9aa407af30 2024-09-21T11:55:09.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.099+0000 7f9aab7fe640 1 -- 172.21.15.118:0/2458029187 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f9ab8198e50 con 0x7f9aa407af30 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.101+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9aa407af30 msgr2=0x7f9aa407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.101+0000 7f9ac079f640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9aa407af30 0x7f9aa407d3f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4031460 tx=0x7f9ab40095f0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.101+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 msgr2=0x7f9ab819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.101+0000 7f9ac079f640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 0x7f9ab819d6c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00d6f0 tx=0x7f9aac00dbb0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.101+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 shutdown_connections 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.101+0000 7f9ac079f640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ab8106950 0x7f9ab819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.101+0000 7f9ac079f640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9aa407af30 0x7f9aa407d3f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.101+0000 7f9ac079f640 1 --2- 172.21.15.118:0/2458029187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab80ffd70 0x7f9ab819d6c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.101+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 >> 172.21.15.118:0/2458029187 conn(0x7f9ab80fbc60 msgr2=0x7f9ab80fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.102+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 shutdown_connections 2024-09-21T11:55:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.102+0000 7f9ac079f640 1 -- 172.21.15.118:0/2458029187 wait complete. 2024-09-21T11:55:09.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 -- 172.21.15.118:0/1842836981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 msgr2=0x7f8afc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 --2- 172.21.15.118:0/1842836981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 0x7f8afc100c40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009880 tx=0x7f8af002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 -- 172.21.15.118:0/1842836981 shutdown_connections 2024-09-21T11:55:09.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 --2- 172.21.15.118:0/1842836981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 0x7f8afc100c40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 --2- 172.21.15.118:0/1842836981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8afc1067e0 0x7f8afc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 -- 172.21.15.118:0/1842836981 >> 172.21.15.118:0/1842836981 conn(0x7f8afc0fc4c0 msgr2=0x7f8afc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:09.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 -- 172.21.15.118:0/1842836981 shutdown_connections 2024-09-21T11:55:09.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 -- 172.21.15.118:0/1842836981 wait complete. 2024-09-21T11:55:09.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 Processor -- start 2024-09-21T11:55:09.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.183+0000 7f8b015ba640 1 -- start start 2024-09-21T11:55:09.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8b015ba640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 0x7f8afc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:09.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8b015ba640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8afc1067e0 0x7f8afc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:09.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8b015ba640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc10dcb0 con 0x7f8afc1007e0 2024-09-21T11:55:09.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8b015ba640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc10db30 con 0x7f8afc1067e0 2024-09-21T11:55:09.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8afaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 0x7f8afc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8afaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 0x7f8afc19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57730/0 (socket says 172.21.15.118:57730) 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8afaffd640 1 -- 172.21.15.118:0/2956749170 learned_addr learned my addr 172.21.15.118:0/2956749170 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8afa7fc640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8afc1067e0 0x7f8afc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8afaffd640 1 -- 172.21.15.118:0/2956749170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8afc1067e0 msgr2=0x7f8afc19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8afaffd640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8afc1067e0 0x7f8afc19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8afaffd640 1 -- 172.21.15.118:0/2956749170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc197800 con 0x7f8afc1007e0 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8afa7fc640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8afc1067e0 0x7f8afc19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8afaffd640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 0x7f8afc19d680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00d6f0 tx=0x7f8aec00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8ae3fff640 1 -- 172.21.15.118:0/2956749170 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8aec017070 con 0x7f8afc1007e0 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc197af0 con 0x7f8afc1007e0 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.184+0000 7f8ae3fff640 1 -- 172.21.15.118:0/2956749170 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8aec00de00 con 0x7f8afc1007e0 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.185+0000 7f8ae3fff640 1 -- 172.21.15.118:0/2956749170 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8aec004bb0 con 0x7f8afc1007e0 2024-09-21T11:55:09.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.185+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc198080 con 0x7f8afc1007e0 2024-09-21T11:55:09.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.186+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8afc101f20 con 0x7f8afc1007e0 2024-09-21T11:55:09.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.186+0000 7f8ae3fff640 1 -- 172.21.15.118:0/2956749170 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8aec004e60 con 0x7f8afc1007e0 2024-09-21T11:55:09.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.187+0000 7f8ae3fff640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ae407af30 0x7f8ae407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:09.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.187+0000 7f8ae3fff640 1 -- 172.21.15.118:0/2956749170 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f8aec09dd00 con 0x7f8afc1007e0 2024-09-21T11:55:09.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.187+0000 7f8afa7fc640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ae407af30 0x7f8ae407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:09.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.187+0000 7f8afa7fc640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ae407af30 0x7f8ae407d3f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8af0031460 tx=0x7f8af00095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:09.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.191+0000 7f8ae3fff640 1 -- 172.21.15.118:0/2956749170 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8aec0a1030 con 0x7f8afc1007e0 2024-09-21T11:55:09.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.374+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8afc1983f0 con 0x7f8ae407af30 2024-09-21T11:55:09.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.384+0000 7f8ae3fff640 1 -- 172.21.15.118:0/2956749170 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8afc1983f0 con 0x7f8ae407af30 2024-09-21T11:55:09.386 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:55:09.386 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (13m) 7m ago 24m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:55:09.386 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (16m) 7m ago 24m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:55:09.386 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (15m) 6m ago 23m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:55:09.386 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (11m) 7m ago 24m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:55:09.386 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (11m) 6m ago 23m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:55:09.386 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (12m) 7m ago 23m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (7m) 7m ago 18m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (7m) 7m ago 18m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (18m) 6m ago 18m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (6m) 6m ago 18m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (15m) 7m ago 25m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (14m) 6m ago 23m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (11m) 7m ago 25m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (11m) 6m ago 23m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (13m) 7m ago 24m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (13m) 6m ago 23m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (10m) 7m ago 21m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (10m) 7m ago 21m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (9m) 7m ago 21m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (8m) 6m ago 20m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:55:09.387 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (8m) 6m ago 20m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:55:09.388 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (7m) 6m ago 19m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:55:09.388 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (13m) 7m ago 23m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:55:09.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ae407af30 msgr2=0x7f8ae407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ae407af30 0x7f8ae407d3f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8af0031460 tx=0x7f8af00095f0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 msgr2=0x7f8afc19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 0x7f8afc19d680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00d6f0 tx=0x7f8aec00dbb0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 shutdown_connections 2024-09-21T11:55:09.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8afc1067e0 0x7f8afc19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8ae407af30 0x7f8ae407d3f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 --2- 172.21.15.118:0/2956749170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8afc1007e0 0x7f8afc19d680 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 >> 172.21.15.118:0/2956749170 conn(0x7f8afc0fc4c0 msgr2=0x7f8afc069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:09.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 shutdown_connections 2024-09-21T11:55:09.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.386+0000 7f8b015ba640 1 -- 172.21.15.118:0/2956749170 wait complete. 2024-09-21T11:55:09.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.466+0000 7f6960b9d640 1 -- 172.21.15.118:0/3050989495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 msgr2=0x7f695c107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.466+0000 7f6960b9d640 1 --2- 172.21.15.118:0/3050989495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 0x7f695c107760 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6950009880 tx=0x7f695002a530 comp rx=0 tx=0).stop 2024-09-21T11:55:09.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.466+0000 7f6960b9d640 1 -- 172.21.15.118:0/3050989495 shutdown_connections 2024-09-21T11:55:09.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.466+0000 7f6960b9d640 1 --2- 172.21.15.118:0/3050989495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 0x7f695c107760 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.466+0000 7f6960b9d640 1 --2- 172.21.15.118:0/3050989495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c102900 0x7f695c102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.466+0000 7f6960b9d640 1 -- 172.21.15.118:0/3050989495 >> 172.21.15.118:0/3050989495 conn(0x7f695c0fc340 msgr2=0x7f695c0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:09.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.466+0000 7f6960b9d640 1 -- 172.21.15.118:0/3050989495 shutdown_connections 2024-09-21T11:55:09.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.466+0000 7f6960b9d640 1 -- 172.21.15.118:0/3050989495 wait complete. 2024-09-21T11:55:09.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.467+0000 7f6960b9d640 1 Processor -- start 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.467+0000 7f6960b9d640 1 -- start start 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.467+0000 7f6960b9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c102900 0x7f695c19d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.467+0000 7f6960b9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 0x7f695c19dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.467+0000 7f6960b9d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f695c10ee10 con 0x7f695c103220 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.467+0000 7f6960b9d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f695c10ec90 con 0x7f695c102900 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.467+0000 7f695affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 0x7f695c19dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.467+0000 7f695affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 0x7f695c19dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57748/0 (socket says 172.21.15.118:57748) 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.467+0000 7f695affd640 1 -- 172.21.15.118:0/201647560 learned_addr learned my addr 172.21.15.118:0/201647560 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f695b7fe640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c102900 0x7f695c19d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:09.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f695affd640 1 -- 172.21.15.118:0/201647560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c102900 msgr2=0x7f695c19d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f695affd640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c102900 0x7f695c19d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f695affd640 1 -- 172.21.15.118:0/201647560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c197920 con 0x7f695c103220 2024-09-21T11:55:09.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f695affd640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 0x7f695c19dca0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6950031460 tx=0x7f69500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:09.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f6958ff9640 1 -- 172.21.15.118:0/201647560 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f695003f070 con 0x7f695c103220 2024-09-21T11:55:09.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695c197bb0 con 0x7f695c103220 2024-09-21T11:55:09.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f6958ff9640 1 -- 172.21.15.118:0/201647560 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6950004cf0 con 0x7f695c103220 2024-09-21T11:55:09.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f6958ff9640 1 -- 172.21.15.118:0/201647560 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6950035030 con 0x7f695c103220 2024-09-21T11:55:09.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.468+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695c1980e0 con 0x7f695c103220 2024-09-21T11:55:09.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.469+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f695c06abe0 con 0x7f695c103220 2024-09-21T11:55:09.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.470+0000 7f6958ff9640 1 -- 172.21.15.118:0/201647560 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6950042070 con 0x7f695c103220 2024-09-21T11:55:09.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.470+0000 7f6958ff9640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f694407af30 0x7f694407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:09.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.470+0000 7f6958ff9640 1 -- 172.21.15.118:0/201647560 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f69500bec10 con 0x7f695c103220 2024-09-21T11:55:09.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.470+0000 7f695b7fe640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f694407af30 0x7f694407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:09.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.471+0000 7f695b7fe640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f694407af30 0x7f694407d3f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f695c198a60 tx=0x7f694c008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:09.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.475+0000 7f6958ff9640 1 -- 172.21.15.118:0/201647560 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f695008a100 con 0x7f695c103220 2024-09-21T11:55:09.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.723+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f695c102ce0 con 0x7f695c103220 2024-09-21T11:55:09.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.723+0000 7f6958ff9640 1 -- 172.21.15.118:0/201647560 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f695008c620 con 0x7f695c103220 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:55:09.726 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:55:09.727 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:55:09.727 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:55:09.727 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:55:09.727 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:55:09.727 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:55:09.727 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:55:09.727 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:55:09.727 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:55:09.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f694407af30 msgr2=0x7f694407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f694407af30 0x7f694407d3f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f695c198a60 tx=0x7f694c008040 comp rx=0 tx=0).stop 2024-09-21T11:55:09.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 msgr2=0x7f695c19dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 0x7f695c19dca0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6950031460 tx=0x7f69500048f0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 shutdown_connections 2024-09-21T11:55:09.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f694407af30 0x7f694407d3f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695c103220 0x7f695c19dca0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 --2- 172.21.15.118:0/201647560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c102900 0x7f695c19d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 >> 172.21.15.118:0/201647560 conn(0x7f695c0fc340 msgr2=0x7f695c10bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:09.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 shutdown_connections 2024-09-21T11:55:09.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.726+0000 7f6960b9d640 1 -- 172.21.15.118:0/201647560 wait complete. 2024-09-21T11:55:09.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.808+0000 7fb505b70640 1 -- 172.21.15.118:0/3194255423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 msgr2=0x7fb500106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.808+0000 7fb505b70640 1 --2- 172.21.15.118:0/3194255423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 0x7fb500106c00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009880 tx=0x7fb4f002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.808+0000 7fb505b70640 1 -- 172.21.15.118:0/3194255423 shutdown_connections 2024-09-21T11:55:09.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.808+0000 7fb505b70640 1 --2- 172.21.15.118:0/3194255423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb500100820 0x7fb500100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.808+0000 7fb505b70640 1 --2- 172.21.15.118:0/3194255423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 0x7fb500106c00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.808+0000 7fb505b70640 1 -- 172.21.15.118:0/3194255423 >> 172.21.15.118:0/3194255423 conn(0x7fb5000fc520 msgr2=0x7fb5000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:09.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.808+0000 7fb505b70640 1 -- 172.21.15.118:0/3194255423 shutdown_connections 2024-09-21T11:55:09.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.809+0000 7fb505b70640 1 -- 172.21.15.118:0/3194255423 wait complete. 2024-09-21T11:55:09.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.809+0000 7fb505b70640 1 Processor -- start 2024-09-21T11:55:09.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.809+0000 7fb505b70640 1 -- start start 2024-09-21T11:55:09.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb505b70640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb500100820 0x7fb50019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:09.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb505b70640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 0x7fb50019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:09.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb505b70640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb50010dcd0 con 0x7fb500106820 2024-09-21T11:55:09.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb505b70640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb50010db50 con 0x7fb500100820 2024-09-21T11:55:09.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4feffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 0x7fb50019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4feffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 0x7fb50019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57768/0 (socket says 172.21.15.118:57768) 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4feffd640 1 -- 172.21.15.118:0/3655550417 learned_addr learned my addr 172.21.15.118:0/3655550417 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4ff7fe640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb500100820 0x7fb50019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4feffd640 1 -- 172.21.15.118:0/3655550417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb500100820 msgr2=0x7fb50019d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4feffd640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb500100820 0x7fb50019d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4feffd640 1 -- 172.21.15.118:0/3655550417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb500197780 con 0x7fb500106820 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4feffd640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 0x7fb50019db40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400d8d0 tx=0x7fb4f400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4fcff9640 1 -- 172.21.15.118:0/3655550417 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4f4017030 con 0x7fb500106820 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb500197a70 con 0x7fb500106820 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.810+0000 7fb4fcff9640 1 -- 172.21.15.118:0/3655550417 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4f4004020 con 0x7fb500106820 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.811+0000 7fb4fcff9640 1 -- 172.21.15.118:0/3655550417 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4f40047a0 con 0x7fb500106820 2024-09-21T11:55:09.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.811+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb500198000 con 0x7fb500106820 2024-09-21T11:55:09.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.811+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb500101f60 con 0x7fb500106820 2024-09-21T11:55:09.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.812+0000 7fb4fcff9640 1 -- 172.21.15.118:0/3655550417 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb4f40041d0 con 0x7fb500106820 2024-09-21T11:55:09.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.813+0000 7fb4fcff9640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb4e807af30 0x7fb4e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:09.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.813+0000 7fb4fcff9640 1 -- 172.21.15.118:0/3655550417 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb4f4018070 con 0x7fb500106820 2024-09-21T11:55:09.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.813+0000 7fb4ff7fe640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb4e807af30 0x7fb4e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:09.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.813+0000 7fb4ff7fe640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb4e807af30 0x7fb4e807d3f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00096c0 tx=0x7fb4f0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:09.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:09.817+0000 7fb4fcff9640 1 -- 172.21.15.118:0/3655550417 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4f40a3020 con 0x7fb500106820 2024-09-21T11:55:10.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.030+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb500198310 con 0x7fb500106820 2024-09-21T11:55:10.033 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:09 smithi118 ceph-mon[111738]: pgmap v489: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:10.033 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:09 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/201647560' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:55:10.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.031+0000 7fb4fcff9640 1 -- 172.21.15.118:0/3655550417 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7fb4f4069350 con 0x7fb500106820 2024-09-21T11:55:10.033 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:55:10.033 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:55:10.035 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:55:10.036 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:55:10.037 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:55:10.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb4e807af30 msgr2=0x7fb4e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb4e807af30 0x7fb4e807d3f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00096c0 tx=0x7fb4f0031400 comp rx=0 tx=0).stop 2024-09-21T11:55:10.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 msgr2=0x7fb50019db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 0x7fb50019db40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400d8d0 tx=0x7fb4f400dd90 comp rx=0 tx=0).stop 2024-09-21T11:55:10.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 shutdown_connections 2024-09-21T11:55:10.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb4e807af30 0x7fb4e807d3f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb500106820 0x7fb50019db40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 --2- 172.21.15.118:0/3655550417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb500100820 0x7fb50019d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 >> 172.21.15.118:0/3655550417 conn(0x7fb5000fc520 msgr2=0x7fb500109e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:10.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 shutdown_connections 2024-09-21T11:55:10.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.033+0000 7fb505b70640 1 -- 172.21.15.118:0/3655550417 wait complete. 2024-09-21T11:55:10.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 -- 172.21.15.118:0/3460499009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1007f0 msgr2=0x7efe8c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 --2- 172.21.15.118:0/3460499009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1007f0 0x7efe8c100c50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efe88009880 tx=0x7efe8802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 -- 172.21.15.118:0/3460499009 shutdown_connections 2024-09-21T11:55:10.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 --2- 172.21.15.118:0/3460499009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1007f0 0x7efe8c100c50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 --2- 172.21.15.118:0/3460499009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe8c1067f0 0x7efe8c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 -- 172.21.15.118:0/3460499009 >> 172.21.15.118:0/3460499009 conn(0x7efe8c0fc4f0 msgr2=0x7efe8c0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:10.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 -- 172.21.15.118:0/3460499009 shutdown_connections 2024-09-21T11:55:10.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 -- 172.21.15.118:0/3460499009 wait complete. 2024-09-21T11:55:10.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 Processor -- start 2024-09-21T11:55:10.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.116+0000 7efe9397a640 1 -- start start 2024-09-21T11:55:10.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe9397a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe8c1007f0 0x7efe8c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:10.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe9397a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1067f0 0x7efe8c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:10.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe9397a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c10dd20 con 0x7efe8c1067f0 2024-09-21T11:55:10.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe9397a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c10dba0 con 0x7efe8c1007f0 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe90f15640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1067f0 0x7efe8c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe90f15640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1067f0 0x7efe8c19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57786/0 (socket says 172.21.15.118:57786) 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe90f15640 1 -- 172.21.15.118:0/1205496462 learned_addr learned my addr 172.21.15.118:0/1205496462 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe91716640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe8c1007f0 0x7efe8c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe90f15640 1 -- 172.21.15.118:0/1205496462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe8c1007f0 msgr2=0x7efe8c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe90f15640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe8c1007f0 0x7efe8c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe90f15640 1 -- 172.21.15.118:0/1205496462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8c197810 con 0x7efe8c1067f0 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe90f15640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1067f0 0x7efe8c19dbd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efe88031460 tx=0x7efe880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe7e7fc640 1 -- 172.21.15.118:0/1205496462 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe8803f070 con 0x7efe8c1067f0 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe8c197aa0 con 0x7efe8c1067f0 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe7e7fc640 1 -- 172.21.15.118:0/1205496462 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe88004cf0 con 0x7efe8c1067f0 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.117+0000 7efe7e7fc640 1 -- 172.21.15.118:0/1205496462 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe88035030 con 0x7efe8c1067f0 2024-09-21T11:55:10.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.118+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe8c197fd0 con 0x7efe8c1067f0 2024-09-21T11:55:10.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.119+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe8c101f30 con 0x7efe8c1067f0 2024-09-21T11:55:10.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.119+0000 7efe7e7fc640 1 -- 172.21.15.118:0/1205496462 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7efe88042070 con 0x7efe8c1067f0 2024-09-21T11:55:10.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.120+0000 7efe7e7fc640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe7807af30 0x7efe7807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:10.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.120+0000 7efe7e7fc640 1 -- 172.21.15.118:0/1205496462 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7efe880be850 con 0x7efe8c1067f0 2024-09-21T11:55:10.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.120+0000 7efe91716640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe7807af30 0x7efe7807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:10.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.120+0000 7efe91716640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe7807af30 0x7efe7807d3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efe80009890 tx=0x7efe80008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:10.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.124+0000 7efe7e7fc640 1 -- 172.21.15.118:0/1205496462 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe88089da0 con 0x7efe8c1067f0 2024-09-21T11:55:10.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:09 smithi149 ceph-mon[79770]: pgmap v489: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:10.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:09 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/201647560' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:55:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.318+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efe8c198340 con 0x7efe7807af30 2024-09-21T11:55:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.319+0000 7efe7e7fc640 1 -- 172.21.15.118:0/1205496462 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7efe8c198340 con 0x7efe7807af30 2024-09-21T11:55:10.322 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:55:10.322 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:55:10.322 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:55:10.322 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:55:10.322 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:55:10.322 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:55:10.323 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:55:10.323 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:55:10.323 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:55:10.323 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:55:10.323 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:55:10.323 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:55:10.323 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:55:10.323 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:55:10.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe7807af30 msgr2=0x7efe7807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe7807af30 0x7efe7807d3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efe80009890 tx=0x7efe80008040 comp rx=0 tx=0).stop 2024-09-21T11:55:10.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1067f0 msgr2=0x7efe8c19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1067f0 0x7efe8c19dbd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efe88031460 tx=0x7efe880048f0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 shutdown_connections 2024-09-21T11:55:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe7807af30 0x7efe7807d3f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8c1067f0 0x7efe8c19dbd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 --2- 172.21.15.118:0/1205496462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe8c1007f0 0x7efe8c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 >> 172.21.15.118:0/1205496462 conn(0x7efe8c0fc4f0 msgr2=0x7efe8c1045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 shutdown_connections 2024-09-21T11:55:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.322+0000 7efe9397a640 1 -- 172.21.15.118:0/1205496462 wait complete. 2024-09-21T11:55:10.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.403+0000 7f8903938640 1 -- 172.21.15.118:0/93874224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc100820 msgr2=0x7f88fc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.403+0000 7f8903938640 1 --2- 172.21.15.118:0/93874224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc100820 0x7f88fc100c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009880 tx=0x7f88ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.403+0000 7f8903938640 1 -- 172.21.15.118:0/93874224 shutdown_connections 2024-09-21T11:55:10.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.403+0000 7f8903938640 1 --2- 172.21.15.118:0/93874224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc100820 0x7f88fc100c80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.403+0000 7f8903938640 1 --2- 172.21.15.118:0/93874224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88fc106820 0x7f88fc106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.403+0000 7f8903938640 1 -- 172.21.15.118:0/93874224 >> 172.21.15.118:0/93874224 conn(0x7f88fc0fc520 msgr2=0x7f88fc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:10.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.403+0000 7f8903938640 1 -- 172.21.15.118:0/93874224 shutdown_connections 2024-09-21T11:55:10.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.403+0000 7f8903938640 1 -- 172.21.15.118:0/93874224 wait complete. 2024-09-21T11:55:10.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8903938640 1 Processor -- start 2024-09-21T11:55:10.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8903938640 1 -- start start 2024-09-21T11:55:10.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8903938640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88fc100820 0x7f88fc1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:10.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8903938640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc106820 0x7f88fc198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8903938640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc10dcd0 con 0x7f88fc106820 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8903938640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc10db50 con 0x7f88fc100820 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8900ed3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc106820 0x7f88fc198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8900ed3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc106820 0x7f88fc198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57800/0 (socket says 172.21.15.118:57800) 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8900ed3640 1 -- 172.21.15.118:0/2836514448 learned_addr learned my addr 172.21.15.118:0/2836514448 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f89016d4640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88fc100820 0x7f88fc1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8900ed3640 1 -- 172.21.15.118:0/2836514448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88fc100820 msgr2=0x7f88fc1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8900ed3640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88fc100820 0x7f88fc1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.404+0000 7f8900ed3640 1 -- 172.21.15.118:0/2836514448 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc199330 con 0x7f88fc106820 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.405+0000 7f8900ed3640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc106820 0x7f88fc198d30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f88ec031460 tx=0x7f88ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.405+0000 7f88f27fc640 1 -- 172.21.15.118:0/2836514448 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88ec03f070 con 0x7f88fc106820 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.405+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc1995c0 con 0x7f88fc106820 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.405+0000 7f88f27fc640 1 -- 172.21.15.118:0/2836514448 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88ec004cf0 con 0x7f88fc106820 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.405+0000 7f88f27fc640 1 -- 172.21.15.118:0/2836514448 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88ec035030 con 0x7f88fc106820 2024-09-21T11:55:10.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.405+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc1a1b70 con 0x7f88fc106820 2024-09-21T11:55:10.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.406+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88fc101f60 con 0x7f88fc106820 2024-09-21T11:55:10.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.406+0000 7f88f27fc640 1 -- 172.21.15.118:0/2836514448 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f88ec042070 con 0x7f88fc106820 2024-09-21T11:55:10.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.407+0000 7f88f27fc640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f88e807af80 0x7f88e807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:10.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.407+0000 7f88f27fc640 1 -- 172.21.15.118:0/2836514448 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f88ec0bea90 con 0x7f88fc106820 2024-09-21T11:55:10.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.407+0000 7f89016d4640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f88e807af80 0x7f88e807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:10.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.408+0000 7f89016d4640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f88e807af80 0x7f88e807d440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f88f80058c0 tx=0x7f88f800a4c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:10.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.411+0000 7f88f27fc640 1 -- 172.21.15.118:0/2836514448 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88ec08a060 con 0x7f88fc106820 2024-09-21T11:55:10.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.660+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f88fc108db0 con 0x7f88fc106820 2024-09-21T11:55:10.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.660+0000 7f88f27fc640 1 -- 172.21.15.118:0/2836514448 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f88ec08ef10 con 0x7f88fc106820 2024-09-21T11:55:10.663 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:55:10.663 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:55:10.663 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:55:10.663 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:55:10.663 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:55:10.663 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:55:10.663 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:55:10.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f88e807af80 msgr2=0x7f88e807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f88e807af80 0x7f88e807d440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f88f80058c0 tx=0x7f88f800a4c0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc106820 msgr2=0x7f88fc198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc106820 0x7f88fc198d30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f88ec031460 tx=0x7f88ec0048f0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 shutdown_connections 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f88e807af80 0x7f88e807d440 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88fc106820 0x7f88fc198d30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 --2- 172.21.15.118:0/2836514448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88fc100820 0x7f88fc1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 >> 172.21.15.118:0/2836514448 conn(0x7f88fc0fc520 msgr2=0x7f88fc0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 shutdown_connections 2024-09-21T11:55:10.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:10.662+0000 7f8903938640 1 -- 172.21.15.118:0/2836514448 wait complete. 2024-09-21T11:55:11.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:10 smithi118 ceph-mon[111738]: from='client.34724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:11.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:10 smithi118 ceph-mon[111738]: from='client.34728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:11.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:10 smithi118 ceph-mon[111738]: from='client.34732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:11.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:10 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3655550417' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:55:11.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:10 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2836514448' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:55:11.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:10 smithi149 ceph-mon[79770]: from='client.34724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:11.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:10 smithi149 ceph-mon[79770]: from='client.34728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:11.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:10 smithi149 ceph-mon[79770]: from='client.34732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:11.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:10 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3655550417' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:55:11.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:10 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2836514448' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:55:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:11 smithi118 ceph-mon[111738]: pgmap v490: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:11 smithi118 ceph-mon[111738]: from='client.34744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:12.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:11 smithi149 ceph-mon[79770]: pgmap v490: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:12.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:11 smithi149 ceph-mon[79770]: from='client.34744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:13 smithi118 ceph-mon[111738]: pgmap v491: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:14.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:13 smithi149 ceph-mon[79770]: pgmap v491: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:15 smithi118 ceph-mon[111738]: pgmap v492: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:16.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:15 smithi149 ceph-mon[79770]: pgmap v492: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:18.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:17 smithi118 ceph-mon[111738]: pgmap v493: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:18.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:17 smithi149 ceph-mon[79770]: pgmap v493: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:19 smithi118 ceph-mon[111738]: pgmap v494: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:20.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:19 smithi149 ceph-mon[79770]: pgmap v494: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:21.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:55:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:55:22.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:21 smithi118 ceph-mon[111738]: pgmap v495: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:22.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:21 smithi149 ceph-mon[79770]: pgmap v495: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:23.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:22 smithi118 ceph-mon[111738]: pgmap v496: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:23.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:22 smithi149 ceph-mon[79770]: pgmap v496: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:25.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:25 smithi149 ceph-mon[79770]: pgmap v497: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:25 smithi118 ceph-mon[111738]: pgmap v497: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:27 smithi149 ceph-mon[79770]: pgmap v498: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:27 smithi118 ceph-mon[111738]: pgmap v498: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:29.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:29 smithi149 ceph-mon[79770]: pgmap v499: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:29 smithi118 ceph-mon[111738]: pgmap v499: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:31.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:31 smithi149 ceph-mon[79770]: pgmap v500: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:31 smithi118 ceph-mon[111738]: pgmap v500: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:33 smithi149 ceph-mon[79770]: pgmap v501: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:33 smithi118 ceph-mon[111738]: pgmap v501: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:35 smithi149 ceph-mon[79770]: pgmap v502: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:55:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:35 smithi118 ceph-mon[111738]: pgmap v502: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:55:37.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:37 smithi149 ceph-mon[79770]: pgmap v503: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:37 smithi118 ceph-mon[111738]: pgmap v503: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:39.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:39 smithi149 ceph-mon[79770]: pgmap v504: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:39 smithi118 ceph-mon[111738]: pgmap v504: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:40.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 -- 172.21.15.118:0/941777000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28106820 msgr2=0x7f6a28106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:40.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 --2- 172.21.15.118:0/941777000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28106820 0x7f6a28106c00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009880 tx=0x7f6a1802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:40.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 -- 172.21.15.118:0/941777000 shutdown_connections 2024-09-21T11:55:40.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 --2- 172.21.15.118:0/941777000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a28100820 0x7f6a28100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:40.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 --2- 172.21.15.118:0/941777000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28106820 0x7f6a28106c00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:40.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 -- 172.21.15.118:0/941777000 >> 172.21.15.118:0/941777000 conn(0x7f6a280fc520 msgr2=0x7f6a280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:40.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 -- 172.21.15.118:0/941777000 shutdown_connections 2024-09-21T11:55:40.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 -- 172.21.15.118:0/941777000 wait complete. 2024-09-21T11:55:40.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 Processor -- start 2024-09-21T11:55:40.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.756+0000 7f6a2efc1640 1 -- start start 2024-09-21T11:55:40.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2efc1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28100820 0x7f6a280fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:40.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2efc1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a28106820 0x7f6a280fd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2efc1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2810dd50 con 0x7f6a28100820 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2efc1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2810dbd0 con 0x7f6a28106820 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2cd5d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28100820 0x7f6a280fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2cd5d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28100820 0x7f6a280fcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56586/0 (socket says 172.21.15.118:56586) 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2cd5d640 1 -- 172.21.15.118:0/2120081500 learned_addr learned my addr 172.21.15.118:0/2120081500 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a27fff640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a28106820 0x7f6a280fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2cd5d640 1 -- 172.21.15.118:0/2120081500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a28106820 msgr2=0x7f6a280fd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2cd5d640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a28106820 0x7f6a280fd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2cd5d640 1 -- 172.21.15.118:0/2120081500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a280fd6a0 con 0x7f6a28100820 2024-09-21T11:55:40.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a27fff640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a28106820 0x7f6a280fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:55:40.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.757+0000 7f6a2cd5d640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28100820 0x7f6a280fcc20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6a18031460 tx=0x7f6a180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:40.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.758+0000 7f6a25ffb640 1 -- 172.21.15.118:0/2120081500 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a1803f070 con 0x7f6a28100820 2024-09-21T11:55:40.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.758+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a280fd930 con 0x7f6a28100820 2024-09-21T11:55:40.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.758+0000 7f6a25ffb640 1 -- 172.21.15.118:0/2120081500 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a18004cf0 con 0x7f6a28100820 2024-09-21T11:55:40.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.758+0000 7f6a25ffb640 1 -- 172.21.15.118:0/2120081500 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a18035030 con 0x7f6a28100820 2024-09-21T11:55:40.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.758+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a281a3df0 con 0x7f6a28100820 2024-09-21T11:55:40.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.759+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a28101f60 con 0x7f6a28100820 2024-09-21T11:55:40.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.760+0000 7f6a25ffb640 1 -- 172.21.15.118:0/2120081500 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6a18042070 con 0x7f6a28100820 2024-09-21T11:55:40.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.760+0000 7f6a25ffb640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6a1007af30 0x7f6a1007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:40.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.760+0000 7f6a25ffb640 1 -- 172.21.15.118:0/2120081500 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f6a180bebb0 con 0x7f6a28100820 2024-09-21T11:55:40.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.760+0000 7f6a27fff640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6a1007af30 0x7f6a1007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:40.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.761+0000 7f6a27fff640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6a1007af30 0x7f6a1007d3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6a280fe6b0 tx=0x7f6a1c008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:40.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.764+0000 7f6a25ffb640 1 -- 172.21.15.118:0/2120081500 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a180c5080 con 0x7f6a28100820 2024-09-21T11:55:40.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.957+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6a28062630 con 0x7f6a1007af30 2024-09-21T11:55:40.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.959+0000 7f6a25ffb640 1 -- 172.21.15.118:0/2120081500 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6a28062630 con 0x7f6a1007af30 2024-09-21T11:55:40.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6a1007af30 msgr2=0x7f6a1007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:40.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6a1007af30 0x7f6a1007d3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6a280fe6b0 tx=0x7f6a1c008040 comp rx=0 tx=0).stop 2024-09-21T11:55:40.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28100820 msgr2=0x7f6a280fcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:40.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28100820 0x7f6a280fcc20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6a18031460 tx=0x7f6a180048f0 comp rx=0 tx=0).stop 2024-09-21T11:55:40.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 shutdown_connections 2024-09-21T11:55:40.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a28106820 0x7f6a280fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:40.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6a1007af30 0x7f6a1007d3f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:40.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 --2- 172.21.15.118:0/2120081500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a28100820 0x7f6a280fcc20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:40.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 >> 172.21.15.118:0/2120081500 conn(0x7f6a280fc520 msgr2=0x7f6a2806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:40.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 shutdown_connections 2024-09-21T11:55:40.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:40.961+0000 7f6a2efc1640 1 -- 172.21.15.118:0/2120081500 wait complete. 2024-09-21T11:55:40.972 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:55:41.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.042+0000 7f6c30e74640 1 -- 172.21.15.118:0/3007486444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 msgr2=0x7f6c2c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.042+0000 7f6c30e74640 1 --2- 172.21.15.118:0/3007486444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 0x7f6c2c102ec0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009880 tx=0x7f6c1c02a530 comp rx=0 tx=0).stop 2024-09-21T11:55:41.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.042+0000 7f6c30e74640 1 -- 172.21.15.118:0/3007486444 shutdown_connections 2024-09-21T11:55:41.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.042+0000 7f6c30e74640 1 --2- 172.21.15.118:0/3007486444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c2c103400 0x7f6c2c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.042+0000 7f6c30e74640 1 --2- 172.21.15.118:0/3007486444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 0x7f6c2c102ec0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.042+0000 7f6c30e74640 1 -- 172.21.15.118:0/3007486444 >> 172.21.15.118:0/3007486444 conn(0x7f6c2c0fc520 msgr2=0x7f6c2c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:41.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.042+0000 7f6c30e74640 1 -- 172.21.15.118:0/3007486444 shutdown_connections 2024-09-21T11:55:41.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.042+0000 7f6c30e74640 1 -- 172.21.15.118:0/3007486444 wait complete. 2024-09-21T11:55:41.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.043+0000 7f6c30e74640 1 Processor -- start 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.043+0000 7f6c30e74640 1 -- start start 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.043+0000 7f6c30e74640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 0x7f6c2c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.043+0000 7f6c30e74640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c2c103400 0x7f6c2c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.043+0000 7f6c30e74640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c10ee10 con 0x7f6c2c102ae0 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.043+0000 7f6c30e74640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c10ec90 con 0x7f6c2c103400 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c2a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 0x7f6c2c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c2a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 0x7f6c2c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56598/0 (socket says 172.21.15.118:56598) 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c2a59c640 1 -- 172.21.15.118:0/863776422 learned_addr learned my addr 172.21.15.118:0/863776422 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c29d9b640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c2c103400 0x7f6c2c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c2a59c640 1 -- 172.21.15.118:0/863776422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c2c103400 msgr2=0x7f6c2c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c2a59c640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c2c103400 0x7f6c2c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c2a59c640 1 -- 172.21.15.118:0/863776422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c197800 con 0x7f6c2c102ae0 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c2a59c640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 0x7f6c2c19d680 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c031460 tx=0x7f6c1c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c1b7fe640 1 -- 172.21.15.118:0/863776422 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c1c03f070 con 0x7f6c2c102ae0 2024-09-21T11:55:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c1b7fe640 1 -- 172.21.15.118:0/863776422 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c1c0035f0 con 0x7f6c2c102ae0 2024-09-21T11:55:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c197a90 con 0x7f6c2c102ae0 2024-09-21T11:55:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c1b7fe640 1 -- 172.21.15.118:0/863776422 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c1c035030 con 0x7f6c2c102ae0 2024-09-21T11:55:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.044+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c197fc0 con 0x7f6c2c102ae0 2024-09-21T11:55:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.046+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2c06abe0 con 0x7f6c2c102ae0 2024-09-21T11:55:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.046+0000 7f6c1b7fe640 1 -- 172.21.15.118:0/863776422 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6c1c042070 con 0x7f6c2c102ae0 2024-09-21T11:55:41.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.047+0000 7f6c1b7fe640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6c1407af30 0x7f6c1407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.047+0000 7f6c1b7fe640 1 -- 172.21.15.118:0/863776422 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f6c1c0bea20 con 0x7f6c2c102ae0 2024-09-21T11:55:41.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.047+0000 7f6c29d9b640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6c1407af30 0x7f6c1407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.047+0000 7f6c29d9b640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6c1407af30 0x7f6c1407d3f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0fe4d0 tx=0x7f6c2000b2e0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.051+0000 7f6c1b7fe640 1 -- 172.21.15.118:0/863776422 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c1c089f70 con 0x7f6c2c102ae0 2024-09-21T11:55:41.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.244+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6c2c198330 con 0x7f6c1407af30 2024-09-21T11:55:41.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.245+0000 7f6c1b7fe640 1 -- 172.21.15.118:0/863776422 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6c2c198330 con 0x7f6c1407af30 2024-09-21T11:55:41.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6c1407af30 msgr2=0x7f6c1407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6c1407af30 0x7f6c1407d3f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0fe4d0 tx=0x7f6c2000b2e0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 msgr2=0x7f6c2c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 0x7f6c2c19d680 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c031460 tx=0x7f6c1c0045e0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 shutdown_connections 2024-09-21T11:55:41.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c2c103400 0x7f6c2c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6c1407af30 0x7f6c1407d3f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 --2- 172.21.15.118:0/863776422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c2c102ae0 0x7f6c2c19d680 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 >> 172.21.15.118:0/863776422 conn(0x7f6c2c0fc520 msgr2=0x7f6c2c108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:41.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 shutdown_connections 2024-09-21T11:55:41.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.247+0000 7f6c30e74640 1 -- 172.21.15.118:0/863776422 wait complete. 2024-09-21T11:55:41.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.328+0000 7f5ee7c59640 1 -- 172.21.15.118:0/3995993284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 msgr2=0x7f5ee0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.328+0000 7f5ee7c59640 1 --2- 172.21.15.118:0/3995993284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 0x7f5ee0107d10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009880 tx=0x7f5ed802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.328+0000 7f5ee7c59640 1 -- 172.21.15.118:0/3995993284 shutdown_connections 2024-09-21T11:55:41.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.328+0000 7f5ee7c59640 1 --2- 172.21.15.118:0/3995993284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee0101930 0x7f5ee0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.328+0000 7f5ee7c59640 1 --2- 172.21.15.118:0/3995993284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 0x7f5ee0107d10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.328+0000 7f5ee7c59640 1 -- 172.21.15.118:0/3995993284 >> 172.21.15.118:0/3995993284 conn(0x7f5ee00fd630 msgr2=0x7f5ee00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:41.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.328+0000 7f5ee7c59640 1 -- 172.21.15.118:0/3995993284 shutdown_connections 2024-09-21T11:55:41.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.328+0000 7f5ee7c59640 1 -- 172.21.15.118:0/3995993284 wait complete. 2024-09-21T11:55:41.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee7c59640 1 Processor -- start 2024-09-21T11:55:41.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee7c59640 1 -- start start 2024-09-21T11:55:41.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee7c59640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee0101930 0x7f5ee019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee7c59640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 0x7f5ee019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee7c59640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee010ee00 con 0x7f5ee0107930 2024-09-21T11:55:41.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee7c59640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee010ec80 con 0x7f5ee0101930 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee51f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 0x7f5ee019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee51f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 0x7f5ee019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56614/0 (socket says 172.21.15.118:56614) 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee51f4640 1 -- 172.21.15.118:0/1624192906 learned_addr learned my addr 172.21.15.118:0/1624192906 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee59f5640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee0101930 0x7f5ee019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee51f4640 1 -- 172.21.15.118:0/1624192906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee0101930 msgr2=0x7f5ee019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee51f4640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee0101930 0x7f5ee019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee51f4640 1 -- 172.21.15.118:0/1624192906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee01977f0 con 0x7f5ee0107930 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.329+0000 7f5ee51f4640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 0x7f5ee019dbb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d6f0 tx=0x7f5ed000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.330+0000 7f5ed6ffd640 1 -- 172.21.15.118:0/1624192906 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ed0017070 con 0x7f5ee0107930 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.330+0000 7f5ed6ffd640 1 -- 172.21.15.118:0/1624192906 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ed000de00 con 0x7f5ee0107930 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.330+0000 7f5ed6ffd640 1 -- 172.21.15.118:0/1624192906 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ed0004bb0 con 0x7f5ee0107930 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.330+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee0197ae0 con 0x7f5ee0107930 2024-09-21T11:55:41.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.330+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee0198070 con 0x7f5ee0107930 2024-09-21T11:55:41.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.331+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee0103070 con 0x7f5ee0107930 2024-09-21T11:55:41.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.331+0000 7f5ed6ffd640 1 -- 172.21.15.118:0/1624192906 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5ed0009a30 con 0x7f5ee0107930 2024-09-21T11:55:41.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.332+0000 7f5ed6ffd640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ecc07af80 0x7f5ecc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.332+0000 7f5ed6ffd640 1 -- 172.21.15.118:0/1624192906 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f5ed009dc20 con 0x7f5ee0107930 2024-09-21T11:55:41.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.332+0000 7f5ee59f5640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ecc07af80 0x7f5ecc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.332+0000 7f5ee59f5640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ecc07af80 0x7f5ecc07d440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80096c0 tx=0x7f5ed8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:41.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.336+0000 7f5ed6ffd640 1 -- 172.21.15.118:0/1624192906 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ed00691f0 con 0x7f5ee0107930 2024-09-21T11:55:41.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.524+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5ee01983e0 con 0x7f5ecc07af80 2024-09-21T11:55:41.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.533+0000 7f5ed6ffd640 1 -- 172.21.15.118:0/1624192906 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5ee01983e0 con 0x7f5ecc07af80 2024-09-21T11:55:41.536 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:55:41.536 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (13m) 7m ago 24m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:55:41.536 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (16m) 7m ago 24m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:55:41.536 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (16m) 7m ago 23m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:55:41.536 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (11m) 7m ago 24m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:55:41.536 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (11m) 7m ago 23m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:55:41.536 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (13m) 7m ago 24m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:55:41.536 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (8m) 7m ago 19m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (7m) 7m ago 19m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (19m) 7m ago 19m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (7m) 7m ago 19m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (15m) 7m ago 26m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (14m) 7m ago 23m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (12m) 7m ago 26m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (11m) 7m ago 23m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (14m) 7m ago 24m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (14m) 7m ago 23m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (11m) 7m ago 22m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (10m) 7m ago 22m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (10m) 7m ago 21m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (9m) 7m ago 21m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:55:41.537 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (8m) 7m ago 20m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:55:41.538 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (8m) 7m ago 20m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:55:41.538 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (13m) 7m ago 24m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:55:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ecc07af80 msgr2=0x7f5ecc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ecc07af80 0x7f5ecc07d440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80096c0 tx=0x7f5ed8031400 comp rx=0 tx=0).stop 2024-09-21T11:55:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 msgr2=0x7f5ee019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 0x7f5ee019dbb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d6f0 tx=0x7f5ed000dbb0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 shutdown_connections 2024-09-21T11:55:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ecc07af80 0x7f5ecc07d440 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee0107930 0x7f5ee019dbb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 --2- 172.21.15.118:0/1624192906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee0101930 0x7f5ee019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 >> 172.21.15.118:0/1624192906 conn(0x7f5ee00fd630 msgr2=0x7f5ee00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:41.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 shutdown_connections 2024-09-21T11:55:41.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.535+0000 7f5ee7c59640 1 -- 172.21.15.118:0/1624192906 wait complete. 2024-09-21T11:55:41.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.616+0000 7f847f19f640 1 -- 172.21.15.118:0/1155445504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 msgr2=0x7f8478100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.616+0000 7f847f19f640 1 --2- 172.21.15.118:0/1155445504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 0x7f8478100c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8464009880 tx=0x7f846402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.616+0000 7f847f19f640 1 -- 172.21.15.118:0/1155445504 shutdown_connections 2024-09-21T11:55:41.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.616+0000 7f847f19f640 1 --2- 172.21.15.118:0/1155445504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 0x7f8478100c80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.616+0000 7f847f19f640 1 --2- 172.21.15.118:0/1155445504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8478106820 0x7f8478106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.616+0000 7f847f19f640 1 -- 172.21.15.118:0/1155445504 >> 172.21.15.118:0/1155445504 conn(0x7f84780fc520 msgr2=0x7f84780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:41.620 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:41 smithi118 ceph-mon[111738]: pgmap v505: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.616+0000 7f847f19f640 1 -- 172.21.15.118:0/1155445504 shutdown_connections 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.616+0000 7f847f19f640 1 -- 172.21.15.118:0/1155445504 wait complete. 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847f19f640 1 Processor -- start 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847f19f640 1 -- start start 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847f19f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 0x7f847819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847f19f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8478106820 0x7f847819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847f19f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f847810dcd0 con 0x7f8478100820 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847f19f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f847810db50 con 0x7f8478106820 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847cf3b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 0x7f847819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847cf3b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 0x7f847819c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56618/0 (socket says 172.21.15.118:56618) 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847cf3b640 1 -- 172.21.15.118:0/2135978991 learned_addr learned my addr 172.21.15.118:0/2135978991 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f8477fff640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8478106820 0x7f847819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847cf3b640 1 -- 172.21.15.118:0/2135978991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8478106820 msgr2=0x7f847819cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847cf3b640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8478106820 0x7f847819cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f847cf3b640 1 -- 172.21.15.118:0/2135978991 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84781966b0 con 0x7f8478100820 2024-09-21T11:55:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.617+0000 7f8477fff640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8478106820 0x7f847819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:55:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.618+0000 7f847cf3b640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 0x7f847819c5e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f846c00c8a0 tx=0x7f846c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.618+0000 7f8475ffb640 1 -- 172.21.15.118:0/2135978991 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f846c0079b0 con 0x7f8478100820 2024-09-21T11:55:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.618+0000 7f8475ffb640 1 -- 172.21.15.118:0/2135978991 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f846c007b50 con 0x7f8478100820 2024-09-21T11:55:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.618+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84781969a0 con 0x7f8478100820 2024-09-21T11:55:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.618+0000 7f8475ffb640 1 -- 172.21.15.118:0/2135978991 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f846c018700 con 0x7f8478100820 2024-09-21T11:55:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.618+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8478196f30 con 0x7f8478100820 2024-09-21T11:55:41.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.619+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8478101f60 con 0x7f8478100820 2024-09-21T11:55:41.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.620+0000 7f8475ffb640 1 -- 172.21.15.118:0/2135978991 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f846c007d00 con 0x7f8478100820 2024-09-21T11:55:41.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.621+0000 7f8475ffb640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f846807af40 0x7f846807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.621+0000 7f8475ffb640 1 -- 172.21.15.118:0/2135978991 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f846c09e3c0 con 0x7f8478100820 2024-09-21T11:55:41.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.621+0000 7f8477fff640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f846807af40 0x7f846807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.621+0000 7f8477fff640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f846807af40 0x7f846807d400 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8464031460 tx=0x7f8464004280 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:41.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.625+0000 7f8475ffb640 1 -- 172.21.15.118:0/2135978991 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f846c014030 con 0x7f8478100820 2024-09-21T11:55:41.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:41 smithi149 ceph-mon[79770]: pgmap v505: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:41.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.874+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8478108db0 con 0x7f8478100820 2024-09-21T11:55:41.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.875+0000 7f8475ffb640 1 -- 172.21.15.118:0/2135978991 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f846c069910 con 0x7f8478100820 2024-09-21T11:55:41.877 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:55:41.878 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:55:41.879 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:55:41.879 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:55:41.879 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:55:41.879 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:55:41.879 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:55:41.879 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:55:41.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f846807af40 msgr2=0x7f846807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f846807af40 0x7f846807d400 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8464031460 tx=0x7f8464004280 comp rx=0 tx=0).stop 2024-09-21T11:55:41.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 msgr2=0x7f847819c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 0x7f847819c5e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f846c00c8a0 tx=0x7f846c00cd60 comp rx=0 tx=0).stop 2024-09-21T11:55:41.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 shutdown_connections 2024-09-21T11:55:41.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8478106820 0x7f847819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f846807af40 0x7f846807d400 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 --2- 172.21.15.118:0/2135978991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8478100820 0x7f847819c5e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 >> 172.21.15.118:0/2135978991 conn(0x7f84780fc520 msgr2=0x7f84780fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:41.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 shutdown_connections 2024-09-21T11:55:41.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.877+0000 7f847f19f640 1 -- 172.21.15.118:0/2135978991 wait complete. 2024-09-21T11:55:41.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.957+0000 7f605ac93640 1 -- 172.21.15.118:0/3935927314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 msgr2=0x7f6054100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.957+0000 7f605ac93640 1 --2- 172.21.15.118:0/3935927314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 0x7f6054100c80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6040009880 tx=0x7f604002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.957+0000 7f605ac93640 1 -- 172.21.15.118:0/3935927314 shutdown_connections 2024-09-21T11:55:41.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 --2- 172.21.15.118:0/3935927314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 0x7f6054100c80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 --2- 172.21.15.118:0/3935927314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6054106820 0x7f6054106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 -- 172.21.15.118:0/3935927314 >> 172.21.15.118:0/3935927314 conn(0x7f60540fc520 msgr2=0x7f60540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:41.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 -- 172.21.15.118:0/3935927314 shutdown_connections 2024-09-21T11:55:41.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 -- 172.21.15.118:0/3935927314 wait complete. 2024-09-21T11:55:41.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 Processor -- start 2024-09-21T11:55:41.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 -- start start 2024-09-21T11:55:41.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 0x7f605419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6054106820 0x7f605419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f605410dcf0 con 0x7f6054100820 2024-09-21T11:55:41.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f605ac93640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f605410db70 con 0x7f6054106820 2024-09-21T11:55:41.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.958+0000 7f6058a2f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 0x7f605419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6058a2f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 0x7f605419f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56640/0 (socket says 172.21.15.118:56640) 2024-09-21T11:55:41.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6058a2f640 1 -- 172.21.15.118:0/448352551 learned_addr learned my addr 172.21.15.118:0/448352551 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:41.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6053fff640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6054106820 0x7f605419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6058a2f640 1 -- 172.21.15.118:0/448352551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6054106820 msgr2=0x7f605419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:41.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6058a2f640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6054106820 0x7f605419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:41.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6058a2f640 1 -- 172.21.15.118:0/448352551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60541999c0 con 0x7f6054100820 2024-09-21T11:55:41.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6058a2f640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 0x7f605419f800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f604800d6f0 tx=0x7f604800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:41.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6051ffb640 1 -- 172.21.15.118:0/448352551 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6048017070 con 0x7f6054100820 2024-09-21T11:55:41.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6051ffb640 1 -- 172.21.15.118:0/448352551 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f604800de00 con 0x7f6054100820 2024-09-21T11:55:41.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f6051ffb640 1 -- 172.21.15.118:0/448352551 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6048004bb0 con 0x7f6054100820 2024-09-21T11:55:41.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6054199cb0 con 0x7f6054100820 2024-09-21T11:55:41.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.959+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605419a210 con 0x7f6054100820 2024-09-21T11:55:41.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.960+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6054101f60 con 0x7f6054100820 2024-09-21T11:55:41.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.961+0000 7f6051ffb640 1 -- 172.21.15.118:0/448352551 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6048009a30 con 0x7f6054100820 2024-09-21T11:55:41.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.961+0000 7f6051ffb640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f604407af80 0x7f604407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:41.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.962+0000 7f6053fff640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f604407af80 0x7f604407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.962+0000 7f6051ffb640 1 -- 172.21.15.118:0/448352551 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f604809db70 con 0x7f6054100820 2024-09-21T11:55:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.962+0000 7f6053fff640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f604407af80 0x7f604407d440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f605419b1b0 tx=0x7f6040031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:41.966+0000 7f6051ffb640 1 -- 172.21.15.118:0/448352551 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6048069140 con 0x7f6054100820 2024-09-21T11:55:42.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.178+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f605419a4c0 con 0x7f6054100820 2024-09-21T11:55:42.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.179+0000 7f6051ffb640 1 -- 172.21.15.118:0/448352551 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f604806dff0 con 0x7f6054100820 2024-09-21T11:55:42.182 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:55:42.182 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:55:42.182 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:55:42.182 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:55:42.182 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:55:42.182 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:55:42.182 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:55:42.183 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:55:42.184 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:55:42.185 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:55:42.185 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:55:42.185 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:55:42.185 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:55:42.185 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:55:42.185 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:55:42.185 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:55:42.186 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:55:42.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f604407af80 msgr2=0x7f604407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f604407af80 0x7f604407d440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f605419b1b0 tx=0x7f6040031400 comp rx=0 tx=0).stop 2024-09-21T11:55:42.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 msgr2=0x7f605419f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 0x7f605419f800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f604800d6f0 tx=0x7f604800dbb0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 shutdown_connections 2024-09-21T11:55:42.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6054106820 0x7f605419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f604407af80 0x7f604407d440 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 --2- 172.21.15.118:0/448352551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6054100820 0x7f605419f800 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 >> 172.21.15.118:0/448352551 conn(0x7f60540fc520 msgr2=0x7f60540fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:42.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 shutdown_connections 2024-09-21T11:55:42.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.181+0000 7f605ac93640 1 -- 172.21.15.118:0/448352551 wait complete. 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.264+0000 7f025046b640 1 -- 172.21.15.118:0/2667046839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 msgr2=0x7f0248106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.264+0000 7f025046b640 1 --2- 172.21.15.118:0/2667046839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 0x7f0248106bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0244009880 tx=0x7f024402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.264+0000 7f025046b640 1 -- 172.21.15.118:0/2667046839 shutdown_connections 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.264+0000 7f025046b640 1 --2- 172.21.15.118:0/2667046839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0248100810 0x7f0248100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.264+0000 7f025046b640 1 --2- 172.21.15.118:0/2667046839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 0x7f0248106bf0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.264+0000 7f025046b640 1 -- 172.21.15.118:0/2667046839 >> 172.21.15.118:0/2667046839 conn(0x7f02480fc510 msgr2=0x7f02480fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.264+0000 7f025046b640 1 -- 172.21.15.118:0/2667046839 shutdown_connections 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.264+0000 7f025046b640 1 -- 172.21.15.118:0/2667046839 wait complete. 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f025046b640 1 Processor -- start 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f025046b640 1 -- start start 2024-09-21T11:55:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f025046b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0248100810 0x7f024819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f025046b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 0x7f024819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f025046b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f024810dd40 con 0x7f0248106810 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f025046b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f024810dbc0 con 0x7f0248100810 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f024da06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 0x7f024819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f024da06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 0x7f024819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56658/0 (socket says 172.21.15.118:56658) 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f024da06640 1 -- 172.21.15.118:0/3298076814 learned_addr learned my addr 172.21.15.118:0/3298076814 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f024e207640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0248100810 0x7f024819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f024da06640 1 -- 172.21.15.118:0/3298076814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0248100810 msgr2=0x7f024819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f024da06640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0248100810 0x7f024819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.265+0000 7f024da06640 1 -- 172.21.15.118:0/3298076814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0248197860 con 0x7f0248106810 2024-09-21T11:55:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.266+0000 7f024da06640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 0x7f024819dbe0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f023800b420 tx=0x7f023800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.266+0000 7f023f7fe640 1 -- 172.21.15.118:0/3298076814 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0238011630 con 0x7f0248106810 2024-09-21T11:55:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.266+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0248197b50 con 0x7f0248106810 2024-09-21T11:55:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.266+0000 7f023f7fe640 1 -- 172.21.15.118:0/3298076814 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0238016070 con 0x7f0248106810 2024-09-21T11:55:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.266+0000 7f023f7fe640 1 -- 172.21.15.118:0/3298076814 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0238010d40 con 0x7f0248106810 2024-09-21T11:55:42.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.266+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02481980e0 con 0x7f0248106810 2024-09-21T11:55:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.267+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0248101f50 con 0x7f0248106810 2024-09-21T11:55:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.268+0000 7f023f7fe640 1 -- 172.21.15.118:0/3298076814 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f023801b460 con 0x7f0248106810 2024-09-21T11:55:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.268+0000 7f023f7fe640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f023407af30 0x7f023407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.268+0000 7f023f7fe640 1 -- 172.21.15.118:0/3298076814 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f023809d860 con 0x7f0248106810 2024-09-21T11:55:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.268+0000 7f024e207640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f023407af30 0x7f023407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:42.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.268+0000 7f024e207640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f023407af30 0x7f023407d3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0244031460 tx=0x7f0244009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:42.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.272+0000 7f023f7fe640 1 -- 172.21.15.118:0/3298076814 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0238021250 con 0x7f0248106810 2024-09-21T11:55:42.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.469+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0248198e60 con 0x7f023407af30 2024-09-21T11:55:42.471 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:42 smithi118 ceph-mon[111738]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:42.472 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:42 smithi118 ceph-mon[111738]: from='client.34756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:42.472 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:42 smithi118 ceph-mon[111738]: from='client.34760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:42.472 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:42 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2135978991' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:55:42.472 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:42 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/448352551' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:55:42.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.470+0000 7f023f7fe640 1 -- 172.21.15.118:0/3298076814 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0248198e60 con 0x7f023407af30 2024-09-21T11:55:42.472 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:55:42.473 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f023407af30 msgr2=0x7f023407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f023407af30 0x7f023407d3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0244031460 tx=0x7f0244009560 comp rx=0 tx=0).stop 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 msgr2=0x7f024819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 0x7f024819dbe0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f023800b420 tx=0x7f023800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 shutdown_connections 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f023407af30 0x7f023407d3f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0248106810 0x7f024819dbe0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 --2- 172.21.15.118:0/3298076814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0248100810 0x7f024819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 >> 172.21.15.118:0/3298076814 conn(0x7f02480fc510 msgr2=0x7f0248104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.472+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 shutdown_connections 2024-09-21T11:55:42.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.473+0000 7f025046b640 1 -- 172.21.15.118:0/3298076814 wait complete. 2024-09-21T11:55:42.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.553+0000 7f2f7b017640 1 -- 172.21.15.118:0/144664899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 msgr2=0x7f2f74100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.553+0000 7f2f7b017640 1 --2- 172.21.15.118:0/144664899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 0x7f2f74100c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009880 tx=0x7f2f6002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.553+0000 7f2f7b017640 1 -- 172.21.15.118:0/144664899 shutdown_connections 2024-09-21T11:55:42.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 --2- 172.21.15.118:0/144664899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 0x7f2f74100c80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 --2- 172.21.15.118:0/144664899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74106820 0x7f2f74106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 -- 172.21.15.118:0/144664899 >> 172.21.15.118:0/144664899 conn(0x7f2f740fc520 msgr2=0x7f2f740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 -- 172.21.15.118:0/144664899 shutdown_connections 2024-09-21T11:55:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 -- 172.21.15.118:0/144664899 wait complete. 2024-09-21T11:55:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 Processor -- start 2024-09-21T11:55:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 -- start start 2024-09-21T11:55:42.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 0x7f2f7419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:42.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74106820 0x7f2f7419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:42.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7410dd50 con 0x7f2f74100820 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.554+0000 7f2f7b017640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7410dbd0 con 0x7f2f74106820 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f78db3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 0x7f2f7419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f78db3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 0x7f2f7419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56674/0 (socket says 172.21.15.118:56674) 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f78db3640 1 -- 172.21.15.118:0/183770942 learned_addr learned my addr 172.21.15.118:0/183770942 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f73fff640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74106820 0x7f2f7419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f78db3640 1 -- 172.21.15.118:0/183770942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74106820 msgr2=0x7f2f7419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f78db3640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74106820 0x7f2f7419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f78db3640 1 -- 172.21.15.118:0/183770942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f74197840 con 0x7f2f74100820 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f78db3640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 0x7f2f7419d6c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800b420 tx=0x7f2f6800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f71ffb640 1 -- 172.21.15.118:0/183770942 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f68011630 con 0x7f2f74100820 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f71ffb640 1 -- 172.21.15.118:0/183770942 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f68016070 con 0x7f2f74100820 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f74197b30 con 0x7f2f74100820 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.555+0000 7f2f71ffb640 1 -- 172.21.15.118:0/183770942 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f68010d40 con 0x7f2f74100820 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.556+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f74198090 con 0x7f2f74100820 2024-09-21T11:55:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.556+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f74101f60 con 0x7f2f74100820 2024-09-21T11:55:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.557+0000 7f2f71ffb640 1 -- 172.21.15.118:0/183770942 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2f6801b460 con 0x7f2f74100820 2024-09-21T11:55:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.557+0000 7f2f71ffb640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f6407af30 0x7f2f6407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:55:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.558+0000 7f2f71ffb640 1 -- 172.21.15.118:0/183770942 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f2f6809d770 con 0x7f2f74100820 2024-09-21T11:55:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.558+0000 7f2f73fff640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f6407af30 0x7f2f6407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:55:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.558+0000 7f2f73fff640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f6407af30 0x7f2f6407d3f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2f74198b90 tx=0x7f2f60031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:55:42.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.562+0000 7f2f71ffb640 1 -- 172.21.15.118:0/183770942 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f68068cc0 con 0x7f2f74100820 2024-09-21T11:55:42.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:42 smithi149 ceph-mon[79770]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:42.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:42 smithi149 ceph-mon[79770]: from='client.34756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:42.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:42 smithi149 ceph-mon[79770]: from='client.34760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:42.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:42 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2135978991' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:55:42.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:42 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/448352551' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:55:42.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.809+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2f74109dc0 con 0x7f2f74100820 2024-09-21T11:55:42.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.809+0000 7f2f71ffb640 1 -- 172.21.15.118:0/183770942 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f2f6806db70 con 0x7f2f74100820 2024-09-21T11:55:42.812 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:55:42.812 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:55:42.812 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:55:42.812 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:55:42.812 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:55:42.812 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:55:42.812 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:55:42.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f6407af30 msgr2=0x7f2f6407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f6407af30 0x7f2f6407d3f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2f74198b90 tx=0x7f2f60031400 comp rx=0 tx=0).stop 2024-09-21T11:55:42.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 msgr2=0x7f2f7419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:55:42.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 0x7f2f7419d6c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800b420 tx=0x7f2f6800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 shutdown_connections 2024-09-21T11:55:42.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74106820 0x7f2f7419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f6407af30 0x7f2f6407d3f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 --2- 172.21.15.118:0/183770942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f74100820 0x7f2f7419d6c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:55:42.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 >> 172.21.15.118:0/183770942 conn(0x7f2f740fc520 msgr2=0x7f2f7406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:55:42.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 shutdown_connections 2024-09-21T11:55:42.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:55:42.812+0000 7f2f7b017640 1 -- 172.21.15.118:0/183770942 wait complete. 2024-09-21T11:55:43.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:43 smithi149 ceph-mon[79770]: pgmap v506: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:43.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:43 smithi149 ceph-mon[79770]: from='client.34772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:43.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:43 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/183770942' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:55:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:43 smithi118 ceph-mon[111738]: pgmap v506: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:43 smithi118 ceph-mon[111738]: from='client.34772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:55:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:43 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/183770942' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:55:45.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:45 smithi149 ceph-mon[79770]: pgmap v507: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:45 smithi118 ceph-mon[111738]: pgmap v507: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:47.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:47 smithi149 ceph-mon[79770]: pgmap v508: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:47 smithi118 ceph-mon[111738]: pgmap v508: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:49.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:49 smithi149 ceph-mon[79770]: pgmap v509: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:49 smithi118 ceph-mon[111738]: pgmap v509: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:55:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:55:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:51 smithi149 ceph-mon[79770]: pgmap v510: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:51.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:51 smithi118 ceph-mon[111738]: pgmap v510: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:53.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:53 smithi149 ceph-mon[79770]: pgmap v511: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:53 smithi118 ceph-mon[111738]: pgmap v511: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:55.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:55 smithi149 ceph-mon[79770]: pgmap v512: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:55 smithi118 ceph-mon[111738]: pgmap v512: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:57.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:57 smithi149 ceph-mon[79770]: pgmap v513: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:57 smithi118 ceph-mon[111738]: pgmap v513: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:59.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:55:59 smithi118 ceph-mon[111738]: pgmap v514: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:55:59.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:55:59 smithi149 ceph-mon[79770]: pgmap v514: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:01.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:01 smithi149 ceph-mon[79770]: pgmap v515: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:01.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:01 smithi118 ceph-mon[111738]: pgmap v515: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:03.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:03 smithi149 ceph-mon[79770]: pgmap v516: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:03 smithi118 ceph-mon[111738]: pgmap v516: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:05 smithi149 ceph-mon[79770]: pgmap v517: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:56:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:05 smithi118 ceph-mon[111738]: pgmap v517: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:56:07.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:07 smithi149 ceph-mon[79770]: pgmap v518: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:07 smithi118 ceph-mon[111738]: pgmap v518: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:09 smithi149 ceph-mon[79770]: pgmap v519: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:09.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:09 smithi118 ceph-mon[111738]: pgmap v519: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:11.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:11 smithi149 ceph-mon[79770]: pgmap v520: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:11 smithi118 ceph-mon[111738]: pgmap v520: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:12.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.912+0000 7f3889755640 1 -- 172.21.15.118:0/1237499871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884101930 msgr2=0x7f3884101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:12.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.912+0000 7f3889755640 1 --2- 172.21.15.118:0/1237499871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884101930 0x7f3884101d90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3878009880 tx=0x7f387802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:56:12.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.912+0000 7f3889755640 1 -- 172.21.15.118:0/1237499871 shutdown_connections 2024-09-21T11:56:12.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.912+0000 7f3889755640 1 --2- 172.21.15.118:0/1237499871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884101930 0x7f3884101d90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:12.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.912+0000 7f3889755640 1 --2- 172.21.15.118:0/1237499871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3884107930 0x7f3884107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:12.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.912+0000 7f3889755640 1 -- 172.21.15.118:0/1237499871 >> 172.21.15.118:0/1237499871 conn(0x7f38840fd630 msgr2=0x7f38840ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:12.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.912+0000 7f3889755640 1 -- 172.21.15.118:0/1237499871 shutdown_connections 2024-09-21T11:56:12.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.912+0000 7f3889755640 1 -- 172.21.15.118:0/1237499871 wait complete. 2024-09-21T11:56:12.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.913+0000 7f3889755640 1 Processor -- start 2024-09-21T11:56:12.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.913+0000 7f3889755640 1 -- start start 2024-09-21T11:56:12.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f3889755640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3884101930 0x7f388419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f3889755640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884107930 0x7f388419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f3889755640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f388410ee60 con 0x7f3884107930 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f3889755640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f388410ece0 con 0x7f3884101930 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f38827fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884107930 0x7f388419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f38827fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884107930 0x7f388419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44260/0 (socket says 172.21.15.118:44260) 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f38827fc640 1 -- 172.21.15.118:0/2024688733 learned_addr learned my addr 172.21.15.118:0/2024688733 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f3882ffd640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3884101930 0x7f388419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f38827fc640 1 -- 172.21.15.118:0/2024688733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3884101930 msgr2=0x7f388419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f38827fc640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3884101930 0x7f388419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f38827fc640 1 -- 172.21.15.118:0/2024688733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3884197870 con 0x7f3884107930 2024-09-21T11:56:12.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f38827fc640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884107930 0x7f388419dbf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3878031460 tx=0x7f38780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:12.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f386bfff640 1 -- 172.21.15.118:0/2024688733 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f387803f070 con 0x7f3884107930 2024-09-21T11:56:12.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3884197b00 con 0x7f3884107930 2024-09-21T11:56:12.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.914+0000 7f386bfff640 1 -- 172.21.15.118:0/2024688733 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3878004cf0 con 0x7f3884107930 2024-09-21T11:56:12.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.915+0000 7f386bfff640 1 -- 172.21.15.118:0/2024688733 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3878035030 con 0x7f3884107930 2024-09-21T11:56:12.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.915+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3884198030 con 0x7f3884107930 2024-09-21T11:56:12.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.916+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3884103070 con 0x7f3884107930 2024-09-21T11:56:12.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.916+0000 7f386bfff640 1 -- 172.21.15.118:0/2024688733 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3878042070 con 0x7f3884107930 2024-09-21T11:56:12.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.917+0000 7f386bfff640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f386c07af30 0x7f386c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:12.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.917+0000 7f386bfff640 1 -- 172.21.15.118:0/2024688733 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f38780bebb0 con 0x7f3884107930 2024-09-21T11:56:12.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.917+0000 7f3882ffd640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f386c07af30 0x7f386c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:12.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.917+0000 7f3882ffd640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f386c07af30 0x7f386c07d3f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f38841989b0 tx=0x7f3874008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:12.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:12.921+0000 7f386bfff640 1 -- 172.21.15.118:0/2024688733 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38780c5080 con 0x7f3884107930 2024-09-21T11:56:13.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.114+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3884198da0 con 0x7f386c07af30 2024-09-21T11:56:13.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.115+0000 7f386bfff640 1 -- 172.21.15.118:0/2024688733 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3884198da0 con 0x7f386c07af30 2024-09-21T11:56:13.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f386c07af30 msgr2=0x7f386c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f386c07af30 0x7f386c07d3f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f38841989b0 tx=0x7f3874008040 comp rx=0 tx=0).stop 2024-09-21T11:56:13.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884107930 msgr2=0x7f388419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884107930 0x7f388419dbf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3878031460 tx=0x7f38780048f0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 shutdown_connections 2024-09-21T11:56:13.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f386c07af30 0x7f386c07d3f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3884107930 0x7f388419dbf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 --2- 172.21.15.118:0/2024688733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3884101930 0x7f388419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 >> 172.21.15.118:0/2024688733 conn(0x7f38840fd630 msgr2=0x7f38840fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:13.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 shutdown_connections 2024-09-21T11:56:13.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.117+0000 7f3889755640 1 -- 172.21.15.118:0/2024688733 wait complete. 2024-09-21T11:56:13.128 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:56:13.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.201+0000 7fcbfafab640 1 -- 172.21.15.118:0/3528352054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4102ae0 msgr2=0x7fcbf4102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.201+0000 7fcbfafab640 1 --2- 172.21.15.118:0/3528352054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4102ae0 0x7fcbf4102ec0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009c20 tx=0x7fcbe402aa00 comp rx=0 tx=0).stop 2024-09-21T11:56:13.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.201+0000 7fcbfafab640 1 -- 172.21.15.118:0/3528352054 shutdown_connections 2024-09-21T11:56:13.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.201+0000 7fcbfafab640 1 --2- 172.21.15.118:0/3528352054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf4103400 0x7fcbf410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.201+0000 7fcbfafab640 1 --2- 172.21.15.118:0/3528352054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4102ae0 0x7fcbf4102ec0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.201+0000 7fcbfafab640 1 -- 172.21.15.118:0/3528352054 >> 172.21.15.118:0/3528352054 conn(0x7fcbf40fc520 msgr2=0x7fcbf40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:13.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.201+0000 7fcbfafab640 1 -- 172.21.15.118:0/3528352054 shutdown_connections 2024-09-21T11:56:13.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.201+0000 7fcbfafab640 1 -- 172.21.15.118:0/3528352054 wait complete. 2024-09-21T11:56:13.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbfafab640 1 Processor -- start 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbfafab640 1 -- start start 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbfafab640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf4102ae0 0x7fcbf4100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbfafab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4103400 0x7fcbf4100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbfafab640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf410ee10 con 0x7fcbf4103400 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbfafab640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf410ec90 con 0x7fcbf4102ae0 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbf3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4103400 0x7fcbf4100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbf3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4103400 0x7fcbf4100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44266/0 (socket says 172.21.15.118:44266) 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbf3fff640 1 -- 172.21.15.118:0/624788947 learned_addr learned my addr 172.21.15.118:0/624788947 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbf8d47640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf4102ae0 0x7fcbf4100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbf3fff640 1 -- 172.21.15.118:0/624788947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf4102ae0 msgr2=0x7fcbf4100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbf3fff640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf4102ae0 0x7fcbf4100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.202+0000 7fcbf3fff640 1 -- 172.21.15.118:0/624788947 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf41011c0 con 0x7fcbf4103400 2024-09-21T11:56:13.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.203+0000 7fcbf3fff640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4103400 0x7fcbf4100c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c8f0 tx=0x7fcbe800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:13.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.203+0000 7fcbf1ffb640 1 -- 172.21.15.118:0/624788947 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbe800ae50 con 0x7fcbf4103400 2024-09-21T11:56:13.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.203+0000 7fcbf1ffb640 1 -- 172.21.15.118:0/624788947 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbe8005020 con 0x7fcbf4103400 2024-09-21T11:56:13.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.203+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf41014b0 con 0x7fcbf4103400 2024-09-21T11:56:13.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.203+0000 7fcbf1ffb640 1 -- 172.21.15.118:0/624788947 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbe8004d70 con 0x7fcbf4103400 2024-09-21T11:56:13.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.203+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf41a3e80 con 0x7fcbf4103400 2024-09-21T11:56:13.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.204+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf406abe0 con 0x7fcbf4103400 2024-09-21T11:56:13.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.204+0000 7fcbf1ffb640 1 -- 172.21.15.118:0/624788947 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcbe80051d0 con 0x7fcbf4103400 2024-09-21T11:56:13.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.205+0000 7fcbf1ffb640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcbdc07b0e0 0x7fcbdc07d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:13.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.205+0000 7fcbf1ffb640 1 -- 172.21.15.118:0/624788947 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fcbe809df10 con 0x7fcbf4103400 2024-09-21T11:56:13.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.205+0000 7fcbf8d47640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcbdc07b0e0 0x7fcbdc07d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:13.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.205+0000 7fcbf8d47640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcbdc07b0e0 0x7fcbdc07d5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4006010 tx=0x7fcbe4009380 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:13.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.209+0000 7fcbf1ffb640 1 -- 172.21.15.118:0/624788947 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcbe8014030 con 0x7fcbf4103400 2024-09-21T11:56:13.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.401+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcbf4062630 con 0x7fcbdc07b0e0 2024-09-21T11:56:13.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.402+0000 7fcbf1ffb640 1 -- 172.21.15.118:0/624788947 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fcbf4062630 con 0x7fcbdc07b0e0 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcbdc07b0e0 msgr2=0x7fcbdc07d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcbdc07b0e0 0x7fcbdc07d5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4006010 tx=0x7fcbe4009380 comp rx=0 tx=0).stop 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4103400 msgr2=0x7fcbf4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4103400 0x7fcbf4100c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c8f0 tx=0x7fcbe800cdb0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 shutdown_connections 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcbdc07b0e0 0x7fcbdc07d5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbf4103400 0x7fcbf4100c80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 --2- 172.21.15.118:0/624788947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf4102ae0 0x7fcbf4100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 >> 172.21.15.118:0/624788947 conn(0x7fcbf40fc520 msgr2=0x7fcbf4108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:13.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.404+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 shutdown_connections 2024-09-21T11:56:13.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.405+0000 7fcbfafab640 1 -- 172.21.15.118:0/624788947 wait complete. 2024-09-21T11:56:13.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 -- 172.21.15.118:0/2094817129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41007e0 msgr2=0x7f78c4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 --2- 172.21.15.118:0/2094817129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41007e0 0x7f78c4100c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009880 tx=0x7f78b402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 -- 172.21.15.118:0/2094817129 shutdown_connections 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 --2- 172.21.15.118:0/2094817129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41007e0 0x7f78c4100c40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 --2- 172.21.15.118:0/2094817129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78c41067e0 0x7f78c4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 -- 172.21.15.118:0/2094817129 >> 172.21.15.118:0/2094817129 conn(0x7f78c40fc4c0 msgr2=0x7f78c40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 -- 172.21.15.118:0/2094817129 shutdown_connections 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 -- 172.21.15.118:0/2094817129 wait complete. 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 Processor -- start 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.486+0000 7f78cc40f640 1 -- start start 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78cc40f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78c41007e0 0x7f78c40fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78cc40f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41067e0 0x7f78c40fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78cc40f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f78c410dd10 con 0x7f78c41067e0 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78cc40f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f78c410db90 con 0x7f78c41007e0 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78c99aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41067e0 0x7f78c40fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78c99aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41067e0 0x7f78c40fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44274/0 (socket says 172.21.15.118:44274) 2024-09-21T11:56:13.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78c99aa640 1 -- 172.21.15.118:0/2499858979 learned_addr learned my addr 172.21.15.118:0/2499858979 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:13.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78ca1ab640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78c41007e0 0x7f78c40fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:13.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78c99aa640 1 -- 172.21.15.118:0/2499858979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78c41007e0 msgr2=0x7f78c40fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78c99aa640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78c41007e0 0x7f78c40fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78c99aa640 1 -- 172.21.15.118:0/2499858979 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c40fd6c0 con 0x7f78c41067e0 2024-09-21T11:56:13.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78c99aa640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41067e0 0x7f78c40fd180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f78b4031460 tx=0x7f78b40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78bb7fe640 1 -- 172.21.15.118:0/2499858979 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78b403f070 con 0x7f78c41067e0 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c40fd950 con 0x7f78c41067e0 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78bb7fe640 1 -- 172.21.15.118:0/2499858979 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78b40044d0 con 0x7f78c41067e0 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.487+0000 7f78bb7fe640 1 -- 172.21.15.118:0/2499858979 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78b4035030 con 0x7f78c41067e0 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.488+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c41a3dc0 con 0x7f78c41067e0 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.489+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c4101f20 con 0x7f78c41067e0 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.489+0000 7f78bb7fe640 1 -- 172.21.15.118:0/2499858979 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f78b4042070 con 0x7f78c41067e0 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.490+0000 7f78bb7fe640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78b007af40 0x7f78b007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.490+0000 7f78bb7fe640 1 -- 172.21.15.118:0/2499858979 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f78b40bec30 con 0x7f78c41067e0 2024-09-21T11:56:13.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.490+0000 7f78ca1ab640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78b007af40 0x7f78b007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:13.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.490+0000 7f78ca1ab640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78b007af40 0x7f78b007d400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009890 tx=0x7f78c0008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:13.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.494+0000 7f78bb7fe640 1 -- 172.21.15.118:0/2499858979 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78b4004cf0 con 0x7f78c41067e0 2024-09-21T11:56:13.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.681+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f78c4062630 con 0x7f78b007af40 2024-09-21T11:56:13.684 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:13 smithi118 ceph-mon[111738]: pgmap v521: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:13.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.691+0000 7f78bb7fe640 1 -- 172.21.15.118:0/2499858979 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f78c4062630 con 0x7f78b007af40 2024-09-21T11:56:13.693 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:56:13.693 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (14m) 8m ago 25m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:56:13.693 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (17m) 8m ago 25m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (16m) 8m ago 24m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (12m) 8m ago 25m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (12m) 8m ago 24m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (13m) 8m ago 24m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (8m) 8m ago 19m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (8m) 8m ago 19m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (19m) 8m ago 19m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (8m) 8m ago 19m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (16m) 8m ago 26m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (15m) 8m ago 24m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (12m) 8m ago 26m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (12m) 8m ago 24m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:56:13.694 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (14m) 8m ago 25m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:56:13.695 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (14m) 8m ago 24m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:56:13.695 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (11m) 8m ago 23m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:56:13.695 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (11m) 8m ago 22m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:56:13.695 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (10m) 8m ago 22m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:56:13.695 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (10m) 8m ago 21m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:56:13.695 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (9m) 8m ago 21m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:56:13.695 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (8m) 8m ago 20m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:56:13.695 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (14m) 8m ago 24m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:56:13.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78b007af40 msgr2=0x7f78b007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78b007af40 0x7f78b007d400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009890 tx=0x7f78c0008040 comp rx=0 tx=0).stop 2024-09-21T11:56:13.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41067e0 msgr2=0x7f78c40fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41067e0 0x7f78c40fd180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f78b4031460 tx=0x7f78b40048f0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 shutdown_connections 2024-09-21T11:56:13.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78b007af40 0x7f78b007d400 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c41067e0 0x7f78c40fd180 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 --2- 172.21.15.118:0/2499858979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78c41007e0 0x7f78c40fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 >> 172.21.15.118:0/2499858979 conn(0x7f78c40fc4c0 msgr2=0x7f78c4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:13.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 shutdown_connections 2024-09-21T11:56:13.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.694+0000 7f78cc40f640 1 -- 172.21.15.118:0/2499858979 wait complete. 2024-09-21T11:56:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:13 smithi149 ceph-mon[79770]: pgmap v521: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:13.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.773+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1930603123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8102b40 msgr2=0x7fb0e8102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.773+0000 7fb0eefc2640 1 --2- 172.21.15.118:0/1930603123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8102b40 0x7fb0e8102f20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009880 tx=0x7fb0d802a530 comp rx=0 tx=0).stop 2024-09-21T11:56:13.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1930603123 shutdown_connections 2024-09-21T11:56:13.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 --2- 172.21.15.118:0/1930603123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0e8103460 0x7fb0e810b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 --2- 172.21.15.118:0/1930603123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8102b40 0x7fb0e8102f20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1930603123 >> 172.21.15.118:0/1930603123 conn(0x7fb0e80fc4c0 msgr2=0x7fb0e80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:13.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1930603123 shutdown_connections 2024-09-21T11:56:13.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1930603123 wait complete. 2024-09-21T11:56:13.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 Processor -- start 2024-09-21T11:56:13.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 -- start start 2024-09-21T11:56:13.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0e8102b40 0x7fb0e819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:13.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8103460 0x7fb0e819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:13.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e810ee30 con 0x7fb0e8103460 2024-09-21T11:56:13.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.774+0000 7fb0eefc2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e810ecb0 con 0x7fb0e8102b40 2024-09-21T11:56:13.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8103460 0x7fb0e819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8103460 0x7fb0e819fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44284/0 (socket says 172.21.15.118:44284) 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e7fff640 1 -- 172.21.15.118:0/1016820248 learned_addr learned my addr 172.21.15.118:0/1016820248 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0ecd5e640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0e8102b40 0x7fb0e819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e7fff640 1 -- 172.21.15.118:0/1016820248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0e8102b40 msgr2=0x7fb0e819f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e7fff640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0e8102b40 0x7fb0e819f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e7fff640 1 -- 172.21.15.118:0/1016820248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e8199ad0 con 0x7fb0e8103460 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e7fff640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8103460 0x7fb0e819fe50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00b420 tx=0x7fb0dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e5ffb640 1 -- 172.21.15.118:0/1016820248 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb0dc011630 con 0x7fb0e8103460 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e5ffb640 1 -- 172.21.15.118:0/1016820248 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb0dc016070 con 0x7fb0e8103460 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e8199dc0 con 0x7fb0e8103460 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0e5ffb640 1 -- 172.21.15.118:0/1016820248 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb0dc010d40 con 0x7fb0e8103460 2024-09-21T11:56:13.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.775+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e819a350 con 0x7fb0e8103460 2024-09-21T11:56:13.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.776+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e806a370 con 0x7fb0e8103460 2024-09-21T11:56:13.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.777+0000 7fb0e5ffb640 1 -- 172.21.15.118:0/1016820248 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb0dc01b460 con 0x7fb0e8103460 2024-09-21T11:56:13.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.777+0000 7fb0e5ffb640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb0d007af80 0x7fb0d007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:13.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.777+0000 7fb0e5ffb640 1 -- 172.21.15.118:0/1016820248 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb0dc09d6a0 con 0x7fb0e8103460 2024-09-21T11:56:13.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.777+0000 7fb0ecd5e640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb0d007af80 0x7fb0d007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:13.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.778+0000 7fb0ecd5e640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb0d007af80 0x7fb0d007d440 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80096c0 tx=0x7fb0d8004f30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:13.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:13.782+0000 7fb0e5ffb640 1 -- 172.21.15.118:0/1016820248 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0dc068c70 con 0x7fb0e8103460 2024-09-21T11:56:14.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.027+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb0e819afc0 con 0x7fb0e8103460 2024-09-21T11:56:14.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.027+0000 7fb0e5ffb640 1 -- 172.21.15.118:0/1016820248 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fb0dc06db20 con 0x7fb0e8103460 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:56:14.030 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:56:14.031 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:56:14.031 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:56:14.031 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:56:14.031 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:56:14.031 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:56:14.031 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:56:14.031 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:56:14.031 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:56:14.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb0d007af80 msgr2=0x7fb0d007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb0d007af80 0x7fb0d007d440 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80096c0 tx=0x7fb0d8004f30 comp rx=0 tx=0).stop 2024-09-21T11:56:14.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8103460 msgr2=0x7fb0e819fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8103460 0x7fb0e819fe50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00b420 tx=0x7fb0dc00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 shutdown_connections 2024-09-21T11:56:14.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb0d007af80 0x7fb0d007d440 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0e8103460 0x7fb0e819fe50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 --2- 172.21.15.118:0/1016820248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0e8102b40 0x7fb0e819f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 >> 172.21.15.118:0/1016820248 conn(0x7fb0e80fc4c0 msgr2=0x7fb0e8100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:14.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 shutdown_connections 2024-09-21T11:56:14.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.030+0000 7fb0eefc2640 1 -- 172.21.15.118:0/1016820248 wait complete. 2024-09-21T11:56:14.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.111+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/3803756654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84103400 msgr2=0x7f4a8410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.111+0000 7f4a8a2ba640 1 --2- 172.21.15.118:0/3803756654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84103400 0x7f4a8410b8f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009880 tx=0x7f4a7802a530 comp rx=0 tx=0).stop 2024-09-21T11:56:14.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.111+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/3803756654 shutdown_connections 2024-09-21T11:56:14.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.111+0000 7f4a8a2ba640 1 --2- 172.21.15.118:0/3803756654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84103400 0x7f4a8410b8f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.111+0000 7f4a8a2ba640 1 --2- 172.21.15.118:0/3803756654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a84102ae0 0x7f4a84102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.111+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/3803756654 >> 172.21.15.118:0/3803756654 conn(0x7f4a840fc520 msgr2=0x7f4a840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:14.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.111+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/3803756654 shutdown_connections 2024-09-21T11:56:14.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.111+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/3803756654 wait complete. 2024-09-21T11:56:14.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a8a2ba640 1 Processor -- start 2024-09-21T11:56:14.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a8a2ba640 1 -- start start 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a8a2ba640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84102ae0 0x7f4a84100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a8a2ba640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a84103400 0x7f4a84100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a8a2ba640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8410ee10 con 0x7f4a84102ae0 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a8a2ba640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8410ec90 con 0x7f4a84103400 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a83fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84102ae0 0x7f4a84100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a83fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84102ae0 0x7f4a84100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44302/0 (socket says 172.21.15.118:44302) 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a83fff640 1 -- 172.21.15.118:0/1310750479 learned_addr learned my addr 172.21.15.118:0/1310750479 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a837fe640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a84103400 0x7f4a84100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a83fff640 1 -- 172.21.15.118:0/1310750479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a84103400 msgr2=0x7f4a84100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a83fff640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a84103400 0x7f4a84100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.112+0000 7f4a83fff640 1 -- 172.21.15.118:0/1310750479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a841011c0 con 0x7f4a84102ae0 2024-09-21T11:56:14.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.113+0000 7f4a83fff640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84102ae0 0x7f4a84100740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400c8f0 tx=0x7f4a7400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:14.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.113+0000 7f4a817fa640 1 -- 172.21.15.118:0/1310750479 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a740079b0 con 0x7f4a84102ae0 2024-09-21T11:56:14.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.113+0000 7f4a817fa640 1 -- 172.21.15.118:0/1310750479 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a740054e0 con 0x7f4a84102ae0 2024-09-21T11:56:14.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.113+0000 7f4a817fa640 1 -- 172.21.15.118:0/1310750479 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a74004dd0 con 0x7f4a84102ae0 2024-09-21T11:56:14.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.113+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a841014b0 con 0x7f4a84102ae0 2024-09-21T11:56:14.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.113+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a841a3ea0 con 0x7f4a84102ae0 2024-09-21T11:56:14.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.114+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8406abe0 con 0x7f4a84102ae0 2024-09-21T11:56:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.114+0000 7f4a817fa640 1 -- 172.21.15.118:0/1310750479 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4a74005020 con 0x7f4a84102ae0 2024-09-21T11:56:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.115+0000 7f4a817fa640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a6c07aed0 0x7f4a6c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.115+0000 7f4a817fa640 1 -- 172.21.15.118:0/1310750479 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f4a7409e070 con 0x7f4a84102ae0 2024-09-21T11:56:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.115+0000 7f4a837fe640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a6c07aed0 0x7f4a6c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.115+0000 7f4a837fe640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a6c07aed0 0x7f4a6c07d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4a78031460 tx=0x7f4a78009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:14.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.119+0000 7f4a817fa640 1 -- 172.21.15.118:0/1310750479 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a74014030 con 0x7f4a84102ae0 2024-09-21T11:56:14.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.333+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4a84105f80 con 0x7f4a84102ae0 2024-09-21T11:56:14.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.334+0000 7f4a817fa640 1 -- 172.21.15.118:0/1310750479 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f4a740695c0 con 0x7f4a84102ae0 2024-09-21T11:56:14.336 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:56:14.336 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:56:14.336 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:56:14.337 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:56:14.338 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:56:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:56:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:56:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a6c07aed0 msgr2=0x7f4a6c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a6c07aed0 0x7f4a6c07d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4a78031460 tx=0x7f4a78009560 comp rx=0 tx=0).stop 2024-09-21T11:56:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84102ae0 msgr2=0x7f4a84100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84102ae0 0x7f4a84100740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400c8f0 tx=0x7f4a7400cdb0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 shutdown_connections 2024-09-21T11:56:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a84103400 0x7f4a84100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a6c07aed0 0x7f4a6c07d390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 --2- 172.21.15.118:0/1310750479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a84102ae0 0x7f4a84100740 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 >> 172.21.15.118:0/1310750479 conn(0x7f4a840fc520 msgr2=0x7f4a84108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:14.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 shutdown_connections 2024-09-21T11:56:14.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.336+0000 7f4a8a2ba640 1 -- 172.21.15.118:0/1310750479 wait complete. 2024-09-21T11:56:14.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.419+0000 7f6756e64640 1 -- 172.21.15.118:0/1099821573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 msgr2=0x7f6750106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.419+0000 7f6756e64640 1 --2- 172.21.15.118:0/1099821573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 0x7f6750106bc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6744009880 tx=0x7f674402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.419+0000 7f6756e64640 1 -- 172.21.15.118:0/1099821573 shutdown_connections 2024-09-21T11:56:14.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.419+0000 7f6756e64640 1 --2- 172.21.15.118:0/1099821573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67501007e0 0x7f6750100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.419+0000 7f6756e64640 1 --2- 172.21.15.118:0/1099821573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 0x7f6750106bc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.419+0000 7f6756e64640 1 -- 172.21.15.118:0/1099821573 >> 172.21.15.118:0/1099821573 conn(0x7f67500fc4c0 msgr2=0x7f67500fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:14.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.419+0000 7f6756e64640 1 -- 172.21.15.118:0/1099821573 shutdown_connections 2024-09-21T11:56:14.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.419+0000 7f6756e64640 1 -- 172.21.15.118:0/1099821573 wait complete. 2024-09-21T11:56:14.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.419+0000 7f6756e64640 1 Processor -- start 2024-09-21T11:56:14.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f6756e64640 1 -- start start 2024-09-21T11:56:14.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f6756e64640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67501007e0 0x7f675019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:14.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f6756e64640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 0x7f675019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f6756e64640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f675010dcb0 con 0x7f67501067e0 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f6756e64640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f675010db30 con 0x7f67501007e0 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f674ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 0x7f675019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f674ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 0x7f675019db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44322/0 (socket says 172.21.15.118:44322) 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f674ffff640 1 -- 172.21.15.118:0/1625424554 learned_addr learned my addr 172.21.15.118:0/1625424554 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f674ffff640 1 -- 172.21.15.118:0/1625424554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67501007e0 msgr2=0x7f675019d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f674ffff640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67501007e0 0x7f675019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f674ffff640 1 -- 172.21.15.118:0/1625424554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6750197790 con 0x7f67501067e0 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f674ffff640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 0x7f675019db50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f673c00d6f0 tx=0x7f673c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.420+0000 7f674dffb640 1 -- 172.21.15.118:0/1625424554 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f673c017070 con 0x7f67501067e0 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.421+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6750197a80 con 0x7f67501067e0 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.421+0000 7f674dffb640 1 -- 172.21.15.118:0/1625424554 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f673c00de00 con 0x7f67501067e0 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.421+0000 7f674dffb640 1 -- 172.21.15.118:0/1625424554 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f673c004bb0 con 0x7f67501067e0 2024-09-21T11:56:14.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.421+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6750198010 con 0x7f67501067e0 2024-09-21T11:56:14.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.422+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6750101f20 con 0x7f67501067e0 2024-09-21T11:56:14.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.422+0000 7f674dffb640 1 -- 172.21.15.118:0/1625424554 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f673c004e60 con 0x7f67501067e0 2024-09-21T11:56:14.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.423+0000 7f674dffb640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f674007af30 0x7f674007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:14.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.423+0000 7f674dffb640 1 -- 172.21.15.118:0/1625424554 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f673c09dd00 con 0x7f67501067e0 2024-09-21T11:56:14.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.423+0000 7f6754c00640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f674007af30 0x7f674007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:14.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.423+0000 7f6754c00640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f674007af30 0x7f674007d3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f67440096c0 tx=0x7f6744000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:14.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.427+0000 7f674dffb640 1 -- 172.21.15.118:0/1625424554 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f673c0a1030 con 0x7f67501067e0 2024-09-21T11:56:14.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.625+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f67501982c0 con 0x7f674007af30 2024-09-21T11:56:14.628 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:14 smithi118 ceph-mon[111738]: from='client.34780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:14.628 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:14 smithi118 ceph-mon[111738]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:14.628 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:14 smithi118 ceph-mon[111738]: from='client.34788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:14.628 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:14 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1016820248' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:56:14.628 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:14 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1310750479' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:56:14.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.626+0000 7f674dffb640 1 -- 172.21.15.118:0/1625424554 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f67501982c0 con 0x7f674007af30 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:56:14.629 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:56:14.630 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f674007af30 msgr2=0x7f674007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f674007af30 0x7f674007d3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f67440096c0 tx=0x7f6744000bc0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 msgr2=0x7f675019db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 0x7f675019db50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f673c00d6f0 tx=0x7f673c00dbb0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 shutdown_connections 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f674007af30 0x7f674007d3f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67501067e0 0x7f675019db50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 --2- 172.21.15.118:0/1625424554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67501007e0 0x7f675019d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 >> 172.21.15.118:0/1625424554 conn(0x7f67500fc4c0 msgr2=0x7f67501045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.628+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 shutdown_connections 2024-09-21T11:56:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.629+0000 7f6756e64640 1 -- 172.21.15.118:0/1625424554 wait complete. 2024-09-21T11:56:14.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.710+0000 7f10615bd640 1 -- 172.21.15.118:0/1014565439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 msgr2=0x7f105c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.710+0000 7f10615bd640 1 --2- 172.21.15.118:0/1014565439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 0x7f105c106c00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f104c009880 tx=0x7f104c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.710+0000 7f10615bd640 1 -- 172.21.15.118:0/1014565439 shutdown_connections 2024-09-21T11:56:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.710+0000 7f10615bd640 1 --2- 172.21.15.118:0/1014565439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105c100820 0x7f105c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.710+0000 7f10615bd640 1 --2- 172.21.15.118:0/1014565439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 0x7f105c106c00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.710+0000 7f10615bd640 1 -- 172.21.15.118:0/1014565439 >> 172.21.15.118:0/1014565439 conn(0x7f105c0fc520 msgr2=0x7f105c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.710+0000 7f10615bd640 1 -- 172.21.15.118:0/1014565439 shutdown_connections 2024-09-21T11:56:14.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.710+0000 7f10615bd640 1 -- 172.21.15.118:0/1014565439 wait complete. 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f10615bd640 1 Processor -- start 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f10615bd640 1 -- start start 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f10615bd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105c100820 0x7f105c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f10615bd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 0x7f105c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f10615bd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f105c10dcd0 con 0x7f105c106820 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f10615bd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f105c10db50 con 0x7f105c100820 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f10527fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 0x7f105c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f10527fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 0x7f105c19cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44338/0 (socket says 172.21.15.118:44338) 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f10527fc640 1 -- 172.21.15.118:0/3386855427 learned_addr learned my addr 172.21.15.118:0/3386855427 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.711+0000 7f105affd640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105c100820 0x7f105c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f10527fc640 1 -- 172.21.15.118:0/3386855427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105c100820 msgr2=0x7f105c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f10527fc640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105c100820 0x7f105c19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f10527fc640 1 -- 172.21.15.118:0/3386855427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105c1966a0 con 0x7f105c106820 2024-09-21T11:56:14.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f105affd640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105c100820 0x7f105c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:56:14.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f10527fc640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 0x7f105c19cb10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1044007b50 tx=0x7f104400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:14.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f1058ff9640 1 -- 172.21.15.118:0/3386855427 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1044007c40 con 0x7f105c106820 2024-09-21T11:56:14.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f1058ff9640 1 -- 172.21.15.118:0/3386855427 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1044007de0 con 0x7f105c106820 2024-09-21T11:56:14.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105c196930 con 0x7f105c106820 2024-09-21T11:56:14.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f1058ff9640 1 -- 172.21.15.118:0/3386855427 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f104400ae30 con 0x7f105c106820 2024-09-21T11:56:14.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.712+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f105c196ec0 con 0x7f105c106820 2024-09-21T11:56:14.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.713+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105c101f60 con 0x7f105c106820 2024-09-21T11:56:14.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.714+0000 7f1058ff9640 1 -- 172.21.15.118:0/3386855427 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f104400eab0 con 0x7f105c106820 2024-09-21T11:56:14.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.714+0000 7f1058ff9640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f104807aed0 0x7f104807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:14.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.714+0000 7f1058ff9640 1 -- 172.21.15.118:0/3386855427 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f1044012050 con 0x7f105c106820 2024-09-21T11:56:14.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.714+0000 7f105affd640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f104807aed0 0x7f104807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:14.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.715+0000 7f105affd640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f104807aed0 0x7f104807d390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f104c031460 tx=0x7f104c009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:14.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.719+0000 7f1058ff9640 1 -- 172.21.15.118:0/3386855427 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1044023020 con 0x7f105c106820 2024-09-21T11:56:14.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:14 smithi149 ceph-mon[79770]: from='client.34780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:14.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:14 smithi149 ceph-mon[79770]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:14.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:14 smithi149 ceph-mon[79770]: from='client.34788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:14.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:14 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1016820248' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:56:14.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:14 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1310750479' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:56:14.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.961+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f105c197170 con 0x7f105c106820 2024-09-21T11:56:14.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.962+0000 7f1058ff9640 1 -- 172.21.15.118:0/3386855427 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f104406b110 con 0x7f105c106820 2024-09-21T11:56:14.964 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:56:14.964 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:56:14.964 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:56:14.964 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:56:14.965 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:56:14.965 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:56:14.965 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f104807aed0 msgr2=0x7f104807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f104807aed0 0x7f104807d390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f104c031460 tx=0x7f104c009560 comp rx=0 tx=0).stop 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 msgr2=0x7f105c19cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 0x7f105c19cb10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1044007b50 tx=0x7f104400e420 comp rx=0 tx=0).stop 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 shutdown_connections 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f104807aed0 0x7f104807d390 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f105c106820 0x7f105c19cb10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 --2- 172.21.15.118:0/3386855427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f105c100820 0x7f105c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 >> 172.21.15.118:0/3386855427 conn(0x7f105c0fc520 msgr2=0x7f105c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 shutdown_connections 2024-09-21T11:56:14.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:14.964+0000 7f10615bd640 1 -- 172.21.15.118:0/3386855427 wait complete. 2024-09-21T11:56:15.720 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:15 smithi149 ceph-mon[79770]: pgmap v522: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:15.720 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:15 smithi149 ceph-mon[79770]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:15.720 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:15 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3386855427' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:56:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:15 smithi118 ceph-mon[111738]: pgmap v522: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:15 smithi118 ceph-mon[111738]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:15 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3386855427' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:56:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:17 smithi118 ceph-mon[111738]: pgmap v523: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:17.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:17 smithi149 ceph-mon[79770]: pgmap v523: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:19 smithi118 ceph-mon[111738]: pgmap v524: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:19.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:19 smithi149 ceph-mon[79770]: pgmap v524: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:20.793 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:56:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:56:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:21 smithi118 ceph-mon[111738]: pgmap v525: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:21 smithi149 ceph-mon[79770]: pgmap v525: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:23 smithi118 ceph-mon[111738]: pgmap v526: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:23.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:23 smithi149 ceph-mon[79770]: pgmap v526: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:25 smithi118 ceph-mon[111738]: pgmap v527: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:25.866 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:25 smithi149 ceph-mon[79770]: pgmap v527: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:27 smithi118 ceph-mon[111738]: pgmap v528: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:27 smithi149 ceph-mon[79770]: pgmap v528: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:29 smithi118 ceph-mon[111738]: pgmap v529: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:29.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:29 smithi149 ceph-mon[79770]: pgmap v529: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:31 smithi118 ceph-mon[111738]: pgmap v530: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:31.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:31 smithi149 ceph-mon[79770]: pgmap v530: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:33 smithi118 ceph-mon[111738]: pgmap v531: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:34.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:33 smithi149 ceph-mon[79770]: pgmap v531: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:35 smithi118 ceph-mon[111738]: pgmap v532: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:56:36.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:35 smithi149 ceph-mon[79770]: pgmap v532: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:56:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:37 smithi118 ceph-mon[111738]: pgmap v533: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:38.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:37 smithi149 ceph-mon[79770]: pgmap v533: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:40.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:39 smithi118 ceph-mon[111738]: pgmap v534: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:40.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:39 smithi149 ceph-mon[79770]: pgmap v534: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:41 smithi118 ceph-mon[111738]: pgmap v535: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:42.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:41 smithi149 ceph-mon[79770]: pgmap v535: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:43 smithi118 ceph-mon[111738]: pgmap v536: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:44.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:43 smithi149 ceph-mon[79770]: pgmap v536: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.067+0000 7fa7f22f3640 1 -- 172.21.15.118:0/3598479706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec107930 msgr2=0x7fa7ec107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.067+0000 7fa7f22f3640 1 --2- 172.21.15.118:0/3598479706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec107930 0x7fa7ec107d10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009880 tx=0x7fa7dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.067+0000 7fa7f22f3640 1 -- 172.21.15.118:0/3598479706 shutdown_connections 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.067+0000 7fa7f22f3640 1 --2- 172.21.15.118:0/3598479706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7ec101930 0x7fa7ec101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.067+0000 7fa7f22f3640 1 --2- 172.21.15.118:0/3598479706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec107930 0x7fa7ec107d10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.067+0000 7fa7f22f3640 1 -- 172.21.15.118:0/3598479706 >> 172.21.15.118:0/3598479706 conn(0x7fa7ec0fd630 msgr2=0x7fa7ec0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.067+0000 7fa7f22f3640 1 -- 172.21.15.118:0/3598479706 shutdown_connections 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.067+0000 7fa7f22f3640 1 -- 172.21.15.118:0/3598479706 wait complete. 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7f22f3640 1 Processor -- start 2024-09-21T11:56:45.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7f22f3640 1 -- start start 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7f22f3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec101930 0x7fa7ec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7f22f3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7ec107930 0x7fa7ec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7f22f3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec10ede0 con 0x7fa7ec101930 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7f22f3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec10ec60 con 0x7fa7ec107930 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7ebfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec101930 0x7fa7ec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7ebfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec101930 0x7fa7ec0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50656/0 (socket says 172.21.15.118:50656) 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7ebfff640 1 -- 172.21.15.118:0/949443695 learned_addr learned my addr 172.21.15.118:0/949443695 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.068+0000 7fa7eb7fe640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7ec107930 0x7fa7ec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.069+0000 7fa7ebfff640 1 -- 172.21.15.118:0/949443695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7ec107930 msgr2=0x7fa7ec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.069+0000 7fa7ebfff640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7ec107930 0x7fa7ec074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.069+0000 7fa7ebfff640 1 -- 172.21.15.118:0/949443695 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ec074f70 con 0x7fa7ec101930 2024-09-21T11:56:45.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.069+0000 7fa7ebfff640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec101930 0x7fa7ec0744f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc031460 tx=0x7fa7dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:45.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.069+0000 7fa7e97fa640 1 -- 172.21.15.118:0/949443695 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7dc03f070 con 0x7fa7ec101930 2024-09-21T11:56:45.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.069+0000 7fa7e97fa640 1 -- 172.21.15.118:0/949443695 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7dc004cf0 con 0x7fa7ec101930 2024-09-21T11:56:45.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.069+0000 7fa7e97fa640 1 -- 172.21.15.118:0/949443695 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7dc035030 con 0x7fa7ec101930 2024-09-21T11:56:45.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.069+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ec075200 con 0x7fa7ec101930 2024-09-21T11:56:45.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.069+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ec1a3dd0 con 0x7fa7ec101930 2024-09-21T11:56:45.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.070+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ec103070 con 0x7fa7ec101930 2024-09-21T11:56:45.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.071+0000 7fa7e97fa640 1 -- 172.21.15.118:0/949443695 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa7dc042070 con 0x7fa7ec101930 2024-09-21T11:56:45.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.071+0000 7fa7e97fa640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa7d407af30 0x7fa7d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.071+0000 7fa7e97fa640 1 -- 172.21.15.118:0/949443695 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fa7dc0beac0 con 0x7fa7ec101930 2024-09-21T11:56:45.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.071+0000 7fa7eb7fe640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa7d407af30 0x7fa7d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.072+0000 7fa7eb7fe640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa7d407af30 0x7fa7d407d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec075f80 tx=0x7fa7e000a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:45.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.076+0000 7fa7e97fa640 1 -- 172.21.15.118:0/949443695 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7dc08a010 con 0x7fa7ec101930 2024-09-21T11:56:45.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.272+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa7ec062630 con 0x7fa7d407af30 2024-09-21T11:56:45.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.273+0000 7fa7e97fa640 1 -- 172.21.15.118:0/949443695 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa7ec062630 con 0x7fa7d407af30 2024-09-21T11:56:45.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.275+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa7d407af30 msgr2=0x7fa7d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.275+0000 7fa7f22f3640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa7d407af30 0x7fa7d407d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec075f80 tx=0x7fa7e000a2d0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.275+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec101930 msgr2=0x7fa7ec0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.275+0000 7fa7f22f3640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec101930 0x7fa7ec0744f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc031460 tx=0x7fa7dc0048f0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.276+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 shutdown_connections 2024-09-21T11:56:45.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.276+0000 7fa7f22f3640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7ec107930 0x7fa7ec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.276+0000 7fa7f22f3640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa7d407af30 0x7fa7d407d3f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.276+0000 7fa7f22f3640 1 --2- 172.21.15.118:0/949443695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7ec101930 0x7fa7ec0744f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.276+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 >> 172.21.15.118:0/949443695 conn(0x7fa7ec0fd630 msgr2=0x7fa7ec0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:45.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.276+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 shutdown_connections 2024-09-21T11:56:45.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.276+0000 7fa7f22f3640 1 -- 172.21.15.118:0/949443695 wait complete. 2024-09-21T11:56:45.287 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:56:45.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.358+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/2473721674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c101930 msgr2=0x7f2a9c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.358+0000 7f2aa1ff2640 1 --2- 172.21.15.118:0/2473721674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c101930 0x7f2a9c101d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009880 tx=0x7f2a9002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.358+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/2473721674 shutdown_connections 2024-09-21T11:56:45.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.358+0000 7f2aa1ff2640 1 --2- 172.21.15.118:0/2473721674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c101930 0x7f2a9c101d90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.358+0000 7f2aa1ff2640 1 --2- 172.21.15.118:0/2473721674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c107930 0x7f2a9c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.358+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/2473721674 >> 172.21.15.118:0/2473721674 conn(0x7f2a9c0fd630 msgr2=0x7f2a9c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:45.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.358+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/2473721674 shutdown_connections 2024-09-21T11:56:45.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.358+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/2473721674 wait complete. 2024-09-21T11:56:45.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.359+0000 7f2aa1ff2640 1 Processor -- start 2024-09-21T11:56:45.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.359+0000 7f2aa1ff2640 1 -- start start 2024-09-21T11:56:45.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.359+0000 7f2aa1ff2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c101930 0x7f2a9c19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.359+0000 7f2aa1ff2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c107930 0x7f2a9c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.359+0000 7f2aa1ff2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c10ee60 con 0x7f2a9c107930 2024-09-21T11:56:45.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.359+0000 7f2aa1ff2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c10ece0 con 0x7f2a9c101930 2024-09-21T11:56:45.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.359+0000 7f2a9affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c107930 0x7f2a9c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.359+0000 7f2a9affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c107930 0x7f2a9c19fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50672/0 (socket says 172.21.15.118:50672) 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.359+0000 7f2a9affd640 1 -- 172.21.15.118:0/249455011 learned_addr learned my addr 172.21.15.118:0/249455011 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2a9b7fe640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c101930 0x7f2a9c19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2a9affd640 1 -- 172.21.15.118:0/249455011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c101930 msgr2=0x7f2a9c19f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2a9affd640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c101930 0x7f2a9c19f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2a9affd640 1 -- 172.21.15.118:0/249455011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c199a40 con 0x7f2a9c107930 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2a9b7fe640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c101930 0x7f2a9c19f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2a9affd640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c107930 0x7f2a9c19fdc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2a90031460 tx=0x7f2a900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2a98ff9640 1 -- 172.21.15.118:0/249455011 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a9003f070 con 0x7f2a9c107930 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2a98ff9640 1 -- 172.21.15.118:0/249455011 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a90004cf0 con 0x7f2a9c107930 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9c199cd0 con 0x7f2a9c107930 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2a98ff9640 1 -- 172.21.15.118:0/249455011 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a90035030 con 0x7f2a9c107930 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.360+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9c19a200 con 0x7f2a9c107930 2024-09-21T11:56:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.361+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9c103070 con 0x7f2a9c107930 2024-09-21T11:56:45.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.362+0000 7f2a98ff9640 1 -- 172.21.15.118:0/249455011 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2a90042070 con 0x7f2a9c107930 2024-09-21T11:56:45.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.362+0000 7f2a98ff9640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a8407af30 0x7f2a8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.362+0000 7f2a98ff9640 1 -- 172.21.15.118:0/249455011 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f2a900bec10 con 0x7f2a9c107930 2024-09-21T11:56:45.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.362+0000 7f2a9b7fe640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a8407af30 0x7f2a8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.363+0000 7f2a9b7fe640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a8407af30 0x7f2a8407d3f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c19ab80 tx=0x7f2a8c009570 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:45.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.367+0000 7f2a98ff9640 1 -- 172.21.15.118:0/249455011 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a9008a100 con 0x7f2a9c107930 2024-09-21T11:56:45.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.559+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2a9c19a4b0 con 0x7f2a8407af30 2024-09-21T11:56:45.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.561+0000 7f2a98ff9640 1 -- 172.21.15.118:0/249455011 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f2a9c19a4b0 con 0x7f2a8407af30 2024-09-21T11:56:45.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a8407af30 msgr2=0x7f2a8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a8407af30 0x7f2a8407d3f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c19ab80 tx=0x7f2a8c009570 comp rx=0 tx=0).stop 2024-09-21T11:56:45.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c107930 msgr2=0x7f2a9c19fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c107930 0x7f2a9c19fdc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2a90031460 tx=0x7f2a900048f0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 shutdown_connections 2024-09-21T11:56:45.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a8407af30 0x7f2a8407d3f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c107930 0x7f2a9c19fdc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 --2- 172.21.15.118:0/249455011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c101930 0x7f2a9c19f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 >> 172.21.15.118:0/249455011 conn(0x7f2a9c0fd630 msgr2=0x7f2a9c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:45.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 shutdown_connections 2024-09-21T11:56:45.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.563+0000 7f2aa1ff2640 1 -- 172.21.15.118:0/249455011 wait complete. 2024-09-21T11:56:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.644+0000 7f0b830f5640 1 -- 172.21.15.118:0/3368325732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1007e0 msgr2=0x7f0b7c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.644+0000 7f0b830f5640 1 --2- 172.21.15.118:0/3368325732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1007e0 0x7f0b7c100c40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009880 tx=0x7f0b6802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.644+0000 7f0b830f5640 1 -- 172.21.15.118:0/3368325732 shutdown_connections 2024-09-21T11:56:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.644+0000 7f0b830f5640 1 --2- 172.21.15.118:0/3368325732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1007e0 0x7f0b7c100c40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.644+0000 7f0b830f5640 1 --2- 172.21.15.118:0/3368325732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c1067e0 0x7f0b7c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.644+0000 7f0b830f5640 1 -- 172.21.15.118:0/3368325732 >> 172.21.15.118:0/3368325732 conn(0x7f0b7c0fc4c0 msgr2=0x7f0b7c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b830f5640 1 -- 172.21.15.118:0/3368325732 shutdown_connections 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b830f5640 1 -- 172.21.15.118:0/3368325732 wait complete. 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b830f5640 1 Processor -- start 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b830f5640 1 -- start start 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b830f5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c1007e0 0x7f0b7c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b830f5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1067e0 0x7f0b7c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b830f5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c10dcb0 con 0x7f0b7c1067e0 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b830f5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c10db30 con 0x7f0b7c1007e0 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1067e0 0x7f0b7c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1067e0 0x7f0b7c19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58892/0 (socket says 172.21.15.118:58892) 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.645+0000 7f0b7bfff640 1 -- 172.21.15.118:0/1924136744 learned_addr learned my addr 172.21.15.118:0/1924136744 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b80e91640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c1007e0 0x7f0b7c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b7bfff640 1 -- 172.21.15.118:0/1924136744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c1007e0 msgr2=0x7f0b7c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b7bfff640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c1007e0 0x7f0b7c19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b7bfff640 1 -- 172.21.15.118:0/1924136744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c1999e0 con 0x7f0b7c1067e0 2024-09-21T11:56:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b80e91640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c1007e0 0x7f0b7c19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:56:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b7bfff640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1067e0 0x7f0b7c19fd60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0b68031460 tx=0x7f0b680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b79ffb640 1 -- 172.21.15.118:0/1924136744 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b6803f070 con 0x7f0b7c1067e0 2024-09-21T11:56:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c199c70 con 0x7f0b7c1067e0 2024-09-21T11:56:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b79ffb640 1 -- 172.21.15.118:0/1924136744 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b680035f0 con 0x7f0b7c1067e0 2024-09-21T11:56:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b79ffb640 1 -- 172.21.15.118:0/1924136744 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b68035030 con 0x7f0b7c1067e0 2024-09-21T11:56:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.646+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c19a1a0 con 0x7f0b7c1067e0 2024-09-21T11:56:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.647+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7c101f20 con 0x7f0b7c1067e0 2024-09-21T11:56:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.648+0000 7f0b79ffb640 1 -- 172.21.15.118:0/1924136744 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0b68042070 con 0x7f0b7c1067e0 2024-09-21T11:56:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.648+0000 7f0b79ffb640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b6c07af30 0x7f0b6c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.648+0000 7f0b79ffb640 1 -- 172.21.15.118:0/1924136744 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0b680beab0 con 0x7f0b7c1067e0 2024-09-21T11:56:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.648+0000 7f0b80e91640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b6c07af30 0x7f0b6c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.649+0000 7f0b80e91640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b6c07af30 0x7f0b6c07d3f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0b70005fd0 tx=0x7f0b70005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.654+0000 7f0b79ffb640 1 -- 172.21.15.118:0/1924136744 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b6808a000 con 0x7f0b7c1067e0 2024-09-21T11:56:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:45 smithi118 ceph-mon[111738]: pgmap v537: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:45.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.840+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0b7c19a450 con 0x7f0b6c07af30 2024-09-21T11:56:45.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.850+0000 7f0b79ffb640 1 -- 172.21.15.118:0/1924136744 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0b7c19a450 con 0x7f0b6c07af30 2024-09-21T11:56:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:56:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (14m) 8m ago 25m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:56:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (17m) 8m ago 25m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:56:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (17m) 8m ago 24m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:56:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (12m) 8m ago 25m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (12m) 8m ago 24m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (14m) 8m ago 25m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (9m) 8m ago 20m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (8m) 8m ago 20m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (20m) 8m ago 20m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (8m) 8m ago 20m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (16m) 8m ago 27m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (15m) 8m ago 24m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (13m) 8m ago 27m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (13m) 8m ago 24m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (15m) 8m ago 25m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:56:45.853 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (15m) 8m ago 24m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:56:45.854 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (12m) 8m ago 23m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:56:45.854 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (11m) 8m ago 23m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:56:45.854 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (11m) 8m ago 22m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:56:45.854 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (10m) 8m ago 22m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:56:45.854 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (9m) 8m ago 21m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:56:45.854 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (9m) 8m ago 21m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:56:45.854 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (15m) 8m ago 25m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:56:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b6c07af30 msgr2=0x7f0b6c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b6c07af30 0x7f0b6c07d3f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0b70005fd0 tx=0x7f0b70005850 comp rx=0 tx=0).stop 2024-09-21T11:56:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1067e0 msgr2=0x7f0b7c19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1067e0 0x7f0b7c19fd60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0b68031460 tx=0x7f0b680045e0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 shutdown_connections 2024-09-21T11:56:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b6c07af30 0x7f0b6c07d3f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c1067e0 0x7f0b7c19fd60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 --2- 172.21.15.118:0/1924136744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c1007e0 0x7f0b7c19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 >> 172.21.15.118:0/1924136744 conn(0x7f0b7c0fc4c0 msgr2=0x7f0b7c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:45.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 shutdown_connections 2024-09-21T11:56:45.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.853+0000 7f0b830f5640 1 -- 172.21.15.118:0/1924136744 wait complete. 2024-09-21T11:56:45.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.935+0000 7f4e7044c640 1 -- 172.21.15.118:0/4023869194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 msgr2=0x7f4e6810b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.935+0000 7f4e7044c640 1 --2- 172.21.15.118:0/4023869194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 0x7f4e6810b950 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0098b0 tx=0x7f4e5c02a560 comp rx=0 tx=0).stop 2024-09-21T11:56:45.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.935+0000 7f4e7044c640 1 -- 172.21.15.118:0/4023869194 shutdown_connections 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.935+0000 7f4e7044c640 1 --2- 172.21.15.118:0/4023869194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 0x7f4e6810b950 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.935+0000 7f4e7044c640 1 --2- 172.21.15.118:0/4023869194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e68102b40 0x7f4e68102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.935+0000 7f4e7044c640 1 -- 172.21.15.118:0/4023869194 >> 172.21.15.118:0/4023869194 conn(0x7f4e680fc520 msgr2=0x7f4e680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.935+0000 7f4e7044c640 1 -- 172.21.15.118:0/4023869194 shutdown_connections 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.935+0000 7f4e7044c640 1 -- 172.21.15.118:0/4023869194 wait complete. 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e7044c640 1 Processor -- start 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e7044c640 1 -- start start 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e7044c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e68102b40 0x7f4e6819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e7044c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 0x7f4e6819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e7044c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6810edf0 con 0x7f4e68103460 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e7044c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6810ec70 con 0x7f4e68102b40 2024-09-21T11:56:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e6d9e7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 0x7f4e6819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e6d9e7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 0x7f4e6819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58912/0 (socket says 172.21.15.118:58912) 2024-09-21T11:56:45.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e6d9e7640 1 -- 172.21.15.118:0/1531914995 learned_addr learned my addr 172.21.15.118:0/1531914995 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:45.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e6e1e8640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e68102b40 0x7f4e6819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e6d9e7640 1 -- 172.21.15.118:0/1531914995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e68102b40 msgr2=0x7f4e6819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:45.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e6d9e7640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e68102b40 0x7f4e6819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:45.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.936+0000 7f4e6d9e7640 1 -- 172.21.15.118:0/1531914995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e68197820 con 0x7f4e68103460 2024-09-21T11:56:45.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.937+0000 7f4e6d9e7640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 0x7f4e6819dbe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c031460 tx=0x7f4e5c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:45.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.937+0000 7f4e677fe640 1 -- 172.21.15.118:0/1531914995 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e5c03f070 con 0x7f4e68103460 2024-09-21T11:56:45.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.937+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e68197ab0 con 0x7f4e68103460 2024-09-21T11:56:45.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.937+0000 7f4e677fe640 1 -- 172.21.15.118:0/1531914995 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e5c0035f0 con 0x7f4e68103460 2024-09-21T11:56:45.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.937+0000 7f4e677fe640 1 -- 172.21.15.118:0/1531914995 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e5c035030 con 0x7f4e68103460 2024-09-21T11:56:45.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.937+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e68197fe0 con 0x7f4e68103460 2024-09-21T11:56:45.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.938+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6806ab80 con 0x7f4e68103460 2024-09-21T11:56:45.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.939+0000 7f4e677fe640 1 -- 172.21.15.118:0/1531914995 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4e5c042070 con 0x7f4e68103460 2024-09-21T11:56:45.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.939+0000 7f4e677fe640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e5007af30 0x7f4e5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:45.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.939+0000 7f4e677fe640 1 -- 172.21.15.118:0/1531914995 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f4e5c0be9b0 con 0x7f4e68103460 2024-09-21T11:56:45.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.939+0000 7f4e6e1e8640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e5007af30 0x7f4e5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:45.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.939+0000 7f4e6e1e8640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e5007af30 0x7f4e5007d3f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000bbe0 tx=0x7f4e6000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:45.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:45.943+0000 7f4e677fe640 1 -- 172.21.15.118:0/1531914995 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e5c089f00 con 0x7f4e68103460 2024-09-21T11:56:46.166 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:45 smithi149 ceph-mon[79770]: pgmap v537: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:46.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.190+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4e68105fd0 con 0x7f4e68103460 2024-09-21T11:56:46.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.191+0000 7f4e677fe640 1 -- 172.21.15.118:0/1531914995 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f4e5c08c420 con 0x7f4e68103460 2024-09-21T11:56:46.193 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:56:46.193 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:56:46.193 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:56:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:56:46.195 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:56:46.195 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:56:46.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e5007af30 msgr2=0x7f4e5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e5007af30 0x7f4e5007d3f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000bbe0 tx=0x7f4e6000b390 comp rx=0 tx=0).stop 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 msgr2=0x7f4e6819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 0x7f4e6819dbe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c031460 tx=0x7f4e5c0045c0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 shutdown_connections 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e5007af30 0x7f4e5007d3f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e68103460 0x7f4e6819dbe0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 --2- 172.21.15.118:0/1531914995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e68102b40 0x7f4e6819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 >> 172.21.15.118:0/1531914995 conn(0x7f4e680fc520 msgr2=0x7f4e68103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 shutdown_connections 2024-09-21T11:56:46.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.193+0000 7f4e7044c640 1 -- 172.21.15.118:0/1531914995 wait complete. 2024-09-21T11:56:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.275+0000 7fa832029640 1 -- 172.21.15.118:0/2501825031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c100820 msgr2=0x7fa82c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.276+0000 7fa832029640 1 --2- 172.21.15.118:0/2501825031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c100820 0x7fa82c100c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa814009880 tx=0x7fa81402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.276+0000 7fa832029640 1 -- 172.21.15.118:0/2501825031 shutdown_connections 2024-09-21T11:56:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.276+0000 7fa832029640 1 --2- 172.21.15.118:0/2501825031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c100820 0x7fa82c100c80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.276+0000 7fa832029640 1 --2- 172.21.15.118:0/2501825031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa82c106820 0x7fa82c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.276+0000 7fa832029640 1 -- 172.21.15.118:0/2501825031 >> 172.21.15.118:0/2501825031 conn(0x7fa82c0fc520 msgr2=0x7fa82c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.276+0000 7fa832029640 1 -- 172.21.15.118:0/2501825031 shutdown_connections 2024-09-21T11:56:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.276+0000 7fa832029640 1 -- 172.21.15.118:0/2501825031 wait complete. 2024-09-21T11:56:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.276+0000 7fa832029640 1 Processor -- start 2024-09-21T11:56:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa832029640 1 -- start start 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa832029640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa82c100820 0x7fa82c19f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa832029640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c106820 0x7fa82c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa832029640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c10cc60 con 0x7fa82c106820 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa832029640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c10cae0 con 0x7fa82c100820 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa82affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c106820 0x7fa82c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa82affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c106820 0x7fa82c19fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58940/0 (socket says 172.21.15.118:58940) 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa82affd640 1 -- 172.21.15.118:0/2818992023 learned_addr learned my addr 172.21.15.118:0/2818992023 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa82affd640 1 -- 172.21.15.118:0/2818992023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa82c100820 msgr2=0x7fa82c19f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa82affd640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa82c100820 0x7fa82c19f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa82affd640 1 -- 172.21.15.118:0/2818992023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c199a60 con 0x7fa82c106820 2024-09-21T11:56:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.277+0000 7fa82affd640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c106820 0x7fa82c19fde0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa814031460 tx=0x7fa8140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.278+0000 7fa828ff9640 1 -- 172.21.15.118:0/2818992023 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa81403f070 con 0x7fa82c106820 2024-09-21T11:56:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.278+0000 7fa828ff9640 1 -- 172.21.15.118:0/2818992023 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa814004cf0 con 0x7fa82c106820 2024-09-21T11:56:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.278+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c199cf0 con 0x7fa82c106820 2024-09-21T11:56:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.278+0000 7fa828ff9640 1 -- 172.21.15.118:0/2818992023 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa814035030 con 0x7fa82c106820 2024-09-21T11:56:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.278+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c19a220 con 0x7fa82c106820 2024-09-21T11:56:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.279+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c101f60 con 0x7fa82c106820 2024-09-21T11:56:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.279+0000 7fa828ff9640 1 -- 172.21.15.118:0/2818992023 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa814042070 con 0x7fa82c106820 2024-09-21T11:56:46.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.280+0000 7fa828ff9640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa81807af30 0x7fa81807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:46.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.280+0000 7fa828ff9640 1 -- 172.21.15.118:0/2818992023 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fa8140bec10 con 0x7fa82c106820 2024-09-21T11:56:46.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.280+0000 7fa82b7fe640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa81807af30 0x7fa81807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:46.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.280+0000 7fa82b7fe640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa81807af30 0x7fa81807d3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa82c19aba0 tx=0x7fa81c006c90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:46.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.284+0000 7fa828ff9640 1 -- 172.21.15.118:0/2818992023 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa81408a100 con 0x7fa82c106820 2024-09-21T11:56:46.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.498+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa82c19af90 con 0x7fa82c106820 2024-09-21T11:56:46.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.498+0000 7fa828ff9640 1 -- 172.21.15.118:0/2818992023 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7fa81408efb0 con 0x7fa82c106820 2024-09-21T11:56:46.500 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:56:46.500 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:56:46.500 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:56:46.500 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:56:46.500 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:56:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:56:46.500 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:56:46.500 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:56:46.501 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:56:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:56:46.503 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:56:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:56:46.503 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:56:46.503 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:56:46.503 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:56:46.503 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa81807af30 msgr2=0x7fa81807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa81807af30 0x7fa81807d3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa82c19aba0 tx=0x7fa81c006c90 comp rx=0 tx=0).stop 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c106820 msgr2=0x7fa82c19fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c106820 0x7fa82c19fde0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa814031460 tx=0x7fa8140048f0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 shutdown_connections 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa81807af30 0x7fa81807d3f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa82c106820 0x7fa82c19fde0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 --2- 172.21.15.118:0/2818992023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa82c100820 0x7fa82c19f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 >> 172.21.15.118:0/2818992023 conn(0x7fa82c0fc520 msgr2=0x7fa82c0fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 shutdown_connections 2024-09-21T11:56:46.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.501+0000 7fa832029640 1 -- 172.21.15.118:0/2818992023 wait complete. 2024-09-21T11:56:46.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.583+0000 7f078b7fa640 1 -- 172.21.15.118:0/4020255105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 msgr2=0x7f0784107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.583+0000 7f078b7fa640 1 --2- 172.21.15.118:0/4020255105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 0x7f0784107d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0774009880 tx=0x7f077402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.583+0000 7f078b7fa640 1 -- 172.21.15.118:0/4020255105 shutdown_connections 2024-09-21T11:56:46.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.583+0000 7f078b7fa640 1 --2- 172.21.15.118:0/4020255105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0784101930 0x7f0784101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.583+0000 7f078b7fa640 1 --2- 172.21.15.118:0/4020255105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 0x7f0784107d10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.583+0000 7f078b7fa640 1 -- 172.21.15.118:0/4020255105 >> 172.21.15.118:0/4020255105 conn(0x7f07840fd630 msgr2=0x7f07840ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:46.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.583+0000 7f078b7fa640 1 -- 172.21.15.118:0/4020255105 shutdown_connections 2024-09-21T11:56:46.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.583+0000 7f078b7fa640 1 -- 172.21.15.118:0/4020255105 wait complete. 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f078b7fa640 1 Processor -- start 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f078b7fa640 1 -- start start 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f078b7fa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0784101930 0x7f078419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f078b7fa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 0x7f078419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f078b7fa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f078410ee60 con 0x7f0784107930 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f078b7fa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f078410ece0 con 0x7f0784101930 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f0788d95640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 0x7f078419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f0788d95640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 0x7f078419dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58952/0 (socket says 172.21.15.118:58952) 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f0788d95640 1 -- 172.21.15.118:0/1782555280 learned_addr learned my addr 172.21.15.118:0/1782555280 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.584+0000 7f0789596640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0784101930 0x7f078419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.585+0000 7f0788d95640 1 -- 172.21.15.118:0/1782555280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0784101930 msgr2=0x7f078419d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.585+0000 7f0788d95640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0784101930 0x7f078419d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.585+0000 7f0788d95640 1 -- 172.21.15.118:0/1782555280 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0784197890 con 0x7f0784107930 2024-09-21T11:56:46.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.585+0000 7f0788d95640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 0x7f078419dc10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f078000b420 tx=0x7f078000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:46.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.585+0000 7f077a7fc640 1 -- 172.21.15.118:0/1782555280 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0780011630 con 0x7f0784107930 2024-09-21T11:56:46.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.585+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0784197b80 con 0x7f0784107930 2024-09-21T11:56:46.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.585+0000 7f077a7fc640 1 -- 172.21.15.118:0/1782555280 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0780016070 con 0x7f0784107930 2024-09-21T11:56:46.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.585+0000 7f077a7fc640 1 -- 172.21.15.118:0/1782555280 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0780010d40 con 0x7f0784107930 2024-09-21T11:56:46.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.585+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0784198110 con 0x7f0784107930 2024-09-21T11:56:46.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.586+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0784103070 con 0x7f0784107930 2024-09-21T11:56:46.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.587+0000 7f077a7fc640 1 -- 172.21.15.118:0/1782555280 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f078001b460 con 0x7f0784107930 2024-09-21T11:56:46.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.587+0000 7f077a7fc640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f077007af30 0x7f077007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:46.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.587+0000 7f077a7fc640 1 -- 172.21.15.118:0/1782555280 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f078009d7f0 con 0x7f0784107930 2024-09-21T11:56:46.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.587+0000 7f0789596640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f077007af30 0x7f077007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:46.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.588+0000 7f0789596640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f077007af30 0x7f077007d3f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0774000c00 tx=0x7f0774031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:46.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.591+0000 7f077a7fc640 1 -- 172.21.15.118:0/1782555280 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0780021250 con 0x7f0784107930 2024-09-21T11:56:46.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.785+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0784198dc0 con 0x7f077007af30 2024-09-21T11:56:46.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.787+0000 7f077a7fc640 1 -- 172.21.15.118:0/1782555280 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0784198dc0 con 0x7f077007af30 2024-09-21T11:56:46.788 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:56:46.788 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:56:46.788 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:56:46.788 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:56:46.788 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:56:46.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:56:46.788 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:56:46.788 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:56:46.789 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:56:46.789 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:56:46.789 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:56:46.789 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:56:46.789 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:56:46.789 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f077007af30 msgr2=0x7f077007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f077007af30 0x7f077007d3f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0774000c00 tx=0x7f0774031400 comp rx=0 tx=0).stop 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 msgr2=0x7f078419dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 0x7f078419dc10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f078000b420 tx=0x7f078000b8e0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 shutdown_connections 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f077007af30 0x7f077007d3f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0784107930 0x7f078419dc10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 --2- 172.21.15.118:0/1782555280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0784101930 0x7f078419d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 >> 172.21.15.118:0/1782555280 conn(0x7f07840fd630 msgr2=0x7f07840fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 shutdown_connections 2024-09-21T11:56:46.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.789+0000 7f078b7fa640 1 -- 172.21.15.118:0/1782555280 wait complete. 2024-09-21T11:56:46.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.871+0000 7f9f19454640 1 -- 172.21.15.118:0/2019384785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 msgr2=0x7f9f1410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.871+0000 7f9f19454640 1 --2- 172.21.15.118:0/2019384785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 0x7f9f1410b8f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009880 tx=0x7f9f0802a530 comp rx=0 tx=0).stop 2024-09-21T11:56:46.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.871+0000 7f9f19454640 1 -- 172.21.15.118:0/2019384785 shutdown_connections 2024-09-21T11:56:46.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.871+0000 7f9f19454640 1 --2- 172.21.15.118:0/2019384785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 0x7f9f1410b8f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.871+0000 7f9f19454640 1 --2- 172.21.15.118:0/2019384785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14102ae0 0x7f9f14102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.871+0000 7f9f19454640 1 -- 172.21.15.118:0/2019384785 >> 172.21.15.118:0/2019384785 conn(0x7f9f140fc520 msgr2=0x7f9f140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:46.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.871+0000 7f9f19454640 1 -- 172.21.15.118:0/2019384785 shutdown_connections 2024-09-21T11:56:46.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.871+0000 7f9f19454640 1 -- 172.21.15.118:0/2019384785 wait complete. 2024-09-21T11:56:46.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.871+0000 7f9f19454640 1 Processor -- start 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f19454640 1 -- start start 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f19454640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14102ae0 0x7f9f14100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f19454640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 0x7f9f14100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f19454640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1410ee10 con 0x7f9f14103400 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f19454640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1410ec90 con 0x7f9f14102ae0 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f127fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 0x7f9f14100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f127fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 0x7f9f14100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58962/0 (socket says 172.21.15.118:58962) 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f127fc640 1 -- 172.21.15.118:0/1656983499 learned_addr learned my addr 172.21.15.118:0/1656983499 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f12ffd640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14102ae0 0x7f9f14100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:46.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f127fc640 1 -- 172.21.15.118:0/1656983499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14102ae0 msgr2=0x7f9f14100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:46.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f127fc640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14102ae0 0x7f9f14100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:46.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f127fc640 1 -- 172.21.15.118:0/1656983499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f141011c0 con 0x7f9f14103400 2024-09-21T11:56:46.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f12ffd640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14102ae0 0x7f9f14100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:56:46.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.872+0000 7f9f127fc640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 0x7f9f14100c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9f08031460 tx=0x7f9f080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:46.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.873+0000 7f9efbfff640 1 -- 172.21.15.118:0/1656983499 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f0803f070 con 0x7f9f14103400 2024-09-21T11:56:46.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.873+0000 7f9efbfff640 1 -- 172.21.15.118:0/1656983499 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f08004ac0 con 0x7f9f14103400 2024-09-21T11:56:46.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.873+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f14101450 con 0x7f9f14103400 2024-09-21T11:56:46.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.873+0000 7f9efbfff640 1 -- 172.21.15.118:0/1656983499 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f08035030 con 0x7f9f14103400 2024-09-21T11:56:46.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.873+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f141a3de0 con 0x7f9f14103400 2024-09-21T11:56:46.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.874+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f1406abe0 con 0x7f9f14103400 2024-09-21T11:56:46.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.874+0000 7f9efbfff640 1 -- 172.21.15.118:0/1656983499 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9f08042070 con 0x7f9f14103400 2024-09-21T11:56:46.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.875+0000 7f9efbfff640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9efc07af80 0x7f9efc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:56:46.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.875+0000 7f9efbfff640 1 -- 172.21.15.118:0/1656983499 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f9f080bea10 con 0x7f9f14103400 2024-09-21T11:56:46.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.875+0000 7f9f12ffd640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9efc07af80 0x7f9efc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:56:46.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.875+0000 7f9f12ffd640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9efc07af80 0x7f9efc07d440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005c40 tx=0x7f9f0400a410 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:56:46.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:46.879+0000 7f9efbfff640 1 -- 172.21.15.118:0/1656983499 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f08089fe0 con 0x7f9f14103400 2024-09-21T11:56:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:46 smithi118 ceph-mon[111738]: from='client.34808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:46 smithi118 ceph-mon[111738]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:46 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1531914995' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:56:47.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:46 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2818992023' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:56:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.126+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9f14105f80 con 0x7f9f14103400 2024-09-21T11:56:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.127+0000 7f9efbfff640 1 -- 172.21.15.118:0/1656983499 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f9f0808ee90 con 0x7f9f14103400 2024-09-21T11:56:47.128 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:56:47.128 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:56:47.128 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:56:47.128 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:56:47.129 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:56:47.129 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:56:47.129 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:56:47.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9efc07af80 msgr2=0x7f9efc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9efc07af80 0x7f9efc07d440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005c40 tx=0x7f9f0400a410 comp rx=0 tx=0).stop 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 msgr2=0x7f9f14100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 0x7f9f14100c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9f08031460 tx=0x7f9f080046c0 comp rx=0 tx=0).stop 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 shutdown_connections 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9efc07af80 0x7f9efc07d440 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f14103400 0x7f9f14100c80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 --2- 172.21.15.118:0/1656983499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f14102ae0 0x7f9f14100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 >> 172.21.15.118:0/1656983499 conn(0x7f9f140fc520 msgr2=0x7f9f14108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 shutdown_connections 2024-09-21T11:56:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:56:47.129+0000 7f9f19454640 1 -- 172.21.15.118:0/1656983499 wait complete. 2024-09-21T11:56:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:46 smithi149 ceph-mon[79770]: from='client.34808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:46 smithi149 ceph-mon[79770]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:46 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1531914995' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:56:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:46 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2818992023' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:56:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:47 smithi118 ceph-mon[111738]: from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:47 smithi118 ceph-mon[111738]: pgmap v538: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:47 smithi118 ceph-mon[111738]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:47 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1656983499' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:56:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:47 smithi149 ceph-mon[79770]: from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:47 smithi149 ceph-mon[79770]: pgmap v538: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:47 smithi149 ceph-mon[79770]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:56:48.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:47 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1656983499' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:56:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:49 smithi118 ceph-mon[111738]: pgmap v539: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:49 smithi149 ceph-mon[79770]: pgmap v539: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:56:51.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:56:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:51 smithi118 ceph-mon[111738]: pgmap v540: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:52.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:51 smithi149 ceph-mon[79770]: pgmap v540: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:53.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:52 smithi118 ceph-mon[111738]: pgmap v541: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:53.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:52 smithi149 ceph-mon[79770]: pgmap v541: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:55.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:55 smithi149 ceph-mon[79770]: pgmap v542: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:55.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:55 smithi118 ceph-mon[111738]: pgmap v542: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:57.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:57 smithi149 ceph-mon[79770]: pgmap v543: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:57 smithi118 ceph-mon[111738]: pgmap v543: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:59.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:56:59 smithi149 ceph-mon[79770]: pgmap v544: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:56:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:56:59 smithi118 ceph-mon[111738]: pgmap v544: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:01.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:01 smithi149 ceph-mon[79770]: pgmap v545: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:01.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:01 smithi118 ceph-mon[111738]: pgmap v545: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:03.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:03 smithi149 ceph-mon[79770]: pgmap v546: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:03 smithi118 ceph-mon[111738]: pgmap v546: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:05 smithi118 ceph-mon[111738]: pgmap v547: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:57:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:05 smithi149 ceph-mon[79770]: pgmap v547: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:57:07.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:07 smithi149 ceph-mon[79770]: pgmap v548: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:07 smithi118 ceph-mon[111738]: pgmap v548: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:09.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:09 smithi149 ceph-mon[79770]: pgmap v549: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:09.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:09 smithi118 ceph-mon[111738]: pgmap v549: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:11.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:11 smithi149 ceph-mon[79770]: pgmap v550: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:11 smithi118 ceph-mon[111738]: pgmap v550: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:13 smithi149 ceph-mon[79770]: pgmap v551: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:13 smithi118 ceph-mon[111738]: pgmap v551: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:15 smithi149 ceph-mon[79770]: pgmap v552: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:15 smithi118 ceph-mon[111738]: pgmap v552: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:17.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.222+0000 7f65ac813640 1 -- 172.21.15.118:0/626350412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100bb0 msgr2=0x7f65a8104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.222+0000 7f65ac813640 1 --2- 172.21.15.118:0/626350412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100bb0 0x7f65a8104c00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f659000a990 tx=0x7f659002b7d0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.222+0000 7f65ac813640 1 -- 172.21.15.118:0/626350412 shutdown_connections 2024-09-21T11:57:17.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.222+0000 7f65ac813640 1 --2- 172.21.15.118:0/626350412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100bb0 0x7f65a8104c00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.222+0000 7f65ac813640 1 --2- 172.21.15.118:0/626350412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a8100200 0x7f65a81005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.222+0000 7f65ac813640 1 -- 172.21.15.118:0/626350412 >> 172.21.15.118:0/626350412 conn(0x7f65a80fbc60 msgr2=0x7f65a80fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:17.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.222+0000 7f65ac813640 1 -- 172.21.15.118:0/626350412 shutdown_connections 2024-09-21T11:57:17.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.222+0000 7f65ac813640 1 -- 172.21.15.118:0/626350412 wait complete. 2024-09-21T11:57:17.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.223+0000 7f65ac813640 1 Processor -- start 2024-09-21T11:57:17.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.223+0000 7f65ac813640 1 -- start start 2024-09-21T11:57:17.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.223+0000 7f65ac813640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100200 0x7f65a819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:17.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.223+0000 7f65ac813640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a8100bb0 0x7f65a819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:17.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.223+0000 7f65ac813640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f65a810cb80 con 0x7f65a8100200 2024-09-21T11:57:17.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.223+0000 7f65ac813640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f65a810ca00 con 0x7f65a8100bb0 2024-09-21T11:57:17.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f65a659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100200 0x7f65a819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f65a659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100200 0x7f65a819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46932/0 (socket says 172.21.15.118:46932) 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f65a659c640 1 -- 172.21.15.118:0/762445096 learned_addr learned my addr 172.21.15.118:0/762445096 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f659dd9b640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a8100bb0 0x7f65a819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f65a659c640 1 -- 172.21.15.118:0/762445096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a8100bb0 msgr2=0x7f65a819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f65a659c640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a8100bb0 0x7f65a819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f65a659c640 1 -- 172.21.15.118:0/762445096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a8197730 con 0x7f65a8100200 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f65a659c640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100200 0x7f65a819d660 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f659800d6f0 tx=0x7f659800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f659ffff640 1 -- 172.21.15.118:0/762445096 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6598017070 con 0x7f65a8100200 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f659ffff640 1 -- 172.21.15.118:0/762445096 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f659800de00 con 0x7f65a8100200 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.224+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a8197a20 con 0x7f65a8100200 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.225+0000 7f659ffff640 1 -- 172.21.15.118:0/762445096 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6598004bb0 con 0x7f65a8100200 2024-09-21T11:57:17.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.225+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a8197f80 con 0x7f65a8100200 2024-09-21T11:57:17.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.226+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a81016e0 con 0x7f65a8100200 2024-09-21T11:57:17.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.226+0000 7f659ffff640 1 -- 172.21.15.118:0/762445096 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6598010460 con 0x7f65a8100200 2024-09-21T11:57:17.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.227+0000 7f659ffff640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f659407af80 0x7f659407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:17.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.227+0000 7f659dd9b640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f659407af80 0x7f659407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:17.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.227+0000 7f659ffff640 1 -- 172.21.15.118:0/762445096 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f659809dc20 con 0x7f65a8100200 2024-09-21T11:57:17.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.227+0000 7f659dd9b640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f659407af80 0x7f659407d440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f659000a340 tx=0x7f6590005fd0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:17.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.231+0000 7f659ffff640 1 -- 172.21.15.118:0/762445096 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f65980691f0 con 0x7f65a8100200 2024-09-21T11:57:17.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.425+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f65a81982c0 con 0x7f659407af80 2024-09-21T11:57:17.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.426+0000 7f659ffff640 1 -- 172.21.15.118:0/762445096 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f65a81982c0 con 0x7f659407af80 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.428+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f659407af80 msgr2=0x7f659407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.428+0000 7f65ac813640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f659407af80 0x7f659407d440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f659000a340 tx=0x7f6590005fd0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.428+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100200 msgr2=0x7f65a819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.428+0000 7f65ac813640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100200 0x7f65a819d660 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f659800d6f0 tx=0x7f659800dbb0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.428+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 shutdown_connections 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.428+0000 7f65ac813640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a8100bb0 0x7f65a819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.428+0000 7f65ac813640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f659407af80 0x7f659407d440 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.428+0000 7f65ac813640 1 --2- 172.21.15.118:0/762445096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65a8100200 0x7f65a819d660 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.428+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 >> 172.21.15.118:0/762445096 conn(0x7f65a80fbc60 msgr2=0x7f65a80fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.429+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 shutdown_connections 2024-09-21T11:57:17.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.429+0000 7f65ac813640 1 -- 172.21.15.118:0/762445096 wait complete. 2024-09-21T11:57:17.440 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:57:17.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.511+0000 7f51fb57c640 1 -- 172.21.15.118:0/694457243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41007e0 msgr2=0x7f51f4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.511+0000 7f51fb57c640 1 --2- 172.21.15.118:0/694457243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41007e0 0x7f51f4100c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009880 tx=0x7f51e402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.511+0000 7f51fb57c640 1 -- 172.21.15.118:0/694457243 shutdown_connections 2024-09-21T11:57:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.511+0000 7f51fb57c640 1 --2- 172.21.15.118:0/694457243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41007e0 0x7f51f4100c40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.511+0000 7f51fb57c640 1 --2- 172.21.15.118:0/694457243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51f41067e0 0x7f51f4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.511+0000 7f51fb57c640 1 -- 172.21.15.118:0/694457243 >> 172.21.15.118:0/694457243 conn(0x7f51f40fc4c0 msgr2=0x7f51f40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:17.514 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:17 smithi118 ceph-mon[111738]: pgmap v553: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.511+0000 7f51fb57c640 1 -- 172.21.15.118:0/694457243 shutdown_connections 2024-09-21T11:57:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.511+0000 7f51fb57c640 1 -- 172.21.15.118:0/694457243 wait complete. 2024-09-21T11:57:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.512+0000 7f51fb57c640 1 Processor -- start 2024-09-21T11:57:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.512+0000 7f51fb57c640 1 -- start start 2024-09-21T11:57:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.512+0000 7f51fb57c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51f41007e0 0x7f51f40fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.512+0000 7f51fb57c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41067e0 0x7f51f40fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.512+0000 7f51fb57c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f51f410dcb0 con 0x7f51f41067e0 2024-09-21T11:57:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.512+0000 7f51fb57c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f51f410db30 con 0x7f51f41007e0 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.512+0000 7f51f8b17640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41067e0 0x7f51f40fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.512+0000 7f51f8b17640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41067e0 0x7f51f40fd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46956/0 (socket says 172.21.15.118:46956) 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.512+0000 7f51f8b17640 1 -- 172.21.15.118:0/2297083540 learned_addr learned my addr 172.21.15.118:0/2297083540 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51f9318640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51f41007e0 0x7f51f40fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51f8b17640 1 -- 172.21.15.118:0/2297083540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51f41007e0 msgr2=0x7f51f40fcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51f8b17640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51f41007e0 0x7f51f40fcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51f8b17640 1 -- 172.21.15.118:0/2297083540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f40fd6f0 con 0x7f51f41067e0 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51f8b17640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41067e0 0x7f51f40fd1b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f51e4031460 tx=0x7f51e40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51ea7fc640 1 -- 172.21.15.118:0/2297083540 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51e403f070 con 0x7f51f41067e0 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f40fd980 con 0x7f51f41067e0 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51ea7fc640 1 -- 172.21.15.118:0/2297083540 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51e40035f0 con 0x7f51f41067e0 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51ea7fc640 1 -- 172.21.15.118:0/2297083540 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51e4035030 con 0x7f51f41067e0 2024-09-21T11:57:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.513+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f41a3df0 con 0x7f51f41067e0 2024-09-21T11:57:17.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.515+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f4101f20 con 0x7f51f41067e0 2024-09-21T11:57:17.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.515+0000 7f51ea7fc640 1 -- 172.21.15.118:0/2297083540 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f51e4042070 con 0x7f51f41067e0 2024-09-21T11:57:17.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.516+0000 7f51ea7fc640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f51e007af80 0x7f51e007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:17.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.516+0000 7f51f9318640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f51e007af80 0x7f51e007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:17.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.516+0000 7f51ea7fc640 1 -- 172.21.15.118:0/2297083540 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f51e40be970 con 0x7f51f41067e0 2024-09-21T11:57:17.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.516+0000 7f51f9318640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f51e007af80 0x7f51e007d440 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51f0005fd0 tx=0x7f51f000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:17.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.520+0000 7f51ea7fc640 1 -- 172.21.15.118:0/2297083540 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51e4089ee0 con 0x7f51f41067e0 2024-09-21T11:57:17.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:17 smithi149 ceph-mon[79770]: pgmap v553: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:17.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.712+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f51f4062630 con 0x7f51e007af80 2024-09-21T11:57:17.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.713+0000 7f51ea7fc640 1 -- 172.21.15.118:0/2297083540 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f51f4062630 con 0x7f51e007af80 2024-09-21T11:57:17.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f51e007af80 msgr2=0x7f51e007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f51e007af80 0x7f51e007d440 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51f0005fd0 tx=0x7f51f000b390 comp rx=0 tx=0).stop 2024-09-21T11:57:17.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41067e0 msgr2=0x7f51f40fd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41067e0 0x7f51f40fd1b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f51e4031460 tx=0x7f51e40045e0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 shutdown_connections 2024-09-21T11:57:17.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f51e007af80 0x7f51e007d440 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51f41067e0 0x7f51f40fd1b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 --2- 172.21.15.118:0/2297083540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51f41007e0 0x7f51f40fcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 >> 172.21.15.118:0/2297083540 conn(0x7f51f40fc4c0 msgr2=0x7f51f4069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:17.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 shutdown_connections 2024-09-21T11:57:17.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.715+0000 7f51fb57c640 1 -- 172.21.15.118:0/2297083540 wait complete. 2024-09-21T11:57:17.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.796+0000 7fb9f4a86640 1 -- 172.21.15.118:0/755245304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 msgr2=0x7fb9f0112400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.796+0000 7fb9f4a86640 1 --2- 172.21.15.118:0/755245304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 0x7fb9f0112400 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009880 tx=0x7fb9e402a530 comp rx=0 tx=0).stop 2024-09-21T11:57:17.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.796+0000 7fb9f4a86640 1 -- 172.21.15.118:0/755245304 shutdown_connections 2024-09-21T11:57:17.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.796+0000 7fb9f4a86640 1 --2- 172.21.15.118:0/755245304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 0x7fb9f0112400 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.796+0000 7fb9f4a86640 1 --2- 172.21.15.118:0/755245304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9f0074590 0x7fb9f0074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.796+0000 7fb9f4a86640 1 -- 172.21.15.118:0/755245304 >> 172.21.15.118:0/755245304 conn(0x7fb9f00fd630 msgr2=0x7fb9f00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:17.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.796+0000 7fb9f4a86640 1 -- 172.21.15.118:0/755245304 shutdown_connections 2024-09-21T11:57:17.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.796+0000 7fb9f4a86640 1 -- 172.21.15.118:0/755245304 wait complete. 2024-09-21T11:57:17.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.797+0000 7fb9f4a86640 1 Processor -- start 2024-09-21T11:57:17.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.797+0000 7fb9f4a86640 1 -- start start 2024-09-21T11:57:17.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.797+0000 7fb9f4a86640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9f0074590 0x7fb9f019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:17.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.797+0000 7fb9f4a86640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 0x7fb9f019e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:17.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.797+0000 7fb9f4a86640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f0115470 con 0x7fb9f0074eb0 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.797+0000 7fb9f4a86640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f01152f0 con 0x7fb9f0074590 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9edd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 0x7fb9f019e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9edd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 0x7fb9f019e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46962/0 (socket says 172.21.15.118:46962) 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9edd9b640 1 -- 172.21.15.118:0/3241842388 learned_addr learned my addr 172.21.15.118:0/3241842388 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9ee59c640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9f0074590 0x7fb9f019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9edd9b640 1 -- 172.21.15.118:0/3241842388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9f0074590 msgr2=0x7fb9f019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9edd9b640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9f0074590 0x7fb9f019e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9edd9b640 1 -- 172.21.15.118:0/3241842388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f01a28e0 con 0x7fb9f0074eb0 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9edd9b640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 0x7fb9f019e550 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4031460 tx=0x7fb9e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9df7fe640 1 -- 172.21.15.118:0/3241842388 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9e403f070 con 0x7fb9f0074eb0 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f01a2b70 con 0x7fb9f0074eb0 2024-09-21T11:57:17.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9df7fe640 1 -- 172.21.15.118:0/3241842388 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9e4004cf0 con 0x7fb9f0074eb0 2024-09-21T11:57:17.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9df7fe640 1 -- 172.21.15.118:0/3241842388 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9e4035030 con 0x7fb9f0074eb0 2024-09-21T11:57:17.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.798+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f01a30a0 con 0x7fb9f0074eb0 2024-09-21T11:57:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.799+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f0075cd0 con 0x7fb9f0074eb0 2024-09-21T11:57:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.800+0000 7fb9df7fe640 1 -- 172.21.15.118:0/3241842388 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb9e4042070 con 0x7fb9f0074eb0 2024-09-21T11:57:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.801+0000 7fb9df7fe640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9d807af30 0x7fb9d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.801+0000 7fb9ee59c640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9d807af30 0x7fb9d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.801+0000 7fb9df7fe640 1 -- 172.21.15.118:0/3241842388 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb9e40bebb0 con 0x7fb9f0074eb0 2024-09-21T11:57:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.801+0000 7fb9ee59c640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9d807af30 0x7fb9d807d3f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009890 tx=0x7fb9e0008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:17.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.805+0000 7fb9df7fe640 1 -- 172.21.15.118:0/3241842388 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9e40c5080 con 0x7fb9f0074eb0 2024-09-21T11:57:17.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:17.990+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb9f019f370 con 0x7fb9d807af30 2024-09-21T11:57:18.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.000+0000 7fb9df7fe640 1 -- 172.21.15.118:0/3241842388 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb9f019f370 con 0x7fb9d807af30 2024-09-21T11:57:18.002 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:57:18.002 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (15m) 9m ago 26m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:57:18.002 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (18m) 9m ago 26m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:57:18.002 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (17m) 9m ago 25m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:57:18.002 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (13m) 9m ago 26m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (13m) 9m ago 25m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (14m) 9m ago 25m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (9m) 9m ago 20m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (9m) 9m ago 20m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (20m) 9m ago 20m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (9m) 9m ago 20m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (17m) 9m ago 27m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (16m) 9m ago 25m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (13m) 9m ago 27m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (13m) 9m ago 25m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (16m) 9m ago 26m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (15m) 9m ago 25m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (12m) 9m ago 24m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:57:18.003 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (12m) 9m ago 23m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:57:18.004 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (11m) 9m ago 23m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:57:18.004 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (11m) 9m ago 22m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:57:18.004 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (10m) 9m ago 22m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:57:18.004 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (9m) 9m ago 21m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:57:18.004 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (15m) 9m ago 25m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9d807af30 msgr2=0x7fb9d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9d807af30 0x7fb9d807d3f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009890 tx=0x7fb9e0008040 comp rx=0 tx=0).stop 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 msgr2=0x7fb9f019e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 0x7fb9f019e550 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4031460 tx=0x7fb9e40048f0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 shutdown_connections 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9d807af30 0x7fb9d807d3f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9f0074eb0 0x7fb9f019e550 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 --2- 172.21.15.118:0/3241842388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9f0074590 0x7fb9f019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 >> 172.21.15.118:0/3241842388 conn(0x7fb9f00fd630 msgr2=0x7fb9f0104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:18.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 shutdown_connections 2024-09-21T11:57:18.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.002+0000 7fb9f4a86640 1 -- 172.21.15.118:0/3241842388 wait complete. 2024-09-21T11:57:18.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.083+0000 7f54a4ed9640 1 -- 172.21.15.118:0/2960457931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a01033c0 msgr2=0x7f54a010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.083+0000 7f54a4ed9640 1 --2- 172.21.15.118:0/2960457931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a01033c0 0x7f54a010b8b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5494009880 tx=0x7f549402a530 comp rx=0 tx=0).stop 2024-09-21T11:57:18.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.083+0000 7f54a4ed9640 1 -- 172.21.15.118:0/2960457931 shutdown_connections 2024-09-21T11:57:18.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.083+0000 7f54a4ed9640 1 --2- 172.21.15.118:0/2960457931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a01033c0 0x7f54a010b8b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.083+0000 7f54a4ed9640 1 --2- 172.21.15.118:0/2960457931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a0102aa0 0x7f54a0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.083+0000 7f54a4ed9640 1 -- 172.21.15.118:0/2960457931 >> 172.21.15.118:0/2960457931 conn(0x7f54a00fc4c0 msgr2=0x7f54a00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:18.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.084+0000 7f54a4ed9640 1 -- 172.21.15.118:0/2960457931 shutdown_connections 2024-09-21T11:57:18.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.084+0000 7f54a4ed9640 1 -- 172.21.15.118:0/2960457931 wait complete. 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.084+0000 7f54a4ed9640 1 Processor -- start 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.084+0000 7f54a4ed9640 1 -- start start 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.084+0000 7f54a4ed9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a0102aa0 0x7f54a0100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.084+0000 7f54a4ed9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a01033c0 0x7f54a0100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.084+0000 7f54a4ed9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f54a010ee30 con 0x7f54a0102aa0 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.084+0000 7f54a4ed9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f54a010ecb0 con 0x7f54a01033c0 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f549e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a0102aa0 0x7f54a0100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f549e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a0102aa0 0x7f54a0100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46980/0 (socket says 172.21.15.118:46980) 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f549e59c640 1 -- 172.21.15.118:0/3288399804 learned_addr learned my addr 172.21.15.118:0/3288399804 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:18.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f549e59c640 1 -- 172.21.15.118:0/3288399804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a01033c0 msgr2=0x7f54a0100c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f549e59c640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a01033c0 0x7f54a0100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f549e59c640 1 -- 172.21.15.118:0/3288399804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a0101180 con 0x7f54a0102aa0 2024-09-21T11:57:18.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f549e59c640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a0102aa0 0x7f54a0100700 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f549000ba50 tx=0x7f549000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:18.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f548f7fe640 1 -- 172.21.15.118:0/3288399804 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5490019070 con 0x7f54a0102aa0 2024-09-21T11:57:18.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a0101470 con 0x7f54a0102aa0 2024-09-21T11:57:18.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f548f7fe640 1 -- 172.21.15.118:0/3288399804 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f549000ce20 con 0x7f54a0102aa0 2024-09-21T11:57:18.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f548f7fe640 1 -- 172.21.15.118:0/3288399804 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54900075a0 con 0x7f54a0102aa0 2024-09-21T11:57:18.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.085+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a01a3f60 con 0x7f54a0102aa0 2024-09-21T11:57:18.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.086+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a006a410 con 0x7f54a0102aa0 2024-09-21T11:57:18.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.087+0000 7f548f7fe640 1 -- 172.21.15.118:0/3288399804 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f549001c070 con 0x7f54a0102aa0 2024-09-21T11:57:18.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.087+0000 7f548f7fe640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f548807af30 0x7f548807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:18.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.087+0000 7f548f7fe640 1 -- 172.21.15.118:0/3288399804 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f549009d9a0 con 0x7f54a0102aa0 2024-09-21T11:57:18.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.087+0000 7f549dd9b640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f548807af30 0x7f548807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:18.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.088+0000 7f549dd9b640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f548807af30 0x7f548807d3f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54940096c0 tx=0x7f5494000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:18.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.092+0000 7f548f7fe640 1 -- 172.21.15.118:0/3288399804 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5490068ef0 con 0x7f54a0102aa0 2024-09-21T11:57:18.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.338+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f54a0101c30 con 0x7f54a0102aa0 2024-09-21T11:57:18.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.339+0000 7f548f7fe640 1 -- 172.21.15.118:0/3288399804 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f549006dda0 con 0x7f54a0102aa0 2024-09-21T11:57:18.341 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:57:18.341 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:57:18.342 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:57:18.343 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:57:18.343 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:57:18.343 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:57:18.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f548807af30 msgr2=0x7f548807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f548807af30 0x7f548807d3f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54940096c0 tx=0x7f5494000bc0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a0102aa0 msgr2=0x7f54a0100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a0102aa0 0x7f54a0100700 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f549000ba50 tx=0x7f549000bf10 comp rx=0 tx=0).stop 2024-09-21T11:57:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 shutdown_connections 2024-09-21T11:57:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54a01033c0 0x7f54a0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f548807af30 0x7f548807d3f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 --2- 172.21.15.118:0/3288399804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54a0102aa0 0x7f54a0100700 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 >> 172.21.15.118:0/3288399804 conn(0x7f54a00fc4c0 msgr2=0x7f54a0107e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 shutdown_connections 2024-09-21T11:57:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.341+0000 7f54a4ed9640 1 -- 172.21.15.118:0/3288399804 wait complete. 2024-09-21T11:57:18.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.423+0000 7f40688ed640 1 -- 172.21.15.118:0/1772082162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 msgr2=0x7f406410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.423+0000 7f40688ed640 1 --2- 172.21.15.118:0/1772082162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 0x7f406410b8b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f404c009880 tx=0x7f404c02a530 comp rx=0 tx=0).stop 2024-09-21T11:57:18.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.423+0000 7f40688ed640 1 -- 172.21.15.118:0/1772082162 shutdown_connections 2024-09-21T11:57:18.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.423+0000 7f40688ed640 1 --2- 172.21.15.118:0/1772082162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 0x7f406410b8b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.423+0000 7f40688ed640 1 --2- 172.21.15.118:0/1772082162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064102aa0 0x7f4064102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.423+0000 7f40688ed640 1 -- 172.21.15.118:0/1772082162 >> 172.21.15.118:0/1772082162 conn(0x7f40640fc4c0 msgr2=0x7f40640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:18.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.423+0000 7f40688ed640 1 -- 172.21.15.118:0/1772082162 shutdown_connections 2024-09-21T11:57:18.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.423+0000 7f40688ed640 1 -- 172.21.15.118:0/1772082162 wait complete. 2024-09-21T11:57:18.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.424+0000 7f40688ed640 1 Processor -- start 2024-09-21T11:57:18.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.424+0000 7f40688ed640 1 -- start start 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.424+0000 7f40688ed640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064102aa0 0x7f4064100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.424+0000 7f40688ed640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 0x7f4064100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.424+0000 7f40688ed640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f406410edd0 con 0x7f40641033c0 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.424+0000 7f40688ed640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f406410ec50 con 0x7f4064102aa0 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.424+0000 7f405bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 0x7f4064100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.424+0000 7f405bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 0x7f4064100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46990/0 (socket says 172.21.15.118:46990) 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.424+0000 7f405bfff640 1 -- 172.21.15.118:0/1470690888 learned_addr learned my addr 172.21.15.118:0/1470690888 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f406259c640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064102aa0 0x7f4064100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f405bfff640 1 -- 172.21.15.118:0/1470690888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064102aa0 msgr2=0x7f4064100700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f405bfff640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064102aa0 0x7f4064100700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f405bfff640 1 -- 172.21.15.118:0/1470690888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4064101180 con 0x7f40641033c0 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f405bfff640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 0x7f4064100c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f404c031460 tx=0x7f404c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f405b7fe640 1 -- 172.21.15.118:0/1470690888 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f404c03f070 con 0x7f40641033c0 2024-09-21T11:57:18.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4064101410 con 0x7f40641033c0 2024-09-21T11:57:18.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f405b7fe640 1 -- 172.21.15.118:0/1470690888 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f404c0035f0 con 0x7f40641033c0 2024-09-21T11:57:18.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f405b7fe640 1 -- 172.21.15.118:0/1470690888 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f404c035030 con 0x7f40641033c0 2024-09-21T11:57:18.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.425+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40641a3dc0 con 0x7f40641033c0 2024-09-21T11:57:18.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.426+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f406406a410 con 0x7f40641033c0 2024-09-21T11:57:18.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.427+0000 7f405b7fe640 1 -- 172.21.15.118:0/1470690888 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f404c042070 con 0x7f40641033c0 2024-09-21T11:57:18.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.427+0000 7f405b7fe640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f405007af30 0x7f405007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:18.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.427+0000 7f405b7fe640 1 -- 172.21.15.118:0/1470690888 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f404c0bea60 con 0x7f40641033c0 2024-09-21T11:57:18.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.427+0000 7f406259c640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f405007af30 0x7f405007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:18.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.428+0000 7f406259c640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f405007af30 0x7f405007d3f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4054005fd0 tx=0x7f4054005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:18.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.432+0000 7f405b7fe640 1 -- 172.21.15.118:0/1470690888 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f404c089fb0 con 0x7f40641033c0 2024-09-21T11:57:18.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.641+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4064105f40 con 0x7f40641033c0 2024-09-21T11:57:18.644 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:18 smithi118 ceph-mon[111738]: from='client.34836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:18.644 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:18 smithi118 ceph-mon[111738]: from='client.34840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:18.644 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:18 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3288399804' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:57:18.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.642+0000 7f405b7fe640 1 -- 172.21.15.118:0/1470690888 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f404c08ee60 con 0x7f40641033c0 2024-09-21T11:57:18.645 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:57:18.645 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:57:18.645 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:57:18.645 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:57:18.645 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:57:18.645 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:57:18.645 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:57:18.646 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:57:18.647 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:57:18.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:57:18.649 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:57:18.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f405007af30 msgr2=0x7f405007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f405007af30 0x7f405007d3f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4054005fd0 tx=0x7f4054005850 comp rx=0 tx=0).stop 2024-09-21T11:57:18.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 msgr2=0x7f4064100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 0x7f4064100c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f404c031460 tx=0x7f404c004530 comp rx=0 tx=0).stop 2024-09-21T11:57:18.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 shutdown_connections 2024-09-21T11:57:18.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f405007af30 0x7f405007d3f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40641033c0 0x7f4064100c40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 --2- 172.21.15.118:0/1470690888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064102aa0 0x7f4064100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 >> 172.21.15.118:0/1470690888 conn(0x7f40640fc4c0 msgr2=0x7f4064108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:18.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 shutdown_connections 2024-09-21T11:57:18.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.644+0000 7f40688ed640 1 -- 172.21.15.118:0/1470690888 wait complete. 2024-09-21T11:57:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:18 smithi149 ceph-mon[79770]: from='client.34836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:18 smithi149 ceph-mon[79770]: from='client.34840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:18 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3288399804' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:57:18.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.725+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2722089259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 msgr2=0x7f3ee8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.725+0000 7f3eedbbe640 1 --2- 172.21.15.118:0/2722089259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 0x7f3ee8106bc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009c20 tx=0x7f3ed802a970 comp rx=0 tx=0).stop 2024-09-21T11:57:18.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.726+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2722089259 shutdown_connections 2024-09-21T11:57:18.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.726+0000 7f3eedbbe640 1 --2- 172.21.15.118:0/2722089259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ee81007e0 0x7f3ee8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.726+0000 7f3eedbbe640 1 --2- 172.21.15.118:0/2722089259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 0x7f3ee8106bc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.726+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2722089259 >> 172.21.15.118:0/2722089259 conn(0x7f3ee80fc4c0 msgr2=0x7f3ee80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:18.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.726+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2722089259 shutdown_connections 2024-09-21T11:57:18.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.726+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2722089259 wait complete. 2024-09-21T11:57:18.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.726+0000 7f3eedbbe640 1 Processor -- start 2024-09-21T11:57:18.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.726+0000 7f3eedbbe640 1 -- start start 2024-09-21T11:57:18.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3eedbbe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ee81007e0 0x7f3ee819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:18.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3eedbbe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 0x7f3ee819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:18.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3eedbbe640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee810dcb0 con 0x7f3ee81067e0 2024-09-21T11:57:18.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3eedbbe640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee810db30 con 0x7f3ee81007e0 2024-09-21T11:57:18.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 0x7f3ee819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:18.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 0x7f3ee819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47008/0 (socket says 172.21.15.118:47008) 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee6ffd640 1 -- 172.21.15.118:0/2745935177 learned_addr learned my addr 172.21.15.118:0/2745935177 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee77fe640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ee81007e0 0x7f3ee819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee6ffd640 1 -- 172.21.15.118:0/2745935177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ee81007e0 msgr2=0x7f3ee819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee6ffd640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ee81007e0 0x7f3ee819d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee6ffd640 1 -- 172.21.15.118:0/2745935177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee81977d0 con 0x7f3ee81067e0 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee6ffd640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 0x7f3ee819db90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c8f0 tx=0x7f3edc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee4ff9640 1 -- 172.21.15.118:0/2745935177 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3edc0079b0 con 0x7f3ee81067e0 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee4ff9640 1 -- 172.21.15.118:0/2745935177 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3edc0054e0 con 0x7f3ee81067e0 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee8197ac0 con 0x7f3ee81067e0 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3ee4ff9640 1 -- 172.21.15.118:0/2745935177 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3edc004dd0 con 0x7f3ee81067e0 2024-09-21T11:57:18.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.727+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee8198050 con 0x7f3ee81067e0 2024-09-21T11:57:18.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.729+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee8101f20 con 0x7f3ee81067e0 2024-09-21T11:57:18.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.729+0000 7f3ee4ff9640 1 -- 172.21.15.118:0/2745935177 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3edc005020 con 0x7f3ee81067e0 2024-09-21T11:57:18.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.730+0000 7f3ee4ff9640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ed007aed0 0x7f3ed007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:18.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.730+0000 7f3ee77fe640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ed007aed0 0x7f3ed007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:18.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.730+0000 7f3ee4ff9640 1 -- 172.21.15.118:0/2745935177 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f3edc09dfe0 con 0x7f3ee81067e0 2024-09-21T11:57:18.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.730+0000 7f3ee77fe640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ed007aed0 0x7f3ed007d390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009430 tx=0x7f3ed803c040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:18.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.734+0000 7f3ee4ff9640 1 -- 172.21.15.118:0/2745935177 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3edc014030 con 0x7f3ee81067e0 2024-09-21T11:57:18.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.927+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3ee81983c0 con 0x7f3ed007aed0 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.929+0000 7f3ee4ff9640 1 -- 172.21.15.118:0/2745935177 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3ee81983c0 con 0x7f3ed007aed0 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:57:18.931 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:57:18.932 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:57:18.932 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:57:18.932 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:57:18.932 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:57:18.932 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:57:18.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ed007aed0 msgr2=0x7f3ed007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ed007aed0 0x7f3ed007d390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009430 tx=0x7f3ed803c040 comp rx=0 tx=0).stop 2024-09-21T11:57:18.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 msgr2=0x7f3ee819db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:18.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 0x7f3ee819db90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c8f0 tx=0x7f3edc00cdb0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 shutdown_connections 2024-09-21T11:57:18.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ed007aed0 0x7f3ed007d390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ee81067e0 0x7f3ee819db90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 --2- 172.21.15.118:0/2745935177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ee81007e0 0x7f3ee819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:18.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 >> 172.21.15.118:0/2745935177 conn(0x7f3ee80fc4c0 msgr2=0x7f3ee8069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:18.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 shutdown_connections 2024-09-21T11:57:18.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:18.931+0000 7f3eedbbe640 1 -- 172.21.15.118:0/2745935177 wait complete. 2024-09-21T11:57:19.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.011+0000 7ff1de7bc640 1 -- 172.21.15.118:0/2628646763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d8102aa0 msgr2=0x7ff1d8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:19.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.011+0000 7ff1de7bc640 1 --2- 172.21.15.118:0/2628646763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d8102aa0 0x7ff1d8102e80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009880 tx=0x7ff1c802a530 comp rx=0 tx=0).stop 2024-09-21T11:57:19.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.011+0000 7ff1de7bc640 1 -- 172.21.15.118:0/2628646763 shutdown_connections 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.011+0000 7ff1de7bc640 1 --2- 172.21.15.118:0/2628646763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d81033c0 0x7ff1d810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.011+0000 7ff1de7bc640 1 --2- 172.21.15.118:0/2628646763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d8102aa0 0x7ff1d8102e80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.011+0000 7ff1de7bc640 1 -- 172.21.15.118:0/2628646763 >> 172.21.15.118:0/2628646763 conn(0x7ff1d80fc4c0 msgr2=0x7ff1d80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.011+0000 7ff1de7bc640 1 -- 172.21.15.118:0/2628646763 shutdown_connections 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.011+0000 7ff1de7bc640 1 -- 172.21.15.118:0/2628646763 wait complete. 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.012+0000 7ff1de7bc640 1 Processor -- start 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.012+0000 7ff1de7bc640 1 -- start start 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.012+0000 7ff1de7bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d8102aa0 0x7ff1d819d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.012+0000 7ff1de7bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d81033c0 0x7ff1d819dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.012+0000 7ff1de7bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d810edd0 con 0x7ff1d81033c0 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.012+0000 7ff1de7bc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d810ec50 con 0x7ff1d8102aa0 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.012+0000 7ff1d77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d81033c0 0x7ff1d819dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.012+0000 7ff1d77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d81033c0 0x7ff1d819dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47022/0 (socket says 172.21.15.118:47022) 2024-09-21T11:57:19.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.012+0000 7ff1d77fe640 1 -- 172.21.15.118:0/1631903355 learned_addr learned my addr 172.21.15.118:0/1631903355 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1d7fff640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d8102aa0 0x7ff1d819d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1d77fe640 1 -- 172.21.15.118:0/1631903355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d8102aa0 msgr2=0x7ff1d819d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1d77fe640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d8102aa0 0x7ff1d819d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1d77fe640 1 -- 172.21.15.118:0/1631903355 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d8197900 con 0x7ff1d81033c0 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1d77fe640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d81033c0 0x7ff1d819dc80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00d6d0 tx=0x7ff1cc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1d57fa640 1 -- 172.21.15.118:0/1631903355 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1cc017070 con 0x7ff1d81033c0 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1d57fa640 1 -- 172.21.15.118:0/1631903355 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1cc0054e0 con 0x7ff1d81033c0 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1d57fa640 1 -- 172.21.15.118:0/1631903355 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1cc004ae0 con 0x7ff1d81033c0 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d8197bf0 con 0x7ff1d81033c0 2024-09-21T11:57:19.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.013+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d8198180 con 0x7ff1d81033c0 2024-09-21T11:57:19.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.014+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d806a410 con 0x7ff1d81033c0 2024-09-21T11:57:19.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.015+0000 7ff1d57fa640 1 -- 172.21.15.118:0/1631903355 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff1cc004de0 con 0x7ff1d81033c0 2024-09-21T11:57:19.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.015+0000 7ff1d57fa640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff1c007af30 0x7ff1c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:19.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.015+0000 7ff1d57fa640 1 -- 172.21.15.118:0/1631903355 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff1cc09dcc0 con 0x7ff1d81033c0 2024-09-21T11:57:19.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.015+0000 7ff1d7fff640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff1c007af30 0x7ff1c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:19.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.016+0000 7ff1d7fff640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff1c007af30 0x7ff1c007d3f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8031460 tx=0x7ff1c8009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:19.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.020+0000 7ff1d57fa640 1 -- 172.21.15.118:0/1631903355 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff1cc069210 con 0x7ff1d81033c0 2024-09-21T11:57:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.268+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff1d8105f70 con 0x7ff1d81033c0 2024-09-21T11:57:19.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.268+0000 7ff1d57fa640 1 -- 172.21.15.118:0/1631903355 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7ff1cc06e0c0 con 0x7ff1d81033c0 2024-09-21T11:57:19.271 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:57:19.271 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:57:19.271 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:57:19.271 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:57:19.271 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:57:19.271 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:57:19.271 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:57:19.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff1c007af30 msgr2=0x7ff1c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:19.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff1c007af30 0x7ff1c007d3f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8031460 tx=0x7ff1c8009560 comp rx=0 tx=0).stop 2024-09-21T11:57:19.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d81033c0 msgr2=0x7ff1d819dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:19.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d81033c0 0x7ff1d819dc80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00d6d0 tx=0x7ff1cc00db90 comp rx=0 tx=0).stop 2024-09-21T11:57:19.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 shutdown_connections 2024-09-21T11:57:19.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff1c007af30 0x7ff1c007d3f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:19.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d81033c0 0x7ff1d819dc80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:19.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 --2- 172.21.15.118:0/1631903355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d8102aa0 0x7ff1d819d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:19.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 >> 172.21.15.118:0/1631903355 conn(0x7ff1d80fc4c0 msgr2=0x7ff1d8108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:19.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 shutdown_connections 2024-09-21T11:57:19.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:19.271+0000 7ff1de7bc640 1 -- 172.21.15.118:0/1631903355 wait complete. 2024-09-21T11:57:19.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:19 smithi118 ceph-mon[111738]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:19.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:19 smithi118 ceph-mon[111738]: pgmap v554: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:19.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:19 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1470690888' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:57:19.575 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:19 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1631903355' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:57:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:19 smithi149 ceph-mon[79770]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:19 smithi149 ceph-mon[79770]: pgmap v554: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:19 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1470690888' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:57:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:19 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1631903355' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:57:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:20 smithi149 ceph-mon[79770]: from='client.34856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:57:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:20 smithi118 ceph-mon[111738]: from='client.34856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:57:21.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:21 smithi149 ceph-mon[79770]: pgmap v555: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:21 smithi118 ceph-mon[111738]: pgmap v555: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:23.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:23 smithi149 ceph-mon[79770]: pgmap v556: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:23 smithi118 ceph-mon[111738]: pgmap v556: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:25.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:25 smithi149 ceph-mon[79770]: pgmap v557: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:25 smithi118 ceph-mon[111738]: pgmap v557: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:27 smithi149 ceph-mon[79770]: pgmap v558: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:27 smithi118 ceph-mon[111738]: pgmap v558: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:29.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:29 smithi149 ceph-mon[79770]: pgmap v559: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:29 smithi118 ceph-mon[111738]: pgmap v559: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:31.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:31 smithi149 ceph-mon[79770]: pgmap v560: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:31 smithi118 ceph-mon[111738]: pgmap v560: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:33 smithi149 ceph-mon[79770]: pgmap v561: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:33 smithi118 ceph-mon[111738]: pgmap v561: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:35.712 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:35 smithi118 ceph-mon[111738]: pgmap v562: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:35.712 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:57:35.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:35 smithi149 ceph-mon[79770]: pgmap v562: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:57:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:37 smithi118 ceph-mon[111738]: pgmap v563: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:37 smithi149 ceph-mon[79770]: pgmap v563: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:39 smithi118 ceph-mon[111738]: pgmap v564: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:39.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:39 smithi149 ceph-mon[79770]: pgmap v564: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:41 smithi118 ceph-mon[111738]: pgmap v565: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:41 smithi149 ceph-mon[79770]: pgmap v565: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:43 smithi118 ceph-mon[111738]: pgmap v566: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:44.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:43 smithi149 ceph-mon[79770]: pgmap v566: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:46.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:45 smithi118 ceph-mon[111738]: pgmap v567: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:45 smithi149 ceph-mon[79770]: pgmap v567: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:47 smithi118 ceph-mon[111738]: pgmap v568: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:47 smithi149 ceph-mon[79770]: pgmap v568: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.367+0000 7f4b197b6640 1 -- 172.21.15.118:0/2851907729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 msgr2=0x7f4b1410b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.367+0000 7f4b197b6640 1 --2- 172.21.15.118:0/2851907729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 0x7f4b1410b8e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009880 tx=0x7f4afc02a530 comp rx=0 tx=0).stop 2024-09-21T11:57:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.367+0000 7f4b197b6640 1 -- 172.21.15.118:0/2851907729 shutdown_connections 2024-09-21T11:57:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.367+0000 7f4b197b6640 1 --2- 172.21.15.118:0/2851907729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 0x7f4b1410b8e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.367+0000 7f4b197b6640 1 --2- 172.21.15.118:0/2851907729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b14102ad0 0x7f4b14102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.367+0000 7f4b197b6640 1 -- 172.21.15.118:0/2851907729 >> 172.21.15.118:0/2851907729 conn(0x7f4b140fc510 msgr2=0x7f4b140fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.367+0000 7f4b197b6640 1 -- 172.21.15.118:0/2851907729 shutdown_connections 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.368+0000 7f4b197b6640 1 -- 172.21.15.118:0/2851907729 wait complete. 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.368+0000 7f4b197b6640 1 Processor -- start 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.368+0000 7f4b197b6640 1 -- start start 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.368+0000 7f4b197b6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b14102ad0 0x7f4b1419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.368+0000 7f4b197b6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 0x7f4b1419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.368+0000 7f4b197b6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1410ede0 con 0x7f4b141033f0 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.368+0000 7f4b197b6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1410ec60 con 0x7f4b14102ad0 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 0x7f4b1419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 0x7f4b1419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41564/0 (socket says 172.21.15.118:41564) 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b0bfff640 1 -- 172.21.15.118:0/2378275174 learned_addr learned my addr 172.21.15.118:0/2378275174 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b12ffd640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b14102ad0 0x7f4b1419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b0bfff640 1 -- 172.21.15.118:0/2378275174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b14102ad0 msgr2=0x7f4b1419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b0bfff640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b14102ad0 0x7f4b1419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b0bfff640 1 -- 172.21.15.118:0/2378275174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b141977b0 con 0x7f4b141033f0 2024-09-21T11:57:49.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b0bfff640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 0x7f4b1419db70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031460 tx=0x7f4afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b10ff9640 1 -- 172.21.15.118:0/2378275174 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4afc03f070 con 0x7f4b141033f0 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b14197a40 con 0x7f4b141033f0 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b10ff9640 1 -- 172.21.15.118:0/2378275174 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4afc004ac0 con 0x7f4b141033f0 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b10ff9640 1 -- 172.21.15.118:0/2378275174 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4afc035030 con 0x7f4b141033f0 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.369+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b14197f70 con 0x7f4b141033f0 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.370+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1406abe0 con 0x7f4b141033f0 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.371+0000 7f4b10ff9640 1 -- 172.21.15.118:0/2378275174 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4afc042070 con 0x7f4b141033f0 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.372+0000 7f4b10ff9640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4b0007af40 0x7f4b0007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.372+0000 7f4b12ffd640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4b0007af40 0x7f4b0007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.372+0000 7f4b10ff9640 1 -- 172.21.15.118:0/2378275174 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f4afc0beb30 con 0x7f4b141033f0 2024-09-21T11:57:49.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.372+0000 7f4b12ffd640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4b0007af40 0x7f4b0007d400 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4b04005e10 tx=0x7f4b04005da0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:49.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.376+0000 7f4b10ff9640 1 -- 172.21.15.118:0/2378275174 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4afc08a080 con 0x7f4b141033f0 2024-09-21T11:57:49.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.572+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4b14198ce0 con 0x7f4b0007af40 2024-09-21T11:57:49.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.573+0000 7f4b10ff9640 1 -- 172.21.15.118:0/2378275174 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4b14198ce0 con 0x7f4b0007af40 2024-09-21T11:57:49.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4b0007af40 msgr2=0x7f4b0007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4b0007af40 0x7f4b0007d400 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4b04005e10 tx=0x7f4b04005da0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 msgr2=0x7f4b1419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 0x7f4b1419db70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031460 tx=0x7f4afc0046c0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 shutdown_connections 2024-09-21T11:57:49.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4b0007af40 0x7f4b0007d400 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b141033f0 0x7f4b1419db70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 --2- 172.21.15.118:0/2378275174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b14102ad0 0x7f4b1419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 >> 172.21.15.118:0/2378275174 conn(0x7f4b140fc510 msgr2=0x7f4b14106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:49.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 shutdown_connections 2024-09-21T11:57:49.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.576+0000 7f4b197b6640 1 -- 172.21.15.118:0/2378275174 wait complete. 2024-09-21T11:57:49.587 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:57:49.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.659+0000 7f773b5f0640 1 -- 172.21.15.118:0/2324364609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 msgr2=0x7f7734106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.659+0000 7f773b5f0640 1 --2- 172.21.15.118:0/2324364609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 0x7f7734106bc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7724009c20 tx=0x7f772402a970 comp rx=0 tx=0).stop 2024-09-21T11:57:49.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.659+0000 7f773b5f0640 1 -- 172.21.15.118:0/2324364609 shutdown_connections 2024-09-21T11:57:49.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.659+0000 7f773b5f0640 1 --2- 172.21.15.118:0/2324364609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77341007e0 0x7f7734100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.659+0000 7f773b5f0640 1 --2- 172.21.15.118:0/2324364609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 0x7f7734106bc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.659+0000 7f773b5f0640 1 -- 172.21.15.118:0/2324364609 >> 172.21.15.118:0/2324364609 conn(0x7f77340fc4c0 msgr2=0x7f77340fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:49.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.660+0000 7f773b5f0640 1 -- 172.21.15.118:0/2324364609 shutdown_connections 2024-09-21T11:57:49.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.660+0000 7f773b5f0640 1 -- 172.21.15.118:0/2324364609 wait complete. 2024-09-21T11:57:49.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.660+0000 7f773b5f0640 1 Processor -- start 2024-09-21T11:57:49.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.660+0000 7f773b5f0640 1 -- start start 2024-09-21T11:57:49.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f773b5f0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77341007e0 0x7f77340fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:49.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f773b5f0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 0x7f77340fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:49.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f773b5f0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f773410dd10 con 0x7f77341067e0 2024-09-21T11:57:49.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f773b5f0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f773410db90 con 0x7f77341007e0 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f7738b8b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 0x7f77340fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f7738b8b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 0x7f77340fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41586/0 (socket says 172.21.15.118:41586) 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f7738b8b640 1 -- 172.21.15.118:0/1602401241 learned_addr learned my addr 172.21.15.118:0/1602401241 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f773938c640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77341007e0 0x7f77340fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f7738b8b640 1 -- 172.21.15.118:0/1602401241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77341007e0 msgr2=0x7f77340fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f7738b8b640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77341007e0 0x7f77340fcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f7738b8b640 1 -- 172.21.15.118:0/1602401241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77340fd780 con 0x7f77341067e0 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f7738b8b640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 0x7f77340fd240 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f772800b420 tx=0x7f772800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f77327fc640 1 -- 172.21.15.118:0/1602401241 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7728011630 con 0x7f77341067e0 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f77327fc640 1 -- 172.21.15.118:0/1602401241 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7728016070 con 0x7f77341067e0 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f77327fc640 1 -- 172.21.15.118:0/1602401241 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7728010d40 con 0x7f77341067e0 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.661+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77340fda70 con 0x7f77341067e0 2024-09-21T11:57:49.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.662+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77341a3fb0 con 0x7f77341067e0 2024-09-21T11:57:49.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.663+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7734101f20 con 0x7f77341067e0 2024-09-21T11:57:49.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.663+0000 7f77327fc640 1 -- 172.21.15.118:0/1602401241 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f772801b460 con 0x7f77341067e0 2024-09-21T11:57:49.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.664+0000 7f77327fc640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f771c07af80 0x7f771c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:49.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.664+0000 7f77327fc640 1 -- 172.21.15.118:0/1602401241 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f772809d750 con 0x7f77341067e0 2024-09-21T11:57:49.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.664+0000 7f773938c640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f771c07af80 0x7f771c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:49.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.664+0000 7f773938c640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f771c07af80 0x7f771c07d440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7724006010 tx=0x7f7724009380 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:49.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.668+0000 7f77327fc640 1 -- 172.21.15.118:0/1602401241 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7728021250 con 0x7f77341067e0 2024-09-21T11:57:49.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.877+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7734062630 con 0x7f771c07af80 2024-09-21T11:57:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.878+0000 7f77327fc640 1 -- 172.21.15.118:0/1602401241 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f7734062630 con 0x7f771c07af80 2024-09-21T11:57:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.880+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f771c07af80 msgr2=0x7f771c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.880+0000 7f773b5f0640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f771c07af80 0x7f771c07d440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7724006010 tx=0x7f7724009380 comp rx=0 tx=0).stop 2024-09-21T11:57:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.880+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 msgr2=0x7f77340fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.880+0000 7f773b5f0640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 0x7f77340fd240 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f772800b420 tx=0x7f772800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.880+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 shutdown_connections 2024-09-21T11:57:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.881+0000 7f773b5f0640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f771c07af80 0x7f771c07d440 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.881+0000 7f773b5f0640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77341067e0 0x7f77340fd240 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.881+0000 7f773b5f0640 1 --2- 172.21.15.118:0/1602401241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77341007e0 0x7f77340fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.881+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 >> 172.21.15.118:0/1602401241 conn(0x7f77340fc4c0 msgr2=0x7f773406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:49.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.881+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 shutdown_connections 2024-09-21T11:57:49.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.881+0000 7f773b5f0640 1 -- 172.21.15.118:0/1602401241 wait complete. 2024-09-21T11:57:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.963+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/363467154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 msgr2=0x7f7cb8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.963+0000 7f7cbd8a6640 1 --2- 172.21.15.118:0/363467154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 0x7f7cb8101d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009880 tx=0x7f7ca002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.963+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/363467154 shutdown_connections 2024-09-21T11:57:49.966 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:49 smithi118 ceph-mon[111738]: pgmap v569: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.963+0000 7f7cbd8a6640 1 --2- 172.21.15.118:0/363467154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 0x7f7cb8101d90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.963+0000 7f7cbd8a6640 1 --2- 172.21.15.118:0/363467154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cb8107930 0x7f7cb8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.963+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/363467154 >> 172.21.15.118:0/363467154 conn(0x7f7cb80fd630 msgr2=0x7f7cb80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.964+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/363467154 shutdown_connections 2024-09-21T11:57:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.964+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/363467154 wait complete. 2024-09-21T11:57:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.964+0000 7f7cbd8a6640 1 Processor -- start 2024-09-21T11:57:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.964+0000 7f7cbd8a6640 1 -- start start 2024-09-21T11:57:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.964+0000 7f7cbd8a6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 0x7f7cb819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.964+0000 7f7cbd8a6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cb8107930 0x7f7cb819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.964+0000 7f7cbd8a6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb810ede0 con 0x7f7cb8101930 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.964+0000 7f7cbd8a6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb810ec60 con 0x7f7cb8107930 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cb6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 0x7f7cb819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cb6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 0x7f7cb819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41610/0 (socket says 172.21.15.118:41610) 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cb6ffd640 1 -- 172.21.15.118:0/488456219 learned_addr learned my addr 172.21.15.118:0/488456219 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7caffff640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cb8107930 0x7f7cb819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cb6ffd640 1 -- 172.21.15.118:0/488456219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cb8107930 msgr2=0x7f7cb819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cb6ffd640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cb8107930 0x7f7cb819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cb6ffd640 1 -- 172.21.15.118:0/488456219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb8197850 con 0x7f7cb8101930 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7caffff640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cb8107930 0x7f7cb819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cb6ffd640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 0x7f7cb819d6d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c810 tx=0x7f7ca800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cbc8a4640 1 -- 172.21.15.118:0/488456219 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ca8004020 con 0x7f7cb8101930 2024-09-21T11:57:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cbc8a4640 1 -- 172.21.15.118:0/488456219 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ca80041c0 con 0x7f7cb8101930 2024-09-21T11:57:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb8197b40 con 0x7f7cb8101930 2024-09-21T11:57:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cbc8a4640 1 -- 172.21.15.118:0/488456219 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ca80047a0 con 0x7f7cb8101930 2024-09-21T11:57:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.965+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb81980a0 con 0x7f7cb8101930 2024-09-21T11:57:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.966+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb8103070 con 0x7f7cb8101930 2024-09-21T11:57:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.967+0000 7f7cbc8a4640 1 -- 172.21.15.118:0/488456219 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7ca80079b0 con 0x7f7cb8101930 2024-09-21T11:57:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.968+0000 7f7cbc8a4640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ca407af80 0x7f7ca407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.968+0000 7f7cbc8a4640 1 -- 172.21.15.118:0/488456219 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f7ca809e340 con 0x7f7cb8101930 2024-09-21T11:57:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.968+0000 7f7caffff640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ca407af80 0x7f7ca407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.969+0000 7f7caffff640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ca407af80 0x7f7ca407d440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8198ba0 tx=0x7f7ca0009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:49.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:49.972+0000 7f7cbc8a4640 1 -- 172.21.15.118:0/488456219 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ca8014030 con 0x7f7cb8101930 2024-09-21T11:57:50.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.158+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7cb81983b0 con 0x7f7ca407af80 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.168+0000 7f7cbc8a4640 1 -- 172.21.15.118:0/488456219 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7cb81983b0 con 0x7f7ca407af80 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (15m) 9m ago 26m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (18m) 9m ago 26m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (18m) 9m ago 26m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (13m) 9m ago 26m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (13m) 9m ago 25m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (15m) 9m ago 26m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (10m) 9m ago 21m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:57:50.170 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (9m) 9m ago 21m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (21m) 9m ago 21m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (9m) 9m ago 21m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (17m) 9m ago 28m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (16m) 9m ago 25m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (14m) 9m ago 28m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (14m) 9m ago 25m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (16m) 9m ago 26m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (16m) 9m ago 25m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (13m) 9m ago 24m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (12m) 9m ago 24m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (12m) 9m ago 23m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (11m) 9m ago 23m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (11m) 9m ago 22m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (10m) 9m ago 22m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:57:50.171 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (16m) 9m ago 26m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ca407af80 msgr2=0x7f7ca407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ca407af80 0x7f7ca407d440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8198ba0 tx=0x7f7ca0009560 comp rx=0 tx=0).stop 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 msgr2=0x7f7cb819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 0x7f7cb819d6d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c810 tx=0x7f7ca800ccd0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 shutdown_connections 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cb8107930 0x7f7cb819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ca407af80 0x7f7ca407d440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 --2- 172.21.15.118:0/488456219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8101930 0x7f7cb819d6d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 >> 172.21.15.118:0/488456219 conn(0x7f7cb80fd630 msgr2=0x7f7cb80fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 shutdown_connections 2024-09-21T11:57:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.170+0000 7f7cbd8a6640 1 -- 172.21.15.118:0/488456219 wait complete. 2024-09-21T11:57:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:49 smithi149 ceph-mon[79770]: pgmap v569: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:50.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 -- 172.21.15.118:0/3330771693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 msgr2=0x7f7d30100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 --2- 172.21.15.118:0/3330771693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 0x7f7d30100c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009880 tx=0x7f7d1802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 -- 172.21.15.118:0/3330771693 shutdown_connections 2024-09-21T11:57:50.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 --2- 172.21.15.118:0/3330771693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 0x7f7d30100c40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 --2- 172.21.15.118:0/3330771693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d301067e0 0x7f7d30106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 -- 172.21.15.118:0/3330771693 >> 172.21.15.118:0/3330771693 conn(0x7f7d300fc4c0 msgr2=0x7f7d300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:50.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 -- 172.21.15.118:0/3330771693 shutdown_connections 2024-09-21T11:57:50.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 -- 172.21.15.118:0/3330771693 wait complete. 2024-09-21T11:57:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 Processor -- start 2024-09-21T11:57:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.252+0000 7f7d35ffb640 1 -- start start 2024-09-21T11:57:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d35ffb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 0x7f7d301987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d35ffb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d301067e0 0x7f7d30198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d35ffb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3010dcb0 con 0x7f7d301007e0 2024-09-21T11:57:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d35ffb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3010db30 con 0x7f7d301067e0 2024-09-21T11:57:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d2f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 0x7f7d301987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d2f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 0x7f7d301987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41626/0 (socket says 172.21.15.118:41626) 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d2f7fe640 1 -- 172.21.15.118:0/1436423453 learned_addr learned my addr 172.21.15.118:0/1436423453 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d26ffd640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d301067e0 0x7f7d30198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d2f7fe640 1 -- 172.21.15.118:0/1436423453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d301067e0 msgr2=0x7f7d30198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d2f7fe640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d301067e0 0x7f7d30198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d2f7fe640 1 -- 172.21.15.118:0/1436423453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d30199330 con 0x7f7d301007e0 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d26ffd640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d301067e0 0x7f7d30198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.253+0000 7f7d2f7fe640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 0x7f7d301987a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000d6f0 tx=0x7f7d2000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.254+0000 7f7d2d7fa640 1 -- 172.21.15.118:0/1436423453 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d20017070 con 0x7f7d301007e0 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.254+0000 7f7d2d7fa640 1 -- 172.21.15.118:0/1436423453 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d2000de00 con 0x7f7d301007e0 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.254+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d301a1810 con 0x7f7d301007e0 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.254+0000 7f7d2d7fa640 1 -- 172.21.15.118:0/1436423453 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d20004bb0 con 0x7f7d301007e0 2024-09-21T11:57:50.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.254+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d301a1c10 con 0x7f7d301007e0 2024-09-21T11:57:50.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.255+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d30101f20 con 0x7f7d301007e0 2024-09-21T11:57:50.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.255+0000 7f7d2d7fa640 1 -- 172.21.15.118:0/1436423453 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7d20009a30 con 0x7f7d301007e0 2024-09-21T11:57:50.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.256+0000 7f7d2d7fa640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d1c07af80 0x7f7d1c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:50.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.257+0000 7f7d26ffd640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d1c07af80 0x7f7d1c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:50.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.257+0000 7f7d2d7fa640 1 -- 172.21.15.118:0/1436423453 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f7d2009dc20 con 0x7f7d301007e0 2024-09-21T11:57:50.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.257+0000 7f7d26ffd640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d1c07af80 0x7f7d1c07d440 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d3006a6c0 tx=0x7f7d18031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:50.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.260+0000 7f7d2d7fa640 1 -- 172.21.15.118:0/1436423453 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d200691f0 con 0x7f7d301007e0 2024-09-21T11:57:50.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.508+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7d3002d7c0 con 0x7f7d301007e0 2024-09-21T11:57:50.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.509+0000 7f7d2d7fa640 1 -- 172.21.15.118:0/1436423453 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f7d2006e0a0 con 0x7f7d301007e0 2024-09-21T11:57:50.511 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:57:50.511 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:57:50.511 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:57:50.511 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:57:50.511 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:57:50.512 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:57:50.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d1c07af80 msgr2=0x7f7d1c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d1c07af80 0x7f7d1c07d440 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d3006a6c0 tx=0x7f7d18031400 comp rx=0 tx=0).stop 2024-09-21T11:57:50.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 msgr2=0x7f7d301987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 0x7f7d301987a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000d6f0 tx=0x7f7d2000dbb0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 shutdown_connections 2024-09-21T11:57:50.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d301067e0 0x7f7d30198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7d1c07af80 0x7f7d1c07d440 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 --2- 172.21.15.118:0/1436423453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301007e0 0x7f7d301987a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 >> 172.21.15.118:0/1436423453 conn(0x7f7d300fc4c0 msgr2=0x7f7d300fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:50.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 shutdown_connections 2024-09-21T11:57:50.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.511+0000 7f7d35ffb640 1 -- 172.21.15.118:0/1436423453 wait complete. 2024-09-21T11:57:50.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.592+0000 7f671bb32640 1 -- 172.21.15.118:0/855596592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714100820 msgr2=0x7f6714100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.592+0000 7f671bb32640 1 --2- 172.21.15.118:0/855596592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714100820 0x7f6714100c80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6704009880 tx=0x7f670402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.592+0000 7f671bb32640 1 -- 172.21.15.118:0/855596592 shutdown_connections 2024-09-21T11:57:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.592+0000 7f671bb32640 1 --2- 172.21.15.118:0/855596592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714100820 0x7f6714100c80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.592+0000 7f671bb32640 1 --2- 172.21.15.118:0/855596592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6714106820 0x7f6714106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.592+0000 7f671bb32640 1 -- 172.21.15.118:0/855596592 >> 172.21.15.118:0/855596592 conn(0x7f67140fc520 msgr2=0x7f67140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.592+0000 7f671bb32640 1 -- 172.21.15.118:0/855596592 shutdown_connections 2024-09-21T11:57:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.592+0000 7f671bb32640 1 -- 172.21.15.118:0/855596592 wait complete. 2024-09-21T11:57:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f671bb32640 1 Processor -- start 2024-09-21T11:57:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f671bb32640 1 -- start start 2024-09-21T11:57:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f671bb32640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6714100820 0x7f671419c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f671bb32640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714106820 0x7f671419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f671bb32640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f671410dcf0 con 0x7f6714106820 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f671bb32640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f671410db70 con 0x7f6714100820 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f67190cd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714106820 0x7f671419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f67190cd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714106820 0x7f671419cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41646/0 (socket says 172.21.15.118:41646) 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f67190cd640 1 -- 172.21.15.118:0/2600544803 learned_addr learned my addr 172.21.15.118:0/2600544803 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f67198ce640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6714100820 0x7f671419c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f67190cd640 1 -- 172.21.15.118:0/2600544803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6714100820 msgr2=0x7f671419c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f67190cd640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6714100820 0x7f671419c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f67190cd640 1 -- 172.21.15.118:0/2600544803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67141966c0 con 0x7f6714106820 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.593+0000 7f67190cd640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714106820 0x7f671419cb30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6704031460 tx=0x7f67040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.594+0000 7f670affd640 1 -- 172.21.15.118:0/2600544803 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f670403f070 con 0x7f6714106820 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.594+0000 7f670affd640 1 -- 172.21.15.118:0/2600544803 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67040044d0 con 0x7f6714106820 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.594+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6714196950 con 0x7f6714106820 2024-09-21T11:57:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.594+0000 7f670affd640 1 -- 172.21.15.118:0/2600544803 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6704035030 con 0x7f6714106820 2024-09-21T11:57:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.594+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6714196e50 con 0x7f6714106820 2024-09-21T11:57:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.595+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6714101f60 con 0x7f6714106820 2024-09-21T11:57:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.595+0000 7f670affd640 1 -- 172.21.15.118:0/2600544803 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6704042070 con 0x7f6714106820 2024-09-21T11:57:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.596+0000 7f670affd640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f670007af40 0x7f670007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.596+0000 7f670affd640 1 -- 172.21.15.118:0/2600544803 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f67040bec10 con 0x7f6714106820 2024-09-21T11:57:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.596+0000 7f67198ce640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f670007af40 0x7f670007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.596+0000 7f67198ce640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f670007af40 0x7f670007d400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6710005fd0 tx=0x7f6710005e20 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.600+0000 7f670affd640 1 -- 172.21.15.118:0/2600544803 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6704004cf0 con 0x7f6714106820 2024-09-21T11:57:50.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.817+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6714108d90 con 0x7f6714106820 2024-09-21T11:57:50.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.818+0000 7f670affd640 1 -- 172.21.15.118:0/2600544803 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f670408a160 con 0x7f6714106820 2024-09-21T11:57:50.820 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:57:50.820 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:57:50.820 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:57:50.821 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:57:50.822 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:57:50.823 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:57:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:57:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f670007af40 msgr2=0x7f670007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f670007af40 0x7f670007d400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6710005fd0 tx=0x7f6710005e20 comp rx=0 tx=0).stop 2024-09-21T11:57:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714106820 msgr2=0x7f671419cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714106820 0x7f671419cb30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6704031460 tx=0x7f67040048f0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 shutdown_connections 2024-09-21T11:57:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f670007af40 0x7f670007d400 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6714106820 0x7f671419cb30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 --2- 172.21.15.118:0/2600544803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6714100820 0x7f671419c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 >> 172.21.15.118:0/2600544803 conn(0x7f67140fc520 msgr2=0x7f67140fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:50.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 shutdown_connections 2024-09-21T11:57:50.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.820+0000 7f671bb32640 1 -- 172.21.15.118:0/2600544803 wait complete. 2024-09-21T11:57:50.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.902+0000 7ff6b157f640 1 -- 172.21.15.118:0/78448657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 msgr2=0x7ff6ac106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.902+0000 7ff6b157f640 1 --2- 172.21.15.118:0/78448657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 0x7ff6ac106c00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009880 tx=0x7ff69c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.902+0000 7ff6b157f640 1 -- 172.21.15.118:0/78448657 shutdown_connections 2024-09-21T11:57:50.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.902+0000 7ff6b157f640 1 --2- 172.21.15.118:0/78448657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ac100820 0x7ff6ac100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.902+0000 7ff6b157f640 1 --2- 172.21.15.118:0/78448657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 0x7ff6ac106c00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.902+0000 7ff6b157f640 1 -- 172.21.15.118:0/78448657 >> 172.21.15.118:0/78448657 conn(0x7ff6ac0fc520 msgr2=0x7ff6ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:50.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.902+0000 7ff6b157f640 1 -- 172.21.15.118:0/78448657 shutdown_connections 2024-09-21T11:57:50.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.902+0000 7ff6b157f640 1 -- 172.21.15.118:0/78448657 wait complete. 2024-09-21T11:57:50.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.902+0000 7ff6b157f640 1 Processor -- start 2024-09-21T11:57:50.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6b157f640 1 -- start start 2024-09-21T11:57:50.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6b157f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ac100820 0x7ff6ac198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:50.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6b157f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 0x7ff6ac198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:50.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6b157f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac10dd50 con 0x7ff6ac106820 2024-09-21T11:57:50.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6b157f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac10dbd0 con 0x7ff6ac100820 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6aa7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 0x7ff6ac198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6aa7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 0x7ff6ac198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41658/0 (socket says 172.21.15.118:41658) 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6aa7fc640 1 -- 172.21.15.118:0/2035395202 learned_addr learned my addr 172.21.15.118:0/2035395202 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6aaffd640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ac100820 0x7ff6ac198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6aa7fc640 1 -- 172.21.15.118:0/2035395202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ac100820 msgr2=0x7ff6ac198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6aa7fc640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ac100820 0x7ff6ac198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6aa7fc640 1 -- 172.21.15.118:0/2035395202 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac1993a0 con 0x7ff6ac106820 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6aa7fc640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 0x7ff6ac198da0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff69400b420 tx=0x7ff69400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6a3fff640 1 -- 172.21.15.118:0/2035395202 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff694011630 con 0x7ff6ac106820 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6a3fff640 1 -- 172.21.15.118:0/2035395202 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff694016070 con 0x7ff6ac106820 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.903+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac199690 con 0x7ff6ac106820 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.904+0000 7ff6a3fff640 1 -- 172.21.15.118:0/2035395202 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff694010d40 con 0x7ff6ac106820 2024-09-21T11:57:50.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.904+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac1a1c90 con 0x7ff6ac106820 2024-09-21T11:57:50.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.905+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ac101f60 con 0x7ff6ac106820 2024-09-21T11:57:50.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.905+0000 7ff6a3fff640 1 -- 172.21.15.118:0/2035395202 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff69401b460 con 0x7ff6ac106820 2024-09-21T11:57:50.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.906+0000 7ff6a3fff640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff69807af30 0x7ff69807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:50.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.906+0000 7ff6aaffd640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff69807af30 0x7ff69807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:50.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.906+0000 7ff6a3fff640 1 -- 172.21.15.118:0/2035395202 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff69409d8a0 con 0x7ff6ac106820 2024-09-21T11:57:50.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.906+0000 7ff6aaffd640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff69807af30 0x7ff69807d3f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0096c0 tx=0x7ff69c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:50.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:50.910+0000 7ff6a3fff640 1 -- 172.21.15.118:0/2035395202 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6ac199690 con 0x7ff6ac106820 2024-09-21T11:57:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:50 smithi118 ceph-mon[111738]: from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:57:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:50 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1436423453' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:57:51.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.120+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff6ac062630 con 0x7ff69807af30 2024-09-21T11:57:51.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.121+0000 7ff6a3fff640 1 -- 172.21.15.118:0/2035395202 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ff6ac062630 con 0x7ff69807af30 2024-09-21T11:57:51.123 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:57:51.123 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:57:51.123 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:57:51.123 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:57:51.123 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:57:51.124 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:57:51.124 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:57:51.124 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:57:51.124 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:57:51.124 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:57:51.124 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:57:51.124 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:57:51.124 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:57:51.124 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:57:51.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff69807af30 msgr2=0x7ff69807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff69807af30 0x7ff69807d3f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0096c0 tx=0x7ff69c031400 comp rx=0 tx=0).stop 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 msgr2=0x7ff6ac198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 0x7ff6ac198da0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff69400b420 tx=0x7ff69400b8e0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 shutdown_connections 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff69807af30 0x7ff69807d3f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ac106820 0x7ff6ac198da0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 --2- 172.21.15.118:0/2035395202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ac100820 0x7ff6ac198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 >> 172.21.15.118:0/2035395202 conn(0x7ff6ac0fc520 msgr2=0x7ff6ac0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 shutdown_connections 2024-09-21T11:57:51.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.123+0000 7ff6b157f640 1 -- 172.21.15.118:0/2035395202 wait complete. 2024-09-21T11:57:51.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:50 smithi149 ceph-mon[79770]: from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:57:51.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:50 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1436423453' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:57:51.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.204+0000 7f36b926d640 1 -- 172.21.15.118:0/2612808719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4100820 msgr2=0x7f36b4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:51.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.204+0000 7f36b926d640 1 --2- 172.21.15.118:0/2612808719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4100820 0x7f36b4100c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f369c009880 tx=0x7f369c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.204+0000 7f36b926d640 1 -- 172.21.15.118:0/2612808719 shutdown_connections 2024-09-21T11:57:51.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.204+0000 7f36b926d640 1 --2- 172.21.15.118:0/2612808719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4100820 0x7f36b4100c80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.204+0000 7f36b926d640 1 --2- 172.21.15.118:0/2612808719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b4106820 0x7f36b4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.204+0000 7f36b926d640 1 -- 172.21.15.118:0/2612808719 >> 172.21.15.118:0/2612808719 conn(0x7f36b40fc520 msgr2=0x7f36b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:51.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.204+0000 7f36b926d640 1 -- 172.21.15.118:0/2612808719 shutdown_connections 2024-09-21T11:57:51.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.204+0000 7f36b926d640 1 -- 172.21.15.118:0/2612808719 wait complete. 2024-09-21T11:57:51.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36b926d640 1 Processor -- start 2024-09-21T11:57:51.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36b926d640 1 -- start start 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36b926d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b4100820 0x7f36b4198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36b926d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4106820 0x7f36b4198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36b926d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f36b410dcf0 con 0x7f36b4106820 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36b926d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36b410db70 con 0x7f36b4100820 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36aa7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4106820 0x7f36b4198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36aa7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4106820 0x7f36b4198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41674/0 (socket says 172.21.15.118:41674) 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36aa7fc640 1 -- 172.21.15.118:0/950855062 learned_addr learned my addr 172.21.15.118:0/950855062 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.205+0000 7f36b2ffd640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b4100820 0x7f36b4198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36aa7fc640 1 -- 172.21.15.118:0/950855062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b4100820 msgr2=0x7f36b4198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36aa7fc640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b4100820 0x7f36b4198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36aa7fc640 1 -- 172.21.15.118:0/950855062 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b4199340 con 0x7f36b4106820 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36b2ffd640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b4100820 0x7f36b4198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36aa7fc640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4106820 0x7f36b4198d40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f369c031460 tx=0x7f369c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36b0ff9640 1 -- 172.21.15.118:0/950855062 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f369c03f070 con 0x7f36b4106820 2024-09-21T11:57:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36b0ff9640 1 -- 172.21.15.118:0/950855062 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f369c004a90 con 0x7f36b4106820 2024-09-21T11:57:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b41995d0 con 0x7f36b4106820 2024-09-21T11:57:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36b0ff9640 1 -- 172.21.15.118:0/950855062 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f369c035030 con 0x7f36b4106820 2024-09-21T11:57:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.206+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b41a1b80 con 0x7f36b4106820 2024-09-21T11:57:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.207+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b4101f60 con 0x7f36b4106820 2024-09-21T11:57:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.208+0000 7f36b0ff9640 1 -- 172.21.15.118:0/950855062 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f369c042070 con 0x7f36b4106820 2024-09-21T11:57:51.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.209+0000 7f36b0ff9640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36a007af40 0x7f36a007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:57:51.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.209+0000 7f36b0ff9640 1 -- 172.21.15.118:0/950855062 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f369c0bf220 con 0x7f36b4106820 2024-09-21T11:57:51.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.209+0000 7f36b2ffd640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36a007af40 0x7f36a007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:57:51.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.209+0000 7f36b2ffd640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36a007af40 0x7f36a007d400 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009c20 tx=0x7f36a4005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:57:51.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.212+0000 7f36b0ff9640 1 -- 172.21.15.118:0/950855062 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f369c08a7f0 con 0x7f36b4106820 2024-09-21T11:57:51.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.461+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f36b4108d90 con 0x7f36b4106820 2024-09-21T11:57:51.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.462+0000 7f36b0ff9640 1 -- 172.21.15.118:0/950855062 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f369c08f6a0 con 0x7f36b4106820 2024-09-21T11:57:51.464 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:57:51.464 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:57:51.464 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:57:51.465 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:57:51.465 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:57:51.465 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:57:51.465 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.465+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36a007af40 msgr2=0x7f36a007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.465+0000 7f36b926d640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36a007af40 0x7f36a007d400 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009c20 tx=0x7f36a4005f90 comp rx=0 tx=0).stop 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.465+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4106820 msgr2=0x7f36b4198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.465+0000 7f36b926d640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4106820 0x7f36b4198d40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f369c031460 tx=0x7f369c004530 comp rx=0 tx=0).stop 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.466+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 shutdown_connections 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.466+0000 7f36b926d640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36a007af40 0x7f36a007d400 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.466+0000 7f36b926d640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36b4106820 0x7f36b4198d40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.466+0000 7f36b926d640 1 --2- 172.21.15.118:0/950855062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36b4100820 0x7f36b4198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.466+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 >> 172.21.15.118:0/950855062 conn(0x7f36b40fc520 msgr2=0x7f36b40fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:57:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.466+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 shutdown_connections 2024-09-21T11:57:51.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:57:51.466+0000 7f36b926d640 1 -- 172.21.15.118:0/950855062 wait complete. 2024-09-21T11:57:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:51 smithi118 ceph-mon[111738]: from='client.34868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:51 smithi118 ceph-mon[111738]: from='client.34872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:51 smithi118 ceph-mon[111738]: pgmap v570: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:51 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2600544803' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:57:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:51 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/950855062' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:57:52.124 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:51 smithi149 ceph-mon[79770]: from='client.34868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:52.124 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:51 smithi149 ceph-mon[79770]: from='client.34872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:52.124 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:51 smithi149 ceph-mon[79770]: pgmap v570: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:52.124 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:51 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2600544803' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:57:52.124 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:51 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/950855062' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:57:53.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:52 smithi118 ceph-mon[111738]: from='client.34884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:53.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:52 smithi149 ceph-mon[79770]: from='client.34884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:57:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:53 smithi118 ceph-mon[111738]: pgmap v571: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:54.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:53 smithi149 ceph-mon[79770]: pgmap v571: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:56.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:55 smithi118 ceph-mon[111738]: pgmap v572: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:56.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:55 smithi149 ceph-mon[79770]: pgmap v572: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:57 smithi118 ceph-mon[111738]: pgmap v573: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:58.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:57 smithi149 ceph-mon[79770]: pgmap v573: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:59.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:57:58 smithi118 ceph-mon[111738]: pgmap v574: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:57:59.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:57:58 smithi149 ceph-mon[79770]: pgmap v574: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:01.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:01 smithi149 ceph-mon[79770]: pgmap v575: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:01.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:01 smithi118 ceph-mon[111738]: pgmap v575: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:03.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:03 smithi149 ceph-mon[79770]: pgmap v576: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:03 smithi118 ceph-mon[111738]: pgmap v576: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:05 smithi149 ceph-mon[79770]: pgmap v577: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:58:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:05 smithi118 ceph-mon[111738]: pgmap v577: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:58:07.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:07 smithi149 ceph-mon[79770]: pgmap v578: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:07 smithi118 ceph-mon[111738]: pgmap v578: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:09 smithi149 ceph-mon[79770]: pgmap v579: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:09.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:09 smithi118 ceph-mon[111738]: pgmap v579: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:11 smithi118 ceph-mon[111738]: pgmap v580: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:11.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:11 smithi149 ceph-mon[79770]: pgmap v580: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:13 smithi149 ceph-mon[79770]: pgmap v581: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:13 smithi118 ceph-mon[111738]: pgmap v581: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:15 smithi149 ceph-mon[79770]: pgmap v582: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:15 smithi118 ceph-mon[111738]: pgmap v582: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:17.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:17 smithi149 ceph-mon[79770]: pgmap v583: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:17 smithi118 ceph-mon[111738]: pgmap v583: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:19 smithi149 ceph-mon[79770]: pgmap v584: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:19 smithi118 ceph-mon[111738]: pgmap v584: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:58:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:58:21.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.554+0000 7fab12d56640 1 -- 172.21.15.118:0/260026697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c1033c0 msgr2=0x7fab0c10b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:21.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.554+0000 7fab12d56640 1 --2- 172.21.15.118:0/260026697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c1033c0 0x7fab0c10b8b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fab00009880 tx=0x7fab0002a530 comp rx=0 tx=0).stop 2024-09-21T11:58:21.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.554+0000 7fab12d56640 1 -- 172.21.15.118:0/260026697 shutdown_connections 2024-09-21T11:58:21.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.554+0000 7fab12d56640 1 --2- 172.21.15.118:0/260026697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c1033c0 0x7fab0c10b8b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.554+0000 7fab12d56640 1 --2- 172.21.15.118:0/260026697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0c102aa0 0x7fab0c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.554+0000 7fab12d56640 1 -- 172.21.15.118:0/260026697 >> 172.21.15.118:0/260026697 conn(0x7fab0c0fc4c0 msgr2=0x7fab0c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:21.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.554+0000 7fab12d56640 1 -- 172.21.15.118:0/260026697 shutdown_connections 2024-09-21T11:58:21.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.554+0000 7fab12d56640 1 -- 172.21.15.118:0/260026697 wait complete. 2024-09-21T11:58:21.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.554+0000 7fab12d56640 1 Processor -- start 2024-09-21T11:58:21.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab12d56640 1 -- start start 2024-09-21T11:58:21.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab12d56640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c102aa0 0x7fab0c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:21.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab12d56640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0c1033c0 0x7fab0c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:21.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab12d56640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10ee30 con 0x7fab0c102aa0 2024-09-21T11:58:21.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab12d56640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10ecb0 con 0x7fab0c1033c0 2024-09-21T11:58:21.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab10af2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c102aa0 0x7fab0c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:21.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab10af2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c102aa0 0x7fab0c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36762/0 (socket says 172.21.15.118:36762) 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab10af2640 1 -- 172.21.15.118:0/881305725 learned_addr learned my addr 172.21.15.118:0/881305725 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab10af2640 1 -- 172.21.15.118:0/881305725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0c1033c0 msgr2=0x7fab0c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab10af2640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0c1033c0 0x7fab0c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab10af2640 1 -- 172.21.15.118:0/881305725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c197860 con 0x7fab0c102aa0 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab10af2640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c102aa0 0x7fab0c19d6a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fab0400ba50 tx=0x7fab0400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.555+0000 7fab09ffb640 1 -- 172.21.15.118:0/881305725 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab04019070 con 0x7fab0c102aa0 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.556+0000 7fab09ffb640 1 -- 172.21.15.118:0/881305725 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab0400ce20 con 0x7fab0c102aa0 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.556+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab0c197b50 con 0x7fab0c102aa0 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.556+0000 7fab09ffb640 1 -- 172.21.15.118:0/881305725 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab040075a0 con 0x7fab0c102aa0 2024-09-21T11:58:21.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.556+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab0c1980e0 con 0x7fab0c102aa0 2024-09-21T11:58:21.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.557+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab0c06a410 con 0x7fab0c102aa0 2024-09-21T11:58:21.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.557+0000 7fab09ffb640 1 -- 172.21.15.118:0/881305725 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fab0401c070 con 0x7fab0c102aa0 2024-09-21T11:58:21.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.558+0000 7fab09ffb640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaf407af90 0x7faaf407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:21.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.558+0000 7fab09ffb640 1 -- 172.21.15.118:0/881305725 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fab0409d8b0 con 0x7fab0c102aa0 2024-09-21T11:58:21.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.558+0000 7fab0bfff640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaf407af90 0x7faaf407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:21.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.558+0000 7fab0bfff640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaf407af90 0x7faaf407d450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab000096c0 tx=0x7fab00000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:21.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.562+0000 7fab09ffb640 1 -- 172.21.15.118:0/881305725 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab04068e80 con 0x7fab0c102aa0 2024-09-21T11:58:21.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:21 smithi149 ceph-mon[79770]: pgmap v585: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:21.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.756+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fab0c198d90 con 0x7faaf407af90 2024-09-21T11:58:21.758 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:21 smithi118 ceph-mon[111738]: pgmap v585: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:21.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.757+0000 7fab09ffb640 1 -- 172.21.15.118:0/881305725 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fab0c198d90 con 0x7faaf407af90 2024-09-21T11:58:21.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.759+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaf407af90 msgr2=0x7faaf407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:21.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.759+0000 7fab12d56640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaf407af90 0x7faaf407d450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab000096c0 tx=0x7fab00000bc0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.759+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c102aa0 msgr2=0x7fab0c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:21.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.759+0000 7fab12d56640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c102aa0 0x7fab0c19d6a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fab0400ba50 tx=0x7fab0400bf10 comp rx=0 tx=0).stop 2024-09-21T11:58:21.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.759+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 shutdown_connections 2024-09-21T11:58:21.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.759+0000 7fab12d56640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0c1033c0 0x7fab0c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.759+0000 7fab12d56640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaf407af90 0x7faaf407d450 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.759+0000 7fab12d56640 1 --2- 172.21.15.118:0/881305725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab0c102aa0 0x7fab0c19d6a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.759+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 >> 172.21.15.118:0/881305725 conn(0x7fab0c0fc4c0 msgr2=0x7fab0c108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:21.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.760+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 shutdown_connections 2024-09-21T11:58:21.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.760+0000 7fab12d56640 1 -- 172.21.15.118:0/881305725 wait complete. 2024-09-21T11:58:21.770 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:58:21.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 -- 172.21.15.118:0/139772785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 msgr2=0x7efde8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:21.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 --2- 172.21.15.118:0/139772785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 0x7efde8101d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009880 tx=0x7efdd002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 -- 172.21.15.118:0/139772785 shutdown_connections 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 --2- 172.21.15.118:0/139772785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 0x7efde8101d90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 --2- 172.21.15.118:0/139772785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efde8107930 0x7efde8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 -- 172.21.15.118:0/139772785 >> 172.21.15.118:0/139772785 conn(0x7efde80fd630 msgr2=0x7efde80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 -- 172.21.15.118:0/139772785 shutdown_connections 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 -- 172.21.15.118:0/139772785 wait complete. 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 Processor -- start 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.842+0000 7efdecf0e640 1 -- start start 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efdecf0e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 0x7efde80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efdecf0e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efde8107930 0x7efde8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efdecf0e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efde810ee00 con 0x7efde8101930 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efdecf0e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efde810ec80 con 0x7efde8107930 2024-09-21T11:58:21.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efde659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 0x7efde80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efde659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 0x7efde80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36784/0 (socket says 172.21.15.118:36784) 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efde659c640 1 -- 172.21.15.118:0/1429252586 learned_addr learned my addr 172.21.15.118:0/1429252586 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efddffff640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efde8107930 0x7efde8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efde659c640 1 -- 172.21.15.118:0/1429252586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efde8107930 msgr2=0x7efde8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efde659c640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efde8107930 0x7efde8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efde659c640 1 -- 172.21.15.118:0/1429252586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde8074f70 con 0x7efde8101930 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.843+0000 7efde659c640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 0x7efde80744f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c8f0 tx=0x7efdd800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.844+0000 7efddf7fe640 1 -- 172.21.15.118:0/1429252586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdd80079b0 con 0x7efde8101930 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.844+0000 7efddf7fe640 1 -- 172.21.15.118:0/1429252586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efdd80054e0 con 0x7efde8101930 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.844+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde8075260 con 0x7efde8101930 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.844+0000 7efddf7fe640 1 -- 172.21.15.118:0/1429252586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdd8004dd0 con 0x7efde8101930 2024-09-21T11:58:21.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.844+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde81a3e90 con 0x7efde8101930 2024-09-21T11:58:21.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.845+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde8103070 con 0x7efde8101930 2024-09-21T11:58:21.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.845+0000 7efddf7fe640 1 -- 172.21.15.118:0/1429252586 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7efdd800f4a0 con 0x7efde8101930 2024-09-21T11:58:21.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.846+0000 7efddf7fe640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efdd407aed0 0x7efdd407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:21.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.846+0000 7efddf7fe640 1 -- 172.21.15.118:0/1429252586 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7efdd809e0b0 con 0x7efde8101930 2024-09-21T11:58:21.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.846+0000 7efddffff640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efdd407aed0 0x7efdd407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:21.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.846+0000 7efddffff640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efdd407aed0 0x7efdd407d390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efde8075f80 tx=0x7efdd0031420 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:21.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:21.854+0000 7efddf7fe640 1 -- 172.21.15.118:0/1429252586 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efdd8014030 con 0x7efde8101930 2024-09-21T11:58:22.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.046+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efde8062630 con 0x7efdd407aed0 2024-09-21T11:58:22.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.047+0000 7efddf7fe640 1 -- 172.21.15.118:0/1429252586 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7efde8062630 con 0x7efdd407aed0 2024-09-21T11:58:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.049+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efdd407aed0 msgr2=0x7efdd407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.049+0000 7efdecf0e640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efdd407aed0 0x7efdd407d390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efde8075f80 tx=0x7efdd0031420 comp rx=0 tx=0).stop 2024-09-21T11:58:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.049+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 msgr2=0x7efde80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.049+0000 7efdecf0e640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 0x7efde80744f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c8f0 tx=0x7efdd800cdb0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.049+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 shutdown_connections 2024-09-21T11:58:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.049+0000 7efdecf0e640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efde8107930 0x7efde8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.049+0000 7efdecf0e640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efdd407aed0 0x7efdd407d390 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.049+0000 7efdecf0e640 1 --2- 172.21.15.118:0/1429252586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde8101930 0x7efde80744f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.049+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 >> 172.21.15.118:0/1429252586 conn(0x7efde80fd630 msgr2=0x7efde80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:22.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.050+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 shutdown_connections 2024-09-21T11:58:22.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.050+0000 7efdecf0e640 1 -- 172.21.15.118:0/1429252586 wait complete. 2024-09-21T11:58:22.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 -- 172.21.15.118:0/328688695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784106820 msgr2=0x7ff784106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 --2- 172.21.15.118:0/328688695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784106820 0x7ff784106c00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff778009880 tx=0x7ff77802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 -- 172.21.15.118:0/328688695 shutdown_connections 2024-09-21T11:58:22.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 --2- 172.21.15.118:0/328688695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff784100820 0x7ff784100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 --2- 172.21.15.118:0/328688695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784106820 0x7ff784106c00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 -- 172.21.15.118:0/328688695 >> 172.21.15.118:0/328688695 conn(0x7ff7840fc520 msgr2=0x7ff7840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 -- 172.21.15.118:0/328688695 shutdown_connections 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 -- 172.21.15.118:0/328688695 wait complete. 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 Processor -- start 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.131+0000 7ff78b9fc640 1 -- start start 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff78b9fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784100820 0x7ff784198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff78b9fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff784106820 0x7ff784198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff78b9fc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff78410dd50 con 0x7ff784100820 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff78b9fc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff78410dbd0 con 0x7ff784106820 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff789798640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784100820 0x7ff784198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff789798640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784100820 0x7ff784198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36806/0 (socket says 172.21.15.118:36806) 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff789798640 1 -- 172.21.15.118:0/997443496 learned_addr learned my addr 172.21.15.118:0/997443496 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff789798640 1 -- 172.21.15.118:0/997443496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff784106820 msgr2=0x7ff784198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff789798640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff784106820 0x7ff784198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff789798640 1 -- 172.21.15.118:0/997443496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7841993a0 con 0x7ff784100820 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff789798640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784100820 0x7ff784198860 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff778031460 tx=0x7ff7780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff7767fc640 1 -- 172.21.15.118:0/997443496 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff77803f070 con 0x7ff784100820 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff784199630 con 0x7ff784100820 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff7767fc640 1 -- 172.21.15.118:0/997443496 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff778004cf0 con 0x7ff784100820 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff7767fc640 1 -- 172.21.15.118:0/997443496 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff778035030 con 0x7ff784100820 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.132+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7841a1be0 con 0x7ff784100820 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.133+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff784101f60 con 0x7ff784100820 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.134+0000 7ff7767fc640 1 -- 172.21.15.118:0/997443496 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff778042070 con 0x7ff784100820 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.135+0000 7ff7767fc640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff77007af80 0x7ff77007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.135+0000 7ff7767fc640 1 -- 172.21.15.118:0/997443496 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff7780bea90 con 0x7ff784100820 2024-09-21T11:58:22.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.135+0000 7ff788f97640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff77007af80 0x7ff77007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:22.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.135+0000 7ff788f97640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff77007af80 0x7ff77007d440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff78406ae50 tx=0x7ff780006c90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:22.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.139+0000 7ff7767fc640 1 -- 172.21.15.118:0/997443496 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff77808a060 con 0x7ff784100820 2024-09-21T11:58:22.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.323+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff784108e00 con 0x7ff77007af80 2024-09-21T11:58:22.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.333+0000 7ff7767fc640 1 -- 172.21.15.118:0/997443496 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff780013400 con 0x7ff77007af80 2024-09-21T11:58:22.334 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:58:22.334 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (16m) 10m ago 27m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:58:22.334 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (19m) 10m ago 27m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:58:22.334 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (18m) 10m ago 26m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:58:22.334 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (14m) 10m ago 27m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:58:22.334 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (14m) 10m ago 26m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (15m) 10m ago 27m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (10m) 10m ago 21m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (10m) 10m ago 21m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (21m) 10m ago 21m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (10m) 10m ago 21m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (18m) 10m ago 28m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (17m) 10m ago 26m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (14m) 10m ago 28m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (14m) 10m ago 26m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (17m) 10m ago 27m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (17m) 10m ago 26m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (14m) 10m ago 25m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (13m) 10m ago 24m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (12m) 10m ago 24m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:58:22.335 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (12m) 10m ago 23m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:58:22.336 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (11m) 10m ago 23m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:58:22.336 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (11m) 10m ago 22m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:58:22.336 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (16m) 10m ago 26m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:58:22.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff77007af80 msgr2=0x7ff77007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff77007af80 0x7ff77007d440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff78406ae50 tx=0x7ff780006c90 comp rx=0 tx=0).stop 2024-09-21T11:58:22.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784100820 msgr2=0x7ff784198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784100820 0x7ff784198860 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff778031460 tx=0x7ff7780048f0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 shutdown_connections 2024-09-21T11:58:22.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff784106820 0x7ff784198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff77007af80 0x7ff77007d440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 --2- 172.21.15.118:0/997443496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff784100820 0x7ff784198860 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 >> 172.21.15.118:0/997443496 conn(0x7ff7840fc520 msgr2=0x7ff7840fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:22.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 shutdown_connections 2024-09-21T11:58:22.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.335+0000 7ff78b9fc640 1 -- 172.21.15.118:0/997443496 wait complete. 2024-09-21T11:58:22.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.415+0000 7fe0271a1640 1 -- 172.21.15.118:0/2192565848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 msgr2=0x7fe020107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.415+0000 7fe0271a1640 1 --2- 172.21.15.118:0/2192565848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 0x7fe020107c20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe018009c20 tx=0x7fe01802a970 comp rx=0 tx=0).stop 2024-09-21T11:58:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.415+0000 7fe0271a1640 1 -- 172.21.15.118:0/2192565848 shutdown_connections 2024-09-21T11:58:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.415+0000 7fe0271a1640 1 --2- 172.21.15.118:0/2192565848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe020101730 0x7fe020101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.415+0000 7fe0271a1640 1 --2- 172.21.15.118:0/2192565848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 0x7fe020107c20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.415+0000 7fe0271a1640 1 -- 172.21.15.118:0/2192565848 >> 172.21.15.118:0/2192565848 conn(0x7fe0200fd430 msgr2=0x7fe0200ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.415+0000 7fe0271a1640 1 -- 172.21.15.118:0/2192565848 shutdown_connections 2024-09-21T11:58:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.415+0000 7fe0271a1640 1 -- 172.21.15.118:0/2192565848 wait complete. 2024-09-21T11:58:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.415+0000 7fe0271a1640 1 Processor -- start 2024-09-21T11:58:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe0271a1640 1 -- start start 2024-09-21T11:58:22.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe0271a1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe020101730 0x7fe0200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe0271a1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 0x7fe020074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe0271a1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe02010ed10 con 0x7fe020107840 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe0271a1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe02010eb90 con 0x7fe020101730 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe02599e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 0x7fe020074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe02599e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 0x7fe020074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36812/0 (socket says 172.21.15.118:36812) 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe02599e640 1 -- 172.21.15.118:0/3126334680 learned_addr learned my addr 172.21.15.118:0/3126334680 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe02619f640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe020101730 0x7fe0200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe02599e640 1 -- 172.21.15.118:0/3126334680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe020101730 msgr2=0x7fe0200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe02599e640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe020101730 0x7fe0200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe02599e640 1 -- 172.21.15.118:0/3126334680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe020074f70 con 0x7fe020107840 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe02599e640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 0x7fe020074a30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe01400d6f0 tx=0x7fe01400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe01f7fe640 1 -- 172.21.15.118:0/3126334680 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe014017070 con 0x7fe020107840 2024-09-21T11:58:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe01f7fe640 1 -- 172.21.15.118:0/3126334680 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe01400de00 con 0x7fe020107840 2024-09-21T11:58:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.416+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe020075260 con 0x7fe020107840 2024-09-21T11:58:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.417+0000 7fe01f7fe640 1 -- 172.21.15.118:0/3126334680 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe014004bb0 con 0x7fe020107840 2024-09-21T11:58:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.417+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0201a3da0 con 0x7fe020107840 2024-09-21T11:58:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.417+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe020101b90 con 0x7fe020107840 2024-09-21T11:58:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.418+0000 7fe01f7fe640 1 -- 172.21.15.118:0/3126334680 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe014004e60 con 0x7fe020107840 2024-09-21T11:58:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.419+0000 7fe01f7fe640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe00807af30 0x7fe00807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.419+0000 7fe01f7fe640 1 -- 172.21.15.118:0/3126334680 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fe01409dd00 con 0x7fe020107840 2024-09-21T11:58:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.419+0000 7fe02619f640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe00807af30 0x7fe00807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.419+0000 7fe02619f640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe00807af30 0x7fe00807d3f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe018006010 tx=0x7fe018009380 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:22.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.423+0000 7fe01f7fe640 1 -- 172.21.15.118:0/3126334680 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0140a1030 con 0x7fe020107840 2024-09-21T11:58:22.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.670+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe020109de0 con 0x7fe020107840 2024-09-21T11:58:22.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:22 smithi118 ceph-mon[111738]: from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:22.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.671+0000 7fe01f7fe640 1 -- 172.21.15.118:0/3126334680 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fe014069250 con 0x7fe020107840 2024-09-21T11:58:22.672 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:58:22.672 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:58:22.672 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:58:22.672 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:58:22.672 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:58:22.672 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:58:22.673 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:58:22.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe00807af30 msgr2=0x7fe00807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe00807af30 0x7fe00807d3f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe018006010 tx=0x7fe018009380 comp rx=0 tx=0).stop 2024-09-21T11:58:22.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 msgr2=0x7fe020074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 0x7fe020074a30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe01400d6f0 tx=0x7fe01400dbb0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 shutdown_connections 2024-09-21T11:58:22.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe00807af30 0x7fe00807d3f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe020107840 0x7fe020074a30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 --2- 172.21.15.118:0/3126334680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe020101730 0x7fe0200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 >> 172.21.15.118:0/3126334680 conn(0x7fe0200fd430 msgr2=0x7fe0200fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:22.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 shutdown_connections 2024-09-21T11:58:22.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.673+0000 7fe0271a1640 1 -- 172.21.15.118:0/3126334680 wait complete. 2024-09-21T11:58:22.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:22 smithi149 ceph-mon[79770]: from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:22.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.754+0000 7ff0b82cc640 1 -- 172.21.15.118:0/2004811311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 msgr2=0x7ff0b0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.754+0000 7ff0b82cc640 1 --2- 172.21.15.118:0/2004811311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 0x7ff0b0106c00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009880 tx=0x7ff0ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.754+0000 7ff0b82cc640 1 -- 172.21.15.118:0/2004811311 shutdown_connections 2024-09-21T11:58:22.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.754+0000 7ff0b82cc640 1 --2- 172.21.15.118:0/2004811311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b0100820 0x7ff0b0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.754+0000 7ff0b82cc640 1 --2- 172.21.15.118:0/2004811311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 0x7ff0b0106c00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.754+0000 7ff0b82cc640 1 -- 172.21.15.118:0/2004811311 >> 172.21.15.118:0/2004811311 conn(0x7ff0b00fc520 msgr2=0x7ff0b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:22.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.754+0000 7ff0b82cc640 1 -- 172.21.15.118:0/2004811311 shutdown_connections 2024-09-21T11:58:22.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.754+0000 7ff0b82cc640 1 -- 172.21.15.118:0/2004811311 wait complete. 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.755+0000 7ff0b82cc640 1 Processor -- start 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.755+0000 7ff0b82cc640 1 -- start start 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.755+0000 7ff0b82cc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b0100820 0x7ff0b0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.755+0000 7ff0b82cc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 0x7ff0b0198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.755+0000 7ff0b82cc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b010dcf0 con 0x7ff0b0106820 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.755+0000 7ff0b82cc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b010db70 con 0x7ff0b0100820 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.755+0000 7ff0b5867640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 0x7ff0b0198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.755+0000 7ff0b5867640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 0x7ff0b0198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36838/0 (socket says 172.21.15.118:36838) 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.755+0000 7ff0b5867640 1 -- 172.21.15.118:0/642451317 learned_addr learned my addr 172.21.15.118:0/642451317 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0b6068640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b0100820 0x7ff0b0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:22.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0b5867640 1 -- 172.21.15.118:0/642451317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b0100820 msgr2=0x7ff0b0198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0b5867640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b0100820 0x7ff0b0198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0b5867640 1 -- 172.21.15.118:0/642451317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b0199380 con 0x7ff0b0106820 2024-09-21T11:58:22.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0b5867640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 0x7ff0b0198d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000d6f0 tx=0x7ff0a000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:22.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0a77fe640 1 -- 172.21.15.118:0/642451317 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0a0017070 con 0x7ff0b0106820 2024-09-21T11:58:22.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0a77fe640 1 -- 172.21.15.118:0/642451317 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0a000de00 con 0x7ff0b0106820 2024-09-21T11:58:22.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b0199670 con 0x7ff0b0106820 2024-09-21T11:58:22.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0a77fe640 1 -- 172.21.15.118:0/642451317 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0a0004bb0 con 0x7ff0b0106820 2024-09-21T11:58:22.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.756+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b01a1c70 con 0x7ff0b0106820 2024-09-21T11:58:22.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.757+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b0101f60 con 0x7ff0b0106820 2024-09-21T11:58:22.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.758+0000 7ff0a77fe640 1 -- 172.21.15.118:0/642451317 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff0a0004e60 con 0x7ff0b0106820 2024-09-21T11:58:22.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.758+0000 7ff0a77fe640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af30 0x7ff09c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:22.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.758+0000 7ff0b6068640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af30 0x7ff09c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:22.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.758+0000 7ff0a77fe640 1 -- 172.21.15.118:0/642451317 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff0a009dc40 con 0x7ff0b0106820 2024-09-21T11:58:22.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.759+0000 7ff0b6068640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af30 0x7ff09c07d3f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0096c0 tx=0x7ff0ac031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:22.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.763+0000 7ff0a77fe640 1 -- 172.21.15.118:0/642451317 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0b0199670 con 0x7ff0b0106820 2024-09-21T11:58:22.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.978+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff0b006a8f0 con 0x7ff0b0106820 2024-09-21T11:58:22.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.979+0000 7ff0a77fe640 1 -- 172.21.15.118:0/642451317 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7ff0a0069190 con 0x7ff0b0106820 2024-09-21T11:58:22.980 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:58:22.980 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:58:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:58:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:58:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:58:22.984 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:58:22.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.981+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af30 msgr2=0x7ff09c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.981+0000 7ff0b82cc640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af30 0x7ff09c07d3f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0096c0 tx=0x7ff0ac031400 comp rx=0 tx=0).stop 2024-09-21T11:58:22.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.981+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 msgr2=0x7ff0b0198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:22.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.981+0000 7ff0b82cc640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 0x7ff0b0198d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000d6f0 tx=0x7ff0a000dbb0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.981+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 shutdown_connections 2024-09-21T11:58:22.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.981+0000 7ff0b82cc640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09c07af30 0x7ff09c07d3f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.981+0000 7ff0b82cc640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0b0106820 0x7ff0b0198d80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.981+0000 7ff0b82cc640 1 --2- 172.21.15.118:0/642451317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0b0100820 0x7ff0b0198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:22.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.982+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 >> 172.21.15.118:0/642451317 conn(0x7ff0b00fc520 msgr2=0x7ff0b00fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:22.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.982+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 shutdown_connections 2024-09-21T11:58:22.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:22.982+0000 7ff0b82cc640 1 -- 172.21.15.118:0/642451317 wait complete. 2024-09-21T11:58:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.064+0000 7feadfd31640 1 -- 172.21.15.118:0/1985642198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81011f0 msgr2=0x7fead81056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.064+0000 7feadfd31640 1 --2- 172.21.15.118:0/1985642198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81011f0 0x7fead81056c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fead4009880 tx=0x7fead402a530 comp rx=0 tx=0).stop 2024-09-21T11:58:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.064+0000 7feadfd31640 1 -- 172.21.15.118:0/1985642198 shutdown_connections 2024-09-21T11:58:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.064+0000 7feadfd31640 1 --2- 172.21.15.118:0/1985642198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81011f0 0x7fead81056c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.064+0000 7feadfd31640 1 --2- 172.21.15.118:0/1985642198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fead81008d0 0x7fead8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.064+0000 7feadfd31640 1 -- 172.21.15.118:0/1985642198 >> 172.21.15.118:0/1985642198 conn(0x7fead80fc520 msgr2=0x7fead80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.064+0000 7feadfd31640 1 -- 172.21.15.118:0/1985642198 shutdown_connections 2024-09-21T11:58:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.064+0000 7feadfd31640 1 -- 172.21.15.118:0/1985642198 wait complete. 2024-09-21T11:58:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feadfd31640 1 Processor -- start 2024-09-21T11:58:23.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feadfd31640 1 -- start start 2024-09-21T11:58:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feadfd31640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81008d0 0x7fead819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feadfd31640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fead81011f0 0x7fead819e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feadfd31640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fead81153f0 con 0x7fead81008d0 2024-09-21T11:58:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feadfd31640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fead8115270 con 0x7fead81011f0 2024-09-21T11:58:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feaddacd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81008d0 0x7fead819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feaddacd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81008d0 0x7fead819dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36858/0 (socket says 172.21.15.118:36858) 2024-09-21T11:58:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feaddacd640 1 -- 172.21.15.118:0/2208125670 learned_addr learned my addr 172.21.15.118:0/2208125670 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.065+0000 7feadd2cc640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fead81011f0 0x7fead819e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feaddacd640 1 -- 172.21.15.118:0/2208125670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fead81011f0 msgr2=0x7fead819e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feaddacd640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fead81011f0 0x7fead819e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feaddacd640 1 -- 172.21.15.118:0/2208125670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead819ebe0 con 0x7fead81008d0 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feadd2cc640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fead81011f0 0x7fead819e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feaddacd640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81008d0 0x7fead819dff0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7feac800c8a0 tx=0x7feac800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feaceffd640 1 -- 172.21.15.118:0/2208125670 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feac80079b0 con 0x7fead81008d0 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead81a2980 con 0x7fead81008d0 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feaceffd640 1 -- 172.21.15.118:0/2208125670 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feac8007b50 con 0x7fead81008d0 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feaceffd640 1 -- 172.21.15.118:0/2208125670 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feac8018700 con 0x7fead81008d0 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.066+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead81a2f10 con 0x7fead81008d0 2024-09-21T11:58:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.067+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead806abe0 con 0x7fead81008d0 2024-09-21T11:58:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.068+0000 7feaceffd640 1 -- 172.21.15.118:0/2208125670 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7feac8007d00 con 0x7fead81008d0 2024-09-21T11:58:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.068+0000 7feaceffd640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feac407af30 0x7feac407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.068+0000 7feaceffd640 1 -- 172.21.15.118:0/2208125670 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7feac809e3c0 con 0x7fead81008d0 2024-09-21T11:58:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.068+0000 7feadd2cc640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feac407af30 0x7feac407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.069+0000 7feadd2cc640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feac407af30 0x7feac407d3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fead8112510 tx=0x7fead4009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:23.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.072+0000 7feaceffd640 1 -- 172.21.15.118:0/2208125670 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feac8014030 con 0x7fead81008d0 2024-09-21T11:58:23.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.267+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fead81a3220 con 0x7feac407af30 2024-09-21T11:58:23.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.268+0000 7feaceffd640 1 -- 172.21.15.118:0/2208125670 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fead81a3220 con 0x7feac407af30 2024-09-21T11:58:23.269 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:58:23.269 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:58:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:58:23.271 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:58:23.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feac407af30 msgr2=0x7feac407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:23.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feac407af30 0x7feac407d3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fead8112510 tx=0x7fead4009560 comp rx=0 tx=0).stop 2024-09-21T11:58:23.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81008d0 msgr2=0x7fead819dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:23.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81008d0 0x7fead819dff0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7feac800c8a0 tx=0x7feac800cd60 comp rx=0 tx=0).stop 2024-09-21T11:58:23.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 shutdown_connections 2024-09-21T11:58:23.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fead81011f0 0x7fead819e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feac407af30 0x7feac407d3f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 --2- 172.21.15.118:0/2208125670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead81008d0 0x7fead819dff0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 >> 172.21.15.118:0/2208125670 conn(0x7fead80fc520 msgr2=0x7fead8112c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:23.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 shutdown_connections 2024-09-21T11:58:23.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.270+0000 7feadfd31640 1 -- 172.21.15.118:0/2208125670 wait complete. 2024-09-21T11:58:23.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.353+0000 7fb5806ca640 1 -- 172.21.15.118:0/2388304106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 msgr2=0x7fb578106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:23.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.353+0000 7fb5806ca640 1 --2- 172.21.15.118:0/2388304106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 0x7fb578106c00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb574009880 tx=0x7fb57402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.353+0000 7fb5806ca640 1 -- 172.21.15.118:0/2388304106 shutdown_connections 2024-09-21T11:58:23.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.353+0000 7fb5806ca640 1 --2- 172.21.15.118:0/2388304106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578100820 0x7fb578100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.353+0000 7fb5806ca640 1 --2- 172.21.15.118:0/2388304106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 0x7fb578106c00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.353+0000 7fb5806ca640 1 -- 172.21.15.118:0/2388304106 >> 172.21.15.118:0/2388304106 conn(0x7fb5780fc520 msgr2=0x7fb5780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.353+0000 7fb5806ca640 1 -- 172.21.15.118:0/2388304106 shutdown_connections 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb5806ca640 1 -- 172.21.15.118:0/2388304106 wait complete. 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb5806ca640 1 Processor -- start 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb5806ca640 1 -- start start 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb5806ca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578100820 0x7fb578198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb5806ca640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 0x7fb578198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb5806ca640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810dcf0 con 0x7fb578106820 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb5806ca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810db70 con 0x7fb578100820 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb57dc65640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 0x7fb578198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:23.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb57dc65640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 0x7fb578198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36886/0 (socket says 172.21.15.118:36886) 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.354+0000 7fb57dc65640 1 -- 172.21.15.118:0/4204338268 learned_addr learned my addr 172.21.15.118:0/4204338268 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb57e466640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578100820 0x7fb578198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb57dc65640 1 -- 172.21.15.118:0/4204338268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578100820 msgr2=0x7fb578198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb57dc65640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578100820 0x7fb578198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb57dc65640 1 -- 172.21.15.118:0/4204338268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb578199390 con 0x7fb578106820 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb57dc65640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 0x7fb578198d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb56800d6f0 tx=0x7fb56800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb56f7fe640 1 -- 172.21.15.118:0/4204338268 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb568017070 con 0x7fb578106820 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb56f7fe640 1 -- 172.21.15.118:0/4204338268 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb56800de00 con 0x7fb578106820 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5781a1870 con 0x7fb578106820 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb56f7fe640 1 -- 172.21.15.118:0/4204338268 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb568004bb0 con 0x7fb578106820 2024-09-21T11:58:23.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.355+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781a1c70 con 0x7fb578106820 2024-09-21T11:58:23.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.356+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb578101f60 con 0x7fb578106820 2024-09-21T11:58:23.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.357+0000 7fb56f7fe640 1 -- 172.21.15.118:0/4204338268 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb568004e60 con 0x7fb578106820 2024-09-21T11:58:23.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.357+0000 7fb56f7fe640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:23.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.357+0000 7fb56f7fe640 1 -- 172.21.15.118:0/4204338268 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb56809dcf0 con 0x7fb578106820 2024-09-21T11:58:23.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.357+0000 7fb57e466640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:23.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.358+0000 7fb57e466640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb5740096c0 tx=0x7fb574031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:23.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.362+0000 7fb56f7fe640 1 -- 172.21.15.118:0/4204338268 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5680691a0 con 0x7fb578106820 2024-09-21T11:58:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:23 smithi118 ceph-mon[111738]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:23 smithi118 ceph-mon[111738]: from='client.34900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:23 smithi118 ceph-mon[111738]: pgmap v586: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:23 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3126334680' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:58:23.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:23 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/642451317' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:58:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.609+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb578108d90 con 0x7fb578106820 2024-09-21T11:58:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.609+0000 7fb56f7fe640 1 -- 172.21.15.118:0/4204338268 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fb56806e050 con 0x7fb578106820 2024-09-21T11:58:23.610 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:58:23.610 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:58:23.611 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:58:23.611 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:58:23.611 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:58:23.611 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:58:23.611 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 msgr2=0x7fb56407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb5740096c0 tx=0x7fb574031400 comp rx=0 tx=0).stop 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 msgr2=0x7fb578198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 0x7fb578198d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb56800d6f0 tx=0x7fb56800dbb0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 shutdown_connections 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578106820 0x7fb578198d40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 --2- 172.21.15.118:0/4204338268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578100820 0x7fb578198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 >> 172.21.15.118:0/4204338268 conn(0x7fb5780fc520 msgr2=0x7fb5780fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 shutdown_connections 2024-09-21T11:58:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:23.611+0000 7fb5806ca640 1 -- 172.21.15.118:0/4204338268 wait complete. 2024-09-21T11:58:23.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:23 smithi149 ceph-mon[79770]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:23.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:23 smithi149 ceph-mon[79770]: from='client.34900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:23.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:23 smithi149 ceph-mon[79770]: pgmap v586: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:23.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:23 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3126334680' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:58:23.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:23 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/642451317' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:58:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:24 smithi149 ceph-mon[79770]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:24 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/4204338268' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:58:24.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:24 smithi118 ceph-mon[111738]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:24.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:24 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/4204338268' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:58:25.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:25 smithi149 ceph-mon[79770]: pgmap v587: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:25 smithi118 ceph-mon[111738]: pgmap v587: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:27 smithi118 ceph-mon[111738]: pgmap v588: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:27 smithi149 ceph-mon[79770]: pgmap v588: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:29 smithi118 ceph-mon[111738]: pgmap v589: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:29.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:29 smithi149 ceph-mon[79770]: pgmap v589: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:31 smithi118 ceph-mon[111738]: pgmap v590: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:31.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:31 smithi149 ceph-mon[79770]: pgmap v590: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:33 smithi118 ceph-mon[111738]: pgmap v591: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:33.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:33 smithi149 ceph-mon[79770]: pgmap v591: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:35 smithi118 ceph-mon[111738]: pgmap v592: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:58:35.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:35 smithi149 ceph-mon[79770]: pgmap v592: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:58:37.799 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:37 smithi149 ceph-mon[79770]: pgmap v593: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:37 smithi118 ceph-mon[111738]: pgmap v593: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:39 smithi118 ceph-mon[111738]: pgmap v594: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:39.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:39 smithi149 ceph-mon[79770]: pgmap v594: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:41.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:41 smithi118 ceph-mon[111738]: pgmap v595: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:41 smithi149 ceph-mon[79770]: pgmap v595: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:43 smithi118 ceph-mon[111738]: pgmap v596: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:43.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:43 smithi149 ceph-mon[79770]: pgmap v596: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:45 smithi118 ceph-mon[111738]: pgmap v597: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:45.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:45 smithi149 ceph-mon[79770]: pgmap v597: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:47.752 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:47 smithi149 ceph-mon[79770]: pgmap v598: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:47 smithi118 ceph-mon[111738]: pgmap v598: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:49 smithi118 ceph-mon[111738]: pgmap v599: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:49.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:49 smithi149 ceph-mon[79770]: pgmap v599: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:58:50.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:58:51.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:51 smithi118 ceph-mon[111738]: pgmap v600: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:51.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:51 smithi149 ceph-mon[79770]: pgmap v600: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.704+0000 7f6efa299640 1 -- 172.21.15.118:0/891208482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 msgr2=0x7f6ef4107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.704+0000 7f6efa299640 1 --2- 172.21.15.118:0/891208482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 0x7f6ef4107d00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009880 tx=0x7f6ee402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.704+0000 7f6efa299640 1 -- 172.21.15.118:0/891208482 shutdown_connections 2024-09-21T11:58:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.704+0000 7f6efa299640 1 --2- 172.21.15.118:0/891208482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef4101920 0x7f6ef4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.704+0000 7f6efa299640 1 --2- 172.21.15.118:0/891208482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 0x7f6ef4107d00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.704+0000 7f6efa299640 1 -- 172.21.15.118:0/891208482 >> 172.21.15.118:0/891208482 conn(0x7f6ef40fd620 msgr2=0x7f6ef40ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.704+0000 7f6efa299640 1 -- 172.21.15.118:0/891208482 shutdown_connections 2024-09-21T11:58:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.704+0000 7f6efa299640 1 -- 172.21.15.118:0/891208482 wait complete. 2024-09-21T11:58:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6efa299640 1 Processor -- start 2024-09-21T11:58:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6efa299640 1 -- start start 2024-09-21T11:58:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6efa299640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef4101920 0x7f6ef419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6efa299640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 0x7f6ef419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6efa299640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef410ee50 con 0x7f6ef4107920 2024-09-21T11:58:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6efa299640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef410ecd0 con 0x7f6ef4101920 2024-09-21T11:58:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6ef37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 0x7f6ef419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6ef37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 0x7f6ef419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32984/0 (socket says 172.21.15.118:32984) 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6ef37fe640 1 -- 172.21.15.118:0/817473380 learned_addr learned my addr 172.21.15.118:0/817473380 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.705+0000 7f6ef3fff640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef4101920 0x7f6ef419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6ef37fe640 1 -- 172.21.15.118:0/817473380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef4101920 msgr2=0x7f6ef419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6ef37fe640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef4101920 0x7f6ef419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6ef37fe640 1 -- 172.21.15.118:0/817473380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef4197820 con 0x7f6ef4107920 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6ef3fff640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef4101920 0x7f6ef419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6ef37fe640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 0x7f6ef419dbe0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00b420 tx=0x7f6edc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6ef17fa640 1 -- 172.21.15.118:0/817473380 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6edc011630 con 0x7f6ef4107920 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef4197b10 con 0x7f6ef4107920 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6ef17fa640 1 -- 172.21.15.118:0/817473380 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6edc016070 con 0x7f6ef4107920 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6ef17fa640 1 -- 172.21.15.118:0/817473380 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6edc010d40 con 0x7f6ef4107920 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.706+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef41980a0 con 0x7f6ef4107920 2024-09-21T11:58:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.707+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef4103060 con 0x7f6ef4107920 2024-09-21T11:58:53.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.708+0000 7f6ef17fa640 1 -- 172.21.15.118:0/817473380 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6edc01b460 con 0x7f6ef4107920 2024-09-21T11:58:53.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.709+0000 7f6ef17fa640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ee007af30 0x7f6ee007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:53.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.709+0000 7f6ef3fff640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ee007af30 0x7f6ee007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:53.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.709+0000 7f6ef17fa640 1 -- 172.21.15.118:0/817473380 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f6edc09d7f0 con 0x7f6ef4107920 2024-09-21T11:58:53.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.709+0000 7f6ef3fff640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ee007af30 0x7f6ee007d3f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4000c00 tx=0x7f6ee4031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:53.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.713+0000 7f6ef17fa640 1 -- 172.21.15.118:0/817473380 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6edc021250 con 0x7f6ef4107920 2024-09-21T11:58:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:53 smithi118 ceph-mon[111738]: pgmap v601: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:53.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.906+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6ef41983b0 con 0x7f6ee007af30 2024-09-21T11:58:53.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.907+0000 7f6ef17fa640 1 -- 172.21.15.118:0/817473380 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6ef41983b0 con 0x7f6ee007af30 2024-09-21T11:58:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ee007af30 msgr2=0x7f6ee007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ee007af30 0x7f6ee007d3f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4000c00 tx=0x7f6ee4031400 comp rx=0 tx=0).stop 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 msgr2=0x7f6ef419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 0x7f6ef419dbe0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00b420 tx=0x7f6edc00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 shutdown_connections 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ee007af30 0x7f6ee007d3f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef4107920 0x7f6ef419dbe0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 --2- 172.21.15.118:0/817473380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef4101920 0x7f6ef419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 >> 172.21.15.118:0/817473380 conn(0x7f6ef40fd620 msgr2=0x7f6ef40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 shutdown_connections 2024-09-21T11:58:53.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.909+0000 7f6efa299640 1 -- 172.21.15.118:0/817473380 wait complete. 2024-09-21T11:58:53.921 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:58:53.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:53 smithi149 ceph-mon[79770]: pgmap v601: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:53.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.992+0000 7f58b9cb1640 1 -- 172.21.15.118:0/2220015256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 msgr2=0x7f58b4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:53.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.992+0000 7f58b9cb1640 1 --2- 172.21.15.118:0/2220015256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 0x7f58b4101d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f589c009880 tx=0x7f589c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.992+0000 7f58b9cb1640 1 -- 172.21.15.118:0/2220015256 shutdown_connections 2024-09-21T11:58:53.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.992+0000 7f58b9cb1640 1 --2- 172.21.15.118:0/2220015256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 0x7f58b4101d90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.992+0000 7f58b9cb1640 1 --2- 172.21.15.118:0/2220015256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b4107930 0x7f58b4107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.992+0000 7f58b9cb1640 1 -- 172.21.15.118:0/2220015256 >> 172.21.15.118:0/2220015256 conn(0x7f58b40fd630 msgr2=0x7f58b40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:53.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.992+0000 7f58b9cb1640 1 -- 172.21.15.118:0/2220015256 shutdown_connections 2024-09-21T11:58:53.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.992+0000 7f58b9cb1640 1 -- 172.21.15.118:0/2220015256 wait complete. 2024-09-21T11:58:53.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b9cb1640 1 Processor -- start 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b9cb1640 1 -- start start 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b9cb1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 0x7f58b419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b9cb1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b4107930 0x7f58b419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b9cb1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f58b410ee60 con 0x7f58b4101930 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b9cb1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58b410ece0 con 0x7f58b4107930 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 0x7f58b419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 0x7f58b419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32990/0 (socket says 172.21.15.118:32990) 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b37fe640 1 -- 172.21.15.118:0/1903647956 learned_addr learned my addr 172.21.15.118:0/1903647956 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58abfff640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b4107930 0x7f58b419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b37fe640 1 -- 172.21.15.118:0/1903647956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b4107930 msgr2=0x7f58b419dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b37fe640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b4107930 0x7f58b419dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b37fe640 1 -- 172.21.15.118:0/1903647956 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b4197870 con 0x7f58b4101930 2024-09-21T11:58:53.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58abfff640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b4107930 0x7f58b419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:58:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.993+0000 7f58b37fe640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 0x7f58b419d6b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f58a400b420 tx=0x7f58a400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.994+0000 7f58b17fa640 1 -- 172.21.15.118:0/1903647956 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58a4011630 con 0x7f58b4101930 2024-09-21T11:58:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.994+0000 7f58b17fa640 1 -- 172.21.15.118:0/1903647956 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58a4016070 con 0x7f58b4101930 2024-09-21T11:58:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.994+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b4197b60 con 0x7f58b4101930 2024-09-21T11:58:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.994+0000 7f58b17fa640 1 -- 172.21.15.118:0/1903647956 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58a4010d40 con 0x7f58b4101930 2024-09-21T11:58:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.994+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b41980f0 con 0x7f58b4101930 2024-09-21T11:58:53.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.995+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b4103070 con 0x7f58b4101930 2024-09-21T11:58:53.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.995+0000 7f58b17fa640 1 -- 172.21.15.118:0/1903647956 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f58a401b460 con 0x7f58b4101930 2024-09-21T11:58:53.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.996+0000 7f58b17fa640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f58a007af30 0x7f58a007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:53.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.996+0000 7f58b17fa640 1 -- 172.21.15.118:0/1903647956 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f58a409d890 con 0x7f58b4101930 2024-09-21T11:58:53.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.996+0000 7f58abfff640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f58a007af30 0x7f58a007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:53.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:53.996+0000 7f58abfff640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f58a007af30 0x7f58a007d3f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f589c031460 tx=0x7f589c0095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:54.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.000+0000 7f58b17fa640 1 -- 172.21.15.118:0/1903647956 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58a4021250 con 0x7f58b4101930 2024-09-21T11:58:54.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.192+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f58b4198da0 con 0x7f58a007af30 2024-09-21T11:58:54.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.194+0000 7f58b17fa640 1 -- 172.21.15.118:0/1903647956 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f58b4198da0 con 0x7f58a007af30 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f58a007af30 msgr2=0x7f58a007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f58a007af30 0x7f58a007d3f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f589c031460 tx=0x7f589c0095f0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 msgr2=0x7f58b419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 0x7f58b419d6b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f58a400b420 tx=0x7f58a400b8e0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 shutdown_connections 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b4107930 0x7f58b419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f58a007af30 0x7f58a007d3f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 --2- 172.21.15.118:0/1903647956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b4101930 0x7f58b419d6b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 >> 172.21.15.118:0/1903647956 conn(0x7f58b40fd630 msgr2=0x7f58b40fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.196+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 shutdown_connections 2024-09-21T11:58:54.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.197+0000 7f58b9cb1640 1 -- 172.21.15.118:0/1903647956 wait complete. 2024-09-21T11:58:54.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.278+0000 7f21b4589640 1 -- 172.21.15.118:0/2383871119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 msgr2=0x7f21ac106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.278+0000 7f21b4589640 1 --2- 172.21.15.118:0/2383871119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 0x7f21ac106c00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009880 tx=0x7f21a802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.278+0000 7f21b4589640 1 -- 172.21.15.118:0/2383871119 shutdown_connections 2024-09-21T11:58:54.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.278+0000 7f21b4589640 1 --2- 172.21.15.118:0/2383871119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21ac100820 0x7f21ac100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.278+0000 7f21b4589640 1 --2- 172.21.15.118:0/2383871119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 0x7f21ac106c00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.278+0000 7f21b4589640 1 -- 172.21.15.118:0/2383871119 >> 172.21.15.118:0/2383871119 conn(0x7f21ac0fc520 msgr2=0x7f21ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:54.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.278+0000 7f21b4589640 1 -- 172.21.15.118:0/2383871119 shutdown_connections 2024-09-21T11:58:54.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.278+0000 7f21b4589640 1 -- 172.21.15.118:0/2383871119 wait complete. 2024-09-21T11:58:54.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b4589640 1 Processor -- start 2024-09-21T11:58:54.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b4589640 1 -- start start 2024-09-21T11:58:54.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b4589640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21ac100820 0x7f21ac0fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:54.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b4589640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 0x7f21ac0fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:54.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b4589640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac10dd50 con 0x7f21ac106820 2024-09-21T11:58:54.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b4589640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac10dbd0 con 0x7f21ac100820 2024-09-21T11:58:54.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b1b24640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 0x7f21ac0fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b1b24640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 0x7f21ac0fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33002/0 (socket says 172.21.15.118:33002) 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b1b24640 1 -- 172.21.15.118:0/928182701 learned_addr learned my addr 172.21.15.118:0/928182701 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b2325640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21ac100820 0x7f21ac0fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b1b24640 1 -- 172.21.15.118:0/928182701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21ac100820 msgr2=0x7f21ac0fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.279+0000 7f21b1b24640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21ac100820 0x7f21ac0fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.280+0000 7f21b1b24640 1 -- 172.21.15.118:0/928182701 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac0fd6c0 con 0x7f21ac106820 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.280+0000 7f21b1b24640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 0x7f21ac0fd180 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f219c00b420 tx=0x7f219c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.280+0000 7f21a37fe640 1 -- 172.21.15.118:0/928182701 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f219c011630 con 0x7f21ac106820 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.280+0000 7f21a37fe640 1 -- 172.21.15.118:0/928182701 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f219c016070 con 0x7f21ac106820 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.280+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ac0fd9b0 con 0x7f21ac106820 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.280+0000 7f21a37fe640 1 -- 172.21.15.118:0/928182701 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f219c010d40 con 0x7f21ac106820 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.280+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ac1a3ec0 con 0x7f21ac106820 2024-09-21T11:58:54.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.281+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ac101f60 con 0x7f21ac106820 2024-09-21T11:58:54.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.282+0000 7f21a37fe640 1 -- 172.21.15.118:0/928182701 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f219c01b460 con 0x7f21ac106820 2024-09-21T11:58:54.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.282+0000 7f21a37fe640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f219807af80 0x7f219807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:54.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.282+0000 7f21b2325640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f219807af80 0x7f219807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:54.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.282+0000 7f21a37fe640 1 -- 172.21.15.118:0/928182701 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f219c09d7a0 con 0x7f21ac106820 2024-09-21T11:58:54.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.283+0000 7f21b2325640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f219807af80 0x7f219807d440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f21a80096c0 tx=0x7f21a8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:54.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.287+0000 7f21a37fe640 1 -- 172.21.15.118:0/928182701 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f219c021250 con 0x7f21ac106820 2024-09-21T11:58:54.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.471+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f21ac062630 con 0x7f219807af80 2024-09-21T11:58:54.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.481+0000 7f21a37fe640 1 -- 172.21.15.118:0/928182701 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f21ac062630 con 0x7f219807af80 2024-09-21T11:58:54.483 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:58:54.483 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (16m) 10m ago 27m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:58:54.483 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (19m) 10m ago 27m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:58:54.483 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (19m) 10m ago 27m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (14m) 10m ago 27m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (14m) 10m ago 27m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (16m) 10m ago 27m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (11m) 10m ago 22m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (11m) 10m ago 22m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (22m) 10m ago 22m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (10m) 10m ago 22m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (19m) 10m ago 29m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (18m) 10m ago 26m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (15m) 10m ago 29m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (15m) 10m ago 26m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (17m) 10m ago 27m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:58:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (17m) 10m ago 26m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:58:54.485 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (14m) 10m ago 25m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:58:54.485 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (13m) 10m ago 25m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:58:54.485 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (13m) 10m ago 24m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:58:54.485 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (12m) 10m ago 24m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:58:54.485 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (12m) 10m ago 23m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:58:54.485 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (11m) 10m ago 23m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:58:54.485 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (17m) 10m ago 27m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:58:54.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f219807af80 msgr2=0x7f219807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f219807af80 0x7f219807d440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f21a80096c0 tx=0x7f21a8031400 comp rx=0 tx=0).stop 2024-09-21T11:58:54.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 msgr2=0x7f21ac0fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 0x7f21ac0fd180 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f219c00b420 tx=0x7f219c00b8e0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 shutdown_connections 2024-09-21T11:58:54.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f219807af80 0x7f219807d440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21ac106820 0x7f21ac0fd180 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 --2- 172.21.15.118:0/928182701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21ac100820 0x7f21ac0fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 >> 172.21.15.118:0/928182701 conn(0x7f21ac0fc520 msgr2=0x7f21ac06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:54.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 shutdown_connections 2024-09-21T11:58:54.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.484+0000 7f21b4589640 1 -- 172.21.15.118:0/928182701 wait complete. 2024-09-21T11:58:54.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.564+0000 7ff642370640 1 -- 172.21.15.118:0/4028489729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c101930 msgr2=0x7ff63c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.564+0000 7ff642370640 1 --2- 172.21.15.118:0/4028489729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c101930 0x7ff63c101d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff630009880 tx=0x7ff63002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.564+0000 7ff642370640 1 -- 172.21.15.118:0/4028489729 shutdown_connections 2024-09-21T11:58:54.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.564+0000 7ff642370640 1 --2- 172.21.15.118:0/4028489729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c101930 0x7ff63c101d90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.564+0000 7ff642370640 1 --2- 172.21.15.118:0/4028489729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c107930 0x7ff63c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.564+0000 7ff642370640 1 -- 172.21.15.118:0/4028489729 >> 172.21.15.118:0/4028489729 conn(0x7ff63c0fd630 msgr2=0x7ff63c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:54.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.564+0000 7ff642370640 1 -- 172.21.15.118:0/4028489729 shutdown_connections 2024-09-21T11:58:54.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.564+0000 7ff642370640 1 -- 172.21.15.118:0/4028489729 wait complete. 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff642370640 1 Processor -- start 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff642370640 1 -- start start 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff642370640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c101930 0x7ff63c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff642370640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c107930 0x7ff63c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff642370640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c10ee00 con 0x7ff63c107930 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff642370640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c10ec80 con 0x7ff63c101930 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff63b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c107930 0x7ff63c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff63b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c107930 0x7ff63c19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33026/0 (socket says 172.21.15.118:33026) 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff63b7fe640 1 -- 172.21.15.118:0/1182709310 learned_addr learned my addr 172.21.15.118:0/1182709310 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.565+0000 7ff63bfff640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c101930 0x7ff63c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.566+0000 7ff63b7fe640 1 -- 172.21.15.118:0/1182709310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c101930 msgr2=0x7ff63c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.566+0000 7ff63b7fe640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c101930 0x7ff63c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.566+0000 7ff63b7fe640 1 -- 172.21.15.118:0/1182709310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c197810 con 0x7ff63c107930 2024-09-21T11:58:54.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.566+0000 7ff63b7fe640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c107930 0x7ff63c19dbd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff630031460 tx=0x7ff6300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:54.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.566+0000 7ff6397fa640 1 -- 172.21.15.118:0/1182709310 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff63003f070 con 0x7ff63c107930 2024-09-21T11:58:54.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.566+0000 7ff6397fa640 1 -- 172.21.15.118:0/1182709310 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff630004cf0 con 0x7ff63c107930 2024-09-21T11:58:54.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.566+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63c197aa0 con 0x7ff63c107930 2024-09-21T11:58:54.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.566+0000 7ff6397fa640 1 -- 172.21.15.118:0/1182709310 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff630035030 con 0x7ff63c107930 2024-09-21T11:58:54.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.566+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63c197fd0 con 0x7ff63c107930 2024-09-21T11:58:54.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.567+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63c103070 con 0x7ff63c107930 2024-09-21T11:58:54.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.568+0000 7ff6397fa640 1 -- 172.21.15.118:0/1182709310 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff630042070 con 0x7ff63c107930 2024-09-21T11:58:54.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.568+0000 7ff6397fa640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62407af30 0x7ff62407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:54.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.568+0000 7ff6397fa640 1 -- 172.21.15.118:0/1182709310 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff6300beac0 con 0x7ff63c107930 2024-09-21T11:58:54.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.568+0000 7ff63bfff640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62407af30 0x7ff62407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:54.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.568+0000 7ff63bfff640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62407af30 0x7ff62407d3f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0058c0 tx=0x7ff62c00a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:54.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.572+0000 7ff6397fa640 1 -- 172.21.15.118:0/1182709310 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff63008a010 con 0x7ff63c107930 2024-09-21T11:58:54.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.823+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff63c109ea0 con 0x7ff63c107930 2024-09-21T11:58:54.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.823+0000 7ff6397fa640 1 -- 172.21.15.118:0/1182709310 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7ff63008c530 con 0x7ff63c107930 2024-09-21T11:58:54.825 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:58:54.826 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:58:54.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:58:54.827 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:58:54.827 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:58:54.827 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:58:54.827 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:58:54.827 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62407af30 msgr2=0x7ff62407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62407af30 0x7ff62407d3f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0058c0 tx=0x7ff62c00a250 comp rx=0 tx=0).stop 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c107930 msgr2=0x7ff63c19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c107930 0x7ff63c19dbd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff630031460 tx=0x7ff6300048f0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 shutdown_connections 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff62407af30 0x7ff62407d3f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff63c107930 0x7ff63c19dbd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 --2- 172.21.15.118:0/1182709310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff63c101930 0x7ff63c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 >> 172.21.15.118:0/1182709310 conn(0x7ff63c0fd630 msgr2=0x7ff63c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 shutdown_connections 2024-09-21T11:58:54.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.825+0000 7ff642370640 1 -- 172.21.15.118:0/1182709310 wait complete. 2024-09-21T11:58:54.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.908+0000 7ff2657b8640 1 -- 172.21.15.118:0/971565817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260100800 msgr2=0x7ff260100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.908+0000 7ff2657b8640 1 --2- 172.21.15.118:0/971565817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260100800 0x7ff260100c60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff254009880 tx=0x7ff25402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.908+0000 7ff2657b8640 1 -- 172.21.15.118:0/971565817 shutdown_connections 2024-09-21T11:58:54.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.908+0000 7ff2657b8640 1 --2- 172.21.15.118:0/971565817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260100800 0x7ff260100c60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.908+0000 7ff2657b8640 1 --2- 172.21.15.118:0/971565817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff260106800 0x7ff260106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.908+0000 7ff2657b8640 1 -- 172.21.15.118:0/971565817 >> 172.21.15.118:0/971565817 conn(0x7ff2600fc4e0 msgr2=0x7ff2600fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:54.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.908+0000 7ff2657b8640 1 -- 172.21.15.118:0/971565817 shutdown_connections 2024-09-21T11:58:54.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.908+0000 7ff2657b8640 1 -- 172.21.15.118:0/971565817 wait complete. 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.908+0000 7ff2657b8640 1 Processor -- start 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff2657b8640 1 -- start start 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff2657b8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff260100800 0x7ff260198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff2657b8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260106800 0x7ff260198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff2657b8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff26010dd30 con 0x7ff260106800 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff2657b8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff26010dbb0 con 0x7ff260100800 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff25e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260106800 0x7ff260198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff25e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260106800 0x7ff260198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33052/0 (socket says 172.21.15.118:33052) 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff25e7fc640 1 -- 172.21.15.118:0/3027821132 learned_addr learned my addr 172.21.15.118:0/3027821132 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:54.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff25e7fc640 1 -- 172.21.15.118:0/3027821132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff260100800 msgr2=0x7ff260198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:54.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff25e7fc640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff260100800 0x7ff260198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:54.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff25e7fc640 1 -- 172.21.15.118:0/3027821132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2601993d0 con 0x7ff260106800 2024-09-21T11:58:54.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.909+0000 7ff25e7fc640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260106800 0x7ff260198dd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff254031460 tx=0x7ff2540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:54.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.910+0000 7ff247fff640 1 -- 172.21.15.118:0/3027821132 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff25403f070 con 0x7ff260106800 2024-09-21T11:58:54.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.910+0000 7ff247fff640 1 -- 172.21.15.118:0/3027821132 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff254004cf0 con 0x7ff260106800 2024-09-21T11:58:54.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.910+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff260199660 con 0x7ff260106800 2024-09-21T11:58:54.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.910+0000 7ff247fff640 1 -- 172.21.15.118:0/3027821132 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff254035030 con 0x7ff260106800 2024-09-21T11:58:54.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.910+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2601a1c10 con 0x7ff260106800 2024-09-21T11:58:54.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.911+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff260101f40 con 0x7ff260106800 2024-09-21T11:58:54.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.911+0000 7ff247fff640 1 -- 172.21.15.118:0/3027821132 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff254042070 con 0x7ff260106800 2024-09-21T11:58:54.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.912+0000 7ff247fff640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff24807af30 0x7ff24807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:54.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.912+0000 7ff247fff640 1 -- 172.21.15.118:0/3027821132 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff2540bebb0 con 0x7ff260106800 2024-09-21T11:58:54.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.912+0000 7ff25effd640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff24807af30 0x7ff24807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:54.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.912+0000 7ff25effd640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff24807af30 0x7ff24807d3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff25000ab90 tx=0x7ff250009250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:54.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:54.916+0000 7ff247fff640 1 -- 172.21.15.118:0/3027821132 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2540c5080 con 0x7ff260106800 2024-09-21T11:58:55.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.133+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff260108d90 con 0x7ff260106800 2024-09-21T11:58:55.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.133+0000 7ff247fff640 1 -- 172.21.15.118:0/3027821132 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7ff25408a100 con 0x7ff260106800 2024-09-21T11:58:55.136 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:58:55.136 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:58:55.136 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:58:55.136 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:58:55.136 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:58:55.137 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:58:55.137 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:58:55.137 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:58:55.137 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:58:55.137 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:58:55.137 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:58:55.138 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:58:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:58:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:58:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:58:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:58:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:58:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:58:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:58:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:58:55.139 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:58:55.140 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:58:55.140 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:58:55.140 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:58:55.140 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:58:55.140 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:58:55.140 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:58:55.141 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:58:55.141 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:58:55.141 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:58:55.141 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:58:55.141 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:58:55.141 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:58:55.142 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:58:55.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.135+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff24807af30 msgr2=0x7ff24807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.135+0000 7ff2657b8640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff24807af30 0x7ff24807d3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff25000ab90 tx=0x7ff250009250 comp rx=0 tx=0).stop 2024-09-21T11:58:55.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.135+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260106800 msgr2=0x7ff260198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.135+0000 7ff2657b8640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260106800 0x7ff260198dd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff254031460 tx=0x7ff2540048f0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.135+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 shutdown_connections 2024-09-21T11:58:55.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.135+0000 7ff2657b8640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff24807af30 0x7ff24807d3f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.135+0000 7ff2657b8640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff260106800 0x7ff260198dd0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.135+0000 7ff2657b8640 1 --2- 172.21.15.118:0/3027821132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff260100800 0x7ff260198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.135+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 >> 172.21.15.118:0/3027821132 conn(0x7ff2600fc4e0 msgr2=0x7ff2600fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:55.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.136+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 shutdown_connections 2024-09-21T11:58:55.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.136+0000 7ff2657b8640 1 -- 172.21.15.118:0/3027821132 wait complete. 2024-09-21T11:58:55.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.218+0000 7f634d46d640 1 -- 172.21.15.118:0/1980384197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481067e0 msgr2=0x7f6348106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.218+0000 7f634d46d640 1 --2- 172.21.15.118:0/1980384197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481067e0 0x7f6348106bc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6338009880 tx=0x7f633802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.218+0000 7f634d46d640 1 -- 172.21.15.118:0/1980384197 shutdown_connections 2024-09-21T11:58:55.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.218+0000 7f634d46d640 1 --2- 172.21.15.118:0/1980384197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63481007e0 0x7f6348100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.218+0000 7f634d46d640 1 --2- 172.21.15.118:0/1980384197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481067e0 0x7f6348106bc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.218+0000 7f634d46d640 1 -- 172.21.15.118:0/1980384197 >> 172.21.15.118:0/1980384197 conn(0x7f63480fc4c0 msgr2=0x7f63480fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:55.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.218+0000 7f634d46d640 1 -- 172.21.15.118:0/1980384197 shutdown_connections 2024-09-21T11:58:55.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.218+0000 7f634d46d640 1 -- 172.21.15.118:0/1980384197 wait complete. 2024-09-21T11:58:55.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.218+0000 7f634d46d640 1 Processor -- start 2024-09-21T11:58:55.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f634d46d640 1 -- start start 2024-09-21T11:58:55.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f634d46d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481007e0 0x7f6348107710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:55.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f634d46d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63481067e0 0x7f6348107c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:55.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f634d46d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f634810dc90 con 0x7f63481007e0 2024-09-21T11:58:55.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f634d46d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f634810db10 con 0x7f63481067e0 2024-09-21T11:58:55.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f6346ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481007e0 0x7f6348107710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:55.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f6346ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481007e0 0x7f6348107710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33060/0 (socket says 172.21.15.118:33060) 2024-09-21T11:58:55.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f6346ffd640 1 -- 172.21.15.118:0/2559082781 learned_addr learned my addr 172.21.15.118:0/2559082781 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:55.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f633e7fc640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63481067e0 0x7f6348107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:55.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f6346ffd640 1 -- 172.21.15.118:0/2559082781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63481067e0 msgr2=0x7f6348107c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f6346ffd640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63481067e0 0x7f6348107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f6346ffd640 1 -- 172.21.15.118:0/2559082781 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6348108190 con 0x7f63481007e0 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f6346ffd640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481007e0 0x7f6348107710 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6338031460 tx=0x7f63380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.219+0000 7f6344ff9640 1 -- 172.21.15.118:0/2559082781 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f633803f070 con 0x7f63481007e0 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.220+0000 7f6344ff9640 1 -- 172.21.15.118:0/2559082781 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6338004cf0 con 0x7f63481007e0 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.220+0000 7f6344ff9640 1 -- 172.21.15.118:0/2559082781 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6338035030 con 0x7f63481007e0 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.220+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6348108420 con 0x7f63481007e0 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.220+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63481a3cf0 con 0x7f63481007e0 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.221+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6348101f20 con 0x7f63481007e0 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.221+0000 7f6344ff9640 1 -- 172.21.15.118:0/2559082781 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6338042070 con 0x7f63481007e0 2024-09-21T11:58:55.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.222+0000 7f6344ff9640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633407af30 0x7f633407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:55.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.222+0000 7f6344ff9640 1 -- 172.21.15.118:0/2559082781 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f63380beb40 con 0x7f63481007e0 2024-09-21T11:58:55.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.222+0000 7f633e7fc640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633407af30 0x7f633407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:55.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.222+0000 7f633e7fc640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633407af30 0x7f633407d3f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f63481091a0 tx=0x7f6330005cc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:55.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.226+0000 7f6344ff9640 1 -- 172.21.15.118:0/2559082781 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f633808a090 con 0x7f63481007e0 2024-09-21T11:58:55.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.420+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f634806a320 con 0x7f633407af30 2024-09-21T11:58:55.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.421+0000 7f6344ff9640 1 -- 172.21.15.118:0/2559082781 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f634806a320 con 0x7f633407af30 2024-09-21T11:58:55.423 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:58:55.424 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:58:55.425 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:58:55.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633407af30 msgr2=0x7f633407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633407af30 0x7f633407d3f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f63481091a0 tx=0x7f6330005cc0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481007e0 msgr2=0x7f6348107710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481007e0 0x7f6348107710 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6338031460 tx=0x7f63380048f0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 shutdown_connections 2024-09-21T11:58:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63481067e0 0x7f6348107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633407af30 0x7f633407d3f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 --2- 172.21.15.118:0/2559082781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63481007e0 0x7f6348107710 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 >> 172.21.15.118:0/2559082781 conn(0x7f63480fc4c0 msgr2=0x7f6348069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 shutdown_connections 2024-09-21T11:58:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.423+0000 7f634d46d640 1 -- 172.21.15.118:0/2559082781 wait complete. 2024-09-21T11:58:55.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.505+0000 7f528d40c640 1 -- 172.21.15.118:0/2488883538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 msgr2=0x7f5288106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.505+0000 7f528d40c640 1 --2- 172.21.15.118:0/2488883538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 0x7f5288106bc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5280009880 tx=0x7f528002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.505+0000 7f528d40c640 1 -- 172.21.15.118:0/2488883538 shutdown_connections 2024-09-21T11:58:55.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.505+0000 7f528d40c640 1 --2- 172.21.15.118:0/2488883538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52881007e0 0x7f5288100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.505+0000 7f528d40c640 1 --2- 172.21.15.118:0/2488883538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 0x7f5288106bc0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.505+0000 7f528d40c640 1 -- 172.21.15.118:0/2488883538 >> 172.21.15.118:0/2488883538 conn(0x7f52880fc4c0 msgr2=0x7f52880fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:55.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.505+0000 7f528d40c640 1 -- 172.21.15.118:0/2488883538 shutdown_connections 2024-09-21T11:58:55.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.505+0000 7f528d40c640 1 -- 172.21.15.118:0/2488883538 wait complete. 2024-09-21T11:58:55.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.506+0000 7f528d40c640 1 Processor -- start 2024-09-21T11:58:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.506+0000 7f528d40c640 1 -- start start 2024-09-21T11:58:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.506+0000 7f528d40c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52881007e0 0x7f528819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.506+0000 7f528d40c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 0x7f528819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.506+0000 7f528d40c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f528810dc90 con 0x7f52881067e0 2024-09-21T11:58:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.506+0000 7f528d40c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f528810db10 con 0x7f52881007e0 2024-09-21T11:58:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.506+0000 7f52867fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 0x7f528819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.506+0000 7f52867fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 0x7f528819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38610/0 (socket says 172.21.15.118:38610) 2024-09-21T11:58:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.506+0000 7f52867fc640 1 -- 172.21.15.118:0/2271886763 learned_addr learned my addr 172.21.15.118:0/2271886763 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:58:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f5286ffd640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52881007e0 0x7f528819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f52867fc640 1 -- 172.21.15.118:0/2271886763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52881007e0 msgr2=0x7f528819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f52867fc640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52881007e0 0x7f528819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f52867fc640 1 -- 172.21.15.118:0/2271886763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52881977a0 con 0x7f52881067e0 2024-09-21T11:58:55.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f52867fc640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 0x7f528819db60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f527000d8d0 tx=0x7f527000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:55.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f527ffff640 1 -- 172.21.15.118:0/2271886763 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5270017070 con 0x7f52881067e0 2024-09-21T11:58:55.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f527ffff640 1 -- 172.21.15.118:0/2271886763 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5270010460 con 0x7f52881067e0 2024-09-21T11:58:55.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5288197a90 con 0x7f52881067e0 2024-09-21T11:58:55.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f527ffff640 1 -- 172.21.15.118:0/2271886763 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f527000f5f0 con 0x7f52881067e0 2024-09-21T11:58:55.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.507+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5288198020 con 0x7f52881067e0 2024-09-21T11:58:55.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.508+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5288101f20 con 0x7f52881067e0 2024-09-21T11:58:55.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.509+0000 7f527ffff640 1 -- 172.21.15.118:0/2271886763 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5270009a30 con 0x7f52881067e0 2024-09-21T11:58:55.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.509+0000 7f527ffff640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f527407af80 0x7f527407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:58:55.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.509+0000 7f5286ffd640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f527407af80 0x7f527407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:58:55.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.510+0000 7f527ffff640 1 -- 172.21.15.118:0/2271886763 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f527009ddf0 con 0x7f52881067e0 2024-09-21T11:58:55.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.510+0000 7f5286ffd640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f527407af80 0x7f527407d440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f52800096c0 tx=0x7f5280031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:58:55.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.514+0000 7f527ffff640 1 -- 172.21.15.118:0/2271886763 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52700693c0 con 0x7f52881067e0 2024-09-21T11:58:55.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.759+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f52881982d0 con 0x7f52881067e0 2024-09-21T11:58:55.762 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:55 smithi118 ceph-mon[111738]: from='client.34920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:55.762 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:55 smithi118 ceph-mon[111738]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:55.762 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:55 smithi118 ceph-mon[111738]: pgmap v602: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:55.762 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:55 smithi118 ceph-mon[111738]: from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:55.763 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:55 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1182709310' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:58:55.763 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:55 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3027821132' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:58:55.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.759+0000 7f527ffff640 1 -- 172.21.15.118:0/2271886763 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f527006e270 con 0x7f52881067e0 2024-09-21T11:58:55.764 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:58:55.764 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:58:55.764 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:58:55.764 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:58:55.764 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:58:55.764 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:58:55.765 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:58:55.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f527407af80 msgr2=0x7f527407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f527407af80 0x7f527407d440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f52800096c0 tx=0x7f5280031400 comp rx=0 tx=0).stop 2024-09-21T11:58:55.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 msgr2=0x7f528819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:58:55.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 0x7f528819db60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f527000d8d0 tx=0x7f527000dd90 comp rx=0 tx=0).stop 2024-09-21T11:58:55.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 shutdown_connections 2024-09-21T11:58:55.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f527407af80 0x7f527407d440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52881067e0 0x7f528819db60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 --2- 172.21.15.118:0/2271886763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52881007e0 0x7f528819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:58:55.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 >> 172.21.15.118:0/2271886763 conn(0x7f52880fc4c0 msgr2=0x7f5288069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:58:55.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 shutdown_connections 2024-09-21T11:58:55.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:58:55.762+0000 7f528d40c640 1 -- 172.21.15.118:0/2271886763 wait complete. 2024-09-21T11:58:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:55 smithi149 ceph-mon[79770]: from='client.34920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:55 smithi149 ceph-mon[79770]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:55 smithi149 ceph-mon[79770]: pgmap v602: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:55 smithi149 ceph-mon[79770]: from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:55 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1182709310' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:58:55.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:55 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3027821132' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:58:56.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:56 smithi118 ceph-mon[111738]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:56.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:56 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2271886763' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:58:56.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:56 smithi149 ceph-mon[79770]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:58:56.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:56 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2271886763' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:58:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:57 smithi118 ceph-mon[111738]: pgmap v603: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:57.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:57 smithi149 ceph-mon[79770]: pgmap v603: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:58:59 smithi118 ceph-mon[111738]: pgmap v604: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:58:59.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:58:59 smithi149 ceph-mon[79770]: pgmap v604: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:01.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:01 smithi118 ceph-mon[111738]: pgmap v605: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:01.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:01 smithi149 ceph-mon[79770]: pgmap v605: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:03 smithi118 ceph-mon[111738]: pgmap v606: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:03.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:03 smithi149 ceph-mon[79770]: pgmap v606: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:05 smithi118 ceph-mon[111738]: pgmap v607: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:59:05.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:05 smithi149 ceph-mon[79770]: pgmap v607: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:05.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:59:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:07 smithi118 ceph-mon[111738]: pgmap v608: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:07.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:07 smithi149 ceph-mon[79770]: pgmap v608: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:09.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:09 smithi118 ceph-mon[111738]: pgmap v609: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:09.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:09 smithi149 ceph-mon[79770]: pgmap v609: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:11 smithi118 ceph-mon[111738]: pgmap v610: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:11.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:11 smithi149 ceph-mon[79770]: pgmap v610: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:13 smithi149 ceph-mon[79770]: pgmap v611: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:13 smithi118 ceph-mon[111738]: pgmap v611: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:15 smithi118 ceph-mon[111738]: pgmap v612: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:15.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:15 smithi149 ceph-mon[79770]: pgmap v612: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:17 smithi118 ceph-mon[111738]: pgmap v613: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:17.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:17 smithi149 ceph-mon[79770]: pgmap v613: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:19 smithi118 ceph-mon[111738]: pgmap v614: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:19.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:19 smithi149 ceph-mon[79770]: pgmap v614: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:59:20.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:59:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:21 smithi118 ceph-mon[111738]: pgmap v615: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:21 smithi149 ceph-mon[79770]: pgmap v615: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:23.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:23 smithi118 ceph-mon[111738]: pgmap v616: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:23.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:23 smithi149 ceph-mon[79770]: pgmap v616: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:25.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:25 smithi118 ceph-mon[111738]: pgmap v617: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:25.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.857+0000 7fc6eddd9640 1 -- 172.21.15.118:0/2237447262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 msgr2=0x7fc6e810b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:25.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.857+0000 7fc6eddd9640 1 --2- 172.21.15.118:0/2237447262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 0x7fc6e810b950 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0098b0 tx=0x7fc6dc02a560 comp rx=0 tx=0).stop 2024-09-21T11:59:25.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.857+0000 7fc6eddd9640 1 -- 172.21.15.118:0/2237447262 shutdown_connections 2024-09-21T11:59:25.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.857+0000 7fc6eddd9640 1 --2- 172.21.15.118:0/2237447262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 0x7fc6e810b950 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:25.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.857+0000 7fc6eddd9640 1 --2- 172.21.15.118:0/2237447262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e8102b40 0x7fc6e8102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:25.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.857+0000 7fc6eddd9640 1 -- 172.21.15.118:0/2237447262 >> 172.21.15.118:0/2237447262 conn(0x7fc6e80fc520 msgr2=0x7fc6e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:25.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.857+0000 7fc6eddd9640 1 -- 172.21.15.118:0/2237447262 shutdown_connections 2024-09-21T11:59:25.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.857+0000 7fc6eddd9640 1 -- 172.21.15.118:0/2237447262 wait complete. 2024-09-21T11:59:25.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.858+0000 7fc6eddd9640 1 Processor -- start 2024-09-21T11:59:25.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.858+0000 7fc6eddd9640 1 -- start start 2024-09-21T11:59:25.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.858+0000 7fc6eddd9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e8102b40 0x7fc6e81007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:25.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.858+0000 7fc6eddd9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 0x7fc6e8100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:25.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.858+0000 7fc6eddd9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e810edf0 con 0x7fc6e8103460 2024-09-21T11:59:25.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.858+0000 7fc6eddd9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e810ec70 con 0x7fc6e8102b40 2024-09-21T11:59:25.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.858+0000 7fc6e6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 0x7fc6e8100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:25.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.858+0000 7fc6e6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 0x7fc6e8100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42876/0 (socket says 172.21.15.118:42876) 2024-09-21T11:59:25.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6e6ffd640 1 -- 172.21.15.118:0/3836896760 learned_addr learned my addr 172.21.15.118:0/3836896760 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:25.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6e77fe640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e8102b40 0x7fc6e81007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:25.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6e6ffd640 1 -- 172.21.15.118:0/3836896760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e8102b40 msgr2=0x7fc6e81007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:25.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6e6ffd640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e8102b40 0x7fc6e81007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:25.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6e6ffd640 1 -- 172.21.15.118:0/3836896760 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e8101220 con 0x7fc6e8103460 2024-09-21T11:59:25.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6e6ffd640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 0x7fc6e8100ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc031460 tx=0x7fc6dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:25.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6e4ff9640 1 -- 172.21.15.118:0/3836896760 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc03f070 con 0x7fc6e8103460 2024-09-21T11:59:25.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6e4ff9640 1 -- 172.21.15.118:0/3836896760 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6dc0044d0 con 0x7fc6e8103460 2024-09-21T11:59:25.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e81014b0 con 0x7fc6e8103460 2024-09-21T11:59:25.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6e4ff9640 1 -- 172.21.15.118:0/3836896760 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc035030 con 0x7fc6e8103460 2024-09-21T11:59:25.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.859+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e81a3df0 con 0x7fc6e8103460 2024-09-21T11:59:25.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.860+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e806ab80 con 0x7fc6e8103460 2024-09-21T11:59:25.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.861+0000 7fc6e4ff9640 1 -- 172.21.15.118:0/3836896760 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc6dc042070 con 0x7fc6e8103460 2024-09-21T11:59:25.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.861+0000 7fc6e4ff9640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc6d007af80 0x7fc6d007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:25.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.862+0000 7fc6e4ff9640 1 -- 172.21.15.118:0/3836896760 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fc6dc0bea10 con 0x7fc6e8103460 2024-09-21T11:59:25.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.862+0000 7fc6e77fe640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc6d007af80 0x7fc6d007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:25.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.862+0000 7fc6e77fe640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc6d007af80 0x7fc6d007d440 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800abe0 tx=0x7fc6d800a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:25.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:25.866+0000 7fc6e4ff9640 1 -- 172.21.15.118:0/3836896760 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6dc089fe0 con 0x7fc6e8103460 2024-09-21T11:59:25.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:25 smithi149 ceph-mon[79770]: pgmap v617: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:26.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.059+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc6e8062630 con 0x7fc6d007af80 2024-09-21T11:59:26.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.060+0000 7fc6e4ff9640 1 -- 172.21.15.118:0/3836896760 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fc6e8062630 con 0x7fc6d007af80 2024-09-21T11:59:26.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc6d007af80 msgr2=0x7fc6d007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc6d007af80 0x7fc6d007d440 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800abe0 tx=0x7fc6d800a2d0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 msgr2=0x7fc6e8100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 0x7fc6e8100ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc031460 tx=0x7fc6dc0048f0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 shutdown_connections 2024-09-21T11:59:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc6d007af80 0x7fc6d007d440 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e8103460 0x7fc6e8100ce0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 --2- 172.21.15.118:0/3836896760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e8102b40 0x7fc6e81007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 >> 172.21.15.118:0/3836896760 conn(0x7fc6e80fc520 msgr2=0x7fc6e8103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 shutdown_connections 2024-09-21T11:59:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.062+0000 7fc6eddd9640 1 -- 172.21.15.118:0/3836896760 wait complete. 2024-09-21T11:59:26.073 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:59:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.145+0000 7fdace353640 1 -- 172.21.15.118:0/4183758912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 msgr2=0x7fdac8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.145+0000 7fdace353640 1 --2- 172.21.15.118:0/4183758912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 0x7fdac8101d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009880 tx=0x7fdabc02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.145+0000 7fdace353640 1 -- 172.21.15.118:0/4183758912 shutdown_connections 2024-09-21T11:59:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.145+0000 7fdace353640 1 --2- 172.21.15.118:0/4183758912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 0x7fdac8101d90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.145+0000 7fdace353640 1 --2- 172.21.15.118:0/4183758912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdac8107930 0x7fdac8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.145+0000 7fdace353640 1 -- 172.21.15.118:0/4183758912 >> 172.21.15.118:0/4183758912 conn(0x7fdac80fd630 msgr2=0x7fdac80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:26.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.145+0000 7fdace353640 1 -- 172.21.15.118:0/4183758912 shutdown_connections 2024-09-21T11:59:26.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.145+0000 7fdace353640 1 -- 172.21.15.118:0/4183758912 wait complete. 2024-09-21T11:59:26.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdace353640 1 Processor -- start 2024-09-21T11:59:26.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdace353640 1 -- start start 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdace353640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 0x7fdac80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdace353640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdac8107930 0x7fdac8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdace353640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdac810ee60 con 0x7fdac8101930 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdace353640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdac810ece0 con 0x7fdac8107930 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdac7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 0x7fdac80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdac7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 0x7fdac80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42898/0 (socket says 172.21.15.118:42898) 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdac7fff640 1 -- 172.21.15.118:0/2955889099 learned_addr learned my addr 172.21.15.118:0/2955889099 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.146+0000 7fdac77fe640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdac8107930 0x7fdac8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdac7fff640 1 -- 172.21.15.118:0/2955889099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdac8107930 msgr2=0x7fdac8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdac7fff640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdac8107930 0x7fdac8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdac7fff640 1 -- 172.21.15.118:0/2955889099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac8074f70 con 0x7fdac8101930 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdac77fe640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdac8107930 0x7fdac8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdac7fff640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 0x7fdac80744f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdab800b420 tx=0x7fdab800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdac57fa640 1 -- 172.21.15.118:0/2955889099 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab8011630 con 0x7fdac8101930 2024-09-21T11:59:26.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdac57fa640 1 -- 172.21.15.118:0/2955889099 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdab8016070 con 0x7fdac8101930 2024-09-21T11:59:26.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac8075260 con 0x7fdac8101930 2024-09-21T11:59:26.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdac57fa640 1 -- 172.21.15.118:0/2955889099 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab8010d40 con 0x7fdac8101930 2024-09-21T11:59:26.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.147+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac81a3ef0 con 0x7fdac8101930 2024-09-21T11:59:26.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.148+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac8103070 con 0x7fdac8101930 2024-09-21T11:59:26.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.149+0000 7fdac57fa640 1 -- 172.21.15.118:0/2955889099 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fdab801b460 con 0x7fdac8101930 2024-09-21T11:59:26.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.150+0000 7fdac57fa640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdab007af30 0x7fdab007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:26.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.150+0000 7fdac57fa640 1 -- 172.21.15.118:0/2955889099 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fdab809d8f0 con 0x7fdac8101930 2024-09-21T11:59:26.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.150+0000 7fdac77fe640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdab007af30 0x7fdab007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:26.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.150+0000 7fdac77fe640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdab007af30 0x7fdab007d3f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdac8075f80 tx=0x7fdabc031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:26.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.154+0000 7fdac57fa640 1 -- 172.21.15.118:0/2955889099 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdab8068da0 con 0x7fdac8101930 2024-09-21T11:59:26.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.347+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdac8062630 con 0x7fdab007af30 2024-09-21T11:59:26.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.349+0000 7fdac57fa640 1 -- 172.21.15.118:0/2955889099 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fdac8062630 con 0x7fdab007af30 2024-09-21T11:59:26.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdab007af30 msgr2=0x7fdab007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdab007af30 0x7fdab007d3f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdac8075f80 tx=0x7fdabc031400 comp rx=0 tx=0).stop 2024-09-21T11:59:26.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 msgr2=0x7fdac80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 0x7fdac80744f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdab800b420 tx=0x7fdab800b8e0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 shutdown_connections 2024-09-21T11:59:26.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdac8107930 0x7fdac8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdab007af30 0x7fdab007d3f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 --2- 172.21.15.118:0/2955889099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdac8101930 0x7fdac80744f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 >> 172.21.15.118:0/2955889099 conn(0x7fdac80fd630 msgr2=0x7fdac80fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:26.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 shutdown_connections 2024-09-21T11:59:26.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.351+0000 7fdace353640 1 -- 172.21.15.118:0/2955889099 wait complete. 2024-09-21T11:59:26.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.432+0000 7f1d72cfc640 1 -- 172.21.15.118:0/939993816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c100820 msgr2=0x7f1d6c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.432+0000 7f1d72cfc640 1 --2- 172.21.15.118:0/939993816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c100820 0x7f1d6c100c80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009880 tx=0x7f1d5802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.432+0000 7f1d72cfc640 1 -- 172.21.15.118:0/939993816 shutdown_connections 2024-09-21T11:59:26.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.432+0000 7f1d72cfc640 1 --2- 172.21.15.118:0/939993816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c100820 0x7f1d6c100c80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.432+0000 7f1d72cfc640 1 --2- 172.21.15.118:0/939993816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d6c106820 0x7f1d6c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.432+0000 7f1d72cfc640 1 -- 172.21.15.118:0/939993816 >> 172.21.15.118:0/939993816 conn(0x7f1d6c0fc520 msgr2=0x7f1d6c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:26.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.432+0000 7f1d72cfc640 1 -- 172.21.15.118:0/939993816 shutdown_connections 2024-09-21T11:59:26.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.432+0000 7f1d72cfc640 1 -- 172.21.15.118:0/939993816 wait complete. 2024-09-21T11:59:26.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d72cfc640 1 Processor -- start 2024-09-21T11:59:26.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d72cfc640 1 -- start start 2024-09-21T11:59:26.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d72cfc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d6c100820 0x7f1d6c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:26.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d72cfc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c106820 0x7f1d6c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:26.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d72cfc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c10dcf0 con 0x7f1d6c106820 2024-09-21T11:59:26.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d72cfc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c10db70 con 0x7f1d6c100820 2024-09-21T11:59:26.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d6bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c106820 0x7f1d6c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:26.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d6bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c106820 0x7f1d6c198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42924/0 (socket says 172.21.15.118:42924) 2024-09-21T11:59:26.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d6bfff640 1 -- 172.21.15.118:0/4017956358 learned_addr learned my addr 172.21.15.118:0/4017956358 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:26.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.433+0000 7f1d70a98640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d6c100820 0x7f1d6c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:26.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.434+0000 7f1d6bfff640 1 -- 172.21.15.118:0/4017956358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d6c100820 msgr2=0x7f1d6c1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.434+0000 7f1d6bfff640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d6c100820 0x7f1d6c1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.434+0000 7f1d6bfff640 1 -- 172.21.15.118:0/4017956358 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c199350 con 0x7f1d6c106820 2024-09-21T11:59:26.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.434+0000 7f1d6bfff640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c106820 0x7f1d6c198d00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1d58031460 tx=0x7f1d580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:26.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.434+0000 7f1d69ffb640 1 -- 172.21.15.118:0/4017956358 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d5803f070 con 0x7f1d6c106820 2024-09-21T11:59:26.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.434+0000 7f1d69ffb640 1 -- 172.21.15.118:0/4017956358 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d58004cf0 con 0x7f1d6c106820 2024-09-21T11:59:26.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.434+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6c1995e0 con 0x7f1d6c106820 2024-09-21T11:59:26.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.434+0000 7f1d69ffb640 1 -- 172.21.15.118:0/4017956358 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d58035030 con 0x7f1d6c106820 2024-09-21T11:59:26.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.434+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d6c1a1b90 con 0x7f1d6c106820 2024-09-21T11:59:26.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.436+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6c101f60 con 0x7f1d6c106820 2024-09-21T11:59:26.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.436+0000 7f1d69ffb640 1 -- 172.21.15.118:0/4017956358 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1d58042070 con 0x7f1d6c106820 2024-09-21T11:59:26.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.436+0000 7f1d69ffb640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d5c07af80 0x7f1d5c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:26.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.436+0000 7f1d69ffb640 1 -- 172.21.15.118:0/4017956358 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f1d580be9e0 con 0x7f1d6c106820 2024-09-21T11:59:26.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.436+0000 7f1d70a98640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d5c07af80 0x7f1d5c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:26.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.437+0000 7f1d70a98640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d5c07af80 0x7f1d5c07d440 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d600058c0 tx=0x7f1d6000a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:26.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.441+0000 7f1d69ffb640 1 -- 172.21.15.118:0/4017956358 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d58089fb0 con 0x7f1d6c106820 2024-09-21T11:59:26.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.627+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1d6c062630 con 0x7f1d5c07af80 2024-09-21T11:59:26.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.636+0000 7f1d69ffb640 1 -- 172.21.15.118:0/4017956358 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1d6c062630 con 0x7f1d5c07af80 2024-09-21T11:59:26.638 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (17m) 11m ago 28m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (20m) 11m ago 28m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (19m) 11m ago 27m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (15m) 11m ago 28m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (15m) 11m ago 27m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (16m) 11m ago 28m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (11m) 11m ago 22m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (11m) 11m ago 22m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (22m) 11m ago 22m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (11m) 11m ago 22m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (19m) 11m ago 29m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (18m) 11m ago 27m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (16m) 11m ago 29m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:59:26.639 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (15m) 11m ago 27m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:59:26.640 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (18m) 11m ago 28m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:59:26.640 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (18m) 11m ago 27m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:59:26.640 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (15m) 11m ago 26m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:59:26.640 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (14m) 11m ago 25m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:59:26.640 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (13m) 11m ago 25m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:59:26.640 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (13m) 11m ago 24m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:59:26.640 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (12m) 11m ago 24m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:59:26.640 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (12m) 11m ago 24m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:59:26.640 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (17m) 11m ago 27m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:59:26.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.638+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d5c07af80 msgr2=0x7f1d5c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.638+0000 7f1d72cfc640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d5c07af80 0x7f1d5c07d440 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d600058c0 tx=0x7f1d6000a250 comp rx=0 tx=0).stop 2024-09-21T11:59:26.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.638+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c106820 msgr2=0x7f1d6c198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.638+0000 7f1d72cfc640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c106820 0x7f1d6c198d00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1d58031460 tx=0x7f1d580048f0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.638+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 shutdown_connections 2024-09-21T11:59:26.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.638+0000 7f1d72cfc640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d5c07af80 0x7f1d5c07d440 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.638+0000 7f1d72cfc640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d6c106820 0x7f1d6c198d00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.638+0000 7f1d72cfc640 1 --2- 172.21.15.118:0/4017956358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d6c100820 0x7f1d6c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.638+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 >> 172.21.15.118:0/4017956358 conn(0x7f1d6c0fc520 msgr2=0x7f1d6c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:26.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.639+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 shutdown_connections 2024-09-21T11:59:26.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.639+0000 7f1d72cfc640 1 -- 172.21.15.118:0/4017956358 wait complete. 2024-09-21T11:59:26.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.719+0000 7fde63e70640 1 -- 172.21.15.118:0/608258093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c101930 msgr2=0x7fde5c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.719+0000 7fde63e70640 1 --2- 172.21.15.118:0/608258093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c101930 0x7fde5c101d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fde50009880 tx=0x7fde5002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.719+0000 7fde63e70640 1 -- 172.21.15.118:0/608258093 shutdown_connections 2024-09-21T11:59:26.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.719+0000 7fde63e70640 1 --2- 172.21.15.118:0/608258093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c101930 0x7fde5c101d90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.719+0000 7fde63e70640 1 --2- 172.21.15.118:0/608258093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde5c107930 0x7fde5c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.719+0000 7fde63e70640 1 -- 172.21.15.118:0/608258093 >> 172.21.15.118:0/608258093 conn(0x7fde5c0fd630 msgr2=0x7fde5c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:26.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.719+0000 7fde63e70640 1 -- 172.21.15.118:0/608258093 shutdown_connections 2024-09-21T11:59:26.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.719+0000 7fde63e70640 1 -- 172.21.15.118:0/608258093 wait complete. 2024-09-21T11:59:26.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde63e70640 1 Processor -- start 2024-09-21T11:59:26.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde63e70640 1 -- start start 2024-09-21T11:59:26.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde63e70640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde5c101930 0x7fde5c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:26.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde63e70640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c107930 0x7fde5c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:26.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde63e70640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c10ee00 con 0x7fde5c107930 2024-09-21T11:59:26.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde63e70640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c10ec80 con 0x7fde5c101930 2024-09-21T11:59:26.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde6140b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c107930 0x7fde5c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:26.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde6140b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c107930 0x7fde5c19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42936/0 (socket says 172.21.15.118:42936) 2024-09-21T11:59:26.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde6140b640 1 -- 172.21.15.118:0/1156535028 learned_addr learned my addr 172.21.15.118:0/1156535028 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:26.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.720+0000 7fde61c0c640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde5c101930 0x7fde5c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:26.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.721+0000 7fde6140b640 1 -- 172.21.15.118:0/1156535028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde5c101930 msgr2=0x7fde5c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.721+0000 7fde6140b640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde5c101930 0x7fde5c19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.721+0000 7fde6140b640 1 -- 172.21.15.118:0/1156535028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c1999e0 con 0x7fde5c107930 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.721+0000 7fde6140b640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c107930 0x7fde5c19fd60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fde50031460 tx=0x7fde500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.721+0000 7fde5affd640 1 -- 172.21.15.118:0/1156535028 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde5003f070 con 0x7fde5c107930 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.721+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5c199c70 con 0x7fde5c107930 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.721+0000 7fde5affd640 1 -- 172.21.15.118:0/1156535028 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde50004cf0 con 0x7fde5c107930 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.721+0000 7fde5affd640 1 -- 172.21.15.118:0/1156535028 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde50035030 con 0x7fde5c107930 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.721+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5c19a1a0 con 0x7fde5c107930 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.722+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5c103070 con 0x7fde5c107930 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.723+0000 7fde5affd640 1 -- 172.21.15.118:0/1156535028 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fde50042070 con 0x7fde5c107930 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.724+0000 7fde5affd640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde4407af30 0x7fde4407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.724+0000 7fde61c0c640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde4407af30 0x7fde4407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.724+0000 7fde5affd640 1 -- 172.21.15.118:0/1156535028 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fde500beac0 con 0x7fde5c107930 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.724+0000 7fde61c0c640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde4407af30 0x7fde4407d3f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fde540058c0 tx=0x7fde5400a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:26.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.728+0000 7fde5affd640 1 -- 172.21.15.118:0/1156535028 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde5008a010 con 0x7fde5c107930 2024-09-21T11:59:26.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.979+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fde5c19af40 con 0x7fde5c107930 2024-09-21T11:59:26.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.980+0000 7fde5affd640 1 -- 172.21.15.118:0/1156535028 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fde5008eec0 con 0x7fde5c107930 2024-09-21T11:59:26.982 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:59:26.982 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:59:26.982 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:59:26.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:59:26.982 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:59:26.982 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:59:26.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:59:26.982 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:59:26.983 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:59:26.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde4407af30 msgr2=0x7fde4407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde4407af30 0x7fde4407d3f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fde540058c0 tx=0x7fde5400a250 comp rx=0 tx=0).stop 2024-09-21T11:59:26.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c107930 msgr2=0x7fde5c19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:26.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c107930 0x7fde5c19fd60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fde50031460 tx=0x7fde500048f0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 shutdown_connections 2024-09-21T11:59:26.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fde4407af30 0x7fde4407d3f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde5c107930 0x7fde5c19fd60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 --2- 172.21.15.118:0/1156535028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde5c101930 0x7fde5c19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:26.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 >> 172.21.15.118:0/1156535028 conn(0x7fde5c0fd630 msgr2=0x7fde5c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:26.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 shutdown_connections 2024-09-21T11:59:26.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:26.982+0000 7fde63e70640 1 -- 172.21.15.118:0/1156535028 wait complete. 2024-09-21T11:59:27.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.064+0000 7f9280fff640 1 -- 172.21.15.118:0/3394501728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 msgr2=0x7f927c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.064+0000 7f9280fff640 1 --2- 172.21.15.118:0/3394501728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 0x7f927c107d10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f926c009880 tx=0x7f926c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.064+0000 7f9280fff640 1 -- 172.21.15.118:0/3394501728 shutdown_connections 2024-09-21T11:59:27.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.064+0000 7f9280fff640 1 --2- 172.21.15.118:0/3394501728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f927c101930 0x7f927c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.064+0000 7f9280fff640 1 --2- 172.21.15.118:0/3394501728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 0x7f927c107d10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.064+0000 7f9280fff640 1 -- 172.21.15.118:0/3394501728 >> 172.21.15.118:0/3394501728 conn(0x7f927c0fd630 msgr2=0x7f927c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:27.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.064+0000 7f9280fff640 1 -- 172.21.15.118:0/3394501728 shutdown_connections 2024-09-21T11:59:27.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.064+0000 7f9280fff640 1 -- 172.21.15.118:0/3394501728 wait complete. 2024-09-21T11:59:27.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.065+0000 7f9280fff640 1 Processor -- start 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.065+0000 7f9280fff640 1 -- start start 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.065+0000 7f9280fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f927c101930 0x7f927c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.065+0000 7f9280fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 0x7f927c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.065+0000 7f9280fff640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f927c10ee00 con 0x7f927c107930 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.065+0000 7f9280fff640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f927c10ec80 con 0x7f927c101930 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.065+0000 7f9279d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 0x7f927c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.065+0000 7f9279d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 0x7f927c19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42958/0 (socket says 172.21.15.118:42958) 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.065+0000 7f9279d9b640 1 -- 172.21.15.118:0/1787124007 learned_addr learned my addr 172.21.15.118:0/1787124007 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f927a59c640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f927c101930 0x7f927c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f9279d9b640 1 -- 172.21.15.118:0/1787124007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f927c101930 msgr2=0x7f927c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f9279d9b640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f927c101930 0x7f927c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f9279d9b640 1 -- 172.21.15.118:0/1787124007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c1977f0 con 0x7f927c107930 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f9279d9b640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 0x7f927c19dbb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f927000d6f0 tx=0x7f927000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:27.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f926b7fe640 1 -- 172.21.15.118:0/1787124007 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9270017070 con 0x7f927c107930 2024-09-21T11:59:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c197ae0 con 0x7f927c107930 2024-09-21T11:59:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f926b7fe640 1 -- 172.21.15.118:0/1787124007 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f927000de00 con 0x7f927c107930 2024-09-21T11:59:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f926b7fe640 1 -- 172.21.15.118:0/1787124007 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9270004bb0 con 0x7f927c107930 2024-09-21T11:59:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.066+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c198070 con 0x7f927c107930 2024-09-21T11:59:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.067+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f927c103070 con 0x7f927c107930 2024-09-21T11:59:27.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.068+0000 7f926b7fe640 1 -- 172.21.15.118:0/1787124007 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9270009a30 con 0x7f927c107930 2024-09-21T11:59:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.068+0000 7f926b7fe640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f926407af80 0x7f926407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.068+0000 7f926b7fe640 1 -- 172.21.15.118:0/1787124007 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f927009db70 con 0x7f927c107930 2024-09-21T11:59:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.068+0000 7f927a59c640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f926407af80 0x7f926407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:27.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.069+0000 7f927a59c640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f926407af80 0x7f926407d440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f926c0096c0 tx=0x7f926c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:27.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.073+0000 7f926b7fe640 1 -- 172.21.15.118:0/1787124007 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9270069140 con 0x7f927c107930 2024-09-21T11:59:27.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.283+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f927c109ea0 con 0x7f927c107930 2024-09-21T11:59:27.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.284+0000 7f926b7fe640 1 -- 172.21.15.118:0/1787124007 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f927006dff0 con 0x7f927c107930 2024-09-21T11:59:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:59:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:59:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:59:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:59:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:59:27.289 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:59:27.290 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:59:27.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.286+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f926407af80 msgr2=0x7f926407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.286+0000 7f9280fff640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f926407af80 0x7f926407d440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f926c0096c0 tx=0x7f926c031400 comp rx=0 tx=0).stop 2024-09-21T11:59:27.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.286+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 msgr2=0x7f927c19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.286+0000 7f9280fff640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 0x7f927c19dbb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f927000d6f0 tx=0x7f927000dbb0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.286+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 shutdown_connections 2024-09-21T11:59:27.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.286+0000 7f9280fff640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f926407af80 0x7f926407d440 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.286+0000 7f9280fff640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f927c107930 0x7f927c19dbb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.286+0000 7f9280fff640 1 --2- 172.21.15.118:0/1787124007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f927c101930 0x7f927c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.286+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 >> 172.21.15.118:0/1787124007 conn(0x7f927c0fd630 msgr2=0x7f927c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:27.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.287+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 shutdown_connections 2024-09-21T11:59:27.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.287+0000 7f9280fff640 1 -- 172.21.15.118:0/1787124007 wait complete. 2024-09-21T11:59:27.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.369+0000 7fb160c80640 1 -- 172.21.15.118:0/1887191296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 msgr2=0x7fb15c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.369+0000 7fb160c80640 1 --2- 172.21.15.118:0/1887191296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 0x7fb15c100c80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb150009880 tx=0x7fb15002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.369+0000 7fb160c80640 1 -- 172.21.15.118:0/1887191296 shutdown_connections 2024-09-21T11:59:27.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.369+0000 7fb160c80640 1 --2- 172.21.15.118:0/1887191296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 0x7fb15c100c80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.369+0000 7fb160c80640 1 --2- 172.21.15.118:0/1887191296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb15c106820 0x7fb15c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.369+0000 7fb160c80640 1 -- 172.21.15.118:0/1887191296 >> 172.21.15.118:0/1887191296 conn(0x7fb15c0fc520 msgr2=0x7fb15c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.369+0000 7fb160c80640 1 -- 172.21.15.118:0/1887191296 shutdown_connections 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.369+0000 7fb160c80640 1 -- 172.21.15.118:0/1887191296 wait complete. 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.370+0000 7fb160c80640 1 Processor -- start 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.370+0000 7fb160c80640 1 -- start start 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.370+0000 7fb160c80640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 0x7fb15c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.370+0000 7fb160c80640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb15c106820 0x7fb15c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.370+0000 7fb160c80640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c10dcf0 con 0x7fb15c100820 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.370+0000 7fb160c80640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c10db70 con 0x7fb15c106820 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.370+0000 7fb15a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 0x7fb15c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:27.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.370+0000 7fb15a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 0x7fb15c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42974/0 (socket says 172.21.15.118:42974) 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.370+0000 7fb15a59c640 1 -- 172.21.15.118:0/2031699454 learned_addr learned my addr 172.21.15.118:0/2031699454 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb159d9b640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb15c106820 0x7fb15c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb15a59c640 1 -- 172.21.15.118:0/2031699454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb15c106820 msgr2=0x7fb15c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb15a59c640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb15c106820 0x7fb15c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb15a59c640 1 -- 172.21.15.118:0/2031699454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15c199380 con 0x7fb15c100820 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb159d9b640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb15c106820 0x7fb15c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb15a59c640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 0x7fb15c198840 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00c8f0 tx=0x7fb14c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb14b7fe640 1 -- 172.21.15.118:0/2031699454 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb14c0079b0 con 0x7fb15c100820 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15c199670 con 0x7fb15c100820 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb14b7fe640 1 -- 172.21.15.118:0/2031699454 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb14c0054e0 con 0x7fb15c100820 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb14b7fe640 1 -- 172.21.15.118:0/2031699454 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb14c004dd0 con 0x7fb15c100820 2024-09-21T11:59:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.371+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15c1a1c70 con 0x7fb15c100820 2024-09-21T11:59:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.372+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb15c101f60 con 0x7fb15c100820 2024-09-21T11:59:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.373+0000 7fb14b7fe640 1 -- 172.21.15.118:0/2031699454 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb14c005020 con 0x7fb15c100820 2024-09-21T11:59:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.373+0000 7fb14b7fe640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb14407aed0 0x7fb14407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.373+0000 7fb14b7fe640 1 -- 172.21.15.118:0/2031699454 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb14c09e080 con 0x7fb15c100820 2024-09-21T11:59:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.373+0000 7fb159d9b640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb14407aed0 0x7fb14407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.374+0000 7fb159d9b640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb14407aed0 0x7fb14407d390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb150006010 tx=0x7fb1500095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.378+0000 7fb14b7fe640 1 -- 172.21.15.118:0/2031699454 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb15c199670 con 0x7fb15c100820 2024-09-21T11:59:27.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.579+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb15c062630 con 0x7fb14407aed0 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.581+0000 7fb14b7fe640 1 -- 172.21.15.118:0/2031699454 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fb15c062630 con 0x7fb14407aed0 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:59:27.583 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:59:27.584 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:59:27.584 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:59:27.584 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:59:27.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb14407aed0 msgr2=0x7fb14407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb14407aed0 0x7fb14407d390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb150006010 tx=0x7fb1500095f0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 msgr2=0x7fb15c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 0x7fb15c198840 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00c8f0 tx=0x7fb14c00cdb0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 shutdown_connections 2024-09-21T11:59:27.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb15c106820 0x7fb15c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb14407aed0 0x7fb14407d390 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 --2- 172.21.15.118:0/2031699454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb15c100820 0x7fb15c198840 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 >> 172.21.15.118:0/2031699454 conn(0x7fb15c0fc520 msgr2=0x7fb15c0fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:27.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 shutdown_connections 2024-09-21T11:59:27.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.583+0000 7fb160c80640 1 -- 172.21.15.118:0/2031699454 wait complete. 2024-09-21T11:59:27.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.663+0000 7feb15cd4640 1 -- 172.21.15.118:0/3372469836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 msgr2=0x7feb10100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.663+0000 7feb15cd4640 1 --2- 172.21.15.118:0/3372469836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 0x7feb10100c70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7feb04009880 tx=0x7feb0402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.663+0000 7feb15cd4640 1 -- 172.21.15.118:0/3372469836 shutdown_connections 2024-09-21T11:59:27.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.663+0000 7feb15cd4640 1 --2- 172.21.15.118:0/3372469836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 0x7feb10100c70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.663+0000 7feb15cd4640 1 --2- 172.21.15.118:0/3372469836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb10106810 0x7feb10106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.663+0000 7feb15cd4640 1 -- 172.21.15.118:0/3372469836 >> 172.21.15.118:0/3372469836 conn(0x7feb100fc510 msgr2=0x7feb100fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.663+0000 7feb15cd4640 1 -- 172.21.15.118:0/3372469836 shutdown_connections 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.663+0000 7feb15cd4640 1 -- 172.21.15.118:0/3372469836 wait complete. 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb15cd4640 1 Processor -- start 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb15cd4640 1 -- start start 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb15cd4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 0x7feb101965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb15cd4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb10106810 0x7feb10196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb15cd4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7feb1010dce0 con 0x7feb10100810 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb15cd4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feb1010db60 con 0x7feb10106810 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb0f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 0x7feb101965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb0f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 0x7feb101965e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42994/0 (socket says 172.21.15.118:42994) 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb0f7fe640 1 -- 172.21.15.118:0/393611601 learned_addr learned my addr 172.21.15.118:0/393611601 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:27.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb0effd640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb10106810 0x7feb10196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:27.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb0f7fe640 1 -- 172.21.15.118:0/393611601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb10106810 msgr2=0x7feb10196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb0f7fe640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb10106810 0x7feb10196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.664+0000 7feb0f7fe640 1 -- 172.21.15.118:0/393611601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb10197060 con 0x7feb10100810 2024-09-21T11:59:27.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.665+0000 7feb0f7fe640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 0x7feb101965e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feb0000cc60 tx=0x7feb0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:27.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.665+0000 7feb0cff9640 1 -- 172.21.15.118:0/393611601 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb0000ad30 con 0x7feb10100810 2024-09-21T11:59:27.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.665+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb10197350 con 0x7feb10100810 2024-09-21T11:59:27.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.665+0000 7feb0cff9640 1 -- 172.21.15.118:0/393611601 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb00005020 con 0x7feb10100810 2024-09-21T11:59:27.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.665+0000 7feb0cff9640 1 -- 172.21.15.118:0/393611601 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb0000f640 con 0x7feb10100810 2024-09-21T11:59:27.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.665+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb101a3e20 con 0x7feb10100810 2024-09-21T11:59:27.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.666+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb10101f50 con 0x7feb10100810 2024-09-21T11:59:27.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.666+0000 7feb0cff9640 1 -- 172.21.15.118:0/393611601 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7feb00004b20 con 0x7feb10100810 2024-09-21T11:59:27.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.667+0000 7feb0cff9640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feaf807af30 0x7feaf807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:27.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.667+0000 7feb0cff9640 1 -- 172.21.15.118:0/393611601 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7feb0009e2a0 con 0x7feb10100810 2024-09-21T11:59:27.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.667+0000 7feb0effd640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feaf807af30 0x7feaf807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:27.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.667+0000 7feb0effd640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feaf807af30 0x7feaf807d3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feb10198740 tx=0x7feb04031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:27.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.671+0000 7feb0cff9640 1 -- 172.21.15.118:0/393611601 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb00014030 con 0x7feb10100810 2024-09-21T11:59:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:27 smithi118 ceph-mon[111738]: from='client.34948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:27 smithi118 ceph-mon[111738]: from='client.34952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:27 smithi118 ceph-mon[111738]: pgmap v618: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:27 smithi118 ceph-mon[111738]: from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:27 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1156535028' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:59:27.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:27 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1787124007' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:59:27.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.920+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7feb10108db0 con 0x7feb10100810 2024-09-21T11:59:27.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.920+0000 7feb0cff9640 1 -- 172.21.15.118:0/393611601 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7feb000697f0 con 0x7feb10100810 2024-09-21T11:59:27.923 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T11:59:27.923 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T11:59:27.923 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T11:59:27.923 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T11:59:27.923 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T11:59:27.923 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T11:59:27.923 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T11:59:27.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feaf807af30 msgr2=0x7feaf807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feaf807af30 0x7feaf807d3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feb10198740 tx=0x7feb04031400 comp rx=0 tx=0).stop 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 msgr2=0x7feb101965e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 0x7feb101965e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feb0000cc60 tx=0x7feb0000a620 comp rx=0 tx=0).stop 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 shutdown_connections 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb10106810 0x7feb10196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feaf807af30 0x7feaf807d3f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 --2- 172.21.15.118:0/393611601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb10100810 0x7feb101965e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 >> 172.21.15.118:0/393611601 conn(0x7feb100fc510 msgr2=0x7feb100fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.922+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 shutdown_connections 2024-09-21T11:59:27.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:27.923+0000 7feb15cd4640 1 -- 172.21.15.118:0/393611601 wait complete. 2024-09-21T11:59:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:27 smithi149 ceph-mon[79770]: from='client.34948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:27 smithi149 ceph-mon[79770]: from='client.34952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:27 smithi149 ceph-mon[79770]: pgmap v618: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:27 smithi149 ceph-mon[79770]: from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:27 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1156535028' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:59:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:27 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1787124007' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:59:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:28 smithi118 ceph-mon[111738]: from='client.34968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:28 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/393611601' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:59:28.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:28 smithi149 ceph-mon[79770]: from='client.34968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:28.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:28 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/393611601' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T11:59:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:29 smithi118 ceph-mon[111738]: pgmap v619: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:29.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:29 smithi149 ceph-mon[79770]: pgmap v619: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:31.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:31 smithi118 ceph-mon[111738]: pgmap v620: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:31.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:31 smithi149 ceph-mon[79770]: pgmap v620: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:33 smithi118 ceph-mon[111738]: pgmap v621: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:33.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:33 smithi149 ceph-mon[79770]: pgmap v621: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:35 smithi118 ceph-mon[111738]: pgmap v622: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:59:35.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:35 smithi149 ceph-mon[79770]: pgmap v622: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:35.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:59:37.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:37 smithi118 ceph-mon[111738]: pgmap v623: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:37 smithi149 ceph-mon[79770]: pgmap v623: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:39.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:39 smithi118 ceph-mon[111738]: pgmap v624: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:39.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:39 smithi149 ceph-mon[79770]: pgmap v624: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:41 smithi149 ceph-mon[79770]: pgmap v625: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:41 smithi118 ceph-mon[111738]: pgmap v625: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:43.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:43 smithi149 ceph-mon[79770]: pgmap v626: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:43 smithi118 ceph-mon[111738]: pgmap v626: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:45.849 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:45 smithi118 ceph-mon[111738]: pgmap v627: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:45.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:45 smithi149 ceph-mon[79770]: pgmap v627: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:47.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:47 smithi149 ceph-mon[79770]: pgmap v628: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:47 smithi118 ceph-mon[111738]: pgmap v628: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:49.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:49 smithi149 ceph-mon[79770]: pgmap v629: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:49 smithi118 ceph-mon[111738]: pgmap v629: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:50.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:59:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T11:59:51.861 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:51 smithi118 ceph-mon[111738]: pgmap v630: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:51.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:51 smithi149 ceph-mon[79770]: pgmap v630: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:53.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:53 smithi149 ceph-mon[79770]: pgmap v631: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:53 smithi118 ceph-mon[111738]: pgmap v631: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:55.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:55 smithi149 ceph-mon[79770]: pgmap v632: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:56.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:55 smithi118 ceph-mon[111738]: pgmap v632: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:57.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:57 smithi149 ceph-mon[79770]: pgmap v633: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:58.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 -- 172.21.15.118:0/640807597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 msgr2=0x7f579010dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 --2- 172.21.15.118:0/640807597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 0x7f579010dc30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5778009880 tx=0x7f577802a530 comp rx=0 tx=0).stop 2024-09-21T11:59:58.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 -- 172.21.15.118:0/640807597 shutdown_connections 2024-09-21T11:59:58.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 --2- 172.21.15.118:0/640807597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 0x7f579010dc30 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 --2- 172.21.15.118:0/640807597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790074620 0x7f5790074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 -- 172.21.15.118:0/640807597 >> 172.21.15.118:0/640807597 conn(0x7f57900fd630 msgr2=0x7f57900ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:58.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 -- 172.21.15.118:0/640807597 shutdown_connections 2024-09-21T11:59:58.013 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:57 smithi118 ceph-mon[111738]: pgmap v633: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:58.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 -- 172.21.15.118:0/640807597 wait complete. 2024-09-21T11:59:58.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 Processor -- start 2024-09-21T11:59:58.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 -- start start 2024-09-21T11:59:58.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790074620 0x7f579019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 0x7f579019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5790111000 con 0x7f5790074f40 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.011+0000 7f579696f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5790110e80 con 0x7f5790074620 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f5787fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 0x7f579019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f5787fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 0x7f579019fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33744/0 (socket says 172.21.15.118:33744) 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f5787fff640 1 -- 172.21.15.118:0/3188050002 learned_addr learned my addr 172.21.15.118:0/3188050002 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f578ffff640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790074620 0x7f579019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f5787fff640 1 -- 172.21.15.118:0/3188050002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790074620 msgr2=0x7f579019f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f5787fff640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790074620 0x7f579019f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f5787fff640 1 -- 172.21.15.118:0/3188050002 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57901999f0 con 0x7f5790074f40 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f5787fff640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 0x7f579019fd70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5778031460 tx=0x7f57780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f578dffb640 1 -- 172.21.15.118:0/3188050002 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f577803f070 con 0x7f5790074f40 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5790199c80 con 0x7f5790074f40 2024-09-21T11:59:58.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f578dffb640 1 -- 172.21.15.118:0/3188050002 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5778004cf0 con 0x7f5790074f40 2024-09-21T11:59:58.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f578dffb640 1 -- 172.21.15.118:0/3188050002 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5778035030 con 0x7f5790074f40 2024-09-21T11:59:58.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.012+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579019a1b0 con 0x7f5790074f40 2024-09-21T11:59:58.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.013+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5790075cd0 con 0x7f5790074f40 2024-09-21T11:59:58.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.014+0000 7f578dffb640 1 -- 172.21.15.118:0/3188050002 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5778042070 con 0x7f5790074f40 2024-09-21T11:59:58.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.015+0000 7f578dffb640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f577c07af30 0x7f577c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.015+0000 7f578dffb640 1 -- 172.21.15.118:0/3188050002 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f57780beac0 con 0x7f5790074f40 2024-09-21T11:59:58.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.015+0000 7f578ffff640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f577c07af30 0x7f577c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.015+0000 7f578ffff640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f577c07af30 0x7f577c07d3f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57800058c0 tx=0x7f578000a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:58.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.019+0000 7f578dffb640 1 -- 172.21.15.118:0/3188050002 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f577808a010 con 0x7f5790074f40 2024-09-21T11:59:58.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.213+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f579010b2a0 con 0x7f577c07af30 2024-09-21T11:59:58.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.214+0000 7f578dffb640 1 -- 172.21.15.118:0/3188050002 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f578000fb30 con 0x7f577c07af30 2024-09-21T11:59:58.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.216+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f577c07af30 msgr2=0x7f577c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.216+0000 7f579696f640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f577c07af30 0x7f577c07d3f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57800058c0 tx=0x7f578000a2d0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.216+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 msgr2=0x7f579019fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.216+0000 7f579696f640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 0x7f579019fd70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5778031460 tx=0x7f57780048f0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.217+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 shutdown_connections 2024-09-21T11:59:58.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.217+0000 7f579696f640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f577c07af30 0x7f577c07d3f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.217+0000 7f579696f640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5790074f40 0x7f579019fd70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.217+0000 7f579696f640 1 --2- 172.21.15.118:0/3188050002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5790074620 0x7f579019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.217+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 >> 172.21.15.118:0/3188050002 conn(0x7f57900fd630 msgr2=0x7f5790108400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:58.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.217+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 shutdown_connections 2024-09-21T11:59:58.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.217+0000 7f579696f640 1 -- 172.21.15.118:0/3188050002 wait complete. 2024-09-21T11:59:58.227 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T11:59:58.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.299+0000 7f536c710640 1 -- 172.21.15.118:0/3739965078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53640ffd70 msgr2=0x7f53641001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.299+0000 7f536c710640 1 --2- 172.21.15.118:0/3739965078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53640ffd70 0x7f53641001d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5354009880 tx=0x7f535402a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.299+0000 7f536c710640 1 -- 172.21.15.118:0/3739965078 shutdown_connections 2024-09-21T11:59:58.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.299+0000 7f536c710640 1 --2- 172.21.15.118:0/3739965078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53640ffd70 0x7f53641001d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.299+0000 7f536c710640 1 --2- 172.21.15.118:0/3739965078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5364106950 0x7f5364106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.299+0000 7f536c710640 1 -- 172.21.15.118:0/3739965078 >> 172.21.15.118:0/3739965078 conn(0x7f53640fbc60 msgr2=0x7f53640fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:58.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.299+0000 7f536c710640 1 -- 172.21.15.118:0/3739965078 shutdown_connections 2024-09-21T11:59:58.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.299+0000 7f536c710640 1 -- 172.21.15.118:0/3739965078 wait complete. 2024-09-21T11:59:58.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f536c710640 1 Processor -- start 2024-09-21T11:59:58.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f536c710640 1 -- start start 2024-09-21T11:59:58.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f536c710640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53640ffd70 0x7f536419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f536c710640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5364106950 0x7f536419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f536c710640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f536410eef0 con 0x7f5364106950 2024-09-21T11:59:58.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f536c710640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f536410ed70 con 0x7f53640ffd70 2024-09-21T11:59:58.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f5369cab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5364106950 0x7f536419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f5369cab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5364106950 0x7f536419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33766/0 (socket says 172.21.15.118:33766) 2024-09-21T11:59:58.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f5369cab640 1 -- 172.21.15.118:0/963584578 learned_addr learned my addr 172.21.15.118:0/963584578 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:58.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.300+0000 7f536a4ac640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53640ffd70 0x7f536419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f5369cab640 1 -- 172.21.15.118:0/963584578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53640ffd70 msgr2=0x7f536419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f5369cab640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53640ffd70 0x7f536419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f5369cab640 1 -- 172.21.15.118:0/963584578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5364197880 con 0x7f5364106950 2024-09-21T11:59:58.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f536a4ac640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53640ffd70 0x7f536419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T11:59:58.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f5369cab640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5364106950 0x7f536419dc00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5354031460 tx=0x7f53540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:58.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f535b7fe640 1 -- 172.21.15.118:0/963584578 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f535403f070 con 0x7f5364106950 2024-09-21T11:59:58.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f535b7fe640 1 -- 172.21.15.118:0/963584578 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53540035f0 con 0x7f5364106950 2024-09-21T11:59:58.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5364197b10 con 0x7f5364106950 2024-09-21T11:59:58.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f535b7fe640 1 -- 172.21.15.118:0/963584578 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5354035030 con 0x7f5364106950 2024-09-21T11:59:58.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.301+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5364198040 con 0x7f5364106950 2024-09-21T11:59:58.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.302+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5364103090 con 0x7f5364106950 2024-09-21T11:59:58.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.303+0000 7f535b7fe640 1 -- 172.21.15.118:0/963584578 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5354042070 con 0x7f5364106950 2024-09-21T11:59:58.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.303+0000 7f535b7fe640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f535007af30 0x7f535007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.303+0000 7f535b7fe640 1 -- 172.21.15.118:0/963584578 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f53540bea20 con 0x7f5364106950 2024-09-21T11:59:58.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.303+0000 7f536a4ac640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f535007af30 0x7f535007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.304+0000 7f536a4ac640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f535007af30 0x7f535007d3f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53641989c0 tx=0x7f536000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:58.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.308+0000 7f535b7fe640 1 -- 172.21.15.118:0/963584578 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5354089f70 con 0x7f5364106950 2024-09-21T11:59:58.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.504+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5364198db0 con 0x7f535007af30 2024-09-21T11:59:58.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.505+0000 7f535b7fe640 1 -- 172.21.15.118:0/963584578 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5364198db0 con 0x7f535007af30 2024-09-21T11:59:58.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f535007af30 msgr2=0x7f535007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f535007af30 0x7f535007d3f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53641989c0 tx=0x7f536000b390 comp rx=0 tx=0).stop 2024-09-21T11:59:58.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5364106950 msgr2=0x7f536419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5364106950 0x7f536419dc00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5354031460 tx=0x7f53540045e0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 shutdown_connections 2024-09-21T11:59:58.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f535007af30 0x7f535007d3f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5364106950 0x7f536419dc00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 --2- 172.21.15.118:0/963584578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53640ffd70 0x7f536419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 >> 172.21.15.118:0/963584578 conn(0x7f53640fbc60 msgr2=0x7f53640fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:58.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 shutdown_connections 2024-09-21T11:59:58.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.507+0000 7f536c710640 1 -- 172.21.15.118:0/963584578 wait complete. 2024-09-21T11:59:58.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.589+0000 7f84ca15f640 1 -- 172.21.15.118:0/2888507303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41007e0 msgr2=0x7f84c4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.589+0000 7f84ca15f640 1 --2- 172.21.15.118:0/2888507303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41007e0 0x7f84c4100c40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009880 tx=0x7f84ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.589+0000 7f84ca15f640 1 -- 172.21.15.118:0/2888507303 shutdown_connections 2024-09-21T11:59:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.589+0000 7f84ca15f640 1 --2- 172.21.15.118:0/2888507303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41007e0 0x7f84c4100c40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.589+0000 7f84ca15f640 1 --2- 172.21.15.118:0/2888507303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c41067e0 0x7f84c4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.589+0000 7f84ca15f640 1 -- 172.21.15.118:0/2888507303 >> 172.21.15.118:0/2888507303 conn(0x7f84c40fc4c0 msgr2=0x7f84c40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.589+0000 7f84ca15f640 1 -- 172.21.15.118:0/2888507303 shutdown_connections 2024-09-21T11:59:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.589+0000 7f84ca15f640 1 -- 172.21.15.118:0/2888507303 wait complete. 2024-09-21T11:59:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.589+0000 7f84ca15f640 1 Processor -- start 2024-09-21T11:59:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84ca15f640 1 -- start start 2024-09-21T11:59:58.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84ca15f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c41007e0 0x7f84c41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84ca15f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41067e0 0x7f84c4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84ca15f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f84c410dcb0 con 0x7f84c41067e0 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84ca15f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f84c410db30 con 0x7f84c41007e0 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84bbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41067e0 0x7f84c4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84bbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41067e0 0x7f84c4198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33782/0 (socket says 172.21.15.118:33782) 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84bbfff640 1 -- 172.21.15.118:0/170092531 learned_addr learned my addr 172.21.15.118:0/170092531 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84c37fe640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c41007e0 0x7f84c41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84bbfff640 1 -- 172.21.15.118:0/170092531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c41007e0 msgr2=0x7f84c41987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84bbfff640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c41007e0 0x7f84c41987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84bbfff640 1 -- 172.21.15.118:0/170092531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c4199320 con 0x7f84c41067e0 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84c37fe640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c41007e0 0x7f84c41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84bbfff640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41067e0 0x7f84c4198d20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f84ac031460 tx=0x7f84ac0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.590+0000 7f84c17fa640 1 -- 172.21.15.118:0/170092531 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84ac03f070 con 0x7f84c41067e0 2024-09-21T11:59:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.591+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c41995b0 con 0x7f84c41067e0 2024-09-21T11:59:58.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.591+0000 7f84c17fa640 1 -- 172.21.15.118:0/170092531 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84ac0035f0 con 0x7f84c41067e0 2024-09-21T11:59:58.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.591+0000 7f84c17fa640 1 -- 172.21.15.118:0/170092531 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84ac035030 con 0x7f84c41067e0 2024-09-21T11:59:58.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.591+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c41a1b60 con 0x7f84c41067e0 2024-09-21T11:59:58.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.592+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c4101f20 con 0x7f84c41067e0 2024-09-21T11:59:58.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.592+0000 7f84c17fa640 1 -- 172.21.15.118:0/170092531 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f84ac042070 con 0x7f84c41067e0 2024-09-21T11:59:58.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.593+0000 7f84c17fa640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84b007af30 0x7f84b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.593+0000 7f84c37fe640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84b007af30 0x7f84b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.593+0000 7f84c17fa640 1 -- 172.21.15.118:0/170092531 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f84ac0bead0 con 0x7f84c41067e0 2024-09-21T11:59:58.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.593+0000 7f84c37fe640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84b007af30 0x7f84b007d3f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f84b40058c0 tx=0x7f84b4005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:58.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.597+0000 7f84c17fa640 1 -- 172.21.15.118:0/170092531 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84ac08a020 con 0x7f84c41067e0 2024-09-21T11:59:58.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.783+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f84c4062630 con 0x7f84b007af30 2024-09-21T11:59:58.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.793+0000 7f84c17fa640 1 -- 172.21.15.118:0/170092531 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f84c4062630 con 0x7f84b007af30 2024-09-21T11:59:58.794 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T11:59:58.794 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (17m) 11m ago 28m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T11:59:58.794 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (20m) 11m ago 29m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T11:59:58.794 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (20m) 11m ago 28m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T11:59:58.794 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (16m) 11m ago 29m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (15m) 11m ago 28m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (17m) 11m ago 28m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (12m) 11m ago 23m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (12m) 11m ago 23m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (23m) 11m ago 23m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (11m) 11m ago 23m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (20m) 11m ago 30m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (19m) 11m ago 28m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (16m) 11m ago 30m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (16m) 11m ago 27m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (18m) 11m ago 28m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (18m) 11m ago 28m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (15m) 11m ago 26m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T11:59:58.795 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (14m) 11m ago 26m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T11:59:58.796 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (14m) 11m ago 25m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T11:59:58.796 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (13m) 11m ago 25m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T11:59:58.796 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (13m) 11m ago 24m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T11:59:58.796 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (12m) 11m ago 24m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T11:59:58.796 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (18m) 11m ago 28m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T11:59:58.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84b007af30 msgr2=0x7f84b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84b007af30 0x7f84b007d3f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f84b40058c0 tx=0x7f84b4005850 comp rx=0 tx=0).stop 2024-09-21T11:59:58.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41067e0 msgr2=0x7f84c4198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41067e0 0x7f84c4198d20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f84ac031460 tx=0x7f84ac0045e0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 shutdown_connections 2024-09-21T11:59:58.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f84b007af30 0x7f84b007d3f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84c41067e0 0x7f84c4198d20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 --2- 172.21.15.118:0/170092531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84c41007e0 0x7f84c41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 >> 172.21.15.118:0/170092531 conn(0x7f84c40fc4c0 msgr2=0x7f84c40fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:58.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 shutdown_connections 2024-09-21T11:59:58.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.795+0000 7f84ca15f640 1 -- 172.21.15.118:0/170092531 wait complete. 2024-09-21T11:59:58.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.875+0000 7f0ce6923640 1 -- 172.21.15.118:0/187467457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01067e0 msgr2=0x7f0ce0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.875+0000 7f0ce6923640 1 --2- 172.21.15.118:0/187467457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01067e0 0x7f0ce0106bc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009880 tx=0x7f0cd002a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.875+0000 7f0ce6923640 1 -- 172.21.15.118:0/187467457 shutdown_connections 2024-09-21T11:59:58.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.875+0000 7f0ce6923640 1 --2- 172.21.15.118:0/187467457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ce01007e0 0x7f0ce0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.875+0000 7f0ce6923640 1 --2- 172.21.15.118:0/187467457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01067e0 0x7f0ce0106bc0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.875+0000 7f0ce6923640 1 -- 172.21.15.118:0/187467457 >> 172.21.15.118:0/187467457 conn(0x7f0ce00fc4c0 msgr2=0x7f0ce00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.876+0000 7f0ce6923640 1 -- 172.21.15.118:0/187467457 shutdown_connections 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.876+0000 7f0ce6923640 1 -- 172.21.15.118:0/187467457 wait complete. 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.876+0000 7f0ce6923640 1 Processor -- start 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.876+0000 7f0ce6923640 1 -- start start 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0ce6923640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01007e0 0x7f0ce019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0ce6923640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ce01067e0 0x7f0ce019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0ce6923640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce010dc90 con 0x7f0ce01007e0 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0ce6923640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce010db10 con 0x7f0ce01067e0 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01007e0 0x7f0ce019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01007e0 0x7f0ce019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33790/0 (socket says 172.21.15.118:33790) 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdffff640 1 -- 172.21.15.118:0/1436868486 learned_addr learned my addr 172.21.15.118:0/1436868486 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:58.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdf7fe640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ce01067e0 0x7f0ce019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdffff640 1 -- 172.21.15.118:0/1436868486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ce01067e0 msgr2=0x7f0ce019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdffff640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ce01067e0 0x7f0ce019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdffff640 1 -- 172.21.15.118:0/1436868486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce01a03d0 con 0x7f0ce01007e0 2024-09-21T11:59:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdffff640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01007e0 0x7f0ce019f7e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0031460 tx=0x7f0cd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdd7fa640 1 -- 172.21.15.118:0/1436868486 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0cd003f070 con 0x7f0ce01007e0 2024-09-21T11:59:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0cdd7fa640 1 -- 172.21.15.118:0/1436868486 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0cd0004cf0 con 0x7f0ce01007e0 2024-09-21T11:59:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.877+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce0199a60 con 0x7f0ce01007e0 2024-09-21T11:59:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.878+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce0199f60 con 0x7f0ce01007e0 2024-09-21T11:59:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.878+0000 7f0cdd7fa640 1 -- 172.21.15.118:0/1436868486 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0cd0035030 con 0x7f0ce01007e0 2024-09-21T11:59:58.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.879+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce0101f20 con 0x7f0ce01007e0 2024-09-21T11:59:58.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.879+0000 7f0cdd7fa640 1 -- 172.21.15.118:0/1436868486 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0cd0042070 con 0x7f0ce01007e0 2024-09-21T11:59:58.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.880+0000 7f0cdd7fa640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cc807af30 0x7f0cc807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:58.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.880+0000 7f0cdd7fa640 1 -- 172.21.15.118:0/1436868486 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0cd00beb70 con 0x7f0ce01007e0 2024-09-21T11:59:58.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.880+0000 7f0cdf7fe640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cc807af30 0x7f0cc807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:58.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.881+0000 7f0cdf7fe640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cc807af30 0x7f0cc807d3f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4005e10 tx=0x7f0cd4005da0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:58.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:58.884+0000 7f0cdd7fa640 1 -- 172.21.15.118:0/1436868486 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0cd008a0c0 con 0x7f0ce01007e0 2024-09-21T11:59:59.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.132+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0ce019a2d0 con 0x7f0ce01007e0 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.132+0000 7f0cdd7fa640 1 -- 172.21.15.118:0/1436868486 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f0cd008c5e0 con 0x7f0ce01007e0 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T11:59:59.134 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:59:59.135 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T11:59:59.135 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T11:59:59.135 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T11:59:59.135 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T11:59:59.135 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T11:59:59.135 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T11:59:59.135 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.134+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cc807af30 msgr2=0x7f0cc807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.134+0000 7f0ce6923640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cc807af30 0x7f0cc807d3f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4005e10 tx=0x7f0cd4005da0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.134+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01007e0 msgr2=0x7f0ce019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.134+0000 7f0ce6923640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01007e0 0x7f0ce019f7e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0031460 tx=0x7f0cd00048f0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.134+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 shutdown_connections 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.134+0000 7f0ce6923640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ce01067e0 0x7f0ce019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.134+0000 7f0ce6923640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cc807af30 0x7f0cc807d3f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.135+0000 7f0ce6923640 1 --2- 172.21.15.118:0/1436868486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ce01007e0 0x7f0ce019f7e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.135+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 >> 172.21.15.118:0/1436868486 conn(0x7f0ce00fc4c0 msgr2=0x7f0ce0069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.135+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 shutdown_connections 2024-09-21T11:59:59.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.135+0000 7f0ce6923640 1 -- 172.21.15.118:0/1436868486 wait complete. 2024-09-21T11:59:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.216+0000 7f701506f640 1 -- 172.21.15.118:0/1466361502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010101930 msgr2=0x7f7010101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.216+0000 7f701506f640 1 --2- 172.21.15.118:0/1466361502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010101930 0x7f7010101d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009880 tx=0x7f6ff802a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.216+0000 7f701506f640 1 -- 172.21.15.118:0/1466361502 shutdown_connections 2024-09-21T11:59:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.216+0000 7f701506f640 1 --2- 172.21.15.118:0/1466361502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010101930 0x7f7010101d90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.216+0000 7f701506f640 1 --2- 172.21.15.118:0/1466361502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7010107930 0x7f7010107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.216+0000 7f701506f640 1 -- 172.21.15.118:0/1466361502 >> 172.21.15.118:0/1466361502 conn(0x7f70100fd630 msgr2=0x7f70100ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.216+0000 7f701506f640 1 -- 172.21.15.118:0/1466361502 shutdown_connections 2024-09-21T11:59:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.216+0000 7f701506f640 1 -- 172.21.15.118:0/1466361502 wait complete. 2024-09-21T11:59:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f701506f640 1 Processor -- start 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f701506f640 1 -- start start 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f701506f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7010101930 0x7f701019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f701506f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010107930 0x7f701019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f701506f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f701010ee60 con 0x7f7010107930 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f701506f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f701010ece0 con 0x7f7010101930 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f700e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010107930 0x7f701019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f700e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010107930 0x7f701019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33806/0 (socket says 172.21.15.118:33806) 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f700e59c640 1 -- 172.21.15.118:0/4045570586 learned_addr learned my addr 172.21.15.118:0/4045570586 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f700ed9d640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7010101930 0x7f701019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f700e59c640 1 -- 172.21.15.118:0/4045570586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7010101930 msgr2=0x7f701019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f700e59c640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7010101930 0x7f701019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.217+0000 7f700e59c640 1 -- 172.21.15.118:0/4045570586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7010197870 con 0x7f7010107930 2024-09-21T11:59:59.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.218+0000 7f700e59c640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010107930 0x7f701019dbf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8031460 tx=0x7f6ff80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:59.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.218+0000 7f7007fff640 1 -- 172.21.15.118:0/4045570586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ff803f070 con 0x7f7010107930 2024-09-21T11:59:59.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.218+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7010197b00 con 0x7f7010107930 2024-09-21T11:59:59.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.218+0000 7f7007fff640 1 -- 172.21.15.118:0/4045570586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ff8004cf0 con 0x7f7010107930 2024-09-21T11:59:59.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.218+0000 7f7007fff640 1 -- 172.21.15.118:0/4045570586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ff8035030 con 0x7f7010107930 2024-09-21T11:59:59.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.218+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7010198030 con 0x7f7010107930 2024-09-21T11:59:59.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.219+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7010103070 con 0x7f7010107930 2024-09-21T11:59:59.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.219+0000 7f7007fff640 1 -- 172.21.15.118:0/4045570586 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6ff8042070 con 0x7f7010107930 2024-09-21T11:59:59.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.220+0000 7f7007fff640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ffc07f340 0x7f6ffc081800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:59.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.220+0000 7f7007fff640 1 -- 172.21.15.118:0/4045570586 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f6ff80beb40 con 0x7f7010107930 2024-09-21T11:59:59.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.220+0000 7f700ed9d640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ffc07f340 0x7f6ffc081800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:59.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.221+0000 7f700ed9d640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ffc07f340 0x7f6ffc081800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f70101989b0 tx=0x7f7000009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:59.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.224+0000 7f7007fff640 1 -- 172.21.15.118:0/4045570586 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ff808a090 con 0x7f7010107930 2024-09-21T11:59:59.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.437+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7010198da0 con 0x7f7010107930 2024-09-21T11:59:59.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.437+0000 7f7007fff640 1 -- 172.21.15.118:0/4045570586 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f6ff808ef40 con 0x7f7010107930 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T11:59:59.439 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T11:59:59.440 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:59:59.441 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:59:59.442 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T11:59:59.442 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T11:59:59.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.439+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ffc07f340 msgr2=0x7f6ffc081800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.439+0000 7f701506f640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ffc07f340 0x7f6ffc081800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f70101989b0 tx=0x7f7000009110 comp rx=0 tx=0).stop 2024-09-21T11:59:59.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.439+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010107930 msgr2=0x7f701019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.439+0000 7f701506f640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010107930 0x7f701019dbf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8031460 tx=0x7f6ff80048f0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.439+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 shutdown_connections 2024-09-21T11:59:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.439+0000 7f701506f640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6ffc07f340 0x7f6ffc081800 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.440+0000 7f701506f640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7010107930 0x7f701019dbf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.440+0000 7f701506f640 1 --2- 172.21.15.118:0/4045570586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7010101930 0x7f701019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.440+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 >> 172.21.15.118:0/4045570586 conn(0x7f70100fd630 msgr2=0x7f70100fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.440+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 shutdown_connections 2024-09-21T11:59:59.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.440+0000 7f701506f640 1 -- 172.21.15.118:0/4045570586 wait complete. 2024-09-21T11:59:59.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.521+0000 7fa2ff102640 1 -- 172.21.15.118:0/1312236891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8107930 msgr2=0x7fa2f8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.521+0000 7fa2ff102640 1 --2- 172.21.15.118:0/1312236891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8107930 0x7fa2f8107d10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009880 tx=0x7fa2ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.521+0000 7fa2ff102640 1 -- 172.21.15.118:0/1312236891 shutdown_connections 2024-09-21T11:59:59.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.521+0000 7fa2ff102640 1 --2- 172.21.15.118:0/1312236891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f8101930 0x7fa2f8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.521+0000 7fa2ff102640 1 --2- 172.21.15.118:0/1312236891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8107930 0x7fa2f8107d10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.521+0000 7fa2ff102640 1 -- 172.21.15.118:0/1312236891 >> 172.21.15.118:0/1312236891 conn(0x7fa2f80fd630 msgr2=0x7fa2f80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:59.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.521+0000 7fa2ff102640 1 -- 172.21.15.118:0/1312236891 shutdown_connections 2024-09-21T11:59:59.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.521+0000 7fa2ff102640 1 -- 172.21.15.118:0/1312236891 wait complete. 2024-09-21T11:59:59.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2ff102640 1 Processor -- start 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2ff102640 1 -- start start 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2ff102640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8101930 0x7fa2f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2ff102640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f8107930 0x7fa2f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2ff102640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f810ee60 con 0x7fa2f8101930 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2ff102640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f810ece0 con 0x7fa2f8107930 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2fce9e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8101930 0x7fa2f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2fce9e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8101930 0x7fa2f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33822/0 (socket says 172.21.15.118:33822) 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2fce9e640 1 -- 172.21.15.118:0/1140370615 learned_addr learned my addr 172.21.15.118:0/1140370615 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2fce9e640 1 -- 172.21.15.118:0/1140370615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f8107930 msgr2=0x7fa2f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2f7fff640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f8107930 0x7fa2f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2fce9e640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f8107930 0x7fa2f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2fce9e640 1 -- 172.21.15.118:0/1140370615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f8074f70 con 0x7fa2f8101930 2024-09-21T11:59:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2f7fff640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f8107930 0x7fa2f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:59:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.522+0000 7fa2fce9e640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8101930 0x7fa2f80744f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec031460 tx=0x7fa2ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.523+0000 7fa2f5ffb640 1 -- 172.21.15.118:0/1140370615 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2ec03f070 con 0x7fa2f8101930 2024-09-21T11:59:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.523+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f8075200 con 0x7fa2f8101930 2024-09-21T11:59:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.523+0000 7fa2f5ffb640 1 -- 172.21.15.118:0/1140370615 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2ec004cf0 con 0x7fa2f8101930 2024-09-21T11:59:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.523+0000 7fa2f5ffb640 1 -- 172.21.15.118:0/1140370615 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2ec035030 con 0x7fa2f8101930 2024-09-21T11:59:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.523+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f81a3e50 con 0x7fa2f8101930 2024-09-21T11:59:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.524+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f8103070 con 0x7fa2f8101930 2024-09-21T11:59:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.524+0000 7fa2f5ffb640 1 -- 172.21.15.118:0/1140370615 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa2ec042070 con 0x7fa2f8101930 2024-09-21T11:59:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.525+0000 7fa2f5ffb640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2e807af30 0x7fa2e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.525+0000 7fa2f7fff640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2e807af30 0x7fa2e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.525+0000 7fa2f5ffb640 1 -- 172.21.15.118:0/1140370615 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fa2ec0bec20 con 0x7fa2f8101930 2024-09-21T11:59:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.526+0000 7fa2f7fff640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2e807af30 0x7fa2e807d3f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4006fd0 tx=0x7fa2e4008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:59.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.529+0000 7fa2f5ffb640 1 -- 172.21.15.118:0/1140370615 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa2ec08a170 con 0x7fa2f8101930 2024-09-21T11:59:59.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.727+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa2f8062630 con 0x7fa2e807af30 2024-09-21T11:59:59.730 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:59 smithi118 ceph-mon[111738]: from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:59.730 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:59 smithi118 ceph-mon[111738]: pgmap v634: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:59.730 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:59 smithi118 ceph-mon[111738]: from='client.34980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:59.730 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:59 smithi118 ceph-mon[111738]: from='client.34984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:59.730 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:59 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1436868486' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:59:59.730 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 11:59:59 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/4045570586' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T11:59:59.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.729+0000 7fa2f5ffb640 1 -- 172.21.15.118:0/1140370615 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa2f8062630 con 0x7fa2e807af30 2024-09-21T11:59:59.731 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T11:59:59.731 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T11:59:59.731 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T11:59:59.731 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T11:59:59.731 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T11:59:59.731 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T11:59:59.731 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T11:59:59.731 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T11:59:59.732 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T11:59:59.732 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T11:59:59.732 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T11:59:59.732 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T11:59:59.732 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T11:59:59.732 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T11:59:59.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.731+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2e807af30 msgr2=0x7fa2e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.731+0000 7fa2ff102640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2e807af30 0x7fa2e807d3f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4006fd0 tx=0x7fa2e4008040 comp rx=0 tx=0).stop 2024-09-21T11:59:59.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.731+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8101930 msgr2=0x7fa2f80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.731+0000 7fa2ff102640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8101930 0x7fa2f80744f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec031460 tx=0x7fa2ec0048f0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.732+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 shutdown_connections 2024-09-21T11:59:59.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.732+0000 7fa2ff102640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f8107930 0x7fa2f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.732+0000 7fa2ff102640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2e807af30 0x7fa2e807d3f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.732+0000 7fa2ff102640 1 --2- 172.21.15.118:0/1140370615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2f8101930 0x7fa2f80744f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.732+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 >> 172.21.15.118:0/1140370615 conn(0x7fa2f80fd630 msgr2=0x7fa2f80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:59.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.732+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 shutdown_connections 2024-09-21T11:59:59.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.732+0000 7fa2ff102640 1 -- 172.21.15.118:0/1140370615 wait complete. 2024-09-21T11:59:59.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.813+0000 7fc4a6d53640 1 -- 172.21.15.118:0/834114816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 msgr2=0x7fc4a0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.813+0000 7fc4a6d53640 1 --2- 172.21.15.118:0/834114816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 0x7fc4a0101d90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc48c009880 tx=0x7fc48c02a4a0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.813+0000 7fc4a6d53640 1 -- 172.21.15.118:0/834114816 shutdown_connections 2024-09-21T11:59:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.813+0000 7fc4a6d53640 1 --2- 172.21.15.118:0/834114816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 0x7fc4a0101d90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.813+0000 7fc4a6d53640 1 --2- 172.21.15.118:0/834114816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a0107930 0x7fc4a0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.813+0000 7fc4a6d53640 1 -- 172.21.15.118:0/834114816 >> 172.21.15.118:0/834114816 conn(0x7fc4a00fd630 msgr2=0x7fc4a00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T11:59:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.813+0000 7fc4a6d53640 1 -- 172.21.15.118:0/834114816 shutdown_connections 2024-09-21T11:59:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.813+0000 7fc4a6d53640 1 -- 172.21.15.118:0/834114816 wait complete. 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a6d53640 1 Processor -- start 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a6d53640 1 -- start start 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a6d53640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 0x7fc4a019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a6d53640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a0107930 0x7fc4a019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a6d53640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a010ee00 con 0x7fc4a0101930 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a6d53640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a010ec80 con 0x7fc4a0107930 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a4aef640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 0x7fc4a019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a4aef640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 0x7fc4a019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33852/0 (socket says 172.21.15.118:33852) 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a4aef640 1 -- 172.21.15.118:0/1530847347 learned_addr learned my addr 172.21.15.118:0/1530847347 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc49ffff640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a0107930 0x7fc4a019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a4aef640 1 -- 172.21.15.118:0/1530847347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a0107930 msgr2=0x7fc4a019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T11:59:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a4aef640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a0107930 0x7fc4a019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T11:59:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc4a4aef640 1 -- 172.21.15.118:0/1530847347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a0197810 con 0x7fc4a0101930 2024-09-21T11:59:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.814+0000 7fc49ffff640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a0107930 0x7fc4a019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T11:59:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.815+0000 7fc4a4aef640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 0x7fc4a019d690 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc49400c8f0 tx=0x7fc49400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.815+0000 7fc49dffb640 1 -- 172.21.15.118:0/1530847347 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4940079b0 con 0x7fc4a0101930 2024-09-21T11:59:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.815+0000 7fc49dffb640 1 -- 172.21.15.118:0/1530847347 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4940054e0 con 0x7fc4a0101930 2024-09-21T11:59:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.815+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a0197b00 con 0x7fc4a0101930 2024-09-21T11:59:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.815+0000 7fc49dffb640 1 -- 172.21.15.118:0/1530847347 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc494004dd0 con 0x7fc4a0101930 2024-09-21T11:59:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.815+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a0198090 con 0x7fc4a0101930 2024-09-21T11:59:59.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.816+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a0103070 con 0x7fc4a0101930 2024-09-21T11:59:59.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.817+0000 7fc49dffb640 1 -- 172.21.15.118:0/1530847347 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc494005020 con 0x7fc4a0101930 2024-09-21T11:59:59.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.817+0000 7fc49dffb640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc49007aed0 0x7fc49007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T11:59:59.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.817+0000 7fc49ffff640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc49007aed0 0x7fc49007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T11:59:59.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.817+0000 7fc49dffb640 1 -- 172.21.15.118:0/1530847347 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fc49409e090 con 0x7fc4a0101930 2024-09-21T11:59:59.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.818+0000 7fc49ffff640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc49007aed0 0x7fc49007d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc48c031460 tx=0x7fc48c0095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T11:59:59.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T11:59:59.822+0000 7fc49dffb640 1 -- 172.21.15.118:0/1530847347 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc494014030 con 0x7fc4a0101930 2024-09-21T11:59:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:59 smithi149 ceph-mon[79770]: from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:59 smithi149 ceph-mon[79770]: pgmap v634: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T11:59:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:59 smithi149 ceph-mon[79770]: from='client.34980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:59 smithi149 ceph-mon[79770]: from='client.34984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T11:59:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:59 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1436868486' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T11:59:59.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 11:59:59 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/4045570586' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:00:00.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.073+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc4a0109ea0 con 0x7fc4a0101930 2024-09-21T12:00:00.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.073+0000 7fc49dffb640 1 -- 172.21.15.118:0/1530847347 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fc4940695e0 con 0x7fc4a0101930 2024-09-21T12:00:00.076 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:00:00.076 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:00:00.076 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:00:00.076 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:00:00.076 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:00:00.076 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:00:00.076 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.075+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc49007aed0 msgr2=0x7fc49007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.075+0000 7fc4a6d53640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc49007aed0 0x7fc49007d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc48c031460 tx=0x7fc48c0095f0 comp rx=0 tx=0).stop 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.075+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 msgr2=0x7fc4a019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.075+0000 7fc4a6d53640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 0x7fc4a019d690 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc49400c8f0 tx=0x7fc49400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.075+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 shutdown_connections 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.075+0000 7fc4a6d53640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a0107930 0x7fc4a019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.075+0000 7fc4a6d53640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc49007aed0 0x7fc49007d390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.075+0000 7fc4a6d53640 1 --2- 172.21.15.118:0/1530847347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0101930 0x7fc4a019d690 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.075+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 >> 172.21.15.118:0/1530847347 conn(0x7fc4a00fd630 msgr2=0x7fc4a00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.076+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 shutdown_connections 2024-09-21T12:00:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:00.076+0000 7fc4a6d53640 1 -- 172.21.15.118:0/1530847347 wait complete. 2024-09-21T12:00:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T11:59:59.998+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:00:00.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:00 smithi149 ceph-mon[79770]: from='client.34996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:00.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:00 smithi149 ceph-mon[79770]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:00:00.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:00 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1530847347' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:00:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:00 smithi118 ceph-mon[111738]: from='client.34996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:00 smithi118 ceph-mon[111738]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:00:01.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:00 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1530847347' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:00:01.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:01 smithi149 ceph-mon[79770]: pgmap v635: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:02.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:01 smithi118 ceph-mon[111738]: pgmap v635: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:03.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:03 smithi149 ceph-mon[79770]: pgmap v636: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:04.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:03 smithi118 ceph-mon[111738]: pgmap v636: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:05.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:05 smithi149 ceph-mon[79770]: pgmap v637: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:05.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:00:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:05 smithi118 ceph-mon[111738]: pgmap v637: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:00:07.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:07 smithi149 ceph-mon[79770]: pgmap v638: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:07.987 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:07 smithi118 ceph-mon[111738]: pgmap v638: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:09.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:09 smithi149 ceph-mon[79770]: pgmap v639: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:10.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:09 smithi118 ceph-mon[111738]: pgmap v639: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:11.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:11 smithi149 ceph-mon[79770]: pgmap v640: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:11 smithi118 ceph-mon[111738]: pgmap v640: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:13.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:13 smithi149 ceph-mon[79770]: pgmap v641: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:13 smithi118 ceph-mon[111738]: pgmap v641: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:15 smithi149 ceph-mon[79770]: pgmap v642: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:15 smithi118 ceph-mon[111738]: pgmap v642: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:17.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:17 smithi149 ceph-mon[79770]: pgmap v643: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:18.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:17 smithi118 ceph-mon[111738]: pgmap v643: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:19.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:19 smithi149 ceph-mon[79770]: pgmap v644: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:19 smithi118 ceph-mon[111738]: pgmap v644: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:20.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:00:21.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:00:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:21 smithi149 ceph-mon[79770]: pgmap v645: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:22.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:21 smithi118 ceph-mon[111738]: pgmap v645: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:23.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:23 smithi149 ceph-mon[79770]: pgmap v646: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:24.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:23 smithi118 ceph-mon[111738]: pgmap v646: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:25.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:25 smithi149 ceph-mon[79770]: pgmap v647: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:26.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:25 smithi118 ceph-mon[111738]: pgmap v647: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:27 smithi149 ceph-mon[79770]: pgmap v648: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:28.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:27 smithi118 ceph-mon[111738]: pgmap v648: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:29.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:29 smithi149 ceph-mon[79770]: pgmap v649: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:29 smithi118 ceph-mon[111738]: pgmap v649: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:30.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 -- 172.21.15.118:0/1232017045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100070 msgr2=0x7f0a28100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 --2- 172.21.15.118:0/1232017045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100070 0x7f0a28100450 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009880 tx=0x7f0a1802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 -- 172.21.15.118:0/1232017045 shutdown_connections 2024-09-21T12:00:30.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 --2- 172.21.15.118:0/1232017045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a28100a20 0x7f0a28106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 --2- 172.21.15.118:0/1232017045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100070 0x7f0a28100450 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 -- 172.21.15.118:0/1232017045 >> 172.21.15.118:0/1232017045 conn(0x7f0a280fbc40 msgr2=0x7f0a280fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:30.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 -- 172.21.15.118:0/1232017045 shutdown_connections 2024-09-21T12:00:30.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 -- 172.21.15.118:0/1232017045 wait complete. 2024-09-21T12:00:30.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 Processor -- start 2024-09-21T12:00:30.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.170+0000 7f0a2de54640 1 -- start start 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a2de54640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a28100070 0x7f0a2819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a2de54640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100a20 0x7f0a2819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a2de54640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2810ede0 con 0x7f0a28100a20 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a2de54640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2810ec60 con 0x7f0a28100070 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a1ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100a20 0x7f0a2819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a1ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100a20 0x7f0a2819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41094/0 (socket says 172.21.15.118:41094) 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a1ffff640 1 -- 172.21.15.118:0/1462317250 learned_addr learned my addr 172.21.15.118:0/1462317250 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a277fe640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a28100070 0x7f0a2819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a1ffff640 1 -- 172.21.15.118:0/1462317250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a28100070 msgr2=0x7f0a2819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a1ffff640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a28100070 0x7f0a2819d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a1ffff640 1 -- 172.21.15.118:0/1462317250 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a281977d0 con 0x7f0a28100a20 2024-09-21T12:00:30.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a1ffff640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100a20 0x7f0a2819db90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000d6f0 tx=0x7f0a1000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:30.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a257fa640 1 -- 172.21.15.118:0/1462317250 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a10017070 con 0x7f0a28100a20 2024-09-21T12:00:30.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a257fa640 1 -- 172.21.15.118:0/1462317250 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a1000de00 con 0x7f0a28100a20 2024-09-21T12:00:30.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.171+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a28197ac0 con 0x7f0a28100a20 2024-09-21T12:00:30.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.172+0000 7f0a257fa640 1 -- 172.21.15.118:0/1462317250 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a10004bb0 con 0x7f0a28100a20 2024-09-21T12:00:30.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.172+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a28198050 con 0x7f0a28100a20 2024-09-21T12:00:30.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.173+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a28103130 con 0x7f0a28100a20 2024-09-21T12:00:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.173+0000 7f0a257fa640 1 -- 172.21.15.118:0/1462317250 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0a10009a30 con 0x7f0a28100a20 2024-09-21T12:00:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.174+0000 7f0a257fa640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a1407af80 0x7f0a1407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.174+0000 7f0a257fa640 1 -- 172.21.15.118:0/1462317250 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0a1009dc20 con 0x7f0a28100a20 2024-09-21T12:00:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.174+0000 7f0a277fe640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a1407af80 0x7f0a1407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.174+0000 7f0a277fe640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a1407af80 0x7f0a1407d440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0a180096c0 tx=0x7f0a18031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:30.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.178+0000 7f0a257fa640 1 -- 172.21.15.118:0/1462317250 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0a100691f0 con 0x7f0a28100a20 2024-09-21T12:00:30.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.372+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0a28198300 con 0x7f0a1407af80 2024-09-21T12:00:30.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.373+0000 7f0a257fa640 1 -- 172.21.15.118:0/1462317250 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0a28198300 con 0x7f0a1407af80 2024-09-21T12:00:30.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a1407af80 msgr2=0x7f0a1407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a1407af80 0x7f0a1407d440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0a180096c0 tx=0x7f0a18031400 comp rx=0 tx=0).stop 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100a20 msgr2=0x7f0a2819db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100a20 0x7f0a2819db90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000d6f0 tx=0x7f0a1000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 shutdown_connections 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0a1407af80 0x7f0a1407d440 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a28100a20 0x7f0a2819db90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 --2- 172.21.15.118:0/1462317250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a28100070 0x7f0a2819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 >> 172.21.15.118:0/1462317250 conn(0x7f0a280fbc40 msgr2=0x7f0a280fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 shutdown_connections 2024-09-21T12:00:30.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.375+0000 7f0a2de54640 1 -- 172.21.15.118:0/1462317250 wait complete. 2024-09-21T12:00:30.387 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:00:30.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.459+0000 7fe55b3df640 1 -- 172.21.15.118:0/3838519663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 msgr2=0x7fe554101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.459+0000 7fe55b3df640 1 --2- 172.21.15.118:0/3838519663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 0x7fe554101d90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe544009880 tx=0x7fe54402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.459+0000 7fe55b3df640 1 -- 172.21.15.118:0/3838519663 shutdown_connections 2024-09-21T12:00:30.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.459+0000 7fe55b3df640 1 --2- 172.21.15.118:0/3838519663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 0x7fe554101d90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.459+0000 7fe55b3df640 1 --2- 172.21.15.118:0/3838519663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe554107930 0x7fe554107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.459+0000 7fe55b3df640 1 -- 172.21.15.118:0/3838519663 >> 172.21.15.118:0/3838519663 conn(0x7fe5540fd630 msgr2=0x7fe5540ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:30.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.459+0000 7fe55b3df640 1 -- 172.21.15.118:0/3838519663 shutdown_connections 2024-09-21T12:00:30.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.459+0000 7fe55b3df640 1 -- 172.21.15.118:0/3838519663 wait complete. 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.460+0000 7fe55b3df640 1 Processor -- start 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.460+0000 7fe55b3df640 1 -- start start 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.460+0000 7fe55b3df640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 0x7fe55419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.460+0000 7fe55b3df640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe554107930 0x7fe55419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.460+0000 7fe55b3df640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe55410ede0 con 0x7fe554101930 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.460+0000 7fe55b3df640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe55410ec60 con 0x7fe554107930 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.460+0000 7fe55917b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 0x7fe55419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.460+0000 7fe55917b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 0x7fe55419d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41120/0 (socket says 172.21.15.118:41120) 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.460+0000 7fe55917b640 1 -- 172.21.15.118:0/813908185 learned_addr learned my addr 172.21.15.118:0/813908185 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe55897a640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe554107930 0x7fe55419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe55917b640 1 -- 172.21.15.118:0/813908185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe554107930 msgr2=0x7fe55419dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe55917b640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe554107930 0x7fe55419dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe55917b640 1 -- 172.21.15.118:0/813908185 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe554197850 con 0x7fe554101930 2024-09-21T12:00:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe55917b640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 0x7fe55419d6d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe55000c8a0 tx=0x7fe55000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe54a7fc640 1 -- 172.21.15.118:0/813908185 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe5500079b0 con 0x7fe554101930 2024-09-21T12:00:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe54a7fc640 1 -- 172.21.15.118:0/813908185 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe550007b50 con 0x7fe554101930 2024-09-21T12:00:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe554197b40 con 0x7fe554101930 2024-09-21T12:00:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe54a7fc640 1 -- 172.21.15.118:0/813908185 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe550018700 con 0x7fe554101930 2024-09-21T12:00:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.461+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5541980d0 con 0x7fe554101930 2024-09-21T12:00:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.462+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe554103070 con 0x7fe554101930 2024-09-21T12:00:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.463+0000 7fe54a7fc640 1 -- 172.21.15.118:0/813908185 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe550007d00 con 0x7fe554101930 2024-09-21T12:00:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.463+0000 7fe54a7fc640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe54007af30 0x7fe54007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.463+0000 7fe55897a640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe54007af30 0x7fe54007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.463+0000 7fe54a7fc640 1 -- 172.21.15.118:0/813908185 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fe55009e330 con 0x7fe554101930 2024-09-21T12:00:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.464+0000 7fe55897a640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe54007af30 0x7fe54007d3f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe544031460 tx=0x7fe544009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:30.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.469+0000 7fe54a7fc640 1 -- 172.21.15.118:0/813908185 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe550014030 con 0x7fe554101930 2024-09-21T12:00:30.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.665+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe554198d80 con 0x7fe54007af30 2024-09-21T12:00:30.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.666+0000 7fe54a7fc640 1 -- 172.21.15.118:0/813908185 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fe554198d80 con 0x7fe54007af30 2024-09-21T12:00:30.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe54007af30 msgr2=0x7fe54007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe54007af30 0x7fe54007d3f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe544031460 tx=0x7fe544009560 comp rx=0 tx=0).stop 2024-09-21T12:00:30.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 msgr2=0x7fe55419d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 0x7fe55419d6d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe55000c8a0 tx=0x7fe55000cd60 comp rx=0 tx=0).stop 2024-09-21T12:00:30.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 shutdown_connections 2024-09-21T12:00:30.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe554107930 0x7fe55419dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe54007af30 0x7fe54007d3f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 --2- 172.21.15.118:0/813908185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe554101930 0x7fe55419d6d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 >> 172.21.15.118:0/813908185 conn(0x7fe5540fd630 msgr2=0x7fe5540fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:30.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 shutdown_connections 2024-09-21T12:00:30.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.668+0000 7fe55b3df640 1 -- 172.21.15.118:0/813908185 wait complete. 2024-09-21T12:00:30.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.750+0000 7f3989122640 1 -- 172.21.15.118:0/2499390127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 msgr2=0x7f3984100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.750+0000 7f3989122640 1 --2- 172.21.15.118:0/2499390127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 0x7f3984100c80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f396c009880 tx=0x7f396c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.750+0000 7f3989122640 1 -- 172.21.15.118:0/2499390127 shutdown_connections 2024-09-21T12:00:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.750+0000 7f3989122640 1 --2- 172.21.15.118:0/2499390127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 0x7f3984100c80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.750+0000 7f3989122640 1 --2- 172.21.15.118:0/2499390127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3984106820 0x7f3984106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.750+0000 7f3989122640 1 -- 172.21.15.118:0/2499390127 >> 172.21.15.118:0/2499390127 conn(0x7f39840fc520 msgr2=0x7f39840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.750+0000 7f3989122640 1 -- 172.21.15.118:0/2499390127 shutdown_connections 2024-09-21T12:00:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.750+0000 7f3989122640 1 -- 172.21.15.118:0/2499390127 wait complete. 2024-09-21T12:00:30.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.750+0000 7f3989122640 1 Processor -- start 2024-09-21T12:00:30.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.751+0000 7f3989122640 1 -- start start 2024-09-21T12:00:30.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.751+0000 7f3989122640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 0x7f39840fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.751+0000 7f3989122640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3984106820 0x7f39840fd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.751+0000 7f3989122640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f398410dcf0 con 0x7f3984100820 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.751+0000 7f3989122640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f398410db70 con 0x7f3984106820 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.751+0000 7f3982d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 0x7f39840fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.751+0000 7f3982d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 0x7f39840fcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41132/0 (socket says 172.21.15.118:41132) 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.751+0000 7f3982d9d640 1 -- 172.21.15.118:0/1865820100 learned_addr learned my addr 172.21.15.118:0/1865820100 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.751+0000 7f398259c640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3984106820 0x7f39840fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f398259c640 1 -- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 msgr2=0x7f39840fcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f398259c640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 0x7f39840fcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f398259c640 1 -- 172.21.15.118:0/1865820100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39840fd640 con 0x7f3984106820 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f3982d9d640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 0x7f39840fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f398259c640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3984106820 0x7f39840fd100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f396c006010 tx=0x7f396c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f397bfff640 1 -- 172.21.15.118:0/1865820100 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f396c03f070 con 0x7f3984106820 2024-09-21T12:00:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39840fd8d0 con 0x7f3984106820 2024-09-21T12:00:30.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39841a3da0 con 0x7f3984106820 2024-09-21T12:00:30.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f397bfff640 1 -- 172.21.15.118:0/1865820100 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f396c0035f0 con 0x7f3984106820 2024-09-21T12:00:30.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.752+0000 7f397bfff640 1 -- 172.21.15.118:0/1865820100 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f396c049060 con 0x7f3984106820 2024-09-21T12:00:30.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.753+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3964005290 con 0x7f3984106820 2024-09-21T12:00:30.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.754+0000 7f397bfff640 1 -- 172.21.15.118:0/1865820100 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f396c042070 con 0x7f3984106820 2024-09-21T12:00:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.755+0000 7f397bfff640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f397007af30 0x7f397007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.755+0000 7f397bfff640 1 -- 172.21.15.118:0/1865820100 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f396c0be7e0 con 0x7f3984106820 2024-09-21T12:00:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.755+0000 7f3982d9d640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f397007af30 0x7f397007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.755+0000 7f3982d9d640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f397007af30 0x7f397007d3f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39740104e0 tx=0x7f397400b410 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:30.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.759+0000 7f397bfff640 1 -- 172.21.15.118:0/1865820100 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f396c089cd0 con 0x7f3984106820 2024-09-21T12:00:30.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.947+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3964000bc0 con 0x7f397007af30 2024-09-21T12:00:30.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.956+0000 7f397bfff640 1 -- 172.21.15.118:0/1865820100 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3964000bc0 con 0x7f397007af30 2024-09-21T12:00:30.958 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:00:30.958 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (18m) 12m ago 29m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:00:30.958 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (21m) 12m ago 29m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (20m) 12m ago 28m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (16m) 12m ago 29m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (16m) 12m ago 28m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (18m) 12m ago 29m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (12m) 12m ago 24m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (12m) 12m ago 23m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (23m) 12m ago 23m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (12m) 12m ago 24m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (20m) 12m ago 30m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (19m) 12m ago 28m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (17m) 12m ago 30m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (16m) 12m ago 28m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (19m) 12m ago 29m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (19m) 12m ago 28m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:00:30.959 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (16m) 12m ago 27m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:00:30.960 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (15m) 12m ago 26m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:00:30.960 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (14m) 12m ago 26m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:00:30.960 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (14m) 12m ago 25m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:00:30.960 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (13m) 12m ago 25m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:00:30.960 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (13m) 12m ago 25m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:00:30.960 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (18m) 12m ago 28m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:00:30.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f397007af30 msgr2=0x7f397007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f397007af30 0x7f397007d3f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39740104e0 tx=0x7f397400b410 comp rx=0 tx=0).stop 2024-09-21T12:00:30.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3984106820 msgr2=0x7f39840fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:30.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3984106820 0x7f39840fd100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f396c006010 tx=0x7f396c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 shutdown_connections 2024-09-21T12:00:30.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3984106820 0x7f39840fd100 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f397007af30 0x7f397007d3f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 --2- 172.21.15.118:0/1865820100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984100820 0x7f39840fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:30.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 >> 172.21.15.118:0/1865820100 conn(0x7f39840fc520 msgr2=0x7f398406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:30.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 shutdown_connections 2024-09-21T12:00:30.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:30.958+0000 7f3989122640 1 -- 172.21.15.118:0/1865820100 wait complete. 2024-09-21T12:00:31.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.037+0000 7efe98ea9640 1 -- 172.21.15.118:0/818258581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941067e0 msgr2=0x7efe94106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.037+0000 7efe98ea9640 1 --2- 172.21.15.118:0/818258581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941067e0 0x7efe94106bc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efe84009880 tx=0x7efe8402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.038+0000 7efe98ea9640 1 -- 172.21.15.118:0/818258581 shutdown_connections 2024-09-21T12:00:31.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.038+0000 7efe98ea9640 1 --2- 172.21.15.118:0/818258581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe941007e0 0x7efe94100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.038+0000 7efe98ea9640 1 --2- 172.21.15.118:0/818258581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941067e0 0x7efe94106bc0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.038+0000 7efe98ea9640 1 -- 172.21.15.118:0/818258581 >> 172.21.15.118:0/818258581 conn(0x7efe940fc4c0 msgr2=0x7efe940fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:31.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.038+0000 7efe98ea9640 1 -- 172.21.15.118:0/818258581 shutdown_connections 2024-09-21T12:00:31.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.038+0000 7efe98ea9640 1 -- 172.21.15.118:0/818258581 wait complete. 2024-09-21T12:00:31.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe98ea9640 1 Processor -- start 2024-09-21T12:00:31.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe98ea9640 1 -- start start 2024-09-21T12:00:31.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe98ea9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941007e0 0x7efe94198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe98ea9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe941067e0 0x7efe94198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe98ea9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efe9410dd10 con 0x7efe941007e0 2024-09-21T12:00:31.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe98ea9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe9410db90 con 0x7efe941067e0 2024-09-21T12:00:31.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe9259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941007e0 0x7efe94198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe9259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941007e0 0x7efe94198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41152/0 (socket says 172.21.15.118:41152) 2024-09-21T12:00:31.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe9259c640 1 -- 172.21.15.118:0/3153665065 learned_addr learned my addr 172.21.15.118:0/3153665065 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.039+0000 7efe91d9b640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe941067e0 0x7efe94198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.040+0000 7efe9259c640 1 -- 172.21.15.118:0/3153665065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe941067e0 msgr2=0x7efe94198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.040+0000 7efe9259c640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe941067e0 0x7efe94198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.040+0000 7efe9259c640 1 -- 172.21.15.118:0/3153665065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe941993c0 con 0x7efe941007e0 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.040+0000 7efe9259c640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941007e0 0x7efe94198880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efe84031460 tx=0x7efe840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.040+0000 7efe8b7fe640 1 -- 172.21.15.118:0/3153665065 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe8403f070 con 0x7efe941007e0 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.040+0000 7efe8b7fe640 1 -- 172.21.15.118:0/3153665065 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe84004cf0 con 0x7efe941007e0 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.040+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe94199650 con 0x7efe941007e0 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.041+0000 7efe8b7fe640 1 -- 172.21.15.118:0/3153665065 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe84035030 con 0x7efe941007e0 2024-09-21T12:00:31.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.041+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe941a1c00 con 0x7efe941007e0 2024-09-21T12:00:31.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.042+0000 7efe8b7fe640 1 -- 172.21.15.118:0/3153665065 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7efe84042070 con 0x7efe941007e0 2024-09-21T12:00:31.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.042+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe94101f20 con 0x7efe941007e0 2024-09-21T12:00:31.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.042+0000 7efe8b7fe640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe8007ad30 0x7efe8007d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.042+0000 7efe91d9b640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe8007ad30 0x7efe8007d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.042+0000 7efe8b7fe640 1 -- 172.21.15.118:0/3153665065 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7efe840be0e0 con 0x7efe941007e0 2024-09-21T12:00:31.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.043+0000 7efe91d9b640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe8007ad30 0x7efe8007d1f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efe9406a680 tx=0x7efe7c009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:31.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.047+0000 7efe8b7fe640 1 -- 172.21.15.118:0/3153665065 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe840895a0 con 0x7efe941007e0 2024-09-21T12:00:31.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.296+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efe9406a120 con 0x7efe941007e0 2024-09-21T12:00:31.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.297+0000 7efe8b7fe640 1 -- 172.21.15.118:0/3153665065 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7efe8408e450 con 0x7efe941007e0 2024-09-21T12:00:31.299 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:00:31.299 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:00:31.300 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T12:00:31.301 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:00:31.301 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:00:31.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe8007ad30 msgr2=0x7efe8007d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe8007ad30 0x7efe8007d1f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efe9406a680 tx=0x7efe7c009110 comp rx=0 tx=0).stop 2024-09-21T12:00:31.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941007e0 msgr2=0x7efe94198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941007e0 0x7efe94198880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efe84031460 tx=0x7efe840048f0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 shutdown_connections 2024-09-21T12:00:31.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe941067e0 0x7efe94198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe8007ad30 0x7efe8007d1f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 --2- 172.21.15.118:0/3153665065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe941007e0 0x7efe94198880 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 >> 172.21.15.118:0/3153665065 conn(0x7efe940fc4c0 msgr2=0x7efe940fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:31.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 shutdown_connections 2024-09-21T12:00:31.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.300+0000 7efe98ea9640 1 -- 172.21.15.118:0/3153665065 wait complete. 2024-09-21T12:00:31.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.381+0000 7f8b3eb20640 1 -- 172.21.15.118:0/2160536698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38107930 msgr2=0x7f8b38107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.381+0000 7f8b3eb20640 1 --2- 172.21.15.118:0/2160536698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38107930 0x7f8b38107d10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009880 tx=0x7f8b3402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.381+0000 7f8b3eb20640 1 -- 172.21.15.118:0/2160536698 shutdown_connections 2024-09-21T12:00:31.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.381+0000 7f8b3eb20640 1 --2- 172.21.15.118:0/2160536698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b38101930 0x7f8b38101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.381+0000 7f8b3eb20640 1 --2- 172.21.15.118:0/2160536698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38107930 0x7f8b38107d10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.381+0000 7f8b3eb20640 1 -- 172.21.15.118:0/2160536698 >> 172.21.15.118:0/2160536698 conn(0x7f8b380fd630 msgr2=0x7f8b380ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.381+0000 7f8b3eb20640 1 -- 172.21.15.118:0/2160536698 shutdown_connections 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.381+0000 7f8b3eb20640 1 -- 172.21.15.118:0/2160536698 wait complete. 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b3eb20640 1 Processor -- start 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b3eb20640 1 -- start start 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b3eb20640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38101930 0x7f8b3819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b3eb20640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b38107930 0x7f8b3819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b3eb20640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3810ee00 con 0x7f8b38101930 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b3eb20640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3810ec80 con 0x7f8b38107930 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b3c8bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38101930 0x7f8b3819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b3c8bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38101930 0x7f8b3819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41174/0 (socket says 172.21.15.118:41174) 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b3c8bc640 1 -- 172.21.15.118:0/1062627864 learned_addr learned my addr 172.21.15.118:0/1062627864 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:00:31.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.382+0000 7f8b2ffff640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b38107930 0x7f8b3819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.383+0000 7f8b3c8bc640 1 -- 172.21.15.118:0/1062627864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b38107930 msgr2=0x7f8b3819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.383+0000 7f8b3c8bc640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b38107930 0x7f8b3819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.383+0000 7f8b3c8bc640 1 -- 172.21.15.118:0/1062627864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b381977f0 con 0x7f8b38101930 2024-09-21T12:00:31.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.383+0000 7f8b3c8bc640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38101930 0x7f8b3819d670 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8b34031460 tx=0x7f8b340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:31.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.383+0000 7f8b2dffb640 1 -- 172.21.15.118:0/1062627864 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8b3403f070 con 0x7f8b38101930 2024-09-21T12:00:31.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.383+0000 7f8b2dffb640 1 -- 172.21.15.118:0/1062627864 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8b340035f0 con 0x7f8b38101930 2024-09-21T12:00:31.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.383+0000 7f8b2dffb640 1 -- 172.21.15.118:0/1062627864 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8b34035030 con 0x7f8b38101930 2024-09-21T12:00:31.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.383+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b38197a80 con 0x7f8b38101930 2024-09-21T12:00:31.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.383+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b38197fb0 con 0x7f8b38101930 2024-09-21T12:00:31.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.384+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b38103070 con 0x7f8b38101930 2024-09-21T12:00:31.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.385+0000 7f8b2dffb640 1 -- 172.21.15.118:0/1062627864 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8b34042070 con 0x7f8b38101930 2024-09-21T12:00:31.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.385+0000 7f8b2dffb640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8b2007af80 0x7f8b2007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.385+0000 7f8b2dffb640 1 -- 172.21.15.118:0/1062627864 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f8b340be910 con 0x7f8b38101930 2024-09-21T12:00:31.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.385+0000 7f8b2ffff640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8b2007af80 0x7f8b2007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.386+0000 7f8b2ffff640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8b2007af80 0x7f8b2007d440 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8b380ffc20 tx=0x7f8b2800b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.390+0000 7f8b2dffb640 1 -- 172.21.15.118:0/1062627864 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b34089ee0 con 0x7f8b38101930 2024-09-21T12:00:31.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.602+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8b38109ea0 con 0x7f8b38101930 2024-09-21T12:00:31.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.602+0000 7f8b2dffb640 1 -- 172.21.15.118:0/1062627864 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f8b3408ed90 con 0x7f8b38101930 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:00:31.605 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:00:31.606 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:00:31.607 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:00:31.608 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T12:00:31.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.604+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8b2007af80 msgr2=0x7f8b2007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.604+0000 7f8b3eb20640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8b2007af80 0x7f8b2007d440 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8b380ffc20 tx=0x7f8b2800b390 comp rx=0 tx=0).stop 2024-09-21T12:00:31.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.604+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38101930 msgr2=0x7f8b3819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.604+0000 7f8b3eb20640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38101930 0x7f8b3819d670 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8b34031460 tx=0x7f8b340045e0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.605+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 shutdown_connections 2024-09-21T12:00:31.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.605+0000 7f8b3eb20640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b38107930 0x7f8b3819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.605+0000 7f8b3eb20640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8b2007af80 0x7f8b2007d440 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.605+0000 7f8b3eb20640 1 --2- 172.21.15.118:0/1062627864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b38101930 0x7f8b3819d670 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.605+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 >> 172.21.15.118:0/1062627864 conn(0x7f8b380fd630 msgr2=0x7f8b380fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:31.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.605+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 shutdown_connections 2024-09-21T12:00:31.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.605+0000 7f8b3eb20640 1 -- 172.21.15.118:0/1062627864 wait complete. 2024-09-21T12:00:31.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.687+0000 7ff827163640 1 -- 172.21.15.118:0/380823889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820103400 msgr2=0x7ff82010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.687+0000 7ff827163640 1 --2- 172.21.15.118:0/380823889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820103400 0x7ff82010b8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff814009880 tx=0x7ff81402a530 comp rx=0 tx=0).stop 2024-09-21T12:00:31.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.687+0000 7ff827163640 1 -- 172.21.15.118:0/380823889 shutdown_connections 2024-09-21T12:00:31.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.687+0000 7ff827163640 1 --2- 172.21.15.118:0/380823889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820103400 0x7ff82010b8f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.687+0000 7ff827163640 1 --2- 172.21.15.118:0/380823889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff820102ae0 0x7ff820102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.687+0000 7ff827163640 1 -- 172.21.15.118:0/380823889 >> 172.21.15.118:0/380823889 conn(0x7ff8200fc520 msgr2=0x7ff8200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:31.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.687+0000 7ff827163640 1 -- 172.21.15.118:0/380823889 shutdown_connections 2024-09-21T12:00:31.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.687+0000 7ff827163640 1 -- 172.21.15.118:0/380823889 wait complete. 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.688+0000 7ff827163640 1 Processor -- start 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.688+0000 7ff827163640 1 -- start start 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.688+0000 7ff827163640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820102ae0 0x7ff82019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.688+0000 7ff827163640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff820103400 0x7ff82019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.688+0000 7ff827163640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff82010ee70 con 0x7ff820102ae0 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.688+0000 7ff827163640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff82010ecf0 con 0x7ff820103400 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.688+0000 7ff824eff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820102ae0 0x7ff82019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.688+0000 7ff824eff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820102ae0 0x7ff82019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41186/0 (socket says 172.21.15.118:41186) 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.688+0000 7ff824eff640 1 -- 172.21.15.118:0/173075603 learned_addr learned my addr 172.21.15.118:0/173075603 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff81ffff640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff820103400 0x7ff82019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff824eff640 1 -- 172.21.15.118:0/173075603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff820103400 msgr2=0x7ff82019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff824eff640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff820103400 0x7ff82019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff824eff640 1 -- 172.21.15.118:0/173075603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff820197880 con 0x7ff820102ae0 2024-09-21T12:00:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff824eff640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820102ae0 0x7ff82019d6c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff81000b420 tx=0x7ff81000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:31.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff81dffb640 1 -- 172.21.15.118:0/173075603 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff810011630 con 0x7ff820102ae0 2024-09-21T12:00:31.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff81dffb640 1 -- 172.21.15.118:0/173075603 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff810016070 con 0x7ff820102ae0 2024-09-21T12:00:31.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff81dffb640 1 -- 172.21.15.118:0/173075603 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff810010d40 con 0x7ff820102ae0 2024-09-21T12:00:31.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff820197b70 con 0x7ff820102ae0 2024-09-21T12:00:31.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.689+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff820198100 con 0x7ff820102ae0 2024-09-21T12:00:31.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.690+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff82006abe0 con 0x7ff820102ae0 2024-09-21T12:00:31.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.691+0000 7ff81dffb640 1 -- 172.21.15.118:0/173075603 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff81001b460 con 0x7ff820102ae0 2024-09-21T12:00:31.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.691+0000 7ff81dffb640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff80807af80 0x7ff80807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.691+0000 7ff81dffb640 1 -- 172.21.15.118:0/173075603 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff81009d7a0 con 0x7ff820102ae0 2024-09-21T12:00:31.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.691+0000 7ff81ffff640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff80807af80 0x7ff80807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.692+0000 7ff81ffff640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff80807af80 0x7ff80807d440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff814031460 tx=0x7ff814009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:31.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.695+0000 7ff81dffb640 1 -- 172.21.15.118:0/173075603 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff810021250 con 0x7ff820102ae0 2024-09-21T12:00:31.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.888+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff820198db0 con 0x7ff80807af80 2024-09-21T12:00:31.891 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:31 smithi118 ceph-mon[111738]: from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:31.891 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:31 smithi118 ceph-mon[111738]: pgmap v650: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:31.891 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:31 smithi118 ceph-mon[111738]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:31.891 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:31 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3153665065' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:00:31.891 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:31 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1062627864' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.889+0000 7ff81dffb640 1 -- 172.21.15.118:0/173075603 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ff820198db0 con 0x7ff80807af80 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:00:31.892 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:00:31.893 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T12:00:31.893 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:00:31.893 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:00:31.893 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:00:31.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff80807af80 msgr2=0x7ff80807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff80807af80 0x7ff80807d440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff814031460 tx=0x7ff814009560 comp rx=0 tx=0).stop 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820102ae0 msgr2=0x7ff82019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820102ae0 0x7ff82019d6c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff81000b420 tx=0x7ff81000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 shutdown_connections 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff820103400 0x7ff82019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff80807af80 0x7ff80807d440 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 --2- 172.21.15.118:0/173075603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820102ae0 0x7ff82019d6c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 >> 172.21.15.118:0/173075603 conn(0x7ff8200fc520 msgr2=0x7ff820108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 shutdown_connections 2024-09-21T12:00:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.893+0000 7ff827163640 1 -- 172.21.15.118:0/173075603 wait complete. 2024-09-21T12:00:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:31 smithi149 ceph-mon[79770]: from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:31 smithi149 ceph-mon[79770]: pgmap v650: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:31 smithi149 ceph-mon[79770]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:31.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:31 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3153665065' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:00:31.951 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:31 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1062627864' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:00:31.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.972+0000 7f13d6877640 1 -- 172.21.15.118:0/895090022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 msgr2=0x7f13d0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.972+0000 7f13d6877640 1 --2- 172.21.15.118:0/895090022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 0x7f13d0100c80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009880 tx=0x7f13c402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.972+0000 7f13d6877640 1 -- 172.21.15.118:0/895090022 shutdown_connections 2024-09-21T12:00:31.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.972+0000 7f13d6877640 1 --2- 172.21.15.118:0/895090022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 0x7f13d0100c80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.972+0000 7f13d6877640 1 --2- 172.21.15.118:0/895090022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13d0106820 0x7f13d0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.972+0000 7f13d6877640 1 -- 172.21.15.118:0/895090022 >> 172.21.15.118:0/895090022 conn(0x7f13d00fc520 msgr2=0x7f13d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:31.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.972+0000 7f13d6877640 1 -- 172.21.15.118:0/895090022 shutdown_connections 2024-09-21T12:00:31.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.972+0000 7f13d6877640 1 -- 172.21.15.118:0/895090022 wait complete. 2024-09-21T12:00:31.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13d6877640 1 Processor -- start 2024-09-21T12:00:31.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13d6877640 1 -- start start 2024-09-21T12:00:31.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13d6877640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 0x7f13d00fcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13d6877640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13d0106820 0x7f13d00fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13d6877640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13d010dcd0 con 0x7f13d0100820 2024-09-21T12:00:31.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13d6877640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13d010db50 con 0x7f13d0106820 2024-09-21T12:00:31.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13cffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 0x7f13d00fcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13cffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 0x7f13d00fcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41210/0 (socket says 172.21.15.118:41210) 2024-09-21T12:00:31.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13cffff640 1 -- 172.21.15.118:0/1651491560 learned_addr learned my addr 172.21.15.118:0/1651491560 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:00:31.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13cf7fe640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13d0106820 0x7f13d00fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13cffff640 1 -- 172.21.15.118:0/1651491560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13d0106820 msgr2=0x7f13d00fd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:31.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13cffff640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13d0106820 0x7f13d00fd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:31.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.973+0000 7f13cffff640 1 -- 172.21.15.118:0/1651491560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d00fd620 con 0x7f13d0100820 2024-09-21T12:00:31.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.974+0000 7f13cffff640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 0x7f13d00fcba0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f13c000d8d0 tx=0x7f13c000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:31.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.974+0000 7f13cd7fa640 1 -- 172.21.15.118:0/1651491560 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13c0017070 con 0x7f13d0100820 2024-09-21T12:00:31.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.974+0000 7f13cd7fa640 1 -- 172.21.15.118:0/1651491560 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13c0010460 con 0x7f13d0100820 2024-09-21T12:00:31.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.974+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d00fd910 con 0x7f13d0100820 2024-09-21T12:00:31.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.974+0000 7f13cd7fa640 1 -- 172.21.15.118:0/1651491560 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13c000f5f0 con 0x7f13d0100820 2024-09-21T12:00:31.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.974+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d01a3e40 con 0x7f13d0100820 2024-09-21T12:00:31.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.975+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d0101f60 con 0x7f13d0100820 2024-09-21T12:00:31.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.975+0000 7f13cd7fa640 1 -- 172.21.15.118:0/1651491560 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f13c0009a30 con 0x7f13d0100820 2024-09-21T12:00:31.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.976+0000 7f13cd7fa640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13b807af80 0x7f13b807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:00:31.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.976+0000 7f13cd7fa640 1 -- 172.21.15.118:0/1651491560 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f13c009de00 con 0x7f13d0100820 2024-09-21T12:00:31.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.976+0000 7f13cf7fe640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13b807af80 0x7f13b807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:00:31.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.976+0000 7f13cf7fe640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13b807af80 0x7f13b807d440 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f13d00fe630 tx=0x7f13c4031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:00:31.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:31.980+0000 7f13cd7fa640 1 -- 172.21.15.118:0/1651491560 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13c00693d0 con 0x7f13d0100820 2024-09-21T12:00:32.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.227+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f13d0100c80 con 0x7f13d0100820 2024-09-21T12:00:32.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.227+0000 7f13cd7fa640 1 -- 172.21.15.118:0/1651491560 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f13c006e280 con 0x7f13d0100820 2024-09-21T12:00:32.230 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:00:32.230 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:00:32.230 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:00:32.230 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:00:32.230 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:00:32.230 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:00:32.230 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:00:32.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13b807af80 msgr2=0x7f13b807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13b807af80 0x7f13b807d440 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f13d00fe630 tx=0x7f13c4031400 comp rx=0 tx=0).stop 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 msgr2=0x7f13d00fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 0x7f13d00fcba0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f13c000d8d0 tx=0x7f13c000dd90 comp rx=0 tx=0).stop 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 shutdown_connections 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13d0106820 0x7f13d00fd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13b807af80 0x7f13b807d440 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 --2- 172.21.15.118:0/1651491560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13d0100820 0x7f13d00fcba0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 >> 172.21.15.118:0/1651491560 conn(0x7f13d00fc520 msgr2=0x7f13d006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.229+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 shutdown_connections 2024-09-21T12:00:32.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:00:32.230+0000 7f13d6877640 1 -- 172.21.15.118:0/1651491560 wait complete. 2024-09-21T12:00:32.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:32 smithi149 ceph-mon[79770]: from='client.44641 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:32.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:32 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1651491560' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:00:33.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:32 smithi118 ceph-mon[111738]: from='client.44641 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:33.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:32 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1651491560' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:00:33.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:33 smithi149 ceph-mon[79770]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:33.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:33 smithi149 ceph-mon[79770]: pgmap v651: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:33 smithi118 ceph-mon[111738]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:00:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:33 smithi118 ceph-mon[111738]: pgmap v651: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:35.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:35 smithi149 ceph-mon[79770]: pgmap v652: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:00:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:35 smithi118 ceph-mon[111738]: pgmap v652: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:00:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:37 smithi149 ceph-mon[79770]: pgmap v653: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:37 smithi118 ceph-mon[111738]: pgmap v653: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:39.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:39 smithi149 ceph-mon[79770]: pgmap v654: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:40.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:39 smithi118 ceph-mon[111738]: pgmap v654: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:41 smithi149 ceph-mon[79770]: pgmap v655: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:41 smithi118 ceph-mon[111738]: pgmap v655: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:43 smithi118 ceph-mon[111738]: pgmap v656: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:43.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:43 smithi149 ceph-mon[79770]: pgmap v656: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:45.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:45 smithi149 ceph-mon[79770]: pgmap v657: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:46.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:45 smithi118 ceph-mon[111738]: pgmap v657: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:47.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:47 smithi149 ceph-mon[79770]: pgmap v658: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:47 smithi118 ceph-mon[111738]: pgmap v658: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:49.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:49 smithi149 ceph-mon[79770]: pgmap v659: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:50.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:49 smithi118 ceph-mon[111738]: pgmap v659: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:51.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:00:51.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:00:52.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:51 smithi118 ceph-mon[111738]: pgmap v660: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:52.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:51 smithi149 ceph-mon[79770]: pgmap v660: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:53 smithi118 ceph-mon[111738]: pgmap v661: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:54.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:53 smithi149 ceph-mon[79770]: pgmap v661: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:56.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:55 smithi118 ceph-mon[111738]: pgmap v662: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:56.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:55 smithi149 ceph-mon[79770]: pgmap v662: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:58.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:57 smithi118 ceph-mon[111738]: pgmap v663: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:00:58.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:57 smithi149 ceph-mon[79770]: pgmap v663: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:00.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:00:59 smithi118 ceph-mon[111738]: pgmap v664: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:00.128 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:00:59 smithi149 ceph-mon[79770]: pgmap v664: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:01.967 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:01 smithi118 ceph-mon[111738]: pgmap v665: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:02.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:01 smithi149 ceph-mon[79770]: pgmap v665: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:02.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.323+0000 7effe5040640 1 -- 172.21.15.118:0/3607603657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 msgr2=0x7effe0102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.323+0000 7effe5040640 1 --2- 172.21.15.118:0/3607603657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 0x7effe0102ec0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7effd0009880 tx=0x7effd002a530 comp rx=0 tx=0).stop 2024-09-21T12:01:02.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.323+0000 7effe5040640 1 -- 172.21.15.118:0/3607603657 shutdown_connections 2024-09-21T12:01:02.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.323+0000 7effe5040640 1 --2- 172.21.15.118:0/3607603657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe0103400 0x7effe010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.323+0000 7effe5040640 1 --2- 172.21.15.118:0/3607603657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 0x7effe0102ec0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.323+0000 7effe5040640 1 -- 172.21.15.118:0/3607603657 >> 172.21.15.118:0/3607603657 conn(0x7effe00fc520 msgr2=0x7effe00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:02.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.323+0000 7effe5040640 1 -- 172.21.15.118:0/3607603657 shutdown_connections 2024-09-21T12:01:02.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.324+0000 7effe5040640 1 -- 172.21.15.118:0/3607603657 wait complete. 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.324+0000 7effe5040640 1 Processor -- start 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effe5040640 1 -- start start 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effe5040640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 0x7effe019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effe5040640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe0103400 0x7effe019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effe5040640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7effe010edf0 con 0x7effe0102ae0 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effe5040640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7effe010ec70 con 0x7effe0103400 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effded9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 0x7effe019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effded9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 0x7effe019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48814/0 (socket says 172.21.15.118:48814) 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effded9d640 1 -- 172.21.15.118:0/1142893528 learned_addr learned my addr 172.21.15.118:0/1142893528 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effde59c640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe0103400 0x7effe019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:02.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effded9d640 1 -- 172.21.15.118:0/1142893528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe0103400 msgr2=0x7effe019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effded9d640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe0103400 0x7effe019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.325+0000 7effded9d640 1 -- 172.21.15.118:0/1142893528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe01977e0 con 0x7effe0102ae0 2024-09-21T12:01:02.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.326+0000 7effded9d640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 0x7effe019d660 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7effd0031460 tx=0x7effd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:02.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.326+0000 7effc7fff640 1 -- 172.21.15.118:0/1142893528 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effd003f070 con 0x7effe0102ae0 2024-09-21T12:01:02.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.326+0000 7effc7fff640 1 -- 172.21.15.118:0/1142893528 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effd0004cf0 con 0x7effe0102ae0 2024-09-21T12:01:02.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.326+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe0197a70 con 0x7effe0102ae0 2024-09-21T12:01:02.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.326+0000 7effc7fff640 1 -- 172.21.15.118:0/1142893528 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effd0035030 con 0x7effe0102ae0 2024-09-21T12:01:02.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.326+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe0197fa0 con 0x7effe0102ae0 2024-09-21T12:01:02.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.327+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe006abe0 con 0x7effe0102ae0 2024-09-21T12:01:02.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.328+0000 7effc7fff640 1 -- 172.21.15.118:0/1142893528 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7effd0042070 con 0x7effe0102ae0 2024-09-21T12:01:02.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.328+0000 7effc7fff640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7effc807af30 0x7effc807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:02.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.328+0000 7effc7fff640 1 -- 172.21.15.118:0/1142893528 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7effd00bec10 con 0x7effe0102ae0 2024-09-21T12:01:02.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.328+0000 7effde59c640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7effc807af30 0x7effc807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:02.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.329+0000 7effde59c640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7effc807af30 0x7effc807d3f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7effd4005fd0 tx=0x7effd4005f60 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:02.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.332+0000 7effc7fff640 1 -- 172.21.15.118:0/1142893528 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effd008a0c0 con 0x7effe0102ae0 2024-09-21T12:01:02.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.526+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7effe0198250 con 0x7effc807af30 2024-09-21T12:01:02.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.528+0000 7effc7fff640 1 -- 172.21.15.118:0/1142893528 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7effe0198250 con 0x7effc807af30 2024-09-21T12:01:02.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7effc807af30 msgr2=0x7effc807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7effc807af30 0x7effc807d3f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7effd4005fd0 tx=0x7effd4005f60 comp rx=0 tx=0).stop 2024-09-21T12:01:02.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 msgr2=0x7effe019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 0x7effe019d660 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7effd0031460 tx=0x7effd00048f0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 shutdown_connections 2024-09-21T12:01:02.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe0103400 0x7effe019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7effc807af30 0x7effc807d3f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 --2- 172.21.15.118:0/1142893528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe0102ae0 0x7effe019d660 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 >> 172.21.15.118:0/1142893528 conn(0x7effe00fc520 msgr2=0x7effe0108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:02.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 shutdown_connections 2024-09-21T12:01:02.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.530+0000 7effe5040640 1 -- 172.21.15.118:0/1142893528 wait complete. 2024-09-21T12:01:02.541 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:01:02.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.612+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3612591328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 msgr2=0x7f7dd0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.612+0000 7f7dd51c6640 1 --2- 172.21.15.118:0/3612591328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 0x7f7dd0107d10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009880 tx=0x7f7dc802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.612+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3612591328 shutdown_connections 2024-09-21T12:01:02.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.612+0000 7f7dd51c6640 1 --2- 172.21.15.118:0/3612591328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0101930 0x7f7dd0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.612+0000 7f7dd51c6640 1 --2- 172.21.15.118:0/3612591328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 0x7f7dd0107d10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.612+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3612591328 >> 172.21.15.118:0/3612591328 conn(0x7f7dd00fd630 msgr2=0x7f7dd00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:02.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.612+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3612591328 shutdown_connections 2024-09-21T12:01:02.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.612+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3612591328 wait complete. 2024-09-21T12:01:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dd51c6640 1 Processor -- start 2024-09-21T12:01:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dd51c6640 1 -- start start 2024-09-21T12:01:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dd51c6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0101930 0x7f7dd019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dd51c6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 0x7f7dd019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dd51c6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd010ee60 con 0x7f7dd0107930 2024-09-21T12:01:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dd51c6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd010ece0 con 0x7f7dd0101930 2024-09-21T12:01:02.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dce59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 0x7f7dd019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dce59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 0x7f7dd019dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48826/0 (socket says 172.21.15.118:48826) 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dce59c640 1 -- 172.21.15.118:0/3905823992 learned_addr learned my addr 172.21.15.118:0/3905823992 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.613+0000 7f7dced9d640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0101930 0x7f7dd019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.614+0000 7f7dce59c640 1 -- 172.21.15.118:0/3905823992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0101930 msgr2=0x7f7dd019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.614+0000 7f7dce59c640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0101930 0x7f7dd019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.614+0000 7f7dce59c640 1 -- 172.21.15.118:0/3905823992 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd0197890 con 0x7f7dd0107930 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.614+0000 7f7dce59c640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 0x7f7dd019dc10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7db800b420 tx=0x7f7db800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.614+0000 7f7dc7fff640 1 -- 172.21.15.118:0/3905823992 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7db8011630 con 0x7f7dd0107930 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.614+0000 7f7dc7fff640 1 -- 172.21.15.118:0/3905823992 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7db8016070 con 0x7f7dd0107930 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.614+0000 7f7dc7fff640 1 -- 172.21.15.118:0/3905823992 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7db8010d40 con 0x7f7dd0107930 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.614+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd0197b80 con 0x7f7dd0107930 2024-09-21T12:01:02.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.614+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd0198110 con 0x7f7dd0107930 2024-09-21T12:01:02.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.615+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd0103070 con 0x7f7dd0107930 2024-09-21T12:01:02.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.616+0000 7f7dc7fff640 1 -- 172.21.15.118:0/3905823992 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7db80117d0 con 0x7f7dd0107930 2024-09-21T12:01:02.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.616+0000 7f7dc7fff640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7dbc07af30 0x7f7dbc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:02.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.616+0000 7f7dc7fff640 1 -- 172.21.15.118:0/3905823992 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f7db809d830 con 0x7f7dd0107930 2024-09-21T12:01:02.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.617+0000 7f7dced9d640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7dbc07af30 0x7f7dbc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:02.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.617+0000 7f7dced9d640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7dbc07af30 0x7f7dbc07d3f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8000c00 tx=0x7f7dc8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:02.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.621+0000 7f7dc7fff640 1 -- 172.21.15.118:0/3905823992 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7db8068d80 con 0x7f7dd0107930 2024-09-21T12:01:02.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.815+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7dd0198dc0 con 0x7f7dbc07af30 2024-09-21T12:01:02.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.816+0000 7f7dc7fff640 1 -- 172.21.15.118:0/3905823992 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f7dd0198dc0 con 0x7f7dbc07af30 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.818+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7dbc07af30 msgr2=0x7f7dbc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.818+0000 7f7dd51c6640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7dbc07af30 0x7f7dbc07d3f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8000c00 tx=0x7f7dc8031400 comp rx=0 tx=0).stop 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.818+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 msgr2=0x7f7dd019dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.818+0000 7f7dd51c6640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 0x7f7dd019dc10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7db800b420 tx=0x7f7db800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.818+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 shutdown_connections 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.818+0000 7f7dd51c6640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7dbc07af30 0x7f7dbc07d3f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.818+0000 7f7dd51c6640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dd0107930 0x7f7dd019dc10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.818+0000 7f7dd51c6640 1 --2- 172.21.15.118:0/3905823992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd0101930 0x7f7dd019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.818+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 >> 172.21.15.118:0/3905823992 conn(0x7f7dd00fd630 msgr2=0x7f7dd00fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:02.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.819+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 shutdown_connections 2024-09-21T12:01:02.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.819+0000 7f7dd51c6640 1 -- 172.21.15.118:0/3905823992 wait complete. 2024-09-21T12:01:02.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.900+0000 7f0f11fa2640 1 -- 172.21.15.118:0/2423816329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c101930 msgr2=0x7f0f0c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.900+0000 7f0f11fa2640 1 --2- 172.21.15.118:0/2423816329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c101930 0x7f0f0c101d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009880 tx=0x7f0f0002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.900+0000 7f0f11fa2640 1 -- 172.21.15.118:0/2423816329 shutdown_connections 2024-09-21T12:01:02.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.900+0000 7f0f11fa2640 1 --2- 172.21.15.118:0/2423816329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c101930 0x7f0f0c101d90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.900+0000 7f0f11fa2640 1 --2- 172.21.15.118:0/2423816329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f0c107930 0x7f0f0c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.900+0000 7f0f11fa2640 1 -- 172.21.15.118:0/2423816329 >> 172.21.15.118:0/2423816329 conn(0x7f0f0c0fd630 msgr2=0x7f0f0c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:02.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.900+0000 7f0f11fa2640 1 -- 172.21.15.118:0/2423816329 shutdown_connections 2024-09-21T12:01:02.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.900+0000 7f0f11fa2640 1 -- 172.21.15.118:0/2423816329 wait complete. 2024-09-21T12:01:02.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.901+0000 7f0f11fa2640 1 Processor -- start 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.901+0000 7f0f11fa2640 1 -- start start 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.901+0000 7f0f11fa2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f0c101930 0x7f0f0c19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.901+0000 7f0f11fa2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c107930 0x7f0f0c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.901+0000 7f0f11fa2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c10ee60 con 0x7f0f0c107930 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.901+0000 7f0f11fa2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c10ece0 con 0x7f0f0c101930 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f0affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c107930 0x7f0f0c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f0affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c107930 0x7f0f0c19fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48834/0 (socket says 172.21.15.118:48834) 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f0affd640 1 -- 172.21.15.118:0/1893109551 learned_addr learned my addr 172.21.15.118:0/1893109551 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f0b7fe640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f0c101930 0x7f0f0c19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f0affd640 1 -- 172.21.15.118:0/1893109551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f0c101930 msgr2=0x7f0f0c19f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f0affd640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f0c101930 0x7f0f0c19f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:02.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f0affd640 1 -- 172.21.15.118:0/1893109551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c199a40 con 0x7f0f0c107930 2024-09-21T12:01:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f0affd640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c107930 0x7f0f0c19fdc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f00031460 tx=0x7f0f000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f08ff9640 1 -- 172.21.15.118:0/1893109551 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f0003f070 con 0x7f0f0c107930 2024-09-21T12:01:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f08ff9640 1 -- 172.21.15.118:0/1893109551 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f00004cf0 con 0x7f0f0c107930 2024-09-21T12:01:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0c199cd0 con 0x7f0f0c107930 2024-09-21T12:01:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f08ff9640 1 -- 172.21.15.118:0/1893109551 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f00035030 con 0x7f0f0c107930 2024-09-21T12:01:02.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.902+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0c19a200 con 0x7f0f0c107930 2024-09-21T12:01:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.904+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0c103070 con 0x7f0f0c107930 2024-09-21T12:01:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.904+0000 7f0f08ff9640 1 -- 172.21.15.118:0/1893109551 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0f00042070 con 0x7f0f0c107930 2024-09-21T12:01:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.905+0000 7f0f08ff9640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0ef407af30 0x7f0ef407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.905+0000 7f0f0b7fe640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0ef407af30 0x7f0ef407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.905+0000 7f0f08ff9640 1 -- 172.21.15.118:0/1893109551 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0f000bebb0 con 0x7f0f0c107930 2024-09-21T12:01:02.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.905+0000 7f0f0b7fe640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0ef407af30 0x7f0ef407d3f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c19ab80 tx=0x7f0efc009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:02.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:02.909+0000 7f0f08ff9640 1 -- 172.21.15.118:0/1893109551 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f0008a0a0 con 0x7f0f0c107930 2024-09-21T12:01:03.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.094+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0f0c19b010 con 0x7f0ef407af30 2024-09-21T12:01:03.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.104+0000 7f0f08ff9640 1 -- 172.21.15.118:0/1893109551 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0f0c19b010 con 0x7f0ef407af30 2024-09-21T12:01:03.106 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:01:03.106 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (18m) 13m ago 29m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:01:03.106 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (22m) 13m ago 30m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:01:03.106 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (21m) 12m ago 29m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:01:03.106 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (17m) 13m ago 30m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:01:03.106 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (17m) 12m ago 29m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (18m) 13m ago 29m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (13m) 13m ago 24m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (13m) 13m ago 24m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (24m) 12m ago 24m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (12m) 12m ago 24m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (21m) 13m ago 31m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (20m) 12m ago 29m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (17m) 13m ago 31m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (17m) 12m ago 29m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (19m) 13m ago 30m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (19m) 12m ago 29m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (16m) 13m ago 27m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (16m) 13m ago 27m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (15m) 13m ago 26m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:01:03.107 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (14m) 12m ago 26m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:01:03.108 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (14m) 12m ago 26m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:01:03.108 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (13m) 12m ago 25m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:01:03.108 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (19m) 13m ago 29m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:01:03.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0ef407af30 msgr2=0x7f0ef407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0ef407af30 0x7f0ef407d3f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c19ab80 tx=0x7f0efc009110 comp rx=0 tx=0).stop 2024-09-21T12:01:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c107930 msgr2=0x7f0f0c19fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c107930 0x7f0f0c19fdc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f00031460 tx=0x7f0f000048f0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 shutdown_connections 2024-09-21T12:01:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0ef407af30 0x7f0ef407d3f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0c107930 0x7f0f0c19fdc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 --2- 172.21.15.118:0/1893109551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f0c101930 0x7f0f0c19f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 >> 172.21.15.118:0/1893109551 conn(0x7f0f0c0fd630 msgr2=0x7f0f0c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 shutdown_connections 2024-09-21T12:01:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.106+0000 7f0f11fa2640 1 -- 172.21.15.118:0/1893109551 wait complete. 2024-09-21T12:01:03.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.187+0000 7fb57f5e6640 1 -- 172.21.15.118:0/443506262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 msgr2=0x7fb578107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.187+0000 7fb57f5e6640 1 --2- 172.21.15.118:0/443506262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 0x7fb578107cf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb568009880 tx=0x7fb56802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.187+0000 7fb57f5e6640 1 -- 172.21.15.118:0/443506262 shutdown_connections 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.187+0000 7fb57f5e6640 1 --2- 172.21.15.118:0/443506262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578101910 0x7fb578101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.187+0000 7fb57f5e6640 1 --2- 172.21.15.118:0/443506262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 0x7fb578107cf0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.187+0000 7fb57f5e6640 1 -- 172.21.15.118:0/443506262 >> 172.21.15.118:0/443506262 conn(0x7fb5780fd5f0 msgr2=0x7fb5780ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.187+0000 7fb57f5e6640 1 -- 172.21.15.118:0/443506262 shutdown_connections 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.187+0000 7fb57f5e6640 1 -- 172.21.15.118:0/443506262 wait complete. 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.187+0000 7fb57f5e6640 1 Processor -- start 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57f5e6640 1 -- start start 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57f5e6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578101910 0x7fb5780744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57f5e6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 0x7fb578074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57f5e6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810ede0 con 0x7fb578107910 2024-09-21T12:01:03.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57f5e6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810ec60 con 0x7fb578101910 2024-09-21T12:01:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57cb81640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 0x7fb578074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57cb81640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 0x7fb578074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48862/0 (socket says 172.21.15.118:48862) 2024-09-21T12:01:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57cb81640 1 -- 172.21.15.118:0/415703276 learned_addr learned my addr 172.21.15.118:0/415703276 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57d382640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578101910 0x7fb5780744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57cb81640 1 -- 172.21.15.118:0/415703276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578101910 msgr2=0x7fb5780744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57cb81640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578101910 0x7fb5780744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57cb81640 1 -- 172.21.15.118:0/415703276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb578074f70 con 0x7fb578107910 2024-09-21T12:01:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.188+0000 7fb57cb81640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 0x7fb578074a30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c8f0 tx=0x7fb57400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.189+0000 7fb56e7fc640 1 -- 172.21.15.118:0/415703276 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5740079b0 con 0x7fb578107910 2024-09-21T12:01:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.189+0000 7fb56e7fc640 1 -- 172.21.15.118:0/415703276 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb5740054e0 con 0x7fb578107910 2024-09-21T12:01:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.189+0000 7fb56e7fc640 1 -- 172.21.15.118:0/415703276 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb574004dd0 con 0x7fb578107910 2024-09-21T12:01:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.189+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb578075260 con 0x7fb578107910 2024-09-21T12:01:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.189+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781a3e60 con 0x7fb578107910 2024-09-21T12:01:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.190+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb578103050 con 0x7fb578107910 2024-09-21T12:01:03.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.190+0000 7fb56e7fc640 1 -- 172.21.15.118:0/415703276 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb574005020 con 0x7fb578107910 2024-09-21T12:01:03.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.191+0000 7fb56e7fc640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:03.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.191+0000 7fb56e7fc640 1 -- 172.21.15.118:0/415703276 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb57409df50 con 0x7fb578107910 2024-09-21T12:01:03.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.191+0000 7fb57d382640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:03.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.192+0000 7fb57d382640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb568031460 tx=0x7fb568009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:03.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.195+0000 7fb56e7fc640 1 -- 172.21.15.118:0/415703276 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb574014030 con 0x7fb578107910 2024-09-21T12:01:03.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.445+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb578109e80 con 0x7fb578107910 2024-09-21T12:01:03.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.445+0000 7fb56e7fc640 1 -- 172.21.15.118:0/415703276 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fb574069520 con 0x7fb578107910 2024-09-21T12:01:03.447 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:01:03.447 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T12:01:03.448 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:01:03.449 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:01:03.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 msgr2=0x7fb56407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb568031460 tx=0x7fb568009560 comp rx=0 tx=0).stop 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 msgr2=0x7fb578074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 0x7fb578074a30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c8f0 tx=0x7fb57400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 shutdown_connections 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb56407af30 0x7fb56407d3f0 secure :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb568031460 tx=0x7fb568009560 comp rx=0 tx=0).stop 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb578107910 0x7fb578074a30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 --2- 172.21.15.118:0/415703276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb578101910 0x7fb5780744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 >> 172.21.15.118:0/415703276 conn(0x7fb5780fd5f0 msgr2=0x7fb5780fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 shutdown_connections 2024-09-21T12:01:03.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.447+0000 7fb57f5e6640 1 -- 172.21.15.118:0/415703276 wait complete. 2024-09-21T12:01:03.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.528+0000 7f0cd573b640 1 -- 172.21.15.118:0/1822823945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0107930 msgr2=0x7f0cd0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.528+0000 7f0cd573b640 1 --2- 172.21.15.118:0/1822823945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0107930 0x7f0cd0107d10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009880 tx=0x7f0cc002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.529+0000 7f0cd573b640 1 -- 172.21.15.118:0/1822823945 shutdown_connections 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.529+0000 7f0cd573b640 1 --2- 172.21.15.118:0/1822823945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd0101930 0x7f0cd0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.529+0000 7f0cd573b640 1 --2- 172.21.15.118:0/1822823945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0107930 0x7f0cd0107d10 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.529+0000 7f0cd573b640 1 -- 172.21.15.118:0/1822823945 >> 172.21.15.118:0/1822823945 conn(0x7f0cd00fd630 msgr2=0x7f0cd00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.529+0000 7f0cd573b640 1 -- 172.21.15.118:0/1822823945 shutdown_connections 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.529+0000 7f0cd573b640 1 -- 172.21.15.118:0/1822823945 wait complete. 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.529+0000 7f0cd573b640 1 Processor -- start 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.529+0000 7f0cd573b640 1 -- start start 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cd573b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0101930 0x7f0cd00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cd573b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd0107930 0x7f0cd0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cd573b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd010ee00 con 0x7f0cd0101930 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cd573b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd010ec80 con 0x7f0cd0107930 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cceffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0101930 0x7f0cd00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cceffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0101930 0x7f0cd00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48888/0 (socket says 172.21.15.118:48888) 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cceffd640 1 -- 172.21.15.118:0/1622071466 learned_addr learned my addr 172.21.15.118:0/1622071466 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cce7fc640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd0107930 0x7f0cd0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:03.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cceffd640 1 -- 172.21.15.118:0/1622071466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd0107930 msgr2=0x7f0cd0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cceffd640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd0107930 0x7f0cd0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cceffd640 1 -- 172.21.15.118:0/1622071466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd0074f70 con 0x7f0cd0101930 2024-09-21T12:01:03.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cceffd640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0101930 0x7f0cd00744f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0031460 tx=0x7f0cc00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:03.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cc7fff640 1 -- 172.21.15.118:0/1622071466 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0cc003f070 con 0x7f0cd0101930 2024-09-21T12:01:03.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd0075200 con 0x7f0cd0101930 2024-09-21T12:01:03.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cc7fff640 1 -- 172.21.15.118:0/1622071466 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0cc00035f0 con 0x7f0cd0101930 2024-09-21T12:01:03.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cc7fff640 1 -- 172.21.15.118:0/1622071466 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0cc0035030 con 0x7f0cd0101930 2024-09-21T12:01:03.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.530+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd01a3db0 con 0x7f0cd0101930 2024-09-21T12:01:03.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.531+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd0103070 con 0x7f0cd0101930 2024-09-21T12:01:03.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.532+0000 7f0cc7fff640 1 -- 172.21.15.118:0/1622071466 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0cc0042070 con 0x7f0cd0101930 2024-09-21T12:01:03.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.533+0000 7f0cc7fff640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cbc07af30 0x7f0cbc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:03.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.533+0000 7f0cce7fc640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cbc07af30 0x7f0cbc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:03.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.533+0000 7f0cc7fff640 1 -- 172.21.15.118:0/1622071466 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0cc00bead0 con 0x7f0cd0101930 2024-09-21T12:01:03.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.533+0000 7f0cce7fc640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cbc07af30 0x7f0cbc07d3f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8005fd0 tx=0x7f0cb8005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:03.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.537+0000 7f0cc7fff640 1 -- 172.21.15.118:0/1622071466 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0cc008a020 con 0x7f0cd0101930 2024-09-21T12:01:03.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.750+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0cd0075a20 con 0x7f0cd0101930 2024-09-21T12:01:03.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.751+0000 7f0cc7fff640 1 -- 172.21.15.118:0/1622071466 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f0cc008c020 con 0x7f0cd0101930 2024-09-21T12:01:03.753 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:01:03.754 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:01:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:01:03.756 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:01:03.757 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T12:01:03.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cbc07af30 msgr2=0x7f0cbc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cbc07af30 0x7f0cbc07d3f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8005fd0 tx=0x7f0cb8005850 comp rx=0 tx=0).stop 2024-09-21T12:01:03.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0101930 msgr2=0x7f0cd00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0101930 0x7f0cd00744f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0031460 tx=0x7f0cc00045e0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 shutdown_connections 2024-09-21T12:01:03.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cd0107930 0x7f0cd0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0cbc07af30 0x7f0cbc07d3f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 --2- 172.21.15.118:0/1622071466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cd0101930 0x7f0cd00744f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 >> 172.21.15.118:0/1622071466 conn(0x7f0cd00fd630 msgr2=0x7f0cd00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:03.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 shutdown_connections 2024-09-21T12:01:03.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.753+0000 7f0cd573b640 1 -- 172.21.15.118:0/1622071466 wait complete. 2024-09-21T12:01:03.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.838+0000 7f6d46777640 1 -- 172.21.15.118:0/1186764604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 msgr2=0x7f6d40102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.838+0000 7f6d46777640 1 --2- 172.21.15.118:0/1186764604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 0x7f6d40102e90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009880 tx=0x7f6d3002a530 comp rx=0 tx=0).stop 2024-09-21T12:01:03.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.838+0000 7f6d46777640 1 -- 172.21.15.118:0/1186764604 shutdown_connections 2024-09-21T12:01:03.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.838+0000 7f6d46777640 1 --2- 172.21.15.118:0/1186764604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d401033d0 0x7f6d4010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.838+0000 7f6d46777640 1 --2- 172.21.15.118:0/1186764604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 0x7f6d40102e90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.838+0000 7f6d46777640 1 -- 172.21.15.118:0/1186764604 >> 172.21.15.118:0/1186764604 conn(0x7f6d400fc4f0 msgr2=0x7f6d400fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:03.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.838+0000 7f6d46777640 1 -- 172.21.15.118:0/1186764604 shutdown_connections 2024-09-21T12:01:03.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.838+0000 7f6d46777640 1 -- 172.21.15.118:0/1186764604 wait complete. 2024-09-21T12:01:03.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d46777640 1 Processor -- start 2024-09-21T12:01:03.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d46777640 1 -- start start 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d46777640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 0x7f6d40100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d46777640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d401033d0 0x7f6d40100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d46777640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4010edc0 con 0x7f6d40102ab0 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d46777640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4010ec40 con 0x7f6d401033d0 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 0x7f6d40100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 0x7f6d40100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48894/0 (socket says 172.21.15.118:48894) 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d3ffff640 1 -- 172.21.15.118:0/3620321916 learned_addr learned my addr 172.21.15.118:0/3620321916 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d3f7fe640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d401033d0 0x7f6d40100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d3ffff640 1 -- 172.21.15.118:0/3620321916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d401033d0 msgr2=0x7f6d40100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d3ffff640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d401033d0 0x7f6d40100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.839+0000 7f6d3ffff640 1 -- 172.21.15.118:0/3620321916 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d40101190 con 0x7f6d40102ab0 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.840+0000 7f6d3ffff640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 0x7f6d40100710 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6d30031460 tx=0x7f6d300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:03.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.840+0000 7f6d3d7fa640 1 -- 172.21.15.118:0/3620321916 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d3003f070 con 0x7f6d40102ab0 2024-09-21T12:01:03.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.840+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d40101420 con 0x7f6d40102ab0 2024-09-21T12:01:03.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.840+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d401a3d00 con 0x7f6d40102ab0 2024-09-21T12:01:03.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.840+0000 7f6d3d7fa640 1 -- 172.21.15.118:0/3620321916 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d300054e0 con 0x7f6d40102ab0 2024-09-21T12:01:03.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.840+0000 7f6d3d7fa640 1 -- 172.21.15.118:0/3620321916 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d30035030 con 0x7f6d40102ab0 2024-09-21T12:01:03.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.841+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d2c005290 con 0x7f6d40102ab0 2024-09-21T12:01:03.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.842+0000 7f6d3d7fa640 1 -- 172.21.15.118:0/3620321916 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6d30042070 con 0x7f6d40102ab0 2024-09-21T12:01:03.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.843+0000 7f6d3d7fa640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d2807af30 0x7f6d2807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:03.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.843+0000 7f6d3d7fa640 1 -- 172.21.15.118:0/3620321916 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f6d300beb10 con 0x7f6d40102ab0 2024-09-21T12:01:03.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.843+0000 7f6d3f7fe640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d2807af30 0x7f6d2807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:03.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.843+0000 7f6d3f7fe640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d2807af30 0x7f6d2807d3f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6d34005fd0 tx=0x7f6d34005f60 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:03.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:03.850+0000 7f6d3d7fa640 1 -- 172.21.15.118:0/3620321916 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d3008a000 con 0x7f6d40102ab0 2024-09-21T12:01:04.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.048+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6d2c000bc0 con 0x7f6d2807af30 2024-09-21T12:01:04.051 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:03 smithi118 ceph-mon[111738]: pgmap v666: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:04.051 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:03 smithi118 ceph-mon[111738]: from='client.35032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:04.051 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:03 smithi118 ceph-mon[111738]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:04.051 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:03 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/415703276' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:01:04.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.050+0000 7f6d3d7fa640 1 -- 172.21.15.118:0/3620321916 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6d2c000bc0 con 0x7f6d2807af30 2024-09-21T12:01:04.052 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:01:04.052 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:01:04.052 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:01:04.052 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:01:04.052 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:01:04.052 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:01:04.052 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:01:04.052 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:01:04.053 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:01:04.053 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:01:04.053 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T12:01:04.053 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:01:04.053 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:01:04.053 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:01:04.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d2807af30 msgr2=0x7f6d2807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:04.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d2807af30 0x7f6d2807d3f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6d34005fd0 tx=0x7f6d34005f60 comp rx=0 tx=0).stop 2024-09-21T12:01:04.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 msgr2=0x7f6d40100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:04.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 0x7f6d40100710 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6d30031460 tx=0x7f6d300048f0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 shutdown_connections 2024-09-21T12:01:04.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d401033d0 0x7f6d40100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d2807af30 0x7f6d2807d3f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 --2- 172.21.15.118:0/3620321916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d40102ab0 0x7f6d40100710 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 >> 172.21.15.118:0/3620321916 conn(0x7f6d400fc4f0 msgr2=0x7f6d40108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:04.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 shutdown_connections 2024-09-21T12:01:04.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.052+0000 7f6d46777640 1 -- 172.21.15.118:0/3620321916 wait complete. 2024-09-21T12:01:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.132+0000 7f061534a640 1 -- 172.21.15.118:0/2323953046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 msgr2=0x7f061010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.132+0000 7f061534a640 1 --2- 172.21.15.118:0/2323953046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 0x7f061010b8c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009880 tx=0x7f05f802a530 comp rx=0 tx=0).stop 2024-09-21T12:01:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.132+0000 7f061534a640 1 -- 172.21.15.118:0/2323953046 shutdown_connections 2024-09-21T12:01:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.132+0000 7f061534a640 1 --2- 172.21.15.118:0/2323953046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 0x7f061010b8c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.132+0000 7f061534a640 1 --2- 172.21.15.118:0/2323953046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0610102ab0 0x7f0610102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.132+0000 7f061534a640 1 -- 172.21.15.118:0/2323953046 >> 172.21.15.118:0/2323953046 conn(0x7f06100fc4f0 msgr2=0x7f06100fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.132+0000 7f061534a640 1 -- 172.21.15.118:0/2323953046 shutdown_connections 2024-09-21T12:01:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.132+0000 7f061534a640 1 -- 172.21.15.118:0/2323953046 wait complete. 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.133+0000 7f061534a640 1 Processor -- start 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.133+0000 7f061534a640 1 -- start start 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.133+0000 7f061534a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0610102ab0 0x7f0610100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.133+0000 7f061534a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 0x7f0610100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.133+0000 7f061534a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f061010ee40 con 0x7f06101033d0 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.133+0000 7f061534a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f061010ecc0 con 0x7f0610102ab0 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f060e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 0x7f0610100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f060e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 0x7f0610100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48926/0 (socket says 172.21.15.118:48926) 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f060e7fc640 1 -- 172.21.15.118:0/3816723405 learned_addr learned my addr 172.21.15.118:0/3816723405 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f060effd640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0610102ab0 0x7f0610100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f060e7fc640 1 -- 172.21.15.118:0/3816723405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0610102ab0 msgr2=0x7f0610100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f060e7fc640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0610102ab0 0x7f0610100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f060e7fc640 1 -- 172.21.15.118:0/3816723405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0610101190 con 0x7f06101033d0 2024-09-21T12:01:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f060e7fc640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 0x7f0610100c50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f05f8031460 tx=0x7f05f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f0607fff640 1 -- 172.21.15.118:0/3816723405 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05f803f070 con 0x7f06101033d0 2024-09-21T12:01:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f0607fff640 1 -- 172.21.15.118:0/3816723405 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05f8004ac0 con 0x7f06101033d0 2024-09-21T12:01:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0610101420 con 0x7f06101033d0 2024-09-21T12:01:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f0607fff640 1 -- 172.21.15.118:0/3816723405 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05f8035030 con 0x7f06101033d0 2024-09-21T12:01:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.134+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06101a3e30 con 0x7f06101033d0 2024-09-21T12:01:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.135+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f061006ac30 con 0x7f06101033d0 2024-09-21T12:01:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.136+0000 7f0607fff640 1 -- 172.21.15.118:0/3816723405 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f05f8042070 con 0x7f06101033d0 2024-09-21T12:01:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.136+0000 7f0607fff640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05fc07af80 0x7f05fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.137+0000 7f0607fff640 1 -- 172.21.15.118:0/3816723405 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f05f80beaa0 con 0x7f06101033d0 2024-09-21T12:01:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.137+0000 7f060effd640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05fc07af80 0x7f05fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.137+0000 7f060effd640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05fc07af80 0x7f05fc07d440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0600007dc0 tx=0x7f06000072f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:04.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.141+0000 7f0607fff640 1 -- 172.21.15.118:0/3816723405 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05f808a070 con 0x7f06101033d0 2024-09-21T12:01:04.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:03 smithi149 ceph-mon[79770]: pgmap v666: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:04.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:03 smithi149 ceph-mon[79770]: from='client.35032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:04.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:03 smithi149 ceph-mon[79770]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:04.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:03 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/415703276' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:01:04.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.387+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0610105f50 con 0x7f06101033d0 2024-09-21T12:01:04.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.388+0000 7f0607fff640 1 -- 172.21.15.118:0/3816723405 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f05f808ef20 con 0x7f06101033d0 2024-09-21T12:01:04.390 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:01:04.390 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:01:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:01:04.390 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:01:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:01:04.390 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:01:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:01:04.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05fc07af80 msgr2=0x7f05fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:04.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05fc07af80 0x7f05fc07d440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0600007dc0 tx=0x7f06000072f0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 msgr2=0x7f0610100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:04.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 0x7f0610100c50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f05f8031460 tx=0x7f05f80046c0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 shutdown_connections 2024-09-21T12:01:04.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f05fc07af80 0x7f05fc07d440 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06101033d0 0x7f0610100c50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 --2- 172.21.15.118:0/3816723405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0610102ab0 0x7f0610100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:04.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 >> 172.21.15.118:0/3816723405 conn(0x7f06100fc4f0 msgr2=0x7f0610108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:04.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 shutdown_connections 2024-09-21T12:01:04.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:04.390+0000 7f061534a640 1 -- 172.21.15.118:0/3816723405 wait complete. 2024-09-21T12:01:04.979 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:04 smithi149 ceph-mon[79770]: from='client.35040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:04.979 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:04 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1622071466' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:01:04.979 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:04 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3816723405' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:01:05.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:04 smithi118 ceph-mon[111738]: from='client.35040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:05.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:04 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1622071466' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:01:05.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:04 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3816723405' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:01:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:05 smithi118 ceph-mon[111738]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:05 smithi118 ceph-mon[111738]: pgmap v667: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:06.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:01:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:05 smithi149 ceph-mon[79770]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:05 smithi149 ceph-mon[79770]: pgmap v667: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:06.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:01:08.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:07 smithi118 ceph-mon[111738]: pgmap v668: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:08.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:07 smithi149 ceph-mon[79770]: pgmap v668: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:10.052 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:09 smithi149 ceph-mon[79770]: pgmap v669: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:10.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:09 smithi118 ceph-mon[111738]: pgmap v669: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:12.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:11 smithi118 ceph-mon[111738]: pgmap v670: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:12.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:11 smithi149 ceph-mon[79770]: pgmap v670: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:14.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:13 smithi118 ceph-mon[111738]: pgmap v671: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:14.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:13 smithi149 ceph-mon[79770]: pgmap v671: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:16.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:15 smithi118 ceph-mon[111738]: pgmap v672: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:16.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:15 smithi149 ceph-mon[79770]: pgmap v672: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:18.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:17 smithi149 ceph-mon[79770]: pgmap v673: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:18.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:17 smithi118 ceph-mon[111738]: pgmap v673: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:20.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:19 smithi118 ceph-mon[111738]: pgmap v674: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:20.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:19 smithi149 ceph-mon[79770]: pgmap v674: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:21.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:01:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:01:22.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:21 smithi118 ceph-mon[111738]: pgmap v675: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:22.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:21 smithi149 ceph-mon[79770]: pgmap v675: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:24.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:23 smithi118 ceph-mon[111738]: pgmap v676: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:24.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:23 smithi149 ceph-mon[79770]: pgmap v676: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:26.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:25 smithi118 ceph-mon[111738]: pgmap v677: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:26.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:25 smithi149 ceph-mon[79770]: pgmap v677: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:28.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:27 smithi118 ceph-mon[111738]: pgmap v678: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:28.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:27 smithi149 ceph-mon[79770]: pgmap v678: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:30.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:29 smithi118 ceph-mon[111738]: pgmap v679: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:30.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:29 smithi149 ceph-mon[79770]: pgmap v679: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:32.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:31 smithi118 ceph-mon[111738]: pgmap v680: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:32.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:31 smithi149 ceph-mon[79770]: pgmap v680: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:33 smithi118 ceph-mon[111738]: pgmap v681: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:34.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:33 smithi149 ceph-mon[79770]: pgmap v681: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:34.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/3191983160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 msgr2=0x7fc9a810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:34.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 --2- 172.21.15.118:0/3191983160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 0x7fc9a810b8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009880 tx=0x7fc99c02a530 comp rx=0 tx=0).stop 2024-09-21T12:01:34.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/3191983160 shutdown_connections 2024-09-21T12:01:34.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 --2- 172.21.15.118:0/3191983160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 0x7fc9a810b8f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 --2- 172.21.15.118:0/3191983160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8102ae0 0x7fc9a8102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/3191983160 >> 172.21.15.118:0/3191983160 conn(0x7fc9a80fc520 msgr2=0x7fc9a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:34.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/3191983160 shutdown_connections 2024-09-21T12:01:34.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/3191983160 wait complete. 2024-09-21T12:01:34.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 Processor -- start 2024-09-21T12:01:34.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.478+0000 7fc9ae9b4640 1 -- start start 2024-09-21T12:01:34.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9ae9b4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8102ae0 0x7fc9a819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:34.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9ae9b4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 0x7fc9a819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:34.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9ae9b4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a810ee10 con 0x7fc9a8103400 2024-09-21T12:01:34.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9ae9b4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a810ec90 con 0x7fc9a8102ae0 2024-09-21T12:01:34.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 0x7fc9a819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:34.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 0x7fc9a819fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58028/0 (socket says 172.21.15.118:58028) 2024-09-21T12:01:34.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9a77fe640 1 -- 172.21.15.118:0/1591847494 learned_addr learned my addr 172.21.15.118:0/1591847494 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:34.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9a7fff640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8102ae0 0x7fc9a819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:34.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9a77fe640 1 -- 172.21.15.118:0/1591847494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8102ae0 msgr2=0x7fc9a819f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:34.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9a77fe640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8102ae0 0x7fc9a819f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9a77fe640 1 -- 172.21.15.118:0/1591847494 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a8199ad0 con 0x7fc9a8103400 2024-09-21T12:01:34.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.479+0000 7fc9a77fe640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 0x7fc9a819fe50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc99c031460 tx=0x7fc99c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:34.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.480+0000 7fc9a57fa640 1 -- 172.21.15.118:0/1591847494 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc99c03f070 con 0x7fc9a8103400 2024-09-21T12:01:34.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.480+0000 7fc9a57fa640 1 -- 172.21.15.118:0/1591847494 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc99c004ac0 con 0x7fc9a8103400 2024-09-21T12:01:34.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.480+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a8199d60 con 0x7fc9a8103400 2024-09-21T12:01:34.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.480+0000 7fc9a57fa640 1 -- 172.21.15.118:0/1591847494 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc99c035030 con 0x7fc9a8103400 2024-09-21T12:01:34.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.480+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a819a290 con 0x7fc9a8103400 2024-09-21T12:01:34.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.481+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a806abe0 con 0x7fc9a8103400 2024-09-21T12:01:34.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.481+0000 7fc9a57fa640 1 -- 172.21.15.118:0/1591847494 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc99c042070 con 0x7fc9a8103400 2024-09-21T12:01:34.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.482+0000 7fc9a57fa640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc99007af80 0x7fc99007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:34.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.482+0000 7fc9a57fa640 1 -- 172.21.15.118:0/1591847494 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fc99c0bea10 con 0x7fc9a8103400 2024-09-21T12:01:34.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.482+0000 7fc9a7fff640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc99007af80 0x7fc99007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:34.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.482+0000 7fc9a7fff640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc99007af80 0x7fc99007d440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc9980058c0 tx=0x7fc99800c4a0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:34.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.486+0000 7fc9a57fa640 1 -- 172.21.15.118:0/1591847494 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc99c089fe0 con 0x7fc9a8103400 2024-09-21T12:01:34.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.682+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc9a819afc0 con 0x7fc99007af80 2024-09-21T12:01:34.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.684+0000 7fc9a57fa640 1 -- 172.21.15.118:0/1591847494 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fc9a819afc0 con 0x7fc99007af80 2024-09-21T12:01:34.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc99007af80 msgr2=0x7fc99007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:34.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc99007af80 0x7fc99007d440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc9980058c0 tx=0x7fc99800c4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 msgr2=0x7fc9a819fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:34.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 0x7fc9a819fe50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc99c031460 tx=0x7fc99c0046c0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 shutdown_connections 2024-09-21T12:01:34.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc99007af80 0x7fc99007d440 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8103400 0x7fc9a819fe50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 --2- 172.21.15.118:0/1591847494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8102ae0 0x7fc9a819f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 >> 172.21.15.118:0/1591847494 conn(0x7fc9a80fc520 msgr2=0x7fc9a8100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:34.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 shutdown_connections 2024-09-21T12:01:34.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.686+0000 7fc9ae9b4640 1 -- 172.21.15.118:0/1591847494 wait complete. 2024-09-21T12:01:34.697 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:01:34.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.769+0000 7f69261b3640 1 -- 172.21.15.118:0/4204244904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920107910 msgr2=0x7f6920107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:34.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.769+0000 7f69261b3640 1 --2- 172.21.15.118:0/4204244904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920107910 0x7f6920107cf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6910009880 tx=0x7f691002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.769+0000 7f69261b3640 1 -- 172.21.15.118:0/4204244904 shutdown_connections 2024-09-21T12:01:34.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.769+0000 7f69261b3640 1 --2- 172.21.15.118:0/4204244904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6920101910 0x7f6920101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.769+0000 7f69261b3640 1 --2- 172.21.15.118:0/4204244904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920107910 0x7f6920107cf0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.769+0000 7f69261b3640 1 -- 172.21.15.118:0/4204244904 >> 172.21.15.118:0/4204244904 conn(0x7f69200fd5f0 msgr2=0x7f69200ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:34.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.769+0000 7f69261b3640 1 -- 172.21.15.118:0/4204244904 shutdown_connections 2024-09-21T12:01:34.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.769+0000 7f69261b3640 1 -- 172.21.15.118:0/4204244904 wait complete. 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.769+0000 7f69261b3640 1 Processor -- start 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f69261b3640 1 -- start start 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f69261b3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920101910 0x7f69200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f69261b3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6920107910 0x7f6920074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f69261b3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f692010ede0 con 0x7f6920101910 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f69261b3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f692010ec60 con 0x7f6920107910 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920101910 0x7f69200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920101910 0x7f69200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58050/0 (socket says 172.21.15.118:58050) 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691f7fe640 1 -- 172.21.15.118:0/443418170 learned_addr learned my addr 172.21.15.118:0/443418170 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691f7fe640 1 -- 172.21.15.118:0/443418170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6920107910 msgr2=0x7f6920074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:34.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691f7fe640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6920107910 0x7f6920074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691f7fe640 1 -- 172.21.15.118:0/443418170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6920074f70 con 0x7f6920101910 2024-09-21T12:01:34.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691f7fe640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920101910 0x7f69200744f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6910031460 tx=0x7f69100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:34.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691d7fa640 1 -- 172.21.15.118:0/443418170 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f691003f070 con 0x7f6920101910 2024-09-21T12:01:34.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691d7fa640 1 -- 172.21.15.118:0/443418170 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69100035f0 con 0x7f6920101910 2024-09-21T12:01:34.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6920075200 con 0x7f6920101910 2024-09-21T12:01:34.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.770+0000 7f691d7fa640 1 -- 172.21.15.118:0/443418170 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6910035030 con 0x7f6920101910 2024-09-21T12:01:34.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.771+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69201a3df0 con 0x7f6920101910 2024-09-21T12:01:34.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.772+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6920103050 con 0x7f6920101910 2024-09-21T12:01:34.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.772+0000 7f691d7fa640 1 -- 172.21.15.118:0/443418170 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6910042070 con 0x7f6920101910 2024-09-21T12:01:34.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.773+0000 7f691d7fa640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f690c07af80 0x7f690c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:34.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.773+0000 7f691d7fa640 1 -- 172.21.15.118:0/443418170 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f69100be9c0 con 0x7f6920101910 2024-09-21T12:01:34.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.773+0000 7f6917fff640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f690c07af80 0x7f690c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:34.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.773+0000 7f6917fff640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f690c07af80 0x7f690c07d440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6908005fd0 tx=0x7f6908005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:34.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.779+0000 7f691d7fa640 1 -- 172.21.15.118:0/443418170 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6910089f90 con 0x7f6920101910 2024-09-21T12:01:34.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.971+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6920062630 con 0x7f690c07af80 2024-09-21T12:01:34.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.972+0000 7f691d7fa640 1 -- 172.21.15.118:0/443418170 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6920062630 con 0x7f690c07af80 2024-09-21T12:01:34.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f690c07af80 msgr2=0x7f690c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f690c07af80 0x7f690c07d440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6908005fd0 tx=0x7f6908005850 comp rx=0 tx=0).stop 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920101910 msgr2=0x7f69200744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920101910 0x7f69200744f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6910031460 tx=0x7f69100045e0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 shutdown_connections 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6920107910 0x7f6920074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f690c07af80 0x7f690c07d440 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 --2- 172.21.15.118:0/443418170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6920101910 0x7f69200744f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 >> 172.21.15.118:0/443418170 conn(0x7f69200fd5f0 msgr2=0x7f69200fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 shutdown_connections 2024-09-21T12:01:34.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:34.974+0000 7f69261b3640 1 -- 172.21.15.118:0/443418170 wait complete. 2024-09-21T12:01:35.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.055+0000 7f48ac315640 1 -- 172.21.15.118:0/3031811690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a41033c0 msgr2=0x7f48a410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.055+0000 7f48ac315640 1 --2- 172.21.15.118:0/3031811690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a41033c0 0x7f48a410b8b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4898009880 tx=0x7f489802a530 comp rx=0 tx=0).stop 2024-09-21T12:01:35.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.056+0000 7f48ac315640 1 -- 172.21.15.118:0/3031811690 shutdown_connections 2024-09-21T12:01:35.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.056+0000 7f48ac315640 1 --2- 172.21.15.118:0/3031811690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a41033c0 0x7f48a410b8b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.056+0000 7f48ac315640 1 --2- 172.21.15.118:0/3031811690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48a4102aa0 0x7f48a4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.056+0000 7f48ac315640 1 -- 172.21.15.118:0/3031811690 >> 172.21.15.118:0/3031811690 conn(0x7f48a40fc4c0 msgr2=0x7f48a40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:35.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.056+0000 7f48ac315640 1 -- 172.21.15.118:0/3031811690 shutdown_connections 2024-09-21T12:01:35.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.056+0000 7f48ac315640 1 -- 172.21.15.118:0/3031811690 wait complete. 2024-09-21T12:01:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.056+0000 7f48ac315640 1 Processor -- start 2024-09-21T12:01:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.056+0000 7f48ac315640 1 -- start start 2024-09-21T12:01:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48ac315640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a4102aa0 0x7f48a419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48ac315640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48a41033c0 0x7f48a419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48ac315640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f48a410edd0 con 0x7f48a4102aa0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48ac315640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f48a410ec50 con 0x7f48a41033c0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48aa0b1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a4102aa0 0x7f48a419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48aa0b1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a4102aa0 0x7f48a419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58068/0 (socket says 172.21.15.118:58068) 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48aa0b1640 1 -- 172.21.15.118:0/742830825 learned_addr learned my addr 172.21.15.118:0/742830825 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48aa0b1640 1 -- 172.21.15.118:0/742830825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48a41033c0 msgr2=0x7f48a419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48aa0b1640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48a41033c0 0x7f48a419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48aa0b1640 1 -- 172.21.15.118:0/742830825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a4197800 con 0x7f48a4102aa0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48aa0b1640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a4102aa0 0x7f48a419d680 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f489c00d6f0 tx=0x7f489c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48a37fe640 1 -- 172.21.15.118:0/742830825 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f489c017070 con 0x7f48a4102aa0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48a37fe640 1 -- 172.21.15.118:0/742830825 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f489c00de00 con 0x7f48a4102aa0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a4197af0 con 0x7f48a4102aa0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48a37fe640 1 -- 172.21.15.118:0/742830825 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f489c004bb0 con 0x7f48a4102aa0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.057+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a4198080 con 0x7f48a4102aa0 2024-09-21T12:01:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.058+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a406a410 con 0x7f48a4102aa0 2024-09-21T12:01:35.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.059+0000 7f48a37fe640 1 -- 172.21.15.118:0/742830825 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f489c009a30 con 0x7f48a4102aa0 2024-09-21T12:01:35.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.059+0000 7f48a37fe640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f488c07af80 0x7f488c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.059+0000 7f48a37fe640 1 -- 172.21.15.118:0/742830825 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f489c09dc20 con 0x7f48a4102aa0 2024-09-21T12:01:35.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.059+0000 7f48a98b0640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f488c07af80 0x7f488c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.060+0000 7f48a98b0640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f488c07af80 0x7f488c07d440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f48980096c0 tx=0x7f4898000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:35.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.064+0000 7f48a37fe640 1 -- 172.21.15.118:0/742830825 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f489c0691f0 con 0x7f48a4102aa0 2024-09-21T12:01:35.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.249+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f48a4198330 con 0x7f488c07af80 2024-09-21T12:01:35.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.259+0000 7f48a37fe640 1 -- 172.21.15.118:0/742830825 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f48a4198330 con 0x7f488c07af80 2024-09-21T12:01:35.261 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:01:35.261 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (19m) 13m ago 30m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:01:35.261 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (22m) 13m ago 30m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:01:35.261 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (21m) 13m ago 29m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:01:35.261 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (17m) 13m ago 30m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:01:35.261 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (17m) 13m ago 29m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:01:35.261 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (19m) 13m ago 30m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:01:35.261 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (13m) 13m ago 25m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (13m) 13m ago 25m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (25m) 13m ago 24m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (13m) 13m ago 25m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (21m) 13m ago 31m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (20m) 13m ago 29m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (18m) 13m ago 32m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (17m) 13m ago 29m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (20m) 13m ago 30m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (20m) 13m ago 29m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (17m) 13m ago 28m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (16m) 13m ago 27m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (15m) 13m ago 27m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (15m) 13m ago 27m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:01:35.262 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (14m) 13m ago 26m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:01:35.263 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (14m) 13m ago 26m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:01:35.263 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (19m) 13m ago 30m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:01:35.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.261+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f488c07af80 msgr2=0x7f488c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.261+0000 7f48ac315640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f488c07af80 0x7f488c07d440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f48980096c0 tx=0x7f4898000bc0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.261+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a4102aa0 msgr2=0x7f48a419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.261+0000 7f48ac315640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a4102aa0 0x7f48a419d680 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f489c00d6f0 tx=0x7f489c00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.261+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 shutdown_connections 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.261+0000 7f48ac315640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48a41033c0 0x7f48a419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.261+0000 7f48ac315640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f488c07af80 0x7f488c07d440 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.261+0000 7f48ac315640 1 --2- 172.21.15.118:0/742830825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48a4102aa0 0x7f48a419d680 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.261+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 >> 172.21.15.118:0/742830825 conn(0x7f48a40fc4c0 msgr2=0x7f48a4108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.262+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 shutdown_connections 2024-09-21T12:01:35.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.262+0000 7f48ac315640 1 -- 172.21.15.118:0/742830825 wait complete. 2024-09-21T12:01:35.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.341+0000 7f0b9504a640 1 -- 172.21.15.118:0/2951223506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90101930 msgr2=0x7f0b90101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.341+0000 7f0b9504a640 1 --2- 172.21.15.118:0/2951223506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90101930 0x7f0b90101d90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009880 tx=0x7f0b7802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.341+0000 7f0b9504a640 1 -- 172.21.15.118:0/2951223506 shutdown_connections 2024-09-21T12:01:35.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.341+0000 7f0b9504a640 1 --2- 172.21.15.118:0/2951223506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90101930 0x7f0b90101d90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.341+0000 7f0b9504a640 1 --2- 172.21.15.118:0/2951223506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b90107930 0x7f0b90107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.341+0000 7f0b9504a640 1 -- 172.21.15.118:0/2951223506 >> 172.21.15.118:0/2951223506 conn(0x7f0b900fd630 msgr2=0x7f0b900ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.341+0000 7f0b9504a640 1 -- 172.21.15.118:0/2951223506 shutdown_connections 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.341+0000 7f0b9504a640 1 -- 172.21.15.118:0/2951223506 wait complete. 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.341+0000 7f0b9504a640 1 Processor -- start 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b9504a640 1 -- start start 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b9504a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b90101930 0x7f0b9019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b9504a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90107930 0x7f0b9019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b9504a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9010ee00 con 0x7f0b90107930 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b9504a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9010ec80 con 0x7f0b90101930 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b8e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90107930 0x7f0b9019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b8e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90107930 0x7f0b9019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58078/0 (socket says 172.21.15.118:58078) 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b8e59c640 1 -- 172.21.15.118:0/1785521688 learned_addr learned my addr 172.21.15.118:0/1785521688 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:35.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b8ed9d640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b90101930 0x7f0b9019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b8e59c640 1 -- 172.21.15.118:0/1785521688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b90101930 msgr2=0x7f0b9019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b8e59c640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b90101930 0x7f0b9019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b8e59c640 1 -- 172.21.15.118:0/1785521688 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b90197810 con 0x7f0b90107930 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.342+0000 7f0b8ed9d640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b90101930 0x7f0b9019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.343+0000 7f0b8e59c640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90107930 0x7f0b9019dbd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0b78031460 tx=0x7f0b780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.343+0000 7f0b87fff640 1 -- 172.21.15.118:0/1785521688 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b7803f070 con 0x7f0b90107930 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.343+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b90197aa0 con 0x7f0b90107930 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.343+0000 7f0b87fff640 1 -- 172.21.15.118:0/1785521688 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b78004cf0 con 0x7f0b90107930 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.343+0000 7f0b87fff640 1 -- 172.21.15.118:0/1785521688 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b78035030 con 0x7f0b90107930 2024-09-21T12:01:35.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.343+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b90197fd0 con 0x7f0b90107930 2024-09-21T12:01:35.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.344+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b90103070 con 0x7f0b90107930 2024-09-21T12:01:35.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.345+0000 7f0b87fff640 1 -- 172.21.15.118:0/1785521688 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0b78042070 con 0x7f0b90107930 2024-09-21T12:01:35.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.345+0000 7f0b87fff640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b7c07af30 0x7f0b7c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.345+0000 7f0b87fff640 1 -- 172.21.15.118:0/1785521688 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0b780beb70 con 0x7f0b90107930 2024-09-21T12:01:35.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.345+0000 7f0b8ed9d640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b7c07af30 0x7f0b7c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.346+0000 7f0b8ed9d640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b7c07af30 0x7f0b7c07d3f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0b800058c0 tx=0x7f0b80005d30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:35.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.350+0000 7f0b87fff640 1 -- 172.21.15.118:0/1785521688 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b7808a0c0 con 0x7f0b90107930 2024-09-21T12:01:35.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.598+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0b90198d40 con 0x7f0b90107930 2024-09-21T12:01:35.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.599+0000 7f0b87fff640 1 -- 172.21.15.118:0/1785521688 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f0b7808c5e0 con 0x7f0b90107930 2024-09-21T12:01:35.601 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:01:35.601 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:01:35.601 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:01:35.601 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:01:35.601 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:01:35.601 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:01:35.601 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:01:35.601 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:01:35.602 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b7c07af30 msgr2=0x7f0b7c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b7c07af30 0x7f0b7c07d3f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0b800058c0 tx=0x7f0b80005d30 comp rx=0 tx=0).stop 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90107930 msgr2=0x7f0b9019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90107930 0x7f0b9019dbd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0b78031460 tx=0x7f0b780048f0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 shutdown_connections 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b7c07af30 0x7f0b7c07d3f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b90107930 0x7f0b9019dbd0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 --2- 172.21.15.118:0/1785521688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b90101930 0x7f0b9019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 >> 172.21.15.118:0/1785521688 conn(0x7f0b900fd630 msgr2=0x7f0b900fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 shutdown_connections 2024-09-21T12:01:35.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.601+0000 7f0b9504a640 1 -- 172.21.15.118:0/1785521688 wait complete. 2024-09-21T12:01:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.682+0000 7f11a1b2a640 1 -- 172.21.15.118:0/2838715306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c100820 msgr2=0x7f119c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.682+0000 7f11a1b2a640 1 --2- 172.21.15.118:0/2838715306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c100820 0x7f119c100c80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1184009880 tx=0x7f118402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.682+0000 7f11a1b2a640 1 -- 172.21.15.118:0/2838715306 shutdown_connections 2024-09-21T12:01:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.682+0000 7f11a1b2a640 1 --2- 172.21.15.118:0/2838715306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c100820 0x7f119c100c80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.682+0000 7f11a1b2a640 1 --2- 172.21.15.118:0/2838715306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f119c106820 0x7f119c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.682+0000 7f11a1b2a640 1 -- 172.21.15.118:0/2838715306 >> 172.21.15.118:0/2838715306 conn(0x7f119c0fc520 msgr2=0x7f119c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.682+0000 7f11a1b2a640 1 -- 172.21.15.118:0/2838715306 shutdown_connections 2024-09-21T12:01:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.682+0000 7f11a1b2a640 1 -- 172.21.15.118:0/2838715306 wait complete. 2024-09-21T12:01:35.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f11a1b2a640 1 Processor -- start 2024-09-21T12:01:35.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f11a1b2a640 1 -- start start 2024-09-21T12:01:35.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f11a1b2a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f119c100820 0x7f119c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f11a1b2a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c106820 0x7f119c198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f11a1b2a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f119c10dcf0 con 0x7f119c106820 2024-09-21T12:01:35.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f11a1b2a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f119c10db70 con 0x7f119c100820 2024-09-21T12:01:35.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f1193fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c106820 0x7f119c198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f1193fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c106820 0x7f119c198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42516/0 (socket says 172.21.15.118:42516) 2024-09-21T12:01:35.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f1193fff640 1 -- 172.21.15.118:0/1109864617 learned_addr learned my addr 172.21.15.118:0/1109864617 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f119b7fe640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f119c100820 0x7f119c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f1193fff640 1 -- 172.21.15.118:0/1109864617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f119c100820 msgr2=0x7f119c198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f1193fff640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f119c100820 0x7f119c198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.683+0000 7f1193fff640 1 -- 172.21.15.118:0/1109864617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c199340 con 0x7f119c106820 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.684+0000 7f1193fff640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c106820 0x7f119c198d40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1184031460 tx=0x7f11840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.684+0000 7f11997fa640 1 -- 172.21.15.118:0/1109864617 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f118403f070 con 0x7f119c106820 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.684+0000 7f11997fa640 1 -- 172.21.15.118:0/1109864617 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1184004cf0 con 0x7f119c106820 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.684+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c1995d0 con 0x7f119c106820 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.684+0000 7f11997fa640 1 -- 172.21.15.118:0/1109864617 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1184035030 con 0x7f119c106820 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.684+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c1a1b80 con 0x7f119c106820 2024-09-21T12:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.685+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119c101f60 con 0x7f119c106820 2024-09-21T12:01:35.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.686+0000 7f11997fa640 1 -- 172.21.15.118:0/1109864617 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1184042070 con 0x7f119c106820 2024-09-21T12:01:35.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.686+0000 7f11997fa640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f118807af30 0x7f118807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.686+0000 7f119b7fe640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f118807af30 0x7f118807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.686+0000 7f11997fa640 1 -- 172.21.15.118:0/1109864617 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f11840beb70 con 0x7f119c106820 2024-09-21T12:01:35.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.687+0000 7f119b7fe640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f118807af30 0x7f118807d3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f118c0058c0 tx=0x7f118c005c60 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:35.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.691+0000 7f11997fa640 1 -- 172.21.15.118:0/1109864617 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f118408a0c0 con 0x7f119c106820 2024-09-21T12:01:35.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.905+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f119c108d90 con 0x7f119c106820 2024-09-21T12:01:35.908 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:35 smithi118 ceph-mon[111738]: pgmap v682: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:35.908 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:35 smithi118 ceph-mon[111738]: from='client.35060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:35.908 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:01:35.908 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:35 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1785521688' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:01:35.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.906+0000 7f11997fa640 1 -- 172.21.15.118:0/1109864617 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f118408ef70 con 0x7f119c106820 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:01:35.909 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:01:35.910 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:01:35.911 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:01:35.912 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:01:35.912 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:01:35.912 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:01:35.912 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:01:35.912 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f118807af30 msgr2=0x7f118807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f118807af30 0x7f118807d3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f118c0058c0 tx=0x7f118c005c60 comp rx=0 tx=0).stop 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c106820 msgr2=0x7f119c198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c106820 0x7f119c198d40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1184031460 tx=0x7f11840048f0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 shutdown_connections 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f118807af30 0x7f118807d3f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c106820 0x7f119c198d40 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 --2- 172.21.15.118:0/1109864617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f119c100820 0x7f119c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 >> 172.21.15.118:0/1109864617 conn(0x7f119c0fc520 msgr2=0x7f119c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 shutdown_connections 2024-09-21T12:01:35.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.908+0000 7f11a1b2a640 1 -- 172.21.15.118:0/1109864617 wait complete. 2024-09-21T12:01:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.990+0000 7f0bb116d640 1 -- 172.21.15.118:0/3317983203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 msgr2=0x7f0bac106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.990+0000 7f0bb116d640 1 --2- 172.21.15.118:0/3317983203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 0x7f0bac106bc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009880 tx=0x7f0b9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.991+0000 7f0bb116d640 1 -- 172.21.15.118:0/3317983203 shutdown_connections 2024-09-21T12:01:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.991+0000 7f0bb116d640 1 --2- 172.21.15.118:0/3317983203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bac1007e0 0x7f0bac100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.991+0000 7f0bb116d640 1 --2- 172.21.15.118:0/3317983203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 0x7f0bac106bc0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.991+0000 7f0bb116d640 1 -- 172.21.15.118:0/3317983203 >> 172.21.15.118:0/3317983203 conn(0x7f0bac0fc4c0 msgr2=0x7f0bac0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.991+0000 7f0bb116d640 1 -- 172.21.15.118:0/3317983203 shutdown_connections 2024-09-21T12:01:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.991+0000 7f0bb116d640 1 -- 172.21.15.118:0/3317983203 wait complete. 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.991+0000 7f0bb116d640 1 Processor -- start 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.991+0000 7f0bb116d640 1 -- start start 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0bb116d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bac1007e0 0x7f0bac19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0bb116d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 0x7f0bac19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0bb116d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac10dd10 con 0x7f0bac1067e0 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0bb116d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac10db90 con 0x7f0bac1007e0 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 0x7f0bac19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 0x7f0bac19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42538/0 (socket says 172.21.15.118:42538) 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba3fff640 1 -- 172.21.15.118:0/157323518 learned_addr learned my addr 172.21.15.118:0/157323518 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0baad9d640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bac1007e0 0x7f0bac19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba3fff640 1 -- 172.21.15.118:0/157323518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bac1007e0 msgr2=0x7f0bac19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba3fff640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bac1007e0 0x7f0bac19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba3fff640 1 -- 172.21.15.118:0/157323518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac197800 con 0x7f0bac1067e0 2024-09-21T12:01:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0baad9d640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bac1007e0 0x7f0bac19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:01:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba3fff640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 0x7f0bac19dbc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400b420 tx=0x7f0b9400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba8d99640 1 -- 172.21.15.118:0/157323518 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b94011630 con 0x7f0bac1067e0 2024-09-21T12:01:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bac197af0 con 0x7f0bac1067e0 2024-09-21T12:01:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba8d99640 1 -- 172.21.15.118:0/157323518 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b94016070 con 0x7f0bac1067e0 2024-09-21T12:01:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0ba8d99640 1 -- 172.21.15.118:0/157323518 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b94010d40 con 0x7f0bac1067e0 2024-09-21T12:01:35.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.992+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bac198080 con 0x7f0bac1067e0 2024-09-21T12:01:35.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.993+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bac101f20 con 0x7f0bac1067e0 2024-09-21T12:01:35.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.994+0000 7f0ba8d99640 1 -- 172.21.15.118:0/157323518 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0b9401b460 con 0x7f0bac1067e0 2024-09-21T12:01:35.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.995+0000 7f0ba8d99640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b9807af30 0x7f0b9807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.995+0000 7f0baad9d640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b9807af30 0x7f0b9807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.995+0000 7f0ba8d99640 1 -- 172.21.15.118:0/157323518 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f0b9409d7f0 con 0x7f0bac1067e0 2024-09-21T12:01:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.995+0000 7f0baad9d640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b9807af30 0x7f0b9807d3f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c006010 tx=0x7f0b9c0095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:36.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:35.999+0000 7f0ba8d99640 1 -- 172.21.15.118:0/157323518 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b94068d40 con 0x7f0bac1067e0 2024-09-21T12:01:36.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.193+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0bac198390 con 0x7f0b9807af30 2024-09-21T12:01:36.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.195+0000 7f0ba8d99640 1 -- 172.21.15.118:0/157323518 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0bac198390 con 0x7f0b9807af30 2024-09-21T12:01:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:01:36.197 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:01:36.197 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:01:36.198 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:01:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:01:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.196+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b9807af30 msgr2=0x7f0b9807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.196+0000 7f0bb116d640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b9807af30 0x7f0b9807d3f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c006010 tx=0x7f0b9c0095f0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.197+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 msgr2=0x7f0bac19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.197+0000 7f0bb116d640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 0x7f0bac19dbc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400b420 tx=0x7f0b9400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.197+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 shutdown_connections 2024-09-21T12:01:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.197+0000 7f0bb116d640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0b9807af30 0x7f0b9807d3f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.197+0000 7f0bb116d640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bac1067e0 0x7f0bac19dbc0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.197+0000 7f0bb116d640 1 --2- 172.21.15.118:0/157323518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bac1007e0 0x7f0bac19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.197+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 >> 172.21.15.118:0/157323518 conn(0x7f0bac0fc4c0 msgr2=0x7f0bac069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.197+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 shutdown_connections 2024-09-21T12:01:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.197+0000 7f0bb116d640 1 -- 172.21.15.118:0/157323518 wait complete. 2024-09-21T12:01:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:35 smithi149 ceph-mon[79770]: pgmap v682: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:35 smithi149 ceph-mon[79770]: from='client.35060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:36.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:01:36.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:35 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1785521688' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:01:36.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.277+0000 7ff72b455640 1 -- 172.21.15.118:0/1195120491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724106820 msgr2=0x7ff724106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:36.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.277+0000 7ff72b455640 1 --2- 172.21.15.118:0/1195120491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724106820 0x7ff724106c00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff718009880 tx=0x7ff71802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.277+0000 7ff72b455640 1 -- 172.21.15.118:0/1195120491 shutdown_connections 2024-09-21T12:01:36.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.277+0000 7ff72b455640 1 --2- 172.21.15.118:0/1195120491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff724100820 0x7ff724100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.277+0000 7ff72b455640 1 --2- 172.21.15.118:0/1195120491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724106820 0x7ff724106c00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.277+0000 7ff72b455640 1 -- 172.21.15.118:0/1195120491 >> 172.21.15.118:0/1195120491 conn(0x7ff7240fc520 msgr2=0x7ff7240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:36.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.277+0000 7ff72b455640 1 -- 172.21.15.118:0/1195120491 shutdown_connections 2024-09-21T12:01:36.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.277+0000 7ff72b455640 1 -- 172.21.15.118:0/1195120491 wait complete. 2024-09-21T12:01:36.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff72b455640 1 Processor -- start 2024-09-21T12:01:36.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff72b455640 1 -- start start 2024-09-21T12:01:36.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff72b455640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724100820 0x7ff72419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:36.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff72b455640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff724106820 0x7ff72419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:36.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff72b455640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff72410dd50 con 0x7ff724100820 2024-09-21T12:01:36.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff72b455640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff72410dbd0 con 0x7ff724106820 2024-09-21T12:01:36.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff7291f1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724100820 0x7ff72419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:36.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff7291f1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724100820 0x7ff72419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42554/0 (socket says 172.21.15.118:42554) 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff7291f1640 1 -- 172.21.15.118:0/3726043030 learned_addr learned my addr 172.21.15.118:0/3726043030 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff7289f0640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff724106820 0x7ff72419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff7291f1640 1 -- 172.21.15.118:0/3726043030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff724106820 msgr2=0x7ff72419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff7291f1640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff724106820 0x7ff72419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff7291f1640 1 -- 172.21.15.118:0/3726043030 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff724197840 con 0x7ff724100820 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.278+0000 7ff7291f1640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724100820 0x7ff72419d6c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff718031460 tx=0x7ff7180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.279+0000 7ff7167fc640 1 -- 172.21.15.118:0/3726043030 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff71803f070 con 0x7ff724100820 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.279+0000 7ff7167fc640 1 -- 172.21.15.118:0/3726043030 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff718004cf0 con 0x7ff724100820 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.279+0000 7ff7167fc640 1 -- 172.21.15.118:0/3726043030 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff718035030 con 0x7ff724100820 2024-09-21T12:01:36.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.279+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff724197ad0 con 0x7ff724100820 2024-09-21T12:01:36.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.279+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff724198000 con 0x7ff724100820 2024-09-21T12:01:36.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.280+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff724101f60 con 0x7ff724100820 2024-09-21T12:01:36.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.280+0000 7ff7167fc640 1 -- 172.21.15.118:0/3726043030 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff718042070 con 0x7ff724100820 2024-09-21T12:01:36.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.281+0000 7ff7167fc640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff71007af80 0x7ff71007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:01:36.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.281+0000 7ff7167fc640 1 -- 172.21.15.118:0/3726043030 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff7180bea90 con 0x7ff724100820 2024-09-21T12:01:36.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.281+0000 7ff7289f0640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff71007af80 0x7ff71007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:01:36.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.281+0000 7ff7289f0640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff71007af80 0x7ff71007d440 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff724104fa0 tx=0x7ff720008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:01:36.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.285+0000 7ff7167fc640 1 -- 172.21.15.118:0/3726043030 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff71808a060 con 0x7ff724100820 2024-09-21T12:01:36.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.529+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff724198d70 con 0x7ff724100820 2024-09-21T12:01:36.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.529+0000 7ff7167fc640 1 -- 172.21.15.118:0/3726043030 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7ff71808ef10 con 0x7ff724100820 2024-09-21T12:01:36.531 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:01:36.532 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:01:36.532 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:01:36.532 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:01:36.532 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:01:36.532 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:01:36.532 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff71007af80 msgr2=0x7ff71007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff71007af80 0x7ff71007d440 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff724104fa0 tx=0x7ff720008040 comp rx=0 tx=0).stop 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724100820 msgr2=0x7ff72419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724100820 0x7ff72419d6c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff718031460 tx=0x7ff7180048f0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 shutdown_connections 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff724106820 0x7ff72419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff71007af80 0x7ff71007d440 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 --2- 172.21.15.118:0/3726043030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff724100820 0x7ff72419d6c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 >> 172.21.15.118:0/3726043030 conn(0x7ff7240fc520 msgr2=0x7ff72406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 shutdown_connections 2024-09-21T12:01:36.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:01:36.532+0000 7ff72b455640 1 -- 172.21.15.118:0/3726043030 wait complete. 2024-09-21T12:01:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:36 smithi118 ceph-mon[111738]: from='client.35064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:36 smithi118 ceph-mon[111738]: from='client.35068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:36 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1109864617' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:01:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:36 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3726043030' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:01:37.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:36 smithi149 ceph-mon[79770]: from='client.35064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:37.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:36 smithi149 ceph-mon[79770]: from='client.35068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:37.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:36 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1109864617' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:01:37.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:36 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3726043030' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:01:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:37 smithi118 ceph-mon[111738]: from='client.35080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:37 smithi118 ceph-mon[111738]: pgmap v683: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:38.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:37 smithi149 ceph-mon[79770]: from='client.35080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:01:38.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:37 smithi149 ceph-mon[79770]: pgmap v683: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:40.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:39 smithi118 ceph-mon[111738]: pgmap v684: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:40.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:39 smithi149 ceph-mon[79770]: pgmap v684: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:42.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:41 smithi118 ceph-mon[111738]: pgmap v685: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:42.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:41 smithi149 ceph-mon[79770]: pgmap v685: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:44.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:43 smithi118 ceph-mon[111738]: pgmap v686: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:44.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:43 smithi149 ceph-mon[79770]: pgmap v686: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:45.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:45 smithi149 ceph-mon[79770]: pgmap v687: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:45 smithi118 ceph-mon[111738]: pgmap v687: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:47 smithi149 ceph-mon[79770]: pgmap v688: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:47 smithi118 ceph-mon[111738]: pgmap v688: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:49 smithi149 ceph-mon[79770]: pgmap v689: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:49 smithi118 ceph-mon[111738]: pgmap v689: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:50.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:01:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:01:52.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:51 smithi149 ceph-mon[79770]: pgmap v690: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:51 smithi118 ceph-mon[111738]: pgmap v690: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:54.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:53 smithi149 ceph-mon[79770]: pgmap v691: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:53 smithi118 ceph-mon[111738]: pgmap v691: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:56.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:55 smithi149 ceph-mon[79770]: pgmap v692: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:55 smithi118 ceph-mon[111738]: pgmap v692: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:58.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:57 smithi149 ceph-mon[79770]: pgmap v693: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:57 smithi118 ceph-mon[111738]: pgmap v693: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:59.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:01:58 smithi149 ceph-mon[79770]: pgmap v694: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:01:59.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:01:58 smithi118 ceph-mon[111738]: pgmap v694: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:01.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:01 smithi118 ceph-mon[111738]: pgmap v695: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:01.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:01 smithi149 ceph-mon[79770]: pgmap v695: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:03 smithi118 ceph-mon[111738]: pgmap v696: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:03.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:03 smithi149 ceph-mon[79770]: pgmap v696: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:05 smithi118 ceph-mon[111738]: pgmap v697: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:02:05.879 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:05 smithi149 ceph-mon[79770]: pgmap v697: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:05.879 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:02:06.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.628+0000 7f5d0222a640 1 -- 172.21.15.118:0/2074884211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc107930 msgr2=0x7f5cfc107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:06.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.628+0000 7f5d0222a640 1 --2- 172.21.15.118:0/2074884211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc107930 0x7f5cfc107d10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009880 tx=0x7f5cec02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.628+0000 7f5d0222a640 1 -- 172.21.15.118:0/2074884211 shutdown_connections 2024-09-21T12:02:06.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.628+0000 7f5d0222a640 1 --2- 172.21.15.118:0/2074884211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cfc101930 0x7f5cfc101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.628+0000 7f5d0222a640 1 --2- 172.21.15.118:0/2074884211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc107930 0x7f5cfc107d10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.628+0000 7f5d0222a640 1 -- 172.21.15.118:0/2074884211 >> 172.21.15.118:0/2074884211 conn(0x7f5cfc0fd630 msgr2=0x7f5cfc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:06.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.628+0000 7f5d0222a640 1 -- 172.21.15.118:0/2074884211 shutdown_connections 2024-09-21T12:02:06.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.628+0000 7f5d0222a640 1 -- 172.21.15.118:0/2074884211 wait complete. 2024-09-21T12:02:06.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5d0222a640 1 Processor -- start 2024-09-21T12:02:06.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5d0222a640 1 -- start start 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5d0222a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc101930 0x7f5cfc19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5d0222a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cfc107930 0x7f5cfc19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5d0222a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc10ee00 con 0x7f5cfc101930 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5d0222a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc10ec80 con 0x7f5cfc107930 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5cfb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc101930 0x7f5cfc19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5cfb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc101930 0x7f5cfc19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48312/0 (socket says 172.21.15.118:48312) 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5cfb7fe640 1 -- 172.21.15.118:0/2558872368 learned_addr learned my addr 172.21.15.118:0/2558872368 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5cf3fff640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cfc107930 0x7f5cfc19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5cfb7fe640 1 -- 172.21.15.118:0/2558872368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cfc107930 msgr2=0x7f5cfc19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5cfb7fe640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cfc107930 0x7f5cfc19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5cfb7fe640 1 -- 172.21.15.118:0/2558872368 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc1977f0 con 0x7f5cfc101930 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.629+0000 7f5cf3fff640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cfc107930 0x7f5cfc19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:02:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.630+0000 7f5cfb7fe640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc101930 0x7f5cfc19d670 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5cec031460 tx=0x7f5cec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.630+0000 7f5cf97fa640 1 -- 172.21.15.118:0/2558872368 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5cec03f070 con 0x7f5cfc101930 2024-09-21T12:02:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.630+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cfc197a80 con 0x7f5cfc101930 2024-09-21T12:02:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.630+0000 7f5cf97fa640 1 -- 172.21.15.118:0/2558872368 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5cec0035f0 con 0x7f5cfc101930 2024-09-21T12:02:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.630+0000 7f5cf97fa640 1 -- 172.21.15.118:0/2558872368 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5cec035030 con 0x7f5cfc101930 2024-09-21T12:02:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.630+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cfc197fb0 con 0x7f5cfc101930 2024-09-21T12:02:06.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.631+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cfc103070 con 0x7f5cfc101930 2024-09-21T12:02:06.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.632+0000 7f5cf97fa640 1 -- 172.21.15.118:0/2558872368 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5cec042070 con 0x7f5cfc101930 2024-09-21T12:02:06.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.632+0000 7f5cf97fa640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ce807af30 0x7f5ce807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:06.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.632+0000 7f5cf97fa640 1 -- 172.21.15.118:0/2558872368 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f5cec0bead0 con 0x7f5cfc101930 2024-09-21T12:02:06.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.632+0000 7f5cf3fff640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ce807af30 0x7f5ce807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:06.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.633+0000 7f5cf3fff640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ce807af30 0x7f5ce807d3f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40058c0 tx=0x7f5ce4005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:06.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.637+0000 7f5cf97fa640 1 -- 172.21.15.118:0/2558872368 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5cec08a020 con 0x7f5cfc101930 2024-09-21T12:02:06.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.832+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5cfc198260 con 0x7f5ce807af30 2024-09-21T12:02:06.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.833+0000 7f5cf97fa640 1 -- 172.21.15.118:0/2558872368 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5cfc198260 con 0x7f5ce807af30 2024-09-21T12:02:06.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ce807af30 msgr2=0x7f5ce807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:06.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ce807af30 0x7f5ce807d3f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40058c0 tx=0x7f5ce4005850 comp rx=0 tx=0).stop 2024-09-21T12:02:06.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc101930 msgr2=0x7f5cfc19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:06.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc101930 0x7f5cfc19d670 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5cec031460 tx=0x7f5cec0045e0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 shutdown_connections 2024-09-21T12:02:06.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cfc107930 0x7f5cfc19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5ce807af30 0x7f5ce807d3f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 --2- 172.21.15.118:0/2558872368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cfc101930 0x7f5cfc19d670 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 >> 172.21.15.118:0/2558872368 conn(0x7f5cfc0fd630 msgr2=0x7f5cfc0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:06.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 shutdown_connections 2024-09-21T12:02:06.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.836+0000 7f5d0222a640 1 -- 172.21.15.118:0/2558872368 wait complete. 2024-09-21T12:02:06.846 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:02:06.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.922+0000 7fb33364c640 1 -- 172.21.15.118:0/1657910843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 msgr2=0x7fb32c10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:06.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.922+0000 7fb33364c640 1 --2- 172.21.15.118:0/1657910843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 0x7fb32c10b8f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb328009880 tx=0x7fb32802a530 comp rx=0 tx=0).stop 2024-09-21T12:02:06.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.922+0000 7fb33364c640 1 -- 172.21.15.118:0/1657910843 shutdown_connections 2024-09-21T12:02:06.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.922+0000 7fb33364c640 1 --2- 172.21.15.118:0/1657910843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 0x7fb32c10b8f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.922+0000 7fb33364c640 1 --2- 172.21.15.118:0/1657910843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb32c102ae0 0x7fb32c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.922+0000 7fb33364c640 1 -- 172.21.15.118:0/1657910843 >> 172.21.15.118:0/1657910843 conn(0x7fb32c0fc520 msgr2=0x7fb32c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:06.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.922+0000 7fb33364c640 1 -- 172.21.15.118:0/1657910843 shutdown_connections 2024-09-21T12:02:06.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.922+0000 7fb33364c640 1 -- 172.21.15.118:0/1657910843 wait complete. 2024-09-21T12:02:06.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb33364c640 1 Processor -- start 2024-09-21T12:02:06.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb33364c640 1 -- start start 2024-09-21T12:02:06.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb33364c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb32c102ae0 0x7fb32c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:06.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb33364c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 0x7fb32c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:06.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb33364c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c10edf0 con 0x7fb32c103400 2024-09-21T12:02:06.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb33364c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c10ec70 con 0x7fb32c102ae0 2024-09-21T12:02:06.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb330be7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 0x7fb32c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb330be7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 0x7fb32c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48328/0 (socket says 172.21.15.118:48328) 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb330be7640 1 -- 172.21.15.118:0/251641357 learned_addr learned my addr 172.21.15.118:0/251641357 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.923+0000 7fb3313e8640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb32c102ae0 0x7fb32c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.924+0000 7fb330be7640 1 -- 172.21.15.118:0/251641357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb32c102ae0 msgr2=0x7fb32c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.924+0000 7fb330be7640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb32c102ae0 0x7fb32c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.924+0000 7fb330be7640 1 -- 172.21.15.118:0/251641357 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c197800 con 0x7fb32c103400 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.924+0000 7fb330be7640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 0x7fb32c19dbc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb328031460 tx=0x7fb3280045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.924+0000 7fb3227fc640 1 -- 172.21.15.118:0/251641357 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb32803f070 con 0x7fb32c103400 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.924+0000 7fb3227fc640 1 -- 172.21.15.118:0/251641357 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3280035f0 con 0x7fb32c103400 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.924+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c197a90 con 0x7fb32c103400 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.924+0000 7fb3227fc640 1 -- 172.21.15.118:0/251641357 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb328035030 con 0x7fb32c103400 2024-09-21T12:02:06.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.924+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c197fc0 con 0x7fb32c103400 2024-09-21T12:02:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.925+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32c06abe0 con 0x7fb32c103400 2024-09-21T12:02:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.925+0000 7fb3227fc640 1 -- 172.21.15.118:0/251641357 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb328042070 con 0x7fb32c103400 2024-09-21T12:02:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.926+0000 7fb3227fc640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb31807af30 0x7fb31807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.926+0000 7fb3227fc640 1 -- 172.21.15.118:0/251641357 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb3280be8f0 con 0x7fb32c103400 2024-09-21T12:02:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.926+0000 7fb3313e8640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb31807af30 0x7fb31807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.927+0000 7fb3313e8640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb31807af30 0x7fb31807d3f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009bd0 tx=0x7fb31c005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:06.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:06.930+0000 7fb3227fc640 1 -- 172.21.15.118:0/251641357 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb328089e40 con 0x7fb32c103400 2024-09-21T12:02:07.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.122+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb32c198330 con 0x7fb31807af30 2024-09-21T12:02:07.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.123+0000 7fb3227fc640 1 -- 172.21.15.118:0/251641357 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fb32c198330 con 0x7fb31807af30 2024-09-21T12:02:07.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.125+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb31807af30 msgr2=0x7fb31807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.125+0000 7fb33364c640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb31807af30 0x7fb31807d3f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009bd0 tx=0x7fb31c005f90 comp rx=0 tx=0).stop 2024-09-21T12:02:07.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.125+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 msgr2=0x7fb32c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.125+0000 7fb33364c640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 0x7fb32c19dbc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb328031460 tx=0x7fb3280045c0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.125+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 shutdown_connections 2024-09-21T12:02:07.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.125+0000 7fb33364c640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb31807af30 0x7fb31807d3f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.125+0000 7fb33364c640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32c103400 0x7fb32c19dbc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.125+0000 7fb33364c640 1 --2- 172.21.15.118:0/251641357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb32c102ae0 0x7fb32c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.125+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 >> 172.21.15.118:0/251641357 conn(0x7fb32c0fc520 msgr2=0x7fb32c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:07.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.126+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 shutdown_connections 2024-09-21T12:02:07.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.126+0000 7fb33364c640 1 -- 172.21.15.118:0/251641357 wait complete. 2024-09-21T12:02:07.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.207+0000 7fa13eb63640 1 -- 172.21.15.118:0/427580634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 msgr2=0x7fa138107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.207+0000 7fa13eb63640 1 --2- 172.21.15.118:0/427580634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 0x7fa138107d10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009880 tx=0x7fa12c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.207+0000 7fa13eb63640 1 -- 172.21.15.118:0/427580634 shutdown_connections 2024-09-21T12:02:07.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.207+0000 7fa13eb63640 1 --2- 172.21.15.118:0/427580634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa138101930 0x7fa138101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.207+0000 7fa13eb63640 1 --2- 172.21.15.118:0/427580634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 0x7fa138107d10 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.207+0000 7fa13eb63640 1 -- 172.21.15.118:0/427580634 >> 172.21.15.118:0/427580634 conn(0x7fa1380fd630 msgr2=0x7fa1380ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:07.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.207+0000 7fa13eb63640 1 -- 172.21.15.118:0/427580634 shutdown_connections 2024-09-21T12:02:07.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.207+0000 7fa13eb63640 1 -- 172.21.15.118:0/427580634 wait complete. 2024-09-21T12:02:07.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa13eb63640 1 Processor -- start 2024-09-21T12:02:07.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa13eb63640 1 -- start start 2024-09-21T12:02:07.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa13eb63640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa138101930 0x7fa1380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:07.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa13eb63640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 0x7fa138074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:07.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa13eb63640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa13810ee00 con 0x7fa138107930 2024-09-21T12:02:07.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa13eb63640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa13810ec80 con 0x7fa138101930 2024-09-21T12:02:07.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa137fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 0x7fa138074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:07.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa137fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 0x7fa138074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48348/0 (socket says 172.21.15.118:48348) 2024-09-21T12:02:07.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa137fff640 1 -- 172.21.15.118:0/2446954694 learned_addr learned my addr 172.21.15.118:0/2446954694 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa13c8ff640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa138101930 0x7fa1380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa137fff640 1 -- 172.21.15.118:0/2446954694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa138101930 msgr2=0x7fa1380744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa137fff640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa138101930 0x7fa1380744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.208+0000 7fa137fff640 1 -- 172.21.15.118:0/2446954694 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa138074f70 con 0x7fa138107930 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.209+0000 7fa137fff640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 0x7fa138074a30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa12400d6f0 tx=0x7fa12400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.209+0000 7fa135ffb640 1 -- 172.21.15.118:0/2446954694 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa124017070 con 0x7fa138107930 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.209+0000 7fa135ffb640 1 -- 172.21.15.118:0/2446954694 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa12400de00 con 0x7fa138107930 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.209+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa138075260 con 0x7fa138107930 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.209+0000 7fa135ffb640 1 -- 172.21.15.118:0/2446954694 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa124004bb0 con 0x7fa138107930 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.209+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1381a3e70 con 0x7fa138107930 2024-09-21T12:02:07.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.210+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa138103070 con 0x7fa138107930 2024-09-21T12:02:07.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.211+0000 7fa135ffb640 1 -- 172.21.15.118:0/2446954694 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa124004e60 con 0x7fa138107930 2024-09-21T12:02:07.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.211+0000 7fa135ffb640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa12807af30 0x7fa12807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:07.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.211+0000 7fa13c8ff640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa12807af30 0x7fa12807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:07.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.212+0000 7fa135ffb640 1 -- 172.21.15.118:0/2446954694 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fa12409dce0 con 0x7fa138107930 2024-09-21T12:02:07.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.212+0000 7fa13c8ff640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa12807af30 0x7fa12807d3f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0096c0 tx=0x7fa12c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:07.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.216+0000 7fa135ffb640 1 -- 172.21.15.118:0/2446954694 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa124069230 con 0x7fa138107930 2024-09-21T12:02:07.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.403+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa138062630 con 0x7fa12807af30 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.413+0000 7fa135ffb640 1 -- 172.21.15.118:0/2446954694 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa138062630 con 0x7fa12807af30 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (20m) 14m ago 30m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (23m) 14m ago 31m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (22m) 13m ago 30m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (18m) 14m ago 31m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (18m) 13m ago 30m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (19m) 14m ago 30m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (14m) 14m ago 25m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (14m) 14m ago 25m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (25m) 13m ago 25m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T12:02:07.414 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (13m) 13m ago 25m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (22m) 14m ago 32m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (21m) 13m ago 30m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (18m) 14m ago 32m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (18m) 13m ago 30m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (20m) 14m ago 31m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (20m) 13m ago 30m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (17m) 14m ago 28m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (17m) 14m ago 28m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (16m) 14m ago 27m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (15m) 13m ago 27m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (15m) 13m ago 27m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (14m) 13m ago 26m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:02:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (20m) 14m ago 30m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa12807af30 msgr2=0x7fa12807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa12807af30 0x7fa12807d3f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0096c0 tx=0x7fa12c031400 comp rx=0 tx=0).stop 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 msgr2=0x7fa138074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 0x7fa138074a30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa12400d6f0 tx=0x7fa12400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 shutdown_connections 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa12807af30 0x7fa12807d3f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa138107930 0x7fa138074a30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 --2- 172.21.15.118:0/2446954694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa138101930 0x7fa1380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 >> 172.21.15.118:0/2446954694 conn(0x7fa1380fd630 msgr2=0x7fa1380fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 shutdown_connections 2024-09-21T12:02:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.415+0000 7fa13eb63640 1 -- 172.21.15.118:0/2446954694 wait complete. 2024-09-21T12:02:07.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.497+0000 7f4250709640 1 -- 172.21.15.118:0/704522371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 msgr2=0x7f4248106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.497+0000 7f4250709640 1 --2- 172.21.15.118:0/704522371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 0x7f4248106c00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f423c009880 tx=0x7f423c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.497+0000 7f4250709640 1 -- 172.21.15.118:0/704522371 shutdown_connections 2024-09-21T12:02:07.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.497+0000 7f4250709640 1 --2- 172.21.15.118:0/704522371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4248100820 0x7f4248100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.497+0000 7f4250709640 1 --2- 172.21.15.118:0/704522371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 0x7f4248106c00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.497+0000 7f4250709640 1 -- 172.21.15.118:0/704522371 >> 172.21.15.118:0/704522371 conn(0x7f42480fc520 msgr2=0x7f42480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:07.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.497+0000 7f4250709640 1 -- 172.21.15.118:0/704522371 shutdown_connections 2024-09-21T12:02:07.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.497+0000 7f4250709640 1 -- 172.21.15.118:0/704522371 wait complete. 2024-09-21T12:02:07.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f4250709640 1 Processor -- start 2024-09-21T12:02:07.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f4250709640 1 -- start start 2024-09-21T12:02:07.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f4250709640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4248100820 0x7f4248198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f4250709640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 0x7f4248198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f4250709640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f424810dd50 con 0x7f4248106820 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f4250709640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f424810dbd0 con 0x7f4248100820 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f424dca4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 0x7f4248198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f424dca4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 0x7f4248198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48372/0 (socket says 172.21.15.118:48372) 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f424dca4640 1 -- 172.21.15.118:0/3338454937 learned_addr learned my addr 172.21.15.118:0/3338454937 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f424e4a5640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4248100820 0x7f4248198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f424dca4640 1 -- 172.21.15.118:0/3338454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4248100820 msgr2=0x7f4248198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f424dca4640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4248100820 0x7f4248198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f424dca4640 1 -- 172.21.15.118:0/3338454937 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42481993a0 con 0x7f4248106820 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.498+0000 7f424e4a5640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4248100820 0x7f4248198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.499+0000 7f424dca4640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 0x7f4248198da0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f424400b420 tx=0x7f424400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.499+0000 7f423b7fe640 1 -- 172.21.15.118:0/3338454937 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4244011630 con 0x7f4248106820 2024-09-21T12:02:07.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.499+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4248199690 con 0x7f4248106820 2024-09-21T12:02:07.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.499+0000 7f423b7fe640 1 -- 172.21.15.118:0/3338454937 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4244016070 con 0x7f4248106820 2024-09-21T12:02:07.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.499+0000 7f423b7fe640 1 -- 172.21.15.118:0/3338454937 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4244010d40 con 0x7f4248106820 2024-09-21T12:02:07.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.499+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42481a1c90 con 0x7f4248106820 2024-09-21T12:02:07.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.500+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4248101f60 con 0x7f4248106820 2024-09-21T12:02:07.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.500+0000 7f423b7fe640 1 -- 172.21.15.118:0/3338454937 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f424401b460 con 0x7f4248106820 2024-09-21T12:02:07.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.501+0000 7f423b7fe640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f423407af30 0x7f423407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:07.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.501+0000 7f423b7fe640 1 -- 172.21.15.118:0/3338454937 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f424409d7f0 con 0x7f4248106820 2024-09-21T12:02:07.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.501+0000 7f424e4a5640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f423407af30 0x7f423407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:07.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.502+0000 7f424e4a5640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f423407af30 0x7f423407d3f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f423c000c00 tx=0x7f423c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:07.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.505+0000 7f423b7fe640 1 -- 172.21.15.118:0/3338454937 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4248199690 con 0x7f4248106820 2024-09-21T12:02:07.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.752+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4248108d90 con 0x7f4248106820 2024-09-21T12:02:07.753 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:07 smithi118 ceph-mon[111738]: pgmap v698: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:07.753 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:07 smithi118 ceph-mon[111738]: from='client.35088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:07.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.752+0000 7f423b7fe640 1 -- 172.21.15.118:0/3338454937 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f4244021250 con 0x7f4248106820 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T12:02:07.754 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:02:07.755 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:02:07.755 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:02:07.755 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T12:02:07.755 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:02:07.755 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.754+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f423407af30 msgr2=0x7f423407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.754+0000 7f4250709640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f423407af30 0x7f423407d3f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f423c000c00 tx=0x7f423c031400 comp rx=0 tx=0).stop 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.754+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 msgr2=0x7f4248198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.754+0000 7f4250709640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 0x7f4248198da0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f424400b420 tx=0x7f424400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.754+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 shutdown_connections 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.754+0000 7f4250709640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f423407af30 0x7f423407d3f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.754+0000 7f4250709640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4248106820 0x7f4248198da0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.754+0000 7f4250709640 1 --2- 172.21.15.118:0/3338454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4248100820 0x7f4248198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.754+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 >> 172.21.15.118:0/3338454937 conn(0x7f42480fc520 msgr2=0x7f42480fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.755+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 shutdown_connections 2024-09-21T12:02:07.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.755+0000 7f4250709640 1 -- 172.21.15.118:0/3338454937 wait complete. 2024-09-21T12:02:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.836+0000 7f9fcfc70640 1 -- 172.21.15.118:0/1969041218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8107930 msgr2=0x7f9fc8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.836+0000 7f9fcfc70640 1 --2- 172.21.15.118:0/1969041218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8107930 0x7f9fc8107d10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009880 tx=0x7f9fc402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.836+0000 7f9fcfc70640 1 -- 172.21.15.118:0/1969041218 shutdown_connections 2024-09-21T12:02:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.836+0000 7f9fcfc70640 1 --2- 172.21.15.118:0/1969041218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc8101930 0x7f9fc8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.836+0000 7f9fcfc70640 1 --2- 172.21.15.118:0/1969041218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8107930 0x7f9fc8107d10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.836+0000 7f9fcfc70640 1 -- 172.21.15.118:0/1969041218 >> 172.21.15.118:0/1969041218 conn(0x7f9fc80fd630 msgr2=0x7f9fc80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.836+0000 7f9fcfc70640 1 -- 172.21.15.118:0/1969041218 shutdown_connections 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.836+0000 7f9fcfc70640 1 -- 172.21.15.118:0/1969041218 wait complete. 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcfc70640 1 Processor -- start 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcfc70640 1 -- start start 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcfc70640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8101930 0x7f9fc819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcfc70640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc8107930 0x7f9fc819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcfc70640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc810ee00 con 0x7f9fc8101930 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcfc70640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc810ec80 con 0x7f9fc8107930 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcda0c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8101930 0x7f9fc819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcda0c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8101930 0x7f9fc819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48386/0 (socket says 172.21.15.118:48386) 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcda0c640 1 -- 172.21.15.118:0/3549690415 learned_addr learned my addr 172.21.15.118:0/3549690415 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcd20b640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc8107930 0x7f9fc819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcda0c640 1 -- 172.21.15.118:0/3549690415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc8107930 msgr2=0x7f9fc819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcda0c640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc8107930 0x7f9fc819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:07.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcda0c640 1 -- 172.21.15.118:0/3549690415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc81977f0 con 0x7f9fc8101930 2024-09-21T12:02:07.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcd20b640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc8107930 0x7f9fc819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:02:07.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.837+0000 7f9fcda0c640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8101930 0x7f9fc819d670 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4031460 tx=0x7f9fc40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:07.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.838+0000 7f9fbeffd640 1 -- 172.21.15.118:0/3549690415 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fc403f070 con 0x7f9fc8101930 2024-09-21T12:02:07.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.838+0000 7f9fbeffd640 1 -- 172.21.15.118:0/3549690415 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fc40035f0 con 0x7f9fc8101930 2024-09-21T12:02:07.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.838+0000 7f9fbeffd640 1 -- 172.21.15.118:0/3549690415 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fc4035030 con 0x7f9fc8101930 2024-09-21T12:02:07.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.838+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc8197a80 con 0x7f9fc8101930 2024-09-21T12:02:07.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.838+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc8197fb0 con 0x7f9fc8101930 2024-09-21T12:02:07.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.839+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc8103070 con 0x7f9fc8101930 2024-09-21T12:02:07.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.839+0000 7f9fbeffd640 1 -- 172.21.15.118:0/3549690415 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9fc4042070 con 0x7f9fc8101930 2024-09-21T12:02:07.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.840+0000 7f9fbeffd640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9fb407af80 0x7f9fb407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:07.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.840+0000 7f9fbeffd640 1 -- 172.21.15.118:0/3549690415 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f9fc40be9c0 con 0x7f9fc8101930 2024-09-21T12:02:07.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.840+0000 7f9fcd20b640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9fb407af80 0x7f9fb407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:07.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.840+0000 7f9fcd20b640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9fb407af80 0x7f9fb407d440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80ffc20 tx=0x7f9fb8005e50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:07.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:07.844+0000 7f9fbeffd640 1 -- 172.21.15.118:0/3549690415 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9fc4089f90 con 0x7f9fc8101930 2024-09-21T12:02:07.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:07 smithi149 ceph-mon[79770]: pgmap v698: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:07.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:07 smithi149 ceph-mon[79770]: from='client.35088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:08.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.058+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9fc8109ea0 con 0x7f9fc8101930 2024-09-21T12:02:08.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.059+0000 7f9fbeffd640 1 -- 172.21.15.118:0/3549690415 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f9fc408ee40 con 0x7f9fc8101930 2024-09-21T12:02:08.060 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T12:02:08.060 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T12:02:08.060 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:02:08.061 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:02:08.062 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:02:08.063 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:02:08.064 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T12:02:08.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9fb407af80 msgr2=0x7f9fb407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9fb407af80 0x7f9fb407d440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80ffc20 tx=0x7f9fb8005e50 comp rx=0 tx=0).stop 2024-09-21T12:02:08.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8101930 msgr2=0x7f9fc819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8101930 0x7f9fc819d670 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4031460 tx=0x7f9fc40045e0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 shutdown_connections 2024-09-21T12:02:08.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc8107930 0x7f9fc819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9fb407af80 0x7f9fb407d440 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 --2- 172.21.15.118:0/3549690415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc8101930 0x7f9fc819d670 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 >> 172.21.15.118:0/3549690415 conn(0x7f9fc80fd630 msgr2=0x7f9fc80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:08.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 shutdown_connections 2024-09-21T12:02:08.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.061+0000 7f9fcfc70640 1 -- 172.21.15.118:0/3549690415 wait complete. 2024-09-21T12:02:08.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.144+0000 7f36da3f0640 1 -- 172.21.15.118:0/4292521069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 msgr2=0x7f36d4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.144+0000 7f36da3f0640 1 --2- 172.21.15.118:0/4292521069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 0x7f36d4100c40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009880 tx=0x7f36c802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.144+0000 7f36da3f0640 1 -- 172.21.15.118:0/4292521069 shutdown_connections 2024-09-21T12:02:08.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.144+0000 7f36da3f0640 1 --2- 172.21.15.118:0/4292521069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 0x7f36d4100c40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.144+0000 7f36da3f0640 1 --2- 172.21.15.118:0/4292521069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d41067e0 0x7f36d4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.144+0000 7f36da3f0640 1 -- 172.21.15.118:0/4292521069 >> 172.21.15.118:0/4292521069 conn(0x7f36d40fc4c0 msgr2=0x7f36d40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:08.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.144+0000 7f36da3f0640 1 -- 172.21.15.118:0/4292521069 shutdown_connections 2024-09-21T12:02:08.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.144+0000 7f36da3f0640 1 -- 172.21.15.118:0/4292521069 wait complete. 2024-09-21T12:02:08.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36da3f0640 1 Processor -- start 2024-09-21T12:02:08.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36da3f0640 1 -- start start 2024-09-21T12:02:08.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36da3f0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 0x7f36d419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:08.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36da3f0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d41067e0 0x7f36d419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36da3f0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f36d410dcb0 con 0x7f36d41007e0 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36da3f0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36d410db30 con 0x7f36d41067e0 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36d3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 0x7f36d419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36d3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 0x7f36d419c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48406/0 (socket says 172.21.15.118:48406) 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36d3fff640 1 -- 172.21.15.118:0/603503684 learned_addr learned my addr 172.21.15.118:0/603503684 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.145+0000 7f36d37fe640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d41067e0 0x7f36d419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.146+0000 7f36d3fff640 1 -- 172.21.15.118:0/603503684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d41067e0 msgr2=0x7f36d419cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.146+0000 7f36d3fff640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d41067e0 0x7f36d419cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.146+0000 7f36d3fff640 1 -- 172.21.15.118:0/603503684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d41966a0 con 0x7f36d41007e0 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.146+0000 7f36d3fff640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 0x7f36d419c5d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f36c400d6f0 tx=0x7f36c400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.146+0000 7f36d17fa640 1 -- 172.21.15.118:0/603503684 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36c4017070 con 0x7f36d41007e0 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.146+0000 7f36d17fa640 1 -- 172.21.15.118:0/603503684 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36c400de00 con 0x7f36d41007e0 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.146+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d4196990 con 0x7f36d41007e0 2024-09-21T12:02:08.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.146+0000 7f36d17fa640 1 -- 172.21.15.118:0/603503684 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36c4004bb0 con 0x7f36d41007e0 2024-09-21T12:02:08.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.146+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d4196ef0 con 0x7f36d41007e0 2024-09-21T12:02:08.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.147+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d4101f20 con 0x7f36d41007e0 2024-09-21T12:02:08.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.148+0000 7f36d17fa640 1 -- 172.21.15.118:0/603503684 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f36c4009a30 con 0x7f36d41007e0 2024-09-21T12:02:08.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.148+0000 7f36d17fa640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36bc07af80 0x7f36bc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:08.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.148+0000 7f36d17fa640 1 -- 172.21.15.118:0/603503684 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f36c409db70 con 0x7f36d41007e0 2024-09-21T12:02:08.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.148+0000 7f36d37fe640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36bc07af80 0x7f36bc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:08.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.149+0000 7f36d37fe640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36bc07af80 0x7f36bc07d440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f36d4197ef0 tx=0x7f36c8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:08.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.152+0000 7f36d17fa640 1 -- 172.21.15.118:0/603503684 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36c4069140 con 0x7f36d41007e0 2024-09-21T12:02:08.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.348+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f36d4197200 con 0x7f36bc07af80 2024-09-21T12:02:08.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.349+0000 7f36d17fa640 1 -- 172.21.15.118:0/603503684 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f36d4197200 con 0x7f36bc07af80 2024-09-21T12:02:08.350 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:02:08.350 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:02:08.350 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:02:08.350 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:02:08.350 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:02:08.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:02:08.350 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:02:08.350 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:02:08.351 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:02:08.351 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:02:08.351 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T12:02:08.351 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:02:08.351 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:02:08.351 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:02:08.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36bc07af80 msgr2=0x7f36bc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36bc07af80 0x7f36bc07d440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f36d4197ef0 tx=0x7f36c8031400 comp rx=0 tx=0).stop 2024-09-21T12:02:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 msgr2=0x7f36d419c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 0x7f36d419c5d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f36c400d6f0 tx=0x7f36c400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 shutdown_connections 2024-09-21T12:02:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36d41067e0 0x7f36d419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f36bc07af80 0x7f36bc07d440 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 --2- 172.21.15.118:0/603503684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d41007e0 0x7f36d419c5d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 >> 172.21.15.118:0/603503684 conn(0x7f36d40fc4c0 msgr2=0x7f36d40fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 shutdown_connections 2024-09-21T12:02:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.351+0000 7f36da3f0640 1 -- 172.21.15.118:0/603503684 wait complete. 2024-09-21T12:02:08.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.433+0000 7ff09e884640 1 -- 172.21.15.118:0/3487529085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098107930 msgr2=0x7ff098107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.433+0000 7ff09e884640 1 --2- 172.21.15.118:0/3487529085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098107930 0x7ff098107d10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff088009880 tx=0x7ff08802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.433+0000 7ff09e884640 1 -- 172.21.15.118:0/3487529085 shutdown_connections 2024-09-21T12:02:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.433+0000 7ff09e884640 1 --2- 172.21.15.118:0/3487529085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff098101930 0x7ff098101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.433+0000 7ff09e884640 1 --2- 172.21.15.118:0/3487529085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098107930 0x7ff098107d10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.433+0000 7ff09e884640 1 -- 172.21.15.118:0/3487529085 >> 172.21.15.118:0/3487529085 conn(0x7ff0980fd630 msgr2=0x7ff0980ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.433+0000 7ff09e884640 1 -- 172.21.15.118:0/3487529085 shutdown_connections 2024-09-21T12:02:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.433+0000 7ff09e884640 1 -- 172.21.15.118:0/3487529085 wait complete. 2024-09-21T12:02:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.433+0000 7ff09e884640 1 Processor -- start 2024-09-21T12:02:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff09e884640 1 -- start start 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff09e884640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098101930 0x7ff0980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff09e884640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff098107930 0x7ff098074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff09e884640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff09810ee60 con 0x7ff098101930 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff09e884640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff09810ece0 con 0x7ff098107930 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff097fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098101930 0x7ff0980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff097fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098101930 0x7ff0980744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48438/0 (socket says 172.21.15.118:48438) 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff097fff640 1 -- 172.21.15.118:0/3488191794 learned_addr learned my addr 172.21.15.118:0/3488191794 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff0977fe640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff098107930 0x7ff098074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff097fff640 1 -- 172.21.15.118:0/3488191794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff098107930 msgr2=0x7ff098074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff097fff640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff098107930 0x7ff098074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff097fff640 1 -- 172.21.15.118:0/3488191794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff098074f70 con 0x7ff098101930 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.434+0000 7ff0977fe640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff098107930 0x7ff098074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:02:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.435+0000 7ff097fff640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098101930 0x7ff0980744f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff088031460 tx=0x7ff0880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.435+0000 7ff0957fa640 1 -- 172.21.15.118:0/3488191794 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff08803f070 con 0x7ff098101930 2024-09-21T12:02:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.435+0000 7ff0957fa640 1 -- 172.21.15.118:0/3488191794 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff088004cf0 con 0x7ff098101930 2024-09-21T12:02:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.435+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff098075200 con 0x7ff098101930 2024-09-21T12:02:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.435+0000 7ff0957fa640 1 -- 172.21.15.118:0/3488191794 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff088035030 con 0x7ff098101930 2024-09-21T12:02:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.435+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0981a3e30 con 0x7ff098101930 2024-09-21T12:02:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.436+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff098103070 con 0x7ff098101930 2024-09-21T12:02:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.436+0000 7ff0957fa640 1 -- 172.21.15.118:0/3488191794 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff088042070 con 0x7ff098101930 2024-09-21T12:02:08.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.437+0000 7ff0957fa640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff08407af30 0x7ff08407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:08.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.437+0000 7ff0957fa640 1 -- 172.21.15.118:0/3488191794 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff0880bebb0 con 0x7ff098101930 2024-09-21T12:02:08.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.437+0000 7ff0977fe640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff08407af30 0x7ff08407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:08.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.437+0000 7ff0977fe640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff08407af30 0x7ff08407d3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff080006fd0 tx=0x7ff080008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:08.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.441+0000 7ff0957fa640 1 -- 172.21.15.118:0/3488191794 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0880c5080 con 0x7ff098101930 2024-09-21T12:02:08.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.689+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff098109ea0 con 0x7ff098101930 2024-09-21T12:02:08.691 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:08 smithi118 ceph-mon[111738]: from='client.35092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:08.691 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:08 smithi118 ceph-mon[111738]: from='client.35096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:08.691 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:08 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3338454937' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:02:08.691 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:08 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3549690415' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:02:08.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.690+0000 7ff0957fa640 1 -- 172.21.15.118:0/3488191794 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7ff08808a100 con 0x7ff098101930 2024-09-21T12:02:08.692 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:02:08.692 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:02:08.692 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:02:08.692 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:02:08.692 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:02:08.692 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:02:08.692 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:02:08.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.692+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff08407af30 msgr2=0x7ff08407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.692+0000 7ff09e884640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff08407af30 0x7ff08407d3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff080006fd0 tx=0x7ff080008040 comp rx=0 tx=0).stop 2024-09-21T12:02:08.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.692+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098101930 msgr2=0x7ff0980744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:08.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.692+0000 7ff09e884640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098101930 0x7ff0980744f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff088031460 tx=0x7ff0880048f0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.693+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 shutdown_connections 2024-09-21T12:02:08.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.693+0000 7ff09e884640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff098107930 0x7ff098074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.693+0000 7ff09e884640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff08407af30 0x7ff08407d3f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.693+0000 7ff09e884640 1 --2- 172.21.15.118:0/3488191794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff098101930 0x7ff0980744f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:08.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.693+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 >> 172.21.15.118:0/3488191794 conn(0x7ff0980fd630 msgr2=0x7ff0980fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.693+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 shutdown_connections 2024-09-21T12:02:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:08.693+0000 7ff09e884640 1 -- 172.21.15.118:0/3488191794 wait complete. 2024-09-21T12:02:08.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:08 smithi149 ceph-mon[79770]: from='client.35092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:08 smithi149 ceph-mon[79770]: from='client.35096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:08 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3338454937' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:02:08.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:08 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3549690415' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:02:09.800 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:09 smithi118 ceph-mon[111738]: from='client.35108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:09.800 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:09 smithi118 ceph-mon[111738]: pgmap v699: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:09.801 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:09 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3488191794' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:02:09.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:09 smithi149 ceph-mon[79770]: from='client.35108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:09.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:09 smithi149 ceph-mon[79770]: pgmap v699: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:09.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:09 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3488191794' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:02:11.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:11 smithi118 ceph-mon[111738]: pgmap v700: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:11.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:11 smithi149 ceph-mon[79770]: pgmap v700: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:13 smithi118 ceph-mon[111738]: pgmap v701: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:13.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:13 smithi149 ceph-mon[79770]: pgmap v701: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:15.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:15 smithi118 ceph-mon[111738]: pgmap v702: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:15.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:15 smithi149 ceph-mon[79770]: pgmap v702: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:17 smithi118 ceph-mon[111738]: pgmap v703: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:17.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:17 smithi149 ceph-mon[79770]: pgmap v703: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:19.752 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:19 smithi149 ceph-mon[79770]: pgmap v704: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:19 smithi118 ceph-mon[111738]: pgmap v704: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:02:20.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:02:21.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:21 smithi118 ceph-mon[111738]: pgmap v705: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:21 smithi149 ceph-mon[79770]: pgmap v705: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:24.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:23 smithi149 ceph-mon[79770]: pgmap v706: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:23 smithi118 ceph-mon[111738]: pgmap v706: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:26.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:25 smithi149 ceph-mon[79770]: pgmap v707: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:25 smithi118 ceph-mon[111738]: pgmap v707: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:28.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:27 smithi149 ceph-mon[79770]: pgmap v708: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:28.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:27 smithi118 ceph-mon[111738]: pgmap v708: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:30.106 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:29 smithi118 ceph-mon[111738]: pgmap v709: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:30.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:29 smithi149 ceph-mon[79770]: pgmap v709: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:32.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:31 smithi149 ceph-mon[79770]: pgmap v710: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:32.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:31 smithi118 ceph-mon[111738]: pgmap v710: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:34.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:33 smithi149 ceph-mon[79770]: pgmap v711: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:33 smithi118 ceph-mon[111738]: pgmap v711: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:36.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:35 smithi149 ceph-mon[79770]: pgmap v712: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:36.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:02:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:35 smithi118 ceph-mon[111738]: pgmap v712: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:02:38.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:37 smithi149 ceph-mon[79770]: pgmap v713: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:37 smithi118 ceph-mon[111738]: pgmap v713: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 -- 172.21.15.118:0/882785297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158102ae0 msgr2=0x7fa158102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 --2- 172.21.15.118:0/882785297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158102ae0 0x7fa158102ec0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa148009880 tx=0x7fa14802a530 comp rx=0 tx=0).stop 2024-09-21T12:02:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 -- 172.21.15.118:0/882785297 shutdown_connections 2024-09-21T12:02:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 --2- 172.21.15.118:0/882785297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa158103400 0x7fa15810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 --2- 172.21.15.118:0/882785297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158102ae0 0x7fa158102ec0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 -- 172.21.15.118:0/882785297 >> 172.21.15.118:0/882785297 conn(0x7fa1580fc520 msgr2=0x7fa1580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 -- 172.21.15.118:0/882785297 shutdown_connections 2024-09-21T12:02:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 -- 172.21.15.118:0/882785297 wait complete. 2024-09-21T12:02:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 Processor -- start 2024-09-21T12:02:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.785+0000 7fa15e544640 1 -- start start 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa15e544640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa158102ae0 0x7fa15819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa15e544640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158103400 0x7fa15819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa15e544640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa15810ee70 con 0x7fa158103400 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa15e544640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa15810ecf0 con 0x7fa158102ae0 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa1577fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158103400 0x7fa15819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa1577fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158103400 0x7fa15819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44494/0 (socket says 172.21.15.118:44494) 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa1577fe640 1 -- 172.21.15.118:0/2114835962 learned_addr learned my addr 172.21.15.118:0/2114835962 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa157fff640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa158102ae0 0x7fa15819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa1577fe640 1 -- 172.21.15.118:0/2114835962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa158102ae0 msgr2=0x7fa15819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa1577fe640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa158102ae0 0x7fa15819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa1577fe640 1 -- 172.21.15.118:0/2114835962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa158197860 con 0x7fa158103400 2024-09-21T12:02:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.786+0000 7fa157fff640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa158102ae0 0x7fa15819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:02:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.787+0000 7fa1577fe640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158103400 0x7fa15819dbe0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b370 tx=0x7fa14c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.787+0000 7fa1557fa640 1 -- 172.21.15.118:0/2114835962 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa14c015020 con 0x7fa158103400 2024-09-21T12:02:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.787+0000 7fa1557fa640 1 -- 172.21.15.118:0/2114835962 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa14c011af0 con 0x7fa158103400 2024-09-21T12:02:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.787+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa158197b50 con 0x7fa158103400 2024-09-21T12:02:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.787+0000 7fa1557fa640 1 -- 172.21.15.118:0/2114835962 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa14c010d60 con 0x7fa158103400 2024-09-21T12:02:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.787+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1581980e0 con 0x7fa158103400 2024-09-21T12:02:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.788+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15806abe0 con 0x7fa158103400 2024-09-21T12:02:38.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.789+0000 7fa1557fa640 1 -- 172.21.15.118:0/2114835962 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa14c018020 con 0x7fa158103400 2024-09-21T12:02:38.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.789+0000 7fa1557fa640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa14007af30 0x7fa14007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:38.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.789+0000 7fa157fff640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa14007af30 0x7fa14007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:38.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.789+0000 7fa1557fa640 1 -- 172.21.15.118:0/2114835962 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fa14c09da80 con 0x7fa158103400 2024-09-21T12:02:38.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.790+0000 7fa157fff640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa14007af30 0x7fa14007d3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c00 tx=0x7fa148031420 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:38.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.794+0000 7fa1557fa640 1 -- 172.21.15.118:0/2114835962 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa14c01f020 con 0x7fa158103400 2024-09-21T12:02:38.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.987+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa158198d90 con 0x7fa14007af30 2024-09-21T12:02:38.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.988+0000 7fa1557fa640 1 -- 172.21.15.118:0/2114835962 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa158198d90 con 0x7fa14007af30 2024-09-21T12:02:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.990+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa14007af30 msgr2=0x7fa14007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.990+0000 7fa15e544640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa14007af30 0x7fa14007d3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c00 tx=0x7fa148031420 comp rx=0 tx=0).stop 2024-09-21T12:02:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.990+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158103400 msgr2=0x7fa15819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.990+0000 7fa15e544640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158103400 0x7fa15819dbe0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b370 tx=0x7fa14c00b830 comp rx=0 tx=0).stop 2024-09-21T12:02:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.991+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 shutdown_connections 2024-09-21T12:02:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.991+0000 7fa15e544640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa14007af30 0x7fa14007d3f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.991+0000 7fa15e544640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa158103400 0x7fa15819dbe0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.991+0000 7fa15e544640 1 --2- 172.21.15.118:0/2114835962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa158102ae0 0x7fa15819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:38.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.991+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 >> 172.21.15.118:0/2114835962 conn(0x7fa1580fc520 msgr2=0x7fa158108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:38.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.991+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 shutdown_connections 2024-09-21T12:02:38.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:38.991+0000 7fa15e544640 1 -- 172.21.15.118:0/2114835962 wait complete. 2024-09-21T12:02:39.002 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:02:39.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:38 smithi118 ceph-mon[111738]: pgmap v714: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:39.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.074+0000 7f03c1165640 1 -- 172.21.15.118:0/3117819891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc1000b0 msgr2=0x7f03bc100490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.074+0000 7f03c1165640 1 --2- 172.21.15.118:0/3117819891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc1000b0 0x7f03bc100490 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009880 tx=0x7f03b002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.074+0000 7f03c1165640 1 -- 172.21.15.118:0/3117819891 shutdown_connections 2024-09-21T12:02:39.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.074+0000 7f03c1165640 1 --2- 172.21.15.118:0/3117819891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03bc100a60 0x7f03bc1065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.074+0000 7f03c1165640 1 --2- 172.21.15.118:0/3117819891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc1000b0 0x7f03bc100490 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.074+0000 7f03c1165640 1 -- 172.21.15.118:0/3117819891 >> 172.21.15.118:0/3117819891 conn(0x7f03bc0fbc40 msgr2=0x7f03bc0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:39.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.074+0000 7f03c1165640 1 -- 172.21.15.118:0/3117819891 shutdown_connections 2024-09-21T12:02:39.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.074+0000 7f03c1165640 1 -- 172.21.15.118:0/3117819891 wait complete. 2024-09-21T12:02:39.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.075+0000 7f03c1165640 1 Processor -- start 2024-09-21T12:02:39.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.075+0000 7f03c1165640 1 -- start start 2024-09-21T12:02:39.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.075+0000 7f03c1165640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03bc1000b0 0x7f03bc19d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.075+0000 7f03c1165640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc100a60 0x7f03bc19dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.075+0000 7f03c1165640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc10ee70 con 0x7f03bc100a60 2024-09-21T12:02:39.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.075+0000 7f03c1165640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc10ecf0 con 0x7f03bc1000b0 2024-09-21T12:02:39.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.075+0000 7f03ba59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc100a60 0x7f03bc19dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03ba59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc100a60 0x7f03bc19dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44510/0 (socket says 172.21.15.118:44510) 2024-09-21T12:02:39.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03ba59c640 1 -- 172.21.15.118:0/2893540732 learned_addr learned my addr 172.21.15.118:0/2893540732 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:39.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03bad9d640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03bc1000b0 0x7f03bc19d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03ba59c640 1 -- 172.21.15.118:0/2893540732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03bc1000b0 msgr2=0x7f03bc19d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03ba59c640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03bc1000b0 0x7f03bc19d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03ba59c640 1 -- 172.21.15.118:0/2893540732 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc1978e0 con 0x7f03bc100a60 2024-09-21T12:02:39.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03ba59c640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc100a60 0x7f03bc19dc60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00b3d0 tx=0x7f03ac00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:39.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03a3fff640 1 -- 172.21.15.118:0/2893540732 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03ac015020 con 0x7f03bc100a60 2024-09-21T12:02:39.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03bc197bd0 con 0x7f03bc100a60 2024-09-21T12:02:39.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03bc198160 con 0x7f03bc100a60 2024-09-21T12:02:39.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03a3fff640 1 -- 172.21.15.118:0/2893540732 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03ac011af0 con 0x7f03bc100a60 2024-09-21T12:02:39.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.076+0000 7f03a3fff640 1 -- 172.21.15.118:0/2893540732 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03ac010d30 con 0x7f03bc100a60 2024-09-21T12:02:39.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.078+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03bc103170 con 0x7f03bc100a60 2024-09-21T12:02:39.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.078+0000 7f03a3fff640 1 -- 172.21.15.118:0/2893540732 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f03ac018020 con 0x7f03bc100a60 2024-09-21T12:02:39.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.078+0000 7f03a3fff640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a407af80 0x7f03a407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.079+0000 7f03a3fff640 1 -- 172.21.15.118:0/2893540732 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f03ac09d8c0 con 0x7f03bc100a60 2024-09-21T12:02:39.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.079+0000 7f03bad9d640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a407af80 0x7f03a407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.079+0000 7f03bad9d640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a407af80 0x7f03a407d440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f03b0000c00 tx=0x7f03b0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:39.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.083+0000 7f03a3fff640 1 -- 172.21.15.118:0/2893540732 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03ac01f020 con 0x7f03bc100a60 2024-09-21T12:02:39.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:38 smithi149 ceph-mon[79770]: pgmap v714: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:39.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.273+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f03bc198e10 con 0x7f03a407af80 2024-09-21T12:02:39.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.275+0000 7f03a3fff640 1 -- 172.21.15.118:0/2893540732 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f03bc198e10 con 0x7f03a407af80 2024-09-21T12:02:39.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a407af80 msgr2=0x7f03a407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a407af80 0x7f03a407d440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f03b0000c00 tx=0x7f03b0031400 comp rx=0 tx=0).stop 2024-09-21T12:02:39.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc100a60 msgr2=0x7f03bc19dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc100a60 0x7f03bc19dc60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00b3d0 tx=0x7f03ac00b890 comp rx=0 tx=0).stop 2024-09-21T12:02:39.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 shutdown_connections 2024-09-21T12:02:39.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a407af80 0x7f03a407d440 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03bc100a60 0x7f03bc19dc60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 --2- 172.21.15.118:0/2893540732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03bc1000b0 0x7f03bc19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 >> 172.21.15.118:0/2893540732 conn(0x7f03bc0fbc40 msgr2=0x7f03bc0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:39.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 shutdown_connections 2024-09-21T12:02:39.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.277+0000 7f03c1165640 1 -- 172.21.15.118:0/2893540732 wait complete. 2024-09-21T12:02:39.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 -- 172.21.15.118:0/913187886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 msgr2=0x7f36a8100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 --2- 172.21.15.118:0/913187886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 0x7f36a8100c40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3690009880 tx=0x7f369002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 -- 172.21.15.118:0/913187886 shutdown_connections 2024-09-21T12:02:39.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 --2- 172.21.15.118:0/913187886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 0x7f36a8100c40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 --2- 172.21.15.118:0/913187886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a81067e0 0x7f36a8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 -- 172.21.15.118:0/913187886 >> 172.21.15.118:0/913187886 conn(0x7f36a80fc4c0 msgr2=0x7f36a80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:39.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 -- 172.21.15.118:0/913187886 shutdown_connections 2024-09-21T12:02:39.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 -- 172.21.15.118:0/913187886 wait complete. 2024-09-21T12:02:39.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 Processor -- start 2024-09-21T12:02:39.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.359+0000 7f36adbd6640 1 -- start start 2024-09-21T12:02:39.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36adbd6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 0x7f36a819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36adbd6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a81067e0 0x7f36a819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36adbd6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f36a810dc90 con 0x7f36a81007e0 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36adbd6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36a810db10 con 0x7f36a81067e0 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 0x7f36a819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 0x7f36a819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44528/0 (socket says 172.21.15.118:44528) 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a77fe640 1 -- 172.21.15.118:0/54080886 learned_addr learned my addr 172.21.15.118:0/54080886 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a77fe640 1 -- 172.21.15.118:0/54080886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a81067e0 msgr2=0x7f36a819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a77fe640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a81067e0 0x7f36a819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a77fe640 1 -- 172.21.15.118:0/54080886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a81977a0 con 0x7f36a81007e0 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a77fe640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 0x7f36a819d620 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f369800c8a0 tx=0x7f369800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a57fa640 1 -- 172.21.15.118:0/54080886 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36980079b0 con 0x7f36a81007e0 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a57fa640 1 -- 172.21.15.118:0/54080886 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3698007b50 con 0x7f36a81007e0 2024-09-21T12:02:39.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a8197a90 con 0x7f36a81007e0 2024-09-21T12:02:39.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.360+0000 7f36a57fa640 1 -- 172.21.15.118:0/54080886 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3698018700 con 0x7f36a81007e0 2024-09-21T12:02:39.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.361+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a8198020 con 0x7f36a81007e0 2024-09-21T12:02:39.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.362+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a8101f20 con 0x7f36a81007e0 2024-09-21T12:02:39.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.362+0000 7f36a57fa640 1 -- 172.21.15.118:0/54080886 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3698007d00 con 0x7f36a81007e0 2024-09-21T12:02:39.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.363+0000 7f36a57fa640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f369407af80 0x7f369407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.363+0000 7f369ffff640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f369407af80 0x7f369407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.363+0000 7f36a57fa640 1 -- 172.21.15.118:0/54080886 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f369809e260 con 0x7f36a81007e0 2024-09-21T12:02:39.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.364+0000 7f369ffff640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f369407af80 0x7f369407d440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f36900096c0 tx=0x7f3690000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:39.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.367+0000 7f36a57fa640 1 -- 172.21.15.118:0/54080886 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3698014030 con 0x7f36a81007e0 2024-09-21T12:02:39.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.551+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f36a8198340 con 0x7f369407af80 2024-09-21T12:02:39.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.561+0000 7f36a57fa640 1 -- 172.21.15.118:0/54080886 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f36a8198340 con 0x7f369407af80 2024-09-21T12:02:39.563 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:02:39.563 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (20m) 14m ago 31m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:02:39.563 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (23m) 14m ago 31m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:02:39.563 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (22m) 14m ago 30m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:02:39.563 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (18m) 14m ago 31m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:02:39.563 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (18m) 14m ago 30m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (20m) 14m ago 31m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (15m) 14m ago 26m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (14m) 14m ago 26m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (26m) 14m ago 26m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (14m) 14m ago 26m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (22m) 14m ago 32m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (21m) 14m ago 30m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (19m) 14m ago 33m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (18m) 14m ago 30m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (21m) 14m ago 31m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (21m) 14m ago 30m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (18m) 14m ago 29m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (17m) 14m ago 29m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:02:39.564 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (17m) 14m ago 28m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:02:39.565 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (16m) 14m ago 28m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:02:39.565 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (15m) 14m ago 27m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:02:39.565 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (15m) 14m ago 27m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:02:39.565 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (20m) 14m ago 31m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f369407af80 msgr2=0x7f369407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f369407af80 0x7f369407d440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f36900096c0 tx=0x7f3690000bc0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 msgr2=0x7f36a819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 0x7f36a819d620 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f369800c8a0 tx=0x7f369800cd60 comp rx=0 tx=0).stop 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 shutdown_connections 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a81067e0 0x7f36a819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f369407af80 0x7f369407d440 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 --2- 172.21.15.118:0/54080886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a81007e0 0x7f36a819d620 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 >> 172.21.15.118:0/54080886 conn(0x7f36a80fc4c0 msgr2=0x7f36a8069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 shutdown_connections 2024-09-21T12:02:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.563+0000 7f36adbd6640 1 -- 172.21.15.118:0/54080886 wait complete. 2024-09-21T12:02:39.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.643+0000 7f7b1f288640 1 -- 172.21.15.118:0/3167384816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 msgr2=0x7f7b18106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.643+0000 7f7b1f288640 1 --2- 172.21.15.118:0/3167384816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 0x7f7b18106bc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009880 tx=0x7f7b1402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.643+0000 7f7b1f288640 1 -- 172.21.15.118:0/3167384816 shutdown_connections 2024-09-21T12:02:39.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.643+0000 7f7b1f288640 1 --2- 172.21.15.118:0/3167384816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b181007e0 0x7f7b18100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.643+0000 7f7b1f288640 1 --2- 172.21.15.118:0/3167384816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 0x7f7b18106bc0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.643+0000 7f7b1f288640 1 -- 172.21.15.118:0/3167384816 >> 172.21.15.118:0/3167384816 conn(0x7f7b180fc4c0 msgr2=0x7f7b180fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:39.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.644+0000 7f7b1f288640 1 -- 172.21.15.118:0/3167384816 shutdown_connections 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.644+0000 7f7b1f288640 1 -- 172.21.15.118:0/3167384816 wait complete. 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1f288640 1 Processor -- start 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1f288640 1 -- start start 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1f288640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b181007e0 0x7f7b18198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1f288640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 0x7f7b18198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1f288640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1810dcb0 con 0x7f7b181067e0 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1f288640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1810db30 con 0x7f7b181007e0 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1c823640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 0x7f7b18198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1c823640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 0x7f7b18198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44552/0 (socket says 172.21.15.118:44552) 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1c823640 1 -- 172.21.15.118:0/161611465 learned_addr learned my addr 172.21.15.118:0/161611465 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.645+0000 7f7b1d024640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b181007e0 0x7f7b18198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.646+0000 7f7b1c823640 1 -- 172.21.15.118:0/161611465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b181007e0 msgr2=0x7f7b18198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.646+0000 7f7b1c823640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b181007e0 0x7f7b18198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.646+0000 7f7b1c823640 1 -- 172.21.15.118:0/161611465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b18199360 con 0x7f7b181067e0 2024-09-21T12:02:39.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.646+0000 7f7b1c823640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 0x7f7b18198d60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800c8f0 tx=0x7f7b0800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:39.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.646+0000 7f7b0e7fc640 1 -- 172.21.15.118:0/161611465 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b080079b0 con 0x7f7b181067e0 2024-09-21T12:02:39.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.646+0000 7f7b0e7fc640 1 -- 172.21.15.118:0/161611465 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b080054e0 con 0x7f7b181067e0 2024-09-21T12:02:39.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.646+0000 7f7b0e7fc640 1 -- 172.21.15.118:0/161611465 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b08004dd0 con 0x7f7b181067e0 2024-09-21T12:02:39.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.646+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b18199650 con 0x7f7b181067e0 2024-09-21T12:02:39.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.646+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b181a1c50 con 0x7f7b181067e0 2024-09-21T12:02:39.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.647+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b18101f20 con 0x7f7b181067e0 2024-09-21T12:02:39.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.648+0000 7f7b0e7fc640 1 -- 172.21.15.118:0/161611465 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7b08005020 con 0x7f7b181067e0 2024-09-21T12:02:39.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.648+0000 7f7b0e7fc640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7b0407aed0 0x7f7b0407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.649+0000 7f7b1d024640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7b0407aed0 0x7f7b0407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.649+0000 7f7b0e7fc640 1 -- 172.21.15.118:0/161611465 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f7b0809e130 con 0x7f7b181067e0 2024-09-21T12:02:39.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.649+0000 7f7b1d024640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7b0407aed0 0x7f7b0407d390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b14031460 tx=0x7f7b14005bd0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:39.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.653+0000 7f7b0e7fc640 1 -- 172.21.15.118:0/161611465 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b18199650 con 0x7f7b181067e0 2024-09-21T12:02:39.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.904+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7b18108d50 con 0x7f7b181067e0 2024-09-21T12:02:39.907 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:39 smithi118 ceph-mon[111738]: from='client.35116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:39.907 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:39 smithi118 ceph-mon[111738]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:39.907 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:39 smithi118 ceph-mon[111738]: from='client.35124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:39.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.905+0000 7f7b0e7fc640 1 -- 172.21.15.118:0/161611465 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f7b08014030 con 0x7f7b181067e0 2024-09-21T12:02:39.907 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:02:39.907 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:02:39.907 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:02:39.907 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:02:39.908 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:02:39.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7b0407aed0 msgr2=0x7f7b0407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7b0407aed0 0x7f7b0407d390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b14031460 tx=0x7f7b14005bd0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 msgr2=0x7f7b18198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 0x7f7b18198d60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800c8f0 tx=0x7f7b0800cdb0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 shutdown_connections 2024-09-21T12:02:39.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7b0407aed0 0x7f7b0407d390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b181067e0 0x7f7b18198d60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 --2- 172.21.15.118:0/161611465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b181007e0 0x7f7b18198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 >> 172.21.15.118:0/161611465 conn(0x7f7b180fc4c0 msgr2=0x7f7b180fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:39.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 shutdown_connections 2024-09-21T12:02:39.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.907+0000 7f7b1f288640 1 -- 172.21.15.118:0/161611465 wait complete. 2024-09-21T12:02:39.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.988+0000 7fe97e01a640 1 -- 172.21.15.118:0/3619097119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978103400 msgr2=0x7fe97810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.988+0000 7fe97e01a640 1 --2- 172.21.15.118:0/3619097119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978103400 0x7fe97810b8f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009880 tx=0x7fe96c02a530 comp rx=0 tx=0).stop 2024-09-21T12:02:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.988+0000 7fe97e01a640 1 -- 172.21.15.118:0/3619097119 shutdown_connections 2024-09-21T12:02:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.988+0000 7fe97e01a640 1 --2- 172.21.15.118:0/3619097119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978103400 0x7fe97810b8f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.988+0000 7fe97e01a640 1 --2- 172.21.15.118:0/3619097119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe978102ae0 0x7fe978102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.988+0000 7fe97e01a640 1 -- 172.21.15.118:0/3619097119 >> 172.21.15.118:0/3619097119 conn(0x7fe9780fc520 msgr2=0x7fe9780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.988+0000 7fe97e01a640 1 -- 172.21.15.118:0/3619097119 shutdown_connections 2024-09-21T12:02:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.988+0000 7fe97e01a640 1 -- 172.21.15.118:0/3619097119 wait complete. 2024-09-21T12:02:39.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.989+0000 7fe97e01a640 1 Processor -- start 2024-09-21T12:02:39.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.989+0000 7fe97e01a640 1 -- start start 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.989+0000 7fe97e01a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978102ae0 0x7fe97819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.989+0000 7fe97e01a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe978103400 0x7fe97819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.989+0000 7fe97e01a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe97810ee10 con 0x7fe978102ae0 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.989+0000 7fe97e01a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe97810ec90 con 0x7fe978103400 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe9777fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978102ae0 0x7fe97819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe9777fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978102ae0 0x7fe97819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44574/0 (socket says 172.21.15.118:44574) 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe9777fe640 1 -- 172.21.15.118:0/2316355317 learned_addr learned my addr 172.21.15.118:0/2316355317 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe976ffd640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe978103400 0x7fe97819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe9777fe640 1 -- 172.21.15.118:0/2316355317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe978103400 msgr2=0x7fe97819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe9777fe640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe978103400 0x7fe97819dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe9777fe640 1 -- 172.21.15.118:0/2316355317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe978197820 con 0x7fe978102ae0 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe9777fe640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978102ae0 0x7fe97819d6a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe96800ea00 tx=0x7fe96800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:39.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe974ff9640 1 -- 172.21.15.118:0/2316355317 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe96800cb80 con 0x7fe978102ae0 2024-09-21T12:02:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe974ff9640 1 -- 172.21.15.118:0/2316355317 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe96800cd20 con 0x7fe978102ae0 2024-09-21T12:02:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe978197b10 con 0x7fe978102ae0 2024-09-21T12:02:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe974ff9640 1 -- 172.21.15.118:0/2316355317 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe968011470 con 0x7fe978102ae0 2024-09-21T12:02:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.990+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe978198070 con 0x7fe978102ae0 2024-09-21T12:02:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.991+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97806abe0 con 0x7fe978102ae0 2024-09-21T12:02:39.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.992+0000 7fe974ff9640 1 -- 172.21.15.118:0/2316355317 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe968011750 con 0x7fe978102ae0 2024-09-21T12:02:39.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.992+0000 7fe974ff9640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe96007af30 0x7fe96007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:39.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.992+0000 7fe974ff9640 1 -- 172.21.15.118:0/2316355317 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fe96809e590 con 0x7fe978102ae0 2024-09-21T12:02:39.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.992+0000 7fe976ffd640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe96007af30 0x7fe96007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:39.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.993+0000 7fe976ffd640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe96007af30 0x7fe96007d3f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe978198b70 tx=0x7fe96c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:39.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:39.997+0000 7fe974ff9640 1 -- 172.21.15.118:0/2316355317 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe968016030 con 0x7fe978102ae0 2024-09-21T12:02:40.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:39 smithi149 ceph-mon[79770]: from='client.35116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:40.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:39 smithi149 ceph-mon[79770]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:40.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:39 smithi149 ceph-mon[79770]: from='client.35124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:40.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.212+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe978105f80 con 0x7fe978102ae0 2024-09-21T12:02:40.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.212+0000 7fe974ff9640 1 -- 172.21.15.118:0/2316355317 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7fe968069ae0 con 0x7fe978102ae0 2024-09-21T12:02:40.214 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T12:02:40.214 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T12:02:40.214 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:02:40.214 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:02:40.215 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:02:40.216 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:02:40.217 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe96007af30 msgr2=0x7fe96007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe96007af30 0x7fe96007d3f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe978198b70 tx=0x7fe96c031400 comp rx=0 tx=0).stop 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978102ae0 msgr2=0x7fe97819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978102ae0 0x7fe97819d6a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe96800ea00 tx=0x7fe96800eec0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 shutdown_connections 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe978103400 0x7fe97819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe96007af30 0x7fe96007d3f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 --2- 172.21.15.118:0/2316355317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe978102ae0 0x7fe97819d6a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 >> 172.21.15.118:0/2316355317 conn(0x7fe9780fc520 msgr2=0x7fe978108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:40.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 shutdown_connections 2024-09-21T12:02:40.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.214+0000 7fe97e01a640 1 -- 172.21.15.118:0/2316355317 wait complete. 2024-09-21T12:02:40.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.299+0000 7f35b73c7640 1 -- 172.21.15.118:0/3584842247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01007e0 msgr2=0x7f35b0100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.299+0000 7f35b73c7640 1 --2- 172.21.15.118:0/3584842247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01007e0 0x7f35b0100c40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009880 tx=0x7f35ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.299+0000 7f35b73c7640 1 -- 172.21.15.118:0/3584842247 shutdown_connections 2024-09-21T12:02:40.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.299+0000 7f35b73c7640 1 --2- 172.21.15.118:0/3584842247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01007e0 0x7f35b0100c40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.299+0000 7f35b73c7640 1 --2- 172.21.15.118:0/3584842247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b01067e0 0x7f35b0106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.299+0000 7f35b73c7640 1 -- 172.21.15.118:0/3584842247 >> 172.21.15.118:0/3584842247 conn(0x7f35b00fc4c0 msgr2=0x7f35b00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:40.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.299+0000 7f35b73c7640 1 -- 172.21.15.118:0/3584842247 shutdown_connections 2024-09-21T12:02:40.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.299+0000 7f35b73c7640 1 -- 172.21.15.118:0/3584842247 wait complete. 2024-09-21T12:02:40.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.299+0000 7f35b73c7640 1 Processor -- start 2024-09-21T12:02:40.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b73c7640 1 -- start start 2024-09-21T12:02:40.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b73c7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b01007e0 0x7f35b00fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:40.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b73c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01067e0 0x7f35b00fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b73c7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f35b010dcb0 con 0x7f35b01067e0 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b73c7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f35b010db30 con 0x7f35b01007e0 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b4962640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01067e0 0x7f35b00fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b4962640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01067e0 0x7f35b00fd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44586/0 (socket says 172.21.15.118:44586) 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b4962640 1 -- 172.21.15.118:0/3187568769 learned_addr learned my addr 172.21.15.118:0/3187568769 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b5163640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b01007e0 0x7f35b00fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b4962640 1 -- 172.21.15.118:0/3187568769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b01007e0 msgr2=0x7f35b00fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b4962640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b01007e0 0x7f35b00fcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b4962640 1 -- 172.21.15.118:0/3187568769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b00fd6d0 con 0x7f35b01067e0 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.300+0000 7f35b5163640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b01007e0 0x7f35b00fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.301+0000 7f35b4962640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01067e0 0x7f35b00fd190 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f35ac031460 tx=0x7f35ac004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.301+0000 7f35a67fc640 1 -- 172.21.15.118:0/3187568769 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35ac03f070 con 0x7f35b01067e0 2024-09-21T12:02:40.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.301+0000 7f35a67fc640 1 -- 172.21.15.118:0/3187568769 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35ac0035f0 con 0x7f35b01067e0 2024-09-21T12:02:40.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.301+0000 7f35a67fc640 1 -- 172.21.15.118:0/3187568769 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35ac035030 con 0x7f35b01067e0 2024-09-21T12:02:40.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.301+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b00fd960 con 0x7f35b01067e0 2024-09-21T12:02:40.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.301+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b01a3df0 con 0x7f35b01067e0 2024-09-21T12:02:40.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.302+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b0101f20 con 0x7f35b01067e0 2024-09-21T12:02:40.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.303+0000 7f35a67fc640 1 -- 172.21.15.118:0/3187568769 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f35ac042070 con 0x7f35b01067e0 2024-09-21T12:02:40.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.303+0000 7f35a67fc640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f359c07af80 0x7f359c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:40.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.303+0000 7f35a67fc640 1 -- 172.21.15.118:0/3187568769 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f35ac0be8e0 con 0x7f35b01067e0 2024-09-21T12:02:40.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.303+0000 7f35b5163640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f359c07af80 0x7f359c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:40.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.304+0000 7f35b5163640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f359c07af80 0x7f359c07d440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009fc0 tx=0x7f35a0005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:40.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.311+0000 7f35a67fc640 1 -- 172.21.15.118:0/3187568769 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35ac089eb0 con 0x7f35b01067e0 2024-09-21T12:02:40.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.504+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f35b0062630 con 0x7f359c07af80 2024-09-21T12:02:40.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.505+0000 7f35a67fc640 1 -- 172.21.15.118:0/3187568769 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f35b0062630 con 0x7f359c07af80 2024-09-21T12:02:40.507 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:02:40.507 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:02:40.508 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:02:40.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f359c07af80 msgr2=0x7f359c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f359c07af80 0x7f359c07d440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009fc0 tx=0x7f35a0005f90 comp rx=0 tx=0).stop 2024-09-21T12:02:40.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01067e0 msgr2=0x7f35b00fd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01067e0 0x7f35b00fd190 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f35ac031460 tx=0x7f35ac004530 comp rx=0 tx=0).stop 2024-09-21T12:02:40.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 shutdown_connections 2024-09-21T12:02:40.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f359c07af80 0x7f359c07d440 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35b01067e0 0x7f35b00fd190 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 --2- 172.21.15.118:0/3187568769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35b01007e0 0x7f35b00fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 >> 172.21.15.118:0/3187568769 conn(0x7f35b00fc4c0 msgr2=0x7f35b0069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:40.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 shutdown_connections 2024-09-21T12:02:40.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.507+0000 7f35b73c7640 1 -- 172.21.15.118:0/3187568769 wait complete. 2024-09-21T12:02:40.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 -- 172.21.15.118:0/2682136855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc103400 msgr2=0x7fa6fc10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 --2- 172.21.15.118:0/2682136855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc103400 0x7fa6fc10b8f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009880 tx=0x7fa6e402a530 comp rx=0 tx=0).stop 2024-09-21T12:02:40.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 -- 172.21.15.118:0/2682136855 shutdown_connections 2024-09-21T12:02:40.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 --2- 172.21.15.118:0/2682136855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc103400 0x7fa6fc10b8f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 --2- 172.21.15.118:0/2682136855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc102ae0 0x7fa6fc102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 -- 172.21.15.118:0/2682136855 >> 172.21.15.118:0/2682136855 conn(0x7fa6fc0fc520 msgr2=0x7fa6fc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:40.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 -- 172.21.15.118:0/2682136855 shutdown_connections 2024-09-21T12:02:40.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 -- 172.21.15.118:0/2682136855 wait complete. 2024-09-21T12:02:40.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 Processor -- start 2024-09-21T12:02:40.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.589+0000 7fa7028fd640 1 -- start start 2024-09-21T12:02:40.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa7028fd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc102ae0 0x7fa6fc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:40.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa7028fd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc103400 0x7fa6fc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:40.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa7028fd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc10ee10 con 0x7fa6fc102ae0 2024-09-21T12:02:40.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa7028fd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc10ec90 con 0x7fa6fc103400 2024-09-21T12:02:40.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc102ae0 0x7fa6fc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:40.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa6fbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc102ae0 0x7fa6fc19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44610/0 (socket says 172.21.15.118:44610) 2024-09-21T12:02:40.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa6fbfff640 1 -- 172.21.15.118:0/4208673217 learned_addr learned my addr 172.21.15.118:0/4208673217 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa6fb7fe640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc103400 0x7fa6fc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa6fbfff640 1 -- 172.21.15.118:0/4208673217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc103400 msgr2=0x7fa6fc19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa6fbfff640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc103400 0x7fa6fc19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa6fbfff640 1 -- 172.21.15.118:0/4208673217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc197820 con 0x7fa6fc102ae0 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.590+0000 7fa6fbfff640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc102ae0 0x7fa6fc19d6a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00d6f0 tx=0x7fa6ec00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.591+0000 7fa6f97fa640 1 -- 172.21.15.118:0/4208673217 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6ec017070 con 0x7fa6fc102ae0 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.591+0000 7fa6f97fa640 1 -- 172.21.15.118:0/4208673217 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6ec00de00 con 0x7fa6fc102ae0 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.591+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6fc197b10 con 0x7fa6fc102ae0 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.591+0000 7fa6f97fa640 1 -- 172.21.15.118:0/4208673217 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6ec004bb0 con 0x7fa6fc102ae0 2024-09-21T12:02:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.591+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6fc198070 con 0x7fa6fc102ae0 2024-09-21T12:02:40.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.592+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6fc06abe0 con 0x7fa6fc102ae0 2024-09-21T12:02:40.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.593+0000 7fa6f97fa640 1 -- 172.21.15.118:0/4208673217 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa6ec009a30 con 0x7fa6fc102ae0 2024-09-21T12:02:40.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.593+0000 7fa6f97fa640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6e807af80 0x7fa6e807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:02:40.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.593+0000 7fa6f97fa640 1 -- 172.21.15.118:0/4208673217 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fa6ec09dc20 con 0x7fa6fc102ae0 2024-09-21T12:02:40.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.593+0000 7fa6fb7fe640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6e807af80 0x7fa6e807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:02:40.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.593+0000 7fa6fb7fe640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6e807af80 0x7fa6e807d440 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc198b70 tx=0x7fa6e4031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:02:40.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.597+0000 7fa6f97fa640 1 -- 172.21.15.118:0/4208673217 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6ec0691f0 con 0x7fa6fc102ae0 2024-09-21T12:02:40.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.843+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa6fc105f80 con 0x7fa6fc102ae0 2024-09-21T12:02:40.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.843+0000 7fa6f97fa640 1 -- 172.21.15.118:0/4208673217 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fa6ec06e0a0 con 0x7fa6fc102ae0 2024-09-21T12:02:40.846 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:02:40.846 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:02:40.846 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:02:40.846 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:02:40.846 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:02:40.846 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:02:40.846 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:02:40.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.845+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6e807af80 msgr2=0x7fa6e807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.845+0000 7fa7028fd640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6e807af80 0x7fa6e807d440 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc198b70 tx=0x7fa6e4031400 comp rx=0 tx=0).stop 2024-09-21T12:02:40.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.845+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc102ae0 msgr2=0x7fa6fc19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:02:40.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.845+0000 7fa7028fd640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc102ae0 0x7fa6fc19d6a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00d6f0 tx=0x7fa6ec00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.846+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 shutdown_connections 2024-09-21T12:02:40.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.846+0000 7fa7028fd640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6fc103400 0x7fa6fc19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.846+0000 7fa7028fd640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6e807af80 0x7fa6e807d440 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.846+0000 7fa7028fd640 1 --2- 172.21.15.118:0/4208673217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6fc102ae0 0x7fa6fc19d6a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:02:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.846+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 >> 172.21.15.118:0/4208673217 conn(0x7fa6fc0fc520 msgr2=0x7fa6fc108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:02:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.846+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 shutdown_connections 2024-09-21T12:02:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:02:40.846+0000 7fa7028fd640 1 -- 172.21.15.118:0/4208673217 wait complete. 2024-09-21T12:02:41.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:40 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/161611465' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:02:41.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:40 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2316355317' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:02:41.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:40 smithi149 ceph-mon[79770]: pgmap v715: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:41.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:40 smithi149 ceph-mon[79770]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:41.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:40 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/4208673217' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:02:41.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:40 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/161611465' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:02:41.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:40 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2316355317' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:02:41.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:40 smithi118 ceph-mon[111738]: pgmap v715: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:41.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:40 smithi118 ceph-mon[111738]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:02:41.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:40 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/4208673217' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:02:43.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:43 smithi118 ceph-mon[111738]: pgmap v716: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:43.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:43 smithi149 ceph-mon[79770]: pgmap v716: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:45.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:45 smithi118 ceph-mon[111738]: pgmap v717: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:45.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:45 smithi149 ceph-mon[79770]: pgmap v717: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:47.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:47 smithi118 ceph-mon[111738]: pgmap v718: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:47.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:47 smithi149 ceph-mon[79770]: pgmap v718: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:49.752 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:49 smithi149 ceph-mon[79770]: pgmap v719: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:49.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:49 smithi118 ceph-mon[111738]: pgmap v719: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:02:50.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:02:51.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:51 smithi118 ceph-mon[111738]: pgmap v720: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:51.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:51 smithi149 ceph-mon[79770]: pgmap v720: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:53.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:53 smithi118 ceph-mon[111738]: pgmap v721: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:53.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:53 smithi149 ceph-mon[79770]: pgmap v721: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:55.595 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:55 smithi118 ceph-mon[111738]: pgmap v722: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:55.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:55 smithi149 ceph-mon[79770]: pgmap v722: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:57.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:57 smithi118 ceph-mon[111738]: pgmap v723: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:57.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:57 smithi149 ceph-mon[79770]: pgmap v723: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:59.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:02:59 smithi118 ceph-mon[111738]: pgmap v724: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:02:59.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:02:59 smithi149 ceph-mon[79770]: pgmap v724: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:01.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:01 smithi118 ceph-mon[111738]: pgmap v725: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:01.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:01 smithi149 ceph-mon[79770]: pgmap v725: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:03.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:03 smithi118 ceph-mon[111738]: pgmap v726: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:03.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:03 smithi149 ceph-mon[79770]: pgmap v726: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:05 smithi118 ceph-mon[111738]: pgmap v727: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:03:05.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:05 smithi149 ceph-mon[79770]: pgmap v727: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:05.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:03:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:07 smithi118 ceph-mon[111738]: pgmap v728: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:07.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:07 smithi149 ceph-mon[79770]: pgmap v728: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:09.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:09 smithi118 ceph-mon[111738]: pgmap v729: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:09.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:09 smithi149 ceph-mon[79770]: pgmap v729: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:10.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.937+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/14166585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81067f0 msgr2=0x7fa6c8106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:10.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.937+0000 7fa6ce9fb640 1 --2- 172.21.15.118:0/14166585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81067f0 0x7fa6c8106bd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009880 tx=0x7fa6b802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:10.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.937+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/14166585 shutdown_connections 2024-09-21T12:03:10.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.937+0000 7fa6ce9fb640 1 --2- 172.21.15.118:0/14166585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81007f0 0x7fa6c8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:10.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.937+0000 7fa6ce9fb640 1 --2- 172.21.15.118:0/14166585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81067f0 0x7fa6c8106bd0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:10.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.937+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/14166585 >> 172.21.15.118:0/14166585 conn(0x7fa6c80fc4f0 msgr2=0x7fa6c80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:10.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.937+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/14166585 shutdown_connections 2024-09-21T12:03:10.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.937+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/14166585 wait complete. 2024-09-21T12:03:10.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6ce9fb640 1 Processor -- start 2024-09-21T12:03:10.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6ce9fb640 1 -- start start 2024-09-21T12:03:10.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6ce9fb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81007f0 0x7fa6c81987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:10.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6ce9fb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81067f0 0x7fa6c8198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:10.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6ce9fb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c810dcc0 con 0x7fa6c81007f0 2024-09-21T12:03:10.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6ce9fb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c810db40 con 0x7fa6c81067f0 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6c7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81007f0 0x7fa6c81987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6c7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81007f0 0x7fa6c81987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43516/0 (socket says 172.21.15.118:43516) 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6c7fff640 1 -- 172.21.15.118:0/3199098643 learned_addr learned my addr 172.21.15.118:0/3199098643 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.938+0000 7fa6c77fe640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81067f0 0x7fa6c8198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.939+0000 7fa6c7fff640 1 -- 172.21.15.118:0/3199098643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81067f0 msgr2=0x7fa6c8198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.939+0000 7fa6c7fff640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81067f0 0x7fa6c8198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.939+0000 7fa6c7fff640 1 -- 172.21.15.118:0/3199098643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c8199330 con 0x7fa6c81007f0 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.939+0000 7fa6c7fff640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81007f0 0x7fa6c81987f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8031460 tx=0x7fa6b8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.939+0000 7fa6c57fa640 1 -- 172.21.15.118:0/3199098643 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6b803f070 con 0x7fa6c81007f0 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.939+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c81995c0 con 0x7fa6c81007f0 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.939+0000 7fa6c57fa640 1 -- 172.21.15.118:0/3199098643 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6b8004a90 con 0x7fa6c81007f0 2024-09-21T12:03:10.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.939+0000 7fa6c57fa640 1 -- 172.21.15.118:0/3199098643 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6b8035030 con 0x7fa6c81007f0 2024-09-21T12:03:10.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.939+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c81a1b70 con 0x7fa6c81007f0 2024-09-21T12:03:10.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.940+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c8101f30 con 0x7fa6c81007f0 2024-09-21T12:03:10.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.941+0000 7fa6c57fa640 1 -- 172.21.15.118:0/3199098643 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa6b8042070 con 0x7fa6c81007f0 2024-09-21T12:03:10.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.941+0000 7fa6c57fa640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6b007af40 0x7fa6b007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:10.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.941+0000 7fa6c57fa640 1 -- 172.21.15.118:0/3199098643 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fa6b80beb00 con 0x7fa6c81007f0 2024-09-21T12:03:10.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.941+0000 7fa6c77fe640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6b007af40 0x7fa6b007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:10.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.942+0000 7fa6c77fe640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6b007af40 0x7fa6b007d400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa6c806aea0 tx=0x7fa6bc005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:10.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:10.946+0000 7fa6c57fa640 1 -- 172.21.15.118:0/3199098643 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6b808a050 con 0x7fa6c81007f0 2024-09-21T12:03:11.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.142+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa6c8062630 con 0x7fa6b007af40 2024-09-21T12:03:11.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.143+0000 7fa6c57fa640 1 -- 172.21.15.118:0/3199098643 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa6c8062630 con 0x7fa6b007af40 2024-09-21T12:03:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.145+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6b007af40 msgr2=0x7fa6b007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.145+0000 7fa6ce9fb640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6b007af40 0x7fa6b007d400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa6c806aea0 tx=0x7fa6bc005f90 comp rx=0 tx=0).stop 2024-09-21T12:03:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.145+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81007f0 msgr2=0x7fa6c81987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.145+0000 7fa6ce9fb640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81007f0 0x7fa6c81987f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8031460 tx=0x7fa6b8004530 comp rx=0 tx=0).stop 2024-09-21T12:03:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.145+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 shutdown_connections 2024-09-21T12:03:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.145+0000 7fa6ce9fb640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81067f0 0x7fa6c8198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.145+0000 7fa6ce9fb640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa6b007af40 0x7fa6b007d400 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.145+0000 7fa6ce9fb640 1 --2- 172.21.15.118:0/3199098643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6c81007f0 0x7fa6c81987f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.145+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 >> 172.21.15.118:0/3199098643 conn(0x7fa6c80fc4f0 msgr2=0x7fa6c80fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:11.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.146+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 shutdown_connections 2024-09-21T12:03:11.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.146+0000 7fa6ce9fb640 1 -- 172.21.15.118:0/3199098643 wait complete. 2024-09-21T12:03:11.156 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:03:11.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.227+0000 7f743d89b640 1 -- 172.21.15.118:0/734760371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381067e0 msgr2=0x7f7438106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.227+0000 7f743d89b640 1 --2- 172.21.15.118:0/734760371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381067e0 0x7f7438106bc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7428009c20 tx=0x7f742802a970 comp rx=0 tx=0).stop 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.227+0000 7f743d89b640 1 -- 172.21.15.118:0/734760371 shutdown_connections 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.227+0000 7f743d89b640 1 --2- 172.21.15.118:0/734760371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74381007e0 0x7f7438100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.227+0000 7f743d89b640 1 --2- 172.21.15.118:0/734760371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381067e0 0x7f7438106bc0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.227+0000 7f743d89b640 1 -- 172.21.15.118:0/734760371 >> 172.21.15.118:0/734760371 conn(0x7f74380fc4c0 msgr2=0x7f74380fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.228+0000 7f743d89b640 1 -- 172.21.15.118:0/734760371 shutdown_connections 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.228+0000 7f743d89b640 1 -- 172.21.15.118:0/734760371 wait complete. 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.228+0000 7f743d89b640 1 Processor -- start 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.228+0000 7f743d89b640 1 -- start start 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.228+0000 7f743d89b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381007e0 0x7f74381987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:11.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.228+0000 7f743d89b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74381067e0 0x7f7438198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:11.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.228+0000 7f743d89b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f743810dc90 con 0x7f74381007e0 2024-09-21T12:03:11.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.228+0000 7f743d89b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f743810db10 con 0x7f74381067e0 2024-09-21T12:03:11.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f7436ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381007e0 0x7f74381987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:11.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f7436ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381007e0 0x7f74381987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43534/0 (socket says 172.21.15.118:43534) 2024-09-21T12:03:11.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f7436ffd640 1 -- 172.21.15.118:0/2335539954 learned_addr learned my addr 172.21.15.118:0/2335539954 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:11.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f74367fc640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74381067e0 0x7f7438198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:11.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f7436ffd640 1 -- 172.21.15.118:0/2335539954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74381067e0 msgr2=0x7f7438198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f7436ffd640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74381067e0 0x7f7438198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f7436ffd640 1 -- 172.21.15.118:0/2335539954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7438199320 con 0x7f74381007e0 2024-09-21T12:03:11.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f7436ffd640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381007e0 0x7f74381987e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f742802ae90 tx=0x7f742802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:11.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f743c899640 1 -- 172.21.15.118:0/2335539954 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7428047070 con 0x7f74381007e0 2024-09-21T12:03:11.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f743c899640 1 -- 172.21.15.118:0/2335539954 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f742802f7e0 con 0x7f74381007e0 2024-09-21T12:03:11.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74381995b0 con 0x7f74381007e0 2024-09-21T12:03:11.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f743c899640 1 -- 172.21.15.118:0/2335539954 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7428034070 con 0x7f74381007e0 2024-09-21T12:03:11.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.229+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74381a1b60 con 0x7f74381007e0 2024-09-21T12:03:11.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.230+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7438101f20 con 0x7f74381007e0 2024-09-21T12:03:11.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.231+0000 7f743c899640 1 -- 172.21.15.118:0/2335539954 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f742804a070 con 0x7f74381007e0 2024-09-21T12:03:11.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.232+0000 7f743c899640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af80 0x7f742407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:11.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.232+0000 7f74367fc640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af80 0x7f742407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:11.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.232+0000 7f743c899640 1 -- 172.21.15.118:0/2335539954 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f74280becb0 con 0x7f74381007e0 2024-09-21T12:03:11.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.232+0000 7f74367fc640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af80 0x7f742407d440 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f743806a680 tx=0x7f742000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:11.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.236+0000 7f743c899640 1 -- 172.21.15.118:0/2335539954 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f742803f070 con 0x7f74381007e0 2024-09-21T12:03:11.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.429+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7438062630 con 0x7f742407af80 2024-09-21T12:03:11.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.430+0000 7f743c899640 1 -- 172.21.15.118:0/2335539954 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f7438062630 con 0x7f742407af80 2024-09-21T12:03:11.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af80 msgr2=0x7f742407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af80 0x7f742407d440 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f743806a680 tx=0x7f742000b390 comp rx=0 tx=0).stop 2024-09-21T12:03:11.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381007e0 msgr2=0x7f74381987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381007e0 0x7f74381987e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f742802ae90 tx=0x7f742802f5f0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 shutdown_connections 2024-09-21T12:03:11.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74381067e0 0x7f7438198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f742407af80 0x7f742407d440 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 --2- 172.21.15.118:0/2335539954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74381007e0 0x7f74381987e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 >> 172.21.15.118:0/2335539954 conn(0x7f74380fc4c0 msgr2=0x7f74380fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:11.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 shutdown_connections 2024-09-21T12:03:11.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.433+0000 7f743d89b640 1 -- 172.21.15.118:0/2335539954 wait complete. 2024-09-21T12:03:11.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 -- 172.21.15.118:0/3112704814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 msgr2=0x7f728c10b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 --2- 172.21.15.118:0/3112704814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 0x7f728c10b950 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f72780098b0 tx=0x7f727802a560 comp rx=0 tx=0).stop 2024-09-21T12:03:11.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 -- 172.21.15.118:0/3112704814 shutdown_connections 2024-09-21T12:03:11.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 --2- 172.21.15.118:0/3112704814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 0x7f728c10b950 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 --2- 172.21.15.118:0/3112704814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f728c102b40 0x7f728c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 -- 172.21.15.118:0/3112704814 >> 172.21.15.118:0/3112704814 conn(0x7f728c0fc520 msgr2=0x7f728c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 -- 172.21.15.118:0/3112704814 shutdown_connections 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 -- 172.21.15.118:0/3112704814 wait complete. 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 Processor -- start 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.515+0000 7f7292bba640 1 -- start start 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f7292bba640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f728c102b40 0x7f728c1007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f7292bba640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 0x7f728c100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f7292bba640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f728c10edf0 con 0x7f728c103460 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f7292bba640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f728c10ec70 con 0x7f728c102b40 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f728bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 0x7f728c100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f728bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 0x7f728c100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43542/0 (socket says 172.21.15.118:43542) 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f728bfff640 1 -- 172.21.15.118:0/940032214 learned_addr learned my addr 172.21.15.118:0/940032214 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:11.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f7290956640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f728c102b40 0x7f728c1007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:11.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f728bfff640 1 -- 172.21.15.118:0/940032214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f728c102b40 msgr2=0x7f728c1007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f728bfff640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f728c102b40 0x7f728c1007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f728bfff640 1 -- 172.21.15.118:0/940032214 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728c101220 con 0x7f728c103460 2024-09-21T12:03:11.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.516+0000 7f728bfff640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 0x7f728c100ce0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7278031460 tx=0x7f72780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:11.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.519+0000 7f7289ffb640 1 -- 172.21.15.118:0/940032214 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f727803f070 con 0x7f728c103460 2024-09-21T12:03:11.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.519+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728c1014b0 con 0x7f728c103460 2024-09-21T12:03:11.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.519+0000 7f7289ffb640 1 -- 172.21.15.118:0/940032214 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72780044d0 con 0x7f728c103460 2024-09-21T12:03:11.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.519+0000 7f7289ffb640 1 -- 172.21.15.118:0/940032214 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7278035030 con 0x7f728c103460 2024-09-21T12:03:11.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.519+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f728c1a3de0 con 0x7f728c103460 2024-09-21T12:03:11.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.520+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f728c06ab80 con 0x7f728c103460 2024-09-21T12:03:11.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.521+0000 7f7289ffb640 1 -- 172.21.15.118:0/940032214 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7278042070 con 0x7f728c103460 2024-09-21T12:03:11.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.521+0000 7f7289ffb640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f727c07af30 0x7f727c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:11.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.522+0000 7f7290956640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f727c07af30 0x7f727c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:11.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.522+0000 7f7290956640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f727c07af30 0x7f727c07d3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f72800058c0 tx=0x7f728000a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:11.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.523+0000 7f7289ffb640 1 -- 172.21.15.118:0/940032214 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f72780bce50 con 0x7f728c103460 2024-09-21T12:03:11.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.527+0000 7f7289ffb640 1 -- 172.21.15.118:0/940032214 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7278004cf0 con 0x7f728c103460 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: pgmap v730: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"} : dispatch 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:11.606 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:11 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:11.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.710+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f728c062630 con 0x7f727c07af30 2024-09-21T12:03:11.713 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: pgmap v730: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:11.713 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"} : dispatch 2024-09-21T12:03:11.713 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:03:11.713 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:03:11.713 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:11.713 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:03:11.713 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:11.713 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:11.714 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:11.714 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:11 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:11.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.720+0000 7f7289ffb640 1 -- 172.21.15.118:0/940032214 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f728c062630 con 0x7f727c07af30 2024-09-21T12:03:11.722 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:03:11.722 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (21m) 15m ago 32m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:03:11.722 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (24m) 15m ago 32m 9286k - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (23m) 14m ago 31m 8702k - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (19m) 15m ago 32m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (19m) 14m ago 31m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (20m) 15m ago 31m 82.2M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (15m) 15m ago 26m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (15m) 15m ago 26m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (26m) 14m ago 26m 23.8M - 19.1.1-373-g4e45e6b4 164465d2334a da6cd63fd014 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (15m) 14m ago 26m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (23m) 15m ago 33m 528M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (22m) 14m ago 31m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (19m) 15m ago 33m 50.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (19m) 14m ago 31m 38.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (21m) 15m ago 32m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (21m) 14m ago 31m 12.5M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:03:11.723 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (18m) 15m ago 30m 93.6M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:03:11.724 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (18m) 15m ago 29m 93.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:03:11.724 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (17m) 15m ago 29m 80.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:03:11.724 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (16m) 14m ago 28m 101M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:03:11.724 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (16m) 14m ago 28m 86.4M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:03:11.724 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (15m) 14m ago 27m 84.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:03:11.724 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (21m) 15m ago 31m 58.5M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:03:11.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f727c07af30 msgr2=0x7f727c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f727c07af30 0x7f727c07d3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f72800058c0 tx=0x7f728000a2d0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 msgr2=0x7f728c100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 0x7f728c100ce0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7278031460 tx=0x7f72780048f0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 shutdown_connections 2024-09-21T12:03:11.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f727c07af30 0x7f727c07d3f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f728c103460 0x7f728c100ce0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 --2- 172.21.15.118:0/940032214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f728c102b40 0x7f728c1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 >> 172.21.15.118:0/940032214 conn(0x7f728c0fc520 msgr2=0x7f728c103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:11.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 shutdown_connections 2024-09-21T12:03:11.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.722+0000 7f7292bba640 1 -- 172.21.15.118:0/940032214 wait complete. 2024-09-21T12:03:11.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.802+0000 7f86f0ccb640 1 -- 172.21.15.118:0/3543020244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 msgr2=0x7f86ec106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.802+0000 7f86f0ccb640 1 --2- 172.21.15.118:0/3543020244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 0x7f86ec106c00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009880 tx=0x7f86dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.802+0000 7f86f0ccb640 1 -- 172.21.15.118:0/3543020244 shutdown_connections 2024-09-21T12:03:11.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.802+0000 7f86f0ccb640 1 --2- 172.21.15.118:0/3543020244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ec100820 0x7f86ec100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.802+0000 7f86f0ccb640 1 --2- 172.21.15.118:0/3543020244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 0x7f86ec106c00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.802+0000 7f86f0ccb640 1 -- 172.21.15.118:0/3543020244 >> 172.21.15.118:0/3543020244 conn(0x7f86ec0fc520 msgr2=0x7f86ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:11.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.802+0000 7f86f0ccb640 1 -- 172.21.15.118:0/3543020244 shutdown_connections 2024-09-21T12:03:11.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.802+0000 7f86f0ccb640 1 -- 172.21.15.118:0/3543020244 wait complete. 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86f0ccb640 1 Processor -- start 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86f0ccb640 1 -- start start 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86f0ccb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ec100820 0x7f86ec19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86f0ccb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 0x7f86ec19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86f0ccb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec10dcf0 con 0x7f86ec106820 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86f0ccb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec10db70 con 0x7f86ec100820 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86e9d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 0x7f86ec19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86e9d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 0x7f86ec19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43552/0 (socket says 172.21.15.118:43552) 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86e9d9b640 1 -- 172.21.15.118:0/1978820466 learned_addr learned my addr 172.21.15.118:0/1978820466 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.803+0000 7f86ea59c640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ec100820 0x7f86ec19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.804+0000 7f86e9d9b640 1 -- 172.21.15.118:0/1978820466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ec100820 msgr2=0x7f86ec19c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.804+0000 7f86e9d9b640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ec100820 0x7f86ec19c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:11.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.804+0000 7f86e9d9b640 1 -- 172.21.15.118:0/1978820466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ec196700 con 0x7f86ec106820 2024-09-21T12:03:11.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.804+0000 7f86e9d9b640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 0x7f86ec19cb70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f86e000d6f0 tx=0x7f86e000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:11.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.804+0000 7f86db7fe640 1 -- 172.21.15.118:0/1978820466 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86e0017070 con 0x7f86ec106820 2024-09-21T12:03:11.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.804+0000 7f86db7fe640 1 -- 172.21.15.118:0/1978820466 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86e000de00 con 0x7f86ec106820 2024-09-21T12:03:11.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.804+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ec1969f0 con 0x7f86ec106820 2024-09-21T12:03:11.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.804+0000 7f86db7fe640 1 -- 172.21.15.118:0/1978820466 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86e0004bb0 con 0x7f86ec106820 2024-09-21T12:03:11.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.804+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ec196f50 con 0x7f86ec106820 2024-09-21T12:03:11.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.805+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86ec101f60 con 0x7f86ec106820 2024-09-21T12:03:11.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.806+0000 7f86db7fe640 1 -- 172.21.15.118:0/1978820466 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f86e0004e60 con 0x7f86ec106820 2024-09-21T12:03:11.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.806+0000 7f86db7fe640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86d407af30 0x7f86d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:11.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.807+0000 7f86ea59c640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86d407af30 0x7f86d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:11.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.807+0000 7f86db7fe640 1 -- 172.21.15.118:0/1978820466 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f86e009dc50 con 0x7f86ec106820 2024-09-21T12:03:11.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.807+0000 7f86ea59c640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86d407af30 0x7f86d407d3f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0096c0 tx=0x7f86dc031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:11.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:11.811+0000 7f86db7fe640 1 -- 172.21.15.118:0/1978820466 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86e00691a0 con 0x7f86ec106820 2024-09-21T12:03:12.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.058+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f86ec108d90 con 0x7f86ec106820 2024-09-21T12:03:12.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.059+0000 7f86db7fe640 1 -- 172.21.15.118:0/1978820466 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f86e006e050 con 0x7f86ec106820 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:03:12.061 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:03:12.062 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T12:03:12.062 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:03:12.062 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:03:12.062 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:03:12.062 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T12:03:12.062 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:03:12.062 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:03:12.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86d407af30 msgr2=0x7f86d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86d407af30 0x7f86d407d3f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0096c0 tx=0x7f86dc031400 comp rx=0 tx=0).stop 2024-09-21T12:03:12.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 msgr2=0x7f86ec19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 0x7f86ec19cb70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f86e000d6f0 tx=0x7f86e000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 shutdown_connections 2024-09-21T12:03:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86d407af30 0x7f86d407d3f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86ec106820 0x7f86ec19cb70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 --2- 172.21.15.118:0/1978820466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86ec100820 0x7f86ec19c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 >> 172.21.15.118:0/1978820466 conn(0x7f86ec0fc520 msgr2=0x7f86ec0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 shutdown_connections 2024-09-21T12:03:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.061+0000 7f86f0ccb640 1 -- 172.21.15.118:0/1978820466 wait complete. 2024-09-21T12:03:12.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.142+0000 7f658e0cc640 1 -- 172.21.15.118:0/716048440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588107930 msgr2=0x7f6588107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.142+0000 7f658e0cc640 1 --2- 172.21.15.118:0/716048440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588107930 0x7f6588107d10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6578009880 tx=0x7f657802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.142+0000 7f658e0cc640 1 -- 172.21.15.118:0/716048440 shutdown_connections 2024-09-21T12:03:12.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.142+0000 7f658e0cc640 1 --2- 172.21.15.118:0/716048440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6588101930 0x7f6588101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.142+0000 7f658e0cc640 1 --2- 172.21.15.118:0/716048440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588107930 0x7f6588107d10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.142+0000 7f658e0cc640 1 -- 172.21.15.118:0/716048440 >> 172.21.15.118:0/716048440 conn(0x7f65880fd630 msgr2=0x7f65880ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:12.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.142+0000 7f658e0cc640 1 -- 172.21.15.118:0/716048440 shutdown_connections 2024-09-21T12:03:12.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.142+0000 7f658e0cc640 1 -- 172.21.15.118:0/716048440 wait complete. 2024-09-21T12:03:12.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.143+0000 7f658e0cc640 1 Processor -- start 2024-09-21T12:03:12.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.143+0000 7f658e0cc640 1 -- start start 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.143+0000 7f658e0cc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588101930 0x7f65880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.143+0000 7f658e0cc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6588107930 0x7f6588074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.143+0000 7f658e0cc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f658810ede0 con 0x7f6588101930 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.143+0000 7f658e0cc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f658810ec60 con 0x7f6588107930 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.143+0000 7f65877fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588101930 0x7f65880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.143+0000 7f65877fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588101930 0x7f65880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43582/0 (socket says 172.21.15.118:43582) 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.143+0000 7f65877fe640 1 -- 172.21.15.118:0/3559234456 learned_addr learned my addr 172.21.15.118:0/3559234456 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f6586ffd640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6588107930 0x7f6588074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f65877fe640 1 -- 172.21.15.118:0/3559234456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6588107930 msgr2=0x7f6588074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f65877fe640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6588107930 0x7f6588074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f65877fe640 1 -- 172.21.15.118:0/3559234456 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6588074f70 con 0x7f6588101930 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f65877fe640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588101930 0x7f65880744f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6578031460 tx=0x7f65780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:12.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f6584ff9640 1 -- 172.21.15.118:0/3559234456 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f657803f070 con 0x7f6588101930 2024-09-21T12:03:12.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6588075200 con 0x7f6588101930 2024-09-21T12:03:12.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f6584ff9640 1 -- 172.21.15.118:0/3559234456 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65780035f0 con 0x7f6588101930 2024-09-21T12:03:12.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f6584ff9640 1 -- 172.21.15.118:0/3559234456 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6578035030 con 0x7f6588101930 2024-09-21T12:03:12.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.144+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65881a3d90 con 0x7f6588101930 2024-09-21T12:03:12.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.145+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6588103070 con 0x7f6588101930 2024-09-21T12:03:12.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.146+0000 7f6584ff9640 1 -- 172.21.15.118:0/3559234456 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6578042070 con 0x7f6588101930 2024-09-21T12:03:12.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.146+0000 7f6584ff9640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f657007af30 0x7f657007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:12.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.146+0000 7f6586ffd640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f657007af30 0x7f657007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:12.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.146+0000 7f6584ff9640 1 -- 172.21.15.118:0/3559234456 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f65780bea20 con 0x7f6588101930 2024-09-21T12:03:12.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.147+0000 7f6586ffd640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f657007af30 0x7f657007d3f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6588075f80 tx=0x7f657c00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:12.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.151+0000 7f6584ff9640 1 -- 172.21.15.118:0/3559234456 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6578089f70 con 0x7f6588101930 2024-09-21T12:03:12.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.364+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6588104b40 con 0x7f6588101930 2024-09-21T12:03:12.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.364+0000 7f6584ff9640 1 -- 172.21.15.118:0/3559234456 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2000 (secure 0 0 0) 0x7f657808ee20 con 0x7f6588101930 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout:e24 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T11:48:11:576140+0000 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:03:12.367 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:03:12.368 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:03:12.369 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:03:12.370 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:03:12.370 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:03:12.370 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:24301} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/1256053322,v1:172.21.15.149:6827/1256053322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:03:12.370 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:03:12.370 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:03:12.370 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:03:12.370 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.366+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f657007af30 msgr2=0x7f657007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.366+0000 7f658e0cc640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f657007af30 0x7f657007d3f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6588075f80 tx=0x7f657c00b390 comp rx=0 tx=0).stop 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.366+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588101930 msgr2=0x7f65880744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.366+0000 7f658e0cc640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588101930 0x7f65880744f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6578031460 tx=0x7f65780045e0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.366+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 shutdown_connections 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.366+0000 7f658e0cc640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6588107930 0x7f6588074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.366+0000 7f658e0cc640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f657007af30 0x7f657007d3f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.366+0000 7f658e0cc640 1 --2- 172.21.15.118:0/3559234456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6588101930 0x7f65880744f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.366+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 >> 172.21.15.118:0/3559234456 conn(0x7f65880fd630 msgr2=0x7f65880fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.367+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 shutdown_connections 2024-09-21T12:03:12.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.367+0000 7f658e0cc640 1 -- 172.21.15.118:0/3559234456 wait complete. 2024-09-21T12:03:12.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.449+0000 7feedf2e4640 1 -- 172.21.15.118:0/3640045414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8100820 msgr2=0x7feed8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.449+0000 7feedf2e4640 1 --2- 172.21.15.118:0/3640045414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8100820 0x7feed8100c80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7feed4009880 tx=0x7feed402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.449+0000 7feedf2e4640 1 -- 172.21.15.118:0/3640045414 shutdown_connections 2024-09-21T12:03:12.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.449+0000 7feedf2e4640 1 --2- 172.21.15.118:0/3640045414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8100820 0x7feed8100c80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.449+0000 7feedf2e4640 1 --2- 172.21.15.118:0/3640045414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feed8106820 0x7feed8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.449+0000 7feedf2e4640 1 -- 172.21.15.118:0/3640045414 >> 172.21.15.118:0/3640045414 conn(0x7feed80fc520 msgr2=0x7feed80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:12.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.449+0000 7feedf2e4640 1 -- 172.21.15.118:0/3640045414 shutdown_connections 2024-09-21T12:03:12.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.449+0000 7feedf2e4640 1 -- 172.21.15.118:0/3640045414 wait complete. 2024-09-21T12:03:12.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedf2e4640 1 Processor -- start 2024-09-21T12:03:12.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedf2e4640 1 -- start start 2024-09-21T12:03:12.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedf2e4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feed8100820 0x7feed8198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:12.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedf2e4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8106820 0x7feed8198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:12.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedf2e4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7feed810dcf0 con 0x7feed8106820 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedf2e4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feed810db70 con 0x7feed8100820 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedc87f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8106820 0x7feed8198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedc87f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8106820 0x7feed8198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43602/0 (socket says 172.21.15.118:43602) 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedc87f640 1 -- 172.21.15.118:0/3351762108 learned_addr learned my addr 172.21.15.118:0/3351762108 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.450+0000 7feedd080640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feed8100820 0x7feed8198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.451+0000 7feedc87f640 1 -- 172.21.15.118:0/3351762108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feed8100820 msgr2=0x7feed8198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.451+0000 7feedc87f640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feed8100820 0x7feed8198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.451+0000 7feedc87f640 1 -- 172.21.15.118:0/3351762108 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed8199380 con 0x7feed8106820 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.451+0000 7feedc87f640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8106820 0x7feed8198d80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feed4031460 tx=0x7feed40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.451+0000 7feeca7fc640 1 -- 172.21.15.118:0/3351762108 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feed403f070 con 0x7feed8106820 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.451+0000 7feeca7fc640 1 -- 172.21.15.118:0/3351762108 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feed40035f0 con 0x7feed8106820 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.451+0000 7feeca7fc640 1 -- 172.21.15.118:0/3351762108 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feed4035030 con 0x7feed8106820 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.451+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed8199610 con 0x7feed8106820 2024-09-21T12:03:12.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.451+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed81a1bc0 con 0x7feed8106820 2024-09-21T12:03:12.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.452+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed8101f60 con 0x7feed8106820 2024-09-21T12:03:12.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.453+0000 7feeca7fc640 1 -- 172.21.15.118:0/3351762108 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7feed4042070 con 0x7feed8106820 2024-09-21T12:03:12.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.453+0000 7feeca7fc640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feec407af80 0x7feec407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:12.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.453+0000 7feeca7fc640 1 -- 172.21.15.118:0/3351762108 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7feed40be910 con 0x7feed8106820 2024-09-21T12:03:12.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.453+0000 7feedd080640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feec407af80 0x7feec407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:12.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.454+0000 7feedd080640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feec407af80 0x7feec407d440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feecc005fd0 tx=0x7feecc00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:12.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.457+0000 7feeca7fc640 1 -- 172.21.15.118:0/3351762108 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feed4089ee0 con 0x7feed8106820 2024-09-21T12:03:12.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.655+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feed8062630 con 0x7feec407af80 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: pgmap v731: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: from='client.35144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1978820466' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3559234456' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.qzbfns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:03:12.658 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:12 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:03:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.657+0000 7feeca7fc640 1 -- 172.21.15.118:0/3351762108 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7feed8062630 con 0x7feec407af80 2024-09-21T12:03:12.659 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:03:12.659 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:03:12.659 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:03:12.659 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:03:12.659 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:03:12.659 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:03:12.659 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:03:12.660 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:03:12.660 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:03:12.660 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:03:12.660 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T12:03:12.660 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:03:12.660 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:03:12.660 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:03:12.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feec407af80 msgr2=0x7feec407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feec407af80 0x7feec407d440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feecc005fd0 tx=0x7feecc00b390 comp rx=0 tx=0).stop 2024-09-21T12:03:12.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8106820 msgr2=0x7feed8198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8106820 0x7feed8198d80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feed4031460 tx=0x7feed40045e0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 shutdown_connections 2024-09-21T12:03:12.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feec407af80 0x7feec407d440 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feed8106820 0x7feed8198d80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 --2- 172.21.15.118:0/3351762108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feed8100820 0x7feed8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 >> 172.21.15.118:0/3351762108 conn(0x7feed80fc520 msgr2=0x7feed80fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:12.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 shutdown_connections 2024-09-21T12:03:12.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.659+0000 7feedf2e4640 1 -- 172.21.15.118:0/3351762108 wait complete. 2024-09-21T12:03:12.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 -- 172.21.15.118:0/4163716089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac106820 msgr2=0x7febac106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 --2- 172.21.15.118:0/4163716089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac106820 0x7febac106c00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009880 tx=0x7feb9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 -- 172.21.15.118:0/4163716089 shutdown_connections 2024-09-21T12:03:12.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 --2- 172.21.15.118:0/4163716089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febac100820 0x7febac100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 --2- 172.21.15.118:0/4163716089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac106820 0x7febac106c00 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 -- 172.21.15.118:0/4163716089 >> 172.21.15.118:0/4163716089 conn(0x7febac0fc520 msgr2=0x7febac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:12.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 -- 172.21.15.118:0/4163716089 shutdown_connections 2024-09-21T12:03:12.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 -- 172.21.15.118:0/4163716089 wait complete. 2024-09-21T12:03:12.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 Processor -- start 2024-09-21T12:03:12.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.741+0000 7febb09ac640 1 -- start start 2024-09-21T12:03:12.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febb09ac640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac100820 0x7febac1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:12.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febb09ac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febac106820 0x7febac198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:12.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febb09ac640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7febac10dcd0 con 0x7febac100820 2024-09-21T12:03:12.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febb09ac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7febac10db50 con 0x7febac106820 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febaa59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac100820 0x7febac1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febaa59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac100820 0x7febac1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43606/0 (socket says 172.21.15.118:43606) 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febaa59c640 1 -- 172.21.15.118:0/3582542591 learned_addr learned my addr 172.21.15.118:0/3582542591 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7feba9d9b640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febac106820 0x7febac198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febaa59c640 1 -- 172.21.15.118:0/3582542591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febac106820 msgr2=0x7febac198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febaa59c640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febac106820 0x7febac198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febaa59c640 1 -- 172.21.15.118:0/3582542591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac199320 con 0x7febac100820 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7febaa59c640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac100820 0x7febac1987e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7feb9c031460 tx=0x7feb9c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.742+0000 7feba37fe640 1 -- 172.21.15.118:0/3582542591 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb9c03f070 con 0x7febac100820 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.743+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febac1995b0 con 0x7febac100820 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.743+0000 7feba37fe640 1 -- 172.21.15.118:0/3582542591 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb9c004cf0 con 0x7febac100820 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.743+0000 7feba37fe640 1 -- 172.21.15.118:0/3582542591 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb9c035030 con 0x7febac100820 2024-09-21T12:03:12.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.743+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febac1a1b60 con 0x7febac100820 2024-09-21T12:03:12.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.743+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febac101f60 con 0x7febac100820 2024-09-21T12:03:12.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.744+0000 7feba37fe640 1 -- 172.21.15.118:0/3582542591 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7feb9c042070 con 0x7febac100820 2024-09-21T12:03:12.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.745+0000 7feba37fe640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb9807af30 0x7feb9807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:12.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.745+0000 7feba37fe640 1 -- 172.21.15.118:0/3582542591 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7feb9c0beac0 con 0x7febac100820 2024-09-21T12:03:12.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.745+0000 7feba9d9b640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb9807af30 0x7feb9807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:12.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.745+0000 7feba9d9b640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb9807af30 0x7feb9807d3f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7febac06ae50 tx=0x7feb9400a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:12.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.749+0000 7feba37fe640 1 -- 172.21.15.118:0/3582542591 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb9c08a010 con 0x7febac100820 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: pgmap v731: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: from='client.35144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1978820466' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3559234456' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.qzbfns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:03:12.850 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:12 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:03:13.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.998+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7febac103a30 con 0x7febac100820 2024-09-21T12:03:13.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:12.998+0000 7feba37fe640 1 -- 172.21.15.118:0/3582542591 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7feb9c08eec0 con 0x7febac100820 2024-09-21T12:03:13.002 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:03:13.002 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:03:13.002 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:03:13.002 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:03:13.002 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:03:13.002 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:03:13.002 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:03:13.002 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:03:13.003 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:03:13.004 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:03:13.004 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:03:13.004 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:03:13.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb9807af30 msgr2=0x7feb9807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:13.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb9807af30 0x7feb9807d3f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7febac06ae50 tx=0x7feb9400a2d0 comp rx=0 tx=0).stop 2024-09-21T12:03:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac100820 msgr2=0x7febac1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac100820 0x7febac1987e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7feb9c031460 tx=0x7feb9c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:03:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 shutdown_connections 2024-09-21T12:03:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febac106820 0x7febac198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb9807af30 0x7feb9807d3f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 --2- 172.21.15.118:0/3582542591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febac100820 0x7febac1987e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 >> 172.21.15.118:0/3582542591 conn(0x7febac0fc520 msgr2=0x7febac0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 shutdown_connections 2024-09-21T12:03:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:13.000+0000 7febb09ac640 1 -- 172.21.15.118:0/3582542591 wait complete. 2024-09-21T12:03:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:13 smithi118 ceph-mon[111738]: Upgrade: Updating mds.cephfs.smithi149.qzbfns 2024-09-21T12:03:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:13 smithi118 ceph-mon[111738]: Deploying daemon mds.cephfs.smithi149.qzbfns on smithi149 2024-09-21T12:03:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:13 smithi118 ceph-mon[111738]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:13.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:13 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3582542591' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:03:13.909 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:13 smithi149 ceph-mon[79770]: Upgrade: Updating mds.cephfs.smithi149.qzbfns 2024-09-21T12:03:13.909 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:13 smithi149 ceph-mon[79770]: Deploying daemon mds.cephfs.smithi149.qzbfns on smithi149 2024-09-21T12:03:13.909 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:13 smithi149 ceph-mon[79770]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:13.909 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:13 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3582542591' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:03:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:14 smithi149 ceph-mon[79770]: pgmap v732: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:14.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:14 smithi118 ceph-mon[111738]: pgmap v732: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:15.789 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:15 smithi118 ceph-mon[111738]: osdmap e82: 6 total, 6 up, 6 in 2024-09-21T12:03:15.790 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:15 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:03:15.790 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:15 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"} : dispatch 2024-09-21T12:03:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:15 smithi149 ceph-mon[79770]: osdmap e82: 6 total, 6 up, 6 in 2024-09-21T12:03:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:15 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:03:15.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:15 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"} : dispatch 2024-09-21T12:03:16.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:16 smithi118 ceph-mon[111738]: pgmap v734: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:16.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:16 smithi149 ceph-mon[79770]: pgmap v734: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: pgmap v735: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] up:boot 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"} : dispatch 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.633 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: pgmap v735: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:18.633 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.634 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.634 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:03:18.634 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] up:boot 2024-09-21T12:03:18.634 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:03:18.634 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "mds metadata", "who": "cephfs.smithi149.qzbfns"} : dispatch 2024-09-21T12:03:18.634 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.634 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.634 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:18.634 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:20 smithi149 ceph-mon[79770]: pgmap v736: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:03:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:20.723 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:20 smithi118 ceph-mon[111738]: pgmap v736: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:20.723 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:20.723 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:03:20.723 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:20.723 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:22.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:21 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:22.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:21 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:22.176 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:21 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:22.176 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:21 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:23.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:22 smithi118 ceph-mon[111738]: pgmap v737: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:23.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:22 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:23.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:22 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:23.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:22 smithi149 ceph-mon[79770]: pgmap v737: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:23.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:22 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:23.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:22 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:03:25.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:24 smithi118 ceph-mon[111738]: pgmap v738: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:25.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:24 smithi149 ceph-mon[79770]: pgmap v738: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:27.076 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:26 smithi149 ceph-mon[79770]: pgmap v739: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:26 smithi118 ceph-mon[111738]: pgmap v739: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:29.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:28 smithi149 ceph-mon[79770]: pgmap v740: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:29.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:28 smithi118 ceph-mon[111738]: pgmap v740: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:31.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:30 smithi149 ceph-mon[79770]: pgmap v741: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:31.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:30 smithi118 ceph-mon[111738]: pgmap v741: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:33.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:32 smithi149 ceph-mon[79770]: pgmap v742: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:33.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:32 smithi118 ceph-mon[111738]: pgmap v742: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:35.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:34 smithi149 ceph-mon[79770]: pgmap v743: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:34 smithi118 ceph-mon[111738]: pgmap v743: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:03:36.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:03:37.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:36 smithi149 ceph-mon[79770]: pgmap v744: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:37.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:36 smithi118 ceph-mon[111738]: pgmap v744: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:39.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:38 smithi149 ceph-mon[79770]: pgmap v745: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:39.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:38 smithi118 ceph-mon[111738]: pgmap v745: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:41.161 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:40 smithi118 ceph-mon[111738]: pgmap v746: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:41.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:40 smithi149 ceph-mon[79770]: pgmap v746: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:43.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.097+0000 7fd31c66e640 1 -- 172.21.15.118:0/3850315784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314100820 msgr2=0x7fd314100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.097+0000 7fd31c66e640 1 --2- 172.21.15.118:0/3850315784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314100820 0x7fd314100c80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd304009880 tx=0x7fd30402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.097+0000 7fd31c66e640 1 -- 172.21.15.118:0/3850315784 shutdown_connections 2024-09-21T12:03:43.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.097+0000 7fd31c66e640 1 --2- 172.21.15.118:0/3850315784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314100820 0x7fd314100c80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.097+0000 7fd31c66e640 1 --2- 172.21.15.118:0/3850315784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314106820 0x7fd314106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.097+0000 7fd31c66e640 1 -- 172.21.15.118:0/3850315784 >> 172.21.15.118:0/3850315784 conn(0x7fd3140fc520 msgr2=0x7fd3140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.097+0000 7fd31c66e640 1 -- 172.21.15.118:0/3850315784 shutdown_connections 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.097+0000 7fd31c66e640 1 -- 172.21.15.118:0/3850315784 wait complete. 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.097+0000 7fd31c66e640 1 Processor -- start 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd31c66e640 1 -- start start 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd31c66e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100820 0x7fd3140fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd31c66e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314106820 0x7fd3140fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd31c66e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd31410dcf0 con 0x7fd314106820 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd31c66e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd31410db70 con 0x7fd314100820 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd319c09640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314106820 0x7fd3140fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd319c09640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314106820 0x7fd3140fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43458/0 (socket says 172.21.15.118:43458) 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd319c09640 1 -- 172.21.15.118:0/547878906 learned_addr learned my addr 172.21.15.118:0/547878906 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:43.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd31a40a640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100820 0x7fd3140fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd319c09640 1 -- 172.21.15.118:0/547878906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100820 msgr2=0x7fd3140fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd319c09640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100820 0x7fd3140fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd319c09640 1 -- 172.21.15.118:0/547878906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3140fd6c0 con 0x7fd314106820 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd31a40a640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100820 0x7fd3140fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.098+0000 7fd319c09640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314106820 0x7fd3140fd180 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd304031460 tx=0x7fd304004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.099+0000 7fd30b7fe640 1 -- 172.21.15.118:0/547878906 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd30403f070 con 0x7fd314106820 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.099+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3140fd950 con 0x7fd314106820 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.099+0000 7fd30b7fe640 1 -- 172.21.15.118:0/547878906 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3040035f0 con 0x7fd314106820 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.099+0000 7fd30b7fe640 1 -- 172.21.15.118:0/547878906 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd304035030 con 0x7fd314106820 2024-09-21T12:03:43.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.099+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3141a3dd0 con 0x7fd314106820 2024-09-21T12:03:43.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.100+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd314101f60 con 0x7fd314106820 2024-09-21T12:03:43.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.101+0000 7fd30b7fe640 1 -- 172.21.15.118:0/547878906 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd304042070 con 0x7fd314106820 2024-09-21T12:03:43.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.101+0000 7fd30b7fe640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd30007af30 0x7fd30007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.101+0000 7fd30b7fe640 1 -- 172.21.15.118:0/547878906 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd3040bea60 con 0x7fd314106820 2024-09-21T12:03:43.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.101+0000 7fd31a40a640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd30007af30 0x7fd30007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.102+0000 7fd31a40a640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd30007af30 0x7fd30007d3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd310009c20 tx=0x7fd310005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:43.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.106+0000 7fd30b7fe640 1 -- 172.21.15.118:0/547878906 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd304089fb0 con 0x7fd314106820 2024-09-21T12:03:43.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:42 smithi149 ceph-mon[79770]: pgmap v747: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:43.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.299+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd314062630 con 0x7fd30007af30 2024-09-21T12:03:43.301 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:42 smithi118 ceph-mon[111738]: pgmap v747: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:43.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.300+0000 7fd30b7fe640 1 -- 172.21.15.118:0/547878906 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd314062630 con 0x7fd30007af30 2024-09-21T12:03:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.302+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd30007af30 msgr2=0x7fd30007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.302+0000 7fd31c66e640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd30007af30 0x7fd30007d3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd310009c20 tx=0x7fd310005f90 comp rx=0 tx=0).stop 2024-09-21T12:03:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.302+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314106820 msgr2=0x7fd3140fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.302+0000 7fd31c66e640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314106820 0x7fd3140fd180 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd304031460 tx=0x7fd304004530 comp rx=0 tx=0).stop 2024-09-21T12:03:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.303+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 shutdown_connections 2024-09-21T12:03:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.303+0000 7fd31c66e640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd30007af30 0x7fd30007d3f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.303+0000 7fd31c66e640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd314106820 0x7fd3140fd180 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.303+0000 7fd31c66e640 1 --2- 172.21.15.118:0/547878906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100820 0x7fd3140fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.303+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 >> 172.21.15.118:0/547878906 conn(0x7fd3140fc520 msgr2=0x7fd31406a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:43.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.303+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 shutdown_connections 2024-09-21T12:03:43.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.303+0000 7fd31c66e640 1 -- 172.21.15.118:0/547878906 wait complete. 2024-09-21T12:03:43.313 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.386+0000 7f690ec86640 1 -- 172.21.15.118:0/3459494231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 msgr2=0x7f6908107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.386+0000 7f690ec86640 1 --2- 172.21.15.118:0/3459494231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 0x7f6908107d10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6904009880 tx=0x7f690402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.386+0000 7f690ec86640 1 -- 172.21.15.118:0/3459494231 shutdown_connections 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.386+0000 7f690ec86640 1 --2- 172.21.15.118:0/3459494231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6908101930 0x7f6908101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.386+0000 7f690ec86640 1 --2- 172.21.15.118:0/3459494231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 0x7f6908107d10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.386+0000 7f690ec86640 1 -- 172.21.15.118:0/3459494231 >> 172.21.15.118:0/3459494231 conn(0x7f69080fd630 msgr2=0x7f69080ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.386+0000 7f690ec86640 1 -- 172.21.15.118:0/3459494231 shutdown_connections 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.386+0000 7f690ec86640 1 -- 172.21.15.118:0/3459494231 wait complete. 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f690ec86640 1 Processor -- start 2024-09-21T12:03:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f690ec86640 1 -- start start 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f690ec86640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6908101930 0x7f690819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f690ec86640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 0x7f690819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f690ec86640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f690810ee00 con 0x7f6908107930 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f690ec86640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f690810ec80 con 0x7f6908101930 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f68fffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 0x7f690819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f68fffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 0x7f690819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43466/0 (socket says 172.21.15.118:43466) 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f68fffff640 1 -- 172.21.15.118:0/3725787851 learned_addr learned my addr 172.21.15.118:0/3725787851 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f68fffff640 1 -- 172.21.15.118:0/3725787851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6908101930 msgr2=0x7f690819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f690ca22640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6908101930 0x7f690819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f68fffff640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6908101930 0x7f690819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.387+0000 7f68fffff640 1 -- 172.21.15.118:0/3725787851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69081977f0 con 0x7f6908107930 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.388+0000 7f68fffff640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 0x7f690819dbb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f68f800d6f0 tx=0x7f68f800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:43.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.388+0000 7f68fdffb640 1 -- 172.21.15.118:0/3725787851 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68f8017070 con 0x7f6908107930 2024-09-21T12:03:43.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.388+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6908197ae0 con 0x7f6908107930 2024-09-21T12:03:43.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.388+0000 7f68fdffb640 1 -- 172.21.15.118:0/3725787851 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68f800de00 con 0x7f6908107930 2024-09-21T12:03:43.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.388+0000 7f68fdffb640 1 -- 172.21.15.118:0/3725787851 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68f8004bb0 con 0x7f6908107930 2024-09-21T12:03:43.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.388+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6908198070 con 0x7f6908107930 2024-09-21T12:03:43.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.389+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6908103070 con 0x7f6908107930 2024-09-21T12:03:43.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.389+0000 7f68fdffb640 1 -- 172.21.15.118:0/3725787851 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f68f8004e60 con 0x7f6908107930 2024-09-21T12:03:43.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.390+0000 7f68fdffb640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f68f007af30 0x7f68f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.390+0000 7f68fdffb640 1 -- 172.21.15.118:0/3725787851 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f68f809dd00 con 0x7f6908107930 2024-09-21T12:03:43.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.390+0000 7f690ca22640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f68f007af30 0x7f68f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.390+0000 7f690ca22640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f68f007af30 0x7f68f007d3f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6904031460 tx=0x7f6904009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:43.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.394+0000 7f68fdffb640 1 -- 172.21.15.118:0/3725787851 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68f80a1030 con 0x7f6908107930 2024-09-21T12:03:43.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.590+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6908198320 con 0x7f68f007af30 2024-09-21T12:03:43.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.591+0000 7f68fdffb640 1 -- 172.21.15.118:0/3725787851 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6908198320 con 0x7f68f007af30 2024-09-21T12:03:43.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.593+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f68f007af30 msgr2=0x7f68f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.593+0000 7f690ec86640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f68f007af30 0x7f68f007d3f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6904031460 tx=0x7f6904009560 comp rx=0 tx=0).stop 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.593+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 msgr2=0x7f690819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.593+0000 7f690ec86640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 0x7f690819dbb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f68f800d6f0 tx=0x7f68f800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.593+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 shutdown_connections 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.593+0000 7f690ec86640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f68f007af30 0x7f68f007d3f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.593+0000 7f690ec86640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6908107930 0x7f690819dbb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.593+0000 7f690ec86640 1 --2- 172.21.15.118:0/3725787851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6908101930 0x7f690819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.593+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 >> 172.21.15.118:0/3725787851 conn(0x7f69080fd630 msgr2=0x7f69080fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.594+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 shutdown_connections 2024-09-21T12:03:43.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.594+0000 7f690ec86640 1 -- 172.21.15.118:0/3725787851 wait complete. 2024-09-21T12:03:43.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.674+0000 7f905c173640 1 -- 172.21.15.118:0/1964095157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541007e0 msgr2=0x7f9054100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.674+0000 7f905c173640 1 --2- 172.21.15.118:0/1964095157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541007e0 0x7f9054100c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9044009880 tx=0x7f904402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.674+0000 7f905c173640 1 -- 172.21.15.118:0/1964095157 shutdown_connections 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.674+0000 7f905c173640 1 --2- 172.21.15.118:0/1964095157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541007e0 0x7f9054100c40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.674+0000 7f905c173640 1 --2- 172.21.15.118:0/1964095157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90541067e0 0x7f9054106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.674+0000 7f905c173640 1 -- 172.21.15.118:0/1964095157 >> 172.21.15.118:0/1964095157 conn(0x7f90540fc4c0 msgr2=0x7f90540fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.675+0000 7f905c173640 1 -- 172.21.15.118:0/1964095157 shutdown_connections 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.675+0000 7f905c173640 1 -- 172.21.15.118:0/1964095157 wait complete. 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.675+0000 7f905c173640 1 Processor -- start 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.675+0000 7f905c173640 1 -- start start 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.675+0000 7f905c173640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90541007e0 0x7f905419f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.675+0000 7f905c173640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541067e0 0x7f905419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.675+0000 7f905c173640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f905410dc90 con 0x7f90541067e0 2024-09-21T12:03:43.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.675+0000 7f905c173640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f905410db10 con 0x7f90541007e0 2024-09-21T12:03:43.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.675+0000 7f905970e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541067e0 0x7f905419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f905970e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541067e0 0x7f905419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43482/0 (socket says 172.21.15.118:43482) 2024-09-21T12:03:43.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f905970e640 1 -- 172.21.15.118:0/1417067347 learned_addr learned my addr 172.21.15.118:0/1417067347 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:43.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f9059f0f640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90541007e0 0x7f905419f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f905970e640 1 -- 172.21.15.118:0/1417067347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90541007e0 msgr2=0x7f905419f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f905970e640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90541007e0 0x7f905419f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f905970e640 1 -- 172.21.15.118:0/1417067347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90541999a0 con 0x7f90541067e0 2024-09-21T12:03:43.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f9059f0f640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90541007e0 0x7f905419f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:03:43.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f905970e640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541067e0 0x7f905419fd20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9044031460 tx=0x7f90440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:43.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f904affd640 1 -- 172.21.15.118:0/1417067347 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f904403f070 con 0x7f90541067e0 2024-09-21T12:03:43.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f904affd640 1 -- 172.21.15.118:0/1417067347 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9044004cf0 con 0x7f90541067e0 2024-09-21T12:03:43.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9054199c30 con 0x7f90541067e0 2024-09-21T12:03:43.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f904affd640 1 -- 172.21.15.118:0/1417067347 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9044035030 con 0x7f90541067e0 2024-09-21T12:03:43.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.676+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905419a160 con 0x7f90541067e0 2024-09-21T12:03:43.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.677+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9054101f20 con 0x7f90541067e0 2024-09-21T12:03:43.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.678+0000 7f904affd640 1 -- 172.21.15.118:0/1417067347 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9044042070 con 0x7f90541067e0 2024-09-21T12:03:43.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.678+0000 7f904affd640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f904007af80 0x7f904007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.679+0000 7f904affd640 1 -- 172.21.15.118:0/1417067347 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f90440bea90 con 0x7f90541067e0 2024-09-21T12:03:43.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.679+0000 7f9059f0f640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f904007af80 0x7f904007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.679+0000 7f9059f0f640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f904007af80 0x7f904007d440 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f90500058c0 tx=0x7f9050005d50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:43.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.683+0000 7f904affd640 1 -- 172.21.15.118:0/1417067347 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f904408a060 con 0x7f90541067e0 2024-09-21T12:03:43.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.868+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f905419a410 con 0x7f904007af80 2024-09-21T12:03:43.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.878+0000 7f904affd640 1 -- 172.21.15.118:0/1417067347 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f905419a410 con 0x7f904007af80 2024-09-21T12:03:43.879 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:03:43.879 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (21m) 21s ago 32m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:03:43.879 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (24m) 21s ago 32m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:03:43.879 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (24m) 23s ago 31m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:03:43.879 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (19m) 21s ago 32m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (19m) 23s ago 31m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (21m) 21s ago 32m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (16m) 21s ago 27m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (15m) 21s ago 27m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (27s) 23s ago 27m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (15m) 23s ago 27m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (23m) 21s ago 34m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (22m) 23s ago 31m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (20m) 21s ago 34m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (20m) 23s ago 31m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (22m) 21s ago 32m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (22m) 23s ago 31m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (19m) 21s ago 30m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:03:43.880 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (18m) 21s ago 30m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:03:43.881 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (18m) 21s ago 29m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:03:43.881 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (17m) 23s ago 29m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:03:43.881 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (16m) 23s ago 28m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:03:43.881 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (16m) 23s ago 28m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:03:43.881 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (21m) 21s ago 32m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:03:43.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f904007af80 msgr2=0x7f904007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f904007af80 0x7f904007d440 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f90500058c0 tx=0x7f9050005d50 comp rx=0 tx=0).stop 2024-09-21T12:03:43.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541067e0 msgr2=0x7f905419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541067e0 0x7f905419fd20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9044031460 tx=0x7f90440048f0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 shutdown_connections 2024-09-21T12:03:43.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f904007af80 0x7f904007d440 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90541067e0 0x7f905419fd20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 --2- 172.21.15.118:0/1417067347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90541007e0 0x7f905419f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 >> 172.21.15.118:0/1417067347 conn(0x7f90540fc4c0 msgr2=0x7f90540fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:43.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 shutdown_connections 2024-09-21T12:03:43.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.880+0000 7f905c173640 1 -- 172.21.15.118:0/1417067347 wait complete. 2024-09-21T12:03:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/2227544756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381007e0 msgr2=0x7f1a38100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 --2- 172.21.15.118:0/2227544756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381007e0 0x7f1a38100c40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009880 tx=0x7f1a2002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/2227544756 shutdown_connections 2024-09-21T12:03:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 --2- 172.21.15.118:0/2227544756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381007e0 0x7f1a38100c40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 --2- 172.21.15.118:0/2227544756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a381067e0 0x7f1a38106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/2227544756 >> 172.21.15.118:0/2227544756 conn(0x7f1a380fc4c0 msgr2=0x7f1a380fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/2227544756 shutdown_connections 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/2227544756 wait complete. 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 Processor -- start 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.961+0000 7f1a3e8ed640 1 -- start start 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a3e8ed640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a381007e0 0x7f1a3819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a3e8ed640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381067e0 0x7f1a3819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a3e8ed640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3810dcb0 con 0x7f1a381067e0 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a3e8ed640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3810db30 con 0x7f1a381007e0 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381067e0 0x7f1a3819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381067e0 0x7f1a3819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43498/0 (socket says 172.21.15.118:43498) 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a377fe640 1 -- 172.21.15.118:0/1657856133 learned_addr learned my addr 172.21.15.118:0/1657856133 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a37fff640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a381007e0 0x7f1a3819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a377fe640 1 -- 172.21.15.118:0/1657856133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a381007e0 msgr2=0x7f1a3819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a377fe640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a381007e0 0x7f1a3819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a377fe640 1 -- 172.21.15.118:0/1657856133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a381977e0 con 0x7f1a381067e0 2024-09-21T12:03:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a377fe640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381067e0 0x7f1a3819dba0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1a20031460 tx=0x7f1a200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a357fa640 1 -- 172.21.15.118:0/1657856133 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a2003f070 con 0x7f1a381067e0 2024-09-21T12:03:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a357fa640 1 -- 172.21.15.118:0/1657856133 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a200035f0 con 0x7f1a381067e0 2024-09-21T12:03:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.962+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a38197a70 con 0x7f1a381067e0 2024-09-21T12:03:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.963+0000 7f1a357fa640 1 -- 172.21.15.118:0/1657856133 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a20035030 con 0x7f1a381067e0 2024-09-21T12:03:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.963+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a38197fa0 con 0x7f1a381067e0 2024-09-21T12:03:43.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.964+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a38101f20 con 0x7f1a381067e0 2024-09-21T12:03:43.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.964+0000 7f1a357fa640 1 -- 172.21.15.118:0/1657856133 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1a20042070 con 0x7f1a381067e0 2024-09-21T12:03:43.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.965+0000 7f1a357fa640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a2407af80 0x7f1a2407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:43.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.965+0000 7f1a357fa640 1 -- 172.21.15.118:0/1657856133 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1a200be910 con 0x7f1a381067e0 2024-09-21T12:03:43.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.965+0000 7f1a37fff640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a2407af80 0x7f1a2407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:43.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.965+0000 7f1a37fff640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a2407af80 0x7f1a2407d440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a28005fd0 tx=0x7f1a2800b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:43.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:43.969+0000 7f1a357fa640 1 -- 172.21.15.118:0/1657856133 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a20089ee0 con 0x7f1a381067e0 2024-09-21T12:03:44.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.221+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1a38198250 con 0x7f1a381067e0 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.222+0000 7f1a357fa640 1 -- 172.21.15.118:0/1657856133 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f1a2008ed90 con 0x7f1a381067e0 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:03:44.223 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:03:44.224 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:03:44.224 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:03:44.224 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:03:44.224 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:03:44.224 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:03:44.224 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:03:44.224 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a2407af80 msgr2=0x7f1a2407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a2407af80 0x7f1a2407d440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a28005fd0 tx=0x7f1a2800b390 comp rx=0 tx=0).stop 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381067e0 msgr2=0x7f1a3819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381067e0 0x7f1a3819dba0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1a20031460 tx=0x7f1a200045e0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 shutdown_connections 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a2407af80 0x7f1a2407d440 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a381067e0 0x7f1a3819dba0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 --2- 172.21.15.118:0/1657856133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a381007e0 0x7f1a3819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 >> 172.21.15.118:0/1657856133 conn(0x7f1a380fc4c0 msgr2=0x7f1a38104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 shutdown_connections 2024-09-21T12:03:44.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.224+0000 7f1a3e8ed640 1 -- 172.21.15.118:0/1657856133 wait complete. 2024-09-21T12:03:44.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.305+0000 7f13c1228640 1 -- 172.21.15.118:0/2806076506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc103460 msgr2=0x7f13bc10b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.305+0000 7f13c1228640 1 --2- 172.21.15.118:0/2806076506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc103460 0x7f13bc10b950 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0098b0 tx=0x7f13ac02a560 comp rx=0 tx=0).stop 2024-09-21T12:03:44.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.305+0000 7f13c1228640 1 -- 172.21.15.118:0/2806076506 shutdown_connections 2024-09-21T12:03:44.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.305+0000 7f13c1228640 1 --2- 172.21.15.118:0/2806076506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc103460 0x7f13bc10b950 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.305+0000 7f13c1228640 1 --2- 172.21.15.118:0/2806076506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13bc102b40 0x7f13bc102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.305+0000 7f13c1228640 1 -- 172.21.15.118:0/2806076506 >> 172.21.15.118:0/2806076506 conn(0x7f13bc0fc520 msgr2=0x7f13bc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:44.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.305+0000 7f13c1228640 1 -- 172.21.15.118:0/2806076506 shutdown_connections 2024-09-21T12:03:44.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.305+0000 7f13c1228640 1 -- 172.21.15.118:0/2806076506 wait complete. 2024-09-21T12:03:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.305+0000 7f13c1228640 1 Processor -- start 2024-09-21T12:03:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13c1228640 1 -- start start 2024-09-21T12:03:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13c1228640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc102b40 0x7f13bc19f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13c1228640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13bc103460 0x7f13bc19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13c1228640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc10ee70 con 0x7f13bc102b40 2024-09-21T12:03:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13c1228640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc10ecf0 con 0x7f13bc103460 2024-09-21T12:03:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13bad9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc102b40 0x7f13bc19f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13bad9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc102b40 0x7f13bc19f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43518/0 (socket says 172.21.15.118:43518) 2024-09-21T12:03:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13bad9d640 1 -- 172.21.15.118:0/232754046 learned_addr learned my addr 172.21.15.118:0/232754046 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13ba59c640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13bc103460 0x7f13bc19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13bad9d640 1 -- 172.21.15.118:0/232754046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13bc103460 msgr2=0x7f13bc19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13bad9d640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13bc103460 0x7f13bc19fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13bad9d640 1 -- 172.21.15.118:0/232754046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc199aa0 con 0x7f13bc102b40 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13ba59c640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13bc103460 0x7f13bc19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.306+0000 7f13bad9d640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc102b40 0x7f13bc19f8e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f13b000b420 tx=0x7f13b000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.307+0000 7f13a3fff640 1 -- 172.21.15.118:0/232754046 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13b0011630 con 0x7f13bc102b40 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.307+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc199d90 con 0x7f13bc102b40 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.307+0000 7f13a3fff640 1 -- 172.21.15.118:0/232754046 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13b0016070 con 0x7f13bc102b40 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.307+0000 7f13a3fff640 1 -- 172.21.15.118:0/232754046 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13b0010d40 con 0x7f13bc102b40 2024-09-21T12:03:44.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.307+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc19a320 con 0x7f13bc102b40 2024-09-21T12:03:44.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.308+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc06ab80 con 0x7f13bc102b40 2024-09-21T12:03:44.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.308+0000 7f13a3fff640 1 -- 172.21.15.118:0/232754046 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f13b001b480 con 0x7f13bc102b40 2024-09-21T12:03:44.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.309+0000 7f13a3fff640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13a407af30 0x7f13a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:44.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.309+0000 7f13a3fff640 1 -- 172.21.15.118:0/232754046 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f13b009d860 con 0x7f13bc102b40 2024-09-21T12:03:44.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.309+0000 7f13ba59c640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13a407af30 0x7f13a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:44.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.309+0000 7f13ba59c640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13a407af30 0x7f13a407d3f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f13ac000c00 tx=0x7f13ac0095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:44.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.313+0000 7f13a3fff640 1 -- 172.21.15.118:0/232754046 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13b0021250 con 0x7f13bc102b40 2024-09-21T12:03:44.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.529+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f13bc19afd0 con 0x7f13bc102b40 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.529+0000 7f13a3fff640 1 -- 172.21.15.118:0/232754046 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f13b0068db0 con 0x7f13bc102b40 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:03:44.531 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:03:44.532 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:03:44.533 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:03:44.534 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:03:44.534 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:03:44.534 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:03:44.534 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:03:44.534 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:03:44.534 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:03:44.534 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:03:44.535 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:03:44.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.532+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13a407af30 msgr2=0x7f13a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.532+0000 7f13c1228640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13a407af30 0x7f13a407d3f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f13ac000c00 tx=0x7f13ac0095f0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.532+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc102b40 msgr2=0x7f13bc19f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.532+0000 7f13c1228640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc102b40 0x7f13bc19f8e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f13b000b420 tx=0x7f13b000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.532+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 shutdown_connections 2024-09-21T12:03:44.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.532+0000 7f13c1228640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13bc103460 0x7f13bc19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.532+0000 7f13c1228640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13a407af30 0x7f13a407d3f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.532+0000 7f13c1228640 1 --2- 172.21.15.118:0/232754046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13bc102b40 0x7f13bc19f8e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.532+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 >> 172.21.15.118:0/232754046 conn(0x7f13bc0fc520 msgr2=0x7f13bc100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:44.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.533+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 shutdown_connections 2024-09-21T12:03:44.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.533+0000 7f13c1228640 1 -- 172.21.15.118:0/232754046 wait complete. 2024-09-21T12:03:44.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 -- 172.21.15.118:0/2701820871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1067e0 msgr2=0x7fe32c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 --2- 172.21.15.118:0/2701820871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1067e0 0x7fe32c106bc0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe320009880 tx=0x7fe32002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 -- 172.21.15.118:0/2701820871 shutdown_connections 2024-09-21T12:03:44.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 --2- 172.21.15.118:0/2701820871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe32c1007e0 0x7fe32c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 --2- 172.21.15.118:0/2701820871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1067e0 0x7fe32c106bc0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 -- 172.21.15.118:0/2701820871 >> 172.21.15.118:0/2701820871 conn(0x7fe32c0fc4c0 msgr2=0x7fe32c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:44.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 -- 172.21.15.118:0/2701820871 shutdown_connections 2024-09-21T12:03:44.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 -- 172.21.15.118:0/2701820871 wait complete. 2024-09-21T12:03:44.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 Processor -- start 2024-09-21T12:03:44.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.616+0000 7fe333ed1640 1 -- start start 2024-09-21T12:03:44.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe333ed1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1007e0 0x7fe32c19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:44.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe333ed1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe32c1067e0 0x7fe32c19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe333ed1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c10dcb0 con 0x7fe32c1007e0 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe333ed1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c10db30 con 0x7fe32c1067e0 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe331c6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1007e0 0x7fe32c19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe331c6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1007e0 0x7fe32c19d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43532/0 (socket says 172.21.15.118:43532) 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe331c6d640 1 -- 172.21.15.118:0/358083870 learned_addr learned my addr 172.21.15.118:0/358083870 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe33146c640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe32c1067e0 0x7fe32c19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe331c6d640 1 -- 172.21.15.118:0/358083870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe32c1067e0 msgr2=0x7fe32c19db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe331c6d640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe32c1067e0 0x7fe32c19db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe331c6d640 1 -- 172.21.15.118:0/358083870 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c197790 con 0x7fe32c1007e0 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe331c6d640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1007e0 0x7fe32c19d610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe320031460 tx=0x7fe320004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe31effd640 1 -- 172.21.15.118:0/358083870 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe32003f070 con 0x7fe32c1007e0 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe31effd640 1 -- 172.21.15.118:0/358083870 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3200035f0 con 0x7fe32c1007e0 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c197a20 con 0x7fe32c1007e0 2024-09-21T12:03:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.617+0000 7fe31effd640 1 -- 172.21.15.118:0/358083870 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe320035030 con 0x7fe32c1007e0 2024-09-21T12:03:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.618+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c197f50 con 0x7fe32c1007e0 2024-09-21T12:03:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.619+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32c101f20 con 0x7fe32c1007e0 2024-09-21T12:03:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.619+0000 7fe31effd640 1 -- 172.21.15.118:0/358083870 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe320042070 con 0x7fe32c1007e0 2024-09-21T12:03:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.619+0000 7fe31effd640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe31807af80 0x7fe31807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.620+0000 7fe33146c640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe31807af80 0x7fe31807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:44.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.620+0000 7fe31effd640 1 -- 172.21.15.118:0/358083870 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe3200be910 con 0x7fe32c1007e0 2024-09-21T12:03:44.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.620+0000 7fe33146c640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe31807af80 0x7fe31807d440 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe32c105f20 tx=0x7fe328005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:44.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.624+0000 7fe31effd640 1 -- 172.21.15.118:0/358083870 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe320089ee0 con 0x7fe32c1007e0 2024-09-21T12:03:44.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.819+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe32c1982c0 con 0x7fe31807af80 2024-09-21T12:03:44.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.820+0000 7fe31effd640 1 -- 172.21.15.118:0/358083870 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe32c1982c0 con 0x7fe31807af80 2024-09-21T12:03:44.821 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:03:44.821 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:03:44.822 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:03:44.823 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.822+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe31807af80 msgr2=0x7fe31807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.822+0000 7fe333ed1640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe31807af80 0x7fe31807d440 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe32c105f20 tx=0x7fe328005f90 comp rx=0 tx=0).stop 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.822+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1007e0 msgr2=0x7fe32c19d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.822+0000 7fe333ed1640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1007e0 0x7fe32c19d610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe320031460 tx=0x7fe320004530 comp rx=0 tx=0).stop 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.822+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 shutdown_connections 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.822+0000 7fe333ed1640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe32c1067e0 0x7fe32c19db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.822+0000 7fe333ed1640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe31807af80 0x7fe31807d440 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.822+0000 7fe333ed1640 1 --2- 172.21.15.118:0/358083870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe32c1007e0 0x7fe32c19d610 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.822+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 >> 172.21.15.118:0/358083870 conn(0x7fe32c0fc4c0 msgr2=0x7fe32c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.823+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 shutdown_connections 2024-09-21T12:03:44.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.823+0000 7fe333ed1640 1 -- 172.21.15.118:0/358083870 wait complete. 2024-09-21T12:03:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.904+0000 7fa1fd13b640 1 -- 172.21.15.118:0/969938871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 msgr2=0x7fa1f8100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.904+0000 7fa1fd13b640 1 --2- 172.21.15.118:0/969938871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 0x7fa1f8100c70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009880 tx=0x7fa1e002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.904+0000 7fa1fd13b640 1 -- 172.21.15.118:0/969938871 shutdown_connections 2024-09-21T12:03:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.904+0000 7fa1fd13b640 1 --2- 172.21.15.118:0/969938871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 0x7fa1f8100c70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.904+0000 7fa1fd13b640 1 --2- 172.21.15.118:0/969938871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f8106810 0x7fa1f8106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.904+0000 7fa1fd13b640 1 -- 172.21.15.118:0/969938871 >> 172.21.15.118:0/969938871 conn(0x7fa1f80fc510 msgr2=0x7fa1f80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.904+0000 7fa1fd13b640 1 -- 172.21.15.118:0/969938871 shutdown_connections 2024-09-21T12:03:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.904+0000 7fa1fd13b640 1 -- 172.21.15.118:0/969938871 wait complete. 2024-09-21T12:03:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.904+0000 7fa1fd13b640 1 Processor -- start 2024-09-21T12:03:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1fd13b640 1 -- start start 2024-09-21T12:03:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1fd13b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 0x7fa1f819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1fd13b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f8106810 0x7fa1f819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:44.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1fd13b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f810dcc0 con 0x7fa1f8100810 2024-09-21T12:03:44.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1fd13b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f810db40 con 0x7fa1f8106810 2024-09-21T12:03:44.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1f6d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 0x7fa1f819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:44.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1f6d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 0x7fa1f819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43548/0 (socket says 172.21.15.118:43548) 2024-09-21T12:03:44.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1f6d9d640 1 -- 172.21.15.118:0/350140053 learned_addr learned my addr 172.21.15.118:0/350140053 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:03:44.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1f659c640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f8106810 0x7fa1f819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:44.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1f6d9d640 1 -- 172.21.15.118:0/350140053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f8106810 msgr2=0x7fa1f819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:44.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1f6d9d640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f8106810 0x7fa1f819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:44.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1f6d9d640 1 -- 172.21.15.118:0/350140053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f81977a0 con 0x7fa1f8100810 2024-09-21T12:03:44.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.905+0000 7fa1f659c640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f8106810 0x7fa1f819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:03:44.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.906+0000 7fa1f6d9d640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 0x7fa1f819d620 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000cc60 tx=0x7fa1f000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:44.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.906+0000 7fa1effff640 1 -- 172.21.15.118:0/350140053 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1f000ad30 con 0x7fa1f8100810 2024-09-21T12:03:44.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.906+0000 7fa1effff640 1 -- 172.21.15.118:0/350140053 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1f0005020 con 0x7fa1f8100810 2024-09-21T12:03:44.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.906+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f8197a90 con 0x7fa1f8100810 2024-09-21T12:03:44.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.906+0000 7fa1effff640 1 -- 172.21.15.118:0/350140053 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1f000f660 con 0x7fa1f8100810 2024-09-21T12:03:44.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.906+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f8197ff0 con 0x7fa1f8100810 2024-09-21T12:03:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.907+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f8101f50 con 0x7fa1f8100810 2024-09-21T12:03:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.908+0000 7fa1effff640 1 -- 172.21.15.118:0/350140053 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa1f00051d0 con 0x7fa1f8100810 2024-09-21T12:03:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.908+0000 7fa1effff640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa1e407af80 0x7fa1e407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:03:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.909+0000 7fa1effff640 1 -- 172.21.15.118:0/350140053 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa1f009e5c0 con 0x7fa1f8100810 2024-09-21T12:03:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.909+0000 7fa1f659c640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa1e407af80 0x7fa1e407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:03:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.909+0000 7fa1f659c640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa1e407af80 0x7fa1e407d440 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8198af0 tx=0x7fa1e0009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:03:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:44.913+0000 7fa1effff640 1 -- 172.21.15.118:0/350140053 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa1f0014030 con 0x7fa1f8100810 2024-09-21T12:03:45.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:44 smithi118 ceph-mon[111738]: pgmap v748: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:45.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:44 smithi118 ceph-mon[111738]: from='client.35172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:44 smithi118 ceph-mon[111738]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:44 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1657856133' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:45.075 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:44 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/232754046' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:03:45.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.160+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa1f8198300 con 0x7fa1f8100810 2024-09-21T12:03:45.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.161+0000 7fa1effff640 1 -- 172.21.15.118:0/350140053 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fa1f0069b90 con 0x7fa1f8100810 2024-09-21T12:03:45.164 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:03:45.164 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:03:45.164 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:03:45.164 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:03:45.164 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:03:45.165 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:03:45.165 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:03:45.165 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:03:45.165 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:03:45.165 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:03:45.165 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:03:45.165 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:03:45.166 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:03:45.166 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:03:45.166 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:03:45.166 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:03:45.166 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:03:45.166 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:03:45.166 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:03:45.167 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:03:45.167 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:03:45.167 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:03:45.167 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:03:45.167 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:03:45.167 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:03:45.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa1e407af80 msgr2=0x7fa1e407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:45.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa1e407af80 0x7fa1e407d440 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8198af0 tx=0x7fa1e0009560 comp rx=0 tx=0).stop 2024-09-21T12:03:45.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 msgr2=0x7fa1f819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:03:45.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 0x7fa1f819d620 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000cc60 tx=0x7fa1f000a620 comp rx=0 tx=0).stop 2024-09-21T12:03:45.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 shutdown_connections 2024-09-21T12:03:45.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f8106810 0x7fa1f819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:45.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa1e407af80 0x7fa1e407d440 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:45.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 --2- 172.21.15.118:0/350140053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f8100810 0x7fa1f819d620 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:03:45.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 >> 172.21.15.118:0/350140053 conn(0x7fa1f80fc510 msgr2=0x7fa1f81045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:03:45.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 shutdown_connections 2024-09-21T12:03:45.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:03:45.163+0000 7fa1fd13b640 1 -- 172.21.15.118:0/350140053 wait complete. 2024-09-21T12:03:45.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:44 smithi149 ceph-mon[79770]: pgmap v748: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:45.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:44 smithi149 ceph-mon[79770]: from='client.35172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:45.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:44 smithi149 ceph-mon[79770]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:45.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:44 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1657856133' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:03:45.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:44 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/232754046' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:03:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:45 smithi149 ceph-mon[79770]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:45 smithi149 ceph-mon[79770]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:46.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:45 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/350140053' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:03:46.236 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:45 smithi118 ceph-mon[111738]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:46.236 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:45 smithi118 ceph-mon[111738]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:03:46.237 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:45 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/350140053' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:03:47.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:46 smithi149 ceph-mon[79770]: pgmap v749: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:47.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:46 smithi118 ceph-mon[111738]: pgmap v749: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:47 smithi149 ceph-mon[79770]: pgmap v750: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:47 smithi118 ceph-mon[111738]: pgmap v750: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:50.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:49 smithi149 ceph-mon[79770]: pgmap v751: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:50.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:49 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:03:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:49 smithi118 ceph-mon[111738]: pgmap v751: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:49 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:03:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:51 smithi118 ceph-mon[111738]: pgmap v752: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:52.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:51 smithi149 ceph-mon[79770]: pgmap v752: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:53 smithi118 ceph-mon[111738]: pgmap v753: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:54.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:53 smithi149 ceph-mon[79770]: pgmap v753: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:55 smithi118 ceph-mon[111738]: pgmap v754: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:55 smithi149 ceph-mon[79770]: pgmap v754: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:57 smithi118 ceph-mon[111738]: pgmap v755: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:03:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:57 smithi149 ceph-mon[79770]: pgmap v755: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:03:59 smithi118 ceph-mon[111738]: pgmap v756: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:03:59 smithi149 ceph-mon[79770]: pgmap v756: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:01 smithi118 ceph-mon[111738]: pgmap v757: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:02.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:01 smithi149 ceph-mon[79770]: pgmap v757: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:03 smithi118 ceph-mon[111738]: pgmap v758: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:03 smithi149 ceph-mon[79770]: pgmap v758: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:04 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:04:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:04 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:04:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:05 smithi118 ceph-mon[111738]: pgmap v759: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:05 smithi149 ceph-mon[79770]: pgmap v759: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:07 smithi118 ceph-mon[111738]: pgmap v760: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:07 smithi149 ceph-mon[79770]: pgmap v760: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:09 smithi118 ceph-mon[111738]: pgmap v761: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:09 smithi149 ceph-mon[79770]: pgmap v761: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:11 smithi118 ceph-mon[111738]: pgmap v762: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:11 smithi149 ceph-mon[79770]: pgmap v762: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:14 smithi118 ceph-mon[111738]: pgmap v763: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:14 smithi149 ceph-mon[79770]: pgmap v763: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.257+0000 7f9d821eb640 1 -- 172.21.15.118:0/3712367349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c102aa0 msgr2=0x7f9d7c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.257+0000 7f9d821eb640 1 --2- 172.21.15.118:0/3712367349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c102aa0 0x7f9d7c102e80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009880 tx=0x7f9d6c02a530 comp rx=0 tx=0).stop 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.257+0000 7f9d821eb640 1 -- 172.21.15.118:0/3712367349 shutdown_connections 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.257+0000 7f9d821eb640 1 --2- 172.21.15.118:0/3712367349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d7c1033c0 0x7f9d7c10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.257+0000 7f9d821eb640 1 --2- 172.21.15.118:0/3712367349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c102aa0 0x7f9d7c102e80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.257+0000 7f9d821eb640 1 -- 172.21.15.118:0/3712367349 >> 172.21.15.118:0/3712367349 conn(0x7f9d7c0fc4c0 msgr2=0x7f9d7c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.257+0000 7f9d821eb640 1 -- 172.21.15.118:0/3712367349 shutdown_connections 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.257+0000 7f9d821eb640 1 -- 172.21.15.118:0/3712367349 wait complete. 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d821eb640 1 Processor -- start 2024-09-21T12:04:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d821eb640 1 -- start start 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d821eb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d7c102aa0 0x7f9d7c100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d821eb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c1033c0 0x7f9d7c100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d821eb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c10ee30 con 0x7f9d7c1033c0 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d821eb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c10ecb0 con 0x7f9d7c102aa0 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c1033c0 0x7f9d7c100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c1033c0 0x7f9d7c100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57948/0 (socket says 172.21.15.118:57948) 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d72ffd640 1 -- 172.21.15.118:0/3394420893 learned_addr learned my addr 172.21.15.118:0/3394420893 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.258+0000 7f9d7b7fe640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d7c102aa0 0x7f9d7c100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.259+0000 7f9d72ffd640 1 -- 172.21.15.118:0/3394420893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d7c102aa0 msgr2=0x7f9d7c100700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.259+0000 7f9d72ffd640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d7c102aa0 0x7f9d7c100700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.259+0000 7f9d72ffd640 1 -- 172.21.15.118:0/3394420893 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c101180 con 0x7f9d7c1033c0 2024-09-21T12:04:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.259+0000 7f9d72ffd640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c1033c0 0x7f9d7c100c40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400b370 tx=0x7f9d6400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:15.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.259+0000 7f9d797fa640 1 -- 172.21.15.118:0/3394420893 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d64015020 con 0x7f9d7c1033c0 2024-09-21T12:04:15.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.259+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7c101470 con 0x7f9d7c1033c0 2024-09-21T12:04:15.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.259+0000 7f9d797fa640 1 -- 172.21.15.118:0/3394420893 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d64011af0 con 0x7f9d7c1033c0 2024-09-21T12:04:15.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.259+0000 7f9d797fa640 1 -- 172.21.15.118:0/3394420893 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d64010d60 con 0x7f9d7c1033c0 2024-09-21T12:04:15.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.259+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7c1a3f60 con 0x7f9d7c1033c0 2024-09-21T12:04:15.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.260+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7c06a410 con 0x7f9d7c1033c0 2024-09-21T12:04:15.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.261+0000 7f9d797fa640 1 -- 172.21.15.118:0/3394420893 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9d64018020 con 0x7f9d7c1033c0 2024-09-21T12:04:15.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.262+0000 7f9d797fa640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d6807af30 0x7f9d6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:15.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.262+0000 7f9d7b7fe640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d6807af30 0x7f9d6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:15.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.262+0000 7f9d797fa640 1 -- 172.21.15.118:0/3394420893 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9d6409d980 con 0x7f9d7c1033c0 2024-09-21T12:04:15.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.262+0000 7f9d7b7fe640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d6807af30 0x7f9d6807d3f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0096c0 tx=0x7f9d6c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:15.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.266+0000 7f9d797fa640 1 -- 172.21.15.118:0/3394420893 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d6401f020 con 0x7f9d7c1033c0 2024-09-21T12:04:15.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.459+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9d7c062630 con 0x7f9d6807af30 2024-09-21T12:04:15.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.461+0000 7f9d797fa640 1 -- 172.21.15.118:0/3394420893 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9d7c062630 con 0x7f9d6807af30 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d6807af30 msgr2=0x7f9d6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d6807af30 0x7f9d6807d3f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0096c0 tx=0x7f9d6c031400 comp rx=0 tx=0).stop 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c1033c0 msgr2=0x7f9d7c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c1033c0 0x7f9d7c100c40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400b370 tx=0x7f9d6400b830 comp rx=0 tx=0).stop 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 shutdown_connections 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d6807af30 0x7f9d6807d3f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d7c1033c0 0x7f9d7c100c40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 --2- 172.21.15.118:0/3394420893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d7c102aa0 0x7f9d7c100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 >> 172.21.15.118:0/3394420893 conn(0x7f9d7c0fc4c0 msgr2=0x7f9d7c108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 shutdown_connections 2024-09-21T12:04:15.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.463+0000 7f9d821eb640 1 -- 172.21.15.118:0/3394420893 wait complete. 2024-09-21T12:04:15.474 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:04:15.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.545+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3416971313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074590 msgr2=0x7f2f04074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.545+0000 7f2f0bcae640 1 --2- 172.21.15.118:0/3416971313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074590 0x7f2f04074970 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009880 tx=0x7f2f0002a530 comp rx=0 tx=0).stop 2024-09-21T12:04:15.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.545+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3416971313 shutdown_connections 2024-09-21T12:04:15.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.545+0000 7f2f0bcae640 1 --2- 172.21.15.118:0/3416971313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f04074eb0 0x7f2f04112400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.545+0000 7f2f0bcae640 1 --2- 172.21.15.118:0/3416971313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074590 0x7f2f04074970 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.545+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3416971313 >> 172.21.15.118:0/3416971313 conn(0x7f2f040fd630 msgr2=0x7f2f040ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:15.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.545+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3416971313 shutdown_connections 2024-09-21T12:04:15.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.545+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3416971313 wait complete. 2024-09-21T12:04:15.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f0bcae640 1 Processor -- start 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f0bcae640 1 -- start start 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f0bcae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f04074590 0x7f2f0419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f0bcae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074eb0 0x7f2f0419e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f0bcae640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f04115400 con 0x7f2f04074eb0 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f0bcae640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f04115280 con 0x7f2f04074590 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f09249640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074eb0 0x7f2f0419e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f09249640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074eb0 0x7f2f0419e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39990/0 (socket says 172.21.15.118:39990) 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f09249640 1 -- 172.21.15.118:0/3438794499 learned_addr learned my addr 172.21.15.118:0/3438794499 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.546+0000 7f2f09a4a640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f04074590 0x7f2f0419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.547+0000 7f2f09249640 1 -- 172.21.15.118:0/3438794499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f04074590 msgr2=0x7f2f0419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.547+0000 7f2f09249640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f04074590 0x7f2f0419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.547+0000 7f2f09249640 1 -- 172.21.15.118:0/3438794499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f041a28d0 con 0x7f2f04074eb0 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.547+0000 7f2f09249640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074eb0 0x7f2f0419e540 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400d8d0 tx=0x7f2ef400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:15.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.547+0000 7f2efaffd640 1 -- 172.21.15.118:0/3438794499 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ef4017070 con 0x7f2f04074eb0 2024-09-21T12:04:15.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.547+0000 7f2efaffd640 1 -- 172.21.15.118:0/3438794499 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ef4010460 con 0x7f2f04074eb0 2024-09-21T12:04:15.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.547+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f041a2bc0 con 0x7f2f04074eb0 2024-09-21T12:04:15.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.547+0000 7f2efaffd640 1 -- 172.21.15.118:0/3438794499 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ef400f5f0 con 0x7f2f04074eb0 2024-09-21T12:04:15.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.547+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f041a3150 con 0x7f2f04074eb0 2024-09-21T12:04:15.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.548+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f04075cd0 con 0x7f2f04074eb0 2024-09-21T12:04:15.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.549+0000 7f2efaffd640 1 -- 172.21.15.118:0/3438794499 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2ef4009a30 con 0x7f2f04074eb0 2024-09-21T12:04:15.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.549+0000 7f2efaffd640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ef007af30 0x7f2ef007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:15.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.549+0000 7f2efaffd640 1 -- 172.21.15.118:0/3438794499 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2ef409dee0 con 0x7f2f04074eb0 2024-09-21T12:04:15.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.549+0000 7f2f09a4a640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ef007af30 0x7f2ef007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:15.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.550+0000 7f2f09a4a640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ef007af30 0x7f2ef007d3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2f000096c0 tx=0x7f2f00031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:15.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.554+0000 7f2efaffd640 1 -- 172.21.15.118:0/3438794499 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ef4069430 con 0x7f2f04074eb0 2024-09-21T12:04:15.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.751+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2f0419f3c0 con 0x7f2ef007af30 2024-09-21T12:04:15.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.752+0000 7f2efaffd640 1 -- 172.21.15.118:0/3438794499 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2f0419f3c0 con 0x7f2ef007af30 2024-09-21T12:04:15.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.754+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ef007af30 msgr2=0x7f2ef007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.754+0000 7f2f0bcae640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ef007af30 0x7f2ef007d3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2f000096c0 tx=0x7f2f00031400 comp rx=0 tx=0).stop 2024-09-21T12:04:15.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.755+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074eb0 msgr2=0x7f2f0419e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.755+0000 7f2f0bcae640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074eb0 0x7f2f0419e540 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400d8d0 tx=0x7f2ef400dd90 comp rx=0 tx=0).stop 2024-09-21T12:04:15.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.755+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 shutdown_connections 2024-09-21T12:04:15.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.755+0000 7f2f0bcae640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2ef007af30 0x7f2ef007d3f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.755+0000 7f2f0bcae640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f04074eb0 0x7f2f0419e540 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.755+0000 7f2f0bcae640 1 --2- 172.21.15.118:0/3438794499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f04074590 0x7f2f0419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.755+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 >> 172.21.15.118:0/3438794499 conn(0x7f2f040fd630 msgr2=0x7f2f04105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:15.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.755+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 shutdown_connections 2024-09-21T12:04:15.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.755+0000 7f2f0bcae640 1 -- 172.21.15.118:0/3438794499 wait complete. 2024-09-21T12:04:15.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 -- 172.21.15.118:0/2423672664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 msgr2=0x7febd8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 --2- 172.21.15.118:0/2423672664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 0x7febd8107d10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7febc0009880 tx=0x7febc002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 -- 172.21.15.118:0/2423672664 shutdown_connections 2024-09-21T12:04:15.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 --2- 172.21.15.118:0/2423672664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd8101930 0x7febd8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 --2- 172.21.15.118:0/2423672664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 0x7febd8107d10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 -- 172.21.15.118:0/2423672664 >> 172.21.15.118:0/2423672664 conn(0x7febd80fd630 msgr2=0x7febd80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 -- 172.21.15.118:0/2423672664 shutdown_connections 2024-09-21T12:04:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 -- 172.21.15.118:0/2423672664 wait complete. 2024-09-21T12:04:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 Processor -- start 2024-09-21T12:04:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.836+0000 7febdd366640 1 -- start start 2024-09-21T12:04:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febdd366640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd8101930 0x7febd819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febdd366640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 0x7febd819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febdd366640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7febd810ee00 con 0x7febd8107930 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febdd366640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7febd810ec80 con 0x7febd8101930 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febd67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 0x7febd819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febd67fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 0x7febd819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40010/0 (socket says 172.21.15.118:40010) 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febd67fc640 1 -- 172.21.15.118:0/4053970798 learned_addr learned my addr 172.21.15.118:0/4053970798 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febd6ffd640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd8101930 0x7febd819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febd67fc640 1 -- 172.21.15.118:0/4053970798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd8101930 msgr2=0x7febd819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febd67fc640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd8101930 0x7febd819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febd67fc640 1 -- 172.21.15.118:0/4053970798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd81977f0 con 0x7febd8107930 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febd67fc640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 0x7febd819dbb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7febc800d6f0 tx=0x7febc800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febcffff640 1 -- 172.21.15.118:0/4053970798 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febc8017070 con 0x7febd8107930 2024-09-21T12:04:15.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd8197ae0 con 0x7febd8107930 2024-09-21T12:04:15.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.837+0000 7febcffff640 1 -- 172.21.15.118:0/4053970798 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7febc800de00 con 0x7febd8107930 2024-09-21T12:04:15.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.838+0000 7febcffff640 1 -- 172.21.15.118:0/4053970798 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febc8004bb0 con 0x7febd8107930 2024-09-21T12:04:15.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.838+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd8198070 con 0x7febd8107930 2024-09-21T12:04:15.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.838+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd8103070 con 0x7febd8107930 2024-09-21T12:04:15.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.839+0000 7febcffff640 1 -- 172.21.15.118:0/4053970798 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7febc8004e60 con 0x7febd8107930 2024-09-21T12:04:15.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.839+0000 7febcffff640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7febc407af30 0x7febc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:15.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.840+0000 7febcffff640 1 -- 172.21.15.118:0/4053970798 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7febc809dc50 con 0x7febd8107930 2024-09-21T12:04:15.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.840+0000 7febd6ffd640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7febc407af30 0x7febc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:15.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.840+0000 7febd6ffd640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7febc407af30 0x7febc407d3f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7febc00096c0 tx=0x7febc0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:15.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:15.844+0000 7febcffff640 1 -- 172.21.15.118:0/4053970798 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7febc80691a0 con 0x7febd8107930 2024-09-21T12:04:16.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.035+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7febd81983e0 con 0x7febc407af30 2024-09-21T12:04:16.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.044+0000 7febcffff640 1 -- 172.21.15.118:0/4053970798 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7febd81983e0 con 0x7febc407af30 2024-09-21T12:04:16.046 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (22m) 53s ago 33m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (25m) 53s ago 33m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (24m) 55s ago 32m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (20m) 53s ago 33m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (20m) 55s ago 32m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (21m) 53s ago 32m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (16m) 53s ago 27m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (16m) 53s ago 27m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (59s) 55s ago 27m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (16m) 55s ago 27m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (24m) 53s ago 34m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (23m) 55s ago 32m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (20m) 53s ago 34m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:04:16.047 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (20m) 55s ago 32m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:04:16.048 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (23m) 53s ago 33m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:04:16.048 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (22m) 55s ago 32m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:04:16.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (19m) 53s ago 31m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:04:16.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (19m) 53s ago 30m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:04:16.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (18m) 53s ago 30m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:04:16.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (18m) 55s ago 29m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:04:16.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (17m) 55s ago 29m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:04:16.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (16m) 55s ago 28m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:04:16.048 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (22m) 53s ago 32m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:04:16.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.046+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7febc407af30 msgr2=0x7febc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.046+0000 7febdd366640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7febc407af30 0x7febc407d3f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7febc00096c0 tx=0x7febc0031400 comp rx=0 tx=0).stop 2024-09-21T12:04:16.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.046+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 msgr2=0x7febd819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.046+0000 7febdd366640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 0x7febd819dbb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7febc800d6f0 tx=0x7febc800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.047+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 shutdown_connections 2024-09-21T12:04:16.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.047+0000 7febdd366640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7febc407af30 0x7febc407d3f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.047+0000 7febdd366640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd8107930 0x7febd819dbb0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.047+0000 7febdd366640 1 --2- 172.21.15.118:0/4053970798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd8101930 0x7febd819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.047+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 >> 172.21.15.118:0/4053970798 conn(0x7febd80fd630 msgr2=0x7febd80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:16.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.047+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 shutdown_connections 2024-09-21T12:04:16.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.047+0000 7febdd366640 1 -- 172.21.15.118:0/4053970798 wait complete. 2024-09-21T12:04:16.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.127+0000 7fa96c4ec640 1 -- 172.21.15.118:0/973291052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 msgr2=0x7fa964100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.127+0000 7fa96c4ec640 1 --2- 172.21.15.118:0/973291052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 0x7fa964100c80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa954009880 tx=0x7fa95402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.130 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:16 smithi118 ceph-mon[111738]: pgmap v764: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:16.130 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:16 smithi118 ceph-mon[111738]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:16.130 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:16 smithi118 ceph-mon[111738]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.127+0000 7fa96c4ec640 1 -- 172.21.15.118:0/973291052 shutdown_connections 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.127+0000 7fa96c4ec640 1 --2- 172.21.15.118:0/973291052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 0x7fa964100c80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.127+0000 7fa96c4ec640 1 --2- 172.21.15.118:0/973291052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa964106820 0x7fa964106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.127+0000 7fa96c4ec640 1 -- 172.21.15.118:0/973291052 >> 172.21.15.118:0/973291052 conn(0x7fa9640fc520 msgr2=0x7fa9640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.127+0000 7fa96c4ec640 1 -- 172.21.15.118:0/973291052 shutdown_connections 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.127+0000 7fa96c4ec640 1 -- 172.21.15.118:0/973291052 wait complete. 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.128+0000 7fa96c4ec640 1 Processor -- start 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.128+0000 7fa96c4ec640 1 -- start start 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.128+0000 7fa96c4ec640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 0x7fa964198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.128+0000 7fa96c4ec640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa964106820 0x7fa964198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.128+0000 7fa96c4ec640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa96410dcf0 con 0x7fa964100820 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.128+0000 7fa96c4ec640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa96410db70 con 0x7fa964106820 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.128+0000 7fa96a288640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 0x7fa964198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.128+0000 7fa96a288640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 0x7fa964198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40030/0 (socket says 172.21.15.118:40030) 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.128+0000 7fa96a288640 1 -- 172.21.15.118:0/2390436318 learned_addr learned my addr 172.21.15.118:0/2390436318 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa969a87640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa964106820 0x7fa964198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa96a288640 1 -- 172.21.15.118:0/2390436318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa964106820 msgr2=0x7fa964198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa96a288640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa964106820 0x7fa964198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa96a288640 1 -- 172.21.15.118:0/2390436318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa964199340 con 0x7fa964100820 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa96a288640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 0x7fa964198800 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e970 tx=0x7fa96000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa95b7fe640 1 -- 172.21.15.118:0/2390436318 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa96000cac0 con 0x7fa964100820 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa95b7fe640 1 -- 172.21.15.118:0/2390436318 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9600054e0 con 0x7fa964100820 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa964199630 con 0x7fa964100820 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa95b7fe640 1 -- 172.21.15.118:0/2390436318 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa960010430 con 0x7fa964100820 2024-09-21T12:04:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.129+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9641a1c30 con 0x7fa964100820 2024-09-21T12:04:16.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.130+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa964101f60 con 0x7fa964100820 2024-09-21T12:04:16.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.131+0000 7fa95b7fe640 1 -- 172.21.15.118:0/2390436318 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa960004f00 con 0x7fa964100820 2024-09-21T12:04:16.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.131+0000 7fa95b7fe640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa95007af30 0x7fa95007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.132+0000 7fa969a87640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa95007af30 0x7fa95007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.132+0000 7fa95b7fe640 1 -- 172.21.15.118:0/2390436318 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa96009e820 con 0x7fa964100820 2024-09-21T12:04:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.132+0000 7fa969a87640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa95007af30 0x7fa95007d3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa96406ae50 tx=0x7fa954031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:16.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.136+0000 7fa95b7fe640 1 -- 172.21.15.118:0/2390436318 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa964199630 con 0x7fa964100820 2024-09-21T12:04:16.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.381+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa964108d90 con 0x7fa964100820 2024-09-21T12:04:16.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.382+0000 7fa95b7fe640 1 -- 172.21.15.118:0/2390436318 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa960069d70 con 0x7fa964100820 2024-09-21T12:04:16.384 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:04:16.384 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:04:16.385 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:04:16.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa95007af30 msgr2=0x7fa95007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa95007af30 0x7fa95007d3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa96406ae50 tx=0x7fa954031400 comp rx=0 tx=0).stop 2024-09-21T12:04:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 msgr2=0x7fa964198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 0x7fa964198800 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e970 tx=0x7fa96000ed70 comp rx=0 tx=0).stop 2024-09-21T12:04:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 shutdown_connections 2024-09-21T12:04:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa964106820 0x7fa964198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa95007af30 0x7fa95007d3f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 --2- 172.21.15.118:0/2390436318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa964100820 0x7fa964198800 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 >> 172.21.15.118:0/2390436318 conn(0x7fa9640fc520 msgr2=0x7fa9640fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 shutdown_connections 2024-09-21T12:04:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.384+0000 7fa96c4ec640 1 -- 172.21.15.118:0/2390436318 wait complete. 2024-09-21T12:04:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:16 smithi149 ceph-mon[79770]: pgmap v764: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:16 smithi149 ceph-mon[79770]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:16 smithi149 ceph-mon[79770]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.465+0000 7f9516be6640 1 -- 172.21.15.118:0/405318717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510102b40 msgr2=0x7f9510102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.465+0000 7f9516be6640 1 --2- 172.21.15.118:0/405318717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510102b40 0x7f9510102f20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9504009880 tx=0x7f950402a530 comp rx=0 tx=0).stop 2024-09-21T12:04:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.465+0000 7f9516be6640 1 -- 172.21.15.118:0/405318717 shutdown_connections 2024-09-21T12:04:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.465+0000 7f9516be6640 1 --2- 172.21.15.118:0/405318717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9510103460 0x7f951010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.465+0000 7f9516be6640 1 --2- 172.21.15.118:0/405318717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510102b40 0x7f9510102f20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.465+0000 7f9516be6640 1 -- 172.21.15.118:0/405318717 >> 172.21.15.118:0/405318717 conn(0x7f95100fc4c0 msgr2=0x7f95100fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f9516be6640 1 -- 172.21.15.118:0/405318717 shutdown_connections 2024-09-21T12:04:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f9516be6640 1 -- 172.21.15.118:0/405318717 wait complete. 2024-09-21T12:04:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f9516be6640 1 Processor -- start 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f9516be6640 1 -- start start 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f9516be6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9510102b40 0x7f951019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f9516be6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510103460 0x7f951019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f9516be6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f951010edd0 con 0x7f9510103460 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f9516be6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f951010ec50 con 0x7f9510102b40 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f950ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510103460 0x7f951019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f950ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510103460 0x7f951019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40048/0 (socket says 172.21.15.118:40048) 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.466+0000 7f950ffff640 1 -- 172.21.15.118:0/369341381 learned_addr learned my addr 172.21.15.118:0/369341381 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f9514982640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9510102b40 0x7f951019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f950ffff640 1 -- 172.21.15.118:0/369341381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9510102b40 msgr2=0x7f951019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f950ffff640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9510102b40 0x7f951019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f950ffff640 1 -- 172.21.15.118:0/369341381 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95101977c0 con 0x7f9510103460 2024-09-21T12:04:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f950ffff640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510103460 0x7f951019db80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00c8f0 tx=0x7f94fc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f950dffb640 1 -- 172.21.15.118:0/369341381 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94fc0079b0 con 0x7f9510103460 2024-09-21T12:04:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9510197ab0 con 0x7f9510103460 2024-09-21T12:04:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f950dffb640 1 -- 172.21.15.118:0/369341381 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94fc0054e0 con 0x7f9510103460 2024-09-21T12:04:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f950dffb640 1 -- 172.21.15.118:0/369341381 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94fc004dd0 con 0x7f9510103460 2024-09-21T12:04:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.467+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9510198040 con 0x7f9510103460 2024-09-21T12:04:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.468+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f951006a370 con 0x7f9510103460 2024-09-21T12:04:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.469+0000 7f950dffb640 1 -- 172.21.15.118:0/369341381 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f94fc005020 con 0x7f9510103460 2024-09-21T12:04:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.469+0000 7f950dffb640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f950007aed0 0x7f950007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.469+0000 7f950dffb640 1 -- 172.21.15.118:0/369341381 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f94fc09e070 con 0x7f9510103460 2024-09-21T12:04:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.469+0000 7f9514982640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f950007aed0 0x7f950007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.470+0000 7f9514982640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f950007aed0 0x7f950007d390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9504000c00 tx=0x7f9504004f30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:16.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.474+0000 7f950dffb640 1 -- 172.21.15.118:0/369341381 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94fc014030 con 0x7f9510103460 2024-09-21T12:04:16.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.686+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9510106010 con 0x7f9510103460 2024-09-21T12:04:16.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.686+0000 7f950dffb640 1 -- 172.21.15.118:0/369341381 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f94fc069520 con 0x7f9510103460 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:04:16.689 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:04:16.690 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:04:16.691 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:04:16.692 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:04:16.692 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:04:16.692 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:04:16.692 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:04:16.692 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:04:16.692 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:04:16.692 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:04:16.692 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:04:16.692 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:04:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:04:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f950007aed0 msgr2=0x7f950007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f950007aed0 0x7f950007d390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9504000c00 tx=0x7f9504004f30 comp rx=0 tx=0).stop 2024-09-21T12:04:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510103460 msgr2=0x7f951019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510103460 0x7f951019db80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00c8f0 tx=0x7f94fc00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 shutdown_connections 2024-09-21T12:04:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f950007aed0 0x7f950007d390 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9510103460 0x7f951019db80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 --2- 172.21.15.118:0/369341381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9510102b40 0x7f951019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 >> 172.21.15.118:0/369341381 conn(0x7f95100fc4c0 msgr2=0x7f9510103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 shutdown_connections 2024-09-21T12:04:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.688+0000 7f9516be6640 1 -- 172.21.15.118:0/369341381 wait complete. 2024-09-21T12:04:16.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.793+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/1970487810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 msgr2=0x7fc2d0107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.793+0000 7fc2d6d9e640 1 --2- 172.21.15.118:0/1970487810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 0x7fc2d0107cf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009880 tx=0x7fc2c402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.793+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/1970487810 shutdown_connections 2024-09-21T12:04:16.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.793+0000 7fc2d6d9e640 1 --2- 172.21.15.118:0/1970487810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d0101910 0x7fc2d0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.793+0000 7fc2d6d9e640 1 --2- 172.21.15.118:0/1970487810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 0x7fc2d0107cf0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.793+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/1970487810 >> 172.21.15.118:0/1970487810 conn(0x7fc2d00fd5f0 msgr2=0x7fc2d00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:16.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.793+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/1970487810 shutdown_connections 2024-09-21T12:04:16.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.793+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/1970487810 wait complete. 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2d6d9e640 1 Processor -- start 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2d6d9e640 1 -- start start 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2d6d9e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d0101910 0x7fc2d019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2d6d9e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 0x7fc2d019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2d6d9e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d010ede0 con 0x7fc2d0107910 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2d6d9e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d010ec60 con 0x7fc2d0101910 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2cffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 0x7fc2d019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2cffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 0x7fc2d019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40076/0 (socket says 172.21.15.118:40076) 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2cffff640 1 -- 172.21.15.118:0/622241300 learned_addr learned my addr 172.21.15.118:0/622241300 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.794+0000 7fc2d4b3a640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d0101910 0x7fc2d019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2cffff640 1 -- 172.21.15.118:0/622241300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d0101910 msgr2=0x7fc2d019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2cffff640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d0101910 0x7fc2d019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2cffff640 1 -- 172.21.15.118:0/622241300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d0197830 con 0x7fc2d0107910 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2d4b3a640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d0101910 0x7fc2d019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2cffff640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 0x7fc2d019dbf0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00d6f0 tx=0x7fc2bc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2cdffb640 1 -- 172.21.15.118:0/622241300 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2bc017070 con 0x7fc2d0107910 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2cdffb640 1 -- 172.21.15.118:0/622241300 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2bc00de00 con 0x7fc2d0107910 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d0197b20 con 0x7fc2d0107910 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2cdffb640 1 -- 172.21.15.118:0/622241300 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2bc004bb0 con 0x7fc2d0107910 2024-09-21T12:04:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.795+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d01980b0 con 0x7fc2d0107910 2024-09-21T12:04:16.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.796+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d0103050 con 0x7fc2d0107910 2024-09-21T12:04:16.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.797+0000 7fc2cdffb640 1 -- 172.21.15.118:0/622241300 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc2bc004e60 con 0x7fc2d0107910 2024-09-21T12:04:16.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.797+0000 7fc2cdffb640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc2c007af30 0x7fc2c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:16.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.797+0000 7fc2cdffb640 1 -- 172.21.15.118:0/622241300 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc2bc09dd60 con 0x7fc2d0107910 2024-09-21T12:04:16.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.797+0000 7fc2d4b3a640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc2c007af30 0x7fc2c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:16.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.798+0000 7fc2d4b3a640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc2c007af30 0x7fc2c007d3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4006010 tx=0x7fc2c40095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:16.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.802+0000 7fc2cdffb640 1 -- 172.21.15.118:0/622241300 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2bc069250 con 0x7fc2d0107910 2024-09-21T12:04:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:16.998+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc2d0198360 con 0x7fc2c007af30 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.000+0000 7fc2cdffb640 1 -- 172.21.15.118:0/622241300 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc2d0198360 con 0x7fc2c007af30 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:04:17.002 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:04:17.003 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:04:17.003 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:04:17.003 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:04:17.003 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:04:17.003 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:04:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc2c007af30 msgr2=0x7fc2c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc2c007af30 0x7fc2c007d3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4006010 tx=0x7fc2c40095f0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 msgr2=0x7fc2d019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:17.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 0x7fc2d019dbf0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00d6f0 tx=0x7fc2bc00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 shutdown_connections 2024-09-21T12:04:17.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc2c007af30 0x7fc2c007d3f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2d0107910 0x7fc2d019dbf0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 --2- 172.21.15.118:0/622241300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d0101910 0x7fc2d019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 >> 172.21.15.118:0/622241300 conn(0x7fc2d00fd5f0 msgr2=0x7fc2d00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:17.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 shutdown_connections 2024-09-21T12:04:17.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.002+0000 7fc2d6d9e640 1 -- 172.21.15.118:0/622241300 wait complete. 2024-09-21T12:04:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.083+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/621418674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 msgr2=0x7fbd681005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.083+0000 7fbd6e0cb640 1 --2- 172.21.15.118:0/621418674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 0x7fbd681005e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009c20 tx=0x7fbd5802a970 comp rx=0 tx=0).stop 2024-09-21T12:04:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.083+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/621418674 shutdown_connections 2024-09-21T12:04:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.083+0000 7fbd6e0cb640 1 --2- 172.21.15.118:0/621418674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd68100bb0 0x7fbd68104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.083+0000 7fbd6e0cb640 1 --2- 172.21.15.118:0/621418674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 0x7fbd681005e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.083+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/621418674 >> 172.21.15.118:0/621418674 conn(0x7fbd680fbc60 msgr2=0x7fbd680fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.083+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/621418674 shutdown_connections 2024-09-21T12:04:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.083+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/621418674 wait complete. 2024-09-21T12:04:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.084+0000 7fbd6e0cb640 1 Processor -- start 2024-09-21T12:04:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.084+0000 7fbd6e0cb640 1 -- start start 2024-09-21T12:04:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.084+0000 7fbd6e0cb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 0x7fbd68198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.084+0000 7fbd6e0cb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd68100bb0 0x7fbd68198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.084+0000 7fbd6e0cb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6810d480 con 0x7fbd68100200 2024-09-21T12:04:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.084+0000 7fbd6e0cb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6810d300 con 0x7fbd68100bb0 2024-09-21T12:04:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.084+0000 7fbd677fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 0x7fbd68198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.084+0000 7fbd677fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 0x7fbd68198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40102/0 (socket says 172.21.15.118:40102) 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.084+0000 7fbd677fe640 1 -- 172.21.15.118:0/1256991798 learned_addr learned my addr 172.21.15.118:0/1256991798 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd66ffd640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd68100bb0 0x7fbd68198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd677fe640 1 -- 172.21.15.118:0/1256991798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd68100bb0 msgr2=0x7fbd68198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd677fe640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd68100bb0 0x7fbd68198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd677fe640 1 -- 172.21.15.118:0/1256991798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd68199360 con 0x7fbd68100200 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd677fe640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 0x7fbd68198820 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbd58005cc0 tx=0x7fbd5802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd64ff9640 1 -- 172.21.15.118:0/1256991798 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd58047070 con 0x7fbd68100200 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd681995f0 con 0x7fbd68100200 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd64ff9640 1 -- 172.21.15.118:0/1256991798 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd5802f7e0 con 0x7fbd68100200 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd64ff9640 1 -- 172.21.15.118:0/1256991798 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd58034070 con 0x7fbd68100200 2024-09-21T12:04:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.085+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a1ba0 con 0x7fbd68100200 2024-09-21T12:04:17.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.086+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd681016e0 con 0x7fbd68100200 2024-09-21T12:04:17.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.087+0000 7fbd64ff9640 1 -- 172.21.15.118:0/1256991798 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbd5804a070 con 0x7fbd68100200 2024-09-21T12:04:17.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.087+0000 7fbd64ff9640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd5007af30 0x7fbd5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:17.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.087+0000 7fbd66ffd640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd5007af30 0x7fbd5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:17.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.088+0000 7fbd64ff9640 1 -- 172.21.15.118:0/1256991798 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbd580bef90 con 0x7fbd68100200 2024-09-21T12:04:17.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.088+0000 7fbd66ffd640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd5007af30 0x7fbd5007d3f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005fd0 tx=0x7fbd5c005e20 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:17.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.092+0000 7fbd64ff9640 1 -- 172.21.15.118:0/1256991798 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd5803f070 con 0x7fbd68100200 2024-09-21T12:04:17.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:17 smithi118 ceph-mon[111738]: from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:17.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:17 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2390436318' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:04:17.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:17 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/369341381' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:04:17.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.339+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fbd681a1e50 con 0x7fbd68100200 2024-09-21T12:04:17.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.339+0000 7fbd64ff9640 1 -- 172.21.15.118:0/1256991798 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fbd5808a4e0 con 0x7fbd68100200 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:04:17.342 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:04:17.343 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:04:17.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd5007af30 msgr2=0x7fbd5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:17.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd5007af30 0x7fbd5007d3f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005fd0 tx=0x7fbd5c005e20 comp rx=0 tx=0).stop 2024-09-21T12:04:17.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 msgr2=0x7fbd68198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:17.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 0x7fbd68198820 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbd58005cc0 tx=0x7fbd5802f5f0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 shutdown_connections 2024-09-21T12:04:17.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd68100bb0 0x7fbd68198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd5007af30 0x7fbd5007d3f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 --2- 172.21.15.118:0/1256991798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd68100200 0x7fbd68198820 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:17.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 >> 172.21.15.118:0/1256991798 conn(0x7fbd680fbc60 msgr2=0x7fbd68103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:17.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 shutdown_connections 2024-09-21T12:04:17.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:17.342+0000 7fbd6e0cb640 1 -- 172.21.15.118:0/1256991798 wait complete. 2024-09-21T12:04:17.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:17 smithi149 ceph-mon[79770]: from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:17.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:17 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2390436318' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:04:17.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:17 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/369341381' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:04:18.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:18 smithi149 ceph-mon[79770]: pgmap v765: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:18.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:18 smithi149 ceph-mon[79770]: from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:18.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:18 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1256991798' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:04:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:18 smithi118 ceph-mon[111738]: pgmap v765: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:18 smithi118 ceph-mon[111738]: from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:18 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1256991798' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:04:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:20 smithi118 ceph-mon[111738]: pgmap v766: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:04:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:20 smithi149 ceph-mon[79770]: pgmap v766: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:04:22.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:22 smithi118 ceph-mon[111738]: pgmap v767: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:22 smithi149 ceph-mon[79770]: pgmap v767: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:24 smithi118 ceph-mon[111738]: pgmap v768: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:24 smithi149 ceph-mon[79770]: pgmap v768: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:26 smithi118 ceph-mon[111738]: pgmap v769: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:26 smithi149 ceph-mon[79770]: pgmap v769: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:28.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:28 smithi118 ceph-mon[111738]: pgmap v770: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:28 smithi149 ceph-mon[79770]: pgmap v770: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:30 smithi118 ceph-mon[111738]: pgmap v771: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:30 smithi149 ceph-mon[79770]: pgmap v771: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:32.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:32 smithi118 ceph-mon[111738]: pgmap v772: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:32 smithi149 ceph-mon[79770]: pgmap v772: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:34 smithi118 ceph-mon[111738]: pgmap v773: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:34 smithi149 ceph-mon[79770]: pgmap v773: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:04:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:04:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:36 smithi118 ceph-mon[111738]: pgmap v774: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:36 smithi149 ceph-mon[79770]: pgmap v774: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:38 smithi118 ceph-mon[111738]: pgmap v775: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:38 smithi149 ceph-mon[79770]: pgmap v775: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:40 smithi118 ceph-mon[111738]: pgmap v776: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:40 smithi149 ceph-mon[79770]: pgmap v776: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:42 smithi118 ceph-mon[111738]: pgmap v777: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:42 smithi149 ceph-mon[79770]: pgmap v777: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:44 smithi118 ceph-mon[111738]: pgmap v778: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:44 smithi149 ceph-mon[79770]: pgmap v778: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:46 smithi118 ceph-mon[111738]: pgmap v779: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:46.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:46 smithi149 ceph-mon[79770]: pgmap v779: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:47.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.431+0000 7facba8d2640 1 -- 172.21.15.118:0/2754268957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4100f80 msgr2=0x7facb41013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:47.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.431+0000 7facba8d2640 1 --2- 172.21.15.118:0/2754268957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4100f80 0x7facb41013e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7faca8009880 tx=0x7faca802a530 comp rx=0 tx=0).stop 2024-09-21T12:04:47.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.432+0000 7facba8d2640 1 -- 172.21.15.118:0/2754268957 shutdown_connections 2024-09-21T12:04:47.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.432+0000 7facba8d2640 1 --2- 172.21.15.118:0/2754268957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4100f80 0x7facb41013e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.432+0000 7facba8d2640 1 --2- 172.21.15.118:0/2754268957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb4106860 0x7facb4106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.432+0000 7facba8d2640 1 -- 172.21.15.118:0/2754268957 >> 172.21.15.118:0/2754268957 conn(0x7facb40fbc60 msgr2=0x7facb40fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:47.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.432+0000 7facba8d2640 1 -- 172.21.15.118:0/2754268957 shutdown_connections 2024-09-21T12:04:47.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.432+0000 7facba8d2640 1 -- 172.21.15.118:0/2754268957 wait complete. 2024-09-21T12:04:47.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.432+0000 7facba8d2640 1 Processor -- start 2024-09-21T12:04:47.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.432+0000 7facba8d2640 1 -- start start 2024-09-21T12:04:47.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facba8d2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb4100f80 0x7facb419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:47.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facba8d2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4106860 0x7facb419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:47.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facba8d2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7facb410dd20 con 0x7facb4106860 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facba8d2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7facb410dba0 con 0x7facb4100f80 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facb37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4106860 0x7facb419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facb37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4106860 0x7facb419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51086/0 (socket says 172.21.15.118:51086) 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facb37fe640 1 -- 172.21.15.118:0/2907917437 learned_addr learned my addr 172.21.15.118:0/2907917437 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facb3fff640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb4100f80 0x7facb419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facb37fe640 1 -- 172.21.15.118:0/2907917437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb4100f80 msgr2=0x7facb419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facb37fe640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb4100f80 0x7facb419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facb37fe640 1 -- 172.21.15.118:0/2907917437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb4197830 con 0x7facb4106860 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facb37fe640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4106860 0x7facb419dbf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7faca8031460 tx=0x7faca80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.433+0000 7facb17fa640 1 -- 172.21.15.118:0/2907917437 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faca803f070 con 0x7facb4106860 2024-09-21T12:04:47.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.434+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb4197ac0 con 0x7facb4106860 2024-09-21T12:04:47.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.434+0000 7facb17fa640 1 -- 172.21.15.118:0/2907917437 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faca80035f0 con 0x7facb4106860 2024-09-21T12:04:47.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.434+0000 7facb17fa640 1 -- 172.21.15.118:0/2907917437 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faca8035030 con 0x7facb4106860 2024-09-21T12:04:47.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.434+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb4197ff0 con 0x7facb4106860 2024-09-21T12:04:47.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.435+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb41013e0 con 0x7facb4106860 2024-09-21T12:04:47.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.435+0000 7facb17fa640 1 -- 172.21.15.118:0/2907917437 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7faca8042070 con 0x7facb4106860 2024-09-21T12:04:47.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.436+0000 7facb17fa640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fac9c07af30 0x7fac9c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:47.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.436+0000 7facb17fa640 1 -- 172.21.15.118:0/2907917437 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faca80bead0 con 0x7facb4106860 2024-09-21T12:04:47.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.436+0000 7facb3fff640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fac9c07af30 0x7fac9c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:47.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.436+0000 7facb3fff640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fac9c07af30 0x7fac9c07d3f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faca4005fd0 tx=0x7faca4005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:47.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.440+0000 7facb17fa640 1 -- 172.21.15.118:0/2907917437 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faca808a020 con 0x7facb4106860 2024-09-21T12:04:47.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.634+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7facb4198360 con 0x7fac9c07af30 2024-09-21T12:04:47.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.635+0000 7facb17fa640 1 -- 172.21.15.118:0/2907917437 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7facb4198360 con 0x7fac9c07af30 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.637+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fac9c07af30 msgr2=0x7fac9c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.637+0000 7facba8d2640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fac9c07af30 0x7fac9c07d3f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faca4005fd0 tx=0x7faca4005850 comp rx=0 tx=0).stop 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.637+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4106860 msgr2=0x7facb419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.637+0000 7facba8d2640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4106860 0x7facb419dbf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7faca8031460 tx=0x7faca80045e0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.638+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 shutdown_connections 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.638+0000 7facba8d2640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fac9c07af30 0x7fac9c07d3f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.638+0000 7facba8d2640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facb4106860 0x7facb419dbf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.638+0000 7facba8d2640 1 --2- 172.21.15.118:0/2907917437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facb4100f80 0x7facb419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.638+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 >> 172.21.15.118:0/2907917437 conn(0x7facb40fbc60 msgr2=0x7facb40fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.638+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 shutdown_connections 2024-09-21T12:04:47.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.638+0000 7facba8d2640 1 -- 172.21.15.118:0/2907917437 wait complete. 2024-09-21T12:04:47.649 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:04:47.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 -- 172.21.15.118:0/3470824776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110100820 msgr2=0x7fc110100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:47.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 --2- 172.21.15.118:0/3470824776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110100820 0x7fc110100c80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc100009c20 tx=0x7fc10002a970 comp rx=0 tx=0).stop 2024-09-21T12:04:47.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 -- 172.21.15.118:0/3470824776 shutdown_connections 2024-09-21T12:04:47.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 --2- 172.21.15.118:0/3470824776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110100820 0x7fc110100c80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 --2- 172.21.15.118:0/3470824776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc110106820 0x7fc110106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 -- 172.21.15.118:0/3470824776 >> 172.21.15.118:0/3470824776 conn(0x7fc1100fc520 msgr2=0x7fc1100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 -- 172.21.15.118:0/3470824776 shutdown_connections 2024-09-21T12:04:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 -- 172.21.15.118:0/3470824776 wait complete. 2024-09-21T12:04:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 Processor -- start 2024-09-21T12:04:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.720+0000 7fc116ee6640 1 -- start start 2024-09-21T12:04:47.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc116ee6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc110100820 0x7fc11019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc116ee6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110106820 0x7fc11019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc116ee6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc11010dcf0 con 0x7fc110106820 2024-09-21T12:04:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc116ee6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc11010db70 con 0x7fc110100820 2024-09-21T12:04:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc10ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110106820 0x7fc11019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc10ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110106820 0x7fc11019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51106/0 (socket says 172.21.15.118:51106) 2024-09-21T12:04:47.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc10ffff640 1 -- 172.21.15.118:0/3475384677 learned_addr learned my addr 172.21.15.118:0/3475384677 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc114c82640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc110100820 0x7fc11019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc10ffff640 1 -- 172.21.15.118:0/3475384677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc110100820 msgr2=0x7fc11019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc10ffff640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc110100820 0x7fc11019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc10ffff640 1 -- 172.21.15.118:0/3475384677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc110197810 con 0x7fc110106820 2024-09-21T12:04:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc114c82640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc110100820 0x7fc11019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:04:47.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc10ffff640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110106820 0x7fc11019dbd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc100005cc0 tx=0x7fc10002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc10dffb640 1 -- 172.21.15.118:0/3475384677 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc100047070 con 0x7fc110106820 2024-09-21T12:04:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.721+0000 7fc10dffb640 1 -- 172.21.15.118:0/3475384677 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc10002f7e0 con 0x7fc110106820 2024-09-21T12:04:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.722+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc110197aa0 con 0x7fc110106820 2024-09-21T12:04:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.722+0000 7fc10dffb640 1 -- 172.21.15.118:0/3475384677 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc100034070 con 0x7fc110106820 2024-09-21T12:04:47.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.722+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc110197fd0 con 0x7fc110106820 2024-09-21T12:04:47.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.723+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc110101f60 con 0x7fc110106820 2024-09-21T12:04:47.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.723+0000 7fc10dffb640 1 -- 172.21.15.118:0/3475384677 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc10004a070 con 0x7fc110106820 2024-09-21T12:04:47.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.724+0000 7fc10dffb640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc0fc07af80 0x7fc0fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:47.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.724+0000 7fc10dffb640 1 -- 172.21.15.118:0/3475384677 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc1000beee0 con 0x7fc110106820 2024-09-21T12:04:47.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.724+0000 7fc114c82640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc0fc07af80 0x7fc0fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:47.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.724+0000 7fc114c82640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc0fc07af80 0x7fc0fc07d440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8005fd0 tx=0x7fc0f8005ea0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:47.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.728+0000 7fc10dffb640 1 -- 172.21.15.118:0/3475384677 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc10003f070 con 0x7fc110106820 2024-09-21T12:04:47.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.922+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc110198340 con 0x7fc0fc07af80 2024-09-21T12:04:47.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.923+0000 7fc10dffb640 1 -- 172.21.15.118:0/3475384677 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc110198340 con 0x7fc0fc07af80 2024-09-21T12:04:47.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc0fc07af80 msgr2=0x7fc0fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:47.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc0fc07af80 0x7fc0fc07d440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8005fd0 tx=0x7fc0f8005ea0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110106820 msgr2=0x7fc11019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110106820 0x7fc11019dbd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc100005cc0 tx=0x7fc10002f5f0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 shutdown_connections 2024-09-21T12:04:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc0fc07af80 0x7fc0fc07d440 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc110106820 0x7fc11019dbd0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 --2- 172.21.15.118:0/3475384677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc110100820 0x7fc11019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 >> 172.21.15.118:0/3475384677 conn(0x7fc1100fc520 msgr2=0x7fc11006a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 shutdown_connections 2024-09-21T12:04:47.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:47.925+0000 7fc116ee6640 1 -- 172.21.15.118:0/3475384677 wait complete. 2024-09-21T12:04:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.006+0000 7ff635958640 1 -- 172.21.15.118:0/1997056899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff630102aa0 msgr2=0x7ff630102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.006+0000 7ff635958640 1 --2- 172.21.15.118:0/1997056899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff630102aa0 0x7ff630102e80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff620009c20 tx=0x7ff62002aa00 comp rx=0 tx=0).stop 2024-09-21T12:04:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.006+0000 7ff635958640 1 -- 172.21.15.118:0/1997056899 shutdown_connections 2024-09-21T12:04:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.006+0000 7ff635958640 1 --2- 172.21.15.118:0/1997056899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6301033c0 0x7ff63010b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.006+0000 7ff635958640 1 --2- 172.21.15.118:0/1997056899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff630102aa0 0x7ff630102e80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.007+0000 7ff635958640 1 -- 172.21.15.118:0/1997056899 >> 172.21.15.118:0/1997056899 conn(0x7ff6300fc4c0 msgr2=0x7ff6300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.007+0000 7ff635958640 1 -- 172.21.15.118:0/1997056899 shutdown_connections 2024-09-21T12:04:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.007+0000 7ff635958640 1 -- 172.21.15.118:0/1997056899 wait complete. 2024-09-21T12:04:48.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.007+0000 7ff635958640 1 Processor -- start 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.007+0000 7ff635958640 1 -- start start 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff635958640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff630102aa0 0x7ff630100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff635958640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6301033c0 0x7ff630100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff635958640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff63010edd0 con 0x7ff6301033c0 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff635958640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff63010ec50 con 0x7ff630102aa0 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff62e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6301033c0 0x7ff630100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff62e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6301033c0 0x7ff630100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51128/0 (socket says 172.21.15.118:51128) 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff62e7fc640 1 -- 172.21.15.118:0/2789689472 learned_addr learned my addr 172.21.15.118:0/2789689472 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff62effd640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff630102aa0 0x7ff630100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff62e7fc640 1 -- 172.21.15.118:0/2789689472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff630102aa0 msgr2=0x7ff630100700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff62e7fc640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff630102aa0 0x7ff630100700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff62e7fc640 1 -- 172.21.15.118:0/2789689472 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff630101180 con 0x7ff6301033c0 2024-09-21T12:04:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff62e7fc640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6301033c0 0x7ff630100c40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff61800d6d0 tx=0x7ff61800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff634956640 1 -- 172.21.15.118:0/2789689472 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff618017070 con 0x7ff6301033c0 2024-09-21T12:04:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff634956640 1 -- 172.21.15.118:0/2789689472 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6180054e0 con 0x7ff6301033c0 2024-09-21T12:04:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.008+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff630101470 con 0x7ff6301033c0 2024-09-21T12:04:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.009+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6301a3f80 con 0x7ff6301033c0 2024-09-21T12:04:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.009+0000 7ff634956640 1 -- 172.21.15.118:0/2789689472 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff618004ae0 con 0x7ff6301033c0 2024-09-21T12:04:48.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.010+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff610005290 con 0x7ff6301033c0 2024-09-21T12:04:48.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.011+0000 7ff634956640 1 -- 172.21.15.118:0/2789689472 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff618010460 con 0x7ff6301033c0 2024-09-21T12:04:48.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.011+0000 7ff634956640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff61c07af40 0x7ff61c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.012+0000 7ff634956640 1 -- 172.21.15.118:0/2789689472 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff61809db10 con 0x7ff6301033c0 2024-09-21T12:04:48.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.012+0000 7ff62effd640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff61c07af40 0x7ff61c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.012+0000 7ff62effd640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff61c07af40 0x7ff61c07d400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff620009430 tx=0x7ff62003a040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:48.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.016+0000 7ff634956640 1 -- 172.21.15.118:0/2789689472 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff618069060 con 0x7ff6301033c0 2024-09-21T12:04:48.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.205+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff610000bc0 con 0x7ff61c07af40 2024-09-21T12:04:48.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.214+0000 7ff634956640 1 -- 172.21.15.118:0/2789689472 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff610000bc0 con 0x7ff61c07af40 2024-09-21T12:04:48.216 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:04:48.216 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (22m) 85s ago 33m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (25m) 85s ago 33m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (25m) 87s ago 32m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (20m) 85s ago 33m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (20m) 87s ago 32m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (22m) 85s ago 33m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (17m) 85s ago 28m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (16m) 85s ago 28m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (91s) 87s ago 28m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (16m) 87s ago 28m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:04:48.217 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (24m) 85s ago 35m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (23m) 87s ago 32m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (21m) 85s ago 35m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (21m) 87s ago 32m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (23m) 85s ago 33m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (23m) 87s ago 32m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (20m) 85s ago 31m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (19m) 85s ago 31m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (19m) 85s ago 30m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (18m) 87s ago 30m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (18m) 87s ago 29m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (17m) 87s ago 29m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:04:48.218 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (23m) 85s ago 33m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:04:48.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff61c07af40 msgr2=0x7ff61c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff61c07af40 0x7ff61c07d400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff620009430 tx=0x7ff62003a040 comp rx=0 tx=0).stop 2024-09-21T12:04:48.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6301033c0 msgr2=0x7ff630100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6301033c0 0x7ff630100c40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff61800d6d0 tx=0x7ff61800db90 comp rx=0 tx=0).stop 2024-09-21T12:04:48.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 shutdown_connections 2024-09-21T12:04:48.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff61c07af40 0x7ff61c07d400 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6301033c0 0x7ff630100c40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 --2- 172.21.15.118:0/2789689472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff630102aa0 0x7ff630100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 >> 172.21.15.118:0/2789689472 conn(0x7ff6300fc4c0 msgr2=0x7ff630108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:48.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 shutdown_connections 2024-09-21T12:04:48.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.216+0000 7ff635958640 1 -- 172.21.15.118:0/2789689472 wait complete. 2024-09-21T12:04:48.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.296+0000 7fb8454d9640 1 -- 172.21.15.118:0/3770370185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 msgr2=0x7fb840101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.296+0000 7fb8454d9640 1 --2- 172.21.15.118:0/3770370185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 0x7fb840101d70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb830009880 tx=0x7fb83002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.296+0000 7fb8454d9640 1 -- 172.21.15.118:0/3770370185 shutdown_connections 2024-09-21T12:04:48.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.296+0000 7fb8454d9640 1 --2- 172.21.15.118:0/3770370185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 0x7fb840101d70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.296+0000 7fb8454d9640 1 --2- 172.21.15.118:0/3770370185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb840107910 0x7fb840107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.296+0000 7fb8454d9640 1 -- 172.21.15.118:0/3770370185 >> 172.21.15.118:0/3770370185 conn(0x7fb8400fd630 msgr2=0x7fb8400ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:48.299 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:48 smithi118 ceph-mon[111738]: pgmap v780: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:48.299 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:48 smithi118 ceph-mon[111738]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.296+0000 7fb8454d9640 1 -- 172.21.15.118:0/3770370185 shutdown_connections 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.296+0000 7fb8454d9640 1 -- 172.21.15.118:0/3770370185 wait complete. 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.296+0000 7fb8454d9640 1 Processor -- start 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb8454d9640 1 -- start start 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb8454d9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 0x7fb8400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb8454d9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb840107910 0x7fb840074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb8454d9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb84010ede0 con 0x7fb840101910 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb8454d9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb84010ec60 con 0x7fb840107910 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb83effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 0x7fb8400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb83effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 0x7fb8400744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51160/0 (socket says 172.21.15.118:51160) 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb83effd640 1 -- 172.21.15.118:0/209148163 learned_addr learned my addr 172.21.15.118:0/209148163 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:48.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb83e7fc640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb840107910 0x7fb840074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb83effd640 1 -- 172.21.15.118:0/209148163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb840107910 msgr2=0x7fb840074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb83effd640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb840107910 0x7fb840074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.297+0000 7fb83effd640 1 -- 172.21.15.118:0/209148163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb840074f70 con 0x7fb840101910 2024-09-21T12:04:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.298+0000 7fb83effd640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 0x7fb8400744f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb83400d6f0 tx=0x7fb83400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.298+0000 7fb827fff640 1 -- 172.21.15.118:0/209148163 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb834017070 con 0x7fb840101910 2024-09-21T12:04:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.298+0000 7fb827fff640 1 -- 172.21.15.118:0/209148163 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb83400de00 con 0x7fb840101910 2024-09-21T12:04:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.298+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb840075260 con 0x7fb840101910 2024-09-21T12:04:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.298+0000 7fb827fff640 1 -- 172.21.15.118:0/209148163 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb834004bb0 con 0x7fb840101910 2024-09-21T12:04:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.298+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8401a3e30 con 0x7fb840101910 2024-09-21T12:04:48.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.299+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb840103050 con 0x7fb840101910 2024-09-21T12:04:48.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.300+0000 7fb827fff640 1 -- 172.21.15.118:0/209148163 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb834010460 con 0x7fb840101910 2024-09-21T12:04:48.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.300+0000 7fb827fff640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb82807af40 0x7fb82807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.301+0000 7fb827fff640 1 -- 172.21.15.118:0/209148163 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb83409dcd0 con 0x7fb840101910 2024-09-21T12:04:48.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.301+0000 7fb83e7fc640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb82807af40 0x7fb82807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.301+0000 7fb83e7fc640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb82807af40 0x7fb82807d400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb840075f80 tx=0x7fb830031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:48.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.305+0000 7fb827fff640 1 -- 172.21.15.118:0/209148163 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb834069220 con 0x7fb840101910 2024-09-21T12:04:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:48 smithi149 ceph-mon[79770]: pgmap v780: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:48.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:48 smithi149 ceph-mon[79770]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:48.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.550+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb840101d70 con 0x7fb840101910 2024-09-21T12:04:48.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.550+0000 7fb827fff640 1 -- 172.21.15.118:0/209148163 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb83406e0d0 con 0x7fb840101910 2024-09-21T12:04:48.552 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:04:48.552 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:04:48.553 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:04:48.554 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:04:48.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.552+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb82807af40 msgr2=0x7fb82807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.552+0000 7fb8454d9640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb82807af40 0x7fb82807d400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb840075f80 tx=0x7fb830031400 comp rx=0 tx=0).stop 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.552+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 msgr2=0x7fb8400744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.552+0000 7fb8454d9640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 0x7fb8400744f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb83400d6f0 tx=0x7fb83400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.552+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 shutdown_connections 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.552+0000 7fb8454d9640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb840107910 0x7fb840074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.552+0000 7fb8454d9640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb82807af40 0x7fb82807d400 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.552+0000 7fb8454d9640 1 --2- 172.21.15.118:0/209148163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb840101910 0x7fb8400744f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.552+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 >> 172.21.15.118:0/209148163 conn(0x7fb8400fd630 msgr2=0x7fb8400fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.553+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 shutdown_connections 2024-09-21T12:04:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.553+0000 7fb8454d9640 1 -- 172.21.15.118:0/209148163 wait complete. 2024-09-21T12:04:48.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.634+0000 7fba5a92d640 1 -- 172.21.15.118:0/1573193128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 msgr2=0x7fba54100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.634+0000 7fba5a92d640 1 --2- 172.21.15.118:0/1573193128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 0x7fba54100c40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fba48009880 tx=0x7fba4802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.635+0000 7fba5a92d640 1 -- 172.21.15.118:0/1573193128 shutdown_connections 2024-09-21T12:04:48.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.635+0000 7fba5a92d640 1 --2- 172.21.15.118:0/1573193128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 0x7fba54100c40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.635+0000 7fba5a92d640 1 --2- 172.21.15.118:0/1573193128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba541067e0 0x7fba54106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.635+0000 7fba5a92d640 1 -- 172.21.15.118:0/1573193128 >> 172.21.15.118:0/1573193128 conn(0x7fba540fc4c0 msgr2=0x7fba540fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:48.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.635+0000 7fba5a92d640 1 -- 172.21.15.118:0/1573193128 shutdown_connections 2024-09-21T12:04:48.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.635+0000 7fba5a92d640 1 -- 172.21.15.118:0/1573193128 wait complete. 2024-09-21T12:04:48.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.635+0000 7fba5a92d640 1 Processor -- start 2024-09-21T12:04:48.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.635+0000 7fba5a92d640 1 -- start start 2024-09-21T12:04:48.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba5a92d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 0x7fba5419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba5a92d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba541067e0 0x7fba5419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba5a92d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fba5410dd10 con 0x7fba541007e0 2024-09-21T12:04:48.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba5a92d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fba5410db90 con 0x7fba541067e0 2024-09-21T12:04:48.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba53fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 0x7fba5419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba53fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 0x7fba5419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51182/0 (socket says 172.21.15.118:51182) 2024-09-21T12:04:48.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba53fff640 1 -- 172.21.15.118:0/1769140447 learned_addr learned my addr 172.21.15.118:0/1769140447 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:48.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba537fe640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba541067e0 0x7fba5419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba53fff640 1 -- 172.21.15.118:0/1769140447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba541067e0 msgr2=0x7fba5419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba53fff640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba541067e0 0x7fba5419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba53fff640 1 -- 172.21.15.118:0/1769140447 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba54197800 con 0x7fba541007e0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba53fff640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 0x7fba5419d680 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fba4400b420 tx=0x7fba4400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba517fa640 1 -- 172.21.15.118:0/1769140447 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba44011630 con 0x7fba541007e0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba517fa640 1 -- 172.21.15.118:0/1769140447 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba44016070 con 0x7fba541007e0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba517fa640 1 -- 172.21.15.118:0/1769140447 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba44010d40 con 0x7fba541007e0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba54197af0 con 0x7fba541007e0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.636+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba54198080 con 0x7fba541007e0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.637+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba54101f20 con 0x7fba541007e0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.638+0000 7fba517fa640 1 -- 172.21.15.118:0/1769140447 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fba4401b460 con 0x7fba541007e0 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.638+0000 7fba517fa640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba3c07af30 0x7fba3c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.639+0000 7fba517fa640 1 -- 172.21.15.118:0/1769140447 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fba4409d7f0 con 0x7fba541007e0 2024-09-21T12:04:48.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.639+0000 7fba537fe640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba3c07af30 0x7fba3c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.639+0000 7fba537fe640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba3c07af30 0x7fba3c07d3f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fba48031460 tx=0x7fba48009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:48.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.643+0000 7fba517fa640 1 -- 172.21.15.118:0/1769140447 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba44021250 con 0x7fba541007e0 2024-09-21T12:04:48.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.857+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fba54109d80 con 0x7fba541007e0 2024-09-21T12:04:48.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.857+0000 7fba517fa640 1 -- 172.21.15.118:0/1769140447 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7fba44068d40 con 0x7fba541007e0 2024-09-21T12:04:48.862 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:04:48.862 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:04:48.862 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:04:48.862 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:04:48.862 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:04:48.862 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:04:48.863 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:04:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:04:48.865 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba3c07af30 msgr2=0x7fba3c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba3c07af30 0x7fba3c07d3f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fba48031460 tx=0x7fba48009560 comp rx=0 tx=0).stop 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 msgr2=0x7fba5419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 0x7fba5419d680 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fba4400b420 tx=0x7fba4400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 shutdown_connections 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba541067e0 0x7fba5419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba3c07af30 0x7fba3c07d3f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 --2- 172.21.15.118:0/1769140447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba541007e0 0x7fba5419d680 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 >> 172.21.15.118:0/1769140447 conn(0x7fba540fc4c0 msgr2=0x7fba54069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:48.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 shutdown_connections 2024-09-21T12:04:48.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.860+0000 7fba5a92d640 1 -- 172.21.15.118:0/1769140447 wait complete. 2024-09-21T12:04:48.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.942+0000 7fed8563a640 1 -- 172.21.15.118:0/4213463124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80101930 msgr2=0x7fed80101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.942+0000 7fed8563a640 1 --2- 172.21.15.118:0/4213463124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80101930 0x7fed80101d90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fed74009880 tx=0x7fed7402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.942+0000 7fed8563a640 1 -- 172.21.15.118:0/4213463124 shutdown_connections 2024-09-21T12:04:48.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.942+0000 7fed8563a640 1 --2- 172.21.15.118:0/4213463124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80101930 0x7fed80101d90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.942+0000 7fed8563a640 1 --2- 172.21.15.118:0/4213463124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed80107930 0x7fed80107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.942+0000 7fed8563a640 1 -- 172.21.15.118:0/4213463124 >> 172.21.15.118:0/4213463124 conn(0x7fed800fd630 msgr2=0x7fed800ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:48.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.942+0000 7fed8563a640 1 -- 172.21.15.118:0/4213463124 shutdown_connections 2024-09-21T12:04:48.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.942+0000 7fed8563a640 1 -- 172.21.15.118:0/4213463124 wait complete. 2024-09-21T12:04:48.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed8563a640 1 Processor -- start 2024-09-21T12:04:48.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed8563a640 1 -- start start 2024-09-21T12:04:48.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed8563a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed80101930 0x7fed8019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed8563a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80107930 0x7fed8019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed8563a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fed8010ede0 con 0x7fed80107930 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed8563a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed8010ec60 con 0x7fed80101930 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed7e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80107930 0x7fed8019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed7e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80107930 0x7fed8019dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51198/0 (socket says 172.21.15.118:51198) 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed7e7fc640 1 -- 172.21.15.118:0/1961138950 learned_addr learned my addr 172.21.15.118:0/1961138950 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed7effd640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed80101930 0x7fed8019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed7e7fc640 1 -- 172.21.15.118:0/1961138950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed80101930 msgr2=0x7fed8019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed7e7fc640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed80101930 0x7fed8019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.943+0000 7fed7e7fc640 1 -- 172.21.15.118:0/1961138950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed80197850 con 0x7fed80107930 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.944+0000 7fed7e7fc640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80107930 0x7fed8019dc10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fed74031460 tx=0x7fed740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.944+0000 7fed67fff640 1 -- 172.21.15.118:0/1961138950 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed7403f070 con 0x7fed80107930 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.944+0000 7fed67fff640 1 -- 172.21.15.118:0/1961138950 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed74004cf0 con 0x7fed80107930 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.944+0000 7fed67fff640 1 -- 172.21.15.118:0/1961138950 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed74035030 con 0x7fed80107930 2024-09-21T12:04:48.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.944+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed80197ae0 con 0x7fed80107930 2024-09-21T12:04:48.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.944+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed80198010 con 0x7fed80107930 2024-09-21T12:04:48.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.945+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed80103070 con 0x7fed80107930 2024-09-21T12:04:48.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.946+0000 7fed67fff640 1 -- 172.21.15.118:0/1961138950 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fed74042070 con 0x7fed80107930 2024-09-21T12:04:48.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.946+0000 7fed67fff640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed6807af30 0x7fed6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:48.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.946+0000 7fed67fff640 1 -- 172.21.15.118:0/1961138950 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fed740beb70 con 0x7fed80107930 2024-09-21T12:04:48.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.946+0000 7fed7effd640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed6807af30 0x7fed6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:48.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.947+0000 7fed7effd640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed6807af30 0x7fed6807d3f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fed700058c0 tx=0x7fed7000a4c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:48.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:48.951+0000 7fed67fff640 1 -- 172.21.15.118:0/1961138950 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed7408a0c0 con 0x7fed80107930 2024-09-21T12:04:49.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.145+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fed80198d80 con 0x7fed6807af30 2024-09-21T12:04:49.148 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:49 smithi118 ceph-mon[111738]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:49.148 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:49 smithi118 ceph-mon[111738]: from='client.35236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:49.148 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:49 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/209148163' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:04:49.148 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:49 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1769140447' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:04:49.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.146+0000 7fed67fff640 1 -- 172.21.15.118:0/1961138950 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fed80198d80 con 0x7fed6807af30 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:04:49.149 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:04:49.150 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:04:49.150 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:04:49.150 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:04:49.150 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed6807af30 msgr2=0x7fed6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed6807af30 0x7fed6807d3f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fed700058c0 tx=0x7fed7000a4c0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80107930 msgr2=0x7fed8019dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80107930 0x7fed8019dc10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fed74031460 tx=0x7fed740048f0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 shutdown_connections 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed6807af30 0x7fed6807d3f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed80107930 0x7fed8019dc10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 --2- 172.21.15.118:0/1961138950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed80101930 0x7fed8019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 >> 172.21.15.118:0/1961138950 conn(0x7fed800fd630 msgr2=0x7fed800fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 shutdown_connections 2024-09-21T12:04:49.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.148+0000 7fed8563a640 1 -- 172.21.15.118:0/1961138950 wait complete. 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.231+0000 7fd7fa07a640 1 -- 172.21.15.118:0/4163348444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4101930 msgr2=0x7fd7f4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.231+0000 7fd7fa07a640 1 --2- 172.21.15.118:0/4163348444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4101930 0x7fd7f4101d90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009880 tx=0x7fd7dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.231+0000 7fd7fa07a640 1 -- 172.21.15.118:0/4163348444 shutdown_connections 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.231+0000 7fd7fa07a640 1 --2- 172.21.15.118:0/4163348444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4101930 0x7fd7f4101d90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.231+0000 7fd7fa07a640 1 --2- 172.21.15.118:0/4163348444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7f4107930 0x7fd7f4107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.231+0000 7fd7fa07a640 1 -- 172.21.15.118:0/4163348444 >> 172.21.15.118:0/4163348444 conn(0x7fd7f40fd630 msgr2=0x7fd7f40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.231+0000 7fd7fa07a640 1 -- 172.21.15.118:0/4163348444 shutdown_connections 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.231+0000 7fd7fa07a640 1 -- 172.21.15.118:0/4163348444 wait complete. 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.231+0000 7fd7fa07a640 1 Processor -- start 2024-09-21T12:04:49.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7fa07a640 1 -- start start 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7fa07a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7f4101930 0x7fd7f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7fa07a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4107930 0x7fd7f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7fa07a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f410ede0 con 0x7fd7f4107930 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7fa07a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f410ec60 con 0x7fd7f4101930 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7ebfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4107930 0x7fd7f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7ebfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4107930 0x7fd7f4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51220/0 (socket says 172.21.15.118:51220) 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7ebfff640 1 -- 172.21.15.118:0/2372390518 learned_addr learned my addr 172.21.15.118:0/2372390518 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7f37fe640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7f4101930 0x7fd7f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7ebfff640 1 -- 172.21.15.118:0/2372390518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7f4101930 msgr2=0x7fd7f40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7ebfff640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7f4101930 0x7fd7f40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7ebfff640 1 -- 172.21.15.118:0/2372390518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f4074f70 con 0x7fd7f4107930 2024-09-21T12:04:49.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7f37fe640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7f4101930 0x7fd7f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:04:49.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7ebfff640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4107930 0x7fd7f4074a30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc031460 tx=0x7fd7dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:49.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.232+0000 7fd7f17fa640 1 -- 172.21.15.118:0/2372390518 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7dc03f070 con 0x7fd7f4107930 2024-09-21T12:04:49.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.233+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f4075200 con 0x7fd7f4107930 2024-09-21T12:04:49.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.233+0000 7fd7f17fa640 1 -- 172.21.15.118:0/2372390518 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7dc0035f0 con 0x7fd7f4107930 2024-09-21T12:04:49.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.233+0000 7fd7f17fa640 1 -- 172.21.15.118:0/2372390518 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7dc035030 con 0x7fd7f4107930 2024-09-21T12:04:49.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.233+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f41a3e10 con 0x7fd7f4107930 2024-09-21T12:04:49.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.234+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f4103070 con 0x7fd7f4107930 2024-09-21T12:04:49.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.234+0000 7fd7f17fa640 1 -- 172.21.15.118:0/2372390518 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd7dc042070 con 0x7fd7f4107930 2024-09-21T12:04:49.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.235+0000 7fd7f17fa640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd7e007af30 0x7fd7e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:04:49.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.235+0000 7fd7f17fa640 1 -- 172.21.15.118:0/2372390518 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd7dc0bead0 con 0x7fd7f4107930 2024-09-21T12:04:49.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.235+0000 7fd7f37fe640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd7e007af30 0x7fd7e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:04:49.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.235+0000 7fd7f37fe640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd7e007af30 0x7fd7e007d3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40058c0 tx=0x7fd7e4005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:04:49.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.239+0000 7fd7f17fa640 1 -- 172.21.15.118:0/2372390518 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7dc08a020 con 0x7fd7f4107930 2024-09-21T12:04:49.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:49 smithi149 ceph-mon[79770]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:49.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:49 smithi149 ceph-mon[79770]: from='client.35236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:49.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:49 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/209148163' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:04:49.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:49 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1769140447' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:04:49.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.486+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd7f4075a20 con 0x7fd7f4107930 2024-09-21T12:04:49.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.487+0000 7fd7f17fa640 1 -- 172.21.15.118:0/2372390518 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fd7dc08c020 con 0x7fd7f4107930 2024-09-21T12:04:49.489 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:04:49.489 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:04:49.490 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:04:49.491 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:04:49.491 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:04:49.491 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:04:49.491 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:04:49.491 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:04:49.491 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:04:49.491 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:04:49.491 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:04:49.491 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:04:49.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd7e007af30 msgr2=0x7fd7e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:49.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd7e007af30 0x7fd7e007d3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40058c0 tx=0x7fd7e4005850 comp rx=0 tx=0).stop 2024-09-21T12:04:49.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4107930 msgr2=0x7fd7f4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:04:49.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4107930 0x7fd7f4074a30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc031460 tx=0x7fd7dc0045e0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 shutdown_connections 2024-09-21T12:04:49.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd7e007af30 0x7fd7e007d3f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7f4107930 0x7fd7f4074a30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 --2- 172.21.15.118:0/2372390518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7f4101930 0x7fd7f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:04:49.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 >> 172.21.15.118:0/2372390518 conn(0x7fd7f40fd630 msgr2=0x7fd7f40fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:04:49.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 shutdown_connections 2024-09-21T12:04:49.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:04:49.490+0000 7fd7fa07a640 1 -- 172.21.15.118:0/2372390518 wait complete. 2024-09-21T12:04:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:50 smithi118 ceph-mon[111738]: pgmap v781: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:50 smithi118 ceph-mon[111738]: from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:50 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2372390518' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:04:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:04:50.351 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:50 smithi149 ceph-mon[79770]: pgmap v781: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:50.351 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:50 smithi149 ceph-mon[79770]: from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:04:50.351 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:50 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2372390518' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:04:50.351 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:04:53.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:52 smithi149 ceph-mon[79770]: pgmap v782: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:53.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:52 smithi118 ceph-mon[111738]: pgmap v782: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:55.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:54 smithi149 ceph-mon[79770]: pgmap v783: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:55.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:54 smithi118 ceph-mon[111738]: pgmap v783: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:57.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:56 smithi149 ceph-mon[79770]: pgmap v784: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:57.318 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:56 smithi118 ceph-mon[111738]: pgmap v784: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:59.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:04:58 smithi149 ceph-mon[79770]: pgmap v785: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:04:59.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:04:58 smithi118 ceph-mon[111738]: pgmap v785: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:01.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:00 smithi149 ceph-mon[79770]: pgmap v786: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:01.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:00 smithi118 ceph-mon[111738]: pgmap v786: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:03.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:02 smithi149 ceph-mon[79770]: pgmap v787: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:03.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:02 smithi118 ceph-mon[111738]: pgmap v787: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:05.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:04 smithi149 ceph-mon[79770]: pgmap v788: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:04 smithi118 ceph-mon[111738]: pgmap v788: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:06.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:05:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:05:07.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:06 smithi149 ceph-mon[79770]: pgmap v789: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:07.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:06 smithi118 ceph-mon[111738]: pgmap v789: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:08.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:07 smithi149 ceph-mon[79770]: pgmap v790: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:07 smithi118 ceph-mon[111738]: pgmap v790: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:09 smithi118 ceph-mon[111738]: pgmap v791: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:09 smithi149 ceph-mon[79770]: pgmap v791: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:11 smithi118 ceph-mon[111738]: pgmap v792: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:11 smithi149 ceph-mon[79770]: pgmap v792: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:13 smithi118 ceph-mon[111738]: pgmap v793: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:13 smithi149 ceph-mon[79770]: pgmap v793: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:16.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:15 smithi118 ceph-mon[111738]: pgmap v794: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:15 smithi149 ceph-mon[79770]: pgmap v794: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:17 smithi118 ceph-mon[111738]: pgmap v795: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:17 smithi149 ceph-mon[79770]: pgmap v795: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:19.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.585+0000 7faf12bb2640 1 -- 172.21.15.118:0/2538042589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 msgr2=0x7faf0c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:19.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.585+0000 7faf12bb2640 1 --2- 172.21.15.118:0/2538042589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 0x7faf0c100c40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faf00009880 tx=0x7faf0002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.585+0000 7faf12bb2640 1 -- 172.21.15.118:0/2538042589 shutdown_connections 2024-09-21T12:05:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.585+0000 7faf12bb2640 1 --2- 172.21.15.118:0/2538042589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 0x7faf0c100c40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.585+0000 7faf12bb2640 1 --2- 172.21.15.118:0/2538042589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c1067e0 0x7faf0c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.585+0000 7faf12bb2640 1 -- 172.21.15.118:0/2538042589 >> 172.21.15.118:0/2538042589 conn(0x7faf0c0fc4c0 msgr2=0x7faf0c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.585+0000 7faf12bb2640 1 -- 172.21.15.118:0/2538042589 shutdown_connections 2024-09-21T12:05:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.585+0000 7faf12bb2640 1 -- 172.21.15.118:0/2538042589 wait complete. 2024-09-21T12:05:19.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf12bb2640 1 Processor -- start 2024-09-21T12:05:19.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf12bb2640 1 -- start start 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf12bb2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 0x7faf0c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf12bb2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c1067e0 0x7faf0c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf12bb2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c10dd10 con 0x7faf0c1007e0 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf12bb2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c10db90 con 0x7faf0c1067e0 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf1094e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 0x7faf0c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf1094e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 0x7faf0c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57552/0 (socket says 172.21.15.118:57552) 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf1094e640 1 -- 172.21.15.118:0/3684051186 learned_addr learned my addr 172.21.15.118:0/3684051186 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf0bfff640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c1067e0 0x7faf0c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf1094e640 1 -- 172.21.15.118:0/3684051186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c1067e0 msgr2=0x7faf0c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf1094e640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c1067e0 0x7faf0c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.586+0000 7faf1094e640 1 -- 172.21.15.118:0/3684051186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c197820 con 0x7faf0c1007e0 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.587+0000 7faf1094e640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 0x7faf0c19d6a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7faefc00b420 tx=0x7faefc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.587+0000 7faf09ffb640 1 -- 172.21.15.118:0/3684051186 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faefc011630 con 0x7faf0c1007e0 2024-09-21T12:05:19.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.587+0000 7faf09ffb640 1 -- 172.21.15.118:0/3684051186 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faefc016070 con 0x7faf0c1007e0 2024-09-21T12:05:19.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.587+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c197b10 con 0x7faf0c1007e0 2024-09-21T12:05:19.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.587+0000 7faf09ffb640 1 -- 172.21.15.118:0/3684051186 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faefc010d40 con 0x7faf0c1007e0 2024-09-21T12:05:19.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.587+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c198070 con 0x7faf0c1007e0 2024-09-21T12:05:19.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.588+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c101f20 con 0x7faf0c1007e0 2024-09-21T12:05:19.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.589+0000 7faf09ffb640 1 -- 172.21.15.118:0/3684051186 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7faefc01b460 con 0x7faf0c1007e0 2024-09-21T12:05:19.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.589+0000 7faf09ffb640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faef407af80 0x7faef407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:19.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.589+0000 7faf09ffb640 1 -- 172.21.15.118:0/3684051186 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faefc09d750 con 0x7faf0c1007e0 2024-09-21T12:05:19.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.589+0000 7faf0bfff640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faef407af80 0x7faef407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:19.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.590+0000 7faf0bfff640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faef407af80 0x7faef407d440 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faf0c198b70 tx=0x7faf00031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:19.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.593+0000 7faf09ffb640 1 -- 172.21.15.118:0/3684051186 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faefc068d20 con 0x7faf0c1007e0 2024-09-21T12:05:19.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.789+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faf0c198380 con 0x7faef407af80 2024-09-21T12:05:19.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.790+0000 7faf09ffb640 1 -- 172.21.15.118:0/3684051186 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7faf0c198380 con 0x7faef407af80 2024-09-21T12:05:19.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faef407af80 msgr2=0x7faef407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faef407af80 0x7faef407d440 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faf0c198b70 tx=0x7faf00031400 comp rx=0 tx=0).stop 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 msgr2=0x7faf0c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 0x7faf0c19d6a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7faefc00b420 tx=0x7faefc00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 shutdown_connections 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c1067e0 0x7faf0c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faef407af80 0x7faef407d440 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 --2- 172.21.15.118:0/3684051186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf0c1007e0 0x7faf0c19d6a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 >> 172.21.15.118:0/3684051186 conn(0x7faf0c0fc4c0 msgr2=0x7faf0c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 shutdown_connections 2024-09-21T12:05:19.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.792+0000 7faf12bb2640 1 -- 172.21.15.118:0/3684051186 wait complete. 2024-09-21T12:05:19.804 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:05:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.874+0000 7f09c3ef2640 1 -- 172.21.15.118:0/609736862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 msgr2=0x7f09bc1001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.874+0000 7f09c3ef2640 1 --2- 172.21.15.118:0/609736862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 0x7f09bc1001d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009880 tx=0x7f09b002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.874+0000 7f09c3ef2640 1 -- 172.21.15.118:0/609736862 shutdown_connections 2024-09-21T12:05:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.874+0000 7f09c3ef2640 1 --2- 172.21.15.118:0/609736862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 0x7f09bc1001d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.874+0000 7f09c3ef2640 1 --2- 172.21.15.118:0/609736862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09bc106950 0x7f09bc106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.874+0000 7f09c3ef2640 1 -- 172.21.15.118:0/609736862 >> 172.21.15.118:0/609736862 conn(0x7f09bc0fbc60 msgr2=0x7f09bc0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.875+0000 7f09c3ef2640 1 -- 172.21.15.118:0/609736862 shutdown_connections 2024-09-21T12:05:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.875+0000 7f09c3ef2640 1 -- 172.21.15.118:0/609736862 wait complete. 2024-09-21T12:05:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.875+0000 7f09c3ef2640 1 Processor -- start 2024-09-21T12:05:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.875+0000 7f09c3ef2640 1 -- start start 2024-09-21T12:05:19.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.875+0000 7f09c3ef2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 0x7f09bc19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:19.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.875+0000 7f09c3ef2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09bc106950 0x7f09bc19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.875+0000 7f09c3ef2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc10eef0 con 0x7f09bc0ffd70 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.875+0000 7f09c3ef2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc10ed70 con 0x7f09bc106950 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.875+0000 7f09c1c8e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 0x7f09bc19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c1c8e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 0x7f09bc19f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57570/0 (socket says 172.21.15.118:57570) 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c1c8e640 1 -- 172.21.15.118:0/1094454937 learned_addr learned my addr 172.21.15.118:0/1094454937 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c148d640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09bc106950 0x7f09bc19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c1c8e640 1 -- 172.21.15.118:0/1094454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09bc106950 msgr2=0x7f09bc19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c1c8e640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09bc106950 0x7f09bc19fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c1c8e640 1 -- 172.21.15.118:0/1094454937 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc199a70 con 0x7f09bc0ffd70 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c148d640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09bc106950 0x7f09bc19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c1c8e640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 0x7f09bc19f8b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00ea00 tx=0x7f09ac00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09baffd640 1 -- 172.21.15.118:0/1094454937 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09ac00cb80 con 0x7f09bc0ffd70 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc199d60 con 0x7f09bc0ffd70 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09bc19a2c0 con 0x7f09bc0ffd70 2024-09-21T12:05:19.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09baffd640 1 -- 172.21.15.118:0/1094454937 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09ac00cd20 con 0x7f09bc0ffd70 2024-09-21T12:05:19.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.876+0000 7f09baffd640 1 -- 172.21.15.118:0/1094454937 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09ac011470 con 0x7f09bc0ffd70 2024-09-21T12:05:19.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.877+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09bc103090 con 0x7f09bc0ffd70 2024-09-21T12:05:19.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.878+0000 7f09baffd640 1 -- 172.21.15.118:0/1094454937 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f09ac005020 con 0x7f09bc0ffd70 2024-09-21T12:05:19.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.878+0000 7f09baffd640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f09a407af30 0x7f09a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.878+0000 7f09c148d640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f09a407af30 0x7f09a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.878+0000 7f09baffd640 1 -- 172.21.15.118:0/1094454937 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f09ac09e570 con 0x7f09bc0ffd70 2024-09-21T12:05:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.879+0000 7f09c148d640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f09a407af30 0x7f09a407d3f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f09bc19b260 tx=0x7f09b0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:19.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:19.883+0000 7f09baffd640 1 -- 172.21.15.118:0/1094454937 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09ac016030 con 0x7f09bc0ffd70 2024-09-21T12:05:20.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.079+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f09bc19b0b0 con 0x7f09a407af30 2024-09-21T12:05:20.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.080+0000 7f09baffd640 1 -- 172.21.15.118:0/1094454937 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f09bc19b0b0 con 0x7f09a407af30 2024-09-21T12:05:20.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f09a407af30 msgr2=0x7f09a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f09a407af30 0x7f09a407d3f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f09bc19b260 tx=0x7f09b0031400 comp rx=0 tx=0).stop 2024-09-21T12:05:20.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 msgr2=0x7f09bc19f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 0x7f09bc19f8b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00ea00 tx=0x7f09ac00eec0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 shutdown_connections 2024-09-21T12:05:20.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09bc106950 0x7f09bc19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f09a407af30 0x7f09a407d3f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 --2- 172.21.15.118:0/1094454937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09bc0ffd70 0x7f09bc19f8b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 >> 172.21.15.118:0/1094454937 conn(0x7f09bc0fbc60 msgr2=0x7f09bc0fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:20.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 shutdown_connections 2024-09-21T12:05:20.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.082+0000 7f09c3ef2640 1 -- 172.21.15.118:0/1094454937 wait complete. 2024-09-21T12:05:20.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 -- 172.21.15.118:0/1616024376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8106820 msgr2=0x7f16b8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 --2- 172.21.15.118:0/1616024376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8106820 0x7f16b8106c00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009880 tx=0x7f16a802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 -- 172.21.15.118:0/1616024376 shutdown_connections 2024-09-21T12:05:20.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 --2- 172.21.15.118:0/1616024376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b8100820 0x7f16b8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 --2- 172.21.15.118:0/1616024376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8106820 0x7f16b8106c00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 -- 172.21.15.118:0/1616024376 >> 172.21.15.118:0/1616024376 conn(0x7f16b80fc520 msgr2=0x7f16b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:20.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 -- 172.21.15.118:0/1616024376 shutdown_connections 2024-09-21T12:05:20.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 -- 172.21.15.118:0/1616024376 wait complete. 2024-09-21T12:05:20.167 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:19 smithi118 ceph-mon[111738]: pgmap v796: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:20.167 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:19 smithi118 ceph-mon[111738]: from='client.35256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:20.167 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:19 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:05:20.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 Processor -- start 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.164+0000 7f16be2c0640 1 -- start start 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16be2c0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8100820 0x7f16b819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16be2c0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b8106820 0x7f16b819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16be2c0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f16b810dd50 con 0x7f16b8100820 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16be2c0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16b810dbd0 con 0x7f16b8106820 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16b7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8100820 0x7f16b819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16b7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8100820 0x7f16b819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57590/0 (socket says 172.21.15.118:57590) 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16b7fff640 1 -- 172.21.15.118:0/1602998406 learned_addr learned my addr 172.21.15.118:0/1602998406 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16b77fe640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b8106820 0x7f16b819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16b7fff640 1 -- 172.21.15.118:0/1602998406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b8106820 msgr2=0x7f16b819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16b7fff640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b8106820 0x7f16b819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16b7fff640 1 -- 172.21.15.118:0/1602998406 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b8197840 con 0x7f16b8100820 2024-09-21T12:05:20.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16b77fe640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b8106820 0x7f16b819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:05:20.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.165+0000 7f16b7fff640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8100820 0x7f16b819d6c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f16a8031460 tx=0x7f16a80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:20.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.166+0000 7f16b57fa640 1 -- 172.21.15.118:0/1602998406 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16a803f070 con 0x7f16b8100820 2024-09-21T12:05:20.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.166+0000 7f16b57fa640 1 -- 172.21.15.118:0/1602998406 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16a8004cf0 con 0x7f16b8100820 2024-09-21T12:05:20.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.166+0000 7f16b57fa640 1 -- 172.21.15.118:0/1602998406 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16a8035030 con 0x7f16b8100820 2024-09-21T12:05:20.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.166+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b8197ad0 con 0x7f16b8100820 2024-09-21T12:05:20.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.166+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b8198000 con 0x7f16b8100820 2024-09-21T12:05:20.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.167+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b8101f60 con 0x7f16b8100820 2024-09-21T12:05:20.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.167+0000 7f16b57fa640 1 -- 172.21.15.118:0/1602998406 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f16a8042070 con 0x7f16b8100820 2024-09-21T12:05:20.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.168+0000 7f16b57fa640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f16a407af80 0x7f16a407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:20.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.168+0000 7f16b57fa640 1 -- 172.21.15.118:0/1602998406 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f16a80bea90 con 0x7f16b8100820 2024-09-21T12:05:20.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.168+0000 7f16b77fe640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f16a407af80 0x7f16a407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:20.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.168+0000 7f16b77fe640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f16a407af80 0x7f16a407d440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f16b8104fa0 tx=0x7f16a0008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:20.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.172+0000 7f16b57fa640 1 -- 172.21.15.118:0/1602998406 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16a808a060 con 0x7f16b8100820 2024-09-21T12:05:20.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.357+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f16b8198370 con 0x7f16a407af80 2024-09-21T12:05:20.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.366+0000 7f16b57fa640 1 -- 172.21.15.118:0/1602998406 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f16b8198370 con 0x7f16a407af80 2024-09-21T12:05:20.368 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (23m) 117s ago 34m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (26m) 117s ago 34m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (25m) 2m ago 33m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (21m) 117s ago 34m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (21m) 2m ago 33m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (22m) 117s ago 34m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (17m) 117s ago 28m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (17m) 117s ago 28m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (2m) 2m ago 28m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (17m) 2m ago 28m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (25m) 117s ago 35m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (24m) 2m ago 33m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (21m) 117s ago 35m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (21m) 2m ago 33m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (24m) 117s ago 34m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:05:20.369 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (24m) 2m ago 33m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:05:20.370 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (20m) 117s ago 32m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:05:20.370 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (20m) 117s ago 31m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:05:20.370 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (19m) 117s ago 31m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:05:20.370 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (19m) 2m ago 30m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:05:20.370 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (18m) 2m ago 30m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:05:20.370 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (17m) 2m ago 29m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:05:20.370 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (23m) 117s ago 33m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.368+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f16a407af80 msgr2=0x7f16a407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.368+0000 7f16be2c0640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f16a407af80 0x7f16a407d440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f16b8104fa0 tx=0x7f16a0008040 comp rx=0 tx=0).stop 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.368+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8100820 msgr2=0x7f16b819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.368+0000 7f16be2c0640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8100820 0x7f16b819d6c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f16a8031460 tx=0x7f16a80048f0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.369+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 shutdown_connections 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.369+0000 7f16be2c0640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b8106820 0x7f16b819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.369+0000 7f16be2c0640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f16a407af80 0x7f16a407d440 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.369+0000 7f16be2c0640 1 --2- 172.21.15.118:0/1602998406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16b8100820 0x7f16b819d6c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.369+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 >> 172.21.15.118:0/1602998406 conn(0x7f16b80fc520 msgr2=0x7f16b806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.369+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 shutdown_connections 2024-09-21T12:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.369+0000 7f16be2c0640 1 -- 172.21.15.118:0/1602998406 wait complete. 2024-09-21T12:05:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:20 smithi149 ceph-mon[79770]: pgmap v796: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:20 smithi149 ceph-mon[79770]: from='client.35256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:05:20.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.449+0000 7f116fd2f640 1 -- 172.21.15.118:0/1441583945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 msgr2=0x7f1168101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.449+0000 7f116fd2f640 1 --2- 172.21.15.118:0/1441583945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f1168101d90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f115c009880 tx=0x7f115c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.449+0000 7f116fd2f640 1 -- 172.21.15.118:0/1441583945 shutdown_connections 2024-09-21T12:05:20.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.449+0000 7f116fd2f640 1 --2- 172.21.15.118:0/1441583945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f1168101d90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.449+0000 7f116fd2f640 1 --2- 172.21.15.118:0/1441583945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168107930 0x7f1168107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.449+0000 7f116fd2f640 1 -- 172.21.15.118:0/1441583945 >> 172.21.15.118:0/1441583945 conn(0x7f11680fd630 msgr2=0x7f11680ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:20.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.449+0000 7f116fd2f640 1 -- 172.21.15.118:0/1441583945 shutdown_connections 2024-09-21T12:05:20.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.449+0000 7f116fd2f640 1 -- 172.21.15.118:0/1441583945 wait complete. 2024-09-21T12:05:20.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.450+0000 7f116fd2f640 1 Processor -- start 2024-09-21T12:05:20.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.450+0000 7f116fd2f640 1 -- start start 2024-09-21T12:05:20.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.450+0000 7f116fd2f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f11680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:20.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.450+0000 7f116fd2f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168107930 0x7f1168074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.450+0000 7f116fd2f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f116810ede0 con 0x7f1168101930 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.450+0000 7f116fd2f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f116810ec60 con 0x7f1168107930 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.450+0000 7f116dacb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f11680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.450+0000 7f116dacb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f11680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57606/0 (socket says 172.21.15.118:57606) 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.450+0000 7f116dacb640 1 -- 172.21.15.118:0/3028044008 learned_addr learned my addr 172.21.15.118:0/3028044008 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f116d2ca640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168107930 0x7f1168074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f116dacb640 1 -- 172.21.15.118:0/3028044008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168107930 msgr2=0x7f1168074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f116dacb640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168107930 0x7f1168074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f116dacb640 1 -- 172.21.15.118:0/3028044008 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1168074f70 con 0x7f1168101930 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f116dacb640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f11680744f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f116000d8d0 tx=0x7f116000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f1166ffd640 1 -- 172.21.15.118:0/3028044008 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1160017070 con 0x7f1168101930 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f1166ffd640 1 -- 172.21.15.118:0/3028044008 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1160010460 con 0x7f1168101930 2024-09-21T12:05:20.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f1166ffd640 1 -- 172.21.15.118:0/3028044008 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f116000f5f0 con 0x7f1168101930 2024-09-21T12:05:20.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1168075260 con 0x7f1168101930 2024-09-21T12:05:20.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.451+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11681a3ed0 con 0x7f1168101930 2024-09-21T12:05:20.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.453+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1168103070 con 0x7f1168101930 2024-09-21T12:05:20.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.453+0000 7f1166ffd640 1 -- 172.21.15.118:0/3028044008 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1160009a30 con 0x7f1168101930 2024-09-21T12:05:20.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.453+0000 7f1166ffd640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115007af30 0x7f115007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:20.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.453+0000 7f1166ffd640 1 -- 172.21.15.118:0/3028044008 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f116009dec0 con 0x7f1168101930 2024-09-21T12:05:20.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.453+0000 7f116d2ca640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115007af30 0x7f115007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:20.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.454+0000 7f116d2ca640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115007af30 0x7f115007d3f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1168075f80 tx=0x7f115c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:20.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.458+0000 7f1166ffd640 1 -- 172.21.15.118:0/3028044008 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1160069410 con 0x7f1168101930 2024-09-21T12:05:20.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.706+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1168109ec0 con 0x7f1168101930 2024-09-21T12:05:20.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.706+0000 7f1166ffd640 1 -- 172.21.15.118:0/3028044008 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f116006e2c0 con 0x7f1168101930 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:05:20.709 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:05:20.710 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:05:20.710 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:05:20.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115007af30 msgr2=0x7f115007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115007af30 0x7f115007d3f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1168075f80 tx=0x7f115c031400 comp rx=0 tx=0).stop 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 msgr2=0x7f11680744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f11680744f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f116000d8d0 tx=0x7f116000dd90 comp rx=0 tx=0).stop 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 shutdown_connections 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1168107930 0x7f1168074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f115007af30 0x7f115007d3f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 --2- 172.21.15.118:0/3028044008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1168101930 0x7f11680744f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 >> 172.21.15.118:0/3028044008 conn(0x7f11680fd630 msgr2=0x7f11680fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 shutdown_connections 2024-09-21T12:05:20.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.708+0000 7f116fd2f640 1 -- 172.21.15.118:0/3028044008 wait complete. 2024-09-21T12:05:20.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.789+0000 7f8d744f2640 1 -- 172.21.15.118:0/1015926122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 msgr2=0x7f8d6c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.789+0000 7f8d744f2640 1 --2- 172.21.15.118:0/1015926122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 0x7f8d6c100c40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009880 tx=0x7f8d5c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 -- 172.21.15.118:0/1015926122 shutdown_connections 2024-09-21T12:05:20.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 --2- 172.21.15.118:0/1015926122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 0x7f8d6c100c40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 --2- 172.21.15.118:0/1015926122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d6c1067e0 0x7f8d6c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 -- 172.21.15.118:0/1015926122 >> 172.21.15.118:0/1015926122 conn(0x7f8d6c0fc4c0 msgr2=0x7f8d6c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 -- 172.21.15.118:0/1015926122 shutdown_connections 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 -- 172.21.15.118:0/1015926122 wait complete. 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 Processor -- start 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 -- start start 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 0x7f8d6c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d6c1067e0 0x7f8d6c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c10dcb0 con 0x7f8d6c1007e0 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.790+0000 7f8d744f2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c10db30 con 0x7f8d6c1067e0 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d7228e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 0x7f8d6c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d7228e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 0x7f8d6c1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57630/0 (socket says 172.21.15.118:57630) 2024-09-21T12:05:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d7228e640 1 -- 172.21.15.118:0/391806036 learned_addr learned my addr 172.21.15.118:0/391806036 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d71a8d640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d6c1067e0 0x7f8d6c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d7228e640 1 -- 172.21.15.118:0/391806036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d6c1067e0 msgr2=0x7f8d6c198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d7228e640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d6c1067e0 0x7f8d6c198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d7228e640 1 -- 172.21.15.118:0/391806036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c199320 con 0x7f8d6c1007e0 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d71a8d640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d6c1067e0 0x7f8d6c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d7228e640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 0x7f8d6c1987e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800d6f0 tx=0x7f8d6800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d637fe640 1 -- 172.21.15.118:0/391806036 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d68017070 con 0x7f8d6c1007e0 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d637fe640 1 -- 172.21.15.118:0/391806036 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d6800de00 con 0x7f8d6c1007e0 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c199610 con 0x7f8d6c1007e0 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d637fe640 1 -- 172.21.15.118:0/391806036 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d68004bb0 con 0x7f8d6c1007e0 2024-09-21T12:05:20.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.791+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c1a1c10 con 0x7f8d6c1007e0 2024-09-21T12:05:20.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.792+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c101f20 con 0x7f8d6c1007e0 2024-09-21T12:05:20.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.793+0000 7f8d637fe640 1 -- 172.21.15.118:0/391806036 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8d68009a30 con 0x7f8d6c1007e0 2024-09-21T12:05:20.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.793+0000 7f8d637fe640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d5807af80 0x7f8d5807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:20.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.793+0000 7f8d637fe640 1 -- 172.21.15.118:0/391806036 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8d6809dc20 con 0x7f8d6c1007e0 2024-09-21T12:05:20.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.793+0000 7f8d71a8d640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d5807af80 0x7f8d5807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:20.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.794+0000 7f8d71a8d640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d5807af80 0x7f8d5807d440 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c06a680 tx=0x7f8d5c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:20.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:20.798+0000 7f8d637fe640 1 -- 172.21.15.118:0/391806036 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d6c199610 con 0x7f8d6c1007e0 2024-09-21T12:05:21.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.013+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8d6c108d50 con 0x7f8d6c1007e0 2024-09-21T12:05:21.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.014+0000 7f8d637fe640 1 -- 172.21.15.118:0/391806036 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f8d680691f0 con 0x7f8d6c1007e0 2024-09-21T12:05:21.016 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:05:21.016 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:05:21.016 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:05:21.016 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:05:21.016 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:05:21.016 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:05:21.016 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:05:21.017 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:05:21.018 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:05:21.019 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:05:21.019 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:05:21.019 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:05:21.019 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:05:21.019 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:05:21.019 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d5807af80 msgr2=0x7f8d5807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d5807af80 0x7f8d5807d440 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c06a680 tx=0x7f8d5c031400 comp rx=0 tx=0).stop 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 msgr2=0x7f8d6c1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 0x7f8d6c1987e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800d6f0 tx=0x7f8d6800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 shutdown_connections 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d6c1067e0 0x7f8d6c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d5807af80 0x7f8d5807d440 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 --2- 172.21.15.118:0/391806036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d6c1007e0 0x7f8d6c1987e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 >> 172.21.15.118:0/391806036 conn(0x7f8d6c0fc4c0 msgr2=0x7f8d6c0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 shutdown_connections 2024-09-21T12:05:21.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.016+0000 7f8d744f2640 1 -- 172.21.15.118:0/391806036 wait complete. 2024-09-21T12:05:21.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.098+0000 7fda07e42640 1 -- 172.21.15.118:0/4034473414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00106820 msgr2=0x7fda00106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.098+0000 7fda07e42640 1 --2- 172.21.15.118:0/4034473414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00106820 0x7fda00106c00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009880 tx=0x7fd9f402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.098+0000 7fda07e42640 1 -- 172.21.15.118:0/4034473414 shutdown_connections 2024-09-21T12:05:21.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.098+0000 7fda07e42640 1 --2- 172.21.15.118:0/4034473414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda00100820 0x7fda00100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.098+0000 7fda07e42640 1 --2- 172.21.15.118:0/4034473414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00106820 0x7fda00106c00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.098+0000 7fda07e42640 1 -- 172.21.15.118:0/4034473414 >> 172.21.15.118:0/4034473414 conn(0x7fda000fc520 msgr2=0x7fda000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:21.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.098+0000 7fda07e42640 1 -- 172.21.15.118:0/4034473414 shutdown_connections 2024-09-21T12:05:21.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.098+0000 7fda07e42640 1 -- 172.21.15.118:0/4034473414 wait complete. 2024-09-21T12:05:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda07e42640 1 Processor -- start 2024-09-21T12:05:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda07e42640 1 -- start start 2024-09-21T12:05:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda07e42640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00100820 0x7fda0019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda07e42640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda00106820 0x7fda0019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda07e42640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fda0006b0e0 con 0x7fda00100820 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda07e42640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fda0006af60 con 0x7fda00106820 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda05bde640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00100820 0x7fda0019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda05bde640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00100820 0x7fda0019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57648/0 (socket says 172.21.15.118:57648) 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda05bde640 1 -- 172.21.15.118:0/988384115 learned_addr learned my addr 172.21.15.118:0/988384115 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda053dd640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda00106820 0x7fda0019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda05bde640 1 -- 172.21.15.118:0/988384115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda00106820 msgr2=0x7fda0019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda05bde640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda00106820 0x7fda0019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda05bde640 1 -- 172.21.15.118:0/988384115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda001977e0 con 0x7fda00100820 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.099+0000 7fda05bde640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00100820 0x7fda0019d660 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4031460 tx=0x7fd9f4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.100+0000 7fd9f2ffd640 1 -- 172.21.15.118:0/988384115 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9f403f070 con 0x7fda00100820 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.100+0000 7fd9f2ffd640 1 -- 172.21.15.118:0/988384115 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9f40035f0 con 0x7fda00100820 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.100+0000 7fd9f2ffd640 1 -- 172.21.15.118:0/988384115 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9f4035030 con 0x7fda00100820 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.100+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda00197a70 con 0x7fda00100820 2024-09-21T12:05:21.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.100+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda00197fa0 con 0x7fda00100820 2024-09-21T12:05:21.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.101+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda00101f60 con 0x7fda00100820 2024-09-21T12:05:21.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.101+0000 7fd9f2ffd640 1 -- 172.21.15.118:0/988384115 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd9f4042070 con 0x7fda00100820 2024-09-21T12:05:21.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.102+0000 7fd9f2ffd640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd9ec07af80 0x7fd9ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:21.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.102+0000 7fd9f2ffd640 1 -- 172.21.15.118:0/988384115 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd9f40be990 con 0x7fda00100820 2024-09-21T12:05:21.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.102+0000 7fda053dd640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd9ec07af80 0x7fd9ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:21.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.102+0000 7fda053dd640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd9ec07af80 0x7fd9ec07d440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fda000feb60 tx=0x7fd9fc005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:21.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.106+0000 7fd9f2ffd640 1 -- 172.21.15.118:0/988384115 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9f4089f60 con 0x7fda00100820 2024-09-21T12:05:21.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.298+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fda00198310 con 0x7fd9ec07af80 2024-09-21T12:05:21.301 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:21 smithi118 ceph-mon[111738]: from='client.35260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:21.301 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:21 smithi118 ceph-mon[111738]: from='client.35264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:21.301 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:21 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3028044008' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:05:21.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.300+0000 7fd9f2ffd640 1 -- 172.21.15.118:0/988384115 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fda00198310 con 0x7fd9ec07af80 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:05:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:05:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:05:21.303 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:05:21.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd9ec07af80 msgr2=0x7fd9ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd9ec07af80 0x7fd9ec07d440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fda000feb60 tx=0x7fd9fc005f90 comp rx=0 tx=0).stop 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00100820 msgr2=0x7fda0019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00100820 0x7fda0019d660 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4031460 tx=0x7fd9f4004530 comp rx=0 tx=0).stop 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 shutdown_connections 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda00106820 0x7fda0019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd9ec07af80 0x7fd9ec07d440 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 --2- 172.21.15.118:0/988384115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda00100820 0x7fda0019d660 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 >> 172.21.15.118:0/988384115 conn(0x7fda000fc520 msgr2=0x7fda000fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 shutdown_connections 2024-09-21T12:05:21.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.302+0000 7fda07e42640 1 -- 172.21.15.118:0/988384115 wait complete. 2024-09-21T12:05:21.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.383+0000 7f782b0ea640 1 -- 172.21.15.118:0/2660587950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074eb0 msgr2=0x7f7824112400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.383+0000 7f782b0ea640 1 --2- 172.21.15.118:0/2660587950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074eb0 0x7f7824112400 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7810009880 tx=0x7f781002a530 comp rx=0 tx=0).stop 2024-09-21T12:05:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.383+0000 7f782b0ea640 1 -- 172.21.15.118:0/2660587950 shutdown_connections 2024-09-21T12:05:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.383+0000 7f782b0ea640 1 --2- 172.21.15.118:0/2660587950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074eb0 0x7f7824112400 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.383+0000 7f782b0ea640 1 --2- 172.21.15.118:0/2660587950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7824074590 0x7f7824074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.383+0000 7f782b0ea640 1 -- 172.21.15.118:0/2660587950 >> 172.21.15.118:0/2660587950 conn(0x7f78240fd630 msgr2=0x7f78240ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.383+0000 7f782b0ea640 1 -- 172.21.15.118:0/2660587950 shutdown_connections 2024-09-21T12:05:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.383+0000 7f782b0ea640 1 -- 172.21.15.118:0/2660587950 wait complete. 2024-09-21T12:05:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f782b0ea640 1 Processor -- start 2024-09-21T12:05:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f782b0ea640 1 -- start start 2024-09-21T12:05:21.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f782b0ea640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074590 0x7f782419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f782b0ea640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7824074eb0 0x7f782419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f782b0ea640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7824115410 con 0x7f7824074590 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f782b0ea640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7824115290 con 0x7f7824074eb0 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f7828e86640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074590 0x7f782419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f7828e86640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074590 0x7f782419df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57672/0 (socket says 172.21.15.118:57672) 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f7828e86640 1 -- 172.21.15.118:0/1881870868 learned_addr learned my addr 172.21.15.118:0/1881870868 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f7823fff640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7824074eb0 0x7f782419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f7828e86640 1 -- 172.21.15.118:0/1881870868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7824074eb0 msgr2=0x7f782419e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f7828e86640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7824074eb0 0x7f782419e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f7828e86640 1 -- 172.21.15.118:0/1881870868 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78241a2860 con 0x7f7824074590 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f7823fff640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7824074eb0 0x7f782419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:05:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.384+0000 7f7828e86640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074590 0x7f782419df90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f781800cc60 tx=0x7f781800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.385+0000 7f7821ffb640 1 -- 172.21.15.118:0/1881870868 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f781800ad30 con 0x7f7824074590 2024-09-21T12:05:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.385+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78241a2b50 con 0x7f7824074590 2024-09-21T12:05:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.385+0000 7f7821ffb640 1 -- 172.21.15.118:0/1881870868 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7818005020 con 0x7f7824074590 2024-09-21T12:05:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.385+0000 7f7821ffb640 1 -- 172.21.15.118:0/1881870868 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f781800f640 con 0x7f7824074590 2024-09-21T12:05:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.385+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78241a30e0 con 0x7f7824074590 2024-09-21T12:05:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.386+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7824075cd0 con 0x7f7824074590 2024-09-21T12:05:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.387+0000 7f7821ffb640 1 -- 172.21.15.118:0/1881870868 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f78180051d0 con 0x7f7824074590 2024-09-21T12:05:21.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.387+0000 7f7821ffb640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f781407af80 0x7f781407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:21.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.387+0000 7f7821ffb640 1 -- 172.21.15.118:0/1881870868 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f781809e2e0 con 0x7f7824074590 2024-09-21T12:05:21.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.387+0000 7f7823fff640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f781407af80 0x7f781407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:21.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.388+0000 7f7823fff640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f781407af80 0x7f781407d440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7810006010 tx=0x7f78100095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:21.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.391+0000 7f7821ffb640 1 -- 172.21.15.118:0/1881870868 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7818014030 con 0x7f7824074590 2024-09-21T12:05:21.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:21 smithi149 ceph-mon[79770]: from='client.35260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:21.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:21 smithi149 ceph-mon[79770]: from='client.35264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:21.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:21 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3028044008' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:05:21.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.641+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f782419f2f0 con 0x7f7824074590 2024-09-21T12:05:21.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.641+0000 7f7821ffb640 1 -- 172.21.15.118:0/1881870868 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f7818069850 con 0x7f7824074590 2024-09-21T12:05:21.643 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:05:21.644 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:05:21.645 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:05:21.645 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:05:21.645 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:05:21.645 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:05:21.645 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:05:21.645 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:05:21.645 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:05:21.645 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:05:21.645 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.643+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f781407af80 msgr2=0x7f781407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.643+0000 7f782b0ea640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f781407af80 0x7f781407d440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7810006010 tx=0x7f78100095f0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.643+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074590 msgr2=0x7f782419df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.643+0000 7f782b0ea640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074590 0x7f782419df90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f781800cc60 tx=0x7f781800a620 comp rx=0 tx=0).stop 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.643+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 shutdown_connections 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.643+0000 7f782b0ea640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7824074eb0 0x7f782419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.643+0000 7f782b0ea640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f781407af80 0x7f781407d440 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.643+0000 7f782b0ea640 1 --2- 172.21.15.118:0/1881870868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7824074590 0x7f782419df90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.643+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 >> 172.21.15.118:0/1881870868 conn(0x7f78240fd630 msgr2=0x7f7824104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.644+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 shutdown_connections 2024-09-21T12:05:21.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:21.644+0000 7f782b0ea640 1 -- 172.21.15.118:0/1881870868 wait complete. 2024-09-21T12:05:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:22 smithi118 ceph-mon[111738]: pgmap v797: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:22 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/391806036' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:05:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:22 smithi118 ceph-mon[111738]: from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:22 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1881870868' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:05:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:22 smithi149 ceph-mon[79770]: pgmap v797: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:22 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/391806036' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:05:22.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:22 smithi149 ceph-mon[79770]: from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:22.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:22 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1881870868' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:05:24.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:24 smithi149 ceph-mon[79770]: pgmap v798: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:24 smithi118 ceph-mon[111738]: pgmap v798: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:26 smithi118 ceph-mon[111738]: pgmap v799: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:26 smithi149 ceph-mon[79770]: pgmap v799: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:28.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:28 smithi118 ceph-mon[111738]: pgmap v800: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:28 smithi149 ceph-mon[79770]: pgmap v800: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:30 smithi118 ceph-mon[111738]: pgmap v801: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:30 smithi149 ceph-mon[79770]: pgmap v801: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:32.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:32 smithi118 ceph-mon[111738]: pgmap v802: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:32 smithi149 ceph-mon[79770]: pgmap v802: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:34 smithi118 ceph-mon[111738]: pgmap v803: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:34 smithi149 ceph-mon[79770]: pgmap v803: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:05:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:05:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:36 smithi118 ceph-mon[111738]: pgmap v804: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:36 smithi149 ceph-mon[79770]: pgmap v804: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:38 smithi118 ceph-mon[111738]: pgmap v805: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:38 smithi149 ceph-mon[79770]: pgmap v805: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:40 smithi118 ceph-mon[111738]: pgmap v806: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:40 smithi149 ceph-mon[79770]: pgmap v806: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:43.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:42 smithi149 ceph-mon[79770]: pgmap v807: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:42 smithi118 ceph-mon[111738]: pgmap v807: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:45.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:44 smithi149 ceph-mon[79770]: pgmap v808: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:44 smithi118 ceph-mon[111738]: pgmap v808: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:47.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:46 smithi149 ceph-mon[79770]: pgmap v809: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:47.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:46 smithi118 ceph-mon[111738]: pgmap v809: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:49.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:48 smithi149 ceph-mon[79770]: pgmap v810: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:49.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:48 smithi118 ceph-mon[111738]: pgmap v810: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:51.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:50 smithi149 ceph-mon[79770]: pgmap v811: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:51.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:05:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:50 smithi118 ceph-mon[111738]: pgmap v811: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:05:51.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.738+0000 7f012eb9d640 1 -- 172.21.15.118:0/22026473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281067e0 msgr2=0x7f0128106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:51.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.738+0000 7f012eb9d640 1 --2- 172.21.15.118:0/22026473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281067e0 0x7f0128106bc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0118009880 tx=0x7f011802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:51.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.738+0000 7f012eb9d640 1 -- 172.21.15.118:0/22026473 shutdown_connections 2024-09-21T12:05:51.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.738+0000 7f012eb9d640 1 --2- 172.21.15.118:0/22026473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01281007e0 0x7f0128100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:51.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.738+0000 7f012eb9d640 1 --2- 172.21.15.118:0/22026473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281067e0 0x7f0128106bc0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:51.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.738+0000 7f012eb9d640 1 -- 172.21.15.118:0/22026473 >> 172.21.15.118:0/22026473 conn(0x7f01280fc4c0 msgr2=0x7f01280fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:51.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.738+0000 7f012eb9d640 1 -- 172.21.15.118:0/22026473 shutdown_connections 2024-09-21T12:05:51.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.738+0000 7f012eb9d640 1 -- 172.21.15.118:0/22026473 wait complete. 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f012eb9d640 1 Processor -- start 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f012eb9d640 1 -- start start 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f012eb9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281007e0 0x7f0128198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f012eb9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01281067e0 0x7f0128198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f012eb9d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f012810dcb0 con 0x7f01281007e0 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f012eb9d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f012810db30 con 0x7f01281067e0 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f012c939640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281007e0 0x7f0128198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f012c939640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281007e0 0x7f0128198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33134/0 (socket says 172.21.15.118:33134) 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f012c939640 1 -- 172.21.15.118:0/3590446592 learned_addr learned my addr 172.21.15.118:0/3590446592 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.739+0000 7f0127fff640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01281067e0 0x7f0128198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:51.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.740+0000 7f012c939640 1 -- 172.21.15.118:0/3590446592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01281067e0 msgr2=0x7f0128198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.740+0000 7f012c939640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01281067e0 0x7f0128198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.740+0000 7f012c939640 1 -- 172.21.15.118:0/3590446592 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0128199360 con 0x7f01281007e0 2024-09-21T12:05:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.740+0000 7f012c939640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281007e0 0x7f0128198820 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0118031460 tx=0x7f01180045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.740+0000 7f0125ffb640 1 -- 172.21.15.118:0/3590446592 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f011803f070 con 0x7f01281007e0 2024-09-21T12:05:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.740+0000 7f0125ffb640 1 -- 172.21.15.118:0/3590446592 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01180035f0 con 0x7f01281007e0 2024-09-21T12:05:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.740+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01281995f0 con 0x7f01281007e0 2024-09-21T12:05:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.740+0000 7f0125ffb640 1 -- 172.21.15.118:0/3590446592 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0118035030 con 0x7f01281007e0 2024-09-21T12:05:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.740+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01281a1ba0 con 0x7f01281007e0 2024-09-21T12:05:51.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.742+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0128101f20 con 0x7f01281007e0 2024-09-21T12:05:51.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.742+0000 7f0125ffb640 1 -- 172.21.15.118:0/3590446592 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0118042070 con 0x7f01281007e0 2024-09-21T12:05:51.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.743+0000 7f0125ffb640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f011407af30 0x7f011407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:51.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.743+0000 7f0125ffb640 1 -- 172.21.15.118:0/3590446592 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f01180bea20 con 0x7f01281007e0 2024-09-21T12:05:51.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.743+0000 7f0127fff640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f011407af30 0x7f011407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:51.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.743+0000 7f0127fff640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f011407af30 0x7f011407d3f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f012806a680 tx=0x7f011000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:51.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.747+0000 7f0125ffb640 1 -- 172.21.15.118:0/3590446592 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0118089f70 con 0x7f01281007e0 2024-09-21T12:05:51.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.946+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0128062630 con 0x7f011407af30 2024-09-21T12:05:51.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.947+0000 7f0125ffb640 1 -- 172.21.15.118:0/3590446592 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0128062630 con 0x7f011407af30 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.949+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f011407af30 msgr2=0x7f011407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.949+0000 7f012eb9d640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f011407af30 0x7f011407d3f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f012806a680 tx=0x7f011000b390 comp rx=0 tx=0).stop 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.949+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281007e0 msgr2=0x7f0128198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.949+0000 7f012eb9d640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281007e0 0x7f0128198820 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0118031460 tx=0x7f01180045e0 comp rx=0 tx=0).stop 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.949+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 shutdown_connections 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.949+0000 7f012eb9d640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01281067e0 0x7f0128198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.949+0000 7f012eb9d640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f011407af30 0x7f011407d3f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.949+0000 7f012eb9d640 1 --2- 172.21.15.118:0/3590446592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01281007e0 0x7f0128198820 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.949+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 >> 172.21.15.118:0/3590446592 conn(0x7f01280fc4c0 msgr2=0x7f01280fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.950+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 shutdown_connections 2024-09-21T12:05:51.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:51.950+0000 7f012eb9d640 1 -- 172.21.15.118:0/3590446592 wait complete. 2024-09-21T12:05:51.960 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:05:52.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.033+0000 7fbe0752b640 1 -- 172.21.15.118:0/110876470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00106820 msgr2=0x7fbe00106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.033+0000 7fbe0752b640 1 --2- 172.21.15.118:0/110876470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00106820 0x7fbe00106c00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009880 tx=0x7fbdfc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.033+0000 7fbe0752b640 1 -- 172.21.15.118:0/110876470 shutdown_connections 2024-09-21T12:05:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.033+0000 7fbe0752b640 1 --2- 172.21.15.118:0/110876470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe00100820 0x7fbe00100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.033+0000 7fbe0752b640 1 --2- 172.21.15.118:0/110876470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00106820 0x7fbe00106c00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.033+0000 7fbe0752b640 1 -- 172.21.15.118:0/110876470 >> 172.21.15.118:0/110876470 conn(0x7fbe000fc520 msgr2=0x7fbe000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.033+0000 7fbe0752b640 1 -- 172.21.15.118:0/110876470 shutdown_connections 2024-09-21T12:05:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.033+0000 7fbe0752b640 1 -- 172.21.15.118:0/110876470 wait complete. 2024-09-21T12:05:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe0752b640 1 Processor -- start 2024-09-21T12:05:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe0752b640 1 -- start start 2024-09-21T12:05:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe0752b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00100820 0x7fbe0019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe0752b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe00106820 0x7fbe0019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe0752b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0010dcf0 con 0x7fbe00100820 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe0752b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0010db70 con 0x7fbe00106820 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe052c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00100820 0x7fbe0019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe052c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00100820 0x7fbe0019f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33162/0 (socket says 172.21.15.118:33162) 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe052c7640 1 -- 172.21.15.118:0/2801534164 learned_addr learned my addr 172.21.15.118:0/2801534164 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.034+0000 7fbe04ac6640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe00106820 0x7fbe0019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.035+0000 7fbe052c7640 1 -- 172.21.15.118:0/2801534164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe00106820 msgr2=0x7fbe0019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.035+0000 7fbe052c7640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe00106820 0x7fbe0019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.035+0000 7fbe052c7640 1 -- 172.21.15.118:0/2801534164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe00199a40 con 0x7fbe00100820 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.035+0000 7fbe052c7640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00100820 0x7fbe0019f880 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc031460 tx=0x7fbdfc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.035+0000 7fbdf67fc640 1 -- 172.21.15.118:0/2801534164 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdfc03f070 con 0x7fbe00100820 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.035+0000 7fbdf67fc640 1 -- 172.21.15.118:0/2801534164 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbdfc0035f0 con 0x7fbe00100820 2024-09-21T12:05:52.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.035+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe00199cd0 con 0x7fbe00100820 2024-09-21T12:05:52.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.035+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0019a200 con 0x7fbe00100820 2024-09-21T12:05:52.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.035+0000 7fbdf67fc640 1 -- 172.21.15.118:0/2801534164 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdfc035030 con 0x7fbe00100820 2024-09-21T12:05:52.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.036+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe00101f60 con 0x7fbe00100820 2024-09-21T12:05:52.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.037+0000 7fbdf67fc640 1 -- 172.21.15.118:0/2801534164 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbdfc042070 con 0x7fbe00100820 2024-09-21T12:05:52.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.038+0000 7fbdf67fc640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbdec07af80 0x7fbdec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.038+0000 7fbe04ac6640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbdec07af80 0x7fbdec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.038+0000 7fbdf67fc640 1 -- 172.21.15.118:0/2801534164 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbdfc0be910 con 0x7fbe00100820 2024-09-21T12:05:52.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.038+0000 7fbe04ac6640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbdec07af80 0x7fbdec07d440 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbe000fe3e0 tx=0x7fbdf000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:52.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.042+0000 7fbdf67fc640 1 -- 172.21.15.118:0/2801534164 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbdfc089ee0 con 0x7fbe00100820 2024-09-21T12:05:52.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.236+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbe0019b070 con 0x7fbdec07af80 2024-09-21T12:05:52.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.238+0000 7fbdf67fc640 1 -- 172.21.15.118:0/2801534164 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fbdf0003890 con 0x7fbdec07af80 2024-09-21T12:05:52.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbdec07af80 msgr2=0x7fbdec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbdec07af80 0x7fbdec07d440 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbe000fe3e0 tx=0x7fbdf000b390 comp rx=0 tx=0).stop 2024-09-21T12:05:52.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00100820 msgr2=0x7fbe0019f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00100820 0x7fbe0019f880 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc031460 tx=0x7fbdfc0045e0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 shutdown_connections 2024-09-21T12:05:52.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe00106820 0x7fbe0019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbdec07af80 0x7fbdec07d440 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 --2- 172.21.15.118:0/2801534164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe00100820 0x7fbe0019f880 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 >> 172.21.15.118:0/2801534164 conn(0x7fbe000fc520 msgr2=0x7fbe000fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:52.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 shutdown_connections 2024-09-21T12:05:52.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.240+0000 7fbe0752b640 1 -- 172.21.15.118:0/2801534164 wait complete. 2024-09-21T12:05:52.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.322+0000 7f724c165640 1 -- 172.21.15.118:0/1330145406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074f40 msgr2=0x7f724410dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.322+0000 7f724c165640 1 --2- 172.21.15.118:0/1330145406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074f40 0x7f724410dc30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7234009880 tx=0x7f723402a530 comp rx=0 tx=0).stop 2024-09-21T12:05:52.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.322+0000 7f724c165640 1 -- 172.21.15.118:0/1330145406 shutdown_connections 2024-09-21T12:05:52.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.322+0000 7f724c165640 1 --2- 172.21.15.118:0/1330145406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074f40 0x7f724410dc30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.322+0000 7f724c165640 1 --2- 172.21.15.118:0/1330145406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7244074620 0x7f7244074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.322+0000 7f724c165640 1 -- 172.21.15.118:0/1330145406 >> 172.21.15.118:0/1330145406 conn(0x7f72440fd630 msgr2=0x7f72440ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:52.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.322+0000 7f724c165640 1 -- 172.21.15.118:0/1330145406 shutdown_connections 2024-09-21T12:05:52.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.322+0000 7f724c165640 1 -- 172.21.15.118:0/1330145406 wait complete. 2024-09-21T12:05:52.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f724c165640 1 Processor -- start 2024-09-21T12:05:52.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f724c165640 1 -- start start 2024-09-21T12:05:52.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f724c165640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074620 0x7f724419f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f724c165640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7244074f40 0x7f724419fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f724c165640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7244111080 con 0x7f7244074620 2024-09-21T12:05:52.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f724c165640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7244110f00 con 0x7f7244074f40 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f7249f01640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074620 0x7f724419f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f7249f01640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074620 0x7f724419f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33174/0 (socket says 172.21.15.118:33174) 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f7249f01640 1 -- 172.21.15.118:0/2111912398 learned_addr learned my addr 172.21.15.118:0/2111912398 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.323+0000 7f7249700640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7244074f40 0x7f724419fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.324+0000 7f7249f01640 1 -- 172.21.15.118:0/2111912398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7244074f40 msgr2=0x7f724419fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.324+0000 7f7249f01640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7244074f40 0x7f724419fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.324+0000 7f7249f01640 1 -- 172.21.15.118:0/2111912398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7244199a70 con 0x7f7244074620 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.324+0000 7f7249700640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7244074f40 0x7f724419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.324+0000 7f7249f01640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074620 0x7f724419f8b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f724000b420 tx=0x7f724000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.324+0000 7f723affd640 1 -- 172.21.15.118:0/2111912398 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7240011630 con 0x7f7244074620 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.324+0000 7f723affd640 1 -- 172.21.15.118:0/2111912398 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7240016070 con 0x7f7244074620 2024-09-21T12:05:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.324+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7244199d60 con 0x7f7244074620 2024-09-21T12:05:52.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.325+0000 7f723affd640 1 -- 172.21.15.118:0/2111912398 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7240010d40 con 0x7f7244074620 2024-09-21T12:05:52.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.325+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724419a2c0 con 0x7f7244074620 2024-09-21T12:05:52.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.326+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7244075cd0 con 0x7f7244074620 2024-09-21T12:05:52.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.326+0000 7f723affd640 1 -- 172.21.15.118:0/2111912398 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f724001b480 con 0x7f7244074620 2024-09-21T12:05:52.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.326+0000 7f723affd640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f723007af30 0x7f723007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.326+0000 7f723affd640 1 -- 172.21.15.118:0/2111912398 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f724009d7f0 con 0x7f7244074620 2024-09-21T12:05:52.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.326+0000 7f7249700640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f723007af30 0x7f723007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.327+0000 7f7249700640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f723007af30 0x7f723007d3f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f724419b260 tx=0x7f7234031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:52.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.330+0000 7f723affd640 1 -- 172.21.15.118:0/2111912398 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7240068d40 con 0x7f7244074620 2024-09-21T12:05:52.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.515+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f724419afa0 con 0x7f723007af30 2024-09-21T12:05:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.524+0000 7f723affd640 1 -- 172.21.15.118:0/2111912398 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f724419afa0 con 0x7f723007af30 2024-09-21T12:05:52.525 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:05:52.525 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (23m) 2m ago 34m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (26m) 2m ago 34m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (26m) 2m ago 34m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (21m) 2m ago 34m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (21m) 2m ago 34m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (23m) 2m ago 34m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (18m) 2m ago 29m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (17m) 2m ago 29m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (2m) 2m ago 29m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (17m) 2m ago 29m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (25m) 2m ago 36m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (25m) 2m ago 33m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (22m) 2m ago 36m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:05:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (22m) 2m ago 33m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:05:52.527 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (24m) 2m ago 34m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:05:52.527 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (24m) 2m ago 33m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:05:52.527 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (21m) 2m ago 32m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:05:52.527 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (20m) 2m ago 32m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:05:52.527 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (20m) 2m ago 31m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:05:52.527 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (19m) 2m ago 31m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:05:52.527 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (19m) 2m ago 30m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:05:52.527 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (18m) 2m ago 30m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:05:52.527 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (24m) 2m ago 34m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f723007af30 msgr2=0x7f723007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f723007af30 0x7f723007d3f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f724419b260 tx=0x7f7234031400 comp rx=0 tx=0).stop 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074620 msgr2=0x7f724419f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074620 0x7f724419f8b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f724000b420 tx=0x7f724000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 shutdown_connections 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7244074f40 0x7f724419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f723007af30 0x7f723007d3f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 --2- 172.21.15.118:0/2111912398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244074620 0x7f724419f8b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 >> 172.21.15.118:0/2111912398 conn(0x7f72440fd630 msgr2=0x7f724410b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:52.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 shutdown_connections 2024-09-21T12:05:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.526+0000 7f724c165640 1 -- 172.21.15.118:0/2111912398 wait complete. 2024-09-21T12:05:52.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2861313224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 msgr2=0x7f41dc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 --2- 172.21.15.118:0/2861313224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 0x7f41dc100c80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009880 tx=0x7f41c802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2861313224 shutdown_connections 2024-09-21T12:05:52.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 --2- 172.21.15.118:0/2861313224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 0x7f41dc100c80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 --2- 172.21.15.118:0/2861313224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41dc106820 0x7f41dc106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2861313224 >> 172.21.15.118:0/2861313224 conn(0x7f41dc0fc520 msgr2=0x7f41dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:52.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2861313224 shutdown_connections 2024-09-21T12:05:52.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2861313224 wait complete. 2024-09-21T12:05:52.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 Processor -- start 2024-09-21T12:05:52.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.607+0000 7f41e2d1f640 1 -- start start 2024-09-21T12:05:52.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e2d1f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 0x7f41dc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e2d1f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41dc106820 0x7f41dc19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e2d1f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc10dd50 con 0x7f41dc100820 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e2d1f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc10dbd0 con 0x7f41dc106820 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e0abb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 0x7f41dc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e0abb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 0x7f41dc19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33188/0 (socket says 172.21.15.118:33188) 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e0abb640 1 -- 172.21.15.118:0/2597962887 learned_addr learned my addr 172.21.15.118:0/2597962887 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41dbfff640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41dc106820 0x7f41dc19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e0abb640 1 -- 172.21.15.118:0/2597962887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41dc106820 msgr2=0x7f41dc19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e0abb640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41dc106820 0x7f41dc19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e0abb640 1 -- 172.21.15.118:0/2597962887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc197830 con 0x7f41dc100820 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e0abb640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 0x7f41dc19d6b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f41d000b420 tx=0x7f41d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41d9ffb640 1 -- 172.21.15.118:0/2597962887 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41d0011630 con 0x7f41dc100820 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41d9ffb640 1 -- 172.21.15.118:0/2597962887 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41d0016070 con 0x7f41dc100820 2024-09-21T12:05:52.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41dc197b20 con 0x7f41dc100820 2024-09-21T12:05:52.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.608+0000 7f41d9ffb640 1 -- 172.21.15.118:0/2597962887 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41d0010d40 con 0x7f41dc100820 2024-09-21T12:05:52.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.609+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc198080 con 0x7f41dc100820 2024-09-21T12:05:52.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.610+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41dc101f60 con 0x7f41dc100820 2024-09-21T12:05:52.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.610+0000 7f41d9ffb640 1 -- 172.21.15.118:0/2597962887 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f41d001b460 con 0x7f41dc100820 2024-09-21T12:05:52.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.610+0000 7f41d9ffb640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f41cc07af80 0x7f41cc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.611+0000 7f41d9ffb640 1 -- 172.21.15.118:0/2597962887 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f41d009d7a0 con 0x7f41dc100820 2024-09-21T12:05:52.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.611+0000 7f41dbfff640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f41cc07af80 0x7f41cc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.611+0000 7f41dbfff640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f41cc07af80 0x7f41cc07d440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f41dc198b80 tx=0x7f41c8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:52.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.615+0000 7f41d9ffb640 1 -- 172.21.15.118:0/2597962887 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41d0021250 con 0x7f41dc100820 2024-09-21T12:05:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.862+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f41dc109dc0 con 0x7f41dc100820 2024-09-21T12:05:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.863+0000 7f41d9ffb640 1 -- 172.21.15.118:0/2597962887 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f41d0068d70 con 0x7f41dc100820 2024-09-21T12:05:52.864 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:05:52.864 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:05:52.864 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:05:52.864 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:05:52.864 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:05:52.864 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:05:52.865 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:05:52.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f41cc07af80 msgr2=0x7f41cc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f41cc07af80 0x7f41cc07d440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f41dc198b80 tx=0x7f41c8031400 comp rx=0 tx=0).stop 2024-09-21T12:05:52.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 msgr2=0x7f41dc19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 0x7f41dc19d6b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f41d000b420 tx=0x7f41d000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 shutdown_connections 2024-09-21T12:05:52.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41dc106820 0x7f41dc19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f41cc07af80 0x7f41cc07d440 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 --2- 172.21.15.118:0/2597962887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41dc100820 0x7f41dc19d6b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 >> 172.21.15.118:0/2597962887 conn(0x7f41dc0fc520 msgr2=0x7f41dc06a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:52.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 shutdown_connections 2024-09-21T12:05:52.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.865+0000 7f41e2d1f640 1 -- 172.21.15.118:0/2597962887 wait complete. 2024-09-21T12:05:52.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.946+0000 7f82dc089640 1 -- 172.21.15.118:0/3700050120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 msgr2=0x7f82d4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.946+0000 7f82dc089640 1 --2- 172.21.15.118:0/3700050120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 0x7f82d4106bc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009880 tx=0x7f82c802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 -- 172.21.15.118:0/3700050120 shutdown_connections 2024-09-21T12:05:52.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 --2- 172.21.15.118:0/3700050120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d41007e0 0x7f82d4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 --2- 172.21.15.118:0/3700050120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 0x7f82d4106bc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 -- 172.21.15.118:0/3700050120 >> 172.21.15.118:0/3700050120 conn(0x7f82d40fc4c0 msgr2=0x7f82d40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:52.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 -- 172.21.15.118:0/3700050120 shutdown_connections 2024-09-21T12:05:52.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 -- 172.21.15.118:0/3700050120 wait complete. 2024-09-21T12:05:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 Processor -- start 2024-09-21T12:05:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 -- start start 2024-09-21T12:05:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d41007e0 0x7f82d419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 0x7f82d419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f82d410dcb0 con 0x7f82d41067e0 2024-09-21T12:05:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.947+0000 7f82dc089640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82d410db30 con 0x7f82d41007e0 2024-09-21T12:05:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82d9624640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 0x7f82d419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82d9624640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 0x7f82d419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33196/0 (socket says 172.21.15.118:33196) 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82d9624640 1 -- 172.21.15.118:0/3409981263 learned_addr learned my addr 172.21.15.118:0/3409981263 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82d9e25640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d41007e0 0x7f82d419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82d9624640 1 -- 172.21.15.118:0/3409981263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d41007e0 msgr2=0x7f82d419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82d9624640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d41007e0 0x7f82d419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82d9624640 1 -- 172.21.15.118:0/3409981263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d41977b0 con 0x7f82d41067e0 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82d9624640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 0x7f82d419db70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f82d000d6f0 tx=0x7f82d000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82c6ffd640 1 -- 172.21.15.118:0/3409981263 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82d0017070 con 0x7f82d41067e0 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82c6ffd640 1 -- 172.21.15.118:0/3409981263 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82d000de00 con 0x7f82d41067e0 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d4197aa0 con 0x7f82d41067e0 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82c6ffd640 1 -- 172.21.15.118:0/3409981263 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82d0004bb0 con 0x7f82d41067e0 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.948+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d4198030 con 0x7f82d41067e0 2024-09-21T12:05:52.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.949+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d4101f20 con 0x7f82d41067e0 2024-09-21T12:05:52.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.950+0000 7f82c6ffd640 1 -- 172.21.15.118:0/3409981263 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f82d0009a30 con 0x7f82d41067e0 2024-09-21T12:05:52.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.950+0000 7f82c6ffd640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82c007af90 0x7f82c007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:52.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.951+0000 7f82d9e25640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82c007af90 0x7f82c007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:52.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.951+0000 7f82c6ffd640 1 -- 172.21.15.118:0/3409981263 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f82d009dc20 con 0x7f82d41067e0 2024-09-21T12:05:52.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.951+0000 7f82d9e25640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82c007af90 0x7f82c007d450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f82c8031460 tx=0x7f82c80095c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:52.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:52.955+0000 7f82c6ffd640 1 -- 172.21.15.118:0/3409981263 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82d00691f0 con 0x7f82d41067e0 2024-09-21T12:05:53.140 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:52 smithi118 ceph-mon[111738]: pgmap v812: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:53.140 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:52 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2597962887' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:05:53.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.168+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f82d41982e0 con 0x7f82d41067e0 2024-09-21T12:05:53.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.168+0000 7f82c6ffd640 1 -- 172.21.15.118:0/3409981263 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f82d006e0a0 con 0x7f82d41067e0 2024-09-21T12:05:53.170 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:05:53.170 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:05:53.170 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:05:53.170 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:05:53.170 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:05:53.170 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:05:53.170 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:05:53.171 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:05:53.172 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:05:53.173 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:05:53.173 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:05:53.173 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:05:53.173 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:05:53.173 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:05:53.173 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:05:53.173 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:05:53.173 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:05:53.174 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:05:53.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82c007af90 msgr2=0x7f82c007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82c007af90 0x7f82c007d450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f82c8031460 tx=0x7f82c80095c0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 msgr2=0x7f82d419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 0x7f82d419db70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f82d000d6f0 tx=0x7f82d000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 shutdown_connections 2024-09-21T12:05:53.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82c007af90 0x7f82c007d450 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d41067e0 0x7f82d419db70 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 --2- 172.21.15.118:0/3409981263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d41007e0 0x7f82d419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 >> 172.21.15.118:0/3409981263 conn(0x7f82d40fc4c0 msgr2=0x7f82d41045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:53.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 shutdown_connections 2024-09-21T12:05:53.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.171+0000 7f82dc089640 1 -- 172.21.15.118:0/3409981263 wait complete. 2024-09-21T12:05:53.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:52 smithi149 ceph-mon[79770]: pgmap v812: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:53.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:52 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2597962887' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:05:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.254+0000 7f408c05a640 1 -- 172.21.15.118:0/1194976421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 msgr2=0x7f40841123d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.254+0000 7f408c05a640 1 --2- 172.21.15.118:0/1194976421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 0x7f40841123d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4074009880 tx=0x7f407402a530 comp rx=0 tx=0).stop 2024-09-21T12:05:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.254+0000 7f408c05a640 1 -- 172.21.15.118:0/1194976421 shutdown_connections 2024-09-21T12:05:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.254+0000 7f408c05a640 1 --2- 172.21.15.118:0/1194976421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 0x7f40841123d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.254+0000 7f408c05a640 1 --2- 172.21.15.118:0/1194976421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4084074590 0x7f4084074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.254+0000 7f408c05a640 1 -- 172.21.15.118:0/1194976421 >> 172.21.15.118:0/1194976421 conn(0x7f40840fd620 msgr2=0x7f40840ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f408c05a640 1 -- 172.21.15.118:0/1194976421 shutdown_connections 2024-09-21T12:05:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f408c05a640 1 -- 172.21.15.118:0/1194976421 wait complete. 2024-09-21T12:05:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f408c05a640 1 Processor -- start 2024-09-21T12:05:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f408c05a640 1 -- start start 2024-09-21T12:05:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f408c05a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4084074590 0x7f408419dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f408c05a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 0x7f408419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f408c05a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f40841153e0 con 0x7f4084074eb0 2024-09-21T12:05:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f408c05a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4084115260 con 0x7f4084074590 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f40895f5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 0x7f408419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f40895f5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 0x7f408419e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33210/0 (socket says 172.21.15.118:33210) 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.255+0000 7f40895f5640 1 -- 172.21.15.118:0/201781919 learned_addr learned my addr 172.21.15.118:0/201781919 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f4089df6640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4084074590 0x7f408419dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f40895f5640 1 -- 172.21.15.118:0/201781919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4084074590 msgr2=0x7f408419dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f40895f5640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4084074590 0x7f408419dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f40895f5640 1 -- 172.21.15.118:0/201781919 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40841a2870 con 0x7f4084074eb0 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f4089df6640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4084074590 0x7f408419dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f40895f5640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 0x7f408419e4e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4074031460 tx=0x7f40740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f407affd640 1 -- 172.21.15.118:0/201781919 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f407403f070 con 0x7f4084074eb0 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f407affd640 1 -- 172.21.15.118:0/201781919 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4074004cf0 con 0x7f4084074eb0 2024-09-21T12:05:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40841a2b00 con 0x7f4084074eb0 2024-09-21T12:05:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f407affd640 1 -- 172.21.15.118:0/201781919 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4074035030 con 0x7f4084074eb0 2024-09-21T12:05:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.256+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40841a3030 con 0x7f4084074eb0 2024-09-21T12:05:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.257+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4084075cd0 con 0x7f4084074eb0 2024-09-21T12:05:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.258+0000 7f407affd640 1 -- 172.21.15.118:0/201781919 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4074042070 con 0x7f4084074eb0 2024-09-21T12:05:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.258+0000 7f407affd640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f407007af30 0x7f407007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.258+0000 7f407affd640 1 -- 172.21.15.118:0/201781919 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f40740bebd0 con 0x7f4084074eb0 2024-09-21T12:05:53.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.258+0000 7f4089df6640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f407007af30 0x7f407007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:53.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.259+0000 7f4089df6640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f407007af30 0x7f407007d3f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f40800058c0 tx=0x7f4080005d30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:53.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.263+0000 7f407affd640 1 -- 172.21.15.118:0/201781919 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f407408a0c0 con 0x7f4084074eb0 2024-09-21T12:05:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.457+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f408419f300 con 0x7f407007af30 2024-09-21T12:05:53.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.459+0000 7f407affd640 1 -- 172.21.15.118:0/201781919 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f408419f300 con 0x7f407007af30 2024-09-21T12:05:53.460 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:05:53.460 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:05:53.460 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:05:53.461 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:05:53.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f407007af30 msgr2=0x7f407007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f407007af30 0x7f407007d3f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f40800058c0 tx=0x7f4080005d30 comp rx=0 tx=0).stop 2024-09-21T12:05:53.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 msgr2=0x7f408419e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 0x7f408419e4e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4074031460 tx=0x7f40740048f0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 shutdown_connections 2024-09-21T12:05:53.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f407007af30 0x7f407007d3f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4084074eb0 0x7f408419e4e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 --2- 172.21.15.118:0/201781919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4084074590 0x7f408419dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 >> 172.21.15.118:0/201781919 conn(0x7f40840fd620 msgr2=0x7f4084104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:53.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 shutdown_connections 2024-09-21T12:05:53.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.462+0000 7f408c05a640 1 -- 172.21.15.118:0/201781919 wait complete. 2024-09-21T12:05:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.543+0000 7fed4c3a9640 1 -- 172.21.15.118:0/3503676364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 msgr2=0x7fed44101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.543+0000 7fed4c3a9640 1 --2- 172.21.15.118:0/3503676364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 0x7fed44101d90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fed34009880 tx=0x7fed3402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.543+0000 7fed4c3a9640 1 -- 172.21.15.118:0/3503676364 shutdown_connections 2024-09-21T12:05:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.543+0000 7fed4c3a9640 1 --2- 172.21.15.118:0/3503676364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 0x7fed44101d90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.543+0000 7fed4c3a9640 1 --2- 172.21.15.118:0/3503676364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed44107930 0x7fed44107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.543+0000 7fed4c3a9640 1 -- 172.21.15.118:0/3503676364 >> 172.21.15.118:0/3503676364 conn(0x7fed440fd630 msgr2=0x7fed440ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.543+0000 7fed4c3a9640 1 -- 172.21.15.118:0/3503676364 shutdown_connections 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.543+0000 7fed4c3a9640 1 -- 172.21.15.118:0/3503676364 wait complete. 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4c3a9640 1 Processor -- start 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4c3a9640 1 -- start start 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4c3a9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 0x7fed440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4c3a9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed44107930 0x7fed44074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4c3a9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fed4410ede0 con 0x7fed44101930 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4c3a9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed4410ec60 con 0x7fed44107930 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4a145640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 0x7fed440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4a145640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 0x7fed440744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33226/0 (socket says 172.21.15.118:33226) 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4a145640 1 -- 172.21.15.118:0/1761105493 learned_addr learned my addr 172.21.15.118:0/1761105493 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4a145640 1 -- 172.21.15.118:0/1761105493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed44107930 msgr2=0x7fed44074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed49944640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed44107930 0x7fed44074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4a145640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed44107930 0x7fed44074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.544+0000 7fed4a145640 1 -- 172.21.15.118:0/1761105493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed44074f70 con 0x7fed44101930 2024-09-21T12:05:53.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.545+0000 7fed4a145640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 0x7fed440744f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fed4000d8d0 tx=0x7fed4000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:53.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.545+0000 7fed3b7fe640 1 -- 172.21.15.118:0/1761105493 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed40017070 con 0x7fed44101930 2024-09-21T12:05:53.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.545+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed44075260 con 0x7fed44101930 2024-09-21T12:05:53.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.545+0000 7fed3b7fe640 1 -- 172.21.15.118:0/1761105493 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed40010460 con 0x7fed44101930 2024-09-21T12:05:53.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.545+0000 7fed3b7fe640 1 -- 172.21.15.118:0/1761105493 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed4000f5f0 con 0x7fed44101930 2024-09-21T12:05:53.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.545+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed441a3ed0 con 0x7fed44101930 2024-09-21T12:05:53.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.546+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed44103070 con 0x7fed44101930 2024-09-21T12:05:53.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.547+0000 7fed3b7fe640 1 -- 172.21.15.118:0/1761105493 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fed40009a30 con 0x7fed44101930 2024-09-21T12:05:53.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.547+0000 7fed3b7fe640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed3007af30 0x7fed3007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:05:53.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.547+0000 7fed3b7fe640 1 -- 172.21.15.118:0/1761105493 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fed4009df70 con 0x7fed44101930 2024-09-21T12:05:53.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.547+0000 7fed49944640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed3007af30 0x7fed3007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:05:53.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.548+0000 7fed49944640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed3007af30 0x7fed3007d3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed34031460 tx=0x7fed34009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:05:53.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.551+0000 7fed3b7fe640 1 -- 172.21.15.118:0/1761105493 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed400694c0 con 0x7fed44101930 2024-09-21T12:05:53.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.798+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fed44075a50 con 0x7fed44101930 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.798+0000 7fed3b7fe640 1 -- 172.21.15.118:0/1761105493 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fed44075a50 con 0x7fed44101930 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:05:53.800 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:05:53.801 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:05:53.802 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:05:53.802 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:05:53.802 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:05:53.802 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:05:53.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed3007af30 msgr2=0x7fed3007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed3007af30 0x7fed3007d3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed34031460 tx=0x7fed34009560 comp rx=0 tx=0).stop 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 msgr2=0x7fed440744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 0x7fed440744f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fed4000d8d0 tx=0x7fed4000dd90 comp rx=0 tx=0).stop 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 shutdown_connections 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed44107930 0x7fed44074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fed3007af30 0x7fed3007d3f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 --2- 172.21.15.118:0/1761105493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed44101930 0x7fed440744f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 >> 172.21.15.118:0/1761105493 conn(0x7fed440fd630 msgr2=0x7fed440fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 shutdown_connections 2024-09-21T12:05:53.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:05:53.801+0000 7fed4c3a9640 1 -- 172.21.15.118:0/1761105493 wait complete. 2024-09-21T12:05:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:53 smithi118 ceph-mon[111738]: from='client.35284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:53 smithi118 ceph-mon[111738]: from='client.35288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:53 smithi118 ceph-mon[111738]: from='client.35292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:53 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3409981263' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:05:54.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:53 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1761105493' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:05:54.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:53 smithi149 ceph-mon[79770]: from='client.35284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:54.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:53 smithi149 ceph-mon[79770]: from='client.35288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:54.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:53 smithi149 ceph-mon[79770]: from='client.35292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:54.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:53 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3409981263' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:05:54.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:53 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1761105493' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:05:55.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:54 smithi149 ceph-mon[79770]: pgmap v813: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:55.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:54 smithi149 ceph-mon[79770]: from='client.35304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:55.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:54 smithi118 ceph-mon[111738]: pgmap v813: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:55.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:54 smithi118 ceph-mon[111738]: from='client.35304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:05:56.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:55 smithi149 ceph-mon[79770]: pgmap v814: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:55 smithi118 ceph-mon[111738]: pgmap v814: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:58.215 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:05:57 smithi118 ceph-mon[111738]: pgmap v815: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:05:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:05:57 smithi149 ceph-mon[79770]: pgmap v815: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:00 smithi118 ceph-mon[111738]: pgmap v816: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:00 smithi149 ceph-mon[79770]: pgmap v816: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:02 smithi118 ceph-mon[111738]: pgmap v817: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:02 smithi149 ceph-mon[79770]: pgmap v817: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:04 smithi118 ceph-mon[111738]: pgmap v818: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:04.401 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:04 smithi149 ceph-mon[79770]: pgmap v818: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:06:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:06:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:06 smithi118 ceph-mon[111738]: pgmap v819: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:06 smithi149 ceph-mon[79770]: pgmap v819: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:08 smithi118 ceph-mon[111738]: pgmap v820: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:08 smithi149 ceph-mon[79770]: pgmap v820: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:10 smithi118 ceph-mon[111738]: pgmap v821: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:10 smithi149 ceph-mon[79770]: pgmap v821: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:12 smithi118 ceph-mon[111738]: pgmap v822: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:12 smithi149 ceph-mon[79770]: pgmap v822: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:14 smithi118 ceph-mon[111738]: pgmap v823: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:14 smithi149 ceph-mon[79770]: pgmap v823: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:16.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:16 smithi118 ceph-mon[111738]: pgmap v824: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:16 smithi149 ceph-mon[79770]: pgmap v824: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:18 smithi118 ceph-mon[111738]: pgmap v825: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:18 smithi149 ceph-mon[79770]: pgmap v825: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:20 smithi118 ceph-mon[111738]: pgmap v826: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:06:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:20 smithi149 ceph-mon[79770]: pgmap v826: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:06:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:22 smithi118 ceph-mon[111738]: pgmap v827: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:22 smithi149 ceph-mon[79770]: pgmap v827: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.888+0000 7f13fe3b6640 1 -- 172.21.15.118:0/395458562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 msgr2=0x7f13f8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.888+0000 7f13fe3b6640 1 --2- 172.21.15.118:0/395458562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 0x7f13f8107d10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009880 tx=0x7f13e802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.888+0000 7f13fe3b6640 1 -- 172.21.15.118:0/395458562 shutdown_connections 2024-09-21T12:06:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.888+0000 7f13fe3b6640 1 --2- 172.21.15.118:0/395458562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f8101930 0x7f13f8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.888+0000 7f13fe3b6640 1 --2- 172.21.15.118:0/395458562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 0x7f13f8107d10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.888+0000 7f13fe3b6640 1 -- 172.21.15.118:0/395458562 >> 172.21.15.118:0/395458562 conn(0x7f13f80fd630 msgr2=0x7f13f80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.888+0000 7f13fe3b6640 1 -- 172.21.15.118:0/395458562 shutdown_connections 2024-09-21T12:06:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.888+0000 7f13fe3b6640 1 -- 172.21.15.118:0/395458562 wait complete. 2024-09-21T12:06:23.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.889+0000 7f13fe3b6640 1 Processor -- start 2024-09-21T12:06:23.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.889+0000 7f13fe3b6640 1 -- start start 2024-09-21T12:06:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.889+0000 7f13fe3b6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f8101930 0x7f13f819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.889+0000 7f13fe3b6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 0x7f13f819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.889+0000 7f13fe3b6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13f810ede0 con 0x7f13f8107930 2024-09-21T12:06:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.889+0000 7f13fe3b6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13f810ec60 con 0x7f13f8101930 2024-09-21T12:06:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.889+0000 7f13f77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 0x7f13f819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 0x7f13f819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58388/0 (socket says 172.21.15.118:58388) 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f77fe640 1 -- 172.21.15.118:0/760953585 learned_addr learned my addr 172.21.15.118:0/760953585 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f7fff640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f8101930 0x7f13f819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f77fe640 1 -- 172.21.15.118:0/760953585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f8101930 msgr2=0x7f13f819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f77fe640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f8101930 0x7f13f819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f77fe640 1 -- 172.21.15.118:0/760953585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f8197810 con 0x7f13f8107930 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f77fe640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 0x7f13f819dbd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c8a0 tx=0x7f13ec00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f57fa640 1 -- 172.21.15.118:0/760953585 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13ec0079b0 con 0x7f13f8107930 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f57fa640 1 -- 172.21.15.118:0/760953585 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13ec007b50 con 0x7f13f8107930 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f8197b00 con 0x7f13f8107930 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13f57fa640 1 -- 172.21.15.118:0/760953585 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13ec018700 con 0x7f13f8107930 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.890+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f8198090 con 0x7f13f8107930 2024-09-21T12:06:23.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.891+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f8103070 con 0x7f13f8107930 2024-09-21T12:06:23.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.892+0000 7f13f57fa640 1 -- 172.21.15.118:0/760953585 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f13ec007d00 con 0x7f13f8107930 2024-09-21T12:06:23.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.892+0000 7f13f57fa640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13e007af40 0x7f13e007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:23.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.892+0000 7f13f57fa640 1 -- 172.21.15.118:0/760953585 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f13ec09e3c0 con 0x7f13f8107930 2024-09-21T12:06:23.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.892+0000 7f13f7fff640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13e007af40 0x7f13e007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:23.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.893+0000 7f13f7fff640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13e007af40 0x7f13e007d400 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13e8031460 tx=0x7f13e8009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:23.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:23.897+0000 7f13f57fa640 1 -- 172.21.15.118:0/760953585 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13ec014030 con 0x7f13f8107930 2024-09-21T12:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.093+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f13f81983a0 con 0x7f13e007af40 2024-09-21T12:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.095+0000 7f13f57fa640 1 -- 172.21.15.118:0/760953585 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f13f81983a0 con 0x7f13e007af40 2024-09-21T12:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13e007af40 msgr2=0x7f13e007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13e007af40 0x7f13e007d400 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13e8031460 tx=0x7f13e8009560 comp rx=0 tx=0).stop 2024-09-21T12:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 msgr2=0x7f13f819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 0x7f13f819dbd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c8a0 tx=0x7f13ec00cd60 comp rx=0 tx=0).stop 2024-09-21T12:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 shutdown_connections 2024-09-21T12:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f13e007af40 0x7f13e007d400 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f8107930 0x7f13f819dbd0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 --2- 172.21.15.118:0/760953585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f8101930 0x7f13f819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 >> 172.21.15.118:0/760953585 conn(0x7f13f80fd630 msgr2=0x7f13f80fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 shutdown_connections 2024-09-21T12:06:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.097+0000 7f13fe3b6640 1 -- 172.21.15.118:0/760953585 wait complete. 2024-09-21T12:06:24.109 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:06:24.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.181+0000 7f86f7032640 1 -- 172.21.15.118:0/3018441578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01067e0 msgr2=0x7f86f0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.181+0000 7f86f7032640 1 --2- 172.21.15.118:0/3018441578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01067e0 0x7f86f0106bc0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009880 tx=0x7f86e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.181+0000 7f86f7032640 1 -- 172.21.15.118:0/3018441578 shutdown_connections 2024-09-21T12:06:24.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.181+0000 7f86f7032640 1 --2- 172.21.15.118:0/3018441578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f01007e0 0x7f86f0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.181+0000 7f86f7032640 1 --2- 172.21.15.118:0/3018441578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01067e0 0x7f86f0106bc0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.181+0000 7f86f7032640 1 -- 172.21.15.118:0/3018441578 >> 172.21.15.118:0/3018441578 conn(0x7f86f00fc4c0 msgr2=0x7f86f00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:24.184 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:24 smithi118 ceph-mon[111738]: pgmap v828: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:24.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.181+0000 7f86f7032640 1 -- 172.21.15.118:0/3018441578 shutdown_connections 2024-09-21T12:06:24.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.181+0000 7f86f7032640 1 -- 172.21.15.118:0/3018441578 wait complete. 2024-09-21T12:06:24.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f7032640 1 Processor -- start 2024-09-21T12:06:24.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f7032640 1 -- start start 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f7032640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01007e0 0x7f86f0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f7032640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f01067e0 0x7f86f0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f7032640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f86f010dcb0 con 0x7f86f01007e0 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f7032640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f86f010db30 con 0x7f86f01067e0 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f4dce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01007e0 0x7f86f0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f4dce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01007e0 0x7f86f0198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58402/0 (socket says 172.21.15.118:58402) 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f4dce640 1 -- 172.21.15.118:0/1631907142 learned_addr learned my addr 172.21.15.118:0/1631907142 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86effff640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f01067e0 0x7f86f0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f4dce640 1 -- 172.21.15.118:0/1631907142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f01067e0 msgr2=0x7f86f0198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f4dce640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f01067e0 0x7f86f0198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.182+0000 7f86f4dce640 1 -- 172.21.15.118:0/1631907142 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f0199360 con 0x7f86f01007e0 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.183+0000 7f86f4dce640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01007e0 0x7f86f0198820 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f86e4031460 tx=0x7f86e40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.183+0000 7f86edffb640 1 -- 172.21.15.118:0/1631907142 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86e403f070 con 0x7f86f01007e0 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.183+0000 7f86edffb640 1 -- 172.21.15.118:0/1631907142 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86e40035f0 con 0x7f86f01007e0 2024-09-21T12:06:24.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.183+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f01995f0 con 0x7f86f01007e0 2024-09-21T12:06:24.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.183+0000 7f86edffb640 1 -- 172.21.15.118:0/1631907142 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86e4035030 con 0x7f86f01007e0 2024-09-21T12:06:24.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.183+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f01967e0 con 0x7f86f01007e0 2024-09-21T12:06:24.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.184+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f0101f20 con 0x7f86f01007e0 2024-09-21T12:06:24.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.185+0000 7f86edffb640 1 -- 172.21.15.118:0/1631907142 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f86e4042070 con 0x7f86f01007e0 2024-09-21T12:06:24.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.186+0000 7f86edffb640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86e007f340 0x7f86e0081800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:24.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.186+0000 7f86edffb640 1 -- 172.21.15.118:0/1631907142 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f86e40bea20 con 0x7f86f01007e0 2024-09-21T12:06:24.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.186+0000 7f86effff640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86e007f340 0x7f86e0081800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:24.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.186+0000 7f86effff640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86e007f340 0x7f86e0081800 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f86f006a680 tx=0x7f86dc00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:24.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.191+0000 7f86edffb640 1 -- 172.21.15.118:0/1631907142 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86e4089f70 con 0x7f86f01007e0 2024-09-21T12:06:24.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.385+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f86f0062630 con 0x7f86e007f340 2024-09-21T12:06:24.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.386+0000 7f86edffb640 1 -- 172.21.15.118:0/1631907142 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f86f0062630 con 0x7f86e007f340 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86e007f340 msgr2=0x7f86e0081800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86e007f340 0x7f86e0081800 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f86f006a680 tx=0x7f86dc00b390 comp rx=0 tx=0).stop 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01007e0 msgr2=0x7f86f0198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01007e0 0x7f86f0198820 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f86e4031460 tx=0x7f86e40045e0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 shutdown_connections 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f01067e0 0x7f86f0198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f86e007f340 0x7f86e0081800 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 --2- 172.21.15.118:0/1631907142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86f01007e0 0x7f86f0198820 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 >> 172.21.15.118:0/1631907142 conn(0x7f86f00fc4c0 msgr2=0x7f86f00fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 shutdown_connections 2024-09-21T12:06:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.388+0000 7f86f7032640 1 -- 172.21.15.118:0/1631907142 wait complete. 2024-09-21T12:06:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:24 smithi149 ceph-mon[79770]: pgmap v828: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:24.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.469+0000 7f2624b71640 1 -- 172.21.15.118:0/3663976290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 msgr2=0x7f2620101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.469+0000 7f2624b71640 1 --2- 172.21.15.118:0/3663976290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 0x7f2620101d90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2608009880 tx=0x7f260802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.470+0000 7f2624b71640 1 -- 172.21.15.118:0/3663976290 shutdown_connections 2024-09-21T12:06:24.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.470+0000 7f2624b71640 1 --2- 172.21.15.118:0/3663976290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 0x7f2620101d90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.470+0000 7f2624b71640 1 --2- 172.21.15.118:0/3663976290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2620107930 0x7f2620107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.470+0000 7f2624b71640 1 -- 172.21.15.118:0/3663976290 >> 172.21.15.118:0/3663976290 conn(0x7f26200fd630 msgr2=0x7f26200ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:24.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.470+0000 7f2624b71640 1 -- 172.21.15.118:0/3663976290 shutdown_connections 2024-09-21T12:06:24.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.470+0000 7f2624b71640 1 -- 172.21.15.118:0/3663976290 wait complete. 2024-09-21T12:06:24.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.470+0000 7f2624b71640 1 Processor -- start 2024-09-21T12:06:24.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f2624b71640 1 -- start start 2024-09-21T12:06:24.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f2624b71640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 0x7f26200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:24.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f2624b71640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2620107930 0x7f2620074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:24.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f2624b71640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f262010ee60 con 0x7f2620101930 2024-09-21T12:06:24.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f2624b71640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f262010ece0 con 0x7f2620107930 2024-09-21T12:06:24.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f261e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 0x7f26200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:24.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f261e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 0x7f26200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58432/0 (socket says 172.21.15.118:58432) 2024-09-21T12:06:24.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f261e59c640 1 -- 172.21.15.118:0/3932418896 learned_addr learned my addr 172.21.15.118:0/3932418896 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f261dd9b640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2620107930 0x7f2620074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f261e59c640 1 -- 172.21.15.118:0/3932418896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2620107930 msgr2=0x7f2620074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f261e59c640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2620107930 0x7f2620074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f261e59c640 1 -- 172.21.15.118:0/3932418896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2620074f70 con 0x7f2620101930 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f261dd9b640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2620107930 0x7f2620074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.471+0000 7f261e59c640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 0x7f26200744f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f261000b420 tx=0x7f261000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.472+0000 7f26177fe640 1 -- 172.21.15.118:0/3932418896 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2610011630 con 0x7f2620101930 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.472+0000 7f26177fe640 1 -- 172.21.15.118:0/3932418896 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2610016070 con 0x7f2620101930 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.472+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2620075260 con 0x7f2620101930 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.472+0000 7f26177fe640 1 -- 172.21.15.118:0/3932418896 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2610010d40 con 0x7f2620101930 2024-09-21T12:06:24.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.472+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26201a3ef0 con 0x7f2620101930 2024-09-21T12:06:24.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.473+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2620103070 con 0x7f2620101930 2024-09-21T12:06:24.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.474+0000 7f26177fe640 1 -- 172.21.15.118:0/3932418896 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f261001b460 con 0x7f2620101930 2024-09-21T12:06:24.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.474+0000 7f26177fe640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f260c07af90 0x7f260c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:24.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.474+0000 7f261dd9b640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f260c07af90 0x7f260c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:24.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.474+0000 7f26177fe640 1 -- 172.21.15.118:0/3932418896 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f261009d7b0 con 0x7f2620101930 2024-09-21T12:06:24.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.475+0000 7f261dd9b640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f260c07af90 0x7f260c07d450 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2608031460 tx=0x7f2608004280 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:24.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.478+0000 7f26177fe640 1 -- 172.21.15.118:0/3932418896 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2610021250 con 0x7f2620101930 2024-09-21T12:06:24.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.662+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2620062630 con 0x7f260c07af90 2024-09-21T12:06:24.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.672+0000 7f26177fe640 1 -- 172.21.15.118:0/3932418896 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2620062630 con 0x7f260c07af90 2024-09-21T12:06:24.674 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:06:24.674 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (24m) 3m ago 35m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:06:24.674 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (27m) 3m ago 35m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:06:24.674 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (26m) 3m ago 34m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:06:24.674 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (22m) 3m ago 35m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:06:24.674 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (22m) 3m ago 34m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:06:24.674 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (23m) 3m ago 35m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:06:24.674 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (18m) 3m ago 29m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (18m) 3m ago 29m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (3m) 3m ago 29m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (18m) 3m ago 29m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (26m) 3m ago 36m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (25m) 3m ago 34m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (22m) 3m ago 36m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (22m) 3m ago 34m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (25m) 3m ago 35m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (25m) 3m ago 34m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (22m) 3m ago 33m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (21m) 3m ago 32m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (20m) 3m ago 32m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (20m) 3m ago 31m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:06:24.675 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (19m) 3m ago 31m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:06:24.676 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (19m) 3m ago 30m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:06:24.676 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (24m) 3m ago 34m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:06:24.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f260c07af90 msgr2=0x7f260c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f260c07af90 0x7f260c07d450 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2608031460 tx=0x7f2608004280 comp rx=0 tx=0).stop 2024-09-21T12:06:24.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 msgr2=0x7f26200744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 0x7f26200744f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f261000b420 tx=0x7f261000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 shutdown_connections 2024-09-21T12:06:24.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2620107930 0x7f2620074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f260c07af90 0x7f260c07d450 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 --2- 172.21.15.118:0/3932418896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2620101930 0x7f26200744f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 >> 172.21.15.118:0/3932418896 conn(0x7f26200fd630 msgr2=0x7f26200fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:24.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 shutdown_connections 2024-09-21T12:06:24.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.674+0000 7f2624b71640 1 -- 172.21.15.118:0/3932418896 wait complete. 2024-09-21T12:06:24.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.754+0000 7f3c74f4a640 1 -- 172.21.15.118:0/203609993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 msgr2=0x7f3c70101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.754+0000 7f3c74f4a640 1 --2- 172.21.15.118:0/203609993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 0x7f3c70101d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009880 tx=0x7f3c5802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.754+0000 7f3c74f4a640 1 -- 172.21.15.118:0/203609993 shutdown_connections 2024-09-21T12:06:24.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.754+0000 7f3c74f4a640 1 --2- 172.21.15.118:0/203609993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 0x7f3c70101d90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.754+0000 7f3c74f4a640 1 --2- 172.21.15.118:0/203609993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c70107930 0x7f3c70107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.754+0000 7f3c74f4a640 1 -- 172.21.15.118:0/203609993 >> 172.21.15.118:0/203609993 conn(0x7f3c700fd630 msgr2=0x7f3c700ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:24.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.754+0000 7f3c74f4a640 1 -- 172.21.15.118:0/203609993 shutdown_connections 2024-09-21T12:06:24.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.754+0000 7f3c74f4a640 1 -- 172.21.15.118:0/203609993 wait complete. 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.755+0000 7f3c74f4a640 1 Processor -- start 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.755+0000 7f3c74f4a640 1 -- start start 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.755+0000 7f3c74f4a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 0x7f3c7019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.755+0000 7f3c74f4a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c70107930 0x7f3c7019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.755+0000 7f3c74f4a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7010ee00 con 0x7f3c70101930 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.755+0000 7f3c74f4a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7010ec80 con 0x7f3c70107930 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.755+0000 7f3c6e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 0x7f3c7019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.755+0000 7f3c6e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 0x7f3c7019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58448/0 (socket says 172.21.15.118:58448) 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.755+0000 7f3c6e59c640 1 -- 172.21.15.118:0/1828974933 learned_addr learned my addr 172.21.15.118:0/1828974933 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c6dd9b640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c70107930 0x7f3c7019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c6e59c640 1 -- 172.21.15.118:0/1828974933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c70107930 msgr2=0x7f3c7019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c6e59c640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c70107930 0x7f3c7019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c6e59c640 1 -- 172.21.15.118:0/1828974933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c70197810 con 0x7f3c70101930 2024-09-21T12:06:24.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c6e59c640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 0x7f3c7019d690 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000e970 tx=0x7f3c6000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:24.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c677fe640 1 -- 172.21.15.118:0/1828974933 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c6000cac0 con 0x7f3c70101930 2024-09-21T12:06:24.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c677fe640 1 -- 172.21.15.118:0/1828974933 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c600054e0 con 0x7f3c70101930 2024-09-21T12:06:24.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c70197b00 con 0x7f3c70101930 2024-09-21T12:06:24.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c677fe640 1 -- 172.21.15.118:0/1828974933 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c60010430 con 0x7f3c70101930 2024-09-21T12:06:24.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.756+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c70198060 con 0x7f3c70101930 2024-09-21T12:06:24.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.757+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c70103070 con 0x7f3c70101930 2024-09-21T12:06:24.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.758+0000 7f3c677fe640 1 -- 172.21.15.118:0/1828974933 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3c60004e80 con 0x7f3c70101930 2024-09-21T12:06:24.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.759+0000 7f3c677fe640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c5c07af30 0x7f3c5c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:24.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.759+0000 7f3c677fe640 1 -- 172.21.15.118:0/1828974933 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3c6009e6e0 con 0x7f3c70101930 2024-09-21T12:06:24.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.759+0000 7f3c6dd9b640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c5c07af30 0x7f3c5c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:24.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.759+0000 7f3c6dd9b640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c5c07af30 0x7f3c5c07d3f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3c70198b60 tx=0x7f3c58031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:24.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:24.764+0000 7f3c677fe640 1 -- 172.21.15.118:0/1828974933 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c60069c30 con 0x7f3c70101930 2024-09-21T12:06:25.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.014+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3c70109ea0 con 0x7f3c70101930 2024-09-21T12:06:25.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.014+0000 7f3c677fe640 1 -- 172.21.15.118:0/1828974933 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3c6006eae0 con 0x7f3c70101930 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:06:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:06:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:06:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:06:25.018 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.016+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c5c07af30 msgr2=0x7f3c5c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.016+0000 7f3c74f4a640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c5c07af30 0x7f3c5c07d3f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3c70198b60 tx=0x7f3c58031400 comp rx=0 tx=0).stop 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.016+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 msgr2=0x7f3c7019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.016+0000 7f3c74f4a640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 0x7f3c7019d690 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000e970 tx=0x7f3c6000ed70 comp rx=0 tx=0).stop 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.017+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 shutdown_connections 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.017+0000 7f3c74f4a640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c70107930 0x7f3c7019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.017+0000 7f3c74f4a640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c5c07af30 0x7f3c5c07d3f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.017+0000 7f3c74f4a640 1 --2- 172.21.15.118:0/1828974933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c70101930 0x7f3c7019d690 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.017+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 >> 172.21.15.118:0/1828974933 conn(0x7f3c700fd630 msgr2=0x7f3c700fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:25.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.017+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 shutdown_connections 2024-09-21T12:06:25.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.017+0000 7f3c74f4a640 1 -- 172.21.15.118:0/1828974933 wait complete. 2024-09-21T12:06:25.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 -- 172.21.15.118:0/2201370794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 msgr2=0x7f3b401065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 --2- 172.21.15.118:0/2201370794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 0x7f3b401065e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009880 tx=0x7f3b3002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 -- 172.21.15.118:0/2201370794 shutdown_connections 2024-09-21T12:06:25.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 --2- 172.21.15.118:0/2201370794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 0x7f3b401065e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 --2- 172.21.15.118:0/2201370794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401000f0 0x7f3b401004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 -- 172.21.15.118:0/2201370794 >> 172.21.15.118:0/2201370794 conn(0x7f3b400fbc60 msgr2=0x7f3b400fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:25.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 -- 172.21.15.118:0/2201370794 shutdown_connections 2024-09-21T12:06:25.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 -- 172.21.15.118:0/2201370794 wait complete. 2024-09-21T12:06:25.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 Processor -- start 2024-09-21T12:06:25.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.099+0000 7f3b48058640 1 -- start start 2024-09-21T12:06:25.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b48058640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401000f0 0x7f3b4019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:25.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b48058640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 0x7f3b4019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:25.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b48058640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4010ee50 con 0x7f3b40100aa0 2024-09-21T12:06:25.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b48058640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4010ecd0 con 0x7f3b401000f0 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b455f3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 0x7f3b4019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b455f3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 0x7f3b4019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58474/0 (socket says 172.21.15.118:58474) 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b455f3640 1 -- 172.21.15.118:0/17984637 learned_addr learned my addr 172.21.15.118:0/17984637 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b45df4640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401000f0 0x7f3b4019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b455f3640 1 -- 172.21.15.118:0/17984637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401000f0 msgr2=0x7f3b4019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b455f3640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401000f0 0x7f3b4019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b455f3640 1 -- 172.21.15.118:0/17984637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b40197840 con 0x7f3b40100aa0 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b455f3640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 0x7f3b4019dc00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3b30031460 tx=0x7f3b300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b36ffd640 1 -- 172.21.15.118:0/17984637 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b3003f070 con 0x7f3b40100aa0 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b36ffd640 1 -- 172.21.15.118:0/17984637 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b30004cf0 con 0x7f3b40100aa0 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b40197ad0 con 0x7f3b40100aa0 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.100+0000 7f3b36ffd640 1 -- 172.21.15.118:0/17984637 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b30035030 con 0x7f3b40100aa0 2024-09-21T12:06:25.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.101+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b40198080 con 0x7f3b40100aa0 2024-09-21T12:06:25.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.101+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b401031b0 con 0x7f3b40100aa0 2024-09-21T12:06:25.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.102+0000 7f3b36ffd640 1 -- 172.21.15.118:0/17984637 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3b30042070 con 0x7f3b40100aa0 2024-09-21T12:06:25.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.102+0000 7f3b36ffd640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b2c07af30 0x7f3b2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:25.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.103+0000 7f3b36ffd640 1 -- 172.21.15.118:0/17984637 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3b300bebb0 con 0x7f3b40100aa0 2024-09-21T12:06:25.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.103+0000 7f3b45df4640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b2c07af30 0x7f3b2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:25.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.103+0000 7f3b45df4640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b2c07af30 0x7f3b2c07d3f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009890 tx=0x7f3b3c008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:25.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.107+0000 7f3b36ffd640 1 -- 172.21.15.118:0/17984637 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b300c5080 con 0x7f3b40100aa0 2024-09-21T12:06:25.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:25 smithi118 ceph-mon[111738]: from='client.35312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:25.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:25 smithi118 ceph-mon[111738]: from='client.35316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:25.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:25 smithi118 ceph-mon[111738]: from='client.35320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:25.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:25 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1828974933' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:06:25.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.322+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3b40198d70 con 0x7f3b40100aa0 2024-09-21T12:06:25.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.323+0000 7f3b36ffd640 1 -- 172.21.15.118:0/17984637 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f3b3008a100 con 0x7f3b40100aa0 2024-09-21T12:06:25.325 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:06:25.325 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:06:25.325 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:06:25.325 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:06:25.325 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:06:25.326 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:06:25.327 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:06:25.328 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:06:25.328 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:06:25.328 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:06:25.328 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:06:25.328 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:06:25.328 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:06:25.328 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:06:25.328 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b2c07af30 msgr2=0x7f3b2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b2c07af30 0x7f3b2c07d3f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009890 tx=0x7f3b3c008040 comp rx=0 tx=0).stop 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 msgr2=0x7f3b4019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 0x7f3b4019dc00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3b30031460 tx=0x7f3b300048f0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 shutdown_connections 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b2c07af30 0x7f3b2c07d3f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b40100aa0 0x7f3b4019dc00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 --2- 172.21.15.118:0/17984637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b401000f0 0x7f3b4019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 >> 172.21.15.118:0/17984637 conn(0x7f3b400fbc60 msgr2=0x7f3b40105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 shutdown_connections 2024-09-21T12:06:25.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.325+0000 7f3b48058640 1 -- 172.21.15.118:0/17984637 wait complete. 2024-09-21T12:06:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.409+0000 7f6b242f2640 1 -- 172.21.15.118:0/4216531857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c102ad0 msgr2=0x7f6b1c102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.409+0000 7f6b242f2640 1 --2- 172.21.15.118:0/4216531857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c102ad0 0x7f6b1c102eb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009880 tx=0x7f6b1802a530 comp rx=0 tx=0).stop 2024-09-21T12:06:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.409+0000 7f6b242f2640 1 -- 172.21.15.118:0/4216531857 shutdown_connections 2024-09-21T12:06:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.409+0000 7f6b242f2640 1 --2- 172.21.15.118:0/4216531857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c1033f0 0x7f6b1c10b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.409+0000 7f6b242f2640 1 --2- 172.21.15.118:0/4216531857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c102ad0 0x7f6b1c102eb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.409+0000 7f6b242f2640 1 -- 172.21.15.118:0/4216531857 >> 172.21.15.118:0/4216531857 conn(0x7f6b1c0fc510 msgr2=0x7f6b1c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.409+0000 7f6b242f2640 1 -- 172.21.15.118:0/4216531857 shutdown_connections 2024-09-21T12:06:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.409+0000 7f6b242f2640 1 -- 172.21.15.118:0/4216531857 wait complete. 2024-09-21T12:06:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b242f2640 1 Processor -- start 2024-09-21T12:06:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b242f2640 1 -- start start 2024-09-21T12:06:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b242f2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c102ad0 0x7f6b1c19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b242f2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c1033f0 0x7f6b1c19dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b242f2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c10ede0 con 0x7f6b1c1033f0 2024-09-21T12:06:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b242f2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c10ec60 con 0x7f6b1c102ad0 2024-09-21T12:06:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b2188d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c1033f0 0x7f6b1c19dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b2188d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c1033f0 0x7f6b1c19dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58492/0 (socket says 172.21.15.118:58492) 2024-09-21T12:06:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b2188d640 1 -- 172.21.15.118:0/1713806946 learned_addr learned my addr 172.21.15.118:0/1713806946 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.410+0000 7f6b2208e640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c102ad0 0x7f6b1c19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b2188d640 1 -- 172.21.15.118:0/1713806946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c102ad0 msgr2=0x7f6b1c19d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b2188d640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c102ad0 0x7f6b1c19d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b2188d640 1 -- 172.21.15.118:0/1713806946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1c1978f0 con 0x7f6b1c1033f0 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b2208e640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c102ad0 0x7f6b1c19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b2188d640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c1033f0 0x7f6b1c19dc70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00d6c0 tx=0x7f6b0c00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b137fe640 1 -- 172.21.15.118:0/1713806946 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b0c017070 con 0x7f6b1c1033f0 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1c197be0 con 0x7f6b1c1033f0 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b137fe640 1 -- 172.21.15.118:0/1713806946 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b0c009ce0 con 0x7f6b1c1033f0 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b137fe640 1 -- 172.21.15.118:0/1713806946 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b0c00f3c0 con 0x7f6b1c1033f0 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.411+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1c198170 con 0x7f6b1c1033f0 2024-09-21T12:06:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.412+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b1c06abe0 con 0x7f6b1c1033f0 2024-09-21T12:06:25.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.413+0000 7f6b137fe640 1 -- 172.21.15.118:0/1713806946 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6b0c010460 con 0x7f6b1c1033f0 2024-09-21T12:06:25.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.413+0000 7f6b137fe640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b0807f350 0x7f6b08081810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:25.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.413+0000 7f6b137fe640 1 -- 172.21.15.118:0/1713806946 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6b0c09df30 con 0x7f6b1c1033f0 2024-09-21T12:06:25.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.413+0000 7f6b2208e640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b0807f350 0x7f6b08081810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:25.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.414+0000 7f6b2208e640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b0807f350 0x7f6b08081810 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6b18000c00 tx=0x7f6b18031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:25.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.417+0000 7f6b137fe640 1 -- 172.21.15.118:0/1713806946 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b0c0693e0 con 0x7f6b1c1033f0 2024-09-21T12:06:25.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:25 smithi149 ceph-mon[79770]: from='client.35312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:25 smithi149 ceph-mon[79770]: from='client.35316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:25 smithi149 ceph-mon[79770]: from='client.35320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:25.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:25 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1828974933' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:06:25.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.612+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6b1c106010 con 0x7f6b0807f350 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.614+0000 7f6b137fe640 1 -- 172.21.15.118:0/1713806946 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6b18004420 con 0x7f6b0807f350 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:06:25.616 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:06:25.617 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:06:25.617 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:06:25.617 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:06:25.617 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:06:25.617 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:06:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b0807f350 msgr2=0x7f6b08081810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b0807f350 0x7f6b08081810 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6b18000c00 tx=0x7f6b18031400 comp rx=0 tx=0).stop 2024-09-21T12:06:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c1033f0 msgr2=0x7f6b1c19dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c1033f0 0x7f6b1c19dc70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00d6c0 tx=0x7f6b0c00db80 comp rx=0 tx=0).stop 2024-09-21T12:06:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 shutdown_connections 2024-09-21T12:06:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b0807f350 0x7f6b08081810 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b1c1033f0 0x7f6b1c19dc70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 --2- 172.21.15.118:0/1713806946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b1c102ad0 0x7f6b1c19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 >> 172.21.15.118:0/1713806946 conn(0x7f6b1c0fc510 msgr2=0x7f6b1c108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 shutdown_connections 2024-09-21T12:06:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.616+0000 7f6b242f2640 1 -- 172.21.15.118:0/1713806946 wait complete. 2024-09-21T12:06:25.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.696+0000 7f474fd78640 1 -- 172.21.15.118:0/306254506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481078f0 msgr2=0x7f4748107cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 --2- 172.21.15.118:0/306254506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481078f0 0x7f4748107cd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4738009880 tx=0x7f473802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 -- 172.21.15.118:0/306254506 shutdown_connections 2024-09-21T12:06:25.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 --2- 172.21.15.118:0/306254506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47481018f0 0x7f4748101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 --2- 172.21.15.118:0/306254506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481078f0 0x7f4748107cd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 -- 172.21.15.118:0/306254506 >> 172.21.15.118:0/306254506 conn(0x7f47480fd630 msgr2=0x7f47480ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:25.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 -- 172.21.15.118:0/306254506 shutdown_connections 2024-09-21T12:06:25.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 -- 172.21.15.118:0/306254506 wait complete. 2024-09-21T12:06:25.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 Processor -- start 2024-09-21T12:06:25.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 -- start start 2024-09-21T12:06:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481018f0 0x7f474819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.697+0000 7f474fd78640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47481078f0 0x7f474819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474fd78640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f474810eda0 con 0x7f47481018f0 2024-09-21T12:06:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474fd78640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f474810ec20 con 0x7f47481078f0 2024-09-21T12:06:25.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474db14640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481018f0 0x7f474819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474db14640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481018f0 0x7f474819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56224/0 (socket says 172.21.15.118:56224) 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474db14640 1 -- 172.21.15.118:0/4035900967 learned_addr learned my addr 172.21.15.118:0/4035900967 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474db14640 1 -- 172.21.15.118:0/4035900967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47481078f0 msgr2=0x7f474819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474db14640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47481078f0 0x7f474819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474db14640 1 -- 172.21.15.118:0/4035900967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4748197770 con 0x7f47481018f0 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474db14640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481018f0 0x7f474819d6a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4738031460 tx=0x7f47380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f473effd640 1 -- 172.21.15.118:0/4035900967 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f473803f070 con 0x7f47481018f0 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f473effd640 1 -- 172.21.15.118:0/4035900967 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47380035f0 con 0x7f47481018f0 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4748197a00 con 0x7f47481018f0 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f473effd640 1 -- 172.21.15.118:0/4035900967 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4738035030 con 0x7f47481018f0 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.698+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4748197f00 con 0x7f47481018f0 2024-09-21T12:06:25.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.699+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4748103030 con 0x7f47481018f0 2024-09-21T12:06:25.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.700+0000 7f473effd640 1 -- 172.21.15.118:0/4035900967 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4738042070 con 0x7f47481018f0 2024-09-21T12:06:25.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.700+0000 7f473effd640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f473407af80 0x7f473407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:25.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.700+0000 7f473effd640 1 -- 172.21.15.118:0/4035900967 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f47380be9c0 con 0x7f47481018f0 2024-09-21T12:06:25.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.700+0000 7f474d313640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f473407af80 0x7f473407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:25.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.701+0000 7f474d313640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f473407af80 0x7f473407d440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4744005fd0 tx=0x7f4744005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:25.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.705+0000 7f473effd640 1 -- 172.21.15.118:0/4035900967 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4738089f90 con 0x7f47481018f0 2024-09-21T12:06:25.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.952+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4748104b00 con 0x7f47481018f0 2024-09-21T12:06:25.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.953+0000 7f473effd640 1 -- 172.21.15.118:0/4035900967 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f473808ee40 con 0x7f47481018f0 2024-09-21T12:06:25.955 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:06:25.955 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:06:25.955 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:06:25.955 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:06:25.955 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:06:25.956 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:06:25.957 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:06:25.957 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:06:25.957 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:06:25.957 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:06:25.957 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:06:25.957 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:06:25.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f473407af80 msgr2=0x7f473407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f473407af80 0x7f473407d440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4744005fd0 tx=0x7f4744005850 comp rx=0 tx=0).stop 2024-09-21T12:06:25.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481018f0 msgr2=0x7f474819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:25.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481018f0 0x7f474819d6a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4738031460 tx=0x7f47380045e0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 shutdown_connections 2024-09-21T12:06:25.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47481078f0 0x7f474819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f473407af80 0x7f473407d440 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 --2- 172.21.15.118:0/4035900967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47481018f0 0x7f474819d6a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:25.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 >> 172.21.15.118:0/4035900967 conn(0x7f47480fd630 msgr2=0x7f47480fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:25.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 shutdown_connections 2024-09-21T12:06:25.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:25.955+0000 7f474fd78640 1 -- 172.21.15.118:0/4035900967 wait complete. 2024-09-21T12:06:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:26 smithi118 ceph-mon[111738]: pgmap v829: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:26 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/17984637' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:06:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:26 smithi118 ceph-mon[111738]: from='client.35332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:26 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/4035900967' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:06:26.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:26 smithi149 ceph-mon[79770]: pgmap v829: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:26.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:26 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/17984637' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:06:26.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:26 smithi149 ceph-mon[79770]: from='client.35332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:26.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:26 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/4035900967' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:06:28.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:28 smithi118 ceph-mon[111738]: pgmap v830: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:28 smithi149 ceph-mon[79770]: pgmap v830: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:30 smithi118 ceph-mon[111738]: pgmap v831: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:30 smithi149 ceph-mon[79770]: pgmap v831: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:32.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:32 smithi118 ceph-mon[111738]: pgmap v832: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:32 smithi149 ceph-mon[79770]: pgmap v832: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:34 smithi118 ceph-mon[111738]: pgmap v833: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:34 smithi149 ceph-mon[79770]: pgmap v833: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:35.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:06:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:06:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:36 smithi118 ceph-mon[111738]: pgmap v834: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:36 smithi149 ceph-mon[79770]: pgmap v834: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:38 smithi118 ceph-mon[111738]: pgmap v835: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:38 smithi149 ceph-mon[79770]: pgmap v835: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:40.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:40 smithi149 ceph-mon[79770]: pgmap v836: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:40 smithi118 ceph-mon[111738]: pgmap v836: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:42.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:42 smithi149 ceph-mon[79770]: pgmap v837: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:42.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:42 smithi118 ceph-mon[111738]: pgmap v837: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:44 smithi118 ceph-mon[111738]: pgmap v838: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:44 smithi149 ceph-mon[79770]: pgmap v838: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:46 smithi118 ceph-mon[111738]: pgmap v839: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:46.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:46 smithi149 ceph-mon[79770]: pgmap v839: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:48 smithi149 ceph-mon[79770]: pgmap v840: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:48 smithi118 ceph-mon[111738]: pgmap v840: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:50 smithi149 ceph-mon[79770]: pgmap v841: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:50.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:06:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:50 smithi118 ceph-mon[111738]: pgmap v841: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:06:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:52 smithi118 ceph-mon[111738]: pgmap v842: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:52.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:52 smithi149 ceph-mon[79770]: pgmap v842: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:54 smithi118 ceph-mon[111738]: pgmap v843: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:54.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:54 smithi149 ceph-mon[79770]: pgmap v843: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:56.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.050+0000 7fa59f4f9640 1 -- 172.21.15.118:0/361542506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 msgr2=0x7fa598100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.050+0000 7fa59f4f9640 1 --2- 172.21.15.118:0/361542506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 0x7fa598100470 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa594009880 tx=0x7fa59402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.050+0000 7fa59f4f9640 1 -- 172.21.15.118:0/361542506 shutdown_connections 2024-09-21T12:06:56.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.050+0000 7fa59f4f9640 1 --2- 172.21.15.118:0/361542506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa598100a40 0x7fa598106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.050+0000 7fa59f4f9640 1 --2- 172.21.15.118:0/361542506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 0x7fa598100470 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.050+0000 7fa59f4f9640 1 -- 172.21.15.118:0/361542506 >> 172.21.15.118:0/361542506 conn(0x7fa5980fbc60 msgr2=0x7fa5980fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:56.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.051+0000 7fa59f4f9640 1 -- 172.21.15.118:0/361542506 shutdown_connections 2024-09-21T12:06:56.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.051+0000 7fa59f4f9640 1 -- 172.21.15.118:0/361542506 wait complete. 2024-09-21T12:06:56.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.051+0000 7fa59f4f9640 1 Processor -- start 2024-09-21T12:06:56.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.051+0000 7fa59f4f9640 1 -- start start 2024-09-21T12:06:56.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59f4f9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 0x7fa598101010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59f4f9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa598100a40 0x7fa598101550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59f4f9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa59810ee00 con 0x7fa598100090 2024-09-21T12:06:56.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59f4f9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa59810ec80 con 0x7fa598100a40 2024-09-21T12:06:56.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59d295640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 0x7fa598101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59d295640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 0x7fa598101010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43904/0 (socket says 172.21.15.118:43904) 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59d295640 1 -- 172.21.15.118:0/476997113 learned_addr learned my addr 172.21.15.118:0/476997113 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59ca94640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa598100a40 0x7fa598101550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59d295640 1 -- 172.21.15.118:0/476997113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa598100a40 msgr2=0x7fa598101550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59d295640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa598100a40 0x7fa598101550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59d295640 1 -- 172.21.15.118:0/476997113 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa598101a90 con 0x7fa598100090 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59ca94640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa598100a40 0x7fa598101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59d295640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 0x7fa598101010 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa594031460 tx=0x7fa5940045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa58e7fc640 1 -- 172.21.15.118:0/476997113 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa59403f070 con 0x7fa598100090 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa58e7fc640 1 -- 172.21.15.118:0/476997113 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5940035f0 con 0x7fa598100090 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa598101d20 con 0x7fa598100090 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.052+0000 7fa58e7fc640 1 -- 172.21.15.118:0/476997113 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa594035030 con 0x7fa598100090 2024-09-21T12:06:56.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.053+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5981a3db0 con 0x7fa598100090 2024-09-21T12:06:56.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.053+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa598103150 con 0x7fa598100090 2024-09-21T12:06:56.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.054+0000 7fa58e7fc640 1 -- 172.21.15.118:0/476997113 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa594042070 con 0x7fa598100090 2024-09-21T12:06:56.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.055+0000 7fa58e7fc640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa58407af80 0x7fa58407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.055+0000 7fa59ca94640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa58407af80 0x7fa58407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.055+0000 7fa58e7fc640 1 -- 172.21.15.118:0/476997113 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa5940be9c0 con 0x7fa598100090 2024-09-21T12:06:56.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.055+0000 7fa59ca94640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa58407af80 0x7fa58407d440 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa598102aa0 tx=0x7fa588005e50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:56.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.059+0000 7fa58e7fc640 1 -- 172.21.15.118:0/476997113 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa594089f90 con 0x7fa598100090 2024-09-21T12:06:56.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.257+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa598062630 con 0x7fa58407af80 2024-09-21T12:06:56.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.259+0000 7fa58e7fc640 1 -- 172.21.15.118:0/476997113 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa598062630 con 0x7fa58407af80 2024-09-21T12:06:56.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa58407af80 msgr2=0x7fa58407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa58407af80 0x7fa58407d440 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa598102aa0 tx=0x7fa588005e50 comp rx=0 tx=0).stop 2024-09-21T12:06:56.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 msgr2=0x7fa598101010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 0x7fa598101010 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa594031460 tx=0x7fa5940045e0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 shutdown_connections 2024-09-21T12:06:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa598100a40 0x7fa598101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa58407af80 0x7fa58407d440 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 --2- 172.21.15.118:0/476997113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa598100090 0x7fa598101010 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 >> 172.21.15.118:0/476997113 conn(0x7fa5980fbc60 msgr2=0x7fa5980fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 shutdown_connections 2024-09-21T12:06:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.261+0000 7fa59f4f9640 1 -- 172.21.15.118:0/476997113 wait complete. 2024-09-21T12:06:56.272 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:06:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:56 smithi118 ceph-mon[111738]: pgmap v844: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:56.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 -- 172.21.15.118:0/1735596178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac1033c0 msgr2=0x7f10ac10b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 --2- 172.21.15.118:0/1735596178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac1033c0 0x7f10ac10b8b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009880 tx=0x7f10a802a530 comp rx=0 tx=0).stop 2024-09-21T12:06:56.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 -- 172.21.15.118:0/1735596178 shutdown_connections 2024-09-21T12:06:56.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 --2- 172.21.15.118:0/1735596178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac1033c0 0x7f10ac10b8b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 --2- 172.21.15.118:0/1735596178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10ac102aa0 0x7f10ac102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 -- 172.21.15.118:0/1735596178 >> 172.21.15.118:0/1735596178 conn(0x7f10ac0fc4c0 msgr2=0x7f10ac0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:56.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 -- 172.21.15.118:0/1735596178 shutdown_connections 2024-09-21T12:06:56.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 -- 172.21.15.118:0/1735596178 wait complete. 2024-09-21T12:06:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 Processor -- start 2024-09-21T12:06:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.346+0000 7f10b439f640 1 -- start start 2024-09-21T12:06:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b439f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac102aa0 0x7f10ac19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b439f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10ac1033c0 0x7f10ac19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b439f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac10ee30 con 0x7f10ac102aa0 2024-09-21T12:06:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b439f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac10ecb0 con 0x7f10ac1033c0 2024-09-21T12:06:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b213b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac102aa0 0x7f10ac19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b213b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac102aa0 0x7f10ac19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43922/0 (socket says 172.21.15.118:43922) 2024-09-21T12:06:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b213b640 1 -- 172.21.15.118:0/4174876603 learned_addr learned my addr 172.21.15.118:0/4174876603 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b193a640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10ac1033c0 0x7f10ac19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b213b640 1 -- 172.21.15.118:0/4174876603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10ac1033c0 msgr2=0x7f10ac19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b213b640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10ac1033c0 0x7f10ac19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b213b640 1 -- 172.21.15.118:0/4174876603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac197860 con 0x7f10ac102aa0 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b193a640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10ac1033c0 0x7f10ac19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b213b640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac102aa0 0x7f10ac19d6a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f109c00b420 tx=0x7f109c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10a37fe640 1 -- 172.21.15.118:0/4174876603 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f109c011630 con 0x7f10ac102aa0 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac197b50 con 0x7f10ac102aa0 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10a37fe640 1 -- 172.21.15.118:0/4174876603 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f109c016070 con 0x7f10ac102aa0 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10a37fe640 1 -- 172.21.15.118:0/4174876603 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f109c010d40 con 0x7f10ac102aa0 2024-09-21T12:06:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.347+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac1980e0 con 0x7f10ac102aa0 2024-09-21T12:06:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.348+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10ac06a410 con 0x7f10ac102aa0 2024-09-21T12:06:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.349+0000 7f10a37fe640 1 -- 172.21.15.118:0/4174876603 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f109c01b460 con 0x7f10ac102aa0 2024-09-21T12:06:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.349+0000 7f10a37fe640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f109807af30 0x7f109807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.350+0000 7f10b193a640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f109807af30 0x7f109807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.350+0000 7f10a37fe640 1 -- 172.21.15.118:0/4174876603 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f109c09d7f0 con 0x7f10ac102aa0 2024-09-21T12:06:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.350+0000 7f10b193a640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f109807af30 0x7f109807d3f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f10a8031460 tx=0x7f10a80095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:56.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.354+0000 7f10a37fe640 1 -- 172.21.15.118:0/4174876603 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f109c021250 con 0x7f10ac102aa0 2024-09-21T12:06:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:56 smithi149 ceph-mon[79770]: pgmap v844: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:56.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.546+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f10ac198d90 con 0x7f109807af30 2024-09-21T12:06:56.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.547+0000 7f10a37fe640 1 -- 172.21.15.118:0/4174876603 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f10ac198d90 con 0x7f109807af30 2024-09-21T12:06:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.549+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f109807af30 msgr2=0x7f109807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.549+0000 7f10b439f640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f109807af30 0x7f109807d3f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f10a8031460 tx=0x7f10a80095f0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.549+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac102aa0 msgr2=0x7f10ac19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.549+0000 7f10b439f640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac102aa0 0x7f10ac19d6a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f109c00b420 tx=0x7f109c00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.549+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 shutdown_connections 2024-09-21T12:06:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.550+0000 7f10b439f640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10ac1033c0 0x7f10ac19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.550+0000 7f10b439f640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f109807af30 0x7f109807d3f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.550+0000 7f10b439f640 1 --2- 172.21.15.118:0/4174876603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10ac102aa0 0x7f10ac19d6a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.550+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 >> 172.21.15.118:0/4174876603 conn(0x7f10ac0fc4c0 msgr2=0x7f10ac108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.550+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 shutdown_connections 2024-09-21T12:06:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.550+0000 7f10b439f640 1 -- 172.21.15.118:0/4174876603 wait complete. 2024-09-21T12:06:56.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.631+0000 7f855bff2640 1 -- 172.21.15.118:0/2731799098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554107930 msgr2=0x7f8554107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.631+0000 7f855bff2640 1 --2- 172.21.15.118:0/2731799098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554107930 0x7f8554107d10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8550009880 tx=0x7f855002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.631+0000 7f855bff2640 1 -- 172.21.15.118:0/2731799098 shutdown_connections 2024-09-21T12:06:56.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.631+0000 7f855bff2640 1 --2- 172.21.15.118:0/2731799098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8554101930 0x7f8554101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.631+0000 7f855bff2640 1 --2- 172.21.15.118:0/2731799098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554107930 0x7f8554107d10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.631+0000 7f855bff2640 1 -- 172.21.15.118:0/2731799098 >> 172.21.15.118:0/2731799098 conn(0x7f85540fd630 msgr2=0x7f85540ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:56.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.631+0000 7f855bff2640 1 -- 172.21.15.118:0/2731799098 shutdown_connections 2024-09-21T12:06:56.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.631+0000 7f855bff2640 1 -- 172.21.15.118:0/2731799098 wait complete. 2024-09-21T12:06:56.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f855bff2640 1 Processor -- start 2024-09-21T12:06:56.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f855bff2640 1 -- start start 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f855bff2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554101930 0x7f855419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f855bff2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8554107930 0x7f855419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f855bff2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f855410ee60 con 0x7f8554101930 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f855bff2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f855410ece0 con 0x7f8554107930 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f8559d8e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554101930 0x7f855419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f8559d8e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554101930 0x7f855419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43942/0 (socket says 172.21.15.118:43942) 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f8559d8e640 1 -- 172.21.15.118:0/2801891949 learned_addr learned my addr 172.21.15.118:0/2801891949 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.632+0000 7f855958d640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8554107930 0x7f855419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f8559d8e640 1 -- 172.21.15.118:0/2801891949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8554107930 msgr2=0x7f855419dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f8559d8e640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8554107930 0x7f855419dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f8559d8e640 1 -- 172.21.15.118:0/2801891949 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8554197870 con 0x7f8554101930 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f855958d640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8554107930 0x7f855419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f8559d8e640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554101930 0x7f855419d6b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8550031460 tx=0x7f85500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:56.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f8546ffd640 1 -- 172.21.15.118:0/2801891949 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f855003f070 con 0x7f8554101930 2024-09-21T12:06:56.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f8546ffd640 1 -- 172.21.15.118:0/2801891949 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8550004cf0 con 0x7f8554101930 2024-09-21T12:06:56.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8554197b00 con 0x7f8554101930 2024-09-21T12:06:56.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f8546ffd640 1 -- 172.21.15.118:0/2801891949 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8550035030 con 0x7f8554101930 2024-09-21T12:06:56.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.633+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8554198030 con 0x7f8554101930 2024-09-21T12:06:56.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.634+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8554103070 con 0x7f8554101930 2024-09-21T12:06:56.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.635+0000 7f8546ffd640 1 -- 172.21.15.118:0/2801891949 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8550042070 con 0x7f8554101930 2024-09-21T12:06:56.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.635+0000 7f8546ffd640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f854007af30 0x7f854007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.635+0000 7f855958d640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f854007af30 0x7f854007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.635+0000 7f8546ffd640 1 -- 172.21.15.118:0/2801891949 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f85500bebb0 con 0x7f8554101930 2024-09-21T12:06:56.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.636+0000 7f855958d640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f854007af30 0x7f854007d3f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f85540ffbf0 tx=0x7f8548008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:56.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.640+0000 7f8546ffd640 1 -- 172.21.15.118:0/2801891949 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85500c5080 con 0x7f8554101930 2024-09-21T12:06:56.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.826+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8554198da0 con 0x7f854007af30 2024-09-21T12:06:56.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.835+0000 7f8546ffd640 1 -- 172.21.15.118:0/2801891949 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8554198da0 con 0x7f854007af30 2024-09-21T12:06:56.837 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:06:56.837 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (24m) 3m ago 35m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:06:56.837 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (27m) 3m ago 36m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (27m) 3m ago 35m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (23m) 3m ago 35m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (22m) 3m ago 35m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (24m) 3m ago 35m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (19m) 3m ago 30m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (19m) 3m ago 30m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (3m) 3m ago 30m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (18m) 3m ago 30m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (27m) 3m ago 37m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (26m) 3m ago 34m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (23m) 3m ago 37m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (23m) 3m ago 34m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:06:56.838 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (25m) 3m ago 35m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:06:56.839 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (25m) 3m ago 35m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:06:56.839 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (22m) 3m ago 33m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:06:56.839 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (21m) 3m ago 33m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:06:56.839 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (21m) 3m ago 32m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:06:56.839 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (20m) 3m ago 32m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:06:56.839 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (20m) 3m ago 31m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:06:56.839 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (19m) 3m ago 31m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:06:56.839 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (25m) 3m ago 35m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f854007af30 msgr2=0x7f854007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f854007af30 0x7f854007d3f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f85540ffbf0 tx=0x7f8548008040 comp rx=0 tx=0).stop 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554101930 msgr2=0x7f855419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554101930 0x7f855419d6b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8550031460 tx=0x7f85500048f0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 shutdown_connections 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8554107930 0x7f855419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f854007af30 0x7f854007d3f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 --2- 172.21.15.118:0/2801891949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8554101930 0x7f855419d6b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 >> 172.21.15.118:0/2801891949 conn(0x7f85540fd630 msgr2=0x7f85540fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:56.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 shutdown_connections 2024-09-21T12:06:56.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.837+0000 7f855bff2640 1 -- 172.21.15.118:0/2801891949 wait complete. 2024-09-21T12:06:56.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.917+0000 7ff15f880640 1 -- 172.21.15.118:0/926485031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158107930 msgr2=0x7ff158107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.917+0000 7ff15f880640 1 --2- 172.21.15.118:0/926485031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158107930 0x7ff158107d10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff150009880 tx=0x7ff15002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.917+0000 7ff15f880640 1 -- 172.21.15.118:0/926485031 shutdown_connections 2024-09-21T12:06:56.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.917+0000 7ff15f880640 1 --2- 172.21.15.118:0/926485031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff158101930 0x7ff158101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.917+0000 7ff15f880640 1 --2- 172.21.15.118:0/926485031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158107930 0x7ff158107d10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.917+0000 7ff15f880640 1 -- 172.21.15.118:0/926485031 >> 172.21.15.118:0/926485031 conn(0x7ff1580fd630 msgr2=0x7ff1580ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:56.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.918+0000 7ff15f880640 1 -- 172.21.15.118:0/926485031 shutdown_connections 2024-09-21T12:06:56.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.918+0000 7ff15f880640 1 -- 172.21.15.118:0/926485031 wait complete. 2024-09-21T12:06:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.918+0000 7ff15f880640 1 Processor -- start 2024-09-21T12:06:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.918+0000 7ff15f880640 1 -- start start 2024-09-21T12:06:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15f880640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158101930 0x7ff1580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15f880640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff158107930 0x7ff158074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15f880640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff15810ee60 con 0x7ff158101930 2024-09-21T12:06:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15f880640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff15810ece0 con 0x7ff158107930 2024-09-21T12:06:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15d61c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158101930 0x7ff1580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15d61c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158101930 0x7ff1580744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43966/0 (socket says 172.21.15.118:43966) 2024-09-21T12:06:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15d61c640 1 -- 172.21.15.118:0/1730360241 learned_addr learned my addr 172.21.15.118:0/1730360241 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15ce1b640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff158107930 0x7ff158074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15d61c640 1 -- 172.21.15.118:0/1730360241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff158107930 msgr2=0x7ff158074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15d61c640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff158107930 0x7ff158074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15d61c640 1 -- 172.21.15.118:0/1730360241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff158074f70 con 0x7ff158101930 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15ce1b640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff158107930 0x7ff158074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff15d61c640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158101930 0x7ff1580744f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff150031460 tx=0x7ff1500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.919+0000 7ff1567fc640 1 -- 172.21.15.118:0/1730360241 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff15003f070 con 0x7ff158101930 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.920+0000 7ff1567fc640 1 -- 172.21.15.118:0/1730360241 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff150004cf0 con 0x7ff158101930 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.920+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff158075200 con 0x7ff158101930 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.920+0000 7ff1567fc640 1 -- 172.21.15.118:0/1730360241 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff150035030 con 0x7ff158101930 2024-09-21T12:06:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.920+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1581a3e30 con 0x7ff158101930 2024-09-21T12:06:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.921+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff158103070 con 0x7ff158101930 2024-09-21T12:06:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.921+0000 7ff1567fc640 1 -- 172.21.15.118:0/1730360241 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff150042070 con 0x7ff158101930 2024-09-21T12:06:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.922+0000 7ff1567fc640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff14007af30 0x7ff14007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.922+0000 7ff1567fc640 1 -- 172.21.15.118:0/1730360241 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff1500bebb0 con 0x7ff158101930 2024-09-21T12:06:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.922+0000 7ff15ce1b640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff14007af30 0x7ff14007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:56.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.922+0000 7ff15ce1b640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff14007af30 0x7ff14007d3f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff158075f80 tx=0x7ff14c008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:56.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:56.926+0000 7ff1567fc640 1 -- 172.21.15.118:0/1730360241 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff1500c5080 con 0x7ff158101930 2024-09-21T12:06:57.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.176+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff158075a20 con 0x7ff158101930 2024-09-21T12:06:57.179 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:57 smithi118 ceph-mon[111738]: from='client.35340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:57.179 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:57 smithi118 ceph-mon[111738]: from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:57.179 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:57 smithi118 ceph-mon[111738]: from='client.35348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.177+0000 7ff1567fc640 1 -- 172.21.15.118:0/1730360241 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7ff15008a100 con 0x7ff158101930 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:06:57.180 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:06:57.181 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:06:57.181 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:06:57.181 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:06:57.181 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:06:57.181 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:06:57.181 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:06:57.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.179+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff14007af30 msgr2=0x7ff14007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.179+0000 7ff15f880640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff14007af30 0x7ff14007d3f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff158075f80 tx=0x7ff14c008040 comp rx=0 tx=0).stop 2024-09-21T12:06:57.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.179+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158101930 msgr2=0x7ff1580744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.179+0000 7ff15f880640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158101930 0x7ff1580744f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff150031460 tx=0x7ff1500048f0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.179+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 shutdown_connections 2024-09-21T12:06:57.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.179+0000 7ff15f880640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff158107930 0x7ff158074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.179+0000 7ff15f880640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff14007af30 0x7ff14007d3f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.179+0000 7ff15f880640 1 --2- 172.21.15.118:0/1730360241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff158101930 0x7ff1580744f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.179+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 >> 172.21.15.118:0/1730360241 conn(0x7ff1580fd630 msgr2=0x7ff1580fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:57.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.180+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 shutdown_connections 2024-09-21T12:06:57.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.180+0000 7ff15f880640 1 -- 172.21.15.118:0/1730360241 wait complete. 2024-09-21T12:06:57.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.260+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/1229909545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 msgr2=0x7f4a44102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.260+0000 7f4a4b9c7640 1 --2- 172.21.15.118:0/1229909545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 0x7f4a44102eb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009c20 tx=0x7f4a3402aa00 comp rx=0 tx=0).stop 2024-09-21T12:06:57.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.260+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/1229909545 shutdown_connections 2024-09-21T12:06:57.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.260+0000 7f4a4b9c7640 1 --2- 172.21.15.118:0/1229909545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a441033f0 0x7f4a4410b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.260+0000 7f4a4b9c7640 1 --2- 172.21.15.118:0/1229909545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 0x7f4a44102eb0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.260+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/1229909545 >> 172.21.15.118:0/1229909545 conn(0x7f4a440fc510 msgr2=0x7f4a440fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:57.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.261+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/1229909545 shutdown_connections 2024-09-21T12:06:57.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.261+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/1229909545 wait complete. 2024-09-21T12:06:57.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.261+0000 7f4a4b9c7640 1 Processor -- start 2024-09-21T12:06:57.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.261+0000 7f4a4b9c7640 1 -- start start 2024-09-21T12:06:57.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.261+0000 7f4a4b9c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 0x7f4a4419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:57.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.261+0000 7f4a4b9c7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a441033f0 0x7f4a4419dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:57.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.261+0000 7f4a4b9c7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4410ede0 con 0x7f4a44102ad0 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.261+0000 7f4a4b9c7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4410ec60 con 0x7f4a441033f0 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a49763640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 0x7f4a4419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a49763640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 0x7f4a4419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43982/0 (socket says 172.21.15.118:43982) 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a49763640 1 -- 172.21.15.118:0/3096665436 learned_addr learned my addr 172.21.15.118:0/3096665436 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a49763640 1 -- 172.21.15.118:0/3096665436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a441033f0 msgr2=0x7f4a4419dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a48f62640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a441033f0 0x7f4a4419dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a49763640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a441033f0 0x7f4a4419dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a49763640 1 -- 172.21.15.118:0/3096665436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4419e320 con 0x7f4a44102ad0 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a48f62640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a441033f0 0x7f4a4419dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a49763640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 0x7f4a4419d730 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4a34005cc0 tx=0x7f4a3402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:57.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a427fc640 1 -- 172.21.15.118:0/3096665436 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a34047070 con 0x7f4a44102ad0 2024-09-21T12:06:57.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a427fc640 1 -- 172.21.15.118:0/3096665436 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a34003e30 con 0x7f4a44102ad0 2024-09-21T12:06:57.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a441979b0 con 0x7f4a44102ad0 2024-09-21T12:06:57.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a427fc640 1 -- 172.21.15.118:0/3096665436 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a34033050 con 0x7f4a44102ad0 2024-09-21T12:06:57.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.262+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a44197eb0 con 0x7f4a44102ad0 2024-09-21T12:06:57.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.263+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a4406ac30 con 0x7f4a44102ad0 2024-09-21T12:06:57.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.264+0000 7f4a427fc640 1 -- 172.21.15.118:0/3096665436 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4a3404a070 con 0x7f4a44102ad0 2024-09-21T12:06:57.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.264+0000 7f4a427fc640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a2c07af90 0x7f4a2c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:57.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.264+0000 7f4a427fc640 1 -- 172.21.15.118:0/3096665436 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4a3403e030 con 0x7f4a44102ad0 2024-09-21T12:06:57.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.264+0000 7f4a48f62640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a2c07af90 0x7f4a2c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:57.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.265+0000 7f4a48f62640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a2c07af90 0x7f4a2c07d450 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4a440feeb0 tx=0x7f4a38005e30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:57.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.269+0000 7f4a427fc640 1 -- 172.21.15.118:0/3096665436 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a3408a800 con 0x7f4a44102ad0 2024-09-21T12:06:57.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:57 smithi149 ceph-mon[79770]: from='client.35340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:57.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:57 smithi149 ceph-mon[79770]: from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:57.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:57 smithi149 ceph-mon[79770]: from='client.35348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:57.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.480+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4a44198e20 con 0x7f4a44102ad0 2024-09-21T12:06:57.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.481+0000 7f4a427fc640 1 -- 172.21.15.118:0/3096665436 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f4a3408f6b0 con 0x7f4a44102ad0 2024-09-21T12:06:57.483 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:06:57.483 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:06:57.483 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:06:57.483 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:06:57.483 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:06:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:06:57.483 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:06:57.483 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:06:57.484 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:06:57.485 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:06:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:06:57.486 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:06:57.486 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:06:57.486 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:06:57.486 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:06:57.486 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:06:57.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a2c07af90 msgr2=0x7f4a2c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a2c07af90 0x7f4a2c07d450 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4a440feeb0 tx=0x7f4a38005e30 comp rx=0 tx=0).stop 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 msgr2=0x7f4a4419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 0x7f4a4419d730 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4a34005cc0 tx=0x7f4a3402ee60 comp rx=0 tx=0).stop 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 shutdown_connections 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a441033f0 0x7f4a4419dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4a2c07af90 0x7f4a2c07d450 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 --2- 172.21.15.118:0/3096665436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a44102ad0 0x7f4a4419d730 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 >> 172.21.15.118:0/3096665436 conn(0x7f4a440fc510 msgr2=0x7f4a44108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 shutdown_connections 2024-09-21T12:06:57.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.483+0000 7f4a4b9c7640 1 -- 172.21.15.118:0/3096665436 wait complete. 2024-09-21T12:06:57.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.565+0000 7f6350f9d640 1 -- 172.21.15.118:0/1771440887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c103400 msgr2=0x7f634c10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.565+0000 7f6350f9d640 1 --2- 172.21.15.118:0/1771440887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c103400 0x7f634c10b8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f633c009880 tx=0x7f633c02a530 comp rx=0 tx=0).stop 2024-09-21T12:06:57.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.565+0000 7f6350f9d640 1 -- 172.21.15.118:0/1771440887 shutdown_connections 2024-09-21T12:06:57.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.565+0000 7f6350f9d640 1 --2- 172.21.15.118:0/1771440887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c103400 0x7f634c10b8f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.565+0000 7f6350f9d640 1 --2- 172.21.15.118:0/1771440887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f634c102ae0 0x7f634c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.565+0000 7f6350f9d640 1 -- 172.21.15.118:0/1771440887 >> 172.21.15.118:0/1771440887 conn(0x7f634c0fc520 msgr2=0x7f634c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:57.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.565+0000 7f6350f9d640 1 -- 172.21.15.118:0/1771440887 shutdown_connections 2024-09-21T12:06:57.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.565+0000 7f6350f9d640 1 -- 172.21.15.118:0/1771440887 wait complete. 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.566+0000 7f6350f9d640 1 Processor -- start 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.566+0000 7f6350f9d640 1 -- start start 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.566+0000 7f6350f9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c102ae0 0x7f634c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.566+0000 7f6350f9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f634c103400 0x7f634c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.566+0000 7f6350f9d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f634c10ee10 con 0x7f634c102ae0 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.566+0000 7f6350f9d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f634c10ec90 con 0x7f634c103400 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.566+0000 7f634a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c102ae0 0x7f634c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f634a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c102ae0 0x7f634c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44002/0 (socket says 172.21.15.118:44002) 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f634a59c640 1 -- 172.21.15.118:0/1349734863 learned_addr learned my addr 172.21.15.118:0/1349734863 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:57.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f6349d9b640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f634c103400 0x7f634c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:57.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f634a59c640 1 -- 172.21.15.118:0/1349734863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f634c103400 msgr2=0x7f634c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f634a59c640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f634c103400 0x7f634c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f634a59c640 1 -- 172.21.15.118:0/1349734863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c197820 con 0x7f634c102ae0 2024-09-21T12:06:57.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f634a59c640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c102ae0 0x7f634c19d6a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f633400c8f0 tx=0x7f633400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:57.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f63437fe640 1 -- 172.21.15.118:0/1349734863 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63340079b0 con 0x7f634c102ae0 2024-09-21T12:06:57.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f63437fe640 1 -- 172.21.15.118:0/1349734863 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63340054e0 con 0x7f634c102ae0 2024-09-21T12:06:57.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634c197b10 con 0x7f634c102ae0 2024-09-21T12:06:57.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f63437fe640 1 -- 172.21.15.118:0/1349734863 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6334004dd0 con 0x7f634c102ae0 2024-09-21T12:06:57.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.567+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634c198070 con 0x7f634c102ae0 2024-09-21T12:06:57.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.568+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634c06abe0 con 0x7f634c102ae0 2024-09-21T12:06:57.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.569+0000 7f63437fe640 1 -- 172.21.15.118:0/1349734863 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6334005020 con 0x7f634c102ae0 2024-09-21T12:06:57.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.569+0000 7f63437fe640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633807af30 0x7f633807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:57.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.569+0000 7f63437fe640 1 -- 172.21.15.118:0/1349734863 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f633409dea0 con 0x7f634c102ae0 2024-09-21T12:06:57.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.569+0000 7f6349d9b640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633807af30 0x7f633807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:57.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.570+0000 7f6349d9b640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633807af30 0x7f633807d3f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f634c198b70 tx=0x7f633c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:57.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.574+0000 7f63437fe640 1 -- 172.21.15.118:0/1349734863 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6334014030 con 0x7f634c102ae0 2024-09-21T12:06:57.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.771+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f634c198380 con 0x7f633807af30 2024-09-21T12:06:57.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.772+0000 7f63437fe640 1 -- 172.21.15.118:0/1349734863 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f634c198380 con 0x7f633807af30 2024-09-21T12:06:57.774 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:06:57.774 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:06:57.774 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:06:57.774 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:06:57.774 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:06:57.775 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:06:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633807af30 msgr2=0x7f633807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633807af30 0x7f633807d3f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f634c198b70 tx=0x7f633c031400 comp rx=0 tx=0).stop 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c102ae0 msgr2=0x7f634c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c102ae0 0x7f634c19d6a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f633400c8f0 tx=0x7f633400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 shutdown_connections 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f634c103400 0x7f634c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f633807af30 0x7f633807d3f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 --2- 172.21.15.118:0/1349734863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f634c102ae0 0x7f634c19d6a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 >> 172.21.15.118:0/1349734863 conn(0x7f634c0fc520 msgr2=0x7f634c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 shutdown_connections 2024-09-21T12:06:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.774+0000 7f6350f9d640 1 -- 172.21.15.118:0/1349734863 wait complete. 2024-09-21T12:06:57.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.856+0000 7feb91b2f640 1 -- 172.21.15.118:0/790470489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1067e0 msgr2=0x7feb8c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.856+0000 7feb91b2f640 1 --2- 172.21.15.118:0/790470489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1067e0 0x7feb8c106bc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009880 tx=0x7feb7c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.856+0000 7feb91b2f640 1 -- 172.21.15.118:0/790470489 shutdown_connections 2024-09-21T12:06:57.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.856+0000 7feb91b2f640 1 --2- 172.21.15.118:0/790470489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c1007e0 0x7feb8c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.856+0000 7feb91b2f640 1 --2- 172.21.15.118:0/790470489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1067e0 0x7feb8c106bc0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.856+0000 7feb91b2f640 1 -- 172.21.15.118:0/790470489 >> 172.21.15.118:0/790470489 conn(0x7feb8c0fc4c0 msgr2=0x7feb8c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:57.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.856+0000 7feb91b2f640 1 -- 172.21.15.118:0/790470489 shutdown_connections 2024-09-21T12:06:57.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.856+0000 7feb91b2f640 1 -- 172.21.15.118:0/790470489 wait complete. 2024-09-21T12:06:57.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.856+0000 7feb91b2f640 1 Processor -- start 2024-09-21T12:06:57.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb91b2f640 1 -- start start 2024-09-21T12:06:57.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb91b2f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1007e0 0x7feb8c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb91b2f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c1067e0 0x7feb8c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb91b2f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c10dc90 con 0x7feb8c1007e0 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb91b2f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c10db10 con 0x7feb8c1067e0 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb8b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1007e0 0x7feb8c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb8b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1007e0 0x7feb8c1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44016/0 (socket says 172.21.15.118:44016) 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb8b7fe640 1 -- 172.21.15.118:0/1620066849 learned_addr learned my addr 172.21.15.118:0/1620066849 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb8affd640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c1067e0 0x7feb8c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb8b7fe640 1 -- 172.21.15.118:0/1620066849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c1067e0 msgr2=0x7feb8c198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb8b7fe640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c1067e0 0x7feb8c198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.857+0000 7feb8b7fe640 1 -- 172.21.15.118:0/1620066849 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c199300 con 0x7feb8c1007e0 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.858+0000 7feb8b7fe640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1007e0 0x7feb8c1987c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7feb7c031460 tx=0x7feb7c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:57.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.858+0000 7feb88ff9640 1 -- 172.21.15.118:0/1620066849 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb7c03f070 con 0x7feb8c1007e0 2024-09-21T12:06:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.858+0000 7feb88ff9640 1 -- 172.21.15.118:0/1620066849 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb7c0035f0 con 0x7feb8c1007e0 2024-09-21T12:06:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.858+0000 7feb88ff9640 1 -- 172.21.15.118:0/1620066849 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb7c035030 con 0x7feb8c1007e0 2024-09-21T12:06:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.858+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c199590 con 0x7feb8c1007e0 2024-09-21T12:06:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.858+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c1a1b40 con 0x7feb8c1007e0 2024-09-21T12:06:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.859+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c101f20 con 0x7feb8c1007e0 2024-09-21T12:06:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.859+0000 7feb88ff9640 1 -- 172.21.15.118:0/1620066849 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7feb7c042070 con 0x7feb8c1007e0 2024-09-21T12:06:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.860+0000 7feb88ff9640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb7407af80 0x7feb7407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:06:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.860+0000 7feb88ff9640 1 -- 172.21.15.118:0/1620066849 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7feb7c0be910 con 0x7feb8c1007e0 2024-09-21T12:06:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.860+0000 7feb8affd640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb7407af80 0x7feb7407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:06:57.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.860+0000 7feb8affd640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb7407af80 0x7feb7407d440 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feb8c06a680 tx=0x7feb8000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:06:57.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:57.864+0000 7feb88ff9640 1 -- 172.21.15.118:0/1620066849 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb7c089ee0 con 0x7feb8c1007e0 2024-09-21T12:06:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.112+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7feb8c1039f0 con 0x7feb8c1007e0 2024-09-21T12:06:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.113+0000 7feb88ff9640 1 -- 172.21.15.118:0/1620066849 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7feb7c08ed90 con 0x7feb8c1007e0 2024-09-21T12:06:58.115 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:06:58.116 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:06:58.116 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:06:58.116 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:06:58.116 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:06:58.116 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:06:58.116 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:06:58.116 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:06:58.116 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:06:58.117 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:06:58.118 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:06:58.118 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:06:58.118 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:06:58.118 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:06:58.118 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:06:58.118 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:06:58.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb7407af80 msgr2=0x7feb7407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:58.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb7407af80 0x7feb7407d440 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feb8c06a680 tx=0x7feb8000b390 comp rx=0 tx=0).stop 2024-09-21T12:06:58.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1007e0 msgr2=0x7feb8c1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:06:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1007e0 0x7feb8c1987c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7feb7c031460 tx=0x7feb7c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:06:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 shutdown_connections 2024-09-21T12:06:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb8c1067e0 0x7feb8c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feb7407af80 0x7feb7407d440 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 --2- 172.21.15.118:0/1620066849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb8c1007e0 0x7feb8c1987c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:06:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 >> 172.21.15.118:0/1620066849 conn(0x7feb8c0fc4c0 msgr2=0x7feb8c0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:06:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 shutdown_connections 2024-09-21T12:06:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:06:58.115+0000 7feb91b2f640 1 -- 172.21.15.118:0/1620066849 wait complete. 2024-09-21T12:06:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:58 smithi149 ceph-mon[79770]: pgmap v845: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:58.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:58 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1730360241' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:06:58.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:58 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3096665436' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:06:58.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:58 smithi149 ceph-mon[79770]: from='client.35360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:58 smithi118 ceph-mon[111738]: pgmap v845: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:06:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:58 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1730360241' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:06:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:58 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3096665436' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:06:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:58 smithi118 ceph-mon[111738]: from='client.35360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:06:59.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:06:59 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1620066849' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:06:59.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:06:59 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1620066849' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:07:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:00 smithi149 ceph-mon[79770]: pgmap v846: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:00 smithi118 ceph-mon[111738]: pgmap v846: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:02 smithi149 ceph-mon[79770]: pgmap v847: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:02.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:02 smithi118 ceph-mon[111738]: pgmap v847: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:04.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:04 smithi118 ceph-mon[111738]: pgmap v848: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:04 smithi149 ceph-mon[79770]: pgmap v848: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:07:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:07:06.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:06 smithi149 ceph-mon[79770]: pgmap v849: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:06 smithi118 ceph-mon[111738]: pgmap v849: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:08 smithi149 ceph-mon[79770]: pgmap v850: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:08.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:08 smithi118 ceph-mon[111738]: pgmap v850: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:10 smithi149 ceph-mon[79770]: pgmap v851: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:10.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:10 smithi118 ceph-mon[111738]: pgmap v851: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:12 smithi149 ceph-mon[79770]: pgmap v852: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:12.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:12 smithi118 ceph-mon[111738]: pgmap v852: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:14.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:14 smithi118 ceph-mon[111738]: pgmap v853: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:14 smithi149 ceph-mon[79770]: pgmap v853: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:16 smithi149 ceph-mon[79770]: pgmap v854: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:16 smithi118 ceph-mon[111738]: pgmap v854: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:18 smithi149 ceph-mon[79770]: pgmap v855: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:18.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:18 smithi118 ceph-mon[111738]: pgmap v855: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:20 smithi149 ceph-mon[79770]: pgmap v856: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:07:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:20 smithi118 ceph-mon[111738]: pgmap v856: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:07:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:22 smithi149 ceph-mon[79770]: pgmap v857: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:22.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:22 smithi118 ceph-mon[111738]: pgmap v857: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:24.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:24 smithi118 ceph-mon[111738]: pgmap v858: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:24 smithi149 ceph-mon[79770]: pgmap v858: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:26 smithi149 ceph-mon[79770]: pgmap v859: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:26 smithi118 ceph-mon[111738]: pgmap v859: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:28.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.210+0000 7f22588a7640 1 -- 172.21.15.118:0/4228261379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254107930 msgr2=0x7f2254107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.210+0000 7f22588a7640 1 --2- 172.21.15.118:0/4228261379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254107930 0x7f2254107d10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2244009880 tx=0x7f224402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.211+0000 7f22588a7640 1 -- 172.21.15.118:0/4228261379 shutdown_connections 2024-09-21T12:07:28.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.211+0000 7f22588a7640 1 --2- 172.21.15.118:0/4228261379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2254101930 0x7f2254101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.211+0000 7f22588a7640 1 --2- 172.21.15.118:0/4228261379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254107930 0x7f2254107d10 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.211+0000 7f22588a7640 1 -- 172.21.15.118:0/4228261379 >> 172.21.15.118:0/4228261379 conn(0x7f22540fd630 msgr2=0x7f22540ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:28.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.211+0000 7f22588a7640 1 -- 172.21.15.118:0/4228261379 shutdown_connections 2024-09-21T12:07:28.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.211+0000 7f22588a7640 1 -- 172.21.15.118:0/4228261379 wait complete. 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.211+0000 7f22588a7640 1 Processor -- start 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f22588a7640 1 -- start start 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f22588a7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254101930 0x7f22540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f22588a7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2254107930 0x7f2254074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f22588a7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f225410ee00 con 0x7f2254101930 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f22588a7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f225410ec80 con 0x7f2254107930 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f225259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254101930 0x7f22540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f225259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254101930 0x7f22540744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56412/0 (socket says 172.21.15.118:56412) 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f225259c640 1 -- 172.21.15.118:0/1074335720 learned_addr learned my addr 172.21.15.118:0/1074335720 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f2251d9b640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2254107930 0x7f2254074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f225259c640 1 -- 172.21.15.118:0/1074335720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2254107930 msgr2=0x7f2254074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f225259c640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2254107930 0x7f2254074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f225259c640 1 -- 172.21.15.118:0/1074335720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2254074f70 con 0x7f2254101930 2024-09-21T12:07:28.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f2251d9b640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2254107930 0x7f2254074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:07:28.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.212+0000 7f225259c640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254101930 0x7f22540744f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2244031460 tx=0x7f22440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:28.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.213+0000 7f224b7fe640 1 -- 172.21.15.118:0/1074335720 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f224403f070 con 0x7f2254101930 2024-09-21T12:07:28.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.213+0000 7f224b7fe640 1 -- 172.21.15.118:0/1074335720 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22440035f0 con 0x7f2254101930 2024-09-21T12:07:28.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.213+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2254075200 con 0x7f2254101930 2024-09-21T12:07:28.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.213+0000 7f224b7fe640 1 -- 172.21.15.118:0/1074335720 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2244035030 con 0x7f2254101930 2024-09-21T12:07:28.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.213+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22541a3db0 con 0x7f2254101930 2024-09-21T12:07:28.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.214+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2254103070 con 0x7f2254101930 2024-09-21T12:07:28.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.214+0000 7f224b7fe640 1 -- 172.21.15.118:0/1074335720 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2244042070 con 0x7f2254101930 2024-09-21T12:07:28.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.215+0000 7f224b7fe640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224007af30 0x7f224007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:28.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.215+0000 7f224b7fe640 1 -- 172.21.15.118:0/1074335720 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f22440beab0 con 0x7f2254101930 2024-09-21T12:07:28.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.215+0000 7f2251d9b640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224007af30 0x7f224007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:28.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.216+0000 7f2251d9b640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224007af30 0x7f224007d3f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f223c0058c0 tx=0x7f223c005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:28.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.220+0000 7f224b7fe640 1 -- 172.21.15.118:0/1074335720 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f224408a000 con 0x7f2254101930 2024-09-21T12:07:28.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.413+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2254062630 con 0x7f224007af30 2024-09-21T12:07:28.415 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:28 smithi118 ceph-mon[111738]: pgmap v860: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:28.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.415+0000 7f224b7fe640 1 -- 172.21.15.118:0/1074335720 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2254062630 con 0x7f224007af30 2024-09-21T12:07:28.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224007af30 msgr2=0x7f224007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224007af30 0x7f224007d3f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f223c0058c0 tx=0x7f223c005850 comp rx=0 tx=0).stop 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254101930 msgr2=0x7f22540744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254101930 0x7f22540744f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2244031460 tx=0x7f22440045e0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 shutdown_connections 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2254107930 0x7f2254074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224007af30 0x7f224007d3f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 --2- 172.21.15.118:0/1074335720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2254101930 0x7f22540744f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 >> 172.21.15.118:0/1074335720 conn(0x7f22540fd630 msgr2=0x7f22540fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 shutdown_connections 2024-09-21T12:07:28.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.417+0000 7f22588a7640 1 -- 172.21.15.118:0/1074335720 wait complete. 2024-09-21T12:07:28.428 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:07:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:28 smithi149 ceph-mon[79770]: pgmap v860: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:28.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/775011896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 msgr2=0x7f6dcc101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 --2- 172.21.15.118:0/775011896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 0x7f6dcc101d90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009880 tx=0x7f6dc002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/775011896 shutdown_connections 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 --2- 172.21.15.118:0/775011896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 0x7f6dcc101d90 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 --2- 172.21.15.118:0/775011896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dcc107930 0x7f6dcc107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/775011896 >> 172.21.15.118:0/775011896 conn(0x7f6dcc0fd630 msgr2=0x7f6dcc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/775011896 shutdown_connections 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/775011896 wait complete. 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 Processor -- start 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 -- start start 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 0x7f6dcc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dcc107930 0x7f6dcc19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:28.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc10ede0 con 0x7f6dcc101930 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.500+0000 7f6dd2d2c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc10ec60 con 0x7f6dcc107930 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dd0ac8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 0x7f6dcc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dd0ac8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 0x7f6dcc19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56428/0 (socket says 172.21.15.118:56428) 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dd0ac8640 1 -- 172.21.15.118:0/3396493824 learned_addr learned my addr 172.21.15.118:0/3396493824 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dd0ac8640 1 -- 172.21.15.118:0/3396493824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dcc107930 msgr2=0x7f6dcc19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dd0ac8640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dcc107930 0x7f6dcc19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dd0ac8640 1 -- 172.21.15.118:0/3396493824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc197850 con 0x7f6dcc101930 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dd0ac8640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 0x7f6dcc19d6d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00d8d0 tx=0x7f6dbc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dc9ffb640 1 -- 172.21.15.118:0/3396493824 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6dbc017030 con 0x7f6dcc101930 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dc9ffb640 1 -- 172.21.15.118:0/3396493824 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6dbc004020 con 0x7f6dcc101930 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc197b40 con 0x7f6dcc101930 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dc9ffb640 1 -- 172.21.15.118:0/3396493824 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6dbc0047a0 con 0x7f6dcc101930 2024-09-21T12:07:28.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.501+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc1980d0 con 0x7f6dcc101930 2024-09-21T12:07:28.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.502+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dcc103070 con 0x7f6dcc101930 2024-09-21T12:07:28.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.503+0000 7f6dc9ffb640 1 -- 172.21.15.118:0/3396493824 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6dbc0041d0 con 0x7f6dcc101930 2024-09-21T12:07:28.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.503+0000 7f6dc9ffb640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6db407af80 0x7f6db407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:28.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.503+0000 7f6dc9ffb640 1 -- 172.21.15.118:0/3396493824 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6dbc018070 con 0x7f6dcc101930 2024-09-21T12:07:28.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.504+0000 7f6dcbfff640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6db407af80 0x7f6db407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:28.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.504+0000 7f6dcbfff640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6db407af80 0x7f6db407d440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00096c0 tx=0x7f6dc0000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:28.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.508+0000 7f6dc9ffb640 1 -- 172.21.15.118:0/3396493824 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6dbc0a3020 con 0x7f6dcc101930 2024-09-21T12:07:28.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.703+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6dcc1983e0 con 0x7f6db407af80 2024-09-21T12:07:28.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.704+0000 7f6dc9ffb640 1 -- 172.21.15.118:0/3396493824 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6dcc1983e0 con 0x7f6db407af80 2024-09-21T12:07:28.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6db407af80 msgr2=0x7f6db407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6db407af80 0x7f6db407d440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00096c0 tx=0x7f6dc0000bc0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 msgr2=0x7f6dcc19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 0x7f6dcc19d6d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00d8d0 tx=0x7f6dbc00dd90 comp rx=0 tx=0).stop 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 shutdown_connections 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dcc107930 0x7f6dcc19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6db407af80 0x7f6db407d440 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 --2- 172.21.15.118:0/3396493824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dcc101930 0x7f6dcc19d6d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 >> 172.21.15.118:0/3396493824 conn(0x7f6dcc0fd630 msgr2=0x7f6dcc0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 shutdown_connections 2024-09-21T12:07:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.706+0000 7f6dd2d2c640 1 -- 172.21.15.118:0/3396493824 wait complete. 2024-09-21T12:07:28.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.788+0000 7f4fb5669640 1 -- 172.21.15.118:0/1815355884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 msgr2=0x7f4fb0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.788+0000 7f4fb5669640 1 --2- 172.21.15.118:0/1815355884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 0x7f4fb0106bc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009880 tx=0x7f4fa002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.788+0000 7f4fb5669640 1 -- 172.21.15.118:0/1815355884 shutdown_connections 2024-09-21T12:07:28.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.788+0000 7f4fb5669640 1 --2- 172.21.15.118:0/1815355884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb01007e0 0x7f4fb0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.788+0000 7f4fb5669640 1 --2- 172.21.15.118:0/1815355884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 0x7f4fb0106bc0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.788+0000 7f4fb5669640 1 -- 172.21.15.118:0/1815355884 >> 172.21.15.118:0/1815355884 conn(0x7f4fb00fc4c0 msgr2=0x7f4fb00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.788+0000 7f4fb5669640 1 -- 172.21.15.118:0/1815355884 shutdown_connections 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.788+0000 7f4fb5669640 1 -- 172.21.15.118:0/1815355884 wait complete. 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4fb5669640 1 Processor -- start 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4fb5669640 1 -- start start 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4fb5669640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb01007e0 0x7f4fb01987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4fb5669640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 0x7f4fb0198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4fb5669640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb010dc90 con 0x7f4fb01067e0 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4fb5669640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb010db10 con 0x7f4fb01007e0 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4fa7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 0x7f4fb0198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4fa7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 0x7f4fb0198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56444/0 (socket says 172.21.15.118:56444) 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4fa7fff640 1 -- 172.21.15.118:0/2827829713 learned_addr learned my addr 172.21.15.118:0/2827829713 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:07:28.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.789+0000 7f4faeffd640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb01007e0 0x7f4fb01987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4fa7fff640 1 -- 172.21.15.118:0/2827829713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb01007e0 msgr2=0x7f4fb01987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4fa7fff640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb01007e0 0x7f4fb01987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4fa7fff640 1 -- 172.21.15.118:0/2827829713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb0199300 con 0x7f4fb01067e0 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4faeffd640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb01007e0 0x7f4fb01987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4fa7fff640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 0x7f4fb0198d00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800d8d0 tx=0x7f4f9800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4facff9640 1 -- 172.21.15.118:0/2827829713 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f98017070 con 0x7f4fb01067e0 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4facff9640 1 -- 172.21.15.118:0/2827829713 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f98010460 con 0x7f4fb01067e0 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb01995f0 con 0x7f4fb01067e0 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4facff9640 1 -- 172.21.15.118:0/2827829713 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f9800f5f0 con 0x7f4fb01067e0 2024-09-21T12:07:28.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.790+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb01a1bf0 con 0x7f4fb01067e0 2024-09-21T12:07:28.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.791+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb0101f20 con 0x7f4fb01067e0 2024-09-21T12:07:28.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.792+0000 7f4facff9640 1 -- 172.21.15.118:0/2827829713 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4f98009a30 con 0x7f4fb01067e0 2024-09-21T12:07:28.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.792+0000 7f4facff9640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4f9c07af80 0x7f4f9c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:28.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.792+0000 7f4facff9640 1 -- 172.21.15.118:0/2827829713 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4f9809df00 con 0x7f4fb01067e0 2024-09-21T12:07:28.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.792+0000 7f4faeffd640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4f9c07af80 0x7f4f9c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:28.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.793+0000 7f4faeffd640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4f9c07af80 0x7f4f9c07d440 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0000c00 tx=0x7f4fa0031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:28.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.797+0000 7f4facff9640 1 -- 172.21.15.118:0/2827829713 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4fb01995f0 con 0x7f4fb01067e0 2024-09-21T12:07:28.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.982+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4fb0062630 con 0x7f4f9c07af80 2024-09-21T12:07:28.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.993+0000 7f4facff9640 1 -- 172.21.15.118:0/2827829713 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4fb0062630 con 0x7f4f9c07af80 2024-09-21T12:07:28.994 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (25m) 4m ago 36m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (28m) 4m ago 36m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (27m) 4m ago 35m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (23m) 4m ago 36m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (23m) 4m ago 35m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (24m) 4m ago 36m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (19m) 4m ago 31m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (19m) 4m ago 30m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (4m) 4m ago 30m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (19m) 4m ago 30m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (27m) 4m ago 37m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (26m) 4m ago 35m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (24m) 4m ago 37m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (23m) 4m ago 35m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:07:28.995 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (26m) 4m ago 36m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:07:28.996 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (26m) 4m ago 35m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:07:28.996 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (23m) 4m ago 34m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:07:28.996 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (22m) 4m ago 33m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:07:28.996 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (21m) 4m ago 33m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:07:28.996 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (21m) 4m ago 32m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:07:28.996 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (20m) 4m ago 32m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:07:28.996 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (20m) 4m ago 32m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:07:28.996 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (25m) 4m ago 35m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:07:28.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.995+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4f9c07af80 msgr2=0x7f4f9c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.995+0000 7f4fb5669640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4f9c07af80 0x7f4f9c07d440 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0000c00 tx=0x7f4fa0031400 comp rx=0 tx=0).stop 2024-09-21T12:07:28.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.995+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 msgr2=0x7f4fb0198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:28.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.995+0000 7f4fb5669640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 0x7f4fb0198d00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800d8d0 tx=0x7f4f9800dd90 comp rx=0 tx=0).stop 2024-09-21T12:07:28.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.996+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 shutdown_connections 2024-09-21T12:07:28.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.996+0000 7f4fb5669640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4f9c07af80 0x7f4f9c07d440 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.996+0000 7f4fb5669640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb01067e0 0x7f4fb0198d00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.996+0000 7f4fb5669640 1 --2- 172.21.15.118:0/2827829713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb01007e0 0x7f4fb01987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:28.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.996+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 >> 172.21.15.118:0/2827829713 conn(0x7f4fb00fc4c0 msgr2=0x7f4fb00fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:28.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.996+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 shutdown_connections 2024-09-21T12:07:28.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:28.996+0000 7f4fb5669640 1 -- 172.21.15.118:0/2827829713 wait complete. 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 -- 172.21.15.118:0/789455685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844106820 msgr2=0x7f7844106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 --2- 172.21.15.118:0/789455685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844106820 0x7f7844106c00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7834009880 tx=0x7f783402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 -- 172.21.15.118:0/789455685 shutdown_connections 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 --2- 172.21.15.118:0/789455685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7844100820 0x7f7844100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 --2- 172.21.15.118:0/789455685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844106820 0x7f7844106c00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 -- 172.21.15.118:0/789455685 >> 172.21.15.118:0/789455685 conn(0x7f78440fc520 msgr2=0x7f78440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 -- 172.21.15.118:0/789455685 shutdown_connections 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 -- 172.21.15.118:0/789455685 wait complete. 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 Processor -- start 2024-09-21T12:07:29.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.076+0000 7f7849c17640 1 -- start start 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f7849c17640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844100820 0x7f78441987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f7849c17640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7844106820 0x7f7844198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f7849c17640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f784410dcd0 con 0x7f7844100820 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f7849c17640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f784410db50 con 0x7f7844106820 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78437fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844100820 0x7f78441987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78437fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844100820 0x7f78441987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56462/0 (socket says 172.21.15.118:56462) 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78437fe640 1 -- 172.21.15.118:0/3580010814 learned_addr learned my addr 172.21.15.118:0/3580010814 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78437fe640 1 -- 172.21.15.118:0/3580010814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7844106820 msgr2=0x7f7844198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f783bfff640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7844106820 0x7f7844198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78437fe640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7844106820 0x7f7844198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78437fe640 1 -- 172.21.15.118:0/3580010814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7844199320 con 0x7f7844100820 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78437fe640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844100820 0x7f78441987e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7834031460 tx=0x7f78340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:29.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78417fa640 1 -- 172.21.15.118:0/3580010814 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f783403f070 con 0x7f7844100820 2024-09-21T12:07:29.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78417fa640 1 -- 172.21.15.118:0/3580010814 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78340035f0 con 0x7f7844100820 2024-09-21T12:07:29.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78441995b0 con 0x7f7844100820 2024-09-21T12:07:29.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.077+0000 7f78417fa640 1 -- 172.21.15.118:0/3580010814 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7834035030 con 0x7f7844100820 2024-09-21T12:07:29.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.078+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78441a1b60 con 0x7f7844100820 2024-09-21T12:07:29.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.078+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7844101f60 con 0x7f7844100820 2024-09-21T12:07:29.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.079+0000 7f78417fa640 1 -- 172.21.15.118:0/3580010814 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7834042070 con 0x7f7844100820 2024-09-21T12:07:29.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.080+0000 7f78417fa640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f783007af30 0x7f783007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:29.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.080+0000 7f783bfff640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f783007af30 0x7f783007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:29.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.080+0000 7f78417fa640 1 -- 172.21.15.118:0/3580010814 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f78340bead0 con 0x7f7844100820 2024-09-21T12:07:29.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.080+0000 7f783bfff640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f783007af30 0x7f783007d3f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f782c005fd0 tx=0x7f782c005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:29.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.084+0000 7f78417fa640 1 -- 172.21.15.118:0/3580010814 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f783408a020 con 0x7f7844100820 2024-09-21T12:07:29.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:29 smithi118 ceph-mon[111738]: from='client.35368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:07:29.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:29 smithi118 ceph-mon[111738]: from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:07:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.332+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7844103a30 con 0x7f7844100820 2024-09-21T12:07:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.332+0000 7f78417fa640 1 -- 172.21.15.118:0/3580010814 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f783408c070 con 0x7f7844100820 2024-09-21T12:07:29.333 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:07:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:07:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:07:29.335 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:07:29.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.334+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f783007af30 msgr2=0x7f783007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.334+0000 7f7849c17640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f783007af30 0x7f783007d3f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f782c005fd0 tx=0x7f782c005850 comp rx=0 tx=0).stop 2024-09-21T12:07:29.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.334+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844100820 msgr2=0x7f78441987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.334+0000 7f7849c17640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844100820 0x7f78441987e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7834031460 tx=0x7f78340045e0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.335+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 shutdown_connections 2024-09-21T12:07:29.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.335+0000 7f7849c17640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7844106820 0x7f7844198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.335+0000 7f7849c17640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f783007af30 0x7f783007d3f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.335+0000 7f7849c17640 1 --2- 172.21.15.118:0/3580010814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7844100820 0x7f78441987e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.335+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 >> 172.21.15.118:0/3580010814 conn(0x7f78440fc520 msgr2=0x7f78440fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:29.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.335+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 shutdown_connections 2024-09-21T12:07:29.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.335+0000 7f7849c17640 1 -- 172.21.15.118:0/3580010814 wait complete. 2024-09-21T12:07:29.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.415+0000 7fce9060c640 1 -- 172.21.15.118:0/2933803748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 msgr2=0x7fce8810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.415+0000 7fce9060c640 1 --2- 172.21.15.118:0/2933803748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 0x7fce8810b8f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009880 tx=0x7fce7c02a530 comp rx=0 tx=0).stop 2024-09-21T12:07:29.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.415+0000 7fce9060c640 1 -- 172.21.15.118:0/2933803748 shutdown_connections 2024-09-21T12:07:29.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.415+0000 7fce9060c640 1 --2- 172.21.15.118:0/2933803748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 0x7fce8810b8f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.415+0000 7fce9060c640 1 --2- 172.21.15.118:0/2933803748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88102ae0 0x7fce88102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.415+0000 7fce9060c640 1 -- 172.21.15.118:0/2933803748 >> 172.21.15.118:0/2933803748 conn(0x7fce880fc520 msgr2=0x7fce880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.415+0000 7fce9060c640 1 -- 172.21.15.118:0/2933803748 shutdown_connections 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.415+0000 7fce9060c640 1 -- 172.21.15.118:0/2933803748 wait complete. 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.416+0000 7fce9060c640 1 Processor -- start 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.416+0000 7fce9060c640 1 -- start start 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.416+0000 7fce9060c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88102ae0 0x7fce8819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.416+0000 7fce9060c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 0x7fce8819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.416+0000 7fce9060c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce8810ee70 con 0x7fce88103400 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.416+0000 7fce9060c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce8810ecf0 con 0x7fce88102ae0 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.416+0000 7fce8dba7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 0x7fce8819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.416+0000 7fce8dba7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 0x7fce8819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56480/0 (socket says 172.21.15.118:56480) 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.416+0000 7fce8dba7640 1 -- 172.21.15.118:0/2018461374 learned_addr learned my addr 172.21.15.118:0/2018461374 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:07:29.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce8e3a8640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88102ae0 0x7fce8819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce8dba7640 1 -- 172.21.15.118:0/2018461374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88102ae0 msgr2=0x7fce8819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce8dba7640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88102ae0 0x7fce8819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce8dba7640 1 -- 172.21.15.118:0/2018461374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce88197880 con 0x7fce88103400 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce8e3a8640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88102ae0 0x7fce8819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce8dba7640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 0x7fce8819dc00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fce7c031460 tx=0x7fce7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce877fe640 1 -- 172.21.15.118:0/2018461374 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce7c03f070 con 0x7fce88103400 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce88197b10 con 0x7fce88103400 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce877fe640 1 -- 172.21.15.118:0/2018461374 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce7c004ac0 con 0x7fce88103400 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce877fe640 1 -- 172.21.15.118:0/2018461374 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce7c035030 con 0x7fce88103400 2024-09-21T12:07:29.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.417+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce88198040 con 0x7fce88103400 2024-09-21T12:07:29.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.418+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce8806abe0 con 0x7fce88103400 2024-09-21T12:07:29.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.419+0000 7fce877fe640 1 -- 172.21.15.118:0/2018461374 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fce7c042070 con 0x7fce88103400 2024-09-21T12:07:29.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.419+0000 7fce877fe640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce7007af30 0x7fce7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:29.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.419+0000 7fce877fe640 1 -- 172.21.15.118:0/2018461374 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fce7c0beb60 con 0x7fce88103400 2024-09-21T12:07:29.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.419+0000 7fce8e3a8640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce7007af30 0x7fce7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:29.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.420+0000 7fce8e3a8640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce7007af30 0x7fce7007d3f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fce78006fd0 tx=0x7fce78008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:29.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.424+0000 7fce877fe640 1 -- 172.21.15.118:0/2018461374 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce7c08a0b0 con 0x7fce88103400 2024-09-21T12:07:29.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:29 smithi149 ceph-mon[79770]: from='client.35368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:07:29.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:29 smithi149 ceph-mon[79770]: from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:07:29.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.643+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fce88105fb0 con 0x7fce88103400 2024-09-21T12:07:29.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.644+0000 7fce877fe640 1 -- 172.21.15.118:0/2018461374 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7fce7c08ef60 con 0x7fce88103400 2024-09-21T12:07:29.645 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:07:29.645 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:07:29.645 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:07:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:07:29.647 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:07:29.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:07:29.649 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:07:29.649 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:07:29.649 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:07:29.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce7007af30 msgr2=0x7fce7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce7007af30 0x7fce7007d3f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fce78006fd0 tx=0x7fce78008040 comp rx=0 tx=0).stop 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 msgr2=0x7fce8819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 0x7fce8819dc00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fce7c031460 tx=0x7fce7c0046c0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 shutdown_connections 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce7007af30 0x7fce7007d3f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce88103400 0x7fce8819dc00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 --2- 172.21.15.118:0/2018461374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88102ae0 0x7fce8819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 >> 172.21.15.118:0/2018461374 conn(0x7fce880fc520 msgr2=0x7fce88108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 shutdown_connections 2024-09-21T12:07:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.646+0000 7fce9060c640 1 -- 172.21.15.118:0/2018461374 wait complete. 2024-09-21T12:07:29.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/3110024988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01067e0 msgr2=0x7f2ff0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 --2- 172.21.15.118:0/3110024988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01067e0 0x7f2ff0106bc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009880 tx=0x7f2fe002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/3110024988 shutdown_connections 2024-09-21T12:07:29.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 --2- 172.21.15.118:0/3110024988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff01007e0 0x7f2ff0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 --2- 172.21.15.118:0/3110024988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01067e0 0x7f2ff0106bc0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/3110024988 >> 172.21.15.118:0/3110024988 conn(0x7f2ff00fc4c0 msgr2=0x7f2ff00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:29.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/3110024988 shutdown_connections 2024-09-21T12:07:29.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/3110024988 wait complete. 2024-09-21T12:07:29.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 Processor -- start 2024-09-21T12:07:29.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.739+0000 7f2ff4ffa640 1 -- start start 2024-09-21T12:07:29.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2ff4ffa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01007e0 0x7f2ff0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:29.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2ff4ffa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff01067e0 0x7f2ff0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2ff4ffa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff010dcb0 con 0x7f2ff01007e0 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2ff4ffa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff010db30 con 0x7f2ff01067e0 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fee59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01007e0 0x7f2ff0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fee59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01007e0 0x7f2ff0198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56510/0 (socket says 172.21.15.118:56510) 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fee59c640 1 -- 172.21.15.118:0/1676509996 learned_addr learned my addr 172.21.15.118:0/1676509996 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fedd9b640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff01067e0 0x7f2ff0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fee59c640 1 -- 172.21.15.118:0/1676509996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff01067e0 msgr2=0x7f2ff0198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fee59c640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff01067e0 0x7f2ff0198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fee59c640 1 -- 172.21.15.118:0/1676509996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff0199360 con 0x7f2ff01007e0 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fedd9b640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff01067e0 0x7f2ff0198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fee59c640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01007e0 0x7f2ff0198820 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0031460 tx=0x7f2fe00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fe77fe640 1 -- 172.21.15.118:0/1676509996 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fe003f070 con 0x7f2ff01007e0 2024-09-21T12:07:29.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff01995f0 con 0x7f2ff01007e0 2024-09-21T12:07:29.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fe77fe640 1 -- 172.21.15.118:0/1676509996 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fe0004cf0 con 0x7f2ff01007e0 2024-09-21T12:07:29.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.740+0000 7f2fe77fe640 1 -- 172.21.15.118:0/1676509996 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fe0035030 con 0x7f2ff01007e0 2024-09-21T12:07:29.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.741+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff01a1ba0 con 0x7f2ff01007e0 2024-09-21T12:07:29.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.741+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff0101f20 con 0x7f2ff01007e0 2024-09-21T12:07:29.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.742+0000 7f2fe77fe640 1 -- 172.21.15.118:0/1676509996 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2fe0042070 con 0x7f2ff01007e0 2024-09-21T12:07:29.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.743+0000 7f2fe77fe640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af30 0x7f2fdc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:29.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.743+0000 7f2fe77fe640 1 -- 172.21.15.118:0/1676509996 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2fe00beb70 con 0x7f2ff01007e0 2024-09-21T12:07:29.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.743+0000 7f2fedd9b640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af30 0x7f2fdc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:29.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.743+0000 7f2fedd9b640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af30 0x7f2fdc07d3f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2ff006a680 tx=0x7f2fd8005d30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:29.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.748+0000 7f2fe77fe640 1 -- 172.21.15.118:0/1676509996 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2fe008a0c0 con 0x7f2ff01007e0 2024-09-21T12:07:29.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.941+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2ff0062630 con 0x7f2fdc07af30 2024-09-21T12:07:29.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.942+0000 7f2fe77fe640 1 -- 172.21.15.118:0/1676509996 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2ff0062630 con 0x7f2fdc07af30 2024-09-21T12:07:29.943 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:07:29.944 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.945+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af30 msgr2=0x7f2fdc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.945+0000 7f2ff4ffa640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af30 0x7f2fdc07d3f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2ff006a680 tx=0x7f2fd8005d30 comp rx=0 tx=0).stop 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.945+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01007e0 msgr2=0x7f2ff0198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.945+0000 7f2ff4ffa640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01007e0 0x7f2ff0198820 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0031460 tx=0x7f2fe00048f0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.945+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 shutdown_connections 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.945+0000 7f2ff4ffa640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff01067e0 0x7f2ff0198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.945+0000 7f2ff4ffa640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af30 0x7f2fdc07d3f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.945+0000 7f2ff4ffa640 1 --2- 172.21.15.118:0/1676509996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff01007e0 0x7f2ff0198820 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.945+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 >> 172.21.15.118:0/1676509996 conn(0x7f2ff00fc4c0 msgr2=0x7f2ff00fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.946+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 shutdown_connections 2024-09-21T12:07:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:29.946+0000 7f2ff4ffa640 1 -- 172.21.15.118:0/1676509996 wait complete. 2024-09-21T12:07:30.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.026+0000 7f7176338640 1 -- 172.21.15.118:0/2514728191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170103420 msgr2=0x7f717010b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:30.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.026+0000 7f7176338640 1 --2- 172.21.15.118:0/2514728191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170103420 0x7f717010b910 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f71640098b0 tx=0x7f716402a560 comp rx=0 tx=0).stop 2024-09-21T12:07:30.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.026+0000 7f7176338640 1 -- 172.21.15.118:0/2514728191 shutdown_connections 2024-09-21T12:07:30.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.026+0000 7f7176338640 1 --2- 172.21.15.118:0/2514728191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170103420 0x7f717010b910 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:30.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.026+0000 7f7176338640 1 --2- 172.21.15.118:0/2514728191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7170102b00 0x7f7170102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:30.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.026+0000 7f7176338640 1 -- 172.21.15.118:0/2514728191 >> 172.21.15.118:0/2514728191 conn(0x7f71700fc4c0 msgr2=0x7f71700fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:30.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.026+0000 7f7176338640 1 -- 172.21.15.118:0/2514728191 shutdown_connections 2024-09-21T12:07:30.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.026+0000 7f7176338640 1 -- 172.21.15.118:0/2514728191 wait complete. 2024-09-21T12:07:30.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.027+0000 7f7176338640 1 Processor -- start 2024-09-21T12:07:30.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.027+0000 7f7176338640 1 -- start start 2024-09-21T12:07:30.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.027+0000 7f7176338640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170102b00 0x7f7170100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:30.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.027+0000 7f7176338640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7170103420 0x7f7170100ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:30.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.027+0000 7f7176338640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f717010edb0 con 0x7f7170102b00 2024-09-21T12:07:30.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.027+0000 7f7176338640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f717010ec30 con 0x7f7170103420 2024-09-21T12:07:30.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170102b00 0x7f7170100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170102b00 0x7f7170100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56530/0 (socket says 172.21.15.118:56530) 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716ffff640 1 -- 172.21.15.118:0/1464217743 learned_addr learned my addr 172.21.15.118:0/1464217743 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716f7fe640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7170103420 0x7f7170100ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716ffff640 1 -- 172.21.15.118:0/1464217743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7170103420 msgr2=0x7f7170100ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716ffff640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7170103420 0x7f7170100ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716ffff640 1 -- 172.21.15.118:0/1464217743 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71701011e0 con 0x7f7170102b00 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716ffff640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170102b00 0x7f7170100760 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f716000d8d0 tx=0x7f716000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716d7fa640 1 -- 172.21.15.118:0/1464217743 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7160017070 con 0x7f7170102b00 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71701014d0 con 0x7f7170102b00 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716d7fa640 1 -- 172.21.15.118:0/1464217743 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7160010460 con 0x7f7170102b00 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f716d7fa640 1 -- 172.21.15.118:0/1464217743 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f716000f5f0 con 0x7f7170102b00 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.028+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71701a3ea0 con 0x7f7170102b00 2024-09-21T12:07:30.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.029+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717006a3b0 con 0x7f7170102b00 2024-09-21T12:07:30.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.030+0000 7f716d7fa640 1 -- 172.21.15.118:0/1464217743 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7160009a30 con 0x7f7170102b00 2024-09-21T12:07:30.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.030+0000 7f716d7fa640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f715807af30 0x7f715807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:07:30.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.031+0000 7f716d7fa640 1 -- 172.21.15.118:0/1464217743 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f716009df90 con 0x7f7170102b00 2024-09-21T12:07:30.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.031+0000 7f716f7fe640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f715807af30 0x7f715807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:07:30.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.031+0000 7f716f7fe640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f715807af30 0x7f715807d3f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7164000c00 tx=0x7f7164031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:07:30.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.035+0000 7f716d7fa640 1 -- 172.21.15.118:0/1464217743 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71600694e0 con 0x7f7170102b00 2024-09-21T12:07:30.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.280+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7170105f90 con 0x7f7170102b00 2024-09-21T12:07:30.282 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:30 smithi118 ceph-mon[111738]: pgmap v861: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:30.282 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:30 smithi118 ceph-mon[111738]: from='client.35376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:07:30.282 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:30 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3580010814' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:07:30.282 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:30 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2018461374' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:07:30.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.281+0000 7f716d7fa640 1 -- 172.21.15.118:0/1464217743 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f716006e390 con 0x7f7170102b00 2024-09-21T12:07:30.283 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:07:30.283 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:07:30.283 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:07:30.283 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:07:30.283 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:07:30.283 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:07:30.283 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:07:30.284 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:07:30.285 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:07:30.285 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:07:30.285 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:07:30.285 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:07:30.285 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f715807af30 msgr2=0x7f715807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f715807af30 0x7f715807d3f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7164000c00 tx=0x7f7164031400 comp rx=0 tx=0).stop 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170102b00 msgr2=0x7f7170100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170102b00 0x7f7170100760 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f716000d8d0 tx=0x7f716000dd90 comp rx=0 tx=0).stop 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 shutdown_connections 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7170103420 0x7f7170100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f715807af30 0x7f715807d3f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 --2- 172.21.15.118:0/1464217743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7170102b00 0x7f7170100760 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 >> 172.21.15.118:0/1464217743 conn(0x7f71700fc4c0 msgr2=0x7f7170103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:07:30.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 shutdown_connections 2024-09-21T12:07:30.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:07:30.283+0000 7f7176338640 1 -- 172.21.15.118:0/1464217743 wait complete. 2024-09-21T12:07:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:30 smithi149 ceph-mon[79770]: pgmap v861: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:30.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:30 smithi149 ceph-mon[79770]: from='client.35376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:07:30.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:30 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3580010814' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:07:30.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:30 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2018461374' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:07:31.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:31 smithi149 ceph-mon[79770]: from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:07:31.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:31 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1464217743' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:07:31.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:31 smithi118 ceph-mon[111738]: from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:07:31.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:31 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1464217743' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:07:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:32 smithi149 ceph-mon[79770]: pgmap v862: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:32 smithi118 ceph-mon[111738]: pgmap v862: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:34 smithi149 ceph-mon[79770]: pgmap v863: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:34.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:34 smithi118 ceph-mon[111738]: pgmap v863: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:07:35.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:07:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:36 smithi149 ceph-mon[79770]: pgmap v864: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:36 smithi118 ceph-mon[111738]: pgmap v864: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:38 smithi149 ceph-mon[79770]: pgmap v865: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:38.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:38 smithi118 ceph-mon[111738]: pgmap v865: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:40 smithi149 ceph-mon[79770]: pgmap v866: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:40.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:40 smithi118 ceph-mon[111738]: pgmap v866: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:42 smithi149 ceph-mon[79770]: pgmap v867: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:42.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:42 smithi118 ceph-mon[111738]: pgmap v867: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:44.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:44 smithi149 ceph-mon[79770]: pgmap v868: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:44.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:44 smithi118 ceph-mon[111738]: pgmap v868: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:46.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:46 smithi149 ceph-mon[79770]: pgmap v869: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:46.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:46 smithi118 ceph-mon[111738]: pgmap v869: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:48 smithi118 ceph-mon[111738]: pgmap v870: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:48.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:48 smithi149 ceph-mon[79770]: pgmap v870: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:50 smithi118 ceph-mon[111738]: pgmap v871: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:07:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:50 smithi149 ceph-mon[79770]: pgmap v871: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:07:52.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:52 smithi118 ceph-mon[111738]: pgmap v872: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:52 smithi149 ceph-mon[79770]: pgmap v872: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:54.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:54 smithi118 ceph-mon[111738]: pgmap v873: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:54.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:54 smithi149 ceph-mon[79770]: pgmap v873: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:56 smithi149 ceph-mon[79770]: pgmap v874: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:56 smithi118 ceph-mon[111738]: pgmap v874: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:07:58 smithi118 ceph-mon[111738]: pgmap v875: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:07:58.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:07:58 smithi149 ceph-mon[79770]: pgmap v875: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:00 smithi118 ceph-mon[111738]: pgmap v876: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:00.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.370+0000 7fbb798ac640 1 -- 172.21.15.118:0/4228386963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741007e0 msgr2=0x7fbb74100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.370+0000 7fbb798ac640 1 --2- 172.21.15.118:0/4228386963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741007e0 0x7fbb74100c40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009880 tx=0x7fbb5c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.370+0000 7fbb798ac640 1 -- 172.21.15.118:0/4228386963 shutdown_connections 2024-09-21T12:08:00.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.370+0000 7fbb798ac640 1 --2- 172.21.15.118:0/4228386963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741007e0 0x7fbb74100c40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.370+0000 7fbb798ac640 1 --2- 172.21.15.118:0/4228386963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb741067e0 0x7fbb74106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.370+0000 7fbb798ac640 1 -- 172.21.15.118:0/4228386963 >> 172.21.15.118:0/4228386963 conn(0x7fbb740fc4c0 msgr2=0x7fbb740fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:00.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.371+0000 7fbb798ac640 1 -- 172.21.15.118:0/4228386963 shutdown_connections 2024-09-21T12:08:00.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.371+0000 7fbb798ac640 1 -- 172.21.15.118:0/4228386963 wait complete. 2024-09-21T12:08:00.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.371+0000 7fbb798ac640 1 Processor -- start 2024-09-21T12:08:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.371+0000 7fbb798ac640 1 -- start start 2024-09-21T12:08:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb798ac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb741007e0 0x7fbb7419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb798ac640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741067e0 0x7fbb7419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb798ac640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7410dcb0 con 0x7fbb741067e0 2024-09-21T12:08:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb798ac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7410db30 con 0x7fbb741007e0 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb727fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741067e0 0x7fbb7419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb727fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741067e0 0x7fbb7419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59998/0 (socket says 172.21.15.118:59998) 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb727fc640 1 -- 172.21.15.118:0/1069555228 learned_addr learned my addr 172.21.15.118:0/1069555228 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb72ffd640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb741007e0 0x7fbb7419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb727fc640 1 -- 172.21.15.118:0/1069555228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb741007e0 msgr2=0x7fbb7419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb727fc640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb741007e0 0x7fbb7419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb727fc640 1 -- 172.21.15.118:0/1069555228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb74197830 con 0x7fbb741067e0 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb727fc640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741067e0 0x7fbb7419dbf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c031460 tx=0x7fbb5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb788aa640 1 -- 172.21.15.118:0/1069555228 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb5c03f070 con 0x7fbb741067e0 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb74197ac0 con 0x7fbb741067e0 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.372+0000 7fbb788aa640 1 -- 172.21.15.118:0/1069555228 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb5c004cf0 con 0x7fbb741067e0 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.373+0000 7fbb788aa640 1 -- 172.21.15.118:0/1069555228 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb5c035030 con 0x7fbb741067e0 2024-09-21T12:08:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.373+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb74197ff0 con 0x7fbb741067e0 2024-09-21T12:08:00.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.374+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb74101f20 con 0x7fbb741067e0 2024-09-21T12:08:00.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.374+0000 7fbb788aa640 1 -- 172.21.15.118:0/1069555228 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbb5c042070 con 0x7fbb741067e0 2024-09-21T12:08:00.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.375+0000 7fbb788aa640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb6007af30 0x7fbb6007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:00.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.375+0000 7fbb788aa640 1 -- 172.21.15.118:0/1069555228 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbb5c0beac0 con 0x7fbb741067e0 2024-09-21T12:08:00.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.375+0000 7fbb72ffd640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb6007af30 0x7fbb6007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:00.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.376+0000 7fbb72ffd640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb6007af30 0x7fbb6007d3f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0058c0 tx=0x7fbb6c00a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.379+0000 7fbb788aa640 1 -- 172.21.15.118:0/1069555228 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb5c08a010 con 0x7fbb741067e0 2024-09-21T12:08:00.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.572+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbb74198360 con 0x7fbb6007af30 2024-09-21T12:08:00.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.573+0000 7fbb788aa640 1 -- 172.21.15.118:0/1069555228 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fbb74198360 con 0x7fbb6007af30 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb6007af30 msgr2=0x7fbb6007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb6007af30 0x7fbb6007d3f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0058c0 tx=0x7fbb6c00a250 comp rx=0 tx=0).stop 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741067e0 msgr2=0x7fbb7419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741067e0 0x7fbb7419dbf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c031460 tx=0x7fbb5c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 shutdown_connections 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbb6007af30 0x7fbb6007d3f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb741067e0 0x7fbb7419dbf0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 --2- 172.21.15.118:0/1069555228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb741007e0 0x7fbb7419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 >> 172.21.15.118:0/1069555228 conn(0x7fbb740fc4c0 msgr2=0x7fbb74069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:00.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 shutdown_connections 2024-09-21T12:08:00.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.576+0000 7fbb798ac640 1 -- 172.21.15.118:0/1069555228 wait complete. 2024-09-21T12:08:00.587 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:08:00.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.658+0000 7fe1fb63d640 1 -- 172.21.15.118:0/2579186534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f40ffd70 msgr2=0x7fe1f41001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.658+0000 7fe1fb63d640 1 --2- 172.21.15.118:0/2579186534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f40ffd70 0x7fe1f41001d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009880 tx=0x7fe1e802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.658+0000 7fe1fb63d640 1 -- 172.21.15.118:0/2579186534 shutdown_connections 2024-09-21T12:08:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.658+0000 7fe1fb63d640 1 --2- 172.21.15.118:0/2579186534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f40ffd70 0x7fe1f41001d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.658+0000 7fe1fb63d640 1 --2- 172.21.15.118:0/2579186534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f4106950 0x7fe1f4106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.658+0000 7fe1fb63d640 1 -- 172.21.15.118:0/2579186534 >> 172.21.15.118:0/2579186534 conn(0x7fe1f40fbc60 msgr2=0x7fe1f40fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.659+0000 7fe1fb63d640 1 -- 172.21.15.118:0/2579186534 shutdown_connections 2024-09-21T12:08:00.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.659+0000 7fe1fb63d640 1 -- 172.21.15.118:0/2579186534 wait complete. 2024-09-21T12:08:00.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.659+0000 7fe1fb63d640 1 Processor -- start 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.659+0000 7fe1fb63d640 1 -- start start 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.659+0000 7fe1fb63d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f40ffd70 0x7fe1f419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.659+0000 7fe1fb63d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f4106950 0x7fe1f419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.659+0000 7fe1fb63d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f410eef0 con 0x7fe1f4106950 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.659+0000 7fe1fb63d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f410ed70 con 0x7fe1f40ffd70 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1f8bd8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f4106950 0x7fe1f419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1f8bd8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f4106950 0x7fe1f419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60022/0 (socket says 172.21.15.118:60022) 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1f8bd8640 1 -- 172.21.15.118:0/1578236778 learned_addr learned my addr 172.21.15.118:0/1578236778 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1f93d9640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f40ffd70 0x7fe1f419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1f8bd8640 1 -- 172.21.15.118:0/1578236778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f40ffd70 msgr2=0x7fe1f419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1f8bd8640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f40ffd70 0x7fe1f419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1f8bd8640 1 -- 172.21.15.118:0/1578236778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f4197880 con 0x7fe1f4106950 2024-09-21T12:08:00.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1f8bd8640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f4106950 0x7fe1f419dc00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8031460 tx=0x7fe1e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:00.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1e67fc640 1 -- 172.21.15.118:0/1578236778 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1e803f070 con 0x7fe1f4106950 2024-09-21T12:08:00.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.660+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f4197b10 con 0x7fe1f4106950 2024-09-21T12:08:00.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.661+0000 7fe1e67fc640 1 -- 172.21.15.118:0/1578236778 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1e80035f0 con 0x7fe1f4106950 2024-09-21T12:08:00.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.661+0000 7fe1e67fc640 1 -- 172.21.15.118:0/1578236778 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1e8035030 con 0x7fe1f4106950 2024-09-21T12:08:00.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.661+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f4198040 con 0x7fe1f4106950 2024-09-21T12:08:00.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.662+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d8005290 con 0x7fe1f4106950 2024-09-21T12:08:00.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.662+0000 7fe1e67fc640 1 -- 172.21.15.118:0/1578236778 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe1e8042070 con 0x7fe1f4106950 2024-09-21T12:08:00.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.663+0000 7fe1e67fc640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1e007af30 0x7fe1e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:00.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.663+0000 7fe1f93d9640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1e007af30 0x7fe1e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:00.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.663+0000 7fe1e67fc640 1 -- 172.21.15.118:0/1578236778 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe1e80be990 con 0x7fe1f4106950 2024-09-21T12:08:00.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.663+0000 7fe1f93d9640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1e007af30 0x7fe1e007d3f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe1f41989c0 tx=0x7fe1f000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:00.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.668+0000 7fe1e67fc640 1 -- 172.21.15.118:0/1578236778 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1e8089ee0 con 0x7fe1f4106950 2024-09-21T12:08:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:00 smithi149 ceph-mon[79770]: pgmap v876: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:00.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.862+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe1d8000bc0 con 0x7fe1e007af30 2024-09-21T12:08:00.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.863+0000 7fe1e67fc640 1 -- 172.21.15.118:0/1578236778 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe1d8000bc0 con 0x7fe1e007af30 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1e007af30 msgr2=0x7fe1e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1e007af30 0x7fe1e007d3f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe1f41989c0 tx=0x7fe1f000b390 comp rx=0 tx=0).stop 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f4106950 msgr2=0x7fe1f419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f4106950 0x7fe1f419dc00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8031460 tx=0x7fe1e80045e0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 shutdown_connections 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1e007af30 0x7fe1e007d3f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f4106950 0x7fe1f419dc00 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 --2- 172.21.15.118:0/1578236778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f40ffd70 0x7fe1f419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 >> 172.21.15.118:0/1578236778 conn(0x7fe1f40fbc60 msgr2=0x7fe1f40fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 shutdown_connections 2024-09-21T12:08:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.866+0000 7fe1fb63d640 1 -- 172.21.15.118:0/1578236778 wait complete. 2024-09-21T12:08:00.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.947+0000 7f33211d1640 1 -- 172.21.15.118:0/984371366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 msgr2=0x7f331c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.947+0000 7f33211d1640 1 --2- 172.21.15.118:0/984371366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 0x7f331c101d90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3304009880 tx=0x7f330402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.947+0000 7f33211d1640 1 -- 172.21.15.118:0/984371366 shutdown_connections 2024-09-21T12:08:00.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.947+0000 7f33211d1640 1 --2- 172.21.15.118:0/984371366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 0x7f331c101d90 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.947+0000 7f33211d1640 1 --2- 172.21.15.118:0/984371366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f331c107930 0x7f331c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.947+0000 7f33211d1640 1 -- 172.21.15.118:0/984371366 >> 172.21.15.118:0/984371366 conn(0x7f331c0fd630 msgr2=0x7f331c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:00.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.947+0000 7f33211d1640 1 -- 172.21.15.118:0/984371366 shutdown_connections 2024-09-21T12:08:00.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.947+0000 7f33211d1640 1 -- 172.21.15.118:0/984371366 wait complete. 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.948+0000 7f33211d1640 1 Processor -- start 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.948+0000 7f33211d1640 1 -- start start 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f33211d1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 0x7f331c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f33211d1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f331c107930 0x7f331c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f33211d1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f331c10ede0 con 0x7f331c101930 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f33211d1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f331c10ec60 con 0x7f331c107930 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f331ad9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 0x7f331c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f331ad9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 0x7f331c19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60042/0 (socket says 172.21.15.118:60042) 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f331ad9d640 1 -- 172.21.15.118:0/4030306526 learned_addr learned my addr 172.21.15.118:0/4030306526 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f331a59c640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f331c107930 0x7f331c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:00.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f331ad9d640 1 -- 172.21.15.118:0/4030306526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f331c107930 msgr2=0x7f331c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:00.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f331ad9d640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f331c107930 0x7f331c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:00.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f331ad9d640 1 -- 172.21.15.118:0/4030306526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c1999c0 con 0x7f331c101930 2024-09-21T12:08:00.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f331ad9d640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 0x7f331c19f800 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f330c00ea30 tx=0x7f330c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:00.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f3313fff640 1 -- 172.21.15.118:0/4030306526 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f330c00cbe0 con 0x7f331c101930 2024-09-21T12:08:00.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331c199cb0 con 0x7f331c101930 2024-09-21T12:08:00.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.949+0000 7f3313fff640 1 -- 172.21.15.118:0/4030306526 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f330c00cd80 con 0x7f331c101930 2024-09-21T12:08:00.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.950+0000 7f3313fff640 1 -- 172.21.15.118:0/4030306526 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f330c01a920 con 0x7f331c101930 2024-09-21T12:08:00.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.950+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331c19a210 con 0x7f331c101930 2024-09-21T12:08:00.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.951+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331c103070 con 0x7f331c101930 2024-09-21T12:08:00.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.951+0000 7f3313fff640 1 -- 172.21.15.118:0/4030306526 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f330c01aac0 con 0x7f331c101930 2024-09-21T12:08:00.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.952+0000 7f3313fff640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:00.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.952+0000 7f3313fff640 1 -- 172.21.15.118:0/4030306526 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f330c09e700 con 0x7f331c101930 2024-09-21T12:08:00.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.952+0000 7f331a59c640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:00.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.952+0000 7f331a59c640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f331c19b1b0 tx=0x7f3304031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:00.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:00.956+0000 7f3313fff640 1 -- 172.21.15.118:0/4030306526 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f330c016030 con 0x7f331c101930 2024-09-21T12:08:01.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.142+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f331c19a580 con 0x7f330807af80 2024-09-21T12:08:01.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.151+0000 7f3313fff640 1 -- 172.21.15.118:0/4030306526 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f331c19a580 con 0x7f330807af80 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (25m) 4m ago 36m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (29m) 4m ago 37m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (28m) 4m ago 36m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (24m) 4m ago 37m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (24m) 4m ago 36m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (25m) 4m ago 36m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (20m) 4m ago 31m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (20m) 4m ago 31m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:08:01.154 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (4m) 4m ago 31m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (19m) 4m ago 31m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (28m) 4m ago 38m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (27m) 4m ago 36m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (24m) 4m ago 38m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (24m) 4m ago 35m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (26m) 4m ago 36m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (26m) 4m ago 36m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (23m) 4m ago 34m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (23m) 4m ago 34m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (22m) 4m ago 33m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (21m) 4m ago 33m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (21m) 4m ago 33m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (20m) 4m ago 32m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:08:01.155 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (26m) 4m ago 36m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:08:01.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 msgr2=0x7f330807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f331c19b1b0 tx=0x7f3304031400 comp rx=0 tx=0).stop 2024-09-21T12:08:01.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 msgr2=0x7f331c19f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 0x7f331c19f800 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f330c00ea30 tx=0x7f330c00eef0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 shutdown_connections 2024-09-21T12:08:01.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f331c107930 0x7f331c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f330807af80 0x7f330807d440 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 --2- 172.21.15.118:0/4030306526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f331c101930 0x7f331c19f800 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 >> 172.21.15.118:0/4030306526 conn(0x7f331c0fd630 msgr2=0x7f331c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:01.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 shutdown_connections 2024-09-21T12:08:01.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.154+0000 7f33211d1640 1 -- 172.21.15.118:0/4030306526 wait complete. 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.236+0000 7f03ba945640 1 -- 172.21.15.118:0/305857051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 msgr2=0x7f03b4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.236+0000 7f03ba945640 1 --2- 172.21.15.118:0/305857051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 0x7f03b4100c80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009880 tx=0x7f03a402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.236+0000 7f03ba945640 1 -- 172.21.15.118:0/305857051 shutdown_connections 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.236+0000 7f03ba945640 1 --2- 172.21.15.118:0/305857051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 0x7f03b4100c80 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.236+0000 7f03ba945640 1 --2- 172.21.15.118:0/305857051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03b4106820 0x7f03b4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.236+0000 7f03ba945640 1 -- 172.21.15.118:0/305857051 >> 172.21.15.118:0/305857051 conn(0x7f03b40fc520 msgr2=0x7f03b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.236+0000 7f03ba945640 1 -- 172.21.15.118:0/305857051 shutdown_connections 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.236+0000 7f03ba945640 1 -- 172.21.15.118:0/305857051 wait complete. 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03ba945640 1 Processor -- start 2024-09-21T12:08:01.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03ba945640 1 -- start start 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03ba945640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 0x7f03b419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03ba945640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03b4106820 0x7f03b419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03ba945640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03b410dcd0 con 0x7f03b4100820 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03ba945640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03b410db50 con 0x7f03b4106820 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03b3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 0x7f03b419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03b3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 0x7f03b419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60054/0 (socket says 172.21.15.118:60054) 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03b3fff640 1 -- 172.21.15.118:0/1645036501 learned_addr learned my addr 172.21.15.118:0/1645036501 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.237+0000 7f03b37fe640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03b4106820 0x7f03b419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.238+0000 7f03b3fff640 1 -- 172.21.15.118:0/1645036501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03b4106820 msgr2=0x7f03b419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.238+0000 7f03b3fff640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03b4106820 0x7f03b419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.238+0000 7f03b3fff640 1 -- 172.21.15.118:0/1645036501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b41977b0 con 0x7f03b4100820 2024-09-21T12:08:01.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.238+0000 7f03b3fff640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 0x7f03b419d630 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f039c00d8d0 tx=0x7f039c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:01.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.238+0000 7f03b17fa640 1 -- 172.21.15.118:0/1645036501 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f039c017070 con 0x7f03b4100820 2024-09-21T12:08:01.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.238+0000 7f03b17fa640 1 -- 172.21.15.118:0/1645036501 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f039c010460 con 0x7f03b4100820 2024-09-21T12:08:01.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.238+0000 7f03b17fa640 1 -- 172.21.15.118:0/1645036501 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f039c00f5f0 con 0x7f03b4100820 2024-09-21T12:08:01.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.238+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b4197aa0 con 0x7f03b4100820 2024-09-21T12:08:01.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.238+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b4198000 con 0x7f03b4100820 2024-09-21T12:08:01.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.239+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b4101f60 con 0x7f03b4100820 2024-09-21T12:08:01.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.240+0000 7f03b17fa640 1 -- 172.21.15.118:0/1645036501 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f039c009a30 con 0x7f03b4100820 2024-09-21T12:08:01.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.240+0000 7f03b17fa640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a007af30 0x7f03a007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:01.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.240+0000 7f03b17fa640 1 -- 172.21.15.118:0/1645036501 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f039c09dee0 con 0x7f03b4100820 2024-09-21T12:08:01.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.240+0000 7f03b37fe640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a007af30 0x7f03a007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:01.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.241+0000 7f03b37fe640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a007af30 0x7f03a007d3f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f03b4198b00 tx=0x7f03a4031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:01.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.244+0000 7f03b17fa640 1 -- 172.21.15.118:0/1645036501 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f039c069430 con 0x7f03b4100820 2024-09-21T12:08:01.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:01 smithi149 ceph-mon[79770]: from='client.35396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:01.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:01 smithi149 ceph-mon[79770]: from='client.35400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.491+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f03b41982b0 con 0x7f03b4100820 2024-09-21T12:08:01.494 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:01 smithi118 ceph-mon[111738]: from='client.35396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:01.494 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:01 smithi118 ceph-mon[111738]: from='client.35400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.492+0000 7f03b17fa640 1 -- 172.21.15.118:0/1645036501 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f039c06e2e0 con 0x7f03b4100820 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:08:01.495 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:08:01.496 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:08:01.496 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:08:01.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a007af30 msgr2=0x7f03a007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a007af30 0x7f03a007d3f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f03b4198b00 tx=0x7f03a4031400 comp rx=0 tx=0).stop 2024-09-21T12:08:01.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 msgr2=0x7f03b419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 0x7f03b419d630 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f039c00d8d0 tx=0x7f039c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:08:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 shutdown_connections 2024-09-21T12:08:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03b4106820 0x7f03b419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03a007af30 0x7f03a007d3f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 --2- 172.21.15.118:0/1645036501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03b4100820 0x7f03b419d630 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 >> 172.21.15.118:0/1645036501 conn(0x7f03b40fc520 msgr2=0x7f03b41045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 shutdown_connections 2024-09-21T12:08:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.494+0000 7f03ba945640 1 -- 172.21.15.118:0/1645036501 wait complete. 2024-09-21T12:08:01.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.575+0000 7f6d9b697640 1 -- 172.21.15.118:0/1270981520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941067e0 msgr2=0x7f6d94106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.575+0000 7f6d9b697640 1 --2- 172.21.15.118:0/1270981520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941067e0 0x7f6d94106bc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009880 tx=0x7f6d9002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.575+0000 7f6d9b697640 1 -- 172.21.15.118:0/1270981520 shutdown_connections 2024-09-21T12:08:01.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.575+0000 7f6d9b697640 1 --2- 172.21.15.118:0/1270981520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d941007e0 0x7f6d94100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.575+0000 7f6d9b697640 1 --2- 172.21.15.118:0/1270981520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941067e0 0x7f6d94106bc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.575+0000 7f6d9b697640 1 -- 172.21.15.118:0/1270981520 >> 172.21.15.118:0/1270981520 conn(0x7f6d940fc4c0 msgr2=0x7f6d940fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:01.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d9b697640 1 -- 172.21.15.118:0/1270981520 shutdown_connections 2024-09-21T12:08:01.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d9b697640 1 -- 172.21.15.118:0/1270981520 wait complete. 2024-09-21T12:08:01.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d9b697640 1 Processor -- start 2024-09-21T12:08:01.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d9b697640 1 -- start start 2024-09-21T12:08:01.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d9b697640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941007e0 0x7f6d9419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:01.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d9b697640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d941067e0 0x7f6d9419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:01.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d9b697640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9410dcb0 con 0x7f6d941007e0 2024-09-21T12:08:01.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d9b697640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9410db30 con 0x7f6d941067e0 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d99433640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941007e0 0x7f6d9419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d99433640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941007e0 0x7f6d9419d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60066/0 (socket says 172.21.15.118:60066) 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.576+0000 7f6d99433640 1 -- 172.21.15.118:0/837306317 learned_addr learned my addr 172.21.15.118:0/837306317 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d98c32640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d941067e0 0x7f6d9419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d99433640 1 -- 172.21.15.118:0/837306317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d941067e0 msgr2=0x7f6d9419db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d99433640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d941067e0 0x7f6d9419db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d99433640 1 -- 172.21.15.118:0/837306317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d941977d0 con 0x7f6d941007e0 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d99433640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941007e0 0x7f6d9419d650 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6d90031460 tx=0x7f6d900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d8a7fc640 1 -- 172.21.15.118:0/837306317 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d9003f070 con 0x7f6d941007e0 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d8a7fc640 1 -- 172.21.15.118:0/837306317 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d90004cf0 con 0x7f6d941007e0 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d94197a60 con 0x7f6d941007e0 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d8a7fc640 1 -- 172.21.15.118:0/837306317 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d90035030 con 0x7f6d941007e0 2024-09-21T12:08:01.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.577+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d94197f90 con 0x7f6d941007e0 2024-09-21T12:08:01.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.578+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d94101f20 con 0x7f6d941007e0 2024-09-21T12:08:01.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.579+0000 7f6d8a7fc640 1 -- 172.21.15.118:0/837306317 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6d90042070 con 0x7f6d941007e0 2024-09-21T12:08:01.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.579+0000 7f6d8a7fc640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d8007af80 0x7f6d8007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:01.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.579+0000 7f6d8a7fc640 1 -- 172.21.15.118:0/837306317 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6d900be9e0 con 0x7f6d941007e0 2024-09-21T12:08:01.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.579+0000 7f6d98c32640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d8007af80 0x7f6d8007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:01.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.580+0000 7f6d98c32640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d8007af80 0x7f6d8007d440 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6d941048a0 tx=0x7f6d8400a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:01.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.584+0000 7f6d8a7fc640 1 -- 172.21.15.118:0/837306317 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d90089fb0 con 0x7f6d941007e0 2024-09-21T12:08:01.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.796+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6d94109d60 con 0x7f6d941007e0 2024-09-21T12:08:01.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.797+0000 7f6d8a7fc640 1 -- 172.21.15.118:0/837306317 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f6d9008ee60 con 0x7f6d941007e0 2024-09-21T12:08:01.799 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:08:01.799 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:08:01.799 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:08:01.799 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:08:01.799 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:08:01.799 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:08:01.800 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:08:01.801 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:08:01.802 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:08:01.802 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:08:01.802 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:08:01.802 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:08:01.802 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:08:01.802 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:08:01.802 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:08:01.802 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:08:01.802 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d8007af80 msgr2=0x7f6d8007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d8007af80 0x7f6d8007d440 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6d941048a0 tx=0x7f6d8400a250 comp rx=0 tx=0).stop 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941007e0 msgr2=0x7f6d9419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941007e0 0x7f6d9419d650 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6d90031460 tx=0x7f6d900048f0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 shutdown_connections 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d941067e0 0x7f6d9419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6d8007af80 0x7f6d8007d440 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 --2- 172.21.15.118:0/837306317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d941007e0 0x7f6d9419d650 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 >> 172.21.15.118:0/837306317 conn(0x7f6d940fc4c0 msgr2=0x7f6d94069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:01.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 shutdown_connections 2024-09-21T12:08:01.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.800+0000 7f6d9b697640 1 -- 172.21.15.118:0/837306317 wait complete. 2024-09-21T12:08:01.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.883+0000 7f3c397e3640 1 -- 172.21.15.118:0/110784739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c341000d0 msgr2=0x7f3c341004b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.883+0000 7f3c397e3640 1 --2- 172.21.15.118:0/110784739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c341000d0 0x7f3c341004b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009880 tx=0x7f3c2402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.883+0000 7f3c397e3640 1 -- 172.21.15.118:0/110784739 shutdown_connections 2024-09-21T12:08:01.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.883+0000 7f3c397e3640 1 --2- 172.21.15.118:0/110784739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c34100a80 0x7f3c341065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.883+0000 7f3c397e3640 1 --2- 172.21.15.118:0/110784739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c341000d0 0x7f3c341004b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.883+0000 7f3c397e3640 1 -- 172.21.15.118:0/110784739 >> 172.21.15.118:0/110784739 conn(0x7f3c340fbc60 msgr2=0x7f3c340fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.883+0000 7f3c397e3640 1 -- 172.21.15.118:0/110784739 shutdown_connections 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.883+0000 7f3c397e3640 1 -- 172.21.15.118:0/110784739 wait complete. 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c397e3640 1 Processor -- start 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c397e3640 1 -- start start 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c397e3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c341000d0 0x7f3c3419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c397e3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c34100a80 0x7f3c3419dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c397e3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3410ee30 con 0x7f3c34100a80 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c397e3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3410ecb0 con 0x7f3c341000d0 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c2bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c34100a80 0x7f3c3419dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c2bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c34100a80 0x7f3c3419dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60084/0 (socket says 172.21.15.118:60084) 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c2bfff640 1 -- 172.21.15.118:0/1301245748 learned_addr learned my addr 172.21.15.118:0/1301245748 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:01.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c32ffd640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c341000d0 0x7f3c3419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:01.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c2bfff640 1 -- 172.21.15.118:0/1301245748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c341000d0 msgr2=0x7f3c3419d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:01.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c2bfff640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c341000d0 0x7f3c3419d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:01.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.884+0000 7f3c2bfff640 1 -- 172.21.15.118:0/1301245748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c341978a0 con 0x7f3c34100a80 2024-09-21T12:08:01.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.885+0000 7f3c2bfff640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c34100a80 0x7f3c3419dc20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00d6c0 tx=0x7f3c1c00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:01.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.885+0000 7f3c30ff9640 1 -- 172.21.15.118:0/1301245748 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c1c017070 con 0x7f3c34100a80 2024-09-21T12:08:01.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.885+0000 7f3c30ff9640 1 -- 172.21.15.118:0/1301245748 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c1c0054e0 con 0x7f3c34100a80 2024-09-21T12:08:01.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.885+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c34197b90 con 0x7f3c34100a80 2024-09-21T12:08:01.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.885+0000 7f3c30ff9640 1 -- 172.21.15.118:0/1301245748 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c1c004b70 con 0x7f3c34100a80 2024-09-21T12:08:01.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.885+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c34198120 con 0x7f3c34100a80 2024-09-21T12:08:01.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.886+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c34103190 con 0x7f3c34100a80 2024-09-21T12:08:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.887+0000 7f3c30ff9640 1 -- 172.21.15.118:0/1301245748 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3c1c009820 con 0x7f3c34100a80 2024-09-21T12:08:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.887+0000 7f3c30ff9640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c2007af30 0x7f3c2007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.887+0000 7f3c32ffd640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c2007af30 0x7f3c2007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.887+0000 7f3c30ff9640 1 -- 172.21.15.118:0/1301245748 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3c1c09dc00 con 0x7f3c34100a80 2024-09-21T12:08:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.888+0000 7f3c32ffd640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c2007af30 0x7f3c2007d3f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3c24000c00 tx=0x7f3c24031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:01.892+0000 7f3c30ff9640 1 -- 172.21.15.118:0/1301245748 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c1c0a3020 con 0x7f3c34100a80 2024-09-21T12:08:02.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.085+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3c34109f30 con 0x7f3c2007af30 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.087+0000 7f3c30ff9640 1 -- 172.21.15.118:0/1301245748 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3c24004260 con 0x7f3c2007af30 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:08:02.089 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:08:02.090 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:08:02.090 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:08:02.090 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:08:02.090 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:08:02.090 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:08:02.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c2007af30 msgr2=0x7f3c2007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:02.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c2007af30 0x7f3c2007d3f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3c24000c00 tx=0x7f3c24031400 comp rx=0 tx=0).stop 2024-09-21T12:08:02.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c34100a80 msgr2=0x7f3c3419dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:02.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c34100a80 0x7f3c3419dc20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00d6c0 tx=0x7f3c1c00db80 comp rx=0 tx=0).stop 2024-09-21T12:08:02.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 shutdown_connections 2024-09-21T12:08:02.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3c2007af30 0x7f3c2007d3f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c34100a80 0x7f3c3419dc20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 --2- 172.21.15.118:0/1301245748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c341000d0 0x7f3c3419d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 >> 172.21.15.118:0/1301245748 conn(0x7f3c340fbc60 msgr2=0x7f3c340fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:02.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 shutdown_connections 2024-09-21T12:08:02.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.089+0000 7f3c397e3640 1 -- 172.21.15.118:0/1301245748 wait complete. 2024-09-21T12:08:02.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.170+0000 7fc31eef3640 1 -- 172.21.15.118:0/4009359735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318101930 msgr2=0x7fc318101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:02.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.170+0000 7fc31eef3640 1 --2- 172.21.15.118:0/4009359735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318101930 0x7fc318101d90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc304009880 tx=0x7fc30402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.170+0000 7fc31eef3640 1 -- 172.21.15.118:0/4009359735 shutdown_connections 2024-09-21T12:08:02.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.170+0000 7fc31eef3640 1 --2- 172.21.15.118:0/4009359735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318101930 0x7fc318101d90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.170+0000 7fc31eef3640 1 --2- 172.21.15.118:0/4009359735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc318107930 0x7fc318107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.170+0000 7fc31eef3640 1 -- 172.21.15.118:0/4009359735 >> 172.21.15.118:0/4009359735 conn(0x7fc3180fd630 msgr2=0x7fc3180ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:02.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.170+0000 7fc31eef3640 1 -- 172.21.15.118:0/4009359735 shutdown_connections 2024-09-21T12:08:02.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.170+0000 7fc31eef3640 1 -- 172.21.15.118:0/4009359735 wait complete. 2024-09-21T12:08:02.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.170+0000 7fc31eef3640 1 Processor -- start 2024-09-21T12:08:02.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc31eef3640 1 -- start start 2024-09-21T12:08:02.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc31eef3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc318101930 0x7fc3180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:02.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc31eef3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318107930 0x7fc318074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:02.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc31eef3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc31810ee60 con 0x7fc318107930 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc31eef3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc31810ece0 con 0x7fc318101930 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc317fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318107930 0x7fc318074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc317fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318107930 0x7fc318074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60090/0 (socket says 172.21.15.118:60090) 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc317fff640 1 -- 172.21.15.118:0/2252301243 learned_addr learned my addr 172.21.15.118:0/2252301243 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc31cc8f640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc318101930 0x7fc3180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc317fff640 1 -- 172.21.15.118:0/2252301243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc318101930 msgr2=0x7fc3180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc317fff640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc318101930 0x7fc3180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc317fff640 1 -- 172.21.15.118:0/2252301243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc318074f70 con 0x7fc318107930 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc31cc8f640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc318101930 0x7fc3180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc317fff640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318107930 0x7fc318074a30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc304031460 tx=0x7fc3040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.171+0000 7fc315ffb640 1 -- 172.21.15.118:0/2252301243 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc30403f070 con 0x7fc318107930 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.172+0000 7fc315ffb640 1 -- 172.21.15.118:0/2252301243 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc304004cf0 con 0x7fc318107930 2024-09-21T12:08:02.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.172+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc318075200 con 0x7fc318107930 2024-09-21T12:08:02.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.172+0000 7fc315ffb640 1 -- 172.21.15.118:0/2252301243 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc304035030 con 0x7fc318107930 2024-09-21T12:08:02.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.172+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3181a3e30 con 0x7fc318107930 2024-09-21T12:08:02.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.173+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc318103070 con 0x7fc318107930 2024-09-21T12:08:02.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.173+0000 7fc315ffb640 1 -- 172.21.15.118:0/2252301243 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc304042070 con 0x7fc318107930 2024-09-21T12:08:02.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.174+0000 7fc315ffb640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc30807af80 0x7fc30807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:02.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.174+0000 7fc315ffb640 1 -- 172.21.15.118:0/2252301243 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc3040beaf0 con 0x7fc318107930 2024-09-21T12:08:02.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.174+0000 7fc31cc8f640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc30807af80 0x7fc30807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:02.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.174+0000 7fc31cc8f640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc30807af80 0x7fc30807d440 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc30c006fd0 tx=0x7fc30c008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:02.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.179+0000 7fc315ffb640 1 -- 172.21.15.118:0/2252301243 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc30408a060 con 0x7fc318107930 2024-09-21T12:08:02.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.424+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc31802d7c0 con 0x7fc318107930 2024-09-21T12:08:02.426 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:02 smithi118 ceph-mon[111738]: pgmap v877: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:02.426 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:02 smithi118 ceph-mon[111738]: from='client.35404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:02.426 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:02 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1645036501' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:08:02.426 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:02 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/837306317' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:08:02.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.424+0000 7fc315ffb640 1 -- 172.21.15.118:0/2252301243 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fc30408ef10 con 0x7fc318107930 2024-09-21T12:08:02.427 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:08:02.427 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:08:02.427 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:08:02.427 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:08:02.427 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:08:02.427 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:08:02.427 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:08:02.427 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:08:02.428 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:08:02.429 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:08:02.429 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:08:02.429 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:08:02.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc30807af80 msgr2=0x7fc30807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:02.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc30807af80 0x7fc30807d440 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc30c006fd0 tx=0x7fc30c008040 comp rx=0 tx=0).stop 2024-09-21T12:08:02.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318107930 msgr2=0x7fc318074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:02.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318107930 0x7fc318074a30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc304031460 tx=0x7fc3040048f0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 shutdown_connections 2024-09-21T12:08:02.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc30807af80 0x7fc30807d440 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc318107930 0x7fc318074a30 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 --2- 172.21.15.118:0/2252301243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc318101930 0x7fc3180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:02.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 >> 172.21.15.118:0/2252301243 conn(0x7fc3180fd630 msgr2=0x7fc3180fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:02.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 shutdown_connections 2024-09-21T12:08:02.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:02.426+0000 7fc31eef3640 1 -- 172.21.15.118:0/2252301243 wait complete. 2024-09-21T12:08:02.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:02 smithi149 ceph-mon[79770]: pgmap v877: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:02.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:02 smithi149 ceph-mon[79770]: from='client.35404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:02.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:02 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1645036501' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:08:02.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:02 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/837306317' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:08:03.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:03 smithi118 ceph-mon[111738]: from='client.35416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:03.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:03 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2252301243' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:08:03.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:03 smithi149 ceph-mon[79770]: from='client.35416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:03.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:03 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2252301243' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:08:04.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:04 smithi118 ceph-mon[111738]: pgmap v878: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:04.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:04 smithi149 ceph-mon[79770]: pgmap v878: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:08:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:08:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:06 smithi118 ceph-mon[111738]: pgmap v879: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:06.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:06 smithi149 ceph-mon[79770]: pgmap v879: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:08.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:08 smithi118 ceph-mon[111738]: pgmap v880: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:08.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:08 smithi149 ceph-mon[79770]: pgmap v880: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:10.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:10 smithi118 ceph-mon[111738]: pgmap v881: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:10.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:10 smithi149 ceph-mon[79770]: pgmap v881: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:12.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:12 smithi118 ceph-mon[111738]: pgmap v882: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:12.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:12 smithi149 ceph-mon[79770]: pgmap v882: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:14.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:14 smithi118 ceph-mon[111738]: pgmap v883: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:14 smithi149 ceph-mon[79770]: pgmap v883: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:16 smithi118 ceph-mon[111738]: pgmap v884: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:16 smithi149 ceph-mon[79770]: pgmap v884: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:18.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:18 smithi118 ceph-mon[111738]: pgmap v885: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:18 smithi149 ceph-mon[79770]: pgmap v885: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:20 smithi118 ceph-mon[111738]: pgmap v886: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:08:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:20 smithi149 ceph-mon[79770]: pgmap v886: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:08:22.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:22 smithi118 ceph-mon[111738]: pgmap v887: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:22.600 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:22 smithi149 ceph-mon[79770]: pgmap v887: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:24.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:24 smithi118 ceph-mon[111738]: pgmap v888: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:24 smithi149 ceph-mon[79770]: pgmap v888: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:26 smithi118 ceph-mon[111738]: pgmap v889: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:26 smithi149 ceph-mon[79770]: pgmap v889: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:28.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:28 smithi118 ceph-mon[111738]: pgmap v890: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:28 smithi149 ceph-mon[79770]: pgmap v890: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:30.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:30 smithi118 ceph-mon[111738]: pgmap v891: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:30.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:30 smithi149 ceph-mon[79770]: pgmap v891: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:32.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.520+0000 7f42d81e3640 1 -- 172.21.15.118:0/2148385223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 msgr2=0x7f42d0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:32.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.520+0000 7f42d81e3640 1 --2- 172.21.15.118:0/2148385223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 0x7f42d0107d10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009c20 tx=0x7f42c002a970 comp rx=0 tx=0).stop 2024-09-21T12:08:32.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.520+0000 7f42d81e3640 1 -- 172.21.15.118:0/2148385223 shutdown_connections 2024-09-21T12:08:32.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.520+0000 7f42d81e3640 1 --2- 172.21.15.118:0/2148385223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0101930 0x7f42d0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.520+0000 7f42d81e3640 1 --2- 172.21.15.118:0/2148385223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 0x7f42d0107d10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.520+0000 7f42d81e3640 1 -- 172.21.15.118:0/2148385223 >> 172.21.15.118:0/2148385223 conn(0x7f42d00fd630 msgr2=0x7f42d00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:32.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.520+0000 7f42d81e3640 1 -- 172.21.15.118:0/2148385223 shutdown_connections 2024-09-21T12:08:32.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.520+0000 7f42d81e3640 1 -- 172.21.15.118:0/2148385223 wait complete. 2024-09-21T12:08:32.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.520+0000 7f42d81e3640 1 Processor -- start 2024-09-21T12:08:32.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d81e3640 1 -- start start 2024-09-21T12:08:32.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d81e3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0101930 0x7f42d019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:32.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d81e3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 0x7f42d019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:32.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d81e3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f42d010ede0 con 0x7f42d0107930 2024-09-21T12:08:32.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d81e3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f42d010ec60 con 0x7f42d0101930 2024-09-21T12:08:32.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d577e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 0x7f42d019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:32.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d577e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 0x7f42d019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54164/0 (socket says 172.21.15.118:54164) 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d577e640 1 -- 172.21.15.118:0/766968081 learned_addr learned my addr 172.21.15.118:0/766968081 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d5f7f640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0101930 0x7f42d019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d577e640 1 -- 172.21.15.118:0/766968081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0101930 msgr2=0x7f42d019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d577e640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0101930 0x7f42d019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d577e640 1 -- 172.21.15.118:0/766968081 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d0197810 con 0x7f42d0107930 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d5f7f640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0101930 0x7f42d019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.521+0000 7f42d577e640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 0x7f42d019dbd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f42c400d8d0 tx=0x7f42c400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.522+0000 7f42ceffd640 1 -- 172.21.15.118:0/766968081 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42c4017070 con 0x7f42d0107930 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.522+0000 7f42ceffd640 1 -- 172.21.15.118:0/766968081 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42c4010460 con 0x7f42d0107930 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.522+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d0197b00 con 0x7f42d0107930 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.522+0000 7f42ceffd640 1 -- 172.21.15.118:0/766968081 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42c400f5f0 con 0x7f42d0107930 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.522+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d0198090 con 0x7f42d0107930 2024-09-21T12:08:32.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.523+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d0103070 con 0x7f42d0107930 2024-09-21T12:08:32.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.523+0000 7f42ceffd640 1 -- 172.21.15.118:0/766968081 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f42c4009a30 con 0x7f42d0107930 2024-09-21T12:08:32.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.524+0000 7f42ceffd640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b807af30 0x7f42b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:32.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.524+0000 7f42ceffd640 1 -- 172.21.15.118:0/766968081 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f42c409df90 con 0x7f42d0107930 2024-09-21T12:08:32.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.524+0000 7f42d5f7f640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b807af30 0x7f42b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:32.528 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:32 smithi118 ceph-mon[111738]: pgmap v892: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:32.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.525+0000 7f42d5f7f640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b807af30 0x7f42b807d3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f42c0005e30 tx=0x7f42c0005da0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:32.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.528+0000 7f42ceffd640 1 -- 172.21.15.118:0/766968081 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42c40694e0 con 0x7f42d0107930 2024-09-21T12:08:32.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:32 smithi149 ceph-mon[79770]: pgmap v892: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:32.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.723+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f42d0198340 con 0x7f42b807af30 2024-09-21T12:08:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.724+0000 7f42ceffd640 1 -- 172.21.15.118:0/766968081 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f42d0198340 con 0x7f42b807af30 2024-09-21T12:08:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.726+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b807af30 msgr2=0x7f42b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.726+0000 7f42d81e3640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b807af30 0x7f42b807d3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f42c0005e30 tx=0x7f42c0005da0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.727+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 msgr2=0x7f42d019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.727+0000 7f42d81e3640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 0x7f42d019dbd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f42c400d8d0 tx=0x7f42c400dd90 comp rx=0 tx=0).stop 2024-09-21T12:08:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.727+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 shutdown_connections 2024-09-21T12:08:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.727+0000 7f42d81e3640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42b807af30 0x7f42b807d3f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.727+0000 7f42d81e3640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42d0107930 0x7f42d019dbd0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.727+0000 7f42d81e3640 1 --2- 172.21.15.118:0/766968081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0101930 0x7f42d019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.727+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 >> 172.21.15.118:0/766968081 conn(0x7f42d00fd630 msgr2=0x7f42d00fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:32.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.727+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 shutdown_connections 2024-09-21T12:08:32.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.727+0000 7f42d81e3640 1 -- 172.21.15.118:0/766968081 wait complete. 2024-09-21T12:08:32.738 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:08:32.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.809+0000 7f42b921d640 1 -- 172.21.15.118:0/1327358319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4107930 msgr2=0x7f42b4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:32.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.809+0000 7f42b921d640 1 --2- 172.21.15.118:0/1327358319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4107930 0x7f42b4107d10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f429c009880 tx=0x7f429c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.809+0000 7f42b921d640 1 -- 172.21.15.118:0/1327358319 shutdown_connections 2024-09-21T12:08:32.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.809+0000 7f42b921d640 1 --2- 172.21.15.118:0/1327358319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42b4101930 0x7f42b4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.809+0000 7f42b921d640 1 --2- 172.21.15.118:0/1327358319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4107930 0x7f42b4107d10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.809+0000 7f42b921d640 1 -- 172.21.15.118:0/1327358319 >> 172.21.15.118:0/1327358319 conn(0x7f42b40fd630 msgr2=0x7f42b40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:32.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.809+0000 7f42b921d640 1 -- 172.21.15.118:0/1327358319 shutdown_connections 2024-09-21T12:08:32.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.809+0000 7f42b921d640 1 -- 172.21.15.118:0/1327358319 wait complete. 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b921d640 1 Processor -- start 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b921d640 1 -- start start 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b921d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4101930 0x7f42b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b921d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42b4107930 0x7f42b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b921d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f42b410ee00 con 0x7f42b4101930 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b921d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f42b410ec80 con 0x7f42b4107930 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b2d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4101930 0x7f42b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b2d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4101930 0x7f42b40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54182/0 (socket says 172.21.15.118:54182) 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b2d9d640 1 -- 172.21.15.118:0/1016583344 learned_addr learned my addr 172.21.15.118:0/1016583344 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.810+0000 7f42b259c640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42b4107930 0x7f42b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.811+0000 7f42b2d9d640 1 -- 172.21.15.118:0/1016583344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42b4107930 msgr2=0x7f42b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.811+0000 7f42b2d9d640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42b4107930 0x7f42b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:32.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.811+0000 7f42b2d9d640 1 -- 172.21.15.118:0/1016583344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b4074f70 con 0x7f42b4101930 2024-09-21T12:08:32.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.811+0000 7f42b2d9d640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4101930 0x7f42b40744f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f429c031460 tx=0x7f429c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:32.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.811+0000 7f42abfff640 1 -- 172.21.15.118:0/1016583344 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f429c03f070 con 0x7f42b4101930 2024-09-21T12:08:32.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.811+0000 7f42abfff640 1 -- 172.21.15.118:0/1016583344 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f429c0035f0 con 0x7f42b4101930 2024-09-21T12:08:32.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.811+0000 7f42abfff640 1 -- 172.21.15.118:0/1016583344 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f429c035030 con 0x7f42b4101930 2024-09-21T12:08:32.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.811+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b4075200 con 0x7f42b4101930 2024-09-21T12:08:32.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.811+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b41a3db0 con 0x7f42b4101930 2024-09-21T12:08:32.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.812+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b4103070 con 0x7f42b4101930 2024-09-21T12:08:32.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.813+0000 7f42abfff640 1 -- 172.21.15.118:0/1016583344 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f429c042070 con 0x7f42b4101930 2024-09-21T12:08:32.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.814+0000 7f42abfff640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42a007af30 0x7f42a007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:32.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.814+0000 7f42b259c640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42a007af30 0x7f42a007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:32.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.814+0000 7f42abfff640 1 -- 172.21.15.118:0/1016583344 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f429c0bea20 con 0x7f42b4101930 2024-09-21T12:08:32.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.814+0000 7f42b259c640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42a007af30 0x7f42a007d3f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f42b4075f80 tx=0x7f42a400b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:32.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:32.818+0000 7f42abfff640 1 -- 172.21.15.118:0/1016583344 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f429c089f70 con 0x7f42b4101930 2024-09-21T12:08:33.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.013+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f42b4062630 con 0x7f42a007af30 2024-09-21T12:08:33.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.015+0000 7f42abfff640 1 -- 172.21.15.118:0/1016583344 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f42b4062630 con 0x7f42a007af30 2024-09-21T12:08:33.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42a007af30 msgr2=0x7f42a007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42a007af30 0x7f42a007d3f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f42b4075f80 tx=0x7f42a400b390 comp rx=0 tx=0).stop 2024-09-21T12:08:33.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4101930 msgr2=0x7f42b40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4101930 0x7f42b40744f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f429c031460 tx=0x7f429c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 shutdown_connections 2024-09-21T12:08:33.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42b4107930 0x7f42b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f42a007af30 0x7f42a007d3f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 --2- 172.21.15.118:0/1016583344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4101930 0x7f42b40744f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 >> 172.21.15.118:0/1016583344 conn(0x7f42b40fd630 msgr2=0x7f42b40fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:33.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 shutdown_connections 2024-09-21T12:08:33.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.017+0000 7f42b921d640 1 -- 172.21.15.118:0/1016583344 wait complete. 2024-09-21T12:08:33.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.099+0000 7f9cdff8b640 1 -- 172.21.15.118:0/2259288054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074e30 msgr2=0x7f9cd810dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.099+0000 7f9cdff8b640 1 --2- 172.21.15.118:0/2259288054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074e30 0x7f9cd810dcb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009880 tx=0x7f9cc802a530 comp rx=0 tx=0).stop 2024-09-21T12:08:33.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.099+0000 7f9cdff8b640 1 -- 172.21.15.118:0/2259288054 shutdown_connections 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.099+0000 7f9cdff8b640 1 --2- 172.21.15.118:0/2259288054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074e30 0x7f9cd810dcb0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.099+0000 7f9cdff8b640 1 --2- 172.21.15.118:0/2259288054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8074510 0x7f9cd80748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.099+0000 7f9cdff8b640 1 -- 172.21.15.118:0/2259288054 >> 172.21.15.118:0/2259288054 conn(0x7f9cd80fd630 msgr2=0x7f9cd80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.100+0000 7f9cdff8b640 1 -- 172.21.15.118:0/2259288054 shutdown_connections 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.100+0000 7f9cdff8b640 1 -- 172.21.15.118:0/2259288054 wait complete. 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.100+0000 7f9cdff8b640 1 Processor -- start 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.100+0000 7f9cdff8b640 1 -- start start 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.100+0000 7f9cdff8b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074510 0x7f9cd819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.100+0000 7f9cdff8b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8074e30 0x7f9cd819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.100+0000 7f9cdff8b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8111010 con 0x7f9cd8074510 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.100+0000 7f9cdff8b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8110e90 con 0x7f9cd8074e30 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cddd27640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074510 0x7f9cd819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cddd27640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074510 0x7f9cd819f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54202/0 (socket says 172.21.15.118:54202) 2024-09-21T12:08:33.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cddd27640 1 -- 172.21.15.118:0/4191111422 learned_addr learned my addr 172.21.15.118:0/4191111422 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cdd526640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8074e30 0x7f9cd819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cddd27640 1 -- 172.21.15.118:0/4191111422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8074e30 msgr2=0x7f9cd819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cddd27640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8074e30 0x7f9cd819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cddd27640 1 -- 172.21.15.118:0/4191111422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd8199a00 con 0x7f9cd8074510 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cddd27640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074510 0x7f9cd819f840 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400d6f0 tx=0x7f9cd400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cceffd640 1 -- 172.21.15.118:0/4191111422 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cd4017070 con 0x7f9cd8074510 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd8199cf0 con 0x7f9cd8074510 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cceffd640 1 -- 172.21.15.118:0/4191111422 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9cd400de00 con 0x7f9cd8074510 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cceffd640 1 -- 172.21.15.118:0/4191111422 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cd4004bb0 con 0x7f9cd8074510 2024-09-21T12:08:33.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.101+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd819a250 con 0x7f9cd8074510 2024-09-21T12:08:33.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.102+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd8075c50 con 0x7f9cd8074510 2024-09-21T12:08:33.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.103+0000 7f9cceffd640 1 -- 172.21.15.118:0/4191111422 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9cd4004e60 con 0x7f9cd8074510 2024-09-21T12:08:33.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.103+0000 7f9cceffd640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9cc407af30 0x7f9cc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:33.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.104+0000 7f9cceffd640 1 -- 172.21.15.118:0/4191111422 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9cd409dd00 con 0x7f9cd8074510 2024-09-21T12:08:33.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.104+0000 7f9cdd526640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9cc407af30 0x7f9cc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:33.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.104+0000 7f9cdd526640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9cc407af30 0x7f9cc407d3f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9cd819b1f0 tx=0x7f9cc8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:33.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.108+0000 7f9cceffd640 1 -- 172.21.15.118:0/4191111422 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cd40a1030 con 0x7f9cd8074510 2024-09-21T12:08:33.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.296+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9cd819af30 con 0x7f9cc407af30 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.305+0000 7f9cceffd640 1 -- 172.21.15.118:0/4191111422 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f9cd819af30 con 0x7f9cc407af30 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (26m) 5m ago 37m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (29m) 5m ago 37m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (28m) 5m ago 36m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (24m) 5m ago 37m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (24m) 5m ago 36m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (26m) 5m ago 37m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (20m) 5m ago 32m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (20m) 5m ago 32m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:08:33.308 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (5m) 5m ago 31m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (20m) 5m ago 32m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (28m) 5m ago 38m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (27m) 5m ago 36m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (25m) 5m ago 38m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (24m) 5m ago 36m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (27m) 5m ago 37m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (27m) 5m ago 36m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (24m) 5m ago 35m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (23m) 5m ago 34m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (22m) 5m ago 34m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (22m) 5m ago 34m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (21m) 5m ago 33m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (21m) 5m ago 33m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:08:33.309 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (26m) 5m ago 37m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:08:33.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9cc407af30 msgr2=0x7f9cc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9cc407af30 0x7f9cc407d3f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9cd819b1f0 tx=0x7f9cc8031400 comp rx=0 tx=0).stop 2024-09-21T12:08:33.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074510 msgr2=0x7f9cd819f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074510 0x7f9cd819f840 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400d6f0 tx=0x7f9cd400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 shutdown_connections 2024-09-21T12:08:33.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd8074e30 0x7f9cd819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9cc407af30 0x7f9cc407d3f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 --2- 172.21.15.118:0/4191111422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cd8074510 0x7f9cd819f840 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 >> 172.21.15.118:0/4191111422 conn(0x7f9cd80fd630 msgr2=0x7f9cd810b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:33.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 shutdown_connections 2024-09-21T12:08:33.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.308+0000 7f9cdff8b640 1 -- 172.21.15.118:0/4191111422 wait complete. 2024-09-21T12:08:33.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 -- 172.21.15.118:0/289198585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 msgr2=0x7f9d18106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 --2- 172.21.15.118:0/289198585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 0x7f9d18106bc0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009880 tx=0x7f9d0002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 -- 172.21.15.118:0/289198585 shutdown_connections 2024-09-21T12:08:33.389 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:33 smithi118 ceph-mon[111738]: from='client.35424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 --2- 172.21.15.118:0/289198585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d181007e0 0x7f9d18100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 --2- 172.21.15.118:0/289198585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 0x7f9d18106bc0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 -- 172.21.15.118:0/289198585 >> 172.21.15.118:0/289198585 conn(0x7f9d180fc4c0 msgr2=0x7f9d180fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 -- 172.21.15.118:0/289198585 shutdown_connections 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 -- 172.21.15.118:0/289198585 wait complete. 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 Processor -- start 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.387+0000 7f9d1f21f640 1 -- start start 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d1f21f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d181007e0 0x7f9d1819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d1f21f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 0x7f9d1819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:33.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d1f21f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1810dcb0 con 0x7f9d181067e0 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d1f21f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1810db30 con 0x7f9d181007e0 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d17fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 0x7f9d1819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d17fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 0x7f9d1819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54218/0 (socket says 172.21.15.118:54218) 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d17fff640 1 -- 172.21.15.118:0/2522012351 learned_addr learned my addr 172.21.15.118:0/2522012351 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d1cfbb640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d181007e0 0x7f9d1819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d17fff640 1 -- 172.21.15.118:0/2522012351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d181007e0 msgr2=0x7f9d1819f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d17fff640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d181007e0 0x7f9d1819f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d17fff640 1 -- 172.21.15.118:0/2522012351 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d18199a20 con 0x7f9d181067e0 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d1cfbb640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d181007e0 0x7f9d1819f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d17fff640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 0x7f9d1819fda0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800d6f0 tx=0x7f9d0800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d15ffb640 1 -- 172.21.15.118:0/2522012351 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d08017070 con 0x7f9d181067e0 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d18199d10 con 0x7f9d181067e0 2024-09-21T12:08:33.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d15ffb640 1 -- 172.21.15.118:0/2522012351 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d0800de00 con 0x7f9d181067e0 2024-09-21T12:08:33.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.388+0000 7f9d15ffb640 1 -- 172.21.15.118:0/2522012351 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d08004bb0 con 0x7f9d181067e0 2024-09-21T12:08:33.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.389+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1819a2a0 con 0x7f9d181067e0 2024-09-21T12:08:33.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.390+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d18101f20 con 0x7f9d181067e0 2024-09-21T12:08:33.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.390+0000 7f9d15ffb640 1 -- 172.21.15.118:0/2522012351 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9d08009a30 con 0x7f9d181067e0 2024-09-21T12:08:33.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.391+0000 7f9d15ffb640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d0407af80 0x7f9d0407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:33.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.391+0000 7f9d15ffb640 1 -- 172.21.15.118:0/2522012351 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9d0809dc20 con 0x7f9d181067e0 2024-09-21T12:08:33.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.391+0000 7f9d1cfbb640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d0407af80 0x7f9d0407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:33.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.391+0000 7f9d1cfbb640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d0407af80 0x7f9d0407d440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9d00006010 tx=0x7f9d00004140 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:33.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.395+0000 7f9d15ffb640 1 -- 172.21.15.118:0/2522012351 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d080691f0 con 0x7f9d181067e0 2024-09-21T12:08:33.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.643+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9d1819afb0 con 0x7f9d181067e0 2024-09-21T12:08:33.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.643+0000 7f9d15ffb640 1 -- 172.21.15.118:0/2522012351 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f9d0806e0a0 con 0x7f9d181067e0 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:08:33.646 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:08:33.647 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:08:33.647 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:08:33.647 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:08:33.647 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:08:33.647 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:08:33.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d0407af80 msgr2=0x7f9d0407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d0407af80 0x7f9d0407d440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9d00006010 tx=0x7f9d00004140 comp rx=0 tx=0).stop 2024-09-21T12:08:33.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 msgr2=0x7f9d1819fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 0x7f9d1819fda0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800d6f0 tx=0x7f9d0800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 shutdown_connections 2024-09-21T12:08:33.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9d0407af80 0x7f9d0407d440 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d181067e0 0x7f9d1819fda0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 --2- 172.21.15.118:0/2522012351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d181007e0 0x7f9d1819f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 >> 172.21.15.118:0/2522012351 conn(0x7f9d180fc4c0 msgr2=0x7f9d180fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:33.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 shutdown_connections 2024-09-21T12:08:33.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.646+0000 7f9d1f21f640 1 -- 172.21.15.118:0/2522012351 wait complete. 2024-09-21T12:08:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:33 smithi149 ceph-mon[79770]: from='client.35424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:33.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.727+0000 7f3a4b20d640 1 -- 172.21.15.118:0/1468923531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 msgr2=0x7f3a44106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.727+0000 7f3a4b20d640 1 --2- 172.21.15.118:0/1468923531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 0x7f3a44106c00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009880 tx=0x7f3a3802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.727+0000 7f3a4b20d640 1 -- 172.21.15.118:0/1468923531 shutdown_connections 2024-09-21T12:08:33.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.727+0000 7f3a4b20d640 1 --2- 172.21.15.118:0/1468923531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a44100820 0x7f3a44100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.727+0000 7f3a4b20d640 1 --2- 172.21.15.118:0/1468923531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 0x7f3a44106c00 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.727+0000 7f3a4b20d640 1 -- 172.21.15.118:0/1468923531 >> 172.21.15.118:0/1468923531 conn(0x7f3a440fc520 msgr2=0x7f3a440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:33.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.727+0000 7f3a4b20d640 1 -- 172.21.15.118:0/1468923531 shutdown_connections 2024-09-21T12:08:33.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.727+0000 7f3a4b20d640 1 -- 172.21.15.118:0/1468923531 wait complete. 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a4b20d640 1 Processor -- start 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a4b20d640 1 -- start start 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a4b20d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a44100820 0x7f3a44198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a4b20d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 0x7f3a44198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a4b20d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4410dcf0 con 0x7f3a44106820 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a4b20d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4410db70 con 0x7f3a44100820 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a43fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 0x7f3a44198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a43fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 0x7f3a44198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54226/0 (socket says 172.21.15.118:54226) 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a43fff640 1 -- 172.21.15.118:0/2454776250 learned_addr learned my addr 172.21.15.118:0/2454776250 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a48fa9640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a44100820 0x7f3a44198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a43fff640 1 -- 172.21.15.118:0/2454776250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a44100820 msgr2=0x7f3a44198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a43fff640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a44100820 0x7f3a44198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.728+0000 7f3a43fff640 1 -- 172.21.15.118:0/2454776250 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a44199390 con 0x7f3a44106820 2024-09-21T12:08:33.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.729+0000 7f3a43fff640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 0x7f3a44198d40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000d6f0 tx=0x7f3a3000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:33.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.729+0000 7f3a41ffb640 1 -- 172.21.15.118:0/2454776250 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a30017070 con 0x7f3a44106820 2024-09-21T12:08:33.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.729+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a441a1870 con 0x7f3a44106820 2024-09-21T12:08:33.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.729+0000 7f3a41ffb640 1 -- 172.21.15.118:0/2454776250 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a3000de00 con 0x7f3a44106820 2024-09-21T12:08:33.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.729+0000 7f3a41ffb640 1 -- 172.21.15.118:0/2454776250 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a30004bb0 con 0x7f3a44106820 2024-09-21T12:08:33.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.729+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a441a1c70 con 0x7f3a44106820 2024-09-21T12:08:33.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.730+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a44101f60 con 0x7f3a44106820 2024-09-21T12:08:33.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.730+0000 7f3a41ffb640 1 -- 172.21.15.118:0/2454776250 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3a30004e60 con 0x7f3a44106820 2024-09-21T12:08:33.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.731+0000 7f3a41ffb640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a3407af30 0x7f3a3407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:33.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.731+0000 7f3a48fa9640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a3407af30 0x7f3a3407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:33.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.731+0000 7f3a41ffb640 1 -- 172.21.15.118:0/2454776250 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3a3009dc50 con 0x7f3a44106820 2024-09-21T12:08:33.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.732+0000 7f3a48fa9640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a3407af30 0x7f3a3407d3f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3a380096c0 tx=0x7f3a38031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:33.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.735+0000 7f3a41ffb640 1 -- 172.21.15.118:0/2454776250 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a300691a0 con 0x7f3a44106820 2024-09-21T12:08:33.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.952+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3a44108d90 con 0x7f3a44106820 2024-09-21T12:08:33.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.953+0000 7f3a41ffb640 1 -- 172.21.15.118:0/2454776250 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f3a3006e050 con 0x7f3a44106820 2024-09-21T12:08:33.955 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:08:33.956 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:08:33.957 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:08:33.958 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:08:33.959 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:08:33.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a3407af30 msgr2=0x7f3a3407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a3407af30 0x7f3a3407d3f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3a380096c0 tx=0x7f3a38031400 comp rx=0 tx=0).stop 2024-09-21T12:08:33.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 msgr2=0x7f3a44198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:33.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 0x7f3a44198d40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000d6f0 tx=0x7f3a3000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 shutdown_connections 2024-09-21T12:08:33.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3a3407af30 0x7f3a3407d3f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a44106820 0x7f3a44198d40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 --2- 172.21.15.118:0/2454776250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a44100820 0x7f3a44198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:33.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 >> 172.21.15.118:0/2454776250 conn(0x7f3a440fc520 msgr2=0x7f3a440fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:33.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 shutdown_connections 2024-09-21T12:08:33.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:33.955+0000 7f3a4b20d640 1 -- 172.21.15.118:0/2454776250 wait complete. 2024-09-21T12:08:34.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.037+0000 7f262e462640 1 -- 172.21.15.118:0/1109043517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 msgr2=0x7f2628110f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.037+0000 7f262e462640 1 --2- 172.21.15.118:0/1109043517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 0x7f2628110f60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2610009880 tx=0x7f261002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 -- 172.21.15.118:0/1109043517 shutdown_connections 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 --2- 172.21.15.118:0/1109043517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 0x7f2628110f60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 --2- 172.21.15.118:0/1109043517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262810c560 0x7f262810c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 -- 172.21.15.118:0/1109043517 >> 172.21.15.118:0/1109043517 conn(0x7f262806c700 msgr2=0x7f262806cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 -- 172.21.15.118:0/1109043517 shutdown_connections 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 -- 172.21.15.118:0/1109043517 wait complete. 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 Processor -- start 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 -- start start 2024-09-21T12:08:34.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262810c560 0x7f26281a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 0x7f26281a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f26281197e0 con 0x7f262810cf10 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.038+0000 7f262e462640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2628119660 con 0x7f262810c560 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f261ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 0x7f26281a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f261ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 0x7f26281a28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54248/0 (socket says 172.21.15.118:54248) 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f261ffff640 1 -- 172.21.15.118:0/3606568375 learned_addr learned my addr 172.21.15.118:0/3606568375 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f2627fff640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262810c560 0x7f26281a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f261ffff640 1 -- 172.21.15.118:0/3606568375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262810c560 msgr2=0x7f26281a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f261ffff640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262810c560 0x7f26281a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f261ffff640 1 -- 172.21.15.118:0/3606568375 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26281a6c80 con 0x7f262810cf10 2024-09-21T12:08:34.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f2627fff640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262810c560 0x7f26281a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:08:34.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f261ffff640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 0x7f26281a28f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f261002a9c0 tx=0x7f2610032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:34.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f2625ffb640 1 -- 172.21.15.118:0/3606568375 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f261003f030 con 0x7f262810cf10 2024-09-21T12:08:34.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26281a6f10 con 0x7f262810cf10 2024-09-21T12:08:34.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f2625ffb640 1 -- 172.21.15.118:0/3606568375 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2610005320 con 0x7f262810cf10 2024-09-21T12:08:34.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f2625ffb640 1 -- 172.21.15.118:0/3606568375 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2610035070 con 0x7f262810cf10 2024-09-21T12:08:34.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.039+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26281a7440 con 0x7f262810cf10 2024-09-21T12:08:34.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.040+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f262810da40 con 0x7f262810cf10 2024-09-21T12:08:34.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.041+0000 7f2625ffb640 1 -- 172.21.15.118:0/3606568375 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2610042030 con 0x7f262810cf10 2024-09-21T12:08:34.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.042+0000 7f2625ffb640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261407af30 0x7f261407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:34.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.042+0000 7f2627fff640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261407af30 0x7f261407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:34.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.042+0000 7f2625ffb640 1 -- 172.21.15.118:0/3606568375 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2610040070 con 0x7f262810cf10 2024-09-21T12:08:34.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.042+0000 7f2627fff640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261407af30 0x7f261407d3f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2618009b40 tx=0x7f2618005e50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:34.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.046+0000 7f2625ffb640 1 -- 172.21.15.118:0/3606568375 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2610089f60 con 0x7f262810cf10 2024-09-21T12:08:34.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.238+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f26281a3710 con 0x7f261407af30 2024-09-21T12:08:34.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.240+0000 7f2625ffb640 1 -- 172.21.15.118:0/3606568375 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f26281a3710 con 0x7f261407af30 2024-09-21T12:08:34.242 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:08:34.242 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:08:34.242 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:08:34.242 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:08:34.242 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:08:34.242 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:08:34.243 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:08:34.243 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:08:34.243 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:08:34.243 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:08:34.243 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:08:34.243 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:08:34.243 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:08:34.244 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:08:34.244 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261407af30 msgr2=0x7f261407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261407af30 0x7f261407d3f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2618009b40 tx=0x7f2618005e50 comp rx=0 tx=0).stop 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 msgr2=0x7f26281a28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 0x7f26281a28f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f261002a9c0 tx=0x7f2610032c80 comp rx=0 tx=0).stop 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 shutdown_connections 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261407af30 0x7f261407d3f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262810cf10 0x7f26281a28f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 --2- 172.21.15.118:0/3606568375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262810c560 0x7f26281a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 >> 172.21.15.118:0/3606568375 conn(0x7f262806c700 msgr2=0x7f262810a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 shutdown_connections 2024-09-21T12:08:34.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.242+0000 7f262e462640 1 -- 172.21.15.118:0/3606568375 wait complete. 2024-09-21T12:08:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 -- 172.21.15.118:0/3464083502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1067e0 msgr2=0x7f316c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 --2- 172.21.15.118:0/3464083502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1067e0 0x7f316c106bc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f315c009880 tx=0x7f315c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 -- 172.21.15.118:0/3464083502 shutdown_connections 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 --2- 172.21.15.118:0/3464083502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c1007e0 0x7f316c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 --2- 172.21.15.118:0/3464083502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1067e0 0x7f316c106bc0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 -- 172.21.15.118:0/3464083502 >> 172.21.15.118:0/3464083502 conn(0x7f316c0fc4c0 msgr2=0x7f316c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 -- 172.21.15.118:0/3464083502 shutdown_connections 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 -- 172.21.15.118:0/3464083502 wait complete. 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 Processor -- start 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 -- start start 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1007e0 0x7f316c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.324+0000 7f3171e36640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c1067e0 0x7f316c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f3171e36640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f316c10dc90 con 0x7f316c1007e0 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f3171e36640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f316c10db10 con 0x7f316c1067e0 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f316b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1007e0 0x7f316c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f316b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1007e0 0x7f316c1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54274/0 (socket says 172.21.15.118:54274) 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f316b7fe640 1 -- 172.21.15.118:0/1228242892 learned_addr learned my addr 172.21.15.118:0/1228242892 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f3163fff640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c1067e0 0x7f316c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f316b7fe640 1 -- 172.21.15.118:0/1228242892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c1067e0 msgr2=0x7f316c198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f316b7fe640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c1067e0 0x7f316c198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f316b7fe640 1 -- 172.21.15.118:0/1228242892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c199300 con 0x7f316c1007e0 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f3163fff640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c1067e0 0x7f316c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f316b7fe640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1007e0 0x7f316c1987c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f315c031460 tx=0x7f315c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f31697fa640 1 -- 172.21.15.118:0/1228242892 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f315c03f070 con 0x7f316c1007e0 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316c199590 con 0x7f316c1007e0 2024-09-21T12:08:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f31697fa640 1 -- 172.21.15.118:0/1228242892 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f315c0035f0 con 0x7f316c1007e0 2024-09-21T12:08:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f31697fa640 1 -- 172.21.15.118:0/1228242892 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f315c035030 con 0x7f316c1007e0 2024-09-21T12:08:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.325+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316c1a1b40 con 0x7f316c1007e0 2024-09-21T12:08:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.326+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316c101f20 con 0x7f316c1007e0 2024-09-21T12:08:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.327+0000 7f31697fa640 1 -- 172.21.15.118:0/1228242892 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f315c042070 con 0x7f316c1007e0 2024-09-21T12:08:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.327+0000 7f31697fa640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f315807af30 0x7f315807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:08:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.327+0000 7f31697fa640 1 -- 172.21.15.118:0/1228242892 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f315c0bead0 con 0x7f316c1007e0 2024-09-21T12:08:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.328+0000 7f3163fff640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f315807af30 0x7f315807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:08:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.328+0000 7f3163fff640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f315807af30 0x7f315807d3f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f31540058c0 tx=0x7f3154005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:08:34.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.332+0000 7f31697fa640 1 -- 172.21.15.118:0/1228242892 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f315c08a020 con 0x7f316c1007e0 2024-09-21T12:08:34.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:34 smithi118 ceph-mon[111738]: pgmap v893: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:34.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:34 smithi118 ceph-mon[111738]: from='client.35428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:34.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:34 smithi118 ceph-mon[111738]: from='client.35432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:34.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:34 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2522012351' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:08:34.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:34 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2454776250' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:08:34.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.580+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f316c100c40 con 0x7f316c1007e0 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.581+0000 7f31697fa640 1 -- 172.21.15.118:0/1228242892 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f316c100c40 con 0x7f316c1007e0 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:08:34.583 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:08:34.584 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:08:34.585 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:08:34.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f315807af30 msgr2=0x7f315807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f315807af30 0x7f315807d3f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f31540058c0 tx=0x7f3154005850 comp rx=0 tx=0).stop 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1007e0 msgr2=0x7f316c1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1007e0 0x7f316c1987c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f315c031460 tx=0x7f315c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 shutdown_connections 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c1067e0 0x7f316c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f315807af30 0x7f315807d3f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 --2- 172.21.15.118:0/1228242892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f316c1007e0 0x7f316c1987c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 >> 172.21.15.118:0/1228242892 conn(0x7f316c0fc4c0 msgr2=0x7f316c0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 shutdown_connections 2024-09-21T12:08:34.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:08:34.583+0000 7f3171e36640 1 -- 172.21.15.118:0/1228242892 wait complete. 2024-09-21T12:08:34.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:34 smithi149 ceph-mon[79770]: pgmap v893: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:34.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:34 smithi149 ceph-mon[79770]: from='client.35428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:34.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:34 smithi149 ceph-mon[79770]: from='client.35432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:34.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:34 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2522012351' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:08:34.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:34 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2454776250' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:08:35.546 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:35 smithi118 ceph-mon[111738]: from='client.35444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:35.546 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:35 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1228242892' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:08:35.546 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:08:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:35 smithi149 ceph-mon[79770]: from='client.35444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:08:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:35 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1228242892' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:08:35.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:08:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:36 smithi118 ceph-mon[111738]: pgmap v894: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:36.665 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:36 smithi149 ceph-mon[79770]: pgmap v894: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:38.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:38 smithi118 ceph-mon[111738]: pgmap v895: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:38.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:38 smithi149 ceph-mon[79770]: pgmap v895: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:40.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:40 smithi118 ceph-mon[111738]: pgmap v896: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:40 smithi149 ceph-mon[79770]: pgmap v896: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:42.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:42 smithi118 ceph-mon[111738]: pgmap v897: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:42.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:42 smithi149 ceph-mon[79770]: pgmap v897: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:44.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:44 smithi118 ceph-mon[111738]: pgmap v898: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:44.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:44 smithi149 ceph-mon[79770]: pgmap v898: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:46.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:46 smithi118 ceph-mon[111738]: pgmap v899: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:46.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:46 smithi149 ceph-mon[79770]: pgmap v899: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:48 smithi118 ceph-mon[111738]: pgmap v900: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:48.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:48 smithi149 ceph-mon[79770]: pgmap v900: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:50 smithi118 ceph-mon[111738]: pgmap v901: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:08:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:50 smithi149 ceph-mon[79770]: pgmap v901: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:08:52.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:52 smithi118 ceph-mon[111738]: pgmap v902: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:52 smithi149 ceph-mon[79770]: pgmap v902: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:54.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:54 smithi118 ceph-mon[111738]: pgmap v903: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:54.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:54 smithi149 ceph-mon[79770]: pgmap v903: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:56 smithi118 ceph-mon[111738]: pgmap v904: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:56.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:56 smithi149 ceph-mon[79770]: pgmap v904: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:58.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:08:58 smithi149 ceph-mon[79770]: pgmap v905: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:08:58.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:08:58 smithi118 ceph-mon[111738]: pgmap v905: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:00 smithi149 ceph-mon[79770]: pgmap v906: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:00.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:00 smithi118 ceph-mon[111738]: pgmap v906: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:02.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:02 smithi149 ceph-mon[79770]: pgmap v907: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:02.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:02 smithi118 ceph-mon[111738]: pgmap v907: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:04.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.676+0000 7f3fe466b640 1 -- 172.21.15.118:0/1530709368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 msgr2=0x7f3fdc101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:04.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.676+0000 7f3fe466b640 1 --2- 172.21.15.118:0/1530709368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 0x7f3fdc101d90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009880 tx=0x7f3fcc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.679 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:04 smithi118 ceph-mon[111738]: pgmap v908: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:04.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.676+0000 7f3fe466b640 1 -- 172.21.15.118:0/1530709368 shutdown_connections 2024-09-21T12:09:04.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.676+0000 7f3fe466b640 1 --2- 172.21.15.118:0/1530709368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 0x7f3fdc101d90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.677+0000 7f3fe466b640 1 --2- 172.21.15.118:0/1530709368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fdc107930 0x7f3fdc107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.677+0000 7f3fe466b640 1 -- 172.21.15.118:0/1530709368 >> 172.21.15.118:0/1530709368 conn(0x7f3fdc0fd630 msgr2=0x7f3fdc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:04.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.677+0000 7f3fe466b640 1 -- 172.21.15.118:0/1530709368 shutdown_connections 2024-09-21T12:09:04.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.677+0000 7f3fe466b640 1 -- 172.21.15.118:0/1530709368 wait complete. 2024-09-21T12:09:04.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.677+0000 7f3fe466b640 1 Processor -- start 2024-09-21T12:09:04.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.677+0000 7f3fe466b640 1 -- start start 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe466b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 0x7f3fdc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe466b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fdc107930 0x7f3fdc19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe466b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc10ede0 con 0x7f3fdc101930 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe466b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc10ec60 con 0x7f3fdc107930 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe2407640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 0x7f3fdc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe2407640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 0x7f3fdc19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33598/0 (socket says 172.21.15.118:33598) 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe2407640 1 -- 172.21.15.118:0/3470593798 learned_addr learned my addr 172.21.15.118:0/3470593798 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe1c06640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fdc107930 0x7f3fdc19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe2407640 1 -- 172.21.15.118:0/3470593798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fdc107930 msgr2=0x7f3fdc19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe2407640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fdc107930 0x7f3fdc19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe2407640 1 -- 172.21.15.118:0/3470593798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc197850 con 0x7f3fdc101930 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.678+0000 7f3fe2407640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 0x7f3fdc19d6d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c8a0 tx=0x7f3fd800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:04.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.679+0000 7f3fd37fe640 1 -- 172.21.15.118:0/3470593798 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fd80079b0 con 0x7f3fdc101930 2024-09-21T12:09:04.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.679+0000 7f3fd37fe640 1 -- 172.21.15.118:0/3470593798 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fd8007b50 con 0x7f3fdc101930 2024-09-21T12:09:04.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.679+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc197b40 con 0x7f3fdc101930 2024-09-21T12:09:04.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.679+0000 7f3fd37fe640 1 -- 172.21.15.118:0/3470593798 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fd8018700 con 0x7f3fdc101930 2024-09-21T12:09:04.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.679+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc1980a0 con 0x7f3fdc101930 2024-09-21T12:09:04.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.680+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fdc103070 con 0x7f3fdc101930 2024-09-21T12:09:04.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.680+0000 7f3fd37fe640 1 -- 172.21.15.118:0/3470593798 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3fd8007d00 con 0x7f3fdc101930 2024-09-21T12:09:04.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.681+0000 7f3fd37fe640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fc807af80 0x7f3fc807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:04.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.681+0000 7f3fe1c06640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fc807af80 0x7f3fc807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:04.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.681+0000 7f3fd37fe640 1 -- 172.21.15.118:0/3470593798 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3fd809e300 con 0x7f3fdc101930 2024-09-21T12:09:04.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.682+0000 7f3fe1c06640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fc807af80 0x7f3fc807d440 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc198ba0 tx=0x7f3fcc031420 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:04.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.686+0000 7f3fd37fe640 1 -- 172.21.15.118:0/3470593798 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3fd8014030 con 0x7f3fdc101930 2024-09-21T12:09:04.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:04 smithi149 ceph-mon[79770]: pgmap v908: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:04.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.881+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3fdc1983b0 con 0x7f3fc807af80 2024-09-21T12:09:04.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.882+0000 7f3fd37fe640 1 -- 172.21.15.118:0/3470593798 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3fdc1983b0 con 0x7f3fc807af80 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.884+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fc807af80 msgr2=0x7f3fc807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.884+0000 7f3fe466b640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fc807af80 0x7f3fc807d440 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc198ba0 tx=0x7f3fcc031420 comp rx=0 tx=0).stop 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.884+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 msgr2=0x7f3fdc19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.884+0000 7f3fe466b640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 0x7f3fdc19d6d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c8a0 tx=0x7f3fd800cd60 comp rx=0 tx=0).stop 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.884+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 shutdown_connections 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.884+0000 7f3fe466b640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fdc107930 0x7f3fdc19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.884+0000 7f3fe466b640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fc807af80 0x7f3fc807d440 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.884+0000 7f3fe466b640 1 --2- 172.21.15.118:0/3470593798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc101930 0x7f3fdc19d6d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.884+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 >> 172.21.15.118:0/3470593798 conn(0x7f3fdc0fd630 msgr2=0x7f3fdc0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:04.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.885+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 shutdown_connections 2024-09-21T12:09:04.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.885+0000 7f3fe466b640 1 -- 172.21.15.118:0/3470593798 wait complete. 2024-09-21T12:09:04.896 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:09:04.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.967+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/4127439441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41067e0 msgr2=0x7f5aa4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:04.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.967+0000 7f5aa8bc5640 1 --2- 172.21.15.118:0/4127439441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41067e0 0x7f5aa4106bc0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009880 tx=0x7f5a9402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.967+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/4127439441 shutdown_connections 2024-09-21T12:09:04.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.967+0000 7f5aa8bc5640 1 --2- 172.21.15.118:0/4127439441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa41007e0 0x7f5aa4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.967+0000 7f5aa8bc5640 1 --2- 172.21.15.118:0/4127439441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41067e0 0x7f5aa4106bc0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.967+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/4127439441 >> 172.21.15.118:0/4127439441 conn(0x7f5aa40fc4c0 msgr2=0x7f5aa40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:04.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.967+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/4127439441 shutdown_connections 2024-09-21T12:09:04.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.968+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/4127439441 wait complete. 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.968+0000 7f5aa8bc5640 1 Processor -- start 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.968+0000 7f5aa8bc5640 1 -- start start 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa8bc5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41007e0 0x7f5aa41023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa8bc5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa41067e0 0x7f5aa41028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa8bc5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa410dcb0 con 0x7f5aa41007e0 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa8bc5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa410db30 con 0x7f5aa41067e0 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41007e0 0x7f5aa41023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41007e0 0x7f5aa41023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33606/0 (socket says 172.21.15.118:33606) 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa259c640 1 -- 172.21.15.118:0/1267077573 learned_addr learned my addr 172.21.15.118:0/1267077573 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa1d9b640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa41067e0 0x7f5aa41028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:04.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa259c640 1 -- 172.21.15.118:0/1267077573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa41067e0 msgr2=0x7f5aa41028f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:04.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa259c640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa41067e0 0x7f5aa41028f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:04.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa259c640 1 -- 172.21.15.118:0/1267077573 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa4102e30 con 0x7f5aa41007e0 2024-09-21T12:09:04.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.969+0000 7f5aa259c640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41007e0 0x7f5aa41023b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5a94031460 tx=0x7f5a940045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:04.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.970+0000 7f5a937fe640 1 -- 172.21.15.118:0/1267077573 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a9403f070 con 0x7f5aa41007e0 2024-09-21T12:09:04.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.970+0000 7f5a937fe640 1 -- 172.21.15.118:0/1267077573 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a940035f0 con 0x7f5aa41007e0 2024-09-21T12:09:04.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.970+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa41030c0 con 0x7f5aa41007e0 2024-09-21T12:09:04.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.970+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa41a3d50 con 0x7f5aa41007e0 2024-09-21T12:09:04.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.970+0000 7f5a937fe640 1 -- 172.21.15.118:0/1267077573 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a94035030 con 0x7f5aa41007e0 2024-09-21T12:09:04.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.971+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa4101f20 con 0x7f5aa41007e0 2024-09-21T12:09:04.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.971+0000 7f5a937fe640 1 -- 172.21.15.118:0/1267077573 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5a94042070 con 0x7f5aa41007e0 2024-09-21T12:09:04.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.972+0000 7f5a937fe640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a8c07af80 0x7f5a8c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:04.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.972+0000 7f5a937fe640 1 -- 172.21.15.118:0/1267077573 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5a940be9b0 con 0x7f5aa41007e0 2024-09-21T12:09:04.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.972+0000 7f5aa1d9b640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a8c07af80 0x7f5a8c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:04.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.973+0000 7f5aa1d9b640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a8c07af80 0x7f5a8c07d440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4103e40 tx=0x7f5a9800b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:04.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:04.976+0000 7f5a937fe640 1 -- 172.21.15.118:0/1267077573 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a94089ee0 con 0x7f5aa41007e0 2024-09-21T12:09:05.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.174+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5aa4069b30 con 0x7f5a8c07af80 2024-09-21T12:09:05.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.176+0000 7f5a937fe640 1 -- 172.21.15.118:0/1267077573 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5aa4069b30 con 0x7f5a8c07af80 2024-09-21T12:09:05.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a8c07af80 msgr2=0x7f5a8c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a8c07af80 0x7f5a8c07d440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4103e40 tx=0x7f5a9800b390 comp rx=0 tx=0).stop 2024-09-21T12:09:05.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41007e0 msgr2=0x7f5aa41023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41007e0 0x7f5aa41023b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5a94031460 tx=0x7f5a940045e0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 shutdown_connections 2024-09-21T12:09:05.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa41067e0 0x7f5aa41028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a8c07af80 0x7f5a8c07d440 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 --2- 172.21.15.118:0/1267077573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5aa41007e0 0x7f5aa41023b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 >> 172.21.15.118:0/1267077573 conn(0x7f5aa40fc4c0 msgr2=0x7f5aa41045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:05.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 shutdown_connections 2024-09-21T12:09:05.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.178+0000 7f5aa8bc5640 1 -- 172.21.15.118:0/1267077573 wait complete. 2024-09-21T12:09:05.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.259+0000 7f594e465640 1 -- 172.21.15.118:0/2053895342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 msgr2=0x7f5948106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.260+0000 7f594e465640 1 --2- 172.21.15.118:0/2053895342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 0x7f5948106bc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5938009880 tx=0x7f593802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.260+0000 7f594e465640 1 -- 172.21.15.118:0/2053895342 shutdown_connections 2024-09-21T12:09:05.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.260+0000 7f594e465640 1 --2- 172.21.15.118:0/2053895342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59481007e0 0x7f5948100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.260+0000 7f594e465640 1 --2- 172.21.15.118:0/2053895342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 0x7f5948106bc0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.260+0000 7f594e465640 1 -- 172.21.15.118:0/2053895342 >> 172.21.15.118:0/2053895342 conn(0x7f59480fc4c0 msgr2=0x7f59480fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:05.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.260+0000 7f594e465640 1 -- 172.21.15.118:0/2053895342 shutdown_connections 2024-09-21T12:09:05.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.260+0000 7f594e465640 1 -- 172.21.15.118:0/2053895342 wait complete. 2024-09-21T12:09:05.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.260+0000 7f594e465640 1 Processor -- start 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.260+0000 7f594e465640 1 -- start start 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f594e465640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59481007e0 0x7f5948198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f594e465640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 0x7f5948198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f594e465640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f594810dcb0 con 0x7f59481067e0 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f594e465640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f594810db30 con 0x7f59481007e0 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f59477fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 0x7f5948198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f59477fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 0x7f5948198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33632/0 (socket says 172.21.15.118:33632) 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f59477fe640 1 -- 172.21.15.118:0/2294185678 learned_addr learned my addr 172.21.15.118:0/2294185678 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f5947fff640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59481007e0 0x7f5948198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f59477fe640 1 -- 172.21.15.118:0/2294185678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59481007e0 msgr2=0x7f5948198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f59477fe640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59481007e0 0x7f5948198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.261+0000 7f59477fe640 1 -- 172.21.15.118:0/2294185678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5948199360 con 0x7f59481067e0 2024-09-21T12:09:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.262+0000 7f59477fe640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 0x7f5948198d60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c8f0 tx=0x7f593c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.262+0000 7f59457fa640 1 -- 172.21.15.118:0/2294185678 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f593c0079b0 con 0x7f59481067e0 2024-09-21T12:09:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.262+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5948199650 con 0x7f59481067e0 2024-09-21T12:09:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.262+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59481a1c50 con 0x7f59481067e0 2024-09-21T12:09:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.262+0000 7f59457fa640 1 -- 172.21.15.118:0/2294185678 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f593c0054e0 con 0x7f59481067e0 2024-09-21T12:09:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.262+0000 7f59457fa640 1 -- 172.21.15.118:0/2294185678 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f593c004dd0 con 0x7f59481067e0 2024-09-21T12:09:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.263+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5934005290 con 0x7f59481067e0 2024-09-21T12:09:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.264+0000 7f59457fa640 1 -- 172.21.15.118:0/2294185678 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f593c007b50 con 0x7f59481067e0 2024-09-21T12:09:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.264+0000 7f59457fa640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f593007af30 0x7f593007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.264+0000 7f59457fa640 1 -- 172.21.15.118:0/2294185678 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f593c09de40 con 0x7f59481067e0 2024-09-21T12:09:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.264+0000 7f5947fff640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f593007af30 0x7f593007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.265+0000 7f5947fff640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f593007af30 0x7f593007d3f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5938000c00 tx=0x7f5938031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:05.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.269+0000 7f59457fa640 1 -- 172.21.15.118:0/2294185678 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5948199650 con 0x7f59481067e0 2024-09-21T12:09:05.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.454+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5934000bc0 con 0x7f593007af30 2024-09-21T12:09:05.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.463+0000 7f59457fa640 1 -- 172.21.15.118:0/2294185678 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5934000bc0 con 0x7f593007af30 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (27m) 5m ago 37m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (30m) 5m ago 38m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (29m) 5m ago 37m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (25m) 5m ago 38m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (25m) 5m ago 37m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (26m) 5m ago 37m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (21m) 5m ago 32m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (21m) 5m ago 32m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:09:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (5m) 5m ago 32m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (20m) 5m ago 32m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (29m) 5m ago 39m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (28m) 5m ago 37m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (25m) 5m ago 39m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (25m) 5m ago 37m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (27m) 5m ago 38m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (27m) 5m ago 37m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (24m) 5m ago 35m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (24m) 5m ago 35m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (23m) 5m ago 34m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (22m) 5m ago 34m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (22m) 5m ago 34m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (21m) 5m ago 33m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:09:05.467 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (27m) 5m ago 37m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:09:05.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f593007af30 msgr2=0x7f593007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f593007af30 0x7f593007d3f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5938000c00 tx=0x7f5938031400 comp rx=0 tx=0).stop 2024-09-21T12:09:05.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 msgr2=0x7f5948198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 0x7f5948198d60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c8f0 tx=0x7f593c00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 shutdown_connections 2024-09-21T12:09:05.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f593007af30 0x7f593007d3f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59481067e0 0x7f5948198d60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 --2- 172.21.15.118:0/2294185678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59481007e0 0x7f5948198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 >> 172.21.15.118:0/2294185678 conn(0x7f59480fc4c0 msgr2=0x7f59480fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:05.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 shutdown_connections 2024-09-21T12:09:05.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.466+0000 7f594e465640 1 -- 172.21.15.118:0/2294185678 wait complete. 2024-09-21T12:09:05.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.546+0000 7f16848ad640 1 -- 172.21.15.118:0/1271502478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801007e0 msgr2=0x7f1680100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.546+0000 7f16848ad640 1 --2- 172.21.15.118:0/1271502478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801007e0 0x7f1680100c40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1668009880 tx=0x7f166802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.546+0000 7f16848ad640 1 -- 172.21.15.118:0/1271502478 shutdown_connections 2024-09-21T12:09:05.548 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:05 smithi118 ceph-mon[111738]: from='client.35452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:05.548 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:09:05.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.546+0000 7f16848ad640 1 --2- 172.21.15.118:0/1271502478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801007e0 0x7f1680100c40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.546+0000 7f16848ad640 1 --2- 172.21.15.118:0/1271502478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16801067e0 0x7f1680106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.546+0000 7f16848ad640 1 -- 172.21.15.118:0/1271502478 >> 172.21.15.118:0/1271502478 conn(0x7f16800fc4c0 msgr2=0x7f16800fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:05.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.546+0000 7f16848ad640 1 -- 172.21.15.118:0/1271502478 shutdown_connections 2024-09-21T12:09:05.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.546+0000 7f16848ad640 1 -- 172.21.15.118:0/1271502478 wait complete. 2024-09-21T12:09:05.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f16848ad640 1 Processor -- start 2024-09-21T12:09:05.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f16848ad640 1 -- start start 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f16848ad640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16801007e0 0x7f16800fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f16848ad640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801067e0 0x7f16800fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f16848ad640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f168010dd10 con 0x7f16801067e0 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f16848ad640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f168010db90 con 0x7f16801007e0 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f167dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801067e0 0x7f16800fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f167dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801067e0 0x7f16800fd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51634/0 (socket says 172.21.15.118:51634) 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f167dd9b640 1 -- 172.21.15.118:0/2109899762 learned_addr learned my addr 172.21.15.118:0/2109899762 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f167e59c640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16801007e0 0x7f16800fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f167dd9b640 1 -- 172.21.15.118:0/2109899762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16801007e0 msgr2=0x7f16800fcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f167dd9b640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16801007e0 0x7f16800fcc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f167dd9b640 1 -- 172.21.15.118:0/2109899762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16800fd6e0 con 0x7f16801067e0 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.547+0000 7f167e59c640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16801007e0 0x7f16800fcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:09:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.548+0000 7f167dd9b640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801067e0 0x7f16800fd1a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1668031460 tx=0x7f16680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:05.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.548+0000 7f16777fe640 1 -- 172.21.15.118:0/2109899762 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f166803f070 con 0x7f16801067e0 2024-09-21T12:09:05.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.548+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16800fd970 con 0x7f16801067e0 2024-09-21T12:09:05.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.548+0000 7f16777fe640 1 -- 172.21.15.118:0/2109899762 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1668004cf0 con 0x7f16801067e0 2024-09-21T12:09:05.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.548+0000 7f16777fe640 1 -- 172.21.15.118:0/2109899762 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1668035030 con 0x7f16801067e0 2024-09-21T12:09:05.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.548+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16801a3de0 con 0x7f16801067e0 2024-09-21T12:09:05.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.549+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1680101f20 con 0x7f16801067e0 2024-09-21T12:09:05.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.550+0000 7f16777fe640 1 -- 172.21.15.118:0/2109899762 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1668042070 con 0x7f16801067e0 2024-09-21T12:09:05.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.550+0000 7f16777fe640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f166c07af30 0x7f166c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:05.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.550+0000 7f16777fe640 1 -- 172.21.15.118:0/2109899762 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f16680beb40 con 0x7f16801067e0 2024-09-21T12:09:05.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.550+0000 7f167e59c640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f166c07af30 0x7f166c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:05.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.551+0000 7f167e59c640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f166c07af30 0x7f166c07d3f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1678009d60 tx=0x7f1678009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:05.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.554+0000 7f16777fe640 1 -- 172.21.15.118:0/2109899762 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f166808a090 con 0x7f16801067e0 2024-09-21T12:09:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:05 smithi149 ceph-mon[79770]: from='client.35452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:05.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:09:05.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.804+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1680109d80 con 0x7f16801067e0 2024-09-21T12:09:05.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.805+0000 7f16777fe640 1 -- 172.21.15.118:0/2109899762 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f166808ef40 con 0x7f16801067e0 2024-09-21T12:09:05.807 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:09:05.807 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:09:05.807 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:09:05.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:09:05.807 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:09:05.807 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:09:05.808 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.807+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f166c07af30 msgr2=0x7f166c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.807+0000 7f16848ad640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f166c07af30 0x7f166c07d3f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1678009d60 tx=0x7f1678009110 comp rx=0 tx=0).stop 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.807+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801067e0 msgr2=0x7f16800fd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.807+0000 7f16848ad640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801067e0 0x7f16800fd1a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1668031460 tx=0x7f16680048f0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.807+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 shutdown_connections 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.807+0000 7f16848ad640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f166c07af30 0x7f166c07d3f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.807+0000 7f16848ad640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16801067e0 0x7f16800fd1a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.807+0000 7f16848ad640 1 --2- 172.21.15.118:0/2109899762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16801007e0 0x7f16800fcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.807+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 >> 172.21.15.118:0/2109899762 conn(0x7f16800fc4c0 msgr2=0x7f1680069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.808+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 shutdown_connections 2024-09-21T12:09:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.808+0000 7f16848ad640 1 -- 172.21.15.118:0/2109899762 wait complete. 2024-09-21T12:09:05.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.888+0000 7ff36a9ba640 1 -- 172.21.15.118:0/1434525352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 msgr2=0x7ff364106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.888+0000 7ff36a9ba640 1 --2- 172.21.15.118:0/1434525352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 0x7ff364106c00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff354009880 tx=0x7ff35402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.888+0000 7ff36a9ba640 1 -- 172.21.15.118:0/1434525352 shutdown_connections 2024-09-21T12:09:05.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.888+0000 7ff36a9ba640 1 --2- 172.21.15.118:0/1434525352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff364100820 0x7ff364100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.888+0000 7ff36a9ba640 1 --2- 172.21.15.118:0/1434525352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 0x7ff364106c00 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.888+0000 7ff36a9ba640 1 -- 172.21.15.118:0/1434525352 >> 172.21.15.118:0/1434525352 conn(0x7ff3640fc520 msgr2=0x7ff3640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:05.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.888+0000 7ff36a9ba640 1 -- 172.21.15.118:0/1434525352 shutdown_connections 2024-09-21T12:09:05.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.888+0000 7ff36a9ba640 1 -- 172.21.15.118:0/1434525352 wait complete. 2024-09-21T12:09:05.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff36a9ba640 1 Processor -- start 2024-09-21T12:09:05.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff36a9ba640 1 -- start start 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff36a9ba640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff364100820 0x7ff36419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff36a9ba640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 0x7ff36419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff36a9ba640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff36410dd50 con 0x7ff364106820 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff36a9ba640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff36410dbd0 con 0x7ff364100820 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff3637fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 0x7ff36419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff3637fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 0x7ff36419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51654/0 (socket says 172.21.15.118:51654) 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff3637fe640 1 -- 172.21.15.118:0/36242755 learned_addr learned my addr 172.21.15.118:0/36242755 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff363fff640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff364100820 0x7ff36419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff3637fe640 1 -- 172.21.15.118:0/36242755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff364100820 msgr2=0x7ff36419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff3637fe640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff364100820 0x7ff36419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.889+0000 7ff3637fe640 1 -- 172.21.15.118:0/36242755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff364197840 con 0x7ff364106820 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.890+0000 7ff3637fe640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 0x7ff36419dc00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff35800b420 tx=0x7ff35800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.890+0000 7ff3617fa640 1 -- 172.21.15.118:0/36242755 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff358011630 con 0x7ff364106820 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.890+0000 7ff3617fa640 1 -- 172.21.15.118:0/36242755 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff358016070 con 0x7ff364106820 2024-09-21T12:09:05.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.890+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff364197b30 con 0x7ff364106820 2024-09-21T12:09:05.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.890+0000 7ff3617fa640 1 -- 172.21.15.118:0/36242755 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff358010d40 con 0x7ff364106820 2024-09-21T12:09:05.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.890+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3641980c0 con 0x7ff364106820 2024-09-21T12:09:05.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.891+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff364101f60 con 0x7ff364106820 2024-09-21T12:09:05.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.891+0000 7ff3617fa640 1 -- 172.21.15.118:0/36242755 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff35801b460 con 0x7ff364106820 2024-09-21T12:09:05.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.892+0000 7ff3617fa640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff34c07af40 0x7ff34c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:05.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.892+0000 7ff3617fa640 1 -- 172.21.15.118:0/36242755 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff35809d7f0 con 0x7ff364106820 2024-09-21T12:09:05.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.892+0000 7ff363fff640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff34c07af40 0x7ff34c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:05.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.892+0000 7ff363fff640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff34c07af40 0x7ff34c07d400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff354031460 tx=0x7ff3540095c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:05.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:05.896+0000 7ff3617fa640 1 -- 172.21.15.118:0/36242755 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff358021250 con 0x7ff364106820 2024-09-21T12:09:06.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.119+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff364109da0 con 0x7ff364106820 2024-09-21T12:09:06.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.119+0000 7ff3617fa640 1 -- 172.21.15.118:0/36242755 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7ff358068d40 con 0x7ff364106820 2024-09-21T12:09:06.121 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:09:06.121 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:09:06.122 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:09:06.123 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:09:06.124 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:09:06.125 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:09:06.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff34c07af40 msgr2=0x7ff34c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff34c07af40 0x7ff34c07d400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff354031460 tx=0x7ff3540095c0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 msgr2=0x7ff36419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 0x7ff36419dc00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff35800b420 tx=0x7ff35800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 shutdown_connections 2024-09-21T12:09:06.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff34c07af40 0x7ff34c07d400 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff364106820 0x7ff36419dc00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 --2- 172.21.15.118:0/36242755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff364100820 0x7ff36419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 >> 172.21.15.118:0/36242755 conn(0x7ff3640fc520 msgr2=0x7ff36406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:06.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 shutdown_connections 2024-09-21T12:09:06.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.122+0000 7ff36a9ba640 1 -- 172.21.15.118:0/36242755 wait complete. 2024-09-21T12:09:06.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.204+0000 7f1323c46640 1 -- 172.21.15.118:0/164960106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 msgr2=0x7f131c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.204+0000 7f1323c46640 1 --2- 172.21.15.118:0/164960106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 0x7f131c106c00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1318009880 tx=0x7f131802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.204+0000 7f1323c46640 1 -- 172.21.15.118:0/164960106 shutdown_connections 2024-09-21T12:09:06.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.204+0000 7f1323c46640 1 --2- 172.21.15.118:0/164960106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f131c100820 0x7f131c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.204+0000 7f1323c46640 1 --2- 172.21.15.118:0/164960106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 0x7f131c106c00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.204+0000 7f1323c46640 1 -- 172.21.15.118:0/164960106 >> 172.21.15.118:0/164960106 conn(0x7f131c0fc520 msgr2=0x7f131c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:06.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.204+0000 7f1323c46640 1 -- 172.21.15.118:0/164960106 shutdown_connections 2024-09-21T12:09:06.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.204+0000 7f1323c46640 1 -- 172.21.15.118:0/164960106 wait complete. 2024-09-21T12:09:06.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.205+0000 7f1323c46640 1 Processor -- start 2024-09-21T12:09:06.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.205+0000 7f1323c46640 1 -- start start 2024-09-21T12:09:06.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.205+0000 7f1323c46640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f131c100820 0x7f131c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:06.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.205+0000 7f1323c46640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 0x7f131c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:06.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.205+0000 7f1323c46640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f131c10dcd0 con 0x7f131c106820 2024-09-21T12:09:06.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.205+0000 7f1323c46640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f131c10db50 con 0x7f131c100820 2024-09-21T12:09:06.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.205+0000 7f13211e1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 0x7f131c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:06.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.205+0000 7f13211e1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 0x7f131c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51680/0 (socket says 172.21.15.118:51680) 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.205+0000 7f13211e1640 1 -- 172.21.15.118:0/66281041 learned_addr learned my addr 172.21.15.118:0/66281041 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f13219e2640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f131c100820 0x7f131c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f13211e1640 1 -- 172.21.15.118:0/66281041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f131c100820 msgr2=0x7f131c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f13211e1640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f131c100820 0x7f131c19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f13211e1640 1 -- 172.21.15.118:0/66281041 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c1977a0 con 0x7f131c106820 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f13211e1640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 0x7f131c19db60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f130c00d8d0 tx=0x7f130c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f1312ffd640 1 -- 172.21.15.118:0/66281041 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f130c017070 con 0x7f131c106820 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f1312ffd640 1 -- 172.21.15.118:0/66281041 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f130c010460 con 0x7f131c106820 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131c197a90 con 0x7f131c106820 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f1312ffd640 1 -- 172.21.15.118:0/66281041 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f130c00f5f0 con 0x7f131c106820 2024-09-21T12:09:06.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.206+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131c198020 con 0x7f131c106820 2024-09-21T12:09:06.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.207+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c101f60 con 0x7f131c106820 2024-09-21T12:09:06.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.208+0000 7f1312ffd640 1 -- 172.21.15.118:0/66281041 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f130c009a30 con 0x7f131c106820 2024-09-21T12:09:06.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.208+0000 7f1312ffd640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f130807af30 0x7f130807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:06.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.208+0000 7f1312ffd640 1 -- 172.21.15.118:0/66281041 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f130c09df90 con 0x7f131c106820 2024-09-21T12:09:06.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.208+0000 7f13219e2640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f130807af30 0x7f130807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:06.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.209+0000 7f13219e2640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f130807af30 0x7f130807d3f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f13180096c0 tx=0x7f1318031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:06.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.212+0000 7f1312ffd640 1 -- 172.21.15.118:0/66281041 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f130c0694e0 con 0x7f131c106820 2024-09-21T12:09:06.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.408+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f131c1982d0 con 0x7f130807af30 2024-09-21T12:09:06.410 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:06 smithi118 ceph-mon[111738]: pgmap v909: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:06.410 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:06 smithi118 ceph-mon[111738]: from='client.35456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:06.410 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:06 smithi118 ceph-mon[111738]: from='client.35460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:06.411 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:06 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2109899762' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:09:06.411 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:06 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/36242755' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:09:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.409+0000 7f1312ffd640 1 -- 172.21.15.118:0/66281041 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f131c1982d0 con 0x7f130807af30 2024-09-21T12:09:06.411 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:09:06.411 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:09:06.411 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:09:06.411 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:09:06.411 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:09:06.412 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.411+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f130807af30 msgr2=0x7f130807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.411+0000 7f1323c46640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f130807af30 0x7f130807d3f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f13180096c0 tx=0x7f1318031400 comp rx=0 tx=0).stop 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.411+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 msgr2=0x7f131c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.411+0000 7f1323c46640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 0x7f131c19db60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f130c00d8d0 tx=0x7f130c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.412+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 shutdown_connections 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.412+0000 7f1323c46640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f130807af30 0x7f130807d3f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.412+0000 7f1323c46640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c106820 0x7f131c19db60 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.412+0000 7f1323c46640 1 --2- 172.21.15.118:0/66281041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f131c100820 0x7f131c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.412+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 >> 172.21.15.118:0/66281041 conn(0x7f131c0fc520 msgr2=0x7f131c109e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:06.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.412+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 shutdown_connections 2024-09-21T12:09:06.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.412+0000 7f1323c46640 1 -- 172.21.15.118:0/66281041 wait complete. 2024-09-21T12:09:06.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.493+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/3982924834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58106820 msgr2=0x7fdf58106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.493+0000 7fdf5dcb3640 1 --2- 172.21.15.118:0/3982924834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58106820 0x7fdf58106c00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009880 tx=0x7fdf4802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.493+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/3982924834 shutdown_connections 2024-09-21T12:09:06.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.493+0000 7fdf5dcb3640 1 --2- 172.21.15.118:0/3982924834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58100820 0x7fdf58100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.493+0000 7fdf5dcb3640 1 --2- 172.21.15.118:0/3982924834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58106820 0x7fdf58106c00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.493+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/3982924834 >> 172.21.15.118:0/3982924834 conn(0x7fdf580fc520 msgr2=0x7fdf580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:06.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.493+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/3982924834 shutdown_connections 2024-09-21T12:09:06.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.493+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/3982924834 wait complete. 2024-09-21T12:09:06.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf5dcb3640 1 Processor -- start 2024-09-21T12:09:06.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf5dcb3640 1 -- start start 2024-09-21T12:09:06.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf5dcb3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58100820 0x7fdf58198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:06.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf5dcb3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58106820 0x7fdf58198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:06.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf5dcb3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5810dcf0 con 0x7fdf58100820 2024-09-21T12:09:06.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf5dcb3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5810db70 con 0x7fdf58106820 2024-09-21T12:09:06.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf577fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58100820 0x7fdf58198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:06.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf577fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58100820 0x7fdf58198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51704/0 (socket says 172.21.15.118:51704) 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf577fe640 1 -- 172.21.15.118:0/2971009435 learned_addr learned my addr 172.21.15.118:0/2971009435 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf4ffff640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58106820 0x7fdf58198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf577fe640 1 -- 172.21.15.118:0/2971009435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58106820 msgr2=0x7fdf58198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf577fe640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58106820 0x7fdf58198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf577fe640 1 -- 172.21.15.118:0/2971009435 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf58199380 con 0x7fdf58100820 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf4ffff640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58106820 0x7fdf58198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.494+0000 7fdf577fe640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58100820 0x7fdf58198840 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdf48031460 tx=0x7fdf480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.495+0000 7fdf557fa640 1 -- 172.21.15.118:0/2971009435 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf4803f070 con 0x7fdf58100820 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.495+0000 7fdf557fa640 1 -- 172.21.15.118:0/2971009435 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf480035f0 con 0x7fdf58100820 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.495+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf58199610 con 0x7fdf58100820 2024-09-21T12:09:06.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.495+0000 7fdf557fa640 1 -- 172.21.15.118:0/2971009435 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf48035030 con 0x7fdf58100820 2024-09-21T12:09:06.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.495+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf581a1bc0 con 0x7fdf58100820 2024-09-21T12:09:06.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.496+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf58101f60 con 0x7fdf58100820 2024-09-21T12:09:06.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.496+0000 7fdf557fa640 1 -- 172.21.15.118:0/2971009435 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fdf48042070 con 0x7fdf58100820 2024-09-21T12:09:06.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.497+0000 7fdf557fa640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdf4407af30 0x7fdf4407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:06.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.497+0000 7fdf557fa640 1 -- 172.21.15.118:0/2971009435 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdf480bead0 con 0x7fdf58100820 2024-09-21T12:09:06.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.497+0000 7fdf4ffff640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdf4407af30 0x7fdf4407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:06.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.497+0000 7fdf4ffff640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdf4407af30 0x7fdf4407d3f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf5806ae50 tx=0x7fdf40005e50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:06.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.501+0000 7fdf557fa640 1 -- 172.21.15.118:0/2971009435 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf4808a020 con 0x7fdf58100820 2024-09-21T12:09:06.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:06 smithi149 ceph-mon[79770]: pgmap v909: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:06.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:06 smithi149 ceph-mon[79770]: from='client.35456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:06.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:06 smithi149 ceph-mon[79770]: from='client.35460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:06.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:06 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2109899762' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:09:06.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:06 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/36242755' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:09:06.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.747+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fdf58108d90 con 0x7fdf58100820 2024-09-21T12:09:06.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.748+0000 7fdf557fa640 1 -- 172.21.15.118:0/2971009435 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fdf4808c020 con 0x7fdf58100820 2024-09-21T12:09:06.750 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:09:06.750 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:09:06.750 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:09:06.751 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:09:06.752 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:09:06.752 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:09:06.752 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:09:06.752 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:09:06.752 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:09:06.752 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:09:06.752 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdf4407af30 msgr2=0x7fdf4407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdf4407af30 0x7fdf4407d3f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf5806ae50 tx=0x7fdf40005e50 comp rx=0 tx=0).stop 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58100820 msgr2=0x7fdf58198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58100820 0x7fdf58198840 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdf48031460 tx=0x7fdf480045e0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 shutdown_connections 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf58106820 0x7fdf58198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fdf4407af30 0x7fdf4407d3f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 --2- 172.21.15.118:0/2971009435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf58100820 0x7fdf58198840 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 >> 172.21.15.118:0/2971009435 conn(0x7fdf580fc520 msgr2=0x7fdf580fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 shutdown_connections 2024-09-21T12:09:06.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:06.750+0000 7fdf5dcb3640 1 -- 172.21.15.118:0/2971009435 wait complete. 2024-09-21T12:09:07.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:07 smithi149 ceph-mon[79770]: from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:07.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:07 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2971009435' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:09:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:07 smithi118 ceph-mon[111738]: from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:07.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:07 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2971009435' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:09:08.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:08 smithi149 ceph-mon[79770]: pgmap v910: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:08.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:08 smithi118 ceph-mon[111738]: pgmap v910: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:10.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:10 smithi149 ceph-mon[79770]: pgmap v911: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:10 smithi118 ceph-mon[111738]: pgmap v911: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:12 smithi149 ceph-mon[79770]: pgmap v912: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:12 smithi118 ceph-mon[111738]: pgmap v912: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:14 smithi149 ceph-mon[79770]: pgmap v913: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:14.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:14 smithi118 ceph-mon[111738]: pgmap v913: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:16 smithi118 ceph-mon[111738]: pgmap v914: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:16 smithi149 ceph-mon[79770]: pgmap v914: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:18 smithi149 ceph-mon[79770]: pgmap v915: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:18.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:18 smithi118 ceph-mon[111738]: pgmap v915: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:20 smithi149 ceph-mon[79770]: pgmap v916: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:09:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:20 smithi118 ceph-mon[111738]: pgmap v916: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:09:22.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:22 smithi149 ceph-mon[79770]: pgmap v917: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:22.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:22 smithi118 ceph-mon[111738]: pgmap v917: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:24 smithi149 ceph-mon[79770]: pgmap v918: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:24.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:24 smithi118 ceph-mon[111738]: pgmap v918: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:26 smithi118 ceph-mon[111738]: pgmap v919: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:26 smithi149 ceph-mon[79770]: pgmap v919: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:28 smithi149 ceph-mon[79770]: pgmap v920: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:28 smithi118 ceph-mon[111738]: pgmap v920: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:30.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:30 smithi149 ceph-mon[79770]: pgmap v921: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:30.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:30 smithi118 ceph-mon[111738]: pgmap v921: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:32.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:32 smithi149 ceph-mon[79770]: pgmap v922: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:32.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:32 smithi118 ceph-mon[111738]: pgmap v922: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:34.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:34 smithi149 ceph-mon[79770]: pgmap v923: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:34.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:34 smithi118 ceph-mon[111738]: pgmap v923: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:09:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:09:36.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:36 smithi149 ceph-mon[79770]: pgmap v924: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:36 smithi118 ceph-mon[111738]: pgmap v924: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:36.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.848+0000 7f7afdadf640 1 -- 172.21.15.118:0/2514095548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7af81067e0 msgr2=0x7f7af8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:36.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.848+0000 7f7afdadf640 1 --2- 172.21.15.118:0/2514095548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7af81067e0 0x7f7af8106bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800d8e0 tx=0x7f7ae802e590 comp rx=0 tx=0).stop 2024-09-21T12:09:36.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.848+0000 7f7afdadf640 1 -- 172.21.15.118:0/2514095548 shutdown_connections 2024-09-21T12:09:36.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.848+0000 7f7afdadf640 1 --2- 172.21.15.118:0/2514095548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af81007e0 0x7f7af8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:36.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.848+0000 7f7afdadf640 1 --2- 172.21.15.118:0/2514095548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7af81067e0 0x7f7af8106bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:36.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.848+0000 7f7afdadf640 1 -- 172.21.15.118:0/2514095548 >> 172.21.15.118:0/2514095548 conn(0x7f7af80fc4c0 msgr2=0x7f7af80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:36.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.849+0000 7f7afdadf640 1 -- 172.21.15.118:0/2514095548 shutdown_connections 2024-09-21T12:09:36.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.849+0000 7f7afdadf640 1 -- 172.21.15.118:0/2514095548 wait complete. 2024-09-21T12:09:36.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.850+0000 7f7afdadf640 1 Processor -- start 2024-09-21T12:09:36.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.850+0000 7f7afdadf640 1 -- start start 2024-09-21T12:09:36.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.850+0000 7f7afdadf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af81007e0 0x7f7af819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:36.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.850+0000 7f7afdadf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7af81067e0 0x7f7af819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:36.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.850+0000 7f7afdadf640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7af810cbb0 con 0x7f7af81007e0 2024-09-21T12:09:36.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.850+0000 7f7afdadf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7af810ca30 con 0x7f7af81067e0 2024-09-21T12:09:36.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af81007e0 0x7f7af819b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:36.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af81007e0 0x7f7af819b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41144/0 (socket says 172.21.15.118:41144) 2024-09-21T12:09:36.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af77fe640 1 -- 172.21.15.118:0/1799063162 learned_addr learned my addr 172.21.15.118:0/1799063162 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:36.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af6ffd640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7af81067e0 0x7f7af819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:36.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af77fe640 1 -- 172.21.15.118:0/1799063162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7af81067e0 msgr2=0x7f7af819bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:36.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af77fe640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7af81067e0 0x7f7af819bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:36.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af77fe640 1 -- 172.21.15.118:0/1799063162 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af8195820 con 0x7f7af81007e0 2024-09-21T12:09:36.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af6ffd640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7af81067e0 0x7f7af819bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:09:36.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af77fe640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af81007e0 0x7f7af819b6a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800da00 tx=0x7f7ae80345d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:36.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af4ff9640 1 -- 172.21.15.118:0/1799063162 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ae8035400 con 0x7f7af81007e0 2024-09-21T12:09:36.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af4ff9640 1 -- 172.21.15.118:0/1799063162 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ae8043070 con 0x7f7af81007e0 2024-09-21T12:09:36.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.851+0000 7f7af4ff9640 1 -- 172.21.15.118:0/1799063162 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ae8003750 con 0x7f7af81007e0 2024-09-21T12:09:36.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.852+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af8195ab0 con 0x7f7af81007e0 2024-09-21T12:09:36.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.852+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af8195f80 con 0x7f7af81007e0 2024-09-21T12:09:36.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.853+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af8101f20 con 0x7f7af81007e0 2024-09-21T12:09:36.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.853+0000 7f7af4ff9640 1 -- 172.21.15.118:0/1799063162 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7ae8004050 con 0x7f7af81007e0 2024-09-21T12:09:36.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.854+0000 7f7af4ff9640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ae0083750 0x7f7ae0085c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:36.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.854+0000 7f7af4ff9640 1 -- 172.21.15.118:0/1799063162 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7ae80be2b0 con 0x7f7af81007e0 2024-09-21T12:09:36.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.854+0000 7f7af6ffd640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ae0083750 0x7f7ae0085c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:36.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.855+0000 7f7af6ffd640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ae0083750 0x7f7ae0085c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7af8106000 tx=0x7f7aec00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:36.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:36.859+0000 7f7af4ff9640 1 -- 172.21.15.118:0/1799063162 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ae8089800 con 0x7f7af81007e0 2024-09-21T12:09:37.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.056+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7af8196230 con 0x7f7ae0083750 2024-09-21T12:09:37.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.057+0000 7f7af4ff9640 1 -- 172.21.15.118:0/1799063162 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7af8196230 con 0x7f7ae0083750 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ae0083750 msgr2=0x7f7ae0085c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ae0083750 0x7f7ae0085c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7af8106000 tx=0x7f7aec00b390 comp rx=0 tx=0).stop 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af81007e0 msgr2=0x7f7af819b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af81007e0 0x7f7af819b6a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800da00 tx=0x7f7ae80345d0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 shutdown_connections 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7af81067e0 0x7f7af819bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7ae0083750 0x7f7ae0085c10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 --2- 172.21.15.118:0/1799063162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7af81007e0 0x7f7af819b6a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 >> 172.21.15.118:0/1799063162 conn(0x7f7af80fc4c0 msgr2=0x7f7af80fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 shutdown_connections 2024-09-21T12:09:37.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.059+0000 7f7afdadf640 1 -- 172.21.15.118:0/1799063162 wait complete. 2024-09-21T12:09:37.070 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:09:37.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.142+0000 7f2ff9be3640 1 -- 172.21.15.118:0/3849089742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 msgr2=0x7f2ff410dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.142+0000 7f2ff9be3640 1 --2- 172.21.15.118:0/3849089742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 0x7f2ff410dd20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009880 tx=0x7f2fe802a490 comp rx=0 tx=0).stop 2024-09-21T12:09:37.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.142+0000 7f2ff9be3640 1 -- 172.21.15.118:0/3849089742 shutdown_connections 2024-09-21T12:09:37.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.142+0000 7f2ff9be3640 1 --2- 172.21.15.118:0/3849089742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 0x7f2ff410dd20 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.142+0000 7f2ff9be3640 1 --2- 172.21.15.118:0/3849089742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff41006b0 0x7f2ff4100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.142+0000 7f2ff9be3640 1 -- 172.21.15.118:0/3849089742 >> 172.21.15.118:0/3849089742 conn(0x7f2ff40fc4c0 msgr2=0x7f2ff40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:37.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.142+0000 7f2ff9be3640 1 -- 172.21.15.118:0/3849089742 shutdown_connections 2024-09-21T12:09:37.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.142+0000 7f2ff9be3640 1 -- 172.21.15.118:0/3849089742 wait complete. 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.143+0000 7f2ff9be3640 1 Processor -- start 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.143+0000 7f2ff9be3640 1 -- start start 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.143+0000 7f2ff9be3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff41006b0 0x7f2ff419f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.143+0000 7f2ff9be3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 0x7f2ff419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.143+0000 7f2ff9be3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4110f70 con 0x7f2ff4101060 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.143+0000 7f2ff9be3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4110df0 con 0x7f2ff41006b0 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.143+0000 7f2ff2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 0x7f2ff419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 0x7f2ff419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41166/0 (socket says 172.21.15.118:41166) 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff2ffd640 1 -- 172.21.15.118:0/2815669948 learned_addr learned my addr 172.21.15.118:0/2815669948 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff37fe640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff41006b0 0x7f2ff419f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:37.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff2ffd640 1 -- 172.21.15.118:0/2815669948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff41006b0 msgr2=0x7f2ff419f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff2ffd640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff41006b0 0x7f2ff419f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff2ffd640 1 -- 172.21.15.118:0/2815669948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff4199940 con 0x7f2ff4101060 2024-09-21T12:09:37.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff2ffd640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 0x7f2ff419fcc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8031460 tx=0x7f2fe80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:37.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff0ff9640 1 -- 172.21.15.118:0/2815669948 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fe803f070 con 0x7f2ff4101060 2024-09-21T12:09:37.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff4199bd0 con 0x7f2ff4101060 2024-09-21T12:09:37.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff419a160 con 0x7f2ff4101060 2024-09-21T12:09:37.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.144+0000 7f2ff0ff9640 1 -- 172.21.15.118:0/2815669948 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fe80035f0 con 0x7f2ff4101060 2024-09-21T12:09:37.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.145+0000 7f2ff0ff9640 1 -- 172.21.15.118:0/2815669948 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fe8035030 con 0x7f2ff4101060 2024-09-21T12:09:37.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.146+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe0005290 con 0x7f2ff4101060 2024-09-21T12:09:37.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.146+0000 7f2ff0ff9640 1 -- 172.21.15.118:0/2815669948 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2fe8042070 con 0x7f2ff4101060 2024-09-21T12:09:37.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.146+0000 7f2ff0ff9640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af80 0x7f2fdc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:37.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.146+0000 7f2ff0ff9640 1 -- 172.21.15.118:0/2815669948 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2fe80be840 con 0x7f2ff4101060 2024-09-21T12:09:37.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.147+0000 7f2ff37fe640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af80 0x7f2fdc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:37.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.147+0000 7f2ff37fe640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af80 0x7f2fdc07d440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ff419aa80 tx=0x7f2fe400b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:37.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.151+0000 7f2ff0ff9640 1 -- 172.21.15.118:0/2815669948 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2fe8089e10 con 0x7f2ff4101060 2024-09-21T12:09:37.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.343+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2fe0000bc0 con 0x7f2fdc07af80 2024-09-21T12:09:37.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.344+0000 7f2ff0ff9640 1 -- 172.21.15.118:0/2815669948 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2fe0000bc0 con 0x7f2fdc07af80 2024-09-21T12:09:37.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af80 msgr2=0x7f2fdc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af80 0x7f2fdc07d440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ff419aa80 tx=0x7f2fe400b390 comp rx=0 tx=0).stop 2024-09-21T12:09:37.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 msgr2=0x7f2ff419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 0x7f2ff419fcc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8031460 tx=0x7f2fe80045e0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 shutdown_connections 2024-09-21T12:09:37.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2fdc07af80 0x7f2fdc07d440 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4101060 0x7f2ff419fcc0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 --2- 172.21.15.118:0/2815669948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff41006b0 0x7f2ff419f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 >> 172.21.15.118:0/2815669948 conn(0x7f2ff40fc4c0 msgr2=0x7f2ff40fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:37.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 shutdown_connections 2024-09-21T12:09:37.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.347+0000 7f2ff9be3640 1 -- 172.21.15.118:0/2815669948 wait complete. 2024-09-21T12:09:37.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.428+0000 7fe696789640 1 -- 172.21.15.118:0/4223344496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690106820 msgr2=0x7fe690106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.428+0000 7fe696789640 1 --2- 172.21.15.118:0/4223344496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690106820 0x7fe690106c00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe680009880 tx=0x7fe68002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.428+0000 7fe696789640 1 -- 172.21.15.118:0/4223344496 shutdown_connections 2024-09-21T12:09:37.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.428+0000 7fe696789640 1 --2- 172.21.15.118:0/4223344496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe690100820 0x7fe690100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.428+0000 7fe696789640 1 --2- 172.21.15.118:0/4223344496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690106820 0x7fe690106c00 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.428+0000 7fe696789640 1 -- 172.21.15.118:0/4223344496 >> 172.21.15.118:0/4223344496 conn(0x7fe6900fc520 msgr2=0x7fe6900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:37.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.428+0000 7fe696789640 1 -- 172.21.15.118:0/4223344496 shutdown_connections 2024-09-21T12:09:37.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.428+0000 7fe696789640 1 -- 172.21.15.118:0/4223344496 wait complete. 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe696789640 1 Processor -- start 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe696789640 1 -- start start 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe696789640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690100820 0x7fe69019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe696789640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe690106820 0x7fe69019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe696789640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe69010dd50 con 0x7fe690100820 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe696789640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe69010dbd0 con 0x7fe690106820 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe68ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690100820 0x7fe69019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe68ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690100820 0x7fe69019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41192/0 (socket says 172.21.15.118:41192) 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe68ffff640 1 -- 172.21.15.118:0/1327743905 learned_addr learned my addr 172.21.15.118:0/1327743905 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.429+0000 7fe68f7fe640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe690106820 0x7fe69019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.430+0000 7fe68ffff640 1 -- 172.21.15.118:0/1327743905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe690106820 msgr2=0x7fe69019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.430+0000 7fe68ffff640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe690106820 0x7fe69019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.430+0000 7fe68ffff640 1 -- 172.21.15.118:0/1327743905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe690197840 con 0x7fe690100820 2024-09-21T12:09:37.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.430+0000 7fe68ffff640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690100820 0x7fe69019d6c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe680031460 tx=0x7fe6800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:37.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.430+0000 7fe68d7fa640 1 -- 172.21.15.118:0/1327743905 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe68003f070 con 0x7fe690100820 2024-09-21T12:09:37.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.430+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe690197ad0 con 0x7fe690100820 2024-09-21T12:09:37.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.430+0000 7fe68d7fa640 1 -- 172.21.15.118:0/1327743905 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe680004cf0 con 0x7fe690100820 2024-09-21T12:09:37.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.430+0000 7fe68d7fa640 1 -- 172.21.15.118:0/1327743905 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe680035030 con 0x7fe690100820 2024-09-21T12:09:37.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.430+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe690198000 con 0x7fe690100820 2024-09-21T12:09:37.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.431+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe690101f60 con 0x7fe690100820 2024-09-21T12:09:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.432+0000 7fe68d7fa640 1 -- 172.21.15.118:0/1327743905 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe680042070 con 0x7fe690100820 2024-09-21T12:09:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.433+0000 7fe68d7fa640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe67807af30 0x7fe67807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.433+0000 7fe68f7fe640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe67807af30 0x7fe67807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.433+0000 7fe68d7fa640 1 -- 172.21.15.118:0/1327743905 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe6800beb40 con 0x7fe690100820 2024-09-21T12:09:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.433+0000 7fe68f7fe640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe67807af30 0x7fe67807d3f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe690104fa0 tx=0x7fe684009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:37.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.437+0000 7fe68d7fa640 1 -- 172.21.15.118:0/1327743905 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe68008a090 con 0x7fe690100820 2024-09-21T12:09:37.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.622+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe690198370 con 0x7fe67807af30 2024-09-21T12:09:37.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.632+0000 7fe68d7fa640 1 -- 172.21.15.118:0/1327743905 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe690198370 con 0x7fe67807af30 2024-09-21T12:09:37.633 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:09:37.633 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (27m) 6m ago 38m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:09:37.633 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (30m) 6m ago 38m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (29m) 6m ago 37m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (25m) 6m ago 38m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (25m) 6m ago 37m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (27m) 6m ago 38m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (22m) 6m ago 33m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (21m) 6m ago 33m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (6m) 6m ago 33m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (21m) 6m ago 33m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (29m) 6m ago 39m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (28m) 6m ago 37m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:09:37.634 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (26m) 6m ago 40m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (25m) 6m ago 37m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (28m) 6m ago 38m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (28m) 6m ago 37m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (25m) 6m ago 36m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (24m) 6m ago 35m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (24m) 6m ago 35m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (23m) 6m ago 35m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (22m) 6m ago 34m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (22m) 6m ago 34m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:09:37.635 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (27m) 6m ago 38m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:09:37.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe67807af30 msgr2=0x7fe67807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe67807af30 0x7fe67807d3f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe690104fa0 tx=0x7fe684009110 comp rx=0 tx=0).stop 2024-09-21T12:09:37.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690100820 msgr2=0x7fe69019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690100820 0x7fe69019d6c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe680031460 tx=0x7fe6800048f0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 shutdown_connections 2024-09-21T12:09:37.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe690106820 0x7fe69019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe67807af30 0x7fe67807d3f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 --2- 172.21.15.118:0/1327743905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe690100820 0x7fe69019d6c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 >> 172.21.15.118:0/1327743905 conn(0x7fe6900fc520 msgr2=0x7fe69006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 shutdown_connections 2024-09-21T12:09:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.635+0000 7fe696789640 1 -- 172.21.15.118:0/1327743905 wait complete. 2024-09-21T12:09:37.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.716+0000 7f5dda320640 1 -- 172.21.15.118:0/2708866181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 msgr2=0x7f5dd4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.716+0000 7f5dda320640 1 --2- 172.21.15.118:0/2708866181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 0x7f5dd4101d90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009880 tx=0x7f5dc802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.716+0000 7f5dda320640 1 -- 172.21.15.118:0/2708866181 shutdown_connections 2024-09-21T12:09:37.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.716+0000 7f5dda320640 1 --2- 172.21.15.118:0/2708866181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 0x7f5dd4101d90 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.716+0000 7f5dda320640 1 --2- 172.21.15.118:0/2708866181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dd4107930 0x7f5dd4107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.716+0000 7f5dda320640 1 -- 172.21.15.118:0/2708866181 >> 172.21.15.118:0/2708866181 conn(0x7f5dd40fd630 msgr2=0x7f5dd40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:37.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.716+0000 7f5dda320640 1 -- 172.21.15.118:0/2708866181 shutdown_connections 2024-09-21T12:09:37.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.716+0000 7f5dda320640 1 -- 172.21.15.118:0/2708866181 wait complete. 2024-09-21T12:09:37.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.717+0000 7f5dda320640 1 Processor -- start 2024-09-21T12:09:37.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.717+0000 7f5dda320640 1 -- start start 2024-09-21T12:09:37.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.717+0000 7f5dda320640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 0x7f5dd419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:37.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.717+0000 7f5dda320640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dd4107930 0x7f5dd419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:37.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.717+0000 7f5dda320640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410ee00 con 0x7f5dd4101930 2024-09-21T12:09:37.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.717+0000 7f5dda320640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410ec80 con 0x7f5dd4107930 2024-09-21T12:09:37.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.717+0000 7f5dd3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 0x7f5dd419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:37.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.717+0000 7f5dd3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 0x7f5dd419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41208/0 (socket says 172.21.15.118:41208) 2024-09-21T12:09:37.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.717+0000 7f5dd3fff640 1 -- 172.21.15.118:0/3125260683 learned_addr learned my addr 172.21.15.118:0/3125260683 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:37.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dd37fe640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dd4107930 0x7f5dd419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:37.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dd3fff640 1 -- 172.21.15.118:0/3125260683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dd4107930 msgr2=0x7f5dd419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dd3fff640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dd4107930 0x7f5dd419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dd3fff640 1 -- 172.21.15.118:0/3125260683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd4197810 con 0x7f5dd4101930 2024-09-21T12:09:37.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dd3fff640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 0x7f5dd419d690 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400d6f0 tx=0x7f5dc400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:37.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dd17fa640 1 -- 172.21.15.118:0/3125260683 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dc4017070 con 0x7f5dd4101930 2024-09-21T12:09:37.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd4197b00 con 0x7f5dd4101930 2024-09-21T12:09:37.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dd17fa640 1 -- 172.21.15.118:0/3125260683 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5dc400de00 con 0x7f5dd4101930 2024-09-21T12:09:37.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dd17fa640 1 -- 172.21.15.118:0/3125260683 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dc4004bb0 con 0x7f5dd4101930 2024-09-21T12:09:37.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.718+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd4198090 con 0x7f5dd4101930 2024-09-21T12:09:37.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.719+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd4103070 con 0x7f5dd4101930 2024-09-21T12:09:37.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.720+0000 7f5dd17fa640 1 -- 172.21.15.118:0/3125260683 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5dc4009a30 con 0x7f5dd4101930 2024-09-21T12:09:37.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.720+0000 7f5dd17fa640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5dbc07af80 0x7f5dbc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:37.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.721+0000 7f5dd17fa640 1 -- 172.21.15.118:0/3125260683 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5dc409dc20 con 0x7f5dd4101930 2024-09-21T12:09:37.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.721+0000 7f5dd37fe640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5dbc07af80 0x7f5dbc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:37.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.721+0000 7f5dd37fe640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5dbc07af80 0x7f5dbc07d440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8031460 tx=0x7f5dc8009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:37.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.725+0000 7f5dd17fa640 1 -- 172.21.15.118:0/3125260683 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5dc40691f0 con 0x7f5dd4101930 2024-09-21T12:09:37.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.974+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5dd4109ea0 con 0x7f5dd4101930 2024-09-21T12:09:37.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.975+0000 7f5dd17fa640 1 -- 172.21.15.118:0/3125260683 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f5dc406e0a0 con 0x7f5dd4101930 2024-09-21T12:09:37.976 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:09:37.976 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:09:37.976 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:09:37.977 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:09:37.978 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:09:37.978 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:09:37.978 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:09:37.978 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5dbc07af80 msgr2=0x7f5dbc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5dbc07af80 0x7f5dbc07d440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8031460 tx=0x7f5dc8009560 comp rx=0 tx=0).stop 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 msgr2=0x7f5dd419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 0x7f5dd419d690 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400d6f0 tx=0x7f5dc400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 shutdown_connections 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dd4107930 0x7f5dd419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5dbc07af80 0x7f5dbc07d440 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 --2- 172.21.15.118:0/3125260683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd4101930 0x7f5dd419d690 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 >> 172.21.15.118:0/3125260683 conn(0x7f5dd40fd630 msgr2=0x7f5dd40fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:37.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 shutdown_connections 2024-09-21T12:09:37.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:37.977+0000 7f5dda320640 1 -- 172.21.15.118:0/3125260683 wait complete. 2024-09-21T12:09:38.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.058+0000 7f7a011a2640 1 -- 172.21.15.118:0/3985520080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc100620 msgr2=0x7f79fc100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.059+0000 7f7a011a2640 1 --2- 172.21.15.118:0/3985520080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc100620 0x7f79fc100a80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009880 tx=0x7f79e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.059+0000 7f7a011a2640 1 -- 172.21.15.118:0/3985520080 shutdown_connections 2024-09-21T12:09:38.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.059+0000 7f7a011a2640 1 --2- 172.21.15.118:0/3985520080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc100620 0x7f79fc100a80 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.059+0000 7f7a011a2640 1 --2- 172.21.15.118:0/3985520080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79fc106620 0x7f79fc106a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.059+0000 7f7a011a2640 1 -- 172.21.15.118:0/3985520080 >> 172.21.15.118:0/3985520080 conn(0x7f79fc0fc360 msgr2=0x7f79fc0fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:38.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.059+0000 7f7a011a2640 1 -- 172.21.15.118:0/3985520080 shutdown_connections 2024-09-21T12:09:38.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.059+0000 7f7a011a2640 1 -- 172.21.15.118:0/3985520080 wait complete. 2024-09-21T12:09:38.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.059+0000 7f7a011a2640 1 Processor -- start 2024-09-21T12:09:38.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.059+0000 7f7a011a2640 1 -- start start 2024-09-21T12:09:38.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f7a011a2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79fc100620 0x7f79fc19d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:38.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f7a011a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc106620 0x7f79fc19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:38.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f7a011a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc10dad0 con 0x7f79fc106620 2024-09-21T12:09:38.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f7a011a2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc10d950 con 0x7f79fc100620 2024-09-21T12:09:38.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79fb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc106620 0x7f79fc19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:38.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79fb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc106620 0x7f79fc19d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41230/0 (socket says 172.21.15.118:41230) 2024-09-21T12:09:38.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79fb7fe640 1 -- 172.21.15.118:0/2353450397 learned_addr learned my addr 172.21.15.118:0/2353450397 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:38.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79fbfff640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79fc100620 0x7f79fc19d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:38.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79fb7fe640 1 -- 172.21.15.118:0/2353450397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79fc100620 msgr2=0x7f79fc19d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79fb7fe640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79fc100620 0x7f79fc19d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79fb7fe640 1 -- 172.21.15.118:0/2353450397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc1975c0 con 0x7f79fc106620 2024-09-21T12:09:38.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79fb7fe640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc106620 0x7f79fc19d940 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f79e4031460 tx=0x7f79e40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:38.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79f97fa640 1 -- 172.21.15.118:0/2353450397 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79e403f070 con 0x7f79fc106620 2024-09-21T12:09:38.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79fc197850 con 0x7f79fc106620 2024-09-21T12:09:38.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79f97fa640 1 -- 172.21.15.118:0/2353450397 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79e40035f0 con 0x7f79fc106620 2024-09-21T12:09:38.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.060+0000 7f79f97fa640 1 -- 172.21.15.118:0/2353450397 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79e4035030 con 0x7f79fc106620 2024-09-21T12:09:38.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.061+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79fc197d80 con 0x7f79fc106620 2024-09-21T12:09:38.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.061+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79fc101d60 con 0x7f79fc106620 2024-09-21T12:09:38.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.062+0000 7f79f97fa640 1 -- 172.21.15.118:0/2353450397 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f79e4042070 con 0x7f79fc106620 2024-09-21T12:09:38.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.063+0000 7f79f97fa640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79e807af30 0x7f79e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:38.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.063+0000 7f79fbfff640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79e807af30 0x7f79e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:38.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.063+0000 7f79f97fa640 1 -- 172.21.15.118:0/2353450397 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f79e40bea20 con 0x7f79fc106620 2024-09-21T12:09:38.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.063+0000 7f79fbfff640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79e807af30 0x7f79e807d3f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00bbe0 tx=0x7f79ec00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:38.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.067+0000 7f79f97fa640 1 -- 172.21.15.118:0/2353450397 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79e4089f70 con 0x7f79fc106620 2024-09-21T12:09:38.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.278+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f79fc198af0 con 0x7f79fc106620 2024-09-21T12:09:38.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.279+0000 7f79f97fa640 1 -- 172.21.15.118:0/2353450397 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f79e408ee20 con 0x7f79fc106620 2024-09-21T12:09:38.280 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:09:38.280 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:09:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:09:38.282 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:09:38.283 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:09:38.284 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:09:38.284 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:09:38.284 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:09:38.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79e807af30 msgr2=0x7f79e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79e807af30 0x7f79e807d3f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00bbe0 tx=0x7f79ec00b390 comp rx=0 tx=0).stop 2024-09-21T12:09:38.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc106620 msgr2=0x7f79fc19d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc106620 0x7f79fc19d940 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f79e4031460 tx=0x7f79e40045e0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 shutdown_connections 2024-09-21T12:09:38.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f79e807af30 0x7f79e807d3f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79fc106620 0x7f79fc19d940 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 --2- 172.21.15.118:0/2353450397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79fc100620 0x7f79fc19d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 >> 172.21.15.118:0/2353450397 conn(0x7f79fc0fc360 msgr2=0x7f79fc1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:38.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 shutdown_connections 2024-09-21T12:09:38.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.281+0000 7f7a011a2640 1 -- 172.21.15.118:0/2353450397 wait complete. 2024-09-21T12:09:38.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 -- 172.21.15.118:0/2814461254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150100820 msgr2=0x7fa150100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 --2- 172.21.15.118:0/2814461254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150100820 0x7fa150100c80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa144009880 tx=0x7fa14402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 -- 172.21.15.118:0/2814461254 shutdown_connections 2024-09-21T12:09:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 --2- 172.21.15.118:0/2814461254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150100820 0x7fa150100c80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 --2- 172.21.15.118:0/2814461254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa150106820 0x7fa150106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 -- 172.21.15.118:0/2814461254 >> 172.21.15.118:0/2814461254 conn(0x7fa1500fc520 msgr2=0x7fa1500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 -- 172.21.15.118:0/2814461254 shutdown_connections 2024-09-21T12:09:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 -- 172.21.15.118:0/2814461254 wait complete. 2024-09-21T12:09:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 Processor -- start 2024-09-21T12:09:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.365+0000 7fa154c62640 1 -- start start 2024-09-21T12:09:38.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa154c62640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa150100820 0x7fa15019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:38.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa154c62640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150106820 0x7fa15019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:38.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa154c62640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa15010dd50 con 0x7fa150106820 2024-09-21T12:09:38.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa154c62640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa15010dbd0 con 0x7fa150100820 2024-09-21T12:09:38.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa14dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150106820 0x7fa15019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:38.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa14dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150106820 0x7fa15019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41250/0 (socket says 172.21.15.118:41250) 2024-09-21T12:09:38.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa14dd9b640 1 -- 172.21.15.118:0/740602674 learned_addr learned my addr 172.21.15.118:0/740602674 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa14dd9b640 1 -- 172.21.15.118:0/740602674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa150100820 msgr2=0x7fa15019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa14dd9b640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa150100820 0x7fa15019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa14dd9b640 1 -- 172.21.15.118:0/740602674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa150197870 con 0x7fa150106820 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa14dd9b640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150106820 0x7fa15019dbf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa144031460 tx=0x7fa1440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.366+0000 7fa13f7fe640 1 -- 172.21.15.118:0/740602674 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa14403f070 con 0x7fa150106820 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.367+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa150197b00 con 0x7fa150106820 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.367+0000 7fa13f7fe640 1 -- 172.21.15.118:0/740602674 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa144004cf0 con 0x7fa150106820 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.367+0000 7fa13f7fe640 1 -- 172.21.15.118:0/740602674 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa144035030 con 0x7fa150106820 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.367+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa150198030 con 0x7fa150106820 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.368+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa150101f60 con 0x7fa150106820 2024-09-21T12:09:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.368+0000 7fa13f7fe640 1 -- 172.21.15.118:0/740602674 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa144042070 con 0x7fa150106820 2024-09-21T12:09:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.369+0000 7fa13f7fe640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa13807af30 0x7fa13807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.369+0000 7fa13f7fe640 1 -- 172.21.15.118:0/740602674 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa1440beb90 con 0x7fa150106820 2024-09-21T12:09:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.369+0000 7fa14e59c640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa13807af30 0x7fa13807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.369+0000 7fa14e59c640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa13807af30 0x7fa13807d3f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa1501989b0 tx=0x7fa140006c90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.373+0000 7fa13f7fe640 1 -- 172.21.15.118:0/740602674 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa14408a0e0 con 0x7fa150106820 2024-09-21T12:09:38.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.564+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa150198da0 con 0x7fa13807af30 2024-09-21T12:09:38.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.565+0000 7fa13f7fe640 1 -- 172.21.15.118:0/740602674 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa150198da0 con 0x7fa13807af30 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:09:38.567 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:09:38.568 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:09:38.568 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:09:38.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa13807af30 msgr2=0x7fa13807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa13807af30 0x7fa13807d3f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa1501989b0 tx=0x7fa140006c90 comp rx=0 tx=0).stop 2024-09-21T12:09:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150106820 msgr2=0x7fa15019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150106820 0x7fa15019dbf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa144031460 tx=0x7fa1440048f0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 shutdown_connections 2024-09-21T12:09:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa13807af30 0x7fa13807d3f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa150106820 0x7fa15019dbf0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 --2- 172.21.15.118:0/740602674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa150100820 0x7fa15019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 >> 172.21.15.118:0/740602674 conn(0x7fa1500fc520 msgr2=0x7fa15006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:38.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 shutdown_connections 2024-09-21T12:09:38.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.568+0000 7fa154c62640 1 -- 172.21.15.118:0/740602674 wait complete. 2024-09-21T12:09:38.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 -- 172.21.15.118:0/3941257941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c107930 msgr2=0x7f522c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 --2- 172.21.15.118:0/3941257941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c107930 0x7f522c107d10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f521c009880 tx=0x7f521c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 -- 172.21.15.118:0/3941257941 shutdown_connections 2024-09-21T12:09:38.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 --2- 172.21.15.118:0/3941257941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522c101930 0x7f522c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 --2- 172.21.15.118:0/3941257941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c107930 0x7f522c107d10 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 -- 172.21.15.118:0/3941257941 >> 172.21.15.118:0/3941257941 conn(0x7f522c0fd630 msgr2=0x7f522c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:38.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 -- 172.21.15.118:0/3941257941 shutdown_connections 2024-09-21T12:09:38.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 -- 172.21.15.118:0/3941257941 wait complete. 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 Processor -- start 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.649+0000 7f5231c92640 1 -- start start 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f5231c92640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c101930 0x7f522c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f5231c92640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522c107930 0x7f522c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f5231c92640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f522c10ede0 con 0x7f522c101930 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f5231c92640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f522c10ec60 con 0x7f522c107930 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f522b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c101930 0x7f522c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f522b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c101930 0x7f522c19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41280/0 (socket says 172.21.15.118:41280) 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f522b7fe640 1 -- 172.21.15.118:0/731469372 learned_addr learned my addr 172.21.15.118:0/731469372 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f5223fff640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522c107930 0x7f522c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f522b7fe640 1 -- 172.21.15.118:0/731469372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522c107930 msgr2=0x7f522c19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f522b7fe640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522c107930 0x7f522c19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f522b7fe640 1 -- 172.21.15.118:0/731469372 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c1977f0 con 0x7f522c101930 2024-09-21T12:09:38.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f522b7fe640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c101930 0x7f522c19d670 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f521c031460 tx=0x7f521c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:38.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f52297fa640 1 -- 172.21.15.118:0/731469372 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f521c03f070 con 0x7f522c101930 2024-09-21T12:09:38.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f52297fa640 1 -- 172.21.15.118:0/731469372 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f521c0035f0 con 0x7f522c101930 2024-09-21T12:09:38.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.650+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c197a80 con 0x7f522c101930 2024-09-21T12:09:38.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.651+0000 7f52297fa640 1 -- 172.21.15.118:0/731469372 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f521c035030 con 0x7f522c101930 2024-09-21T12:09:38.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.651+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c197fb0 con 0x7f522c101930 2024-09-21T12:09:38.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.652+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522c103070 con 0x7f522c101930 2024-09-21T12:09:38.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.652+0000 7f52297fa640 1 -- 172.21.15.118:0/731469372 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f521c042070 con 0x7f522c101930 2024-09-21T12:09:38.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.653+0000 7f52297fa640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f521807af80 0x7f521807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:09:38.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.653+0000 7f52297fa640 1 -- 172.21.15.118:0/731469372 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f521c0be910 con 0x7f522c101930 2024-09-21T12:09:38.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.653+0000 7f5223fff640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f521807af80 0x7f521807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:09:38.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.653+0000 7f5223fff640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f521807af80 0x7f521807d440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f522c0ffc80 tx=0x7f521400b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:09:38.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.657+0000 7f52297fa640 1 -- 172.21.15.118:0/731469372 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f521c089ee0 con 0x7f522c101930 2024-09-21T12:09:38.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.907+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f522c109ea0 con 0x7f522c101930 2024-09-21T12:09:38.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.907+0000 7f52297fa640 1 -- 172.21.15.118:0/731469372 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f521c08ed90 con 0x7f522c101930 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:09:38.909 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:09:38.910 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:09:38.911 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:09:38.911 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:09:38.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f521807af80 msgr2=0x7f521807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f521807af80 0x7f521807d440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f522c0ffc80 tx=0x7f521400b390 comp rx=0 tx=0).stop 2024-09-21T12:09:38.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c101930 msgr2=0x7f522c19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:09:38.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c101930 0x7f522c19d670 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f521c031460 tx=0x7f521c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 shutdown_connections 2024-09-21T12:09:38.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522c107930 0x7f522c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f521807af80 0x7f521807d440 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 --2- 172.21.15.118:0/731469372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f522c101930 0x7f522c19d670 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:09:38.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 >> 172.21.15.118:0/731469372 conn(0x7f522c0fd630 msgr2=0x7f522c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:09:38.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.909+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 shutdown_connections 2024-09-21T12:09:38.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:09:38.910+0000 7f5231c92640 1 -- 172.21.15.118:0/731469372 wait complete. 2024-09-21T12:09:39.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:38 smithi149 ceph-mon[79770]: pgmap v925: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:38 smithi149 ceph-mon[79770]: from='client.35480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:38 smithi149 ceph-mon[79770]: from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:38 smithi149 ceph-mon[79770]: from='client.35488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:38 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3125260683' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:09:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:38 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2353450397' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:09:39.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:38 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/731469372' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:09:39.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:38 smithi118 ceph-mon[111738]: pgmap v925: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:39.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:38 smithi118 ceph-mon[111738]: from='client.35480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:39.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:38 smithi118 ceph-mon[111738]: from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:39.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:38 smithi118 ceph-mon[111738]: from='client.35488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:39.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:38 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3125260683' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:09:39.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:38 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2353450397' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:09:39.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:38 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/731469372' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:09:40.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:39 smithi149 ceph-mon[79770]: from='client.35500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:39 smithi118 ceph-mon[111738]: from='client.35500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:09:41.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:40 smithi149 ceph-mon[79770]: pgmap v926: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:41.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:40 smithi118 ceph-mon[111738]: pgmap v926: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:43.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:42 smithi149 ceph-mon[79770]: pgmap v927: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:42 smithi118 ceph-mon[111738]: pgmap v927: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:45.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:44 smithi149 ceph-mon[79770]: pgmap v928: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:44 smithi118 ceph-mon[111738]: pgmap v928: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:47.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:46 smithi149 ceph-mon[79770]: pgmap v929: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:47.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:46 smithi118 ceph-mon[111738]: pgmap v929: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:47 smithi118 ceph-mon[111738]: pgmap v930: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:47 smithi149 ceph-mon[79770]: pgmap v930: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:50 smithi118 ceph-mon[111738]: pgmap v931: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:09:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:50 smithi149 ceph-mon[79770]: pgmap v931: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:09:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:52 smithi118 ceph-mon[111738]: pgmap v932: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:52.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:52 smithi149 ceph-mon[79770]: pgmap v932: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:54 smithi118 ceph-mon[111738]: pgmap v933: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:54.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:54 smithi149 ceph-mon[79770]: pgmap v933: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:56 smithi149 ceph-mon[79770]: pgmap v934: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:56 smithi118 ceph-mon[111738]: pgmap v934: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:58.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:09:58 smithi149 ceph-mon[79770]: pgmap v935: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:09:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:09:58 smithi118 ceph-mon[111738]: pgmap v935: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:10:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:10:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:10:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : /usr/bin/podman: timeout after 895 seconds 2024-09-21T12:10:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : Traceback (most recent call last): 2024-09-21T12:10:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:10:00.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : return _run_code(code, main_globals, None, 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : exec(code, run_globals) 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:00.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:09:59.999+0000 7fc62ea9b640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: pgmap v936: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: Health detail: HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: /usr/bin/podman: timeout after 895 seconds 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: Traceback (most recent call last): 2024-09-21T12:10:00.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: return _run_code(code, main_globals, None, 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: exec(code, run_globals) 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:10:00.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: fs cephfs is degraded 2024-09-21T12:10:00.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:10:00.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:10:00.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:10:00.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:00 smithi118 ceph-mon[111738]: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:10:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: pgmap v936: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: Health detail: HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:10:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:10:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:10:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: /usr/bin/podman: timeout after 895 seconds 2024-09-21T12:10:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: Traceback (most recent call last): 2024-09-21T12:10:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:10:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: return _run_code(code, main_globals, None, 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: exec(code, run_globals) 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: fs cephfs is degraded 2024-09-21T12:10:00.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:10:00.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:10:00.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:10:00.452 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:00 smithi149 ceph-mon[79770]: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:10:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:02 smithi149 ceph-mon[79770]: pgmap v937: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:02.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:02 smithi118 ceph-mon[111738]: pgmap v937: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:04 smithi118 ceph-mon[111738]: pgmap v938: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:04 smithi149 ceph-mon[79770]: pgmap v938: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:10:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:10:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:06 smithi149 ceph-mon[79770]: pgmap v939: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:06 smithi118 ceph-mon[111738]: pgmap v939: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:08 smithi149 ceph-mon[79770]: pgmap v940: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:08.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:08 smithi118 ceph-mon[111738]: pgmap v940: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.003+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3006086695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 msgr2=0x7f2ddc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.003+0000 7f2de2e6c640 1 --2- 172.21.15.118:0/3006086695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 0x7f2ddc100c40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009880 tx=0x7f2dcc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.003+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3006086695 shutdown_connections 2024-09-21T12:10:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.003+0000 7f2de2e6c640 1 --2- 172.21.15.118:0/3006086695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 0x7f2ddc100c40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.003+0000 7f2de2e6c640 1 --2- 172.21.15.118:0/3006086695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ddc1067e0 0x7f2ddc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.003+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3006086695 >> 172.21.15.118:0/3006086695 conn(0x7f2ddc0fc4c0 msgr2=0x7f2ddc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.003+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3006086695 shutdown_connections 2024-09-21T12:10:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.003+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3006086695 wait complete. 2024-09-21T12:10:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.004+0000 7f2de2e6c640 1 Processor -- start 2024-09-21T12:10:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.004+0000 7f2de2e6c640 1 -- start start 2024-09-21T12:10:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.004+0000 7f2de2e6c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 0x7f2ddc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.004+0000 7f2de2e6c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ddc1067e0 0x7f2ddc19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.004+0000 7f2de2e6c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc10dcb0 con 0x7f2ddc1007e0 2024-09-21T12:10:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.004+0000 7f2de2e6c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc10db30 con 0x7f2ddc1067e0 2024-09-21T12:10:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2de0c08640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 0x7f2ddc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2de0c08640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 0x7f2ddc19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41752/0 (socket says 172.21.15.118:41752) 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2de0c08640 1 -- 172.21.15.118:0/3124291533 learned_addr learned my addr 172.21.15.118:0/3124291533 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2dd3fff640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ddc1067e0 0x7f2ddc19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2de0c08640 1 -- 172.21.15.118:0/3124291533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ddc1067e0 msgr2=0x7f2ddc19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2de0c08640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ddc1067e0 0x7f2ddc19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2de0c08640 1 -- 172.21.15.118:0/3124291533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc197830 con 0x7f2ddc1007e0 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2de0c08640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 0x7f2ddc19d6b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800e970 tx=0x7f2dd800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2dd1ffb640 1 -- 172.21.15.118:0/3124291533 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2dd800cac0 con 0x7f2ddc1007e0 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2dd1ffb640 1 -- 172.21.15.118:0/3124291533 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2dd80054e0 con 0x7f2ddc1007e0 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc197b20 con 0x7f2ddc1007e0 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.005+0000 7f2dd1ffb640 1 -- 172.21.15.118:0/3124291533 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2dd8010430 con 0x7f2ddc1007e0 2024-09-21T12:10:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.006+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc198080 con 0x7f2ddc1007e0 2024-09-21T12:10:09.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.007+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ddc101f20 con 0x7f2ddc1007e0 2024-09-21T12:10:09.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.007+0000 7f2dd1ffb640 1 -- 172.21.15.118:0/3124291533 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2dd8004ec0 con 0x7f2ddc1007e0 2024-09-21T12:10:09.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.008+0000 7f2dd1ffb640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2dc407af30 0x7f2dc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.008+0000 7f2dd1ffb640 1 -- 172.21.15.118:0/3124291533 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2dd809e7d0 con 0x7f2ddc1007e0 2024-09-21T12:10:09.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.008+0000 7f2dd3fff640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2dc407af30 0x7f2dc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.008+0000 7f2dd3fff640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2dc407af30 0x7f2dc407d3f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc198b80 tx=0x7f2dcc031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:09.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.012+0000 7f2dd1ffb640 1 -- 172.21.15.118:0/3124291533 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2dd8069cc0 con 0x7f2ddc1007e0 2024-09-21T12:10:09.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.207+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2ddc198390 con 0x7f2dc407af30 2024-09-21T12:10:09.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.209+0000 7f2dd1ffb640 1 -- 172.21.15.118:0/3124291533 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2ddc198390 con 0x7f2dc407af30 2024-09-21T12:10:09.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2dc407af30 msgr2=0x7f2dc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2dc407af30 0x7f2dc407d3f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc198b80 tx=0x7f2dcc031400 comp rx=0 tx=0).stop 2024-09-21T12:10:09.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 msgr2=0x7f2ddc19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 0x7f2ddc19d6b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800e970 tx=0x7f2dd800ed70 comp rx=0 tx=0).stop 2024-09-21T12:10:09.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 shutdown_connections 2024-09-21T12:10:09.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ddc1067e0 0x7f2ddc19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2dc407af30 0x7f2dc407d3f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 --2- 172.21.15.118:0/3124291533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc1007e0 0x7f2ddc19d6b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 >> 172.21.15.118:0/3124291533 conn(0x7f2ddc0fc4c0 msgr2=0x7f2ddc069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:09.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 shutdown_connections 2024-09-21T12:10:09.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.211+0000 7f2de2e6c640 1 -- 172.21.15.118:0/3124291533 wait complete. 2024-09-21T12:10:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.294+0000 7fef0a1aa640 1 -- 172.21.15.118:0/1983246347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef04102aa0 msgr2=0x7fef04102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.294+0000 7fef0a1aa640 1 --2- 172.21.15.118:0/1983246347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef04102aa0 0x7fef04102e80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7feef4009880 tx=0x7feef402a530 comp rx=0 tx=0).stop 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.294+0000 7fef0a1aa640 1 -- 172.21.15.118:0/1983246347 shutdown_connections 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.294+0000 7fef0a1aa640 1 --2- 172.21.15.118:0/1983246347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef041033c0 0x7fef0410b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.294+0000 7fef0a1aa640 1 --2- 172.21.15.118:0/1983246347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef04102aa0 0x7fef04102e80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.294+0000 7fef0a1aa640 1 -- 172.21.15.118:0/1983246347 >> 172.21.15.118:0/1983246347 conn(0x7fef040fc4c0 msgr2=0x7fef040fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.294+0000 7fef0a1aa640 1 -- 172.21.15.118:0/1983246347 shutdown_connections 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.294+0000 7fef0a1aa640 1 -- 172.21.15.118:0/1983246347 wait complete. 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef0a1aa640 1 Processor -- start 2024-09-21T12:10:09.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef0a1aa640 1 -- start start 2024-09-21T12:10:09.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef0a1aa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef04102aa0 0x7fef0419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef0a1aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef041033c0 0x7fef0419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef0a1aa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fef0410ee30 con 0x7fef041033c0 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef0a1aa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef0410ecb0 con 0x7fef04102aa0 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef02ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef041033c0 0x7fef0419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef02ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef041033c0 0x7fef0419dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41784/0 (socket says 172.21.15.118:41784) 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef02ffd640 1 -- 172.21.15.118:0/3233781875 learned_addr learned my addr 172.21.15.118:0/3233781875 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.295+0000 7fef037fe640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef04102aa0 0x7fef0419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef02ffd640 1 -- 172.21.15.118:0/3233781875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef04102aa0 msgr2=0x7fef0419d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef02ffd640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef04102aa0 0x7fef0419d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef02ffd640 1 -- 172.21.15.118:0/3233781875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef041978e0 con 0x7fef041033c0 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef037fe640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef04102aa0 0x7fef0419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef02ffd640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef041033c0 0x7fef0419dc60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feef800b370 tx=0x7feef800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef00ff9640 1 -- 172.21.15.118:0/3233781875 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feef8015020 con 0x7fef041033c0 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef04197bd0 con 0x7fef041033c0 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef00ff9640 1 -- 172.21.15.118:0/3233781875 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feef8011af0 con 0x7fef041033c0 2024-09-21T12:10:09.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef00ff9640 1 -- 172.21.15.118:0/3233781875 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feef8010d60 con 0x7fef041033c0 2024-09-21T12:10:09.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.296+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef04198160 con 0x7fef041033c0 2024-09-21T12:10:09.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.297+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef0406a410 con 0x7fef041033c0 2024-09-21T12:10:09.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.298+0000 7fef00ff9640 1 -- 172.21.15.118:0/3233781875 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7feef8018020 con 0x7fef041033c0 2024-09-21T12:10:09.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.298+0000 7fef00ff9640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feeec07af30 0x7feeec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.298+0000 7fef00ff9640 1 -- 172.21.15.118:0/3233781875 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7feef809da20 con 0x7fef041033c0 2024-09-21T12:10:09.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.298+0000 7fef037fe640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feeec07af30 0x7feeec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.299+0000 7fef037fe640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feeec07af30 0x7feeec07d3f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feef4000c00 tx=0x7feef4031420 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:09.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.303+0000 7fef00ff9640 1 -- 172.21.15.118:0/3233781875 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feef801f020 con 0x7fef041033c0 2024-09-21T12:10:09.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.497+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fef04198e10 con 0x7feeec07af30 2024-09-21T12:10:09.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.498+0000 7fef00ff9640 1 -- 172.21.15.118:0/3233781875 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fef04198e10 con 0x7feeec07af30 2024-09-21T12:10:09.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feeec07af30 msgr2=0x7feeec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feeec07af30 0x7feeec07d3f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feef4000c00 tx=0x7feef4031420 comp rx=0 tx=0).stop 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef041033c0 msgr2=0x7fef0419dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef041033c0 0x7fef0419dc60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feef800b370 tx=0x7feef800b830 comp rx=0 tx=0).stop 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 shutdown_connections 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feeec07af30 0x7feeec07d3f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef041033c0 0x7fef0419dc60 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 --2- 172.21.15.118:0/3233781875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef04102aa0 0x7fef0419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 >> 172.21.15.118:0/3233781875 conn(0x7fef040fc4c0 msgr2=0x7fef04108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 shutdown_connections 2024-09-21T12:10:09.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.500+0000 7fef0a1aa640 1 -- 172.21.15.118:0/3233781875 wait complete. 2024-09-21T12:10:09.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.582+0000 7f1984333640 1 -- 172.21.15.118:0/1253915951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100070 msgr2=0x7f197c100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.582+0000 7f1984333640 1 --2- 172.21.15.118:0/1253915951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100070 0x7f197c100450 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1978009880 tx=0x7f197802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.582+0000 7f1984333640 1 -- 172.21.15.118:0/1253915951 shutdown_connections 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.582+0000 7f1984333640 1 --2- 172.21.15.118:0/1253915951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f197c100a20 0x7f197c106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.582+0000 7f1984333640 1 --2- 172.21.15.118:0/1253915951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100070 0x7f197c100450 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f1984333640 1 -- 172.21.15.118:0/1253915951 >> 172.21.15.118:0/1253915951 conn(0x7f197c0fbc40 msgr2=0x7f197c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f1984333640 1 -- 172.21.15.118:0/1253915951 shutdown_connections 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f1984333640 1 -- 172.21.15.118:0/1253915951 wait complete. 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f1984333640 1 Processor -- start 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f1984333640 1 -- start start 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f1984333640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f197c100070 0x7f197c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f1984333640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100a20 0x7f197c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f1984333640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f197c10ede0 con 0x7f197c100a20 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f1984333640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f197c10ec60 con 0x7f197c100070 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.583+0000 7f19818ce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100a20 0x7f197c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19818ce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100a20 0x7f197c19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41792/0 (socket says 172.21.15.118:41792) 2024-09-21T12:10:09.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19818ce640 1 -- 172.21.15.118:0/3446267325 learned_addr learned my addr 172.21.15.118:0/3446267325 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19820cf640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f197c100070 0x7f197c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19818ce640 1 -- 172.21.15.118:0/3446267325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f197c100070 msgr2=0x7f197c19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19818ce640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f197c100070 0x7f197c19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19818ce640 1 -- 172.21.15.118:0/3446267325 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c1977d0 con 0x7f197c100a20 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19820cf640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f197c100070 0x7f197c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19818ce640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100a20 0x7f197c19db90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f196c00c8f0 tx=0x7f196c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19737fe640 1 -- 172.21.15.118:0/3446267325 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f196c0079b0 con 0x7f197c100a20 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19737fe640 1 -- 172.21.15.118:0/3446267325 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f196c0054e0 con 0x7f197c100a20 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c197ac0 con 0x7f197c100a20 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f19737fe640 1 -- 172.21.15.118:0/3446267325 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f196c004dd0 con 0x7f197c100a20 2024-09-21T12:10:09.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.584+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197c198050 con 0x7f197c100a20 2024-09-21T12:10:09.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.585+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197c103130 con 0x7f197c100a20 2024-09-21T12:10:09.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.586+0000 7f19737fe640 1 -- 172.21.15.118:0/3446267325 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f196c005020 con 0x7f197c100a20 2024-09-21T12:10:09.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.586+0000 7f19737fe640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f196807aed0 0x7f196807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.586+0000 7f19737fe640 1 -- 172.21.15.118:0/3446267325 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f196c09e080 con 0x7f197c100a20 2024-09-21T12:10:09.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.586+0000 7f19820cf640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f196807aed0 0x7f196807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.587+0000 7f19820cf640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f196807aed0 0x7f196807d390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1978031460 tx=0x7f1978009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:09.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.591+0000 7f19737fe640 1 -- 172.21.15.118:0/3446267325 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f196c014030 con 0x7f197c100a20 2024-09-21T12:10:09.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.792+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f197c198360 con 0x7f196807aed0 2024-09-21T12:10:09.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.801+0000 7f19737fe640 1 -- 172.21.15.118:0/3446267325 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f197c198360 con 0x7f196807aed0 2024-09-21T12:10:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (28m) 6m ago 39m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (31m) 6m ago 39m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (30m) 6m ago 38m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (26m) 6m ago 39m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (26m) 6m ago 38m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (27m) 6m ago 38m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (22m) 6m ago 33m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (22m) 6m ago 33m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (6m) 6m ago 33m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (21m) 6m ago 33m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (30m) 6m ago 40m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (29m) 6m ago 38m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (26m) 6m ago 40m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (26m) 6m ago 38m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:10:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (28m) 6m ago 39m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:10:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (28m) 6m ago 38m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:10:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (25m) 6m ago 37m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:10:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (25m) 6m ago 36m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:10:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (24m) 6m ago 36m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:10:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (23m) 6m ago 35m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:10:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (23m) 6m ago 35m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:10:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (22m) 6m ago 34m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:10:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (28m) 6m ago 38m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.803+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f196807aed0 msgr2=0x7f196807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.803+0000 7f1984333640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f196807aed0 0x7f196807d390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1978031460 tx=0x7f1978009560 comp rx=0 tx=0).stop 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.803+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100a20 msgr2=0x7f197c19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.803+0000 7f1984333640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100a20 0x7f197c19db90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f196c00c8f0 tx=0x7f196c00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.803+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 shutdown_connections 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.803+0000 7f1984333640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f196807aed0 0x7f196807d390 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.803+0000 7f1984333640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f197c100a20 0x7f197c19db90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.803+0000 7f1984333640 1 --2- 172.21.15.118:0/3446267325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f197c100070 0x7f197c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.803+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 >> 172.21.15.118:0/3446267325 conn(0x7f197c0fbc40 msgr2=0x7f197c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.804+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 shutdown_connections 2024-09-21T12:10:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.804+0000 7f1984333640 1 -- 172.21.15.118:0/3446267325 wait complete. 2024-09-21T12:10:09.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.887+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/2670647158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0106820 msgr2=0x7fd7b0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.887+0000 7fd7b6b8b640 1 --2- 172.21.15.118:0/2670647158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0106820 0x7fd7b0106c00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009880 tx=0x7fd7ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.887+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/2670647158 shutdown_connections 2024-09-21T12:10:09.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.887+0000 7fd7b6b8b640 1 --2- 172.21.15.118:0/2670647158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b0100820 0x7fd7b0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.887+0000 7fd7b6b8b640 1 --2- 172.21.15.118:0/2670647158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0106820 0x7fd7b0106c00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.887+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/2670647158 >> 172.21.15.118:0/2670647158 conn(0x7fd7b00fc520 msgr2=0x7fd7b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:09.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.887+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/2670647158 shutdown_connections 2024-09-21T12:10:09.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.887+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/2670647158 wait complete. 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7b6b8b640 1 Processor -- start 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7b6b8b640 1 -- start start 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7b6b8b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0100820 0x7fd7b019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7b6b8b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b0106820 0x7fd7b019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7b6b8b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b010dcd0 con 0x7fd7b0100820 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7b6b8b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b010db50 con 0x7fd7b0106820 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7b4927640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0100820 0x7fd7b019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7b4927640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0100820 0x7fd7b019d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41820/0 (socket says 172.21.15.118:41820) 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7b4927640 1 -- 172.21.15.118:0/574276915 learned_addr learned my addr 172.21.15.118:0/574276915 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.888+0000 7fd7a7fff640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b0106820 0x7fd7b019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.889+0000 7fd7b4927640 1 -- 172.21.15.118:0/574276915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b0106820 msgr2=0x7fd7b019db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.889+0000 7fd7b4927640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b0106820 0x7fd7b019db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.889+0000 7fd7b4927640 1 -- 172.21.15.118:0/574276915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b0197790 con 0x7fd7b0100820 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.889+0000 7fd7b4927640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0100820 0x7fd7b019d610 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac031460 tx=0x7fd7ac004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.889+0000 7fd7a5ffb640 1 -- 172.21.15.118:0/574276915 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac03f070 con 0x7fd7b0100820 2024-09-21T12:10:09.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.889+0000 7fd7a5ffb640 1 -- 172.21.15.118:0/574276915 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7ac0035f0 con 0x7fd7b0100820 2024-09-21T12:10:09.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.889+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b0197a20 con 0x7fd7b0100820 2024-09-21T12:10:09.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.889+0000 7fd7a5ffb640 1 -- 172.21.15.118:0/574276915 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac035030 con 0x7fd7b0100820 2024-09-21T12:10:09.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.889+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b0197f50 con 0x7fd7b0100820 2024-09-21T12:10:09.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.890+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b0101f60 con 0x7fd7b0100820 2024-09-21T12:10:09.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.891+0000 7fd7a5ffb640 1 -- 172.21.15.118:0/574276915 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd7ac042070 con 0x7fd7b0100820 2024-09-21T12:10:09.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.891+0000 7fd7a5ffb640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd79807af80 0x7fd79807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:09.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.891+0000 7fd7a5ffb640 1 -- 172.21.15.118:0/574276915 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd7ac0be990 con 0x7fd7b0100820 2024-09-21T12:10:09.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.891+0000 7fd7a7fff640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd79807af80 0x7fd79807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:09.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.892+0000 7fd7a7fff640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd79807af80 0x7fd79807d440 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00ffb50 tx=0x7fd7a0005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:09.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:09.896+0000 7fd7a5ffb640 1 -- 172.21.15.118:0/574276915 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7ac089f60 con 0x7fd7b0100820 2024-09-21T12:10:10.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.148+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd7b01982c0 con 0x7fd7b0100820 2024-09-21T12:10:10.151 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:10 smithi118 ceph-mon[111738]: pgmap v941: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:10.151 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:10 smithi118 ceph-mon[111738]: from='client.35508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:10.151 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:10 smithi118 ceph-mon[111738]: from='client.35512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:10.151 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:10 smithi118 ceph-mon[111738]: from='client.35516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:10.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.149+0000 7fd7a5ffb640 1 -- 172.21.15.118:0/574276915 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd7ac08ee10 con 0x7fd7b0100820 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:10:10.152 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:10:10.153 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:10:10.153 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:10:10.153 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:10:10.153 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd79807af80 msgr2=0x7fd79807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd79807af80 0x7fd79807d440 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00ffb50 tx=0x7fd7a0005f90 comp rx=0 tx=0).stop 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0100820 msgr2=0x7fd7b019d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0100820 0x7fd7b019d610 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac031460 tx=0x7fd7ac004530 comp rx=0 tx=0).stop 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 shutdown_connections 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b0106820 0x7fd7b019db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd79807af80 0x7fd79807d440 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 --2- 172.21.15.118:0/574276915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7b0100820 0x7fd7b019d610 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 >> 172.21.15.118:0/574276915 conn(0x7fd7b00fc520 msgr2=0x7fd7b006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 shutdown_connections 2024-09-21T12:10:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.152+0000 7fd7b6b8b640 1 -- 172.21.15.118:0/574276915 wait complete. 2024-09-21T12:10:10.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.233+0000 7f71b3fd2640 1 -- 172.21.15.118:0/1901526853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 msgr2=0x7f71ac106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.233+0000 7f71b3fd2640 1 --2- 172.21.15.118:0/1901526853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 0x7f71ac106c00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009880 tx=0x7f71a802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.233+0000 7f71b3fd2640 1 -- 172.21.15.118:0/1901526853 shutdown_connections 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.233+0000 7f71b3fd2640 1 --2- 172.21.15.118:0/1901526853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71ac100820 0x7f71ac100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.233+0000 7f71b3fd2640 1 --2- 172.21.15.118:0/1901526853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 0x7f71ac106c00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.233+0000 7f71b3fd2640 1 -- 172.21.15.118:0/1901526853 >> 172.21.15.118:0/1901526853 conn(0x7f71ac0fc520 msgr2=0x7f71ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.233+0000 7f71b3fd2640 1 -- 172.21.15.118:0/1901526853 shutdown_connections 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.233+0000 7f71b3fd2640 1 -- 172.21.15.118:0/1901526853 wait complete. 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b3fd2640 1 Processor -- start 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b3fd2640 1 -- start start 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b3fd2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71ac100820 0x7f71ac19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b3fd2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 0x7f71ac19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b3fd2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac10ee10 con 0x7f71ac106820 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b3fd2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac10ec90 con 0x7f71ac100820 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b156d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 0x7f71ac19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:10.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b156d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 0x7f71ac19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41850/0 (socket says 172.21.15.118:41850) 2024-09-21T12:10:10.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b156d640 1 -- 172.21.15.118:0/336632280 learned_addr learned my addr 172.21.15.118:0/336632280 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:10.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b1d6e640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71ac100820 0x7f71ac19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:10.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b156d640 1 -- 172.21.15.118:0/336632280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71ac100820 msgr2=0x7f71ac19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b156d640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71ac100820 0x7f71ac19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.234+0000 7f71b156d640 1 -- 172.21.15.118:0/336632280 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac197820 con 0x7f71ac106820 2024-09-21T12:10:10.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.235+0000 7f71b156d640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 0x7f71ac19dbe0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f719c00d6f0 tx=0x7f719c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:10.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.235+0000 7f71a2ffd640 1 -- 172.21.15.118:0/336632280 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f719c017070 con 0x7f71ac106820 2024-09-21T12:10:10.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.235+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac197b10 con 0x7f71ac106820 2024-09-21T12:10:10.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.235+0000 7f71a2ffd640 1 -- 172.21.15.118:0/336632280 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f719c00de00 con 0x7f71ac106820 2024-09-21T12:10:10.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.235+0000 7f71a2ffd640 1 -- 172.21.15.118:0/336632280 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f719c004bb0 con 0x7f71ac106820 2024-09-21T12:10:10.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.235+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1980a0 con 0x7f71ac106820 2024-09-21T12:10:10.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.236+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac101f60 con 0x7f71ac106820 2024-09-21T12:10:10.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.236+0000 7f71a2ffd640 1 -- 172.21.15.118:0/336632280 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f719c004e60 con 0x7f71ac106820 2024-09-21T12:10:10.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.237+0000 7f71a2ffd640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f719807af30 0x7f719807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:10.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.237+0000 7f71a2ffd640 1 -- 172.21.15.118:0/336632280 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f719c09dcf0 con 0x7f71ac106820 2024-09-21T12:10:10.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.237+0000 7f71b1d6e640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f719807af30 0x7f719807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:10.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.237+0000 7f71b1d6e640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f719807af30 0x7f719807d3f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f71a80096c0 tx=0x7f71a8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:10.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.241+0000 7f71a2ffd640 1 -- 172.21.15.118:0/336632280 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f719c0691a0 con 0x7f71ac106820 2024-09-21T12:10:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:10 smithi149 ceph-mon[79770]: pgmap v941: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:10 smithi149 ceph-mon[79770]: from='client.35508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:10 smithi149 ceph-mon[79770]: from='client.35512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:10 smithi149 ceph-mon[79770]: from='client.35516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.457+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f71ac108d90 con 0x7f71ac106820 2024-09-21T12:10:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.458+0000 7f71a2ffd640 1 -- 172.21.15.118:0/336632280 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f719c06e050 con 0x7f71ac106820 2024-09-21T12:10:10.460 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:10:10.460 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:10:10.460 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:10:10.460 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:10:10.461 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:10:10.462 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:10:10.463 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:10:10.463 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:10:10.463 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:10:10.463 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:10:10.463 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:10:10.463 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:10:10.463 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:10:10.463 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.460+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f719807af30 msgr2=0x7f719807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.460+0000 7f71b3fd2640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f719807af30 0x7f719807d3f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f71a80096c0 tx=0x7f71a8031400 comp rx=0 tx=0).stop 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.460+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 msgr2=0x7f71ac19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.460+0000 7f71b3fd2640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 0x7f71ac19dbe0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f719c00d6f0 tx=0x7f719c00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.461+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 shutdown_connections 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.461+0000 7f71b3fd2640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f719807af30 0x7f719807d3f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.461+0000 7f71b3fd2640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71ac106820 0x7f71ac19dbe0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.461+0000 7f71b3fd2640 1 --2- 172.21.15.118:0/336632280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71ac100820 0x7f71ac19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.461+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 >> 172.21.15.118:0/336632280 conn(0x7f71ac0fc520 msgr2=0x7f71ac0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.461+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 shutdown_connections 2024-09-21T12:10:10.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.461+0000 7f71b3fd2640 1 -- 172.21.15.118:0/336632280 wait complete. 2024-09-21T12:10:10.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.543+0000 7f39db669640 1 -- 172.21.15.118:0/1555541949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4106820 msgr2=0x7f39d4106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.543+0000 7f39db669640 1 --2- 172.21.15.118:0/1555541949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4106820 0x7f39d4106c00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009880 tx=0x7f39c802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.543+0000 7f39db669640 1 -- 172.21.15.118:0/1555541949 shutdown_connections 2024-09-21T12:10:10.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.543+0000 7f39db669640 1 --2- 172.21.15.118:0/1555541949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39d4100820 0x7f39d4100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.543+0000 7f39db669640 1 --2- 172.21.15.118:0/1555541949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4106820 0x7f39d4106c00 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.543+0000 7f39db669640 1 -- 172.21.15.118:0/1555541949 >> 172.21.15.118:0/1555541949 conn(0x7f39d40fc520 msgr2=0x7f39d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:10.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.543+0000 7f39db669640 1 -- 172.21.15.118:0/1555541949 shutdown_connections 2024-09-21T12:10:10.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.543+0000 7f39db669640 1 -- 172.21.15.118:0/1555541949 wait complete. 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39db669640 1 Processor -- start 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39db669640 1 -- start start 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39db669640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4100820 0x7f39d419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39db669640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39d4106820 0x7f39d419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39db669640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f39d410dcf0 con 0x7f39d4100820 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39db669640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f39d410db70 con 0x7f39d4106820 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39d9405640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4100820 0x7f39d419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39d9405640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4100820 0x7f39d419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41868/0 (socket says 172.21.15.118:41868) 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39d9405640 1 -- 172.21.15.118:0/2685162874 learned_addr learned my addr 172.21.15.118:0/2685162874 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39d8c04640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39d4106820 0x7f39d419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39d9405640 1 -- 172.21.15.118:0/2685162874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39d4106820 msgr2=0x7f39d419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39d9405640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39d4106820 0x7f39d419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.544+0000 7f39d9405640 1 -- 172.21.15.118:0/2685162874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d41977e0 con 0x7f39d4100820 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.545+0000 7f39d9405640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4100820 0x7f39d419d660 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f39c8031460 tx=0x7f39c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.545+0000 7f39c67fc640 1 -- 172.21.15.118:0/2685162874 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39c803f070 con 0x7f39d4100820 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.545+0000 7f39c67fc640 1 -- 172.21.15.118:0/2685162874 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39c8004cf0 con 0x7f39d4100820 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.545+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d4197a70 con 0x7f39d4100820 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.545+0000 7f39c67fc640 1 -- 172.21.15.118:0/2685162874 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39c8035030 con 0x7f39d4100820 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.545+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d4197fa0 con 0x7f39d4100820 2024-09-21T12:10:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.546+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d4101f60 con 0x7f39d4100820 2024-09-21T12:10:10.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.547+0000 7f39c67fc640 1 -- 172.21.15.118:0/2685162874 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f39c8042070 con 0x7f39d4100820 2024-09-21T12:10:10.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.547+0000 7f39c67fc640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f39c007af80 0x7f39c007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:10.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.547+0000 7f39c67fc640 1 -- 172.21.15.118:0/2685162874 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f39c80be9e0 con 0x7f39d4100820 2024-09-21T12:10:10.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.547+0000 7f39d8c04640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f39c007af80 0x7f39c007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:10.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.548+0000 7f39d8c04640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f39c007af80 0x7f39c007d440 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f39d4104fa0 tx=0x7f39d000a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:10.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.551+0000 7f39c67fc640 1 -- 172.21.15.118:0/2685162874 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39c8089fb0 con 0x7f39d4100820 2024-09-21T12:10:10.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.745+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f39d4198250 con 0x7f39c007af80 2024-09-21T12:10:10.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.746+0000 7f39c67fc640 1 -- 172.21.15.118:0/2685162874 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f39d4198250 con 0x7f39c007af80 2024-09-21T12:10:10.748 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:10:10.748 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:10:10.748 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:10:10.748 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:10:10.748 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:10:10.749 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.748+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f39c007af80 msgr2=0x7f39c007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.748+0000 7f39db669640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f39c007af80 0x7f39c007d440 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f39d4104fa0 tx=0x7f39d000a250 comp rx=0 tx=0).stop 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.748+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4100820 msgr2=0x7f39d419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.748+0000 7f39db669640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4100820 0x7f39d419d660 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f39c8031460 tx=0x7f39c80048f0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.748+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 shutdown_connections 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.748+0000 7f39db669640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39d4106820 0x7f39d419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.748+0000 7f39db669640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f39c007af80 0x7f39c007d440 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.748+0000 7f39db669640 1 --2- 172.21.15.118:0/2685162874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39d4100820 0x7f39d419d660 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.748+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 >> 172.21.15.118:0/2685162874 conn(0x7f39d40fc520 msgr2=0x7f39d406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.749+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 shutdown_connections 2024-09-21T12:10:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.749+0000 7f39db669640 1 -- 172.21.15.118:0/2685162874 wait complete. 2024-09-21T12:10:10.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.830+0000 7f2282220640 1 -- 172.21.15.118:0/740391834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 msgr2=0x7f227c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.830+0000 7f2282220640 1 --2- 172.21.15.118:0/740391834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 0x7f227c100c80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2264009880 tx=0x7f226402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.830+0000 7f2282220640 1 -- 172.21.15.118:0/740391834 shutdown_connections 2024-09-21T12:10:10.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.830+0000 7f2282220640 1 --2- 172.21.15.118:0/740391834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 0x7f227c100c80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.830+0000 7f2282220640 1 --2- 172.21.15.118:0/740391834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f227c106820 0x7f227c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.830+0000 7f2282220640 1 -- 172.21.15.118:0/740391834 >> 172.21.15.118:0/740391834 conn(0x7f227c0fc520 msgr2=0x7f227c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:10.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.830+0000 7f2282220640 1 -- 172.21.15.118:0/740391834 shutdown_connections 2024-09-21T12:10:10.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.830+0000 7f2282220640 1 -- 172.21.15.118:0/740391834 wait complete. 2024-09-21T12:10:10.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f2282220640 1 Processor -- start 2024-09-21T12:10:10.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f2282220640 1 -- start start 2024-09-21T12:10:10.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f2282220640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 0x7f227c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:10.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f2282220640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f227c106820 0x7f227c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:10.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f2282220640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f227c10dd50 con 0x7f227c100820 2024-09-21T12:10:10.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f2282220640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f227c10dbd0 con 0x7f227c106820 2024-09-21T12:10:10.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f227b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 0x7f227c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:10.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f227b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 0x7f227c198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41900/0 (socket says 172.21.15.118:41900) 2024-09-21T12:10:10.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f227b7fe640 1 -- 172.21.15.118:0/3273916643 learned_addr learned my addr 172.21.15.118:0/3273916643 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:10.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f2273fff640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f227c106820 0x7f227c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:10.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f227b7fe640 1 -- 172.21.15.118:0/3273916643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f227c106820 msgr2=0x7f227c198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:10.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f227b7fe640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f227c106820 0x7f227c198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:10.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f227b7fe640 1 -- 172.21.15.118:0/3273916643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c1993b0 con 0x7f227c100820 2024-09-21T12:10:10.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.831+0000 7f227b7fe640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 0x7f227c198870 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f226c00b420 tx=0x7f226c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:10.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.832+0000 7f22797fa640 1 -- 172.21.15.118:0/3273916643 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f226c011630 con 0x7f227c100820 2024-09-21T12:10:10.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.832+0000 7f22797fa640 1 -- 172.21.15.118:0/3273916643 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f226c016070 con 0x7f227c100820 2024-09-21T12:10:10.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.832+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227c1996a0 con 0x7f227c100820 2024-09-21T12:10:10.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.832+0000 7f22797fa640 1 -- 172.21.15.118:0/3273916643 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f226c010d40 con 0x7f227c100820 2024-09-21T12:10:10.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.832+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227c1a1ca0 con 0x7f227c100820 2024-09-21T12:10:10.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.833+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f227c101f60 con 0x7f227c100820 2024-09-21T12:10:10.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.833+0000 7f22797fa640 1 -- 172.21.15.118:0/3273916643 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f226c01b460 con 0x7f227c100820 2024-09-21T12:10:10.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.834+0000 7f22797fa640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f226807af30 0x7f226807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:10.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.834+0000 7f22797fa640 1 -- 172.21.15.118:0/3273916643 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f226c09d7f0 con 0x7f227c100820 2024-09-21T12:10:10.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.834+0000 7f2273fff640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f226807af30 0x7f226807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:10.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.834+0000 7f2273fff640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f226807af30 0x7f226807d3f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2264031460 tx=0x7f2264009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:10.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:10.838+0000 7f22797fa640 1 -- 172.21.15.118:0/3273916643 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f227c1996a0 con 0x7f227c100820 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.085+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f227c108db0 con 0x7f227c100820 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.086+0000 7f22797fa640 1 -- 172.21.15.118:0/3273916643 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f226c068d40 con 0x7f227c100820 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:10:11.088 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:10:11.089 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:10:11.090 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:10:11.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f226807af30 msgr2=0x7f226807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:11.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f226807af30 0x7f226807d3f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2264031460 tx=0x7f2264009560 comp rx=0 tx=0).stop 2024-09-21T12:10:11.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 msgr2=0x7f227c198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:11.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 0x7f227c198870 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f226c00b420 tx=0x7f226c00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:10:11.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 shutdown_connections 2024-09-21T12:10:11.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f227c106820 0x7f227c198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:11.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f226807af30 0x7f226807d3f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:11.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 --2- 172.21.15.118:0/3273916643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f227c100820 0x7f227c198870 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:11.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 >> 172.21.15.118:0/3273916643 conn(0x7f227c0fc520 msgr2=0x7f227c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:11.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 shutdown_connections 2024-09-21T12:10:11.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:11.088+0000 7f2282220640 1 -- 172.21.15.118:0/3273916643 wait complete. 2024-09-21T12:10:11.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:11 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/574276915' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:10:11.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:11 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/336632280' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:10:11.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:11 smithi149 ceph-mon[79770]: from='client.35528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:11.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:11 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3273916643' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:10:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:11 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/574276915' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:10:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:11 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/336632280' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:10:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:11 smithi118 ceph-mon[111738]: from='client.35528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:11.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:11 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3273916643' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:10:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:12 smithi118 ceph-mon[111738]: pgmap v942: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:12 smithi149 ceph-mon[79770]: pgmap v942: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:14.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:14 smithi118 ceph-mon[111738]: pgmap v943: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:14 smithi149 ceph-mon[79770]: pgmap v943: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:16 smithi149 ceph-mon[79770]: pgmap v944: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:16 smithi118 ceph-mon[111738]: pgmap v944: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:18 smithi149 ceph-mon[79770]: pgmap v945: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:18.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:18 smithi118 ceph-mon[111738]: pgmap v945: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:20 smithi149 ceph-mon[79770]: pgmap v946: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:10:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:20 smithi118 ceph-mon[111738]: pgmap v946: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:10:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:22 smithi149 ceph-mon[79770]: pgmap v947: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:22.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:22 smithi118 ceph-mon[111738]: pgmap v947: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:24.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:24 smithi118 ceph-mon[111738]: pgmap v948: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:24 smithi149 ceph-mon[79770]: pgmap v948: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:26.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:26 smithi149 ceph-mon[79770]: pgmap v949: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:26 smithi118 ceph-mon[111738]: pgmap v949: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:28 smithi149 ceph-mon[79770]: pgmap v950: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:28.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:28 smithi118 ceph-mon[111738]: pgmap v950: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:30 smithi149 ceph-mon[79770]: pgmap v951: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:30.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:30 smithi118 ceph-mon[111738]: pgmap v951: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:32 smithi149 ceph-mon[79770]: pgmap v952: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:32 smithi118 ceph-mon[111738]: pgmap v952: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:34.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:34 smithi118 ceph-mon[111738]: pgmap v953: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:34 smithi149 ceph-mon[79770]: pgmap v953: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:10:35.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:10:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:36 smithi149 ceph-mon[79770]: pgmap v954: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:36 smithi118 ceph-mon[111738]: pgmap v954: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:38 smithi149 ceph-mon[79770]: pgmap v955: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:38.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:38 smithi118 ceph-mon[111738]: pgmap v955: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:40 smithi149 ceph-mon[79770]: pgmap v956: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:40.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:40 smithi118 ceph-mon[111738]: pgmap v956: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:41.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.183+0000 7f609e154640 1 -- 172.21.15.118:0/2066544571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 msgr2=0x7f6098106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.183+0000 7f609e154640 1 --2- 172.21.15.118:0/2066544571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 0x7f6098106bc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6088009880 tx=0x7f608802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.183+0000 7f609e154640 1 -- 172.21.15.118:0/2066544571 shutdown_connections 2024-09-21T12:10:41.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.183+0000 7f609e154640 1 --2- 172.21.15.118:0/2066544571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60981007e0 0x7f6098100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.183+0000 7f609e154640 1 --2- 172.21.15.118:0/2066544571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 0x7f6098106bc0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.183+0000 7f609e154640 1 -- 172.21.15.118:0/2066544571 >> 172.21.15.118:0/2066544571 conn(0x7f60980fc4c0 msgr2=0x7f60980fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:41.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.183+0000 7f609e154640 1 -- 172.21.15.118:0/2066544571 shutdown_connections 2024-09-21T12:10:41.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.183+0000 7f609e154640 1 -- 172.21.15.118:0/2066544571 wait complete. 2024-09-21T12:10:41.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f609e154640 1 Processor -- start 2024-09-21T12:10:41.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f609e154640 1 -- start start 2024-09-21T12:10:41.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f609e154640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60981007e0 0x7f60981987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:41.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f609e154640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 0x7f6098198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:41.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f609e154640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f609810dcb0 con 0x7f60981067e0 2024-09-21T12:10:41.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f609e154640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f609810db30 con 0x7f60981007e0 2024-09-21T12:10:41.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f608ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 0x7f6098198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:41.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f608ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 0x7f6098198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43972/0 (socket says 172.21.15.118:43972) 2024-09-21T12:10:41.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f608ffff640 1 -- 172.21.15.118:0/2339206339 learned_addr learned my addr 172.21.15.118:0/2339206339 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:41.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.184+0000 7f60977fe640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60981007e0 0x7f60981987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:41.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.185+0000 7f608ffff640 1 -- 172.21.15.118:0/2339206339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60981007e0 msgr2=0x7f60981987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.185+0000 7f608ffff640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60981007e0 0x7f60981987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.185+0000 7f608ffff640 1 -- 172.21.15.118:0/2339206339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6098199370 con 0x7f60981067e0 2024-09-21T12:10:41.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.185+0000 7f608ffff640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 0x7f6098198d20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f608000c8f0 tx=0x7f608000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:41.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.185+0000 7f60957fa640 1 -- 172.21.15.118:0/2339206339 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60800079b0 con 0x7f60981067e0 2024-09-21T12:10:41.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.185+0000 7f60957fa640 1 -- 172.21.15.118:0/2339206339 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60800054e0 con 0x7f60981067e0 2024-09-21T12:10:41.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.185+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60981a1850 con 0x7f60981067e0 2024-09-21T12:10:41.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.185+0000 7f60957fa640 1 -- 172.21.15.118:0/2339206339 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6080004dd0 con 0x7f60981067e0 2024-09-21T12:10:41.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.185+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60981a1c50 con 0x7f60981067e0 2024-09-21T12:10:41.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.186+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6098101f20 con 0x7f60981067e0 2024-09-21T12:10:41.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.187+0000 7f60957fa640 1 -- 172.21.15.118:0/2339206339 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6080005020 con 0x7f60981067e0 2024-09-21T12:10:41.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.187+0000 7f60957fa640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f608407af30 0x7f608407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:41.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.188+0000 7f60977fe640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f608407af30 0x7f608407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:41.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.188+0000 7f60957fa640 1 -- 172.21.15.118:0/2339206339 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f608009df30 con 0x7f60981067e0 2024-09-21T12:10:41.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.188+0000 7f60977fe640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f608407af30 0x7f608407d3f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6088000c00 tx=0x7f6088031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:41.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.192+0000 7f60957fa640 1 -- 172.21.15.118:0/2339206339 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6080014030 con 0x7f60981067e0 2024-09-21T12:10:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.384+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6098062630 con 0x7f608407af30 2024-09-21T12:10:41.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.386+0000 7f60957fa640 1 -- 172.21.15.118:0/2339206339 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6098062630 con 0x7f608407af30 2024-09-21T12:10:41.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f608407af30 msgr2=0x7f608407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f608407af30 0x7f608407d3f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6088000c00 tx=0x7f6088031400 comp rx=0 tx=0).stop 2024-09-21T12:10:41.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 msgr2=0x7f6098198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 0x7f6098198d20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f608000c8f0 tx=0x7f608000cdb0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 shutdown_connections 2024-09-21T12:10:41.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f608407af30 0x7f608407d3f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60981067e0 0x7f6098198d20 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 --2- 172.21.15.118:0/2339206339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60981007e0 0x7f60981987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 >> 172.21.15.118:0/2339206339 conn(0x7f60980fc4c0 msgr2=0x7f60980fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:41.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 shutdown_connections 2024-09-21T12:10:41.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.388+0000 7f609e154640 1 -- 172.21.15.118:0/2339206339 wait complete. 2024-09-21T12:10:41.399 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:10:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.470+0000 7fe3465fb640 1 -- 172.21.15.118:0/1196422482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401007e0 msgr2=0x7fe340100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.470+0000 7fe3465fb640 1 --2- 172.21.15.118:0/1196422482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401007e0 0x7fe340100c40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe334009880 tx=0x7fe33402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.470+0000 7fe3465fb640 1 -- 172.21.15.118:0/1196422482 shutdown_connections 2024-09-21T12:10:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.470+0000 7fe3465fb640 1 --2- 172.21.15.118:0/1196422482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401007e0 0x7fe340100c40 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.470+0000 7fe3465fb640 1 --2- 172.21.15.118:0/1196422482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3401067e0 0x7fe340106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.470+0000 7fe3465fb640 1 -- 172.21.15.118:0/1196422482 >> 172.21.15.118:0/1196422482 conn(0x7fe3400fc4c0 msgr2=0x7fe3400fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.470+0000 7fe3465fb640 1 -- 172.21.15.118:0/1196422482 shutdown_connections 2024-09-21T12:10:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.470+0000 7fe3465fb640 1 -- 172.21.15.118:0/1196422482 wait complete. 2024-09-21T12:10:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.471+0000 7fe3465fb640 1 Processor -- start 2024-09-21T12:10:41.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.471+0000 7fe3465fb640 1 -- start start 2024-09-21T12:10:41.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.471+0000 7fe3465fb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3401007e0 0x7fe3400fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:41.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.471+0000 7fe3465fb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401067e0 0x7fe3400fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:41.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.471+0000 7fe3465fb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe34010dcb0 con 0x7fe3401067e0 2024-09-21T12:10:41.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.471+0000 7fe3465fb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe34010db30 con 0x7fe3401007e0 2024-09-21T12:10:41.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.471+0000 7fe33f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401067e0 0x7fe3400fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:41.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401067e0 0x7fe3400fd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43992/0 (socket says 172.21.15.118:43992) 2024-09-21T12:10:41.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33f7fe640 1 -- 172.21.15.118:0/3182099823 learned_addr learned my addr 172.21.15.118:0/3182099823 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33ffff640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3401007e0 0x7fe3400fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33f7fe640 1 -- 172.21.15.118:0/3182099823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3401007e0 msgr2=0x7fe3400fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33f7fe640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3401007e0 0x7fe3400fcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33f7fe640 1 -- 172.21.15.118:0/3182099823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3400fd6d0 con 0x7fe3401067e0 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33f7fe640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401067e0 0x7fe3400fd190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe334031460 tx=0x7fe3340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33d7fa640 1 -- 172.21.15.118:0/3182099823 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe33403f070 con 0x7fe3401067e0 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3400fd960 con 0x7fe3401067e0 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33d7fa640 1 -- 172.21.15.118:0/3182099823 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe334004cf0 con 0x7fe3401067e0 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe33d7fa640 1 -- 172.21.15.118:0/3182099823 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe334035030 con 0x7fe3401067e0 2024-09-21T12:10:41.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.472+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3401a3df0 con 0x7fe3401067e0 2024-09-21T12:10:41.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.474+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe340101f20 con 0x7fe3401067e0 2024-09-21T12:10:41.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.474+0000 7fe33d7fa640 1 -- 172.21.15.118:0/3182099823 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe334042070 con 0x7fe3401067e0 2024-09-21T12:10:41.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.474+0000 7fe33d7fa640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe32807af30 0x7fe32807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:41.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.475+0000 7fe33d7fa640 1 -- 172.21.15.118:0/3182099823 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe3340beac0 con 0x7fe3401067e0 2024-09-21T12:10:41.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.475+0000 7fe33ffff640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe32807af30 0x7fe32807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:41.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.475+0000 7fe33ffff640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe32807af30 0x7fe32807d3f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe3300058c0 tx=0x7fe33000a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:41.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.479+0000 7fe33d7fa640 1 -- 172.21.15.118:0/3182099823 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe33408a010 con 0x7fe3401067e0 2024-09-21T12:10:41.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.673+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe340062630 con 0x7fe32807af30 2024-09-21T12:10:41.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.674+0000 7fe33d7fa640 1 -- 172.21.15.118:0/3182099823 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe340062630 con 0x7fe32807af30 2024-09-21T12:10:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe32807af30 msgr2=0x7fe32807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe32807af30 0x7fe32807d3f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe3300058c0 tx=0x7fe33000a250 comp rx=0 tx=0).stop 2024-09-21T12:10:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401067e0 msgr2=0x7fe3400fd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401067e0 0x7fe3400fd190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe334031460 tx=0x7fe3340048f0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 shutdown_connections 2024-09-21T12:10:41.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe32807af30 0x7fe32807d3f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3401067e0 0x7fe3400fd190 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 --2- 172.21.15.118:0/3182099823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3401007e0 0x7fe3400fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 >> 172.21.15.118:0/3182099823 conn(0x7fe3400fc4c0 msgr2=0x7fe340069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:41.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 shutdown_connections 2024-09-21T12:10:41.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.676+0000 7fe3465fb640 1 -- 172.21.15.118:0/3182099823 wait complete. 2024-09-21T12:10:41.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.758+0000 7fec8c64c640 1 -- 172.21.15.118:0/903196610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841007e0 msgr2=0x7fec84100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.758+0000 7fec8c64c640 1 --2- 172.21.15.118:0/903196610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841007e0 0x7fec84100c40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fec80009880 tx=0x7fec8002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.758+0000 7fec8c64c640 1 -- 172.21.15.118:0/903196610 shutdown_connections 2024-09-21T12:10:41.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.758+0000 7fec8c64c640 1 --2- 172.21.15.118:0/903196610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841007e0 0x7fec84100c40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.758+0000 7fec8c64c640 1 --2- 172.21.15.118:0/903196610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec841067e0 0x7fec84106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.758+0000 7fec8c64c640 1 -- 172.21.15.118:0/903196610 >> 172.21.15.118:0/903196610 conn(0x7fec840fc4c0 msgr2=0x7fec840fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.758+0000 7fec8c64c640 1 -- 172.21.15.118:0/903196610 shutdown_connections 2024-09-21T12:10:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.758+0000 7fec8c64c640 1 -- 172.21.15.118:0/903196610 wait complete. 2024-09-21T12:10:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec8c64c640 1 Processor -- start 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec8c64c640 1 -- start start 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec8c64c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec841007e0 0x7fec84198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec8c64c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841067e0 0x7fec84198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec8c64c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fec8410dd10 con 0x7fec841067e0 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec8c64c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec8410db90 con 0x7fec841007e0 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec89be7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841067e0 0x7fec84198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec89be7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841067e0 0x7fec84198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44014/0 (socket says 172.21.15.118:44014) 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec89be7640 1 -- 172.21.15.118:0/2036799228 learned_addr learned my addr 172.21.15.118:0/2036799228 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec8a3e8640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec841007e0 0x7fec84198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec89be7640 1 -- 172.21.15.118:0/2036799228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec841007e0 msgr2=0x7fec84198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec89be7640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec841007e0 0x7fec84198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.759+0000 7fec89be7640 1 -- 172.21.15.118:0/2036799228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec84199380 con 0x7fec841067e0 2024-09-21T12:10:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.760+0000 7fec89be7640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841067e0 0x7fec84198d80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fec80031460 tx=0x7fec800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.760+0000 7fec777fe640 1 -- 172.21.15.118:0/2036799228 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec8003f070 con 0x7fec841067e0 2024-09-21T12:10:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.760+0000 7fec777fe640 1 -- 172.21.15.118:0/2036799228 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec80004cf0 con 0x7fec841067e0 2024-09-21T12:10:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.760+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec84199610 con 0x7fec841067e0 2024-09-21T12:10:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.760+0000 7fec777fe640 1 -- 172.21.15.118:0/2036799228 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec80035030 con 0x7fec841067e0 2024-09-21T12:10:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.760+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec841a1bc0 con 0x7fec841067e0 2024-09-21T12:10:41.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.761+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec84101f20 con 0x7fec841067e0 2024-09-21T12:10:41.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.762+0000 7fec777fe640 1 -- 172.21.15.118:0/2036799228 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fec80042070 con 0x7fec841067e0 2024-09-21T12:10:41.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.762+0000 7fec777fe640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec7007af30 0x7fec7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:41.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.762+0000 7fec777fe640 1 -- 172.21.15.118:0/2036799228 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fec800beb10 con 0x7fec841067e0 2024-09-21T12:10:41.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.762+0000 7fec8a3e8640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec7007af30 0x7fec7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:41.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.763+0000 7fec8a3e8640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec7007af30 0x7fec7007d3f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fec78009990 tx=0x7fec78009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:41.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.766+0000 7fec777fe640 1 -- 172.21.15.118:0/2036799228 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec8008a060 con 0x7fec841067e0 2024-09-21T12:10:41.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.951+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fec84062630 con 0x7fec7007af30 2024-09-21T12:10:41.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.960+0000 7fec777fe640 1 -- 172.21.15.118:0/2036799228 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fec84062630 con 0x7fec7007af30 2024-09-21T12:10:41.963 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:10:41.963 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (28m) 7m ago 39m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:10:41.963 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (31m) 7m ago 39m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:10:41.964 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (31m) 7m ago 38m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:10:41.964 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (26m) 7m ago 39m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:10:41.964 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (26m) 7m ago 38m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:10:41.964 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (28m) 7m ago 39m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:10:41.964 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (23m) 7m ago 34m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:10:41.964 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (22m) 7m ago 34m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:10:41.964 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (7m) 7m ago 34m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:10:41.965 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (22m) 7m ago 34m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:10:41.965 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (30m) 7m ago 41m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:10:41.965 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (29m) 7m ago 38m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:10:41.965 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (27m) 7m ago 41m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:10:41.965 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (26m) 7m ago 38m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:10:41.965 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (29m) 7m ago 39m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:10:41.965 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (29m) 7m ago 38m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:10:41.965 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (26m) 7m ago 37m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:10:41.966 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (25m) 7m ago 37m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:10:41.966 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (25m) 7m ago 36m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:10:41.966 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (24m) 7m ago 36m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:10:41.966 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (23m) 7m ago 35m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:10:41.966 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (23m) 7m ago 35m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:10:41.966 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (28m) 7m ago 39m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:10:41.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec7007af30 msgr2=0x7fec7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec7007af30 0x7fec7007d3f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fec78009990 tx=0x7fec78009110 comp rx=0 tx=0).stop 2024-09-21T12:10:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841067e0 msgr2=0x7fec84198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841067e0 0x7fec84198d80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fec80031460 tx=0x7fec800048f0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 shutdown_connections 2024-09-21T12:10:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fec7007af30 0x7fec7007d3f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec841067e0 0x7fec84198d80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 --2- 172.21.15.118:0/2036799228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec841007e0 0x7fec84198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:41.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 >> 172.21.15.118:0/2036799228 conn(0x7fec840fc4c0 msgr2=0x7fec840fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:41.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 shutdown_connections 2024-09-21T12:10:41.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:41.963+0000 7fec8c64c640 1 -- 172.21.15.118:0/2036799228 wait complete. 2024-09-21T12:10:42.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.042+0000 7f4558e3e640 1 -- 172.21.15.118:0/911521908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45540ffe30 msgr2=0x7f4554100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.042+0000 7f4558e3e640 1 --2- 172.21.15.118:0/911521908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45540ffe30 0x7f4554100290 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4548009880 tx=0x7f454802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.042+0000 7f4558e3e640 1 -- 172.21.15.118:0/911521908 shutdown_connections 2024-09-21T12:10:42.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.043+0000 7f4558e3e640 1 --2- 172.21.15.118:0/911521908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45540ffe30 0x7f4554100290 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.043+0000 7f4558e3e640 1 --2- 172.21.15.118:0/911521908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4554106900 0x7f4554106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.043+0000 7f4558e3e640 1 -- 172.21.15.118:0/911521908 >> 172.21.15.118:0/911521908 conn(0x7f45540fbc40 msgr2=0x7f45540fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:42.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.043+0000 7f4558e3e640 1 -- 172.21.15.118:0/911521908 shutdown_connections 2024-09-21T12:10:42.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.043+0000 7f4558e3e640 1 -- 172.21.15.118:0/911521908 wait complete. 2024-09-21T12:10:42.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.043+0000 7f4558e3e640 1 Processor -- start 2024-09-21T12:10:42.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4558e3e640 1 -- start start 2024-09-21T12:10:42.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4558e3e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45540ffe30 0x7f455419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4558e3e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4554106900 0x7f455419dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4558e3e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f455410ef40 con 0x7f4554106900 2024-09-21T12:10:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4558e3e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f455410edc0 con 0x7f45540ffe30 2024-09-21T12:10:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4551d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4554106900 0x7f455419dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4551d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4554106900 0x7f455419dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44028/0 (socket says 172.21.15.118:44028) 2024-09-21T12:10:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4551d9b640 1 -- 172.21.15.118:0/2489582631 learned_addr learned my addr 172.21.15.118:0/2489582631 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f455259c640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45540ffe30 0x7f455419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4551d9b640 1 -- 172.21.15.118:0/2489582631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45540ffe30 msgr2=0x7f455419d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4551d9b640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45540ffe30 0x7f455419d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f4551d9b640 1 -- 172.21.15.118:0/2489582631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45541978b0 con 0x7f4554106900 2024-09-21T12:10:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.044+0000 7f455259c640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45540ffe30 0x7f455419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:10:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.045+0000 7f4551d9b640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4554106900 0x7f455419dc30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4548031460 tx=0x7f45480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.045+0000 7f45437fe640 1 -- 172.21.15.118:0/2489582631 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f454803f070 con 0x7f4554106900 2024-09-21T12:10:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.045+0000 7f45437fe640 1 -- 172.21.15.118:0/2489582631 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45480044d0 con 0x7f4554106900 2024-09-21T12:10:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.045+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4554197b40 con 0x7f4554106900 2024-09-21T12:10:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.045+0000 7f45437fe640 1 -- 172.21.15.118:0/2489582631 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4548035030 con 0x7f4554106900 2024-09-21T12:10:42.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.045+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4554198070 con 0x7f4554106900 2024-09-21T12:10:42.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.046+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4554103150 con 0x7f4554106900 2024-09-21T12:10:42.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.047+0000 7f45437fe640 1 -- 172.21.15.118:0/2489582631 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4548042070 con 0x7f4554106900 2024-09-21T12:10:42.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.047+0000 7f45437fe640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f453c07afe0 0x7f453c07d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.048+0000 7f455259c640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f453c07afe0 0x7f453c07d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.048+0000 7f45437fe640 1 -- 172.21.15.118:0/2489582631 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f45480bea60 con 0x7f4554106900 2024-09-21T12:10:42.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.048+0000 7f455259c640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f453c07afe0 0x7f453c07d4a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4544006fd0 tx=0x7f4544008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:42.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.052+0000 7f45437fe640 1 -- 172.21.15.118:0/2489582631 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4548004cf0 con 0x7f4554106900 2024-09-21T12:10:42.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.299+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4554198de0 con 0x7f4554106900 2024-09-21T12:10:42.302 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:42 smithi118 ceph-mon[111738]: pgmap v957: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:42.302 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:42 smithi118 ceph-mon[111738]: from='client.35536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:42.302 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:42 smithi118 ceph-mon[111738]: from='client.35540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:42.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.300+0000 7f45437fe640 1 -- 172.21.15.118:0/2489582631 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f454808a0d0 con 0x7f4554106900 2024-09-21T12:10:42.302 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:10:42.302 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:10:42.303 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:10:42.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f453c07afe0 msgr2=0x7f453c07d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f453c07afe0 0x7f453c07d4a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4544006fd0 tx=0x7f4544008040 comp rx=0 tx=0).stop 2024-09-21T12:10:42.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4554106900 msgr2=0x7f455419dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4554106900 0x7f455419dc30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4548031460 tx=0x7f45480048f0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 shutdown_connections 2024-09-21T12:10:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f453c07afe0 0x7f453c07d4a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4554106900 0x7f455419dc30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 --2- 172.21.15.118:0/2489582631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45540ffe30 0x7f455419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 >> 172.21.15.118:0/2489582631 conn(0x7f45540fbc40 msgr2=0x7f45540fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 shutdown_connections 2024-09-21T12:10:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.302+0000 7f4558e3e640 1 -- 172.21.15.118:0/2489582631 wait complete. 2024-09-21T12:10:42.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.384+0000 7f3ffeae4640 1 -- 172.21.15.118:0/3740053722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81067e0 msgr2=0x7f3ff8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.384+0000 7f3ffeae4640 1 --2- 172.21.15.118:0/3740053722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81067e0 0x7f3ff8106bc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009880 tx=0x7f3fec02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.384+0000 7f3ffeae4640 1 -- 172.21.15.118:0/3740053722 shutdown_connections 2024-09-21T12:10:42.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.384+0000 7f3ffeae4640 1 --2- 172.21.15.118:0/3740053722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff81007e0 0x7f3ff8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.384+0000 7f3ffeae4640 1 --2- 172.21.15.118:0/3740053722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81067e0 0x7f3ff8106bc0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.384+0000 7f3ffeae4640 1 -- 172.21.15.118:0/3740053722 >> 172.21.15.118:0/3740053722 conn(0x7f3ff80fc4c0 msgr2=0x7f3ff80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:42.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.384+0000 7f3ffeae4640 1 -- 172.21.15.118:0/3740053722 shutdown_connections 2024-09-21T12:10:42.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.384+0000 7f3ffeae4640 1 -- 172.21.15.118:0/3740053722 wait complete. 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffeae4640 1 Processor -- start 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffeae4640 1 -- start start 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffeae4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81007e0 0x7f3ff819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffeae4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff81067e0 0x7f3ff819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffeae4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff810dd10 con 0x7f3ff81007e0 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffeae4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff810db90 con 0x7f3ff81067e0 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffc880640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81007e0 0x7f3ff819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffc880640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81007e0 0x7f3ff819f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44044/0 (socket says 172.21.15.118:44044) 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffc880640 1 -- 172.21.15.118:0/2801313826 learned_addr learned my addr 172.21.15.118:0/2801313826 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ff7fff640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff81067e0 0x7f3ff819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffc880640 1 -- 172.21.15.118:0/2801313826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff81067e0 msgr2=0x7f3ff819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffc880640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff81067e0 0x7f3ff819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffc880640 1 -- 172.21.15.118:0/2801313826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff8199a00 con 0x7f3ff81007e0 2024-09-21T12:10:42.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ff7fff640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff81067e0 0x7f3ff819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:10:42.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.385+0000 7f3ffc880640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81007e0 0x7f3ff819f840 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3fec031460 tx=0x7f3fec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:42.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.386+0000 7f3ff5ffb640 1 -- 172.21.15.118:0/2801313826 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fec03f070 con 0x7f3ff81007e0 2024-09-21T12:10:42.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.386+0000 7f3ff5ffb640 1 -- 172.21.15.118:0/2801313826 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fec004cf0 con 0x7f3ff81007e0 2024-09-21T12:10:42.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.386+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff8199c90 con 0x7f3ff81007e0 2024-09-21T12:10:42.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.386+0000 7f3ff5ffb640 1 -- 172.21.15.118:0/2801313826 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fec035030 con 0x7f3ff81007e0 2024-09-21T12:10:42.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.386+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff819a1c0 con 0x7f3ff81007e0 2024-09-21T12:10:42.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.387+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff8101f20 con 0x7f3ff81007e0 2024-09-21T12:10:42.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.387+0000 7f3ff5ffb640 1 -- 172.21.15.118:0/2801313826 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3fec042070 con 0x7f3ff81007e0 2024-09-21T12:10:42.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.388+0000 7f3ff5ffb640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fe807af80 0x7f3fe807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.388+0000 7f3ff7fff640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fe807af80 0x7f3fe807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.388+0000 7f3ff5ffb640 1 -- 172.21.15.118:0/2801313826 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3fec0bea90 con 0x7f3ff81007e0 2024-09-21T12:10:42.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.389+0000 7f3ff7fff640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fe807af80 0x7f3fe807d440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4006fd0 tx=0x7f3fe4008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:42.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.393+0000 7f3ff5ffb640 1 -- 172.21.15.118:0/2801313826 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3fec08a060 con 0x7f3ff81007e0 2024-09-21T12:10:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:42 smithi149 ceph-mon[79770]: pgmap v957: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:42 smithi149 ceph-mon[79770]: from='client.35536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:42.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:42 smithi149 ceph-mon[79770]: from='client.35540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:42.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.615+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3ff819a470 con 0x7f3ff81007e0 2024-09-21T12:10:42.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.615+0000 7f3ff5ffb640 1 -- 172.21.15.118:0/2801313826 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f3fec08ef10 con 0x7f3ff81007e0 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:10:42.618 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:10:42.619 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:10:42.620 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:10:42.621 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:10:42.621 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:10:42.621 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:10:42.621 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fe807af80 msgr2=0x7f3fe807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fe807af80 0x7f3fe807d440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4006fd0 tx=0x7f3fe4008040 comp rx=0 tx=0).stop 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81007e0 msgr2=0x7f3ff819f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81007e0 0x7f3ff819f840 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3fec031460 tx=0x7f3fec0048f0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 shutdown_connections 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ff81067e0 0x7f3ff819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3fe807af80 0x7f3fe807d440 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 --2- 172.21.15.118:0/2801313826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff81007e0 0x7f3ff819f840 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 >> 172.21.15.118:0/2801313826 conn(0x7f3ff80fc4c0 msgr2=0x7f3ff8069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 shutdown_connections 2024-09-21T12:10:42.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.617+0000 7f3ffeae4640 1 -- 172.21.15.118:0/2801313826 wait complete. 2024-09-21T12:10:42.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.700+0000 7f7636902640 1 -- 172.21.15.118:0/3474967655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630107930 msgr2=0x7f7630107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.700+0000 7f7636902640 1 --2- 172.21.15.118:0/3474967655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630107930 0x7f7630107d10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7620009880 tx=0x7f762002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.700+0000 7f7636902640 1 -- 172.21.15.118:0/3474967655 shutdown_connections 2024-09-21T12:10:42.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.700+0000 7f7636902640 1 --2- 172.21.15.118:0/3474967655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7630101930 0x7f7630101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.700+0000 7f7636902640 1 --2- 172.21.15.118:0/3474967655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630107930 0x7f7630107d10 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.700+0000 7f7636902640 1 -- 172.21.15.118:0/3474967655 >> 172.21.15.118:0/3474967655 conn(0x7f76300fd630 msgr2=0x7f76300ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:42.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.700+0000 7f7636902640 1 -- 172.21.15.118:0/3474967655 shutdown_connections 2024-09-21T12:10:42.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.700+0000 7f7636902640 1 -- 172.21.15.118:0/3474967655 wait complete. 2024-09-21T12:10:42.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.701+0000 7f7636902640 1 Processor -- start 2024-09-21T12:10:42.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.701+0000 7f7636902640 1 -- start start 2024-09-21T12:10:42.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.701+0000 7f7636902640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630101930 0x7f763019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.701+0000 7f7636902640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7630107930 0x7f763019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.701+0000 7f7636902640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f763010ee00 con 0x7f7630101930 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.701+0000 7f7636902640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f763010ec80 con 0x7f7630107930 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.701+0000 7f762ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630101930 0x7f763019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.701+0000 7f762ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630101930 0x7f763019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44064/0 (socket says 172.21.15.118:44064) 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.701+0000 7f762ffff640 1 -- 172.21.15.118:0/1135485189 learned_addr learned my addr 172.21.15.118:0/1135485189 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f762f7fe640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7630107930 0x7f763019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f762ffff640 1 -- 172.21.15.118:0/1135485189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7630107930 msgr2=0x7f763019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f762ffff640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7630107930 0x7f763019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f762ffff640 1 -- 172.21.15.118:0/1135485189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76301977f0 con 0x7f7630101930 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f762ffff640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630101930 0x7f763019d670 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7620031460 tx=0x7f76200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f762d7fa640 1 -- 172.21.15.118:0/1135485189 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f762003f070 con 0x7f7630101930 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f762d7fa640 1 -- 172.21.15.118:0/1135485189 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76200035f0 con 0x7f7630101930 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7630197a80 con 0x7f7630101930 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f762d7fa640 1 -- 172.21.15.118:0/1135485189 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7620035030 con 0x7f7630101930 2024-09-21T12:10:42.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.702+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7630197fb0 con 0x7f7630101930 2024-09-21T12:10:42.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.703+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7630103070 con 0x7f7630101930 2024-09-21T12:10:42.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.704+0000 7f762d7fa640 1 -- 172.21.15.118:0/1135485189 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7620042070 con 0x7f7630101930 2024-09-21T12:10:42.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.704+0000 7f762d7fa640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f761807af30 0x7f761807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.704+0000 7f762d7fa640 1 -- 172.21.15.118:0/1135485189 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f76200bead0 con 0x7f7630101930 2024-09-21T12:10:42.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.704+0000 7f762f7fe640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f761807af30 0x7f761807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.705+0000 7f762f7fe640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f761807af30 0x7f761807d3f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7624005fd0 tx=0x7f7624005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:42.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.709+0000 7f762d7fa640 1 -- 172.21.15.118:0/1135485189 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f762008a020 con 0x7f7630101930 2024-09-21T12:10:42.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.904+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7630198260 con 0x7f761807af30 2024-09-21T12:10:42.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.905+0000 7f762d7fa640 1 -- 172.21.15.118:0/1135485189 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7630198260 con 0x7f761807af30 2024-09-21T12:10:42.907 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:10:42.907 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:10:42.907 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:10:42.907 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:10:42.907 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:10:42.907 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:10:42.908 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:10:42.908 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:10:42.908 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:10:42.908 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:10:42.908 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:10:42.908 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:10:42.908 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:10:42.908 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:10:42.908 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.907+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f761807af30 msgr2=0x7f761807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.907+0000 7f7636902640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f761807af30 0x7f761807d3f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7624005fd0 tx=0x7f7624005850 comp rx=0 tx=0).stop 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.907+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630101930 msgr2=0x7f763019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.907+0000 7f7636902640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630101930 0x7f763019d670 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7620031460 tx=0x7f76200045e0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.908+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 shutdown_connections 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.908+0000 7f7636902640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7630107930 0x7f763019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.908+0000 7f7636902640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f761807af30 0x7f761807d3f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.908+0000 7f7636902640 1 --2- 172.21.15.118:0/1135485189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7630101930 0x7f763019d670 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.908+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 >> 172.21.15.118:0/1135485189 conn(0x7f76300fd630 msgr2=0x7f76300fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.908+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 shutdown_connections 2024-09-21T12:10:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.908+0000 7f7636902640 1 -- 172.21.15.118:0/1135485189 wait complete. 2024-09-21T12:10:42.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 -- 172.21.15.118:0/1628080988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c102aa0 msgr2=0x7f8d3c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 --2- 172.21.15.118:0/1628080988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c102e80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009880 tx=0x7f8d2c02a530 comp rx=0 tx=0).stop 2024-09-21T12:10:42.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 -- 172.21.15.118:0/1628080988 shutdown_connections 2024-09-21T12:10:42.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 --2- 172.21.15.118:0/1628080988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d3c1033c0 0x7f8d3c10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 --2- 172.21.15.118:0/1628080988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c102e80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 -- 172.21.15.118:0/1628080988 >> 172.21.15.118:0/1628080988 conn(0x7f8d3c0fc4c0 msgr2=0x7f8d3c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:42.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 -- 172.21.15.118:0/1628080988 shutdown_connections 2024-09-21T12:10:42.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 -- 172.21.15.118:0/1628080988 wait complete. 2024-09-21T12:10:42.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 Processor -- start 2024-09-21T12:10:42.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.990+0000 7f8d42886640 1 -- start start 2024-09-21T12:10:42.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d42886640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d42886640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c1033c0 0x7f8d3c19dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:42.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d42886640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c10ee30 con 0x7f8d3c1033c0 2024-09-21T12:10:42.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d42886640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c10ecb0 con 0x7f8d3c102aa0 2024-09-21T12:10:42.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d3b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c1033c0 0x7f8d3c19dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d3b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c1033c0 0x7f8d3c19dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44088/0 (socket says 172.21.15.118:44088) 2024-09-21T12:10:42.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d3b7fe640 1 -- 172.21.15.118:0/2642547484 learned_addr learned my addr 172.21.15.118:0/2642547484 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:10:42.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d3bfff640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:42.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d3b7fe640 1 -- 172.21.15.118:0/2642547484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d3c102aa0 msgr2=0x7f8d3c19d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:42.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d3b7fe640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c19d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:42.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d3b7fe640 1 -- 172.21.15.118:0/2642547484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c197960 con 0x7f8d3c1033c0 2024-09-21T12:10:42.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d3b7fe640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c1033c0 0x7f8d3c19dce0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000b370 tx=0x7f8d3000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:42.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d397fa640 1 -- 172.21.15.118:0/2642547484 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d30015020 con 0x7f8d3c1033c0 2024-09-21T12:10:42.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d397fa640 1 -- 172.21.15.118:0/2642547484 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d30011af0 con 0x7f8d3c1033c0 2024-09-21T12:10:42.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3c197c50 con 0x7f8d3c1033c0 2024-09-21T12:10:42.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.991+0000 7f8d397fa640 1 -- 172.21.15.118:0/2642547484 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d30010d60 con 0x7f8d3c1033c0 2024-09-21T12:10:42.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.992+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3c1981e0 con 0x7f8d3c1033c0 2024-09-21T12:10:42.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.992+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3c06a410 con 0x7f8d3c1033c0 2024-09-21T12:10:43.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.993+0000 7f8d397fa640 1 -- 172.21.15.118:0/2642547484 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8d30018020 con 0x7f8d3c1033c0 2024-09-21T12:10:43.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.994+0000 7f8d397fa640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d2407af30 0x7f8d2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:10:43.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.994+0000 7f8d3bfff640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d2407af30 0x7f8d2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:10:43.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.994+0000 7f8d397fa640 1 -- 172.21.15.118:0/2642547484 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8d3009da50 con 0x7f8d3c1033c0 2024-09-21T12:10:43.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.994+0000 7f8d3bfff640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d2407af30 0x7f8d2407d3f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c031460 tx=0x7f8d2c009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:10:43.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:42.998+0000 7f8d397fa640 1 -- 172.21.15.118:0/2642547484 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d3001f020 con 0x7f8d3c1033c0 2024-09-21T12:10:43.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.246+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8d3c105f70 con 0x7f8d3c1033c0 2024-09-21T12:10:43.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.247+0000 7f8d397fa640 1 -- 172.21.15.118:0/2642547484 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f8d30068f40 con 0x7f8d3c1033c0 2024-09-21T12:10:43.249 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:10:43.249 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:10:43.249 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:10:43.249 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:10:43.249 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:43.249 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:10:43.250 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:10:43.251 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:10:43.251 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:10:43.251 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:10:43.251 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:10:43.251 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:10:43.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d2407af30 msgr2=0x7f8d2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:43.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d2407af30 0x7f8d2407d3f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c031460 tx=0x7f8d2c009560 comp rx=0 tx=0).stop 2024-09-21T12:10:43.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c1033c0 msgr2=0x7f8d3c19dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:10:43.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c1033c0 0x7f8d3c19dce0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000b370 tx=0x7f8d3000b830 comp rx=0 tx=0).stop 2024-09-21T12:10:43.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 shutdown_connections 2024-09-21T12:10:43.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8d2407af30 0x7f8d2407d3f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:43.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3c1033c0 0x7f8d3c19dce0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:43.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 --2- 172.21.15.118:0/2642547484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c19d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:10:43.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 >> 172.21.15.118:0/2642547484 conn(0x7f8d3c0fc4c0 msgr2=0x7f8d3c108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:10:43.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 shutdown_connections 2024-09-21T12:10:43.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:10:43.249+0000 7f8d42886640 1 -- 172.21.15.118:0/2642547484 wait complete. 2024-09-21T12:10:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:43 smithi149 ceph-mon[79770]: from='client.35544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:43 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2489582631' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:10:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:43 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2801313826' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:10:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:43 smithi149 ceph-mon[79770]: from='client.35556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:43 smithi118 ceph-mon[111738]: from='client.35544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:43 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2489582631' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:10:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:43 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2801313826' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:10:43.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:43 smithi118 ceph-mon[111738]: from='client.35556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:10:44.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:44 smithi118 ceph-mon[111738]: pgmap v958: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:44.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:44 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2642547484' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:10:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:44 smithi149 ceph-mon[79770]: pgmap v958: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:44 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2642547484' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:10:46.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:46 smithi149 ceph-mon[79770]: pgmap v959: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:46.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:46 smithi118 ceph-mon[111738]: pgmap v959: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:48 smithi149 ceph-mon[79770]: pgmap v960: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:48 smithi118 ceph-mon[111738]: pgmap v960: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:50 smithi149 ceph-mon[79770]: pgmap v961: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:50.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:10:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:50 smithi118 ceph-mon[111738]: pgmap v961: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:10:52.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:52 smithi149 ceph-mon[79770]: pgmap v962: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:52.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:52 smithi118 ceph-mon[111738]: pgmap v962: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:54.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:54 smithi149 ceph-mon[79770]: pgmap v963: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:54.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:54 smithi118 ceph-mon[111738]: pgmap v963: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:56 smithi149 ceph-mon[79770]: pgmap v964: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:56 smithi118 ceph-mon[111738]: pgmap v964: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:10:58 smithi149 ceph-mon[79770]: pgmap v965: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:10:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:10:58 smithi118 ceph-mon[111738]: pgmap v965: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:00 smithi149 ceph-mon[79770]: pgmap v966: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:00 smithi118 ceph-mon[111738]: pgmap v966: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:02 smithi149 ceph-mon[79770]: pgmap v967: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:02.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:02 smithi118 ceph-mon[111738]: pgmap v967: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:04 smithi149 ceph-mon[79770]: pgmap v968: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:04.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:04 smithi118 ceph-mon[111738]: pgmap v968: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:11:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:11:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:06 smithi149 ceph-mon[79770]: pgmap v969: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:06 smithi118 ceph-mon[111738]: pgmap v969: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:08.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:08 smithi118 ceph-mon[111738]: pgmap v970: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:08.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:08 smithi149 ceph-mon[79770]: pgmap v970: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:10.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:10 smithi118 ceph-mon[111738]: pgmap v971: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:10.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:10 smithi149 ceph-mon[79770]: pgmap v971: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:12.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:12 smithi118 ceph-mon[111738]: pgmap v972: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:12.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:12 smithi149 ceph-mon[79770]: pgmap v972: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:13.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.335+0000 7fbd3d66c640 1 -- 172.21.15.118:0/2748139844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 msgr2=0x7fbd38100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.335+0000 7fbd3d66c640 1 --2- 172.21.15.118:0/2748139844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 0x7fbd38100c80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009880 tx=0x7fbd2002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.335+0000 7fbd3d66c640 1 -- 172.21.15.118:0/2748139844 shutdown_connections 2024-09-21T12:11:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.335+0000 7fbd3d66c640 1 --2- 172.21.15.118:0/2748139844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 0x7fbd38100c80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.335+0000 7fbd3d66c640 1 --2- 172.21.15.118:0/2748139844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38106820 0x7fbd38106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.335+0000 7fbd3d66c640 1 -- 172.21.15.118:0/2748139844 >> 172.21.15.118:0/2748139844 conn(0x7fbd380fc520 msgr2=0x7fbd380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.335+0000 7fbd3d66c640 1 -- 172.21.15.118:0/2748139844 shutdown_connections 2024-09-21T12:11:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.335+0000 7fbd3d66c640 1 -- 172.21.15.118:0/2748139844 wait complete. 2024-09-21T12:11:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd3d66c640 1 Processor -- start 2024-09-21T12:11:13.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd3d66c640 1 -- start start 2024-09-21T12:11:13.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd3d66c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 0x7fbd3819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:13.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd3d66c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38106820 0x7fbd3819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd3d66c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3810dd50 con 0x7fbd38100820 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd3d66c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3810dbd0 con 0x7fbd38106820 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd36ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 0x7fbd3819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd36ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 0x7fbd3819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58956/0 (socket says 172.21.15.118:58956) 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd36ffd640 1 -- 172.21.15.118:0/539981255 learned_addr learned my addr 172.21.15.118:0/539981255 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.336+0000 7fbd2e7fc640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38106820 0x7fbd3819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.337+0000 7fbd36ffd640 1 -- 172.21.15.118:0/539981255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38106820 msgr2=0x7fbd3819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.337+0000 7fbd36ffd640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38106820 0x7fbd3819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.337+0000 7fbd36ffd640 1 -- 172.21.15.118:0/539981255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd38196740 con 0x7fbd38100820 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.337+0000 7fbd36ffd640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 0x7fbd3819c670 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800b420 tx=0x7fbd2800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.337+0000 7fbd34ff9640 1 -- 172.21.15.118:0/539981255 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd28011630 con 0x7fbd38100820 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.337+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd38196a30 con 0x7fbd38100820 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.337+0000 7fbd34ff9640 1 -- 172.21.15.118:0/539981255 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd28016070 con 0x7fbd38100820 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.337+0000 7fbd34ff9640 1 -- 172.21.15.118:0/539981255 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd28010d40 con 0x7fbd38100820 2024-09-21T12:11:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.337+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd38196f90 con 0x7fbd38100820 2024-09-21T12:11:13.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.338+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd38101f60 con 0x7fbd38100820 2024-09-21T12:11:13.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.339+0000 7fbd34ff9640 1 -- 172.21.15.118:0/539981255 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbd2801b460 con 0x7fbd38100820 2024-09-21T12:11:13.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.339+0000 7fbd34ff9640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd2407af40 0x7fbd2407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:13.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.339+0000 7fbd34ff9640 1 -- 172.21.15.118:0/539981255 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbd2809d890 con 0x7fbd38100820 2024-09-21T12:11:13.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.339+0000 7fbd2e7fc640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd2407af40 0x7fbd2407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:13.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.340+0000 7fbd2e7fc640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd2407af40 0x7fbd2407d400 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbd38197f90 tx=0x7fbd200095c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:13.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.343+0000 7fbd34ff9640 1 -- 172.21.15.118:0/539981255 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd28021250 con 0x7fbd38100820 2024-09-21T12:11:13.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.535+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbd381972a0 con 0x7fbd2407af40 2024-09-21T12:11:13.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.536+0000 7fbd34ff9640 1 -- 172.21.15.118:0/539981255 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fbd381972a0 con 0x7fbd2407af40 2024-09-21T12:11:13.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd2407af40 msgr2=0x7fbd2407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd2407af40 0x7fbd2407d400 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbd38197f90 tx=0x7fbd200095c0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 msgr2=0x7fbd3819c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 0x7fbd3819c670 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800b420 tx=0x7fbd2800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 shutdown_connections 2024-09-21T12:11:13.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38106820 0x7fbd3819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbd2407af40 0x7fbd2407d400 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 --2- 172.21.15.118:0/539981255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd38100820 0x7fbd3819c670 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 >> 172.21.15.118:0/539981255 conn(0x7fbd380fc520 msgr2=0x7fbd380fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:13.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 shutdown_connections 2024-09-21T12:11:13.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.538+0000 7fbd3d66c640 1 -- 172.21.15.118:0/539981255 wait complete. 2024-09-21T12:11:13.549 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:11:13.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.621+0000 7f8f900cb640 1 -- 172.21.15.118:0/2110353702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881067e0 msgr2=0x7f8f88106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.621+0000 7f8f900cb640 1 --2- 172.21.15.118:0/2110353702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881067e0 0x7f8f88106bc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009c20 tx=0x7f8f8402a970 comp rx=0 tx=0).stop 2024-09-21T12:11:13.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.621+0000 7f8f900cb640 1 -- 172.21.15.118:0/2110353702 shutdown_connections 2024-09-21T12:11:13.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.621+0000 7f8f900cb640 1 --2- 172.21.15.118:0/2110353702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f881007e0 0x7f8f88100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.621+0000 7f8f900cb640 1 --2- 172.21.15.118:0/2110353702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881067e0 0x7f8f88106bc0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.621+0000 7f8f900cb640 1 -- 172.21.15.118:0/2110353702 >> 172.21.15.118:0/2110353702 conn(0x7f8f880fc4c0 msgr2=0x7f8f880fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:13.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.621+0000 7f8f900cb640 1 -- 172.21.15.118:0/2110353702 shutdown_connections 2024-09-21T12:11:13.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.621+0000 7f8f900cb640 1 -- 172.21.15.118:0/2110353702 wait complete. 2024-09-21T12:11:13.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f900cb640 1 Processor -- start 2024-09-21T12:11:13.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f900cb640 1 -- start start 2024-09-21T12:11:13.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f900cb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881007e0 0x7f8f8819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:13.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f900cb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f881067e0 0x7f8f8819db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:13.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f900cb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8810dcb0 con 0x7f8f881007e0 2024-09-21T12:11:13.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f900cb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8810db30 con 0x7f8f881067e0 2024-09-21T12:11:13.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f8de67640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881007e0 0x7f8f8819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:13.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f8de67640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881007e0 0x7f8f8819d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58982/0 (socket says 172.21.15.118:58982) 2024-09-21T12:11:13.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f8de67640 1 -- 172.21.15.118:0/102464076 learned_addr learned my addr 172.21.15.118:0/102464076 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f8d666640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f881067e0 0x7f8f8819db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f8de67640 1 -- 172.21.15.118:0/102464076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f881067e0 msgr2=0x7f8f8819db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.622+0000 7f8f8de67640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f881067e0 0x7f8f8819db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.623+0000 7f8f8de67640 1 -- 172.21.15.118:0/102464076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f88197790 con 0x7f8f881007e0 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.623+0000 7f8f8de67640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881007e0 0x7f8f8819d610 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8f8402ae90 tx=0x7f8f8402fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.623+0000 7f8f7effd640 1 -- 172.21.15.118:0/102464076 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f84047070 con 0x7f8f881007e0 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.623+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f88197a20 con 0x7f8f881007e0 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.623+0000 7f8f7effd640 1 -- 172.21.15.118:0/102464076 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f84003e30 con 0x7f8f881007e0 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.623+0000 7f8f7effd640 1 -- 172.21.15.118:0/102464076 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f84034070 con 0x7f8f881007e0 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.623+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f88197f50 con 0x7f8f881007e0 2024-09-21T12:11:13.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.624+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f88101f20 con 0x7f8f881007e0 2024-09-21T12:11:13.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.626+0000 7f8f7effd640 1 -- 172.21.15.118:0/102464076 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8f8404a070 con 0x7f8f881007e0 2024-09-21T12:11:13.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.626+0000 7f8f7effd640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8f7407af80 0x7f8f7407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:13.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.626+0000 7f8f7effd640 1 -- 172.21.15.118:0/102464076 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8f840bf010 con 0x7f8f881007e0 2024-09-21T12:11:13.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.626+0000 7f8f8d666640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8f7407af80 0x7f8f7407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:13.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.627+0000 7f8f8d666640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8f7407af80 0x7f8f7407d440 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8f88105f20 tx=0x7f8f78005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:13.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.630+0000 7f8f7effd640 1 -- 172.21.15.118:0/102464076 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f84051020 con 0x7f8f881007e0 2024-09-21T12:11:13.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.826+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8f88198200 con 0x7f8f7407af80 2024-09-21T12:11:13.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.827+0000 7f8f7effd640 1 -- 172.21.15.118:0/102464076 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8f88198200 con 0x7f8f7407af80 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8f7407af80 msgr2=0x7f8f7407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8f7407af80 0x7f8f7407d440 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8f88105f20 tx=0x7f8f78005f90 comp rx=0 tx=0).stop 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881007e0 msgr2=0x7f8f8819d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881007e0 0x7f8f8819d610 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8f8402ae90 tx=0x7f8f8402fd60 comp rx=0 tx=0).stop 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 shutdown_connections 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f881067e0 0x7f8f8819db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8f7407af80 0x7f8f7407d440 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 --2- 172.21.15.118:0/102464076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f881007e0 0x7f8f8819d610 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 >> 172.21.15.118:0/102464076 conn(0x7f8f880fc4c0 msgr2=0x7f8f88069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 shutdown_connections 2024-09-21T12:11:13.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.829+0000 7f8f900cb640 1 -- 172.21.15.118:0/102464076 wait complete. 2024-09-21T12:11:13.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.910+0000 7fe9795df640 1 -- 172.21.15.118:0/3723471927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974106820 msgr2=0x7fe974106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.910+0000 7fe9795df640 1 --2- 172.21.15.118:0/3723471927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974106820 0x7fe974106c00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe964009880 tx=0x7fe96402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.910+0000 7fe9795df640 1 -- 172.21.15.118:0/3723471927 shutdown_connections 2024-09-21T12:11:13.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.910+0000 7fe9795df640 1 --2- 172.21.15.118:0/3723471927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe974100820 0x7fe974100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.910+0000 7fe9795df640 1 --2- 172.21.15.118:0/3723471927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974106820 0x7fe974106c00 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.910+0000 7fe9795df640 1 -- 172.21.15.118:0/3723471927 >> 172.21.15.118:0/3723471927 conn(0x7fe9740fc520 msgr2=0x7fe9740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:13.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.910+0000 7fe9795df640 1 -- 172.21.15.118:0/3723471927 shutdown_connections 2024-09-21T12:11:13.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.910+0000 7fe9795df640 1 -- 172.21.15.118:0/3723471927 wait complete. 2024-09-21T12:11:13.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.911+0000 7fe9795df640 1 Processor -- start 2024-09-21T12:11:13.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.911+0000 7fe9795df640 1 -- start start 2024-09-21T12:11:13.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.911+0000 7fe9795df640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974100820 0x7fe9740fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.911+0000 7fe9795df640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe974106820 0x7fe9740fd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.911+0000 7fe9795df640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe97410dcf0 con 0x7fe974100820 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.911+0000 7fe9795df640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe97410db70 con 0x7fe974106820 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.911+0000 7fe972ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974100820 0x7fe9740fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.911+0000 7fe972ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974100820 0x7fe9740fcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59002/0 (socket says 172.21.15.118:59002) 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe972ffd640 1 -- 172.21.15.118:0/2185563637 learned_addr learned my addr 172.21.15.118:0/2185563637 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe9727fc640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe974106820 0x7fe9740fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe972ffd640 1 -- 172.21.15.118:0/2185563637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe974106820 msgr2=0x7fe9740fd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe972ffd640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe974106820 0x7fe9740fd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe972ffd640 1 -- 172.21.15.118:0/2185563637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9740fd6a0 con 0x7fe974100820 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe972ffd640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974100820 0x7fe9740fcc20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe964031460 tx=0x7fe9640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe95bfff640 1 -- 172.21.15.118:0/2185563637 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe96403f070 con 0x7fe974100820 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe95bfff640 1 -- 172.21.15.118:0/2185563637 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe964004cf0 con 0x7fe974100820 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9740fd930 con 0x7fe974100820 2024-09-21T12:11:13.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe95bfff640 1 -- 172.21.15.118:0/2185563637 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe964035030 con 0x7fe974100820 2024-09-21T12:11:13.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.912+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9741a3dd0 con 0x7fe974100820 2024-09-21T12:11:13.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.913+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe974101f60 con 0x7fe974100820 2024-09-21T12:11:13.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.914+0000 7fe95bfff640 1 -- 172.21.15.118:0/2185563637 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe964042070 con 0x7fe974100820 2024-09-21T12:11:13.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.915+0000 7fe95bfff640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe95c07af80 0x7fe95c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:13.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.915+0000 7fe95bfff640 1 -- 172.21.15.118:0/2185563637 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe9640be9e0 con 0x7fe974100820 2024-09-21T12:11:13.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.915+0000 7fe9727fc640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe95c07af80 0x7fe95c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:13.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.915+0000 7fe9727fc640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe95c07af80 0x7fe95c07d440 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe9740fe6b0 tx=0x7fe96800a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:13.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:13.919+0000 7fe95bfff640 1 -- 172.21.15.118:0/2185563637 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe964089fb0 con 0x7fe974100820 2024-09-21T12:11:14.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.105+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe974062630 con 0x7fe95c07af80 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.115+0000 7fe95bfff640 1 -- 172.21.15.118:0/2185563637 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe974062630 con 0x7fe95c07af80 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (29m) 7m ago 40m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (32m) 7m ago 40m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (31m) 7m ago 39m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (27m) 7m ago 40m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (27m) 7m ago 39m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (28m) 7m ago 39m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (23m) 7m ago 34m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (23m) 7m ago 34m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:11:14.116 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (7m) 7m ago 34m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (23m) 7m ago 34m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (31m) 7m ago 41m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (30m) 7m ago 39m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (27m) 7m ago 41m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (27m) 7m ago 39m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (30m) 7m ago 40m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (29m) 7m ago 39m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (26m) 7m ago 38m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (26m) 7m ago 37m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (25m) 7m ago 37m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (25m) 7m ago 36m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (24m) 7m ago 36m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (23m) 7m ago 35m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:11:14.117 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (29m) 7m ago 39m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:11:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe95c07af80 msgr2=0x7fe95c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe95c07af80 0x7fe95c07d440 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe9740fe6b0 tx=0x7fe96800a250 comp rx=0 tx=0).stop 2024-09-21T12:11:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974100820 msgr2=0x7fe9740fcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974100820 0x7fe9740fcc20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe964031460 tx=0x7fe9640048f0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 shutdown_connections 2024-09-21T12:11:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe974106820 0x7fe9740fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe95c07af80 0x7fe95c07d440 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 --2- 172.21.15.118:0/2185563637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe974100820 0x7fe9740fcc20 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 >> 172.21.15.118:0/2185563637 conn(0x7fe9740fc520 msgr2=0x7fe97406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:14.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 shutdown_connections 2024-09-21T12:11:14.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.117+0000 7fe9795df640 1 -- 172.21.15.118:0/2185563637 wait complete. 2024-09-21T12:11:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.197+0000 7fce2be7c640 1 -- 172.21.15.118:0/3160705759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24107930 msgr2=0x7fce24107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.197+0000 7fce2be7c640 1 --2- 172.21.15.118:0/3160705759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24107930 0x7fce24107d10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009880 tx=0x7fce1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.197+0000 7fce2be7c640 1 -- 172.21.15.118:0/3160705759 shutdown_connections 2024-09-21T12:11:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.197+0000 7fce2be7c640 1 --2- 172.21.15.118:0/3160705759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce24101930 0x7fce24101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.197+0000 7fce2be7c640 1 --2- 172.21.15.118:0/3160705759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24107930 0x7fce24107d10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.197+0000 7fce2be7c640 1 -- 172.21.15.118:0/3160705759 >> 172.21.15.118:0/3160705759 conn(0x7fce240fd630 msgr2=0x7fce240ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.197+0000 7fce2be7c640 1 -- 172.21.15.118:0/3160705759 shutdown_connections 2024-09-21T12:11:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.197+0000 7fce2be7c640 1 -- 172.21.15.118:0/3160705759 wait complete. 2024-09-21T12:11:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce2be7c640 1 Processor -- start 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce2be7c640 1 -- start start 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce2be7c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24101930 0x7fce240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce2be7c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce24107930 0x7fce24074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce2be7c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce2410ee60 con 0x7fce24101930 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce2be7c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce2410ece0 con 0x7fce24107930 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce29c18640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24101930 0x7fce240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce29c18640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24101930 0x7fce240744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59018/0 (socket says 172.21.15.118:59018) 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce29c18640 1 -- 172.21.15.118:0/222596974 learned_addr learned my addr 172.21.15.118:0/222596974 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.198+0000 7fce29417640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce24107930 0x7fce24074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.199+0000 7fce29c18640 1 -- 172.21.15.118:0/222596974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce24107930 msgr2=0x7fce24074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.199+0000 7fce29c18640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce24107930 0x7fce24074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.199+0000 7fce29c18640 1 -- 172.21.15.118:0/222596974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce24074f70 con 0x7fce24101930 2024-09-21T12:11:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.199+0000 7fce29c18640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24101930 0x7fce240744f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fce1c031460 tx=0x7fce1c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:14.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.199+0000 7fce22ffd640 1 -- 172.21.15.118:0/222596974 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce1c03f070 con 0x7fce24101930 2024-09-21T12:11:14.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.199+0000 7fce22ffd640 1 -- 172.21.15.118:0/222596974 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce1c004cf0 con 0x7fce24101930 2024-09-21T12:11:14.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.199+0000 7fce22ffd640 1 -- 172.21.15.118:0/222596974 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce1c035030 con 0x7fce24101930 2024-09-21T12:11:14.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.199+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce24075200 con 0x7fce24101930 2024-09-21T12:11:14.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.199+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce241a3e30 con 0x7fce24101930 2024-09-21T12:11:14.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.200+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce24103070 con 0x7fce24101930 2024-09-21T12:11:14.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.201+0000 7fce22ffd640 1 -- 172.21.15.118:0/222596974 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fce1c042070 con 0x7fce24101930 2024-09-21T12:11:14.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.201+0000 7fce22ffd640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0c07af30 0x7fce0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:14.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.201+0000 7fce22ffd640 1 -- 172.21.15.118:0/222596974 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fce1c0beb00 con 0x7fce24101930 2024-09-21T12:11:14.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.201+0000 7fce29417640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0c07af30 0x7fce0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:14.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.202+0000 7fce29417640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0c07af30 0x7fce0c07d3f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce24075f80 tx=0x7fce1800d040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:14.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.206+0000 7fce22ffd640 1 -- 172.21.15.118:0/222596974 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce1c08a050 con 0x7fce24101930 2024-09-21T12:11:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:14 smithi149 ceph-mon[79770]: pgmap v973: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:14 smithi149 ceph-mon[79770]: from='client.35564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:14 smithi149 ceph-mon[79770]: from='client.35568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:14.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.456+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fce24109ea0 con 0x7fce24101930 2024-09-21T12:11:14.457 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:14 smithi118 ceph-mon[111738]: pgmap v973: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:14.457 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:14 smithi118 ceph-mon[111738]: from='client.35564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:14.457 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:14 smithi118 ceph-mon[111738]: from='client.35568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:14.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.456+0000 7fce22ffd640 1 -- 172.21.15.118:0/222596974 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fce1c08ef00 con 0x7fce24101930 2024-09-21T12:11:14.457 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:11:14.458 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:11:14.459 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.458+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0c07af30 msgr2=0x7fce0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.458+0000 7fce2be7c640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0c07af30 0x7fce0c07d3f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce24075f80 tx=0x7fce1800d040 comp rx=0 tx=0).stop 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.458+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24101930 msgr2=0x7fce240744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.458+0000 7fce2be7c640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24101930 0x7fce240744f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fce1c031460 tx=0x7fce1c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.458+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 shutdown_connections 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.458+0000 7fce2be7c640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce24107930 0x7fce24074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.458+0000 7fce2be7c640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0c07af30 0x7fce0c07d3f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.458+0000 7fce2be7c640 1 --2- 172.21.15.118:0/222596974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce24101930 0x7fce240744f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.458+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 >> 172.21.15.118:0/222596974 conn(0x7fce240fd630 msgr2=0x7fce240fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.459+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 shutdown_connections 2024-09-21T12:11:14.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.459+0000 7fce2be7c640 1 -- 172.21.15.118:0/222596974 wait complete. 2024-09-21T12:11:14.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.539+0000 7fb9aed90640 1 -- 172.21.15.118:0/4092238101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81007e0 msgr2=0x7fb9a8100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.539+0000 7fb9aed90640 1 --2- 172.21.15.118:0/4092238101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81007e0 0x7fb9a8100c40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb990009c20 tx=0x7fb99002a970 comp rx=0 tx=0).stop 2024-09-21T12:11:14.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 -- 172.21.15.118:0/4092238101 shutdown_connections 2024-09-21T12:11:14.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 --2- 172.21.15.118:0/4092238101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81007e0 0x7fb9a8100c40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 --2- 172.21.15.118:0/4092238101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9a81067e0 0x7fb9a8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 -- 172.21.15.118:0/4092238101 >> 172.21.15.118:0/4092238101 conn(0x7fb9a80fc4c0 msgr2=0x7fb9a80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:14.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 -- 172.21.15.118:0/4092238101 shutdown_connections 2024-09-21T12:11:14.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 -- 172.21.15.118:0/4092238101 wait complete. 2024-09-21T12:11:14.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 Processor -- start 2024-09-21T12:11:14.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 -- start start 2024-09-21T12:11:14.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9a81007e0 0x7fb9a819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:14.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81067e0 0x7fb9a819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:14.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a810dc90 con 0x7fb9a81067e0 2024-09-21T12:11:14.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.540+0000 7fb9aed90640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a810db10 con 0x7fb9a81007e0 2024-09-21T12:11:14.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81067e0 0x7fb9a819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:14.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81067e0 0x7fb9a819caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59030/0 (socket says 172.21.15.118:59030) 2024-09-21T12:11:14.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a7fff640 1 -- 172.21.15.118:0/3206702864 learned_addr learned my addr 172.21.15.118:0/3206702864 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9acb2c640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9a81007e0 0x7fb9a819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a7fff640 1 -- 172.21.15.118:0/3206702864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9a81007e0 msgr2=0x7fb9a819c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a7fff640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9a81007e0 0x7fb9a819c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a7fff640 1 -- 172.21.15.118:0/3206702864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a8196680 con 0x7fb9a81067e0 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a7fff640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81067e0 0x7fb9a819caf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb990005cc0 tx=0x7fb99002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a5ffb640 1 -- 172.21.15.118:0/3206702864 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb990047070 con 0x7fb9a81067e0 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a5ffb640 1 -- 172.21.15.118:0/3206702864 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb99002f7e0 con 0x7fb9a81067e0 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a8196910 con 0x7fb9a81067e0 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9a5ffb640 1 -- 172.21.15.118:0/3206702864 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb990034070 con 0x7fb9a81067e0 2024-09-21T12:11:14.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.541+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a8196e40 con 0x7fb9a81067e0 2024-09-21T12:11:14.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.542+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a8101f20 con 0x7fb9a81067e0 2024-09-21T12:11:14.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.543+0000 7fb9a5ffb640 1 -- 172.21.15.118:0/3206702864 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb99004a070 con 0x7fb9a81067e0 2024-09-21T12:11:14.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.544+0000 7fb9a5ffb640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99407af30 0x7fb99407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:14.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.544+0000 7fb9a5ffb640 1 -- 172.21.15.118:0/3206702864 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb9900bef90 con 0x7fb9a81067e0 2024-09-21T12:11:14.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.544+0000 7fb9acb2c640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99407af30 0x7fb99407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:14.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.544+0000 7fb9acb2c640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99407af30 0x7fb99407d3f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000abe0 tx=0x7fb9a000a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:14.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.548+0000 7fb9a5ffb640 1 -- 172.21.15.118:0/3206702864 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb99003f070 con 0x7fb9a81067e0 2024-09-21T12:11:14.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.758+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb9a8197bb0 con 0x7fb9a81067e0 2024-09-21T12:11:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.759+0000 7fb9a5ffb640 1 -- 172.21.15.118:0/3206702864 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7fb99008a440 con 0x7fb9a81067e0 2024-09-21T12:11:14.760 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:11:14.760 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:11:14.760 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:11:14.760 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:11:14.761 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:11:14.762 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:11:14.763 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:11:14.763 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:11:14.763 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:11:14.763 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:11:14.763 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:11:14.763 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:11:14.763 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:11:14.763 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99407af30 msgr2=0x7fb99407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99407af30 0x7fb99407d3f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000abe0 tx=0x7fb9a000a2d0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81067e0 msgr2=0x7fb9a819caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81067e0 0x7fb9a819caf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb990005cc0 tx=0x7fb99002f5f0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 shutdown_connections 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb99407af30 0x7fb99407d3f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9a81067e0 0x7fb9a819caf0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 --2- 172.21.15.118:0/3206702864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9a81007e0 0x7fb9a819c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 >> 172.21.15.118:0/3206702864 conn(0x7fb9a80fc4c0 msgr2=0x7fb9a80fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 shutdown_connections 2024-09-21T12:11:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.762+0000 7fb9aed90640 1 -- 172.21.15.118:0/3206702864 wait complete. 2024-09-21T12:11:14.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.846+0000 7f5ffa744640 1 -- 172.21.15.118:0/707149206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 msgr2=0x7f5ff4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.846+0000 7f5ffa744640 1 --2- 172.21.15.118:0/707149206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 0x7f5ff4100c80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009880 tx=0x7f5fe802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.846+0000 7f5ffa744640 1 -- 172.21.15.118:0/707149206 shutdown_connections 2024-09-21T12:11:14.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.846+0000 7f5ffa744640 1 --2- 172.21.15.118:0/707149206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 0x7f5ff4100c80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.846+0000 7f5ffa744640 1 --2- 172.21.15.118:0/707149206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff4106820 0x7f5ff4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.846+0000 7f5ffa744640 1 -- 172.21.15.118:0/707149206 >> 172.21.15.118:0/707149206 conn(0x7f5ff40fc520 msgr2=0x7f5ff40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:14.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.846+0000 7f5ffa744640 1 -- 172.21.15.118:0/707149206 shutdown_connections 2024-09-21T12:11:14.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.846+0000 7f5ffa744640 1 -- 172.21.15.118:0/707149206 wait complete. 2024-09-21T12:11:14.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ffa744640 1 Processor -- start 2024-09-21T12:11:14.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ffa744640 1 -- start start 2024-09-21T12:11:14.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ffa744640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 0x7f5ff419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ffa744640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff4106820 0x7f5ff419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ffa744640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff410dcd0 con 0x7f5ff4100820 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ffa744640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff410db50 con 0x7f5ff4106820 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ff3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 0x7f5ff419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ff3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 0x7f5ff419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59050/0 (socket says 172.21.15.118:59050) 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ff3fff640 1 -- 172.21.15.118:0/4138889049 learned_addr learned my addr 172.21.15.118:0/4138889049 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ff37fe640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff4106820 0x7f5ff419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ff3fff640 1 -- 172.21.15.118:0/4138889049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff4106820 msgr2=0x7f5ff419dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ff3fff640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff4106820 0x7f5ff419dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.847+0000 7f5ff3fff640 1 -- 172.21.15.118:0/4138889049 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff41977f0 con 0x7f5ff4100820 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.848+0000 7f5ff3fff640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 0x7f5ff419d670 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400c8a0 tx=0x7f5fe400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.848+0000 7f5ff17fa640 1 -- 172.21.15.118:0/4138889049 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fe40079b0 con 0x7f5ff4100820 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.848+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff4197ae0 con 0x7f5ff4100820 2024-09-21T12:11:14.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.848+0000 7f5ff17fa640 1 -- 172.21.15.118:0/4138889049 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fe4007b50 con 0x7f5ff4100820 2024-09-21T12:11:14.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.848+0000 7f5ff17fa640 1 -- 172.21.15.118:0/4138889049 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fe4018700 con 0x7f5ff4100820 2024-09-21T12:11:14.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.848+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff4198040 con 0x7f5ff4100820 2024-09-21T12:11:14.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.849+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff4101f60 con 0x7f5ff4100820 2024-09-21T12:11:14.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.850+0000 7f5ff17fa640 1 -- 172.21.15.118:0/4138889049 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5fe4007d00 con 0x7f5ff4100820 2024-09-21T12:11:14.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.850+0000 7f5ff17fa640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fdc07af30 0x7f5fdc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:14.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.850+0000 7f5ff37fe640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fdc07af30 0x7f5fdc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:14.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.850+0000 7f5ff17fa640 1 -- 172.21.15.118:0/4138889049 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5fe409e2d0 con 0x7f5ff4100820 2024-09-21T12:11:14.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.851+0000 7f5ff37fe640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fdc07af30 0x7f5fdc07d3f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4198b40 tx=0x7f5fe8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:14.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:14.854+0000 7f5ff17fa640 1 -- 172.21.15.118:0/4138889049 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fe4014030 con 0x7f5ff4100820 2024-09-21T12:11:15.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.046+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5ff41982f0 con 0x7f5fdc07af30 2024-09-21T12:11:15.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.047+0000 7f5ff17fa640 1 -- 172.21.15.118:0/4138889049 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5ff41982f0 con 0x7f5fdc07af30 2024-09-21T12:11:15.048 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:11:15.048 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:11:15.049 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.049+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fdc07af30 msgr2=0x7f5fdc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.049+0000 7f5ffa744640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fdc07af30 0x7f5fdc07d3f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4198b40 tx=0x7f5fe8031400 comp rx=0 tx=0).stop 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.049+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 msgr2=0x7f5ff419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.049+0000 7f5ffa744640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 0x7f5ff419d670 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400c8a0 tx=0x7f5fe400cd60 comp rx=0 tx=0).stop 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.049+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 shutdown_connections 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.049+0000 7f5ffa744640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff4106820 0x7f5ff419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.049+0000 7f5ffa744640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5fdc07af30 0x7f5fdc07d3f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.049+0000 7f5ffa744640 1 --2- 172.21.15.118:0/4138889049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ff4100820 0x7f5ff419d670 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.049+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 >> 172.21.15.118:0/4138889049 conn(0x7f5ff40fc520 msgr2=0x7f5ff406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.050+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 shutdown_connections 2024-09-21T12:11:15.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.050+0000 7f5ffa744640 1 -- 172.21.15.118:0/4138889049 wait complete. 2024-09-21T12:11:15.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.131+0000 7f5012a9b640 1 -- 172.21.15.118:0/3597666120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 msgr2=0x7f500c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:15.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.131+0000 7f5012a9b640 1 --2- 172.21.15.118:0/3597666120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 0x7f500c106bc0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5000009880 tx=0x7f500002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.131+0000 7f5012a9b640 1 -- 172.21.15.118:0/3597666120 shutdown_connections 2024-09-21T12:11:15.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.131+0000 7f5012a9b640 1 --2- 172.21.15.118:0/3597666120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c1007e0 0x7f500c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.131+0000 7f5012a9b640 1 --2- 172.21.15.118:0/3597666120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 0x7f500c106bc0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.131+0000 7f5012a9b640 1 -- 172.21.15.118:0/3597666120 >> 172.21.15.118:0/3597666120 conn(0x7f500c0fc4c0 msgr2=0x7f500c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:15.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.131+0000 7f5012a9b640 1 -- 172.21.15.118:0/3597666120 shutdown_connections 2024-09-21T12:11:15.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.131+0000 7f5012a9b640 1 -- 172.21.15.118:0/3597666120 wait complete. 2024-09-21T12:11:15.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.131+0000 7f5012a9b640 1 Processor -- start 2024-09-21T12:11:15.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f5012a9b640 1 -- start start 2024-09-21T12:11:15.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f5012a9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c1007e0 0x7f500c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:15.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f5012a9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 0x7f500c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:15.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f5012a9b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f500c10dcb0 con 0x7f500c1067e0 2024-09-21T12:11:15.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f5012a9b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f500c10db30 con 0x7f500c1007e0 2024-09-21T12:11:15.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f500bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 0x7f500c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f500bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 0x7f500c19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59068/0 (socket says 172.21.15.118:59068) 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f500bfff640 1 -- 172.21.15.118:0/3191029944 learned_addr learned my addr 172.21.15.118:0/3191029944 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f5010837640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c1007e0 0x7f500c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f500bfff640 1 -- 172.21.15.118:0/3191029944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c1007e0 msgr2=0x7f500c19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f500bfff640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c1007e0 0x7f500c19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f500bfff640 1 -- 172.21.15.118:0/3191029944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c1966e0 con 0x7f500c1067e0 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f500bfff640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 0x7f500c19cb50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800d6f0 tx=0x7f4ff800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.132+0000 7f5009ffb640 1 -- 172.21.15.118:0/3191029944 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ff8017070 con 0x7f500c1067e0 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.133+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500c1969d0 con 0x7f500c1067e0 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.133+0000 7f5009ffb640 1 -- 172.21.15.118:0/3191029944 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ff800de00 con 0x7f500c1067e0 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.133+0000 7f5009ffb640 1 -- 172.21.15.118:0/3191029944 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ff8004bb0 con 0x7f500c1067e0 2024-09-21T12:11:15.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.133+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500c196f30 con 0x7f500c1067e0 2024-09-21T12:11:15.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.134+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500c101f20 con 0x7f500c1067e0 2024-09-21T12:11:15.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.134+0000 7f5009ffb640 1 -- 172.21.15.118:0/3191029944 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4ff8009a30 con 0x7f500c1067e0 2024-09-21T12:11:15.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.135+0000 7f5009ffb640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ffc07af80 0x7f4ffc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:15.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.135+0000 7f5009ffb640 1 -- 172.21.15.118:0/3191029944 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4ff809db70 con 0x7f500c1067e0 2024-09-21T12:11:15.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.135+0000 7f5010837640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ffc07af80 0x7f4ffc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:15.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.135+0000 7f5010837640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ffc07af80 0x7f4ffc07d440 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f50000096c0 tx=0x7f5000031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:15.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.139+0000 7f5009ffb640 1 -- 172.21.15.118:0/3191029944 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ff8069140 con 0x7f500c1067e0 2024-09-21T12:11:15.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:15 smithi118 ceph-mon[111738]: from='client.35572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:15.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:15 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/222596974' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:11:15.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:15 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3206702864' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:11:15.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.386+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f500c108d50 con 0x7f500c1067e0 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.387+0000 7f5009ffb640 1 -- 172.21.15.118:0/3191029944 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f4ff806dff0 con 0x7f500c1067e0 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:11:15.388 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:11:15.389 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:11:15.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ffc07af80 msgr2=0x7f4ffc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:15.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ffc07af80 0x7f4ffc07d440 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f50000096c0 tx=0x7f5000031400 comp rx=0 tx=0).stop 2024-09-21T12:11:15.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 msgr2=0x7f500c19cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:15.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 0x7f500c19cb50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800d6f0 tx=0x7f4ff800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 shutdown_connections 2024-09-21T12:11:15.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4ffc07af80 0x7f4ffc07d440 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f500c1067e0 0x7f500c19cb50 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 --2- 172.21.15.118:0/3191029944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c1007e0 0x7f500c19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:15.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 >> 172.21.15.118:0/3191029944 conn(0x7f500c0fc4c0 msgr2=0x7f500c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:15.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 shutdown_connections 2024-09-21T12:11:15.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:15.389+0000 7f5012a9b640 1 -- 172.21.15.118:0/3191029944 wait complete. 2024-09-21T12:11:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:15 smithi149 ceph-mon[79770]: from='client.35572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:15 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/222596974' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:11:15.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:15 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3206702864' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:11:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:16 smithi118 ceph-mon[111738]: pgmap v974: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:16 smithi118 ceph-mon[111738]: from='client.35584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:16 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3191029944' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:11:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:16 smithi149 ceph-mon[79770]: pgmap v974: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:16.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:16 smithi149 ceph-mon[79770]: from='client.35584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:16.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:16 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3191029944' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:11:18.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:18 smithi118 ceph-mon[111738]: pgmap v975: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:18 smithi149 ceph-mon[79770]: pgmap v975: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:20 smithi118 ceph-mon[111738]: pgmap v976: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:11:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:20 smithi149 ceph-mon[79770]: pgmap v976: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:11:22.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:22 smithi149 ceph-mon[79770]: pgmap v977: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:22.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:22 smithi118 ceph-mon[111738]: pgmap v977: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:24 smithi149 ceph-mon[79770]: pgmap v978: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:24.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:24 smithi118 ceph-mon[111738]: pgmap v978: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:26 smithi118 ceph-mon[111738]: pgmap v979: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:26 smithi149 ceph-mon[79770]: pgmap v979: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:28.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:28 smithi118 ceph-mon[111738]: pgmap v980: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:28 smithi149 ceph-mon[79770]: pgmap v980: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:30.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:30 smithi118 ceph-mon[111738]: pgmap v981: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:30.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:30 smithi149 ceph-mon[79770]: pgmap v981: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:32 smithi118 ceph-mon[111738]: pgmap v982: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:32.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:32 smithi149 ceph-mon[79770]: pgmap v982: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:34.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:34 smithi118 ceph-mon[111738]: pgmap v983: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:34.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:34 smithi149 ceph-mon[79770]: pgmap v983: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:35.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:11:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:11:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:36 smithi118 ceph-mon[111738]: pgmap v984: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:36.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:36 smithi149 ceph-mon[79770]: pgmap v984: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:38.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:38 smithi118 ceph-mon[111738]: pgmap v985: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:38.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:38 smithi149 ceph-mon[79770]: pgmap v985: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:40.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:40 smithi118 ceph-mon[111738]: pgmap v986: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:40 smithi149 ceph-mon[79770]: pgmap v986: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:42.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:42 smithi118 ceph-mon[111738]: pgmap v987: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:42.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:42 smithi149 ceph-mon[79770]: pgmap v987: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:44.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:44 smithi118 ceph-mon[111738]: pgmap v988: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:44.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:44 smithi149 ceph-mon[79770]: pgmap v988: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:45.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.480+0000 7fc7625e2640 1 -- 172.21.15.118:0/3387708832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c107930 msgr2=0x7fc75c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:45.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.480+0000 7fc7625e2640 1 --2- 172.21.15.118:0/3387708832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c107930 0x7fc75c107d10 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009880 tx=0x7fc74c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.481+0000 7fc7625e2640 1 -- 172.21.15.118:0/3387708832 shutdown_connections 2024-09-21T12:11:45.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.481+0000 7fc7625e2640 1 --2- 172.21.15.118:0/3387708832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75c101930 0x7fc75c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.481+0000 7fc7625e2640 1 --2- 172.21.15.118:0/3387708832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c107930 0x7fc75c107d10 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.481+0000 7fc7625e2640 1 -- 172.21.15.118:0/3387708832 >> 172.21.15.118:0/3387708832 conn(0x7fc75c0fd630 msgr2=0x7fc75c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:45.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.481+0000 7fc7625e2640 1 -- 172.21.15.118:0/3387708832 shutdown_connections 2024-09-21T12:11:45.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.481+0000 7fc7625e2640 1 -- 172.21.15.118:0/3387708832 wait complete. 2024-09-21T12:11:45.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.481+0000 7fc7625e2640 1 Processor -- start 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.481+0000 7fc7625e2640 1 -- start start 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc7625e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c101930 0x7fc75c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc7625e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75c107930 0x7fc75c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc7625e2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c10ee00 con 0x7fc75c101930 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc7625e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c10ec80 con 0x7fc75c107930 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc75bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c101930 0x7fc75c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc75bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c101930 0x7fc75c19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33214/0 (socket says 172.21.15.118:33214) 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc75bfff640 1 -- 172.21.15.118:0/2613664640 learned_addr learned my addr 172.21.15.118:0/2613664640 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc75b7fe640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75c107930 0x7fc75c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc75bfff640 1 -- 172.21.15.118:0/2613664640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75c107930 msgr2=0x7fc75c19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc75bfff640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75c107930 0x7fc75c19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc75bfff640 1 -- 172.21.15.118:0/2613664640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c1977f0 con 0x7fc75c101930 2024-09-21T12:11:45.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc75b7fe640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75c107930 0x7fc75c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:11:45.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.482+0000 7fc75bfff640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c101930 0x7fc75c19d670 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc74c031460 tx=0x7fc74c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:45.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.483+0000 7fc7597fa640 1 -- 172.21.15.118:0/2613664640 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc74c03f070 con 0x7fc75c101930 2024-09-21T12:11:45.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.483+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75c197a80 con 0x7fc75c101930 2024-09-21T12:11:45.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.483+0000 7fc7597fa640 1 -- 172.21.15.118:0/2613664640 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc74c0035f0 con 0x7fc75c101930 2024-09-21T12:11:45.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.483+0000 7fc7597fa640 1 -- 172.21.15.118:0/2613664640 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc74c035030 con 0x7fc75c101930 2024-09-21T12:11:45.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.483+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75c197fb0 con 0x7fc75c101930 2024-09-21T12:11:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.484+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75c103070 con 0x7fc75c101930 2024-09-21T12:11:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.485+0000 7fc7597fa640 1 -- 172.21.15.118:0/2613664640 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc74c042070 con 0x7fc75c101930 2024-09-21T12:11:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.485+0000 7fc7597fa640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc74407af30 0x7fc74407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.485+0000 7fc7597fa640 1 -- 172.21.15.118:0/2613664640 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc74c0bea60 con 0x7fc75c101930 2024-09-21T12:11:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.485+0000 7fc75b7fe640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc74407af30 0x7fc74407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:45.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.486+0000 7fc75b7fe640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc74407af30 0x7fc74407d3f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0ffc20 tx=0x7fc750005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:45.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.490+0000 7fc7597fa640 1 -- 172.21.15.118:0/2613664640 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc74c089fb0 con 0x7fc75c101930 2024-09-21T12:11:45.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.684+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc75c198320 con 0x7fc74407af30 2024-09-21T12:11:45.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.686+0000 7fc7597fa640 1 -- 172.21.15.118:0/2613664640 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc75c198320 con 0x7fc74407af30 2024-09-21T12:11:45.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc74407af30 msgr2=0x7fc74407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:45.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc74407af30 0x7fc74407d3f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0ffc20 tx=0x7fc750005f90 comp rx=0 tx=0).stop 2024-09-21T12:11:45.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c101930 msgr2=0x7fc75c19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:45.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c101930 0x7fc75c19d670 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc74c031460 tx=0x7fc74c004530 comp rx=0 tx=0).stop 2024-09-21T12:11:45.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 shutdown_connections 2024-09-21T12:11:45.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75c107930 0x7fc75c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc74407af30 0x7fc74407d3f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 --2- 172.21.15.118:0/2613664640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc75c101930 0x7fc75c19d670 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 >> 172.21.15.118:0/2613664640 conn(0x7fc75c0fd630 msgr2=0x7fc75c0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:45.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 shutdown_connections 2024-09-21T12:11:45.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.688+0000 7fc7625e2640 1 -- 172.21.15.118:0/2613664640 wait complete. 2024-09-21T12:11:45.699 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:11:45.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.771+0000 7f340ae2c640 1 -- 172.21.15.118:0/653468310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 msgr2=0x7f3404106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:45.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.771+0000 7f340ae2c640 1 --2- 172.21.15.118:0/653468310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 0x7f3404106c00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009880 tx=0x7f33f402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.771+0000 7f340ae2c640 1 -- 172.21.15.118:0/653468310 shutdown_connections 2024-09-21T12:11:45.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.771+0000 7f340ae2c640 1 --2- 172.21.15.118:0/653468310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3404100820 0x7f3404100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.771+0000 7f340ae2c640 1 --2- 172.21.15.118:0/653468310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 0x7f3404106c00 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.771+0000 7f340ae2c640 1 -- 172.21.15.118:0/653468310 >> 172.21.15.118:0/653468310 conn(0x7f34040fc520 msgr2=0x7f34040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:45.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.771+0000 7f340ae2c640 1 -- 172.21.15.118:0/653468310 shutdown_connections 2024-09-21T12:11:45.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.771+0000 7f340ae2c640 1 -- 172.21.15.118:0/653468310 wait complete. 2024-09-21T12:11:45.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.771+0000 7f340ae2c640 1 Processor -- start 2024-09-21T12:11:45.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f340ae2c640 1 -- start start 2024-09-21T12:11:45.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f340ae2c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3404100820 0x7f3404198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:45.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f340ae2c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 0x7f3404198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:45.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f340ae2c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f340410dd50 con 0x7f3404106820 2024-09-21T12:11:45.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f340ae2c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f340410dbd0 con 0x7f3404100820 2024-09-21T12:11:45.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f3403fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 0x7f3404198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:45.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f3403fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 0x7f3404198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33242/0 (socket says 172.21.15.118:33242) 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f3403fff640 1 -- 172.21.15.118:0/1262106255 learned_addr learned my addr 172.21.15.118:0/1262106255 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f3408bc8640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3404100820 0x7f3404198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f3403fff640 1 -- 172.21.15.118:0/1262106255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3404100820 msgr2=0x7f3404198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f3403fff640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3404100820 0x7f3404198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f3403fff640 1 -- 172.21.15.118:0/1262106255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34041993a0 con 0x7f3404106820 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.772+0000 7f3403fff640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 0x7f3404198da0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00b420 tx=0x7f33ec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.773+0000 7f3401ffb640 1 -- 172.21.15.118:0/1262106255 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33ec011630 con 0x7f3404106820 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.773+0000 7f3401ffb640 1 -- 172.21.15.118:0/1262106255 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33ec016070 con 0x7f3404106820 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.773+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3404199690 con 0x7f3404106820 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.773+0000 7f3401ffb640 1 -- 172.21.15.118:0/1262106255 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33ec010d40 con 0x7f3404106820 2024-09-21T12:11:45.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.773+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34041a1c90 con 0x7f3404106820 2024-09-21T12:11:45.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.774+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3404101f60 con 0x7f3404106820 2024-09-21T12:11:45.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.774+0000 7f3401ffb640 1 -- 172.21.15.118:0/1262106255 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f33ec01b460 con 0x7f3404106820 2024-09-21T12:11:45.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.775+0000 7f3401ffb640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f33f007af30 0x7f33f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:45.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.775+0000 7f3408bc8640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f33f007af30 0x7f33f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:45.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.775+0000 7f3401ffb640 1 -- 172.21.15.118:0/1262106255 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f33ec09d890 con 0x7f3404106820 2024-09-21T12:11:45.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.776+0000 7f3408bc8640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f33f007af30 0x7f33f007d3f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f33f40096c0 tx=0x7f33f4031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:45.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.779+0000 7f3401ffb640 1 -- 172.21.15.118:0/1262106255 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3404199690 con 0x7f3404106820 2024-09-21T12:11:45.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.976+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3404062630 con 0x7f33f007af30 2024-09-21T12:11:45.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.977+0000 7f3401ffb640 1 -- 172.21.15.118:0/1262106255 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3404062630 con 0x7f33f007af30 2024-09-21T12:11:45.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f33f007af30 msgr2=0x7f33f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f33f007af30 0x7f33f007d3f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f33f40096c0 tx=0x7f33f4031400 comp rx=0 tx=0).stop 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 msgr2=0x7f3404198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 0x7f3404198da0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00b420 tx=0x7f33ec00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 shutdown_connections 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f33f007af30 0x7f33f007d3f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3404106820 0x7f3404198da0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 --2- 172.21.15.118:0/1262106255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3404100820 0x7f3404198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 >> 172.21.15.118:0/1262106255 conn(0x7f34040fc520 msgr2=0x7f34040fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 shutdown_connections 2024-09-21T12:11:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:45.979+0000 7f340ae2c640 1 -- 172.21.15.118:0/1262106255 wait complete. 2024-09-21T12:11:46.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.062+0000 7f746dfeb640 1 -- 172.21.15.118:0/4129039266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468101910 msgr2=0x7f7468101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.062+0000 7f746dfeb640 1 --2- 172.21.15.118:0/4129039266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468101910 0x7f7468101d70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f745c009880 tx=0x7f745c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.062+0000 7f746dfeb640 1 -- 172.21.15.118:0/4129039266 shutdown_connections 2024-09-21T12:11:46.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.062+0000 7f746dfeb640 1 --2- 172.21.15.118:0/4129039266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468101910 0x7f7468101d70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.062+0000 7f746dfeb640 1 --2- 172.21.15.118:0/4129039266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7468107910 0x7f7468107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.062+0000 7f746dfeb640 1 -- 172.21.15.118:0/4129039266 >> 172.21.15.118:0/4129039266 conn(0x7f74680fd630 msgr2=0x7f74680ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.062+0000 7f746dfeb640 1 -- 172.21.15.118:0/4129039266 shutdown_connections 2024-09-21T12:11:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.062+0000 7f746dfeb640 1 -- 172.21.15.118:0/4129039266 wait complete. 2024-09-21T12:11:46.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f746dfeb640 1 Processor -- start 2024-09-21T12:11:46.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f746dfeb640 1 -- start start 2024-09-21T12:11:46.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f746dfeb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7468101910 0x7f746819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f746dfeb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468107910 0x7f746819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f746dfeb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f746810edc0 con 0x7f7468107910 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f746dfeb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f746810ec40 con 0x7f7468101910 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f7466ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468107910 0x7f746819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f7466ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468107910 0x7f746819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33272/0 (socket says 172.21.15.118:33272) 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f7466ffd640 1 -- 172.21.15.118:0/3452710622 learned_addr learned my addr 172.21.15.118:0/3452710622 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.063+0000 7f74677fe640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7468101910 0x7f746819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.064+0000 7f7466ffd640 1 -- 172.21.15.118:0/3452710622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7468101910 msgr2=0x7f746819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.064+0000 7f7466ffd640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7468101910 0x7f746819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.064+0000 7f7466ffd640 1 -- 172.21.15.118:0/3452710622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74681977e0 con 0x7f7468107910 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.064+0000 7f7466ffd640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468107910 0x7f746819dba0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f745c031460 tx=0x7f745c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.064+0000 7f7464ff9640 1 -- 172.21.15.118:0/3452710622 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f745c03f070 con 0x7f7468107910 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.064+0000 7f7464ff9640 1 -- 172.21.15.118:0/3452710622 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f745c0035f0 con 0x7f7468107910 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.064+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7468197a70 con 0x7f7468107910 2024-09-21T12:11:46.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.064+0000 7f7464ff9640 1 -- 172.21.15.118:0/3452710622 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f745c035030 con 0x7f7468107910 2024-09-21T12:11:46.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.064+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7468197fa0 con 0x7f7468107910 2024-09-21T12:11:46.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.065+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7468103050 con 0x7f7468107910 2024-09-21T12:11:46.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.066+0000 7f7464ff9640 1 -- 172.21.15.118:0/3452710622 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f745c042070 con 0x7f7468107910 2024-09-21T12:11:46.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.067+0000 7f7464ff9640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f745007af30 0x7f745007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.067+0000 7f74677fe640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f745007af30 0x7f745007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:46.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.067+0000 7f7464ff9640 1 -- 172.21.15.118:0/3452710622 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f745c0bea80 con 0x7f7468107910 2024-09-21T12:11:46.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.067+0000 7f74677fe640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f745007af30 0x7f745007d3f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7458005d00 tx=0x7f745800b410 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:46.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.071+0000 7f7464ff9640 1 -- 172.21.15.118:0/3452710622 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f745c089f70 con 0x7f7468107910 2024-09-21T12:11:46.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.256+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7468198310 con 0x7f745007af30 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.266+0000 7f7464ff9640 1 -- 172.21.15.118:0/3452710622 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7468198310 con 0x7f745007af30 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (29m) 8m ago 40m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (32m) 8m ago 40m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (32m) 8m ago 39m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (27m) 8m ago 40m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (27m) 8m ago 39m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (29m) 8m ago 40m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (24m) 8m ago 35m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (23m) 8m ago 35m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:11:46.268 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (8m) 8m ago 35m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (23m) 8m ago 35m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (31m) 8m ago 42m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (30m) 8m ago 39m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (28m) 8m ago 42m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (28m) 8m ago 39m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (30m) 8m ago 40m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (30m) 8m ago 39m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (27m) 8m ago 38m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (26m) 8m ago 38m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (26m) 8m ago 37m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (25m) 8m ago 37m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (24m) 8m ago 36m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (24m) 8m ago 36m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:11:46.269 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (30m) 8m ago 40m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:11:46.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f745007af30 msgr2=0x7f745007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f745007af30 0x7f745007d3f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7458005d00 tx=0x7f745800b410 comp rx=0 tx=0).stop 2024-09-21T12:11:46.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468107910 msgr2=0x7f746819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468107910 0x7f746819dba0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f745c031460 tx=0x7f745c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 shutdown_connections 2024-09-21T12:11:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f745007af30 0x7f745007d3f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7468107910 0x7f746819dba0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 --2- 172.21.15.118:0/3452710622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7468101910 0x7f746819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 >> 172.21.15.118:0/3452710622 conn(0x7f74680fd630 msgr2=0x7f74680fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 shutdown_connections 2024-09-21T12:11:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.268+0000 7f746dfeb640 1 -- 172.21.15.118:0/3452710622 wait complete. 2024-09-21T12:11:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:46 smithi118 ceph-mon[111738]: pgmap v989: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:46 smithi118 ceph-mon[111738]: from='client.35592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.350+0000 7fd56cbf6640 1 -- 172.21.15.118:0/1528840970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681067e0 msgr2=0x7fd568106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.350+0000 7fd56cbf6640 1 --2- 172.21.15.118:0/1528840970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681067e0 0x7fd568106bc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd560009880 tx=0x7fd56002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.350+0000 7fd56cbf6640 1 -- 172.21.15.118:0/1528840970 shutdown_connections 2024-09-21T12:11:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.350+0000 7fd56cbf6640 1 --2- 172.21.15.118:0/1528840970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5681007e0 0x7fd568100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.350+0000 7fd56cbf6640 1 --2- 172.21.15.118:0/1528840970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681067e0 0x7fd568106bc0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.350+0000 7fd56cbf6640 1 -- 172.21.15.118:0/1528840970 >> 172.21.15.118:0/1528840970 conn(0x7fd5680fc4c0 msgr2=0x7fd5680fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.350+0000 7fd56cbf6640 1 -- 172.21.15.118:0/1528840970 shutdown_connections 2024-09-21T12:11:46.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.350+0000 7fd56cbf6640 1 -- 172.21.15.118:0/1528840970 wait complete. 2024-09-21T12:11:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56cbf6640 1 Processor -- start 2024-09-21T12:11:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56cbf6640 1 -- start start 2024-09-21T12:11:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56cbf6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681007e0 0x7fd568198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56cbf6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5681067e0 0x7fd568198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56cbf6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd56810dcb0 con 0x7fd5681007e0 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56cbf6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd56810db30 con 0x7fd5681067e0 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681007e0 0x7fd568198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681007e0 0x7fd568198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33290/0 (socket says 172.21.15.118:33290) 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56659c640 1 -- 172.21.15.118:0/2455309586 learned_addr learned my addr 172.21.15.118:0/2455309586 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd565d9b640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5681067e0 0x7fd568198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56659c640 1 -- 172.21.15.118:0/2455309586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5681067e0 msgr2=0x7fd568198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56659c640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5681067e0 0x7fd568198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.351+0000 7fd56659c640 1 -- 172.21.15.118:0/2455309586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd568199360 con 0x7fd5681007e0 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.352+0000 7fd56659c640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681007e0 0x7fd568198820 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd560031460 tx=0x7fd5600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.352+0000 7fd55f7fe640 1 -- 172.21.15.118:0/2455309586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd56003f070 con 0x7fd5681007e0 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.352+0000 7fd55f7fe640 1 -- 172.21.15.118:0/2455309586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5600035f0 con 0x7fd5681007e0 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.352+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5681995f0 con 0x7fd5681007e0 2024-09-21T12:11:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.352+0000 7fd55f7fe640 1 -- 172.21.15.118:0/2455309586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd560035030 con 0x7fd5681007e0 2024-09-21T12:11:46.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.352+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5681a1ba0 con 0x7fd5681007e0 2024-09-21T12:11:46.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.353+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd568101f20 con 0x7fd5681007e0 2024-09-21T12:11:46.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.354+0000 7fd55f7fe640 1 -- 172.21.15.118:0/2455309586 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd560042070 con 0x7fd5681007e0 2024-09-21T12:11:46.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.354+0000 7fd55f7fe640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd55407af30 0x7fd55407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.354+0000 7fd55f7fe640 1 -- 172.21.15.118:0/2455309586 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd5600bea20 con 0x7fd5681007e0 2024-09-21T12:11:46.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.354+0000 7fd565d9b640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd55407af30 0x7fd55407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:46.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.355+0000 7fd565d9b640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd55407af30 0x7fd55407d3f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd56806a680 tx=0x7fd550009680 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:46.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.358+0000 7fd55f7fe640 1 -- 172.21.15.118:0/2455309586 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd560089f70 con 0x7fd5681007e0 2024-09-21T12:11:46.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.604+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd56806a150 con 0x7fd5681007e0 2024-09-21T12:11:46.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.605+0000 7fd55f7fe640 1 -- 172.21.15.118:0/2455309586 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd56806a150 con 0x7fd5681007e0 2024-09-21T12:11:46.607 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:11:46.607 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:11:46.607 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:11:46.607 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:11:46.607 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:11:46.607 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:11:46.608 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:11:46.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd55407af30 msgr2=0x7fd55407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd55407af30 0x7fd55407d3f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd56806a680 tx=0x7fd550009680 comp rx=0 tx=0).stop 2024-09-21T12:11:46.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681007e0 msgr2=0x7fd568198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681007e0 0x7fd568198820 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd560031460 tx=0x7fd5600045e0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 shutdown_connections 2024-09-21T12:11:46.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5681067e0 0x7fd568198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd55407af30 0x7fd55407d3f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 --2- 172.21.15.118:0/2455309586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5681007e0 0x7fd568198820 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 >> 172.21.15.118:0/2455309586 conn(0x7fd5680fc4c0 msgr2=0x7fd5680fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:46.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 shutdown_connections 2024-09-21T12:11:46.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.608+0000 7fd56cbf6640 1 -- 172.21.15.118:0/2455309586 wait complete. 2024-09-21T12:11:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.688+0000 7fb7f4aae640 1 -- 172.21.15.118:0/2163271636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f01033e0 msgr2=0x7fb7f010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.688+0000 7fb7f4aae640 1 --2- 172.21.15.118:0/2163271636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f01033e0 0x7fb7f010b8d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009880 tx=0x7fb7e402a530 comp rx=0 tx=0).stop 2024-09-21T12:11:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.689+0000 7fb7f4aae640 1 -- 172.21.15.118:0/2163271636 shutdown_connections 2024-09-21T12:11:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.689+0000 7fb7f4aae640 1 --2- 172.21.15.118:0/2163271636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f01033e0 0x7fb7f010b8d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.689+0000 7fb7f4aae640 1 --2- 172.21.15.118:0/2163271636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7f0102ac0 0x7fb7f0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.689+0000 7fb7f4aae640 1 -- 172.21.15.118:0/2163271636 >> 172.21.15.118:0/2163271636 conn(0x7fb7f00fc4e0 msgr2=0x7fb7f00fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.689+0000 7fb7f4aae640 1 -- 172.21.15.118:0/2163271636 shutdown_connections 2024-09-21T12:11:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.689+0000 7fb7f4aae640 1 -- 172.21.15.118:0/2163271636 wait complete. 2024-09-21T12:11:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.689+0000 7fb7f4aae640 1 Processor -- start 2024-09-21T12:11:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.689+0000 7fb7f4aae640 1 -- start start 2024-09-21T12:11:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7f4aae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f0102ac0 0x7fb7f019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7f4aae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7f01033e0 0x7fb7f019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7f4aae640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f010edf0 con 0x7fb7f0102ac0 2024-09-21T12:11:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7f4aae640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f010ec70 con 0x7fb7f01033e0 2024-09-21T12:11:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7ee59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f0102ac0 0x7fb7f019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7ee59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f0102ac0 0x7fb7f019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33306/0 (socket says 172.21.15.118:33306) 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7ee59c640 1 -- 172.21.15.118:0/468772582 learned_addr learned my addr 172.21.15.118:0/468772582 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7edd9b640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7f01033e0 0x7fb7f019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7ee59c640 1 -- 172.21.15.118:0/468772582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7f01033e0 msgr2=0x7fb7f019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7ee59c640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7f01033e0 0x7fb7f019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7ee59c640 1 -- 172.21.15.118:0/468772582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f0197800 con 0x7fb7f0102ac0 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7edd9b640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7f01033e0 0x7fb7f019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7ee59c640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f0102ac0 0x7fb7f019d680 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000cc60 tx=0x7fb7e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7df7fe640 1 -- 172.21.15.118:0/468772582 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7e000ad30 con 0x7fb7f0102ac0 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7df7fe640 1 -- 172.21.15.118:0/468772582 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7e0005020 con 0x7fb7f0102ac0 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7df7fe640 1 -- 172.21.15.118:0/468772582 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7e000f640 con 0x7fb7f0102ac0 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f0197af0 con 0x7fb7f0102ac0 2024-09-21T12:11:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.690+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f0198080 con 0x7fb7f0102ac0 2024-09-21T12:11:46.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.692+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f006ac30 con 0x7fb7f0102ac0 2024-09-21T12:11:46.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.692+0000 7fb7df7fe640 1 -- 172.21.15.118:0/468772582 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb7e0004b20 con 0x7fb7f0102ac0 2024-09-21T12:11:46.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.692+0000 7fb7df7fe640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7d807af30 0x7fb7d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.693+0000 7fb7df7fe640 1 -- 172.21.15.118:0/468772582 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb7e009e360 con 0x7fb7f0102ac0 2024-09-21T12:11:46.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.693+0000 7fb7edd9b640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7d807af30 0x7fb7d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:46.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.693+0000 7fb7edd9b640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7d807af30 0x7fb7d807d3f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4031460 tx=0x7fb7e40095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:46.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.697+0000 7fb7df7fe640 1 -- 172.21.15.118:0/468772582 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7e0014030 con 0x7fb7f0102ac0 2024-09-21T12:11:46.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:46 smithi149 ceph-mon[79770]: pgmap v989: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:46.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:46 smithi149 ceph-mon[79770]: from='client.35592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:46.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.909+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb7f0105f60 con 0x7fb7f0102ac0 2024-09-21T12:11:46.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.910+0000 7fb7df7fe640 1 -- 172.21.15.118:0/468772582 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7fb7e00698b0 con 0x7fb7f0102ac0 2024-09-21T12:11:46.912 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:11:46.912 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:11:46.912 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:11:46.912 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:11:46.913 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:11:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:11:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:11:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:11:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7d807af30 msgr2=0x7fb7d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7d807af30 0x7fb7d807d3f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4031460 tx=0x7fb7e40095f0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f0102ac0 msgr2=0x7fb7f019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f0102ac0 0x7fb7f019d680 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000cc60 tx=0x7fb7e000a620 comp rx=0 tx=0).stop 2024-09-21T12:11:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 shutdown_connections 2024-09-21T12:11:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7f01033e0 0x7fb7f019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7d807af30 0x7fb7d807d3f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 --2- 172.21.15.118:0/468772582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7f0102ac0 0x7fb7f019d680 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 >> 172.21.15.118:0/468772582 conn(0x7fb7f00fc4e0 msgr2=0x7fb7f0108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:46.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 shutdown_connections 2024-09-21T12:11:46.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.912+0000 7fb7f4aae640 1 -- 172.21.15.118:0/468772582 wait complete. 2024-09-21T12:11:46.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.995+0000 7f66c9356640 1 -- 172.21.15.118:0/1210991916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4106810 msgr2=0x7f66c4106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:46.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.995+0000 7f66c9356640 1 --2- 172.21.15.118:0/1210991916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4106810 0x7f66c4106bf0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009880 tx=0x7f66b402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.995+0000 7f66c9356640 1 -- 172.21.15.118:0/1210991916 shutdown_connections 2024-09-21T12:11:46.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.995+0000 7f66c9356640 1 --2- 172.21.15.118:0/1210991916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66c4100810 0x7f66c4100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.995+0000 7f66c9356640 1 --2- 172.21.15.118:0/1210991916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4106810 0x7f66c4106bf0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:46.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.995+0000 7f66c9356640 1 -- 172.21.15.118:0/1210991916 >> 172.21.15.118:0/1210991916 conn(0x7f66c40fc510 msgr2=0x7f66c40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:46.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.995+0000 7f66c9356640 1 -- 172.21.15.118:0/1210991916 shutdown_connections 2024-09-21T12:11:46.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.995+0000 7f66c9356640 1 -- 172.21.15.118:0/1210991916 wait complete. 2024-09-21T12:11:46.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.995+0000 7f66c9356640 1 Processor -- start 2024-09-21T12:11:46.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c9356640 1 -- start start 2024-09-21T12:11:46.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c9356640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4100810 0x7f66c419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c9356640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66c4106810 0x7f66c419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:46.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c9356640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f66c410dce0 con 0x7f66c4100810 2024-09-21T12:11:46.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c9356640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f66c410db60 con 0x7f66c4106810 2024-09-21T12:11:46.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4100810 0x7f66c419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4100810 0x7f66c419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33322/0 (socket says 172.21.15.118:33322) 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c2ffd640 1 -- 172.21.15.118:0/2858577080 learned_addr learned my addr 172.21.15.118:0/2858577080 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c27fc640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66c4106810 0x7f66c419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c2ffd640 1 -- 172.21.15.118:0/2858577080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66c4106810 msgr2=0x7f66c419cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c2ffd640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66c4106810 0x7f66c419cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c2ffd640 1 -- 172.21.15.118:0/2858577080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c41966f0 con 0x7f66c4100810 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c27fc640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66c4106810 0x7f66c419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.996+0000 7f66c2ffd640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4100810 0x7f66c419c620 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f66b4031460 tx=0x7f66b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.997+0000 7f66abfff640 1 -- 172.21.15.118:0/2858577080 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66b403f070 con 0x7f66c4100810 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.997+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c4196980 con 0x7f66c4100810 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.997+0000 7f66abfff640 1 -- 172.21.15.118:0/2858577080 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66b40035f0 con 0x7f66c4100810 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.997+0000 7f66abfff640 1 -- 172.21.15.118:0/2858577080 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66b4035030 con 0x7f66c4100810 2024-09-21T12:11:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.997+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c4196e80 con 0x7f66c4100810 2024-09-21T12:11:47.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.998+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c4101f50 con 0x7f66c4100810 2024-09-21T12:11:47.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.998+0000 7f66abfff640 1 -- 172.21.15.118:0/2858577080 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f66b4042070 con 0x7f66c4100810 2024-09-21T12:11:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.999+0000 7f66abfff640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f66ac07af80 0x7f66ac07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.999+0000 7f66abfff640 1 -- 172.21.15.118:0/2858577080 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f66b40be9c0 con 0x7f66c4100810 2024-09-21T12:11:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.999+0000 7f66c27fc640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f66ac07af80 0x7f66ac07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:46.999+0000 7f66c27fc640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f66ac07af80 0x7f66ac07d440 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f66b80058c0 tx=0x7f66b8005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:47.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.003+0000 7f66abfff640 1 -- 172.21.15.118:0/2858577080 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66b4089f90 con 0x7f66c4100810 2024-09-21T12:11:47.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.196+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f66c41971f0 con 0x7f66ac07af80 2024-09-21T12:11:47.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.197+0000 7f66abfff640 1 -- 172.21.15.118:0/2858577080 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f66c41971f0 con 0x7f66ac07af80 2024-09-21T12:11:47.199 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:11:47.199 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:11:47.199 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:11:47.200 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.199+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f66ac07af80 msgr2=0x7f66ac07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.199+0000 7f66c9356640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f66ac07af80 0x7f66ac07d440 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f66b80058c0 tx=0x7f66b8005850 comp rx=0 tx=0).stop 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.199+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4100810 msgr2=0x7f66c419c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.199+0000 7f66c9356640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4100810 0x7f66c419c620 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f66b4031460 tx=0x7f66b40045e0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.199+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 shutdown_connections 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.199+0000 7f66c9356640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66c4106810 0x7f66c419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.199+0000 7f66c9356640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f66ac07af80 0x7f66ac07d440 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.199+0000 7f66c9356640 1 --2- 172.21.15.118:0/2858577080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66c4100810 0x7f66c419c620 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.199+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 >> 172.21.15.118:0/2858577080 conn(0x7f66c40fc510 msgr2=0x7f66c40fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.200+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 shutdown_connections 2024-09-21T12:11:47.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.200+0000 7f66c9356640 1 -- 172.21.15.118:0/2858577080 wait complete. 2024-09-21T12:11:47.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.280+0000 7f23d82ec640 1 -- 172.21.15.118:0/2016618533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 msgr2=0x7f23d0102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.280+0000 7f23d82ec640 1 --2- 172.21.15.118:0/2016618533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 0x7f23d0102eb0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009880 tx=0x7f23cc02a530 comp rx=0 tx=0).stop 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.280+0000 7f23d82ec640 1 -- 172.21.15.118:0/2016618533 shutdown_connections 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.280+0000 7f23d82ec640 1 --2- 172.21.15.118:0/2016618533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d01033f0 0x7f23d010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.280+0000 7f23d82ec640 1 --2- 172.21.15.118:0/2016618533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 0x7f23d0102eb0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.280+0000 7f23d82ec640 1 -- 172.21.15.118:0/2016618533 >> 172.21.15.118:0/2016618533 conn(0x7f23d00fc510 msgr2=0x7f23d00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.280+0000 7f23d82ec640 1 -- 172.21.15.118:0/2016618533 shutdown_connections 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.280+0000 7f23d82ec640 1 -- 172.21.15.118:0/2016618533 wait complete. 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.281+0000 7f23d82ec640 1 Processor -- start 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.281+0000 7f23d82ec640 1 -- start start 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.281+0000 7f23d82ec640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 0x7f23d019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.281+0000 7f23d82ec640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d01033f0 0x7f23d019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.281+0000 7f23d82ec640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f23d010ee00 con 0x7f23d0102ad0 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.281+0000 7f23d82ec640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23d010ec80 con 0x7f23d01033f0 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.281+0000 7f23d6088640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 0x7f23d019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:47.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.281+0000 7f23d6088640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 0x7f23d019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33348/0 (socket says 172.21.15.118:33348) 2024-09-21T12:11:47.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.281+0000 7f23d6088640 1 -- 172.21.15.118:0/2228788276 learned_addr learned my addr 172.21.15.118:0/2228788276 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:11:47.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23d5887640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d01033f0 0x7f23d019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:47.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23d6088640 1 -- 172.21.15.118:0/2228788276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d01033f0 msgr2=0x7f23d019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:47.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23d6088640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d01033f0 0x7f23d019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23d6088640 1 -- 172.21.15.118:0/2228788276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d0197830 con 0x7f23d0102ad0 2024-09-21T12:11:47.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23d6088640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 0x7f23d019d6b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f23cc031460 tx=0x7f23cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:47.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23c77fe640 1 -- 172.21.15.118:0/2228788276 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f23cc03f070 con 0x7f23d0102ad0 2024-09-21T12:11:47.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d0197ac0 con 0x7f23d0102ad0 2024-09-21T12:11:47.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23c77fe640 1 -- 172.21.15.118:0/2228788276 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23cc0035f0 con 0x7f23d0102ad0 2024-09-21T12:11:47.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23c77fe640 1 -- 172.21.15.118:0/2228788276 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f23cc035030 con 0x7f23d0102ad0 2024-09-21T12:11:47.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.282+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d0197ff0 con 0x7f23d0102ad0 2024-09-21T12:11:47.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.283+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d006abe0 con 0x7f23d0102ad0 2024-09-21T12:11:47.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.284+0000 7f23c77fe640 1 -- 172.21.15.118:0/2228788276 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f23cc042070 con 0x7f23d0102ad0 2024-09-21T12:11:47.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.284+0000 7f23c77fe640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f23bc07af30 0x7f23bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:11:47.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.284+0000 7f23d5887640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f23bc07af30 0x7f23bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:11:47.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.284+0000 7f23c77fe640 1 -- 172.21.15.118:0/2228788276 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f23cc0bea20 con 0x7f23d0102ad0 2024-09-21T12:11:47.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.285+0000 7f23d5887640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f23bc07af30 0x7f23bc07d3f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f23d00fefa0 tx=0x7f23c000b2e0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:11:47.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.289+0000 7f23c77fe640 1 -- 172.21.15.118:0/2228788276 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23cc089f70 con 0x7f23d0102ad0 2024-09-21T12:11:47.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.534+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f23d0108ee0 con 0x7f23d0102ad0 2024-09-21T12:11:47.536 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:47 smithi118 ceph-mon[111738]: from='client.35596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:47.536 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:47 smithi118 ceph-mon[111738]: from='client.35600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:47.537 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:47 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2455309586' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:11:47.537 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:47 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/468772582' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:11:47.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.534+0000 7f23c77fe640 1 -- 172.21.15.118:0/2228788276 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f23cc08ee20 con 0x7f23d0102ad0 2024-09-21T12:11:47.537 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:11:47.537 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:11:47.537 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:11:47.537 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:11:47.537 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:11:47.537 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:11:47.538 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:11:47.539 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:11:47.539 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:11:47.539 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:11:47.539 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:11:47.539 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f23bc07af30 msgr2=0x7f23bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f23bc07af30 0x7f23bc07d3f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f23d00fefa0 tx=0x7f23c000b2e0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 msgr2=0x7f23d019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 0x7f23d019d6b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f23cc031460 tx=0x7f23cc0045e0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 shutdown_connections 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d01033f0 0x7f23d019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f23bc07af30 0x7f23bc07d3f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 --2- 172.21.15.118:0/2228788276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d0102ad0 0x7f23d019d6b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 >> 172.21.15.118:0/2228788276 conn(0x7f23d00fc510 msgr2=0x7f23d01060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 shutdown_connections 2024-09-21T12:11:47.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:11:47.537+0000 7f23d82ec640 1 -- 172.21.15.118:0/2228788276 wait complete. 2024-09-21T12:11:47.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:47 smithi149 ceph-mon[79770]: from='client.35596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:47.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:47 smithi149 ceph-mon[79770]: from='client.35600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:47.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:47 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2455309586' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:11:47.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:47 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/468772582' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:11:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:48 smithi118 ceph-mon[111738]: pgmap v990: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:48 smithi118 ceph-mon[111738]: from='client.35612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:48 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2228788276' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:11:48.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:48 smithi149 ceph-mon[79770]: pgmap v990: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:48.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:48 smithi149 ceph-mon[79770]: from='client.35612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:48.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:48 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2228788276' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:11:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:50 smithi118 ceph-mon[111738]: pgmap v991: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:11:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:50 smithi149 ceph-mon[79770]: pgmap v991: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:11:52.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:52 smithi118 ceph-mon[111738]: pgmap v992: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:52 smithi149 ceph-mon[79770]: pgmap v992: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:54.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:54 smithi118 ceph-mon[111738]: pgmap v993: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:54.582 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:54 smithi149 ceph-mon[79770]: pgmap v993: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:56 smithi118 ceph-mon[111738]: pgmap v994: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:56.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:56 smithi149 ceph-mon[79770]: pgmap v994: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:58.553 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:11:58 smithi118 ceph-mon[111738]: pgmap v995: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:11:58.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:11:58 smithi149 ceph-mon[79770]: pgmap v995: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:00 smithi118 ceph-mon[111738]: pgmap v996: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:00 smithi149 ceph-mon[79770]: pgmap v996: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:02.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:02 smithi118 ceph-mon[111738]: pgmap v997: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:02.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:02 smithi149 ceph-mon[79770]: pgmap v997: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:04.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:04 smithi118 ceph-mon[111738]: pgmap v998: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:04.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:04 smithi149 ceph-mon[79770]: pgmap v998: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:12:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:12:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:06 smithi118 ceph-mon[111738]: pgmap v999: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:06.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:06 smithi149 ceph-mon[79770]: pgmap v999: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:08.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:08 smithi118 ceph-mon[111738]: pgmap v1000: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:08.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:08 smithi149 ceph-mon[79770]: pgmap v1000: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:10.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:10 smithi118 ceph-mon[111738]: pgmap v1001: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:10.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:10 smithi149 ceph-mon[79770]: pgmap v1001: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:12.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:12 smithi118 ceph-mon[111738]: pgmap v1002: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:12.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:12 smithi149 ceph-mon[79770]: pgmap v1002: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:14.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:14 smithi118 ceph-mon[111738]: pgmap v1003: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:14 smithi149 ceph-mon[79770]: pgmap v1003: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:16 smithi118 ceph-mon[111738]: pgmap v1004: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:16 smithi149 ceph-mon[79770]: pgmap v1004: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:17.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1329946755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 msgr2=0x7f7ec8100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:17.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 --2- 172.21.15.118:0/1329946755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 0x7f7ec8100cb0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009c20 tx=0x7f7ec402aa00 comp rx=0 tx=0).stop 2024-09-21T12:12:17.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1329946755 shutdown_connections 2024-09-21T12:12:17.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 --2- 172.21.15.118:0/1329946755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ec81011f0 0x7f7ec81056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 --2- 172.21.15.118:0/1329946755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 0x7f7ec8100cb0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1329946755 >> 172.21.15.118:0/1329946755 conn(0x7f7ec80fc520 msgr2=0x7f7ec80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:17.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1329946755 shutdown_connections 2024-09-21T12:12:17.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1329946755 wait complete. 2024-09-21T12:12:17.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 Processor -- start 2024-09-21T12:12:17.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.633+0000 7f7ecf4e3640 1 -- start start 2024-09-21T12:12:17.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecf4e3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 0x7f7ec819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecf4e3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ec81011f0 0x7f7ec819e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecf4e3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec81153f0 con 0x7f7ec81008d0 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecf4e3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec8115270 con 0x7f7ec81011f0 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecd27f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 0x7f7ec819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecd27f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 0x7f7ec819dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51818/0 (socket says 172.21.15.118:51818) 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecd27f640 1 -- 172.21.15.118:0/1151023982 learned_addr learned my addr 172.21.15.118:0/1151023982 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecca7e640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ec81011f0 0x7f7ec819e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecd27f640 1 -- 172.21.15.118:0/1151023982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ec81011f0 msgr2=0x7f7ec819e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecd27f640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ec81011f0 0x7f7ec819e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecd27f640 1 -- 172.21.15.118:0/1151023982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec81a28a0 con 0x7f7ec81008d0 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ecd27f640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 0x7f7ec819dfd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7ec402af20 tx=0x7f7ec402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.634+0000 7f7ebe7fc640 1 -- 172.21.15.118:0/1151023982 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ec4047070 con 0x7f7ec81008d0 2024-09-21T12:12:17.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.635+0000 7f7ebe7fc640 1 -- 172.21.15.118:0/1151023982 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ec4003e30 con 0x7f7ec81008d0 2024-09-21T12:12:17.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.635+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec81a2b30 con 0x7f7ec81008d0 2024-09-21T12:12:17.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.635+0000 7f7ebe7fc640 1 -- 172.21.15.118:0/1151023982 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ec4033050 con 0x7f7ec81008d0 2024-09-21T12:12:17.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.635+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec81a3060 con 0x7f7ec81008d0 2024-09-21T12:12:17.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.636+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec806abe0 con 0x7f7ec81008d0 2024-09-21T12:12:17.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.636+0000 7f7ebe7fc640 1 -- 172.21.15.118:0/1151023982 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7ec404a070 con 0x7f7ec81008d0 2024-09-21T12:12:17.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.637+0000 7f7ebe7fc640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7eb407af40 0x7f7eb407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:17.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.637+0000 7f7ebe7fc640 1 -- 172.21.15.118:0/1151023982 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7ec403e030 con 0x7f7ec81008d0 2024-09-21T12:12:17.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.637+0000 7f7ecca7e640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7eb407af40 0x7f7eb407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:17.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.637+0000 7f7ecca7e640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7eb407af40 0x7f7eb407d400 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8112510 tx=0x7f7eb800b2e0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:17.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.641+0000 7f7ebe7fc640 1 -- 172.21.15.118:0/1151023982 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ec408a6f0 con 0x7f7ec81008d0 2024-09-21T12:12:17.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.835+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7ec81a33d0 con 0x7f7eb407af40 2024-09-21T12:12:17.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.836+0000 7f7ebe7fc640 1 -- 172.21.15.118:0/1151023982 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7ec81a33d0 con 0x7f7eb407af40 2024-09-21T12:12:17.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7eb407af40 msgr2=0x7f7eb407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:17.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7eb407af40 0x7f7eb407d400 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8112510 tx=0x7f7eb800b2e0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 msgr2=0x7f7ec819dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:17.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 0x7f7ec819dfd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7ec402af20 tx=0x7f7ec402ee60 comp rx=0 tx=0).stop 2024-09-21T12:12:17.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 shutdown_connections 2024-09-21T12:12:17.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ec81011f0 0x7f7ec819e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7eb407af40 0x7f7eb407d400 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 --2- 172.21.15.118:0/1151023982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ec81008d0 0x7f7ec819dfd0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 >> 172.21.15.118:0/1151023982 conn(0x7f7ec80fc520 msgr2=0x7f7ec8112bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:17.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 shutdown_connections 2024-09-21T12:12:17.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.839+0000 7f7ecf4e3640 1 -- 172.21.15.118:0/1151023982 wait complete. 2024-09-21T12:12:17.850 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:12:17.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.921+0000 7fba49aa6640 1 -- 172.21.15.118:0/3380799176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44103460 msgr2=0x7fba4410b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:17.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.921+0000 7fba49aa6640 1 --2- 172.21.15.118:0/3380799176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44103460 0x7fba4410b950 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fba38009880 tx=0x7fba3802a530 comp rx=0 tx=0).stop 2024-09-21T12:12:17.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.921+0000 7fba49aa6640 1 -- 172.21.15.118:0/3380799176 shutdown_connections 2024-09-21T12:12:17.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.921+0000 7fba49aa6640 1 --2- 172.21.15.118:0/3380799176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44103460 0x7fba4410b950 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.921+0000 7fba49aa6640 1 --2- 172.21.15.118:0/3380799176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba44102b40 0x7fba44102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.921+0000 7fba49aa6640 1 -- 172.21.15.118:0/3380799176 >> 172.21.15.118:0/3380799176 conn(0x7fba440fc4c0 msgr2=0x7fba440fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:17.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.921+0000 7fba49aa6640 1 -- 172.21.15.118:0/3380799176 shutdown_connections 2024-09-21T12:12:17.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.921+0000 7fba49aa6640 1 -- 172.21.15.118:0/3380799176 wait complete. 2024-09-21T12:12:17.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.922+0000 7fba49aa6640 1 Processor -- start 2024-09-21T12:12:17.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.922+0000 7fba49aa6640 1 -- start start 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.922+0000 7fba49aa6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44102b40 0x7fba4419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.922+0000 7fba49aa6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba44103460 0x7fba4419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.922+0000 7fba49aa6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fba4410edb0 con 0x7fba44102b40 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.922+0000 7fba49aa6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fba4410ec30 con 0x7fba44103460 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.922+0000 7fba437fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44102b40 0x7fba4419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.922+0000 7fba437fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44102b40 0x7fba4419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51840/0 (socket says 172.21.15.118:51840) 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.922+0000 7fba437fe640 1 -- 172.21.15.118:0/2987937631 learned_addr learned my addr 172.21.15.118:0/2987937631 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba42ffd640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba44103460 0x7fba4419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba437fe640 1 -- 172.21.15.118:0/2987937631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba44103460 msgr2=0x7fba4419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba437fe640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba44103460 0x7fba4419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba437fe640 1 -- 172.21.15.118:0/2987937631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba441977c0 con 0x7fba44102b40 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba437fe640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44102b40 0x7fba4419d640 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d8d0 tx=0x7fba3400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:17.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba40ff9640 1 -- 172.21.15.118:0/2987937631 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba34017030 con 0x7fba44102b40 2024-09-21T12:12:17.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba44197ab0 con 0x7fba44102b40 2024-09-21T12:12:17.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba40ff9640 1 -- 172.21.15.118:0/2987937631 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba34004020 con 0x7fba44102b40 2024-09-21T12:12:17.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba40ff9640 1 -- 172.21.15.118:0/2987937631 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba340047a0 con 0x7fba44102b40 2024-09-21T12:12:17.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.923+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba44198010 con 0x7fba44102b40 2024-09-21T12:12:17.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.924+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4406a370 con 0x7fba44102b40 2024-09-21T12:12:17.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.925+0000 7fba40ff9640 1 -- 172.21.15.118:0/2987937631 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fba340041d0 con 0x7fba44102b40 2024-09-21T12:12:17.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.925+0000 7fba40ff9640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba2c07af30 0x7fba2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:17.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.926+0000 7fba40ff9640 1 -- 172.21.15.118:0/2987937631 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fba34018070 con 0x7fba44102b40 2024-09-21T12:12:17.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.926+0000 7fba42ffd640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba2c07af30 0x7fba2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:17.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.926+0000 7fba42ffd640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba2c07af30 0x7fba2c07d3f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fba44198b10 tx=0x7fba38004f30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:17.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:17.931+0000 7fba40ff9640 1 -- 172.21.15.118:0/2987937631 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba340a3020 con 0x7fba44102b40 2024-09-21T12:12:18.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.126+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fba44198380 con 0x7fba2c07af30 2024-09-21T12:12:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.127+0000 7fba40ff9640 1 -- 172.21.15.118:0/2987937631 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fba44198380 con 0x7fba2c07af30 2024-09-21T12:12:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba2c07af30 msgr2=0x7fba2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba2c07af30 0x7fba2c07d3f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fba44198b10 tx=0x7fba38004f30 comp rx=0 tx=0).stop 2024-09-21T12:12:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44102b40 msgr2=0x7fba4419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44102b40 0x7fba4419d640 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d8d0 tx=0x7fba3400dd90 comp rx=0 tx=0).stop 2024-09-21T12:12:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 shutdown_connections 2024-09-21T12:12:18.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba44103460 0x7fba4419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fba2c07af30 0x7fba2c07d3f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 --2- 172.21.15.118:0/2987937631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba44102b40 0x7fba4419d640 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 >> 172.21.15.118:0/2987937631 conn(0x7fba440fc4c0 msgr2=0x7fba44103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:18.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 shutdown_connections 2024-09-21T12:12:18.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.129+0000 7fba49aa6640 1 -- 172.21.15.118:0/2987937631 wait complete. 2024-09-21T12:12:18.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.210+0000 7f21e2480640 1 -- 172.21.15.118:0/1533724748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc1034a0 msgr2=0x7f21dc10b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.210+0000 7f21e2480640 1 --2- 172.21.15.118:0/1533724748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc1034a0 0x7f21dc10b990 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009880 tx=0x7f21d002a530 comp rx=0 tx=0).stop 2024-09-21T12:12:18.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.210+0000 7f21e2480640 1 -- 172.21.15.118:0/1533724748 shutdown_connections 2024-09-21T12:12:18.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.210+0000 7f21e2480640 1 --2- 172.21.15.118:0/1533724748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc1034a0 0x7f21dc10b990 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.210+0000 7f21e2480640 1 --2- 172.21.15.118:0/1533724748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21dc102b80 0x7f21dc102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.210+0000 7f21e2480640 1 -- 172.21.15.118:0/1533724748 >> 172.21.15.118:0/1533724748 conn(0x7f21dc0fc520 msgr2=0x7f21dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:18.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.211+0000 7f21e2480640 1 -- 172.21.15.118:0/1533724748 shutdown_connections 2024-09-21T12:12:18.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.211+0000 7f21e2480640 1 -- 172.21.15.118:0/1533724748 wait complete. 2024-09-21T12:12:18.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.211+0000 7f21e2480640 1 Processor -- start 2024-09-21T12:12:18.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.211+0000 7f21e2480640 1 -- start start 2024-09-21T12:12:18.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21e2480640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc102b80 0x7f21dc1007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:18.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21e2480640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21dc1034a0 0x7f21dc100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:18.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21e2480640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc10ee70 con 0x7f21dc102b80 2024-09-21T12:12:18.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21e2480640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc10ecf0 con 0x7f21dc1034a0 2024-09-21T12:12:18.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21dbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc102b80 0x7f21dc1007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:18.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21dbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc102b80 0x7f21dc1007e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51856/0 (socket says 172.21.15.118:51856) 2024-09-21T12:12:18.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21dbfff640 1 -- 172.21.15.118:0/3993944852 learned_addr learned my addr 172.21.15.118:0/3993944852 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21db7fe640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21dc1034a0 0x7f21dc100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21dbfff640 1 -- 172.21.15.118:0/3993944852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21dc1034a0 msgr2=0x7f21dc100d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21dbfff640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21dc1034a0 0x7f21dc100d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21dbfff640 1 -- 172.21.15.118:0/3993944852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21dc101260 con 0x7f21dc102b80 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21db7fe640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21dc1034a0 0x7f21dc100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21dbfff640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc102b80 0x7f21dc1007e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00b420 tx=0x7f21cc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.212+0000 7f21d97fa640 1 -- 172.21.15.118:0/3993944852 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21cc011630 con 0x7f21dc102b80 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.213+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21dc101550 con 0x7f21dc102b80 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.213+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21dc1a3fe0 con 0x7f21dc102b80 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.213+0000 7f21d97fa640 1 -- 172.21.15.118:0/3993944852 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21cc016070 con 0x7f21dc102b80 2024-09-21T12:12:18.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.213+0000 7f21d97fa640 1 -- 172.21.15.118:0/3993944852 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21cc01bbd0 con 0x7f21dc102b80 2024-09-21T12:12:18.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.214+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c8005290 con 0x7f21dc102b80 2024-09-21T12:12:18.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.214+0000 7f21d97fa640 1 -- 172.21.15.118:0/3993944852 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f21cc010380 con 0x7f21dc102b80 2024-09-21T12:12:18.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.215+0000 7f21d97fa640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21c407af30 0x7f21c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:18.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.215+0000 7f21d97fa640 1 -- 172.21.15.118:0/3993944852 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f21cc09d5b0 con 0x7f21dc102b80 2024-09-21T12:12:18.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.215+0000 7f21db7fe640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21c407af30 0x7f21c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:18.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.215+0000 7f21db7fe640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21c407af30 0x7f21c407d3f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f21d0006010 tx=0x7f21d00095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:18.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.219+0000 7f21d97fa640 1 -- 172.21.15.118:0/3993944852 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21cc068b00 con 0x7f21dc102b80 2024-09-21T12:12:18.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.404+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f21c8000bc0 con 0x7f21c407af30 2024-09-21T12:12:18.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.414+0000 7f21d97fa640 1 -- 172.21.15.118:0/3993944852 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f21c8000bc0 con 0x7f21c407af30 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (30m) 8m ago 41m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (33m) 8m ago 41m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (32m) 8m ago 40m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (28m) 8m ago 41m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (28m) 8m ago 40m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (29m) 8m ago 40m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (24m) 8m ago 35m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (24m) 8m ago 35m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (9m) 8m ago 35m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:12:18.416 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (24m) 8m ago 35m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (32m) 8m ago 42m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (31m) 8m ago 40m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (28m) 8m ago 42m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (28m) 8m ago 40m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (31m) 8m ago 41m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (30m) 8m ago 40m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (27m) 8m ago 39m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (27m) 8m ago 38m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (26m) 8m ago 38m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (26m) 8m ago 37m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (25m) 8m ago 37m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (24m) 8m ago 36m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:12:18.417 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (30m) 8m ago 40m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21c407af30 msgr2=0x7f21c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21c407af30 0x7f21c407d3f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f21d0006010 tx=0x7f21d00095f0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc102b80 msgr2=0x7f21dc1007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc102b80 0x7f21dc1007e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00b420 tx=0x7f21cc00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 shutdown_connections 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21dc1034a0 0x7f21dc100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21c407af30 0x7f21c407d3f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 --2- 172.21.15.118:0/3993944852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21dc102b80 0x7f21dc1007e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 >> 172.21.15.118:0/3993944852 conn(0x7f21dc0fc520 msgr2=0x7f21dc107ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 shutdown_connections 2024-09-21T12:12:18.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.416+0000 7f21e2480640 1 -- 172.21.15.118:0/3993944852 wait complete. 2024-09-21T12:12:18.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.497+0000 7ff770a70640 1 -- 172.21.15.118:0/966800596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 msgr2=0x7ff76c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.497+0000 7ff770a70640 1 --2- 172.21.15.118:0/966800596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 0x7ff76c101d90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff760009880 tx=0x7ff76002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.499 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:18 smithi118 ceph-mon[111738]: pgmap v1005: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:18.499 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:18 smithi118 ceph-mon[111738]: from='client.35620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.497+0000 7ff770a70640 1 -- 172.21.15.118:0/966800596 shutdown_connections 2024-09-21T12:12:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.497+0000 7ff770a70640 1 --2- 172.21.15.118:0/966800596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 0x7ff76c101d90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.497+0000 7ff770a70640 1 --2- 172.21.15.118:0/966800596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76c107930 0x7ff76c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.497+0000 7ff770a70640 1 -- 172.21.15.118:0/966800596 >> 172.21.15.118:0/966800596 conn(0x7ff76c0fd630 msgr2=0x7ff76c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.497+0000 7ff770a70640 1 -- 172.21.15.118:0/966800596 shutdown_connections 2024-09-21T12:12:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.497+0000 7ff770a70640 1 -- 172.21.15.118:0/966800596 wait complete. 2024-09-21T12:12:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff770a70640 1 Processor -- start 2024-09-21T12:12:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff770a70640 1 -- start start 2024-09-21T12:12:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff770a70640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 0x7ff76c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff770a70640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76c107930 0x7ff76c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff770a70640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c10ede0 con 0x7ff76c101930 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff770a70640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c10ec60 con 0x7ff76c107930 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 0x7ff76c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 0x7ff76c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51870/0 (socket says 172.21.15.118:51870) 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff76a59c640 1 -- 172.21.15.118:0/559324240 learned_addr learned my addr 172.21.15.118:0/559324240 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff769d9b640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76c107930 0x7ff76c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff76a59c640 1 -- 172.21.15.118:0/559324240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76c107930 msgr2=0x7ff76c19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff76a59c640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76c107930 0x7ff76c19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.498+0000 7ff76a59c640 1 -- 172.21.15.118:0/559324240 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c197850 con 0x7ff76c101930 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.499+0000 7ff76a59c640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 0x7ff76c19d6d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00c8a0 tx=0x7ff75c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.499+0000 7ff75b7fe640 1 -- 172.21.15.118:0/559324240 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff75c0079b0 con 0x7ff76c101930 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.499+0000 7ff75b7fe640 1 -- 172.21.15.118:0/559324240 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff75c007b50 con 0x7ff76c101930 2024-09-21T12:12:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.499+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c197b40 con 0x7ff76c101930 2024-09-21T12:12:18.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.499+0000 7ff75b7fe640 1 -- 172.21.15.118:0/559324240 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff75c018700 con 0x7ff76c101930 2024-09-21T12:12:18.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.499+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c1980a0 con 0x7ff76c101930 2024-09-21T12:12:18.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.500+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c103070 con 0x7ff76c101930 2024-09-21T12:12:18.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.501+0000 7ff75b7fe640 1 -- 172.21.15.118:0/559324240 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff75c007d00 con 0x7ff76c101930 2024-09-21T12:12:18.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.502+0000 7ff75b7fe640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff75407af30 0x7ff75407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:18.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.502+0000 7ff769d9b640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff75407af30 0x7ff75407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:18.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.502+0000 7ff75b7fe640 1 -- 172.21.15.118:0/559324240 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff75c09e530 con 0x7ff76c101930 2024-09-21T12:12:18.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.503+0000 7ff769d9b640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff75407af30 0x7ff75407d3f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff76c198ba0 tx=0x7ff760031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:18.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.505+0000 7ff75b7fe640 1 -- 172.21.15.118:0/559324240 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff75c014030 con 0x7ff76c101930 2024-09-21T12:12:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:18 smithi149 ceph-mon[79770]: pgmap v1005: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:18 smithi149 ceph-mon[79770]: from='client.35620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.751+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff76c198d80 con 0x7ff76c101930 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.752+0000 7ff75b7fe640 1 -- 172.21.15.118:0/559324240 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7ff75c069ae0 con 0x7ff76c101930 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:12:18.754 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:12:18.755 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:12:18.755 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:12:18.755 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:12:18.755 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:12:18.755 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:12:18.755 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:12:18.755 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:12:18.755 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:12:18.755 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff75407af30 msgr2=0x7ff75407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff75407af30 0x7ff75407d3f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff76c198ba0 tx=0x7ff760031400 comp rx=0 tx=0).stop 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 msgr2=0x7ff76c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 0x7ff76c19d6d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00c8a0 tx=0x7ff75c00cd60 comp rx=0 tx=0).stop 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 shutdown_connections 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff76c107930 0x7ff76c19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff75407af30 0x7ff75407d3f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 --2- 172.21.15.118:0/559324240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff76c101930 0x7ff76c19d6d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 >> 172.21.15.118:0/559324240 conn(0x7ff76c0fd630 msgr2=0x7ff76c0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:18.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 shutdown_connections 2024-09-21T12:12:18.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.754+0000 7ff770a70640 1 -- 172.21.15.118:0/559324240 wait complete. 2024-09-21T12:12:18.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 -- 172.21.15.118:0/3957937815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1067e0 msgr2=0x7f026c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 --2- 172.21.15.118:0/3957937815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1067e0 0x7f026c106bc0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0254009880 tx=0x7f025402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 -- 172.21.15.118:0/3957937815 shutdown_connections 2024-09-21T12:12:18.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 --2- 172.21.15.118:0/3957937815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f026c1007e0 0x7f026c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 --2- 172.21.15.118:0/3957937815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1067e0 0x7f026c106bc0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 -- 172.21.15.118:0/3957937815 >> 172.21.15.118:0/3957937815 conn(0x7f026c0fc4c0 msgr2=0x7f026c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:18.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 -- 172.21.15.118:0/3957937815 shutdown_connections 2024-09-21T12:12:18.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 -- 172.21.15.118:0/3957937815 wait complete. 2024-09-21T12:12:18.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 Processor -- start 2024-09-21T12:12:18.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.835+0000 7f0272956640 1 -- start start 2024-09-21T12:12:18.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f0272956640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1007e0 0x7f026c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:18.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f0272956640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f026c1067e0 0x7f026c19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:18.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f0272956640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f026c10dc90 con 0x7f026c1007e0 2024-09-21T12:12:18.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f0272956640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f026c10db10 con 0x7f026c1067e0 2024-09-21T12:12:18.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f026bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1007e0 0x7f026c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:18.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f026bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1007e0 0x7f026c19c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51892/0 (socket says 172.21.15.118:51892) 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f026bfff640 1 -- 172.21.15.118:0/3477468104 learned_addr learned my addr 172.21.15.118:0/3477468104 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f026bfff640 1 -- 172.21.15.118:0/3477468104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f026c1067e0 msgr2=0x7f026c19caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f026bfff640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f026c1067e0 0x7f026c19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f026bfff640 1 -- 172.21.15.118:0/3477468104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c196680 con 0x7f026c1007e0 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f026bfff640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1007e0 0x7f026c19c5b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0254031460 tx=0x7f02540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.836+0000 7f02697fa640 1 -- 172.21.15.118:0/3477468104 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f025403f070 con 0x7f026c1007e0 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.837+0000 7f02697fa640 1 -- 172.21.15.118:0/3477468104 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0254004cf0 con 0x7f026c1007e0 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.837+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c196910 con 0x7f026c1007e0 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.837+0000 7f02697fa640 1 -- 172.21.15.118:0/3477468104 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0254035030 con 0x7f026c1007e0 2024-09-21T12:12:18.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.837+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c196e40 con 0x7f026c1007e0 2024-09-21T12:12:18.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.838+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f026c101f20 con 0x7f026c1007e0 2024-09-21T12:12:18.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.838+0000 7f02697fa640 1 -- 172.21.15.118:0/3477468104 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0254042070 con 0x7f026c1007e0 2024-09-21T12:12:18.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.839+0000 7f02697fa640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f025807af30 0x7f025807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:18.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.839+0000 7f02697fa640 1 -- 172.21.15.118:0/3477468104 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f02540beb70 con 0x7f026c1007e0 2024-09-21T12:12:18.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.839+0000 7f026b7fe640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f025807af30 0x7f025807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:18.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.839+0000 7f026b7fe640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f025807af30 0x7f025807d3f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f026c197ed0 tx=0x7f025c005c70 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:18.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:18.843+0000 7f02697fa640 1 -- 172.21.15.118:0/3477468104 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f025408a0c0 con 0x7f026c1007e0 2024-09-21T12:12:19.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.077+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f026c1039f0 con 0x7f026c1007e0 2024-09-21T12:12:19.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.077+0000 7f02697fa640 1 -- 172.21.15.118:0/3477468104 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f025408ef70 con 0x7f026c1007e0 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:12:19.080 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:12:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:12:19.082 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:12:19.083 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:12:19.083 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:12:19.083 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:12:19.083 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:12:19.083 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:12:19.083 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:12:19.083 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:12:19.083 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:12:19.084 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:12:19.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.079+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f025807af30 msgr2=0x7f025807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.079+0000 7f0272956640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f025807af30 0x7f025807d3f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f026c197ed0 tx=0x7f025c005c70 comp rx=0 tx=0).stop 2024-09-21T12:12:19.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.079+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1007e0 msgr2=0x7f026c19c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.079+0000 7f0272956640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1007e0 0x7f026c19c5b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0254031460 tx=0x7f02540048f0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.080+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 shutdown_connections 2024-09-21T12:12:19.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.080+0000 7f0272956640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f026c1067e0 0x7f026c19caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.080+0000 7f0272956640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f025807af30 0x7f025807d3f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.080+0000 7f0272956640 1 --2- 172.21.15.118:0/3477468104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f026c1007e0 0x7f026c19c5b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.080+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 >> 172.21.15.118:0/3477468104 conn(0x7f026c0fc4c0 msgr2=0x7f026c0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:19.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.080+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 shutdown_connections 2024-09-21T12:12:19.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.080+0000 7f0272956640 1 -- 172.21.15.118:0/3477468104 wait complete. 2024-09-21T12:12:19.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.161+0000 7ffaab758640 1 -- 172.21.15.118:0/576581012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 msgr2=0x7ffaa4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.161+0000 7ffaab758640 1 --2- 172.21.15.118:0/576581012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 0x7ffaa4107d10 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009880 tx=0x7ffa9402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.161+0000 7ffaab758640 1 -- 172.21.15.118:0/576581012 shutdown_connections 2024-09-21T12:12:19.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.161+0000 7ffaab758640 1 --2- 172.21.15.118:0/576581012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaa4101930 0x7ffaa4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.161+0000 7ffaab758640 1 --2- 172.21.15.118:0/576581012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 0x7ffaa4107d10 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.161+0000 7ffaab758640 1 -- 172.21.15.118:0/576581012 >> 172.21.15.118:0/576581012 conn(0x7ffaa40fd630 msgr2=0x7ffaa40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:19.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.161+0000 7ffaab758640 1 -- 172.21.15.118:0/576581012 shutdown_connections 2024-09-21T12:12:19.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.161+0000 7ffaab758640 1 -- 172.21.15.118:0/576581012 wait complete. 2024-09-21T12:12:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.162+0000 7ffaab758640 1 Processor -- start 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.162+0000 7ffaab758640 1 -- start start 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.162+0000 7ffaab758640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaa4101930 0x7ffaa419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.162+0000 7ffaab758640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 0x7ffaa419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.162+0000 7ffaab758640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa410ede0 con 0x7ffaa4107930 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.162+0000 7ffaab758640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa410ec60 con 0x7ffaa4101930 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.162+0000 7ffaa8cf3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 0x7ffaa419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.162+0000 7ffaa8cf3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 0x7ffaa419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51898/0 (socket says 172.21.15.118:51898) 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.162+0000 7ffaa8cf3640 1 -- 172.21.15.118:0/3314319795 learned_addr learned my addr 172.21.15.118:0/3314319795 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffaa94f4640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaa4101930 0x7ffaa419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffaa8cf3640 1 -- 172.21.15.118:0/3314319795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaa4101930 msgr2=0x7ffaa419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffaa8cf3640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaa4101930 0x7ffaa419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffaa8cf3640 1 -- 172.21.15.118:0/3314319795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa41977d0 con 0x7ffaa4107930 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffaa94f4640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaa4101930 0x7ffaa419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:12:19.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffaa8cf3640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 0x7ffaa419db90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d6f0 tx=0x7ffaa000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:19.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffa9a7fc640 1 -- 172.21.15.118:0/3314319795 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffaa0017070 con 0x7ffaa4107930 2024-09-21T12:12:19.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa4197ac0 con 0x7ffaa4107930 2024-09-21T12:12:19.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffa9a7fc640 1 -- 172.21.15.118:0/3314319795 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffaa000de00 con 0x7ffaa4107930 2024-09-21T12:12:19.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffa9a7fc640 1 -- 172.21.15.118:0/3314319795 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffaa0004b90 con 0x7ffaa4107930 2024-09-21T12:12:19.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.163+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa4198050 con 0x7ffaa4107930 2024-09-21T12:12:19.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.164+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa4103070 con 0x7ffaa4107930 2024-09-21T12:12:19.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.165+0000 7ffa9a7fc640 1 -- 172.21.15.118:0/3314319795 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ffaa00053d0 con 0x7ffaa4107930 2024-09-21T12:12:19.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.165+0000 7ffa9a7fc640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ffa9007af30 0x7ffa9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:19.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.165+0000 7ffa9a7fc640 1 -- 172.21.15.118:0/3314319795 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ffaa009dc90 con 0x7ffaa4107930 2024-09-21T12:12:19.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.165+0000 7ffaa94f4640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ffa9007af30 0x7ffa9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:19.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.166+0000 7ffaa94f4640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ffa9007af30 0x7ffa9007d3f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffa94006010 tx=0x7ffa940095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:19.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.169+0000 7ffa9a7fc640 1 -- 172.21.15.118:0/3314319795 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffaa00691e0 con 0x7ffaa4107930 2024-09-21T12:12:19.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.364+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffaa4198300 con 0x7ffa9007af30 2024-09-21T12:12:19.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.365+0000 7ffa9a7fc640 1 -- 172.21.15.118:0/3314319795 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ffaa4198300 con 0x7ffa9007af30 2024-09-21T12:12:19.367 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:12:19.368 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:12:19.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.367+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ffa9007af30 msgr2=0x7ffa9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.367+0000 7ffaab758640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ffa9007af30 0x7ffa9007d3f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffa94006010 tx=0x7ffa940095f0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.367+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 msgr2=0x7ffaa419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.367+0000 7ffaab758640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 0x7ffaa419db90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d6f0 tx=0x7ffaa000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.368+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 shutdown_connections 2024-09-21T12:12:19.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.368+0000 7ffaab758640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ffa9007af30 0x7ffa9007d3f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.368+0000 7ffaab758640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffaa4107930 0x7ffaa419db90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.368+0000 7ffaab758640 1 --2- 172.21.15.118:0/3314319795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffaa4101930 0x7ffaa419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.368+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 >> 172.21.15.118:0/3314319795 conn(0x7ffaa40fd630 msgr2=0x7ffaa40fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:19.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.368+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 shutdown_connections 2024-09-21T12:12:19.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.368+0000 7ffaab758640 1 -- 172.21.15.118:0/3314319795 wait complete. 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.449+0000 7fb99aedd640 1 -- 172.21.15.118:0/3763181273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994101930 msgr2=0x7fb994101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.449+0000 7fb99aedd640 1 --2- 172.21.15.118:0/3763181273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994101930 0x7fb994101d90 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb984009880 tx=0x7fb98402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.449+0000 7fb99aedd640 1 -- 172.21.15.118:0/3763181273 shutdown_connections 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.449+0000 7fb99aedd640 1 --2- 172.21.15.118:0/3763181273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994101930 0x7fb994101d90 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.449+0000 7fb99aedd640 1 --2- 172.21.15.118:0/3763181273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994107930 0x7fb994107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.449+0000 7fb99aedd640 1 -- 172.21.15.118:0/3763181273 >> 172.21.15.118:0/3763181273 conn(0x7fb9940fd630 msgr2=0x7fb9940ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.449+0000 7fb99aedd640 1 -- 172.21.15.118:0/3763181273 shutdown_connections 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.449+0000 7fb99aedd640 1 -- 172.21.15.118:0/3763181273 wait complete. 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb99aedd640 1 Processor -- start 2024-09-21T12:12:19.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb99aedd640 1 -- start start 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb99aedd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994101930 0x7fb99419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb99aedd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994107930 0x7fb99419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb99aedd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb99410ede0 con 0x7fb994107930 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb99aedd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb99410ec60 con 0x7fb994101930 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb98bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994107930 0x7fb99419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb98bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994107930 0x7fb99419dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51916/0 (socket says 172.21.15.118:51916) 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb98bfff640 1 -- 172.21.15.118:0/469520922 learned_addr learned my addr 172.21.15.118:0/469520922 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.450+0000 7fb998c79640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994101930 0x7fb99419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.451+0000 7fb98bfff640 1 -- 172.21.15.118:0/469520922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994101930 msgr2=0x7fb99419d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.451+0000 7fb98bfff640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994101930 0x7fb99419d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.451+0000 7fb98bfff640 1 -- 172.21.15.118:0/469520922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb994197850 con 0x7fb994107930 2024-09-21T12:12:19.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.451+0000 7fb98bfff640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994107930 0x7fb99419dc10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb984031460 tx=0x7fb9840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:19.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.451+0000 7fb989ffb640 1 -- 172.21.15.118:0/469520922 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb98403f070 con 0x7fb994107930 2024-09-21T12:12:19.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.451+0000 7fb989ffb640 1 -- 172.21.15.118:0/469520922 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb984004cf0 con 0x7fb994107930 2024-09-21T12:12:19.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.451+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb994197ae0 con 0x7fb994107930 2024-09-21T12:12:19.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.451+0000 7fb989ffb640 1 -- 172.21.15.118:0/469520922 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb984035030 con 0x7fb994107930 2024-09-21T12:12:19.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.451+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb994198010 con 0x7fb994107930 2024-09-21T12:12:19.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.452+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb994103070 con 0x7fb994107930 2024-09-21T12:12:19.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.453+0000 7fb989ffb640 1 -- 172.21.15.118:0/469520922 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb984042070 con 0x7fb994107930 2024-09-21T12:12:19.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.453+0000 7fb989ffb640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb97c07af80 0x7fb97c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:19.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.453+0000 7fb989ffb640 1 -- 172.21.15.118:0/469520922 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb9840beb30 con 0x7fb994107930 2024-09-21T12:12:19.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.453+0000 7fb998c79640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb97c07af80 0x7fb97c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:19.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.454+0000 7fb998c79640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb97c07af80 0x7fb97c07d440 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb9900058c0 tx=0x7fb99000a4c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:19.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.458+0000 7fb989ffb640 1 -- 172.21.15.118:0/469520922 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb98408a060 con 0x7fb994107930 2024-09-21T12:12:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:19 smithi149 ceph-mon[79770]: from='client.35624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:19 smithi149 ceph-mon[79770]: from='client.35628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:19 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/559324240' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:12:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:19 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3477468104' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:12:19.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.703+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb994109ec0 con 0x7fb994107930 2024-09-21T12:12:19.706 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:19 smithi118 ceph-mon[111738]: from='client.35624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:19.706 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:19 smithi118 ceph-mon[111738]: from='client.35628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:19.706 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:19 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/559324240' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:12:19.706 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:19 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3477468104' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:12:19.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.704+0000 7fb989ffb640 1 -- 172.21.15.118:0/469520922 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fb98408ef10 con 0x7fb994107930 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:12:19.707 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:12:19.708 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:12:19.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb97c07af80 msgr2=0x7fb97c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb97c07af80 0x7fb97c07d440 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb9900058c0 tx=0x7fb99000a4c0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994107930 msgr2=0x7fb99419dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:19.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994107930 0x7fb99419dc10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb984031460 tx=0x7fb9840048f0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 shutdown_connections 2024-09-21T12:12:19.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb97c07af80 0x7fb97c07d440 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994107930 0x7fb99419dc10 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 --2- 172.21.15.118:0/469520922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994101930 0x7fb99419d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:19.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 >> 172.21.15.118:0/469520922 conn(0x7fb9940fd630 msgr2=0x7fb9940fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:19.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 shutdown_connections 2024-09-21T12:12:19.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:19.707+0000 7fb99aedd640 1 -- 172.21.15.118:0/469520922 wait complete. 2024-09-21T12:12:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:20 smithi149 ceph-mon[79770]: pgmap v1006: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:20 smithi149 ceph-mon[79770]: from='client.35640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:20 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/469520922' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:12:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:12:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:20 smithi118 ceph-mon[111738]: pgmap v1006: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:20 smithi118 ceph-mon[111738]: from='client.35640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:20 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/469520922' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:12:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:12:22.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:22 smithi149 ceph-mon[79770]: pgmap v1007: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:22.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:22 smithi118 ceph-mon[111738]: pgmap v1007: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:24 smithi149 ceph-mon[79770]: pgmap v1008: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:24.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:24 smithi118 ceph-mon[111738]: pgmap v1008: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:26.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:26 smithi149 ceph-mon[79770]: pgmap v1009: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:26 smithi118 ceph-mon[111738]: pgmap v1009: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:28 smithi149 ceph-mon[79770]: pgmap v1010: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:28 smithi118 ceph-mon[111738]: pgmap v1010: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:30 smithi149 ceph-mon[79770]: pgmap v1011: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:30.779 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:30 smithi118 ceph-mon[111738]: pgmap v1011: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:32.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:32 smithi149 ceph-mon[79770]: pgmap v1012: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:32.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:32 smithi118 ceph-mon[111738]: pgmap v1012: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:34.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:34 smithi149 ceph-mon[79770]: pgmap v1013: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:34.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:34 smithi118 ceph-mon[111738]: pgmap v1013: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:12:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:12:36.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:36 smithi149 ceph-mon[79770]: pgmap v1014: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:36.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:36 smithi118 ceph-mon[111738]: pgmap v1014: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:38.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:38 smithi149 ceph-mon[79770]: pgmap v1015: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:38 smithi118 ceph-mon[111738]: pgmap v1015: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:40 smithi149 ceph-mon[79770]: pgmap v1016: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:40.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:40 smithi118 ceph-mon[111738]: pgmap v1016: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:42.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:42 smithi149 ceph-mon[79770]: pgmap v1017: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:42.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:42 smithi118 ceph-mon[111738]: pgmap v1017: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:44.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:44 smithi118 ceph-mon[111738]: pgmap v1018: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:44.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:44 smithi149 ceph-mon[79770]: pgmap v1018: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:46.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:46 smithi149 ceph-mon[79770]: pgmap v1019: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:46.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:46 smithi118 ceph-mon[111738]: pgmap v1019: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:48.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:48 smithi149 ceph-mon[79770]: pgmap v1020: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:48.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:48 smithi118 ceph-mon[111738]: pgmap v1020: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:49.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.796+0000 7fcc48b8c640 1 -- 172.21.15.118:0/2984052030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441007e0 msgr2=0x7fcc44100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:49.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.796+0000 7fcc48b8c640 1 --2- 172.21.15.118:0/2984052030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441007e0 0x7fcc44100c40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009880 tx=0x7fcc3802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:49.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.796+0000 7fcc48b8c640 1 -- 172.21.15.118:0/2984052030 shutdown_connections 2024-09-21T12:12:49.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.796+0000 7fcc48b8c640 1 --2- 172.21.15.118:0/2984052030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441007e0 0x7fcc44100c40 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:49.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.796+0000 7fcc48b8c640 1 --2- 172.21.15.118:0/2984052030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc441067e0 0x7fcc44106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:49.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.796+0000 7fcc48b8c640 1 -- 172.21.15.118:0/2984052030 >> 172.21.15.118:0/2984052030 conn(0x7fcc440fc4c0 msgr2=0x7fcc440fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:49.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.796+0000 7fcc48b8c640 1 -- 172.21.15.118:0/2984052030 shutdown_connections 2024-09-21T12:12:49.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.796+0000 7fcc48b8c640 1 -- 172.21.15.118:0/2984052030 wait complete. 2024-09-21T12:12:49.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.796+0000 7fcc48b8c640 1 Processor -- start 2024-09-21T12:12:49.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc48b8c640 1 -- start start 2024-09-21T12:12:49.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc48b8c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc441007e0 0x7fcc4419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:49.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc48b8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441067e0 0x7fcc4419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:49.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc48b8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4410dcb0 con 0x7fcc441067e0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc48b8c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4410db30 con 0x7fcc441007e0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc41d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441067e0 0x7fcc4419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc41d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441067e0 0x7fcc4419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59088/0 (socket says 172.21.15.118:59088) 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc41d9b640 1 -- 172.21.15.118:0/3285758184 learned_addr learned my addr 172.21.15.118:0/3285758184 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc4259c640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc441007e0 0x7fcc4419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc41d9b640 1 -- 172.21.15.118:0/3285758184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc441007e0 msgr2=0x7fcc4419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc41d9b640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc441007e0 0x7fcc4419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc41d9b640 1 -- 172.21.15.118:0/3285758184 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc44197830 con 0x7fcc441067e0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.797+0000 7fcc41d9b640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441067e0 0x7fcc4419dbf0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcc38031460 tx=0x7fcc380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.798+0000 7fcc337fe640 1 -- 172.21.15.118:0/3285758184 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc3803f070 con 0x7fcc441067e0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.798+0000 7fcc337fe640 1 -- 172.21.15.118:0/3285758184 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc38004b10 con 0x7fcc441067e0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.798+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc44197ac0 con 0x7fcc441067e0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.798+0000 7fcc337fe640 1 -- 172.21.15.118:0/3285758184 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc38035030 con 0x7fcc441067e0 2024-09-21T12:12:49.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.798+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc44197ff0 con 0x7fcc441067e0 2024-09-21T12:12:49.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.799+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc44101f20 con 0x7fcc441067e0 2024-09-21T12:12:49.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.799+0000 7fcc337fe640 1 -- 172.21.15.118:0/3285758184 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcc38042070 con 0x7fcc441067e0 2024-09-21T12:12:49.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.800+0000 7fcc337fe640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc2c07af90 0x7fcc2c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:49.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.800+0000 7fcc4259c640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc2c07af90 0x7fcc2c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:49.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.800+0000 7fcc337fe640 1 -- 172.21.15.118:0/3285758184 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcc380beac0 con 0x7fcc441067e0 2024-09-21T12:12:49.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.800+0000 7fcc4259c640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc2c07af90 0x7fcc2c07d450 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcc34005fd0 tx=0x7fcc3400b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:49.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:49.804+0000 7fcc337fe640 1 -- 172.21.15.118:0/3285758184 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc3808a090 con 0x7fcc441067e0 2024-09-21T12:12:50.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.001+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcc441982a0 con 0x7fcc2c07af90 2024-09-21T12:12:50.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.002+0000 7fcc337fe640 1 -- 172.21.15.118:0/3285758184 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fcc441982a0 con 0x7fcc2c07af90 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.004+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc2c07af90 msgr2=0x7fcc2c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.004+0000 7fcc48b8c640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc2c07af90 0x7fcc2c07d450 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcc34005fd0 tx=0x7fcc3400b390 comp rx=0 tx=0).stop 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.004+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441067e0 msgr2=0x7fcc4419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.004+0000 7fcc48b8c640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441067e0 0x7fcc4419dbf0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcc38031460 tx=0x7fcc380045e0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.004+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 shutdown_connections 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.004+0000 7fcc48b8c640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcc2c07af90 0x7fcc2c07d450 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.004+0000 7fcc48b8c640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc441067e0 0x7fcc4419dbf0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.004+0000 7fcc48b8c640 1 --2- 172.21.15.118:0/3285758184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc441007e0 0x7fcc4419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.004+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 >> 172.21.15.118:0/3285758184 conn(0x7fcc440fc4c0 msgr2=0x7fcc44069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.005+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 shutdown_connections 2024-09-21T12:12:50.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.005+0000 7fcc48b8c640 1 -- 172.21.15.118:0/3285758184 wait complete. 2024-09-21T12:12:50.016 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:12:50.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.087+0000 7f06f3531640 1 -- 172.21.15.118:0/1509592380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec100820 msgr2=0x7f06ec100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.087+0000 7f06f3531640 1 --2- 172.21.15.118:0/1509592380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec100820 0x7f06ec100c80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009880 tx=0x7f06dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.087+0000 7f06f3531640 1 -- 172.21.15.118:0/1509592380 shutdown_connections 2024-09-21T12:12:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.087+0000 7f06f3531640 1 --2- 172.21.15.118:0/1509592380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec100820 0x7f06ec100c80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.087+0000 7f06f3531640 1 --2- 172.21.15.118:0/1509592380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06ec106820 0x7f06ec106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.087+0000 7f06f3531640 1 -- 172.21.15.118:0/1509592380 >> 172.21.15.118:0/1509592380 conn(0x7f06ec0fc520 msgr2=0x7f06ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.087+0000 7f06f3531640 1 -- 172.21.15.118:0/1509592380 shutdown_connections 2024-09-21T12:12:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.087+0000 7f06f3531640 1 -- 172.21.15.118:0/1509592380 wait complete. 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f3531640 1 Processor -- start 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f3531640 1 -- start start 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f3531640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06ec100820 0x7f06ec19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f3531640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec106820 0x7f06ec19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f3531640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec10dcd0 con 0x7f06ec106820 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f3531640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec10db50 con 0x7f06ec100820 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f0acc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec106820 0x7f06ec19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f0acc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec106820 0x7f06ec19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59096/0 (socket says 172.21.15.118:59096) 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f0acc640 1 -- 172.21.15.118:0/1252818771 learned_addr learned my addr 172.21.15.118:0/1252818771 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.088+0000 7f06f12cd640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06ec100820 0x7f06ec19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.089+0000 7f06f0acc640 1 -- 172.21.15.118:0/1252818771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06ec100820 msgr2=0x7f06ec19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.089+0000 7f06f0acc640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06ec100820 0x7f06ec19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.089+0000 7f06f0acc640 1 -- 172.21.15.118:0/1252818771 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec1977f0 con 0x7f06ec106820 2024-09-21T12:12:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.089+0000 7f06f0acc640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec106820 0x7f06ec19dbb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f06dc031460 tx=0x7f06dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.089+0000 7f06e27fc640 1 -- 172.21.15.118:0/1252818771 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06dc03f070 con 0x7f06ec106820 2024-09-21T12:12:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.089+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec197a80 con 0x7f06ec106820 2024-09-21T12:12:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.089+0000 7f06e27fc640 1 -- 172.21.15.118:0/1252818771 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06dc004cf0 con 0x7f06ec106820 2024-09-21T12:12:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.089+0000 7f06e27fc640 1 -- 172.21.15.118:0/1252818771 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06dc035030 con 0x7f06ec106820 2024-09-21T12:12:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.089+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec197fb0 con 0x7f06ec106820 2024-09-21T12:12:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.090+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec101f60 con 0x7f06ec106820 2024-09-21T12:12:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.091+0000 7f06e27fc640 1 -- 172.21.15.118:0/1252818771 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f06dc042070 con 0x7f06ec106820 2024-09-21T12:12:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.091+0000 7f06e27fc640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f06d807af80 0x7f06d807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.091+0000 7f06e27fc640 1 -- 172.21.15.118:0/1252818771 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f06dc0bea90 con 0x7f06ec106820 2024-09-21T12:12:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.091+0000 7f06f12cd640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f06d807af80 0x7f06d807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.092+0000 7f06f12cd640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f06d807af80 0x7f06d807d440 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f06e8005e10 tx=0x7f06e8005da0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:50.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.096+0000 7f06e27fc640 1 -- 172.21.15.118:0/1252818771 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06dc08a060 con 0x7f06ec106820 2024-09-21T12:12:50.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.292+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f06ec198260 con 0x7f06d807af80 2024-09-21T12:12:50.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.293+0000 7f06e27fc640 1 -- 172.21.15.118:0/1252818771 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f06ec198260 con 0x7f06d807af80 2024-09-21T12:12:50.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.295+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f06d807af80 msgr2=0x7f06d807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.295+0000 7f06f3531640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f06d807af80 0x7f06d807d440 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f06e8005e10 tx=0x7f06e8005da0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.295+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec106820 msgr2=0x7f06ec19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.295+0000 7f06f3531640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec106820 0x7f06ec19dbb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f06dc031460 tx=0x7f06dc0048f0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.296+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 shutdown_connections 2024-09-21T12:12:50.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.296+0000 7f06f3531640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f06d807af80 0x7f06d807d440 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.296+0000 7f06f3531640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06ec106820 0x7f06ec19dbb0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.296+0000 7f06f3531640 1 --2- 172.21.15.118:0/1252818771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06ec100820 0x7f06ec19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.296+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 >> 172.21.15.118:0/1252818771 conn(0x7f06ec0fc520 msgr2=0x7f06ec06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:50.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.296+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 shutdown_connections 2024-09-21T12:12:50.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.296+0000 7f06f3531640 1 -- 172.21.15.118:0/1252818771 wait complete. 2024-09-21T12:12:50.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.376+0000 7f01925fc640 1 -- 172.21.15.118:0/25867479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c106820 msgr2=0x7f018c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.376+0000 7f01925fc640 1 --2- 172.21.15.118:0/25867479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c106820 0x7f018c106c00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f017c009880 tx=0x7f017c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.376+0000 7f01925fc640 1 -- 172.21.15.118:0/25867479 shutdown_connections 2024-09-21T12:12:50.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.376+0000 7f01925fc640 1 --2- 172.21.15.118:0/25867479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f018c100820 0x7f018c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.376+0000 7f01925fc640 1 --2- 172.21.15.118:0/25867479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c106820 0x7f018c106c00 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.376+0000 7f01925fc640 1 -- 172.21.15.118:0/25867479 >> 172.21.15.118:0/25867479 conn(0x7f018c0fc520 msgr2=0x7f018c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:50.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.376+0000 7f01925fc640 1 -- 172.21.15.118:0/25867479 shutdown_connections 2024-09-21T12:12:50.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.376+0000 7f01925fc640 1 -- 172.21.15.118:0/25867479 wait complete. 2024-09-21T12:12:50.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.377+0000 7f01925fc640 1 Processor -- start 2024-09-21T12:12:50.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.377+0000 7f01925fc640 1 -- start start 2024-09-21T12:12:50.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f01925fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c100820 0x7f018c19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:50.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f01925fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f018c106820 0x7f018c19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:50.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f01925fc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f018c10dcd0 con 0x7f018c100820 2024-09-21T12:12:50.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f01925fc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f018c10db50 con 0x7f018c106820 2024-09-21T12:12:50.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f018bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c100820 0x7f018c19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:50.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f018bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c100820 0x7f018c19d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59124/0 (socket says 172.21.15.118:59124) 2024-09-21T12:12:50.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f018bfff640 1 -- 172.21.15.118:0/2155473053 learned_addr learned my addr 172.21.15.118:0/2155473053 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:50.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f018b7fe640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f018c106820 0x7f018c19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:50.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f018bfff640 1 -- 172.21.15.118:0/2155473053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f018c106820 msgr2=0x7f018c19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f018bfff640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f018c106820 0x7f018c19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.378+0000 7f018bfff640 1 -- 172.21.15.118:0/2155473053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c197780 con 0x7f018c100820 2024-09-21T12:12:50.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.379+0000 7f018bfff640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c100820 0x7f018c19d600 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f017c031460 tx=0x7f017c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:50.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.380+0000 7f01897fa640 1 -- 172.21.15.118:0/2155473053 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f017c03f070 con 0x7f018c100820 2024-09-21T12:12:50.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.380+0000 7f01897fa640 1 -- 172.21.15.118:0/2155473053 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f017c004cf0 con 0x7f018c100820 2024-09-21T12:12:50.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.380+0000 7f01897fa640 1 -- 172.21.15.118:0/2155473053 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f017c035030 con 0x7f018c100820 2024-09-21T12:12:50.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.380+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c197a10 con 0x7f018c100820 2024-09-21T12:12:50.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.380+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c197f40 con 0x7f018c100820 2024-09-21T12:12:50.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.381+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018c101f60 con 0x7f018c100820 2024-09-21T12:12:50.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.382+0000 7f01897fa640 1 -- 172.21.15.118:0/2155473053 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f017c042070 con 0x7f018c100820 2024-09-21T12:12:50.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.382+0000 7f01897fa640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f017407af80 0x7f017407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:50.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.383+0000 7f01897fa640 1 -- 172.21.15.118:0/2155473053 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f017c0be9c0 con 0x7f018c100820 2024-09-21T12:12:50.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.383+0000 7f018b7fe640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f017407af80 0x7f017407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:50.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.383+0000 7f018b7fe640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f017407af80 0x7f017407d440 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f018c06b390 tx=0x7f018000a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:50.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.387+0000 7f01897fa640 1 -- 172.21.15.118:0/2155473053 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f017c089f90 con 0x7f018c100820 2024-09-21T12:12:50.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.570+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f018c1981f0 con 0x7f017407af80 2024-09-21T12:12:50.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.579+0000 7f01897fa640 1 -- 172.21.15.118:0/2155473053 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f018c1981f0 con 0x7f017407af80 2024-09-21T12:12:50.582 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:12:50.582 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (30m) 9m ago 41m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:12:50.582 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (33m) 9m ago 41m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:12:50.582 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (33m) 9m ago 41m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:12:50.582 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (28m) 9m ago 41m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:12:50.582 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (28m) 9m ago 40m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:12:50.582 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (30m) 9m ago 41m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:12:50.582 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (25m) 9m ago 36m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:12:50.582 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (24m) 9m ago 36m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (9m) 9m ago 36m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (24m) 9m ago 36m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (32m) 9m ago 43m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (31m) 9m ago 40m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (29m) 9m ago 43m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (29m) 9m ago 40m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (31m) 9m ago 41m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (31m) 9m ago 40m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (28m) 9m ago 39m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (27m) 9m ago 39m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (27m) 9m ago 38m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (26m) 9m ago 38m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (26m) 9m ago 37m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:12:50.583 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (25m) 9m ago 37m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:12:50.584 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (31m) 9m ago 41m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:12:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f017407af80 msgr2=0x7f017407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f017407af80 0x7f017407d440 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f018c06b390 tx=0x7f018000a2d0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c100820 msgr2=0x7f018c19d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c100820 0x7f018c19d600 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f017c031460 tx=0x7f017c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 shutdown_connections 2024-09-21T12:12:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f018c106820 0x7f018c19db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f017407af80 0x7f017407d440 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 --2- 172.21.15.118:0/2155473053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f018c100820 0x7f018c19d600 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 >> 172.21.15.118:0/2155473053 conn(0x7f018c0fc520 msgr2=0x7f018c109e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 shutdown_connections 2024-09-21T12:12:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.582+0000 7f01925fc640 1 -- 172.21.15.118:0/2155473053 wait complete. 2024-09-21T12:12:50.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.662+0000 7f4e89d76640 1 -- 172.21.15.118:0/3591416693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84107930 msgr2=0x7f4e84107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.662+0000 7f4e89d76640 1 --2- 172.21.15.118:0/3591416693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84107930 0x7f4e84107d10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009880 tx=0x7f4e7402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.664 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:50 smithi118 ceph-mon[111738]: pgmap v1021: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:50.665 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.662+0000 7f4e89d76640 1 -- 172.21.15.118:0/3591416693 shutdown_connections 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.662+0000 7f4e89d76640 1 --2- 172.21.15.118:0/3591416693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e84101930 0x7f4e84101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.662+0000 7f4e89d76640 1 --2- 172.21.15.118:0/3591416693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84107930 0x7f4e84107d10 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.662+0000 7f4e89d76640 1 -- 172.21.15.118:0/3591416693 >> 172.21.15.118:0/3591416693 conn(0x7f4e840fd630 msgr2=0x7f4e840ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.662+0000 7f4e89d76640 1 -- 172.21.15.118:0/3591416693 shutdown_connections 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.662+0000 7f4e89d76640 1 -- 172.21.15.118:0/3591416693 wait complete. 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.663+0000 7f4e89d76640 1 Processor -- start 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.663+0000 7f4e89d76640 1 -- start start 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.663+0000 7f4e89d76640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84101930 0x7f4e8419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:50.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.663+0000 7f4e89d76640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e84107930 0x7f4e8419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.663+0000 7f4e89d76640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8410ee00 con 0x7f4e84101930 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.663+0000 7f4e89d76640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8410ec80 con 0x7f4e84107930 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e837fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84101930 0x7f4e8419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e837fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84101930 0x7f4e8419d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59140/0 (socket says 172.21.15.118:59140) 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e837fe640 1 -- 172.21.15.118:0/1969787552 learned_addr learned my addr 172.21.15.118:0/1969787552 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e82ffd640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e84107930 0x7f4e8419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e837fe640 1 -- 172.21.15.118:0/1969787552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e84107930 msgr2=0x7f4e8419db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e837fe640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e84107930 0x7f4e8419db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e837fe640 1 -- 172.21.15.118:0/1969787552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e841977d0 con 0x7f4e84101930 2024-09-21T12:12:50.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e837fe640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84101930 0x7f4e8419d650 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4e74031460 tx=0x7f4e740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:50.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e80ff9640 1 -- 172.21.15.118:0/1969787552 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e7403f070 con 0x7f4e84101930 2024-09-21T12:12:50.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e84197a60 con 0x7f4e84101930 2024-09-21T12:12:50.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e80ff9640 1 -- 172.21.15.118:0/1969787552 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e740035f0 con 0x7f4e84101930 2024-09-21T12:12:50.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e80ff9640 1 -- 172.21.15.118:0/1969787552 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e74035030 con 0x7f4e84101930 2024-09-21T12:12:50.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.664+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e84197f90 con 0x7f4e84101930 2024-09-21T12:12:50.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.665+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e84103070 con 0x7f4e84101930 2024-09-21T12:12:50.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.666+0000 7f4e80ff9640 1 -- 172.21.15.118:0/1969787552 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4e74042070 con 0x7f4e84101930 2024-09-21T12:12:50.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.667+0000 7f4e80ff9640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e6c07af80 0x7f4e6c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:50.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.667+0000 7f4e82ffd640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e6c07af80 0x7f4e6c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:50.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.667+0000 7f4e80ff9640 1 -- 172.21.15.118:0/1969787552 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4e740be910 con 0x7f4e84101930 2024-09-21T12:12:50.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.667+0000 7f4e82ffd640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e6c07af80 0x7f4e6c07d440 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4e840ffc20 tx=0x7f4e7800b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:50.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.671+0000 7f4e80ff9640 1 -- 172.21.15.118:0/1969787552 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e74089ee0 con 0x7f4e84101930 2024-09-21T12:12:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:50 smithi149 ceph-mon[79770]: pgmap v1021: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:12:50.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.923+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4e84109ea0 con 0x7f4e84101930 2024-09-21T12:12:50.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.923+0000 7f4e80ff9640 1 -- 172.21.15.118:0/1969787552 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4e7408ed90 con 0x7f4e84101930 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:12:50.926 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:12:50.927 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:12:50.927 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:12:50.927 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:12:50.927 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:12:50.927 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:12:50.927 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:12:50.927 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e6c07af80 msgr2=0x7f4e6c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e6c07af80 0x7f4e6c07d440 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4e840ffc20 tx=0x7f4e7800b390 comp rx=0 tx=0).stop 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84101930 msgr2=0x7f4e8419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84101930 0x7f4e8419d650 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4e74031460 tx=0x7f4e740045e0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 shutdown_connections 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e84107930 0x7f4e8419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4e6c07af80 0x7f4e6c07d440 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 --2- 172.21.15.118:0/1969787552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e84101930 0x7f4e8419d650 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 >> 172.21.15.118:0/1969787552 conn(0x7f4e840fd630 msgr2=0x7f4e840fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 shutdown_connections 2024-09-21T12:12:50.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:50.926+0000 7f4e89d76640 1 -- 172.21.15.118:0/1969787552 wait complete. 2024-09-21T12:12:51.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.007+0000 7f2cb1d95640 1 -- 172.21.15.118:0/1083327762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac106a40 msgr2=0x7f2cac106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.007+0000 7f2cb1d95640 1 --2- 172.21.15.118:0/1083327762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac106a40 0x7f2cac106e20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009880 tx=0x7f2c9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.007+0000 7f2cb1d95640 1 -- 172.21.15.118:0/1083327762 shutdown_connections 2024-09-21T12:12:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.007+0000 7f2cb1d95640 1 --2- 172.21.15.118:0/1083327762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac100f60 0x7f2cac1013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.007+0000 7f2cb1d95640 1 --2- 172.21.15.118:0/1083327762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac106a40 0x7f2cac106e20 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.007+0000 7f2cb1d95640 1 -- 172.21.15.118:0/1083327762 >> 172.21.15.118:0/1083327762 conn(0x7f2cac0fbc60 msgr2=0x7f2cac0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.007+0000 7f2cb1d95640 1 -- 172.21.15.118:0/1083327762 shutdown_connections 2024-09-21T12:12:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.007+0000 7f2cb1d95640 1 -- 172.21.15.118:0/1083327762 wait complete. 2024-09-21T12:12:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cb1d95640 1 Processor -- start 2024-09-21T12:12:51.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cb1d95640 1 -- start start 2024-09-21T12:12:51.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cb1d95640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100f60 0x7f2cac0fc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cb1d95640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106a40 0x7f2cac0fc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cb1d95640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac10df10 con 0x7f2cac100f60 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cb1d95640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac10dd90 con 0x7f2cac106a40 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cab7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100f60 0x7f2cac0fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cab7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100f60 0x7f2cac0fc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59152/0 (socket says 172.21.15.118:59152) 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cab7fe640 1 -- 172.21.15.118:0/295544507 learned_addr learned my addr 172.21.15.118:0/295544507 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2caaffd640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106a40 0x7f2cac0fc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cab7fe640 1 -- 172.21.15.118:0/295544507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106a40 msgr2=0x7f2cac0fc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cab7fe640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106a40 0x7f2cac0fc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.008+0000 7f2cab7fe640 1 -- 172.21.15.118:0/295544507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac0fce10 con 0x7f2cac100f60 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.009+0000 7f2cab7fe640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100f60 0x7f2cac0fc390 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c031460 tx=0x7f2c9c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.009+0000 7f2ca8ff9640 1 -- 172.21.15.118:0/295544507 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c9c03f070 con 0x7f2cac100f60 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.009+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cac0fd0a0 con 0x7f2cac100f60 2024-09-21T12:12:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.009+0000 7f2ca8ff9640 1 -- 172.21.15.118:0/295544507 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c9c0035f0 con 0x7f2cac100f60 2024-09-21T12:12:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.009+0000 7f2ca8ff9640 1 -- 172.21.15.118:0/295544507 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c9c035030 con 0x7f2cac100f60 2024-09-21T12:12:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.009+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cac1a4000 con 0x7f2cac100f60 2024-09-21T12:12:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.010+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cac102180 con 0x7f2cac100f60 2024-09-21T12:12:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.011+0000 7f2ca8ff9640 1 -- 172.21.15.118:0/295544507 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2c9c042070 con 0x7f2cac100f60 2024-09-21T12:12:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.011+0000 7f2ca8ff9640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9407af30 0x7f2c9407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.011+0000 7f2ca8ff9640 1 -- 172.21.15.118:0/295544507 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2c9c0be990 con 0x7f2cac100f60 2024-09-21T12:12:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.011+0000 7f2caaffd640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9407af30 0x7f2c9407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.012+0000 7f2caaffd640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9407af30 0x7f2c9407d3f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0fde20 tx=0x7f2ca000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.016+0000 7f2ca8ff9640 1 -- 172.21.15.118:0/295544507 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c9c089ee0 con 0x7f2cac100f60 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.226+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2cac06a0e0 con 0x7f2cac100f60 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.227+0000 7f2ca8ff9640 1 -- 172.21.15.118:0/295544507 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f2c9c08ed90 con 0x7f2cac100f60 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:12:51.229 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:12:51.230 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:12:51.231 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:12:51.232 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:12:51.232 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:12:51.232 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:12:51.232 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:12:51.232 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:12:51.232 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9407af30 msgr2=0x7f2c9407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9407af30 0x7f2c9407d3f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0fde20 tx=0x7f2ca000b390 comp rx=0 tx=0).stop 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100f60 msgr2=0x7f2cac0fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100f60 0x7f2cac0fc390 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c031460 tx=0x7f2c9c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 shutdown_connections 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac106a40 0x7f2cac0fc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2c9407af30 0x7f2c9407d3f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 --2- 172.21.15.118:0/295544507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac100f60 0x7f2cac0fc390 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 >> 172.21.15.118:0/295544507 conn(0x7f2cac0fbc60 msgr2=0x7f2cac100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 shutdown_connections 2024-09-21T12:12:51.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.229+0000 7f2cb1d95640 1 -- 172.21.15.118:0/295544507 wait complete. 2024-09-21T12:12:51.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 -- 172.21.15.118:0/1510588397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108106820 msgr2=0x7f5108106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 --2- 172.21.15.118:0/1510588397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108106820 0x7f5108106c00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009880 tx=0x7f50fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 -- 172.21.15.118:0/1510588397 shutdown_connections 2024-09-21T12:12:51.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 --2- 172.21.15.118:0/1510588397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5108100820 0x7f5108100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 --2- 172.21.15.118:0/1510588397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108106820 0x7f5108106c00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 -- 172.21.15.118:0/1510588397 >> 172.21.15.118:0/1510588397 conn(0x7f51080fc520 msgr2=0x7f51080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:51.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 -- 172.21.15.118:0/1510588397 shutdown_connections 2024-09-21T12:12:51.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 -- 172.21.15.118:0/1510588397 wait complete. 2024-09-21T12:12:51.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 Processor -- start 2024-09-21T12:12:51.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 -- start start 2024-09-21T12:12:51.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.312+0000 7f510eb24640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108100820 0x7f51080fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:51.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510eb24640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5108106820 0x7f51080fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510eb24640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f510810dd50 con 0x7f5108100820 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510eb24640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f510810dbd0 con 0x7f5108106820 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510c8c0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108100820 0x7f51080fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510c8c0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108100820 0x7f51080fcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59160/0 (socket says 172.21.15.118:59160) 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510c8c0640 1 -- 172.21.15.118:0/4049363528 learned_addr learned my addr 172.21.15.118:0/4049363528 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f5107fff640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5108106820 0x7f51080fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510c8c0640 1 -- 172.21.15.118:0/4049363528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5108106820 msgr2=0x7f51080fd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510c8c0640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5108106820 0x7f51080fd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510c8c0640 1 -- 172.21.15.118:0/4049363528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080fd6e0 con 0x7f5108100820 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f5107fff640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5108106820 0x7f51080fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510c8c0640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108100820 0x7f51080fcc60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f50fc031460 tx=0x7f50fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f5105ffb640 1 -- 172.21.15.118:0/4049363528 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50fc03f070 con 0x7f5108100820 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f5105ffb640 1 -- 172.21.15.118:0/4049363528 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50fc004cf0 con 0x7f5108100820 2024-09-21T12:12:51.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51080fd970 con 0x7f5108100820 2024-09-21T12:12:51.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.313+0000 7f5105ffb640 1 -- 172.21.15.118:0/4049363528 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50fc035030 con 0x7f5108100820 2024-09-21T12:12:51.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.314+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51081a3df0 con 0x7f5108100820 2024-09-21T12:12:51.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.315+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5108101f60 con 0x7f5108100820 2024-09-21T12:12:51.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.315+0000 7f5105ffb640 1 -- 172.21.15.118:0/4049363528 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f50fc042070 con 0x7f5108100820 2024-09-21T12:12:51.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.316+0000 7f5105ffb640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f50f807af30 0x7f50f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:51.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.316+0000 7f5105ffb640 1 -- 172.21.15.118:0/4049363528 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f50fc0bebf0 con 0x7f5108100820 2024-09-21T12:12:51.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.316+0000 7f5107fff640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f50f807af30 0x7f50f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:51.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.316+0000 7f5107fff640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f50f807af30 0x7f50f807d3f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006fd0 tx=0x7f50f4008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:51.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.320+0000 7f5105ffb640 1 -- 172.21.15.118:0/4049363528 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f50fc08a140 con 0x7f5108100820 2024-09-21T12:12:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.514+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5108062630 con 0x7f50f807af30 2024-09-21T12:12:51.516 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:51 smithi118 ceph-mon[111738]: from='client.35648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:51.516 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:51 smithi118 ceph-mon[111738]: from='client.35652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:51.516 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:51 smithi118 ceph-mon[111738]: from='client.35656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:51.516 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:51 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1969787552' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:12:51.516 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:51 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/295544507' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:12:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.515+0000 7f5105ffb640 1 -- 172.21.15.118:0/4049363528 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5108062630 con 0x7f50f807af30 2024-09-21T12:12:51.517 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:12:51.517 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:12:51.517 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:12:51.517 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:12:51.517 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:12:51.517 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:12:51.517 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:12:51.518 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:12:51.518 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:12:51.518 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:12:51.518 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:12:51.518 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:12:51.518 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:12:51.518 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:12:51.518 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:12:51.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f50f807af30 msgr2=0x7f50f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f50f807af30 0x7f50f807d3f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006fd0 tx=0x7f50f4008040 comp rx=0 tx=0).stop 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108100820 msgr2=0x7f51080fcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108100820 0x7f51080fcc60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f50fc031460 tx=0x7f50fc0048f0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 shutdown_connections 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5108106820 0x7f51080fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f50f807af30 0x7f50f807d3f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 --2- 172.21.15.118:0/4049363528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5108100820 0x7f51080fcc60 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 >> 172.21.15.118:0/4049363528 conn(0x7f51080fc520 msgr2=0x7f510806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 shutdown_connections 2024-09-21T12:12:51.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.517+0000 7f510eb24640 1 -- 172.21.15.118:0/4049363528 wait complete. 2024-09-21T12:12:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 -- 172.21.15.118:0/3650047604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781007e0 msgr2=0x7f2678100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 --2- 172.21.15.118:0/3650047604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781007e0 0x7f2678100c40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2674009880 tx=0x7f267402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 -- 172.21.15.118:0/3650047604 shutdown_connections 2024-09-21T12:12:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 --2- 172.21.15.118:0/3650047604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781007e0 0x7f2678100c40 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 --2- 172.21.15.118:0/3650047604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26781067e0 0x7f2678106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 -- 172.21.15.118:0/3650047604 >> 172.21.15.118:0/3650047604 conn(0x7f26780fc4c0 msgr2=0x7f26780fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 -- 172.21.15.118:0/3650047604 shutdown_connections 2024-09-21T12:12:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 -- 172.21.15.118:0/3650047604 wait complete. 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 Processor -- start 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.600+0000 7f267fde1640 1 -- start start 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267fde1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26781007e0 0x7f267819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267fde1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781067e0 0x7f267819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267fde1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f267810dcb0 con 0x7f26781067e0 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267fde1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f267810db30 con 0x7f26781007e0 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267d37c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781067e0 0x7f267819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267d37c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781067e0 0x7f267819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59192/0 (socket says 172.21.15.118:59192) 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267d37c640 1 -- 172.21.15.118:0/3775155778 learned_addr learned my addr 172.21.15.118:0/3775155778 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267db7d640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26781007e0 0x7f267819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267d37c640 1 -- 172.21.15.118:0/3775155778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26781007e0 msgr2=0x7f267819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267d37c640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26781007e0 0x7f267819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267d37c640 1 -- 172.21.15.118:0/3775155778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2678197830 con 0x7f26781067e0 2024-09-21T12:12:51.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267d37c640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781067e0 0x7f267819dbf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2674031460 tx=0x7f26740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:51.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f266effd640 1 -- 172.21.15.118:0/3775155778 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f267403f070 con 0x7f26781067e0 2024-09-21T12:12:51.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f266effd640 1 -- 172.21.15.118:0/3775155778 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26740035f0 con 0x7f26781067e0 2024-09-21T12:12:51.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2678197ac0 con 0x7f26781067e0 2024-09-21T12:12:51.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f266effd640 1 -- 172.21.15.118:0/3775155778 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2674035030 con 0x7f26781067e0 2024-09-21T12:12:51.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.601+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2678197ff0 con 0x7f26781067e0 2024-09-21T12:12:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.603+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2678101f20 con 0x7f26781067e0 2024-09-21T12:12:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.603+0000 7f266effd640 1 -- 172.21.15.118:0/3775155778 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2674042070 con 0x7f26781067e0 2024-09-21T12:12:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.604+0000 7f266effd640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f266407af30 0x7f266407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:12:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.604+0000 7f266effd640 1 -- 172.21.15.118:0/3775155778 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f26740bea20 con 0x7f26781067e0 2024-09-21T12:12:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.604+0000 7f267db7d640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f266407af30 0x7f266407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:12:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.604+0000 7f267db7d640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f266407af30 0x7f266407d3f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2668005fd0 tx=0x7f266800b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:12:51.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.608+0000 7f266effd640 1 -- 172.21.15.118:0/3775155778 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2674089f70 con 0x7f26781067e0 2024-09-21T12:12:51.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:51 smithi149 ceph-mon[79770]: from='client.35648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:51 smithi149 ceph-mon[79770]: from='client.35652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:51 smithi149 ceph-mon[79770]: from='client.35656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:51 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1969787552' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:12:51.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:51 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/295544507' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:12:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.855+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2678109d60 con 0x7f26781067e0 2024-09-21T12:12:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.855+0000 7f266effd640 1 -- 172.21.15.118:0/3775155778 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f267408ee20 con 0x7f26781067e0 2024-09-21T12:12:51.857 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:12:51.858 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:12:51.859 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:12:51.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.857+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f266407af30 msgr2=0x7f266407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.857+0000 7f267fde1640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f266407af30 0x7f266407d3f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2668005fd0 tx=0x7f266800b390 comp rx=0 tx=0).stop 2024-09-21T12:12:51.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.857+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781067e0 msgr2=0x7f267819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:12:51.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.857+0000 7f267fde1640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781067e0 0x7f267819dbf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2674031460 tx=0x7f26740045e0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.857+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 shutdown_connections 2024-09-21T12:12:51.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.857+0000 7f267fde1640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f266407af30 0x7f266407d3f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.857+0000 7f267fde1640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781067e0 0x7f267819dbf0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.857+0000 7f267fde1640 1 --2- 172.21.15.118:0/3775155778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26781007e0 0x7f267819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:12:51.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.857+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 >> 172.21.15.118:0/3775155778 conn(0x7f26780fc4c0 msgr2=0x7f2678069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:12:51.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.858+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 shutdown_connections 2024-09-21T12:12:51.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:12:51.858+0000 7f267fde1640 1 -- 172.21.15.118:0/3775155778 wait complete. 2024-09-21T12:12:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:52 smithi149 ceph-mon[79770]: pgmap v1022: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:52 smithi149 ceph-mon[79770]: from='client.35668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:52 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3775155778' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:12:52.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:52 smithi118 ceph-mon[111738]: pgmap v1022: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:52.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:52 smithi118 ceph-mon[111738]: from='client.35668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:52.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:52 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3775155778' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:12:54.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:54 smithi149 ceph-mon[79770]: pgmap v1023: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:54.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:54 smithi118 ceph-mon[111738]: pgmap v1023: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:56.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:56 smithi149 ceph-mon[79770]: pgmap v1024: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:56.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:56 smithi118 ceph-mon[111738]: pgmap v1024: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:58.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:12:58 smithi149 ceph-mon[79770]: pgmap v1025: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:12:58.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:12:58 smithi118 ceph-mon[111738]: pgmap v1025: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:00 smithi149 ceph-mon[79770]: pgmap v1026: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:00.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:00 smithi118 ceph-mon[111738]: pgmap v1026: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:02.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:02 smithi149 ceph-mon[79770]: pgmap v1027: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:02.772 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:02 smithi118 ceph-mon[111738]: pgmap v1027: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:04.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:04 smithi149 ceph-mon[79770]: pgmap v1028: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:04.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:04 smithi118 ceph-mon[111738]: pgmap v1028: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:13:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:13:06.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:06 smithi149 ceph-mon[79770]: pgmap v1029: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:06.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:06 smithi118 ceph-mon[111738]: pgmap v1029: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:08.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:08 smithi149 ceph-mon[79770]: pgmap v1030: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:08.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:08 smithi118 ceph-mon[111738]: pgmap v1030: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:10.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:10 smithi149 ceph-mon[79770]: pgmap v1031: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:10 smithi118 ceph-mon[111738]: pgmap v1031: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:13.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:12 smithi118 ceph-mon[111738]: pgmap v1032: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:13.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:12 smithi149 ceph-mon[79770]: pgmap v1032: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:13 smithi118 ceph-mon[111738]: pgmap v1033: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:13 smithi149 ceph-mon[79770]: pgmap v1033: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:16 smithi149 ceph-mon[79770]: pgmap v1034: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:16 smithi118 ceph-mon[111738]: pgmap v1034: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:18 smithi149 ceph-mon[79770]: pgmap v1035: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:18.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:18 smithi118 ceph-mon[111738]: pgmap v1035: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:20 smithi149 ceph-mon[79770]: pgmap v1036: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:13:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:20 smithi118 ceph-mon[111738]: pgmap v1036: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:13:21.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.951+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1524445029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 msgr2=0x7f4da0100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:21.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.951+0000 7f4d9ffff640 1 --2- 172.21.15.118:0/1524445029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 0x7f4da0100aa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009880 tx=0x7f4d8802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:21.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.951+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1524445029 shutdown_connections 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.951+0000 7f4d9ffff640 1 --2- 172.21.15.118:0/1524445029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 0x7f4da0100aa0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.951+0000 7f4d9ffff640 1 --2- 172.21.15.118:0/1524445029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da0106750 0x7f4da0106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.951+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1524445029 >> 172.21.15.118:0/1524445029 conn(0x7f4da00fc340 msgr2=0x7f4da00fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.951+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1524445029 shutdown_connections 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.951+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1524445029 wait complete. 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.952+0000 7f4d9ffff640 1 Processor -- start 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.952+0000 7f4d9ffff640 1 -- start start 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.952+0000 7f4d9ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 0x7f4da0196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.952+0000 7f4d9ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da0106750 0x7f4da0196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.952+0000 7f4d9ffff640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4da010dc00 con 0x7f4da0100640 2024-09-21T12:13:21.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.952+0000 7f4d9ffff640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4da010da80 con 0x7f4da0106750 2024-09-21T12:13:21.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.952+0000 7f4d9effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 0x7f4da0196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:21.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.952+0000 7f4d9effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 0x7f4da0196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32862/0 (socket says 172.21.15.118:32862) 2024-09-21T12:13:21.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.952+0000 7f4d9effd640 1 -- 172.21.15.118:0/1707144555 learned_addr learned my addr 172.21.15.118:0/1707144555 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:21.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4d9e7fc640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da0106750 0x7f4da0196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:21.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4d9effd640 1 -- 172.21.15.118:0/1707144555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da0106750 msgr2=0x7f4da0196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:21.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4d9effd640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da0106750 0x7f4da0196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:21.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4d9effd640 1 -- 172.21.15.118:0/1707144555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da0196fa0 con 0x7f4da0100640 2024-09-21T12:13:21.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4d9e7fc640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da0106750 0x7f4da0196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:13:21.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4d9effd640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 0x7f4da0196520 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800d8d0 tx=0x7f4d9800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:21.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4da49fd640 1 -- 172.21.15.118:0/1707144555 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d98017030 con 0x7f4da0100640 2024-09-21T12:13:21.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4da49fd640 1 -- 172.21.15.118:0/1707144555 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d98004020 con 0x7f4da0100640 2024-09-21T12:13:21.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da0197290 con 0x7f4da0100640 2024-09-21T12:13:21.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4da49fd640 1 -- 172.21.15.118:0/1707144555 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d980047a0 con 0x7f4da0100640 2024-09-21T12:13:21.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.953+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da01a3d60 con 0x7f4da0100640 2024-09-21T12:13:21.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.955+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da0100aa0 con 0x7f4da0100640 2024-09-21T12:13:21.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.955+0000 7f4da49fd640 1 -- 172.21.15.118:0/1707144555 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4d980041d0 con 0x7f4da0100640 2024-09-21T12:13:21.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.956+0000 7f4da49fd640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4d8c07af30 0x7f4d8c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:21.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.956+0000 7f4da49fd640 1 -- 172.21.15.118:0/1707144555 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4d98018070 con 0x7f4da0100640 2024-09-21T12:13:21.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.956+0000 7f4d9e7fc640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4d8c07af30 0x7f4d8c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:21.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.956+0000 7f4d9e7fc640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4d8c07af30 0x7f4d8c07d3f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4da0198680 tx=0x7f4d88031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:21.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:21.960+0000 7f4da49fd640 1 -- 172.21.15.118:0/1707144555 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d98069420 con 0x7f4da0100640 2024-09-21T12:13:22.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.157+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4da0101e50 con 0x7f4d8c07af30 2024-09-21T12:13:22.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.158+0000 7f4da49fd640 1 -- 172.21.15.118:0/1707144555 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4da0101e50 con 0x7f4d8c07af30 2024-09-21T12:13:22.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.160+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4d8c07af30 msgr2=0x7f4d8c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.160+0000 7f4d9ffff640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4d8c07af30 0x7f4d8c07d3f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4da0198680 tx=0x7f4d88031400 comp rx=0 tx=0).stop 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.160+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 msgr2=0x7f4da0196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.160+0000 7f4d9ffff640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 0x7f4da0196520 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800d8d0 tx=0x7f4d9800dd90 comp rx=0 tx=0).stop 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.160+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 shutdown_connections 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.160+0000 7f4d9ffff640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4da0106750 0x7f4da0196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.160+0000 7f4d9ffff640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f4d8c07af30 0x7f4d8c07d3f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.160+0000 7f4d9ffff640 1 --2- 172.21.15.118:0/1707144555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4da0100640 0x7f4da0196520 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.160+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 >> 172.21.15.118:0/1707144555 conn(0x7f4da00fc340 msgr2=0x7f4da00fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.161+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 shutdown_connections 2024-09-21T12:13:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.161+0000 7f4d9ffff640 1 -- 172.21.15.118:0/1707144555 wait complete. 2024-09-21T12:13:22.170 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:13:22.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.243+0000 7fa928630640 1 -- 172.21.15.118:0/343763479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920100820 msgr2=0x7fa920100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.243+0000 7fa928630640 1 --2- 172.21.15.118:0/343763479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920100820 0x7fa920100c80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa914009880 tx=0x7fa91402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.243+0000 7fa928630640 1 -- 172.21.15.118:0/343763479 shutdown_connections 2024-09-21T12:13:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.243+0000 7fa928630640 1 --2- 172.21.15.118:0/343763479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920100820 0x7fa920100c80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.243+0000 7fa928630640 1 --2- 172.21.15.118:0/343763479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa920106820 0x7fa920106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.243+0000 7fa928630640 1 -- 172.21.15.118:0/343763479 >> 172.21.15.118:0/343763479 conn(0x7fa9200fc520 msgr2=0x7fa9200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.243+0000 7fa928630640 1 -- 172.21.15.118:0/343763479 shutdown_connections 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.243+0000 7fa928630640 1 -- 172.21.15.118:0/343763479 wait complete. 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa928630640 1 Processor -- start 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa928630640 1 -- start start 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa928630640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa920100820 0x7fa9201965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa928630640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920106820 0x7fa920196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa928630640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa92010dcd0 con 0x7fa920106820 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa928630640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa92010db50 con 0x7fa920100820 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa925bcb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920106820 0x7fa920196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa925bcb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920106820 0x7fa920196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32868/0 (socket says 172.21.15.118:32868) 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa925bcb640 1 -- 172.21.15.118:0/3860037215 learned_addr learned my addr 172.21.15.118:0/3860037215 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa9263cc640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa920100820 0x7fa9201965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa925bcb640 1 -- 172.21.15.118:0/3860037215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa920100820 msgr2=0x7fa9201965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa925bcb640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa920100820 0x7fa9201965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa925bcb640 1 -- 172.21.15.118:0/3860037215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa920197070 con 0x7fa920106820 2024-09-21T12:13:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.244+0000 7fa925bcb640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920106820 0x7fa920196b30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa914031460 tx=0x7fa9140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.245+0000 7fa91f7fe640 1 -- 172.21.15.118:0/3860037215 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa91403f070 con 0x7fa920106820 2024-09-21T12:13:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.245+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa920197300 con 0x7fa920106820 2024-09-21T12:13:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.245+0000 7fa91f7fe640 1 -- 172.21.15.118:0/3860037215 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9140035f0 con 0x7fa920106820 2024-09-21T12:13:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.245+0000 7fa91f7fe640 1 -- 172.21.15.118:0/3860037215 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa914035030 con 0x7fa920106820 2024-09-21T12:13:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.245+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9201a3e30 con 0x7fa920106820 2024-09-21T12:13:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.246+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa920101f60 con 0x7fa920106820 2024-09-21T12:13:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.246+0000 7fa91f7fe640 1 -- 172.21.15.118:0/3860037215 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa914042070 con 0x7fa920106820 2024-09-21T12:13:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.247+0000 7fa91f7fe640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa90807af30 0x7fa90807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.247+0000 7fa91f7fe640 1 -- 172.21.15.118:0/3860037215 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa9140bea20 con 0x7fa920106820 2024-09-21T12:13:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.247+0000 7fa9263cc640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa90807af30 0x7fa90807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.247+0000 7fa9263cc640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa90807af30 0x7fa90807d3f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa918005d00 tx=0x7fa91800b410 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:22.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.251+0000 7fa91f7fe640 1 -- 172.21.15.118:0/3860037215 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa914089f70 con 0x7fa920106820 2024-09-21T12:13:22.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.443+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa920062630 con 0x7fa90807af30 2024-09-21T12:13:22.445 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:22 smithi118 ceph-mon[111738]: pgmap v1037: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:22.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.445+0000 7fa91f7fe640 1 -- 172.21.15.118:0/3860037215 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa920062630 con 0x7fa90807af30 2024-09-21T12:13:22.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa90807af30 msgr2=0x7fa90807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa90807af30 0x7fa90807d3f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa918005d00 tx=0x7fa91800b410 comp rx=0 tx=0).stop 2024-09-21T12:13:22.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920106820 msgr2=0x7fa920196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920106820 0x7fa920196b30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa914031460 tx=0x7fa9140045e0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 shutdown_connections 2024-09-21T12:13:22.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa90807af30 0x7fa90807d3f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa920106820 0x7fa920196b30 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 --2- 172.21.15.118:0/3860037215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa920100820 0x7fa9201965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 >> 172.21.15.118:0/3860037215 conn(0x7fa9200fc520 msgr2=0x7fa9200fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:22.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 shutdown_connections 2024-09-21T12:13:22.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.447+0000 7fa928630640 1 -- 172.21.15.118:0/3860037215 wait complete. 2024-09-21T12:13:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:22 smithi149 ceph-mon[79770]: pgmap v1037: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:22.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.528+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/3321629002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 msgr2=0x7fc9e4106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.528+0000 7fc9ea0a2640 1 --2- 172.21.15.118:0/3321629002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 0x7fc9e4106bf0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009880 tx=0x7fc9d402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.528+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/3321629002 shutdown_connections 2024-09-21T12:13:22.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.528+0000 7fc9ea0a2640 1 --2- 172.21.15.118:0/3321629002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e4100810 0x7fc9e4100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.528+0000 7fc9ea0a2640 1 --2- 172.21.15.118:0/3321629002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 0x7fc9e4106bf0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.528+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/3321629002 >> 172.21.15.118:0/3321629002 conn(0x7fc9e40fc510 msgr2=0x7fc9e40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:22.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.529+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/3321629002 shutdown_connections 2024-09-21T12:13:22.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.529+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/3321629002 wait complete. 2024-09-21T12:13:22.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.529+0000 7fc9ea0a2640 1 Processor -- start 2024-09-21T12:13:22.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.529+0000 7fc9ea0a2640 1 -- start start 2024-09-21T12:13:22.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9ea0a2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e4100810 0x7fc9e419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:22.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9ea0a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 0x7fc9e419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:22.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9ea0a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e410dce0 con 0x7fc9e4106810 2024-09-21T12:13:22.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9ea0a2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e410db60 con 0x7fc9e4100810 2024-09-21T12:13:22.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 0x7fc9e419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:22.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 0x7fc9e419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32886/0 (socket says 172.21.15.118:32886) 2024-09-21T12:13:22.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e2ffd640 1 -- 172.21.15.118:0/522356284 learned_addr learned my addr 172.21.15.118:0/522356284 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e37fe640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e4100810 0x7fc9e419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e2ffd640 1 -- 172.21.15.118:0/522356284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e4100810 msgr2=0x7fc9e419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e2ffd640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e4100810 0x7fc9e419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e2ffd640 1 -- 172.21.15.118:0/522356284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e41977c0 con 0x7fc9e4106810 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e37fe640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e4100810 0x7fc9e419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e2ffd640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 0x7fc9e419db80 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800e970 tx=0x7fc9d800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e0ff9640 1 -- 172.21.15.118:0/522356284 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9d800cac0 con 0x7fc9e4106810 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e0ff9640 1 -- 172.21.15.118:0/522356284 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9d80054e0 con 0x7fc9e4106810 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9e0ff9640 1 -- 172.21.15.118:0/522356284 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9d8010430 con 0x7fc9e4106810 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e4197ab0 con 0x7fc9e4106810 2024-09-21T12:13:22.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.530+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e4198040 con 0x7fc9e4106810 2024-09-21T12:13:22.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.531+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e4101f50 con 0x7fc9e4106810 2024-09-21T12:13:22.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.532+0000 7fc9e0ff9640 1 -- 172.21.15.118:0/522356284 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc9d8004f00 con 0x7fc9e4106810 2024-09-21T12:13:22.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.532+0000 7fc9e0ff9640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc9cc07af80 0x7fc9cc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:22.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.533+0000 7fc9e0ff9640 1 -- 172.21.15.118:0/522356284 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc9d809e700 con 0x7fc9e4106810 2024-09-21T12:13:22.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.533+0000 7fc9e37fe640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc9cc07af80 0x7fc9cc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:22.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.533+0000 7fc9e37fe640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc9cc07af80 0x7fc9cc07d440 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4006010 tx=0x7fc9d40095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:22.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.537+0000 7fc9e0ff9640 1 -- 172.21.15.118:0/522356284 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9d8069cd0 con 0x7fc9e4106810 2024-09-21T12:13:22.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.724+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc9e4198350 con 0x7fc9cc07af80 2024-09-21T12:13:22.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.735+0000 7fc9e0ff9640 1 -- 172.21.15.118:0/522356284 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc9e4198350 con 0x7fc9cc07af80 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (31m) 10m ago 42m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (34m) 10m ago 42m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (33m) 10m ago 41m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (29m) 10m ago 42m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (29m) 10m ago 41m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (30m) 10m ago 42m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (25m) 10m ago 36m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (25m) 10m ago 36m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:13:22.737 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (10m) 10m ago 36m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (25m) 10m ago 36m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (33m) 10m ago 43m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (32m) 10m ago 41m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (29m) 10m ago 43m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (29m) 10m ago 41m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (32m) 10m ago 42m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (32m) 10m ago 41m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (29m) 10m ago 40m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (28m) 10m ago 39m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (27m) 10m ago 39m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (27m) 10m ago 38m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (26m) 10m ago 38m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:13:22.738 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (26m) 10m ago 37m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:13:22.739 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (31m) 10m ago 41m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:13:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc9cc07af80 msgr2=0x7fc9cc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc9cc07af80 0x7fc9cc07d440 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4006010 tx=0x7fc9d40095f0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 msgr2=0x7fc9e419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 0x7fc9e419db80 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800e970 tx=0x7fc9d800ed70 comp rx=0 tx=0).stop 2024-09-21T12:13:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 shutdown_connections 2024-09-21T12:13:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc9cc07af80 0x7fc9cc07d440 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9e4106810 0x7fc9e419db80 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 --2- 172.21.15.118:0/522356284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9e4100810 0x7fc9e419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 >> 172.21.15.118:0/522356284 conn(0x7fc9e40fc510 msgr2=0x7fc9e406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:22.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 shutdown_connections 2024-09-21T12:13:22.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.738+0000 7fc9ea0a2640 1 -- 172.21.15.118:0/522356284 wait complete. 2024-09-21T12:13:22.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.818+0000 7f25ec326640 1 -- 172.21.15.118:0/1928196269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 msgr2=0x7f25e4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.818+0000 7f25ec326640 1 --2- 172.21.15.118:0/1928196269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 0x7f25e4100c80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009880 tx=0x7f25d402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.818+0000 7f25ec326640 1 -- 172.21.15.118:0/1928196269 shutdown_connections 2024-09-21T12:13:22.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.818+0000 7f25ec326640 1 --2- 172.21.15.118:0/1928196269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 0x7f25e4100c80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.818+0000 7f25ec326640 1 --2- 172.21.15.118:0/1928196269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25e4106820 0x7f25e4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.818+0000 7f25ec326640 1 -- 172.21.15.118:0/1928196269 >> 172.21.15.118:0/1928196269 conn(0x7f25e40fc520 msgr2=0x7f25e40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:22.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.818+0000 7f25ec326640 1 -- 172.21.15.118:0/1928196269 shutdown_connections 2024-09-21T12:13:22.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.818+0000 7f25ec326640 1 -- 172.21.15.118:0/1928196269 wait complete. 2024-09-21T12:13:22.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ec326640 1 Processor -- start 2024-09-21T12:13:22.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ec326640 1 -- start start 2024-09-21T12:13:22.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ec326640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 0x7f25e419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:22.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ec326640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25e4106820 0x7f25e419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:22.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ec326640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f25e410dcd0 con 0x7f25e4100820 2024-09-21T12:13:22.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ec326640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f25e410db50 con 0x7f25e4106820 2024-09-21T12:13:22.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ea0c2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 0x7f25e419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:22.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ea0c2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 0x7f25e419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32904/0 (socket says 172.21.15.118:32904) 2024-09-21T12:13:22.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ea0c2640 1 -- 172.21.15.118:0/1201246578 learned_addr learned my addr 172.21.15.118:0/1201246578 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:22.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ea0c2640 1 -- 172.21.15.118:0/1201246578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25e4106820 msgr2=0x7f25e419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:22.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25e98c1640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25e4106820 0x7f25e419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:22.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ea0c2640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25e4106820 0x7f25e419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:22.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ea0c2640 1 -- 172.21.15.118:0/1201246578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e41977c0 con 0x7f25e4100820 2024-09-21T12:13:22.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.819+0000 7f25ea0c2640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 0x7f25e419d640 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c810 tx=0x7f25e000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:22.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.820+0000 7f25db7fe640 1 -- 172.21.15.118:0/1201246578 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25e0004020 con 0x7f25e4100820 2024-09-21T12:13:22.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.820+0000 7f25db7fe640 1 -- 172.21.15.118:0/1201246578 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25e00041c0 con 0x7f25e4100820 2024-09-21T12:13:22.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.820+0000 7f25db7fe640 1 -- 172.21.15.118:0/1201246578 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25e00047a0 con 0x7f25e4100820 2024-09-21T12:13:22.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.820+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e4197ab0 con 0x7f25e4100820 2024-09-21T12:13:22.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.820+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e4198040 con 0x7f25e4100820 2024-09-21T12:13:22.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.821+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e4101f60 con 0x7f25e4100820 2024-09-21T12:13:22.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.821+0000 7f25db7fe640 1 -- 172.21.15.118:0/1201246578 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f25e00079b0 con 0x7f25e4100820 2024-09-21T12:13:22.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.822+0000 7f25db7fe640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f25d007af80 0x7f25d007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:22.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.822+0000 7f25db7fe640 1 -- 172.21.15.118:0/1201246578 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f25e009df30 con 0x7f25e4100820 2024-09-21T12:13:22.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.822+0000 7f25e98c1640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f25d007af80 0x7f25d007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:22.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.822+0000 7f25e98c1640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f25d007af80 0x7f25d007d440 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f25d4031460 tx=0x7f25d4009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:22.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:22.826+0000 7f25db7fe640 1 -- 172.21.15.118:0/1201246578 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25e0014030 con 0x7f25e4100820 2024-09-21T12:13:23.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.071+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f25e4109dc0 con 0x7f25e4100820 2024-09-21T12:13:23.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.072+0000 7f25db7fe640 1 -- 172.21.15.118:0/1201246578 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f25e0069500 con 0x7f25e4100820 2024-09-21T12:13:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:13:23.074 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:13:23.074 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:13:23.074 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:13:23.074 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:13:23.074 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:13:23.075 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:13:23.075 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:13:23.075 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:13:23.075 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:13:23.075 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:13:23.075 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:13:23.075 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:13:23.075 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:13:23.076 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:13:23.076 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:13:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:13:23.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f25d007af80 msgr2=0x7f25d007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f25d007af80 0x7f25d007d440 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f25d4031460 tx=0x7f25d4009560 comp rx=0 tx=0).stop 2024-09-21T12:13:23.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 msgr2=0x7f25e419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 0x7f25e419d640 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c810 tx=0x7f25e000ccd0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 shutdown_connections 2024-09-21T12:13:23.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25e4106820 0x7f25e419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f25d007af80 0x7f25d007d440 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 --2- 172.21.15.118:0/1201246578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e4100820 0x7f25e419d640 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 >> 172.21.15.118:0/1201246578 conn(0x7f25e40fc520 msgr2=0x7f25e406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:23.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 shutdown_connections 2024-09-21T12:13:23.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.076+0000 7f25ec326640 1 -- 172.21.15.118:0/1201246578 wait complete. 2024-09-21T12:13:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 -- 172.21.15.118:0/3578463961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 msgr2=0x7f0e8c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 --2- 172.21.15.118:0/3578463961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 0x7f0e8c107d10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009c20 tx=0x7f0e8402a970 comp rx=0 tx=0).stop 2024-09-21T12:13:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 -- 172.21.15.118:0/3578463961 shutdown_connections 2024-09-21T12:13:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 --2- 172.21.15.118:0/3578463961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e8c101930 0x7f0e8c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 --2- 172.21.15.118:0/3578463961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 0x7f0e8c107d10 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 -- 172.21.15.118:0/3578463961 >> 172.21.15.118:0/3578463961 conn(0x7f0e8c0fd630 msgr2=0x7f0e8c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:23.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 -- 172.21.15.118:0/3578463961 shutdown_connections 2024-09-21T12:13:23.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 -- 172.21.15.118:0/3578463961 wait complete. 2024-09-21T12:13:23.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 Processor -- start 2024-09-21T12:13:23.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.159+0000 7f0e915d0640 1 -- start start 2024-09-21T12:13:23.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e915d0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e8c101930 0x7f0e8c19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:23.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e915d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 0x7f0e8c19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e915d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c10ee60 con 0x7f0e8c107930 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e915d0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c10ece0 con 0x7f0e8c101930 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e8a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 0x7f0e8c19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e8a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 0x7f0e8c19dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32920/0 (socket says 172.21.15.118:32920) 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e8a7fc640 1 -- 172.21.15.118:0/3469139545 learned_addr learned my addr 172.21.15.118:0/3469139545 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e8affd640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e8c101930 0x7f0e8c19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e8a7fc640 1 -- 172.21.15.118:0/3469139545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e8c101930 msgr2=0x7f0e8c19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e8a7fc640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e8c101930 0x7f0e8c19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e8a7fc640 1 -- 172.21.15.118:0/3469139545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c1978d0 con 0x7f0e8c107930 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e8a7fc640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 0x7f0e8c19dc50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400b420 tx=0x7f0e7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e83fff640 1 -- 172.21.15.118:0/3469139545 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e74011630 con 0x7f0e8c107930 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8c197bc0 con 0x7f0e8c107930 2024-09-21T12:13:23.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e83fff640 1 -- 172.21.15.118:0/3469139545 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e74016070 con 0x7f0e8c107930 2024-09-21T12:13:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.160+0000 7f0e83fff640 1 -- 172.21.15.118:0/3469139545 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e74010d40 con 0x7f0e8c107930 2024-09-21T12:13:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.161+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e8c198150 con 0x7f0e8c107930 2024-09-21T12:13:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.161+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e8c103070 con 0x7f0e8c107930 2024-09-21T12:13:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.162+0000 7f0e83fff640 1 -- 172.21.15.118:0/3469139545 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0e7401b460 con 0x7f0e8c107930 2024-09-21T12:13:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.163+0000 7f0e83fff640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e7807af30 0x7f0e7807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.163+0000 7f0e83fff640 1 -- 172.21.15.118:0/3469139545 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0e7409d7f0 con 0x7f0e8c107930 2024-09-21T12:13:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.163+0000 7f0e8affd640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e7807af30 0x7f0e7807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.163+0000 7f0e8affd640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e7807af30 0x7f0e7807d3f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009430 tx=0x7f0e840093c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:23.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.167+0000 7f0e83fff640 1 -- 172.21.15.118:0/3469139545 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e74068d40 con 0x7f0e8c107930 2024-09-21T12:13:23.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:23 smithi118 ceph-mon[111738]: from='client.35676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:23.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:23 smithi118 ceph-mon[111738]: from='client.35680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:23.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:23 smithi118 ceph-mon[111738]: from='client.35684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:23.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:23 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1201246578' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.379+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0e8c198e00 con 0x7f0e8c107930 2024-09-21T12:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.380+0000 7f0e83fff640 1 -- 172.21.15.118:0/3469139545 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f0e7406dbf0 con 0x7f0e8c107930 2024-09-21T12:13:23.381 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:13:23.381 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:13:23.381 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:13:23.381 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:13:23.381 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:13:23.381 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:13:23.382 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:13:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:13:23.384 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:13:23.384 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:13:23.384 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:13:23.384 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:13:23.384 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:13:23.384 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:13:23.384 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:13:23.384 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:13:23.384 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e7807af30 msgr2=0x7f0e7807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e7807af30 0x7f0e7807d3f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009430 tx=0x7f0e840093c0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 msgr2=0x7f0e8c19dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 0x7f0e8c19dc50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400b420 tx=0x7f0e7400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 shutdown_connections 2024-09-21T12:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e7807af30 0x7f0e7807d3f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e8c107930 0x7f0e8c19dc50 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 --2- 172.21.15.118:0/3469139545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e8c101930 0x7f0e8c19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 >> 172.21.15.118:0/3469139545 conn(0x7f0e8c0fd630 msgr2=0x7f0e8c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 shutdown_connections 2024-09-21T12:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.382+0000 7f0e915d0640 1 -- 172.21.15.118:0/3469139545 wait complete. 2024-09-21T12:13:23.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:23 smithi149 ceph-mon[79770]: from='client.35676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:23.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:23 smithi149 ceph-mon[79770]: from='client.35680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:23.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:23 smithi149 ceph-mon[79770]: from='client.35684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:23.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:23 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1201246578' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:13:23.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.464+0000 7f1781a93640 1 -- 172.21.15.118:0/1428143177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c107930 msgr2=0x7f177c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.464+0000 7f1781a93640 1 --2- 172.21.15.118:0/1428143177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c107930 0x7f177c107d10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f176c009880 tx=0x7f176c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.464+0000 7f1781a93640 1 -- 172.21.15.118:0/1428143177 shutdown_connections 2024-09-21T12:13:23.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.464+0000 7f1781a93640 1 --2- 172.21.15.118:0/1428143177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c101930 0x7f177c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.464+0000 7f1781a93640 1 --2- 172.21.15.118:0/1428143177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c107930 0x7f177c107d10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.464+0000 7f1781a93640 1 -- 172.21.15.118:0/1428143177 >> 172.21.15.118:0/1428143177 conn(0x7f177c0fd630 msgr2=0x7f177c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:23.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.464+0000 7f1781a93640 1 -- 172.21.15.118:0/1428143177 shutdown_connections 2024-09-21T12:13:23.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.464+0000 7f1781a93640 1 -- 172.21.15.118:0/1428143177 wait complete. 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.465+0000 7f1781a93640 1 Processor -- start 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.465+0000 7f1781a93640 1 -- start start 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.465+0000 7f1781a93640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c101930 0x7f177c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.465+0000 7f1781a93640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c107930 0x7f177c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.465+0000 7f1781a93640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f177c10ee00 con 0x7f177c101930 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.465+0000 7f1781a93640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f177c10ec80 con 0x7f177c107930 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.465+0000 7f177b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c101930 0x7f177c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f177b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c101930 0x7f177c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32938/0 (socket says 172.21.15.118:32938) 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f177b7fe640 1 -- 172.21.15.118:0/281121510 learned_addr learned my addr 172.21.15.118:0/281121510 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f177affd640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c107930 0x7f177c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:23.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f177b7fe640 1 -- 172.21.15.118:0/281121510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c107930 msgr2=0x7f177c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f177b7fe640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c107930 0x7f177c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f177b7fe640 1 -- 172.21.15.118:0/281121510 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c074f70 con 0x7f177c101930 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f177b7fe640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c101930 0x7f177c0744f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f176c031460 tx=0x7f176c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f1778ff9640 1 -- 172.21.15.118:0/281121510 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f176c03f070 con 0x7f177c101930 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177c075200 con 0x7f177c101930 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f1778ff9640 1 -- 172.21.15.118:0/281121510 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f176c0035f0 con 0x7f177c101930 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f1778ff9640 1 -- 172.21.15.118:0/281121510 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f176c035030 con 0x7f177c101930 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.466+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177c1a3db0 con 0x7f177c101930 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.467+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f177c103070 con 0x7f177c101930 2024-09-21T12:13:23.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.468+0000 7f1778ff9640 1 -- 172.21.15.118:0/281121510 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f176c042070 con 0x7f177c101930 2024-09-21T12:13:23.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.468+0000 7f1778ff9640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176407af30 0x7f176407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:23.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.469+0000 7f1778ff9640 1 -- 172.21.15.118:0/281121510 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f176c0bea60 con 0x7f177c101930 2024-09-21T12:13:23.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.469+0000 7f177affd640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176407af30 0x7f176407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:23.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.469+0000 7f177affd640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176407af30 0x7f176407d3f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f177c075f80 tx=0x7f1770005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:23.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.473+0000 7f1778ff9640 1 -- 172.21.15.118:0/281121510 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f176c089fb0 con 0x7f177c101930 2024-09-21T12:13:23.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.664+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f177c062630 con 0x7f176407af30 2024-09-21T12:13:23.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.666+0000 7f1778ff9640 1 -- 172.21.15.118:0/281121510 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f177c062630 con 0x7f176407af30 2024-09-21T12:13:23.667 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:13:23.667 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:13:23.667 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:13:23.668 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:13:23.669 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:13:23.669 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:13:23.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176407af30 msgr2=0x7f176407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176407af30 0x7f176407d3f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f177c075f80 tx=0x7f1770005f90 comp rx=0 tx=0).stop 2024-09-21T12:13:23.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c101930 msgr2=0x7f177c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c101930 0x7f177c0744f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f176c031460 tx=0x7f176c004530 comp rx=0 tx=0).stop 2024-09-21T12:13:23.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 shutdown_connections 2024-09-21T12:13:23.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c107930 0x7f177c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176407af30 0x7f176407d3f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 --2- 172.21.15.118:0/281121510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c101930 0x7f177c0744f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 >> 172.21.15.118:0/281121510 conn(0x7f177c0fd630 msgr2=0x7f177c0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:23.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 shutdown_connections 2024-09-21T12:13:23.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.669+0000 7f1781a93640 1 -- 172.21.15.118:0/281121510 wait complete. 2024-09-21T12:13:23.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.751+0000 7fd18914c640 1 -- 172.21.15.118:0/3234767356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 msgr2=0x7fd184107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.751+0000 7fd18914c640 1 --2- 172.21.15.118:0/3234767356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 0x7fd184107d10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd178009880 tx=0x7fd17802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.751+0000 7fd18914c640 1 -- 172.21.15.118:0/3234767356 shutdown_connections 2024-09-21T12:13:23.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.751+0000 7fd18914c640 1 --2- 172.21.15.118:0/3234767356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd184101930 0x7fd184101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.751+0000 7fd18914c640 1 --2- 172.21.15.118:0/3234767356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 0x7fd184107d10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.751+0000 7fd18914c640 1 -- 172.21.15.118:0/3234767356 >> 172.21.15.118:0/3234767356 conn(0x7fd1840fd630 msgr2=0x7fd1840ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:23.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.751+0000 7fd18914c640 1 -- 172.21.15.118:0/3234767356 shutdown_connections 2024-09-21T12:13:23.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.751+0000 7fd18914c640 1 -- 172.21.15.118:0/3234767356 wait complete. 2024-09-21T12:13:23.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18914c640 1 Processor -- start 2024-09-21T12:13:23.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18914c640 1 -- start start 2024-09-21T12:13:23.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18914c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd184101930 0x7fd18419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:23.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18914c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 0x7fd18419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:23.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18914c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd18410ee60 con 0x7fd184107930 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18914c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd18410ece0 con 0x7fd184101930 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 0x7fd18419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18259c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 0x7fd18419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32960/0 (socket says 172.21.15.118:32960) 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18259c640 1 -- 172.21.15.118:0/454221085 learned_addr learned my addr 172.21.15.118:0/454221085 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd182d9d640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd184101930 0x7fd18419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18259c640 1 -- 172.21.15.118:0/454221085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd184101930 msgr2=0x7fd18419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18259c640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd184101930 0x7fd18419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.752+0000 7fd18259c640 1 -- 172.21.15.118:0/454221085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd184197870 con 0x7fd184107930 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.753+0000 7fd18259c640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 0x7fd18419dbf0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b420 tx=0x7fd17400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.753+0000 7fd16bfff640 1 -- 172.21.15.118:0/454221085 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd174011630 con 0x7fd184107930 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.753+0000 7fd16bfff640 1 -- 172.21.15.118:0/454221085 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd174016070 con 0x7fd184107930 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.753+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd184197b60 con 0x7fd184107930 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.753+0000 7fd16bfff640 1 -- 172.21.15.118:0/454221085 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd174010d40 con 0x7fd184107930 2024-09-21T12:13:23.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.753+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1841980f0 con 0x7fd184107930 2024-09-21T12:13:23.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.754+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd184103070 con 0x7fd184107930 2024-09-21T12:13:23.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.755+0000 7fd16bfff640 1 -- 172.21.15.118:0/454221085 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd17401b460 con 0x7fd184107930 2024-09-21T12:13:23.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.755+0000 7fd16bfff640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd16c07af30 0x7fd16c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:23.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.755+0000 7fd16bfff640 1 -- 172.21.15.118:0/454221085 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd17409d860 con 0x7fd184107930 2024-09-21T12:13:23.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.755+0000 7fd182d9d640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd16c07af30 0x7fd16c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:23.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.756+0000 7fd182d9d640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd16c07af30 0x7fd16c07d3f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd178000c00 tx=0x7fd178031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:23.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:23.759+0000 7fd16bfff640 1 -- 172.21.15.118:0/454221085 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd174021250 con 0x7fd184107930 2024-09-21T12:13:24.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.003+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd184109f00 con 0x7fd184107930 2024-09-21T12:13:24.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.003+0000 7fd16bfff640 1 -- 172.21.15.118:0/454221085 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fd174068db0 con 0x7fd184107930 2024-09-21T12:13:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:13:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:13:24.004 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:13:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:13:24.005 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:13:24.006 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:13:24.006 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:13:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:13:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:13:24.006 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:13:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:13:24.006 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:13:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:13:24.006 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:13:24.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd16c07af30 msgr2=0x7fd16c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:24.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd16c07af30 0x7fd16c07d3f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd178000c00 tx=0x7fd178031400 comp rx=0 tx=0).stop 2024-09-21T12:13:24.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 msgr2=0x7fd18419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:24.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 0x7fd18419dbf0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b420 tx=0x7fd17400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:13:24.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 shutdown_connections 2024-09-21T12:13:24.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd16c07af30 0x7fd16c07d3f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:24.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd184107930 0x7fd18419dbf0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:24.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 --2- 172.21.15.118:0/454221085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd184101930 0x7fd18419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:24.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 >> 172.21.15.118:0/454221085 conn(0x7fd1840fd630 msgr2=0x7fd1840fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:24.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 shutdown_connections 2024-09-21T12:13:24.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:24.006+0000 7fd18914c640 1 -- 172.21.15.118:0/454221085 wait complete. 2024-09-21T12:13:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:24 smithi118 ceph-mon[111738]: pgmap v1038: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:24 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3469139545' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:13:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:24 smithi118 ceph-mon[111738]: from='client.35696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:24 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/454221085' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:13:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:24 smithi149 ceph-mon[79770]: pgmap v1038: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:24 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3469139545' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:13:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:24 smithi149 ceph-mon[79770]: from='client.35696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:24.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:24 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/454221085' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:13:26.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:26 smithi149 ceph-mon[79770]: pgmap v1039: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:26 smithi118 ceph-mon[111738]: pgmap v1039: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:28 smithi149 ceph-mon[79770]: pgmap v1040: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:28.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:28 smithi118 ceph-mon[111738]: pgmap v1040: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:30 smithi118 ceph-mon[111738]: pgmap v1041: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:30 smithi149 ceph-mon[79770]: pgmap v1041: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:32 smithi149 ceph-mon[79770]: pgmap v1042: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:32 smithi118 ceph-mon[111738]: pgmap v1042: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:34.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:34 smithi118 ceph-mon[111738]: pgmap v1043: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:34.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:34 smithi149 ceph-mon[79770]: pgmap v1043: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:13:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:13:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:36 smithi149 ceph-mon[79770]: pgmap v1044: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:36 smithi118 ceph-mon[111738]: pgmap v1044: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:38 smithi118 ceph-mon[111738]: pgmap v1045: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:38 smithi149 ceph-mon[79770]: pgmap v1045: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:40 smithi149 ceph-mon[79770]: pgmap v1046: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:40.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:40 smithi118 ceph-mon[111738]: pgmap v1046: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:42 smithi149 ceph-mon[79770]: pgmap v1047: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:42.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:42 smithi118 ceph-mon[111738]: pgmap v1047: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:44.417 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:44 smithi118 ceph-mon[111738]: pgmap v1048: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:44 smithi149 ceph-mon[79770]: pgmap v1048: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:46.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:46 smithi149 ceph-mon[79770]: pgmap v1049: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:46.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:46 smithi118 ceph-mon[111738]: pgmap v1049: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:48 smithi149 ceph-mon[79770]: pgmap v1050: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:48 smithi118 ceph-mon[111738]: pgmap v1050: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:50 smithi149 ceph-mon[79770]: pgmap v1051: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:50.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:13:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:50 smithi118 ceph-mon[111738]: pgmap v1051: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:13:52.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:52 smithi149 ceph-mon[79770]: pgmap v1052: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:52.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:52 smithi118 ceph-mon[111738]: pgmap v1052: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:54.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.100+0000 7fb07fb1a640 1 -- 172.21.15.118:0/459766382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781008d0 msgr2=0x7fb078100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.100+0000 7fb07fb1a640 1 --2- 172.21.15.118:0/459766382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781008d0 0x7fb078100cb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb068009c20 tx=0x7fb06802aa00 comp rx=0 tx=0).stop 2024-09-21T12:13:54.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.100+0000 7fb07fb1a640 1 -- 172.21.15.118:0/459766382 shutdown_connections 2024-09-21T12:13:54.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.100+0000 7fb07fb1a640 1 --2- 172.21.15.118:0/459766382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0781011f0 0x7fb0781056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.100+0000 7fb07fb1a640 1 --2- 172.21.15.118:0/459766382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781008d0 0x7fb078100cb0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.100+0000 7fb07fb1a640 1 -- 172.21.15.118:0/459766382 >> 172.21.15.118:0/459766382 conn(0x7fb0780fc520 msgr2=0x7fb0780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:54.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.100+0000 7fb07fb1a640 1 -- 172.21.15.118:0/459766382 shutdown_connections 2024-09-21T12:13:54.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.100+0000 7fb07fb1a640 1 -- 172.21.15.118:0/459766382 wait complete. 2024-09-21T12:13:54.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.100+0000 7fb07fb1a640 1 Processor -- start 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07fb1a640 1 -- start start 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07fb1a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0781008d0 0x7fb07819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07fb1a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781011f0 0x7fb07819e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07fb1a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb078115410 con 0x7fb0781011f0 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07fb1a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb078115290 con 0x7fb0781008d0 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07d0b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781011f0 0x7fb07819e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07d0b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781011f0 0x7fb07819e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60484/0 (socket says 172.21.15.118:60484) 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07d0b5640 1 -- 172.21.15.118:0/3065593284 learned_addr learned my addr 172.21.15.118:0/3065593284 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07d8b6640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0781008d0 0x7fb07819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07d0b5640 1 -- 172.21.15.118:0/3065593284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0781008d0 msgr2=0x7fb07819df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07d0b5640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0781008d0 0x7fb07819df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07d0b5640 1 -- 172.21.15.118:0/3065593284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0781a2860 con 0x7fb0781011f0 2024-09-21T12:13:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07d8b6640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0781008d0 0x7fb07819df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:13:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.101+0000 7fb07d0b5640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781011f0 0x7fb07819e4d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c8f0 tx=0x7fb06c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.102+0000 7fb076ffd640 1 -- 172.21.15.118:0/3065593284 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb06c00ae50 con 0x7fb0781011f0 2024-09-21T12:13:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.102+0000 7fb076ffd640 1 -- 172.21.15.118:0/3065593284 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb06c005020 con 0x7fb0781011f0 2024-09-21T12:13:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.102+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0781a2b50 con 0x7fb0781011f0 2024-09-21T12:13:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.102+0000 7fb076ffd640 1 -- 172.21.15.118:0/3065593284 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb06c004d70 con 0x7fb0781011f0 2024-09-21T12:13:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.102+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0781a30e0 con 0x7fb0781011f0 2024-09-21T12:13:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.103+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07806abe0 con 0x7fb0781011f0 2024-09-21T12:13:54.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.103+0000 7fb076ffd640 1 -- 172.21.15.118:0/3065593284 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb06c0051d0 con 0x7fb0781011f0 2024-09-21T12:13:54.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.104+0000 7fb076ffd640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb06007b130 0x7fb06007d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.104+0000 7fb076ffd640 1 -- 172.21.15.118:0/3065593284 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb06c09de40 con 0x7fb0781011f0 2024-09-21T12:13:54.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.104+0000 7fb07d8b6640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb06007b130 0x7fb06007d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.105+0000 7fb07d8b6640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb06007b130 0x7fb06007d5f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f80 tx=0x7fb06803a040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:54.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.108+0000 7fb076ffd640 1 -- 172.21.15.118:0/3065593284 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb06c014030 con 0x7fb0781011f0 2024-09-21T12:13:54.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.301+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb0781a33f0 con 0x7fb06007b130 2024-09-21T12:13:54.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.303+0000 7fb076ffd640 1 -- 172.21.15.118:0/3065593284 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb0680481c0 con 0x7fb06007b130 2024-09-21T12:13:54.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb06007b130 msgr2=0x7fb06007d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb06007b130 0x7fb06007d5f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f80 tx=0x7fb06803a040 comp rx=0 tx=0).stop 2024-09-21T12:13:54.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781011f0 msgr2=0x7fb07819e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781011f0 0x7fb07819e4d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c8f0 tx=0x7fb06c00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 shutdown_connections 2024-09-21T12:13:54.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb06007b130 0x7fb06007d5f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0781011f0 0x7fb07819e4d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 --2- 172.21.15.118:0/3065593284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0781008d0 0x7fb07819df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 >> 172.21.15.118:0/3065593284 conn(0x7fb0780fc520 msgr2=0x7fb078112b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:54.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 shutdown_connections 2024-09-21T12:13:54.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.305+0000 7fb07fb1a640 1 -- 172.21.15.118:0/3065593284 wait complete. 2024-09-21T12:13:54.316 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:13:54.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.388+0000 7f80d936b640 1 -- 172.21.15.118:0/3024043107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d4106950 msgr2=0x7f80d4106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.388+0000 7f80d936b640 1 --2- 172.21.15.118:0/3024043107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d4106950 0x7f80d4106d30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009880 tx=0x7f80c402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.388+0000 7f80d936b640 1 -- 172.21.15.118:0/3024043107 shutdown_connections 2024-09-21T12:13:54.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.388+0000 7f80d936b640 1 --2- 172.21.15.118:0/3024043107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80d40ffd70 0x7f80d41001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.388+0000 7f80d936b640 1 --2- 172.21.15.118:0/3024043107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d4106950 0x7f80d4106d30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.388+0000 7f80d936b640 1 -- 172.21.15.118:0/3024043107 >> 172.21.15.118:0/3024043107 conn(0x7f80d40fbc60 msgr2=0x7f80d40fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:54.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.388+0000 7f80d936b640 1 -- 172.21.15.118:0/3024043107 shutdown_connections 2024-09-21T12:13:54.392 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:54 smithi118 ceph-mon[111738]: pgmap v1053: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:54.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d936b640 1 -- 172.21.15.118:0/3024043107 wait complete. 2024-09-21T12:13:54.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d936b640 1 Processor -- start 2024-09-21T12:13:54.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d936b640 1 -- start start 2024-09-21T12:13:54.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d936b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d40ffd70 0x7f80d419f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d936b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80d4106950 0x7f80d419fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d936b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f80d410eef0 con 0x7f80d40ffd70 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d936b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80d410ed70 con 0x7f80d4106950 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d40ffd70 0x7f80d419f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d40ffd70 0x7f80d419f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60498/0 (socket says 172.21.15.118:60498) 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.389+0000 7f80d2ffd640 1 -- 172.21.15.118:0/2300520299 learned_addr learned my addr 172.21.15.118:0/2300520299 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80cbfff640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80d4106950 0x7f80d419fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80d2ffd640 1 -- 172.21.15.118:0/2300520299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80d4106950 msgr2=0x7f80d419fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80d2ffd640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80d4106950 0x7f80d419fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80d2ffd640 1 -- 172.21.15.118:0/2300520299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d4199a70 con 0x7f80d40ffd70 2024-09-21T12:13:54.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80d2ffd640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d40ffd70 0x7f80d419f8b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f80c4031460 tx=0x7f80c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:54.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80d0ff9640 1 -- 172.21.15.118:0/2300520299 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80c403f070 con 0x7f80d40ffd70 2024-09-21T12:13:54.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80d0ff9640 1 -- 172.21.15.118:0/2300520299 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80c40035f0 con 0x7f80d40ffd70 2024-09-21T12:13:54.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d4199d00 con 0x7f80d40ffd70 2024-09-21T12:13:54.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80d0ff9640 1 -- 172.21.15.118:0/2300520299 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80c4035030 con 0x7f80d40ffd70 2024-09-21T12:13:54.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.390+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d419a230 con 0x7f80d40ffd70 2024-09-21T12:13:54.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.391+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d4103090 con 0x7f80d40ffd70 2024-09-21T12:13:54.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.392+0000 7f80d0ff9640 1 -- 172.21.15.118:0/2300520299 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f80c4042070 con 0x7f80d40ffd70 2024-09-21T12:13:54.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.392+0000 7f80d0ff9640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80c007af30 0x7f80c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.392+0000 7f80d0ff9640 1 -- 172.21.15.118:0/2300520299 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f80c40bead0 con 0x7f80d40ffd70 2024-09-21T12:13:54.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.392+0000 7f80cbfff640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80c007af30 0x7f80c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.393+0000 7f80cbfff640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80c007af30 0x7f80c007d3f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f80bc005fd0 tx=0x7f80bc005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:54.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.396+0000 7f80d0ff9640 1 -- 172.21.15.118:0/2300520299 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80c408a020 con 0x7f80d40ffd70 2024-09-21T12:13:54.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:54 smithi149 ceph-mon[79770]: pgmap v1053: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:54.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.595+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f80d419afa0 con 0x7f80c007af30 2024-09-21T12:13:54.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.596+0000 7f80d0ff9640 1 -- 172.21.15.118:0/2300520299 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f80d419afa0 con 0x7f80c007af30 2024-09-21T12:13:54.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.598+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80c007af30 msgr2=0x7f80c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.598+0000 7f80d936b640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80c007af30 0x7f80c007d3f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f80bc005fd0 tx=0x7f80bc005850 comp rx=0 tx=0).stop 2024-09-21T12:13:54.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.598+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d40ffd70 msgr2=0x7f80d419f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.598+0000 7f80d936b640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d40ffd70 0x7f80d419f8b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f80c4031460 tx=0x7f80c40045e0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.598+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 shutdown_connections 2024-09-21T12:13:54.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.598+0000 7f80d936b640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80d4106950 0x7f80d419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.598+0000 7f80d936b640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f80c007af30 0x7f80c007d3f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.598+0000 7f80d936b640 1 --2- 172.21.15.118:0/2300520299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80d40ffd70 0x7f80d419f8b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.598+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 >> 172.21.15.118:0/2300520299 conn(0x7f80d40fbc60 msgr2=0x7f80d40fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:54.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.599+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 shutdown_connections 2024-09-21T12:13:54.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.599+0000 7f80d936b640 1 -- 172.21.15.118:0/2300520299 wait complete. 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.680+0000 7f3ede95c640 1 -- 172.21.15.118:0/2789763284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 msgr2=0x7f3ed810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.680+0000 7f3ede95c640 1 --2- 172.21.15.118:0/2789763284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 0x7f3ed810b8f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009880 tx=0x7f3ecc02a530 comp rx=0 tx=0).stop 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.680+0000 7f3ede95c640 1 -- 172.21.15.118:0/2789763284 shutdown_connections 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.680+0000 7f3ede95c640 1 --2- 172.21.15.118:0/2789763284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 0x7f3ed810b8f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.680+0000 7f3ede95c640 1 --2- 172.21.15.118:0/2789763284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8102ae0 0x7f3ed8102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.680+0000 7f3ede95c640 1 -- 172.21.15.118:0/2789763284 >> 172.21.15.118:0/2789763284 conn(0x7f3ed80fc520 msgr2=0x7f3ed80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.680+0000 7f3ede95c640 1 -- 172.21.15.118:0/2789763284 shutdown_connections 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.680+0000 7f3ede95c640 1 -- 172.21.15.118:0/2789763284 wait complete. 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.681+0000 7f3ede95c640 1 Processor -- start 2024-09-21T12:13:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.681+0000 7f3ede95c640 1 -- start start 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.681+0000 7f3ede95c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8102ae0 0x7f3ed819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.681+0000 7f3ede95c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 0x7f3ed819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.681+0000 7f3ede95c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed810ee70 con 0x7f3ed8103400 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.681+0000 7f3ede95c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed810ecf0 con 0x7f3ed8102ae0 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.681+0000 7f3ed77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 0x7f3ed819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.681+0000 7f3ed77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 0x7f3ed819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60508/0 (socket says 172.21.15.118:60508) 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.681+0000 7f3ed77fe640 1 -- 172.21.15.118:0/1404405872 learned_addr learned my addr 172.21.15.118:0/1404405872 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ed7fff640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8102ae0 0x7f3ed819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ed77fe640 1 -- 172.21.15.118:0/1404405872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8102ae0 msgr2=0x7f3ed819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ed77fe640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8102ae0 0x7f3ed819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ed77fe640 1 -- 172.21.15.118:0/1404405872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed8197880 con 0x7f3ed8103400 2024-09-21T12:13:54.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ed77fe640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 0x7f3ed819dc00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc031460 tx=0x7f3ecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ed57fa640 1 -- 172.21.15.118:0/1404405872 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ecc03f070 con 0x7f3ed8103400 2024-09-21T12:13:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ed57fa640 1 -- 172.21.15.118:0/1404405872 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ecc004ac0 con 0x7f3ed8103400 2024-09-21T12:13:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed8197b10 con 0x7f3ed8103400 2024-09-21T12:13:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ed57fa640 1 -- 172.21.15.118:0/1404405872 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ecc035030 con 0x7f3ed8103400 2024-09-21T12:13:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.682+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed8198040 con 0x7f3ed8103400 2024-09-21T12:13:54.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.683+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed806abe0 con 0x7f3ed8103400 2024-09-21T12:13:54.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.684+0000 7f3ed57fa640 1 -- 172.21.15.118:0/1404405872 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3ecc042070 con 0x7f3ed8103400 2024-09-21T12:13:54.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.685+0000 7f3ed57fa640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ec007af80 0x7f3ec007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.685+0000 7f3ed57fa640 1 -- 172.21.15.118:0/1404405872 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3ecc0bea00 con 0x7f3ed8103400 2024-09-21T12:13:54.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.685+0000 7f3ed7fff640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ec007af80 0x7f3ec007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.685+0000 7f3ed7fff640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ec007af80 0x7f3ec007d440 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3ed81989c0 tx=0x7f3ec8009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:54.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.689+0000 7f3ed57fa640 1 -- 172.21.15.118:0/1404405872 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ecc089fd0 con 0x7f3ed8103400 2024-09-21T12:13:54.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.875+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3ed8198db0 con 0x7f3ec007af80 2024-09-21T12:13:54.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.884+0000 7f3ed57fa640 1 -- 172.21.15.118:0/1404405872 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3ed8198db0 con 0x7f3ec007af80 2024-09-21T12:13:54.886 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:13:54.886 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (31m) 10m ago 42m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:13:54.886 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (34m) 10m ago 43m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (34m) 10m ago 42m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (30m) 10m ago 42m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (29m) 10m ago 42m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (31m) 10m ago 42m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (26m) 10m ago 37m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (26m) 10m ago 37m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (10m) 10m ago 37m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (25m) 10m ago 37m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (34m) 10m ago 44m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (33m) 10m ago 41m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (30m) 10m ago 44m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (30m) 10m ago 41m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (32m) 10m ago 42m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (32m) 10m ago 42m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:13:54.887 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (29m) 10m ago 40m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:13:54.888 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (28m) 10m ago 40m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:13:54.888 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (28m) 10m ago 39m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:13:54.888 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (27m) 10m ago 39m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:13:54.888 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (27m) 10m ago 38m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:13:54.888 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (26m) 10m ago 38m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:13:54.888 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (32m) 10m ago 42m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ec007af80 msgr2=0x7f3ec007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ec007af80 0x7f3ec007d440 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3ed81989c0 tx=0x7f3ec8009110 comp rx=0 tx=0).stop 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 msgr2=0x7f3ed819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 0x7f3ed819dc00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc031460 tx=0x7f3ecc0046c0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 shutdown_connections 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3ec007af80 0x7f3ec007d440 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ed8103400 0x7f3ed819dc00 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 --2- 172.21.15.118:0/1404405872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8102ae0 0x7f3ed819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 >> 172.21.15.118:0/1404405872 conn(0x7f3ed80fc520 msgr2=0x7f3ed8108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 shutdown_connections 2024-09-21T12:13:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.886+0000 7f3ede95c640 1 -- 172.21.15.118:0/1404405872 wait complete. 2024-09-21T12:13:54.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.966+0000 7f9e55848640 1 -- 172.21.15.118:0/1857224117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50100820 msgr2=0x7f9e50100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.966+0000 7f9e55848640 1 --2- 172.21.15.118:0/1857224117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50100820 0x7f9e50100c80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009880 tx=0x7f9e4402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.966+0000 7f9e55848640 1 -- 172.21.15.118:0/1857224117 shutdown_connections 2024-09-21T12:13:54.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.966+0000 7f9e55848640 1 --2- 172.21.15.118:0/1857224117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50100820 0x7f9e50100c80 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.966+0000 7f9e55848640 1 --2- 172.21.15.118:0/1857224117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e50106820 0x7f9e50106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.966+0000 7f9e55848640 1 -- 172.21.15.118:0/1857224117 >> 172.21.15.118:0/1857224117 conn(0x7f9e500fc520 msgr2=0x7f9e500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:54.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.966+0000 7f9e55848640 1 -- 172.21.15.118:0/1857224117 shutdown_connections 2024-09-21T12:13:54.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.966+0000 7f9e55848640 1 -- 172.21.15.118:0/1857224117 wait complete. 2024-09-21T12:13:54.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.967+0000 7f9e55848640 1 Processor -- start 2024-09-21T12:13:54.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.967+0000 7f9e55848640 1 -- start start 2024-09-21T12:13:54.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.967+0000 7f9e55848640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e50100820 0x7f9e5019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.967+0000 7f9e55848640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50106820 0x7f9e5019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.967+0000 7f9e55848640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5010ee50 con 0x7f9e50106820 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.967+0000 7f9e55848640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5010ecd0 con 0x7f9e50100820 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e4e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50106820 0x7f9e5019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e4e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50106820 0x7f9e5019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60526/0 (socket says 172.21.15.118:60526) 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e4e7fc640 1 -- 172.21.15.118:0/2155667433 learned_addr learned my addr 172.21.15.118:0/2155667433 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e4effd640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e50100820 0x7f9e5019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e4e7fc640 1 -- 172.21.15.118:0/2155667433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e50100820 msgr2=0x7f9e5019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e4e7fc640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e50100820 0x7f9e5019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e4e7fc640 1 -- 172.21.15.118:0/2155667433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e50197830 con 0x7f9e50106820 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e4e7fc640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50106820 0x7f9e5019dbf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9e44031460 tx=0x7f9e440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e54846640 1 -- 172.21.15.118:0/2155667433 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e4403f070 con 0x7f9e50106820 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e50197ac0 con 0x7f9e50106820 2024-09-21T12:13:54.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e54846640 1 -- 172.21.15.118:0/2155667433 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e44004cf0 con 0x7f9e50106820 2024-09-21T12:13:54.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.968+0000 7f9e54846640 1 -- 172.21.15.118:0/2155667433 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e44035030 con 0x7f9e50106820 2024-09-21T12:13:54.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.969+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e50197ff0 con 0x7f9e50106820 2024-09-21T12:13:54.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.970+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e50101f60 con 0x7f9e50106820 2024-09-21T12:13:54.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.970+0000 7f9e54846640 1 -- 172.21.15.118:0/2155667433 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9e44042070 con 0x7f9e50106820 2024-09-21T12:13:54.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.971+0000 7f9e54846640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9e3807af30 0x7f9e3807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:54.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.971+0000 7f9e4effd640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9e3807af30 0x7f9e3807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:54.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.971+0000 7f9e54846640 1 -- 172.21.15.118:0/2155667433 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9e440beb40 con 0x7f9e50106820 2024-09-21T12:13:54.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.972+0000 7f9e4effd640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9e3807af30 0x7f9e3807d3f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009990 tx=0x7f9e40009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:54.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:54.975+0000 7f9e54846640 1 -- 172.21.15.118:0/2155667433 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e4408a090 con 0x7f9e50106820 2024-09-21T12:13:55.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.225+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9e50198d60 con 0x7f9e50106820 2024-09-21T12:13:55.228 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:55 smithi118 ceph-mon[111738]: from='client.35704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:55.228 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:55 smithi118 ceph-mon[111738]: from='client.35708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:55.228 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:55 smithi118 ceph-mon[111738]: from='client.35712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:55.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.226+0000 7f9e54846640 1 -- 172.21.15.118:0/2155667433 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f9e4408ef40 con 0x7f9e50106820 2024-09-21T12:13:55.228 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:13:55.228 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:13:55.228 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:13:55.228 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:13:55.229 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.228+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9e3807af30 msgr2=0x7f9e3807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.228+0000 7f9e55848640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9e3807af30 0x7f9e3807d3f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009990 tx=0x7f9e40009110 comp rx=0 tx=0).stop 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.228+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50106820 msgr2=0x7f9e5019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.228+0000 7f9e55848640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50106820 0x7f9e5019dbf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9e44031460 tx=0x7f9e440048f0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.228+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 shutdown_connections 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.228+0000 7f9e55848640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9e3807af30 0x7f9e3807d3f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.228+0000 7f9e55848640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e50106820 0x7f9e5019dbf0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.228+0000 7f9e55848640 1 --2- 172.21.15.118:0/2155667433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e50100820 0x7f9e5019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.228+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 >> 172.21.15.118:0/2155667433 conn(0x7f9e500fc520 msgr2=0x7f9e500fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.229+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 shutdown_connections 2024-09-21T12:13:55.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.229+0000 7f9e55848640 1 -- 172.21.15.118:0/2155667433 wait complete. 2024-09-21T12:13:55.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 -- 172.21.15.118:0/1230130606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 msgr2=0x7f032c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 --2- 172.21.15.118:0/1230130606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 0x7f032c107cf0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f031c009880 tx=0x7f031c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 -- 172.21.15.118:0/1230130606 shutdown_connections 2024-09-21T12:13:55.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 --2- 172.21.15.118:0/1230130606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032c101910 0x7f032c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 --2- 172.21.15.118:0/1230130606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 0x7f032c107cf0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 -- 172.21.15.118:0/1230130606 >> 172.21.15.118:0/1230130606 conn(0x7f032c0fd5f0 msgr2=0x7f032c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:55.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 -- 172.21.15.118:0/1230130606 shutdown_connections 2024-09-21T12:13:55.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 -- 172.21.15.118:0/1230130606 wait complete. 2024-09-21T12:13:55.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 Processor -- start 2024-09-21T12:13:55.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.310+0000 7f03317dc640 1 -- start start 2024-09-21T12:13:55.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f03317dc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032c101910 0x7f032c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:55.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f03317dc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 0x7f032c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f03317dc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f032c10ee40 con 0x7f032c107910 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f03317dc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f032c10ecc0 con 0x7f032c101910 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f0323fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 0x7f032c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f0323fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 0x7f032c19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60532/0 (socket says 172.21.15.118:60532) 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f0323fff640 1 -- 172.21.15.118:0/2909774939 learned_addr learned my addr 172.21.15.118:0/2909774939 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f032affd640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032c101910 0x7f032c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f0323fff640 1 -- 172.21.15.118:0/2909774939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032c101910 msgr2=0x7f032c19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f0323fff640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032c101910 0x7f032c19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f0323fff640 1 -- 172.21.15.118:0/2909774939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c197830 con 0x7f032c107910 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f0323fff640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 0x7f032c19dbf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f031400b420 tx=0x7f031400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f0328ff9640 1 -- 172.21.15.118:0/2909774939 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0314011630 con 0x7f032c107910 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f0328ff9640 1 -- 172.21.15.118:0/2909774939 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0314016070 con 0x7f032c107910 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.311+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032c197b20 con 0x7f032c107910 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.312+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032c1980b0 con 0x7f032c107910 2024-09-21T12:13:55.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.312+0000 7f0328ff9640 1 -- 172.21.15.118:0/2909774939 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0314010d40 con 0x7f032c107910 2024-09-21T12:13:55.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.313+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032c103050 con 0x7f032c107910 2024-09-21T12:13:55.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.313+0000 7f0328ff9640 1 -- 172.21.15.118:0/2909774939 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f031401b460 con 0x7f032c107910 2024-09-21T12:13:55.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.314+0000 7f0328ff9640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f031807af80 0x7f031807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:55.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.314+0000 7f0328ff9640 1 -- 172.21.15.118:0/2909774939 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f031409d750 con 0x7f032c107910 2024-09-21T12:13:55.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.314+0000 7f032affd640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f031807af80 0x7f031807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:55.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.314+0000 7f032affd640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f031807af80 0x7f031807d440 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f031c0096c0 tx=0x7f031c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:55.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.318+0000 7f0328ff9640 1 -- 172.21.15.118:0/2909774939 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0314068d20 con 0x7f032c107910 2024-09-21T12:13:55.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:55 smithi149 ceph-mon[79770]: from='client.35704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:55.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:55 smithi149 ceph-mon[79770]: from='client.35708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:55.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:55 smithi149 ceph-mon[79770]: from='client.35712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:55.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.537+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f032c109e80 con 0x7f032c107910 2024-09-21T12:13:55.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.537+0000 7f0328ff9640 1 -- 172.21.15.118:0/2909774939 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f031406dbd0 con 0x7f032c107910 2024-09-21T12:13:55.539 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:13:55.539 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:13:55.539 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:13:55.540 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:13:55.541 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:13:55.542 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:13:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:13:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f031807af80 msgr2=0x7f031807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f031807af80 0x7f031807d440 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f031c0096c0 tx=0x7f031c031400 comp rx=0 tx=0).stop 2024-09-21T12:13:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 msgr2=0x7f032c19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 0x7f032c19dbf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f031400b420 tx=0x7f031400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 shutdown_connections 2024-09-21T12:13:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f031807af80 0x7f031807d440 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f032c107910 0x7f032c19dbf0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 --2- 172.21.15.118:0/2909774939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f032c101910 0x7f032c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 >> 172.21.15.118:0/2909774939 conn(0x7f032c0fd5f0 msgr2=0x7f032c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:55.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 shutdown_connections 2024-09-21T12:13:55.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.539+0000 7f03317dc640 1 -- 172.21.15.118:0/2909774939 wait complete. 2024-09-21T12:13:55.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.621+0000 7fe4a929e640 1 -- 172.21.15.118:0/1098894270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4102ae0 msgr2=0x7fe4a4102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.621+0000 7fe4a929e640 1 --2- 172.21.15.118:0/1098894270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4102ae0 0x7fe4a4102ec0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe494009c20 tx=0x7fe49402aa00 comp rx=0 tx=0).stop 2024-09-21T12:13:55.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.621+0000 7fe4a929e640 1 -- 172.21.15.118:0/1098894270 shutdown_connections 2024-09-21T12:13:55.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.621+0000 7fe4a929e640 1 --2- 172.21.15.118:0/1098894270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a4103400 0x7fe4a410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.621+0000 7fe4a929e640 1 --2- 172.21.15.118:0/1098894270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4102ae0 0x7fe4a4102ec0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.621+0000 7fe4a929e640 1 -- 172.21.15.118:0/1098894270 >> 172.21.15.118:0/1098894270 conn(0x7fe4a40fc520 msgr2=0x7fe4a40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:55.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.621+0000 7fe4a929e640 1 -- 172.21.15.118:0/1098894270 shutdown_connections 2024-09-21T12:13:55.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.621+0000 7fe4a929e640 1 -- 172.21.15.118:0/1098894270 wait complete. 2024-09-21T12:13:55.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.622+0000 7fe4a929e640 1 Processor -- start 2024-09-21T12:13:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.622+0000 7fe4a929e640 1 -- start start 2024-09-21T12:13:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.622+0000 7fe4a929e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a4102ae0 0x7fe4a4100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.622+0000 7fe4a929e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4103400 0x7fe4a4100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.622+0000 7fe4a929e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a410edf0 con 0x7fe4a4103400 2024-09-21T12:13:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.622+0000 7fe4a929e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a410ec70 con 0x7fe4a4102ae0 2024-09-21T12:13:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.622+0000 7fe4a27fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4103400 0x7fe4a4100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.622+0000 7fe4a27fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4103400 0x7fe4a4100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39992/0 (socket says 172.21.15.118:39992) 2024-09-21T12:13:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.622+0000 7fe4a27fc640 1 -- 172.21.15.118:0/1352844467 learned_addr learned my addr 172.21.15.118:0/1352844467 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:55.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe4a2ffd640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a4102ae0 0x7fe4a4100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe4a27fc640 1 -- 172.21.15.118:0/1352844467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a4102ae0 msgr2=0x7fe4a4100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe4a27fc640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a4102ae0 0x7fe4a4100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe4a27fc640 1 -- 172.21.15.118:0/1352844467 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a41011c0 con 0x7fe4a4103400 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe4a2ffd640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a4102ae0 0x7fe4a4100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe4a27fc640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4103400 0x7fe4a4100c80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe49800c8f0 tx=0x7fe49800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe48bfff640 1 -- 172.21.15.118:0/1352844467 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4980079b0 con 0x7fe4a4103400 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe48bfff640 1 -- 172.21.15.118:0/1352844467 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe498007b50 con 0x7fe4a4103400 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe48bfff640 1 -- 172.21.15.118:0/1352844467 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe498018610 con 0x7fe4a4103400 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a41014b0 con 0x7fe4a4103400 2024-09-21T12:13:55.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.623+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a41a3e00 con 0x7fe4a4103400 2024-09-21T12:13:55.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.624+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a406abe0 con 0x7fe4a4103400 2024-09-21T12:13:55.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.625+0000 7fe48bfff640 1 -- 172.21.15.118:0/1352844467 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe498007d00 con 0x7fe4a4103400 2024-09-21T12:13:55.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.625+0000 7fe48bfff640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe48c07af90 0x7fe48c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:55.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.625+0000 7fe4a2ffd640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe48c07af90 0x7fe48c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:55.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.625+0000 7fe48bfff640 1 -- 172.21.15.118:0/1352844467 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe49809e1e0 con 0x7fe4a4103400 2024-09-21T12:13:55.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.626+0000 7fe4a2ffd640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe48c07af90 0x7fe48c07d450 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe494006010 tx=0x7fe49402e9b0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:55.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.630+0000 7fe48bfff640 1 -- 172.21.15.118:0/1352844467 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe498014030 con 0x7fe4a4103400 2024-09-21T12:13:55.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.823+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe4a4106020 con 0x7fe48c07af90 2024-09-21T12:13:55.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.824+0000 7fe48bfff640 1 -- 172.21.15.118:0/1352844467 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe49402ec10 con 0x7fe48c07af90 2024-09-21T12:13:55.826 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:13:55.826 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:13:55.826 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:13:55.826 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:13:55.826 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:13:55.827 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:13:55.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe48c07af90 msgr2=0x7fe48c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe48c07af90 0x7fe48c07d450 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe494006010 tx=0x7fe49402e9b0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4103400 msgr2=0x7fe4a4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4103400 0x7fe4a4100c80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe49800c8f0 tx=0x7fe49800cdb0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 shutdown_connections 2024-09-21T12:13:55.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe48c07af90 0x7fe48c07d450 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a4103400 0x7fe4a4100c80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 --2- 172.21.15.118:0/1352844467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a4102ae0 0x7fe4a4100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 >> 172.21.15.118:0/1352844467 conn(0x7fe4a40fc520 msgr2=0x7fe4a4108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:55.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 shutdown_connections 2024-09-21T12:13:55.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.826+0000 7fe4a929e640 1 -- 172.21.15.118:0/1352844467 wait complete. 2024-09-21T12:13:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.907+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1390437221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0103480 msgr2=0x7fb8a010b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.907+0000 7fb8a5ac8640 1 --2- 172.21.15.118:0/1390437221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0103480 0x7fb8a010b970 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb894009880 tx=0x7fb89402a530 comp rx=0 tx=0).stop 2024-09-21T12:13:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.907+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1390437221 shutdown_connections 2024-09-21T12:13:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.907+0000 7fb8a5ac8640 1 --2- 172.21.15.118:0/1390437221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0103480 0x7fb8a010b970 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.907+0000 7fb8a5ac8640 1 --2- 172.21.15.118:0/1390437221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a0102b60 0x7fb8a0102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.907+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1390437221 >> 172.21.15.118:0/1390437221 conn(0x7fb8a00fc520 msgr2=0x7fb8a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.907+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1390437221 shutdown_connections 2024-09-21T12:13:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.907+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1390437221 wait complete. 2024-09-21T12:13:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.908+0000 7fb8a5ac8640 1 Processor -- start 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.908+0000 7fb8a5ac8640 1 -- start start 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.908+0000 7fb8a5ac8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0102b60 0x7fb8a01007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.908+0000 7fb8a5ac8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a0103480 0x7fb8a0100d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.908+0000 7fb8a5ac8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a010ee10 con 0x7fb8a0102b60 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.908+0000 7fb8a5ac8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a010ec90 con 0x7fb8a0103480 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.908+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0102b60 0x7fb8a01007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.908+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0102b60 0x7fb8a01007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40010/0 (socket says 172.21.15.118:40010) 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.908+0000 7fb89f7fe640 1 -- 172.21.15.118:0/1834940980 learned_addr learned my addr 172.21.15.118:0/1834940980 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb89effd640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a0103480 0x7fb8a0100d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb89f7fe640 1 -- 172.21.15.118:0/1834940980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a0103480 msgr2=0x7fb8a0100d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb89f7fe640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a0103480 0x7fb8a0100d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb89f7fe640 1 -- 172.21.15.118:0/1834940980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0101240 con 0x7fb8a0102b60 2024-09-21T12:13:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb89f7fe640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0102b60 0x7fb8a01007c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb89000c8f0 tx=0x7fb89000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb89cff9640 1 -- 172.21.15.118:0/1834940980 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8900079b0 con 0x7fb8a0102b60 2024-09-21T12:13:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb89cff9640 1 -- 172.21.15.118:0/1834940980 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8900054e0 con 0x7fb8a0102b60 2024-09-21T12:13:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a0101530 con 0x7fb8a0102b60 2024-09-21T12:13:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb89cff9640 1 -- 172.21.15.118:0/1834940980 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb890004dd0 con 0x7fb8a0102b60 2024-09-21T12:13:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.909+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a01a3e60 con 0x7fb8a0102b60 2024-09-21T12:13:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.910+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a006ab60 con 0x7fb8a0102b60 2024-09-21T12:13:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.911+0000 7fb89cff9640 1 -- 172.21.15.118:0/1834940980 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb890005020 con 0x7fb8a0102b60 2024-09-21T12:13:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.911+0000 7fb89cff9640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb88807aed0 0x7fb88807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.911+0000 7fb89cff9640 1 -- 172.21.15.118:0/1834940980 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb89009dfd0 con 0x7fb8a0102b60 2024-09-21T12:13:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.911+0000 7fb89effd640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb88807aed0 0x7fb88807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.912+0000 7fb89effd640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb88807aed0 0x7fb88807d390 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0102250 tx=0x7fb894004f30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:55.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:55.915+0000 7fb89cff9640 1 -- 172.21.15.118:0/1834940980 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb890014030 con 0x7fb8a0102b60 2024-09-21T12:13:56.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.165+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb8a0105ff0 con 0x7fb8a0102b60 2024-09-21T12:13:56.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.166+0000 7fb89cff9640 1 -- 172.21.15.118:0/1834940980 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fb890069520 con 0x7fb8a0102b60 2024-09-21T12:13:56.168 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:13:56.168 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:13:56.168 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:13:56.168 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:13:56.168 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:13:56.168 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:13:56.168 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:13:56.169 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:13:56.170 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:13:56.170 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:13:56.170 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:13:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb88807aed0 msgr2=0x7fb88807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb88807aed0 0x7fb88807d390 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0102250 tx=0x7fb894004f30 comp rx=0 tx=0).stop 2024-09-21T12:13:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0102b60 msgr2=0x7fb8a01007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0102b60 0x7fb8a01007c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb89000c8f0 tx=0x7fb89000cdb0 comp rx=0 tx=0).stop 2024-09-21T12:13:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 shutdown_connections 2024-09-21T12:13:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a0103480 0x7fb8a0100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb88807aed0 0x7fb88807d390 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 --2- 172.21.15.118:0/1834940980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a0102b60 0x7fb8a01007c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 >> 172.21.15.118:0/1834940980 conn(0x7fb8a00fc520 msgr2=0x7fb8a0103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 shutdown_connections 2024-09-21T12:13:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:13:56.168+0000 7fb8a5ac8640 1 -- 172.21.15.118:0/1834940980 wait complete. 2024-09-21T12:13:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:56 smithi149 ceph-mon[79770]: pgmap v1054: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:56.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:56 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2155667433' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:13:56.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:56 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2909774939' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:13:56.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:56 smithi149 ceph-mon[79770]: from='client.35724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:56 smithi118 ceph-mon[111738]: pgmap v1054: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:56 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2155667433' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:13:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:56 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2909774939' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:13:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:56 smithi118 ceph-mon[111738]: from='client.35724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:57.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:57 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1834940980' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:13:57.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:57 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1834940980' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:13:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:13:58 smithi149 ceph-mon[79770]: pgmap v1055: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:13:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:13:58 smithi118 ceph-mon[111738]: pgmap v1055: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:00 smithi149 ceph-mon[79770]: pgmap v1056: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:00 smithi118 ceph-mon[111738]: pgmap v1056: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:02 smithi149 ceph-mon[79770]: pgmap v1057: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:02.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:02 smithi118 ceph-mon[111738]: pgmap v1057: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:04 smithi149 ceph-mon[79770]: pgmap v1058: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:04.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:04 smithi118 ceph-mon[111738]: pgmap v1058: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:14:05.459 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:14:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:06 smithi149 ceph-mon[79770]: pgmap v1059: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:06 smithi118 ceph-mon[111738]: pgmap v1059: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:08 smithi149 ceph-mon[79770]: pgmap v1060: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:08.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:08 smithi118 ceph-mon[111738]: pgmap v1060: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:10 smithi149 ceph-mon[79770]: pgmap v1061: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:10.535 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:10 smithi118 ceph-mon[111738]: pgmap v1061: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:12 smithi149 ceph-mon[79770]: pgmap v1062: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:12.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:12 smithi118 ceph-mon[111738]: pgmap v1062: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:14 smithi149 ceph-mon[79770]: pgmap v1063: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:14.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:14 smithi118 ceph-mon[111738]: pgmap v1063: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:16 smithi149 ceph-mon[79770]: pgmap v1064: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:16 smithi118 ceph-mon[111738]: pgmap v1064: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:18.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:18 smithi118 ceph-mon[111738]: pgmap v1065: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:18 smithi149 ceph-mon[79770]: pgmap v1065: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:20 smithi118 ceph-mon[111738]: pgmap v1066: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:14:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:20 smithi149 ceph-mon[79770]: pgmap v1066: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:14:22.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:22 smithi118 ceph-mon[111738]: pgmap v1067: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:22.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:22 smithi149 ceph-mon[79770]: pgmap v1067: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:24.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:24 smithi118 ceph-mon[111738]: pgmap v1068: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:24 smithi149 ceph-mon[79770]: pgmap v1068: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:26.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.262+0000 7ff96b2d7640 1 -- 172.21.15.118:0/3836940723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9641033c0 msgr2=0x7ff96410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.262+0000 7ff96b2d7640 1 --2- 172.21.15.118:0/3836940723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9641033c0 0x7ff96410b8b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff958009880 tx=0x7ff95802a530 comp rx=0 tx=0).stop 2024-09-21T12:14:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.262+0000 7ff96b2d7640 1 -- 172.21.15.118:0/3836940723 shutdown_connections 2024-09-21T12:14:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.262+0000 7ff96b2d7640 1 --2- 172.21.15.118:0/3836940723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9641033c0 0x7ff96410b8b0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.262+0000 7ff96b2d7640 1 --2- 172.21.15.118:0/3836940723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff964102aa0 0x7ff964102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.262+0000 7ff96b2d7640 1 -- 172.21.15.118:0/3836940723 >> 172.21.15.118:0/3836940723 conn(0x7ff9640fc4c0 msgr2=0x7ff9640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.262+0000 7ff96b2d7640 1 -- 172.21.15.118:0/3836940723 shutdown_connections 2024-09-21T12:14:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.262+0000 7ff96b2d7640 1 -- 172.21.15.118:0/3836940723 wait complete. 2024-09-21T12:14:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.262+0000 7ff96b2d7640 1 Processor -- start 2024-09-21T12:14:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff96b2d7640 1 -- start start 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff96b2d7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff964102aa0 0x7ff96419f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff96b2d7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641033c0 0x7ff96419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff96b2d7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff96410ee30 con 0x7ff964102aa0 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff96b2d7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff96410ecb0 con 0x7ff9641033c0 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff969073640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff964102aa0 0x7ff96419f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff969073640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff964102aa0 0x7ff96419f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58440/0 (socket says 172.21.15.118:58440) 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff969073640 1 -- 172.21.15.118:0/2626882429 learned_addr learned my addr 172.21.15.118:0/2626882429 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff968872640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641033c0 0x7ff96419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff969073640 1 -- 172.21.15.118:0/2626882429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641033c0 msgr2=0x7ff96419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff969073640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641033c0 0x7ff96419fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff969073640 1 -- 172.21.15.118:0/2626882429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff964199ac0 con 0x7ff964102aa0 2024-09-21T12:14:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.263+0000 7ff969073640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff964102aa0 0x7ff96419f900 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff95400ba50 tx=0x7ff95400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.264+0000 7ff9627fc640 1 -- 172.21.15.118:0/2626882429 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff954019070 con 0x7ff964102aa0 2024-09-21T12:14:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.264+0000 7ff9627fc640 1 -- 172.21.15.118:0/2626882429 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff95400ce20 con 0x7ff964102aa0 2024-09-21T12:14:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.264+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff964199db0 con 0x7ff964102aa0 2024-09-21T12:14:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.264+0000 7ff9627fc640 1 -- 172.21.15.118:0/2626882429 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9540075a0 con 0x7ff964102aa0 2024-09-21T12:14:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.264+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96419a310 con 0x7ff964102aa0 2024-09-21T12:14:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.265+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96406a410 con 0x7ff964102aa0 2024-09-21T12:14:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.266+0000 7ff9627fc640 1 -- 172.21.15.118:0/2626882429 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff95401c070 con 0x7ff964102aa0 2024-09-21T12:14:26.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.266+0000 7ff9627fc640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff94c07af80 0x7ff94c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:26.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.266+0000 7ff9627fc640 1 -- 172.21.15.118:0/2626882429 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff95409d920 con 0x7ff964102aa0 2024-09-21T12:14:26.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.266+0000 7ff968872640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff94c07af80 0x7ff94c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:26.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.267+0000 7ff968872640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff94c07af80 0x7ff94c07d440 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff96419b2b0 tx=0x7ff958031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:26.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.270+0000 7ff9627fc640 1 -- 172.21.15.118:0/2626882429 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff954068ef0 con 0x7ff964102aa0 2024-09-21T12:14:26.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.465+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff96419aff0 con 0x7ff94c07af80 2024-09-21T12:14:26.467 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:26 smithi118 ceph-mon[111738]: pgmap v1069: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:26.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.466+0000 7ff9627fc640 1 -- 172.21.15.118:0/2626882429 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff96419aff0 con 0x7ff94c07af80 2024-09-21T12:14:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff94c07af80 msgr2=0x7ff94c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff94c07af80 0x7ff94c07d440 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff96419b2b0 tx=0x7ff958031400 comp rx=0 tx=0).stop 2024-09-21T12:14:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff964102aa0 msgr2=0x7ff96419f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff964102aa0 0x7ff96419f900 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff95400ba50 tx=0x7ff95400bf10 comp rx=0 tx=0).stop 2024-09-21T12:14:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 shutdown_connections 2024-09-21T12:14:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641033c0 0x7ff96419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff94c07af80 0x7ff94c07d440 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 --2- 172.21.15.118:0/2626882429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff964102aa0 0x7ff96419f900 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 >> 172.21.15.118:0/2626882429 conn(0x7ff9640fc4c0 msgr2=0x7ff964100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:26.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 shutdown_connections 2024-09-21T12:14:26.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.469+0000 7ff96b2d7640 1 -- 172.21.15.118:0/2626882429 wait complete. 2024-09-21T12:14:26.480 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:14:26.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.551+0000 7f48fe8cb640 1 -- 172.21.15.118:0/1112338533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8107930 msgr2=0x7f48f8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.551+0000 7f48fe8cb640 1 --2- 172.21.15.118:0/1112338533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8107930 0x7f48f8107d10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009880 tx=0x7f48e802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.551+0000 7f48fe8cb640 1 -- 172.21.15.118:0/1112338533 shutdown_connections 2024-09-21T12:14:26.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.551+0000 7f48fe8cb640 1 --2- 172.21.15.118:0/1112338533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48f8101930 0x7f48f8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.551+0000 7f48fe8cb640 1 --2- 172.21.15.118:0/1112338533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8107930 0x7f48f8107d10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.551+0000 7f48fe8cb640 1 -- 172.21.15.118:0/1112338533 >> 172.21.15.118:0/1112338533 conn(0x7f48f80fd630 msgr2=0x7f48f80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:26.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.552+0000 7f48fe8cb640 1 -- 172.21.15.118:0/1112338533 shutdown_connections 2024-09-21T12:14:26.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.552+0000 7f48fe8cb640 1 -- 172.21.15.118:0/1112338533 wait complete. 2024-09-21T12:14:26.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.552+0000 7f48fe8cb640 1 Processor -- start 2024-09-21T12:14:26.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.552+0000 7f48fe8cb640 1 -- start start 2024-09-21T12:14:26.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.552+0000 7f48fe8cb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8101930 0x7f48f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:26.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.552+0000 7f48fe8cb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48f8107930 0x7f48f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:26.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48fe8cb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f48f810ede0 con 0x7f48f8101930 2024-09-21T12:14:26.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48fe8cb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f48f810ec60 con 0x7f48f8107930 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8101930 0x7f48f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8101930 0x7f48f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58464/0 (socket says 172.21.15.118:58464) 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f7fff640 1 -- 172.21.15.118:0/3640442888 learned_addr learned my addr 172.21.15.118:0/3640442888 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f77fe640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48f8107930 0x7f48f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f7fff640 1 -- 172.21.15.118:0/3640442888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48f8107930 msgr2=0x7f48f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f7fff640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48f8107930 0x7f48f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f7fff640 1 -- 172.21.15.118:0/3640442888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f8074f70 con 0x7f48f8101930 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f77fe640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48f8107930 0x7f48f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f7fff640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8101930 0x7f48f80744f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f48e8031460 tx=0x7f48e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f57fa640 1 -- 172.21.15.118:0/3640442888 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f48e803f070 con 0x7f48f8101930 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f57fa640 1 -- 172.21.15.118:0/3640442888 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48e8004cf0 con 0x7f48f8101930 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48f57fa640 1 -- 172.21.15.118:0/3640442888 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f48e8035030 con 0x7f48f8101930 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f8075200 con 0x7f48f8101930 2024-09-21T12:14:26.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.553+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f81a3dd0 con 0x7f48f8101930 2024-09-21T12:14:26.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.554+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f8103070 con 0x7f48f8101930 2024-09-21T12:14:26.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.555+0000 7f48f57fa640 1 -- 172.21.15.118:0/3640442888 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f48e8042070 con 0x7f48f8101930 2024-09-21T12:14:26.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.555+0000 7f48f57fa640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f48e007af30 0x7f48e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:26.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.555+0000 7f48f57fa640 1 -- 172.21.15.118:0/3640442888 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f48e80beb70 con 0x7f48f8101930 2024-09-21T12:14:26.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.555+0000 7f48f77fe640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f48e007af30 0x7f48e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:26.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.556+0000 7f48f77fe640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f48e007af30 0x7f48e007d3f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f48f8075f80 tx=0x7f48ec005d30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:26.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.560+0000 7f48f57fa640 1 -- 172.21.15.118:0/3640442888 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48e808a0c0 con 0x7f48f8101930 2024-09-21T12:14:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:26 smithi149 ceph-mon[79770]: pgmap v1069: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:26.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.755+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f48f8062630 con 0x7f48e007af30 2024-09-21T12:14:26.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.756+0000 7f48f57fa640 1 -- 172.21.15.118:0/3640442888 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f48f8062630 con 0x7f48e007af30 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.758+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f48e007af30 msgr2=0x7f48e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.758+0000 7f48fe8cb640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f48e007af30 0x7f48e007d3f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f48f8075f80 tx=0x7f48ec005d30 comp rx=0 tx=0).stop 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.758+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8101930 msgr2=0x7f48f80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.758+0000 7f48fe8cb640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8101930 0x7f48f80744f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f48e8031460 tx=0x7f48e80048f0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.759+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 shutdown_connections 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.759+0000 7f48fe8cb640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48f8107930 0x7f48f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.759+0000 7f48fe8cb640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f48e007af30 0x7f48e007d3f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.759+0000 7f48fe8cb640 1 --2- 172.21.15.118:0/3640442888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48f8101930 0x7f48f80744f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.759+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 >> 172.21.15.118:0/3640442888 conn(0x7f48f80fd630 msgr2=0x7f48f80fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:26.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.759+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 shutdown_connections 2024-09-21T12:14:26.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.759+0000 7f48fe8cb640 1 -- 172.21.15.118:0/3640442888 wait complete. 2024-09-21T12:14:26.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.840+0000 7f0844948640 1 -- 172.21.15.118:0/386028089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840106820 msgr2=0x7f0840106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.840+0000 7f0844948640 1 --2- 172.21.15.118:0/386028089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840106820 0x7f0840106c00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0830009880 tx=0x7f083002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.840+0000 7f0844948640 1 -- 172.21.15.118:0/386028089 shutdown_connections 2024-09-21T12:14:26.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.840+0000 7f0844948640 1 --2- 172.21.15.118:0/386028089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0840100820 0x7f0840100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.840+0000 7f0844948640 1 --2- 172.21.15.118:0/386028089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840106820 0x7f0840106c00 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.840+0000 7f0844948640 1 -- 172.21.15.118:0/386028089 >> 172.21.15.118:0/386028089 conn(0x7f08400fc520 msgr2=0x7f08400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:26.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.840+0000 7f0844948640 1 -- 172.21.15.118:0/386028089 shutdown_connections 2024-09-21T12:14:26.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.840+0000 7f0844948640 1 -- 172.21.15.118:0/386028089 wait complete. 2024-09-21T12:14:26.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f0844948640 1 Processor -- start 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f0844948640 1 -- start start 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f0844948640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840100820 0x7f0840198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f0844948640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0840106820 0x7f0840198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f0844948640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f084010dcf0 con 0x7f0840100820 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f0844948640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f084010db70 con 0x7f0840106820 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f083e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840100820 0x7f0840198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f083e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840100820 0x7f0840198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58480/0 (socket says 172.21.15.118:58480) 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f083e59c640 1 -- 172.21.15.118:0/2322047583 learned_addr learned my addr 172.21.15.118:0/2322047583 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.841+0000 7f083dd9b640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0840106820 0x7f0840198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f083e59c640 1 -- 172.21.15.118:0/2322047583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0840106820 msgr2=0x7f0840198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f083e59c640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0840106820 0x7f0840198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f083e59c640 1 -- 172.21.15.118:0/2322047583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0840199380 con 0x7f0840100820 2024-09-21T12:14:26.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f083dd9b640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0840106820 0x7f0840198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:14:26.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f083e59c640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840100820 0x7f0840198840 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0830031460 tx=0x7f0830004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:26.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f082f7fe640 1 -- 172.21.15.118:0/2322047583 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f083003f070 con 0x7f0840100820 2024-09-21T12:14:26.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f082f7fe640 1 -- 172.21.15.118:0/2322047583 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08300035f0 con 0x7f0840100820 2024-09-21T12:14:26.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0840199610 con 0x7f0840100820 2024-09-21T12:14:26.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f082f7fe640 1 -- 172.21.15.118:0/2322047583 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0830035030 con 0x7f0840100820 2024-09-21T12:14:26.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.842+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08401a1bc0 con 0x7f0840100820 2024-09-21T12:14:26.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.843+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0840101f60 con 0x7f0840100820 2024-09-21T12:14:26.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.844+0000 7f082f7fe640 1 -- 172.21.15.118:0/2322047583 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0830042070 con 0x7f0840100820 2024-09-21T12:14:26.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.844+0000 7f082f7fe640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082807af30 0x7f082807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:26.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.844+0000 7f083dd9b640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082807af30 0x7f082807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:26.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.844+0000 7f082f7fe640 1 -- 172.21.15.118:0/2322047583 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f08300bea60 con 0x7f0840100820 2024-09-21T12:14:26.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.845+0000 7f083dd9b640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082807af30 0x7f082807d3f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f084006ae50 tx=0x7f0834005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:26.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:26.849+0000 7f082f7fe640 1 -- 172.21.15.118:0/2322047583 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0830089fb0 con 0x7f0840100820 2024-09-21T12:14:27.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.035+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0840062630 con 0x7f082807af30 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.044+0000 7f082f7fe640 1 -- 172.21.15.118:0/2322047583 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0840062630 con 0x7f082807af30 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (32m) 11m ago 43m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (35m) 11m ago 43m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (34m) 11m ago 42m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (30m) 11m ago 43m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (30m) 11m ago 42m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (31m) 11m ago 43m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (26m) 11m ago 37m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:14:27.047 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (26m) 11m ago 37m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (11m) 11m ago 37m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (26m) 11m ago 37m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (34m) 11m ago 44m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (33m) 11m ago 42m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (31m) 11m ago 44m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (30m) 11m ago 42m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (33m) 11m ago 43m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (33m) 11m ago 42m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (30m) 11m ago 41m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (29m) 11m ago 40m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (28m) 11m ago 40m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (28m) 11m ago 39m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (27m) 11m ago 39m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (27m) 11m ago 39m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:14:27.048 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (32m) 11m ago 42m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:14:27.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082807af30 msgr2=0x7f082807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082807af30 0x7f082807d3f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f084006ae50 tx=0x7f0834005f90 comp rx=0 tx=0).stop 2024-09-21T12:14:27.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840100820 msgr2=0x7f0840198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840100820 0x7f0840198840 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0830031460 tx=0x7f0830004530 comp rx=0 tx=0).stop 2024-09-21T12:14:27.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 shutdown_connections 2024-09-21T12:14:27.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0840106820 0x7f0840198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082807af30 0x7f082807d3f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 --2- 172.21.15.118:0/2322047583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0840100820 0x7f0840198840 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 >> 172.21.15.118:0/2322047583 conn(0x7f08400fc520 msgr2=0x7f08400fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:27.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 shutdown_connections 2024-09-21T12:14:27.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.047+0000 7f0844948640 1 -- 172.21.15.118:0/2322047583 wait complete. 2024-09-21T12:14:27.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.126+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3171658333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74106820 msgr2=0x7f7c74106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.126+0000 7f7c7b8a8640 1 --2- 172.21.15.118:0/3171658333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74106820 0x7f7c74106c00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009c20 tx=0x7f7c6c02a970 comp rx=0 tx=0).stop 2024-09-21T12:14:27.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.126+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3171658333 shutdown_connections 2024-09-21T12:14:27.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.126+0000 7f7c7b8a8640 1 --2- 172.21.15.118:0/3171658333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c74100820 0x7f7c74100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.126+0000 7f7c7b8a8640 1 --2- 172.21.15.118:0/3171658333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74106820 0x7f7c74106c00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.126+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3171658333 >> 172.21.15.118:0/3171658333 conn(0x7f7c740fc520 msgr2=0x7f7c740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:27.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.126+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3171658333 shutdown_connections 2024-09-21T12:14:27.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.126+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3171658333 wait complete. 2024-09-21T12:14:27.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c7b8a8640 1 Processor -- start 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c7b8a8640 1 -- start start 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c7b8a8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74100820 0x7f7c7419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c7b8a8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c74106820 0x7f7c7419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c7b8a8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7410cc00 con 0x7f7c74100820 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c7b8a8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7410ca80 con 0x7f7c74106820 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c79644640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74100820 0x7f7c7419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c79644640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74100820 0x7f7c7419f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58500/0 (socket says 172.21.15.118:58500) 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c79644640 1 -- 172.21.15.118:0/3571490606 learned_addr learned my addr 172.21.15.118:0/3571490606 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c78e43640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c74106820 0x7f7c7419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c79644640 1 -- 172.21.15.118:0/3571490606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c74106820 msgr2=0x7f7c7419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c79644640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c74106820 0x7f7c7419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c79644640 1 -- 172.21.15.118:0/3571490606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c74199a20 con 0x7f7c74100820 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.127+0000 7f7c78e43640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c74106820 0x7f7c7419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.128+0000 7f7c79644640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74100820 0x7f7c7419f860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c005cc0 tx=0x7f7c6c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.128+0000 7f7c6a7fc640 1 -- 172.21.15.118:0/3571490606 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c6c047070 con 0x7f7c74100820 2024-09-21T12:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.128+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c74199cb0 con 0x7f7c74100820 2024-09-21T12:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.128+0000 7f7c6a7fc640 1 -- 172.21.15.118:0/3571490606 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c6c02f7e0 con 0x7f7c74100820 2024-09-21T12:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.128+0000 7f7c6a7fc640 1 -- 172.21.15.118:0/3571490606 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c6c034070 con 0x7f7c74100820 2024-09-21T12:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.128+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7419a1e0 con 0x7f7c74100820 2024-09-21T12:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.129+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c74101f60 con 0x7f7c74100820 2024-09-21T12:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.129+0000 7f7c6a7fc640 1 -- 172.21.15.118:0/3571490606 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7c6c04a070 con 0x7f7c74100820 2024-09-21T12:14:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.130+0000 7f7c6a7fc640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6007af30 0x7f7c6007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.130+0000 7f7c78e43640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6007af30 0x7f7c6007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.130+0000 7f7c6a7fc640 1 -- 172.21.15.118:0/3571490606 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7c6c0bef90 con 0x7f7c74100820 2024-09-21T12:14:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.130+0000 7f7c78e43640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6007af30 0x7f7c6007d3f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7c740feb80 tx=0x7f7c64005d30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:27.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.134+0000 7f7c6a7fc640 1 -- 172.21.15.118:0/3571490606 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c6c03f070 con 0x7f7c74100820 2024-09-21T12:14:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:27 smithi118 ceph-mon[111738]: from='client.35732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:27.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:27 smithi118 ceph-mon[111738]: from='client.35736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:27.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.384+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7c7419af50 con 0x7f7c74100820 2024-09-21T12:14:27.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.384+0000 7f7c6a7fc640 1 -- 172.21.15.118:0/3571490606 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7c6c08a4e0 con 0x7f7c74100820 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:14:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:14:27.388 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:14:27.388 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:14:27.388 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:14:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.386+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6007af30 msgr2=0x7f7c6007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.386+0000 7f7c7b8a8640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6007af30 0x7f7c6007d3f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7c740feb80 tx=0x7f7c64005d30 comp rx=0 tx=0).stop 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.386+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74100820 msgr2=0x7f7c7419f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.386+0000 7f7c7b8a8640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74100820 0x7f7c7419f860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c005cc0 tx=0x7f7c6c02f5f0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.386+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 shutdown_connections 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.386+0000 7f7c7b8a8640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c74106820 0x7f7c7419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.386+0000 7f7c7b8a8640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f7c6007af30 0x7f7c6007d3f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.386+0000 7f7c7b8a8640 1 --2- 172.21.15.118:0/3571490606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c74100820 0x7f7c7419f860 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.386+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 >> 172.21.15.118:0/3571490606 conn(0x7f7c740fc520 msgr2=0x7f7c740fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.387+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 shutdown_connections 2024-09-21T12:14:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.387+0000 7f7c7b8a8640 1 -- 172.21.15.118:0/3571490606 wait complete. 2024-09-21T12:14:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.467+0000 7f5a3d16e640 1 -- 172.21.15.118:0/1615316776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381007e0 msgr2=0x7f5a38100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.467+0000 7f5a3d16e640 1 --2- 172.21.15.118:0/1615316776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381007e0 0x7f5a38100c40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009880 tx=0x7f5a2002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.467+0000 7f5a3d16e640 1 -- 172.21.15.118:0/1615316776 shutdown_connections 2024-09-21T12:14:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.467+0000 7f5a3d16e640 1 --2- 172.21.15.118:0/1615316776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381007e0 0x7f5a38100c40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.467+0000 7f5a3d16e640 1 --2- 172.21.15.118:0/1615316776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a381067e0 0x7f5a38106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.467+0000 7f5a3d16e640 1 -- 172.21.15.118:0/1615316776 >> 172.21.15.118:0/1615316776 conn(0x7f5a380fc4c0 msgr2=0x7f5a380fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.467+0000 7f5a3d16e640 1 -- 172.21.15.118:0/1615316776 shutdown_connections 2024-09-21T12:14:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.467+0000 7f5a3d16e640 1 -- 172.21.15.118:0/1615316776 wait complete. 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.468+0000 7f5a3d16e640 1 Processor -- start 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.468+0000 7f5a3d16e640 1 -- start start 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3d16e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a381007e0 0x7f5a381965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3d16e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381067e0 0x7f5a38196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3d16e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3810dcb0 con 0x7f5a381067e0 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3d16e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3810db30 con 0x7f5a381007e0 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381067e0 0x7f5a38196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381067e0 0x7f5a38196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58514/0 (socket says 172.21.15.118:58514) 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3659c640 1 -- 172.21.15.118:0/3050434154 learned_addr learned my addr 172.21.15.118:0/3050434154 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3659c640 1 -- 172.21.15.118:0/3050434154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a381007e0 msgr2=0x7f5a381965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a36d9d640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a381007e0 0x7f5a381965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3659c640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a381007e0 0x7f5a381965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3659c640 1 -- 172.21.15.118:0/3050434154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a38197050 con 0x7f5a381067e0 2024-09-21T12:14:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3659c640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381067e0 0x7f5a38196b10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5a20031460 tx=0x7f5a200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a2ffff640 1 -- 172.21.15.118:0/3050434154 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a2003f070 con 0x7f5a381067e0 2024-09-21T12:14:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a2ffff640 1 -- 172.21.15.118:0/3050434154 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a200035f0 con 0x7f5a381067e0 2024-09-21T12:14:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a381972e0 con 0x7f5a381067e0 2024-09-21T12:14:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a2ffff640 1 -- 172.21.15.118:0/3050434154 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a20035030 con 0x7f5a381067e0 2024-09-21T12:14:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.469+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a381a3e10 con 0x7f5a381067e0 2024-09-21T12:14:27.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.470+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a38101f20 con 0x7f5a381067e0 2024-09-21T12:14:27.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.471+0000 7f5a2ffff640 1 -- 172.21.15.118:0/3050434154 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5a20042070 con 0x7f5a381067e0 2024-09-21T12:14:27.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.472+0000 7f5a2ffff640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a2407af30 0x7f5a2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:27.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.472+0000 7f5a2ffff640 1 -- 172.21.15.118:0/3050434154 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5a200bead0 con 0x7f5a381067e0 2024-09-21T12:14:27.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.472+0000 7f5a36d9d640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a2407af30 0x7f5a2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:27.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.472+0000 7f5a36d9d640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a2407af30 0x7f5a2407d3f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005c40 tx=0x7f5a28005bd0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:27.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.476+0000 7f5a2ffff640 1 -- 172.21.15.118:0/3050434154 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a2008a020 con 0x7f5a381067e0 2024-09-21T12:14:27.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.689+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5a38108d50 con 0x7f5a381067e0 2024-09-21T12:14:27.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.690+0000 7f5a2ffff640 1 -- 172.21.15.118:0/3050434154 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f5a200be7e0 con 0x7f5a381067e0 2024-09-21T12:14:27.692 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:14:27.692 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:14:27.692 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:14:27.692 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:14:27.692 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:14:27.693 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:14:27.694 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:14:27.695 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:14:27.696 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:14:27.696 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:14:27.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a2407af30 msgr2=0x7f5a2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a2407af30 0x7f5a2407d3f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005c40 tx=0x7f5a28005bd0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381067e0 msgr2=0x7f5a38196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381067e0 0x7f5a38196b10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5a20031460 tx=0x7f5a200045e0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 shutdown_connections 2024-09-21T12:14:27.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f5a2407af30 0x7f5a2407d3f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a381067e0 0x7f5a38196b10 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 --2- 172.21.15.118:0/3050434154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a381007e0 0x7f5a381965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 >> 172.21.15.118:0/3050434154 conn(0x7f5a380fc4c0 msgr2=0x7f5a380fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:27.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 shutdown_connections 2024-09-21T12:14:27.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.692+0000 7f5a3d16e640 1 -- 172.21.15.118:0/3050434154 wait complete. 2024-09-21T12:14:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:27 smithi149 ceph-mon[79770]: from='client.35732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:27.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:27 smithi149 ceph-mon[79770]: from='client.35736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:27.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.776+0000 7f9690a27640 1 -- 172.21.15.118:0/1184938201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 msgr2=0x7f968c100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.776+0000 7f9690a27640 1 --2- 172.21.15.118:0/1184938201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 0x7f968c100c70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9680009880 tx=0x7f968002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.776+0000 7f9690a27640 1 -- 172.21.15.118:0/1184938201 shutdown_connections 2024-09-21T12:14:27.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.776+0000 7f9690a27640 1 --2- 172.21.15.118:0/1184938201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 0x7f968c100c70 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.776+0000 7f9690a27640 1 --2- 172.21.15.118:0/1184938201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f968c106810 0x7f968c106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.776+0000 7f9690a27640 1 -- 172.21.15.118:0/1184938201 >> 172.21.15.118:0/1184938201 conn(0x7f968c0fc510 msgr2=0x7f968c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:27.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.776+0000 7f9690a27640 1 -- 172.21.15.118:0/1184938201 shutdown_connections 2024-09-21T12:14:27.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.776+0000 7f9690a27640 1 -- 172.21.15.118:0/1184938201 wait complete. 2024-09-21T12:14:27.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.777+0000 7f9690a27640 1 Processor -- start 2024-09-21T12:14:27.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.777+0000 7f9690a27640 1 -- start start 2024-09-21T12:14:27.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.777+0000 7f9690a27640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 0x7f968c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:27.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.777+0000 7f9690a27640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f968c106810 0x7f968c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:27.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.777+0000 7f9690a27640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f968c10dce0 con 0x7f968c100810 2024-09-21T12:14:27.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.777+0000 7f9690a27640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f968c10db60 con 0x7f968c106810 2024-09-21T12:14:27.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.777+0000 7f968a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 0x7f968c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:27.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.777+0000 7f968a59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 0x7f968c198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58538/0 (socket says 172.21.15.118:58538) 2024-09-21T12:14:27.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.777+0000 7f968a59c640 1 -- 172.21.15.118:0/1891916088 learned_addr learned my addr 172.21.15.118:0/1891916088 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:27.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f9689d9b640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f968c106810 0x7f968c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:27.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f968a59c640 1 -- 172.21.15.118:0/1891916088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f968c106810 msgr2=0x7f968c198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f968a59c640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f968c106810 0x7f968c198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f968a59c640 1 -- 172.21.15.118:0/1891916088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c199370 con 0x7f968c100810 2024-09-21T12:14:27.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f968a59c640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 0x7f968c198830 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e970 tx=0x7f967c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:27.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f967b7fe640 1 -- 172.21.15.118:0/1891916088 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f967c00cac0 con 0x7f968c100810 2024-09-21T12:14:27.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c199660 con 0x7f968c100810 2024-09-21T12:14:27.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f967b7fe640 1 -- 172.21.15.118:0/1891916088 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f967c0054e0 con 0x7f968c100810 2024-09-21T12:14:27.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f967b7fe640 1 -- 172.21.15.118:0/1891916088 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f967c010430 con 0x7f968c100810 2024-09-21T12:14:27.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.778+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c1a1c60 con 0x7f968c100810 2024-09-21T12:14:27.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.779+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c101f50 con 0x7f968c100810 2024-09-21T12:14:27.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.780+0000 7f967b7fe640 1 -- 172.21.15.118:0/1891916088 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f967c004f00 con 0x7f968c100810 2024-09-21T12:14:27.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.780+0000 7f967b7fe640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f967407af80 0x7f967407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:27.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.781+0000 7f967b7fe640 1 -- 172.21.15.118:0/1891916088 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f967c09e700 con 0x7f968c100810 2024-09-21T12:14:27.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.781+0000 7f9689d9b640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f967407af80 0x7f967407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:27.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.781+0000 7f9689d9b640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f967407af80 0x7f967407d440 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f968c06ae50 tx=0x7f9680031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:27.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.785+0000 7f967b7fe640 1 -- 172.21.15.118:0/1891916088 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f968c199660 con 0x7f968c100810 2024-09-21T12:14:27.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.981+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f968c108df0 con 0x7f967407af80 2024-09-21T12:14:27.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.982+0000 7f967b7fe640 1 -- 172.21.15.118:0/1891916088 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9680004340 con 0x7f967407af80 2024-09-21T12:14:27.985 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:14:27.985 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:14:27.985 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:14:27.985 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:14:27.985 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:14:27.986 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:14:27.986 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:14:27.986 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:14:27.986 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:14:27.986 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:14:27.986 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:14:27.986 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:14:27.987 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:14:27.987 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:14:27.987 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:14:27.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f967407af80 msgr2=0x7f967407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f967407af80 0x7f967407d440 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f968c06ae50 tx=0x7f9680031400 comp rx=0 tx=0).stop 2024-09-21T12:14:27.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 msgr2=0x7f968c198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:27.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 0x7f968c198830 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e970 tx=0x7f967c00ed70 comp rx=0 tx=0).stop 2024-09-21T12:14:27.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 shutdown_connections 2024-09-21T12:14:27.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f968c106810 0x7f968c198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f967407af80 0x7f967407d440 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 --2- 172.21.15.118:0/1891916088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f968c100810 0x7f968c198830 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:27.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 >> 172.21.15.118:0/1891916088 conn(0x7f968c0fc510 msgr2=0x7f968c0fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:27.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 shutdown_connections 2024-09-21T12:14:27.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:27.985+0000 7f9690a27640 1 -- 172.21.15.118:0/1891916088 wait complete. 2024-09-21T12:14:28.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.067+0000 7f24a6e0b640 1 -- 172.21.15.118:0/887341454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0100820 msgr2=0x7f24a0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:28.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.067+0000 7f24a6e0b640 1 --2- 172.21.15.118:0/887341454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0100820 0x7f24a0100c80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f248c009880 tx=0x7f248c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.067+0000 7f24a6e0b640 1 -- 172.21.15.118:0/887341454 shutdown_connections 2024-09-21T12:14:28.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.067+0000 7f24a6e0b640 1 --2- 172.21.15.118:0/887341454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0100820 0x7f24a0100c80 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.067+0000 7f24a6e0b640 1 --2- 172.21.15.118:0/887341454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a0106820 0x7f24a0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.067+0000 7f24a6e0b640 1 -- 172.21.15.118:0/887341454 >> 172.21.15.118:0/887341454 conn(0x7f24a00fc520 msgr2=0x7f24a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:28.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.067+0000 7f24a6e0b640 1 -- 172.21.15.118:0/887341454 shutdown_connections 2024-09-21T12:14:28.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.067+0000 7f24a6e0b640 1 -- 172.21.15.118:0/887341454 wait complete. 2024-09-21T12:14:28.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.067+0000 7f24a6e0b640 1 Processor -- start 2024-09-21T12:14:28.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f24a6e0b640 1 -- start start 2024-09-21T12:14:28.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f24a6e0b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a0100820 0x7f24a019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:28.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f24a6e0b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0106820 0x7f24a019cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:28.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f24a6e0b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f24a010dcf0 con 0x7f24a0106820 2024-09-21T12:14:28.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f24a6e0b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24a010db70 con 0x7f24a0100820 2024-09-21T12:14:28.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f249ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0106820 0x7f24a019cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:28.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f249ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0106820 0x7f24a019cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58550/0 (socket says 172.21.15.118:58550) 2024-09-21T12:14:28.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f249ffff640 1 -- 172.21.15.118:0/1959792343 learned_addr learned my addr 172.21.15.118:0/1959792343 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:28.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f24a4ba7640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a0100820 0x7f24a019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:28.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f249ffff640 1 -- 172.21.15.118:0/1959792343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a0100820 msgr2=0x7f24a019c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:28.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f249ffff640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a0100820 0x7f24a019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f249ffff640 1 -- 172.21.15.118:0/1959792343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a01966c0 con 0x7f24a0106820 2024-09-21T12:14:28.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f249ffff640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0106820 0x7f24a019cb30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f248c031460 tx=0x7f248c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:28.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.068+0000 7f249dffb640 1 -- 172.21.15.118:0/1959792343 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f248c03f070 con 0x7f24a0106820 2024-09-21T12:14:28.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.069+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a0196950 con 0x7f24a0106820 2024-09-21T12:14:28.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.069+0000 7f249dffb640 1 -- 172.21.15.118:0/1959792343 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f248c004cf0 con 0x7f24a0106820 2024-09-21T12:14:28.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.069+0000 7f249dffb640 1 -- 172.21.15.118:0/1959792343 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f248c035030 con 0x7f24a0106820 2024-09-21T12:14:28.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.069+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a0196e50 con 0x7f24a0106820 2024-09-21T12:14:28.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.070+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a0101f60 con 0x7f24a0106820 2024-09-21T12:14:28.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.070+0000 7f249dffb640 1 -- 172.21.15.118:0/1959792343 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f248c042070 con 0x7f24a0106820 2024-09-21T12:14:28.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.071+0000 7f249dffb640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f249007af30 0x7f249007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:28.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.071+0000 7f249dffb640 1 -- 172.21.15.118:0/1959792343 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f248c0bebd0 con 0x7f24a0106820 2024-09-21T12:14:28.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.071+0000 7f24a4ba7640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f249007af30 0x7f249007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:28.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.071+0000 7f24a4ba7640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f249007af30 0x7f249007d3f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f24940058c0 tx=0x7f2494005c60 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:28.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.075+0000 7f249dffb640 1 -- 172.21.15.118:0/1959792343 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f248c08a0c0 con 0x7f24a0106820 2024-09-21T12:14:28.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.320+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f24a0108d90 con 0x7f24a0106820 2024-09-21T12:14:28.323 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:28 smithi118 ceph-mon[111738]: from='client.35740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:28.323 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:28 smithi118 ceph-mon[111738]: pgmap v1070: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:28.323 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:28 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3571490606' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:14:28.323 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:28 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3050434154' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:14:28.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.320+0000 7f249dffb640 1 -- 172.21.15.118:0/1959792343 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f248c08ef70 con 0x7f24a0106820 2024-09-21T12:14:28.324 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:14:28.324 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:14:28.324 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:14:28.324 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:14:28.324 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:14:28.325 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:14:28.325 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:14:28.325 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:14:28.325 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:14:28.325 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:14:28.325 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:14:28.325 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:14:28.325 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:14:28.325 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:14:28.326 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:14:28.326 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:14:28.326 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:14:28.326 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:14:28.326 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:14:28.326 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:14:28.326 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:14:28.326 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:14:28.326 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:14:28.327 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:14:28.327 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:14:28.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f249007af30 msgr2=0x7f249007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:28.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f249007af30 0x7f249007d3f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f24940058c0 tx=0x7f2494005c60 comp rx=0 tx=0).stop 2024-09-21T12:14:28.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0106820 msgr2=0x7f24a019cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:28.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0106820 0x7f24a019cb30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f248c031460 tx=0x7f248c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 shutdown_connections 2024-09-21T12:14:28.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f249007af30 0x7f249007d3f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24a0106820 0x7f24a019cb30 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 --2- 172.21.15.118:0/1959792343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a0100820 0x7f24a019c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 >> 172.21.15.118:0/1959792343 conn(0x7f24a00fc520 msgr2=0x7f24a00fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:28.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 shutdown_connections 2024-09-21T12:14:28.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:28.323+0000 7f24a6e0b640 1 -- 172.21.15.118:0/1959792343 wait complete. 2024-09-21T12:14:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:28 smithi149 ceph-mon[79770]: from='client.35740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:28 smithi149 ceph-mon[79770]: pgmap v1070: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:28.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:28 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3571490606' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:14:28.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:28 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3050434154' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:14:29.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:29 smithi118 ceph-mon[111738]: from='client.35752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:29.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:29 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1959792343' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:14:29.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:29 smithi149 ceph-mon[79770]: from='client.35752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:29.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:29 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1959792343' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:14:30.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:30 smithi118 ceph-mon[111738]: pgmap v1071: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:30.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:30 smithi149 ceph-mon[79770]: pgmap v1071: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:32 smithi118 ceph-mon[111738]: pgmap v1072: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:32.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:32 smithi149 ceph-mon[79770]: pgmap v1072: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:34.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:34 smithi118 ceph-mon[111738]: pgmap v1073: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:34.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:34 smithi149 ceph-mon[79770]: pgmap v1073: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:35.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:14:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:14:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:36 smithi118 ceph-mon[111738]: pgmap v1074: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:36.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:36 smithi149 ceph-mon[79770]: pgmap v1074: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:38.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:38 smithi118 ceph-mon[111738]: pgmap v1075: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:38.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:38 smithi149 ceph-mon[79770]: pgmap v1075: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:40.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:40 smithi118 ceph-mon[111738]: pgmap v1076: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:40 smithi149 ceph-mon[79770]: pgmap v1076: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:42 smithi149 ceph-mon[79770]: pgmap v1077: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:42.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:42 smithi118 ceph-mon[111738]: pgmap v1077: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:44.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:44 smithi118 ceph-mon[111738]: pgmap v1078: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:44.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:44 smithi149 ceph-mon[79770]: pgmap v1078: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:46.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:46 smithi118 ceph-mon[111738]: pgmap v1079: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:46.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:46 smithi149 ceph-mon[79770]: pgmap v1079: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:48 smithi118 ceph-mon[111738]: pgmap v1080: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:48.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:48 smithi149 ceph-mon[79770]: pgmap v1080: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:50 smithi118 ceph-mon[111738]: pgmap v1081: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:14:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:50 smithi149 ceph-mon[79770]: pgmap v1081: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:14:52.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:52 smithi149 ceph-mon[79770]: pgmap v1082: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:52.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:52 smithi118 ceph-mon[111738]: pgmap v1082: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:54.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:54 smithi118 ceph-mon[111738]: pgmap v1083: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:54.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:54 smithi149 ceph-mon[79770]: pgmap v1083: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:56 smithi118 ceph-mon[111738]: pgmap v1084: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:56.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:56 smithi149 ceph-mon[79770]: pgmap v1084: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:58.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.417+0000 7f82b3549640 1 -- 172.21.15.118:0/3920044798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 msgr2=0x7f82ac1056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.417+0000 7f82b3549640 1 --2- 172.21.15.118:0/3920044798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 0x7f82ac1056c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009880 tx=0x7f82a002a530 comp rx=0 tx=0).stop 2024-09-21T12:14:58.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.418+0000 7f82b3549640 1 -- 172.21.15.118:0/3920044798 shutdown_connections 2024-09-21T12:14:58.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.418+0000 7f82b3549640 1 --2- 172.21.15.118:0/3920044798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 0x7f82ac1056c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.418+0000 7f82b3549640 1 --2- 172.21.15.118:0/3920044798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82ac1008d0 0x7f82ac100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.418+0000 7f82b3549640 1 -- 172.21.15.118:0/3920044798 >> 172.21.15.118:0/3920044798 conn(0x7f82ac0fc520 msgr2=0x7f82ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:58.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.418+0000 7f82b3549640 1 -- 172.21.15.118:0/3920044798 shutdown_connections 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.418+0000 7f82b3549640 1 -- 172.21.15.118:0/3920044798 wait complete. 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.418+0000 7f82b3549640 1 Processor -- start 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.418+0000 7f82b3549640 1 -- start start 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b3549640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82ac1008d0 0x7f82ac19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b3549640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 0x7f82ac19e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b3549640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac115410 con 0x7f82ac1011f0 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b3549640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac115290 con 0x7f82ac1008d0 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b0ae4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 0x7f82ac19e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b0ae4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 0x7f82ac19e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39194/0 (socket says 172.21.15.118:39194) 2024-09-21T12:14:58.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b0ae4640 1 -- 172.21.15.118:0/1169283539 learned_addr learned my addr 172.21.15.118:0/1169283539 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b12e5640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82ac1008d0 0x7f82ac19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b0ae4640 1 -- 172.21.15.118:0/1169283539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82ac1008d0 msgr2=0x7f82ac19e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b0ae4640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82ac1008d0 0x7f82ac19e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b0ae4640 1 -- 172.21.15.118:0/1169283539 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac1a28e0 con 0x7f82ac1011f0 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b0ae4640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 0x7f82ac19e550 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f82a0031460 tx=0x7f82a0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f829e7fc640 1 -- 172.21.15.118:0/1169283539 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82a003f070 con 0x7f82ac1011f0 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f829e7fc640 1 -- 172.21.15.118:0/1169283539 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82a00035f0 con 0x7f82ac1011f0 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ac1a2b70 con 0x7f82ac1011f0 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.419+0000 7f829e7fc640 1 -- 172.21.15.118:0/1169283539 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82a0035030 con 0x7f82ac1011f0 2024-09-21T12:14:58.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.420+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ac1a30a0 con 0x7f82ac1011f0 2024-09-21T12:14:58.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.421+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ac06abe0 con 0x7f82ac1011f0 2024-09-21T12:14:58.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.421+0000 7f829e7fc640 1 -- 172.21.15.118:0/1169283539 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f82a0042070 con 0x7f82ac1011f0 2024-09-21T12:14:58.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.422+0000 7f829e7fc640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f829807af30 0x7f829807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:58.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.422+0000 7f829e7fc640 1 -- 172.21.15.118:0/1169283539 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f82a00be9b0 con 0x7f82ac1011f0 2024-09-21T12:14:58.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.422+0000 7f82b12e5640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f829807af30 0x7f829807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:58.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.422+0000 7f82b12e5640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f829807af30 0x7f829807d3f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005fd0 tx=0x7f82a800b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:58.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.426+0000 7f829e7fc640 1 -- 172.21.15.118:0/1169283539 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82a0089f00 con 0x7f82ac1011f0 2024-09-21T12:14:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:58 smithi118 ceph-mon[111738]: pgmap v1085: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:58.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.621+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f82ac1a3350 con 0x7f829807af30 2024-09-21T12:14:58.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.623+0000 7f829e7fc640 1 -- 172.21.15.118:0/1169283539 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f82ac1a3350 con 0x7f829807af30 2024-09-21T12:14:58.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f829807af30 msgr2=0x7f829807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f829807af30 0x7f829807d3f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005fd0 tx=0x7f82a800b390 comp rx=0 tx=0).stop 2024-09-21T12:14:58.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 msgr2=0x7f82ac19e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 0x7f82ac19e550 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f82a0031460 tx=0x7f82a0004530 comp rx=0 tx=0).stop 2024-09-21T12:14:58.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 shutdown_connections 2024-09-21T12:14:58.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f829807af30 0x7f829807d3f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac1011f0 0x7f82ac19e550 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 --2- 172.21.15.118:0/1169283539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82ac1008d0 0x7f82ac19e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 >> 172.21.15.118:0/1169283539 conn(0x7f82ac0fc520 msgr2=0x7f82ac112c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:58.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 shutdown_connections 2024-09-21T12:14:58.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.625+0000 7f82b3549640 1 -- 172.21.15.118:0/1169283539 wait complete. 2024-09-21T12:14:58.635 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:14:58.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:58 smithi149 ceph-mon[79770]: pgmap v1085: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:14:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.706+0000 7f446a869640 1 -- 172.21.15.118:0/2438647273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 msgr2=0x7f446410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.706+0000 7f446a869640 1 --2- 172.21.15.118:0/2438647273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 0x7f446410b8b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4458009880 tx=0x7f445802a530 comp rx=0 tx=0).stop 2024-09-21T12:14:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.706+0000 7f446a869640 1 -- 172.21.15.118:0/2438647273 shutdown_connections 2024-09-21T12:14:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.706+0000 7f446a869640 1 --2- 172.21.15.118:0/2438647273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 0x7f446410b8b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.706+0000 7f446a869640 1 --2- 172.21.15.118:0/2438647273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4464102aa0 0x7f4464102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.707+0000 7f446a869640 1 -- 172.21.15.118:0/2438647273 >> 172.21.15.118:0/2438647273 conn(0x7f44640fc4c0 msgr2=0x7f44640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.707+0000 7f446a869640 1 -- 172.21.15.118:0/2438647273 shutdown_connections 2024-09-21T12:14:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.707+0000 7f446a869640 1 -- 172.21.15.118:0/2438647273 wait complete. 2024-09-21T12:14:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.707+0000 7f446a869640 1 Processor -- start 2024-09-21T12:14:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.707+0000 7f446a869640 1 -- start start 2024-09-21T12:14:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.707+0000 7f446a869640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4464102aa0 0x7f446419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.707+0000 7f446a869640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 0x7f446419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.707+0000 7f446a869640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f446410edd0 con 0x7f44641033c0 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.707+0000 7f446a869640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f446410ec50 con 0x7f4464102aa0 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44637fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 0x7f446419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44637fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 0x7f446419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39204/0 (socket says 172.21.15.118:39204) 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44637fe640 1 -- 172.21.15.118:0/289167805 learned_addr learned my addr 172.21.15.118:0/289167805 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f4463fff640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4464102aa0 0x7f446419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44637fe640 1 -- 172.21.15.118:0/289167805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4464102aa0 msgr2=0x7f446419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44637fe640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4464102aa0 0x7f446419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44637fe640 1 -- 172.21.15.118:0/289167805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4464197860 con 0x7f44641033c0 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f4463fff640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4464102aa0 0x7f446419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44637fe640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 0x7f446419dbe0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4458031460 tx=0x7f44580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44617fa640 1 -- 172.21.15.118:0/289167805 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f445803f070 con 0x7f44641033c0 2024-09-21T12:14:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4464197af0 con 0x7f44641033c0 2024-09-21T12:14:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44617fa640 1 -- 172.21.15.118:0/289167805 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4458004ac0 con 0x7f44641033c0 2024-09-21T12:14:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f44617fa640 1 -- 172.21.15.118:0/289167805 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4458035030 con 0x7f44641033c0 2024-09-21T12:14:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.708+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4464198020 con 0x7f44641033c0 2024-09-21T12:14:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.710+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446406a410 con 0x7f44641033c0 2024-09-21T12:14:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.710+0000 7f44617fa640 1 -- 172.21.15.118:0/289167805 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4458042070 con 0x7f44641033c0 2024-09-21T12:14:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.711+0000 7f44617fa640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f444c07af30 0x7f444c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.711+0000 7f44617fa640 1 -- 172.21.15.118:0/289167805 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f44580be750 con 0x7f44641033c0 2024-09-21T12:14:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.711+0000 7f4463fff640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f444c07af30 0x7f444c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.711+0000 7f4463fff640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f444c07af30 0x7f444c07d3f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f44540058c0 tx=0x7f4454005d50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:58.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.715+0000 7f44617fa640 1 -- 172.21.15.118:0/289167805 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4458089ca0 con 0x7f44641033c0 2024-09-21T12:14:58.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.909+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4464198d90 con 0x7f444c07af30 2024-09-21T12:14:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.911+0000 7f44617fa640 1 -- 172.21.15.118:0/289167805 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4464198d90 con 0x7f444c07af30 2024-09-21T12:14:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f444c07af30 msgr2=0x7f444c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f444c07af30 0x7f444c07d3f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f44540058c0 tx=0x7f4454005d50 comp rx=0 tx=0).stop 2024-09-21T12:14:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 msgr2=0x7f446419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 0x7f446419dbe0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4458031460 tx=0x7f44580046c0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 shutdown_connections 2024-09-21T12:14:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f444c07af30 0x7f444c07d3f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44641033c0 0x7f446419dbe0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 --2- 172.21.15.118:0/289167805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4464102aa0 0x7f446419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 >> 172.21.15.118:0/289167805 conn(0x7f44640fc4c0 msgr2=0x7f4464107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 shutdown_connections 2024-09-21T12:14:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.913+0000 7f446a869640 1 -- 172.21.15.118:0/289167805 wait complete. 2024-09-21T12:14:58.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 -- 172.21.15.118:0/1285363659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c101930 msgr2=0x7fa11c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 --2- 172.21.15.118:0/1285363659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c101930 0x7fa11c101d90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009880 tx=0x7fa10c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 -- 172.21.15.118:0/1285363659 shutdown_connections 2024-09-21T12:14:58.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 --2- 172.21.15.118:0/1285363659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c101930 0x7fa11c101d90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 --2- 172.21.15.118:0/1285363659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa11c107930 0x7fa11c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 -- 172.21.15.118:0/1285363659 >> 172.21.15.118:0/1285363659 conn(0x7fa11c0fd630 msgr2=0x7fa11c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:58.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 -- 172.21.15.118:0/1285363659 shutdown_connections 2024-09-21T12:14:58.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 -- 172.21.15.118:0/1285363659 wait complete. 2024-09-21T12:14:58.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 Processor -- start 2024-09-21T12:14:58.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.995+0000 7fa123cb0640 1 -- start start 2024-09-21T12:14:58.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa123cb0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa11c101930 0x7fa11c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:58.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa123cb0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c107930 0x7fa11c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa123cb0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c10ee00 con 0x7fa11c107930 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa123cb0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c10ec80 con 0x7fa11c101930 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa12124b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c107930 0x7fa11c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa12124b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c107930 0x7fa11c19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39222/0 (socket says 172.21.15.118:39222) 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa12124b640 1 -- 172.21.15.118:0/1924218195 learned_addr learned my addr 172.21.15.118:0/1924218195 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa121a4c640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa11c101930 0x7fa11c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa12124b640 1 -- 172.21.15.118:0/1924218195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa11c101930 msgr2=0x7fa11c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa12124b640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa11c101930 0x7fa11c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa12124b640 1 -- 172.21.15.118:0/1924218195 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c197810 con 0x7fa11c107930 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa12124b640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c107930 0x7fa11c19dbd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa10c031460 tx=0x7fa10c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa112ffd640 1 -- 172.21.15.118:0/1924218195 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa10c03f070 con 0x7fa11c107930 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa112ffd640 1 -- 172.21.15.118:0/1924218195 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa10c0044d0 con 0x7fa11c107930 2024-09-21T12:14:58.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11c197aa0 con 0x7fa11c107930 2024-09-21T12:14:59.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa112ffd640 1 -- 172.21.15.118:0/1924218195 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa10c035030 con 0x7fa11c107930 2024-09-21T12:14:59.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.996+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11c197fd0 con 0x7fa11c107930 2024-09-21T12:14:59.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.998+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11c103070 con 0x7fa11c107930 2024-09-21T12:14:59.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.998+0000 7fa112ffd640 1 -- 172.21.15.118:0/1924218195 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa10c042070 con 0x7fa11c107930 2024-09-21T12:14:59.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.999+0000 7fa112ffd640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa10807af40 0x7fa10807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.999+0000 7fa112ffd640 1 -- 172.21.15.118:0/1924218195 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa10c0beb60 con 0x7fa11c107930 2024-09-21T12:14:59.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.999+0000 7fa121a4c640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa10807af40 0x7fa10807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:58.999+0000 7fa121a4c640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa10807af40 0x7fa10807d400 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa1180058c0 tx=0x7fa11800a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:59.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.003+0000 7fa112ffd640 1 -- 172.21.15.118:0/1924218195 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa10c004cf0 con 0x7fa11c107930 2024-09-21T12:14:59.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.188+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa11c198280 con 0x7fa10807af40 2024-09-21T12:14:59.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.199+0000 7fa112ffd640 1 -- 172.21.15.118:0/1924218195 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa11c198280 con 0x7fa10807af40 2024-09-21T12:14:59.201 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:14:59.201 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (32m) 11m ago 43m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:14:59.202 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (35m) 11m ago 44m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:14:59.202 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (35m) 11m ago 43m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:14:59.202 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (31m) 11m ago 44m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:14:59.202 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (30m) 11m ago 43m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:14:59.202 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (32m) 11m ago 43m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:14:59.202 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (27m) 11m ago 38m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:14:59.202 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (27m) 11m ago 38m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:14:59.202 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (11m) 11m ago 38m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:14:59.202 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (26m) 11m ago 38m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (35m) 11m ago 45m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (34m) 11m ago 43m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (31m) 11m ago 45m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (31m) 11m ago 42m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (33m) 11m ago 43m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (33m) 11m ago 43m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (30m) 11m ago 41m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (29m) 11m ago 41m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (29m) 11m ago 40m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:14:59.203 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (28m) 11m ago 40m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:14:59.204 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (28m) 11m ago 39m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:14:59.204 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (27m) 11m ago 39m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:14:59.204 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (33m) 11m ago 43m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:14:59.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa10807af40 msgr2=0x7fa10807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa10807af40 0x7fa10807d400 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa1180058c0 tx=0x7fa11800a250 comp rx=0 tx=0).stop 2024-09-21T12:14:59.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c107930 msgr2=0x7fa11c19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c107930 0x7fa11c19dbd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa10c031460 tx=0x7fa10c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 shutdown_connections 2024-09-21T12:14:59.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa10807af40 0x7fa10807d400 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa11c107930 0x7fa11c19dbd0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 --2- 172.21.15.118:0/1924218195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa11c101930 0x7fa11c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 >> 172.21.15.118:0/1924218195 conn(0x7fa11c0fd630 msgr2=0x7fa11c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 shutdown_connections 2024-09-21T12:14:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.201+0000 7fa123cb0640 1 -- 172.21.15.118:0/1924218195 wait complete. 2024-09-21T12:14:59.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.282+0000 7f3d75cd6640 1 -- 172.21.15.118:0/2363189814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 msgr2=0x7f3d70102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.282+0000 7f3d75cd6640 1 --2- 172.21.15.118:0/2363189814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 0x7f3d70102ec0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009880 tx=0x7f3d6002a530 comp rx=0 tx=0).stop 2024-09-21T12:14:59.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.282+0000 7f3d75cd6640 1 -- 172.21.15.118:0/2363189814 shutdown_connections 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.282+0000 7f3d75cd6640 1 --2- 172.21.15.118:0/2363189814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d70103400 0x7f3d7010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.282+0000 7f3d75cd6640 1 --2- 172.21.15.118:0/2363189814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 0x7f3d70102ec0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.282+0000 7f3d75cd6640 1 -- 172.21.15.118:0/2363189814 >> 172.21.15.118:0/2363189814 conn(0x7f3d700fc520 msgr2=0x7f3d700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.282+0000 7f3d75cd6640 1 -- 172.21.15.118:0/2363189814 shutdown_connections 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.282+0000 7f3d75cd6640 1 -- 172.21.15.118:0/2363189814 wait complete. 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.283+0000 7f3d75cd6640 1 Processor -- start 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.283+0000 7f3d75cd6640 1 -- start start 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.283+0000 7f3d75cd6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 0x7f3d7019d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.283+0000 7f3d75cd6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d70103400 0x7f3d7019dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.283+0000 7f3d75cd6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7010ee10 con 0x7f3d70102ae0 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.283+0000 7f3d75cd6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7010ec90 con 0x7f3d70103400 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 0x7f3d7019d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 0x7f3d7019d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39232/0 (socket says 172.21.15.118:39232) 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6f7fe640 1 -- 172.21.15.118:0/3181305506 learned_addr learned my addr 172.21.15.118:0/3181305506 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6effd640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d70103400 0x7f3d7019dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6f7fe640 1 -- 172.21.15.118:0/3181305506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d70103400 msgr2=0x7f3d7019dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6f7fe640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d70103400 0x7f3d7019dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6f7fe640 1 -- 172.21.15.118:0/3181305506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d70197920 con 0x7f3d70102ae0 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6f7fe640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 0x7f3d7019d760 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3d60031460 tx=0x7f3d600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:59.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6cff9640 1 -- 172.21.15.118:0/3181305506 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d6003f070 con 0x7f3d70102ae0 2024-09-21T12:14:59.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6cff9640 1 -- 172.21.15.118:0/3181305506 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d600035f0 con 0x7f3d70102ae0 2024-09-21T12:14:59.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d70197bb0 con 0x7f3d70102ae0 2024-09-21T12:14:59.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d6cff9640 1 -- 172.21.15.118:0/3181305506 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d60035030 con 0x7f3d70102ae0 2024-09-21T12:14:59.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.284+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d701980e0 con 0x7f3d70102ae0 2024-09-21T12:14:59.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.285+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7006abe0 con 0x7f3d70102ae0 2024-09-21T12:14:59.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.286+0000 7f3d6cff9640 1 -- 172.21.15.118:0/3181305506 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3d60042070 con 0x7f3d70102ae0 2024-09-21T12:14:59.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.286+0000 7f3d6cff9640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d5807af30 0x7f3d5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.286+0000 7f3d6cff9640 1 -- 172.21.15.118:0/3181305506 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3d600bead0 con 0x7f3d70102ae0 2024-09-21T12:14:59.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.286+0000 7f3d6effd640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d5807af30 0x7f3d5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.287+0000 7f3d6effd640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d5807af30 0x7f3d5807d3f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3d640058c0 tx=0x7f3d64005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:59.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.291+0000 7f3d6cff9640 1 -- 172.21.15.118:0/3181305506 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d6008a020 con 0x7f3d70102ae0 2024-09-21T12:14:59.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.538+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3d70105fb0 con 0x7f3d70102ae0 2024-09-21T12:14:59.543 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:59 smithi118 ceph-mon[111738]: from='client.35760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:59.543 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:14:59 smithi118 ceph-mon[111738]: from='client.35764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:59.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.539+0000 7f3d6cff9640 1 -- 172.21.15.118:0/3181305506 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3d6008c070 con 0x7f3d70102ae0 2024-09-21T12:14:59.544 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:14:59.544 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:14:59.544 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:14:59.544 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:14:59.545 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:14:59.545 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:14:59.545 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:14:59.545 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:14:59.546 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:14:59.546 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:14:59.546 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:14:59.546 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:14:59.546 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:14:59.547 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:14:59.547 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:14:59.547 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:14:59.547 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:14:59.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d5807af30 msgr2=0x7f3d5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d5807af30 0x7f3d5807d3f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3d640058c0 tx=0x7f3d64005850 comp rx=0 tx=0).stop 2024-09-21T12:14:59.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 msgr2=0x7f3d7019d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 0x7f3d7019d760 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3d60031460 tx=0x7f3d600045e0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 shutdown_connections 2024-09-21T12:14:59.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d70103400 0x7f3d7019dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3d5807af30 0x7f3d5807d3f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 --2- 172.21.15.118:0/3181305506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d70102ae0 0x7f3d7019d760 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 >> 172.21.15.118:0/3181305506 conn(0x7f3d700fc520 msgr2=0x7f3d70108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:59.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 shutdown_connections 2024-09-21T12:14:59.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.541+0000 7f3d75cd6640 1 -- 172.21.15.118:0/3181305506 wait complete. 2024-09-21T12:14:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.622+0000 7f225fdb7640 1 -- 172.21.15.118:0/54085795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581067e0 msgr2=0x7f2258106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.622+0000 7f225fdb7640 1 --2- 172.21.15.118:0/54085795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581067e0 0x7f2258106bc0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2254009880 tx=0x7f225402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.622+0000 7f225fdb7640 1 -- 172.21.15.118:0/54085795 shutdown_connections 2024-09-21T12:14:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.622+0000 7f225fdb7640 1 --2- 172.21.15.118:0/54085795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22581007e0 0x7f2258100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.622+0000 7f225fdb7640 1 --2- 172.21.15.118:0/54085795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581067e0 0x7f2258106bc0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.622+0000 7f225fdb7640 1 -- 172.21.15.118:0/54085795 >> 172.21.15.118:0/54085795 conn(0x7f22580fc4c0 msgr2=0x7f22580fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.622+0000 7f225fdb7640 1 -- 172.21.15.118:0/54085795 shutdown_connections 2024-09-21T12:14:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.622+0000 7f225fdb7640 1 -- 172.21.15.118:0/54085795 wait complete. 2024-09-21T12:14:59.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225fdb7640 1 Processor -- start 2024-09-21T12:14:59.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225fdb7640 1 -- start start 2024-09-21T12:14:59.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225fdb7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581007e0 0x7f22580fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225fdb7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22581067e0 0x7f22580fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225fdb7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f225810dcb0 con 0x7f22581007e0 2024-09-21T12:14:59.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225fdb7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f225810db30 con 0x7f22581067e0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225db53640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581007e0 0x7f22580fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225db53640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581007e0 0x7f22580fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39248/0 (socket says 172.21.15.118:39248) 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225db53640 1 -- 172.21.15.118:0/1673153710 learned_addr learned my addr 172.21.15.118:0/1673153710 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.623+0000 7f225d352640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22581067e0 0x7f22580fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.624+0000 7f225db53640 1 -- 172.21.15.118:0/1673153710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22581067e0 msgr2=0x7f22580fd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.624+0000 7f225db53640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22581067e0 0x7f22580fd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.624+0000 7f225db53640 1 -- 172.21.15.118:0/1673153710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580fd750 con 0x7f22581007e0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.624+0000 7f225db53640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581007e0 0x7f22580fccd0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2254031460 tx=0x7f22540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.624+0000 7f224effd640 1 -- 172.21.15.118:0/1673153710 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f225403f070 con 0x7f22581007e0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.624+0000 7f224effd640 1 -- 172.21.15.118:0/1673153710 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22540035f0 con 0x7f22581007e0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.624+0000 7f224effd640 1 -- 172.21.15.118:0/1673153710 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2254035030 con 0x7f22581007e0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.624+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22580fd9e0 con 0x7f22581007e0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.624+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22581a3d30 con 0x7f22581007e0 2024-09-21T12:14:59.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.625+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2258101f20 con 0x7f22581007e0 2024-09-21T12:14:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.626+0000 7f224effd640 1 -- 172.21.15.118:0/1673153710 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2254042070 con 0x7f22581007e0 2024-09-21T12:14:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.626+0000 7f224effd640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224407af80 0x7f224407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.626+0000 7f225d352640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224407af80 0x7f224407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.626+0000 7f224effd640 1 -- 172.21.15.118:0/1673153710 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f22540be910 con 0x7f22581007e0 2024-09-21T12:14:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.627+0000 7f225d352640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224407af80 0x7f224407d440 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f22580fe760 tx=0x7f224800b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:59.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.631+0000 7f224effd640 1 -- 172.21.15.118:0/1673153710 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2254089ee0 con 0x7f22581007e0 2024-09-21T12:14:59.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:59 smithi149 ceph-mon[79770]: from='client.35760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:59.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:14:59 smithi149 ceph-mon[79770]: from='client.35764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:59.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.844+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2258109d60 con 0x7f22581007e0 2024-09-21T12:14:59.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.844+0000 7f224effd640 1 -- 172.21.15.118:0/1673153710 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f225408ed90 con 0x7f22581007e0 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:14:59.846 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:14:59.847 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:14:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:14:59.849 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:14:59.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.846+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224407af80 msgr2=0x7f224407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.846+0000 7f225fdb7640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224407af80 0x7f224407d440 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f22580fe760 tx=0x7f224800b390 comp rx=0 tx=0).stop 2024-09-21T12:14:59.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.846+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581007e0 msgr2=0x7f22580fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.846+0000 7f225fdb7640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581007e0 0x7f22580fccd0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2254031460 tx=0x7f22540045e0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.846+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 shutdown_connections 2024-09-21T12:14:59.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.846+0000 7f225fdb7640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22581067e0 0x7f22580fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.846+0000 7f225fdb7640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f224407af80 0x7f224407d440 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.846+0000 7f225fdb7640 1 --2- 172.21.15.118:0/1673153710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22581007e0 0x7f22580fccd0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.846+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 >> 172.21.15.118:0/1673153710 conn(0x7f22580fc4c0 msgr2=0x7f2258069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:59.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.847+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 shutdown_connections 2024-09-21T12:14:59.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.847+0000 7f225fdb7640 1 -- 172.21.15.118:0/1673153710 wait complete. 2024-09-21T12:14:59.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.928+0000 7f8826b82640 1 -- 172.21.15.118:0/50567566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 msgr2=0x7f882010dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.928+0000 7f8826b82640 1 --2- 172.21.15.118:0/50567566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 0x7f882010dc30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f880c009880 tx=0x7f880c02a530 comp rx=0 tx=0).stop 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.928+0000 7f8826b82640 1 -- 172.21.15.118:0/50567566 shutdown_connections 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.928+0000 7f8826b82640 1 --2- 172.21.15.118:0/50567566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 0x7f882010dc30 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.928+0000 7f8826b82640 1 --2- 172.21.15.118:0/50567566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8820074620 0x7f8820074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.928+0000 7f8826b82640 1 -- 172.21.15.118:0/50567566 >> 172.21.15.118:0/50567566 conn(0x7f88200fd630 msgr2=0x7f88200ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.928+0000 7f8826b82640 1 -- 172.21.15.118:0/50567566 shutdown_connections 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.928+0000 7f8826b82640 1 -- 172.21.15.118:0/50567566 wait complete. 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f8826b82640 1 Processor -- start 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f8826b82640 1 -- start start 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f8826b82640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8820074620 0x7f882019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f8826b82640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 0x7f882019ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f8826b82640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8820111020 con 0x7f8820074f40 2024-09-21T12:14:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f8826b82640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8820110ea0 con 0x7f8820074620 2024-09-21T12:14:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f881ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 0x7f882019ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f881ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 0x7f882019ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39268/0 (socket says 172.21.15.118:39268) 2024-09-21T12:14:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f881ffff640 1 -- 172.21.15.118:0/1049771542 learned_addr learned my addr 172.21.15.118:0/1049771542 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:14:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f882491e640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8820074620 0x7f882019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f881ffff640 1 -- 172.21.15.118:0/1049771542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8820074620 msgr2=0x7f882019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f881ffff640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8820074620 0x7f882019fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.929+0000 7f881ffff640 1 -- 172.21.15.118:0/1049771542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8820199b30 con 0x7f8820074f40 2024-09-21T12:14:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.930+0000 7f881ffff640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 0x7f882019ffa0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f880c031460 tx=0x7f880c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.930+0000 7f881dffb640 1 -- 172.21.15.118:0/1049771542 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f880c03f070 con 0x7f8820074f40 2024-09-21T12:14:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.930+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8820199dc0 con 0x7f8820074f40 2024-09-21T12:14:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.930+0000 7f881dffb640 1 -- 172.21.15.118:0/1049771542 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f880c0035f0 con 0x7f8820074f40 2024-09-21T12:14:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.930+0000 7f881dffb640 1 -- 172.21.15.118:0/1049771542 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f880c035030 con 0x7f8820074f40 2024-09-21T12:14:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.930+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882019a2c0 con 0x7f8820074f40 2024-09-21T12:14:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.931+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8820075cd0 con 0x7f8820074f40 2024-09-21T12:14:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.932+0000 7f881dffb640 1 -- 172.21.15.118:0/1049771542 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f880c042070 con 0x7f8820074f40 2024-09-21T12:14:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.932+0000 7f881dffb640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f881007af30 0x7f881007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.932+0000 7f882491e640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f881007af30 0x7f881007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.932+0000 7f881dffb640 1 -- 172.21.15.118:0/1049771542 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f880c0bead0 con 0x7f8820074f40 2024-09-21T12:14:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.933+0000 7f882491e640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f881007af30 0x7f881007d3f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8814005fd0 tx=0x7f8814005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:59.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:14:59.937+0000 7f881dffb640 1 -- 172.21.15.118:0/1049771542 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f880c08a020 con 0x7f8820074f40 2024-09-21T12:15:00.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.131+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f882019aff0 con 0x7f881007af30 2024-09-21T12:15:00.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.133+0000 7f881dffb640 1 -- 172.21.15.118:0/1049771542 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f882019aff0 con 0x7f881007af30 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:15:00.134 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:15:00.135 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:15:00.135 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:15:00.135 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f881007af30 msgr2=0x7f881007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f881007af30 0x7f881007d3f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8814005fd0 tx=0x7f8814005850 comp rx=0 tx=0).stop 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 msgr2=0x7f882019ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 0x7f882019ffa0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f880c031460 tx=0x7f880c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 shutdown_connections 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f881007af30 0x7f881007d3f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8820074f40 0x7f882019ffa0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 --2- 172.21.15.118:0/1049771542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8820074620 0x7f882019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 >> 172.21.15.118:0/1049771542 conn(0x7f88200fd630 msgr2=0x7f882010b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:00.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 shutdown_connections 2024-09-21T12:15:00.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.135+0000 7f8826b82640 1 -- 172.21.15.118:0/1049771542 wait complete. 2024-09-21T12:15:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.216+0000 7f083cfd8640 1 -- 172.21.15.118:0/3228456199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838102ae0 msgr2=0x7f0838102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.216+0000 7f083cfd8640 1 --2- 172.21.15.118:0/3228456199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838102ae0 0x7f0838102ec0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0828009880 tx=0x7f082802a530 comp rx=0 tx=0).stop 2024-09-21T12:15:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.216+0000 7f083cfd8640 1 -- 172.21.15.118:0/3228456199 shutdown_connections 2024-09-21T12:15:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.216+0000 7f083cfd8640 1 --2- 172.21.15.118:0/3228456199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0838103400 0x7f083810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.216+0000 7f083cfd8640 1 --2- 172.21.15.118:0/3228456199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838102ae0 0x7f0838102ec0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.216+0000 7f083cfd8640 1 -- 172.21.15.118:0/3228456199 >> 172.21.15.118:0/3228456199 conn(0x7f08380fc520 msgr2=0x7f08380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.216+0000 7f083cfd8640 1 -- 172.21.15.118:0/3228456199 shutdown_connections 2024-09-21T12:15:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.216+0000 7f083cfd8640 1 -- 172.21.15.118:0/3228456199 wait complete. 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.217+0000 7f083cfd8640 1 Processor -- start 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.217+0000 7f083cfd8640 1 -- start start 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.217+0000 7f083cfd8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0838102ae0 0x7f083819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.217+0000 7f083cfd8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838103400 0x7f083819dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.217+0000 7f083cfd8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f083810ee10 con 0x7f0838103400 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.217+0000 7f083cfd8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f083810ec90 con 0x7f0838102ae0 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.217+0000 7f0835d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838103400 0x7f083819dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f0835d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838103400 0x7f083819dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39286/0 (socket says 172.21.15.118:39286) 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f0835d9b640 1 -- 172.21.15.118:0/844185997 learned_addr learned my addr 172.21.15.118:0/844185997 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f083659c640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0838102ae0 0x7f083819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f0835d9b640 1 -- 172.21.15.118:0/844185997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0838102ae0 msgr2=0x7f083819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f0835d9b640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0838102ae0 0x7f083819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f0835d9b640 1 -- 172.21.15.118:0/844185997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0838197920 con 0x7f0838103400 2024-09-21T12:15:00.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f0835d9b640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838103400 0x7f083819dca0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f082c00d6d0 tx=0x7f082c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:00.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f08277fe640 1 -- 172.21.15.118:0/844185997 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f082c017070 con 0x7f0838103400 2024-09-21T12:15:00.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f08277fe640 1 -- 172.21.15.118:0/844185997 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f082c0054e0 con 0x7f0838103400 2024-09-21T12:15:00.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0838197c10 con 0x7f0838103400 2024-09-21T12:15:00.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f08277fe640 1 -- 172.21.15.118:0/844185997 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f082c004ae0 con 0x7f0838103400 2024-09-21T12:15:00.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.218+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08381981a0 con 0x7f0838103400 2024-09-21T12:15:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.219+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083806abe0 con 0x7f0838103400 2024-09-21T12:15:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.220+0000 7f08277fe640 1 -- 172.21.15.118:0/844185997 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f082c004de0 con 0x7f0838103400 2024-09-21T12:15:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.220+0000 7f08277fe640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082007af30 0x7f082007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.220+0000 7f08277fe640 1 -- 172.21.15.118:0/844185997 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f082c09dc10 con 0x7f0838103400 2024-09-21T12:15:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.221+0000 7f083659c640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082007af30 0x7f082007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.221+0000 7f083659c640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082007af30 0x7f082007d3f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0828000c00 tx=0x7f0828031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:00.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.225+0000 7f08277fe640 1 -- 172.21.15.118:0/844185997 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f082c069160 con 0x7f0838103400 2024-09-21T12:15:00.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.474+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0838105fb0 con 0x7f0838103400 2024-09-21T12:15:00.475 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:00 smithi118 ceph-mon[111738]: pgmap v1086: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:00.476 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:00 smithi118 ceph-mon[111738]: from='client.35768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:00.476 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:00 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3181305506' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:15:00.476 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:00 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1673153710' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:15:00.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.474+0000 7f08277fe640 1 -- 172.21.15.118:0/844185997 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f082c06e010 con 0x7f0838103400 2024-09-21T12:15:00.476 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:15:00.476 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:15:00.476 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:15:00.477 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:15:00.478 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:15:00.478 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:15:00.478 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:15:00.478 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:15:00.478 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:15:00.478 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:15:00.478 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:15:00.478 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:15:00.478 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:15:00.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082007af30 msgr2=0x7f082007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:00.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082007af30 0x7f082007d3f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0828000c00 tx=0x7f0828031400 comp rx=0 tx=0).stop 2024-09-21T12:15:00.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838103400 msgr2=0x7f083819dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:00.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838103400 0x7f083819dca0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f082c00d6d0 tx=0x7f082c00db90 comp rx=0 tx=0).stop 2024-09-21T12:15:00.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 shutdown_connections 2024-09-21T12:15:00.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f082007af30 0x7f082007d3f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0838103400 0x7f083819dca0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 --2- 172.21.15.118:0/844185997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0838102ae0 0x7f083819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:00.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 >> 172.21.15.118:0/844185997 conn(0x7f08380fc520 msgr2=0x7f0838108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:00.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 shutdown_connections 2024-09-21T12:15:00.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:00.477+0000 7f083cfd8640 1 -- 172.21.15.118:0/844185997 wait complete. 2024-09-21T12:15:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:00 smithi149 ceph-mon[79770]: pgmap v1086: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:00 smithi149 ceph-mon[79770]: from='client.35768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:00 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3181305506' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:15:00.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:00 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1673153710' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:15:01.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:01 smithi118 ceph-mon[111738]: from='client.35780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:01.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:01 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/844185997' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:15:01.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:01 smithi149 ceph-mon[79770]: from='client.35780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:01.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:01 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/844185997' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:15:02.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:02 smithi118 ceph-mon[111738]: pgmap v1087: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:02.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:02 smithi149 ceph-mon[79770]: pgmap v1087: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:04.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:04 smithi118 ceph-mon[111738]: pgmap v1088: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:04.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:04 smithi149 ceph-mon[79770]: pgmap v1088: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:15:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:15:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:06 smithi118 ceph-mon[111738]: pgmap v1089: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:06.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:06 smithi149 ceph-mon[79770]: pgmap v1089: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:08.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:08 smithi118 ceph-mon[111738]: pgmap v1090: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:08.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:08 smithi149 ceph-mon[79770]: pgmap v1090: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:10.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:10 smithi118 ceph-mon[111738]: pgmap v1091: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:10.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:10 smithi149 ceph-mon[79770]: pgmap v1091: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:12.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:12 smithi118 ceph-mon[111738]: pgmap v1092: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:12.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:12 smithi149 ceph-mon[79770]: pgmap v1092: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:14.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:14 smithi118 ceph-mon[111738]: pgmap v1093: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:14 smithi149 ceph-mon[79770]: pgmap v1093: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:16 smithi118 ceph-mon[111738]: pgmap v1094: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:16 smithi149 ceph-mon[79770]: pgmap v1094: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:18.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:18 smithi118 ceph-mon[111738]: pgmap v1095: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:18 smithi149 ceph-mon[79770]: pgmap v1095: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:20 smithi118 ceph-mon[111738]: pgmap v1096: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:15:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:20 smithi149 ceph-mon[79770]: pgmap v1096: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:15:22.653 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:22 smithi149 ceph-mon[79770]: pgmap v1097: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:22.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:22 smithi118 ceph-mon[111738]: pgmap v1097: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:24 smithi149 ceph-mon[79770]: pgmap v1098: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:24.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:24 smithi118 ceph-mon[111738]: pgmap v1098: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:26.672 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:26 smithi118 ceph-mon[111738]: pgmap v1099: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:26 smithi149 ceph-mon[79770]: pgmap v1099: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:28 smithi149 ceph-mon[79770]: pgmap v1100: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:28 smithi118 ceph-mon[111738]: pgmap v1100: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:30.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.569+0000 7fce1f6c4640 1 -- 172.21.15.118:0/4210809148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 msgr2=0x7fce18102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:30.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.569+0000 7fce1f6c4640 1 --2- 172.21.15.118:0/4210809148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 0x7fce18102ec0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fce14009880 tx=0x7fce1402a530 comp rx=0 tx=0).stop 2024-09-21T12:15:30.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.569+0000 7fce1f6c4640 1 -- 172.21.15.118:0/4210809148 shutdown_connections 2024-09-21T12:15:30.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.569+0000 7fce1f6c4640 1 --2- 172.21.15.118:0/4210809148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce18103400 0x7fce1810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.569+0000 7fce1f6c4640 1 --2- 172.21.15.118:0/4210809148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 0x7fce18102ec0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.569+0000 7fce1f6c4640 1 -- 172.21.15.118:0/4210809148 >> 172.21.15.118:0/4210809148 conn(0x7fce180fc520 msgr2=0x7fce180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:30.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.569+0000 7fce1f6c4640 1 -- 172.21.15.118:0/4210809148 shutdown_connections 2024-09-21T12:15:30.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.569+0000 7fce1f6c4640 1 -- 172.21.15.118:0/4210809148 wait complete. 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1f6c4640 1 Processor -- start 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1f6c4640 1 -- start start 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1f6c4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 0x7fce1819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1f6c4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce18103400 0x7fce1819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1f6c4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce1810ee10 con 0x7fce18102ae0 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1f6c4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce1810ec90 con 0x7fce18103400 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1d460640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 0x7fce1819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1d460640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 0x7fce1819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55022/0 (socket says 172.21.15.118:55022) 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1d460640 1 -- 172.21.15.118:0/3526712583 learned_addr learned my addr 172.21.15.118:0/3526712583 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.570+0000 7fce1cc5f640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce18103400 0x7fce1819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:30.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.571+0000 7fce1d460640 1 -- 172.21.15.118:0/3526712583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce18103400 msgr2=0x7fce1819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:30.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.571+0000 7fce1d460640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce18103400 0x7fce1819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.571+0000 7fce1d460640 1 -- 172.21.15.118:0/3526712583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce18197800 con 0x7fce18102ae0 2024-09-21T12:15:30.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.571+0000 7fce1d460640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 0x7fce1819d680 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fce14031460 tx=0x7fce140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:30.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.571+0000 7fce0a7fc640 1 -- 172.21.15.118:0/3526712583 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce1403f070 con 0x7fce18102ae0 2024-09-21T12:15:30.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.571+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce18197a90 con 0x7fce18102ae0 2024-09-21T12:15:30.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.571+0000 7fce0a7fc640 1 -- 172.21.15.118:0/3526712583 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce140035f0 con 0x7fce18102ae0 2024-09-21T12:15:30.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.571+0000 7fce0a7fc640 1 -- 172.21.15.118:0/3526712583 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce14035030 con 0x7fce18102ae0 2024-09-21T12:15:30.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.571+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce18197fc0 con 0x7fce18102ae0 2024-09-21T12:15:30.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.572+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1806abe0 con 0x7fce18102ae0 2024-09-21T12:15:30.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.573+0000 7fce0a7fc640 1 -- 172.21.15.118:0/3526712583 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fce14042070 con 0x7fce18102ae0 2024-09-21T12:15:30.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.573+0000 7fce0a7fc640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0407af80 0x7fce0407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:30.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.573+0000 7fce0a7fc640 1 -- 172.21.15.118:0/3526712583 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fce140be910 con 0x7fce18102ae0 2024-09-21T12:15:30.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.573+0000 7fce1cc5f640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0407af80 0x7fce0407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:30.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.574+0000 7fce1cc5f640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0407af80 0x7fce0407d440 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fce180fe4d0 tx=0x7fce0c00b2e0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:30.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.578+0000 7fce0a7fc640 1 -- 172.21.15.118:0/3526712583 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce14089ee0 con 0x7fce18102ae0 2024-09-21T12:15:30.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:30 smithi149 ceph-mon[79770]: pgmap v1101: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:30.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.772+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fce18198270 con 0x7fce0407af80 2024-09-21T12:15:30.775 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:30 smithi118 ceph-mon[111738]: pgmap v1101: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:30.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.774+0000 7fce0a7fc640 1 -- 172.21.15.118:0/3526712583 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fce18198270 con 0x7fce0407af80 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0407af80 msgr2=0x7fce0407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0407af80 0x7fce0407d440 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fce180fe4d0 tx=0x7fce0c00b2e0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 msgr2=0x7fce1819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 0x7fce1819d680 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fce14031460 tx=0x7fce140045e0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 shutdown_connections 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce18103400 0x7fce1819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fce0407af80 0x7fce0407d440 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 --2- 172.21.15.118:0/3526712583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce18102ae0 0x7fce1819d680 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 >> 172.21.15.118:0/3526712583 conn(0x7fce180fc520 msgr2=0x7fce18108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:30.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 shutdown_connections 2024-09-21T12:15:30.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.776+0000 7fce1f6c4640 1 -- 172.21.15.118:0/3526712583 wait complete. 2024-09-21T12:15:30.786 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:15:30.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.859+0000 7f0287e1b640 1 -- 172.21.15.118:0/3012136724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801007e0 msgr2=0x7f0280100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:30.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.859+0000 7f0287e1b640 1 --2- 172.21.15.118:0/3012136724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801007e0 0x7f0280100c40 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0270009880 tx=0x7f027002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.859+0000 7f0287e1b640 1 -- 172.21.15.118:0/3012136724 shutdown_connections 2024-09-21T12:15:30.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.859+0000 7f0287e1b640 1 --2- 172.21.15.118:0/3012136724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801007e0 0x7f0280100c40 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.859+0000 7f0287e1b640 1 --2- 172.21.15.118:0/3012136724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02801067e0 0x7f0280106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.859+0000 7f0287e1b640 1 -- 172.21.15.118:0/3012136724 >> 172.21.15.118:0/3012136724 conn(0x7f02800fc4c0 msgr2=0x7f02800fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.859+0000 7f0287e1b640 1 -- 172.21.15.118:0/3012136724 shutdown_connections 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.859+0000 7f0287e1b640 1 -- 172.21.15.118:0/3012136724 wait complete. 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f0287e1b640 1 Processor -- start 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f0287e1b640 1 -- start start 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f0287e1b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02801007e0 0x7f02801987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f0287e1b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801067e0 0x7f0280198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f0287e1b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f028010dcb0 con 0x7f02801067e0 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f0287e1b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f028010db30 con 0x7f02801007e0 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f02853b6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801067e0 0x7f0280198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f02853b6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801067e0 0x7f0280198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55032/0 (socket says 172.21.15.118:55032) 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f02853b6640 1 -- 172.21.15.118:0/2776228263 learned_addr learned my addr 172.21.15.118:0/2776228263 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f0285bb7640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02801007e0 0x7f02801987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f02853b6640 1 -- 172.21.15.118:0/2776228263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02801007e0 msgr2=0x7f02801987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:30.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f02853b6640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02801007e0 0x7f02801987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:30.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f02853b6640 1 -- 172.21.15.118:0/2776228263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0280199320 con 0x7f02801067e0 2024-09-21T12:15:30.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f0285bb7640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02801007e0 0x7f02801987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:15:30.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.860+0000 7f02853b6640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801067e0 0x7f0280198d20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0270031460 tx=0x7f02700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:30.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.861+0000 7f0276ffd640 1 -- 172.21.15.118:0/2776228263 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f027003f070 con 0x7f02801067e0 2024-09-21T12:15:30.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.861+0000 7f0276ffd640 1 -- 172.21.15.118:0/2776228263 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02700035f0 con 0x7f02801067e0 2024-09-21T12:15:30.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.861+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02801995b0 con 0x7f02801067e0 2024-09-21T12:15:30.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.861+0000 7f0276ffd640 1 -- 172.21.15.118:0/2776228263 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0270035030 con 0x7f02801067e0 2024-09-21T12:15:30.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.861+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02801a1b60 con 0x7f02801067e0 2024-09-21T12:15:30.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.862+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0280101f20 con 0x7f02801067e0 2024-09-21T12:15:30.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.863+0000 7f0276ffd640 1 -- 172.21.15.118:0/2776228263 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0270042070 con 0x7f02801067e0 2024-09-21T12:15:30.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.863+0000 7f0276ffd640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f026c07af80 0x7f026c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:30.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.863+0000 7f0276ffd640 1 -- 172.21.15.118:0/2776228263 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f02700be9c0 con 0x7f02801067e0 2024-09-21T12:15:30.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.863+0000 7f0285bb7640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f026c07af80 0x7f026c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:30.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.864+0000 7f0285bb7640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f026c07af80 0x7f026c07d440 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f027c009b40 tx=0x7f027c005e50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:30.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:30.867+0000 7f0276ffd640 1 -- 172.21.15.118:0/2776228263 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0270089f90 con 0x7f02801067e0 2024-09-21T12:15:31.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.062+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0280062630 con 0x7f026c07af80 2024-09-21T12:15:31.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.063+0000 7f0276ffd640 1 -- 172.21.15.118:0/2776228263 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0280062630 con 0x7f026c07af80 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f026c07af80 msgr2=0x7f026c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f026c07af80 0x7f026c07d440 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f027c009b40 tx=0x7f027c005e50 comp rx=0 tx=0).stop 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801067e0 msgr2=0x7f0280198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801067e0 0x7f0280198d20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0270031460 tx=0x7f02700045e0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 shutdown_connections 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f026c07af80 0x7f026c07d440 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02801067e0 0x7f0280198d20 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 --2- 172.21.15.118:0/2776228263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02801007e0 0x7f02801987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 >> 172.21.15.118:0/2776228263 conn(0x7f02800fc4c0 msgr2=0x7f02800fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 shutdown_connections 2024-09-21T12:15:31.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.065+0000 7f0287e1b640 1 -- 172.21.15.118:0/2776228263 wait complete. 2024-09-21T12:15:31.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.146+0000 7fccbabdf640 1 -- 172.21.15.118:0/399879854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 msgr2=0x7fccb4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.146+0000 7fccbabdf640 1 --2- 172.21.15.118:0/399879854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 0x7fccb4100c80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009c20 tx=0x7fcca402a970 comp rx=0 tx=0).stop 2024-09-21T12:15:31.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 -- 172.21.15.118:0/399879854 shutdown_connections 2024-09-21T12:15:31.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 --2- 172.21.15.118:0/399879854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 0x7fccb4100c80 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 --2- 172.21.15.118:0/399879854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb4106820 0x7fccb4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 -- 172.21.15.118:0/399879854 >> 172.21.15.118:0/399879854 conn(0x7fccb40fc520 msgr2=0x7fccb40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 -- 172.21.15.118:0/399879854 shutdown_connections 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 -- 172.21.15.118:0/399879854 wait complete. 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 Processor -- start 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 -- start start 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 0x7fccb419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb4106820 0x7fccb419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fccb410dcf0 con 0x7fccb4100820 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccbabdf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fccb410db70 con 0x7fccb4106820 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.147+0000 7fccb897b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 0x7fccb419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb897b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 0x7fccb419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55062/0 (socket says 172.21.15.118:55062) 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb897b640 1 -- 172.21.15.118:0/306974713 learned_addr learned my addr 172.21.15.118:0/306974713 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb3fff640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb4106820 0x7fccb419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:31.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb897b640 1 -- 172.21.15.118:0/306974713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb4106820 msgr2=0x7fccb419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb897b640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb4106820 0x7fccb419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb897b640 1 -- 172.21.15.118:0/306974713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb41977e0 con 0x7fccb4100820 2024-09-21T12:15:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb897b640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 0x7fccb419d660 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00c8f0 tx=0x7fcc9c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb1ffb640 1 -- 172.21.15.118:0/306974713 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc9c0079b0 con 0x7fccb4100820 2024-09-21T12:15:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb1ffb640 1 -- 172.21.15.118:0/306974713 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc9c0054e0 con 0x7fccb4100820 2024-09-21T12:15:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb4197ad0 con 0x7fccb4100820 2024-09-21T12:15:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccb1ffb640 1 -- 172.21.15.118:0/306974713 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc9c004dd0 con 0x7fccb4100820 2024-09-21T12:15:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.148+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb4198060 con 0x7fccb4100820 2024-09-21T12:15:31.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.149+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb4101f60 con 0x7fccb4100820 2024-09-21T12:15:31.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.150+0000 7fccb1ffb640 1 -- 172.21.15.118:0/306974713 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcc9c005020 con 0x7fccb4100820 2024-09-21T12:15:31.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.150+0000 7fccb1ffb640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcca007af30 0x7fcca007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:31.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.150+0000 7fccb1ffb640 1 -- 172.21.15.118:0/306974713 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcc9c09df50 con 0x7fccb4100820 2024-09-21T12:15:31.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.150+0000 7fccb3fff640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcca007af30 0x7fcca007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:31.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.151+0000 7fccb3fff640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcca007af30 0x7fcca007d3f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcca4006010 tx=0x7fcca4009380 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:31.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.155+0000 7fccb1ffb640 1 -- 172.21.15.118:0/306974713 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc9c014030 con 0x7fccb4100820 2024-09-21T12:15:31.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.341+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fccb4198370 con 0x7fcca007af30 2024-09-21T12:15:31.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.351+0000 7fccb1ffb640 1 -- 172.21.15.118:0/306974713 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fccb4198370 con 0x7fcca007af30 2024-09-21T12:15:31.354 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:15:31.354 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (33m) 12m ago 44m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:15:31.354 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (36m) 12m ago 44m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:15:31.354 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (35m) 12m ago 43m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:15:31.354 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (31m) 12m ago 44m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:15:31.354 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (31m) 12m ago 43m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:15:31.354 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (33m) 12m ago 44m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:15:31.354 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (27m) 12m ago 39m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:15:31.354 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (27m) 12m ago 38m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (12m) 12m ago 38m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (27m) 12m ago 39m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (35m) 12m ago 45m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (34m) 12m ago 43m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (32m) 12m ago 45m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (31m) 12m ago 43m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (34m) 12m ago 44m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (34m) 12m ago 43m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (31m) 12m ago 42m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (30m) 12m ago 41m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (29m) 12m ago 41m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (29m) 12m ago 40m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (28m) 12m ago 40m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (28m) 12m ago 40m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:15:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (33m) 12m ago 43m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:15:31.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcca007af30 msgr2=0x7fcca007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcca007af30 0x7fcca007d3f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcca4006010 tx=0x7fcca4009380 comp rx=0 tx=0).stop 2024-09-21T12:15:31.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 msgr2=0x7fccb419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 0x7fccb419d660 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00c8f0 tx=0x7fcc9c00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 shutdown_connections 2024-09-21T12:15:31.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb4106820 0x7fccb419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcca007af30 0x7fcca007d3f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 --2- 172.21.15.118:0/306974713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb4100820 0x7fccb419d660 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 >> 172.21.15.118:0/306974713 conn(0x7fccb40fc520 msgr2=0x7fccb406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:31.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 shutdown_connections 2024-09-21T12:15:31.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.353+0000 7fccbabdf640 1 -- 172.21.15.118:0/306974713 wait complete. 2024-09-21T12:15:31.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.433+0000 7f643e8ab640 1 -- 172.21.15.118:0/859406032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 msgr2=0x7f6438106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.433+0000 7f643e8ab640 1 --2- 172.21.15.118:0/859406032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 0x7f6438106bc0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6428009880 tx=0x7f642802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.433+0000 7f643e8ab640 1 -- 172.21.15.118:0/859406032 shutdown_connections 2024-09-21T12:15:31.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.433+0000 7f643e8ab640 1 --2- 172.21.15.118:0/859406032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64381007e0 0x7f6438100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.433+0000 7f643e8ab640 1 --2- 172.21.15.118:0/859406032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 0x7f6438106bc0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.434+0000 7f643e8ab640 1 -- 172.21.15.118:0/859406032 >> 172.21.15.118:0/859406032 conn(0x7f64380fc4c0 msgr2=0x7f64380fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:31.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.434+0000 7f643e8ab640 1 -- 172.21.15.118:0/859406032 shutdown_connections 2024-09-21T12:15:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.434+0000 7f643e8ab640 1 -- 172.21.15.118:0/859406032 wait complete. 2024-09-21T12:15:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.434+0000 7f643e8ab640 1 Processor -- start 2024-09-21T12:15:31.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.434+0000 7f643e8ab640 1 -- start start 2024-09-21T12:15:31.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f643e8ab640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64381007e0 0x7f64381965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:31.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f643e8ab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 0x7f6438196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:31.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f643e8ab640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f643810dc90 con 0x7f64381067e0 2024-09-21T12:15:31.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f643e8ab640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f643810db10 con 0x7f64381007e0 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64377fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 0x7f6438196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64377fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 0x7f6438196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55076/0 (socket says 172.21.15.118:55076) 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64377fe640 1 -- 172.21.15.118:0/1198339286 learned_addr learned my addr 172.21.15.118:0/1198339286 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f6437fff640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64381007e0 0x7f64381965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64377fe640 1 -- 172.21.15.118:0/1198339286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64381007e0 msgr2=0x7f64381965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64377fe640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64381007e0 0x7f64381965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64377fe640 1 -- 172.21.15.118:0/1198339286 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6438197030 con 0x7f64381067e0 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f6437fff640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64381007e0 0x7f64381965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64377fe640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 0x7f6438196af0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f642c00d8d0 tx=0x7f642c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64357fa640 1 -- 172.21.15.118:0/1198339286 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f642c017070 con 0x7f64381067e0 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64357fa640 1 -- 172.21.15.118:0/1198339286 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f642c010460 con 0x7f64381067e0 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6438197320 con 0x7f64381067e0 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.435+0000 7f64357fa640 1 -- 172.21.15.118:0/1198339286 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f642c00f5f0 con 0x7f64381067e0 2024-09-21T12:15:31.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.436+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64381a3df0 con 0x7f64381067e0 2024-09-21T12:15:31.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.436+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6438101f20 con 0x7f64381067e0 2024-09-21T12:15:31.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.437+0000 7f64357fa640 1 -- 172.21.15.118:0/1198339286 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f642c009a30 con 0x7f64381067e0 2024-09-21T12:15:31.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.438+0000 7f64357fa640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f642007af30 0x7f642007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:31.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.438+0000 7f64357fa640 1 -- 172.21.15.118:0/1198339286 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f642c09df80 con 0x7f64381067e0 2024-09-21T12:15:31.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.438+0000 7f6437fff640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f642007af30 0x7f642007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:31.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.438+0000 7f6437fff640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f642007af30 0x7f642007d3f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6428006010 tx=0x7f64280095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:31.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.442+0000 7f64357fa640 1 -- 172.21.15.118:0/1198339286 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f642c0694d0 con 0x7f64381067e0 2024-09-21T12:15:31.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.690+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f64381039f0 con 0x7f64381067e0 2024-09-21T12:15:31.692 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:31 smithi118 ceph-mon[111738]: from='client.35788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:31.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.690+0000 7f64357fa640 1 -- 172.21.15.118:0/1198339286 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f642c06e380 con 0x7f64381067e0 2024-09-21T12:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:15:31.693 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:15:31.694 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:15:31.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f642007af30 msgr2=0x7f642007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f642007af30 0x7f642007d3f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6428006010 tx=0x7f64280095f0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 msgr2=0x7f6438196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 0x7f6438196af0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f642c00d8d0 tx=0x7f642c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:15:31.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 shutdown_connections 2024-09-21T12:15:31.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f642007af30 0x7f642007d3f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64381067e0 0x7f6438196af0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 --2- 172.21.15.118:0/1198339286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64381007e0 0x7f64381965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 >> 172.21.15.118:0/1198339286 conn(0x7f64380fc4c0 msgr2=0x7f64380fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:31.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 shutdown_connections 2024-09-21T12:15:31.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.693+0000 7f643e8ab640 1 -- 172.21.15.118:0/1198339286 wait complete. 2024-09-21T12:15:31.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:31 smithi149 ceph-mon[79770]: from='client.35788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:31.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.775+0000 7f15ba6f7640 1 -- 172.21.15.118:0/3625497982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 msgr2=0x7f15b4107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.775+0000 7f15ba6f7640 1 --2- 172.21.15.118:0/3625497982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 0x7f15b4107d00 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009880 tx=0x7f15a402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.775+0000 7f15ba6f7640 1 -- 172.21.15.118:0/3625497982 shutdown_connections 2024-09-21T12:15:31.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.775+0000 7f15ba6f7640 1 --2- 172.21.15.118:0/3625497982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15b4101920 0x7f15b4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.775+0000 7f15ba6f7640 1 --2- 172.21.15.118:0/3625497982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 0x7f15b4107d00 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.776+0000 7f15ba6f7640 1 -- 172.21.15.118:0/3625497982 >> 172.21.15.118:0/3625497982 conn(0x7f15b40fd620 msgr2=0x7f15b40ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:31.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.776+0000 7f15ba6f7640 1 -- 172.21.15.118:0/3625497982 shutdown_connections 2024-09-21T12:15:31.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.776+0000 7f15ba6f7640 1 -- 172.21.15.118:0/3625497982 wait complete. 2024-09-21T12:15:31.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.776+0000 7f15ba6f7640 1 Processor -- start 2024-09-21T12:15:31.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.776+0000 7f15ba6f7640 1 -- start start 2024-09-21T12:15:31.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15ba6f7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15b4101920 0x7f15b419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:31.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15ba6f7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 0x7f15b419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:31.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15ba6f7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f15b410edd0 con 0x7f15b4107920 2024-09-21T12:15:31.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15ba6f7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f15b410ec50 con 0x7f15b4101920 2024-09-21T12:15:31.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 0x7f15b419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:31.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 0x7f15b419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55090/0 (socket says 172.21.15.118:55090) 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b37fe640 1 -- 172.21.15.118:0/1539461506 learned_addr learned my addr 172.21.15.118:0/1539461506 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b3fff640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15b4101920 0x7f15b419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b37fe640 1 -- 172.21.15.118:0/1539461506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15b4101920 msgr2=0x7f15b419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b37fe640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15b4101920 0x7f15b419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b37fe640 1 -- 172.21.15.118:0/1539461506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b41977b0 con 0x7f15b4107920 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b3fff640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15b4101920 0x7f15b419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b37fe640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 0x7f15b419db70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f159c00d8d0 tx=0x7f159c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b17fa640 1 -- 172.21.15.118:0/1539461506 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f159c017070 con 0x7f15b4107920 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.777+0000 7f15b17fa640 1 -- 172.21.15.118:0/1539461506 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f159c010460 con 0x7f15b4107920 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.778+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b4197aa0 con 0x7f15b4107920 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.778+0000 7f15b17fa640 1 -- 172.21.15.118:0/1539461506 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f159c00f5f0 con 0x7f15b4107920 2024-09-21T12:15:31.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.778+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b4198030 con 0x7f15b4107920 2024-09-21T12:15:31.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.778+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b4103060 con 0x7f15b4107920 2024-09-21T12:15:31.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.779+0000 7f15b17fa640 1 -- 172.21.15.118:0/1539461506 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f159c009a30 con 0x7f15b4107920 2024-09-21T12:15:31.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.780+0000 7f15b17fa640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15a007af80 0x7f15a007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:31.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.780+0000 7f15b17fa640 1 -- 172.21.15.118:0/1539461506 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f159c09dee0 con 0x7f15b4107920 2024-09-21T12:15:31.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.780+0000 7f15b3fff640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15a007af80 0x7f15a007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:31.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.780+0000 7f15b3fff640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15a007af80 0x7f15a007d440 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006010 tx=0x7f15a40095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:31.784+0000 7f15b17fa640 1 -- 172.21.15.118:0/1539461506 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f159c0694b0 con 0x7f15b4107920 2024-09-21T12:15:32.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.001+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f15b4104b30 con 0x7f15b4107920 2024-09-21T12:15:32.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.002+0000 7f15b17fa640 1 -- 172.21.15.118:0/1539461506 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f159c06e360 con 0x7f15b4107920 2024-09-21T12:15:32.004 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:15:32.004 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:15:32.004 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:15:32.004 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:15:32.005 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:15:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:15:32.007 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:15:32.008 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:15:32.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.004+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15a007af80 msgr2=0x7f15a007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.004+0000 7f15ba6f7640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15a007af80 0x7f15a007d440 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006010 tx=0x7f15a40095f0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.004+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 msgr2=0x7f15b419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.004+0000 7f15ba6f7640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 0x7f15b419db70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f159c00d8d0 tx=0x7f159c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:15:32.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.004+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 shutdown_connections 2024-09-21T12:15:32.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.004+0000 7f15ba6f7640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f15a007af80 0x7f15a007d440 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.005+0000 7f15ba6f7640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15b4107920 0x7f15b419db70 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.005+0000 7f15ba6f7640 1 --2- 172.21.15.118:0/1539461506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15b4101920 0x7f15b419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.005+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 >> 172.21.15.118:0/1539461506 conn(0x7f15b40fd620 msgr2=0x7f15b40fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:32.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.005+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 shutdown_connections 2024-09-21T12:15:32.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.005+0000 7f15ba6f7640 1 -- 172.21.15.118:0/1539461506 wait complete. 2024-09-21T12:15:32.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.088+0000 7faf9a385640 1 -- 172.21.15.118:0/1983942924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94100820 msgr2=0x7faf94100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.088+0000 7faf9a385640 1 --2- 172.21.15.118:0/1983942924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94100820 0x7faf94100c80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7faf88009880 tx=0x7faf8802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.088+0000 7faf9a385640 1 -- 172.21.15.118:0/1983942924 shutdown_connections 2024-09-21T12:15:32.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.088+0000 7faf9a385640 1 --2- 172.21.15.118:0/1983942924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94100820 0x7faf94100c80 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.088+0000 7faf9a385640 1 --2- 172.21.15.118:0/1983942924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf94106820 0x7faf94106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.088+0000 7faf9a385640 1 -- 172.21.15.118:0/1983942924 >> 172.21.15.118:0/1983942924 conn(0x7faf940fc520 msgr2=0x7faf940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:32.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.088+0000 7faf9a385640 1 -- 172.21.15.118:0/1983942924 shutdown_connections 2024-09-21T12:15:32.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.088+0000 7faf9a385640 1 -- 172.21.15.118:0/1983942924 wait complete. 2024-09-21T12:15:32.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.089+0000 7faf9a385640 1 Processor -- start 2024-09-21T12:15:32.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.089+0000 7faf9a385640 1 -- start start 2024-09-21T12:15:32.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.089+0000 7faf9a385640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf94100820 0x7faf94198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:32.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.089+0000 7faf9a385640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94106820 0x7faf94198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:32.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.089+0000 7faf9a385640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faf9410dd50 con 0x7faf94106820 2024-09-21T12:15:32.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.089+0000 7faf9a385640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf9410dbd0 con 0x7faf94100820 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.089+0000 7faf937fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94106820 0x7faf94198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.089+0000 7faf937fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94106820 0x7faf94198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55100/0 (socket says 172.21.15.118:55100) 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf937fe640 1 -- 172.21.15.118:0/1561439258 learned_addr learned my addr 172.21.15.118:0/1561439258 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf93fff640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf94100820 0x7faf94198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf937fe640 1 -- 172.21.15.118:0/1561439258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf94100820 msgr2=0x7faf94198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf937fe640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf94100820 0x7faf94198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf937fe640 1 -- 172.21.15.118:0/1561439258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf941993c0 con 0x7faf94106820 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf937fe640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94106820 0x7faf94198dc0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7faf88031460 tx=0x7faf880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf917fa640 1 -- 172.21.15.118:0/1561439258 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf8803f070 con 0x7faf94106820 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf94199650 con 0x7faf94106820 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf917fa640 1 -- 172.21.15.118:0/1561439258 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf88004cf0 con 0x7faf94106820 2024-09-21T12:15:32.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf917fa640 1 -- 172.21.15.118:0/1561439258 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf88035030 con 0x7faf94106820 2024-09-21T12:15:32.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.090+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf941a1c00 con 0x7faf94106820 2024-09-21T12:15:32.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.091+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf94101f60 con 0x7faf94106820 2024-09-21T12:15:32.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.092+0000 7faf917fa640 1 -- 172.21.15.118:0/1561439258 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7faf88042070 con 0x7faf94106820 2024-09-21T12:15:32.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.092+0000 7faf917fa640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faf7c07af30 0x7faf7c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:32.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.092+0000 7faf93fff640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faf7c07af30 0x7faf7c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:32.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.092+0000 7faf917fa640 1 -- 172.21.15.118:0/1561439258 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faf880beb40 con 0x7faf94106820 2024-09-21T12:15:32.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.093+0000 7faf93fff640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faf7c07af30 0x7faf7c07d3f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faf84009990 tx=0x7faf84009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:32.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.097+0000 7faf917fa640 1 -- 172.21.15.118:0/1561439258 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf8808a090 con 0x7faf94106820 2024-09-21T12:15:32.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.288+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faf94062630 con 0x7faf7c07af30 2024-09-21T12:15:32.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.289+0000 7faf917fa640 1 -- 172.21.15.118:0/1561439258 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7faf94062630 con 0x7faf7c07af30 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:15:32.292 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:15:32.293 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:15:32.293 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:15:32.293 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:15:32.293 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.291+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faf7c07af30 msgr2=0x7faf7c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.291+0000 7faf9a385640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faf7c07af30 0x7faf7c07d3f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faf84009990 tx=0x7faf84009110 comp rx=0 tx=0).stop 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.291+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94106820 msgr2=0x7faf94198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.291+0000 7faf9a385640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94106820 0x7faf94198dc0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7faf88031460 tx=0x7faf880048f0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.292+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 shutdown_connections 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.292+0000 7faf9a385640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faf7c07af30 0x7faf7c07d3f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.292+0000 7faf9a385640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf94106820 0x7faf94198dc0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.292+0000 7faf9a385640 1 --2- 172.21.15.118:0/1561439258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf94100820 0x7faf94198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.292+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 >> 172.21.15.118:0/1561439258 conn(0x7faf940fc520 msgr2=0x7faf940fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.292+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 shutdown_connections 2024-09-21T12:15:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.292+0000 7faf9a385640 1 -- 172.21.15.118:0/1561439258 wait complete. 2024-09-21T12:15:32.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.373+0000 7ff9bacf6640 1 -- 172.21.15.118:0/1946165840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b4102b80 msgr2=0x7ff9b4102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.373+0000 7ff9bacf6640 1 --2- 172.21.15.118:0/1946165840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b4102b80 0x7ff9b4102f60 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009880 tx=0x7ff9a402a530 comp rx=0 tx=0).stop 2024-09-21T12:15:32.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.373+0000 7ff9bacf6640 1 -- 172.21.15.118:0/1946165840 shutdown_connections 2024-09-21T12:15:32.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.373+0000 7ff9bacf6640 1 --2- 172.21.15.118:0/1946165840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9b41034a0 0x7ff9b410b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.373+0000 7ff9bacf6640 1 --2- 172.21.15.118:0/1946165840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b4102b80 0x7ff9b4102f60 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.373+0000 7ff9bacf6640 1 -- 172.21.15.118:0/1946165840 >> 172.21.15.118:0/1946165840 conn(0x7ff9b40fc520 msgr2=0x7ff9b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:32.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.373+0000 7ff9bacf6640 1 -- 172.21.15.118:0/1946165840 shutdown_connections 2024-09-21T12:15:32.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.373+0000 7ff9bacf6640 1 -- 172.21.15.118:0/1946165840 wait complete. 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.374+0000 7ff9bacf6640 1 Processor -- start 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.374+0000 7ff9bacf6640 1 -- start start 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.374+0000 7ff9bacf6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9b4102b80 0x7ff9b41007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.374+0000 7ff9bacf6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b41034a0 0x7ff9b4100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.374+0000 7ff9bacf6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b410ee10 con 0x7ff9b41034a0 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.374+0000 7ff9bacf6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b410ec90 con 0x7ff9b4102b80 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.374+0000 7ff9b3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b41034a0 0x7ff9b4100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.374+0000 7ff9b3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b41034a0 0x7ff9b4100d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55122/0 (socket says 172.21.15.118:55122) 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.374+0000 7ff9b3fff640 1 -- 172.21.15.118:0/2194973679 learned_addr learned my addr 172.21.15.118:0/2194973679 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9b8a92640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9b4102b80 0x7ff9b41007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9b3fff640 1 -- 172.21.15.118:0/2194973679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9b4102b80 msgr2=0x7ff9b41007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9b3fff640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9b4102b80 0x7ff9b41007e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9b3fff640 1 -- 172.21.15.118:0/2194973679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b4101260 con 0x7ff9b41034a0 2024-09-21T12:15:32.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9b3fff640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b41034a0 0x7ff9b4100d20 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800d6f0 tx=0x7ff9a800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:32.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9b1ffb640 1 -- 172.21.15.118:0/2194973679 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9a8017070 con 0x7ff9b41034a0 2024-09-21T12:15:32.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9b1ffb640 1 -- 172.21.15.118:0/2194973679 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9a800de00 con 0x7ff9b41034a0 2024-09-21T12:15:32.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b4101550 con 0x7ff9b41034a0 2024-09-21T12:15:32.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9b1ffb640 1 -- 172.21.15.118:0/2194973679 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9a8004bb0 con 0x7ff9b41034a0 2024-09-21T12:15:32.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.375+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b41a3f20 con 0x7ff9b41034a0 2024-09-21T12:15:32.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.376+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b406ab40 con 0x7ff9b41034a0 2024-09-21T12:15:32.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.377+0000 7ff9b1ffb640 1 -- 172.21.15.118:0/2194973679 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff9a8009a30 con 0x7ff9b41034a0 2024-09-21T12:15:32.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.377+0000 7ff9b1ffb640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff99c07af80 0x7ff99c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:32.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.377+0000 7ff9b1ffb640 1 -- 172.21.15.118:0/2194973679 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff9a809dc30 con 0x7ff9b41034a0 2024-09-21T12:15:32.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.378+0000 7ff9b8a92640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff99c07af80 0x7ff99c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:32.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.378+0000 7ff9b8a92640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff99c07af80 0x7ff99c07d440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40096c0 tx=0x7ff9a4004f30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:32.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.382+0000 7ff9b1ffb640 1 -- 172.21.15.118:0/2194973679 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9a8069200 con 0x7ff9b41034a0 2024-09-21T12:15:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:32 smithi118 ceph-mon[111738]: from='client.35792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:32 smithi118 ceph-mon[111738]: pgmap v1102: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:32 smithi118 ceph-mon[111738]: from='client.35796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:32 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1198339286' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:15:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:32 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1539461506' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:15:32.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.628+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff9b4102f60 con 0x7ff9b41034a0 2024-09-21T12:15:32.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.628+0000 7ff9b1ffb640 1 -- 172.21.15.118:0/2194973679 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7ff9a805ee20 con 0x7ff9b41034a0 2024-09-21T12:15:32.631 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:15:32.631 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:15:32.631 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:15:32.631 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:15:32.631 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:15:32.631 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:15:32.631 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:15:32.632 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:15:32.633 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:15:32.633 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:15:32.633 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:15:32.633 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:15:32.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff99c07af80 msgr2=0x7ff99c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff99c07af80 0x7ff99c07d440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40096c0 tx=0x7ff9a4004f30 comp rx=0 tx=0).stop 2024-09-21T12:15:32.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b41034a0 msgr2=0x7ff9b4100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:32.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b41034a0 0x7ff9b4100d20 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800d6f0 tx=0x7ff9a800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 shutdown_connections 2024-09-21T12:15:32.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff99c07af80 0x7ff99c07d440 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b41034a0 0x7ff9b4100d20 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 --2- 172.21.15.118:0/2194973679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9b4102b80 0x7ff9b41007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:32.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 >> 172.21.15.118:0/2194973679 conn(0x7ff9b40fc520 msgr2=0x7ff9b4107ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:32.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 shutdown_connections 2024-09-21T12:15:32.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:15:32.631+0000 7ff9bacf6640 1 -- 172.21.15.118:0/2194973679 wait complete. 2024-09-21T12:15:32.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:32 smithi149 ceph-mon[79770]: from='client.35792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:32 smithi149 ceph-mon[79770]: pgmap v1102: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:32 smithi149 ceph-mon[79770]: from='client.35796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:32 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1198339286' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:15:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:32 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1539461506' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:15:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:33 smithi149 ceph-mon[79770]: from='client.35808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:33.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:33 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2194973679' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:15:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:33 smithi118 ceph-mon[111738]: from='client.35808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:33.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:33 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2194973679' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:15:34.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:34 smithi149 ceph-mon[79770]: pgmap v1103: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:34.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:34 smithi118 ceph-mon[111738]: pgmap v1103: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:15:35.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:15:36.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:36 smithi149 ceph-mon[79770]: pgmap v1104: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:36.820 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:36 smithi118 ceph-mon[111738]: pgmap v1104: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:38.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:38 smithi149 ceph-mon[79770]: pgmap v1105: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:38 smithi118 ceph-mon[111738]: pgmap v1105: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:40 smithi149 ceph-mon[79770]: pgmap v1106: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:40.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:40 smithi118 ceph-mon[111738]: pgmap v1106: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:42.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:42 smithi149 ceph-mon[79770]: pgmap v1107: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:42.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:42 smithi118 ceph-mon[111738]: pgmap v1107: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:44.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:44 smithi149 ceph-mon[79770]: pgmap v1108: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:44.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:44 smithi118 ceph-mon[111738]: pgmap v1108: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:46.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:46 smithi149 ceph-mon[79770]: pgmap v1109: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:46.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:46 smithi118 ceph-mon[111738]: pgmap v1109: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:48.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:48 smithi149 ceph-mon[79770]: pgmap v1110: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:48.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:48 smithi118 ceph-mon[111738]: pgmap v1110: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:50 smithi149 ceph-mon[79770]: pgmap v1111: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:15:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:50 smithi118 ceph-mon[111738]: pgmap v1111: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:15:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:52 smithi149 ceph-mon[79770]: pgmap v1112: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:52.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:52 smithi118 ceph-mon[111738]: pgmap v1112: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:54.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:54 smithi149 ceph-mon[79770]: pgmap v1113: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:54.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:54 smithi118 ceph-mon[111738]: pgmap v1113: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:56.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:56 smithi149 ceph-mon[79770]: pgmap v1114: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:56.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:56 smithi118 ceph-mon[111738]: pgmap v1114: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:15:58 smithi149 ceph-mon[79770]: pgmap v1115: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:15:58.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:15:58 smithi118 ceph-mon[111738]: pgmap v1115: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:00 smithi149 ceph-mon[79770]: pgmap v1116: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:00.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:00 smithi118 ceph-mon[111738]: pgmap v1116: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:02.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:02 smithi118 ceph-mon[111738]: pgmap v1117: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:02.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:02 smithi149 ceph-mon[79770]: pgmap v1117: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.723+0000 7f3ba8eca640 1 -- 172.21.15.118:0/1303996234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 msgr2=0x7f3ba410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.723+0000 7f3ba8eca640 1 --2- 172.21.15.118:0/1303996234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 0x7f3ba410b8b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009880 tx=0x7f3b8c02a530 comp rx=0 tx=0).stop 2024-09-21T12:16:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.723+0000 7f3ba8eca640 1 -- 172.21.15.118:0/1303996234 shutdown_connections 2024-09-21T12:16:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.723+0000 7f3ba8eca640 1 --2- 172.21.15.118:0/1303996234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 0x7f3ba410b8b0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.723+0000 7f3ba8eca640 1 --2- 172.21.15.118:0/1303996234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ba4102aa0 0x7f3ba4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.723+0000 7f3ba8eca640 1 -- 172.21.15.118:0/1303996234 >> 172.21.15.118:0/1303996234 conn(0x7f3ba40fc4c0 msgr2=0x7f3ba40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.723+0000 7f3ba8eca640 1 -- 172.21.15.118:0/1303996234 shutdown_connections 2024-09-21T12:16:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.723+0000 7f3ba8eca640 1 -- 172.21.15.118:0/1303996234 wait complete. 2024-09-21T12:16:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba8eca640 1 Processor -- start 2024-09-21T12:16:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba8eca640 1 -- start start 2024-09-21T12:16:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba8eca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ba4102aa0 0x7f3ba419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba8eca640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 0x7f3ba419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba8eca640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba410edd0 con 0x7f3ba41033c0 2024-09-21T12:16:02.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba8eca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba410ec50 con 0x7f3ba4102aa0 2024-09-21T12:16:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba1d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 0x7f3ba419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba1d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 0x7f3ba419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58150/0 (socket says 172.21.15.118:58150) 2024-09-21T12:16:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba1d9b640 1 -- 172.21.15.118:0/4292922923 learned_addr learned my addr 172.21.15.118:0/4292922923 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.724+0000 7f3ba259c640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ba4102aa0 0x7f3ba419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.725+0000 7f3ba1d9b640 1 -- 172.21.15.118:0/4292922923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ba4102aa0 msgr2=0x7f3ba419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.725+0000 7f3ba1d9b640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ba4102aa0 0x7f3ba419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.725+0000 7f3ba1d9b640 1 -- 172.21.15.118:0/4292922923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba4197860 con 0x7f3ba41033c0 2024-09-21T12:16:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.725+0000 7f3ba1d9b640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 0x7f3ba419dbe0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c031460 tx=0x7f3b8c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.725+0000 7f3b9b7fe640 1 -- 172.21.15.118:0/4292922923 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c03f070 con 0x7f3ba41033c0 2024-09-21T12:16:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.725+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba4197af0 con 0x7f3ba41033c0 2024-09-21T12:16:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.725+0000 7f3b9b7fe640 1 -- 172.21.15.118:0/4292922923 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b8c0035f0 con 0x7f3ba41033c0 2024-09-21T12:16:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.725+0000 7f3b9b7fe640 1 -- 172.21.15.118:0/4292922923 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c035030 con 0x7f3ba41033c0 2024-09-21T12:16:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.725+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba4198020 con 0x7f3ba41033c0 2024-09-21T12:16:02.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.726+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba406a410 con 0x7f3ba41033c0 2024-09-21T12:16:02.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.727+0000 7f3b9b7fe640 1 -- 172.21.15.118:0/4292922923 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3b8c042070 con 0x7f3ba41033c0 2024-09-21T12:16:02.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.727+0000 7f3b9b7fe640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b9007af30 0x7f3b9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:02.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.727+0000 7f3b9b7fe640 1 -- 172.21.15.118:0/4292922923 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3b8c0be9b0 con 0x7f3ba41033c0 2024-09-21T12:16:02.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.727+0000 7f3ba259c640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b9007af30 0x7f3b9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:02.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.728+0000 7f3ba259c640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b9007af30 0x7f3b9007d3f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3ba41989a0 tx=0x7f3b9c00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:02.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.732+0000 7f3b9b7fe640 1 -- 172.21.15.118:0/4292922923 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b8c089f00 con 0x7f3ba41033c0 2024-09-21T12:16:02.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.927+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3ba4104fb0 con 0x7f3b9007af30 2024-09-21T12:16:02.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.928+0000 7f3b9b7fe640 1 -- 172.21.15.118:0/4292922923 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3ba4104fb0 con 0x7f3b9007af30 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.930+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b9007af30 msgr2=0x7f3b9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.930+0000 7f3ba8eca640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b9007af30 0x7f3b9007d3f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3ba41989a0 tx=0x7f3b9c00b390 comp rx=0 tx=0).stop 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.930+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 msgr2=0x7f3ba419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.930+0000 7f3ba8eca640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 0x7f3ba419dbe0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c031460 tx=0x7f3b8c004530 comp rx=0 tx=0).stop 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.930+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 shutdown_connections 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.930+0000 7f3ba8eca640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f3b9007af30 0x7f3b9007d3f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.930+0000 7f3ba8eca640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ba41033c0 0x7f3ba419dbe0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.930+0000 7f3ba8eca640 1 --2- 172.21.15.118:0/4292922923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ba4102aa0 0x7f3ba419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.930+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 >> 172.21.15.118:0/4292922923 conn(0x7f3ba40fc4c0 msgr2=0x7f3ba4107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:02.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.931+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 shutdown_connections 2024-09-21T12:16:02.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:02.931+0000 7f3ba8eca640 1 -- 172.21.15.118:0/4292922923 wait complete. 2024-09-21T12:16:02.942 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:16:03.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.013+0000 7f90d6c6a640 1 -- 172.21.15.118:0/2294478412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 msgr2=0x7f90d0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.013+0000 7f90d6c6a640 1 --2- 172.21.15.118:0/2294478412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 0x7f90d0107d10 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009880 tx=0x7f90cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.013+0000 7f90d6c6a640 1 -- 172.21.15.118:0/2294478412 shutdown_connections 2024-09-21T12:16:03.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.013+0000 7f90d6c6a640 1 --2- 172.21.15.118:0/2294478412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0101930 0x7f90d0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.013+0000 7f90d6c6a640 1 --2- 172.21.15.118:0/2294478412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 0x7f90d0107d10 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.013+0000 7f90d6c6a640 1 -- 172.21.15.118:0/2294478412 >> 172.21.15.118:0/2294478412 conn(0x7f90d00fd630 msgr2=0x7f90d00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:03.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.013+0000 7f90d6c6a640 1 -- 172.21.15.118:0/2294478412 shutdown_connections 2024-09-21T12:16:03.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.013+0000 7f90d6c6a640 1 -- 172.21.15.118:0/2294478412 wait complete. 2024-09-21T12:16:03.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90d6c6a640 1 Processor -- start 2024-09-21T12:16:03.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90d6c6a640 1 -- start start 2024-09-21T12:16:03.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90d6c6a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0101930 0x7f90d019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90d6c6a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 0x7f90d019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90d6c6a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f90d010ee60 con 0x7f90d0107930 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90d6c6a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f90d010ece0 con 0x7f90d0101930 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90c7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 0x7f90d019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90c7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 0x7f90d019dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58178/0 (socket says 172.21.15.118:58178) 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90c7fff640 1 -- 172.21.15.118:0/553186538 learned_addr learned my addr 172.21.15.118:0/553186538 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.014+0000 7f90d4a06640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0101930 0x7f90d019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.015+0000 7f90c7fff640 1 -- 172.21.15.118:0/553186538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0101930 msgr2=0x7f90d019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.015+0000 7f90c7fff640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0101930 0x7f90d019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.015+0000 7f90c7fff640 1 -- 172.21.15.118:0/553186538 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d0197890 con 0x7f90d0107930 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.015+0000 7f90c7fff640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 0x7f90d019dc10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f90c000b420 tx=0x7f90c000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.015+0000 7f90c5ffb640 1 -- 172.21.15.118:0/553186538 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90c0011630 con 0x7f90d0107930 2024-09-21T12:16:03.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.015+0000 7f90c5ffb640 1 -- 172.21.15.118:0/553186538 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90c0016070 con 0x7f90d0107930 2024-09-21T12:16:03.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.015+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d0197b80 con 0x7f90d0107930 2024-09-21T12:16:03.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.015+0000 7f90c5ffb640 1 -- 172.21.15.118:0/553186538 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90c0010d40 con 0x7f90d0107930 2024-09-21T12:16:03.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.015+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d0198110 con 0x7f90d0107930 2024-09-21T12:16:03.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.016+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d0103070 con 0x7f90d0107930 2024-09-21T12:16:03.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.017+0000 7f90c5ffb640 1 -- 172.21.15.118:0/553186538 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f90c001b460 con 0x7f90d0107930 2024-09-21T12:16:03.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.017+0000 7f90c5ffb640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90b807af80 0x7f90b807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.018+0000 7f90d4a06640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90b807af80 0x7f90b807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.018+0000 7f90c5ffb640 1 -- 172.21.15.118:0/553186538 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f90c009d6a0 con 0x7f90d0107930 2024-09-21T12:16:03.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.018+0000 7f90d4a06640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90b807af80 0x7f90b807d440 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f90cc000c00 tx=0x7f90cc031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:03.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.022+0000 7f90c5ffb640 1 -- 172.21.15.118:0/553186538 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90c0068c70 con 0x7f90d0107930 2024-09-21T12:16:03.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.215+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f90d0198dc0 con 0x7f90b807af80 2024-09-21T12:16:03.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.216+0000 7f90c5ffb640 1 -- 172.21.15.118:0/553186538 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f90d0198dc0 con 0x7f90b807af80 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.218+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90b807af80 msgr2=0x7f90b807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.218+0000 7f90d6c6a640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90b807af80 0x7f90b807d440 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f90cc000c00 tx=0x7f90cc031400 comp rx=0 tx=0).stop 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.218+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 msgr2=0x7f90d019dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.218+0000 7f90d6c6a640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 0x7f90d019dc10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f90c000b420 tx=0x7f90c000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.218+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 shutdown_connections 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.218+0000 7f90d6c6a640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f90b807af80 0x7f90b807d440 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.218+0000 7f90d6c6a640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0107930 0x7f90d019dc10 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.218+0000 7f90d6c6a640 1 --2- 172.21.15.118:0/553186538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0101930 0x7f90d019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.218+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 >> 172.21.15.118:0/553186538 conn(0x7f90d00fd630 msgr2=0x7f90d00fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.219+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 shutdown_connections 2024-09-21T12:16:03.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.219+0000 7f90d6c6a640 1 -- 172.21.15.118:0/553186538 wait complete. 2024-09-21T12:16:03.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.300+0000 7f1da06fe640 1 -- 172.21.15.118:0/3836884004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 msgr2=0x7f1d98105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.300+0000 7f1da06fe640 1 --2- 172.21.15.118:0/3836884004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 0x7f1d98105bd0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009880 tx=0x7f1d9402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.300+0000 7f1da06fe640 1 -- 172.21.15.118:0/3836884004 shutdown_connections 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.300+0000 7f1da06fe640 1 --2- 172.21.15.118:0/3836884004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d98100fc0 0x7f1d98101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.300+0000 7f1da06fe640 1 --2- 172.21.15.118:0/3836884004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 0x7f1d98105bd0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.300+0000 7f1da06fe640 1 -- 172.21.15.118:0/3836884004 >> 172.21.15.118:0/3836884004 conn(0x7f1d980fbc60 msgr2=0x7f1d980fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.300+0000 7f1da06fe640 1 -- 172.21.15.118:0/3836884004 shutdown_connections 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.300+0000 7f1da06fe640 1 -- 172.21.15.118:0/3836884004 wait complete. 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1da06fe640 1 Processor -- start 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1da06fe640 1 -- start start 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1da06fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d98100fc0 0x7f1d980fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1da06fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 0x7f1d980fc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1da06fe640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9810dcc0 con 0x7f1d981057f0 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1da06fe640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9810db40 con 0x7f1d98100fc0 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1d9dc99640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 0x7f1d980fc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1d9dc99640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 0x7f1d980fc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58194/0 (socket says 172.21.15.118:58194) 2024-09-21T12:16:03.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1d9dc99640 1 -- 172.21.15.118:0/3345235436 learned_addr learned my addr 172.21.15.118:0/3345235436 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:03.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.301+0000 7f1d9e49a640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d98100fc0 0x7f1d980fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.302+0000 7f1d9dc99640 1 -- 172.21.15.118:0/3345235436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d98100fc0 msgr2=0x7f1d980fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.302+0000 7f1d9dc99640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d98100fc0 0x7f1d980fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.302+0000 7f1d9dc99640 1 -- 172.21.15.118:0/3345235436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d980fce60 con 0x7f1d981057f0 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.302+0000 7f1d9dc99640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 0x7f1d980fc920 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800d8d0 tx=0x7f1d8800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.302+0000 7f1d8f7fe640 1 -- 172.21.15.118:0/3345235436 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d88017030 con 0x7f1d981057f0 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.302+0000 7f1d8f7fe640 1 -- 172.21.15.118:0/3345235436 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d88004020 con 0x7f1d981057f0 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.302+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d980fd150 con 0x7f1d981057f0 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.302+0000 7f1d8f7fe640 1 -- 172.21.15.118:0/3345235436 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d880047a0 con 0x7f1d981057f0 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.302+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d981a3db0 con 0x7f1d981057f0 2024-09-21T12:16:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.303+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d98101fd0 con 0x7f1d981057f0 2024-09-21T12:16:03.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.304+0000 7f1d8f7fe640 1 -- 172.21.15.118:0/3345235436 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1d880041d0 con 0x7f1d981057f0 2024-09-21T12:16:03.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.305+0000 7f1d8f7fe640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d8407af80 0x7f1d8407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.305+0000 7f1d9e49a640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d8407af80 0x7f1d8407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.305+0000 7f1d8f7fe640 1 -- 172.21.15.118:0/3345235436 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1d88018070 con 0x7f1d981057f0 2024-09-21T12:16:03.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.305+0000 7f1d9e49a640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d8407af80 0x7f1d8407d440 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1d940096c0 tx=0x7f1d94031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:03.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.309+0000 7f1d8f7fe640 1 -- 172.21.15.118:0/3345235436 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d88069370 con 0x7f1d981057f0 2024-09-21T12:16:03.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.492+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1d98109dd0 con 0x7f1d8407af80 2024-09-21T12:16:03.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.502+0000 7f1d8f7fe640 1 -- 172.21.15.118:0/3345235436 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1d94004260 con 0x7f1d8407af80 2024-09-21T12:16:03.504 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:16:03.504 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (33m) 12m ago 44m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:16:03.504 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (37m) 12m ago 45m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:16:03.504 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (36m) 12m ago 44m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:16:03.504 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (32m) 12m ago 45m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:16:03.504 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (32m) 12m ago 44m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:16:03.504 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (33m) 12m ago 44m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (28m) 12m ago 39m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (28m) 12m ago 39m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (12m) 12m ago 39m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (27m) 12m ago 39m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (36m) 12m ago 46m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (35m) 12m ago 44m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (32m) 12m ago 46m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (32m) 12m ago 44m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (34m) 12m ago 45m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (34m) 12m ago 44m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (31m) 12m ago 42m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (31m) 12m ago 42m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (30m) 12m ago 41m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (29m) 12m ago 41m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:16:03.505 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (29m) 12m ago 41m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:16:03.506 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (28m) 12m ago 40m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:16:03.506 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (34m) 12m ago 44m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:16:03.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d8407af80 msgr2=0x7f1d8407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d8407af80 0x7f1d8407d440 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1d940096c0 tx=0x7f1d94031400 comp rx=0 tx=0).stop 2024-09-21T12:16:03.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 msgr2=0x7f1d980fc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 0x7f1d980fc920 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800d8d0 tx=0x7f1d8800dd90 comp rx=0 tx=0).stop 2024-09-21T12:16:03.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 shutdown_connections 2024-09-21T12:16:03.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1d8407af80 0x7f1d8407d440 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d981057f0 0x7f1d980fc920 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 --2- 172.21.15.118:0/3345235436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d98100fc0 0x7f1d980fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 >> 172.21.15.118:0/3345235436 conn(0x7f1d980fbc60 msgr2=0x7f1d98100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:03.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 shutdown_connections 2024-09-21T12:16:03.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.504+0000 7f1da06fe640 1 -- 172.21.15.118:0/3345235436 wait complete. 2024-09-21T12:16:03.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:03 smithi118 ceph-mon[111738]: from='client.35816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:03.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.585+0000 7fc29182a640 1 -- 172.21.15.118:0/4011511198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c100f30 msgr2=0x7fc28c101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.585+0000 7fc29182a640 1 --2- 172.21.15.118:0/4011511198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c100f30 0x7fc28c101390 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc280009880 tx=0x7fc28002a530 comp rx=0 tx=0).stop 2024-09-21T12:16:03.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.586+0000 7fc29182a640 1 -- 172.21.15.118:0/4011511198 shutdown_connections 2024-09-21T12:16:03.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.586+0000 7fc29182a640 1 --2- 172.21.15.118:0/4011511198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c100f30 0x7fc28c101390 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.586+0000 7fc29182a640 1 --2- 172.21.15.118:0/4011511198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc28c106810 0x7fc28c106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.586+0000 7fc29182a640 1 -- 172.21.15.118:0/4011511198 >> 172.21.15.118:0/4011511198 conn(0x7fc28c0fbc10 msgr2=0x7fc28c0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:03.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.586+0000 7fc29182a640 1 -- 172.21.15.118:0/4011511198 shutdown_connections 2024-09-21T12:16:03.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.586+0000 7fc29182a640 1 -- 172.21.15.118:0/4011511198 wait complete. 2024-09-21T12:16:03.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.586+0000 7fc29182a640 1 Processor -- start 2024-09-21T12:16:03.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.586+0000 7fc29182a640 1 -- start start 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc29182a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc28c100f30 0x7fc28c19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc29182a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c106810 0x7fc28c19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc29182a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c10cbd0 con 0x7fc28c106810 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc29182a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c10ca50 con 0x7fc28c100f30 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc28a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c106810 0x7fc28c19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc28a7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c106810 0x7fc28c19bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58214/0 (socket says 172.21.15.118:58214) 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc28a7fc640 1 -- 172.21.15.118:0/1450351230 learned_addr learned my addr 172.21.15.118:0/1450351230 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc28affd640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc28c100f30 0x7fc28c19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc28a7fc640 1 -- 172.21.15.118:0/1450351230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc28c100f30 msgr2=0x7fc28c19b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc28a7fc640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc28c100f30 0x7fc28c19b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc28a7fc640 1 -- 172.21.15.118:0/1450351230 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c1956c0 con 0x7fc28c106810 2024-09-21T12:16:03.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc28a7fc640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c106810 0x7fc28c19bb30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc280031460 tx=0x7fc2800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:03.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc290828640 1 -- 172.21.15.118:0/1450351230 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc28003f070 con 0x7fc28c106810 2024-09-21T12:16:03.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc290828640 1 -- 172.21.15.118:0/1450351230 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc280004cf0 con 0x7fc28c106810 2024-09-21T12:16:03.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.587+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c195950 con 0x7fc28c106810 2024-09-21T12:16:03.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.588+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c195e50 con 0x7fc28c106810 2024-09-21T12:16:03.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.588+0000 7fc290828640 1 -- 172.21.15.118:0/1450351230 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc280035030 con 0x7fc28c106810 2024-09-21T12:16:03.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.588+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc28c101f40 con 0x7fc28c106810 2024-09-21T12:16:03.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.589+0000 7fc290828640 1 -- 172.21.15.118:0/1450351230 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc280042070 con 0x7fc28c106810 2024-09-21T12:16:03.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.590+0000 7fc290828640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc27407d150 0x7fc27407f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.590+0000 7fc290828640 1 -- 172.21.15.118:0/1450351230 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc2800beac0 con 0x7fc28c106810 2024-09-21T12:16:03.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.590+0000 7fc28affd640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc27407d150 0x7fc27407f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.590+0000 7fc28affd640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc27407d150 0x7fc27407f610 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc27c005c40 tx=0x7fc27c00a570 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:03.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.594+0000 7fc290828640 1 -- 172.21.15.118:0/1450351230 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc28008a010 con 0x7fc28c106810 2024-09-21T12:16:03.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:03 smithi149 ceph-mon[79770]: from='client.35816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:03.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.844+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc28c196bf0 con 0x7fc28c106810 2024-09-21T12:16:03.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.845+0000 7fc290828640 1 -- 172.21.15.118:0/1450351230 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fc28008eec0 con 0x7fc28c106810 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:16:03.847 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:16:03.848 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:16:03.848 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:16:03.848 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:16:03.848 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:16:03.848 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:16:03.848 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:16:03.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc27407d150 msgr2=0x7fc27407f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc27407d150 0x7fc27407f610 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc27c005c40 tx=0x7fc27c00a570 comp rx=0 tx=0).stop 2024-09-21T12:16:03.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c106810 msgr2=0x7fc28c19bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c106810 0x7fc28c19bb30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc280031460 tx=0x7fc2800048f0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 shutdown_connections 2024-09-21T12:16:03.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc27407d150 0x7fc27407f610 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc28c106810 0x7fc28c19bb30 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 --2- 172.21.15.118:0/1450351230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc28c100f30 0x7fc28c19b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 >> 172.21.15.118:0/1450351230 conn(0x7fc28c0fbc10 msgr2=0x7fc28c0fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:03.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 shutdown_connections 2024-09-21T12:16:03.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.847+0000 7fc29182a640 1 -- 172.21.15.118:0/1450351230 wait complete. 2024-09-21T12:16:03.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.930+0000 7f262a121640 1 -- 172.21.15.118:0/1753766777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 msgr2=0x7f2624100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.930+0000 7f262a121640 1 --2- 172.21.15.118:0/1753766777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 0x7f2624100c80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f260c009880 tx=0x7f260c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.930+0000 7f262a121640 1 -- 172.21.15.118:0/1753766777 shutdown_connections 2024-09-21T12:16:03.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.930+0000 7f262a121640 1 --2- 172.21.15.118:0/1753766777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 0x7f2624100c80 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.930+0000 7f262a121640 1 --2- 172.21.15.118:0/1753766777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2624106820 0x7f2624106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.930+0000 7f262a121640 1 -- 172.21.15.118:0/1753766777 >> 172.21.15.118:0/1753766777 conn(0x7f26240fc520 msgr2=0x7f26240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:03.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.930+0000 7f262a121640 1 -- 172.21.15.118:0/1753766777 shutdown_connections 2024-09-21T12:16:03.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.930+0000 7f262a121640 1 -- 172.21.15.118:0/1753766777 wait complete. 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f262a121640 1 Processor -- start 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f262a121640 1 -- start start 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f262a121640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 0x7f2624198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f262a121640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2624106820 0x7f2624198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f262a121640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f262410dcf0 con 0x7f2624100820 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f262a121640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f262410db70 con 0x7f2624106820 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f26237fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 0x7f2624198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f26237fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 0x7f2624198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58236/0 (socket says 172.21.15.118:58236) 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f26237fe640 1 -- 172.21.15.118:0/2697132431 learned_addr learned my addr 172.21.15.118:0/2697132431 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f261bfff640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2624106820 0x7f2624198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f26237fe640 1 -- 172.21.15.118:0/2697132431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2624106820 msgr2=0x7f2624198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f26237fe640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2624106820 0x7f2624198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f26237fe640 1 -- 172.21.15.118:0/2697132431 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2624199340 con 0x7f2624100820 2024-09-21T12:16:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.931+0000 7f26237fe640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 0x7f2624198800 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f261400c8f0 tx=0x7f261400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.932+0000 7f26217fa640 1 -- 172.21.15.118:0/2697132431 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26140079b0 con 0x7f2624100820 2024-09-21T12:16:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.932+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2624199630 con 0x7f2624100820 2024-09-21T12:16:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.932+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26241a1c30 con 0x7f2624100820 2024-09-21T12:16:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.932+0000 7f26217fa640 1 -- 172.21.15.118:0/2697132431 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26140054e0 con 0x7f2624100820 2024-09-21T12:16:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.932+0000 7f26217fa640 1 -- 172.21.15.118:0/2697132431 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2614004dd0 con 0x7f2624100820 2024-09-21T12:16:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.933+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2624101f60 con 0x7f2624100820 2024-09-21T12:16:03.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.933+0000 7f26217fa640 1 -- 172.21.15.118:0/2697132431 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2614005020 con 0x7f2624100820 2024-09-21T12:16:03.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.934+0000 7f26217fa640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261007af30 0x7f261007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:03.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.934+0000 7f261bfff640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261007af30 0x7f261007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:03.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.934+0000 7f26217fa640 1 -- 172.21.15.118:0/2697132431 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f261409df70 con 0x7f2624100820 2024-09-21T12:16:03.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.934+0000 7f261bfff640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261007af30 0x7f261007d3f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f262406ae50 tx=0x7f260c031420 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:03.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:03.938+0000 7f26217fa640 1 -- 172.21.15.118:0/2697132431 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2624199630 con 0x7f2624100820 2024-09-21T12:16:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.151+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2624108d90 con 0x7f2624100820 2024-09-21T12:16:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.152+0000 7f26217fa640 1 -- 172.21.15.118:0/2697132431 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f2614014030 con 0x7f2624100820 2024-09-21T12:16:04.154 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:16:04.154 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:16:04.155 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:16:04.156 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:16:04.157 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:16:04.158 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:16:04.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261007af30 msgr2=0x7f261007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261007af30 0x7f261007d3f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f262406ae50 tx=0x7f260c031420 comp rx=0 tx=0).stop 2024-09-21T12:16:04.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 msgr2=0x7f2624198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 0x7f2624198800 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f261400c8f0 tx=0x7f261400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 shutdown_connections 2024-09-21T12:16:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2624106820 0x7f2624198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f261007af30 0x7f261007d3f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 --2- 172.21.15.118:0/2697132431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2624100820 0x7f2624198800 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 >> 172.21.15.118:0/2697132431 conn(0x7f26240fc520 msgr2=0x7f26240fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 shutdown_connections 2024-09-21T12:16:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.154+0000 7f262a121640 1 -- 172.21.15.118:0/2697132431 wait complete. 2024-09-21T12:16:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.235+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/120487066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100bb0 msgr2=0x7ff5f0104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.235+0000 7ff5f4f9a640 1 --2- 172.21.15.118:0/120487066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100bb0 0x7ff5f0104c00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009880 tx=0x7ff5d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.235+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/120487066 shutdown_connections 2024-09-21T12:16:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.235+0000 7ff5f4f9a640 1 --2- 172.21.15.118:0/120487066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100bb0 0x7ff5f0104c00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.235+0000 7ff5f4f9a640 1 --2- 172.21.15.118:0/120487066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5f0100200 0x7ff5f01005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.235+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/120487066 >> 172.21.15.118:0/120487066 conn(0x7ff5f00fbc60 msgr2=0x7ff5f00fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.235+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/120487066 shutdown_connections 2024-09-21T12:16:04.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.235+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/120487066 wait complete. 2024-09-21T12:16:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.236+0000 7ff5f4f9a640 1 Processor -- start 2024-09-21T12:16:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.236+0000 7ff5f4f9a640 1 -- start start 2024-09-21T12:16:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.236+0000 7ff5f4f9a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100200 0x7ff5f019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.236+0000 7ff5f4f9a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5f0100bb0 0x7ff5f019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.236+0000 7ff5f4f9a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f010d480 con 0x7ff5f0100200 2024-09-21T12:16:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.236+0000 7ff5f4f9a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f010d300 con 0x7ff5f0100bb0 2024-09-21T12:16:04.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.236+0000 7ff5ee59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100200 0x7ff5f019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.236+0000 7ff5ee59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100200 0x7ff5f019c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58258/0 (socket says 172.21.15.118:58258) 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.236+0000 7ff5ee59c640 1 -- 172.21.15.118:0/3799351719 learned_addr learned my addr 172.21.15.118:0/3799351719 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5e7fff640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5f0100bb0 0x7ff5f019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5ee59c640 1 -- 172.21.15.118:0/3799351719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5f0100bb0 msgr2=0x7ff5f019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5ee59c640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5f0100bb0 0x7ff5f019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5ee59c640 1 -- 172.21.15.118:0/3799351719 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f0196790 con 0x7ff5f0100200 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5ee59c640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100200 0x7ff5f019c610 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000d6f0 tx=0x7ff5e000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5e77fe640 1 -- 172.21.15.118:0/3799351719 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5e0017070 con 0x7ff5f0100200 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5e77fe640 1 -- 172.21.15.118:0/3799351719 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5e000de00 con 0x7ff5f0100200 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f0196a80 con 0x7ff5f0100200 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5e77fe640 1 -- 172.21.15.118:0/3799351719 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5e0004bb0 con 0x7ff5f0100200 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.237+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f0196fe0 con 0x7ff5f0100200 2024-09-21T12:16:04.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.238+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f01016e0 con 0x7ff5f0100200 2024-09-21T12:16:04.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.239+0000 7ff5e77fe640 1 -- 172.21.15.118:0/3799351719 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff5e0009a30 con 0x7ff5f0100200 2024-09-21T12:16:04.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.239+0000 7ff5e77fe640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff5dc07af80 0x7ff5dc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:04.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.239+0000 7ff5e77fe640 1 -- 172.21.15.118:0/3799351719 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff5e009dc20 con 0x7ff5f0100200 2024-09-21T12:16:04.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.239+0000 7ff5e7fff640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff5dc07af80 0x7ff5dc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:04.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.240+0000 7ff5e7fff640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff5dc07af80 0x7ff5dc07d440 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0197ae0 tx=0x7ff5d8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:04.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.244+0000 7ff5e77fe640 1 -- 172.21.15.118:0/3799351719 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5e00691f0 con 0x7ff5f0100200 2024-09-21T12:16:04.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:04 smithi118 ceph-mon[111738]: pgmap v1118: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:04.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:04 smithi118 ceph-mon[111738]: from='client.35820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:04.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:04 smithi118 ceph-mon[111738]: from='client.35824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:04.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:04 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1450351230' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:16:04.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:04 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2697132431' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:16:04.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.440+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff5f0197290 con 0x7ff5dc07af80 2024-09-21T12:16:04.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.441+0000 7ff5e77fe640 1 -- 172.21.15.118:0/3799351719 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff5f0197290 con 0x7ff5dc07af80 2024-09-21T12:16:04.443 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:16:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:16:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:16:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:16:04.444 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.443+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff5dc07af80 msgr2=0x7ff5dc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.443+0000 7ff5f4f9a640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff5dc07af80 0x7ff5dc07d440 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0197ae0 tx=0x7ff5d8031400 comp rx=0 tx=0).stop 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.443+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100200 msgr2=0x7ff5f019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.443+0000 7ff5f4f9a640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100200 0x7ff5f019c610 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000d6f0 tx=0x7ff5e000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.443+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 shutdown_connections 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.443+0000 7ff5f4f9a640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5f0100bb0 0x7ff5f019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.443+0000 7ff5f4f9a640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff5dc07af80 0x7ff5dc07d440 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.443+0000 7ff5f4f9a640 1 --2- 172.21.15.118:0/3799351719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5f0100200 0x7ff5f019c610 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.443+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 >> 172.21.15.118:0/3799351719 conn(0x7ff5f00fbc60 msgr2=0x7ff5f0103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.444+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 shutdown_connections 2024-09-21T12:16:04.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.444+0000 7ff5f4f9a640 1 -- 172.21.15.118:0/3799351719 wait complete. 2024-09-21T12:16:04.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.524+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/3558624700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 msgr2=0x7f1b84101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.524+0000 7f1b8bfb3640 1 --2- 172.21.15.118:0/3558624700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 0x7f1b84101d90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009880 tx=0x7f1b8002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.524+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/3558624700 shutdown_connections 2024-09-21T12:16:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.524+0000 7f1b8bfb3640 1 --2- 172.21.15.118:0/3558624700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 0x7f1b84101d90 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.524+0000 7f1b8bfb3640 1 --2- 172.21.15.118:0/3558624700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b84107930 0x7f1b84107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.524+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/3558624700 >> 172.21.15.118:0/3558624700 conn(0x7f1b840fd630 msgr2=0x7f1b840ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.524+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/3558624700 shutdown_connections 2024-09-21T12:16:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.524+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/3558624700 wait complete. 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b8bfb3640 1 Processor -- start 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b8bfb3640 1 -- start start 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b8bfb3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 0x7f1b8419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b8bfb3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b84107930 0x7f1b8419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b8bfb3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8410ee60 con 0x7f1b84101930 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b8bfb3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8410ece0 con 0x7f1b84107930 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b89d4f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 0x7f1b8419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b89d4f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 0x7f1b8419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58274/0 (socket says 172.21.15.118:58274) 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b89d4f640 1 -- 172.21.15.118:0/1461628122 learned_addr learned my addr 172.21.15.118:0/1461628122 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b8954e640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b84107930 0x7f1b8419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b89d4f640 1 -- 172.21.15.118:0/1461628122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b84107930 msgr2=0x7f1b8419dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b89d4f640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b84107930 0x7f1b8419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.525+0000 7f1b89d4f640 1 -- 172.21.15.118:0/1461628122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b84197870 con 0x7f1b84101930 2024-09-21T12:16:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.526+0000 7f1b89d4f640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 0x7f1b8419d6b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400b420 tx=0x7f1b7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.526+0000 7f1b7affd640 1 -- 172.21.15.118:0/1461628122 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b74011630 con 0x7f1b84101930 2024-09-21T12:16:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.526+0000 7f1b7affd640 1 -- 172.21.15.118:0/1461628122 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b74016070 con 0x7f1b84101930 2024-09-21T12:16:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.526+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b84197b60 con 0x7f1b84101930 2024-09-21T12:16:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.526+0000 7f1b7affd640 1 -- 172.21.15.118:0/1461628122 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b74010d40 con 0x7f1b84101930 2024-09-21T12:16:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.526+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841980f0 con 0x7f1b84101930 2024-09-21T12:16:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.527+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b84103070 con 0x7f1b84101930 2024-09-21T12:16:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.527+0000 7f1b7affd640 1 -- 172.21.15.118:0/1461628122 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1b7401b460 con 0x7f1b84101930 2024-09-21T12:16:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.528+0000 7f1b7affd640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af80 0x7f1b7007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.528+0000 7f1b7affd640 1 -- 172.21.15.118:0/1461628122 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1b7409d7a0 con 0x7f1b84101930 2024-09-21T12:16:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.528+0000 7f1b8954e640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af80 0x7f1b7007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:04.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.529+0000 7f1b8954e640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af80 0x7f1b7007d440 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1b80031460 tx=0x7f1b80009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:04.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.532+0000 7f1b7affd640 1 -- 172.21.15.118:0/1461628122 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1b74021250 con 0x7f1b84101930 2024-09-21T12:16:04.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:04 smithi149 ceph-mon[79770]: pgmap v1118: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:04.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:04 smithi149 ceph-mon[79770]: from='client.35820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:04.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:04 smithi149 ceph-mon[79770]: from='client.35824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:04.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:04 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1450351230' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:16:04.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:04 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2697132431' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:16:04.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.778+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1b84198da0 con 0x7f1b84101930 2024-09-21T12:16:04.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.778+0000 7f1b7affd640 1 -- 172.21.15.118:0/1461628122 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f1b74068d70 con 0x7f1b84101930 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:16:04.781 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:16:04.782 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:16:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.780+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af80 msgr2=0x7f1b7007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.780+0000 7f1b8bfb3640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af80 0x7f1b7007d440 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1b80031460 tx=0x7f1b80009560 comp rx=0 tx=0).stop 2024-09-21T12:16:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.780+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 msgr2=0x7f1b8419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.780+0000 7f1b8bfb3640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 0x7f1b8419d6b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400b420 tx=0x7f1b7400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.780+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 shutdown_connections 2024-09-21T12:16:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.780+0000 7f1b8bfb3640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b84107930 0x7f1b8419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.780+0000 7f1b8bfb3640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1b7007af80 0x7f1b7007d440 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.780+0000 7f1b8bfb3640 1 --2- 172.21.15.118:0/1461628122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b84101930 0x7f1b8419d6b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:04.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.780+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 >> 172.21.15.118:0/1461628122 conn(0x7f1b840fd630 msgr2=0x7f1b840fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:04.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.781+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 shutdown_connections 2024-09-21T12:16:04.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:04.781+0000 7f1b8bfb3640 1 -- 172.21.15.118:0/1461628122 wait complete. 2024-09-21T12:16:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:05 smithi149 ceph-mon[79770]: from='client.35836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:05 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1461628122' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:16:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:16:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:05 smithi118 ceph-mon[111738]: from='client.35836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:05 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1461628122' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:16:05.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:16:06.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:06 smithi149 ceph-mon[79770]: pgmap v1119: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:06.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:06 smithi118 ceph-mon[111738]: pgmap v1119: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:08.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:08 smithi149 ceph-mon[79770]: pgmap v1120: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:08.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:08 smithi118 ceph-mon[111738]: pgmap v1120: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:10.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:10 smithi149 ceph-mon[79770]: pgmap v1121: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:10.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:10 smithi118 ceph-mon[111738]: pgmap v1121: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:12.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:12 smithi149 ceph-mon[79770]: pgmap v1122: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:12 smithi118 ceph-mon[111738]: pgmap v1122: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:14 smithi149 ceph-mon[79770]: pgmap v1123: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:14.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:14 smithi118 ceph-mon[111738]: pgmap v1123: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:16 smithi149 ceph-mon[79770]: pgmap v1124: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:16.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:16 smithi118 ceph-mon[111738]: pgmap v1124: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:18 smithi149 ceph-mon[79770]: pgmap v1125: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:18.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:18 smithi118 ceph-mon[111738]: pgmap v1125: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:20 smithi149 ceph-mon[79770]: pgmap v1126: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:16:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:20 smithi118 ceph-mon[111738]: pgmap v1126: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:20.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:16:22.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:22 smithi149 ceph-mon[79770]: pgmap v1127: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:22.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:22 smithi118 ceph-mon[111738]: pgmap v1127: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:24 smithi149 ceph-mon[79770]: pgmap v1128: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:24.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:24 smithi118 ceph-mon[111738]: pgmap v1128: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:26 smithi149 ceph-mon[79770]: pgmap v1129: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:26 smithi118 ceph-mon[111738]: pgmap v1129: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:28 smithi149 ceph-mon[79770]: pgmap v1130: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:28 smithi118 ceph-mon[111738]: pgmap v1130: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:30.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:30 smithi149 ceph-mon[79770]: pgmap v1131: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:30.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:30 smithi118 ceph-mon[111738]: pgmap v1131: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:32.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:32 smithi118 ceph-mon[111738]: pgmap v1132: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:32.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:32 smithi149 ceph-mon[79770]: pgmap v1132: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:34.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:34 smithi118 ceph-mon[111738]: pgmap v1133: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:34.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.874+0000 7f216321b640 1 -- 172.21.15.118:0/3187230976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c0ffe50 msgr2=0x7f215c1002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:34.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.874+0000 7f216321b640 1 --2- 172.21.15.118:0/3187230976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c0ffe50 0x7f215c1002b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f214c009880 tx=0x7f214c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:34.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.874+0000 7f216321b640 1 -- 172.21.15.118:0/3187230976 shutdown_connections 2024-09-21T12:16:34.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.874+0000 7f216321b640 1 --2- 172.21.15.118:0/3187230976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c0ffe50 0x7f215c1002b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.874+0000 7f216321b640 1 --2- 172.21.15.118:0/3187230976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215c106920 0x7f215c106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.874+0000 7f216321b640 1 -- 172.21.15.118:0/3187230976 >> 172.21.15.118:0/3187230976 conn(0x7f215c0fbc60 msgr2=0x7f215c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.875+0000 7f216321b640 1 -- 172.21.15.118:0/3187230976 shutdown_connections 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.875+0000 7f216321b640 1 -- 172.21.15.118:0/3187230976 wait complete. 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.875+0000 7f216321b640 1 Processor -- start 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.875+0000 7f216321b640 1 -- start start 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.875+0000 7f216321b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215c0ffe50 0x7f215c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.875+0000 7f216321b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c106920 0x7f215c19dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.875+0000 7f216321b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f215c10ef00 con 0x7f215c106920 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.875+0000 7f216321b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f215c10ed80 con 0x7f215c0ffe50 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.875+0000 7f2153fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c106920 0x7f215c19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2153fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c106920 0x7f215c19dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33830/0 (socket says 172.21.15.118:33830) 2024-09-21T12:16:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2153fff640 1 -- 172.21.15.118:0/3190361059 learned_addr learned my addr 172.21.15.118:0/3190361059 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:34.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2160fb7640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215c0ffe50 0x7f215c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:34.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2153fff640 1 -- 172.21.15.118:0/3190361059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215c0ffe50 msgr2=0x7f215c19d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:34.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2153fff640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215c0ffe50 0x7f215c19d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:34.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2153fff640 1 -- 172.21.15.118:0/3190361059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c1978a0 con 0x7f215c106920 2024-09-21T12:16:34.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2153fff640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c106920 0x7f215c19dc20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f214c031460 tx=0x7f214c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:34.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2151ffb640 1 -- 172.21.15.118:0/3190361059 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f214c03f070 con 0x7f215c106920 2024-09-21T12:16:34.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c197b30 con 0x7f215c106920 2024-09-21T12:16:34.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2151ffb640 1 -- 172.21.15.118:0/3190361059 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f214c0035f0 con 0x7f215c106920 2024-09-21T12:16:34.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f2151ffb640 1 -- 172.21.15.118:0/3190361059 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f214c035030 con 0x7f215c106920 2024-09-21T12:16:34.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.876+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c198060 con 0x7f215c106920 2024-09-21T12:16:34.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.878+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c103170 con 0x7f215c106920 2024-09-21T12:16:34.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.878+0000 7f2151ffb640 1 -- 172.21.15.118:0/3190361059 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f214c042070 con 0x7f215c106920 2024-09-21T12:16:34.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.879+0000 7f2151ffb640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f214407af30 0x7f214407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:34.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.879+0000 7f2151ffb640 1 -- 172.21.15.118:0/3190361059 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f214c0beb20 con 0x7f215c106920 2024-09-21T12:16:34.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.879+0000 7f2160fb7640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f214407af30 0x7f214407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:34.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.879+0000 7f2160fb7640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f214407af30 0x7f214407d3f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2158005fd0 tx=0x7f2158005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:34.883+0000 7f2151ffb640 1 -- 172.21.15.118:0/3190361059 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f214c08a070 con 0x7f215c106920 2024-09-21T12:16:34.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:34 smithi149 ceph-mon[79770]: pgmap v1133: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:35.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.079+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f215c109ea0 con 0x7f214407af30 2024-09-21T12:16:35.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.080+0000 7f2151ffb640 1 -- 172.21.15.118:0/3190361059 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f215800fb90 con 0x7f214407af30 2024-09-21T12:16:35.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f214407af30 msgr2=0x7f214407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f214407af30 0x7f214407d3f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2158005fd0 tx=0x7f2158005850 comp rx=0 tx=0).stop 2024-09-21T12:16:35.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c106920 msgr2=0x7f215c19dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c106920 0x7f215c19dc20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f214c031460 tx=0x7f214c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 shutdown_connections 2024-09-21T12:16:35.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f214407af30 0x7f214407d3f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215c106920 0x7f215c19dc20 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 --2- 172.21.15.118:0/3190361059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215c0ffe50 0x7f215c19d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 >> 172.21.15.118:0/3190361059 conn(0x7f215c0fbc60 msgr2=0x7f215c0fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:35.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 shutdown_connections 2024-09-21T12:16:35.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.082+0000 7f216321b640 1 -- 172.21.15.118:0/3190361059 wait complete. 2024-09-21T12:16:35.093 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:16:35.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.165+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3202998102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 msgr2=0x7fd1e4112400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.165+0000 7fd1ebc7a640 1 --2- 172.21.15.118:0/3202998102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 0x7fd1e4112400 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009880 tx=0x7fd1d402a530 comp rx=0 tx=0).stop 2024-09-21T12:16:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.165+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3202998102 shutdown_connections 2024-09-21T12:16:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.165+0000 7fd1ebc7a640 1 --2- 172.21.15.118:0/3202998102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 0x7fd1e4112400 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.165+0000 7fd1ebc7a640 1 --2- 172.21.15.118:0/3202998102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4074590 0x7fd1e4074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.165+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3202998102 >> 172.21.15.118:0/3202998102 conn(0x7fd1e40fd630 msgr2=0x7fd1e40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.165+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3202998102 shutdown_connections 2024-09-21T12:16:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.165+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3202998102 wait complete. 2024-09-21T12:16:35.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1ebc7a640 1 Processor -- start 2024-09-21T12:16:35.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1ebc7a640 1 -- start start 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1ebc7a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4074590 0x7fd1e419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1ebc7a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 0x7fd1e419e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1ebc7a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e41153f0 con 0x7fd1e4074eb0 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1ebc7a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e4115270 con 0x7fd1e4074590 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1e9215640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 0x7fd1e419e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1e9215640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 0x7fd1e419e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33846/0 (socket says 172.21.15.118:33846) 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1e9215640 1 -- 172.21.15.118:0/3307406905 learned_addr learned my addr 172.21.15.118:0/3307406905 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1e9a16640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4074590 0x7fd1e419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.166+0000 7fd1e9215640 1 -- 172.21.15.118:0/3307406905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4074590 msgr2=0x7fd1e419dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.167+0000 7fd1e9215640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4074590 0x7fd1e419dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.167+0000 7fd1e9215640 1 -- 172.21.15.118:0/3307406905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e41a28c0 con 0x7fd1e4074eb0 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.167+0000 7fd1e9215640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 0x7fd1e419e530 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4031460 tx=0x7fd1d40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.167+0000 7fd1daffd640 1 -- 172.21.15.118:0/3307406905 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1d403f070 con 0x7fd1e4074eb0 2024-09-21T12:16:35.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.167+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e41a2b50 con 0x7fd1e4074eb0 2024-09-21T12:16:35.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.167+0000 7fd1daffd640 1 -- 172.21.15.118:0/3307406905 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1d40035f0 con 0x7fd1e4074eb0 2024-09-21T12:16:35.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.167+0000 7fd1daffd640 1 -- 172.21.15.118:0/3307406905 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1d4035030 con 0x7fd1e4074eb0 2024-09-21T12:16:35.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.167+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e41a3080 con 0x7fd1e4074eb0 2024-09-21T12:16:35.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.168+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e4075cd0 con 0x7fd1e4074eb0 2024-09-21T12:16:35.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.169+0000 7fd1daffd640 1 -- 172.21.15.118:0/3307406905 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd1d4042070 con 0x7fd1e4074eb0 2024-09-21T12:16:35.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.169+0000 7fd1daffd640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd1d007af30 0x7fd1d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:35.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.169+0000 7fd1daffd640 1 -- 172.21.15.118:0/3307406905 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd1d40bea20 con 0x7fd1e4074eb0 2024-09-21T12:16:35.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.169+0000 7fd1e9a16640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd1d007af30 0x7fd1d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:35.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.170+0000 7fd1e9a16640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd1d007af30 0x7fd1d007d3f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000bbe0 tx=0x7fd1e000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:35.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.174+0000 7fd1daffd640 1 -- 172.21.15.118:0/3307406905 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1d4089f70 con 0x7fd1e4074eb0 2024-09-21T12:16:35.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.366+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd1e41a3330 con 0x7fd1d007af30 2024-09-21T12:16:35.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.367+0000 7fd1daffd640 1 -- 172.21.15.118:0/3307406905 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd1e41a3330 con 0x7fd1d007af30 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.369+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd1d007af30 msgr2=0x7fd1d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.369+0000 7fd1ebc7a640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd1d007af30 0x7fd1d007d3f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000bbe0 tx=0x7fd1e000b390 comp rx=0 tx=0).stop 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.369+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 msgr2=0x7fd1e419e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.369+0000 7fd1ebc7a640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 0x7fd1e419e530 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4031460 tx=0x7fd1d40045e0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.370+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 shutdown_connections 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.370+0000 7fd1ebc7a640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd1d007af30 0x7fd1d007d3f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.370+0000 7fd1ebc7a640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4074eb0 0x7fd1e419e530 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.370+0000 7fd1ebc7a640 1 --2- 172.21.15.118:0/3307406905 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4074590 0x7fd1e419dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.370+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 >> 172.21.15.118:0/3307406905 conn(0x7fd1e40fd630 msgr2=0x7fd1e4104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:35.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.370+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 shutdown_connections 2024-09-21T12:16:35.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.370+0000 7fd1ebc7a640 1 -- 172.21.15.118:0/3307406905 wait complete. 2024-09-21T12:16:35.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.451+0000 7f379949a640 1 -- 172.21.15.118:0/151682045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 msgr2=0x7f3794100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.451+0000 7f379949a640 1 --2- 172.21.15.118:0/151682045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 0x7f3794100c40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f377c009880 tx=0x7f377c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.451+0000 7f379949a640 1 -- 172.21.15.118:0/151682045 shutdown_connections 2024-09-21T12:16:35.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.451+0000 7f379949a640 1 --2- 172.21.15.118:0/151682045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 0x7f3794100c40 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.451+0000 7f379949a640 1 --2- 172.21.15.118:0/151682045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37941067e0 0x7f3794106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.451+0000 7f379949a640 1 -- 172.21.15.118:0/151682045 >> 172.21.15.118:0/151682045 conn(0x7f37940fc4c0 msgr2=0x7f37940fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:35.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.451+0000 7f379949a640 1 -- 172.21.15.118:0/151682045 shutdown_connections 2024-09-21T12:16:35.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.451+0000 7f379949a640 1 -- 172.21.15.118:0/151682045 wait complete. 2024-09-21T12:16:35.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.452+0000 7f379949a640 1 Processor -- start 2024-09-21T12:16:35.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.452+0000 7f379949a640 1 -- start start 2024-09-21T12:16:35.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.452+0000 7f379949a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 0x7f379419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:35.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.452+0000 7f379949a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37941067e0 0x7f379419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:35.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.452+0000 7f379949a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f379410dd10 con 0x7f37941007e0 2024-09-21T12:16:35.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.452+0000 7f379949a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f379410db90 con 0x7f37941067e0 2024-09-21T12:16:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.452+0000 7f3792ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 0x7f379419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.452+0000 7f3792ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 0x7f379419c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50222/0 (socket says 172.21.15.118:50222) 2024-09-21T12:16:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.453+0000 7f3792ffd640 1 -- 172.21.15.118:0/1614920507 learned_addr learned my addr 172.21.15.118:0/1614920507 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.453+0000 7f37927fc640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37941067e0 0x7f379419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.453+0000 7f3792ffd640 1 -- 172.21.15.118:0/1614920507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37941067e0 msgr2=0x7f379419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.453+0000 7f3792ffd640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37941067e0 0x7f379419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.453+0000 7f3792ffd640 1 -- 172.21.15.118:0/1614920507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3794196700 con 0x7f37941007e0 2024-09-21T12:16:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.453+0000 7f3792ffd640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 0x7f379419c630 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f378400b420 tx=0x7f378400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:35.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.454+0000 7f378bfff640 1 -- 172.21.15.118:0/1614920507 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3784011630 con 0x7f37941007e0 2024-09-21T12:16:35.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.455+0000 7f378bfff640 1 -- 172.21.15.118:0/1614920507 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3784016070 con 0x7f37941007e0 2024-09-21T12:16:35.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.455+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37941969f0 con 0x7f37941007e0 2024-09-21T12:16:35.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.455+0000 7f378bfff640 1 -- 172.21.15.118:0/1614920507 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3784010d40 con 0x7f37941007e0 2024-09-21T12:16:35.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.455+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3794196f50 con 0x7f37941007e0 2024-09-21T12:16:35.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.456+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3794101f20 con 0x7f37941007e0 2024-09-21T12:16:35.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.456+0000 7f378bfff640 1 -- 172.21.15.118:0/1614920507 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f37840117d0 con 0x7f37941007e0 2024-09-21T12:16:35.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.457+0000 7f378bfff640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f378007af30 0x7f378007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:35.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.457+0000 7f378bfff640 1 -- 172.21.15.118:0/1614920507 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f378409d780 con 0x7f37941007e0 2024-09-21T12:16:35.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.457+0000 7f37927fc640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f378007af30 0x7f378007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:35.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.457+0000 7f37927fc640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f378007af30 0x7f378007d3f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3794197f50 tx=0x7f377c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:35.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.463+0000 7f378bfff640 1 -- 172.21.15.118:0/1614920507 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3784068cd0 con 0x7f37941007e0 2024-09-21T12:16:35.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.649+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3794197260 con 0x7f378007af30 2024-09-21T12:16:35.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.658+0000 7f378bfff640 1 -- 172.21.15.118:0/1614920507 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3794197260 con 0x7f378007af30 2024-09-21T12:16:35.661 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:16:35.661 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (34m) 13m ago 45m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:16:35.661 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (37m) 13m ago 45m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:16:35.661 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (36m) 13m ago 44m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:16:35.662 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (32m) 13m ago 45m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:16:35.662 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (32m) 13m ago 44m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:16:35.662 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (34m) 13m ago 45m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:16:35.662 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (28m) 13m ago 40m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:16:35.662 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (28m) 13m ago 40m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:16:35.662 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (13m) 13m ago 40m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:16:35.663 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (28m) 13m ago 40m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:16:35.663 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (36m) 13m ago 46m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:16:35.663 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (35m) 13m ago 44m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:16:35.663 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (33m) 13m ago 47m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:16:35.663 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (32m) 13m ago 44m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:16:35.663 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (35m) 13m ago 45m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:16:35.664 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (35m) 13m ago 44m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:16:35.664 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (32m) 13m ago 43m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:16:35.664 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (31m) 13m ago 42m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:16:35.664 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (30m) 13m ago 42m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:16:35.664 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (30m) 13m ago 42m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:16:35.664 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (29m) 13m ago 41m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:16:35.664 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (29m) 13m ago 41m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:16:35.665 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (34m) 13m ago 45m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:16:35.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f378007af30 msgr2=0x7f378007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f378007af30 0x7f378007d3f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3794197f50 tx=0x7f377c031400 comp rx=0 tx=0).stop 2024-09-21T12:16:35.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 msgr2=0x7f379419c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 0x7f379419c630 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f378400b420 tx=0x7f378400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 shutdown_connections 2024-09-21T12:16:35.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37941067e0 0x7f379419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f378007af30 0x7f378007d3f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 --2- 172.21.15.118:0/1614920507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37941007e0 0x7f379419c630 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 >> 172.21.15.118:0/1614920507 conn(0x7f37940fc4c0 msgr2=0x7f37940fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:35.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 shutdown_connections 2024-09-21T12:16:35.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.661+0000 7f379949a640 1 -- 172.21.15.118:0/1614920507 wait complete. 2024-09-21T12:16:35.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.740+0000 7f0bf74be640 1 -- 172.21.15.118:0/3694584876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 msgr2=0x7f0bf0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.740+0000 7f0bf74be640 1 --2- 172.21.15.118:0/3694584876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 0x7f0bf0100c80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009880 tx=0x7f0be002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.740+0000 7f0bf74be640 1 -- 172.21.15.118:0/3694584876 shutdown_connections 2024-09-21T12:16:35.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.740+0000 7f0bf74be640 1 --2- 172.21.15.118:0/3694584876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 0x7f0bf0100c80 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.740+0000 7f0bf74be640 1 --2- 172.21.15.118:0/3694584876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bf0106820 0x7f0bf0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.740+0000 7f0bf74be640 1 -- 172.21.15.118:0/3694584876 >> 172.21.15.118:0/3694584876 conn(0x7f0bf00fc520 msgr2=0x7f0bf00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:35.747 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:16:35.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.740+0000 7f0bf74be640 1 -- 172.21.15.118:0/3694584876 shutdown_connections 2024-09-21T12:16:35.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.740+0000 7f0bf74be640 1 -- 172.21.15.118:0/3694584876 wait complete. 2024-09-21T12:16:35.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.741+0000 7f0bf74be640 1 Processor -- start 2024-09-21T12:16:35.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.741+0000 7f0bf74be640 1 -- start start 2024-09-21T12:16:35.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.741+0000 7f0bf74be640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 0x7f0bf00fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:35.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.741+0000 7f0bf74be640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bf0106820 0x7f0bf00fd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:35.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.741+0000 7f0bf74be640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf010dcf0 con 0x7f0bf0100820 2024-09-21T12:16:35.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.741+0000 7f0bf74be640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf010db70 con 0x7f0bf0106820 2024-09-21T12:16:35.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.741+0000 7f0bf525a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 0x7f0bf00fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:35.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.741+0000 7f0bf525a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 0x7f0bf00fcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50238/0 (socket says 172.21.15.118:50238) 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.741+0000 7f0bf525a640 1 -- 172.21.15.118:0/1674593193 learned_addr learned my addr 172.21.15.118:0/1674593193 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0bf4a59640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bf0106820 0x7f0bf00fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0bf525a640 1 -- 172.21.15.118:0/1674593193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bf0106820 msgr2=0x7f0bf00fd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0bf525a640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bf0106820 0x7f0bf00fd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0bf525a640 1 -- 172.21.15.118:0/1674593193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf00fd640 con 0x7f0bf0100820 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0bf4a59640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bf0106820 0x7f0bf00fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0bf525a640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 0x7f0bf00fcbc0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c8f0 tx=0x7f0bec00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0be67fc640 1 -- 172.21.15.118:0/1674593193 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0bec0079b0 con 0x7f0bf0100820 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0be67fc640 1 -- 172.21.15.118:0/1674593193 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0bec0054e0 con 0x7f0bf0100820 2024-09-21T12:16:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf00fd930 con 0x7f0bf0100820 2024-09-21T12:16:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0be67fc640 1 -- 172.21.15.118:0/1674593193 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0bec004dd0 con 0x7f0bf0100820 2024-09-21T12:16:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.742+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf01a3e60 con 0x7f0bf0100820 2024-09-21T12:16:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.743+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf0101f60 con 0x7f0bf0100820 2024-09-21T12:16:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.744+0000 7f0be67fc640 1 -- 172.21.15.118:0/1674593193 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0bec005020 con 0x7f0bf0100820 2024-09-21T12:16:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.745+0000 7f0be67fc640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0bdc07af30 0x7f0bdc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.745+0000 7f0be67fc640 1 -- 172.21.15.118:0/1674593193 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0bec09dfe0 con 0x7f0bf0100820 2024-09-21T12:16:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.745+0000 7f0bf4a59640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0bdc07af30 0x7f0bdc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.745+0000 7f0bf4a59640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0bdc07af30 0x7f0bdc07d3f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00fe650 tx=0x7f0be0009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:35.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.749+0000 7f0be67fc640 1 -- 172.21.15.118:0/1674593193 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0bec014030 con 0x7f0bf0100820 2024-09-21T12:16:35.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:16:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.994+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0bf0109da0 con 0x7f0bf0100820 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.995+0000 7f0be67fc640 1 -- 172.21.15.118:0/1674593193 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f0bec069570 con 0x7f0bf0100820 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:16:35.997 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:16:35.998 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:16:35.998 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:16:35.998 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:16:35.998 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:16:35.998 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:16:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0bdc07af30 msgr2=0x7f0bdc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0bdc07af30 0x7f0bdc07d3f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00fe650 tx=0x7f0be0009560 comp rx=0 tx=0).stop 2024-09-21T12:16:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 msgr2=0x7f0bf00fcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 0x7f0bf00fcbc0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c8f0 tx=0x7f0bec00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:16:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 shutdown_connections 2024-09-21T12:16:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bf0106820 0x7f0bf00fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0bdc07af30 0x7f0bdc07d3f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 --2- 172.21.15.118:0/1674593193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bf0100820 0x7f0bf00fcbc0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 >> 172.21.15.118:0/1674593193 conn(0x7f0bf00fc520 msgr2=0x7f0bf006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 shutdown_connections 2024-09-21T12:16:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:35.997+0000 7f0bf74be640 1 -- 172.21.15.118:0/1674593193 wait complete. 2024-09-21T12:16:36.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.078+0000 7fe1efdfb640 1 -- 172.21.15.118:0/2886443867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8103460 msgr2=0x7fe1e810b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.078+0000 7fe1efdfb640 1 --2- 172.21.15.118:0/2886443867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8103460 0x7fe1e810b950 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80098b0 tx=0x7fe1d802a560 comp rx=0 tx=0).stop 2024-09-21T12:16:36.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.078+0000 7fe1efdfb640 1 -- 172.21.15.118:0/2886443867 shutdown_connections 2024-09-21T12:16:36.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.078+0000 7fe1efdfb640 1 --2- 172.21.15.118:0/2886443867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8103460 0x7fe1e810b950 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.078+0000 7fe1efdfb640 1 --2- 172.21.15.118:0/2886443867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e8102b40 0x7fe1e8102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.078+0000 7fe1efdfb640 1 -- 172.21.15.118:0/2886443867 >> 172.21.15.118:0/2886443867 conn(0x7fe1e80fc520 msgr2=0x7fe1e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:36.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.078+0000 7fe1efdfb640 1 -- 172.21.15.118:0/2886443867 shutdown_connections 2024-09-21T12:16:36.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.078+0000 7fe1efdfb640 1 -- 172.21.15.118:0/2886443867 wait complete. 2024-09-21T12:16:36.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1efdfb640 1 Processor -- start 2024-09-21T12:16:36.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1efdfb640 1 -- start start 2024-09-21T12:16:36.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1efdfb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8102b40 0x7fe1e819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:36.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1efdfb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e8103460 0x7fe1e819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:36.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1efdfb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e810ee10 con 0x7fe1e8102b40 2024-09-21T12:16:36.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1efdfb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e810ec90 con 0x7fe1e8103460 2024-09-21T12:16:36.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1edb97640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8102b40 0x7fe1e819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:36.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1edb97640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8102b40 0x7fe1e819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50256/0 (socket says 172.21.15.118:50256) 2024-09-21T12:16:36.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1edb97640 1 -- 172.21.15.118:0/3888564810 learned_addr learned my addr 172.21.15.118:0/3888564810 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:36.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1ed396640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e8103460 0x7fe1e819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:36.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1edb97640 1 -- 172.21.15.118:0/3888564810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e8103460 msgr2=0x7fe1e819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1edb97640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e8103460 0x7fe1e819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.079+0000 7fe1edb97640 1 -- 172.21.15.118:0/3888564810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e8197840 con 0x7fe1e8102b40 2024-09-21T12:16:36.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.080+0000 7fe1edb97640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8102b40 0x7fe1e819d6c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400d6f0 tx=0x7fe1e400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:36.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.080+0000 7fe1deffd640 1 -- 172.21.15.118:0/3888564810 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1e4017070 con 0x7fe1e8102b40 2024-09-21T12:16:36.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.080+0000 7fe1deffd640 1 -- 172.21.15.118:0/3888564810 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1e400de00 con 0x7fe1e8102b40 2024-09-21T12:16:36.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.080+0000 7fe1deffd640 1 -- 172.21.15.118:0/3888564810 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1e4004bb0 con 0x7fe1e8102b40 2024-09-21T12:16:36.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.080+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e8197b30 con 0x7fe1e8102b40 2024-09-21T12:16:36.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.080+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e8198090 con 0x7fe1e8102b40 2024-09-21T12:16:36.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.081+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e806ab80 con 0x7fe1e8102b40 2024-09-21T12:16:36.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.081+0000 7fe1deffd640 1 -- 172.21.15.118:0/3888564810 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe1e4004e60 con 0x7fe1e8102b40 2024-09-21T12:16:36.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.082+0000 7fe1deffd640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1d407af30 0x7fe1d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:36.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.082+0000 7fe1deffd640 1 -- 172.21.15.118:0/3888564810 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe1e409dc50 con 0x7fe1e8102b40 2024-09-21T12:16:36.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.082+0000 7fe1ed396640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1d407af30 0x7fe1d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:36.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.083+0000 7fe1ed396640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1d407af30 0x7fe1d407d3f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000c00 tx=0x7fe1d8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:36.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.086+0000 7fe1deffd640 1 -- 172.21.15.118:0/3888564810 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1e40691a0 con 0x7fe1e8102b40 2024-09-21T12:16:36.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.298+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe1e8105fd0 con 0x7fe1e8102b40 2024-09-21T12:16:36.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.298+0000 7fe1deffd640 1 -- 172.21.15.118:0/3888564810 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7fe1e406e050 con 0x7fe1e8102b40 2024-09-21T12:16:36.300 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:16:36.301 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:16:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:16:36.303 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:16:36.304 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:16:36.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1d407af30 msgr2=0x7fe1d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1d407af30 0x7fe1d407d3f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000c00 tx=0x7fe1d8031400 comp rx=0 tx=0).stop 2024-09-21T12:16:36.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8102b40 msgr2=0x7fe1e819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8102b40 0x7fe1e819d6c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400d6f0 tx=0x7fe1e400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 shutdown_connections 2024-09-21T12:16:36.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e8103460 0x7fe1e819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1d407af30 0x7fe1d407d3f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 --2- 172.21.15.118:0/3888564810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e8102b40 0x7fe1e819d6c0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 >> 172.21.15.118:0/3888564810 conn(0x7fe1e80fc520 msgr2=0x7fe1e8103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:36.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 shutdown_connections 2024-09-21T12:16:36.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.301+0000 7fe1efdfb640 1 -- 172.21.15.118:0/3888564810 wait complete. 2024-09-21T12:16:36.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.383+0000 7f1966d80640 1 -- 172.21.15.118:0/4236751970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 msgr2=0x7f1960101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.383+0000 7f1966d80640 1 --2- 172.21.15.118:0/4236751970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 0x7f1960101d90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f194c009880 tx=0x7f194c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.383+0000 7f1966d80640 1 -- 172.21.15.118:0/4236751970 shutdown_connections 2024-09-21T12:16:36.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.383+0000 7f1966d80640 1 --2- 172.21.15.118:0/4236751970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 0x7f1960101d90 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.383+0000 7f1966d80640 1 --2- 172.21.15.118:0/4236751970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1960107930 0x7f1960107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.383+0000 7f1966d80640 1 -- 172.21.15.118:0/4236751970 >> 172.21.15.118:0/4236751970 conn(0x7f19600fd630 msgr2=0x7f19600ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:36.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.383+0000 7f1966d80640 1 -- 172.21.15.118:0/4236751970 shutdown_connections 2024-09-21T12:16:36.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.383+0000 7f1966d80640 1 -- 172.21.15.118:0/4236751970 wait complete. 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.384+0000 7f1966d80640 1 Processor -- start 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.384+0000 7f1966d80640 1 -- start start 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.384+0000 7f1966d80640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 0x7f196019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.384+0000 7f1966d80640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1960107930 0x7f196019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.384+0000 7f1966d80640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f196010ee00 con 0x7f1960101930 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.384+0000 7f1966d80640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f196010ec80 con 0x7f1960107930 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.384+0000 7f1964b1c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 0x7f196019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.384+0000 7f1964b1c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 0x7f196019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50274/0 (socket says 172.21.15.118:50274) 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.384+0000 7f1964b1c640 1 -- 172.21.15.118:0/660242082 learned_addr learned my addr 172.21.15.118:0/660242082 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f195ffff640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1960107930 0x7f196019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f1964b1c640 1 -- 172.21.15.118:0/660242082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1960107930 msgr2=0x7f196019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f1964b1c640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1960107930 0x7f196019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f1964b1c640 1 -- 172.21.15.118:0/660242082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1960197810 con 0x7f1960101930 2024-09-21T12:16:36.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f195ffff640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1960107930 0x7f196019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:16:36.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f1964b1c640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 0x7f196019d690 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f195400d6f0 tx=0x7f195400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:36.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f195dffb640 1 -- 172.21.15.118:0/660242082 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1954017070 con 0x7f1960101930 2024-09-21T12:16:36.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1960197b00 con 0x7f1960101930 2024-09-21T12:16:36.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f195dffb640 1 -- 172.21.15.118:0/660242082 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f195400de00 con 0x7f1960101930 2024-09-21T12:16:36.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f195dffb640 1 -- 172.21.15.118:0/660242082 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1954004bb0 con 0x7f1960101930 2024-09-21T12:16:36.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.385+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1960198060 con 0x7f1960101930 2024-09-21T12:16:36.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.386+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1960103070 con 0x7f1960101930 2024-09-21T12:16:36.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.387+0000 7f195dffb640 1 -- 172.21.15.118:0/660242082 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1954004e60 con 0x7f1960101930 2024-09-21T12:16:36.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.387+0000 7f195dffb640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f195007af30 0x7f195007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:36.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.387+0000 7f195dffb640 1 -- 172.21.15.118:0/660242082 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f195409dd00 con 0x7f1960101930 2024-09-21T12:16:36.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.387+0000 7f195ffff640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f195007af30 0x7f195007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:36.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.388+0000 7f195ffff640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f195007af30 0x7f195007d3f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1960198b60 tx=0x7f194c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:36.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.391+0000 7f195dffb640 1 -- 172.21.15.118:0/660242082 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19540a1030 con 0x7f1960101930 2024-09-21T12:16:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:36 smithi118 ceph-mon[111738]: from='client.35844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:36 smithi118 ceph-mon[111738]: pgmap v1134: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:36 smithi118 ceph-mon[111738]: from='client.35848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:36 smithi118 ceph-mon[111738]: from='client.35852 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:36 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1674593193' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:16:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:36 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3888564810' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:16:36.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.588+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1960198310 con 0x7f195007af30 2024-09-21T12:16:36.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.589+0000 7f195dffb640 1 -- 172.21.15.118:0/660242082 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1960198310 con 0x7f195007af30 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:16:36.592 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:16:36.593 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:16:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f195007af30 msgr2=0x7f195007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f195007af30 0x7f195007d3f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1960198b60 tx=0x7f194c031400 comp rx=0 tx=0).stop 2024-09-21T12:16:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 msgr2=0x7f196019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 0x7f196019d690 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f195400d6f0 tx=0x7f195400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 shutdown_connections 2024-09-21T12:16:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1960107930 0x7f196019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f195007af30 0x7f195007d3f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 --2- 172.21.15.118:0/660242082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1960101930 0x7f196019d690 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 >> 172.21.15.118:0/660242082 conn(0x7f19600fd630 msgr2=0x7f19600fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:36.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 shutdown_connections 2024-09-21T12:16:36.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.592+0000 7f1966d80640 1 -- 172.21.15.118:0/660242082 wait complete. 2024-09-21T12:16:36.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.673+0000 7ff010541640 1 -- 172.21.15.118:0/4280809215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008107930 msgr2=0x7ff008107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.673+0000 7ff010541640 1 --2- 172.21.15.118:0/4280809215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008107930 0x7ff008107d10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff004009880 tx=0x7ff00402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.673+0000 7ff010541640 1 -- 172.21.15.118:0/4280809215 shutdown_connections 2024-09-21T12:16:36.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.673+0000 7ff010541640 1 --2- 172.21.15.118:0/4280809215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff008101930 0x7ff008101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.673+0000 7ff010541640 1 --2- 172.21.15.118:0/4280809215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008107930 0x7ff008107d10 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.673+0000 7ff010541640 1 -- 172.21.15.118:0/4280809215 >> 172.21.15.118:0/4280809215 conn(0x7ff0080fd630 msgr2=0x7ff0080ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.673+0000 7ff010541640 1 -- 172.21.15.118:0/4280809215 shutdown_connections 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.673+0000 7ff010541640 1 -- 172.21.15.118:0/4280809215 wait complete. 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.674+0000 7ff010541640 1 Processor -- start 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.674+0000 7ff010541640 1 -- start start 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.674+0000 7ff010541640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008101930 0x7ff0080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.674+0000 7ff010541640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff008107930 0x7ff008074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.674+0000 7ff010541640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff00810ee00 con 0x7ff008101930 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.674+0000 7ff010541640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff00810ec80 con 0x7ff008107930 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.674+0000 7ff00e2dd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008101930 0x7ff0080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.674+0000 7ff00e2dd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008101930 0x7ff0080744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50302/0 (socket says 172.21.15.118:50302) 2024-09-21T12:16:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.674+0000 7ff00e2dd640 1 -- 172.21.15.118:0/1812226495 learned_addr learned my addr 172.21.15.118:0/1812226495 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:16:36.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7ff00dadc640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff008107930 0x7ff008074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7ff00e2dd640 1 -- 172.21.15.118:0/1812226495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff008107930 msgr2=0x7ff008074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7ff00e2dd640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff008107930 0x7ff008074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7ff00e2dd640 1 -- 172.21.15.118:0/1812226495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff008074f70 con 0x7ff008101930 2024-09-21T12:16:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7ff00e2dd640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008101930 0x7ff0080744f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff004031460 tx=0x7ff004004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7fefff7fe640 1 -- 172.21.15.118:0/1812226495 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff00403f070 con 0x7ff008101930 2024-09-21T12:16:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff008075200 con 0x7ff008101930 2024-09-21T12:16:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7fefff7fe640 1 -- 172.21.15.118:0/1812226495 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0040035f0 con 0x7ff008101930 2024-09-21T12:16:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7fefff7fe640 1 -- 172.21.15.118:0/1812226495 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff004035030 con 0x7ff008101930 2024-09-21T12:16:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.675+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0081a3db0 con 0x7ff008101930 2024-09-21T12:16:36.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.676+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff008103070 con 0x7ff008101930 2024-09-21T12:16:36.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.677+0000 7fefff7fe640 1 -- 172.21.15.118:0/1812226495 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff004042070 con 0x7ff008101930 2024-09-21T12:16:36.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.677+0000 7fefff7fe640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feff407af30 0x7feff407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:36.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.677+0000 7fefff7fe640 1 -- 172.21.15.118:0/1812226495 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff0040bea60 con 0x7ff008101930 2024-09-21T12:16:36.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.677+0000 7ff00dadc640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feff407af30 0x7feff407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:36.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.678+0000 7ff00dadc640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feff407af30 0x7feff407d3f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff008075f80 tx=0x7feff8005f90 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:36.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.682+0000 7fefff7fe640 1 -- 172.21.15.118:0/1812226495 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff004089fb0 con 0x7ff008101930 2024-09-21T12:16:36.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.938+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff008109ea0 con 0x7ff008101930 2024-09-21T12:16:36.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.938+0000 7fefff7fe640 1 -- 172.21.15.118:0/1812226495 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7ff00408ee60 con 0x7ff008101930 2024-09-21T12:16:36.941 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:16:36.941 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:16:36.942 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:16:36.942 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:16:36.942 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:16:36.942 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:16:36.942 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:16:36.942 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:16:36.942 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:16:36.943 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:16:36.944 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:16:36.944 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:16:36.944 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:16:36.944 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:16:36.944 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:16:36.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feff407af30 msgr2=0x7feff407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feff407af30 0x7feff407d3f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff008075f80 tx=0x7feff8005f90 comp rx=0 tx=0).stop 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008101930 msgr2=0x7ff0080744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008101930 0x7ff0080744f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff004031460 tx=0x7ff004004530 comp rx=0 tx=0).stop 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 shutdown_connections 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff008107930 0x7ff008074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7feff407af30 0x7feff407d3f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 --2- 172.21.15.118:0/1812226495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff008101930 0x7ff0080744f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 >> 172.21.15.118:0/1812226495 conn(0x7ff0080fd630 msgr2=0x7ff0080fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 shutdown_connections 2024-09-21T12:16:36.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:16:36.941+0000 7ff010541640 1 -- 172.21.15.118:0/1812226495 wait complete. 2024-09-21T12:16:36.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:36 smithi149 ceph-mon[79770]: from='client.35844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:36.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:36 smithi149 ceph-mon[79770]: pgmap v1134: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:36.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:36 smithi149 ceph-mon[79770]: from='client.35848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:36 smithi149 ceph-mon[79770]: from='client.35852 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:36 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1674593193' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:16:36.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:36 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3888564810' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:16:37.725 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:37 smithi118 ceph-mon[111738]: from='client.35864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:37.725 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:37 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1812226495' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:16:37.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:37 smithi149 ceph-mon[79770]: from='client.35864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:37.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:37 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1812226495' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:16:38.784 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:38 smithi149 ceph-mon[79770]: pgmap v1135: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:38.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:38 smithi118 ceph-mon[111738]: pgmap v1135: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:40.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:40 smithi118 ceph-mon[111738]: pgmap v1136: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:40.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:40 smithi149 ceph-mon[79770]: pgmap v1136: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:42.801 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:42 smithi118 ceph-mon[111738]: pgmap v1137: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:42.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:42 smithi149 ceph-mon[79770]: pgmap v1137: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:44.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:44 smithi118 ceph-mon[111738]: pgmap v1138: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:44.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:44 smithi149 ceph-mon[79770]: pgmap v1138: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:46.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:46 smithi118 ceph-mon[111738]: pgmap v1139: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:46.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:46 smithi149 ceph-mon[79770]: pgmap v1139: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:48.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:48 smithi118 ceph-mon[111738]: pgmap v1140: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:48.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:48 smithi149 ceph-mon[79770]: pgmap v1140: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:50 smithi118 ceph-mon[111738]: pgmap v1141: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:50.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:16:50.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:50 smithi149 ceph-mon[79770]: pgmap v1141: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:50.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:16:52.752 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:52 smithi149 ceph-mon[79770]: pgmap v1142: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:52.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:52 smithi118 ceph-mon[111738]: pgmap v1142: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:54.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:54 smithi118 ceph-mon[111738]: pgmap v1143: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:54.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:54 smithi149 ceph-mon[79770]: pgmap v1143: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:56.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:56 smithi118 ceph-mon[111738]: pgmap v1144: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:56.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:56 smithi149 ceph-mon[79770]: pgmap v1144: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:16:58 smithi118 ceph-mon[111738]: pgmap v1145: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:16:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:16:58 smithi149 ceph-mon[79770]: pgmap v1145: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:00 smithi149 ceph-mon[79770]: pgmap v1146: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:00 smithi118 ceph-mon[111738]: pgmap v1146: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:02 smithi149 ceph-mon[79770]: pgmap v1147: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:02.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:02 smithi118 ceph-mon[111738]: pgmap v1147: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:04 smithi149 ceph-mon[79770]: pgmap v1148: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:04.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:04 smithi118 ceph-mon[111738]: pgmap v1148: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:17:05.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:17:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:06 smithi118 ceph-mon[111738]: pgmap v1149: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:06.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:06 smithi149 ceph-mon[79770]: pgmap v1149: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:07.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.036+0000 7fc61df9f640 1 -- 172.21.15.118:0/2465457520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618106620 msgr2=0x7fc618106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.036+0000 7fc61df9f640 1 --2- 172.21.15.118:0/2465457520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618106620 0x7fc618106a00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009880 tx=0x7fc60c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.036+0000 7fc61df9f640 1 -- 172.21.15.118:0/2465457520 shutdown_connections 2024-09-21T12:17:07.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.036+0000 7fc61df9f640 1 --2- 172.21.15.118:0/2465457520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc618100620 0x7fc618100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.036+0000 7fc61df9f640 1 --2- 172.21.15.118:0/2465457520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618106620 0x7fc618106a00 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.036+0000 7fc61df9f640 1 -- 172.21.15.118:0/2465457520 >> 172.21.15.118:0/2465457520 conn(0x7fc6180fc360 msgr2=0x7fc6180fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.036+0000 7fc61df9f640 1 -- 172.21.15.118:0/2465457520 shutdown_connections 2024-09-21T12:17:07.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.036+0000 7fc61df9f640 1 -- 172.21.15.118:0/2465457520 wait complete. 2024-09-21T12:17:07.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61df9f640 1 Processor -- start 2024-09-21T12:17:07.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61df9f640 1 -- start start 2024-09-21T12:17:07.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61df9f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618100620 0x7fc61819d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61df9f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc618106620 0x7fc61819daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61df9f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc61810db50 con 0x7fc618100620 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61df9f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc61810d9d0 con 0x7fc618106620 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61cf9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618100620 0x7fc61819d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61cf9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618100620 0x7fc61819d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32876/0 (socket says 172.21.15.118:32876) 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61cf9d640 1 -- 172.21.15.118:0/1054310564 learned_addr learned my addr 172.21.15.118:0/1054310564 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc617fff640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc618106620 0x7fc61819daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61cf9d640 1 -- 172.21.15.118:0/1054310564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc618106620 msgr2=0x7fc61819daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61cf9d640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc618106620 0x7fc61819daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc61cf9d640 1 -- 172.21.15.118:0/1054310564 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc618197630 con 0x7fc618100620 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.037+0000 7fc617fff640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc618106620 0x7fc61819daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.038+0000 7fc61cf9d640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618100620 0x7fc61819d560 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc60c031460 tx=0x7fc60c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.038+0000 7fc615ffb640 1 -- 172.21.15.118:0/1054310564 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc60c03f070 con 0x7fc618100620 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.038+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6181978c0 con 0x7fc618100620 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.038+0000 7fc615ffb640 1 -- 172.21.15.118:0/1054310564 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc60c004cf0 con 0x7fc618100620 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.038+0000 7fc615ffb640 1 -- 172.21.15.118:0/1054310564 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc60c035030 con 0x7fc618100620 2024-09-21T12:17:07.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.038+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc618197dc0 con 0x7fc618100620 2024-09-21T12:17:07.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.039+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc618101d60 con 0x7fc618100620 2024-09-21T12:17:07.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.040+0000 7fc615ffb640 1 -- 172.21.15.118:0/1054310564 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc60c042070 con 0x7fc618100620 2024-09-21T12:17:07.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.041+0000 7fc615ffb640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc60807af30 0x7fc60807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.041+0000 7fc615ffb640 1 -- 172.21.15.118:0/1054310564 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc60c0bec10 con 0x7fc618100620 2024-09-21T12:17:07.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.041+0000 7fc617fff640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc60807af30 0x7fc60807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.041+0000 7fc617fff640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc60807af30 0x7fc60807d3f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc604006fd0 tx=0x7fc604008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.045+0000 7fc615ffb640 1 -- 172.21.15.118:0/1054310564 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc60c08a100 con 0x7fc618100620 2024-09-21T12:17:07.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.241+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc618198070 con 0x7fc60807af30 2024-09-21T12:17:07.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.242+0000 7fc615ffb640 1 -- 172.21.15.118:0/1054310564 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc618198070 con 0x7fc60807af30 2024-09-21T12:17:07.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc60807af30 msgr2=0x7fc60807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc60807af30 0x7fc60807d3f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc604006fd0 tx=0x7fc604008040 comp rx=0 tx=0).stop 2024-09-21T12:17:07.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618100620 msgr2=0x7fc61819d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618100620 0x7fc61819d560 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc60c031460 tx=0x7fc60c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 shutdown_connections 2024-09-21T12:17:07.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc618106620 0x7fc61819daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc60807af30 0x7fc60807d3f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 --2- 172.21.15.118:0/1054310564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc618100620 0x7fc61819d560 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 >> 172.21.15.118:0/1054310564 conn(0x7fc6180fc360 msgr2=0x7fc618104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 shutdown_connections 2024-09-21T12:17:07.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.245+0000 7fc61df9f640 1 -- 172.21.15.118:0/1054310564 wait complete. 2024-09-21T12:17:07.255 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:17:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.328+0000 7fd465aa2640 1 -- 172.21.15.118:0/1953176093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460107930 msgr2=0x7fd460107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.328+0000 7fd465aa2640 1 --2- 172.21.15.118:0/1953176093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460107930 0x7fd460107d10 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd450009880 tx=0x7fd45002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.328+0000 7fd465aa2640 1 -- 172.21.15.118:0/1953176093 shutdown_connections 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.328+0000 7fd465aa2640 1 --2- 172.21.15.118:0/1953176093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd460101930 0x7fd460101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.328+0000 7fd465aa2640 1 --2- 172.21.15.118:0/1953176093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460107930 0x7fd460107d10 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.328+0000 7fd465aa2640 1 -- 172.21.15.118:0/1953176093 >> 172.21.15.118:0/1953176093 conn(0x7fd4600fd630 msgr2=0x7fd4600ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.328+0000 7fd465aa2640 1 -- 172.21.15.118:0/1953176093 shutdown_connections 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.328+0000 7fd465aa2640 1 -- 172.21.15.118:0/1953176093 wait complete. 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd465aa2640 1 Processor -- start 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd465aa2640 1 -- start start 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd465aa2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460101930 0x7fd46019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd465aa2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd460107930 0x7fd46019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd465aa2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd46010ee00 con 0x7fd460101930 2024-09-21T12:17:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd465aa2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd46010ec80 con 0x7fd460107930 2024-09-21T12:17:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd45f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460101930 0x7fd46019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd45f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460101930 0x7fd46019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32888/0 (socket says 172.21.15.118:32888) 2024-09-21T12:17:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd45f7fe640 1 -- 172.21.15.118:0/3839883772 learned_addr learned my addr 172.21.15.118:0/3839883772 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd457fff640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd460107930 0x7fd46019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd45f7fe640 1 -- 172.21.15.118:0/3839883772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd460107930 msgr2=0x7fd46019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd45f7fe640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd460107930 0x7fd46019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.329+0000 7fd45f7fe640 1 -- 172.21.15.118:0/3839883772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4601977f0 con 0x7fd460101930 2024-09-21T12:17:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.330+0000 7fd45f7fe640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460101930 0x7fd46019d670 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd450031460 tx=0x7fd4500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.330+0000 7fd45d7fa640 1 -- 172.21.15.118:0/3839883772 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd45003f070 con 0x7fd460101930 2024-09-21T12:17:07.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.330+0000 7fd45d7fa640 1 -- 172.21.15.118:0/3839883772 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4500035f0 con 0x7fd460101930 2024-09-21T12:17:07.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.330+0000 7fd45d7fa640 1 -- 172.21.15.118:0/3839883772 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd450035030 con 0x7fd460101930 2024-09-21T12:17:07.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.330+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd460197a80 con 0x7fd460101930 2024-09-21T12:17:07.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.330+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd460197fb0 con 0x7fd460101930 2024-09-21T12:17:07.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.331+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd460103070 con 0x7fd460101930 2024-09-21T12:17:07.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.332+0000 7fd45d7fa640 1 -- 172.21.15.118:0/3839883772 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd450042070 con 0x7fd460101930 2024-09-21T12:17:07.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.332+0000 7fd45d7fa640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd44c07af80 0x7fd44c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.332+0000 7fd45d7fa640 1 -- 172.21.15.118:0/3839883772 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd4500be9c0 con 0x7fd460101930 2024-09-21T12:17:07.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.332+0000 7fd457fff640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd44c07af80 0x7fd44c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.332+0000 7fd457fff640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd44c07af80 0x7fd44c07d440 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd448005fd0 tx=0x7fd448005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.336+0000 7fd45d7fa640 1 -- 172.21.15.118:0/3839883772 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd450089f90 con 0x7fd460101930 2024-09-21T12:17:07.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.527+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd460198320 con 0x7fd44c07af80 2024-09-21T12:17:07.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.529+0000 7fd45d7fa640 1 -- 172.21.15.118:0/3839883772 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd460198320 con 0x7fd44c07af80 2024-09-21T12:17:07.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd44c07af80 msgr2=0x7fd44c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd44c07af80 0x7fd44c07d440 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd448005fd0 tx=0x7fd448005850 comp rx=0 tx=0).stop 2024-09-21T12:17:07.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460101930 msgr2=0x7fd46019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460101930 0x7fd46019d670 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd450031460 tx=0x7fd4500045e0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 shutdown_connections 2024-09-21T12:17:07.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd460107930 0x7fd46019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd44c07af80 0x7fd44c07d440 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 --2- 172.21.15.118:0/3839883772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd460101930 0x7fd46019d670 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 >> 172.21.15.118:0/3839883772 conn(0x7fd4600fd630 msgr2=0x7fd4600fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 shutdown_connections 2024-09-21T12:17:07.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.531+0000 7fd465aa2640 1 -- 172.21.15.118:0/3839883772 wait complete. 2024-09-21T12:17:07.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.612+0000 7f411d0a8640 1 -- 172.21.15.118:0/1161590736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 msgr2=0x7f4118100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.612+0000 7f411d0a8640 1 --2- 172.21.15.118:0/1161590736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 0x7f4118100c80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f410c009880 tx=0x7f410c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.612+0000 7f411d0a8640 1 -- 172.21.15.118:0/1161590736 shutdown_connections 2024-09-21T12:17:07.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.612+0000 7f411d0a8640 1 --2- 172.21.15.118:0/1161590736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 0x7f4118100c80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.612+0000 7f411d0a8640 1 --2- 172.21.15.118:0/1161590736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4118106820 0x7f4118106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.612+0000 7f411d0a8640 1 -- 172.21.15.118:0/1161590736 >> 172.21.15.118:0/1161590736 conn(0x7f41180fc520 msgr2=0x7f41180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.612+0000 7f411d0a8640 1 -- 172.21.15.118:0/1161590736 shutdown_connections 2024-09-21T12:17:07.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.612+0000 7f411d0a8640 1 -- 172.21.15.118:0/1161590736 wait complete. 2024-09-21T12:17:07.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f411d0a8640 1 Processor -- start 2024-09-21T12:17:07.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f411d0a8640 1 -- start start 2024-09-21T12:17:07.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f411d0a8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 0x7f411819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f411d0a8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4118106820 0x7f411819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f411d0a8640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f411810dcf0 con 0x7f4118100820 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f411d0a8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f411810db70 con 0x7f4118106820 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f4116d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 0x7f411819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f4116d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 0x7f411819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32896/0 (socket says 172.21.15.118:32896) 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f4116d9d640 1 -- 172.21.15.118:0/1670726314 learned_addr learned my addr 172.21.15.118:0/1670726314 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.613+0000 7f411659c640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4118106820 0x7f411819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.614+0000 7f4116d9d640 1 -- 172.21.15.118:0/1670726314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4118106820 msgr2=0x7f411819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.614+0000 7f4116d9d640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4118106820 0x7f411819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.614+0000 7f4116d9d640 1 -- 172.21.15.118:0/1670726314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41181977c0 con 0x7f4118100820 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.614+0000 7f4116d9d640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 0x7f411819d640 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f410800c8f0 tx=0x7f410800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.614+0000 7f40fffff640 1 -- 172.21.15.118:0/1670726314 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41080079b0 con 0x7f4118100820 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.614+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4118197ab0 con 0x7f4118100820 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.614+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4118198010 con 0x7f4118100820 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.614+0000 7f40fffff640 1 -- 172.21.15.118:0/1670726314 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41080054e0 con 0x7f4118100820 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.614+0000 7f40fffff640 1 -- 172.21.15.118:0/1670726314 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f410801d060 con 0x7f4118100820 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.615+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4104005290 con 0x7f4118100820 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.616+0000 7f40fffff640 1 -- 172.21.15.118:0/1670726314 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4108004c20 con 0x7f4118100820 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.616+0000 7f40fffff640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f410007af80 0x7f410007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.617+0000 7f40fffff640 1 -- 172.21.15.118:0/1670726314 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f410809dc50 con 0x7f4118100820 2024-09-21T12:17:07.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.617+0000 7f411659c640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f410007af80 0x7f410007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.617+0000 7f411659c640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f410007af80 0x7f410007d440 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4118198b10 tx=0x7f410c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.621+0000 7f40fffff640 1 -- 172.21.15.118:0/1670726314 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4108014030 con 0x7f4118100820 2024-09-21T12:17:07.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.806+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4104000bc0 con 0x7f410007af80 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.815+0000 7f40fffff640 1 -- 172.21.15.118:0/1670726314 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4104000bc0 con 0x7f410007af80 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (35m) 13m ago 45m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (38m) 13m ago 46m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (37m) 13m ago 45m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (33m) 13m ago 46m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (33m) 13m ago 45m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (34m) 13m ago 45m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (29m) 13m ago 40m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:17:07.817 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (29m) 13m ago 40m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (13m) 13m ago 40m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (28m) 13m ago 40m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (37m) 13m ago 47m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (36m) 13m ago 45m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (33m) 13m ago 47m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (33m) 13m ago 45m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (35m) 13m ago 46m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (35m) 13m ago 45m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (32m) 13m ago 43m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (32m) 13m ago 43m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (31m) 13m ago 43m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (30m) 13m ago 42m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (30m) 13m ago 42m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:17:07.818 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (29m) 13m ago 41m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:17:07.819 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (35m) 13m ago 45m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:17:07.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f410007af80 msgr2=0x7f410007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f410007af80 0x7f410007d440 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4118198b10 tx=0x7f410c031400 comp rx=0 tx=0).stop 2024-09-21T12:17:07.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 msgr2=0x7f411819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 0x7f411819d640 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f410800c8f0 tx=0x7f410800cdb0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 shutdown_connections 2024-09-21T12:17:07.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4118106820 0x7f411819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f410007af80 0x7f410007d440 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 --2- 172.21.15.118:0/1670726314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118100820 0x7f411819d640 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 >> 172.21.15.118:0/1670726314 conn(0x7f41180fc520 msgr2=0x7f41181045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 shutdown_connections 2024-09-21T12:17:07.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.818+0000 7f411d0a8640 1 -- 172.21.15.118:0/1670726314 wait complete. 2024-09-21T12:17:07.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 -- 172.21.15.118:0/1294506902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 msgr2=0x7fb570101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 --2- 172.21.15.118:0/1294506902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 0x7fb570101d90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb564009880 tx=0x7fb56402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 -- 172.21.15.118:0/1294506902 shutdown_connections 2024-09-21T12:17:07.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 --2- 172.21.15.118:0/1294506902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 0x7fb570101d90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 --2- 172.21.15.118:0/1294506902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb570107930 0x7fb570107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 -- 172.21.15.118:0/1294506902 >> 172.21.15.118:0/1294506902 conn(0x7fb5700fd630 msgr2=0x7fb5700ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 -- 172.21.15.118:0/1294506902 shutdown_connections 2024-09-21T12:17:07.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 -- 172.21.15.118:0/1294506902 wait complete. 2024-09-21T12:17:07.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 Processor -- start 2024-09-21T12:17:07.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.898+0000 7fb57639c640 1 -- start start 2024-09-21T12:17:07.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb57639c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 0x7fb57019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb57639c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb570107930 0x7fb57019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb57639c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb57010ee00 con 0x7fb570101930 2024-09-21T12:17:07.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb57639c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb57010ec80 con 0x7fb570107930 2024-09-21T12:17:07.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb56ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 0x7fb57019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb56ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 0x7fb57019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32912/0 (socket says 172.21.15.118:32912) 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb56ffff640 1 -- 172.21.15.118:0/4228301685 learned_addr learned my addr 172.21.15.118:0/4228301685 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb56f7fe640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb570107930 0x7fb57019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb56ffff640 1 -- 172.21.15.118:0/4228301685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb570107930 msgr2=0x7fb57019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb56ffff640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb570107930 0x7fb57019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb56ffff640 1 -- 172.21.15.118:0/4228301685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb570197810 con 0x7fb570101930 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb56ffff640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 0x7fb57019d690 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb56000d6f0 tx=0x7fb56000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.899+0000 7fb56d7fa640 1 -- 172.21.15.118:0/4228301685 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb560017070 con 0x7fb570101930 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.900+0000 7fb56d7fa640 1 -- 172.21.15.118:0/4228301685 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb56000de00 con 0x7fb570101930 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.900+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb570197b00 con 0x7fb570101930 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.900+0000 7fb56d7fa640 1 -- 172.21.15.118:0/4228301685 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb560004bb0 con 0x7fb570101930 2024-09-21T12:17:07.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.900+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb570198090 con 0x7fb570101930 2024-09-21T12:17:07.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.901+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb570103070 con 0x7fb570101930 2024-09-21T12:17:07.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.901+0000 7fb56d7fa640 1 -- 172.21.15.118:0/4228301685 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb560004e60 con 0x7fb570101930 2024-09-21T12:17:07.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.902+0000 7fb56d7fa640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb55807af30 0x7fb55807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.902+0000 7fb56d7fa640 1 -- 172.21.15.118:0/4228301685 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb56009dda0 con 0x7fb570101930 2024-09-21T12:17:07.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.902+0000 7fb56f7fe640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb55807af30 0x7fb55807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.902+0000 7fb56f7fe640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb55807af30 0x7fb55807d3f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb564031460 tx=0x7fb564009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:07.906+0000 7fb56d7fa640 1 -- 172.21.15.118:0/4228301685 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb560069250 con 0x7fb570101930 2024-09-21T12:17:08.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.161+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb570109ea0 con 0x7fb570101930 2024-09-21T12:17:08.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.161+0000 7fb56d7fa640 1 -- 172.21.15.118:0/4228301685 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb56006e100 con 0x7fb570101930 2024-09-21T12:17:08.162 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:17:08.163 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:17:08.164 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb55807af30 msgr2=0x7fb55807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb55807af30 0x7fb55807d3f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb564031460 tx=0x7fb564009560 comp rx=0 tx=0).stop 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 msgr2=0x7fb57019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 0x7fb57019d690 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb56000d6f0 tx=0x7fb56000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 shutdown_connections 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb570107930 0x7fb57019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb55807af30 0x7fb55807d3f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 --2- 172.21.15.118:0/4228301685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb570101930 0x7fb57019d690 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 >> 172.21.15.118:0/4228301685 conn(0x7fb5700fd630 msgr2=0x7fb5700fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 shutdown_connections 2024-09-21T12:17:08.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.164+0000 7fb57639c640 1 -- 172.21.15.118:0/4228301685 wait complete. 2024-09-21T12:17:08.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.252+0000 7f384b8c1640 1 -- 172.21.15.118:0/3490901173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 msgr2=0x7f384410b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.252+0000 7f384b8c1640 1 --2- 172.21.15.118:0/3490901173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 0x7f384410b950 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3840009880 tx=0x7f384002a530 comp rx=0 tx=0).stop 2024-09-21T12:17:08.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.252+0000 7f384b8c1640 1 -- 172.21.15.118:0/3490901173 shutdown_connections 2024-09-21T12:17:08.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.252+0000 7f384b8c1640 1 --2- 172.21.15.118:0/3490901173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 0x7f384410b950 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.252+0000 7f384b8c1640 1 --2- 172.21.15.118:0/3490901173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3844102b40 0x7f3844102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.252+0000 7f384b8c1640 1 -- 172.21.15.118:0/3490901173 >> 172.21.15.118:0/3490901173 conn(0x7f38440fc4c0 msgr2=0x7f38440fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:08.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.253+0000 7f384b8c1640 1 -- 172.21.15.118:0/3490901173 shutdown_connections 2024-09-21T12:17:08.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.253+0000 7f384b8c1640 1 -- 172.21.15.118:0/3490901173 wait complete. 2024-09-21T12:17:08.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.253+0000 7f384b8c1640 1 Processor -- start 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.253+0000 7f384b8c1640 1 -- start start 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.253+0000 7f384b8c1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3844102b40 0x7f384419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.253+0000 7f384b8c1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 0x7f384419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.253+0000 7f384b8c1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f384410ee30 con 0x7f3844103460 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.253+0000 7f384b8c1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f384410ecb0 con 0x7f3844102b40 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f3848e5c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 0x7f384419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f3848e5c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 0x7f384419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32918/0 (socket says 172.21.15.118:32918) 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f3848e5c640 1 -- 172.21.15.118:0/3239308496 learned_addr learned my addr 172.21.15.118:0/3239308496 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f384965d640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3844102b40 0x7f384419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f3848e5c640 1 -- 172.21.15.118:0/3239308496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3844102b40 msgr2=0x7f384419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f3848e5c640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3844102b40 0x7f384419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f3848e5c640 1 -- 172.21.15.118:0/3239308496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3844197800 con 0x7f3844103460 2024-09-21T12:17:08.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f3848e5c640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 0x7f384419dbc0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3840004f90 tx=0x7f38400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:08.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f383a7fc640 1 -- 172.21.15.118:0/3239308496 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f384003f070 con 0x7f3844103460 2024-09-21T12:17:08.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3844197a90 con 0x7f3844103460 2024-09-21T12:17:08.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f383a7fc640 1 -- 172.21.15.118:0/3239308496 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3840004cf0 con 0x7f3844103460 2024-09-21T12:17:08.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f383a7fc640 1 -- 172.21.15.118:0/3239308496 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3840035030 con 0x7f3844103460 2024-09-21T12:17:08.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.254+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3844197fc0 con 0x7f3844103460 2024-09-21T12:17:08.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.255+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384406a370 con 0x7f3844103460 2024-09-21T12:17:08.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.256+0000 7f383a7fc640 1 -- 172.21.15.118:0/3239308496 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3840042070 con 0x7f3844103460 2024-09-21T12:17:08.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.257+0000 7f383a7fc640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f383007f340 0x7f3830081800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:08.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.257+0000 7f383a7fc640 1 -- 172.21.15.118:0/3239308496 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f38400beca0 con 0x7f3844103460 2024-09-21T12:17:08.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.257+0000 7f384965d640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f383007f340 0x7f3830081800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:08.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.257+0000 7f384965d640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f383007f340 0x7f3830081800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f383400a810 tx=0x7f3834008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:08.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.261+0000 7f383a7fc640 1 -- 172.21.15.118:0/3239308496 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f384008a150 con 0x7f3844103460 2024-09-21T12:17:08.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.475+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3844105fd0 con 0x7f3844103460 2024-09-21T12:17:08.477 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:08 smithi118 ceph-mon[111738]: pgmap v1150: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:08.477 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:08 smithi118 ceph-mon[111738]: from='client.35872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:08.477 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:08 smithi118 ceph-mon[111738]: from='client.35876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:08.477 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:08 smithi118 ceph-mon[111738]: from='client.35880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:08.477 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:08 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/4228301685' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:17:08.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.476+0000 7f383a7fc640 1 -- 172.21.15.118:0/3239308496 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f384008f000 con 0x7f3844103460 2024-09-21T12:17:08.478 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:17:08.478 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:17:08.478 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:17:08.478 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:17:08.478 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:17:08.478 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:17:08.478 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:17:08.478 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:17:08.479 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:17:08.480 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:17:08.481 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:17:08.481 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:17:08.481 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:08.481 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:08.481 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:08.481 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f383007f340 msgr2=0x7f3830081800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f383007f340 0x7f3830081800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f383400a810 tx=0x7f3834008040 comp rx=0 tx=0).stop 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 msgr2=0x7f384419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 0x7f384419dbc0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3840004f90 tx=0x7f38400048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 shutdown_connections 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f383007f340 0x7f3830081800 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3844103460 0x7f384419dbc0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 --2- 172.21.15.118:0/3239308496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3844102b40 0x7f384419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 >> 172.21.15.118:0/3239308496 conn(0x7f38440fc4c0 msgr2=0x7f3844103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 shutdown_connections 2024-09-21T12:17:08.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.478+0000 7f384b8c1640 1 -- 172.21.15.118:0/3239308496 wait complete. 2024-09-21T12:17:08.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.560+0000 7f6f276b0640 1 -- 172.21.15.118:0/1565526412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20103460 msgr2=0x7f6f2010b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.560+0000 7f6f276b0640 1 --2- 172.21.15.118:0/1565526412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20103460 0x7f6f2010b950 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009880 tx=0x7f6f1002a530 comp rx=0 tx=0).stop 2024-09-21T12:17:08.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.560+0000 7f6f276b0640 1 -- 172.21.15.118:0/1565526412 shutdown_connections 2024-09-21T12:17:08.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.560+0000 7f6f276b0640 1 --2- 172.21.15.118:0/1565526412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20103460 0x7f6f2010b950 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.560+0000 7f6f276b0640 1 --2- 172.21.15.118:0/1565526412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f20102b40 0x7f6f20102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.560+0000 7f6f276b0640 1 -- 172.21.15.118:0/1565526412 >> 172.21.15.118:0/1565526412 conn(0x7f6f200fc4c0 msgr2=0x7f6f200fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:08.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.560+0000 7f6f276b0640 1 -- 172.21.15.118:0/1565526412 shutdown_connections 2024-09-21T12:17:08.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.560+0000 7f6f276b0640 1 -- 172.21.15.118:0/1565526412 wait complete. 2024-09-21T12:17:08.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f276b0640 1 Processor -- start 2024-09-21T12:17:08.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f276b0640 1 -- start start 2024-09-21T12:17:08.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f276b0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20102b40 0x7f6f2019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:08.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f276b0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f20103460 0x7f6f2019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:08.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f276b0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2010edd0 con 0x7f6f20102b40 2024-09-21T12:17:08.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f276b0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2010ec50 con 0x7f6f20103460 2024-09-21T12:17:08.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f2544c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20102b40 0x7f6f2019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:08.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f2544c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20102b40 0x7f6f2019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32932/0 (socket says 172.21.15.118:32932) 2024-09-21T12:17:08.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f2544c640 1 -- 172.21.15.118:0/785162601 learned_addr learned my addr 172.21.15.118:0/785162601 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:08.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f24c4b640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f20103460 0x7f6f2019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:08.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f2544c640 1 -- 172.21.15.118:0/785162601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f20103460 msgr2=0x7f6f2019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f2544c640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f20103460 0x7f6f2019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.561+0000 7f6f2544c640 1 -- 172.21.15.118:0/785162601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f201977c0 con 0x7f6f20102b40 2024-09-21T12:17:08.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.562+0000 7f6f24c4b640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f20103460 0x7f6f2019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:17:08.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.562+0000 7f6f2544c640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20102b40 0x7f6f2019d640 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00e970 tx=0x7f6f1c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:08.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.562+0000 7f6f167fc640 1 -- 172.21.15.118:0/785162601 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f1c00cac0 con 0x7f6f20102b40 2024-09-21T12:17:08.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.562+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f20197ab0 con 0x7f6f20102b40 2024-09-21T12:17:08.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.562+0000 7f6f167fc640 1 -- 172.21.15.118:0/785162601 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f1c0054e0 con 0x7f6f20102b40 2024-09-21T12:17:08.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.562+0000 7f6f167fc640 1 -- 172.21.15.118:0/785162601 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f1c010430 con 0x7f6f20102b40 2024-09-21T12:17:08.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.562+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f20198040 con 0x7f6f20102b40 2024-09-21T12:17:08.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.563+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2006a370 con 0x7f6f20102b40 2024-09-21T12:17:08.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.564+0000 7f6f167fc640 1 -- 172.21.15.118:0/785162601 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6f1c004e80 con 0x7f6f20102b40 2024-09-21T12:17:08.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.564+0000 7f6f167fc640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6f0c07af30 0x7f6f0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:08.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.564+0000 7f6f24c4b640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6f0c07af30 0x7f6f0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:08.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.564+0000 7f6f167fc640 1 -- 172.21.15.118:0/785162601 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6f1c09e7a0 con 0x7f6f20102b40 2024-09-21T12:17:08.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.565+0000 7f6f24c4b640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6f0c07af30 0x7f6f0c07d3f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6f10004f90 tx=0x7f6f100095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:08.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.568+0000 7f6f167fc640 1 -- 172.21.15.118:0/785162601 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f1c069cf0 con 0x7f6f20102b40 2024-09-21T12:17:08.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:08 smithi149 ceph-mon[79770]: pgmap v1150: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:08.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:08 smithi149 ceph-mon[79770]: from='client.35872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:08.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:08 smithi149 ceph-mon[79770]: from='client.35876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:08.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:08 smithi149 ceph-mon[79770]: from='client.35880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:08.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:08 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/4228301685' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:17:08.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.759+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6f20198350 con 0x7f6f0c07af30 2024-09-21T12:17:08.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.760+0000 7f6f167fc640 1 -- 172.21.15.118:0/785162601 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6f20198350 con 0x7f6f0c07af30 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:17:08.762 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:17:08.763 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.763+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6f0c07af30 msgr2=0x7f6f0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.763+0000 7f6f276b0640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6f0c07af30 0x7f6f0c07d3f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6f10004f90 tx=0x7f6f100095f0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.763+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20102b40 msgr2=0x7f6f2019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.763+0000 7f6f276b0640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20102b40 0x7f6f2019d640 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00e970 tx=0x7f6f1c00ed70 comp rx=0 tx=0).stop 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.764+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 shutdown_connections 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.764+0000 7f6f276b0640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f20103460 0x7f6f2019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.764+0000 7f6f276b0640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6f0c07af30 0x7f6f0c07d3f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.764+0000 7f6f276b0640 1 --2- 172.21.15.118:0/785162601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f20102b40 0x7f6f2019d640 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.764+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 >> 172.21.15.118:0/785162601 conn(0x7f6f200fc4c0 msgr2=0x7f6f20103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.764+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 shutdown_connections 2024-09-21T12:17:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.764+0000 7f6f276b0640 1 -- 172.21.15.118:0/785162601 wait complete. 2024-09-21T12:17:08.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.845+0000 7f8c08be3640 1 -- 172.21.15.118:0/1407583092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c040ffd70 msgr2=0x7f8c041001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.845+0000 7f8c08be3640 1 --2- 172.21.15.118:0/1407583092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c040ffd70 0x7f8c041001d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009880 tx=0x7f8bf402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.845+0000 7f8c08be3640 1 -- 172.21.15.118:0/1407583092 shutdown_connections 2024-09-21T12:17:08.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.845+0000 7f8c08be3640 1 --2- 172.21.15.118:0/1407583092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c040ffd70 0x7f8c041001d0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.845+0000 7f8c08be3640 1 --2- 172.21.15.118:0/1407583092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c04106950 0x7f8c04106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.845+0000 7f8c08be3640 1 -- 172.21.15.118:0/1407583092 >> 172.21.15.118:0/1407583092 conn(0x7f8c040fbc60 msgr2=0x7f8c040fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:08.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.845+0000 7f8c08be3640 1 -- 172.21.15.118:0/1407583092 shutdown_connections 2024-09-21T12:17:08.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.845+0000 7f8c08be3640 1 -- 172.21.15.118:0/1407583092 wait complete. 2024-09-21T12:17:08.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c08be3640 1 Processor -- start 2024-09-21T12:17:08.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c08be3640 1 -- start start 2024-09-21T12:17:08.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c08be3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c040ffd70 0x7f8c0419f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:08.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c08be3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04106950 0x7f8c0419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:08.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c08be3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0410eef0 con 0x7f8c04106950 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c08be3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0410ed70 con 0x7f8c040ffd70 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c01d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04106950 0x7f8c0419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c01d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04106950 0x7f8c0419fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:32950/0 (socket says 172.21.15.118:32950) 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c01d9b640 1 -- 172.21.15.118:0/3082245826 learned_addr learned my addr 172.21.15.118:0/3082245826 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c0259c640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c040ffd70 0x7f8c0419f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c01d9b640 1 -- 172.21.15.118:0/3082245826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c040ffd70 msgr2=0x7f8c0419f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c01d9b640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c040ffd70 0x7f8c0419f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c01d9b640 1 -- 172.21.15.118:0/3082245826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c04199a90 con 0x7f8c04106950 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.846+0000 7f8c01d9b640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04106950 0x7f8c0419fe10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4031460 tx=0x7f8bf40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.847+0000 7f8bfb7fe640 1 -- 172.21.15.118:0/3082245826 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8bf403f070 con 0x7f8c04106950 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.847+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c04199d20 con 0x7f8c04106950 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.847+0000 7f8bfb7fe640 1 -- 172.21.15.118:0/3082245826 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8bf40035f0 con 0x7f8c04106950 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.847+0000 7f8bfb7fe640 1 -- 172.21.15.118:0/3082245826 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8bf4035030 con 0x7f8c04106950 2024-09-21T12:17:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.847+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0419a250 con 0x7f8c04106950 2024-09-21T12:17:08.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.848+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c04103090 con 0x7f8c04106950 2024-09-21T12:17:08.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.848+0000 7f8bfb7fe640 1 -- 172.21.15.118:0/3082245826 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8bf4042070 con 0x7f8c04106950 2024-09-21T12:17:08.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.849+0000 7f8bfb7fe640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8bf007af30 0x7f8bf007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:08.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.849+0000 7f8c0259c640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8bf007af30 0x7f8bf007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:08.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.849+0000 7f8bfb7fe640 1 -- 172.21.15.118:0/3082245826 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8bf40bea20 con 0x7f8c04106950 2024-09-21T12:17:08.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.849+0000 7f8c0259c640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8bf007af30 0x7f8bf007d3f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8c0419abd0 tx=0x7f8bec00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:08.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:08.853+0000 7f8bfb7fe640 1 -- 172.21.15.118:0/3082245826 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8bf4089f70 con 0x7f8c04106950 2024-09-21T12:17:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.099+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8c0419afc0 con 0x7f8c04106950 2024-09-21T12:17:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.099+0000 7f8bfb7fe640 1 -- 172.21.15.118:0/3082245826 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f8bf408ee20 con 0x7f8c04106950 2024-09-21T12:17:09.101 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:17:09.101 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:17:09.101 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:17:09.101 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:17:09.101 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:17:09.102 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:17:09.102 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:17:09.102 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:17:09.102 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:17:09.102 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:17:09.102 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:17:09.103 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:17:09.103 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:17:09.103 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:17:09.103 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:17:09.103 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:17:09.103 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:17:09.104 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:17:09.104 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:17:09.104 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:17:09.104 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:17:09.104 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:17:09.104 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:17:09.104 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:17:09.104 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:17:09.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8bf007af30 msgr2=0x7f8bf007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:09.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8bf007af30 0x7f8bf007d3f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8c0419abd0 tx=0x7f8bec00b390 comp rx=0 tx=0).stop 2024-09-21T12:17:09.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04106950 msgr2=0x7f8c0419fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:09.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04106950 0x7f8c0419fe10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4031460 tx=0x7f8bf40045e0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 shutdown_connections 2024-09-21T12:17:09.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8bf007af30 0x7f8bf007d3f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c04106950 0x7f8c0419fe10 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 --2- 172.21.15.118:0/3082245826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c040ffd70 0x7f8c0419f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 >> 172.21.15.118:0/3082245826 conn(0x7f8c040fbc60 msgr2=0x7f8c04100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:09.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 shutdown_connections 2024-09-21T12:17:09.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:09.101+0000 7f8c08be3640 1 -- 172.21.15.118:0/3082245826 wait complete. 2024-09-21T12:17:09.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:09 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3239308496' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:17:09.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:09 smithi118 ceph-mon[111738]: from='client.35892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:09.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:09 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3082245826' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:17:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:09 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3239308496' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:17:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:09 smithi149 ceph-mon[79770]: from='client.35892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:09.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:09 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3082245826' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:17:10.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:10 smithi118 ceph-mon[111738]: pgmap v1151: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:10.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:10 smithi149 ceph-mon[79770]: pgmap v1151: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:12.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:12 smithi118 ceph-mon[111738]: pgmap v1152: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:12.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:12 smithi149 ceph-mon[79770]: pgmap v1152: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:14.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:14 smithi118 ceph-mon[111738]: pgmap v1153: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:14 smithi149 ceph-mon[79770]: pgmap v1153: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:16.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:16 smithi118 ceph-mon[111738]: pgmap v1154: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:16 smithi149 ceph-mon[79770]: pgmap v1154: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:18.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:18 smithi118 ceph-mon[111738]: pgmap v1155: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:18.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:18 smithi149 ceph-mon[79770]: pgmap v1155: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:20 smithi118 ceph-mon[111738]: pgmap v1156: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:17:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:20 smithi149 ceph-mon[79770]: pgmap v1156: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:17:22.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:22 smithi149 ceph-mon[79770]: pgmap v1157: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:22.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:22 smithi118 ceph-mon[111738]: pgmap v1157: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:24.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:24 smithi118 ceph-mon[111738]: pgmap v1158: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:24.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:24 smithi149 ceph-mon[79770]: pgmap v1158: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:26.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:26 smithi118 ceph-mon[111738]: pgmap v1159: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:26.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:26 smithi149 ceph-mon[79770]: pgmap v1159: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:28.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:28 smithi118 ceph-mon[111738]: pgmap v1160: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:28.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:28 smithi149 ceph-mon[79770]: pgmap v1160: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:30.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:30 smithi118 ceph-mon[111738]: pgmap v1161: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:30.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:30 smithi149 ceph-mon[79770]: pgmap v1161: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:32.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:32 smithi118 ceph-mon[111738]: pgmap v1162: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:32.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:32 smithi149 ceph-mon[79770]: pgmap v1162: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:34.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:34 smithi118 ceph-mon[111738]: pgmap v1163: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:34.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:34 smithi149 ceph-mon[79770]: pgmap v1163: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:35.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:17:35.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:17:36.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:36 smithi118 ceph-mon[111738]: pgmap v1164: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:36.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:36 smithi149 ceph-mon[79770]: pgmap v1164: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:38.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:38 smithi118 ceph-mon[111738]: pgmap v1165: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:38.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:38 smithi149 ceph-mon[79770]: pgmap v1165: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:39.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.193+0000 7f5938474640 1 -- 172.21.15.118:0/888254136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 msgr2=0x7f5930107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.193+0000 7f5938474640 1 --2- 172.21.15.118:0/888254136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 0x7f5930107d10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f592c009880 tx=0x7f592c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.193+0000 7f5938474640 1 -- 172.21.15.118:0/888254136 shutdown_connections 2024-09-21T12:17:39.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.193+0000 7f5938474640 1 --2- 172.21.15.118:0/888254136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5930101930 0x7f5930101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.193+0000 7f5938474640 1 --2- 172.21.15.118:0/888254136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 0x7f5930107d10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.193+0000 7f5938474640 1 -- 172.21.15.118:0/888254136 >> 172.21.15.118:0/888254136 conn(0x7f59300fd630 msgr2=0x7f59300ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:39.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.194+0000 7f5938474640 1 -- 172.21.15.118:0/888254136 shutdown_connections 2024-09-21T12:17:39.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.194+0000 7f5938474640 1 -- 172.21.15.118:0/888254136 wait complete. 2024-09-21T12:17:39.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.194+0000 7f5938474640 1 Processor -- start 2024-09-21T12:17:39.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.194+0000 7f5938474640 1 -- start start 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5938474640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5930101930 0x7f593019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5938474640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 0x7f593019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5938474640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f593010ee60 con 0x7f5930107930 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5938474640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f593010ece0 con 0x7f5930101930 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5935a0f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 0x7f593019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5935a0f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 0x7f593019dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51466/0 (socket says 172.21.15.118:51466) 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5935a0f640 1 -- 172.21.15.118:0/1767170671 learned_addr learned my addr 172.21.15.118:0/1767170671 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5936210640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5930101930 0x7f593019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5935a0f640 1 -- 172.21.15.118:0/1767170671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5930101930 msgr2=0x7f593019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5935a0f640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5930101930 0x7f593019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5935a0f640 1 -- 172.21.15.118:0/1767170671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5930197890 con 0x7f5930107930 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5936210640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5930101930 0x7f593019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:17:39.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5935a0f640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 0x7f593019dc10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f592000b420 tx=0x7f592000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:39.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f59277fe640 1 -- 172.21.15.118:0/1767170671 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5920011630 con 0x7f5930107930 2024-09-21T12:17:39.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5930197b80 con 0x7f5930107930 2024-09-21T12:17:39.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.195+0000 7f59277fe640 1 -- 172.21.15.118:0/1767170671 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5920016070 con 0x7f5930107930 2024-09-21T12:17:39.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.196+0000 7f59277fe640 1 -- 172.21.15.118:0/1767170671 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5920010d40 con 0x7f5930107930 2024-09-21T12:17:39.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.196+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5930198110 con 0x7f5930107930 2024-09-21T12:17:39.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.197+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5930103070 con 0x7f5930107930 2024-09-21T12:17:39.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.197+0000 7f59277fe640 1 -- 172.21.15.118:0/1767170671 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f592001b480 con 0x7f5930107930 2024-09-21T12:17:39.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.198+0000 7f59277fe640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f591c07af40 0x7f591c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:39.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.198+0000 7f5936210640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f591c07af40 0x7f591c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:39.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.198+0000 7f59277fe640 1 -- 172.21.15.118:0/1767170671 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f592009d7f0 con 0x7f5930107930 2024-09-21T12:17:39.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.198+0000 7f5936210640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f591c07af40 0x7f591c07d400 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f592c000c00 tx=0x7f592c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:39.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.202+0000 7f59277fe640 1 -- 172.21.15.118:0/1767170671 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5920068d40 con 0x7f5930107930 2024-09-21T12:17:39.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.398+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5930198dc0 con 0x7f591c07af40 2024-09-21T12:17:39.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.400+0000 7f59277fe640 1 -- 172.21.15.118:0/1767170671 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5930198dc0 con 0x7f591c07af40 2024-09-21T12:17:39.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f591c07af40 msgr2=0x7f591c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f591c07af40 0x7f591c07d400 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f592c000c00 tx=0x7f592c031400 comp rx=0 tx=0).stop 2024-09-21T12:17:39.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 msgr2=0x7f593019dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 0x7f593019dc10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f592000b420 tx=0x7f592000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 shutdown_connections 2024-09-21T12:17:39.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f591c07af40 0x7f591c07d400 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5930107930 0x7f593019dc10 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 --2- 172.21.15.118:0/1767170671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5930101930 0x7f593019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 >> 172.21.15.118:0/1767170671 conn(0x7f59300fd630 msgr2=0x7f59300fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:39.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 shutdown_connections 2024-09-21T12:17:39.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.402+0000 7f5938474640 1 -- 172.21.15.118:0/1767170671 wait complete. 2024-09-21T12:17:39.413 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:17:39.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.484+0000 7fb5bb86b640 1 -- 172.21.15.118:0/1910221341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4101930 msgr2=0x7fb5b4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.484+0000 7fb5bb86b640 1 --2- 172.21.15.118:0/1910221341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4101930 0x7fb5b4101d90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009c20 tx=0x7fb5a802a970 comp rx=0 tx=0).stop 2024-09-21T12:17:39.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.484+0000 7fb5bb86b640 1 -- 172.21.15.118:0/1910221341 shutdown_connections 2024-09-21T12:17:39.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.484+0000 7fb5bb86b640 1 --2- 172.21.15.118:0/1910221341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4101930 0x7fb5b4101d90 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.484+0000 7fb5bb86b640 1 --2- 172.21.15.118:0/1910221341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b4107930 0x7fb5b4107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.484+0000 7fb5bb86b640 1 -- 172.21.15.118:0/1910221341 >> 172.21.15.118:0/1910221341 conn(0x7fb5b40fd630 msgr2=0x7fb5b40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:39.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.484+0000 7fb5bb86b640 1 -- 172.21.15.118:0/1910221341 shutdown_connections 2024-09-21T12:17:39.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.484+0000 7fb5bb86b640 1 -- 172.21.15.118:0/1910221341 wait complete. 2024-09-21T12:17:39.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5bb86b640 1 Processor -- start 2024-09-21T12:17:39.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5bb86b640 1 -- start start 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5bb86b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b4101930 0x7fb5b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5bb86b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4107930 0x7fb5b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5bb86b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b410ede0 con 0x7fb5b4107930 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5bb86b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b410ec60 con 0x7fb5b4101930 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5b8e06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4107930 0x7fb5b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5b8e06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4107930 0x7fb5b4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51484/0 (socket says 172.21.15.118:51484) 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5b8e06640 1 -- 172.21.15.118:0/540433438 learned_addr learned my addr 172.21.15.118:0/540433438 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5b9607640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b4101930 0x7fb5b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5b8e06640 1 -- 172.21.15.118:0/540433438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b4101930 msgr2=0x7fb5b40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5b8e06640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b4101930 0x7fb5b40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.485+0000 7fb5b8e06640 1 -- 172.21.15.118:0/540433438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b4074f70 con 0x7fb5b4107930 2024-09-21T12:17:39.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.486+0000 7fb5b8e06640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4107930 0x7fb5b4074a30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8006010 tx=0x7fb5a802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:39.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.486+0000 7fb5b27fc640 1 -- 172.21.15.118:0/540433438 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5a8047070 con 0x7fb5b4107930 2024-09-21T12:17:39.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.486+0000 7fb5b27fc640 1 -- 172.21.15.118:0/540433438 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb5a802f7e0 con 0x7fb5b4107930 2024-09-21T12:17:39.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.486+0000 7fb5b27fc640 1 -- 172.21.15.118:0/540433438 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5a8034070 con 0x7fb5b4107930 2024-09-21T12:17:39.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.486+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b4075200 con 0x7fb5b4107930 2024-09-21T12:17:39.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.486+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b41a3e10 con 0x7fb5b4107930 2024-09-21T12:17:39.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.487+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b4103070 con 0x7fb5b4107930 2024-09-21T12:17:39.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.487+0000 7fb5b27fc640 1 -- 172.21.15.118:0/540433438 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb5a804a070 con 0x7fb5b4107930 2024-09-21T12:17:39.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.488+0000 7fb5b27fc640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb59c07af90 0x7fb59c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:39.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.488+0000 7fb5b9607640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb59c07af90 0x7fb59c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:39.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.488+0000 7fb5b27fc640 1 -- 172.21.15.118:0/540433438 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb5a80beda0 con 0x7fb5b4107930 2024-09-21T12:17:39.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.489+0000 7fb5b9607640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb59c07af90 0x7fb59c07d450 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40058c0 tx=0x7fb5a400a2d0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:39.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.492+0000 7fb5b27fc640 1 -- 172.21.15.118:0/540433438 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5a803f070 con 0x7fb5b4107930 2024-09-21T12:17:39.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.685+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb5b4062630 con 0x7fb59c07af90 2024-09-21T12:17:39.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.686+0000 7fb5b27fc640 1 -- 172.21.15.118:0/540433438 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb5b4062630 con 0x7fb59c07af90 2024-09-21T12:17:39.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb59c07af90 msgr2=0x7fb59c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb59c07af90 0x7fb59c07d450 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40058c0 tx=0x7fb5a400a2d0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4107930 msgr2=0x7fb5b4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4107930 0x7fb5b4074a30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8006010 tx=0x7fb5a802f5f0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 shutdown_connections 2024-09-21T12:17:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb59c07af90 0x7fb59c07d450 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5b4107930 0x7fb5b4074a30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 --2- 172.21.15.118:0/540433438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5b4101930 0x7fb5b40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 >> 172.21.15.118:0/540433438 conn(0x7fb5b40fd630 msgr2=0x7fb5b40fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 shutdown_connections 2024-09-21T12:17:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.688+0000 7fb5bb86b640 1 -- 172.21.15.118:0/540433438 wait complete. 2024-09-21T12:17:39.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.769+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2019461831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 msgr2=0x7f8fc0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.769+0000 7f8fc51a4640 1 --2- 172.21.15.118:0/2019461831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 0x7f8fc0106c00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009c20 tx=0x7f8fb802a970 comp rx=0 tx=0).stop 2024-09-21T12:17:39.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.769+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2019461831 shutdown_connections 2024-09-21T12:17:39.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.769+0000 7f8fc51a4640 1 --2- 172.21.15.118:0/2019461831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0100820 0x7f8fc0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.769+0000 7f8fc51a4640 1 --2- 172.21.15.118:0/2019461831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 0x7f8fc0106c00 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.769+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2019461831 >> 172.21.15.118:0/2019461831 conn(0x7f8fc00fc520 msgr2=0x7f8fc00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:39.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.769+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2019461831 shutdown_connections 2024-09-21T12:17:39.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.769+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2019461831 wait complete. 2024-09-21T12:17:39.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fc51a4640 1 Processor -- start 2024-09-21T12:17:39.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fc51a4640 1 -- start start 2024-09-21T12:17:39.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fc51a4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0100820 0x7f8fc019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:39.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fc51a4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 0x7f8fc019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:39.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fc51a4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc010dcd0 con 0x7f8fc0106820 2024-09-21T12:17:39.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fc51a4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc010db50 con 0x7f8fc0100820 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fbe59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 0x7f8fc019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fbe59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 0x7f8fc019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51510/0 (socket says 172.21.15.118:51510) 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fbe59c640 1 -- 172.21.15.118:0/2862762839 learned_addr learned my addr 172.21.15.118:0/2862762839 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.770+0000 7f8fbed9d640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0100820 0x7f8fc019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.771+0000 7f8fbe59c640 1 -- 172.21.15.118:0/2862762839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0100820 msgr2=0x7f8fc019d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.771+0000 7f8fbe59c640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0100820 0x7f8fc019d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.771+0000 7f8fbe59c640 1 -- 172.21.15.118:0/2862762839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc0197780 con 0x7f8fc0106820 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.771+0000 7f8fbe59c640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 0x7f8fc019db40 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c8a0 tx=0x7f8fa800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.771+0000 7f8fb7fff640 1 -- 172.21.15.118:0/2862762839 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fa80079b0 con 0x7f8fc0106820 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.771+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc0197a70 con 0x7f8fc0106820 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.771+0000 7f8fb7fff640 1 -- 172.21.15.118:0/2862762839 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fa8007b50 con 0x7f8fc0106820 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.771+0000 7f8fb7fff640 1 -- 172.21.15.118:0/2862762839 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fa8018700 con 0x7f8fc0106820 2024-09-21T12:17:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.771+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc0198000 con 0x7f8fc0106820 2024-09-21T12:17:39.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.772+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc0101f60 con 0x7f8fc0106820 2024-09-21T12:17:39.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.773+0000 7f8fb7fff640 1 -- 172.21.15.118:0/2862762839 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8fa8007d00 con 0x7f8fc0106820 2024-09-21T12:17:39.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.773+0000 7f8fb7fff640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fac07af30 0x7f8fac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:39.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.774+0000 7f8fb7fff640 1 -- 172.21.15.118:0/2862762839 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8fa809e2c0 con 0x7f8fc0106820 2024-09-21T12:17:39.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.774+0000 7f8fbed9d640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fac07af30 0x7f8fac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:39.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.774+0000 7f8fbed9d640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fac07af30 0x7f8fac07d3f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009430 tx=0x7f8fb803c040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:39.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.778+0000 7f8fb7fff640 1 -- 172.21.15.118:0/2862762839 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fa8014030 con 0x7f8fc0106820 2024-09-21T12:17:39.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.968+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8fc0198370 con 0x7f8fac07af30 2024-09-21T12:17:39.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.977+0000 7f8fb7fff640 1 -- 172.21.15.118:0/2862762839 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8fc0198370 con 0x7f8fac07af30 2024-09-21T12:17:39.979 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:17:39.980 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (35m) 14m ago 46m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:17:39.980 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (38m) 14m ago 46m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:17:39.980 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (37m) 14m ago 45m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:17:39.980 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (33m) 14m ago 46m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:17:39.980 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (33m) 14m ago 45m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:17:39.980 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (35m) 14m ago 46m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (30m) 14m ago 41m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (29m) 14m ago 41m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (14m) 14m ago 41m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (29m) 14m ago 41m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (37m) 14m ago 47m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (36m) 14m ago 45m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (34m) 14m ago 48m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (33m) 14m ago 45m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (36m) 14m ago 46m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (36m) 14m ago 45m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (33m) 14m ago 44m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (32m) 14m ago 44m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (32m) 14m ago 43m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:17:39.981 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (31m) 14m ago 43m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:17:39.982 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (30m) 14m ago 42m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:17:39.982 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (30m) 14m ago 42m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:17:39.982 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (35m) 14m ago 46m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fac07af30 msgr2=0x7f8fac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fac07af30 0x7f8fac07d3f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009430 tx=0x7f8fb803c040 comp rx=0 tx=0).stop 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 msgr2=0x7f8fc019db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 0x7f8fc019db40 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c8a0 tx=0x7f8fa800cd60 comp rx=0 tx=0).stop 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 shutdown_connections 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8fac07af30 0x7f8fac07d3f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fc0106820 0x7f8fc019db40 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 --2- 172.21.15.118:0/2862762839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc0100820 0x7f8fc019d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 >> 172.21.15.118:0/2862762839 conn(0x7f8fc00fc520 msgr2=0x7f8fc0109e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 shutdown_connections 2024-09-21T12:17:39.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:39.980+0000 7f8fc51a4640 1 -- 172.21.15.118:0/2862762839 wait complete. 2024-09-21T12:17:40.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.061+0000 7fd6e678c640 1 -- 172.21.15.118:0/514738883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 msgr2=0x7fd6e010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.061+0000 7fd6e678c640 1 --2- 172.21.15.118:0/514738883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 0x7fd6e010b8b0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009880 tx=0x7fd6d402a530 comp rx=0 tx=0).stop 2024-09-21T12:17:40.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.061+0000 7fd6e678c640 1 -- 172.21.15.118:0/514738883 shutdown_connections 2024-09-21T12:17:40.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.061+0000 7fd6e678c640 1 --2- 172.21.15.118:0/514738883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 0x7fd6e010b8b0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.061+0000 7fd6e678c640 1 --2- 172.21.15.118:0/514738883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6e0102aa0 0x7fd6e0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.061+0000 7fd6e678c640 1 -- 172.21.15.118:0/514738883 >> 172.21.15.118:0/514738883 conn(0x7fd6e00fc4c0 msgr2=0x7fd6e00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:40.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.062+0000 7fd6e678c640 1 -- 172.21.15.118:0/514738883 shutdown_connections 2024-09-21T12:17:40.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.062+0000 7fd6e678c640 1 -- 172.21.15.118:0/514738883 wait complete. 2024-09-21T12:17:40.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.062+0000 7fd6e678c640 1 Processor -- start 2024-09-21T12:17:40.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.062+0000 7fd6e678c640 1 -- start start 2024-09-21T12:17:40.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6e678c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6e0102aa0 0x7fd6e019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6e678c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 0x7fd6e019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6e678c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e010edd0 con 0x7fd6e01033c0 2024-09-21T12:17:40.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6e678c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e010ec50 con 0x7fd6e0102aa0 2024-09-21T12:17:40.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6df7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 0x7fd6e019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6df7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 0x7fd6e019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51528/0 (socket says 172.21.15.118:51528) 2024-09-21T12:17:40.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6df7fe640 1 -- 172.21.15.118:0/1626718655 learned_addr learned my addr 172.21.15.118:0/1626718655 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6dffff640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6e0102aa0 0x7fd6e019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6df7fe640 1 -- 172.21.15.118:0/1626718655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6e0102aa0 msgr2=0x7fd6e019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6df7fe640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6e0102aa0 0x7fd6e019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6df7fe640 1 -- 172.21.15.118:0/1626718655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e0197800 con 0x7fd6e01033c0 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.063+0000 7fd6df7fe640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 0x7fd6e019dbc0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4031460 tx=0x7fd6d4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.064+0000 7fd6dd7fa640 1 -- 172.21.15.118:0/1626718655 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6d403f070 con 0x7fd6e01033c0 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.064+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e0197a90 con 0x7fd6e01033c0 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.064+0000 7fd6dd7fa640 1 -- 172.21.15.118:0/1626718655 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6d40035f0 con 0x7fd6e01033c0 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.064+0000 7fd6dd7fa640 1 -- 172.21.15.118:0/1626718655 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6d4035030 con 0x7fd6e01033c0 2024-09-21T12:17:40.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.064+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e0197fc0 con 0x7fd6e01033c0 2024-09-21T12:17:40.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.065+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e006a410 con 0x7fd6e01033c0 2024-09-21T12:17:40.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.065+0000 7fd6dd7fa640 1 -- 172.21.15.118:0/1626718655 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd6d4042070 con 0x7fd6e01033c0 2024-09-21T12:17:40.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.066+0000 7fd6dd7fa640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd6c807af30 0x7fd6c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.066+0000 7fd6dffff640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd6c807af30 0x7fd6c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.066+0000 7fd6dd7fa640 1 -- 172.21.15.118:0/1626718655 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd6d40be9a0 con 0x7fd6e01033c0 2024-09-21T12:17:40.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.067+0000 7fd6dffff640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd6c807af30 0x7fd6c807d3f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0005fd0 tx=0x7fd6d000b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:40.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.070+0000 7fd6dd7fa640 1 -- 172.21.15.118:0/1626718655 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6d4089ef0 con 0x7fd6e01033c0 2024-09-21T12:17:40.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.321+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd6e0105f40 con 0x7fd6e01033c0 2024-09-21T12:17:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:40 smithi118 ceph-mon[111738]: pgmap v1166: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:40 smithi118 ceph-mon[111738]: from='client.35900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:40 smithi118 ceph-mon[111738]: from='client.35904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:40 smithi118 ceph-mon[111738]: from='client.35908 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:40.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.322+0000 7fd6dd7fa640 1 -- 172.21.15.118:0/1626718655 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd6d408eda0 con 0x7fd6e01033c0 2024-09-21T12:17:40.325 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:17:40.325 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:17:40.325 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:17:40.325 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:17:40.325 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:17:40.325 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:17:40.325 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:17:40.325 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:17:40.326 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:17:40.326 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:17:40.326 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:17:40.326 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:17:40.326 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:17:40.326 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:17:40.326 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:17:40.326 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:17:40.326 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd6c807af30 msgr2=0x7fd6c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd6c807af30 0x7fd6c807d3f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0005fd0 tx=0x7fd6d000b390 comp rx=0 tx=0).stop 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 msgr2=0x7fd6e019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 0x7fd6e019dbc0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4031460 tx=0x7fd6d4004530 comp rx=0 tx=0).stop 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 shutdown_connections 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd6c807af30 0x7fd6c807d3f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e01033c0 0x7fd6e019dbc0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 --2- 172.21.15.118:0/1626718655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6e0102aa0 0x7fd6e019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 >> 172.21.15.118:0/1626718655 conn(0x7fd6e00fc4c0 msgr2=0x7fd6e0108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:40.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 shutdown_connections 2024-09-21T12:17:40.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.324+0000 7fd6e678c640 1 -- 172.21.15.118:0/1626718655 wait complete. 2024-09-21T12:17:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.405+0000 7f9bab3a5640 1 -- 172.21.15.118:0/982725696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4101930 msgr2=0x7f9ba4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.405+0000 7f9bab3a5640 1 --2- 172.21.15.118:0/982725696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4101930 0x7f9ba4101d90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009880 tx=0x7f9ba002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.405+0000 7f9bab3a5640 1 -- 172.21.15.118:0/982725696 shutdown_connections 2024-09-21T12:17:40.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.405+0000 7f9bab3a5640 1 --2- 172.21.15.118:0/982725696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4101930 0x7f9ba4101d90 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.405+0000 7f9bab3a5640 1 --2- 172.21.15.118:0/982725696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba4107930 0x7f9ba4107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.405+0000 7f9bab3a5640 1 -- 172.21.15.118:0/982725696 >> 172.21.15.118:0/982725696 conn(0x7f9ba40fd630 msgr2=0x7f9ba40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:40.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.405+0000 7f9bab3a5640 1 -- 172.21.15.118:0/982725696 shutdown_connections 2024-09-21T12:17:40.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.405+0000 7f9bab3a5640 1 -- 172.21.15.118:0/982725696 wait complete. 2024-09-21T12:17:40.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.405+0000 7f9bab3a5640 1 Processor -- start 2024-09-21T12:17:40.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9bab3a5640 1 -- start start 2024-09-21T12:17:40.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9bab3a5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba4101930 0x7f9ba40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9bab3a5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4107930 0x7f9ba4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9bab3a5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba410ee00 con 0x7f9ba4107930 2024-09-21T12:17:40.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9bab3a5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba410ec80 con 0x7f9ba4101930 2024-09-21T12:17:40.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9ba8940640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4107930 0x7f9ba4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9ba8940640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4107930 0x7f9ba4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51548/0 (socket says 172.21.15.118:51548) 2024-09-21T12:17:40.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9ba8940640 1 -- 172.21.15.118:0/762293087 learned_addr learned my addr 172.21.15.118:0/762293087 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9ba8940640 1 -- 172.21.15.118:0/762293087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba4101930 msgr2=0x7f9ba40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9ba8940640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba4101930 0x7f9ba40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9ba8940640 1 -- 172.21.15.118:0/762293087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba4074f70 con 0x7f9ba4107930 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9ba8940640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4107930 0x7f9ba4074a30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0031460 tx=0x7f9ba00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.406+0000 7f9b9a7fc640 1 -- 172.21.15.118:0/762293087 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ba003f070 con 0x7f9ba4107930 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.407+0000 7f9b9a7fc640 1 -- 172.21.15.118:0/762293087 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ba0004b10 con 0x7f9ba4107930 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.407+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba4075200 con 0x7f9ba4107930 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.407+0000 7f9b9a7fc640 1 -- 172.21.15.118:0/762293087 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ba0035030 con 0x7f9ba4107930 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.407+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba41a3dd0 con 0x7f9ba4107930 2024-09-21T12:17:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.408+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba4103070 con 0x7f9ba4107930 2024-09-21T12:17:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.408+0000 7f9b9a7fc640 1 -- 172.21.15.118:0/762293087 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9ba0042070 con 0x7f9ba4107930 2024-09-21T12:17:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.409+0000 7f9b9a7fc640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9b9007af40 0x7f9b9007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.409+0000 7f9b9a7fc640 1 -- 172.21.15.118:0/762293087 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9ba00bec00 con 0x7f9ba4107930 2024-09-21T12:17:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.409+0000 7f9ba9141640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9b9007af40 0x7f9b9007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.409+0000 7f9ba9141640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9b9007af40 0x7f9b9007d400 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9b94005fd0 tx=0x7f9b94005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.413+0000 7f9b9a7fc640 1 -- 172.21.15.118:0/762293087 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ba00c4020 con 0x7f9ba4107930 2024-09-21T12:17:40.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.627+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9ba4109ea0 con 0x7f9ba4107930 2024-09-21T12:17:40.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.628+0000 7f9b9a7fc640 1 -- 172.21.15.118:0/762293087 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f9ba008a150 con 0x7f9ba4107930 2024-09-21T12:17:40.630 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:17:40.630 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:17:40.630 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:17:40.630 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:17:40.630 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:17:40.630 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:17:40.631 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:17:40.632 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:40.633 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9b9007af40 msgr2=0x7f9b9007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9b9007af40 0x7f9b9007d400 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9b94005fd0 tx=0x7f9b94005850 comp rx=0 tx=0).stop 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4107930 msgr2=0x7f9ba4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4107930 0x7f9ba4074a30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0031460 tx=0x7f9ba00045e0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 shutdown_connections 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9b9007af40 0x7f9b9007d400 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba4107930 0x7f9ba4074a30 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 --2- 172.21.15.118:0/762293087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba4101930 0x7f9ba40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 >> 172.21.15.118:0/762293087 conn(0x7f9ba40fd630 msgr2=0x7f9ba40fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 shutdown_connections 2024-09-21T12:17:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.631+0000 7f9bab3a5640 1 -- 172.21.15.118:0/762293087 wait complete. 2024-09-21T12:17:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:40 smithi149 ceph-mon[79770]: pgmap v1166: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:40 smithi149 ceph-mon[79770]: from='client.35900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:40 smithi149 ceph-mon[79770]: from='client.35904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:40.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:40 smithi149 ceph-mon[79770]: from='client.35908 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:40.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.712+0000 7f82d86e9640 1 -- 172.21.15.118:0/2930687668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 msgr2=0x7f82d0102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.712+0000 7f82d86e9640 1 --2- 172.21.15.118:0/2930687668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 0x7f82d0102ec0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009880 tx=0x7f82c002a530 comp rx=0 tx=0).stop 2024-09-21T12:17:40.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.712+0000 7f82d86e9640 1 -- 172.21.15.118:0/2930687668 shutdown_connections 2024-09-21T12:17:40.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.712+0000 7f82d86e9640 1 --2- 172.21.15.118:0/2930687668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d0103400 0x7f82d010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.712+0000 7f82d86e9640 1 --2- 172.21.15.118:0/2930687668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 0x7f82d0102ec0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.712+0000 7f82d86e9640 1 -- 172.21.15.118:0/2930687668 >> 172.21.15.118:0/2930687668 conn(0x7f82d00fc520 msgr2=0x7f82d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:40.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.712+0000 7f82d86e9640 1 -- 172.21.15.118:0/2930687668 shutdown_connections 2024-09-21T12:17:40.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.712+0000 7f82d86e9640 1 -- 172.21.15.118:0/2930687668 wait complete. 2024-09-21T12:17:40.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d86e9640 1 Processor -- start 2024-09-21T12:17:40.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d86e9640 1 -- start start 2024-09-21T12:17:40.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d86e9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 0x7f82d019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d86e9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d0103400 0x7f82d019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d86e9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f82d010edf0 con 0x7f82d0102ae0 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d86e9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82d010ec70 con 0x7f82d0103400 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d6485640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 0x7f82d019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d6485640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 0x7f82d019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51570/0 (socket says 172.21.15.118:51570) 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d6485640 1 -- 172.21.15.118:0/736400748 learned_addr learned my addr 172.21.15.118:0/736400748 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d5c84640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d0103400 0x7f82d019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d6485640 1 -- 172.21.15.118:0/736400748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d0103400 msgr2=0x7f82d019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d6485640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d0103400 0x7f82d019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.713+0000 7f82d6485640 1 -- 172.21.15.118:0/736400748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d01977e0 con 0x7f82d0102ae0 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.714+0000 7f82d6485640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 0x7f82d019d660 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f82c0031460 tx=0x7f82c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.714+0000 7f82c77fe640 1 -- 172.21.15.118:0/736400748 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82c003f070 con 0x7f82d0102ae0 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.714+0000 7f82c77fe640 1 -- 172.21.15.118:0/736400748 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82c0004cf0 con 0x7f82d0102ae0 2024-09-21T12:17:40.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.714+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d0197a70 con 0x7f82d0102ae0 2024-09-21T12:17:40.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.714+0000 7f82c77fe640 1 -- 172.21.15.118:0/736400748 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82c0035030 con 0x7f82d0102ae0 2024-09-21T12:17:40.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.714+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d0197fa0 con 0x7f82d0102ae0 2024-09-21T12:17:40.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.715+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d006abe0 con 0x7f82d0102ae0 2024-09-21T12:17:40.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.716+0000 7f82c77fe640 1 -- 172.21.15.118:0/736400748 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f82c0042070 con 0x7f82d0102ae0 2024-09-21T12:17:40.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.716+0000 7f82c77fe640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82bc07af80 0x7f82bc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.716+0000 7f82c77fe640 1 -- 172.21.15.118:0/736400748 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f82c00be9e0 con 0x7f82d0102ae0 2024-09-21T12:17:40.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.716+0000 7f82d5c84640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82bc07af80 0x7f82bc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.717+0000 7f82d5c84640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82bc07af80 0x7f82bc07d440 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f82d0108920 tx=0x7f82cc005f70 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:40.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.720+0000 7f82c77fe640 1 -- 172.21.15.118:0/736400748 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82c0089fb0 con 0x7f82d0102ae0 2024-09-21T12:17:40.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.911+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f82d0198250 con 0x7f82bc07af80 2024-09-21T12:17:40.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.913+0000 7f82c77fe640 1 -- 172.21.15.118:0/736400748 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f82d0198250 con 0x7f82bc07af80 2024-09-21T12:17:40.915 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:17:40.915 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:17:40.915 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:17:40.915 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:17:40.915 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:17:40.915 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:17:40.915 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:17:40.915 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:17:40.916 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:17:40.916 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:17:40.916 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:17:40.916 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:17:40.916 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:17:40.916 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:17:40.916 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:17:40.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82bc07af80 msgr2=0x7f82bc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82bc07af80 0x7f82bc07d440 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f82d0108920 tx=0x7f82cc005f70 comp rx=0 tx=0).stop 2024-09-21T12:17:40.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 msgr2=0x7f82d019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 0x7f82d019d660 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f82c0031460 tx=0x7f82c00048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 shutdown_connections 2024-09-21T12:17:40.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d0103400 0x7f82d019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f82bc07af80 0x7f82bc07d440 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 --2- 172.21.15.118:0/736400748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82d0102ae0 0x7f82d019d660 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 >> 172.21.15.118:0/736400748 conn(0x7f82d00fc520 msgr2=0x7f82d0108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:40.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 shutdown_connections 2024-09-21T12:17:40.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.915+0000 7f82d86e9640 1 -- 172.21.15.118:0/736400748 wait complete. 2024-09-21T12:17:40.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.997+0000 7f2f4da5d640 1 -- 172.21.15.118:0/2248913372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48101900 msgr2=0x7f2f48101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.997+0000 7f2f4da5d640 1 --2- 172.21.15.118:0/2248913372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48101900 0x7f2f48101d60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009880 tx=0x7f2f3002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.997+0000 7f2f4da5d640 1 -- 172.21.15.118:0/2248913372 shutdown_connections 2024-09-21T12:17:40.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.997+0000 7f2f4da5d640 1 --2- 172.21.15.118:0/2248913372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48101900 0x7f2f48101d60 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.997+0000 7f2f4da5d640 1 --2- 172.21.15.118:0/2248913372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f48107900 0x7f2f48107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.997+0000 7f2f4da5d640 1 -- 172.21.15.118:0/2248913372 >> 172.21.15.118:0/2248913372 conn(0x7f2f480fd620 msgr2=0x7f2f480ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:40.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.997+0000 7f2f4da5d640 1 -- 172.21.15.118:0/2248913372 shutdown_connections 2024-09-21T12:17:41.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.997+0000 7f2f4da5d640 1 -- 172.21.15.118:0/2248913372 wait complete. 2024-09-21T12:17:41.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f4da5d640 1 Processor -- start 2024-09-21T12:17:41.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f4da5d640 1 -- start start 2024-09-21T12:17:41.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f4da5d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f48101900 0x7f2f4819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f4da5d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48107900 0x7f2f4819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f4da5d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4810edd0 con 0x7f2f48107900 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f4da5d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4810ec50 con 0x7f2f48101900 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f3e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48107900 0x7f2f4819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f3e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48107900 0x7f2f4819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51592/0 (socket says 172.21.15.118:51592) 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f3e7fc640 1 -- 172.21.15.118:0/1561478480 learned_addr learned my addr 172.21.15.118:0/1561478480 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f46ffd640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f48101900 0x7f2f4819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f3e7fc640 1 -- 172.21.15.118:0/1561478480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f48101900 msgr2=0x7f2f4819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f3e7fc640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f48101900 0x7f2f4819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.998+0000 7f2f3e7fc640 1 -- 172.21.15.118:0/1561478480 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f48197770 con 0x7f2f48107900 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.999+0000 7f2f3e7fc640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48107900 0x7f2f4819dbe0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2f30031460 tx=0x7f2f300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:41.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.999+0000 7f2f4ca5b640 1 -- 172.21.15.118:0/1561478480 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f3003f070 con 0x7f2f48107900 2024-09-21T12:17:41.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.999+0000 7f2f4ca5b640 1 -- 172.21.15.118:0/1561478480 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f30004cf0 con 0x7f2f48107900 2024-09-21T12:17:41.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.999+0000 7f2f4ca5b640 1 -- 172.21.15.118:0/1561478480 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f30035030 con 0x7f2f48107900 2024-09-21T12:17:41.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.999+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f48197a00 con 0x7f2f48107900 2024-09-21T12:17:41.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:40.999+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f48197f00 con 0x7f2f48107900 2024-09-21T12:17:41.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.000+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f48103040 con 0x7f2f48107900 2024-09-21T12:17:41.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.001+0000 7f2f4ca5b640 1 -- 172.21.15.118:0/1561478480 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2f30042070 con 0x7f2f48107900 2024-09-21T12:17:41.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.001+0000 7f2f4ca5b640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f3407af80 0x7f2f3407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:41.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.001+0000 7f2f46ffd640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f3407af80 0x7f2f3407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:41.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.001+0000 7f2f4ca5b640 1 -- 172.21.15.118:0/1561478480 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2f300be9e0 con 0x7f2f48107900 2024-09-21T12:17:41.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.002+0000 7f2f46ffd640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f3407af80 0x7f2f3407d440 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2f380058c0 tx=0x7f2f3800a250 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:41.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.006+0000 7f2f4ca5b640 1 -- 172.21.15.118:0/1561478480 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f30089fb0 con 0x7f2f48107900 2024-09-21T12:17:41.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.252+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2f48198ca0 con 0x7f2f48107900 2024-09-21T12:17:41.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.253+0000 7f2f4ca5b640 1 -- 172.21.15.118:0/1561478480 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f2f3008ee60 con 0x7f2f48107900 2024-09-21T12:17:41.255 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:17:41.255 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:17:41.255 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:17:41.255 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:17:41.255 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:17:41.256 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:17:41.257 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:17:41.257 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:17:41.257 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:17:41.257 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f3407af80 msgr2=0x7f2f3407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f3407af80 0x7f2f3407d440 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2f380058c0 tx=0x7f2f3800a250 comp rx=0 tx=0).stop 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48107900 msgr2=0x7f2f4819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48107900 0x7f2f4819dbe0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2f30031460 tx=0x7f2f300048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 shutdown_connections 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2f3407af80 0x7f2f3407d440 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f48107900 0x7f2f4819dbe0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 --2- 172.21.15.118:0/1561478480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f48101900 0x7f2f4819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 >> 172.21.15.118:0/1561478480 conn(0x7f2f480fd620 msgr2=0x7f2f480fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 shutdown_connections 2024-09-21T12:17:41.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:17:41.255+0000 7f2f4da5d640 1 -- 172.21.15.118:0/1561478480 wait complete. 2024-09-21T12:17:41.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:41 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1626718655' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:17:41.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:41 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/762293087' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:17:41.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:41 smithi118 ceph-mon[111738]: from='client.35920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:41.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:41 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1561478480' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:17:41.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:41 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1626718655' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:17:41.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:41 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/762293087' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:17:41.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:41 smithi149 ceph-mon[79770]: from='client.35920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:41.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:41 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1561478480' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:17:42.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:42 smithi118 ceph-mon[111738]: pgmap v1167: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:42.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:42 smithi149 ceph-mon[79770]: pgmap v1167: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:44.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:44 smithi118 ceph-mon[111738]: pgmap v1168: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:44.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:44 smithi149 ceph-mon[79770]: pgmap v1168: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:46.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:46 smithi118 ceph-mon[111738]: pgmap v1169: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:46.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:46 smithi149 ceph-mon[79770]: pgmap v1169: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:48.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:48 smithi118 ceph-mon[111738]: pgmap v1170: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:48.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:48 smithi149 ceph-mon[79770]: pgmap v1170: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:50 smithi118 ceph-mon[111738]: pgmap v1171: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:50.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:17:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:50 smithi149 ceph-mon[79770]: pgmap v1171: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:17:52.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:52 smithi118 ceph-mon[111738]: pgmap v1172: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:52.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:52 smithi149 ceph-mon[79770]: pgmap v1172: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:54.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:54 smithi118 ceph-mon[111738]: pgmap v1173: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:54.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:54 smithi149 ceph-mon[79770]: pgmap v1173: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:56.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:56 smithi118 ceph-mon[111738]: pgmap v1174: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:56.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:56 smithi149 ceph-mon[79770]: pgmap v1174: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:58.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:17:58 smithi118 ceph-mon[111738]: pgmap v1175: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:17:58.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:17:58 smithi149 ceph-mon[79770]: pgmap v1175: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:00.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:00 smithi118 ceph-mon[111738]: pgmap v1176: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:00.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:00 smithi149 ceph-mon[79770]: pgmap v1176: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:02.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:02 smithi118 ceph-mon[111738]: pgmap v1177: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:02.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:02 smithi149 ceph-mon[79770]: pgmap v1177: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:04.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:04 smithi118 ceph-mon[111738]: pgmap v1178: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:04.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:04 smithi149 ceph-mon[79770]: pgmap v1178: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:18:05.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:18:06.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:06 smithi118 ceph-mon[111738]: pgmap v1179: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:06.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:06 smithi149 ceph-mon[79770]: pgmap v1179: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:08.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:08 smithi118 ceph-mon[111738]: pgmap v1180: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:08.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:08 smithi149 ceph-mon[79770]: pgmap v1180: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:10 smithi149 ceph-mon[79770]: pgmap v1181: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:10.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:10 smithi118 ceph-mon[111738]: pgmap v1181: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:11.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.351+0000 7f0e79519640 1 -- 172.21.15.118:0/1285410036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 msgr2=0x7f0e74107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.351+0000 7f0e79519640 1 --2- 172.21.15.118:0/1285410036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 0x7f0e74107cf0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009c20 tx=0x7f0e6402a970 comp rx=0 tx=0).stop 2024-09-21T12:18:11.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.351+0000 7f0e79519640 1 -- 172.21.15.118:0/1285410036 shutdown_connections 2024-09-21T12:18:11.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.351+0000 7f0e79519640 1 --2- 172.21.15.118:0/1285410036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e74101910 0x7f0e74101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.351+0000 7f0e79519640 1 --2- 172.21.15.118:0/1285410036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 0x7f0e74107cf0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.351+0000 7f0e79519640 1 -- 172.21.15.118:0/1285410036 >> 172.21.15.118:0/1285410036 conn(0x7f0e740fd5f0 msgr2=0x7f0e740ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:11.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.351+0000 7f0e79519640 1 -- 172.21.15.118:0/1285410036 shutdown_connections 2024-09-21T12:18:11.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.351+0000 7f0e79519640 1 -- 172.21.15.118:0/1285410036 wait complete. 2024-09-21T12:18:11.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e79519640 1 Processor -- start 2024-09-21T12:18:11.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e79519640 1 -- start start 2024-09-21T12:18:11.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e79519640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e74101910 0x7f0e7419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e79519640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 0x7f0e7419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e79519640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7410ede0 con 0x7f0e74107910 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e79519640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7410ec60 con 0x7f0e74101910 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e727fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 0x7f0e7419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e727fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 0x7f0e7419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53474/0 (socket says 172.21.15.118:53474) 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e727fc640 1 -- 172.21.15.118:0/2395028398 learned_addr learned my addr 172.21.15.118:0/2395028398 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.352+0000 7f0e72ffd640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e74101910 0x7f0e7419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.353+0000 7f0e727fc640 1 -- 172.21.15.118:0/2395028398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e74101910 msgr2=0x7f0e7419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.353+0000 7f0e727fc640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e74101910 0x7f0e7419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.353+0000 7f0e727fc640 1 -- 172.21.15.118:0/2395028398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e741977d0 con 0x7f0e74107910 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.353+0000 7f0e727fc640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 0x7f0e7419db90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800e970 tx=0x7f0e6800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.353+0000 7f0e5bfff640 1 -- 172.21.15.118:0/2395028398 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e6800cac0 con 0x7f0e74107910 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.353+0000 7f0e5bfff640 1 -- 172.21.15.118:0/2395028398 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e680054e0 con 0x7f0e74107910 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.353+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e74197ac0 con 0x7f0e74107910 2024-09-21T12:18:11.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.353+0000 7f0e5bfff640 1 -- 172.21.15.118:0/2395028398 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e68010430 con 0x7f0e74107910 2024-09-21T12:18:11.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.353+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e74198050 con 0x7f0e74107910 2024-09-21T12:18:11.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.354+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e74103050 con 0x7f0e74107910 2024-09-21T12:18:11.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.355+0000 7f0e5bfff640 1 -- 172.21.15.118:0/2395028398 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0e68004ec0 con 0x7f0e74107910 2024-09-21T12:18:11.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.355+0000 7f0e5bfff640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e5c07af30 0x7f0e5c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:11.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.355+0000 7f0e72ffd640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e5c07af30 0x7f0e5c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:11.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.355+0000 7f0e5bfff640 1 -- 172.21.15.118:0/2395028398 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0e6809e800 con 0x7f0e74107910 2024-09-21T12:18:11.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.356+0000 7f0e72ffd640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e5c07af30 0x7f0e5c07d3f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0e64005fc0 tx=0x7f0e64005f30 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:11.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.360+0000 7f0e5bfff640 1 -- 172.21.15.118:0/2395028398 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e68069d50 con 0x7f0e74107910 2024-09-21T12:18:11.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.554+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0e74198360 con 0x7f0e5c07af30 2024-09-21T12:18:11.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.555+0000 7f0e5bfff640 1 -- 172.21.15.118:0/2395028398 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0e74198360 con 0x7f0e5c07af30 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.557+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e5c07af30 msgr2=0x7f0e5c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.557+0000 7f0e79519640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e5c07af30 0x7f0e5c07d3f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0e64005fc0 tx=0x7f0e64005f30 comp rx=0 tx=0).stop 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.557+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 msgr2=0x7f0e7419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.557+0000 7f0e79519640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 0x7f0e7419db90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800e970 tx=0x7f0e6800ed70 comp rx=0 tx=0).stop 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.557+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 shutdown_connections 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.557+0000 7f0e79519640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f0e5c07af30 0x7f0e5c07d3f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.557+0000 7f0e79519640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e74107910 0x7f0e7419db90 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.557+0000 7f0e79519640 1 --2- 172.21.15.118:0/2395028398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e74101910 0x7f0e7419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.558+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 >> 172.21.15.118:0/2395028398 conn(0x7f0e740fd5f0 msgr2=0x7f0e740fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:11.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.558+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 shutdown_connections 2024-09-21T12:18:11.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.558+0000 7f0e79519640 1 -- 172.21.15.118:0/2395028398 wait complete. 2024-09-21T12:18:11.569 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:18:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.641+0000 7fc8a3b64640 1 -- 172.21.15.118:0/2327123944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 msgr2=0x7fc89c100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.641+0000 7fc8a3b64640 1 --2- 172.21.15.118:0/2327123944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 0x7fc89c100290 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009880 tx=0x7fc88c02a530 comp rx=0 tx=0).stop 2024-09-21T12:18:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.641+0000 7fc8a3b64640 1 -- 172.21.15.118:0/2327123944 shutdown_connections 2024-09-21T12:18:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.641+0000 7fc8a3b64640 1 --2- 172.21.15.118:0/2327123944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 0x7fc89c100290 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.641+0000 7fc8a3b64640 1 --2- 172.21.15.118:0/2327123944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89c102840 0x7fc89c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.641+0000 7fc8a3b64640 1 -- 172.21.15.118:0/2327123944 >> 172.21.15.118:0/2327123944 conn(0x7fc89c0fbc40 msgr2=0x7fc89c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.641+0000 7fc8a3b64640 1 -- 172.21.15.118:0/2327123944 shutdown_connections 2024-09-21T12:18:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.641+0000 7fc8a3b64640 1 -- 172.21.15.118:0/2327123944 wait complete. 2024-09-21T12:18:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.642+0000 7fc8a3b64640 1 Processor -- start 2024-09-21T12:18:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.642+0000 7fc8a3b64640 1 -- start start 2024-09-21T12:18:11.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.642+0000 7fc8a3b64640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89c102840 0x7fc89c19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:11.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.642+0000 7fc8a3b64640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 0x7fc89c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:11.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.642+0000 7fc8a3b64640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c110ff0 con 0x7fc89c102c20 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.642+0000 7fc8a3b64640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c110e70 con 0x7fc89c102840 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.642+0000 7fc8a10ff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 0x7fc89c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.642+0000 7fc8a10ff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 0x7fc89c19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53494/0 (socket says 172.21.15.118:53494) 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.642+0000 7fc8a10ff640 1 -- 172.21.15.118:0/487651662 learned_addr learned my addr 172.21.15.118:0/487651662 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc8a1900640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89c102840 0x7fc89c19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc8a10ff640 1 -- 172.21.15.118:0/487651662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89c102840 msgr2=0x7fc89c19f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc8a10ff640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89c102840 0x7fc89c19f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc8a10ff640 1 -- 172.21.15.118:0/487651662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c1999a0 con 0x7fc89c102c20 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc8a10ff640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 0x7fc89c19fd20 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc88c031460 tx=0x7fc88c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc892ffd640 1 -- 172.21.15.118:0/487651662 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc88c03f070 con 0x7fc89c102c20 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc892ffd640 1 -- 172.21.15.118:0/487651662 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc88c004cf0 con 0x7fc89c102c20 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc892ffd640 1 -- 172.21.15.118:0/487651662 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc88c035030 con 0x7fc89c102c20 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89c199c90 con 0x7fc89c102c20 2024-09-21T12:18:11.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.643+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89c19a2a0 con 0x7fc89c102c20 2024-09-21T12:18:11.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.644+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89c100f70 con 0x7fc89c102c20 2024-09-21T12:18:11.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.645+0000 7fc892ffd640 1 -- 172.21.15.118:0/487651662 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc88c042070 con 0x7fc89c102c20 2024-09-21T12:18:11.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.645+0000 7fc892ffd640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc88807af30 0x7fc88807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:11.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.645+0000 7fc892ffd640 1 -- 172.21.15.118:0/487651662 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc88c0beae0 con 0x7fc89c102c20 2024-09-21T12:18:11.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.645+0000 7fc8a1900640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc88807af30 0x7fc88807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:11.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.646+0000 7fc8a1900640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc88807af30 0x7fc88807d3f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc89c19aae0 tx=0x7fc898009110 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:11.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.650+0000 7fc892ffd640 1 -- 172.21.15.118:0/487651662 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc88c08a030 con 0x7fc89c102c20 2024-09-21T12:18:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.845+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc89c19aed0 con 0x7fc88807af30 2024-09-21T12:18:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.846+0000 7fc892ffd640 1 -- 172.21.15.118:0/487651662 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc89c19aed0 con 0x7fc88807af30 2024-09-21T12:18:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc88807af30 msgr2=0x7fc88807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc88807af30 0x7fc88807d3f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc89c19aae0 tx=0x7fc898009110 comp rx=0 tx=0).stop 2024-09-21T12:18:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 msgr2=0x7fc89c19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 0x7fc89c19fd20 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc88c031460 tx=0x7fc88c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 shutdown_connections 2024-09-21T12:18:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fc88807af30 0x7fc88807d3f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc89c102c20 0x7fc89c19fd20 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 --2- 172.21.15.118:0/487651662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89c102840 0x7fc89c19f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 >> 172.21.15.118:0/487651662 conn(0x7fc89c0fbc40 msgr2=0x7fc89c0fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:11.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 shutdown_connections 2024-09-21T12:18:11.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.849+0000 7fc8a3b64640 1 -- 172.21.15.118:0/487651662 wait complete. 2024-09-21T12:18:11.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.930+0000 7f1082b1e640 1 -- 172.21.15.118:0/261237824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c102ae0 msgr2=0x7f107c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.930+0000 7f1082b1e640 1 --2- 172.21.15.118:0/261237824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c102ae0 0x7f107c102ec0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f106c009880 tx=0x7f106c02a540 comp rx=0 tx=0).stop 2024-09-21T12:18:11.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.930+0000 7f1082b1e640 1 -- 172.21.15.118:0/261237824 shutdown_connections 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.930+0000 7f1082b1e640 1 --2- 172.21.15.118:0/261237824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107c103400 0x7f107c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.930+0000 7f1082b1e640 1 --2- 172.21.15.118:0/261237824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c102ae0 0x7f107c102ec0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.930+0000 7f1082b1e640 1 -- 172.21.15.118:0/261237824 >> 172.21.15.118:0/261237824 conn(0x7f107c0fc520 msgr2=0x7f107c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.930+0000 7f1082b1e640 1 -- 172.21.15.118:0/261237824 shutdown_connections 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.930+0000 7f1082b1e640 1 -- 172.21.15.118:0/261237824 wait complete. 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f1082b1e640 1 Processor -- start 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f1082b1e640 1 -- start start 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f1082b1e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107c102ae0 0x7f107c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f1082b1e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c103400 0x7f107c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f1082b1e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f107c10edf0 con 0x7f107c103400 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f1082b1e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f107c10ec70 con 0x7f107c102ae0 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f107bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c103400 0x7f107c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f107bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c103400 0x7f107c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53508/0 (socket says 172.21.15.118:53508) 2024-09-21T12:18:11.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f107bfff640 1 -- 172.21.15.118:0/1801673406 learned_addr learned my addr 172.21.15.118:0/1801673406 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:11.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.931+0000 7f10808ba640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107c102ae0 0x7f107c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:11.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.932+0000 7f10808ba640 1 -- 172.21.15.118:0/1801673406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c103400 msgr2=0x7f107c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:11.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.932+0000 7f10808ba640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c103400 0x7f107c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:11.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.932+0000 7f10808ba640 1 -- 172.21.15.118:0/1801673406 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c1977e0 con 0x7f107c102ae0 2024-09-21T12:18:11.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.932+0000 7f10808ba640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107c102ae0 0x7f107c19d660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f106c006010 tx=0x7f106c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:11.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.932+0000 7f1079ffb640 1 -- 172.21.15.118:0/1801673406 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f106c03f070 con 0x7f107c102ae0 2024-09-21T12:18:11.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.932+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c197a70 con 0x7f107c102ae0 2024-09-21T12:18:11.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.933+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c197fa0 con 0x7f107c102ae0 2024-09-21T12:18:11.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.933+0000 7f1079ffb640 1 -- 172.21.15.118:0/1801673406 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f106c0035f0 con 0x7f107c102ae0 2024-09-21T12:18:11.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.933+0000 7f1079ffb640 1 -- 172.21.15.118:0/1801673406 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f106c049060 con 0x7f107c102ae0 2024-09-21T12:18:11.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.934+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107c06abe0 con 0x7f107c102ae0 2024-09-21T12:18:11.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.935+0000 7f1079ffb640 1 -- 172.21.15.118:0/1801673406 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f106c042070 con 0x7f107c102ae0 2024-09-21T12:18:11.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.935+0000 7f1079ffb640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f106407af30 0x7f106407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:11.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.935+0000 7f1079ffb640 1 -- 172.21.15.118:0/1801673406 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f106c0be890 con 0x7f107c102ae0 2024-09-21T12:18:11.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.936+0000 7f107bfff640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f106407af30 0x7f106407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:11.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.936+0000 7f107bfff640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f106407af30 0x7f106407d3f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f107c0fe510 tx=0x7f1070004040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:11.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:11.941+0000 7f1079ffb640 1 -- 172.21.15.118:0/1801673406 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f106c089de0 con 0x7f107c102ae0 2024-09-21T12:18:12.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.126+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f107c198220 con 0x7f106407af30 2024-09-21T12:18:12.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.136+0000 7f1079ffb640 1 -- 172.21.15.118:0/1801673406 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f107c198220 con 0x7f106407af30 2024-09-21T12:18:12.138 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:18:12.138 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (36m) 14m ago 47m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:18:12.138 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (39m) 14m ago 47m 10.2M - 19.1.1-373-g4e45e6b4 164465d2334a 0a09e85b3891 2024-09-21T12:18:12.138 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (38m) 14m ago 46m 9.79M - 19.1.1-373-g4e45e6b4 164465d2334a 8f385d8c1770 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (34m) 14m ago 47m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (34m) 14m ago 46m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (35m) 14m ago 46m 79.3M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (30m) 14m ago 41m 20.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (30m) 14m ago 41m 22.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (14m) 14m ago 41m 13.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (30m) 14m ago 41m 20.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (38m) 14m ago 48m 531M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (37m) 14m ago 46m 465M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (34m) 14m ago 48m 69.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (34m) 14m ago 46m 48.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (36m) 14m ago 47m 11.9M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (36m) 14m ago 46m 12.0M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (33m) 14m ago 45m 97.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:18:12.139 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (33m) 14m ago 44m 97.8M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:18:12.140 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (32m) 14m ago 44m 84.1M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:18:12.140 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (31m) 14m ago 43m 105M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:18:12.140 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (31m) 14m ago 43m 90.6M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:18:12.140 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (30m) 14m ago 42m 88.2M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:18:12.140 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (36m) 14m ago 46m 68.0M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f106407af30 msgr2=0x7f106407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f106407af30 0x7f106407d3f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f107c0fe510 tx=0x7f1070004040 comp rx=0 tx=0).stop 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107c102ae0 msgr2=0x7f107c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107c102ae0 0x7f107c19d660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f106c006010 tx=0x7f106c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 shutdown_connections 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f106407af30 0x7f106407d3f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f107c103400 0x7f107c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 --2- 172.21.15.118:0/1801673406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f107c102ae0 0x7f107c19d660 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 >> 172.21.15.118:0/1801673406 conn(0x7f107c0fc520 msgr2=0x7f107c108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 shutdown_connections 2024-09-21T12:18:12.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.139+0000 7f1082b1e640 1 -- 172.21.15.118:0/1801673406 wait complete. 2024-09-21T12:18:12.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.218+0000 7f6b873fc640 1 -- 172.21.15.118:0/3111799347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 msgr2=0x7f6b80106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.218+0000 7f6b873fc640 1 --2- 172.21.15.118:0/3111799347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 0x7f6b80106c00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009880 tx=0x7f6b7002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.218+0000 7f6b873fc640 1 -- 172.21.15.118:0/3111799347 shutdown_connections 2024-09-21T12:18:12.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.218+0000 7f6b873fc640 1 --2- 172.21.15.118:0/3111799347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b80100820 0x7f6b80100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.218+0000 7f6b873fc640 1 --2- 172.21.15.118:0/3111799347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 0x7f6b80106c00 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.218+0000 7f6b873fc640 1 -- 172.21.15.118:0/3111799347 >> 172.21.15.118:0/3111799347 conn(0x7f6b800fc520 msgr2=0x7f6b800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.218+0000 7f6b873fc640 1 -- 172.21.15.118:0/3111799347 shutdown_connections 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.218+0000 7f6b873fc640 1 -- 172.21.15.118:0/3111799347 wait complete. 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b873fc640 1 Processor -- start 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b873fc640 1 -- start start 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b873fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b80100820 0x7f6b80198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b873fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 0x7f6b80198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b873fc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8010dcf0 con 0x7f6b80106820 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b873fc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8010db70 con 0x7f6b80100820 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b84997640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 0x7f6b80198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b84997640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 0x7f6b80198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53526/0 (socket says 172.21.15.118:53526) 2024-09-21T12:18:12.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b84997640 1 -- 172.21.15.118:0/1471065729 learned_addr learned my addr 172.21.15.118:0/1471065729 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.219+0000 7f6b85198640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b80100820 0x7f6b80198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.220+0000 7f6b84997640 1 -- 172.21.15.118:0/1471065729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b80100820 msgr2=0x7f6b80198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.220+0000 7f6b84997640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b80100820 0x7f6b80198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.220+0000 7f6b84997640 1 -- 172.21.15.118:0/1471065729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b80199380 con 0x7f6b80106820 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.220+0000 7f6b84997640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 0x7f6b80198d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00d6f0 tx=0x7f6b7c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.220+0000 7f6b767fc640 1 -- 172.21.15.118:0/1471065729 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b7c017070 con 0x7f6b80106820 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.220+0000 7f6b767fc640 1 -- 172.21.15.118:0/1471065729 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b7c00de00 con 0x7f6b80106820 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.220+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b80199670 con 0x7f6b80106820 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.220+0000 7f6b767fc640 1 -- 172.21.15.118:0/1471065729 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b7c004bb0 con 0x7f6b80106820 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.220+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b801a1c70 con 0x7f6b80106820 2024-09-21T12:18:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.221+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b80101f60 con 0x7f6b80106820 2024-09-21T12:18:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.222+0000 7f6b767fc640 1 -- 172.21.15.118:0/1471065729 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6b7c009a30 con 0x7f6b80106820 2024-09-21T12:18:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.222+0000 7f6b767fc640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b6c07af80 0x7f6b6c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.222+0000 7f6b767fc640 1 -- 172.21.15.118:0/1471065729 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6b7c09db70 con 0x7f6b80106820 2024-09-21T12:18:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.222+0000 7f6b85198640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b6c07af80 0x7f6b6c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.223+0000 7f6b85198640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b6c07af80 0x7f6b6c07d440 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6b700096c0 tx=0x7f6b70031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:12.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.227+0000 7f6b767fc640 1 -- 172.21.15.118:0/1471065729 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b80199670 con 0x7f6b80106820 2024-09-21T12:18:12.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.475+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6b80108d90 con 0x7f6b80106820 2024-09-21T12:18:12.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:12 smithi118 ceph-mon[111738]: pgmap v1182: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:12.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:12 smithi118 ceph-mon[111738]: from='client.35928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:12.478 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:12 smithi118 ceph-mon[111738]: from='client.35932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:12.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.476+0000 7f6b767fc640 1 -- 172.21.15.118:0/1471065729 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f6b7c069140 con 0x7f6b80106820 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:18:12.479 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:18:12.480 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:18:12.480 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:18:12.480 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:18:12.480 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:18:12.480 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b6c07af80 msgr2=0x7f6b6c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b6c07af80 0x7f6b6c07d440 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6b700096c0 tx=0x7f6b70031400 comp rx=0 tx=0).stop 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 msgr2=0x7f6b80198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 0x7f6b80198d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00d6f0 tx=0x7f6b7c00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 shutdown_connections 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b6c07af80 0x7f6b6c07d440 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b80106820 0x7f6b80198d80 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 --2- 172.21.15.118:0/1471065729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b80100820 0x7f6b80198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 >> 172.21.15.118:0/1471065729 conn(0x7f6b800fc520 msgr2=0x7f6b800fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:12.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 shutdown_connections 2024-09-21T12:18:12.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.478+0000 7f6b873fc640 1 -- 172.21.15.118:0/1471065729 wait complete. 2024-09-21T12:18:12.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.559+0000 7f448ee9a640 1 -- 172.21.15.118:0/4108873739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488102ae0 msgr2=0x7f4488102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.559+0000 7f448ee9a640 1 --2- 172.21.15.118:0/4108873739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488102ae0 0x7f4488102ec0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f447c0098b0 tx=0x7f447c02a560 comp rx=0 tx=0).stop 2024-09-21T12:18:12.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.559+0000 7f448ee9a640 1 -- 172.21.15.118:0/4108873739 shutdown_connections 2024-09-21T12:18:12.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 --2- 172.21.15.118:0/4108873739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4488103400 0x7f448810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 --2- 172.21.15.118:0/4108873739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488102ae0 0x7f4488102ec0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 -- 172.21.15.118:0/4108873739 >> 172.21.15.118:0/4108873739 conn(0x7f44880fc4c0 msgr2=0x7f44880fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:12.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 -- 172.21.15.118:0/4108873739 shutdown_connections 2024-09-21T12:18:12.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 -- 172.21.15.118:0/4108873739 wait complete. 2024-09-21T12:18:12.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 Processor -- start 2024-09-21T12:18:12.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 -- start start 2024-09-21T12:18:12.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4488102ae0 0x7f448819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488103400 0x7f448819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f448810ee30 con 0x7f4488103400 2024-09-21T12:18:12.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.560+0000 7f448ee9a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f448810ecb0 con 0x7f4488102ae0 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4487fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488103400 0x7f448819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4487fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488103400 0x7f448819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53544/0 (socket says 172.21.15.118:53544) 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4487fff640 1 -- 172.21.15.118:0/2419287678 learned_addr learned my addr 172.21.15.118:0/2419287678 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f448cc36640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4488102ae0 0x7f448819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4487fff640 1 -- 172.21.15.118:0/2419287678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4488102ae0 msgr2=0x7f448819f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4487fff640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4488102ae0 0x7f448819f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4487fff640 1 -- 172.21.15.118:0/2419287678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4488199aa0 con 0x7f4488103400 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4487fff640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488103400 0x7f448819fdd0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f447400b420 tx=0x7f447400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4485ffb640 1 -- 172.21.15.118:0/2419287678 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4474011630 con 0x7f4488103400 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4485ffb640 1 -- 172.21.15.118:0/2419287678 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4474016070 con 0x7f4488103400 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4488199d30 con 0x7f4488103400 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f4485ffb640 1 -- 172.21.15.118:0/2419287678 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4474010d40 con 0x7f4488103400 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.561+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448819a2c0 con 0x7f4488103400 2024-09-21T12:18:12.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.562+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448806a3d0 con 0x7f4488103400 2024-09-21T12:18:12.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.563+0000 7f4485ffb640 1 -- 172.21.15.118:0/2419287678 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f447401b480 con 0x7f4488103400 2024-09-21T12:18:12.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.563+0000 7f4485ffb640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f447807af30 0x7f447807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.563+0000 7f448cc36640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f447807af30 0x7f447807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.563+0000 7f4485ffb640 1 -- 172.21.15.118:0/2419287678 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f447409d740 con 0x7f4488103400 2024-09-21T12:18:12.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.564+0000 7f448cc36640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f447807af30 0x7f447807d3f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f447c009230 tx=0x7f447c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:12.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.568+0000 7f4485ffb640 1 -- 172.21.15.118:0/2419287678 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4474068c90 con 0x7f4488103400 2024-09-21T12:18:12.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:12 smithi149 ceph-mon[79770]: pgmap v1182: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:12.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:12 smithi149 ceph-mon[79770]: from='client.35928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:12.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:12 smithi149 ceph-mon[79770]: from='client.35932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:12.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.782+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f448819af80 con 0x7f4488103400 2024-09-21T12:18:12.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.783+0000 7f4485ffb640 1 -- 172.21.15.118:0/2419287678 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2000 (secure 0 0 0) 0x7f4474069e20 con 0x7f4488103400 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:e26 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:03:17:535028+0000 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 17 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:18:12.785 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T11:47:28.938924+0000 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:up {} 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:failed 0,1 2024-09-21T12:18:12.786 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:18:12.787 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:18:12.788 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:18:12.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f447807af30 msgr2=0x7f447807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f447807af30 0x7f447807d3f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f447c009230 tx=0x7f447c031400 comp rx=0 tx=0).stop 2024-09-21T12:18:12.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488103400 msgr2=0x7f448819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488103400 0x7f448819fdd0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f447400b420 tx=0x7f447400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 shutdown_connections 2024-09-21T12:18:12.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f447807af30 0x7f447807d3f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4488103400 0x7f448819fdd0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 --2- 172.21.15.118:0/2419287678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4488102ae0 0x7f448819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 >> 172.21.15.118:0/2419287678 conn(0x7f44880fc4c0 msgr2=0x7f4488100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:12.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 shutdown_connections 2024-09-21T12:18:12.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.786+0000 7f448ee9a640 1 -- 172.21.15.118:0/2419287678 wait complete. 2024-09-21T12:18:12.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.871+0000 7f881a9a9640 1 -- 172.21.15.118:0/1460197356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814101910 msgr2=0x7f8814101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.871+0000 7f881a9a9640 1 --2- 172.21.15.118:0/1460197356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814101910 0x7f8814101d70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8808009880 tx=0x7f880802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.872+0000 7f881a9a9640 1 -- 172.21.15.118:0/1460197356 shutdown_connections 2024-09-21T12:18:12.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.872+0000 7f881a9a9640 1 --2- 172.21.15.118:0/1460197356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814101910 0x7f8814101d70 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.872+0000 7f881a9a9640 1 --2- 172.21.15.118:0/1460197356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8814107910 0x7f8814107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.872+0000 7f881a9a9640 1 -- 172.21.15.118:0/1460197356 >> 172.21.15.118:0/1460197356 conn(0x7f88140fd5f0 msgr2=0x7f88140ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:12.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.872+0000 7f881a9a9640 1 -- 172.21.15.118:0/1460197356 shutdown_connections 2024-09-21T12:18:12.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.872+0000 7f881a9a9640 1 -- 172.21.15.118:0/1460197356 wait complete. 2024-09-21T12:18:12.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.872+0000 7f881a9a9640 1 Processor -- start 2024-09-21T12:18:12.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.872+0000 7f881a9a9640 1 -- start start 2024-09-21T12:18:12.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f881a9a9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8814101910 0x7f881419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f881a9a9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814107910 0x7f881419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f881a9a9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f881410edc0 con 0x7f8814107910 2024-09-21T12:18:12.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f881a9a9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f881410ec40 con 0x7f8814101910 2024-09-21T12:18:12.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88137fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814107910 0x7f881419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88137fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814107910 0x7f881419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53564/0 (socket says 172.21.15.118:53564) 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88137fe640 1 -- 172.21.15.118:0/723824596 learned_addr learned my addr 172.21.15.118:0/723824596 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f8813fff640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8814101910 0x7f881419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88137fe640 1 -- 172.21.15.118:0/723824596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8814101910 msgr2=0x7f881419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88137fe640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8814101910 0x7f881419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88137fe640 1 -- 172.21.15.118:0/723824596 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88141977d0 con 0x7f8814107910 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f8813fff640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8814101910 0x7f881419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88137fe640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814107910 0x7f881419db90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8808031460 tx=0x7f88080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88117fa640 1 -- 172.21.15.118:0/723824596 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f880803f070 con 0x7f8814107910 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88117fa640 1 -- 172.21.15.118:0/723824596 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8808004b10 con 0x7f8814107910 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8814197a60 con 0x7f8814107910 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f88117fa640 1 -- 172.21.15.118:0/723824596 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8808035030 con 0x7f8814107910 2024-09-21T12:18:12.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.873+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8814197f90 con 0x7f8814107910 2024-09-21T12:18:12.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.875+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8814103050 con 0x7f8814107910 2024-09-21T12:18:12.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.875+0000 7f88117fa640 1 -- 172.21.15.118:0/723824596 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8808042070 con 0x7f8814107910 2024-09-21T12:18:12.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.876+0000 7f88117fa640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f87fc07af40 0x7f87fc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.876+0000 7f8813fff640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f87fc07af40 0x7f87fc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.876+0000 7f88117fa640 1 -- 172.21.15.118:0/723824596 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f88080bec00 con 0x7f8814107910 2024-09-21T12:18:12.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.876+0000 7f8813fff640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f87fc07af40 0x7f87fc07d400 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8804009b40 tx=0x7f8804005e50 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:12.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:12.880+0000 7f88117fa640 1 -- 172.21.15.118:0/723824596 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88080c4020 con 0x7f8814107910 2024-09-21T12:18:13.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.073+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8814198240 con 0x7f87fc07af40 2024-09-21T12:18:13.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.074+0000 7f88117fa640 1 -- 172.21.15.118:0/723824596 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8814198240 con 0x7f87fc07af40 2024-09-21T12:18:13.076 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:18:13.076 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:18:13.076 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": true, 2024-09-21T12:18:13.076 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:18:13.076 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [ 2024-09-21T12:18:13.076 INFO:teuthology.orchestra.run.smithi118.stdout: "osd", 2024-09-21T12:18:13.076 INFO:teuthology.orchestra.run.smithi118.stdout: "mds", 2024-09-21T12:18:13.076 INFO:teuthology.orchestra.run.smithi118.stdout: "mon", 2024-09-21T12:18:13.077 INFO:teuthology.orchestra.run.smithi118.stdout: "crash", 2024-09-21T12:18:13.077 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr" 2024-09-21T12:18:13.077 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T12:18:13.077 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:18:13.077 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:18:13.077 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:18:13.077 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.076+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f87fc07af40 msgr2=0x7f87fc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.076+0000 7f881a9a9640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f87fc07af40 0x7f87fc07d400 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8804009b40 tx=0x7f8804005e50 comp rx=0 tx=0).stop 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.076+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814107910 msgr2=0x7f881419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.076+0000 7f881a9a9640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814107910 0x7f881419db90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8808031460 tx=0x7f88080045e0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.077+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 shutdown_connections 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.077+0000 7f881a9a9640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f87fc07af40 0x7f87fc07d400 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.077+0000 7f881a9a9640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8814107910 0x7f881419db90 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.077+0000 7f881a9a9640 1 --2- 172.21.15.118:0/723824596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8814101910 0x7f881419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.077+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 >> 172.21.15.118:0/723824596 conn(0x7f88140fd5f0 msgr2=0x7f88140fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.077+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 shutdown_connections 2024-09-21T12:18:13.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.077+0000 7f881a9a9640 1 -- 172.21.15.118:0/723824596 wait complete. 2024-09-21T12:18:13.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.157+0000 7f57f80a5640 1 -- 172.21.15.118:0/2454085045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 msgr2=0x7f57f0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:13.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.157+0000 7f57f80a5640 1 --2- 172.21.15.118:0/2454085045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 0x7f57f0107d10 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009880 tx=0x7f57ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.157+0000 7f57f80a5640 1 -- 172.21.15.118:0/2454085045 shutdown_connections 2024-09-21T12:18:13.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.157+0000 7f57f80a5640 1 --2- 172.21.15.118:0/2454085045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f0101930 0x7f57f0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.157+0000 7f57f80a5640 1 --2- 172.21.15.118:0/2454085045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 0x7f57f0107d10 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.157+0000 7f57f80a5640 1 -- 172.21.15.118:0/2454085045 >> 172.21.15.118:0/2454085045 conn(0x7f57f00fd630 msgr2=0x7f57f00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:13.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.157+0000 7f57f80a5640 1 -- 172.21.15.118:0/2454085045 shutdown_connections 2024-09-21T12:18:13.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.157+0000 7f57f80a5640 1 -- 172.21.15.118:0/2454085045 wait complete. 2024-09-21T12:18:13.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f80a5640 1 Processor -- start 2024-09-21T12:18:13.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f80a5640 1 -- start start 2024-09-21T12:18:13.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f80a5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f0101930 0x7f57f019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:13.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f80a5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 0x7f57f019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f80a5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f57f010ede0 con 0x7f57f0107930 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f80a5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f57f010ec60 con 0x7f57f0101930 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f5640640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 0x7f57f019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f5640640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 0x7f57f019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53586/0 (socket says 172.21.15.118:53586) 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f5640640 1 -- 172.21.15.118:0/3313058552 learned_addr learned my addr 172.21.15.118:0/3313058552 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f5e41640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f0101930 0x7f57f019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f5640640 1 -- 172.21.15.118:0/3313058552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f0101930 msgr2=0x7f57f019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f5640640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f0101930 0x7f57f019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f5640640 1 -- 172.21.15.118:0/3313058552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f01977d0 con 0x7f57f0107930 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.158+0000 7f57f5e41640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f0101930 0x7f57f019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.159+0000 7f57f5640640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 0x7f57f019db90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f57e000d8d0 tx=0x7f57e000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.159+0000 7f57e6ffd640 1 -- 172.21.15.118:0/3313058552 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57e0017070 con 0x7f57f0107930 2024-09-21T12:18:13.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.159+0000 7f57e6ffd640 1 -- 172.21.15.118:0/3313058552 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57e0010460 con 0x7f57f0107930 2024-09-21T12:18:13.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.159+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f0197ac0 con 0x7f57f0107930 2024-09-21T12:18:13.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.159+0000 7f57e6ffd640 1 -- 172.21.15.118:0/3313058552 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57e000f5f0 con 0x7f57f0107930 2024-09-21T12:18:13.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.159+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f0198050 con 0x7f57f0107930 2024-09-21T12:18:13.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.160+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f0103070 con 0x7f57f0107930 2024-09-21T12:18:13.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.160+0000 7f57e6ffd640 1 -- 172.21.15.118:0/3313058552 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f57e0009a30 con 0x7f57f0107930 2024-09-21T12:18:13.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.161+0000 7f57e6ffd640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f57dc07af30 0x7f57dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:13.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.161+0000 7f57e6ffd640 1 -- 172.21.15.118:0/3313058552 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f57e009df90 con 0x7f57f0107930 2024-09-21T12:18:13.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.161+0000 7f57f5e41640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f57dc07af30 0x7f57dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:13.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.161+0000 7f57f5e41640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f57dc07af30 0x7f57dc07d3f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f57ec000c00 tx=0x7f57ec031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:13.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.165+0000 7f57e6ffd640 1 -- 172.21.15.118:0/3313058552 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57e00694e0 con 0x7f57f0107930 2024-09-21T12:18:13.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.411+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f57f0198d30 con 0x7f57f0107930 2024-09-21T12:18:13.414 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:13 smithi118 ceph-mon[111738]: from='client.45221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:13.414 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:13 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1471065729' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:13.414 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:13 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2419287678' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:18:13.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.411+0000 7f57e6ffd640 1 -- 172.21.15.118:0/3313058552 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f57f0198d30 con 0x7f57f0107930 2024-09-21T12:18:13.414 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:18:13.414 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: host smithi149 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi149/config 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout:Traceback (most recent call last): 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: return _run_code(code, main_globals, None, 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: exec(code, run_globals) 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T12:18:13.415 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T12:18:13.416 INFO:teuthology.orchestra.run.smithi118.stdout: File "/tmp/tmpp_um7nei.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T12:18:13.416 INFO:teuthology.orchestra.run.smithi118.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 -e NODE_NAME=smithi149 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp50_isc5w:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 inventory --format=json-pretty --filter-for-batch 2024-09-21T12:18:13.416 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:18:13.416 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is degraded 2024-09-21T12:18:13.416 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:18:13.416 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:18:13.416 INFO:teuthology.orchestra.run.smithi118.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:18:13.416 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f57dc07af30 msgr2=0x7f57dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f57dc07af30 0x7f57dc07d3f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f57ec000c00 tx=0x7f57ec031400 comp rx=0 tx=0).stop 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 msgr2=0x7f57f019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 0x7f57f019db90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f57e000d8d0 tx=0x7f57e000dd90 comp rx=0 tx=0).stop 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 shutdown_connections 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f57dc07af30 0x7f57dc07d3f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0107930 0x7f57f019db90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 --2- 172.21.15.118:0/3313058552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f0101930 0x7f57f019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 >> 172.21.15.118:0/3313058552 conn(0x7f57f00fd630 msgr2=0x7f57f00fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 shutdown_connections 2024-09-21T12:18:13.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:13.414+0000 7f57f80a5640 1 -- 172.21.15.118:0/3313058552 wait complete. 2024-09-21T12:18:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:13 smithi149 ceph-mon[79770]: from='client.45221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:13.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:13 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1471065729' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:13.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:13 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2419287678' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:18:14.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:14 smithi118 ceph-mon[111738]: from='client.35948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:14.418 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:14 smithi118 ceph-mon[111738]: pgmap v1183: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:14.419 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:14 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3313058552' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:18:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:14 smithi149 ceph-mon[79770]: from='client.35948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:14 smithi149 ceph-mon[79770]: pgmap v1183: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:14.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:14 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3313058552' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:18:16.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:16 smithi149 ceph-mon[79770]: pgmap v1184: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:16.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:16 smithi118 ceph-mon[111738]: pgmap v1184: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:17.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:17 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"} : dispatch 2024-09-21T12:18:17.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:17 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:17 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:18:17.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:17 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:17 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"} : dispatch 2024-09-21T12:18:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:17 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:17 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:18:17.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:17 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: pgmap v1185: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: pgmap v1186: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: pgmap v1187: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all mds 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:18.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi118.ciljqr"} : dispatch 2024-09-21T12:18:18.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi118.ciljqr"}]': finished 2024-09-21T12:18:18.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi118.macjke"} : dispatch 2024-09-21T12:18:18.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi118.macjke"}]': finished 2024-09-21T12:18:18.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.qzbfns"} : dispatch 2024-09-21T12:18:18.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.qzbfns"}]': finished 2024-09-21T12:18:18.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.zgoqsi"} : dispatch 2024-09-21T12:18:18.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.zgoqsi"}]': finished 2024-09-21T12:18:18.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T12:18:18.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:18 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T12:18:18.802 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: pgmap v1185: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:18.802 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: pgmap v1186: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:18.802 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: pgmap v1187: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:18.802 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:18.802 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.802 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.802 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.802 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all mds 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi118.ciljqr"} : dispatch 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi118.ciljqr"}]': finished 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi118.macjke"} : dispatch 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi118.macjke"}]': finished 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.qzbfns"} : dispatch 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.qzbfns"}]': finished 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.zgoqsi"} : dispatch 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.zgoqsi"}]': finished 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T12:18:18.803 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:18 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T12:18:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T12:18:19.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: Standby daemon mds.cephfs.smithi118.ciljqr assigned to filesystem cephfs as rank 0 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: Standby daemon mds.cephfs.smithi118.macjke assigned to filesystem cephfs as rank 1 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:replay,1=cephfs.smithi118.macjke=up:replay} 2 up:standby 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all rgw 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:19.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:19 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T12:18:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: Standby daemon mds.cephfs.smithi118.ciljqr assigned to filesystem cephfs as rank 0 2024-09-21T12:18:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: Standby daemon mds.cephfs.smithi118.macjke assigned to filesystem cephfs as rank 1 2024-09-21T12:18:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:18:19.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:18:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:replay,1=cephfs.smithi118.macjke=up:replay} 2 up:standby 2024-09-21T12:18:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all rgw 2024-09-21T12:18:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T12:18:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:19.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:19 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:20.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:20 smithi118 ceph-mon[111738]: pgmap v1188: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:20.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:20 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:resolve 2024-09-21T12:18:20.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:20 smithi118 ceph-mon[111738]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:replay,1=cephfs.smithi118.macjke=up:resolve} 2 up:standby 2024-09-21T12:18:20.669 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:20.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:18:20.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:20.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi118", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T12:18:20.670 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:20 smithi149 ceph-mon[79770]: pgmap v1188: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:20 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:resolve 2024-09-21T12:18:20.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:20 smithi149 ceph-mon[79770]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:replay,1=cephfs.smithi118.macjke=up:resolve} 2 up:standby 2024-09-21T12:18:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:18:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi118", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T12:18:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:21.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:21 smithi149 ceph-mon[79770]: Upgrade: Updating ceph-exporter.smithi118 (1/2) 2024-09-21T12:18:21.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:21 smithi149 ceph-mon[79770]: Deploying daemon ceph-exporter.smithi118 on smithi118 2024-09-21T12:18:21.778 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:21 smithi118 ceph-mon[111738]: Upgrade: Updating ceph-exporter.smithi118 (1/2) 2024-09-21T12:18:21.778 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:21 smithi118 ceph-mon[111738]: Deploying daemon ceph-exporter.smithi118 on smithi118 2024-09-21T12:18:22.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:22 smithi149 ceph-mon[79770]: pgmap v1189: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-09-21T12:18:22.707 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:22 smithi118 ceph-mon[111738]: pgmap v1189: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-09-21T12:18:25.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:24 smithi149 ceph-mon[79770]: pgmap v1190: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 7 op/s 2024-09-21T12:18:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:24 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:25.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:24 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:25.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:24 smithi118 ceph-mon[111738]: pgmap v1190: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 7 op/s 2024-09-21T12:18:25.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:24 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:25.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:24 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:26.628 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:26 smithi149 ceph-mon[79770]: pgmap v1191: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 8 op/s 2024-09-21T12:18:26.629 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:26 smithi149 ceph-mon[79770]: Upgrade: Updating ceph-exporter.smithi149 (2/2) 2024-09-21T12:18:26.629 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:26 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:26.629 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:26 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T12:18:26.629 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:26 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:26.629 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:26 smithi149 ceph-mon[79770]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-09-21T12:18:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:26 smithi118 ceph-mon[111738]: pgmap v1191: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 8 op/s 2024-09-21T12:18:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:26 smithi118 ceph-mon[111738]: Upgrade: Updating ceph-exporter.smithi149 (2/2) 2024-09-21T12:18:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:26 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:26 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T12:18:26.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:26 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:26.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:26 smithi118 ceph-mon[111738]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-09-21T12:18:27.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:27 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:resolve 2024-09-21T12:18:27.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:27 smithi149 ceph-mon[79770]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:resolve,1=cephfs.smithi118.macjke=up:resolve} 2 up:standby 2024-09-21T12:18:27.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:27 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:resolve 2024-09-21T12:18:27.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:27 smithi118 ceph-mon[111738]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:resolve,1=cephfs.smithi118.macjke=up:resolve} 2 up:standby 2024-09-21T12:18:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:28 smithi149 ceph-mon[79770]: pgmap v1192: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 8 op/s 2024-09-21T12:18:28.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:28 smithi149 ceph-mon[79770]: reconnect by client.14606 192.168.0.1:0/2284766377 after 0.000999978 2024-09-21T12:18:28.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:28 smithi149 ceph-mon[79770]: reconnect by client.14606 192.168.0.1:0/2284766377 after 0.000999978 2024-09-21T12:18:28.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:28 smithi149 ceph-mon[79770]: reconnect by client.24327 192.168.0.1:0/3135304614 after 0.000999978 2024-09-21T12:18:28.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:28 smithi149 ceph-mon[79770]: reconnect by client.24327 192.168.0.1:0/3135304614 after 0.000999978 2024-09-21T12:18:28.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:28 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:reconnect 2024-09-21T12:18:28.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:28 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:reconnect 2024-09-21T12:18:28.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:28 smithi149 ceph-mon[79770]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:reconnect,1=cephfs.smithi118.macjke=up:reconnect} 2 up:standby 2024-09-21T12:18:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:28 smithi118 ceph-mon[111738]: pgmap v1192: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 8 op/s 2024-09-21T12:18:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:28 smithi118 ceph-mon[111738]: reconnect by client.14606 192.168.0.1:0/2284766377 after 0.000999978 2024-09-21T12:18:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:28 smithi118 ceph-mon[111738]: reconnect by client.14606 192.168.0.1:0/2284766377 after 0.000999978 2024-09-21T12:18:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:28 smithi118 ceph-mon[111738]: reconnect by client.24327 192.168.0.1:0/3135304614 after 0.000999978 2024-09-21T12:18:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:28 smithi118 ceph-mon[111738]: reconnect by client.24327 192.168.0.1:0/3135304614 after 0.000999978 2024-09-21T12:18:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:28 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:reconnect 2024-09-21T12:18:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:28 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:reconnect 2024-09-21T12:18:28.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:28 smithi118 ceph-mon[111738]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:reconnect,1=cephfs.smithi118.macjke=up:reconnect} 2 up:standby 2024-09-21T12:18:29.689 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:rejoin 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:rejoin 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:rejoin,1=cephfs.smithi118.macjke=up:rejoin} 2 up:standby 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: daemon mds.cephfs.smithi118.macjke is now active in filesystem cephfs as rank 1 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: daemon mds.cephfs.smithi118.ciljqr is now active in filesystem cephfs as rank 0 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:29 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:rejoin 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:rejoin 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: fsmap cephfs:2/2 {0=cephfs.smithi118.ciljqr=up:rejoin,1=cephfs.smithi118.macjke=up:rejoin} 2 up:standby 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: daemon mds.cephfs.smithi118.macjke is now active in filesystem cephfs as rank 1 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: daemon mds.cephfs.smithi118.ciljqr is now active in filesystem cephfs as rank 0 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:29.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:29 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:30.646 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:30 smithi149 ceph-mon[79770]: pgmap v1193: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-09-21T12:18:30.646 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:30 smithi149 ceph-mon[79770]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:18:30.646 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:30 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:active 2024-09-21T12:18:30.646 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:30 smithi149 ceph-mon[79770]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:active 2024-09-21T12:18:30.646 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:30 smithi149 ceph-mon[79770]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T12:18:30.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:30 smithi118 ceph-mon[111738]: pgmap v1193: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-09-21T12:18:30.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:30 smithi118 ceph-mon[111738]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:18:30.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:30 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] up:active 2024-09-21T12:18:30.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:30 smithi118 ceph-mon[111738]: mds.? [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] up:active 2024-09-21T12:18:30.825 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:30 smithi118 ceph-mon[111738]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T12:18:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:32 smithi149 ceph-mon[79770]: pgmap v1194: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 85 B/s wr, 11 op/s 2024-09-21T12:18:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:32 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:32.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:32 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:32.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:32 smithi118 ceph-mon[111738]: pgmap v1194: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 85 B/s wr, 11 op/s 2024-09-21T12:18:32.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:32 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:32.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:32 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:33 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:33 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:34.151 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:33 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:34.151 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:33 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:35.092 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:34 smithi118 ceph-mon[111738]: pgmap v1195: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 341 B/s wr, 14 op/s 2024-09-21T12:18:35.168 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:34 smithi149 ceph-mon[79770]: pgmap v1195: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 341 B/s wr, 14 op/s 2024-09-21T12:18:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:18:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:36.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:36.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:18:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:37.263 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:36 smithi118 ceph-mon[111738]: pgmap v1196: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 8.8 MiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T12:18:37.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:36 smithi149 ceph-mon[79770]: pgmap v1196: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 8.8 MiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T12:18:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:38 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:38 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:38 smithi118 ceph-mon[111738]: pgmap v1197: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-21T12:18:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:38 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:38 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:38 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:38 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:38 smithi149 ceph-mon[79770]: pgmap v1197: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-21T12:18:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:38 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:38.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:38 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:40.493 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:40 smithi118 ceph-mon[111738]: pgmap v1198: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T12:18:40.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:40 smithi149 ceph-mon[79770]: pgmap v1198: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T12:18:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:41.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: pgmap v1199: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 9.2 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T12:18:41.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:41 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T12:18:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:18:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: pgmap v1199: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 9.2 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-21T12:18:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T12:18:42.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:41 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T12:18:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-21T12:18:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T12:18:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T12:18:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi118"} : dispatch 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi118"}]': finished 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"} : dispatch 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]': finished 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all iscsi 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all nfs 2024-09-21T12:18:43.201 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: Upgrade: Setting container_image for all nvmeof 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: Upgrade: Finalizing container_image settings 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T12:18:43.202 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T12:18:43.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.204 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: Upgrade: Complete! 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:18:43.205 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-21T12:18:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T12:18:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: fsmap cephfs:2 {0=cephfs.smithi118.ciljqr=up:active,1=cephfs.smithi118.macjke=up:active} 2 up:standby 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi118"} : dispatch 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi118"}]': finished 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"} : dispatch 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]': finished 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all iscsi 2024-09-21T12:18:43.325 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all nfs 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: Upgrade: Setting container_image for all nvmeof 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: Upgrade: Finalizing container_image settings 2024-09-21T12:18:43.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T12:18:43.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T12:18:43.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T12:18:43.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T12:18:43.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T12:18:43.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T12:18:43.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T12:18:43.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T12:18:43.328 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: Upgrade: Complete! 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:18:43.329 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:18:43.330 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:18:43.330 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:43.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.512+0000 7f9c57023640 1 -- 172.21.15.118:0/708671810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 msgr2=0x7f9c50107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:43.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.512+0000 7f9c57023640 1 --2- 172.21.15.118:0/708671810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 0x7f9c50107d10 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009880 tx=0x7f9c4002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:43.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.513+0000 7f9c57023640 1 -- 172.21.15.118:0/708671810 shutdown_connections 2024-09-21T12:18:43.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.513+0000 7f9c57023640 1 --2- 172.21.15.118:0/708671810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c50101930 0x7f9c50101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:43.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.513+0000 7f9c57023640 1 --2- 172.21.15.118:0/708671810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 0x7f9c50107d10 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:43.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.513+0000 7f9c57023640 1 -- 172.21.15.118:0/708671810 >> 172.21.15.118:0/708671810 conn(0x7f9c500fd630 msgr2=0x7f9c500ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:43.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.513+0000 7f9c57023640 1 -- 172.21.15.118:0/708671810 shutdown_connections 2024-09-21T12:18:43.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.513+0000 7f9c57023640 1 -- 172.21.15.118:0/708671810 wait complete. 2024-09-21T12:18:43.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.513+0000 7f9c57023640 1 Processor -- start 2024-09-21T12:18:43.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.513+0000 7f9c57023640 1 -- start start 2024-09-21T12:18:43.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c57023640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c50101930 0x7f9c500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:43.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c57023640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 0x7f9c50074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:43.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c57023640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5010ee00 con 0x7f9c50107930 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c57023640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5010ec80 con 0x7f9c50101930 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c4ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 0x7f9c50074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c4ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 0x7f9c50074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54192/0 (socket says 172.21.15.118:54192) 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c4ffff640 1 -- 172.21.15.118:0/3122598247 learned_addr learned my addr 172.21.15.118:0/3122598247 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c54dbf640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c50101930 0x7f9c500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c4ffff640 1 -- 172.21.15.118:0/3122598247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c50101930 msgr2=0x7f9c500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c4ffff640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c50101930 0x7f9c500744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c4ffff640 1 -- 172.21.15.118:0/3122598247 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c50074f70 con 0x7f9c50107930 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c4ffff640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 0x7f9c50074a30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400e970 tx=0x7f9c4400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.514+0000 7f9c4dffb640 1 -- 172.21.15.118:0/3122598247 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c4400cac0 con 0x7f9c50107930 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.515+0000 7f9c4dffb640 1 -- 172.21.15.118:0/3122598247 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c440054e0 con 0x7f9c50107930 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.515+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c50075260 con 0x7f9c50107930 2024-09-21T12:18:43.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.515+0000 7f9c4dffb640 1 -- 172.21.15.118:0/3122598247 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c44010430 con 0x7f9c50107930 2024-09-21T12:18:43.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.515+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c501a3e70 con 0x7f9c50107930 2024-09-21T12:18:43.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.516+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c50103070 con 0x7f9c50107930 2024-09-21T12:18:43.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.516+0000 7f9c4dffb640 1 -- 172.21.15.118:0/3122598247 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9c44004e80 con 0x7f9c50107930 2024-09-21T12:18:43.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.517+0000 7f9c4dffb640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9c3807af30 0x7f9c3807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:43.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.517+0000 7f9c4dffb640 1 -- 172.21.15.118:0/3122598247 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9c4409e700 con 0x7f9c50107930 2024-09-21T12:18:43.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.517+0000 7f9c54dbf640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9c3807af30 0x7f9c3807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:43.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.518+0000 7f9c54dbf640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9c3807af30 0x7f9c3807d3f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9c400096c0 tx=0x7f9c40031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:43.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.522+0000 7f9c4dffb640 1 -- 172.21.15.118:0/3122598247 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9c44069c50 con 0x7f9c50107930 2024-09-21T12:18:43.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.718+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9c50062630 con 0x7f9c3807af30 2024-09-21T12:18:43.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.719+0000 7f9c4dffb640 1 -- 172.21.15.118:0/3122598247 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f9c50062630 con 0x7f9c3807af30 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.721+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9c3807af30 msgr2=0x7f9c3807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.721+0000 7f9c57023640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9c3807af30 0x7f9c3807d3f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9c400096c0 tx=0x7f9c40031400 comp rx=0 tx=0).stop 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.722+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 msgr2=0x7f9c50074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.722+0000 7f9c57023640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 0x7f9c50074a30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400e970 tx=0x7f9c4400ed70 comp rx=0 tx=0).stop 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.722+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 shutdown_connections 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.722+0000 7f9c57023640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f9c3807af30 0x7f9c3807d3f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.722+0000 7f9c57023640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c50107930 0x7f9c50074a30 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.722+0000 7f9c57023640 1 --2- 172.21.15.118:0/3122598247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c50101930 0x7f9c500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.722+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 >> 172.21.15.118:0/3122598247 conn(0x7f9c500fd630 msgr2=0x7f9c500fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.722+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 shutdown_connections 2024-09-21T12:18:43.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:43.722+0000 7f9c57023640 1 -- 172.21.15.118:0/3122598247 wait complete. 2024-09-21T12:18:44.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:43 smithi149 ceph-mon[79770]: pgmap v1200: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-21T12:18:44.265 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:43 smithi118 ceph-mon[111738]: pgmap v1200: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-21T12:18:44.366 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch ps' 2024-09-21T12:18:44.655 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:18:45.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:44 smithi118 ceph-mon[111738]: from='client.35958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:45.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.099+0000 7f2a7d67c640 1 -- 172.21.15.118:0/2605469154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 msgr2=0x7f2a78100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:45.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.099+0000 7f2a7d67c640 1 --2- 172.21.15.118:0/2605469154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 0x7f2a78100c80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009880 tx=0x7f2a6002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:45.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.100+0000 7f2a7d67c640 1 -- 172.21.15.118:0/2605469154 shutdown_connections 2024-09-21T12:18:45.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.100+0000 7f2a7d67c640 1 --2- 172.21.15.118:0/2605469154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 0x7f2a78100c80 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:45.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.100+0000 7f2a7d67c640 1 --2- 172.21.15.118:0/2605469154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a78106820 0x7f2a78106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:45.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.100+0000 7f2a7d67c640 1 -- 172.21.15.118:0/2605469154 >> 172.21.15.118:0/2605469154 conn(0x7f2a780fc520 msgr2=0x7f2a780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:45.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.100+0000 7f2a7d67c640 1 -- 172.21.15.118:0/2605469154 shutdown_connections 2024-09-21T12:18:45.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.100+0000 7f2a7d67c640 1 -- 172.21.15.118:0/2605469154 wait complete. 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.100+0000 7f2a7d67c640 1 Processor -- start 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.100+0000 7f2a7d67c640 1 -- start start 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a7d67c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 0x7f2a7819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a7d67c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a78106820 0x7f2a7819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a7d67c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7810dcd0 con 0x7f2a78100820 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a7d67c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7810db50 con 0x7f2a78106820 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a76ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 0x7f2a7819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a76ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 0x7f2a7819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54210/0 (socket says 172.21.15.118:54210) 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a76ffd640 1 -- 172.21.15.118:0/587695871 learned_addr learned my addr 172.21.15.118:0/587695871 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a767fc640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a78106820 0x7f2a7819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a76ffd640 1 -- 172.21.15.118:0/587695871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a78106820 msgr2=0x7f2a7819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a76ffd640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a78106820 0x7f2a7819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a76ffd640 1 -- 172.21.15.118:0/587695871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a781977c0 con 0x7f2a78100820 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a767fc640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a78106820 0x7f2a7819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a76ffd640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 0x7f2a7819d640 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cc60 tx=0x7f2a6800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a6ffff640 1 -- 172.21.15.118:0/587695871 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a6800ce10 con 0x7f2a78100820 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a6ffff640 1 -- 172.21.15.118:0/587695871 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a6800f910 con 0x7f2a78100820 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a6ffff640 1 -- 172.21.15.118:0/587695871 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a68018ae0 con 0x7f2a78100820 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a78197ab0 con 0x7f2a78100820 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.101+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a78198040 con 0x7f2a78100820 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.102+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a78101f60 con 0x7f2a78100820 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.103+0000 7f2a6ffff640 1 -- 172.21.15.118:0/587695871 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2a68018ca0 con 0x7f2a78100820 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.103+0000 7f2a6ffff640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a6407af30 0x7f2a6407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.104+0000 7f2a6ffff640 1 -- 172.21.15.118:0/587695871 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2a6809e7b0 con 0x7f2a78100820 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.104+0000 7f2a767fc640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a6407af30 0x7f2a6407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.104+0000 7f2a767fc640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a6407af30 0x7f2a6407d3f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2a60031460 tx=0x7f2a600095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:45.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.108+0000 7f2a6ffff640 1 -- 172.21.15.118:0/587695871 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a68014030 con 0x7f2a78100820 2024-09-21T12:18:45.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:44 smithi149 ceph-mon[79770]: from='client.35958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:45.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.296+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2a78198350 con 0x7f2a6407af30 2024-09-21T12:18:45.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.306+0000 7f2a6ffff640 1 -- 172.21.15.118:0/587695871 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2a78198350 con 0x7f2a6407af30 2024-09-21T12:18:45.307 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:18:45.307 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (36m) 8s ago 47m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:18:45.307 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (21s) 8s ago 47m 8258k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 6ce8282ab068 2024-09-21T12:18:45.307 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (17s) 13s ago 46m 7285k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3d5564d277ce 2024-09-21T12:18:45.307 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (34m) 8s ago 47m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:18:45.307 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (34m) 13s ago 46m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:18:45.307 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (36m) 8s ago 47m 82.9M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (31m) 8s ago 42m 88.6M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (30m) 8s ago 42m 25.4M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (15m) 13s ago 42m 20.8M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (30m) 13s ago 42m 24.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (38m) 8s ago 49m 535M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (37m) 13s ago 46m 466M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (35m) 8s ago 49m 87.6M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (35m) 13s ago 46m 59.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (37m) 8s ago 47m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (37m) 13s ago 46m 12.8M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (34m) 8s ago 45m 101M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (33m) 8s ago 45m 107M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (33m) 8s ago 44m 93.2M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:18:45.308 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (32m) 13s ago 44m 114M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:18:45.309 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (31m) 13s ago 43m 94.7M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:18:45.309 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (31m) 13s ago 43m 96.5M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:18:45.309 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (36m) 8s ago 47m 71.7M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:18:45.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a6407af30 msgr2=0x7f2a6407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:45.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a6407af30 0x7f2a6407d3f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2a60031460 tx=0x7f2a600095f0 comp rx=0 tx=0).stop 2024-09-21T12:18:45.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 msgr2=0x7f2a7819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:45.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 0x7f2a7819d640 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cc60 tx=0x7f2a6800a620 comp rx=0 tx=0).stop 2024-09-21T12:18:45.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 shutdown_connections 2024-09-21T12:18:45.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a78106820 0x7f2a7819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:45.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f2a6407af30 0x7f2a6407d3f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:45.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 --2- 172.21.15.118:0/587695871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a78100820 0x7f2a7819d640 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:45.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 >> 172.21.15.118:0/587695871 conn(0x7f2a780fc520 msgr2=0x7f2a7806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:45.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 shutdown_connections 2024-09-21T12:18:45.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:45.308+0000 7f2a7d67c640 1 -- 172.21.15.118:0/587695871 wait complete. 2024-09-21T12:18:45.989 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:45 smithi118 ceph-mon[111738]: pgmap v1201: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-21T12:18:45.989 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:46.018 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade status' 2024-09-21T12:18:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:45 smithi149 ceph-mon[79770]: pgmap v1201: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-21T12:18:46.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:46.265 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.723+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/2441498589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 msgr2=0x7fa2e8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.723+0000 7fa2ed2f7640 1 --2- 172.21.15.118:0/2441498589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 0x7fa2e8106c00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009880 tx=0x7fa2d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.723+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/2441498589 shutdown_connections 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.723+0000 7fa2ed2f7640 1 --2- 172.21.15.118:0/2441498589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2e8100820 0x7fa2e8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.723+0000 7fa2ed2f7640 1 --2- 172.21.15.118:0/2441498589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 0x7fa2e8106c00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.723+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/2441498589 >> 172.21.15.118:0/2441498589 conn(0x7fa2e80fc520 msgr2=0x7fa2e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.723+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/2441498589 shutdown_connections 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.723+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/2441498589 wait complete. 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2ed2f7640 1 Processor -- start 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2ed2f7640 1 -- start start 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2ed2f7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2e8100820 0x7fa2e819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2ed2f7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 0x7fa2e819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2ed2f7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e810dcf0 con 0x7fa2e8106820 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2ed2f7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e810db70 con 0x7fa2e8100820 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2dffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 0x7fa2e819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2dffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 0x7fa2e819cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54040/0 (socket says 172.21.15.118:54040) 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2dffff640 1 -- 172.21.15.118:0/958705580 learned_addr learned my addr 172.21.15.118:0/958705580 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.724+0000 7fa2e6ffd640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2e8100820 0x7fa2e819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.725+0000 7fa2dffff640 1 -- 172.21.15.118:0/958705580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2e8100820 msgr2=0x7fa2e819c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.725+0000 7fa2dffff640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2e8100820 0x7fa2e819c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.725+0000 7fa2dffff640 1 -- 172.21.15.118:0/958705580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e81966e0 con 0x7fa2e8106820 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.725+0000 7fa2dffff640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 0x7fa2e819cb50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000e970 tx=0x7fa2d000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.725+0000 7fa2e4ff9640 1 -- 172.21.15.118:0/958705580 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2d000cac0 con 0x7fa2e8106820 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.725+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e81969d0 con 0x7fa2e8106820 2024-09-21T12:18:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.725+0000 7fa2e4ff9640 1 -- 172.21.15.118:0/958705580 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2d00054e0 con 0x7fa2e8106820 2024-09-21T12:18:46.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.725+0000 7fa2e4ff9640 1 -- 172.21.15.118:0/958705580 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2d0010430 con 0x7fa2e8106820 2024-09-21T12:18:46.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.725+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e8196f30 con 0x7fa2e8106820 2024-09-21T12:18:46.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.726+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e8101f60 con 0x7fa2e8106820 2024-09-21T12:18:46.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.727+0000 7fa2e4ff9640 1 -- 172.21.15.118:0/958705580 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa2d0004ec0 con 0x7fa2e8106820 2024-09-21T12:18:46.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.727+0000 7fa2e4ff9640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2d407af30 0x7fa2d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:46.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.727+0000 7fa2e4ff9640 1 -- 172.21.15.118:0/958705580 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa2d009e810 con 0x7fa2e8106820 2024-09-21T12:18:46.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.728+0000 7fa2e6ffd640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2d407af30 0x7fa2d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:46.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.728+0000 7fa2e6ffd640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2d407af30 0x7fa2d407d3f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80096c0 tx=0x7fa2d8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.732+0000 7fa2e4ff9640 1 -- 172.21.15.118:0/958705580 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa2d0069cc0 con 0x7fa2e8106820 2024-09-21T12:18:46.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.934+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa2e8197240 con 0x7fa2d407af30 2024-09-21T12:18:46.935 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:46 smithi118 ceph-mon[111738]: from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:46.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.936+0000 7fa2e4ff9640 1 -- 172.21.15.118:0/958705580 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fa2e8197240 con 0x7fa2d407af30 2024-09-21T12:18:46.937 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:18:46.937 INFO:teuthology.orchestra.run.smithi118.stdout: "target_image": null, 2024-09-21T12:18:46.937 INFO:teuthology.orchestra.run.smithi118.stdout: "in_progress": false, 2024-09-21T12:18:46.937 INFO:teuthology.orchestra.run.smithi118.stdout: "which": "", 2024-09-21T12:18:46.937 INFO:teuthology.orchestra.run.smithi118.stdout: "services_complete": [], 2024-09-21T12:18:46.937 INFO:teuthology.orchestra.run.smithi118.stdout: "progress": null, 2024-09-21T12:18:46.937 INFO:teuthology.orchestra.run.smithi118.stdout: "message": "", 2024-09-21T12:18:46.937 INFO:teuthology.orchestra.run.smithi118.stdout: "is_paused": false 2024-09-21T12:18:46.937 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:18:46.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2d407af30 msgr2=0x7fa2d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2d407af30 0x7fa2d407d3f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80096c0 tx=0x7fa2d8031400 comp rx=0 tx=0).stop 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 msgr2=0x7fa2e819cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 0x7fa2e819cb50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000e970 tx=0x7fa2d000ed70 comp rx=0 tx=0).stop 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 shutdown_connections 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fa2d407af30 0x7fa2d407d3f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2e8106820 0x7fa2e819cb50 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 --2- 172.21.15.118:0/958705580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2e8100820 0x7fa2e819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 >> 172.21.15.118:0/958705580 conn(0x7fa2e80fc520 msgr2=0x7fa2e80fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 shutdown_connections 2024-09-21T12:18:46.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:46.938+0000 7fa2ed2f7640 1 -- 172.21.15.118:0/958705580 wait complete. 2024-09-21T12:18:47.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:46 smithi149 ceph-mon[79770]: from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:47.609 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph health detail' 2024-09-21T12:18:47.856 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:18:48.130 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:47 smithi118 ceph-mon[111738]: pgmap v1202: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-21T12:18:48.130 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:47 smithi118 ceph-mon[111738]: from='client.35966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:47 smithi149 ceph-mon[79770]: pgmap v1202: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-21T12:18:48.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:47 smithi149 ceph-mon[79770]: from='client.35966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.337+0000 7fba04586640 1 -- 172.21.15.118:0/2014369988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc100820 msgr2=0x7fb9fc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.337+0000 7fba04586640 1 --2- 172.21.15.118:0/2014369988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc100820 0x7fb9fc100c80 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009880 tx=0x7fb9f802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.337+0000 7fba04586640 1 -- 172.21.15.118:0/2014369988 shutdown_connections 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.337+0000 7fba04586640 1 --2- 172.21.15.118:0/2014369988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc100820 0x7fb9fc100c80 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.337+0000 7fba04586640 1 --2- 172.21.15.118:0/2014369988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9fc106820 0x7fb9fc106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.337+0000 7fba04586640 1 -- 172.21.15.118:0/2014369988 >> 172.21.15.118:0/2014369988 conn(0x7fb9fc0fc520 msgr2=0x7fb9fc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.337+0000 7fba04586640 1 -- 172.21.15.118:0/2014369988 shutdown_connections 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.337+0000 7fba04586640 1 -- 172.21.15.118:0/2014369988 wait complete. 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.337+0000 7fba04586640 1 Processor -- start 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba04586640 1 -- start start 2024-09-21T12:18:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba04586640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9fc100820 0x7fb9fc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba04586640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc106820 0x7fb9fc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba04586640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10dcd0 con 0x7fb9fc106820 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba04586640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10db50 con 0x7fb9fc100820 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba01b21640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc106820 0x7fb9fc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba01b21640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc106820 0x7fb9fc19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54052/0 (socket says 172.21.15.118:54052) 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba01b21640 1 -- 172.21.15.118:0/1102749958 learned_addr learned my addr 172.21.15.118:0/1102749958 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba01b21640 1 -- 172.21.15.118:0/1102749958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9fc100820 msgr2=0x7fb9fc19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba02322640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9fc100820 0x7fb9fc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba01b21640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9fc100820 0x7fb9fc19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba01b21640 1 -- 172.21.15.118:0/1102749958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc1977b0 con 0x7fb9fc106820 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba01b21640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc106820 0x7fb9fc19db70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8031460 tx=0x7fb9f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fb9ef7fe640 1 -- 172.21.15.118:0/1102749958 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9f803f070 con 0x7fb9fc106820 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fb9ef7fe640 1 -- 172.21.15.118:0/1102749958 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9f8004cf0 con 0x7fb9fc106820 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc197a40 con 0x7fb9fc106820 2024-09-21T12:18:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.338+0000 7fb9ef7fe640 1 -- 172.21.15.118:0/1102749958 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9f8035030 con 0x7fb9fc106820 2024-09-21T12:18:48.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.339+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc197f70 con 0x7fb9fc106820 2024-09-21T12:18:48.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.340+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc101f60 con 0x7fb9fc106820 2024-09-21T12:18:48.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.340+0000 7fb9ef7fe640 1 -- 172.21.15.118:0/1102749958 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb9f8042070 con 0x7fb9fc106820 2024-09-21T12:18:48.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.341+0000 7fb9ef7fe640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9e807af30 0x7fb9e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:48.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.341+0000 7fba02322640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9e807af30 0x7fb9e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:48.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.341+0000 7fb9ef7fe640 1 -- 172.21.15.118:0/1102749958 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb9f80beb70 con 0x7fb9fc106820 2024-09-21T12:18:48.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.341+0000 7fba02322640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9e807af30 0x7fb9e807d3f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000ba40 tx=0x7fb9f0005cc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:48.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.345+0000 7fb9ef7fe640 1 -- 172.21.15.118:0/1102749958 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9f808a0c0 con 0x7fb9fc106820 2024-09-21T12:18:48.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.597+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb9fc198d10 con 0x7fb9fc106820 2024-09-21T12:18:48.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.597+0000 7fb9ef7fe640 1 -- 172.21.15.118:0/1102749958 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fb9fc198d10 con 0x7fb9fc106820 2024-09-21T12:18:48.599 INFO:teuthology.orchestra.run.smithi118.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:18:48.599 INFO:teuthology.orchestra.run.smithi118.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:18:48.599 INFO:teuthology.orchestra.run.smithi118.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:18:48.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9e807af30 msgr2=0x7fb9e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:48.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9e807af30 0x7fb9e807d3f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000ba40 tx=0x7fb9f0005cc0 comp rx=0 tx=0).stop 2024-09-21T12:18:48.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc106820 msgr2=0x7fb9fc19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:48.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc106820 0x7fb9fc19db70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8031460 tx=0x7fb9f80048f0 comp rx=0 tx=0).stop 2024-09-21T12:18:48.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 shutdown_connections 2024-09-21T12:18:48.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb9e807af30 0x7fb9e807d3f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:48.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9fc106820 0x7fb9fc19db70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:48.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 --2- 172.21.15.118:0/1102749958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9fc100820 0x7fb9fc19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:48.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 >> 172.21.15.118:0/1102749958 conn(0x7fb9fc0fc520 msgr2=0x7fb9fc1045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:48.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 shutdown_connections 2024-09-21T12:18:48.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:48.599+0000 7fba04586640 1 -- 172.21.15.118:0/1102749958 wait complete. 2024-09-21T12:18:49.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:48 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1102749958' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:18:49.222 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:48 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1102749958' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:18:49.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions' 2024-09-21T12:18:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:18:50.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.013+0000 7fbc7bfee640 1 -- 172.21.15.118:0/2754310297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741011f0 msgr2=0x7fbc741056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:50.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.013+0000 7fbc7bfee640 1 --2- 172.21.15.118:0/2754310297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741011f0 0x7fbc741056c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009880 tx=0x7fbc6802a530 comp rx=0 tx=0).stop 2024-09-21T12:18:50.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.013+0000 7fbc7bfee640 1 -- 172.21.15.118:0/2754310297 shutdown_connections 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.013+0000 7fbc7bfee640 1 --2- 172.21.15.118:0/2754310297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741011f0 0x7fbc741056c0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.013+0000 7fbc7bfee640 1 --2- 172.21.15.118:0/2754310297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc741008d0 0x7fbc74100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.013+0000 7fbc7bfee640 1 -- 172.21.15.118:0/2754310297 >> 172.21.15.118:0/2754310297 conn(0x7fbc740fc520 msgr2=0x7fbc740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.013+0000 7fbc7bfee640 1 -- 172.21.15.118:0/2754310297 shutdown_connections 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.013+0000 7fbc7bfee640 1 -- 172.21.15.118:0/2754310297 wait complete. 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.014+0000 7fbc7bfee640 1 Processor -- start 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.014+0000 7fbc7bfee640 1 -- start start 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.014+0000 7fbc7bfee640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741008d0 0x7fbc7419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.014+0000 7fbc7bfee640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc741011f0 0x7fbc7419e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.014+0000 7fbc7bfee640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbc74115470 con 0x7fbc741008d0 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.014+0000 7fbc7bfee640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc741152f0 con 0x7fbc741011f0 2024-09-21T12:18:50.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.014+0000 7fbc79d8a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741008d0 0x7fbc7419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.014+0000 7fbc79d8a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741008d0 0x7fbc7419e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54064/0 (socket says 172.21.15.118:54064) 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.014+0000 7fbc79d8a640 1 -- 172.21.15.118:0/1742270986 learned_addr learned my addr 172.21.15.118:0/1742270986 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.015+0000 7fbc79d8a640 1 -- 172.21.15.118:0/1742270986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc741011f0 msgr2=0x7fbc7419e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.015+0000 7fbc79d8a640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc741011f0 0x7fbc7419e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.015+0000 7fbc79d8a640 1 -- 172.21.15.118:0/1742270986 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc741a2920 con 0x7fbc741008d0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.015+0000 7fbc79d8a640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741008d0 0x7fbc7419e050 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00ba50 tx=0x7fbc6c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.015+0000 7fbc72ffd640 1 -- 172.21.15.118:0/1742270986 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc6c019070 con 0x7fbc741008d0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.015+0000 7fbc72ffd640 1 -- 172.21.15.118:0/1742270986 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc6c00ce20 con 0x7fbc741008d0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.015+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc741a2c10 con 0x7fbc741008d0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.015+0000 7fbc72ffd640 1 -- 172.21.15.118:0/1742270986 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc6c0075a0 con 0x7fbc741008d0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.015+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc741a31a0 con 0x7fbc741008d0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.016+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc7406abe0 con 0x7fbc741008d0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.017+0000 7fbc72ffd640 1 -- 172.21.15.118:0/1742270986 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbc6c01c070 con 0x7fbc741008d0 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.017+0000 7fbc72ffd640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbc5c07af30 0x7fbc5c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:50.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.017+0000 7fbc72ffd640 1 -- 172.21.15.118:0/1742270986 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbc6c09d9a0 con 0x7fbc741008d0 2024-09-21T12:18:50.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.017+0000 7fbc79589640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbc5c07af30 0x7fbc5c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:50.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.018+0000 7fbc79589640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbc5c07af30 0x7fbc5c07d3f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbc680096c0 tx=0x7fbc68000bc0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:50.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.021+0000 7fbc72ffd640 1 -- 172.21.15.118:0/1742270986 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbc6c068ef0 con 0x7fbc741008d0 2024-09-21T12:18:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:49 smithi149 ceph-mon[79770]: pgmap v1203: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:50.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.267+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbc7419f3b0 con 0x7fbc741008d0 2024-09-21T12:18:50.269 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:49 smithi118 ceph-mon[111738]: pgmap v1203: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:50.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.267+0000 7fbc72ffd640 1 -- 172.21.15.118:0/1742270986 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fbc6c06dda0 con 0x7fbc741008d0 2024-09-21T12:18:50.270 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:18:50.270 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:18:50.270 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:18:50.270 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:18:50.270 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:18:50.270 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:18:50.271 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:18:50.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.269+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbc5c07af30 msgr2=0x7fbc5c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:50.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.269+0000 7fbc7bfee640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbc5c07af30 0x7fbc5c07d3f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbc680096c0 tx=0x7fbc68000bc0 comp rx=0 tx=0).stop 2024-09-21T12:18:50.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.269+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741008d0 msgr2=0x7fbc7419e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:50.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.269+0000 7fbc7bfee640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741008d0 0x7fbc7419e050 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00ba50 tx=0x7fbc6c00bf10 comp rx=0 tx=0).stop 2024-09-21T12:18:50.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.269+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 shutdown_connections 2024-09-21T12:18:50.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.269+0000 7fbc7bfee640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc741011f0 0x7fbc7419e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:50.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.269+0000 7fbc7bfee640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fbc5c07af30 0x7fbc5c07d3f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:50.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.269+0000 7fbc7bfee640 1 --2- 172.21.15.118:0/1742270986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc741008d0 0x7fbc7419e050 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:50.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.269+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 >> 172.21.15.118:0/1742270986 conn(0x7fbc740fc520 msgr2=0x7fbc74112c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:50.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.270+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 shutdown_connections 2024-09-21T12:18:50.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:18:50.270+0000 7fbc7bfee640 1 -- 172.21.15.118:0/1742270986 wait complete. 2024-09-21T12:18:50.876 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-21T12:18:51.124 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:18:51.245 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:51.245 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:18:51.245 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:50 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1742270986' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:51.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:18:51.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:18:51.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:50 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1742270986' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:18:51.660 INFO:teuthology.orchestra.run.smithi118.stdout:wait for servicemap items w/ changing names to refresh 2024-09-21T12:18:52.231 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:51 smithi118 ceph-mon[111738]: pgmap v1204: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:52.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'sleep 60' 2024-09-21T12:18:52.351 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:51 smithi149 ceph-mon[79770]: pgmap v1204: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:18:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:53 smithi118 ceph-mon[111738]: pgmap v1205: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:54.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:53 smithi149 ceph-mon[79770]: pgmap v1205: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:55 smithi118 ceph-mon[111738]: pgmap v1206: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:55 smithi149 ceph-mon[79770]: pgmap v1206: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:57 smithi118 ceph-mon[111738]: pgmap v1207: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:18:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:57 smithi149 ceph-mon[79770]: pgmap v1207: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:18:59 smithi118 ceph-mon[111738]: pgmap v1208: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:18:59 smithi149 ceph-mon[79770]: pgmap v1208: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:01 smithi118 ceph-mon[111738]: pgmap v1209: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:01 smithi149 ceph-mon[79770]: pgmap v1209: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:03 smithi118 ceph-mon[111738]: pgmap v1210: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:04 smithi149 ceph-mon[79770]: pgmap v1210: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:19:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:19:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:06 smithi118 ceph-mon[111738]: pgmap v1211: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:06 smithi149 ceph-mon[79770]: pgmap v1211: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:08 smithi118 ceph-mon[111738]: pgmap v1212: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:08.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:08 smithi149 ceph-mon[79770]: pgmap v1212: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:09.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:09 smithi118 ceph-mon[111738]: pgmap v1213: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:09.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:09 smithi149 ceph-mon[79770]: pgmap v1213: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:12.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:11 smithi149 ceph-mon[79770]: pgmap v1214: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:11 smithi118 ceph-mon[111738]: pgmap v1214: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:14.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:13 smithi149 ceph-mon[79770]: pgmap v1215: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:13 smithi118 ceph-mon[111738]: pgmap v1215: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:16.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:15 smithi149 ceph-mon[79770]: pgmap v1216: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:16.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:15 smithi118 ceph-mon[111738]: pgmap v1216: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:18.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:17 smithi149 ceph-mon[79770]: pgmap v1217: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:17 smithi118 ceph-mon[111738]: pgmap v1217: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:20.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:19 smithi149 ceph-mon[79770]: pgmap v1218: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:19 smithi118 ceph-mon[111738]: pgmap v1218: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:21.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:19:21.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:19:22.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:21 smithi149 ceph-mon[79770]: pgmap v1219: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:21 smithi118 ceph-mon[111738]: pgmap v1219: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:23 smithi118 ceph-mon[111738]: pgmap v1220: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:23 smithi149 ceph-mon[79770]: pgmap v1220: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:25 smithi118 ceph-mon[111738]: pgmap v1221: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:25 smithi149 ceph-mon[79770]: pgmap v1221: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:28.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:27 smithi118 ceph-mon[111738]: pgmap v1222: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:27 smithi149 ceph-mon[79770]: pgmap v1222: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:29 smithi118 ceph-mon[111738]: pgmap v1223: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:29 smithi149 ceph-mon[79770]: pgmap v1223: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:32.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:31 smithi118 ceph-mon[111738]: pgmap v1224: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:31 smithi149 ceph-mon[79770]: pgmap v1224: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:33 smithi118 ceph-mon[111738]: pgmap v1225: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:33 smithi149 ceph-mon[79770]: pgmap v1225: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:35 smithi118 ceph-mon[111738]: pgmap v1226: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:19:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:35 smithi149 ceph-mon[79770]: pgmap v1226: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:19:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:37 smithi118 ceph-mon[111738]: pgmap v1227: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:37 smithi149 ceph-mon[79770]: pgmap v1227: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:39 smithi118 ceph-mon[111738]: pgmap v1228: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:39 smithi149 ceph-mon[79770]: pgmap v1228: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:41 smithi118 ceph-mon[111738]: pgmap v1229: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:42.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:41 smithi149 ceph-mon[79770]: pgmap v1229: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:19:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:19:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:19:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:19:43.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:19:43.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:19:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:19:43.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:19:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:43 smithi118 ceph-mon[111738]: pgmap v1230: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:43 smithi149 ceph-mon[79770]: pgmap v1230: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:45 smithi118 ceph-mon[111738]: pgmap v1231: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:46.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:45 smithi149 ceph-mon[79770]: pgmap v1231: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:47 smithi118 ceph-mon[111738]: pgmap v1232: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:47 smithi149 ceph-mon[79770]: pgmap v1232: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:50.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:49 smithi149 ceph-mon[79770]: pgmap v1233: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:50.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:49 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:19:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:49 smithi118 ceph-mon[111738]: pgmap v1233: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:49 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:19:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:51 smithi118 ceph-mon[111738]: pgmap v1234: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:52.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:51 smithi149 ceph-mon[79770]: pgmap v1234: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:53.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch ps' 2024-09-21T12:19:53.833 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:19:54.264 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:53 smithi118 ceph-mon[111738]: pgmap v1235: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:54.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.262+0000 7fab08164640 1 -- 172.21.15.118:0/39180218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 msgr2=0x7fab00101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:54.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.262+0000 7fab08164640 1 --2- 172.21.15.118:0/39180218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 0x7fab00101d90 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7faafc009880 tx=0x7faafc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:19:54.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.262+0000 7fab08164640 1 -- 172.21.15.118:0/39180218 shutdown_connections 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.262+0000 7fab08164640 1 --2- 172.21.15.118:0/39180218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 0x7fab00101d90 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.262+0000 7fab08164640 1 --2- 172.21.15.118:0/39180218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab00107930 0x7fab00107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.262+0000 7fab08164640 1 -- 172.21.15.118:0/39180218 >> 172.21.15.118:0/39180218 conn(0x7fab000fd630 msgr2=0x7fab000ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.262+0000 7fab08164640 1 -- 172.21.15.118:0/39180218 shutdown_connections 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.262+0000 7fab08164640 1 -- 172.21.15.118:0/39180218 wait complete. 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab08164640 1 Processor -- start 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab08164640 1 -- start start 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab08164640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 0x7fab000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab08164640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab00107930 0x7fab00074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab08164640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fab0010ede0 con 0x7fab00101930 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab08164640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab0010ec60 con 0x7fab00107930 2024-09-21T12:19:54.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab05f00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 0x7fab000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab05f00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 0x7fab000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57146/0 (socket says 172.21.15.118:57146) 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab05f00640 1 -- 172.21.15.118:0/3724490409 learned_addr learned my addr 172.21.15.118:0/3724490409 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.263+0000 7fab056ff640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab00107930 0x7fab00074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.264+0000 7fab05f00640 1 -- 172.21.15.118:0/3724490409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab00107930 msgr2=0x7fab00074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.264+0000 7fab05f00640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab00107930 0x7fab00074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.264+0000 7fab05f00640 1 -- 172.21.15.118:0/3724490409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab00074f70 con 0x7fab00101930 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.264+0000 7fab05f00640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 0x7fab000744f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7faaf000d8d0 tx=0x7faaf000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.264+0000 7faaf6ffd640 1 -- 172.21.15.118:0/3724490409 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faaf0017070 con 0x7fab00101930 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.264+0000 7faaf6ffd640 1 -- 172.21.15.118:0/3724490409 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faaf0010460 con 0x7fab00101930 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.264+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab00075260 con 0x7fab00101930 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.264+0000 7faaf6ffd640 1 -- 172.21.15.118:0/3724490409 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faaf000f5f0 con 0x7fab00101930 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.264+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab001a3ed0 con 0x7fab00101930 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.265+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab00103070 con 0x7fab00101930 2024-09-21T12:19:54.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.266+0000 7faaf6ffd640 1 -- 172.21.15.118:0/3724490409 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7faaf0009a30 con 0x7fab00101930 2024-09-21T12:19:54.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.267+0000 7faaf6ffd640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaec07af30 0x7faaec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:54.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.267+0000 7faaf6ffd640 1 -- 172.21.15.118:0/3724490409 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faaf009df70 con 0x7fab00101930 2024-09-21T12:19:54.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.267+0000 7fab056ff640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaec07af30 0x7faaec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:54.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.268+0000 7fab056ff640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaec07af30 0x7faaec07d3f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fab00075f80 tx=0x7faafc031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:54.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.271+0000 7faaf6ffd640 1 -- 172.21.15.118:0/3724490409 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faaf00694c0 con 0x7fab00101930 2024-09-21T12:19:54.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:53 smithi149 ceph-mon[79770]: pgmap v1235: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:54.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.463+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 --> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fab00062630 con 0x7faaec07af30 2024-09-21T12:19:54.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.473+0000 7faaf6ffd640 1 -- 172.21.15.118:0/3724490409 <== mgr.14762 v2:172.21.15.118:6800/2298005256 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fab00062630 con 0x7faaec07af30 2024-09-21T12:19:54.475 INFO:teuthology.orchestra.run.smithi118.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:19:54.475 INFO:teuthology.orchestra.run.smithi118.stdout:alertmanager.smithi118 smithi118 *:9093,9094 running (37m) 77s ago 48m 20.1M - 0.27.0 11f11916f8cd a1bd5c1cc702 2024-09-21T12:19:54.475 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi118 smithi118 running (91s) 77s ago 48m 8258k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 6ce8282ab068 2024-09-21T12:19:54.475 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-exporter.smithi149 smithi149 running (86s) 82s ago 48m 7285k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3d5564d277ce 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi118 smithi118 running (35m) 77s ago 48m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 df31da5e257e 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:crash.smithi149 smithi149 running (35m) 82s ago 48m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c244bc1ff159 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:grafana.smithi118 smithi118 *:3000 running (37m) 77s ago 48m 82.9M - 10.4.8 5aad1d7cf004 31f75175f3ba 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.ciljqr smithi118 running (32m) 77s ago 43m 88.6M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 80aba2b87665 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi118.macjke smithi118 running (32m) 77s ago 43m 25.4M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 3ec49308aa68 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.qzbfns smithi149 running (16m) 82s ago 43m 20.8M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 43d9f85f1ff4 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:mds.cephfs.smithi149.zgoqsi smithi149 running (31m) 82s ago 43m 24.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bc87c1bccbce 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi118.djbwyn smithi118 *:8443,9283,8765 running (40m) 77s ago 50m 535M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 111e5e40e520 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:mgr.smithi149.xjglai smithi149 *:8443,9283,8765 running (39m) 82s ago 47m 466M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 14cb011e51bc 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi118 smithi118 running (36m) 77s ago 50m 87.6M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 68b433ac89c1 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:mon.smithi149 smithi149 running (36m) 82s ago 47m 59.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 8f06ed02d2f5 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi118 smithi118 *:9100 running (38m) 77s ago 48m 11.4M - 1.7.0 72c9c2088986 dabbcbe5ad3b 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:node-exporter.smithi149 smithi149 *:9100 running (38m) 82s ago 47m 12.8M - 1.7.0 72c9c2088986 298c9e868287 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:osd.0 smithi118 running (35m) 77s ago 46m 101M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 cced3491d260 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:osd.1 smithi118 running (34m) 77s ago 46m 107M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9548bc632e7c 2024-09-21T12:19:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:osd.2 smithi118 running (34m) 77s ago 45m 93.2M 1216M 19.3.0-5103-g5c1cdc3c 8f4d013db793 41c161aa8867 2024-09-21T12:19:54.477 INFO:teuthology.orchestra.run.smithi118.stdout:osd.3 smithi149 running (33m) 82s ago 45m 114M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fce4c8099aef 2024-09-21T12:19:54.477 INFO:teuthology.orchestra.run.smithi118.stdout:osd.4 smithi149 running (33m) 82s ago 44m 94.7M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 27363cb204c1 2024-09-21T12:19:54.477 INFO:teuthology.orchestra.run.smithi118.stdout:osd.5 smithi149 running (32m) 82s ago 44m 96.5M 4096M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e7036b24824b 2024-09-21T12:19:54.477 INFO:teuthology.orchestra.run.smithi118.stdout:prometheus.smithi118 smithi118 *:9095 running (38m) 77s ago 48m 71.7M - 2.51.0 1d3b7f56885b aeacbad94d90 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.475+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaec07af30 msgr2=0x7faaec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.475+0000 7fab08164640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaec07af30 0x7faaec07d3f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fab00075f80 tx=0x7faafc031400 comp rx=0 tx=0).stop 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.475+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 msgr2=0x7fab000744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.475+0000 7fab08164640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 0x7fab000744f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7faaf000d8d0 tx=0x7faaf000dd90 comp rx=0 tx=0).stop 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.476+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 shutdown_connections 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.476+0000 7fab08164640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab00107930 0x7fab00074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.476+0000 7fab08164640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7faaec07af30 0x7faaec07d3f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.476+0000 7fab08164640 1 --2- 172.21.15.118:0/3724490409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab00101930 0x7fab000744f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.476+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 >> 172.21.15.118:0/3724490409 conn(0x7fab000fd630 msgr2=0x7fab000fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:54.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.476+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 shutdown_connections 2024-09-21T12:19:54.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:54.476+0000 7fab08164640 1 -- 172.21.15.118:0/3724490409 wait complete. 2024-09-21T12:19:55.107 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions' 2024-09-21T12:19:55.372 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.852+0000 7fee66d8d640 1 -- 172.21.15.118:0/415484018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 msgr2=0x7fee60100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.852+0000 7fee66d8d640 1 --2- 172.21.15.118:0/415484018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 0x7fee60100c80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009880 tx=0x7fee4c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.852+0000 7fee66d8d640 1 -- 172.21.15.118:0/415484018 shutdown_connections 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.852+0000 7fee66d8d640 1 --2- 172.21.15.118:0/415484018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 0x7fee60100c80 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.852+0000 7fee66d8d640 1 --2- 172.21.15.118:0/415484018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee60106820 0x7fee60106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.852+0000 7fee66d8d640 1 -- 172.21.15.118:0/415484018 >> 172.21.15.118:0/415484018 conn(0x7fee600fc520 msgr2=0x7fee600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.852+0000 7fee66d8d640 1 -- 172.21.15.118:0/415484018 shutdown_connections 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.852+0000 7fee66d8d640 1 -- 172.21.15.118:0/415484018 wait complete. 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.853+0000 7fee66d8d640 1 Processor -- start 2024-09-21T12:19:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.853+0000 7fee66d8d640 1 -- start start 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.853+0000 7fee66d8d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 0x7fee60198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.853+0000 7fee66d8d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee60106820 0x7fee60198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.853+0000 7fee66d8d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fee6010dcf0 con 0x7fee60100820 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.853+0000 7fee66d8d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee6010db70 con 0x7fee60106820 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.853+0000 7fee64b29640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 0x7fee60198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.853+0000 7fee64b29640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 0x7fee60198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57944/0 (socket says 172.21.15.118:57944) 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.853+0000 7fee64b29640 1 -- 172.21.15.118:0/1046531256 learned_addr learned my addr 172.21.15.118:0/1046531256 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee5ffff640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee60106820 0x7fee60198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee64b29640 1 -- 172.21.15.118:0/1046531256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee60106820 msgr2=0x7fee60198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee64b29640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee60106820 0x7fee60198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee64b29640 1 -- 172.21.15.118:0/1046531256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee60199340 con 0x7fee60100820 2024-09-21T12:19:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee64b29640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 0x7fee60198800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fee5400d6f0 tx=0x7fee5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee5dffb640 1 -- 172.21.15.118:0/1046531256 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee54017070 con 0x7fee60100820 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee5dffb640 1 -- 172.21.15.118:0/1046531256 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee5400de00 con 0x7fee60100820 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee60199630 con 0x7fee60100820 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee5dffb640 1 -- 172.21.15.118:0/1046531256 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee54004bb0 con 0x7fee60100820 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.854+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee601a1c30 con 0x7fee60100820 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.855+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee60101f60 con 0x7fee60100820 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.856+0000 7fee5dffb640 1 -- 172.21.15.118:0/1046531256 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fee54004e60 con 0x7fee60100820 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.856+0000 7fee5dffb640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fee5007af30 0x7fee5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.856+0000 7fee5dffb640 1 -- 172.21.15.118:0/1046531256 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fee5409dd00 con 0x7fee60100820 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.856+0000 7fee5ffff640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fee5007af30 0x7fee5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.857+0000 7fee5ffff640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fee5007af30 0x7fee5007d3f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fee6006ae50 tx=0x7fee4c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:55.860+0000 7fee5dffb640 1 -- 172.21.15.118:0/1046531256 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fee540a1030 con 0x7fee60100820 2024-09-21T12:19:56.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:55 smithi118 ceph-mon[111738]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:56.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:55 smithi118 ceph-mon[111738]: pgmap v1236: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.113+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fee60108d90 con 0x7fee60100820 2024-09-21T12:19:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.113+0000 7fee5dffb640 1 -- 172.21.15.118:0/1046531256 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fee60199630 con 0x7fee60100820 2024-09-21T12:19:56.115 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T12:19:56.115 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": { 2024-09-21T12:19:56.115 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": { 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": { 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: "overall": { 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T12:19:56.116 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T12:19:56.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fee5007af30 msgr2=0x7fee5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:56.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fee5007af30 0x7fee5007d3f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fee6006ae50 tx=0x7fee4c031400 comp rx=0 tx=0).stop 2024-09-21T12:19:56.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 msgr2=0x7fee60198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:56.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 0x7fee60198800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fee5400d6f0 tx=0x7fee5400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:19:56.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 shutdown_connections 2024-09-21T12:19:56.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee60106820 0x7fee60198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:56.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fee5007af30 0x7fee5007d3f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:56.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 --2- 172.21.15.118:0/1046531256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee60100820 0x7fee60198800 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:56.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 >> 172.21.15.118:0/1046531256 conn(0x7fee600fc520 msgr2=0x7fee600fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:56.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 shutdown_connections 2024-09-21T12:19:56.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:56.115+0000 7fee66d8d640 1 -- 172.21.15.118:0/1046531256 wait complete. 2024-09-21T12:19:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:55 smithi149 ceph-mon[79770]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:55 smithi149 ceph-mon[79770]: pgmap v1236: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:56.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-21T12:19:57.017 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:19:57.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:57 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1046531256' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:19:57.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:57 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1046531256' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:19:57.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.492+0000 7fe11670d640 1 -- 172.21.15.118:0/3254122299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110102b40 msgr2=0x7fe110102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:57.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.492+0000 7fe11670d640 1 --2- 172.21.15.118:0/3254122299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110102b40 0x7fe110102f20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fe1000098b0 tx=0x7fe10002a560 comp rx=0 tx=0).stop 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.492+0000 7fe11670d640 1 -- 172.21.15.118:0/3254122299 shutdown_connections 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.492+0000 7fe11670d640 1 --2- 172.21.15.118:0/3254122299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe110103460 0x7fe11010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.492+0000 7fe11670d640 1 --2- 172.21.15.118:0/3254122299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110102b40 0x7fe110102f20 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.492+0000 7fe11670d640 1 -- 172.21.15.118:0/3254122299 >> 172.21.15.118:0/3254122299 conn(0x7fe1100fc520 msgr2=0x7fe1100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.492+0000 7fe11670d640 1 -- 172.21.15.118:0/3254122299 shutdown_connections 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.492+0000 7fe11670d640 1 -- 172.21.15.118:0/3254122299 wait complete. 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe11670d640 1 Processor -- start 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe11670d640 1 -- start start 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe11670d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe110102b40 0x7fe1101007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe11670d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110103460 0x7fe110100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe11670d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe11010ee70 con 0x7fe110103460 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe11670d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe11010ecf0 con 0x7fe110102b40 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe10f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110103460 0x7fe110100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:57.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe10f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110103460 0x7fe110100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57962/0 (socket says 172.21.15.118:57962) 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe10f7fe640 1 -- 172.21.15.118:0/1426584814 learned_addr learned my addr 172.21.15.118:0/1426584814 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.493+0000 7fe10ffff640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe110102b40 0x7fe1101007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.494+0000 7fe10f7fe640 1 -- 172.21.15.118:0/1426584814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe110102b40 msgr2=0x7fe1101007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.494+0000 7fe10f7fe640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe110102b40 0x7fe1101007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.494+0000 7fe10f7fe640 1 -- 172.21.15.118:0/1426584814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe110101220 con 0x7fe110103460 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.494+0000 7fe10f7fe640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110103460 0x7fe110100ce0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe10400b420 tx=0x7fe10400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.494+0000 7fe10d7fa640 1 -- 172.21.15.118:0/1426584814 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe104011630 con 0x7fe110103460 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.494+0000 7fe10d7fa640 1 -- 172.21.15.118:0/1426584814 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe104016070 con 0x7fe110103460 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.494+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe110101510 con 0x7fe110103460 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.494+0000 7fe10d7fa640 1 -- 172.21.15.118:0/1426584814 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe104010d40 con 0x7fe110103460 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.494+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1101a3f00 con 0x7fe110103460 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.495+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe11006ab80 con 0x7fe110103460 2024-09-21T12:19:57.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.496+0000 7fe10d7fa640 1 -- 172.21.15.118:0/1426584814 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe1040117d0 con 0x7fe110103460 2024-09-21T12:19:57.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.496+0000 7fe10d7fa640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0f807af30 0x7fe0f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:57.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.496+0000 7fe10ffff640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0f807af30 0x7fe0f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:57.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.496+0000 7fe10d7fa640 1 -- 172.21.15.118:0/1426584814 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe10409d8a0 con 0x7fe110103460 2024-09-21T12:19:57.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.497+0000 7fe10ffff640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0f807af30 0x7fe0f807d3f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe100000c00 tx=0x7fe100031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:57.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.501+0000 7fe10d7fa640 1 -- 172.21.15.118:0/1426584814 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe104068df0 con 0x7fe110103460 2024-09-21T12:19:57.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.747+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe110106010 con 0x7fe110103460 2024-09-21T12:19:57.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.748+0000 7fe10d7fa640 1 -- 172.21.15.118:0/1426584814 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fe10406dca0 con 0x7fe110103460 2024-09-21T12:19:57.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0f807af30 msgr2=0x7fe0f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:57.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0f807af30 0x7fe0f807d3f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe100000c00 tx=0x7fe100031400 comp rx=0 tx=0).stop 2024-09-21T12:19:57.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110103460 msgr2=0x7fe110100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:57.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110103460 0x7fe110100ce0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe10400b420 tx=0x7fe10400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:19:57.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 shutdown_connections 2024-09-21T12:19:57.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe0f807af30 0x7fe0f807d3f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:57.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe110103460 0x7fe110100ce0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:57.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 --2- 172.21.15.118:0/1426584814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe110102b40 0x7fe1101007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:57.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 >> 172.21.15.118:0/1426584814 conn(0x7fe1100fc520 msgr2=0x7fe110103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:57.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 shutdown_connections 2024-09-21T12:19:57.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:57.750+0000 7fe11670d640 1 -- 172.21.15.118:0/1426584814 wait complete. 2024-09-21T12:19:57.761 INFO:teuthology.orchestra.run.smithi118.stdout:true 2024-09-21T12:19:58.304 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:58 smithi118 ceph-mon[111738]: pgmap v1237: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:58.304 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:19:58 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1426584814' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:19:58.332 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-21T12:19:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:58 smithi149 ceph-mon[79770]: pgmap v1237: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:19:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:19:58 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1426584814' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:19:58.579 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:19:59.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.057+0000 7fae9255d640 1 -- 172.21.15.118:0/1639650167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 msgr2=0x7fae8c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:59.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.057+0000 7fae9255d640 1 --2- 172.21.15.118:0/1639650167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 0x7fae8c106c00 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009880 tx=0x7fae7c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.057+0000 7fae9255d640 1 -- 172.21.15.118:0/1639650167 shutdown_connections 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.057+0000 7fae9255d640 1 --2- 172.21.15.118:0/1639650167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8c100820 0x7fae8c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.057+0000 7fae9255d640 1 --2- 172.21.15.118:0/1639650167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 0x7fae8c106c00 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.057+0000 7fae9255d640 1 -- 172.21.15.118:0/1639650167 >> 172.21.15.118:0/1639650167 conn(0x7fae8c0fc520 msgr2=0x7fae8c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.057+0000 7fae9255d640 1 -- 172.21.15.118:0/1639650167 shutdown_connections 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.057+0000 7fae9255d640 1 -- 172.21.15.118:0/1639650167 wait complete. 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae9255d640 1 Processor -- start 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae9255d640 1 -- start start 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae9255d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8c100820 0x7fae8c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae9255d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 0x7fae8c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae9255d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c10dd50 con 0x7fae8c106820 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae9255d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c10dbd0 con 0x7fae8c100820 2024-09-21T12:19:59.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae83fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 0x7fae8c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae83fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 0x7fae8c19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57988/0 (socket says 172.21.15.118:57988) 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae83fff640 1 -- 172.21.15.118:0/373465578 learned_addr learned my addr 172.21.15.118:0/373465578 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae8bfff640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8c100820 0x7fae8c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae83fff640 1 -- 172.21.15.118:0/373465578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8c100820 msgr2=0x7fae8c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae83fff640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8c100820 0x7fae8c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.058+0000 7fae83fff640 1 -- 172.21.15.118:0/373465578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c197820 con 0x7fae8c106820 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.059+0000 7fae83fff640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 0x7fae8c19dbe0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fae7400b420 tx=0x7fae7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.059+0000 7fae89ffb640 1 -- 172.21.15.118:0/373465578 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae74011630 con 0x7fae8c106820 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.059+0000 7fae89ffb640 1 -- 172.21.15.118:0/373465578 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae74016070 con 0x7fae8c106820 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.059+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8c197b10 con 0x7fae8c106820 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.059+0000 7fae89ffb640 1 -- 172.21.15.118:0/373465578 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae74010d40 con 0x7fae8c106820 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.059+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8c1980a0 con 0x7fae8c106820 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.060+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8c101f60 con 0x7fae8c106820 2024-09-21T12:19:59.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.060+0000 7fae89ffb640 1 -- 172.21.15.118:0/373465578 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fae7401b460 con 0x7fae8c106820 2024-09-21T12:19:59.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.061+0000 7fae89ffb640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fae7807af30 0x7fae7807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:59.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.061+0000 7fae89ffb640 1 -- 172.21.15.118:0/373465578 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fae7409d7f0 con 0x7fae8c106820 2024-09-21T12:19:59.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.061+0000 7fae8bfff640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fae7807af30 0x7fae7807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:59.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.061+0000 7fae8bfff640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fae7807af30 0x7fae7807d3f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0096c0 tx=0x7fae7c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:59.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.065+0000 7fae89ffb640 1 -- 172.21.15.118:0/373465578 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae74021250 con 0x7fae8c106820 2024-09-21T12:19:59.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.316+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fae8c1983b0 con 0x7fae8c106820 2024-09-21T12:19:59.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.316+0000 7fae89ffb640 1 -- 172.21.15.118:0/373465578 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fae74068d40 con 0x7fae8c106820 2024-09-21T12:19:59.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.318+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fae7807af30 msgr2=0x7fae7807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:59.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.318+0000 7fae9255d640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fae7807af30 0x7fae7807d3f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0096c0 tx=0x7fae7c031400 comp rx=0 tx=0).stop 2024-09-21T12:19:59.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.318+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 msgr2=0x7fae8c19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:59.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.318+0000 7fae9255d640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 0x7fae8c19dbe0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fae7400b420 tx=0x7fae7400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:19:59.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.319+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 shutdown_connections 2024-09-21T12:19:59.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.319+0000 7fae9255d640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fae7807af30 0x7fae7807d3f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:59.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.319+0000 7fae9255d640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c106820 0x7fae8c19dbe0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:59.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.319+0000 7fae9255d640 1 --2- 172.21.15.118:0/373465578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8c100820 0x7fae8c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:59.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.319+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 >> 172.21.15.118:0/373465578 conn(0x7fae8c0fc520 msgr2=0x7fae8c1045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:59.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.319+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 shutdown_connections 2024-09-21T12:19:59.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:19:59.319+0000 7fae9255d640 1 -- 172.21.15.118:0/373465578 wait complete. 2024-09-21T12:19:59.330 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)" 2024-09-21T12:20:00.078 DEBUG:teuthology.parallel:result is None 2024-09-21T12:20:00.078 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:20:00.089 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T12:20:00.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae037950-780c-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T12:20:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:00 smithi118 ceph-mon[111738]: pgmap v1238: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:00 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/373465578' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:20:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:00 smithi118 ceph-mon[111738]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:20:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:00 smithi118 ceph-mon[111738]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:20:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:00 smithi118 ceph-mon[111738]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:20:00.341 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:00 smithi149 ceph-mon[79770]: pgmap v1238: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:00 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/373465578' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:20:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:00 smithi149 ceph-mon[79770]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:20:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:00 smithi149 ceph-mon[79770]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:20:00.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:00 smithi149 ceph-mon[79770]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.815+0000 7fe283f8a640 1 -- 172.21.15.118:0/588678053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c107910 msgr2=0x7fe27c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.815+0000 7fe283f8a640 1 --2- 172.21.15.118:0/588678053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c107910 0x7fe27c107cf0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009880 tx=0x7fe26c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.815+0000 7fe283f8a640 1 -- 172.21.15.118:0/588678053 shutdown_connections 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.815+0000 7fe283f8a640 1 --2- 172.21.15.118:0/588678053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c101910 0x7fe27c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.815+0000 7fe283f8a640 1 --2- 172.21.15.118:0/588678053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c107910 0x7fe27c107cf0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.815+0000 7fe283f8a640 1 -- 172.21.15.118:0/588678053 >> 172.21.15.118:0/588678053 conn(0x7fe27c0fd5f0 msgr2=0x7fe27c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.815+0000 7fe283f8a640 1 -- 172.21.15.118:0/588678053 shutdown_connections 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.815+0000 7fe283f8a640 1 -- 172.21.15.118:0/588678053 wait complete. 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe283f8a640 1 Processor -- start 2024-09-21T12:20:00.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe283f8a640 1 -- start start 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe283f8a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c101910 0x7fe27c19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe283f8a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c107910 0x7fe27c19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe283f8a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe27c10edc0 con 0x7fe27c101910 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe283f8a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe27c10ec40 con 0x7fe27c107910 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe281d26640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c101910 0x7fe27c19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe281d26640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c101910 0x7fe27c19d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58004/0 (socket says 172.21.15.118:58004) 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe281d26640 1 -- 172.21.15.118:0/2326456350 learned_addr learned my addr 172.21.15.118:0/2326456350 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe281525640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c107910 0x7fe27c19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe281d26640 1 -- 172.21.15.118:0/2326456350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c107910 msgr2=0x7fe27c19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe281d26640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c107910 0x7fe27c19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.816+0000 7fe281d26640 1 -- 172.21.15.118:0/2326456350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27c197780 con 0x7fe27c101910 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.817+0000 7fe281d26640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c101910 0x7fe27c19d600 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe26c031460 tx=0x7fe26c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.817+0000 7fe272ffd640 1 -- 172.21.15.118:0/2326456350 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe26c03f070 con 0x7fe27c101910 2024-09-21T12:20:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.817+0000 7fe272ffd640 1 -- 172.21.15.118:0/2326456350 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe26c0035f0 con 0x7fe27c101910 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.817+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27c197a10 con 0x7fe27c101910 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.817+0000 7fe272ffd640 1 -- 172.21.15.118:0/2326456350 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe26c035030 con 0x7fe27c101910 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.817+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe27c197f40 con 0x7fe27c101910 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.818+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe27c103050 con 0x7fe27c101910 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.818+0000 7fe272ffd640 1 -- 172.21.15.118:0/2326456350 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe26c042070 con 0x7fe27c101910 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.819+0000 7fe272ffd640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe26807af30 0x7fe26807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.819+0000 7fe272ffd640 1 -- 172.21.15.118:0/2326456350 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe26c0bead0 con 0x7fe27c101910 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.819+0000 7fe281525640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe26807af30 0x7fe26807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.819+0000 7fe281525640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe26807af30 0x7fe26807d3f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe278005fd0 tx=0x7fe278005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:00.823+0000 7fe272ffd640 1 -- 172.21.15.118:0/2326456350 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe26c08a020 con 0x7fe27c101910 2024-09-21T12:20:01.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.039+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe27c104b20 con 0x7fe27c101910 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.039+0000 7fe272ffd640 1 -- 172.21.15.118:0/2326456350 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) ==== 76+0+2036 (secure 0 0 0) 0x7fe26c0be810 con 0x7fe27c101910 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout:e34 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout:btime 2024-09-21T12:18:41:867976+0000 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout:legacy client fscid: 1 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout:fs_name cephfs 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 34 2024-09-21T12:20:01.042 INFO:teuthology.orchestra.run.smithi118.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T11:36:23.785634+0000 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:modified 2024-09-21T12:18:40.962859+0000 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:tableserver 0 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:root 0 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:session_timeout 60 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:session_autoclose 300 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:max_file_size 1099511627776 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:max_xattr_size 65536 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:required_client_features {} 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure 0 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:last_failure_osd_epoch 75 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:max_mds 2 2024-09-21T12:20:01.043 INFO:teuthology.orchestra.run.smithi118.stdout:in 0,1 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:up {0=34320,1=34352} 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:failed 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:damaged 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:stopped 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:data_pools [3] 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:metadata_pool 2 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:inline_data enabled 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:balancer 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:bal_rank_mask -1 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:standby_count_wanted 1 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:qdb_cluster leader: 34320 members: 34352,34320 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.ciljqr{0:34320} state up:active seq 467 join_fscid=1 addr [v2:172.21.15.118:6828/3446995825,v1:172.21.15.118:6829/3446995825] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi118.macjke{1:34352} state up:active seq 461 join_fscid=1 addr [v2:172.21.15.118:6826/851771831,v1:172.21.15.118:6827/851771831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:01.044 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:01.045 INFO:teuthology.orchestra.run.smithi118.stdout:Standby daemons: 2024-09-21T12:20:01.045 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:01.045 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.zgoqsi{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/37700515,v1:172.21.15.149:6825/37700515] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:20:01.045 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.cephfs.smithi149.qzbfns{-1:44737} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2325869358,v1:172.21.15.149:6827/2325869358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:20:01.045 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 34 2024-09-21T12:20:01.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.042+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe26807af30 msgr2=0x7fe26807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:01.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.042+0000 7fe283f8a640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe26807af30 0x7fe26807d3f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe278005fd0 tx=0x7fe278005850 comp rx=0 tx=0).stop 2024-09-21T12:20:01.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.042+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c101910 msgr2=0x7fe27c19d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:01.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.042+0000 7fe283f8a640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c101910 0x7fe27c19d600 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe26c031460 tx=0x7fe26c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:20:01.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.042+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 shutdown_connections 2024-09-21T12:20:01.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.042+0000 7fe283f8a640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c107910 0x7fe27c19db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:01.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.042+0000 7fe283f8a640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe26807af30 0x7fe26807d3f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:01.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.042+0000 7fe283f8a640 1 --2- 172.21.15.118:0/2326456350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c101910 0x7fe27c19d600 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:01.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.042+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 >> 172.21.15.118:0/2326456350 conn(0x7fe27c0fd5f0 msgr2=0x7fe27c0fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:01.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.043+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 shutdown_connections 2024-09-21T12:20:01.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:01.043+0000 7fe283f8a640 1 -- 172.21.15.118:0/2326456350 wait complete. 2024-09-21T12:20:01.649 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-21T12:20:01.661 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T12:20:01.911 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:02.262 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:02 smithi118 ceph-mon[111738]: pgmap v1239: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:02.262 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:02 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2326456350' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:20:02.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 -- 172.21.15.118:0/1623078970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48103420 msgr2=0x7f6b4810b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:02.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 --2- 172.21.15.118:0/1623078970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48103420 0x7f6b4810b910 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0098b0 tx=0x7f6b3c02a560 comp rx=0 tx=0).stop 2024-09-21T12:20:02.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 -- 172.21.15.118:0/1623078970 shutdown_connections 2024-09-21T12:20:02.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 --2- 172.21.15.118:0/1623078970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48103420 0x7f6b4810b910 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 --2- 172.21.15.118:0/1623078970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b48102b00 0x7f6b48102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 -- 172.21.15.118:0/1623078970 >> 172.21.15.118:0/1623078970 conn(0x7f6b480fc4c0 msgr2=0x7f6b480fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 -- 172.21.15.118:0/1623078970 shutdown_connections 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 -- 172.21.15.118:0/1623078970 wait complete. 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 Processor -- start 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.336+0000 7f6b4e520640 1 -- start start 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b4e520640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48102b00 0x7f6b4819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b4e520640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b48103420 0x7f6b4819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b4e520640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4810edd0 con 0x7f6b48102b00 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b4e520640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4810ec50 con 0x7f6b48103420 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48102b00 0x7f6b4819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48102b00 0x7f6b4819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58020/0 (socket says 172.21.15.118:58020) 2024-09-21T12:20:02.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b47fff640 1 -- 172.21.15.118:0/1210369092 learned_addr learned my addr 172.21.15.118:0/1210369092 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b477fe640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b48103420 0x7f6b4819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b47fff640 1 -- 172.21.15.118:0/1210369092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b48103420 msgr2=0x7f6b4819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b47fff640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b48103420 0x7f6b4819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b47fff640 1 -- 172.21.15.118:0/1210369092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b48197800 con 0x7f6b48102b00 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b477fe640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b48103420 0x7f6b4819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b47fff640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48102b00 0x7f6b4819d680 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800e970 tx=0x7f6b3800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b457fa640 1 -- 172.21.15.118:0/1210369092 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b3800cac0 con 0x7f6b48102b00 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b48197af0 con 0x7f6b48102b00 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b457fa640 1 -- 172.21.15.118:0/1210369092 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b380054e0 con 0x7f6b48102b00 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.337+0000 7f6b457fa640 1 -- 172.21.15.118:0/1210369092 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b38010430 con 0x7f6b48102b00 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.338+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b48198050 con 0x7f6b48102b00 2024-09-21T12:20:02.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.339+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4806a3b0 con 0x7f6b48102b00 2024-09-21T12:20:02.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.339+0000 7f6b457fa640 1 -- 172.21.15.118:0/1210369092 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6b38004e80 con 0x7f6b48102b00 2024-09-21T12:20:02.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.339+0000 7f6b457fa640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b3007af30 0x7f6b3007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:02.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.340+0000 7f6b477fe640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b3007af30 0x7f6b3007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:02.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.340+0000 7f6b457fa640 1 -- 172.21.15.118:0/1210369092 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6b3809e7d0 con 0x7f6b48102b00 2024-09-21T12:20:02.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.340+0000 7f6b477fe640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b3007af30 0x7f6b3007d3f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000c00 tx=0x7f6b3c031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:02.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.344+0000 7f6b457fa640 1 -- 172.21.15.118:0/1210369092 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b38069d20 con 0x7f6b48102b00 2024-09-21T12:20:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:02 smithi149 ceph-mon[79770]: pgmap v1239: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:02 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2326456350' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:20:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.560+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b48105f90 con 0x7f6b48102b00 2024-09-21T12:20:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.561+0000 7f6b457fa640 1 -- 172.21.15.118:0/1210369092 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5345 (secure 0 0 0) 0x7f6b3806ebd0 con 0x7f6b48102b00 2024-09-21T12:20:02.563 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:02.564 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":34,"btime":"2024-09-21T12:18:41:867976+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44737,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2325869358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2325869358},{"type":"v1","addr":"172.21.15.149:6827","nonce":2325869358}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T12:18:40.962859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":0,"incarnation":28,"state":"up:active","state_seq":467,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi118.macjke","rank":1,"incarnation":28,"state":"up:active","state_seq":461,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34320,"qdb_cluster":[34352,34320]},"id":1}]} 2024-09-21T12:20:02.564 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 34 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.563+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b3007af30 msgr2=0x7f6b3007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.563+0000 7f6b4e520640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b3007af30 0x7f6b3007d3f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000c00 tx=0x7f6b3c031400 comp rx=0 tx=0).stop 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.564+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48102b00 msgr2=0x7f6b4819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.564+0000 7f6b4e520640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48102b00 0x7f6b4819d680 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800e970 tx=0x7f6b3800ed70 comp rx=0 tx=0).stop 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.564+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 shutdown_connections 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.564+0000 7f6b4e520640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b48103420 0x7f6b4819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.564+0000 7f6b4e520640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f6b3007af30 0x7f6b3007d3f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.564+0000 7f6b4e520640 1 --2- 172.21.15.118:0/1210369092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b48102b00 0x7f6b4819d680 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.564+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 >> 172.21.15.118:0/1210369092 conn(0x7f6b480fc4c0 msgr2=0x7f6b48103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.564+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 shutdown_connections 2024-09-21T12:20:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:02.564+0000 7f6b4e520640 1 -- 172.21.15.118:0/1210369092 wait complete. 2024-09-21T12:20:03.187 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:03 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1210369092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T12:20:03.215 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 2, 'flags': 18} 2024-09-21T12:20:03.215 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 17 2024-09-21T12:20:03.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:03 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1210369092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T12:20:03.464 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.977+0000 7ff0adf67640 1 -- 172.21.15.118:0/3124566114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a81001c0 msgr2=0x7ff0a81005a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.977+0000 7ff0adf67640 1 --2- 172.21.15.118:0/3124566114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a81001c0 0x7ff0a81005a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7ff098009880 tx=0x7ff09802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.977+0000 7ff0adf67640 1 -- 172.21.15.118:0/3124566114 shutdown_connections 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.977+0000 7ff0adf67640 1 --2- 172.21.15.118:0/3124566114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a8100b70 0x7ff0a8104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.977+0000 7ff0adf67640 1 --2- 172.21.15.118:0/3124566114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a81001c0 0x7ff0a81005a0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.977+0000 7ff0adf67640 1 -- 172.21.15.118:0/3124566114 >> 172.21.15.118:0/3124566114 conn(0x7ff0a80fbc40 msgr2=0x7ff0a80fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.977+0000 7ff0adf67640 1 -- 172.21.15.118:0/3124566114 shutdown_connections 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.977+0000 7ff0adf67640 1 -- 172.21.15.118:0/3124566114 wait complete. 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.978+0000 7ff0adf67640 1 Processor -- start 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.978+0000 7ff0adf67640 1 -- start start 2024-09-21T12:20:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.978+0000 7ff0adf67640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81001c0 0x7ff0a819d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.978+0000 7ff0adf67640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a8100b70 0x7ff0a819dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.978+0000 7ff0adf67640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a810d4a0 con 0x7ff0a8100b70 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.978+0000 7ff0adf67640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a810d320 con 0x7ff0a81001c0 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.978+0000 7ff09ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a8100b70 0x7ff0a819dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.978+0000 7ff09ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a8100b70 0x7ff0a819dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58042/0 (socket says 172.21.15.118:58042) 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.978+0000 7ff09ffff640 1 -- 172.21.15.118:0/2171736647 learned_addr learned my addr 172.21.15.118:0/2171736647 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff0a77fe640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81001c0 0x7ff0a819d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff09ffff640 1 -- 172.21.15.118:0/2171736647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81001c0 msgr2=0x7ff0a819d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff09ffff640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81001c0 0x7ff0a819d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff09ffff640 1 -- 172.21.15.118:0/2171736647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a8195e20 con 0x7ff0a8100b70 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff09ffff640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a8100b70 0x7ff0a819dd30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b420 tx=0x7ff09000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:04.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff0a57fa640 1 -- 172.21.15.118:0/2171736647 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff090011630 con 0x7ff0a8100b70 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a8196110 con 0x7ff0a8100b70 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff0a57fa640 1 -- 172.21.15.118:0/2171736647 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff090016070 con 0x7ff0a8100b70 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff0a57fa640 1 -- 172.21.15.118:0/2171736647 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff090010d40 con 0x7ff0a8100b70 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.979+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a81966a0 con 0x7ff0a8100b70 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.980+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a81016a0 con 0x7ff0a8100b70 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.981+0000 7ff0a57fa640 1 -- 172.21.15.118:0/2171736647 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff09001b460 con 0x7ff0a8100b70 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.981+0000 7ff0a57fa640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09407af40 0x7ff09407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.981+0000 7ff0a57fa640 1 -- 172.21.15.118:0/2171736647 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff09009d770 con 0x7ff0a8100b70 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.981+0000 7ff0a77fe640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09407af40 0x7ff09407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.982+0000 7ff0a77fe640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09407af40 0x7ff09407d400 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff0980096c0 tx=0x7ff098031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:03.985+0000 7ff0a57fa640 1 -- 172.21.15.118:0/2171736647 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff090068cc0 con 0x7ff0a8100b70 2024-09-21T12:20:04.203 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:04 smithi118 ceph-mon[111738]: pgmap v1240: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:04.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.201+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7ff0a8069fa0 con 0x7ff0a8100b70 2024-09-21T12:20:04.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.202+0000 7ff0a57fa640 1 -- 172.21.15.118:0/2171736647 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v34) ==== 107+0+3613 (secure 0 0 0) 0x7ff09006db70 con 0x7ff0a8100b70 2024-09-21T12:20:04.204 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:04.204 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":17,"btime":"2024-09-21T11:47:28:938927+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/1256053322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1256053322},{"type":"v1","addr":"172.21.15.149:6827","nonce":1256053322}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24305,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/2469878089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2469878089},{"type":"v1","addr":"172.21.15.149:6825","nonce":2469878089}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:04.205 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 17 2024-09-21T12:20:04.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09407af40 msgr2=0x7ff09407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:04.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09407af40 0x7ff09407d400 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff0980096c0 tx=0x7ff098031400 comp rx=0 tx=0).stop 2024-09-21T12:20:04.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a8100b70 msgr2=0x7ff0a819dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:04.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a8100b70 0x7ff0a819dd30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b420 tx=0x7ff09000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:20:04.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 shutdown_connections 2024-09-21T12:20:04.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7ff09407af40 0x7ff09407d400 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:04.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0a8100b70 0x7ff0a819dd30 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:04.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 --2- 172.21.15.118:0/2171736647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0a81001c0 0x7ff0a819d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:04.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 >> 172.21.15.118:0/2171736647 conn(0x7ff0a80fbc40 msgr2=0x7ff0a80fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:04.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 shutdown_connections 2024-09-21T12:20:04.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:04.204+0000 7ff0adf67640 1 -- 172.21.15.118:0/2171736647 wait complete. 2024-09-21T12:20:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:04 smithi149 ceph-mon[79770]: pgmap v1240: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:05.027 DEBUG:tasks.fs:max_mds not reduced in epoch 17 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:05.027 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 18 2024-09-21T12:20:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:05 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2171736647' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-21T12:20:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:20:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:05 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2171736647' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-21T12:20:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:20:05.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.770+0000 7fe1c1a60640 1 -- 172.21.15.118:0/3777754723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc101900 msgr2=0x7fe1bc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:05.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.770+0000 7fe1c1a60640 1 --2- 172.21.15.118:0/3777754723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc101900 0x7fe1bc101d60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009880 tx=0x7fe1a402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:05.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.770+0000 7fe1c1a60640 1 -- 172.21.15.118:0/3777754723 shutdown_connections 2024-09-21T12:20:05.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.770+0000 7fe1c1a60640 1 --2- 172.21.15.118:0/3777754723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc101900 0x7fe1bc101d60 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:05.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.770+0000 7fe1c1a60640 1 --2- 172.21.15.118:0/3777754723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1bc107900 0x7fe1bc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:05.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.770+0000 7fe1c1a60640 1 -- 172.21.15.118:0/3777754723 >> 172.21.15.118:0/3777754723 conn(0x7fe1bc0fd620 msgr2=0x7fe1bc0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:05.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.770+0000 7fe1c1a60640 1 -- 172.21.15.118:0/3777754723 shutdown_connections 2024-09-21T12:20:05.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.770+0000 7fe1c1a60640 1 -- 172.21.15.118:0/3777754723 wait complete. 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1c1a60640 1 Processor -- start 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1c1a60640 1 -- start start 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1c1a60640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1bc101900 0x7fe1bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1c1a60640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc107900 0x7fe1bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1c1a60640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc10edd0 con 0x7fe1bc107900 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1c1a60640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc10ec50 con 0x7fe1bc101900 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1b27fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc107900 0x7fe1bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1b27fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc107900 0x7fe1bc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44236/0 (socket says 172.21.15.118:44236) 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1b27fc640 1 -- 172.21.15.118:0/2007345840 learned_addr learned my addr 172.21.15.118:0/2007345840 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.771+0000 7fe1baffd640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1bc101900 0x7fe1bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.772+0000 7fe1b27fc640 1 -- 172.21.15.118:0/2007345840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1bc101900 msgr2=0x7fe1bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.772+0000 7fe1b27fc640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1bc101900 0x7fe1bc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:05.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.772+0000 7fe1b27fc640 1 -- 172.21.15.118:0/2007345840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc074f70 con 0x7fe1bc107900 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.772+0000 7fe1b27fc640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc107900 0x7fe1bc074a30 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4031460 tx=0x7fe1a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.772+0000 7fe1c0a5e640 1 -- 172.21.15.118:0/2007345840 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1a403f070 con 0x7fe1bc107900 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.772+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc075200 con 0x7fe1bc107900 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.772+0000 7fe1c0a5e640 1 -- 172.21.15.118:0/2007345840 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1a40035f0 con 0x7fe1bc107900 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.772+0000 7fe1c0a5e640 1 -- 172.21.15.118:0/2007345840 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1a4035030 con 0x7fe1bc107900 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.772+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc1a3d60 con 0x7fe1bc107900 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.773+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1bc103040 con 0x7fe1bc107900 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.774+0000 7fe1c0a5e640 1 -- 172.21.15.118:0/2007345840 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe1a4042070 con 0x7fe1bc107900 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.774+0000 7fe1c0a5e640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1a807af30 0x7fe1a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.774+0000 7fe1c0a5e640 1 -- 172.21.15.118:0/2007345840 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe1a40bea20 con 0x7fe1bc107900 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.774+0000 7fe1baffd640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1a807af30 0x7fe1a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.775+0000 7fe1baffd640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1a807af30 0x7fe1a807d3f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac005fd0 tx=0x7fe1ac00b390 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:05.779+0000 7fe1c0a5e640 1 -- 172.21.15.118:0/2007345840 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1a4089f70 con 0x7fe1bc107900 2024-09-21T12:20:06.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.038+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7fe1bc109e70 con 0x7fe1bc107900 2024-09-21T12:20:06.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.039+0000 7fe1c0a5e640 1 -- 172.21.15.118:0/2007345840 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v34) ==== 107+0+5310 (secure 0 0 0) 0x7fe1a408ee20 con 0x7fe1bc107900 2024-09-21T12:20:06.041 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:06.041 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":18,"btime":"2024-09-21T11:47:29:940863+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/1256053322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1256053322},{"type":"v1","addr":"172.21.15.149:6827","nonce":1256053322}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24305,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/2469878089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2469878089},{"type":"v1","addr":"172.21.15.149:6825","nonce":2469878089}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34310,"name":"cephfs.smithi118.macjke","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6827/1975444019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1975444019},{"type":"v1","addr":"172.21.15.118:6827","nonce":1975444019}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34314,"name":"cephfs.smithi118.ciljqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6829/533954515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":533954515},{"type":"v1","addr":"172.21.15.118:6829","nonce":533954515}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 18 2024-09-21T12:20:06.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1a807af30 msgr2=0x7fe1a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:06.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1a807af30 0x7fe1a807d3f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac005fd0 tx=0x7fe1ac00b390 comp rx=0 tx=0).stop 2024-09-21T12:20:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc107900 msgr2=0x7fe1bc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc107900 0x7fe1bc074a30 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4031460 tx=0x7fe1a40045e0 comp rx=0 tx=0).stop 2024-09-21T12:20:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 shutdown_connections 2024-09-21T12:20:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fe1a807af30 0x7fe1a807d3f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1bc107900 0x7fe1bc074a30 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 --2- 172.21.15.118:0/2007345840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1bc101900 0x7fe1bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:06.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 >> 172.21.15.118:0/2007345840 conn(0x7fe1bc0fd620 msgr2=0x7fe1bc0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:06.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 shutdown_connections 2024-09-21T12:20:06.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:06.041+0000 7fe1c1a60640 1 -- 172.21.15.118:0/2007345840 wait complete. 2024-09-21T12:20:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:06 smithi118 ceph-mon[111738]: pgmap v1241: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:06 smithi149 ceph-mon[79770]: pgmap v1241: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:06.675 DEBUG:tasks.fs:max_mds not reduced in epoch 18 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:06.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 19 2024-09-21T12:20:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:07.299 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:07 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2007345840' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-21T12:20:07.300 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:07 smithi118 ceph-mon[111738]: pgmap v1242: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 -- 172.21.15.118:0/2067270910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 msgr2=0x7fb7b8103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 --2- 172.21.15.118:0/2067270910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 0x7fb7b8103f60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009880 tx=0x7fb7a802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 -- 172.21.15.118:0/2067270910 shutdown_connections 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 --2- 172.21.15.118:0/2067270910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 0x7fb7b8103f60 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 --2- 172.21.15.118:0/2067270910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7b8109b90 0x7fb7b8109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 -- 172.21.15.118:0/2067270910 >> 172.21.15.118:0/2067270910 conn(0x7fb7b80ff800 msgr2=0x7fb7b8101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 -- 172.21.15.118:0/2067270910 shutdown_connections 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 -- 172.21.15.118:0/2067270910 wait complete. 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 Processor -- start 2024-09-21T12:20:07.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 -- start start 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.378+0000 7fb7c05d3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 0x7fb7b819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7c05d3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7b8109b90 0x7fb7b819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7c05d3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b8111030 con 0x7fb7b8103b00 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7c05d3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b8110eb0 con 0x7fb7b8109b90 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7be36f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 0x7fb7b819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7be36f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 0x7fb7b819f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44252/0 (socket says 172.21.15.118:44252) 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7be36f640 1 -- 172.21.15.118:0/412532359 learned_addr learned my addr 172.21.15.118:0/412532359 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7bdb6e640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7b8109b90 0x7fb7b819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7be36f640 1 -- 172.21.15.118:0/412532359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7b8109b90 msgr2=0x7fb7b819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7be36f640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7b8109b90 0x7fb7b819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7be36f640 1 -- 172.21.15.118:0/412532359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b8199a20 con 0x7fb7b8103b00 2024-09-21T12:20:07.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7be36f640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 0x7fb7b819f860 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400b420 tx=0x7fb7b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7af7fe640 1 -- 172.21.15.118:0/412532359 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7b4011630 con 0x7fb7b8103b00 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b8199d10 con 0x7fb7b8103b00 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7af7fe640 1 -- 172.21.15.118:0/412532359 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7b4016070 con 0x7fb7b8103b00 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7af7fe640 1 -- 172.21.15.118:0/412532359 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7b4010d40 con 0x7fb7b8103b00 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.379+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b819a270 con 0x7fb7b8103b00 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.380+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b8105200 con 0x7fb7b8103b00 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.381+0000 7fb7af7fe640 1 -- 172.21.15.118:0/412532359 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb7b401b460 con 0x7fb7b8103b00 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.381+0000 7fb7af7fe640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7a407af30 0x7fb7a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.381+0000 7fb7af7fe640 1 -- 172.21.15.118:0/412532359 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb7b409d7f0 con 0x7fb7b8103b00 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.381+0000 7fb7bdb6e640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7a407af30 0x7fb7a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.382+0000 7fb7bdb6e640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7a407af30 0x7fb7a407d3f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb7b819b210 tx=0x7fb7a8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:07.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.386+0000 7fb7af7fe640 1 -- 172.21.15.118:0/412532359 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7b4021250 con 0x7fb7b8103b00 2024-09-21T12:20:07.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:07 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2007345840' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-21T12:20:07.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:07 smithi149 ceph-mon[79770]: pgmap v1242: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:07.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.600+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7fb7b819af50 con 0x7fb7b8103b00 2024-09-21T12:20:07.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.601+0000 7fb7af7fe640 1 -- 172.21.15.118:0/412532359 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v34) ==== 107+0+4463 (secure 0 0 0) 0x7fb7b4068d40 con 0x7fb7b8103b00 2024-09-21T12:20:07.603 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:07.603 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":19,"btime":"2024-09-21T11:47:32:951706+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/1256053322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1256053322},{"type":"v1","addr":"172.21.15.149:6827","nonce":1256053322}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24305,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/2469878089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2469878089},{"type":"v1","addr":"172.21.15.149:6825","nonce":2469878089}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34310,"name":"cephfs.smithi118.macjke","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6827/1975444019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1975444019},{"type":"v1","addr":"172.21.15.118:6827","nonce":1975444019}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:07.603 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 19 2024-09-21T12:20:07.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7a407af30 msgr2=0x7fb7a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:07.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7a407af30 0x7fb7a407d3f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb7b819b210 tx=0x7fb7a8031400 comp rx=0 tx=0).stop 2024-09-21T12:20:07.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 msgr2=0x7fb7b819f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:07.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 0x7fb7b819f860 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400b420 tx=0x7fb7b400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:20:07.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 shutdown_connections 2024-09-21T12:20:07.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7b8109b90 0x7fb7b819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:07.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fb7a407af30 0x7fb7a407d3f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:07.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 --2- 172.21.15.118:0/412532359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7b8103b00 0x7fb7b819f860 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:07.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 >> 172.21.15.118:0/412532359 conn(0x7fb7b80ff800 msgr2=0x7fb7b8100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:07.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 shutdown_connections 2024-09-21T12:20:07.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:07.603+0000 7fb7c05d3640 1 -- 172.21.15.118:0/412532359 wait complete. 2024-09-21T12:20:08.179 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:08 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/412532359' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-21T12:20:08.206 DEBUG:tasks.fs:max_mds not reduced in epoch 19 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:08.206 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 20 2024-09-21T12:20:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:08 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/412532359' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-21T12:20:08.455 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:08.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.903+0000 7efe1f1fd640 1 -- 172.21.15.118:0/3043606373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe181011b0 msgr2=0x7efe18105680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:08.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.903+0000 7efe1f1fd640 1 --2- 172.21.15.118:0/3043606373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe181011b0 0x7efe18105680 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7efe04009880 tx=0x7efe0402a540 comp rx=0 tx=0).stop 2024-09-21T12:20:08.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.903+0000 7efe1f1fd640 1 -- 172.21.15.118:0/3043606373 shutdown_connections 2024-09-21T12:20:08.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.903+0000 7efe1f1fd640 1 --2- 172.21.15.118:0/3043606373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe181011b0 0x7efe18105680 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:08.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.903+0000 7efe1f1fd640 1 --2- 172.21.15.118:0/3043606373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe18100890 0x7efe18100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:08.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.903+0000 7efe1f1fd640 1 -- 172.21.15.118:0/3043606373 >> 172.21.15.118:0/3043606373 conn(0x7efe180fc4c0 msgr2=0x7efe180fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.903+0000 7efe1f1fd640 1 -- 172.21.15.118:0/3043606373 shutdown_connections 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.903+0000 7efe1f1fd640 1 -- 172.21.15.118:0/3043606373 wait complete. 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1f1fd640 1 Processor -- start 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1f1fd640 1 -- start start 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1f1fd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe18100890 0x7efe1819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1f1fd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe181011b0 0x7efe1819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1f1fd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efe18115430 con 0x7efe18100890 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1f1fd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe181152b0 con 0x7efe181011b0 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1cf99640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe18100890 0x7efe1819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1cf99640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe18100890 0x7efe1819e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44282/0 (socket says 172.21.15.118:44282) 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1cf99640 1 -- 172.21.15.118:0/2181491904 learned_addr learned my addr 172.21.15.118:0/2181491904 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe17fff640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe181011b0 0x7efe1819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1cf99640 1 -- 172.21.15.118:0/2181491904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe181011b0 msgr2=0x7efe1819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:08.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1cf99640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe181011b0 0x7efe1819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1cf99640 1 -- 172.21.15.118:0/2181491904 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe181a28e0 con 0x7efe18100890 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe17fff640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe181011b0 0x7efe1819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.904+0000 7efe1cf99640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe18100890 0x7efe1819e010 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00b420 tx=0x7efe0c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.905+0000 7efe15ffb640 1 -- 172.21.15.118:0/2181491904 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe0c011630 con 0x7efe18100890 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.905+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe181a2bd0 con 0x7efe18100890 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.905+0000 7efe15ffb640 1 -- 172.21.15.118:0/2181491904 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe0c016070 con 0x7efe18100890 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.905+0000 7efe15ffb640 1 -- 172.21.15.118:0/2181491904 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe0c010d40 con 0x7efe18100890 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.905+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe181a3160 con 0x7efe18100890 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.906+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1806a410 con 0x7efe18100890 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.906+0000 7efe15ffb640 1 -- 172.21.15.118:0/2181491904 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7efe0c01b460 con 0x7efe18100890 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.907+0000 7efe15ffb640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe0807af30 0x7efe0807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.907+0000 7efe15ffb640 1 -- 172.21.15.118:0/2181491904 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efe0c09d7f0 con 0x7efe18100890 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.907+0000 7efe17fff640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe0807af30 0x7efe0807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:08.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.907+0000 7efe17fff640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe0807af30 0x7efe0807d3f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efe04006010 tx=0x7efe040095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:08.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:08.911+0000 7efe15ffb640 1 -- 172.21.15.118:0/2181491904 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe0c068d40 con 0x7efe18100890 2024-09-21T12:20:09.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.124+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7efe18102d00 con 0x7efe18100890 2024-09-21T12:20:09.125 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:09 smithi118 ceph-mon[111738]: pgmap v1243: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:09.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.125+0000 7efe15ffb640 1 -- 172.21.15.118:0/2181491904 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v34) ==== 107+0+5313 (secure 0 0 0) 0x7efe0c06dbf0 con 0x7efe18100890 2024-09-21T12:20:09.126 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:09.126 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"btime":"2024-09-21T11:47:38:291128+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/1256053322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1256053322},{"type":"v1","addr":"172.21.15.149:6827","nonce":1256053322}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24305,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/2469878089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2469878089},{"type":"v1","addr":"172.21.15.149:6825","nonce":2469878089}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34310,"name":"cephfs.smithi118.macjke","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6827/1975444019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1975444019},{"type":"v1","addr":"172.21.15.118:6827","nonce":1975444019}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:09.126 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 20 2024-09-21T12:20:09.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe0807af30 msgr2=0x7efe0807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe0807af30 0x7efe0807d3f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efe04006010 tx=0x7efe040095f0 comp rx=0 tx=0).stop 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe18100890 msgr2=0x7efe1819e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe18100890 0x7efe1819e010 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00b420 tx=0x7efe0c00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 shutdown_connections 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe181011b0 0x7efe1819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7efe0807af30 0x7efe0807d3f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 --2- 172.21.15.118:0/2181491904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe18100890 0x7efe1819e010 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 >> 172.21.15.118:0/2181491904 conn(0x7efe180fc4c0 msgr2=0x7efe18112bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 shutdown_connections 2024-09-21T12:20:09.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:09.127+0000 7efe1f1fd640 1 -- 172.21.15.118:0/2181491904 wait complete. 2024-09-21T12:20:09.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:09 smithi149 ceph-mon[79770]: pgmap v1243: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:09.860 DEBUG:tasks.fs:max_mds not reduced in epoch 20 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:09.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 21 2024-09-21T12:20:10.114 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:10.231 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:10 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2181491904' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-21T12:20:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:10 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2181491904' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-21T12:20:10.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.655+0000 7f17821ea640 1 -- 172.21.15.118:0/3381163119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 msgr2=0x7f177c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:10.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.655+0000 7f17821ea640 1 --2- 172.21.15.118:0/3381163119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 0x7f177c100c80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f1764009880 tx=0x7f176402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:10.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.655+0000 7f17821ea640 1 -- 172.21.15.118:0/3381163119 shutdown_connections 2024-09-21T12:20:10.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.655+0000 7f17821ea640 1 --2- 172.21.15.118:0/3381163119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 0x7f177c100c80 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:10.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.655+0000 7f17821ea640 1 --2- 172.21.15.118:0/3381163119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c106820 0x7f177c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:10.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.655+0000 7f17821ea640 1 -- 172.21.15.118:0/3381163119 >> 172.21.15.118:0/3381163119 conn(0x7f177c0fc520 msgr2=0x7f177c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:10.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.655+0000 7f17821ea640 1 -- 172.21.15.118:0/3381163119 shutdown_connections 2024-09-21T12:20:10.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.655+0000 7f17821ea640 1 -- 172.21.15.118:0/3381163119 wait complete. 2024-09-21T12:20:10.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.655+0000 7f17821ea640 1 Processor -- start 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f17821ea640 1 -- start start 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f17821ea640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 0x7f177c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f17821ea640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c106820 0x7f177c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f17821ea640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f177c10dcf0 con 0x7f177c100820 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f17821ea640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f177c10db70 con 0x7f177c106820 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f177b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 0x7f177c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f177b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 0x7f177c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44298/0 (socket says 172.21.15.118:44298) 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f177b7fe640 1 -- 172.21.15.118:0/3466682702 learned_addr learned my addr 172.21.15.118:0/3466682702 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f177affd640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c106820 0x7f177c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:10.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f177b7fe640 1 -- 172.21.15.118:0/3466682702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c106820 msgr2=0x7f177c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:10.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f177b7fe640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c106820 0x7f177c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:10.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f177b7fe640 1 -- 172.21.15.118:0/3466682702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c199380 con 0x7f177c100820 2024-09-21T12:20:10.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.656+0000 7f177b7fe640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 0x7f177c198840 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d6f0 tx=0x7f176c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:10.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.657+0000 7f1778ff9640 1 -- 172.21.15.118:0/3466682702 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f176c017070 con 0x7f177c100820 2024-09-21T12:20:10.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.657+0000 7f1778ff9640 1 -- 172.21.15.118:0/3466682702 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f176c00de00 con 0x7f177c100820 2024-09-21T12:20:10.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.657+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177c199670 con 0x7f177c100820 2024-09-21T12:20:10.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.657+0000 7f1778ff9640 1 -- 172.21.15.118:0/3466682702 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f176c004bb0 con 0x7f177c100820 2024-09-21T12:20:10.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.657+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177c1a1c70 con 0x7f177c100820 2024-09-21T12:20:10.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.658+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f177c101f60 con 0x7f177c100820 2024-09-21T12:20:10.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.658+0000 7f1778ff9640 1 -- 172.21.15.118:0/3466682702 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f176c009a30 con 0x7f177c100820 2024-09-21T12:20:10.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.659+0000 7f1778ff9640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176807af80 0x7f176807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:10.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.659+0000 7f177affd640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176807af80 0x7f176807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:10.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.659+0000 7f1778ff9640 1 -- 172.21.15.118:0/3466682702 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f176c09db70 con 0x7f177c100820 2024-09-21T12:20:10.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.660+0000 7f177affd640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176807af80 0x7f176807d440 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f177c06ae50 tx=0x7f1764031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:10.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.663+0000 7f1778ff9640 1 -- 172.21.15.118:0/3466682702 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f177c199670 con 0x7f177c100820 2024-09-21T12:20:10.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.877+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f177c108d90 con 0x7f177c100820 2024-09-21T12:20:10.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.878+0000 7f1778ff9640 1 -- 172.21.15.118:0/3466682702 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v34) ==== 107+0+4463 (secure 0 0 0) 0x7f176c069140 con 0x7f177c100820 2024-09-21T12:20:10.879 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:10.879 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"btime":"2024-09-21T11:47:50:938355+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/1256053322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1256053322},{"type":"v1","addr":"172.21.15.149:6827","nonce":1256053322}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24305,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/2469878089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2469878089},{"type":"v1","addr":"172.21.15.149:6825","nonce":2469878089}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:10.879 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 21 2024-09-21T12:20:10.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176807af80 msgr2=0x7f176807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:10.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176807af80 0x7f176807d440 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f177c06ae50 tx=0x7f1764031400 comp rx=0 tx=0).stop 2024-09-21T12:20:10.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 msgr2=0x7f177c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:10.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 0x7f177c198840 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d6f0 tx=0x7f176c00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:20:10.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 shutdown_connections 2024-09-21T12:20:10.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f177c106820 0x7f177c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:10.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f176807af80 0x7f176807d440 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:10.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 --2- 172.21.15.118:0/3466682702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177c100820 0x7f177c198840 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:10.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 >> 172.21.15.118:0/3466682702 conn(0x7f177c0fc520 msgr2=0x7f177c0fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:10.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 shutdown_connections 2024-09-21T12:20:10.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:10.880+0000 7f17821ea640 1 -- 172.21.15.118:0/3466682702 wait complete. 2024-09-21T12:20:11.277 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:11 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3466682702' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T12:20:11.278 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:11 smithi118 ceph-mon[111738]: pgmap v1244: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:11.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:11 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3466682702' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T12:20:11.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:11 smithi149 ceph-mon[79770]: pgmap v1244: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:11.585 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:11.586 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 22 2024-09-21T12:20:11.836 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:12.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.338+0000 7fcaa4446640 1 -- 172.21.15.118:0/624673877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 msgr2=0x7fca9c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:12.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.338+0000 7fcaa4446640 1 --2- 172.21.15.118:0/624673877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 0x7fca9c102e80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fca94009880 tx=0x7fca9402a530 comp rx=0 tx=0).stop 2024-09-21T12:20:12.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.338+0000 7fcaa4446640 1 -- 172.21.15.118:0/624673877 shutdown_connections 2024-09-21T12:20:12.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.338+0000 7fcaa4446640 1 --2- 172.21.15.118:0/624673877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c1033c0 0x7fca9c10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:12.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.338+0000 7fcaa4446640 1 --2- 172.21.15.118:0/624673877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 0x7fca9c102e80 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:12.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.338+0000 7fcaa4446640 1 -- 172.21.15.118:0/624673877 >> 172.21.15.118:0/624673877 conn(0x7fca9c0fc4c0 msgr2=0x7fca9c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:12.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.338+0000 7fcaa4446640 1 -- 172.21.15.118:0/624673877 shutdown_connections 2024-09-21T12:20:12.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.338+0000 7fcaa4446640 1 -- 172.21.15.118:0/624673877 wait complete. 2024-09-21T12:20:12.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa4446640 1 Processor -- start 2024-09-21T12:20:12.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa4446640 1 -- start start 2024-09-21T12:20:12.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa4446640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 0x7fca9c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:12.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa4446640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c1033c0 0x7fca9c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa4446640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c101910 con 0x7fca9c102aa0 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa4446640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c101790 con 0x7fca9c1033c0 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa21e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 0x7fca9c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa21e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 0x7fca9c19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44306/0 (socket says 172.21.15.118:44306) 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa21e2640 1 -- 172.21.15.118:0/1162545288 learned_addr learned my addr 172.21.15.118:0/1162545288 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.339+0000 7fcaa19e1640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c1033c0 0x7fca9c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.340+0000 7fcaa21e2640 1 -- 172.21.15.118:0/1162545288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c1033c0 msgr2=0x7fca9c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.340+0000 7fcaa21e2640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c1033c0 0x7fca9c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.340+0000 7fcaa21e2640 1 -- 172.21.15.118:0/1162545288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c199a10 con 0x7fca9c102aa0 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.340+0000 7fcaa21e2640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 0x7fca9c19f850 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fca94031460 tx=0x7fca940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.340+0000 7fca9b7fe640 1 -- 172.21.15.118:0/1162545288 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca9403f070 con 0x7fca9c102aa0 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.340+0000 7fca9b7fe640 1 -- 172.21.15.118:0/1162545288 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca94004cf0 con 0x7fca9c102aa0 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.340+0000 7fca9b7fe640 1 -- 172.21.15.118:0/1162545288 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca94035030 con 0x7fca9c102aa0 2024-09-21T12:20:12.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.340+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9c199ca0 con 0x7fca9c102aa0 2024-09-21T12:20:12.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.340+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9c19a1d0 con 0x7fca9c102aa0 2024-09-21T12:20:12.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.341+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca9c06a410 con 0x7fca9c102aa0 2024-09-21T12:20:12.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.341+0000 7fca9b7fe640 1 -- 172.21.15.118:0/1162545288 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fca94042070 con 0x7fca9c102aa0 2024-09-21T12:20:12.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.342+0000 7fca9b7fe640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca8407af30 0x7fca8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:12.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.342+0000 7fca9b7fe640 1 -- 172.21.15.118:0/1162545288 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fca940beb00 con 0x7fca9c102aa0 2024-09-21T12:20:12.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.342+0000 7fcaa19e1640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca8407af30 0x7fca8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:12.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.342+0000 7fcaa19e1640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca8407af30 0x7fca8407d3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fca9c1080b0 tx=0x7fca90009060 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:12.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.346+0000 7fca9b7fe640 1 -- 172.21.15.118:0/1162545288 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca9408a050 con 0x7fca9c102aa0 2024-09-21T12:20:12.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.558+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7fca9c19afe0 con 0x7fca9c102aa0 2024-09-21T12:20:12.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.559+0000 7fca9b7fe640 1 -- 172.21.15.118:0/1162545288 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v34) ==== 107+0+5310 (secure 0 0 0) 0x7fca9408ef00 con 0x7fca9c102aa0 2024-09-21T12:20:12.560 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:12.560 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":22,"btime":"2024-09-21T11:47:55:243224+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/1256053322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1256053322},{"type":"v1","addr":"172.21.15.149:6827","nonce":1256053322}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24305,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/2469878089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2469878089},{"type":"v1","addr":"172.21.15.149:6825","nonce":2469878089}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34352,"name":"cephfs.smithi118.macjke","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:12.561 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 22 2024-09-21T12:20:12.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.561+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca8407af30 msgr2=0x7fca8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:12.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.561+0000 7fcaa4446640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca8407af30 0x7fca8407d3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fca9c1080b0 tx=0x7fca90009060 comp rx=0 tx=0).stop 2024-09-21T12:20:12.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.561+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 msgr2=0x7fca9c19f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:12.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.561+0000 7fcaa4446640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 0x7fca9c19f850 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fca94031460 tx=0x7fca940048f0 comp rx=0 tx=0).stop 2024-09-21T12:20:12.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.561+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 shutdown_connections 2024-09-21T12:20:12.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.561+0000 7fcaa4446640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca9c1033c0 0x7fca9c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:12.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.561+0000 7fcaa4446640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fca8407af30 0x7fca8407d3f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:12.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.561+0000 7fcaa4446640 1 --2- 172.21.15.118:0/1162545288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca9c102aa0 0x7fca9c19f850 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:12.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.561+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 >> 172.21.15.118:0/1162545288 conn(0x7fca9c0fc4c0 msgr2=0x7fca9c0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:12.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.562+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 shutdown_connections 2024-09-21T12:20:12.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:12.562+0000 7fcaa4446640 1 -- 172.21.15.118:0/1162545288 wait complete. 2024-09-21T12:20:12.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:12 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1162545288' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T12:20:12.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:12 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1162545288' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T12:20:13.233 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:13.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 23 2024-09-21T12:20:13.482 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:13.859 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:13 smithi118 ceph-mon[111738]: pgmap v1245: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:13.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:13 smithi149 ceph-mon[79770]: pgmap v1245: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:13.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.938+0000 7fcdbec7c640 1 -- 172.21.15.118:0/3435676197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb81011b0 msgr2=0x7fcdb8105680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:13.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.938+0000 7fcdbec7c640 1 --2- 172.21.15.118:0/3435676197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb81011b0 0x7fcdb8105680 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009880 tx=0x7fcda802a530 comp rx=0 tx=0).stop 2024-09-21T12:20:13.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.938+0000 7fcdbec7c640 1 -- 172.21.15.118:0/3435676197 shutdown_connections 2024-09-21T12:20:13.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.938+0000 7fcdbec7c640 1 --2- 172.21.15.118:0/3435676197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb81011b0 0x7fcdb8105680 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:13.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.938+0000 7fcdbec7c640 1 --2- 172.21.15.118:0/3435676197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdb8100890 0x7fcdb8100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:13.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.938+0000 7fcdbec7c640 1 -- 172.21.15.118:0/3435676197 >> 172.21.15.118:0/3435676197 conn(0x7fcdb80fc4c0 msgr2=0x7fcdb80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:13.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.938+0000 7fcdbec7c640 1 -- 172.21.15.118:0/3435676197 shutdown_connections 2024-09-21T12:20:13.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.938+0000 7fcdbec7c640 1 -- 172.21.15.118:0/3435676197 wait complete. 2024-09-21T12:20:13.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbec7c640 1 Processor -- start 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbec7c640 1 -- start start 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbec7c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb8100890 0x7fcdb819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbec7c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdb81011b0 0x7fcdb819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbec7c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb8115430 con 0x7fcdb8100890 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbec7c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb81152b0 con 0x7fcdb81011b0 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbca18640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb8100890 0x7fcdb819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbca18640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb8100890 0x7fcdb819e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44328/0 (socket says 172.21.15.118:44328) 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbca18640 1 -- 172.21.15.118:0/983357723 learned_addr learned my addr 172.21.15.118:0/983357723 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdaffff640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdb81011b0 0x7fcdb819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbca18640 1 -- 172.21.15.118:0/983357723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdb81011b0 msgr2=0x7fcdb819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbca18640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdb81011b0 0x7fcdb819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.939+0000 7fcdbca18640 1 -- 172.21.15.118:0/983357723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb81a28e0 con 0x7fcdb8100890 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.940+0000 7fcdbca18640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb8100890 0x7fcdb819e010 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400b420 tx=0x7fcdb400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:13.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.940+0000 7fcdadffb640 1 -- 172.21.15.118:0/983357723 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcdb4011630 con 0x7fcdb8100890 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.940+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb81a2bd0 con 0x7fcdb8100890 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.940+0000 7fcdadffb640 1 -- 172.21.15.118:0/983357723 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcdb4016070 con 0x7fcdb8100890 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.940+0000 7fcdadffb640 1 -- 172.21.15.118:0/983357723 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcdb4010d40 con 0x7fcdb8100890 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.940+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb81a3160 con 0x7fcdb8100890 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.941+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb806a410 con 0x7fcdb8100890 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.941+0000 7fcdadffb640 1 -- 172.21.15.118:0/983357723 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcdb40117d0 con 0x7fcdb8100890 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.942+0000 7fcdadffb640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcda007af30 0x7fcda007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.942+0000 7fcdadffb640 1 -- 172.21.15.118:0/983357723 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcdb409d8b0 con 0x7fcdb8100890 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.942+0000 7fcdaffff640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcda007af30 0x7fcda007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.942+0000 7fcdaffff640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcda007af30 0x7fcda007d3f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcdb81124d0 tx=0x7fcda8031400 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:13.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:13.946+0000 7fcdadffb640 1 -- 172.21.15.118:0/983357723 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcdb4068da0 con 0x7fcdb8100890 2024-09-21T12:20:14.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.159+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7fcdb819f370 con 0x7fcdb8100890 2024-09-21T12:20:14.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.160+0000 7fcdadffb640 1 -- 172.21.15.118:0/983357723 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v34) ==== 107+0+4460 (secure 0 0 0) 0x7fcdb406dc50 con 0x7fcdb8100890 2024-09-21T12:20:14.161 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:14.161 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":23,"btime":"2024-09-21T11:48:06:569532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/1256053322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1256053322},{"type":"v1","addr":"172.21.15.149:6827","nonce":1256053322}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34352,"name":"cephfs.smithi118.macjke","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:14.162 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 23 2024-09-21T12:20:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcda007af30 msgr2=0x7fcda007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcda007af30 0x7fcda007d3f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcdb81124d0 tx=0x7fcda8031400 comp rx=0 tx=0).stop 2024-09-21T12:20:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb8100890 msgr2=0x7fcdb819e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb8100890 0x7fcdb819e010 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400b420 tx=0x7fcdb400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:20:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 shutdown_connections 2024-09-21T12:20:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdb81011b0 0x7fcdb819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fcda007af30 0x7fcda007d3f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 --2- 172.21.15.118:0/983357723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb8100890 0x7fcdb819e010 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 >> 172.21.15.118:0/983357723 conn(0x7fcdb80fc4c0 msgr2=0x7fcdb8112bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 shutdown_connections 2024-09-21T12:20:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:14.164+0000 7fcdbec7c640 1 -- 172.21.15.118:0/983357723 wait complete. 2024-09-21T12:20:14.824 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:14 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/983357723' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T12:20:14.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:14 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/983357723' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T12:20:15.180 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:15.180 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 24 2024-09-21T12:20:15.431 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:15.810 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:15 smithi118 ceph-mon[111738]: pgmap v1246: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.891+0000 7f1a24d8b640 1 -- 172.21.15.118:0/2245238989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20100820 msgr2=0x7f1a20100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.891+0000 7f1a24d8b640 1 --2- 172.21.15.118:0/2245238989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20100820 0x7f1a20100c80 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009c20 tx=0x7f1a1402a970 comp rx=0 tx=0).stop 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.891+0000 7f1a24d8b640 1 -- 172.21.15.118:0/2245238989 shutdown_connections 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.891+0000 7f1a24d8b640 1 --2- 172.21.15.118:0/2245238989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20100820 0x7f1a20100c80 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.891+0000 7f1a24d8b640 1 --2- 172.21.15.118:0/2245238989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a20106820 0x7f1a20106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.891+0000 7f1a24d8b640 1 -- 172.21.15.118:0/2245238989 >> 172.21.15.118:0/2245238989 conn(0x7f1a200fc520 msgr2=0x7f1a200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.892+0000 7f1a24d8b640 1 -- 172.21.15.118:0/2245238989 shutdown_connections 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.892+0000 7f1a24d8b640 1 -- 172.21.15.118:0/2245238989 wait complete. 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.892+0000 7f1a24d8b640 1 Processor -- start 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.892+0000 7f1a24d8b640 1 -- start start 2024-09-21T12:20:15.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a24d8b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a20100820 0x7f1a2019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a24d8b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20106820 0x7f1a2019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a24d8b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2010dd50 con 0x7f1a20106820 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a24d8b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2010dbd0 con 0x7f1a20100820 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a1dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20106820 0x7f1a2019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a1dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20106820 0x7f1a2019fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59684/0 (socket says 172.21.15.118:59684) 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a1dd9b640 1 -- 172.21.15.118:0/932195429 learned_addr learned my addr 172.21.15.118:0/932195429 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a1e59c640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a20100820 0x7f1a2019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a1dd9b640 1 -- 172.21.15.118:0/932195429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a20100820 msgr2=0x7f1a2019f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a1dd9b640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a20100820 0x7f1a2019f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a1dd9b640 1 -- 172.21.15.118:0/932195429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a20199ae0 con 0x7f1a20106820 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a1dd9b640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20106820 0x7f1a2019fe60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1a14005cc0 tx=0x7f1a1402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a0f7fe640 1 -- 172.21.15.118:0/932195429 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a14047070 con 0x7f1a20106820 2024-09-21T12:20:15.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a0f7fe640 1 -- 172.21.15.118:0/932195429 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a1402f7e0 con 0x7f1a20106820 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a20199d70 con 0x7f1a20106820 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a0f7fe640 1 -- 172.21.15.118:0/932195429 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a14034070 con 0x7f1a20106820 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.893+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2019a2a0 con 0x7f1a20106820 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.894+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a20101f60 con 0x7f1a20106820 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.895+0000 7f1a0f7fe640 1 -- 172.21.15.118:0/932195429 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1a1404a070 con 0x7f1a20106820 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.896+0000 7f1a0f7fe640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a0807af30 0x7f1a0807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.896+0000 7f1a1e59c640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a0807af30 0x7f1a0807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.896+0000 7f1a0f7fe640 1 -- 172.21.15.118:0/932195429 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1a140bef90 con 0x7f1a20106820 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.896+0000 7f1a1e59c640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a0807af30 0x7f1a0807d3f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009890 tx=0x7f1a10008040 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:15.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:15.900+0000 7f1a0f7fe640 1 -- 172.21.15.118:0/932195429 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a1403f070 con 0x7f1a20106820 2024-09-21T12:20:15.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:15 smithi149 ceph-mon[79770]: pgmap v1246: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:16.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.124+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f1a2019b070 con 0x7f1a20106820 2024-09-21T12:20:16.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.124+0000 7f1a0f7fe640 1 -- 172.21.15.118:0/932195429 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v34) ==== 107+0+5304 (secure 0 0 0) 0x7f1a1408a4e0 con 0x7f1a20106820 2024-09-21T12:20:16.126 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:16.126 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":24,"btime":"2024-09-21T11:48:11:576140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/1256053322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1256053322},{"type":"v1","addr":"172.21.15.149:6827","nonce":1256053322}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34352,"name":"cephfs.smithi118.macjke","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:16.126 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 24 2024-09-21T12:20:16.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a0807af30 msgr2=0x7f1a0807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:16.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a0807af30 0x7f1a0807d3f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009890 tx=0x7f1a10008040 comp rx=0 tx=0).stop 2024-09-21T12:20:16.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20106820 msgr2=0x7f1a2019fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:16.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20106820 0x7f1a2019fe60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1a14005cc0 tx=0x7f1a1402f5f0 comp rx=0 tx=0).stop 2024-09-21T12:20:16.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 shutdown_connections 2024-09-21T12:20:16.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f1a0807af30 0x7f1a0807d3f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:16.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20106820 0x7f1a2019fe60 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:16.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 --2- 172.21.15.118:0/932195429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a20100820 0x7f1a2019f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:16.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 >> 172.21.15.118:0/932195429 conn(0x7f1a200fc520 msgr2=0x7f1a200fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:16.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 shutdown_connections 2024-09-21T12:20:16.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:16.127+0000 7f1a24d8b640 1 -- 172.21.15.118:0/932195429 wait complete. 2024-09-21T12:20:16.714 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:16 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/932195429' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T12:20:16.743 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:16.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 25 2024-09-21T12:20:16.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:16 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/932195429' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T12:20:16.990 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:17.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.463+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3666324566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 msgr2=0x7f78f4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:17.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.463+0000 7f78fa7b5640 1 --2- 172.21.15.118:0/3666324566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 0x7f78f4106bc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009880 tx=0x7f78e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.463+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3666324566 shutdown_connections 2024-09-21T12:20:17.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.463+0000 7f78fa7b5640 1 --2- 172.21.15.118:0/3666324566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78f41007e0 0x7f78f4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.463+0000 7f78fa7b5640 1 --2- 172.21.15.118:0/3666324566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 0x7f78f4106bc0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.463+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3666324566 >> 172.21.15.118:0/3666324566 conn(0x7f78f40fc4c0 msgr2=0x7f78f40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:17.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.463+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3666324566 shutdown_connections 2024-09-21T12:20:17.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.463+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3666324566 wait complete. 2024-09-21T12:20:17.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78fa7b5640 1 Processor -- start 2024-09-21T12:20:17.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78fa7b5640 1 -- start start 2024-09-21T12:20:17.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78fa7b5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78f41007e0 0x7f78f41987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:17.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78fa7b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 0x7f78f4198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:17.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78fa7b5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f78f410dc90 con 0x7f78f41067e0 2024-09-21T12:20:17.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78fa7b5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f78f410db10 con 0x7f78f41007e0 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78ebfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 0x7f78f4198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78ebfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 0x7f78f4198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59692/0 (socket says 172.21.15.118:59692) 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78ebfff640 1 -- 172.21.15.118:0/3548366316 learned_addr learned my addr 172.21.15.118:0/3548366316 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78f3fff640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78f41007e0 0x7f78f41987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78ebfff640 1 -- 172.21.15.118:0/3548366316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78f41007e0 msgr2=0x7f78f41987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78ebfff640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78f41007e0 0x7f78f41987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.464+0000 7f78ebfff640 1 -- 172.21.15.118:0/3548366316 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f41992a0 con 0x7f78f41067e0 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.465+0000 7f78ebfff640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 0x7f78f4198ce0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00c8a0 tx=0x7f78dc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.465+0000 7f78f1ffb640 1 -- 172.21.15.118:0/3548366316 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78dc0079b0 con 0x7f78f41067e0 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.465+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f4199590 con 0x7f78f41067e0 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.465+0000 7f78f1ffb640 1 -- 172.21.15.118:0/3548366316 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78dc007b50 con 0x7f78f41067e0 2024-09-21T12:20:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.465+0000 7f78f1ffb640 1 -- 172.21.15.118:0/3548366316 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78dc018700 con 0x7f78f41067e0 2024-09-21T12:20:17.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.465+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f41a1b80 con 0x7f78f41067e0 2024-09-21T12:20:17.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.466+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f4101f20 con 0x7f78f41067e0 2024-09-21T12:20:17.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.467+0000 7f78f1ffb640 1 -- 172.21.15.118:0/3548366316 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f78dc007d00 con 0x7f78f41067e0 2024-09-21T12:20:17.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.467+0000 7f78f1ffb640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78e007af30 0x7f78e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:17.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.467+0000 7f78f1ffb640 1 -- 172.21.15.118:0/3548366316 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f78dc09e3d0 con 0x7f78f41067e0 2024-09-21T12:20:17.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.467+0000 7f78f3fff640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78e007af30 0x7f78e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:17.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.468+0000 7f78f3fff640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78e007af30 0x7f78e007d3f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f78e4031460 tx=0x7f78e4005bd0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:17.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.472+0000 7f78f1ffb640 1 -- 172.21.15.118:0/3548366316 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78dc014030 con 0x7f78f41067e0 2024-09-21T12:20:17.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.689+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f78f41039f0 con 0x7f78f41067e0 2024-09-21T12:20:17.691 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:17 smithi118 ceph-mon[111738]: pgmap v1247: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:17.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.690+0000 7f78f1ffb640 1 -- 172.21.15.118:0/3548366316 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v34) ==== 107+0+4454 (secure 0 0 0) 0x7f78dc0699a0 con 0x7f78f41067e0 2024-09-21T12:20:17.691 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:17.691 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T12:03:14:526601+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34352,"name":"cephfs.smithi118.macjke","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:17.692 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T12:20:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78e007af30 msgr2=0x7f78e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78e007af30 0x7f78e007d3f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f78e4031460 tx=0x7f78e4005bd0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 msgr2=0x7f78f4198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 0x7f78f4198ce0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00c8a0 tx=0x7f78dc00cd60 comp rx=0 tx=0).stop 2024-09-21T12:20:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 shutdown_connections 2024-09-21T12:20:17.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f78e007af30 0x7f78e007d3f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f41067e0 0x7f78f4198ce0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 --2- 172.21.15.118:0/3548366316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78f41007e0 0x7f78f41987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 >> 172.21.15.118:0/3548366316 conn(0x7f78f40fc4c0 msgr2=0x7f78f40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:17.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 shutdown_connections 2024-09-21T12:20:17.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:17.692+0000 7f78fa7b5640 1 -- 172.21.15.118:0/3548366316 wait complete. 2024-09-21T12:20:17.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:17 smithi149 ceph-mon[79770]: pgmap v1247: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:18.326 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:18.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 26 2024-09-21T12:20:18.574 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:18.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:18 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3548366316' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T12:20:18.967 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:18 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3548366316' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T12:20:19.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.045+0000 7fd8574db640 1 -- 172.21.15.118:0/67529235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850106820 msgr2=0x7fd850106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.045+0000 7fd8574db640 1 --2- 172.21.15.118:0/67529235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850106820 0x7fd850106c00 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009880 tx=0x7fd84c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.045+0000 7fd8574db640 1 -- 172.21.15.118:0/67529235 shutdown_connections 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.045+0000 7fd8574db640 1 --2- 172.21.15.118:0/67529235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd850100820 0x7fd850100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.045+0000 7fd8574db640 1 --2- 172.21.15.118:0/67529235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850106820 0x7fd850106c00 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.045+0000 7fd8574db640 1 -- 172.21.15.118:0/67529235 >> 172.21.15.118:0/67529235 conn(0x7fd8500fc520 msgr2=0x7fd8500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.045+0000 7fd8574db640 1 -- 172.21.15.118:0/67529235 shutdown_connections 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.045+0000 7fd8574db640 1 -- 172.21.15.118:0/67529235 wait complete. 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd8574db640 1 Processor -- start 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd8574db640 1 -- start start 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd8574db640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850100820 0x7fd850196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd8574db640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd850106820 0x7fd850196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd8574db640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd85010dcf0 con 0x7fd850100820 2024-09-21T12:20:19.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd8574db640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd85010db70 con 0x7fd850106820 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd855277640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850100820 0x7fd850196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd855277640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850100820 0x7fd850196610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59712/0 (socket says 172.21.15.118:59712) 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd855277640 1 -- 172.21.15.118:0/1954151482 learned_addr learned my addr 172.21.15.118:0/1954151482 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd854a76640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd850106820 0x7fd850196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd855277640 1 -- 172.21.15.118:0/1954151482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd850106820 msgr2=0x7fd850196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd855277640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd850106820 0x7fd850196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd855277640 1 -- 172.21.15.118:0/1954151482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd850197090 con 0x7fd850100820 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.046+0000 7fd854a76640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd850106820 0x7fd850196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.047+0000 7fd855277640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850100820 0x7fd850196610 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd84c031460 tx=0x7fd84c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.047+0000 7fd8467fc640 1 -- 172.21.15.118:0/1954151482 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd84c03f070 con 0x7fd850100820 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.047+0000 7fd8467fc640 1 -- 172.21.15.118:0/1954151482 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd84c0035f0 con 0x7fd850100820 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.047+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd850197320 con 0x7fd850100820 2024-09-21T12:20:19.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.047+0000 7fd8467fc640 1 -- 172.21.15.118:0/1954151482 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd84c035030 con 0x7fd850100820 2024-09-21T12:20:19.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.047+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8501a3e50 con 0x7fd850100820 2024-09-21T12:20:19.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.048+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd850101f60 con 0x7fd850100820 2024-09-21T12:20:19.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.048+0000 7fd8467fc640 1 -- 172.21.15.118:0/1954151482 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd84c042070 con 0x7fd850100820 2024-09-21T12:20:19.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.049+0000 7fd8467fc640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd83c07af30 0x7fd83c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:19.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.049+0000 7fd854a76640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd83c07af30 0x7fd83c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:19.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.049+0000 7fd8467fc640 1 -- 172.21.15.118:0/1954151482 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd84c0bea60 con 0x7fd850100820 2024-09-21T12:20:19.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.049+0000 7fd854a76640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd83c07af30 0x7fd83c07d3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd8400058c0 tx=0x7fd840005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:19.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.053+0000 7fd8467fc640 1 -- 172.21.15.118:0/1954151482 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd84c089fb0 con 0x7fd850100820 2024-09-21T12:20:19.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.265+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7fd850100c80 con 0x7fd850100820 2024-09-21T12:20:19.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.265+0000 7fd8467fc640 1 -- 172.21.15.118:0/1954151482 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v34) ==== 107+0+5304 (secure 0 0 0) 0x7fd84c08ee60 con 0x7fd850100820 2024-09-21T12:20:19.267 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:19.268 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":26,"btime":"2024-09-21T12:03:17:535028+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34352,"name":"cephfs.smithi118.macjke","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44737,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2325869358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2325869358},{"type":"v1","addr":"172.21.15.149:6827","nonce":2325869358}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T11:47:28.938924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:19.268 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 26 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.267+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd83c07af30 msgr2=0x7fd83c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.267+0000 7fd8574db640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd83c07af30 0x7fd83c07d3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd8400058c0 tx=0x7fd840005850 comp rx=0 tx=0).stop 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.267+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850100820 msgr2=0x7fd850196610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.267+0000 7fd8574db640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850100820 0x7fd850196610 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd84c031460 tx=0x7fd84c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.268+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 shutdown_connections 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.268+0000 7fd8574db640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd850106820 0x7fd850196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.268+0000 7fd8574db640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd83c07af30 0x7fd83c07d3f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.268+0000 7fd8574db640 1 --2- 172.21.15.118:0/1954151482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd850100820 0x7fd850196610 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.268+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 >> 172.21.15.118:0/1954151482 conn(0x7fd8500fc520 msgr2=0x7fd8500fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:19.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.268+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 shutdown_connections 2024-09-21T12:20:19.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:19.268+0000 7fd8574db640 1 -- 172.21.15.118:0/1954151482 wait complete. 2024-09-21T12:20:19.914 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:19 smithi118 ceph-mon[111738]: pgmap v1248: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:19.914 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:19 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1954151482' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T12:20:19.943 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T12:20:19.943 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 27 2024-09-21T12:20:19.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:19 smithi149 ceph-mon[79770]: pgmap v1248: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:19.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:19 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1954151482' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T12:20:20.192 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:20.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.691+0000 7f1072904640 1 -- 172.21.15.118:0/3146508246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c101930 msgr2=0x7f106c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:20.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.691+0000 7f1072904640 1 --2- 172.21.15.118:0/3146508246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c101930 0x7f106c101d90 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1060009880 tx=0x7f106002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.691+0000 7f1072904640 1 -- 172.21.15.118:0/3146508246 shutdown_connections 2024-09-21T12:20:20.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.691+0000 7f1072904640 1 --2- 172.21.15.118:0/3146508246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c101930 0x7f106c101d90 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.691+0000 7f1072904640 1 --2- 172.21.15.118:0/3146508246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f106c107930 0x7f106c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.691+0000 7f1072904640 1 -- 172.21.15.118:0/3146508246 >> 172.21.15.118:0/3146508246 conn(0x7f106c0fd630 msgr2=0x7f106c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:20.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.691+0000 7f1072904640 1 -- 172.21.15.118:0/3146508246 shutdown_connections 2024-09-21T12:20:20.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.691+0000 7f1072904640 1 -- 172.21.15.118:0/3146508246 wait complete. 2024-09-21T12:20:20.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.692+0000 7f1072904640 1 Processor -- start 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.692+0000 7f1072904640 1 -- start start 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.692+0000 7f1072904640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f106c101930 0x7f106c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.692+0000 7f1072904640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c107930 0x7f106c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.692+0000 7f1072904640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f106c10ede0 con 0x7f106c107930 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.692+0000 7f1072904640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f106c10ec60 con 0x7f106c101930 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.692+0000 7f106b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c107930 0x7f106c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.692+0000 7f106b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c107930 0x7f106c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59722/0 (socket says 172.21.15.118:59722) 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.692+0000 7f106b7fe640 1 -- 172.21.15.118:0/1972407296 learned_addr learned my addr 172.21.15.118:0/1972407296 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f106bfff640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f106c101930 0x7f106c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f106b7fe640 1 -- 172.21.15.118:0/1972407296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f106c101930 msgr2=0x7f106c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f106b7fe640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f106c101930 0x7f106c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f106b7fe640 1 -- 172.21.15.118:0/1972407296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106c074f70 con 0x7f106c107930 2024-09-21T12:20:20.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f106b7fe640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c107930 0x7f106c074a30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1060031460 tx=0x7f10600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f10697fa640 1 -- 172.21.15.118:0/1972407296 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f106003f070 con 0x7f106c107930 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f106c075200 con 0x7f106c107930 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f10697fa640 1 -- 172.21.15.118:0/1972407296 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10600035f0 con 0x7f106c107930 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f10697fa640 1 -- 172.21.15.118:0/1972407296 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1060035030 con 0x7f106c107930 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.693+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f106c1a3e10 con 0x7f106c107930 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.694+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f106c103070 con 0x7f106c107930 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.695+0000 7f10697fa640 1 -- 172.21.15.118:0/1972407296 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1060042070 con 0x7f106c107930 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.695+0000 7f10697fa640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f105407af30 0x7f105407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.695+0000 7f10697fa640 1 -- 172.21.15.118:0/1972407296 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f10600bead0 con 0x7f106c107930 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.695+0000 7f106bfff640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f105407af30 0x7f105407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:20.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.696+0000 7f106bfff640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f105407af30 0x7f105407d3f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f105c005fd0 tx=0x7f105c005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:20.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.699+0000 7f10697fa640 1 -- 172.21.15.118:0/1972407296 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f106008a020 con 0x7f106c107930 2024-09-21T12:20:20.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.914+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7f106c109ec0 con 0x7f106c107930 2024-09-21T12:20:20.916 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:20:20.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.914+0000 7f10697fa640 1 -- 172.21.15.118:0/1972407296 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v34) ==== 107+0+5303 (secure 0 0 0) 0x7f106008c020 con 0x7f106c107930 2024-09-21T12:20:20.917 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:20.917 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":27,"btime":"2024-09-21T12:18:18:389487+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34352,"name":"cephfs.smithi118.macjke","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44737,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2325869358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2325869358},{"type":"v1","addr":"172.21.15.149:6827","nonce":2325869358}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T12:18:17.392485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:20.917 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 27 2024-09-21T12:20:20.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f105407af30 msgr2=0x7f105407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:20.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f105407af30 0x7f105407d3f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f105c005fd0 tx=0x7f105c005850 comp rx=0 tx=0).stop 2024-09-21T12:20:20.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c107930 msgr2=0x7f106c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:20.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c107930 0x7f106c074a30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1060031460 tx=0x7f10600045e0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 shutdown_connections 2024-09-21T12:20:20.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f105407af30 0x7f105407d3f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f106c107930 0x7f106c074a30 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 --2- 172.21.15.118:0/1972407296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f106c101930 0x7f106c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 >> 172.21.15.118:0/1972407296 conn(0x7f106c0fd630 msgr2=0x7f106c0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:20.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 shutdown_connections 2024-09-21T12:20:20.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:20.917+0000 7f1072904640 1 -- 172.21.15.118:0/1972407296 wait complete. 2024-09-21T12:20:20.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:20:21.550 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 28 2024-09-21T12:20:21.799 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:21.920 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:21 smithi118 ceph-mon[111738]: pgmap v1249: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:21.920 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:21 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1972407296' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T12:20:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:21 smithi149 ceph-mon[79770]: pgmap v1249: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:21.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:21 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1972407296' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T12:20:22.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/320454643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4106820 msgr2=0x7fd5a4106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:22.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 --2- 172.21.15.118:0/320454643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4106820 0x7fd5a4106c00 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009880 tx=0x7fd5a002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:22.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/320454643 shutdown_connections 2024-09-21T12:20:22.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 --2- 172.21.15.118:0/320454643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4100820 0x7fd5a4100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:22.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 --2- 172.21.15.118:0/320454643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4106820 0x7fd5a4106c00 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:22.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/320454643 >> 172.21.15.118:0/320454643 conn(0x7fd5a40fc520 msgr2=0x7fd5a40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:22.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/320454643 shutdown_connections 2024-09-21T12:20:22.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/320454643 wait complete. 2024-09-21T12:20:22.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 Processor -- start 2024-09-21T12:20:22.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.237+0000 7fd5ac4d2640 1 -- start start 2024-09-21T12:20:22.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5ac4d2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4100820 0x7fd5a40fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:22.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5ac4d2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4106820 0x7fd5a40fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:22.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5ac4d2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a410dcf0 con 0x7fd5a4100820 2024-09-21T12:20:22.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5ac4d2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a410db70 con 0x7fd5a4106820 2024-09-21T12:20:22.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5aa26e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4100820 0x7fd5a40fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:22.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5aa26e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4100820 0x7fd5a40fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59754/0 (socket says 172.21.15.118:59754) 2024-09-21T12:20:22.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5aa26e640 1 -- 172.21.15.118:0/717787172 learned_addr learned my addr 172.21.15.118:0/717787172 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5aa26e640 1 -- 172.21.15.118:0/717787172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4106820 msgr2=0x7fd5a40fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5aa26e640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4106820 0x7fd5a40fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5aa26e640 1 -- 172.21.15.118:0/717787172 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a40fd6c0 con 0x7fd5a4100820 2024-09-21T12:20:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5aa26e640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4100820 0x7fd5a40fcc40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0031460 tx=0x7fd5a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd59b7fe640 1 -- 172.21.15.118:0/717787172 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5a003f070 con 0x7fd5a4100820 2024-09-21T12:20:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd59b7fe640 1 -- 172.21.15.118:0/717787172 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5a00035f0 con 0x7fd5a4100820 2024-09-21T12:20:22.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a40fd950 con 0x7fd5a4100820 2024-09-21T12:20:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.238+0000 7fd59b7fe640 1 -- 172.21.15.118:0/717787172 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5a0035030 con 0x7fd5a4100820 2024-09-21T12:20:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.239+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a41a3da0 con 0x7fd5a4100820 2024-09-21T12:20:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.240+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a4101f60 con 0x7fd5a4100820 2024-09-21T12:20:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.240+0000 7fd59b7fe640 1 -- 172.21.15.118:0/717787172 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fd5a0042070 con 0x7fd5a4100820 2024-09-21T12:20:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.241+0000 7fd59b7fe640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd59007af80 0x7fd59007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.241+0000 7fd59b7fe640 1 -- 172.21.15.118:0/717787172 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd5a00be9c0 con 0x7fd5a4100820 2024-09-21T12:20:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.241+0000 7fd5a9a6d640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd59007af80 0x7fd59007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:22.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.241+0000 7fd5a9a6d640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd59007af80 0x7fd59007d440 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd594005fd0 tx=0x7fd594005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.245+0000 7fd59b7fe640 1 -- 172.21.15.118:0/717787172 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5a0089f90 con 0x7fd5a4100820 2024-09-21T12:20:22.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.459+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7fd5a40fe170 con 0x7fd5a4100820 2024-09-21T12:20:22.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.459+0000 7fd59b7fe640 1 -- 172.21.15.118:0/717787172 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v34) ==== 107+0+5326 (secure 0 0 0) 0x7fd5a008ee40 con 0x7fd5a4100820 2024-09-21T12:20:22.462 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:22.462 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":28,"btime":"2024-09-21T12:18:18:393468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44737,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2325869358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2325869358},{"type":"v1","addr":"172.21.15.149:6827","nonce":2325869358}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T12:18:18.393455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi118.macjke","rank":1,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:22.462 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 28 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd59007af80 msgr2=0x7fd59007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd59007af80 0x7fd59007d440 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd594005fd0 tx=0x7fd594005850 comp rx=0 tx=0).stop 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4100820 msgr2=0x7fd5a40fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4100820 0x7fd5a40fcc40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0031460 tx=0x7fd5a00045e0 comp rx=0 tx=0).stop 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 shutdown_connections 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4106820 0x7fd5a40fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fd59007af80 0x7fd59007d440 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 --2- 172.21.15.118:0/717787172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a4100820 0x7fd5a40fcc40 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 >> 172.21.15.118:0/717787172 conn(0x7fd5a40fc520 msgr2=0x7fd5a406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:22.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 shutdown_connections 2024-09-21T12:20:22.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:22.462+0000 7fd5ac4d2640 1 -- 172.21.15.118:0/717787172 wait complete. 2024-09-21T12:20:22.938 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:22 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/717787172' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T12:20:22.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:22 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/717787172' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T12:20:23.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 29 2024-09-21T12:20:23.498 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:23.892 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:23 smithi118 ceph-mon[111738]: pgmap v1250: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:23.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:23 smithi149 ceph-mon[79770]: pgmap v1250: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:23.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.969+0000 7f53c2559640 1 -- 172.21.15.118:0/384150300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1007e0 msgr2=0x7f53bc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:23.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.969+0000 7f53c2559640 1 --2- 172.21.15.118:0/384150300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1007e0 0x7f53bc100c40 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009880 tx=0x7f53b002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:23.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.969+0000 7f53c2559640 1 -- 172.21.15.118:0/384150300 shutdown_connections 2024-09-21T12:20:23.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.969+0000 7f53c2559640 1 --2- 172.21.15.118:0/384150300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1007e0 0x7f53bc100c40 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:23.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.969+0000 7f53c2559640 1 --2- 172.21.15.118:0/384150300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53bc1067e0 0x7f53bc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.969+0000 7f53c2559640 1 -- 172.21.15.118:0/384150300 >> 172.21.15.118:0/384150300 conn(0x7f53bc0fc4c0 msgr2=0x7f53bc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.969+0000 7f53c2559640 1 -- 172.21.15.118:0/384150300 shutdown_connections 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.970+0000 7f53c2559640 1 -- 172.21.15.118:0/384150300 wait complete. 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.970+0000 7f53c2559640 1 Processor -- start 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.970+0000 7f53c2559640 1 -- start start 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.970+0000 7f53c2559640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53bc1007e0 0x7f53bc19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.970+0000 7f53c2559640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1067e0 0x7f53bc19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.970+0000 7f53c2559640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc10dcb0 con 0x7f53bc1067e0 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.970+0000 7f53c2559640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc10db30 con 0x7f53bc1007e0 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53bb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1067e0 0x7f53bc19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53bb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1067e0 0x7f53bc19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59770/0 (socket says 172.21.15.118:59770) 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53bb7fe640 1 -- 172.21.15.118:0/3488252528 learned_addr learned my addr 172.21.15.118:0/3488252528 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53bbfff640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53bc1007e0 0x7f53bc19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53bb7fe640 1 -- 172.21.15.118:0/3488252528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53bc1007e0 msgr2=0x7f53bc19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53bb7fe640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53bc1007e0 0x7f53bc19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53bb7fe640 1 -- 172.21.15.118:0/3488252528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc1977e0 con 0x7f53bc1067e0 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53bbfff640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53bc1007e0 0x7f53bc19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53bb7fe640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1067e0 0x7f53bc19dba0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f53b0031460 tx=0x7f53b00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53b97fa640 1 -- 172.21.15.118:0/3488252528 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53b003f070 con 0x7f53bc1067e0 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53bc197a70 con 0x7f53bc1067e0 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53b97fa640 1 -- 172.21.15.118:0/3488252528 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53b00035f0 con 0x7f53bc1067e0 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53b97fa640 1 -- 172.21.15.118:0/3488252528 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53b0035030 con 0x7f53bc1067e0 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.971+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53bc197fa0 con 0x7f53bc1067e0 2024-09-21T12:20:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.972+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53bc101f20 con 0x7f53bc1067e0 2024-09-21T12:20:23.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.973+0000 7f53b97fa640 1 -- 172.21.15.118:0/3488252528 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f53b0042070 con 0x7f53bc1067e0 2024-09-21T12:20:23.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.973+0000 7f53b97fa640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f53a407af30 0x7f53a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:23.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.973+0000 7f53b97fa640 1 -- 172.21.15.118:0/3488252528 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f53b00beab0 con 0x7f53bc1067e0 2024-09-21T12:20:23.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.973+0000 7f53bbfff640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f53a407af30 0x7f53a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:23.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.974+0000 7f53bbfff640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f53a407af30 0x7f53a407d3f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0058c0 tx=0x7f53ac005850 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:23.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:23.977+0000 7f53b97fa640 1 -- 172.21.15.118:0/3488252528 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53b008a000 con 0x7f53bc1067e0 2024-09-21T12:20:24.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.190+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f53bc198250 con 0x7f53bc1067e0 2024-09-21T12:20:24.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.191+0000 7f53b97fa640 1 -- 172.21.15.118:0/3488252528 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v34) ==== 107+0+5329 (secure 0 0 0) 0x7f53b008eeb0 con 0x7f53bc1067e0 2024-09-21T12:20:24.193 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:24.193 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"btime":"2024-09-21T12:18:19:401050+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44737,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2325869358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2325869358},{"type":"v1","addr":"172.21.15.149:6827","nonce":2325869358}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T12:18:18.407718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi118.macjke","rank":1,"incarnation":28,"state":"up:resolve","state_seq":457,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:24.194 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 29 2024-09-21T12:20:24.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f53a407af30 msgr2=0x7f53a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:24.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f53a407af30 0x7f53a407d3f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0058c0 tx=0x7f53ac005850 comp rx=0 tx=0).stop 2024-09-21T12:20:24.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1067e0 msgr2=0x7f53bc19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:24.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1067e0 0x7f53bc19dba0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f53b0031460 tx=0x7f53b00045e0 comp rx=0 tx=0).stop 2024-09-21T12:20:24.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 shutdown_connections 2024-09-21T12:20:24.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f53a407af30 0x7f53a407d3f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:24.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53bc1067e0 0x7f53bc19dba0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:24.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 --2- 172.21.15.118:0/3488252528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53bc1007e0 0x7f53bc19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:24.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 >> 172.21.15.118:0/3488252528 conn(0x7f53bc0fc4c0 msgr2=0x7f53bc104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:24.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 shutdown_connections 2024-09-21T12:20:24.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:24.193+0000 7f53c2559640 1 -- 172.21.15.118:0/3488252528 wait complete. 2024-09-21T12:20:24.813 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:24 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3488252528' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T12:20:24.840 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 30 2024-09-21T12:20:24.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:24 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3488252528' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T12:20:25.090 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:25.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.546+0000 7f2196fa1640 1 -- 172.21.15.118:0/1208257253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21901009e0 msgr2=0x7f2190104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:25.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.546+0000 7f2196fa1640 1 --2- 172.21.15.118:0/1208257253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21901009e0 0x7f2190104b40 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2180009880 tx=0x7f218002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:25.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.546+0000 7f2196fa1640 1 -- 172.21.15.118:0/1208257253 shutdown_connections 2024-09-21T12:20:25.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.546+0000 7f2196fa1640 1 --2- 172.21.15.118:0/1208257253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21901009e0 0x7f2190104b40 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.546+0000 7f2196fa1640 1 --2- 172.21.15.118:0/1208257253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2190100030 0x7f2190100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.546+0000 7f2196fa1640 1 -- 172.21.15.118:0/1208257253 >> 172.21.15.118:0/1208257253 conn(0x7f21900fbad0 msgr2=0x7f21900fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.546+0000 7f2196fa1640 1 -- 172.21.15.118:0/1208257253 shutdown_connections 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.547+0000 7f2196fa1640 1 -- 172.21.15.118:0/1208257253 wait complete. 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.547+0000 7f2196fa1640 1 Processor -- start 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.547+0000 7f2196fa1640 1 -- start start 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.547+0000 7f2196fa1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2190100030 0x7f219019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.547+0000 7f2196fa1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21901009e0 0x7f219019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.547+0000 7f2196fa1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f219010dc40 con 0x7f2190100030 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.547+0000 7f2196fa1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f219010dac0 con 0x7f21901009e0 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.547+0000 7f2195f9f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2190100030 0x7f219019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.547+0000 7f2195f9f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2190100030 0x7f219019c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57904/0 (socket says 172.21.15.118:57904) 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2195f9f640 1 -- 172.21.15.118:0/1317418836 learned_addr learned my addr 172.21.15.118:0/1317418836 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:25.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f219579e640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21901009e0 0x7f219019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2195f9f640 1 -- 172.21.15.118:0/1317418836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21901009e0 msgr2=0x7f219019cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2195f9f640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21901009e0 0x7f219019cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2195f9f640 1 -- 172.21.15.118:0/1317418836 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21901966b0 con 0x7f2190100030 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2195f9f640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2190100030 0x7f219019c5e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f218c009860 tx=0x7f218c009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2186ffd640 1 -- 172.21.15.118:0/1317418836 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f218c005020 con 0x7f2190100030 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2186ffd640 1 -- 172.21.15.118:0/1317418836 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f218c0047a0 con 0x7f2190100030 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2186ffd640 1 -- 172.21.15.118:0/1317418836 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f218c007b00 con 0x7f2190100030 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2190196940 con 0x7f2190100030 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.548+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2190196ea0 con 0x7f2190100030 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.549+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2190101510 con 0x7f2190100030 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.550+0000 7f2186ffd640 1 -- 172.21.15.118:0/1317418836 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f218c004950 con 0x7f2190100030 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.550+0000 7f2186ffd640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f217c07af80 0x7f217c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.550+0000 7f2186ffd640 1 -- 172.21.15.118:0/1317418836 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f218c013030 con 0x7f2190100030 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.550+0000 7f219579e640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f217c07af80 0x7f217c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:25.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.551+0000 7f219579e640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f217c07af80 0x7f217c07d440 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2180031460 tx=0x7f2180009560 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:25.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.555+0000 7f2186ffd640 1 -- 172.21.15.118:0/1317418836 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f218c06ae50 con 0x7f2190100030 2024-09-21T12:20:25.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.775+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7f2190197be0 con 0x7f2190100030 2024-09-21T12:20:25.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.775+0000 7f2186ffd640 1 -- 172.21.15.118:0/1317418836 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v34) ==== 107+0+5332 (secure 0 0 0) 0x7f218c06fd00 con 0x7f2190100030 2024-09-21T12:20:25.777 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:25.778 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":30,"btime":"2024-09-21T12:18:26:349626+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44737,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2325869358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2325869358},{"type":"v1","addr":"172.21.15.149:6827","nonce":2325869358}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T12:18:25.906259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":0,"incarnation":28,"state":"up:resolve","state_seq":464,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi118.macjke","rank":1,"incarnation":28,"state":"up:resolve","state_seq":457,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:25.778 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 30 2024-09-21T12:20:25.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f217c07af80 msgr2=0x7f217c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:25.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f217c07af80 0x7f217c07d440 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2180031460 tx=0x7f2180009560 comp rx=0 tx=0).stop 2024-09-21T12:20:25.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2190100030 msgr2=0x7f219019c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:25.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2190100030 0x7f219019c5e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f218c009860 tx=0x7f218c009d20 comp rx=0 tx=0).stop 2024-09-21T12:20:25.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 shutdown_connections 2024-09-21T12:20:25.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21901009e0 0x7f219019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:25.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f217c07af80 0x7f217c07d440 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:25.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 --2- 172.21.15.118:0/1317418836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2190100030 0x7f219019c5e0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:25.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 >> 172.21.15.118:0/1317418836 conn(0x7f21900fbad0 msgr2=0x7f21900fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:25.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 shutdown_connections 2024-09-21T12:20:25.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:25.778+0000 7f2196fa1640 1 -- 172.21.15.118:0/1317418836 wait complete. 2024-09-21T12:20:25.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:25 smithi149 ceph-mon[79770]: pgmap v1251: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:26.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:25 smithi118 ceph-mon[111738]: pgmap v1251: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:26.433 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 31 2024-09-21T12:20:26.701 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:26.923 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:26 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1317418836' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T12:20:26.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:26 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1317418836' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T12:20:27.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.215+0000 7f8e546d3640 1 -- 172.21.15.118:0/2818383517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1007e0 msgr2=0x7f8e4c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:27.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.215+0000 7f8e546d3640 1 --2- 172.21.15.118:0/2818383517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1007e0 0x7f8e4c100c40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009880 tx=0x7f8e3c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:27.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.215+0000 7f8e546d3640 1 -- 172.21.15.118:0/2818383517 shutdown_connections 2024-09-21T12:20:27.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.215+0000 7f8e546d3640 1 --2- 172.21.15.118:0/2818383517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1007e0 0x7f8e4c100c40 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.215+0000 7f8e546d3640 1 --2- 172.21.15.118:0/2818383517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4c1067e0 0x7f8e4c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.215+0000 7f8e546d3640 1 -- 172.21.15.118:0/2818383517 >> 172.21.15.118:0/2818383517 conn(0x7f8e4c0fc4c0 msgr2=0x7f8e4c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.215+0000 7f8e546d3640 1 -- 172.21.15.118:0/2818383517 shutdown_connections 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.215+0000 7f8e546d3640 1 -- 172.21.15.118:0/2818383517 wait complete. 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.216+0000 7f8e546d3640 1 Processor -- start 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.216+0000 7f8e546d3640 1 -- start start 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.216+0000 7f8e546d3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4c1007e0 0x7f8e4c1955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.216+0000 7f8e546d3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1067e0 0x7f8e4c195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.216+0000 7f8e546d3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c10dc90 con 0x7f8e4c1067e0 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.216+0000 7f8e546d3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c10db10 con 0x7f8e4c1007e0 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.216+0000 7f8e51c6e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1067e0 0x7f8e4c195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.216+0000 7f8e51c6e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1067e0 0x7f8e4c195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57912/0 (socket says 172.21.15.118:57912) 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e51c6e640 1 -- 172.21.15.118:0/1832837352 learned_addr learned my addr 172.21.15.118:0/1832837352 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e5246f640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4c1007e0 0x7f8e4c1955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e51c6e640 1 -- 172.21.15.118:0/1832837352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4c1007e0 msgr2=0x7f8e4c1955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e51c6e640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4c1007e0 0x7f8e4c1955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e51c6e640 1 -- 172.21.15.118:0/1832837352 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c1961d0 con 0x7f8e4c1067e0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e51c6e640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1067e0 0x7f8e4c195b00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c031460 tx=0x7f8e3c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e437fe640 1 -- 172.21.15.118:0/1832837352 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e3c03f070 con 0x7f8e4c1067e0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4c1a7e00 con 0x7f8e4c1067e0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e437fe640 1 -- 172.21.15.118:0/1832837352 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e3c0035f0 con 0x7f8e4c1067e0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e437fe640 1 -- 172.21.15.118:0/1832837352 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e3c035030 con 0x7f8e4c1067e0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.217+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4c1a81f0 con 0x7f8e4c1067e0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.218+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4c101f20 con 0x7f8e4c1067e0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.219+0000 7f8e437fe640 1 -- 172.21.15.118:0/1832837352 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8e3c042070 con 0x7f8e4c1067e0 2024-09-21T12:20:27.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.219+0000 7f8e437fe640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e3807af30 0x7f8e3807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:27.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.219+0000 7f8e437fe640 1 -- 172.21.15.118:0/1832837352 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8e3c0bead0 con 0x7f8e4c1067e0 2024-09-21T12:20:27.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.219+0000 7f8e5246f640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e3807af30 0x7f8e3807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:27.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.220+0000 7f8e5246f640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e3807af30 0x7f8e3807d3f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005fd0 tx=0x7f8e4800b590 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:27.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.224+0000 7f8e437fe640 1 -- 172.21.15.118:0/1832837352 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e3c08a020 con 0x7f8e4c1067e0 2024-09-21T12:20:27.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.442+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f8e4c1a8470 con 0x7f8e4c1067e0 2024-09-21T12:20:27.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.442+0000 7f8e437fe640 1 -- 172.21.15.118:0/1832837352 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v34) ==== 107+0+5336 (secure 0 0 0) 0x7f8e3c08c020 con 0x7f8e4c1067e0 2024-09-21T12:20:27.444 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:27.445 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"btime":"2024-09-21T12:18:27:354501+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44737,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2325869358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2325869358},{"type":"v1","addr":"172.21.15.149:6827","nonce":2325869358}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T12:18:26.401883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":465,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi118.macjke","rank":1,"incarnation":28,"state":"up:reconnect","state_seq":459,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:27.445 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 31 2024-09-21T12:20:27.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e3807af30 msgr2=0x7f8e3807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:27.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e3807af30 0x7f8e3807d3f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005fd0 tx=0x7f8e4800b590 comp rx=0 tx=0).stop 2024-09-21T12:20:27.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1067e0 msgr2=0x7f8e4c195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:27.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1067e0 0x7f8e4c195b00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c031460 tx=0x7f8e3c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:20:27.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 shutdown_connections 2024-09-21T12:20:27.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f8e3807af30 0x7f8e3807d3f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:27.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4c1067e0 0x7f8e4c195b00 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:27.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 --2- 172.21.15.118:0/1832837352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4c1007e0 0x7f8e4c1955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:27.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 >> 172.21.15.118:0/1832837352 conn(0x7f8e4c0fc4c0 msgr2=0x7f8e4c069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:27.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.444+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 shutdown_connections 2024-09-21T12:20:27.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:27.445+0000 7f8e546d3640 1 -- 172.21.15.118:0/1832837352 wait complete. 2024-09-21T12:20:27.949 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:27 smithi149 ceph-mon[79770]: pgmap v1252: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:27.950 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:27 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/1832837352' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T12:20:28.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:27 smithi118 ceph-mon[111738]: pgmap v1252: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:28.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:27 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/1832837352' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T12:20:28.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 32 2024-09-21T12:20:28.365 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:28.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.830+0000 7f956b024640 1 -- 172.21.15.118:0/953744396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 msgr2=0x7f956410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:28.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.830+0000 7f956b024640 1 --2- 172.21.15.118:0/953744396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 0x7f956410b8f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9558009880 tx=0x7f955802a530 comp rx=0 tx=0).stop 2024-09-21T12:20:28.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.830+0000 7f956b024640 1 -- 172.21.15.118:0/953744396 shutdown_connections 2024-09-21T12:20:28.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.830+0000 7f956b024640 1 --2- 172.21.15.118:0/953744396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 0x7f956410b8f0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:28.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.830+0000 7f956b024640 1 --2- 172.21.15.118:0/953744396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9564102ae0 0x7f9564102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:28.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.830+0000 7f956b024640 1 -- 172.21.15.118:0/953744396 >> 172.21.15.118:0/953744396 conn(0x7f95640fc520 msgr2=0x7f95640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:28.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.830+0000 7f956b024640 1 -- 172.21.15.118:0/953744396 shutdown_connections 2024-09-21T12:20:28.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.830+0000 7f956b024640 1 -- 172.21.15.118:0/953744396 wait complete. 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f956b024640 1 Processor -- start 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f956b024640 1 -- start start 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f956b024640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9564102ae0 0x7f956419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f956b024640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 0x7f956419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f956b024640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f956410edf0 con 0x7f9564103400 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f956b024640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f956410ec70 con 0x7f9564102ae0 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f9563fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 0x7f956419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f9563fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 0x7f956419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57922/0 (socket says 172.21.15.118:57922) 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f9563fff640 1 -- 172.21.15.118:0/2260898391 learned_addr learned my addr 172.21.15.118:0/2260898391 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f9568dc0640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9564102ae0 0x7f956419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f9563fff640 1 -- 172.21.15.118:0/2260898391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9564102ae0 msgr2=0x7f956419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:28.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f9563fff640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9564102ae0 0x7f956419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f9563fff640 1 -- 172.21.15.118:0/2260898391 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9564197800 con 0x7f9564103400 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f9568dc0640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9564102ae0 0x7f956419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.831+0000 7f9563fff640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 0x7f956419dbc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f9558031460 tx=0x7f95580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.832+0000 7f9561ffb640 1 -- 172.21.15.118:0/2260898391 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f955803f070 con 0x7f9564103400 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.832+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9564197a90 con 0x7f9564103400 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.832+0000 7f9561ffb640 1 -- 172.21.15.118:0/2260898391 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9558004ac0 con 0x7f9564103400 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.832+0000 7f9561ffb640 1 -- 172.21.15.118:0/2260898391 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9558035030 con 0x7f9564103400 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.832+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9564197fc0 con 0x7f9564103400 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.833+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f956406abe0 con 0x7f9564103400 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.834+0000 7f9561ffb640 1 -- 172.21.15.118:0/2260898391 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9558042070 con 0x7f9564103400 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.834+0000 7f9561ffb640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f954c07af30 0x7f954c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.834+0000 7f9561ffb640 1 -- 172.21.15.118:0/2260898391 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f95580beb70 con 0x7f9564103400 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.834+0000 7f9568dc0640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f954c07af30 0x7f954c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.835+0000 7f9568dc0640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f954c07af30 0x7f954c07d3f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f955400abe0 tx=0x7f955400a5c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:28.838+0000 7f9561ffb640 1 -- 172.21.15.118:0/2260898391 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f955808a060 con 0x7f9564103400 2024-09-21T12:20:29.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.052+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7f9564105f80 con 0x7f9564103400 2024-09-21T12:20:29.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.053+0000 7f9561ffb640 1 -- 172.21.15.118:0/2260898391 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v34) ==== 107+0+5330 (secure 0 0 0) 0x7f955808ef10 con 0x7f9564103400 2024-09-21T12:20:29.055 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:29.055 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":32,"btime":"2024-09-21T12:18:28:358962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44737,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2325869358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2325869358},{"type":"v1","addr":"172.21.15.149:6827","nonce":2325869358}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T12:18:27.361630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":466,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi118.macjke","rank":1,"incarnation":28,"state":"up:rejoin","state_seq":460,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:20:29.055 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 32 2024-09-21T12:20:29.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f954c07af30 msgr2=0x7f954c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:29.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f954c07af30 0x7f954c07d3f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f955400abe0 tx=0x7f955400a5c0 comp rx=0 tx=0).stop 2024-09-21T12:20:29.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 msgr2=0x7f956419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:29.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 0x7f956419dbc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f9558031460 tx=0x7f95580046c0 comp rx=0 tx=0).stop 2024-09-21T12:20:29.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 shutdown_connections 2024-09-21T12:20:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f954c07af30 0x7f954c07d3f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9564103400 0x7f956419dbc0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 --2- 172.21.15.118:0/2260898391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9564102ae0 0x7f956419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 >> 172.21.15.118:0/2260898391 conn(0x7f95640fc520 msgr2=0x7f9564108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 shutdown_connections 2024-09-21T12:20:29.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:29.055+0000 7f956b024640 1 -- 172.21.15.118:0/2260898391 wait complete. 2024-09-21T12:20:29.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 33 2024-09-21T12:20:29.940 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:30.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:29 smithi149 ceph-mon[79770]: pgmap v1253: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:30.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:29 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2260898391' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T12:20:30.205 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:29 smithi118 ceph-mon[111738]: pgmap v1253: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:30.205 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:29 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2260898391' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T12:20:30.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.395+0000 7f03c8364640 1 -- 172.21.15.118:0/507978734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 msgr2=0x7f03c0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:30.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.395+0000 7f03c8364640 1 --2- 172.21.15.118:0/507978734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 0x7f03c0101d90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009880 tx=0x7f03b002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:30.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.395+0000 7f03c8364640 1 -- 172.21.15.118:0/507978734 shutdown_connections 2024-09-21T12:20:30.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.395+0000 7f03c8364640 1 --2- 172.21.15.118:0/507978734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 0x7f03c0101d90 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:30.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.395+0000 7f03c8364640 1 --2- 172.21.15.118:0/507978734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c0107930 0x7f03c0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.395+0000 7f03c8364640 1 -- 172.21.15.118:0/507978734 >> 172.21.15.118:0/507978734 conn(0x7f03c00fd630 msgr2=0x7f03c00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.395+0000 7f03c8364640 1 -- 172.21.15.118:0/507978734 shutdown_connections 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.395+0000 7f03c8364640 1 -- 172.21.15.118:0/507978734 wait complete. 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c8364640 1 Processor -- start 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c8364640 1 -- start start 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c8364640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 0x7f03c019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c8364640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c0107930 0x7f03c019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c8364640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03c010ee60 con 0x7f03c0101930 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c8364640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03c010ece0 con 0x7f03c0107930 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c6100640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 0x7f03c019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c6100640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 0x7f03c019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57948/0 (socket says 172.21.15.118:57948) 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c6100640 1 -- 172.21.15.118:0/942021939 learned_addr learned my addr 172.21.15.118:0/942021939 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c58ff640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c0107930 0x7f03c019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c6100640 1 -- 172.21.15.118:0/942021939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c0107930 msgr2=0x7f03c019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c6100640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c0107930 0x7f03c019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c6100640 1 -- 172.21.15.118:0/942021939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c0197870 con 0x7f03c0101930 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c58ff640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c0107930 0x7f03c019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.396+0000 7f03c6100640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 0x7f03c019d6b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00b420 tx=0x7f03bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.397+0000 7f03b77fe640 1 -- 172.21.15.118:0/942021939 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03bc011630 con 0x7f03c0101930 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.397+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c0197b60 con 0x7f03c0101930 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.397+0000 7f03b77fe640 1 -- 172.21.15.118:0/942021939 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03bc016070 con 0x7f03c0101930 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.397+0000 7f03b77fe640 1 -- 172.21.15.118:0/942021939 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03bc010d40 con 0x7f03c0101930 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.397+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01980f0 con 0x7f03c0101930 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.398+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c0103070 con 0x7f03c0101930 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.398+0000 7f03b77fe640 1 -- 172.21.15.118:0/942021939 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f03bc01b460 con 0x7f03c0101930 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.399+0000 7f03b77fe640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03ac07af30 0x7f03ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.399+0000 7f03c58ff640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03ac07af30 0x7f03ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.399+0000 7f03b77fe640 1 -- 172.21.15.118:0/942021939 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f03bc09d7f0 con 0x7f03c0101930 2024-09-21T12:20:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.399+0000 7f03c58ff640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03ac07af30 0x7f03ac07d3f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f03b0031460 tx=0x7f03b00095f0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.403+0000 7f03b77fe640 1 -- 172.21.15.118:0/942021939 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03bc068d40 con 0x7f03c0101930 2024-09-21T12:20:30.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.616+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7f03c0198da0 con 0x7f03c0101930 2024-09-21T12:20:30.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.616+0000 7f03b77fe640 1 -- 172.21.15.118:0/942021939 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v34) ==== 107+0+5345 (secure 0 0 0) 0x7f03bc06dbf0 con 0x7f03c0101930 2024-09-21T12:20:30.619 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T12:20:30.619 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":33,"btime":"2024-09-21T12:18:29:365933+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44281,"name":"cephfs.smithi149.zgoqsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/37700515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":37700515},{"type":"v1","addr":"172.21.15.149:6825","nonce":37700515}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44737,"name":"cephfs.smithi149.qzbfns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2325869358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2325869358},{"type":"v1","addr":"172.21.15.149:6827","nonce":2325869358}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T11:36:23.785634+0000","modified":"2024-09-21T12:18:29.365928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi118.ciljqr","rank":0,"incarnation":28,"state":"up:active","state_seq":467,"addr":"172.21.15.118:6829/3446995825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":3446995825},{"type":"v1","addr":"172.21.15.118:6829","nonce":3446995825}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi118.macjke","rank":1,"incarnation":28,"state":"up:active","state_seq":461,"addr":"172.21.15.118:6827/851771831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":851771831},{"type":"v1","addr":"172.21.15.118:6827","nonce":851771831}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34320,"qdb_cluster":[34320,34352]},"id":1}]} 2024-09-21T12:20:30.619 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 33 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03ac07af30 msgr2=0x7f03ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03ac07af30 0x7f03ac07d3f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f03b0031460 tx=0x7f03b00095f0 comp rx=0 tx=0).stop 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 msgr2=0x7f03c019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 0x7f03c019d6b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00b420 tx=0x7f03bc00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 shutdown_connections 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c0107930 0x7f03c019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f03ac07af30 0x7f03ac07d3f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 --2- 172.21.15.118:0/942021939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0101930 0x7f03c019d6b0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 >> 172.21.15.118:0/942021939 conn(0x7f03c00fd630 msgr2=0x7f03c00fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:30.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 shutdown_connections 2024-09-21T12:20:30.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:30.619+0000 7f03c8364640 1 -- 172.21.15.118:0/942021939 wait complete. 2024-09-21T12:20:31.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:30 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/942021939' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T12:20:31.362 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T12:20:31.372 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T12:20:31.373 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T12:20:31.373 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T12:20:31.391 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T12:20:31.391 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T12:20:31.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T12:20:31.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:30 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/942021939' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T12:20:31.735 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:32.156 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:31 smithi118 ceph-mon[111738]: pgmap v1254: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:32.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.154+0000 7f21bf441640 1 -- 172.21.15.118:0/3370395130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8100810 msgr2=0x7f21b8100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:32.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.154+0000 7f21bf441640 1 --2- 172.21.15.118:0/3370395130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8100810 0x7f21b8100c70 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009880 tx=0x7f21b402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:32.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.154+0000 7f21bf441640 1 -- 172.21.15.118:0/3370395130 shutdown_connections 2024-09-21T12:20:32.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.154+0000 7f21bf441640 1 --2- 172.21.15.118:0/3370395130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8100810 0x7f21b8100c70 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:32.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.154+0000 7f21bf441640 1 --2- 172.21.15.118:0/3370395130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b8106810 0x7f21b8106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:32.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.154+0000 7f21bf441640 1 -- 172.21.15.118:0/3370395130 >> 172.21.15.118:0/3370395130 conn(0x7f21b80fc510 msgr2=0x7f21b80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:32.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.154+0000 7f21bf441640 1 -- 172.21.15.118:0/3370395130 shutdown_connections 2024-09-21T12:20:32.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.154+0000 7f21bf441640 1 -- 172.21.15.118:0/3370395130 wait complete. 2024-09-21T12:20:32.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.155+0000 7f21bf441640 1 Processor -- start 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.155+0000 7f21bf441640 1 -- start start 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.155+0000 7f21bf441640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b8100810 0x7f21b80fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.155+0000 7f21bf441640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8106810 0x7f21b80fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.155+0000 7f21bf441640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21b810dcc0 con 0x7f21b8106810 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.155+0000 7f21bf441640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f21b810db40 con 0x7f21b8100810 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.155+0000 7f21bc9dc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8106810 0x7f21b80fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.155+0000 7f21bc9dc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8106810 0x7f21b80fd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57972/0 (socket says 172.21.15.118:57972) 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.155+0000 7f21bc9dc640 1 -- 172.21.15.118:0/3852888606 learned_addr learned my addr 172.21.15.118:0/3852888606 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21bd1dd640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b8100810 0x7f21b80fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:32.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21bc9dc640 1 -- 172.21.15.118:0/3852888606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b8100810 msgr2=0x7f21b80fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:32.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21bc9dc640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b8100810 0x7f21b80fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:32.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21bc9dc640 1 -- 172.21.15.118:0/3852888606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b80fd670 con 0x7f21b8106810 2024-09-21T12:20:32.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21bc9dc640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8106810 0x7f21b80fd130 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f21b4031460 tx=0x7f21b40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:32.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21ae7fc640 1 -- 172.21.15.118:0/3852888606 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21b403f070 con 0x7f21b8106810 2024-09-21T12:20:32.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21ae7fc640 1 -- 172.21.15.118:0/3852888606 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21b4004cf0 con 0x7f21b8106810 2024-09-21T12:20:32.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b80fd900 con 0x7f21b8106810 2024-09-21T12:20:32.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21ae7fc640 1 -- 172.21.15.118:0/3852888606 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21b4035030 con 0x7f21b8106810 2024-09-21T12:20:32.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.156+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b81a3db0 con 0x7f21b8106810 2024-09-21T12:20:32.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.157+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b8101f50 con 0x7f21b8106810 2024-09-21T12:20:32.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.158+0000 7f21ae7fc640 1 -- 172.21.15.118:0/3852888606 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f21b4042070 con 0x7f21b8106810 2024-09-21T12:20:32.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.159+0000 7f21ae7fc640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21a407af30 0x7f21a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:32.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.159+0000 7f21ae7fc640 1 -- 172.21.15.118:0/3852888606 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f21b40bec10 con 0x7f21b8106810 2024-09-21T12:20:32.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.159+0000 7f21bd1dd640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21a407af30 0x7f21a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:32.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.160+0000 7f21bd1dd640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21a407af30 0x7f21a407d3f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f21a80058c0 tx=0x7f21a800a4c0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:32.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.163+0000 7f21ae7fc640 1 -- 172.21.15.118:0/3852888606 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21b408a0c0 con 0x7f21b8106810 2024-09-21T12:20:32.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.351+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f21b8100c70 con 0x7f21b8106810 2024-09-21T12:20:32.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.351+0000 7f21ae7fc640 1 -- 172.21.15.118:0/3852888606 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) ==== 81+0+2098 (secure 0 0 0) 0x7f21b408ef70 con 0x7f21b8106810 2024-09-21T12:20:32.353 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6827/395212393 2024-09-22T11:47:28.938738+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6826/395212393 2024-09-22T11:47:28.938738+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6828/98130516 2024-09-22T11:47:28.938750+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6800/1247137526 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6829/98130516 2024-09-22T11:47:28.938750+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:6824/888554295 2024-09-22T11:36:37.147798+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/569646691 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:6825/888554295 2024-09-22T11:36:37.147798+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6801/1247137526 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/3869671741 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/2783214462 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6800/2509956308 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6801/2509956308 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/2186226005 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6801/1466313795 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/2545032153 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/591223858 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/870566679 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/1431244700 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/2459604279 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/21977860 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6801/821568869 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/2193247089 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/2091506307 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/1228637555 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/1896148961 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:32.355 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/1658281961 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:32.356 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/1054797697 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:32.356 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/2247151685 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:32.356 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:6829/3420416133 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:32.356 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:6828/3420416133 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:32.356 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6800/821568869 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:32.356 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6800/1466313795 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:32.356 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/3338260704 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:32.356 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/3259731444 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:32.357 INFO:teuthology.orchestra.run.smithi118.stderr:listed 35 entries 2024-09-21T12:20:32.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21a407af30 msgr2=0x7f21a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:32.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21a407af30 0x7f21a407d3f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f21a80058c0 tx=0x7f21a800a4c0 comp rx=0 tx=0).stop 2024-09-21T12:20:32.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8106810 msgr2=0x7f21b80fd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:32.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8106810 0x7f21b80fd130 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f21b4031460 tx=0x7f21b40048f0 comp rx=0 tx=0).stop 2024-09-21T12:20:32.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 shutdown_connections 2024-09-21T12:20:32.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7f21a407af30 0x7f21a407d3f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:32.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b8106810 0x7f21b80fd130 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:32.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 --2- 172.21.15.118:0/3852888606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b8100810 0x7f21b80fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:32.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 >> 172.21.15.118:0/3852888606 conn(0x7f21b80fc510 msgr2=0x7f21b806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:32.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 shutdown_connections 2024-09-21T12:20:32.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:32.353+0000 7f21bf441640 1 -- 172.21.15.118:0/3852888606 wait complete. 2024-09-21T12:20:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:31 smithi149 ceph-mon[79770]: pgmap v1254: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:33.057 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T12:20:33.057 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T12:20:33.074 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ae037950-780c-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T12:20:33.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:32 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/3852888606' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T12:20:33.360 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/mon.smithi118/config 2024-09-21T12:20:33.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:32 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/3852888606' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T12:20:33.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.811+0000 7fea302ce640 1 -- 172.21.15.118:0/2171274749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28107930 msgr2=0x7fea28107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.811+0000 7fea302ce640 1 --2- 172.21.15.118:0/2171274749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28107930 0x7fea28107d10 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fea24009880 tx=0x7fea2402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.811+0000 7fea302ce640 1 -- 172.21.15.118:0/2171274749 shutdown_connections 2024-09-21T12:20:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.811+0000 7fea302ce640 1 --2- 172.21.15.118:0/2171274749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea28101930 0x7fea28101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.811+0000 7fea302ce640 1 --2- 172.21.15.118:0/2171274749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28107930 0x7fea28107d10 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.811+0000 7fea302ce640 1 -- 172.21.15.118:0/2171274749 >> 172.21.15.118:0/2171274749 conn(0x7fea280fd630 msgr2=0x7fea280ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.811+0000 7fea302ce640 1 -- 172.21.15.118:0/2171274749 shutdown_connections 2024-09-21T12:20:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.811+0000 7fea302ce640 1 -- 172.21.15.118:0/2171274749 wait complete. 2024-09-21T12:20:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea302ce640 1 Processor -- start 2024-09-21T12:20:33.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea302ce640 1 -- start start 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea302ce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28101930 0x7fea2819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea302ce640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea28107930 0x7fea2819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea302ce640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fea2810ede0 con 0x7fea28101930 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea302ce640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea2810ec60 con 0x7fea28107930 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea2e06a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28101930 0x7fea2819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea2e06a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28101930 0x7fea2819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57978/0 (socket says 172.21.15.118:57978) 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea2e06a640 1 -- 172.21.15.118:0/2153598923 learned_addr learned my addr 172.21.15.118:0/2153598923 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea2d869640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea28107930 0x7fea2819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea2e06a640 1 -- 172.21.15.118:0/2153598923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea28107930 msgr2=0x7fea2819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea2e06a640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea28107930 0x7fea2819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.812+0000 7fea2e06a640 1 -- 172.21.15.118:0/2153598923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea28197810 con 0x7fea28101930 2024-09-21T12:20:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.813+0000 7fea2e06a640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28101930 0x7fea2819d690 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fea24031460 tx=0x7fea240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.813+0000 7fea1f7fe640 1 -- 172.21.15.118:0/2153598923 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea2403f070 con 0x7fea28101930 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.813+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea28197aa0 con 0x7fea28101930 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.813+0000 7fea1f7fe640 1 -- 172.21.15.118:0/2153598923 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea24004cf0 con 0x7fea28101930 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.813+0000 7fea1f7fe640 1 -- 172.21.15.118:0/2153598923 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea24035030 con 0x7fea28101930 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.813+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea28197fd0 con 0x7fea28101930 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.814+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea28103070 con 0x7fea28101930 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.814+0000 7fea1f7fe640 1 -- 172.21.15.118:0/2153598923 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fea24042070 con 0x7fea28101930 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.815+0000 7fea1f7fe640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea1407af30 0x7fea1407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.815+0000 7fea1f7fe640 1 -- 172.21.15.118:0/2153598923 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fea240beb70 con 0x7fea28101930 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.815+0000 7fea2d869640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea1407af30 0x7fea1407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:33.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.815+0000 7fea2d869640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea1407af30 0x7fea1407d3f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fea18005e10 tx=0x7fea18005da0 comp rx=0 tx=0).ready entity=mgr.14762 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:33.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:33.819+0000 7fea1f7fe640 1 -- 172.21.15.118:0/2153598923 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea2408a0c0 con 0x7fea28101930 2024-09-21T12:20:34.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.014+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea28198d70 con 0x7fea28101930 2024-09-21T12:20:34.016 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:33 smithi118 ceph-mon[111738]: pgmap v1255: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:34.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.014+0000 7fea1f7fe640 1 -- 172.21.15.118:0/2153598923 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) ==== 81+0+2098 (secure 0 0 0) 0x7fea28198d70 con 0x7fea28101930 2024-09-21T12:20:34.017 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6827/395212393 2024-09-22T11:47:28.938738+0000 2024-09-21T12:20:34.017 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6826/395212393 2024-09-22T11:47:28.938738+0000 2024-09-21T12:20:34.017 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6828/98130516 2024-09-22T11:47:28.938750+0000 2024-09-21T12:20:34.017 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6800/1247137526 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:34.017 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6829/98130516 2024-09-22T11:47:28.938750+0000 2024-09-21T12:20:34.017 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:6824/888554295 2024-09-22T11:36:37.147798+0000 2024-09-21T12:20:34.017 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/569646691 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:34.017 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:6825/888554295 2024-09-22T11:36:37.147798+0000 2024-09-21T12:20:34.017 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6801/1247137526 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/3869671741 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/2783214462 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6800/2509956308 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6801/2509956308 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/2186226005 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6801/1466313795 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/2545032153 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/591223858 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/870566679 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/1431244700 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:34.018 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/2459604279 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/21977860 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6801/821568869 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/2193247089 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/2091506307 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/1228637555 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/1896148961 2024-09-22T11:38:34.763027+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/1658281961 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/1054797697 2024-09-22T11:30:39.263894+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/2247151685 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:6829/3420416133 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:6828/3420416133 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6800/821568869 2024-09-22T11:31:38.466642+0000 2024-09-21T12:20:34.019 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:6800/1466313795 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:34.020 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.149:0/3338260704 2024-09-22T11:40:04.068445+0000 2024-09-21T12:20:34.020 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118:0/3259731444 2024-09-22T11:30:09.037549+0000 2024-09-21T12:20:34.020 INFO:teuthology.orchestra.run.smithi118.stderr:listed 35 entries 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea1407af30 msgr2=0x7fea1407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea1407af30 0x7fea1407d3f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fea18005e10 tx=0x7fea18005da0 comp rx=0 tx=0).stop 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28101930 msgr2=0x7fea2819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28101930 0x7fea2819d690 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fea24031460 tx=0x7fea240048f0 comp rx=0 tx=0).stop 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 shutdown_connections 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea28107930 0x7fea2819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:6800/2298005256,v1:172.21.15.118:6801/2298005256] conn(0x7fea1407af30 0x7fea1407d3f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 --2- 172.21.15.118:0/2153598923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea28101930 0x7fea2819d690 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 >> 172.21.15.118:0/2153598923 conn(0x7fea280fd630 msgr2=0x7fea280fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 shutdown_connections 2024-09-21T12:20:34.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T12:20:34.017+0000 7fea302ce640 1 -- 172.21.15.118:0/2153598923 wait complete. 2024-09-21T12:20:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:33 smithi149 ceph-mon[79770]: pgmap v1255: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:34.683 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2024-09-21T12:20:34.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:20:34.683 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-21T12:20:34.711 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T12:20:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:34 smithi118 ceph-mon[111738]: from='client.? 172.21.15.118:0/2153598923' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T12:20:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:34 smithi149 ceph-mon[79770]: from='client.? 172.21.15.118:0/2153598923' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T12:20:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:35 smithi118 ceph-mon[111738]: pgmap v1256: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:20:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:35 smithi149 ceph-mon[79770]: pgmap v1256: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:36.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:20:38.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:37 smithi118 ceph-mon[111738]: pgmap v1257: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:37 smithi149 ceph-mon[79770]: pgmap v1257: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:39 smithi118 ceph-mon[111738]: pgmap v1258: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:39 smithi149 ceph-mon[79770]: pgmap v1258: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:41 smithi118 ceph-mon[111738]: pgmap v1259: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:41 smithi149 ceph-mon[79770]: pgmap v1259: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:42 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:20:43.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:42 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:20:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:43 smithi118 ceph-mon[111738]: pgmap v1260: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:20:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:20:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:20:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:43 smithi149 ceph-mon[79770]: pgmap v1260: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:20:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:20:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:20:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:45 smithi118 ceph-mon[111738]: pgmap v1261: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:46.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:45 smithi149 ceph-mon[79770]: pgmap v1261: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:47 smithi118 ceph-mon[111738]: pgmap v1262: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:47 smithi149 ceph-mon[79770]: pgmap v1262: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:49 smithi118 ceph-mon[111738]: pgmap v1263: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:49 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:20:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:49 smithi149 ceph-mon[79770]: pgmap v1263: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:49 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:20:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:51 smithi118 ceph-mon[111738]: pgmap v1264: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:52.361 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:51 smithi149 ceph-mon[79770]: pgmap v1264: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:53 smithi118 ceph-mon[111738]: pgmap v1265: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:54.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:53 smithi149 ceph-mon[79770]: pgmap v1265: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:56.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:55 smithi149 ceph-mon[79770]: pgmap v1266: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:55 smithi118 ceph-mon[111738]: pgmap v1266: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:20:58 smithi118 ceph-mon[111738]: pgmap v1267: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:20:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:20:58 smithi149 ceph-mon[79770]: pgmap v1267: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:00 smithi118 ceph-mon[111738]: pgmap v1268: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:00 smithi149 ceph-mon[79770]: pgmap v1268: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:02 smithi118 ceph-mon[111738]: pgmap v1269: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:02 smithi149 ceph-mon[79770]: pgmap v1269: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:04 smithi118 ceph-mon[111738]: pgmap v1270: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:04 smithi149 ceph-mon[79770]: pgmap v1270: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:21:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:21:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:06 smithi118 ceph-mon[111738]: pgmap v1271: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:06 smithi149 ceph-mon[79770]: pgmap v1271: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:08 smithi118 ceph-mon[111738]: pgmap v1272: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:08 smithi149 ceph-mon[79770]: pgmap v1272: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:10 smithi118 ceph-mon[111738]: pgmap v1273: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:10 smithi149 ceph-mon[79770]: pgmap v1273: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:12 smithi118 ceph-mon[111738]: pgmap v1274: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:12 smithi149 ceph-mon[79770]: pgmap v1274: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:14 smithi118 ceph-mon[111738]: pgmap v1275: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:14 smithi149 ceph-mon[79770]: pgmap v1275: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:16.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:16 smithi118 ceph-mon[111738]: pgmap v1276: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:16 smithi149 ceph-mon[79770]: pgmap v1276: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:18 smithi118 ceph-mon[111738]: pgmap v1277: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:18 smithi149 ceph-mon[79770]: pgmap v1277: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:20 smithi118 ceph-mon[111738]: pgmap v1278: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:21:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:20 smithi149 ceph-mon[79770]: pgmap v1278: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:21:22.299 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:22 smithi118 ceph-mon[111738]: pgmap v1279: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:22.351 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:22 smithi149 ceph-mon[79770]: pgmap v1279: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:23.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:23 smithi118 ceph-mon[111738]: pgmap v1280: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:23.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:23 smithi149 ceph-mon[79770]: pgmap v1280: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:26.258 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:25 smithi149 ceph-mon[79770]: pgmap v1281: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:25 smithi118 ceph-mon[111738]: pgmap v1281: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:28.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:27 smithi118 ceph-mon[111738]: pgmap v1282: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:27 smithi149 ceph-mon[79770]: pgmap v1282: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:29 smithi118 ceph-mon[111738]: pgmap v1283: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:29 smithi149 ceph-mon[79770]: pgmap v1283: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:32.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:31 smithi118 ceph-mon[111738]: pgmap v1284: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:31 smithi149 ceph-mon[79770]: pgmap v1284: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:33.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:33 smithi118 ceph-mon[111738]: pgmap v1285: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:33.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:33 smithi149 ceph-mon[79770]: pgmap v1285: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:35 smithi118 ceph-mon[111738]: pgmap v1286: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:21:36.407 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:35 smithi149 ceph-mon[79770]: pgmap v1286: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:36.407 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:21:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:37 smithi118 ceph-mon[111738]: pgmap v1287: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:37 smithi149 ceph-mon[79770]: pgmap v1287: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:39 smithi118 ceph-mon[111738]: pgmap v1288: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:39 smithi149 ceph-mon[79770]: pgmap v1288: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:41 smithi118 ceph-mon[111738]: pgmap v1289: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:41 smithi149 ceph-mon[79770]: pgmap v1289: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:43.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:43 smithi118 ceph-mon[111738]: pgmap v1290: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:43.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:43 smithi149 ceph-mon[79770]: pgmap v1290: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:21:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:21:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:21:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:21:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:21:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:21:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:21:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:21:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:45 smithi118 ceph-mon[111738]: pgmap v1291: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:45.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:45 smithi149 ceph-mon[79770]: pgmap v1291: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:48.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:47 smithi118 ceph-mon[111738]: pgmap v1292: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:47 smithi149 ceph-mon[79770]: pgmap v1292: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:49 smithi118 ceph-mon[111738]: pgmap v1293: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:49 smithi149 ceph-mon[79770]: pgmap v1293: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:51.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:21:51.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:21:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:51 smithi118 ceph-mon[111738]: pgmap v1294: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:52.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:51 smithi149 ceph-mon[79770]: pgmap v1294: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:53 smithi118 ceph-mon[111738]: pgmap v1295: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:54.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:53 smithi149 ceph-mon[79770]: pgmap v1295: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:55 smithi118 ceph-mon[111738]: pgmap v1296: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:55 smithi149 ceph-mon[79770]: pgmap v1296: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:57 smithi118 ceph-mon[111738]: pgmap v1297: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:21:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:57 smithi149 ceph-mon[79770]: pgmap v1297: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:21:59 smithi118 ceph-mon[111738]: pgmap v1298: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:21:59 smithi149 ceph-mon[79770]: pgmap v1298: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:02.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:01 smithi149 ceph-mon[79770]: pgmap v1299: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:01 smithi118 ceph-mon[111738]: pgmap v1299: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:03 smithi118 ceph-mon[111738]: pgmap v1300: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:03 smithi149 ceph-mon[79770]: pgmap v1300: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:22:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:22:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:06 smithi118 ceph-mon[111738]: pgmap v1301: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:06 smithi149 ceph-mon[79770]: pgmap v1301: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:08 smithi118 ceph-mon[111738]: pgmap v1302: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:08 smithi149 ceph-mon[79770]: pgmap v1302: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:10 smithi118 ceph-mon[111738]: pgmap v1303: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:10 smithi149 ceph-mon[79770]: pgmap v1303: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:12.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:12 smithi149 ceph-mon[79770]: pgmap v1304: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:12 smithi118 ceph-mon[111738]: pgmap v1304: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:14 smithi118 ceph-mon[111738]: pgmap v1305: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:14 smithi149 ceph-mon[79770]: pgmap v1305: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:16.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:16 smithi118 ceph-mon[111738]: pgmap v1306: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:16 smithi149 ceph-mon[79770]: pgmap v1306: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:18 smithi118 ceph-mon[111738]: pgmap v1307: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:18 smithi149 ceph-mon[79770]: pgmap v1307: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:20 smithi118 ceph-mon[111738]: pgmap v1308: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:22:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:20 smithi149 ceph-mon[79770]: pgmap v1308: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:22:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:22 smithi118 ceph-mon[111738]: pgmap v1309: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:22 smithi149 ceph-mon[79770]: pgmap v1309: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:24 smithi118 ceph-mon[111738]: pgmap v1310: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:24 smithi149 ceph-mon[79770]: pgmap v1310: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:26 smithi118 ceph-mon[111738]: pgmap v1311: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:26 smithi149 ceph-mon[79770]: pgmap v1311: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:28.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:28 smithi118 ceph-mon[111738]: pgmap v1312: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:28 smithi149 ceph-mon[79770]: pgmap v1312: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:30 smithi118 ceph-mon[111738]: pgmap v1313: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:30 smithi149 ceph-mon[79770]: pgmap v1313: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:32.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:32 smithi118 ceph-mon[111738]: pgmap v1314: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:32 smithi149 ceph-mon[79770]: pgmap v1314: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:34 smithi118 ceph-mon[111738]: pgmap v1315: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:34 smithi149 ceph-mon[79770]: pgmap v1315: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:22:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:22:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:36 smithi118 ceph-mon[111738]: pgmap v1316: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:36 smithi149 ceph-mon[79770]: pgmap v1316: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:38 smithi118 ceph-mon[111738]: pgmap v1317: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:38 smithi149 ceph-mon[79770]: pgmap v1317: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:39.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:39 smithi118 ceph-mon[111738]: pgmap v1318: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:39.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:39 smithi149 ceph-mon[79770]: pgmap v1318: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:41 smithi118 ceph-mon[111738]: pgmap v1319: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:42.381 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:41 smithi149 ceph-mon[79770]: pgmap v1319: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:43 smithi118 ceph-mon[111738]: pgmap v1320: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:22:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:22:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:22:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:43 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:22:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:43 smithi149 ceph-mon[79770]: pgmap v1320: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:22:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:22:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:22:44.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:43 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:22:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:45 smithi118 ceph-mon[111738]: pgmap v1321: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:46.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:45 smithi149 ceph-mon[79770]: pgmap v1321: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:47 smithi118 ceph-mon[111738]: pgmap v1322: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:47 smithi149 ceph-mon[79770]: pgmap v1322: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:49 smithi118 ceph-mon[111738]: pgmap v1323: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:49 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:22:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:49 smithi149 ceph-mon[79770]: pgmap v1323: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:49 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:22:52.252 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:51 smithi149 ceph-mon[79770]: pgmap v1324: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:51 smithi118 ceph-mon[111738]: pgmap v1324: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:53 smithi118 ceph-mon[111738]: pgmap v1325: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:54.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:53 smithi149 ceph-mon[79770]: pgmap v1325: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:56 smithi118 ceph-mon[111738]: pgmap v1326: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:56 smithi149 ceph-mon[79770]: pgmap v1326: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:22:58 smithi118 ceph-mon[111738]: pgmap v1327: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:22:58 smithi149 ceph-mon[79770]: pgmap v1327: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:00 smithi118 ceph-mon[111738]: pgmap v1328: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:00 smithi149 ceph-mon[79770]: pgmap v1328: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:02 smithi118 ceph-mon[111738]: pgmap v1329: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:02 smithi149 ceph-mon[79770]: pgmap v1329: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:04.209 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:04 smithi118 ceph-mon[111738]: pgmap v1330: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:04.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:04 smithi149 ceph-mon[79770]: pgmap v1330: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:23:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:23:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:06 smithi118 ceph-mon[111738]: pgmap v1331: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:06 smithi149 ceph-mon[79770]: pgmap v1331: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:08 smithi118 ceph-mon[111738]: pgmap v1332: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:08 smithi149 ceph-mon[79770]: pgmap v1332: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:10 smithi118 ceph-mon[111738]: pgmap v1333: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:10 smithi149 ceph-mon[79770]: pgmap v1333: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:12 smithi118 ceph-mon[111738]: pgmap v1334: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:12 smithi149 ceph-mon[79770]: pgmap v1334: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:14 smithi118 ceph-mon[111738]: pgmap v1335: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:14 smithi149 ceph-mon[79770]: pgmap v1335: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:16.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:16 smithi118 ceph-mon[111738]: pgmap v1336: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:16 smithi149 ceph-mon[79770]: pgmap v1336: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:18.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:18 smithi149 ceph-mon[79770]: pgmap v1337: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:18 smithi118 ceph-mon[111738]: pgmap v1337: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:20 smithi118 ceph-mon[111738]: pgmap v1338: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:23:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:20 smithi149 ceph-mon[79770]: pgmap v1338: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:23:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:22 smithi118 ceph-mon[111738]: pgmap v1339: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:22 smithi149 ceph-mon[79770]: pgmap v1339: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:24 smithi118 ceph-mon[111738]: pgmap v1340: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:24 smithi149 ceph-mon[79770]: pgmap v1340: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:26 smithi118 ceph-mon[111738]: pgmap v1341: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:26 smithi149 ceph-mon[79770]: pgmap v1341: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:28.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:28 smithi118 ceph-mon[111738]: pgmap v1342: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:28 smithi149 ceph-mon[79770]: pgmap v1342: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:30 smithi118 ceph-mon[111738]: pgmap v1343: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:30.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:30 smithi149 ceph-mon[79770]: pgmap v1343: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:32.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:32 smithi118 ceph-mon[111738]: pgmap v1344: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:32 smithi149 ceph-mon[79770]: pgmap v1344: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:33.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:33 smithi149 ceph-mon[79770]: pgmap v1345: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:33.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:33 smithi118 ceph-mon[111738]: pgmap v1345: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:35.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:23:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:23:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:36 smithi118 ceph-mon[111738]: pgmap v1346: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:36 smithi149 ceph-mon[79770]: pgmap v1346: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:38 smithi118 ceph-mon[111738]: pgmap v1347: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:38 smithi149 ceph-mon[79770]: pgmap v1347: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:40.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:40 smithi118 ceph-mon[111738]: pgmap v1348: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:40.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:40 smithi149 ceph-mon[79770]: pgmap v1348: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:42 smithi118 ceph-mon[111738]: pgmap v1349: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:42 smithi149 ceph-mon[79770]: pgmap v1349: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:44 smithi118 ceph-mon[111738]: pgmap v1350: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:44 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:23:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:44 smithi149 ceph-mon[79770]: pgmap v1350: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:44 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:23:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:23:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:23:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:23:45.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:23:45.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:23:45.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:23:46.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:46 smithi118 ceph-mon[111738]: pgmap v1351: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:46.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:46 smithi149 ceph-mon[79770]: pgmap v1351: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:48 smithi118 ceph-mon[111738]: pgmap v1352: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:48.358 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:48 smithi149 ceph-mon[79770]: pgmap v1352: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:50 smithi118 ceph-mon[111738]: pgmap v1353: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:50.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:23:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:50 smithi149 ceph-mon[79770]: pgmap v1353: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:23:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:52 smithi118 ceph-mon[111738]: pgmap v1354: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:52.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:52 smithi149 ceph-mon[79770]: pgmap v1354: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:54 smithi118 ceph-mon[111738]: pgmap v1355: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:54.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:54 smithi149 ceph-mon[79770]: pgmap v1355: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:56.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:56 smithi118 ceph-mon[111738]: pgmap v1356: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:56.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:56 smithi149 ceph-mon[79770]: pgmap v1356: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:57.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:23:57 smithi149 ceph-mon[79770]: pgmap v1357: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:57.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:23:57 smithi118 ceph-mon[111738]: pgmap v1357: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:00.259 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:00 smithi118 ceph-mon[111738]: pgmap v1358: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:00 smithi149 ceph-mon[79770]: pgmap v1358: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:02 smithi118 ceph-mon[111738]: pgmap v1359: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:02 smithi149 ceph-mon[79770]: pgmap v1359: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:04 smithi118 ceph-mon[111738]: pgmap v1360: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:04 smithi149 ceph-mon[79770]: pgmap v1360: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:24:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:24:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:06 smithi118 ceph-mon[111738]: pgmap v1361: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:06 smithi149 ceph-mon[79770]: pgmap v1361: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:08 smithi118 ceph-mon[111738]: pgmap v1362: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:08 smithi149 ceph-mon[79770]: pgmap v1362: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:10 smithi118 ceph-mon[111738]: pgmap v1363: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:10 smithi149 ceph-mon[79770]: pgmap v1363: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:12 smithi118 ceph-mon[111738]: pgmap v1364: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:12 smithi149 ceph-mon[79770]: pgmap v1364: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:14 smithi118 ceph-mon[111738]: pgmap v1365: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:14 smithi149 ceph-mon[79770]: pgmap v1365: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:16.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:16 smithi118 ceph-mon[111738]: pgmap v1366: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:16 smithi149 ceph-mon[79770]: pgmap v1366: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:18 smithi118 ceph-mon[111738]: pgmap v1367: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:18 smithi149 ceph-mon[79770]: pgmap v1367: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:20 smithi118 ceph-mon[111738]: pgmap v1368: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:20.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:24:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:20 smithi149 ceph-mon[79770]: pgmap v1368: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:24:22.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:22 smithi118 ceph-mon[111738]: pgmap v1369: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:22.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:22 smithi149 ceph-mon[79770]: pgmap v1369: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:24.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:24 smithi149 ceph-mon[79770]: pgmap v1370: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:24 smithi118 ceph-mon[111738]: pgmap v1370: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:26 smithi118 ceph-mon[111738]: pgmap v1371: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:26 smithi149 ceph-mon[79770]: pgmap v1371: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:28.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:28 smithi118 ceph-mon[111738]: pgmap v1372: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:28 smithi149 ceph-mon[79770]: pgmap v1372: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:30 smithi118 ceph-mon[111738]: pgmap v1373: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:30.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:30 smithi149 ceph-mon[79770]: pgmap v1373: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:32.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:32 smithi118 ceph-mon[111738]: pgmap v1374: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:32 smithi149 ceph-mon[79770]: pgmap v1374: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:34.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:34 smithi118 ceph-mon[111738]: pgmap v1375: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:34.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:34 smithi149 ceph-mon[79770]: pgmap v1375: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:35 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:24:35.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:35 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:24:36.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:36 smithi118 ceph-mon[111738]: pgmap v1376: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:36.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:36 smithi149 ceph-mon[79770]: pgmap v1376: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:38.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:38 smithi118 ceph-mon[111738]: pgmap v1377: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:38.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:38 smithi149 ceph-mon[79770]: pgmap v1377: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:39.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:39 smithi149 ceph-mon[79770]: pgmap v1378: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:39.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:39 smithi118 ceph-mon[111738]: pgmap v1378: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:42.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:42 smithi118 ceph-mon[111738]: pgmap v1379: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:42.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:42 smithi149 ceph-mon[79770]: pgmap v1379: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:44.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:44 smithi118 ceph-mon[111738]: pgmap v1380: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:44.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:44 smithi149 ceph-mon[79770]: pgmap v1380: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:24:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:24:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:24:45.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:45 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:24:45.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:24:45.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:24:45.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:24:45.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:45 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' 2024-09-21T12:24:46.119 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:46 smithi118 ceph-mon[111738]: pgmap v1381: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:46.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:46 smithi149 ceph-mon[79770]: pgmap v1381: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:48.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:48 smithi118 ceph-mon[111738]: pgmap v1382: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:48.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:48 smithi149 ceph-mon[79770]: pgmap v1382: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:50.326 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:50 smithi118 ceph-mon[111738]: pgmap v1383: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:50.327 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:50 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:24:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:50 smithi149 ceph-mon[79770]: pgmap v1383: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:50.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:50 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:24:52.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:52 smithi118 ceph-mon[111738]: pgmap v1384: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:52.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:52 smithi149 ceph-mon[79770]: pgmap v1384: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:54.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:54 smithi118 ceph-mon[111738]: pgmap v1385: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:54.340 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:54 smithi149 ceph-mon[79770]: pgmap v1385: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:56.311 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:56 smithi118 ceph-mon[111738]: pgmap v1386: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:56.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:56 smithi149 ceph-mon[79770]: pgmap v1386: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:58.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:24:58 smithi118 ceph-mon[111738]: pgmap v1387: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:58.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:24:58 smithi149 ceph-mon[79770]: pgmap v1387: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:00.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:00 smithi118 ceph-mon[111738]: pgmap v1388: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:00.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:00 smithi149 ceph-mon[79770]: pgmap v1388: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:02.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:02 smithi118 ceph-mon[111738]: pgmap v1389: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:02.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:02 smithi149 ceph-mon[79770]: pgmap v1389: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:04.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:04 smithi118 ceph-mon[111738]: pgmap v1390: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:04.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:04 smithi149 ceph-mon[79770]: pgmap v1390: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:05.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:05 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:05.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:05 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:06.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:06 smithi118 ceph-mon[111738]: pgmap v1391: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:06.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:06 smithi149 ceph-mon[79770]: pgmap v1391: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:08.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:08 smithi118 ceph-mon[111738]: pgmap v1392: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:08.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:08 smithi149 ceph-mon[79770]: pgmap v1392: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:10.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:10 smithi118 ceph-mon[111738]: pgmap v1393: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:10 smithi149 ceph-mon[79770]: pgmap v1393: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:12.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:12 smithi118 ceph-mon[111738]: pgmap v1394: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:12.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:12 smithi149 ceph-mon[79770]: pgmap v1394: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:14.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:14 smithi118 ceph-mon[111738]: pgmap v1395: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:14.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:14 smithi149 ceph-mon[79770]: pgmap v1395: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:16.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:16 smithi118 ceph-mon[111738]: pgmap v1396: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:16.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:16 smithi149 ceph-mon[79770]: pgmap v1396: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:18.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:18 smithi118 ceph-mon[111738]: pgmap v1397: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:18.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:18 smithi149 ceph-mon[79770]: pgmap v1397: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:20.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:20 smithi149 ceph-mon[79770]: pgmap v1398: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:20.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:20 smithi149 ceph-mon[79770]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:20 smithi118 ceph-mon[111738]: pgmap v1398: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:20.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:20 smithi118 ceph-mon[111738]: from='mgr.14762 172.21.15.118:0/4221827138' entity='mgr.smithi118.djbwyn' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:21.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:21 smithi149 ceph-mon[79770]: pgmap v1399: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:21.574 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:21 smithi118 ceph-mon[111738]: pgmap v1399: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:24.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:24 smithi118 ceph-mon[111738]: pgmap v1400: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:24.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:24 smithi149 ceph-mon[79770]: pgmap v1400: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:26.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:26 smithi118 ceph-mon[111738]: pgmap v1401: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:26.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:26 smithi149 ceph-mon[79770]: pgmap v1401: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:28.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:28 smithi118 ceph-mon[111738]: pgmap v1402: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:28.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:28 smithi149 ceph-mon[79770]: pgmap v1402: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:30.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:30 smithi149 ceph-mon[79770]: pgmap v1403: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:30.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:30 smithi118 ceph-mon[111738]: pgmap v1403: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:32.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:32 smithi118 ceph-mon[111738]: pgmap v1404: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:32.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:32 smithi149 ceph-mon[79770]: pgmap v1404: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:33.780 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-21T12:25:33.780 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T12:25:33.781 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T12:25:33.793 INFO:tasks.cephadm:Teardown begin 2024-09-21T12:25:33.793 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T12:25:33.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:25:33.827 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:25:33.861 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T12:25:33.861 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T12:25:33.885 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T12:25:33.918 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T12:25:33.918 INFO:tasks.cephadm.mon.smithi118:Stopping mon.smithi118... 2024-09-21T12:25:33.918 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118 2024-09-21T12:25:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:33 smithi118 systemd[1]: Stopping Ceph mon.smithi118 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T12:25:34.074 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:34 smithi118 ceph-mon[111738]: pgmap v1405: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:34.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:34 smithi149 ceph-mon[79770]: pgmap v1405: 65 pgs: 65 active+clean; 245 MiB data, 981 MiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:34.523 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:34 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:25:34.224+0000 7fc631aa1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi118 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:25:34.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:34 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118[111731]: 2024-09-21T12:25:34.224+0000 7fc631aa1640 -1 mon.smithi118@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T12:25:34.524 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:34 smithi118 podman[163295]: 2024-09-21 12:25:34.428369561 +0000 UTC m=+0.307316924 container died 68b433ac89c1ace8c4c845401ae542bfef2881fa30bd6e1e165f1a887b952453 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T12:25:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:34 smithi118 podman[163295]: 2024-09-21 12:25:34.941850029 +0000 UTC m=+0.820797391 container cleanup 68b433ac89c1ace8c4c845401ae542bfef2881fa30bd6e1e165f1a887b952453 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T12:25:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:34 smithi118 bash[163295]: ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118 2024-09-21T12:25:35.324 INFO:journalctl@ceph.mon.smithi118.smithi118.stdout:Sep 21 12:25:35 smithi118 podman[163321]: 2024-09-21 12:25:35.160365736 +0000 UTC m=+0.730111576 container remove 68b433ac89c1ace8c4c845401ae542bfef2881fa30bd6e1e165f1a887b952453 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi118, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux ) 2024-09-21T12:25:35.381 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi118.service' 2024-09-21T12:25:35.435 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:25:35.436 INFO:tasks.cephadm.mon.smithi118:Stopped mon.smithi118 2024-09-21T12:25:35.436 INFO:tasks.cephadm.mon.smithi149:Stopping mon.smithi149... 2024-09-21T12:25:35.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi149 2024-09-21T12:25:35.747 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:35 smithi149 systemd[1]: Stopping Ceph mon.smithi149 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T12:25:36.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:35 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149[79766]: 2024-09-21T12:25:35.745+0000 7f0329ea9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi149 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:25:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:35 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149[79766]: 2024-09-21T12:25:35.745+0000 7f0329ea9640 -1 mon.smithi149@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T12:25:36.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:35 smithi149 podman[113695]: 2024-09-21 12:25:35.929821279 +0000 UTC m=+0.294073482 container died 8f06ed02d2f5ed2168554e20887580b2afc6b69ae6d5d5da834135eac2566050 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T12:25:36.673 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:36 smithi149 podman[113695]: 2024-09-21 12:25:36.387467767 +0000 UTC m=+0.751719972 container cleanup 8f06ed02d2f5ed2168554e20887580b2afc6b69ae6d5d5da834135eac2566050 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T12:25:36.673 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 21 12:25:36 smithi149 bash[113695]: ceph-ae037950-780c-11ef-baf6-efdc52797490-mon-smithi149 2024-09-21T12:25:36.817 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@mon.smithi149.service' 2024-09-21T12:25:36.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:25:36.863 INFO:tasks.cephadm.mon.smithi149:Stopped mon.smithi149 2024-09-21T12:25:36.863 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T12:25:36.863 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.0 2024-09-21T12:25:37.173 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:36 smithi118 systemd[1]: Stopping Ceph osd.0 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T12:25:37.574 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:37 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[120855]: 2024-09-21T12:25:37.170+0000 7f91bf0e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:25:37.574 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:37 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[120855]: 2024-09-21T12:25:37.170+0000 7f91bf0e5640 -1 osd.0 82 *** Got signal Terminated *** 2024-09-21T12:25:37.574 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:37 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0[120855]: 2024-09-21T12:25:37.170+0000 7f91bf0e5640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:25:42.824 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:42 smithi118 podman[163428]: 2024-09-21 12:25:42.541954953 +0000 UTC m=+5.490658145 container died cced3491d26011342f82eca04adf5b93902dbd2e7d525c6e3351a9ecbedcc235 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T12:25:43.233 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:42 smithi118 podman[163428]: 2024-09-21 12:25:42.913953351 +0000 UTC m=+5.862656544 container cleanup cced3491d26011342f82eca04adf5b93902dbd2e7d525c6e3351a9ecbedcc235 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:25:43.233 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:42 smithi118 bash[163428]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0 2024-09-21T12:25:43.574 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:43 smithi118 podman[163446]: 2024-09-21 12:25:43.232200879 +0000 UTC m=+0.688672537 container remove cced3491d26011342f82eca04adf5b93902dbd2e7d525c6e3351a9ecbedcc235 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T12:25:43.912 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:43 smithi118 podman[163534]: 2024-09-21 12:25:43.486143548 +0000 UTC m=+0.015917391 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:25:43.913 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:43 smithi118 podman[163534]: 2024-09-21 12:25:43.625190636 +0000 UTC m=+0.154964479 container create 83d892ac37ea1b8ffbcc9635274a90f0a02385597af949660cc7d978b34fb06c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux ) 2024-09-21T12:25:43.913 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:43 smithi118 podman[163534]: 2024-09-21 12:25:43.911793643 +0000 UTC m=+0.441567486 container init 83d892ac37ea1b8ffbcc9635274a90f0a02385597af949660cc7d978b34fb06c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T12:25:44.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:43 smithi118 podman[163534]: 2024-09-21 12:25:43.915425188 +0000 UTC m=+0.445199041 container start 83d892ac37ea1b8ffbcc9635274a90f0a02385597af949660cc7d978b34fb06c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:25:44.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:44 smithi118 podman[163534]: 2024-09-21 12:25:44.011675175 +0000 UTC m=+0.541449040 container attach 83d892ac37ea1b8ffbcc9635274a90f0a02385597af949660cc7d978b34fb06c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:25:44.324 INFO:journalctl@ceph.osd.0.smithi118.stdout:Sep 21 12:25:44 smithi118 podman[163534]: 2024-09-21 12:25:44.104093449 +0000 UTC m=+0.633867298 container died 83d892ac37ea1b8ffbcc9635274a90f0a02385597af949660cc7d978b34fb06c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T12:25:44.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.0.service' 2024-09-21T12:25:44.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:25:44.842 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T12:25:44.843 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T12:25:44.843 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.1 2024-09-21T12:25:45.074 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:44 smithi118 systemd[1]: Stopping Ceph osd.1 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T12:25:45.574 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:45 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[126241]: 2024-09-21T12:25:45.185+0000 7f099b887640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:25:45.574 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:45 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[126241]: 2024-09-21T12:25:45.185+0000 7f099b887640 -1 osd.1 82 *** Got signal Terminated *** 2024-09-21T12:25:45.574 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:45 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1[126241]: 2024-09-21T12:25:45.185+0000 7f099b887640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:25:50.797 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:50 smithi118 podman[163649]: 2024-09-21 12:25:50.532633652 +0000 UTC m=+5.463604917 container died 9548bc632e7c6dfd134f555869667824761c30b21426d8454460107036025a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T12:25:51.064 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:50 smithi118 podman[163649]: 2024-09-21 12:25:50.878369565 +0000 UTC m=+5.809340828 container cleanup 9548bc632e7c6dfd134f555869667824761c30b21426d8454460107036025a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T12:25:51.064 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:50 smithi118 bash[163649]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1 2024-09-21T12:25:51.324 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:51 smithi118 podman[163668]: 2024-09-21 12:25:51.063056335 +0000 UTC m=+0.521933681 container remove 9548bc632e7c6dfd134f555869667824761c30b21426d8454460107036025a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:25:51.752 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:51 smithi118 podman[163755]: 2024-09-21 12:25:51.381790932 +0000 UTC m=+0.016406495 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:25:51.753 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:51 smithi118 podman[163755]: 2024-09-21 12:25:51.52272538 +0000 UTC m=+0.157340970 container create 96daa63555d102d18bc42577a33147c65a93a84f219e820a02c5971b898cd74e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T12:25:51.753 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:51 smithi118 podman[163755]: 2024-09-21 12:25:51.751924893 +0000 UTC m=+0.386540447 container init 96daa63555d102d18bc42577a33147c65a93a84f219e820a02c5971b898cd74e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T12:25:52.074 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:51 smithi118 podman[163755]: 2024-09-21 12:25:51.75524613 +0000 UTC m=+0.389861688 container start 96daa63555d102d18bc42577a33147c65a93a84f219e820a02c5971b898cd74e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T12:25:52.074 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:51 smithi118 podman[163755]: 2024-09-21 12:25:51.841933148 +0000 UTC m=+0.476548709 container attach 96daa63555d102d18bc42577a33147c65a93a84f219e820a02c5971b898cd74e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T12:25:52.074 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 21 12:25:51 smithi118 podman[163755]: 2024-09-21 12:25:51.94994629 +0000 UTC m=+0.584561857 container died 96daa63555d102d18bc42577a33147c65a93a84f219e820a02c5971b898cd74e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T12:25:52.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.1.service' 2024-09-21T12:25:52.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:25:52.638 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T12:25:52.638 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T12:25:52.638 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.2 2024-09-21T12:25:52.967 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:52 smithi118 systemd[1]: Stopping Ceph osd.2 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T12:25:53.324 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:52 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[131450]: 2024-09-21T12:25:52.964+0000 7f08631b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:25:53.324 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:52 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[131450]: 2024-09-21T12:25:52.964+0000 7f08631b7640 -1 osd.2 82 *** Got signal Terminated *** 2024-09-21T12:25:53.324 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:52 smithi118 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2[131450]: 2024-09-21T12:25:52.964+0000 7f08631b7640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:25:58.693 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:58 smithi118 podman[163860]: 2024-09-21 12:25:58.397221755 +0000 UTC m=+5.540868224 container died 41c161aa8867bc83a6af0514b1d843f9958ef4cb115e139df942b00f58593e6c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T12:25:59.074 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:58 smithi118 podman[163860]: 2024-09-21 12:25:58.782239134 +0000 UTC m=+5.925885602 container cleanup 41c161aa8867bc83a6af0514b1d843f9958ef4cb115e139df942b00f58593e6c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:25:59.074 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:58 smithi118 bash[163860]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2 2024-09-21T12:25:59.450 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:59 smithi118 podman[163890]: 2024-09-21 12:25:59.09243405 +0000 UTC m=+0.690638084 container remove 41c161aa8867bc83a6af0514b1d843f9958ef4cb115e139df942b00f58593e6c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T12:25:59.714 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:59 smithi118 podman[163976]: 2024-09-21 12:25:59.352336676 +0000 UTC m=+0.016267872 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:25:59.714 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:59 smithi118 podman[163976]: 2024-09-21 12:25:59.486954518 +0000 UTC m=+0.150885696 container create 4a1a4f043713e7f8089356c95d8f18f371b23f08790dbb7f2f180910d0e9640c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T12:25:59.714 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:59 smithi118 podman[163976]: 2024-09-21 12:25:59.713123919 +0000 UTC m=+0.377055111 container init 4a1a4f043713e7f8089356c95d8f18f371b23f08790dbb7f2f180910d0e9640c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T12:26:00.075 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:59 smithi118 podman[163976]: 2024-09-21 12:25:59.717041302 +0000 UTC m=+0.380972491 container start 4a1a4f043713e7f8089356c95d8f18f371b23f08790dbb7f2f180910d0e9640c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T12:26:00.120 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:59 smithi118 podman[163976]: 2024-09-21 12:25:59.796339442 +0000 UTC m=+0.460270634 container attach 4a1a4f043713e7f8089356c95d8f18f371b23f08790dbb7f2f180910d0e9640c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T12:26:00.121 INFO:journalctl@ceph.osd.2.smithi118.stdout:Sep 21 12:25:59 smithi118 podman[163976]: 2024-09-21 12:25:59.906584103 +0000 UTC m=+0.570515296 container died 4a1a4f043713e7f8089356c95d8f18f371b23f08790dbb7f2f180910d0e9640c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T12:26:00.611 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.2.service' 2024-09-21T12:26:00.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:26:00.652 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T12:26:00.652 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T12:26:00.652 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.3 2024-09-21T12:26:00.949 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:00 smithi149 systemd[1]: Stopping Ceph osd.3 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T12:26:01.449 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:00 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[88162]: 2024-09-21T12:26:00.982+0000 7f039d221640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:26:01.449 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:00 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[88162]: 2024-09-21T12:26:00.982+0000 7f039d221640 -1 osd.3 82 *** Got signal Terminated *** 2024-09-21T12:26:01.450 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:00 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[88162]: 2024-09-21T12:26:00.982+0000 7f039d221640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:26:04.107 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:03 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[88162]: 2024-09-21T12:26:03.783+0000 7f039582e640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.992897+0000 front 2024-09-21T12:25:38.992989+0000 (oldest deadline 2024-09-21T12:26:03.092823+0000) 2024-09-21T12:26:04.107 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:03 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:03.825+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:04.449 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:04 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:04.105+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:05.058 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:04 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[88162]: 2024-09-21T12:26:04.806+0000 7f039582e640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.992897+0000 front 2024-09-21T12:25:38.992989+0000 (oldest deadline 2024-09-21T12:26:03.092823+0000) 2024-09-21T12:26:05.058 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:04 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:04.842+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:05.351 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:05 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:05.057+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:06.199 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:05 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3[88162]: 2024-09-21T12:26:05.837+0000 7f039582e640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.992897+0000 front 2024-09-21T12:25:38.992989+0000 (oldest deadline 2024-09-21T12:26:03.092823+0000) 2024-09-21T12:26:06.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:06 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:06.019+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:06.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:05 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:05.861+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:06.617 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:06 smithi149 podman[113829]: 2024-09-21 12:26:06.308916327 +0000 UTC m=+5.462857729 container died fce4c8099aefa27e7d0a4cf91a85d23ddb9b543e38f78345bace0ea5bb7eaaac (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:26:06.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:06 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:06.814+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:06.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:06 smithi149 podman[113829]: 2024-09-21 12:26:06.715460349 +0000 UTC m=+5.869401754 container cleanup fce4c8099aefa27e7d0a4cf91a85d23ddb9b543e38f78345bace0ea5bb7eaaac (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T12:26:06.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:06 smithi149 bash[113829]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3 2024-09-21T12:26:07.293 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:07 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:07.030+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:07.293 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:06 smithi149 podman[113844]: 2024-09-21 12:26:06.978053159 +0000 UTC m=+0.665505325 container remove fce4c8099aefa27e7d0a4cf91a85d23ddb9b543e38f78345bace0ea5bb7eaaac (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T12:26:07.604 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:07 smithi149 podman[113935]: 2024-09-21 12:26:07.292522052 +0000 UTC m=+0.106054502 container create 523db7bdb5492e0c7cbd8b142bb096b52d740e58404b17ffbd943af0ed5f9f79 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:26:07.604 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:07 smithi149 podman[113935]: 2024-09-21 12:26:07.202518203 +0000 UTC m=+0.016050661 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:26:07.604 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:07 smithi149 podman[113935]: 2024-09-21 12:26:07.511784635 +0000 UTC m=+0.325317086 container init 523db7bdb5492e0c7cbd8b142bb096b52d740e58404b17ffbd943af0ed5f9f79 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T12:26:07.604 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:07 smithi149 podman[113935]: 2024-09-21 12:26:07.515237933 +0000 UTC m=+0.328770385 container start 523db7bdb5492e0c7cbd8b142bb096b52d740e58404b17ffbd943af0ed5f9f79 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T12:26:07.604 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:07 smithi149 podman[113935]: 2024-09-21 12:26:07.603208411 +0000 UTC m=+0.416740874 container attach 523db7bdb5492e0c7cbd8b142bb096b52d740e58404b17ffbd943af0ed5f9f79 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:26:07.950 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 21 12:26:07 smithi149 podman[113935]: 2024-09-21 12:26:07.712141598 +0000 UTC m=+0.525674065 container died 523db7bdb5492e0c7cbd8b142bb096b52d740e58404b17ffbd943af0ed5f9f79 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T12:26:07.950 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:07 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:07.794+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:08.275 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:08 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:08.000+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:08.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.3.service' 2024-09-21T12:26:08.329 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:26:08.329 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T12:26:08.329 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T12:26:08.329 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.4 2024-09-21T12:26:08.584 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:08 smithi149 systemd[1]: Stopping Ceph osd.4 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T12:26:08.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:08 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:08.776+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:08.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:08 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:08.718+0000 7fdaf86ad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:26:08.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:08 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:08.718+0000 7fdaf86ad640 -1 osd.4 82 *** Got signal Terminated *** 2024-09-21T12:26:08.950 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:08 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:08.718+0000 7fdaf86ad640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:26:09.449 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:08 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:08.993+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:09.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:09 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:09.759+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:10.418 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:09 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:09.968+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:11.199 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:11 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:11.012+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:11.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:10 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:10.797+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:12.199 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:11 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:11.986+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:12.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:11 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:11.774+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:12.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:11 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:11.774+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:13.199 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:12.969+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:39.233709+0000 front 2024-09-21T12:25:39.233789+0000 (oldest deadline 2024-09-21T12:26:03.933546+0000) 2024-09-21T12:26:13.200 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4[93042]: 2024-09-21T12:26:12.969+0000 7fdaf4cc2640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.635159+0000 front 2024-09-21T12:25:49.635138+0000 (oldest deadline 2024-09-21T12:26:12.535063+0000) 2024-09-21T12:26:13.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:12.741+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:13.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:12 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:12.741+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:14.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:13 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:13.750+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:14.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:13 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:13.750+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:14.541 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:14 smithi149 podman[114041]: 2024-09-21 12:26:14.258627998 +0000 UTC m=+5.657828805 container died 27363cb204c114cd0bb1d7af3953faca460b141d06da5a8535e9da39339c8efc (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:26:14.800 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:14 smithi149 podman[114041]: 2024-09-21 12:26:14.645728732 +0000 UTC m=+6.044929531 container cleanup 27363cb204c114cd0bb1d7af3953faca460b141d06da5a8535e9da39339c8efc (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T12:26:14.800 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:14 smithi149 bash[114041]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4 2024-09-21T12:26:15.199 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:14 smithi149 podman[114067]: 2024-09-21 12:26:14.928592566 +0000 UTC m=+0.668647384 container remove 27363cb204c114cd0bb1d7af3953faca460b141d06da5a8535e9da39339c8efc (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:26:15.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:14 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:14.798+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:15.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:14 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:14.798+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:15.607 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:15 smithi149 podman[114152]: 2024-09-21 12:26:15.168607071 +0000 UTC m=+0.016271668 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:26:15.608 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:15 smithi149 podman[114152]: 2024-09-21 12:26:15.296066626 +0000 UTC m=+0.143731196 container create 71ff5f904bb4f9f49cd14d3ec22ae7e22e2ab4eaa95d6433974e8f2890ad6f02 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True) 2024-09-21T12:26:15.608 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:15 smithi149 podman[114152]: 2024-09-21 12:26:15.507060608 +0000 UTC m=+0.354725193 container init 71ff5f904bb4f9f49cd14d3ec22ae7e22e2ab4eaa95d6433974e8f2890ad6f02 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:26:15.608 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:15 smithi149 podman[114152]: 2024-09-21 12:26:15.510661762 +0000 UTC m=+0.358326344 container start 71ff5f904bb4f9f49cd14d3ec22ae7e22e2ab4eaa95d6433974e8f2890ad6f02 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T12:26:15.608 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:15 smithi149 podman[114152]: 2024-09-21 12:26:15.606785175 +0000 UTC m=+0.454449746 container attach 71ff5f904bb4f9f49cd14d3ec22ae7e22e2ab4eaa95d6433974e8f2890ad6f02 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T12:26:15.949 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:15 smithi149 podman[114152]: 2024-09-21 12:26:15.707479034 +0000 UTC m=+0.555143623 container died 71ff5f904bb4f9f49cd14d3ec22ae7e22e2ab4eaa95d6433974e8f2890ad6f02 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T12:26:15.950 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:15 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:15.839+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:15.950 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:15 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:15.839+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:16.264 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 21 12:26:16 smithi149 podman[114175]: 2024-09-21 12:26:16.251670585 +0000 UTC m=+0.537589442 container remove 71ff5f904bb4f9f49cd14d3ec22ae7e22e2ab4eaa95d6433974e8f2890ad6f02 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:26:16.269 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.4.service' 2024-09-21T12:26:16.307 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:26:16.307 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T12:26:16.307 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T12:26:16.307 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.5 2024-09-21T12:26:16.631 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:16 smithi149 systemd[1]: Stopping Ceph osd.5 for ae037950-780c-11ef-baf6-efdc52797490... 2024-09-21T12:26:16.631 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:16 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:16.629+0000 7f20ad2e2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:26:16.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:16 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:16.629+0000 7f20ad2e2640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-21T12:26:16.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:16 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:16.629+0000 7f20ad2e2640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:26:16.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:16 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:16.801+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:16.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:16 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:16.801+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:18.199 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:17 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:17.783+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:18.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:17 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:17.783+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:19.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:18 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:18.823+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:19.200 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:18 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:18.823+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:19.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:19 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:19.841+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:19.949 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:19 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:19.841+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:21.199 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:20 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:20.840+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6806 osd.0 since back 2024-09-21T12:25:38.178530+0000 front 2024-09-21T12:25:38.178562+0000 (oldest deadline 2024-09-21T12:26:03.478497+0000) 2024-09-21T12:26:21.199 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:20 smithi149 ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5[97891]: 2024-09-21T12:26:20.840+0000 7f20a98f7640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.118:6814 osd.1 since back 2024-09-21T12:25:49.279595+0000 front 2024-09-21T12:25:49.279611+0000 (oldest deadline 2024-09-21T12:26:10.979598+0000) 2024-09-21T12:26:22.423 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:22 smithi149 podman[114253]: 2024-09-21 12:26:22.158264468 +0000 UTC m=+5.632185830 container died e7036b24824bf2c1405eb2ab1b64709263f5a3cb5320477d28b859bcf11e87d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:26:22.699 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:22 smithi149 podman[114253]: 2024-09-21 12:26:22.512696722 +0000 UTC m=+5.986618075 container cleanup e7036b24824bf2c1405eb2ab1b64709263f5a3cb5320477d28b859bcf11e87d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T12:26:22.699 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:22 smithi149 bash[114253]: ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5 2024-09-21T12:26:23.162 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:22 smithi149 podman[114268]: 2024-09-21 12:26:22.839007611 +0000 UTC m=+0.673735253 container remove e7036b24824bf2c1405eb2ab1b64709263f5a3cb5320477d28b859bcf11e87d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T12:26:23.449 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:23 smithi149 podman[114357]: 2024-09-21 12:26:23.063762628 +0000 UTC m=+0.015922554 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:26:23.450 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:23 smithi149 podman[114357]: 2024-09-21 12:26:23.164719076 +0000 UTC m=+0.116878997 container create 5990b651d502a8c45b17461a96b101a1aace1bb6105554c08d10ec4cc2ecdcb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T12:26:23.450 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:23 smithi149 podman[114357]: 2024-09-21 12:26:23.375757361 +0000 UTC m=+0.327917296 container init 5990b651d502a8c45b17461a96b101a1aace1bb6105554c08d10ec4cc2ecdcb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:26:23.450 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:23 smithi149 podman[114357]: 2024-09-21 12:26:23.379131664 +0000 UTC m=+0.331291585 container start 5990b651d502a8c45b17461a96b101a1aace1bb6105554c08d10ec4cc2ecdcb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T12:26:23.890 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:23 smithi149 podman[114357]: 2024-09-21 12:26:23.450498296 +0000 UTC m=+0.402658231 container attach 5990b651d502a8c45b17461a96b101a1aace1bb6105554c08d10ec4cc2ecdcb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T12:26:23.890 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 21 12:26:23 smithi149 podman[114357]: 2024-09-21 12:26:23.570683148 +0000 UTC m=+0.522843070 container died 5990b651d502a8c45b17461a96b101a1aace1bb6105554c08d10ec4cc2ecdcb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-ae037950-780c-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T12:26:24.170 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae037950-780c-11ef-baf6-efdc52797490@osd.5.service' 2024-09-21T12:26:24.210 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:26:24.210 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T12:26:24.211 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae037950-780c-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T12:26:24.414 INFO:teuthology.orchestra.run.smithi118.stdout:Deleting cluster with fsid: ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T12:26:28.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[78238]: fuse finished with error 0 and tester_r 0 2024-09-21T12:26:46.977 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae037950-780c-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T12:26:47.179 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T12:26:58.727 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:26:58.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:26:58.789 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T12:26:58.791 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913852/remote/smithi118/crash 2024-09-21T12:26:58.792 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash -- . 2024-09-21T12:26:58.830 INFO:teuthology.orchestra.run.smithi118.stderr:tar: /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T12:26:58.830 INFO:teuthology.orchestra.run.smithi118.stderr:tar: Error is not recoverable: exiting now 2024-09-21T12:26:58.832 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913852/remote/smithi149/crash 2024-09-21T12:26:58.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash -- . 2024-09-21T12:26:58.857 INFO:teuthology.orchestra.run.smithi149.stderr:tar: /var/lib/ceph/ae037950-780c-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T12:26:58.857 INFO:teuthology.orchestra.run.smithi149.stderr:tar: Error is not recoverable: exiting now 2024-09-21T12:26:58.858 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T12:26:58.859 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T12:26:58.938 INFO:teuthology.orchestra.run.smithi118.stdout:2024-09-21T11:50:00.000233+0000 mon.smithi118 (mon.0) 513 : cluster [ERR] fs cephfs is offline because no MDS is active for it. 2024-09-21T12:26:58.939 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-21T12:26:58.939 INFO:tasks.cephadm:Compressing logs... 2024-09-21T12:26:58.939 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T12:26:58.942 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T12:26:58.964 INFO:teuthology.orchestra.run.smithi118.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.0.log 2024-09-21T12:26:58.964 INFO:teuthology.orchestra.run.smithi118.stderr:: No such file or directory 2024-09-21T12:26:58.964 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi118.log 2024-09-21T12:26:58.964 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi118.macjke.log 2024-09-21T12:26:58.965 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi118.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.1.log 2024-09-21T12:26:58.965 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi118.macjke.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T12:26:58.965 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T12:26:58.968 INFO:teuthology.orchestra.run.smithi149.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi149.zgoqsi.log 2024-09-21T12:26:58.969 INFO:teuthology.orchestra.run.smithi149.stderr:: No such file or directory 2024-09-21T12:26:58.969 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T12:26:58.969 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi149.zgoqsi.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mgr.smithi149.xjglai.log 2024-09-21T12:26:58.969 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.4.log 2024-09-21T12:26:58.969 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mgr.smithi149.xjglai.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T12:26:58.969 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mon.smithi149.log 2024-09-21T12:26:58.969 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.4.log: /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T12:26:58.971 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.1.log: /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi118.ciljqr.log 2024-09-21T12:26:58.971 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T12:26:58.971 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi118.ciljqr.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.2.log 2024-09-21T12:26:58.971 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.cephadm.log: 86.7% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T12:26:58.971 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.log 2024-09-21T12:26:58.971 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.2.log: 94.5% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi118.log.gz 2024-09-21T12:26:58.971 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mon.smithi118.log 2024-09-21T12:26:58.971 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mon.smithi149.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.5.log 2024-09-21T12:26:58.972 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.log 2024-09-21T12:26:58.972 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.5.log: 85.2% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T12:26:58.972 INFO:teuthology.orchestra.run.smithi149.stderr: 91.5% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T12:26:58.973 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.log: 91.4% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T12:26:58.973 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mgr.smithi118.djbwyn.log 2024-09-21T12:26:58.975 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mon.smithi118.log: 89.6% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T12:26:58.976 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T12:26:58.988 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi149.qzbfns.log 2024-09-21T12:26:58.988 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi149.log 2024-09-21T12:26:58.990 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mgr.smithi118.djbwyn.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T12:26:58.990 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi149.qzbfns.log: 89.6% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T12:26:58.993 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.3.log 2024-09-21T12:26:58.993 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi149.log: 93.6% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi149.zgoqsi.log.gz 2024-09-21T12:26:58.993 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-21T12:26:58.993 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.3.log: 91.3% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T12:26:58.994 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.log: 91.4% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T12:26:58.995 INFO:teuthology.orchestra.run.smithi149.stderr: 94.6% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi149.log.gz 2024-09-21T12:26:58.999 INFO:teuthology.orchestra.run.smithi149.stderr: 94.9% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi149.qzbfns.log.gz 2024-09-21T12:26:59.008 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T12:26:59.011 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T12:26:59.020 INFO:teuthology.orchestra.run.smithi149.stderr: 90.1% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mgr.smithi149.xjglai.log.gz 2024-09-21T12:26:59.038 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T12:26:59.059 INFO:teuthology.orchestra.run.smithi118.stderr: 93.6% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi118.macjke.log.gz 2024-09-21T12:26:59.616 INFO:teuthology.orchestra.run.smithi118.stderr: 90.1% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mgr.smithi118.djbwyn.log.gz 2024-09-21T12:26:59.675 INFO:teuthology.orchestra.run.smithi149.stderr: 92.5% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mon.smithi149.log.gz 2024-09-21T12:27:00.840 INFO:teuthology.orchestra.run.smithi118.stderr: 89.8% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mon.smithi118.log.gz 2024-09-21T12:27:03.045 INFO:teuthology.orchestra.run.smithi149.stderr: 93.7% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.4.log.gz 2024-09-21T12:27:04.270 INFO:teuthology.orchestra.run.smithi118.stderr: 93.7% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.0.log.gz 2024-09-21T12:27:04.272 INFO:teuthology.orchestra.run.smithi149.stderr: 93.8% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.5.log.gz 2024-09-21T12:27:04.866 INFO:teuthology.orchestra.run.smithi118.stderr: 93.7% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.2.log.gz 2024-09-21T12:27:04.903 INFO:teuthology.orchestra.run.smithi118.stderr: 93.8% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.1.log.gz 2024-09-21T12:27:05.221 INFO:teuthology.orchestra.run.smithi149.stderr: 93.7% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-osd.3.log.gz 2024-09-21T12:27:12.948 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-21T12:27:12.948 INFO:teuthology.orchestra.run.smithi149.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-21T12:27:12.949 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-09-21T12:27:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m13.993s 2024-09-21T12:27:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m29.407s 2024-09-21T12:27:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m0.957s 2024-09-21T12:27:15.309 INFO:teuthology.orchestra.run.smithi118.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T12:28:41.970 INFO:teuthology.orchestra.run.smithi118.stderr: 92.9% -- replaced with /var/log/ceph/ae037950-780c-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi118.ciljqr.log.gz 2024-09-21T12:28:41.972 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T12:28:41.972 INFO:teuthology.orchestra.run.smithi118.stderr:real 1m43.018s 2024-09-21T12:28:41.972 INFO:teuthology.orchestra.run.smithi118.stderr:user 2m14.393s 2024-09-21T12:28:41.972 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m4.396s 2024-09-21T12:28:41.972 INFO:tasks.cephadm:Archiving logs... 2024-09-21T12:28:41.973 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913852/remote/smithi118/log 2024-09-21T12:28:41.974 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T12:29:00.705 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913852/remote/smithi149/log 2024-09-21T12:29:00.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T12:29:04.817 INFO:tasks.cephadm:Removing cluster... 2024-09-21T12:29:04.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae037950-780c-11ef-baf6-efdc52797490 --force 2024-09-21T12:29:05.029 INFO:teuthology.orchestra.run.smithi118.stdout:Deleting cluster with fsid: ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T12:29:05.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae037950-780c-11ef-baf6-efdc52797490 --force 2024-09-21T12:29:05.632 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: ae037950-780c-11ef-baf6-efdc52797490 2024-09-21T12:29:05.906 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T12:29:05.907 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T12:29:05.924 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T12:29:05.940 INFO:tasks.cephadm:Teardown complete 2024-09-21T12:29:05.940 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T12:29:05.951 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T12:29:05.952 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T12:29:05.952 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T12:29:05.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T12:29:06.048 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T12:29:06.058 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T12:29:06.059 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T12:29:06.061 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T12:29:06.073 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-21T12:29:06.076 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-21T12:29:06.078 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T12:29:06.078 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-21T12:29:06.078 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv01.front.sepia.ceph.com 3 7 377 63 -20us[ -28us] +/- 40ms 2024-09-21T12:29:06.078 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 -59us[ -59us] +/- 54ms 2024-09-21T12:29:06.078 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 61 +163us[ +163us] +/- 84ms 2024-09-21T12:29:06.078 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:29:06.080 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T12:29:06.080 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-21T12:29:06.080 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 8 377 188 -33us[ -37us] +/- 38ms 2024-09-21T12:29:06.080 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 56 +12us[ +12us] +/- 54ms 2024-09-21T12:29:06.080 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +97us[ +97us] +/- 84ms 2024-09-21T12:29:06.080 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:29:06.081 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T12:29:06.121 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T12:29:06.122 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T12:29:06.204 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T12:29:06.283 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T12:29:06.356 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T12:29:06.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:29:06.385 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T12:29:06.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:29:06.413 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T12:29:06.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T12:29:06.503 INFO:teuthology.task.internal:Duration was 3982.200025 seconds 2024-09-21T12:29:06.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T12:29:06.537 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T12:29:06.537 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T12:29:06.540 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T12:29:06.576 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T12:29:06.579 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T12:29:06.988 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T12:29:06.988 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T12:29:06.988 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T12:29:07.008 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T12:29:07.008 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T12:29:07.051 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T12:29:07.051 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T12:29:07.054 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T12:29:07.118 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T12:29:07.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T12:29:07.121 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T12:29:08.331 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T12:29:08.349 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T12:29:08.349 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T12:29:08.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T12:29:08.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T12:29:08.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T12:29:08.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T12:29:08.453 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2024-09-21T12:29:08.471 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-09-21T12:29:08.494 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T12:29:08.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:29:08.543 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T12:29:08.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:29:08.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T12:29:08.570 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T12:29:08.571 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913852/remote/smithi118 2024-09-21T12:29:08.571 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T12:29:08.638 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913852/remote/smithi149 2024-09-21T12:29:08.638 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T12:29:08.678 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T12:29:08.678 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T12:29:08.681 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T12:29:08.729 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T12:29:08.742 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T12:29:08.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T12:29:08.772 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T12:29:08.772 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T12:29:08.774 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T12:29:08.787 INFO:teuthology.orchestra.run.smithi118.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 21 12:29 /home/ubuntu/cephtest 2024-09-21T12:29:08.787 INFO:teuthology.orchestra.run.smithi118.stdout: 549196 4 d--------- 2 ubuntu ubuntu 4096 Sep 21 11:36 /home/ubuntu/cephtest/mnt.0 2024-09-21T12:29:08.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:29:08.788 INFO:teuthology.orchestra.run.smithi118.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-21T12:29:08.788 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-21T12:29:08.788 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi118 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-21T12:29:08.789 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T12:29:08.805 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T12:29:08.839 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T12:29:08.842 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 3982.2000246047974 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_gabrioux@teuthology status: fail success: false 2024-09-21T12:29:08.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T12:29:08.939 INFO:teuthology.run:FAIL